[08:49:23] <elukey>	 !log stopping oozie and camus as prep-step for Yarn/HDFS master failover (remaining hosts with old openjdk)
[08:49:24] <stashbot>	 Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log
[08:52:46] <elukey>	 no running job anymore from yarn, proceeding :)
[09:05:35] <elukey>	 an1002 is the new master, all daemons restarted (TIL: mapreduce-history-server and httpfs)
[09:05:46] <elukey>	 lsof | grep DEL is awesome
[09:06:07] <elukey>	 waiting 5 mins and then proceeding with 1002
[09:16:17] <elukey>	 !log resumed oozie bundles and camus crontab after maintenance
[09:16:18] <stashbot>	 Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log
[10:02:21] <elukey>	 joal: o/
[10:02:34] <elukey>	 whenever you have time I'd like to discuss a new alarm for us
[10:03:04] <elukey>	 namely too many sequence number drop to zero events for varnishkafka in a certain time span
[10:04:05] <elukey>	 this could be helpful in catching issues with varnish or vk itself that might not be caught by our current alarming
[11:33:54] <elukey>	 mobrovac: hola, not sure where you are in the world now and if you are working but we'd need to restart kafka on kafka100[123] for openjdk upgrades
[11:34:18] <elukey>	 we can do it on Monday if you want
[11:54:26] * elukey lunch!
[12:44:31] <wikibugs_>	 10Analytics-Tech-community-metrics: No korma data updates for last two weeks - https://phabricator.wikimedia.org/T151503#2823231 (10Aklapper) p:05Unbreak!>03High @Lcanasdiaz: [[ https://github.com/Bitergia/mediawiki-identities/ | Owlbot made an update today ]] and http://korma.wmflabs.org/browser/code_contri...
[12:56:11] <wikibugs_>	 10Analytics-Tech-community-metrics: When indexing new users, identify identical email addresses and merge identities accordingly in the DB - https://phabricator.wikimedia.org/T151634#2823252 (10Aklapper)
[12:56:19] <wikibugs>	 10Analytics-Tech-community-metrics: When indexing new users, identify identical email addresses and merge identities accordingly in the DB - https://phabricator.wikimedia.org/T151634#2823252 (10Aklapper) p:05Triage>03Low
[13:11:52] <joal>	 Hi elukey, I'm teaching during the day, will be online this evening
[13:12:19] <joal>	 elukey: about the new alarm, why not, but not sure it should targetted to Analytics (maybe more Traffic?)
[13:12:27] <joal>	 Anyhow, let's discuss later :)
[13:32:28] <mforns>	 hi a-team :]
[13:33:07] <milimetric>	 hey mforns, I think it's just us
[13:33:20] <mforns>	 hi milimetric!
[13:33:33] <elukey>	 nope :)
[13:33:34] <mforns>	 have you been here for a long time?
[13:33:38] <milimetric>	 I am going to grab some breakfast but I was going to review that reportupdater patch
[13:33:40] <mforns>	 oh o/
[13:33:51] <milimetric>	 Oh, Hi Luca! :)
[13:33:51] <mforns>	 ok
[13:33:55] <elukey>	 o/
[13:44:15] <wikibugs>	 10Analytics-Tech-community-metrics: Deployment of IRC panel - https://phabricator.wikimedia.org/T138004#2823308 (10Lcanasdiaz) We're delayed with this deployment. No technical issues so the new ETA is sometime next week. Sorry for the wrong estimation.
[13:46:17] <wikibugs_>	 10Analytics-Tech-community-metrics: No korma data updates for last two weeks - https://phabricator.wikimedia.org/T151503#2823309 (10Lcanasdiaz) Legacy version of the dashboard stopped running and left a .pid file, so the next execution was not able to start. One of our devops found the file, remove it and execut...
[13:46:47] <wikibugs>	 10Analytics-Tech-community-metrics: No korma data updates for last two weeks - https://phabricator.wikimedia.org/T151503#2823310 (10Lcanasdiaz) @Aklapper can we close this issue?
[14:29:47] <wikibugs_>	 10Analytics-Tech-community-metrics, 06Developer-Relations (Oct-Dec-2016): Fix incorrect mailing list activity of AKlapper (=Phabricator) in Technical Community Metrics user data - https://phabricator.wikimedia.org/T132907#2823406 (10Aklapper) Verified: On 2016-11-23, http://korma.wmflabs.org/browser/top-contri...
[14:34:39] <wikibugs_>	 10Analytics-Tech-community-metrics, 06Developer-Relations (Oct-Dec-2016): Fix incorrect mailing list activity of AKlapper (=Phabricator) in Technical Community Metrics user data - https://phabricator.wikimedia.org/T132907#2823409 (10Aklapper) Oh, wait: Korma seems correct now. **Kibana not yet** because https:...
[15:50:26] <milimetric>	 mforns: have you reviewed this reportupdater code?
[15:50:46] <mforns>	 milimetric, I reviewed it in an early stage, but not the latest patch
[15:51:02] <mforns>	 wanna comment on in in da cave?
[15:51:07] <milimetric>	 yeah, let's do that
[15:51:10] <mforns>	 ok
[16:49:36] <elukey>	 mforns,milimetric - https://graphite.wikimedia.org/S/Bz
[16:50:51] <elukey>	 so you can see the datapoints..
[16:52:03] <elukey>	 I think it is something weird with the OneMinuteRate
[16:52:05] <elukey>	 Count looks fine
[16:54:32] <elukey>	 could be https://phabricator.wikimedia.org/T101141 related?
[17:01:16] <milimetric>	 it's something to watch at least, to see if it changes after the restarts
[17:01:19] <milimetric>	 weird
[17:04:10] <elukey>	 the alarms is still there :/
[18:03:22] <mforns>	 elukey, :[
[18:04:44] <grrrit-wm>	 (03CR) 10Milimetric: [C: 04-1] Optionally record data to Graphite (0310 comments) [analytics/reportupdater] - 10https://gerrit.wikimedia.org/r/322365 (https://phabricator.wikimedia.org/T150187) (owner: 10MaxSem) 
[18:06:11] <grrrit-wm>	 (03CR) 10Milimetric: "Yuri and Max: I will try to make these changes now, and submit a new patch. Thanks for getting it started, and let me know if you have ob" [analytics/reportupdater] - 10https://gerrit.wikimedia.org/r/322365 (https://phabricator.wikimedia.org/T150187) (owner: 10MaxSem) 
[18:10:18] <milimetric>	 mforns: how do you test reportupdater?  You run tx?
[18:10:19] <milimetric>	 *tox
[18:10:49] <milimetric>	 my tox is broken...
[18:12:05] <milimetric>	 running nosetests is fine, but I'm just curious
[18:14:32] * elukey goes afk!
[18:14:41] <elukey>	 have a good weekend folks :)
[18:14:58] <milimetric>	 have a good one elukey 
[18:19:02] <mforns>	 bye elukey !
[18:19:09] <mforns>	 milimetric, you can use nosetests
[18:19:48] <mforns>	 milimetric, yes, Antoine added tox for CI, but originally it was by nosetests
[18:21:39] <milimetric>	 right, nosetests works fine, but when I run tox I get pages of nasty red errors
[18:21:53] <milimetric>	 and it always reminds me of "tox"ic... so I never was a fan :)
[18:40:41] <wikibugs_>	 10Analytics-Tech-community-metrics: No korma data updates for last two weeks - https://phabricator.wikimedia.org/T151503#2823659 (10Aklapper) 05Open>03Resolved Yes! Thanks :)
[19:43:17] <mforns>	 milimetric, yt?
[19:43:35] <milimetric>	 hi mforns 
[19:44:26] <mforns>	 hey, I was changing passwords and don't remember... does meta.wikimedia.org use wikitech credentials or another wiki
[19:44:31] <mforns>	 or is it standalone?
[19:44:46] <milimetric>	 mforns: I added a section to office wiki about that! one sec
[19:45:00] <mforns>	 milimetric, I got that!
[19:45:05] <mforns>	 I was following it
[19:45:22] <mforns>	 but says nothing about meta
[19:45:24] <milimetric>	 oh... uh, no, meta and wikitech are different
[19:45:25] <milimetric>	 https://office.wikimedia.org/wiki/Security_Basics#Changing_Passwords_When_Compromised
[19:45:26] <mforns>	 only meta.beta
[19:45:36] <milimetric>	 really?
[19:45:40] <mforns>	 yea
[19:46:06] <milimetric>	 you're right!  Uh... I don't know then, you're right
[19:46:12] <milimetric>	 then... add it when you find out :)
[19:46:55] <mforns>	 sure :]
[20:16:49] <mforns>	 milimetric, added, you also need to change meta, it's standalone together with commons
[20:17:12] <milimetric>	 good to know
[20:52:22] <mforns>	 bye milimetric, have a nice weekend!
[20:52:38] <milimetric>	 you too mforns