[01:24:48] <milimetric>	 greg-g: must've lost the metric somehow, check the end of my link vs. yours.  Also, you can select the metric from the "Add Metric" menu, but there's a bug there now
[01:25:19] <milimetric>	 For totals on pageviews you can search "Totals" or just use this: https://analytics.wikimedia.org/dashboards/vital-signs/#projects=eswiki,itwiki,enwiki,jawiki,dewiki,ruwiki,frwiki,all/metrics=Pageviews
[01:26:43] <milimetric>	 greg-g: you can't get totals for uniques by addition, that's important!  Because people visit multiple sites.
[02:26:42] <neilpquinn>	 greg-g: another place to look (of the many that exist—that's one of the things we have to work on) is https://www.mediawiki.org/wiki/Wikimedia_Product
[02:27:26] <neilpquinn>	 that's where Reading, Editing, and Discovery (and some other departments) post metrics that we do monthly for Wes and the Board. 
[07:10:50] <greg-g>	 neilpquinn: thanks!
[08:47:08] <joal>	 addshore: Hi, in conference now, will be back next week :)
[08:47:16] <addshore>	 joal: okay! :0
[08:47:17] <addshore>	 :)
[08:47:36] <joal>	 Thanks for the testing anyhow ;)
[08:49:52] <addshore>	 joal: well, I found my cheat sheet and actually put it on wikitech ;) https://wikitech.wikimedia.org/wiki/User:Addshore/Oozie
[11:12:04] <elukey>	 https://github.com/yahoo/kafka-manager - this one seems nice!
[11:12:09] <elukey>	 also a bit dangerous
[12:54:29] <jdlrobson>	 is anyone around that understands the EventBus extension? I'm having issues getting setup and could use some help :)
[14:24:26] <grrrit-wm>	 (03CR) 10Ori.livneh: [C: 04-1] "Looks great -- thanks. One small issue." (031 comment) [analytics/statsv] - 10https://gerrit.wikimedia.org/r/321550 (owner: 10Ottomata)
[14:52:00] * elukey sees mforns testing the new alarms and hugs him
[14:52:08] <mforns>	 elukey, hehehe
[14:52:37] <mforns>	 elukey, actually I already tested them, they work well! I'm trying now to attach the error file to the email
[14:54:16] <mforns>	 but oozie is really... aarrgh!
[15:25:51] <elukey>	 ahhaah
[15:49:49] <grrrit-wm>	 (03CR) 10Elukey: Use kafka-python instead of pykafka (031 comment) [analytics/statsv] - 10https://gerrit.wikimedia.org/r/321550 (owner: 10Ottomata)
[15:51:51] <ottomata>	 elukey:  +1, will do that as a different commit
[15:52:58] <elukey>	 thankssss
[15:56:22] <grrrit-wm>	 (03PS1) 10Mforns: Attach error file to webrequest load email [analytics/refinery] - 10https://gerrit.wikimedia.org/r/321676 (https://phabricator.wikimedia.org/T148980) 
[15:57:56] <grrrit-wm>	 (03PS6) 10Mforns: Improve oozie data loss alarms [analytics/refinery] - 10https://gerrit.wikimedia.org/r/319582 (https://phabricator.wikimedia.org/T148980) 
[16:01:24] <nuria>	 milimetric: standduppp
[16:01:29] <milimetric>	 arggh
[16:06:56] <nuria>	 ottomata: yt?
[16:31:10] <grrrit-wm>	 (03PS1) 10Milimetric: Fix semantic dropdown regression [analytics/dashiki] - 10https://gerrit.wikimedia.org/r/321683 (https://phabricator.wikimedia.org/T150664) 
[16:31:26] <grrrit-wm>	 (03CR) 10Milimetric: [C: 032 V: 032] Fix semantic dropdown regression [analytics/dashiki] - 10https://gerrit.wikimedia.org/r/321683 (https://phabricator.wikimedia.org/T150664) (owner: 10Milimetric)
[16:34:01] <grrrit-wm>	 (03PS1) 10Milimetric: Fix metric selector dropdown [analytics/analytics.wikimedia.org] - 10https://gerrit.wikimedia.org/r/321685 (https://phabricator.wikimedia.org/T150664) 
[16:34:13] <grrrit-wm>	 (03CR) 10Milimetric: [C: 032 V: 032] Fix metric selector dropdown [analytics/analytics.wikimedia.org] - 10https://gerrit.wikimedia.org/r/321685 (https://phabricator.wikimedia.org/T150664) (owner: 10Milimetric)
[16:37:51] <milimetric>	 ottomata: someone else doesn't have access to piwik, I want to check if they're in wmf/nda, how would I do that?
[16:50:00] <ottomata>	 milimetric:  hm
[16:50:05] <ottomata>	 https://wikitech.wikimedia.org/wiki/Ops_Clinic_Duty#LDAP_group_changes
[16:50:07] <ottomata>	 not sure if you an though
[16:50:53] <milimetric>	 what's the labs ldap server?
[16:50:57] <milimetric>	 and wouldn't this be in prod?
[16:52:07] <ottomata>	 yes, i don't totally know, i think ummm, i thikn i can run on  labcontrol1001
[16:52:12] <ottomata>	 and, ldap is shared by labs and prod
[16:52:13] <ottomata>	 so it is in prod
[16:52:14] <ottomata>	 but yeah
[16:52:37] <ottomata>	 milimetric:  what account do you want ot check?
[17:02:24] <bd808>	 ottomata: is https://gerrit.wikimedia.org/r/#/c/321675 ready to merge? I can give you a rubber stamp +2 if you'd like
[17:02:58] <ottomata>	 bd808:  yup
[17:03:05] <ottomata>	 its safe and good and shoudla been in there to begin with
[17:03:06] <ottomata>	 thanks
[17:10:42] <elukey>	 quote of the day
[17:10:48] <elukey>	 "Data is the new bacon" - Cloudera
[17:16:12] <grrrit-wm>	 (03CR) 10Elukey: [C: 031] "I like it! Not super expert with the Hive SQL but everything looks good. Thanks!" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/319582 (https://phabricator.wikimedia.org/T148980) (owner: 10Mforns)
[17:16:56] <mforns>	 elukey, thanks! still have to change the email text a bit
[17:17:25] <elukey>	 sure, but from now on is a +1 :)
[17:38:14] <grrrit-wm>	 (03PS7) 10Mforns: Improve oozie data loss alarms [analytics/refinery] - 10https://gerrit.wikimedia.org/r/319582 (https://phabricator.wikimedia.org/T148980) 
[17:39:03] <grrrit-wm>	 (03CR) 10Mforns: "Ok, I tested that and I think it's ready to merge :]" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/319582 (https://phabricator.wikimedia.org/T148980) (owner: 10Mforns)
[17:39:23] <grrrit-wm>	 (03PS8) 10Mforns: Improve oozie data loss alarms [analytics/refinery] - 10https://gerrit.wikimedia.org/r/319582 (https://phabricator.wikimedia.org/T148980) 
[17:40:35] <grrrit-wm>	 (03PS9) 10Mforns: Improve oozie data loss alarms [analytics/refinery] - 10https://gerrit.wikimedia.org/r/319582 (https://phabricator.wikimedia.org/T148980) 
[17:42:32] <grrrit-wm>	 (03PS2) 10Mforns: Attach error file to webrequest load email [analytics/refinery] - 10https://gerrit.wikimedia.org/r/321676 (https://phabricator.wikimedia.org/T148980) 
[17:43:21] <grrrit-wm>	 (03PS10) 10Mforns: Improve oozie data loss alarms [analytics/refinery] - 10https://gerrit.wikimedia.org/r/319582 (https://phabricator.wikimedia.org/T148980) 
[18:48:33] <HaeB>	 neilpquinn: made some slight corrections to the recent additions: https://meta.wikimedia.org/w/index.php?title=Research:Page_view&action=history
[18:56:26] <elukey>	 ottomata: have you ever seen https://github.com/yahoo/kafka-manager ?
[18:56:54] <ottomata>	 i have not!
[18:57:44] <elukey>	 it seems cooool
[18:57:49] <elukey>	 but also dangerous :P
[18:58:13] <ottomata>	 yeah, would be nice to be able to look at that stuff
[18:58:22] <ottomata>	 and edit partition assignments oh man
[18:58:24] <ottomata>	 that would be nice
[18:58:27] <ottomata>	 that is such a pain
[18:58:30] <ottomata>	 to do manually right now
[18:59:39] <elukey>	 the uber guys have also tons of stuff kafka-related
[18:59:50] <elukey>	 basically it is a tier1 service for them
[19:00:03] <elukey>	 they have their version of mirror maker (IIRC you checked that right?)
[19:00:20] <elukey>	 and they are going to open source a tool to also do partition rebalancing
[19:02:51] <wikibugs>	 06Analytics-Kanban: Ongoing: Give me permissions in LDAP - https://phabricator.wikimedia.org/T150790#2796693 (10Milimetric)
[19:05:13] <ottomata>	 hmm, don't think i've looked at this elukey!
[19:05:27] <wikibugs>	 06Analytics-Kanban: Ongoing: Give me permissions in LDAP - https://phabricator.wikimedia.org/T150790#2796719 (10elukey)
[19:05:28] <ottomata>	 elukey:  you learning about this at confernce?
[19:06:05] <elukey>	 yes!
[19:06:18] <elukey>	 ottomata: https://eng.uber.com/ureplicator/
[19:07:17] <elukey>	 they also have a HTTP rest api in front of kafka brokers to be more agile in adding clients
[19:07:27] <elukey>	 that need to talk HTTP and not kafka protocol
[19:07:58] <elukey>	 plus their app is very clever about what to send home in case of failures (discard logging for example)
[19:08:13] <elukey>	 I haven't got the time to ask them few questions 
[19:08:21] <elukey>	 but it might be good to check with them in the future
[19:08:32] <wikibugs>	 06Analytics-Kanban: Ongoing: Give me permissions in LDAP - https://phabricator.wikimedia.org/T150790#2796726 (10Milimetric)
[19:09:28] <wikibugs>	 06Analytics-Kanban: Ongoing: Give me permissions in LDAP - https://phabricator.wikimedia.org/T150790#2796693 (10Abit) Can you please add me to the WMF group?  I need it to see some stuff on piwik.
[19:11:50] <elukey>	 team going afk, I think I am the only one here at apache con :P
[19:11:54] <elukey>	 everybody left
[19:13:49] <travis-ci>	 wikimedia/mediawiki-extensions-EventLogging#618 (wmf/1.29.0-wmf.3 - 41f8b94 : Chad Horohoe): The build has errored.
[19:13:49] <travis-ci>	 Change view : https://github.com/wikimedia/mediawiki-extensions-EventLogging/compare/wmf/1.29.0-wmf.3
[19:13:49] <travis-ci>	 Build details : https://travis-ci.org/wikimedia/mediawiki-extensions-EventLogging/builds/176145612
[19:17:59] <ottomata>	 elukey:  later! sorry!  yeah, let's talk about this, looks tied to helix?  dunno.  cool though!
[19:39:00] <grrrit-wm>	 (03CR) 10Nuria: Attach error file to webrequest load email (031 comment) [analytics/refinery] - 10https://gerrit.wikimedia.org/r/321676 (https://phabricator.wikimedia.org/T148980) (owner: 10Mforns)
[20:03:36] <nuria>	 ottomata: please let me know if this makes sense: https://gerrit.wikimedia.org/r/#/c/321676/ metrics that are not numbers or strings will be 'silently' dropped
[20:10:07] <grrrit-wm>	 (03CR) 10Nuria: "Tested fixed on local chrome. Deploying to analytics domain" [analytics/dashiki] - 10https://gerrit.wikimedia.org/r/321683 (https://phabricator.wikimedia.org/T150664) (owner: 10Milimetric)
[20:10:35] <milimetric>	 nuria: I already deployed
[20:10:42] <nuria>	 milimetric: ah sorry
[20:10:43] <milimetric>	 and moved it to done
[20:10:51] <nuria>	 milimetric: i should have chacked!
[20:10:54] <nuria>	 *checked
[20:10:55] <milimetric>	 sorry to skip process, it was a one line of css not affecting other layouts
[20:11:37] <nuria>	 ok, i just wanted to test fix 
[20:11:48] <nuria>	 thanks, I can see it is fixed on prod
[20:12:28] <milimetric>	 yep, though I still have to do Ctrl+R in Chrome, it caches the html for a day due to the cache headers, that's kind of annoying
[20:12:40] <milimetric>	 I think maybe we shouldn't cache html 'cause that's really lightweight anyway
[20:14:14] <grrrit-wm>	 (03CR) 10Mforns: Attach error file to webrequest load email (031 comment) [analytics/refinery] - 10https://gerrit.wikimedia.org/r/321676 (https://phabricator.wikimedia.org/T148980) (owner: 10Mforns)
[20:15:13] <ottomata>	 nuria:  is that the correct link?
[20:15:13] <ottomata>	 :)
[20:15:26] <ottomata>	 you want me to look at node rdkafka statsd, ja?
[20:15:28] <nuria>	 milimetric: nah, i disagree, we cannot send html everytime fresh but If we want smaller caching time we should reduce the cache interval
[20:15:44] <nuria>	 ottomata: ahem ...
[20:15:56] <nuria>	 excuse my sloppinesss
[20:16:07] <ottomata>	 looking, yeah, nuria i think that is correct
[20:16:28] <ottomata>	 can you add some comments as to how report() works?  i.e. why and when we choose to use gauge/set
[20:16:36] <nuria>	 ottomata: of course
[20:16:55] <ottomata>	 coo
[20:16:57] <ottomata>	 looking good!
[20:26:13] <grrrit-wm>	 (03CR) 10Nuria: [C: 032 V: 032] Attach error file to webrequest load email [analytics/refinery] - 10https://gerrit.wikimedia.org/r/321676 (https://phabricator.wikimedia.org/T148980) (owner: 10Mforns)
[20:28:59] <nuria>	 ottomata: ok, how do we go about testing this?
[20:30:00] <ottomata>	 Pchelolo:  we will publish it, let us test it a bit first
[20:30:14] <ottomata>	 nuria: let's write a quick little consumer script that uses this
[20:30:20] <Pchelolo>	 sure ottomata ping me when you have it on npm
[20:30:23] <ottomata>	 k
[20:30:45] <ottomata>	 nuria:  i'll write one real quick...
[20:31:06] <nuria>	 ottomata: but where are we running it ?
[20:31:19] <ottomata>	 just in a script, hmm, kafka401 in analytics project?
[20:32:49] <nuria>	 ottomata: right, but 1)i do not have access to kafka machines  and2) don't we need a node based kafka consumer?
[20:33:07] <ottomata>	 nuria ya will write one real quick using node-rdkafka
[20:33:10] <ottomata>	 you do have access in labs
[20:33:15] <ottomata>	 kafka401.analytics.eqiad.wmflabs
[20:33:19] <nuria>	 ah labs ok
[20:41:25] <nuria>	 ottomata: and the way to move teh code there is scp right?
[20:42:08] <ottomata>	 nuria:  package.json
[20:42:12] <ottomata>	   "name": "node-kafka-statsd",
[20:42:13] <ottomata>	 shoudl be 
[20:42:15] <ottomata>	 node-rdkafka-statsd
[20:42:27] <ottomata>	 nuria:  i'm just editing there, i cloned your repo and checked out your patch
[20:42:32] <ottomata>	 but scp could work too
[20:43:31] <ottomata>	 also
[20:43:36] <ottomata>	 src/rdkafka-statsd.js ddoes not exist
[20:43:43] <ottomata>	 "main": "src/rdkafka-statsd.js",
[20:44:12] <nuria>	 ottomata: corrected both
[20:44:34] <nuria>	 ottomata: did you had to do anything fancy to clone depot ?
[20:45:24] <nuria>	 ottomata: ah nevermindddd
[20:46:34] <nuria>	 ottomata: i had forgotten all my gerrit mojo
[20:47:28] <nuria>	 ok, installing node-rdkafka
[20:47:32] <nuria>	 cc ottomata 
[20:49:09] <ottomata>	 nuria:  aye, got something almost working on kafka401 ~otto/rdkafka-test
[20:49:18] <ottomata>	 trying to remember how to register this callback now
[20:56:08] <ottomata>	 nuria nice!
[20:56:20] <ottomata>	 oh wait hang on
[20:56:21] <nuria>	 ottomata: ahem , i am still trying to consume
[20:56:29] <ottomata>	 saw some stats, they were kafka broker stats though :)
[20:56:36] <ottomata>	 nuria: , batcave?
[20:56:53] <nuria>	 ottomata: i am at the library, give a sec
[20:56:55] <ottomata>	 ok
[20:57:45] <ottomata>	 ha, nuria also, typo at bottom 
[20:57:48] <ottomata>	  /************** Mopdule exports ***********************/
[21:02:20] <nuria>	 ottomata: k, batcave?
[21:02:34] <ottomata>	 ok
[21:07:05] <wikibugs>	 10Analytics, 10ChangeProp, 10Citoid, 10ContentTranslation-CXserver, and 10 others: Node 6 upgrade planning - https://phabricator.wikimedia.org/T149331#2797114 (10GWicke) @akosiaris, thank you for taking care of etherpad!  Overall, the only remaining service that still needs some work is kartotherian, which...
[21:20:59] <wikibugs>	 10Analytics, 06Discovery, 06Discovery-Analysis, 07RfC: RFC: Requirements for analytics stats processor - https://phabricator.wikimedia.org/T150028#2797197 (10debt) We'll take a closer look at this once T148686 is done to determine feasibility.
[22:04:37] <joal>	 Test
[22:04:42] <joal>	 Yay :)