[06:35:49] <wikibugs>	 Analytics, Discovery, EventBus, MediaWiki-General-or-Unknown, and 6 others: Reliable publish / subscribe event bus - https://phabricator.wikimedia.org/T84923#1900332 (JanZerebecki)
[06:36:55] <wikibugs>	 Analytics-Kanban, Discovery, EventBus, MediaWiki-General-or-Unknown, and 7 others: EventBus MVP - https://phabricator.wikimedia.org/T114443#1900334 (JanZerebecki) Will the MVP include being publicly accessible, i.e. anyone on the Internet can run a consumer?
[06:39:05] <wikibugs>	 Analytics-Kanban, Discovery, EventBus, MediaWiki-General-or-Unknown, and 7 others: EventBus MVP - https://phabricator.wikimedia.org/T114443#1900343 (yuvipanda) >>! In T114443#1900334, @JanZerebecki wrote: > Will the MVP include being publicly accessible, i.e. anyone on the Internet can run a consum...
[09:42:59] <wikibugs>	 Analytics-Kanban, DBA, Patch-For-Review: Pending maintenance on the eventlogging databases (db1046, db1047, dbstore1002, other dbstores) - https://phabricator.wikimedia.org/T120187#1900455 (jcrespo) These are the tables pending to be converted. They are a total of 425GB or ~41 hours of conversion (obvi...
[10:41:17] <grrrit-wm>	 (PS9) Addshore: EntityData usage tracking [analytics/limn-wikidata-data] - https://gerrit.wikimedia.org/r/260576
[10:54:18] <mforns>	 hi a-team
[10:54:22] <joal>	 Hi mforns :)
[10:54:31] <mforns>	 hey how are you?
[10:54:54] <joal>	 Good ! Thx :)
[10:54:57] <joal>	 You ?
[10:55:17] <mforns>	 good but running
[10:55:27] <joal>	 I'm happy monday's virus is gone, I should have a healthy christmas :)
[10:55:31] <joal>	 Riiiight :)
[10:55:39] <mforns>	 cool, that's good
[10:58:14] <grrrit-wm>	 (PS10) Addshore: EntityData usage tracking [analytics/limn-wikidata-data] - https://gerrit.wikimedia.org/r/260576
[10:58:42] <grrrit-wm>	 (PS11) Addshore: EntityData usage tracking [analytics/limn-wikidata-data] - https://gerrit.wikimedia.org/r/260576 (https://phabricator.wikimedia.org/T64874)
[10:58:58] <grrrit-wm>	 (CR) Addshore: [C: 2 V: 2] EntityData usage tracking [analytics/limn-wikidata-data] - https://gerrit.wikimedia.org/r/260576 (https://phabricator.wikimedia.org/T64874) (owner: Addshore)
[11:03:18] <grrrit-wm>	 (PS1) Addshore: Report entitydata usage on correct date [analytics/limn-wikidata-data] - https://gerrit.wikimedia.org/r/260739
[11:03:42] <grrrit-wm>	 (CR) jenkins-bot: [V: -1] Report entitydata usage on correct date [analytics/limn-wikidata-data] - https://gerrit.wikimedia.org/r/260739 (owner: Addshore)
[11:05:35] <mforns>	 joal, do you want to talk about spark anon? Maybe pair? Maybe merge codes?
[11:05:45] <joal>	 mforns: Sure !
[11:05:51] <joal>	 Heavily testing currently :)
[11:06:16] <mforns>	 batcave?
[11:06:45] <joal>	 sure ! OMW :)
[11:11:24] <grrrit-wm>	 (PS2) Addshore: Make it easy to run entitydata script for past days [analytics/limn-wikidata-data] - https://gerrit.wikimedia.org/r/260739
[11:11:35] <grrrit-wm>	 (CR) Addshore: [C: 2 V: 2] Make it easy to run entitydata script for past days [analytics/limn-wikidata-data] - https://gerrit.wikimedia.org/r/260739 (owner: Addshore)
[11:13:06] <wikibugs>	 Analytics-Backlog, Analytics-General-or-Unknown, WMDE-Analytics-Engineering, Wikidata, and 2 others: [Story] Statistics for Special:EntityData usage - https://phabricator.wikimedia.org/T64874#1900574 (Addshore) Open>Resolved a:Addshore https://grafana.wikimedia.org/dashboard/db/wikidata-sp...
[11:15:49] <icinga-wm>	 PROBLEM - Analytics Cassanda CQL query interface on aqs1001 is CRITICAL: Connection refused
[11:21:08] <icinga-wm>	 ACKNOWLEDGEMENT - Analytics Cassanda CQL query interface on aqs1001 is CRITICAL: Connection refused Filippo Giunchedi cassandra upgrade/restart in progress
[11:40:29] <icinga-wm>	 RECOVERY - Analytics Cassanda CQL query interface on aqs1001 is OK: TCP OK - 0.000 second response time on port 9042
[11:46:00] <mforns>	 joal, need to brb for 20 mins
[11:46:35] <joal>	 np mforns, getting to somewhere, hopefully will have secured something when you get back :)
[11:50:41] <icinga-wm>	 PROBLEM - Analytics Cassanda CQL query interface on aqs1002 is CRITICAL: Connection refused
[11:53:09] <grrrit-wm>	 (PS1) Addshore: api log scan, only add properties starting with P [analytics/limn-wikidata-data] - https://gerrit.wikimedia.org/r/260744
[11:54:41] <grrrit-wm>	 (CR) Addshore: [C: 2 V: 2] api log scan, only add properties starting with P [analytics/limn-wikidata-data] - https://gerrit.wikimedia.org/r/260744 (owner: Addshore)
[11:58:20] <grrrit-wm>	 (PS1) Addshore: +x wd-analysis/metrics.php [analytics/limn-wikidata-data] - https://gerrit.wikimedia.org/r/260747
[11:58:35] <grrrit-wm>	 (CR) Addshore: [C: 2 V: 2] +x wd-analysis/metrics.php [analytics/limn-wikidata-data] - https://gerrit.wikimedia.org/r/260747 (owner: Addshore)
[12:05:13] <grrrit-wm>	 (PS1) Addshore: apilog scan send getclaims prop metrics again [analytics/limn-wikidata-data] - https://gerrit.wikimedia.org/r/260748
[12:05:30] <grrrit-wm>	 (CR) Addshore: [C: 2 V: 2] apilog scan send getclaims prop metrics again [analytics/limn-wikidata-data] - https://gerrit.wikimedia.org/r/260748 (owner: Addshore)
[12:10:12] <addshore>	 lalallalaaa, and my daily spam is done
[12:10:31] <icinga-wm>	 RECOVERY - Analytics Cassanda CQL query interface on aqs1002 is OK: TCP OK - 0.015 second response time on port 9042
[12:13:58] <joal>	 :) addshore
[12:14:06] <joal>	 You are a regular spammer :)
[12:16:52] <icinga-wm>	 PROBLEM - Analytics Cassanda CQL query interface on aqs1003 is CRITICAL: Connection refused
[12:20:36] <addshore>	 I normally try to do it while others are asleep ;)
[12:21:01] * joal is watching !
[12:21:27] <joal>	 addshore: I'm living in France, so working hours are a bit shifted :)
[12:22:01] <addshore>	 Ahhh! and I am switching between the UK and Germany :)
[12:22:22] <joal>	  right :)
[12:23:33] * joal is trying to imagine a half-british half-german geek :)
[12:24:23] <addshore>	 hah! well, will you be at the dev summit? ;)
[12:24:29] <joal>	 I will :)
[12:24:37] <addshore>	 I'll probably see you there then! ;)
[12:24:41] <joal>	 Indeed !
[12:25:04] <addshore>	 And I can add another wikimedia Frenchman to my list :P
[12:25:08] <joal>	 It will be fun to meet with not-unknown but never met people :)
[12:25:25] <joal>	 You can, I'm undoubtly French :)
[12:25:49] <addshore>	 yup! I think I I need to say hello and thankyou to many of the a-team ;0
[12:25:59] <joal>	 huhuh :)
[12:26:23] <addshore>	 beeen so very helpfull over the last months :DF
[12:27:30] <joal>	 addshore: That's great if we can help :)
[12:30:20] <addshore>	 :D
[12:32:36] <addshore>	 joal: https://grafana.wikimedia.org/dashboard/db/wikidata-special-entitydata ;)
[12:33:04] <joal>	 This is great !
[12:33:30] <joal>	 Data from hive queries ?
[12:33:41] <addshore>	 yup
[12:33:46] <joal>	 awesome :)
[12:34:06] <addshore>	 so currently a cron that runs and parses a hive query every day, shoves it in graphite, and then displayed through grafana
[12:34:36] <joal>	 addshore: We have an example of something similar using spark
[12:35:09] <joal>	 addshore: If needed to be productionnized, we'll probably go for spark + oozie (unfortunately some more work)
[12:35:21] <addshore>	 yup!
[12:35:38] <joal>	 But the grafana is looking great :)
[12:36:03] <addshore>	 after lots of looking and thinking and comparing I think the analytics cluster should get a opentsdb install ;)
[12:36:51] <joal>	 hmmm
[12:37:49] <joal>	 addshore: lot of different technical bricks for similar purposes (openTsdb, influxDb, cyanite for instance)
[12:38:03] <joal>	 addshore: I have no special idea of which should be used :)
[12:38:23] <addshore>	 oooh, not head of cyanite  before *goes to read things*
[12:42:03] <icinga-wm>	 RECOVERY - Analytics Cassanda CQL query interface on aqs1003 is OK: TCP OK - 0.002 second response time on port 9042
[13:06:16] <joal>	 mforns: Are you back ?
[13:06:22] <mforns>	 joal, yes
[13:06:28] <mforns>	 I just found the error I think
[13:07:32] <joal>	 mforns: I have a working example
[13:07:42] <mforns>	 woooohoooo
[13:07:49] <joal>	 YEAH :)
[13:07:55] <mforns>	 batcave?
[13:07:57] <joal>	 sure
[13:08:00] <mforns>	 ok
[14:52:36] <wikibugs>	 Analytics-Backlog: Track pageview stats for outreach.wikimedia.org - https://phabricator.wikimedia.org/T118987#1900916 (TFlanagan-WMF) Thanks, @Nuria. Is the process you mention quick and easy? I'm just thinking ahead if we need to report some pageview numbers for internal or external reporting. I think we'd...
[15:19:40] <wikibugs>	 Analytics-Kanban, Discovery, EventBus, MediaWiki-General-or-Unknown, and 7 others: EventBus MVP - https://phabricator.wikimedia.org/T114443#1900948 (Ottomata) No, consumption is not part of the MVP.  There may be future work to make consumption from Kafka via websockets easy to set up, but we will...
[16:09:17] <mforns>	 joal, I think joal.anon is empty
[16:09:39] <joal>	 mforns: it is, I have deleted the data in order to recreate it, and ran into an issue :(
[16:09:47] <mforns>	 oh ok
[16:09:48] <joal>	 mforns: scuse me :(
[16:09:55] <mforns>	 no problem at all
[16:10:07] <joal>	 Man, I ran into an unexpected stuff
[16:10:19] <mforns>	 within scala-spark?
[16:10:40] <joal>	 parquet from hive to be precise
[16:10:53] <mforns>	 ah
[16:11:20] <mforns>	 but the first time you managed to write the anonymized data into the new table no?
[16:11:25] <joal>	 I hope I have found a way to have working, but man, lost almost an hour
[16:11:35] <joal>	 problem is reading in fact
[16:11:46] <mforns>	 oh
[16:11:53] <joal>	 I created a new table with the data, and oculdn't read it as parwut
[16:11:57] <joal>	 prquet sorry
[16:12:05] <mforns>	 well, an hour is nothing, considering the time we've spent in this task :]
[16:12:12] <mforns>	 I see
[16:12:22] <joal>	 huhuhu
[16:12:22] <joal>	  :)
[16:12:40] <joal>	 currently running a version that seems to wrk
[16:12:47] <joal>	 Wait and see
[16:16:39] <mforns>	 joal, are you running it against ips already?
[16:17:21] <joal>	 mforns: I am trying to
[16:18:01] <mforns>	 but the job that is running is using ips?
[16:18:24] <joal>	 ?
[16:19:05] <mforns>	 I mean if the version that is running now and seems to work is applying the K on distinct ips?
[16:19:19] <joal>	 yes
[16:19:24] <mforns>	 wow
[16:19:26] <mforns>	 ninja
[16:19:30] <joal>	 huhu :)
[16:19:35] <joal>	 Not really ;)
[16:37:38] <ottomata>	 running home, backshortly
[16:39:31] <wikibugs>	 Analytics-Kanban, DBA, Patch-For-Review: Pending maintenance on the eventlogging databases (db1046, db1047, dbstore1002, other dbstores) - https://phabricator.wikimedia.org/T120187#1901065 (Nuria) @jcrespo: I see, what about scheduling an outage monday and Tuesday next week (28 and 29) ?
[16:41:01] <wikibugs>	 Analytics-Kanban, DBA, Patch-For-Review: Pending maintenance on the eventlogging databases (db1046, db1047, dbstore1002, other dbstores) - https://phabricator.wikimedia.org/T120187#1901069 (jcrespo) I'm ok with that.
[16:50:51] <wikibugs>	 Analytics-Backlog, Reading-Infrastructure-Team, Patch-For-Review, User-bd808: Create user defined function to classify network origin of an IP address - https://phabricator.wikimedia.org/T118592#1901084 (bd808) Open>Resolved Function is in /srv/deployment/analytics/refinery/artifacts/refinery-...
[16:50:53] <wikibugs>	 Analytics-Backlog, MediaWiki-API, Reading-Infrastructure-Team, Research-and-Data, and 3 others: Publish detailed Action API request information to Hadoop - https://phabricator.wikimedia.org/T108618#1901086 (bd808)
[17:00:56] <wikibugs>	 Analytics-Kanban, EventBus: LVS/PyBal for eventbus [8 pts] - https://phabricator.wikimedia.org/T122217#1901096 (Ottomata)
[17:24:21] <joal>	 Ah, a-team, forgot to mention in standup : cassandra has been updated by ops
[17:24:39] <joal>	 It went well, the only issue is that since then the response time is really higher
[17:25:09] <joal>	 I'll wait to see if it's realted to some kind of data caching, but if not, we might need to invesdtigatre
[17:25:32] <madhuvishy>	 i was gonna say nice, but now i'm like aaah
[17:25:46] <joal>	 yeah, indeed madhu
[17:34:17] <wikibugs>	 Analytics-Backlog: Spike: Investigate situation of logstash and hadoop logs - https://phabricator.wikimedia.org/T121418#1901217 (Nuria)
[17:36:16] <wikibugs>	 Analytics-Kanban: Communicate the WikimediaBot convention {hawk} [5 pts] - https://phabricator.wikimedia.org/T108599#1901245 (Nuria) We need to:  1) have a half an hour sync up meeting to understand what is the convention 2) document convention on wikitech 3) send e-mail to analytics@ documenting convention
[17:39:39] <wikibugs>	 Analytics-Kanban: Set up piwik on given hardware - https://phabricator.wikimedia.org/T122313#1901257 (Nuria) NEW
[17:40:33] <wikibugs>	 Analytics-Kanban: Set up piwik on given hardware - https://phabricator.wikimedia.org/T122313#1901266 (Nuria) a:Ottomata
[17:43:12] <wikibugs>	 Analytics-Kanban: Set up piwik on given hardware - https://phabricator.wikimedia.org/T122313#1901257 (Nuria) Hardware request for piwiki is here: https://gerrit.wikimedia.org/r/260749
[18:24:35] <wikibugs>	 Analytics-Backlog, Wikipedia-iOS-App-Product-Backlog, Zero, operations, and 3 others: Request one server to suport piwik analytics - https://phabricator.wikimedia.org/T116312#1901384 (Dzahn) Alex installed the OS, i finished it by adding it to puppet.  bohrium.eqiad.wmnet is up and running and has a...
[18:25:46] <wikibugs>	 Analytics-Backlog, Wikipedia-iOS-App-Product-Backlog, Zero, operations, and 3 others: Request one server to suport piwik analytics - https://phabricator.wikimedia.org/T116312#1901394 (Nuria) @Dzahn: Can we reuse analytics-admins?
[18:27:40] <wikibugs>	 Analytics-Backlog, Wikipedia-iOS-App-Product-Backlog, Zero, operations, and 3 others: Request one server to suport piwik analytics - https://phabricator.wikimedia.org/T116312#1901403 (JMinor) Can we also add @BGerstle-WMF to that group? I don't see us accessing the box directly (we'll use the web in...
[18:29:07] <mutante>	 nuria: hi. re: the piwik server, a virtual machine has been created and now we are at the stage where it's about access. the ticket does not say yet which people are going to run it / should have access (and if it means root). could you maybe comment on that?
[18:29:31] <mutante>	 meanwhile i'll create an empty group called "piwik-admins" or so
[18:29:39] <nuria>	 mutante: i just did, i was hoping we could use the analytics-admin group for sudo cc ottomata for thoughts
[18:29:45] <mutante>	 and put it on that box, and then later people just have to be added to the group
[18:30:48] <mutante>	 nuria: gotcha, so the same 2 users already in that? ok
[18:31:19] <mutante>	 is "joal, madhuvishy" = analytics infra team ?
[18:31:36] <nuria>	 mutante: only two? there should be several: mforns, milimetric, nuria,ottomata, madhuvishy and joal
[18:31:45] <mutante>	 members: [joal, madhuvishy]
[18:31:53] <mutante>	 description: Admin access to analytics cluster.
[18:31:59] <madhuvishy>	 mutante: thats the group that give sudo in hdfs
[18:32:02] <ottomata>	 yeah analytics-admins is probably not what you want :)
[18:32:39] <ottomata>	 eventlogging-roots is closest to what you want, probably make a new group
[18:32:45] <ottomata>	 piwik-admins or something
[18:32:45] <mutante>	 cant we just use piwik-admins
[18:32:48] <ottomata>	 is godo mutante
[18:32:48] <ottomata>	 yeah
[18:32:53] <mutante>	 ok
[18:33:10] <nuria>	 mutante: ok, then piwik-admins with mforns, milimetric, nuria,ottomata, madhuvishy and joal
[18:34:24] <mutante>	 ok,i'm adding the group and the access request ticket to put the people in the group
[18:34:45] <nuria>	 mutante: many thanks
[18:36:16] <mutante>	 are they going to need full root?
[18:36:25] <mutante>	 or can we list some commands
[18:36:32] <nuria>	 mutante: full sudo please
[18:36:36] <mutante>	 that changes the group setup
[18:36:40] <mutante>	 and the rules for the access
[18:36:59] <nuria>	 mutante: this is a very low availability system for which we do not want to trouble ops at all
[18:37:43] <mutante>	 ok, i'm asking because access requests for root just have to go to the ops meeting
[18:37:44] <ottomata>	 mutante:  piwik isn't puppetized yet, am looking into it, but its annoying because the only instructions i can find are for web guided gui install
[18:37:47] <ottomata>	 but will get it
[18:37:53] <ottomata>	 mutante:  i think thats fine, there isn't a hurry to get access
[18:38:01] <mutante>	 alright
[18:39:04] <nuria>	 mutante: ok, at least ottomata should have sudo and the rest of us can have lesser permits until ops meeting if that is ok
[18:39:33] <mutante>	 ottomata has root since like now
[18:39:37] <mutante>	 because i just added it to puppet
[18:39:47] <mutante>	 and it setup the standard root users already
[18:40:24] <mutante>	 the others of you could have regular users but could probably not do that much with it
[18:40:50] <mutante>	 ideally we would later list commands like "start/stop/restart the service"
[18:41:08] <nuria>	 mutante: we also need to query db and such
[18:41:08] <mutante>	 that's what we usually do for -admin groups , while -roots groups have ALL ALL
[18:41:14] <ottomata>	 ja i have access
[18:41:17] <mutante>	 cool
[18:41:25] <nuria>	 mutante: ok, however ottomata thinks is best I am ok with
[18:41:26] <ottomata>	 mutante:  i think its ok for them to have sudo all on this box
[18:41:36] <ottomata>	 its a vhost, and i have no experience with this thing, so no idea what commands they'll need to run
[18:43:03] <mutante>	 it's up to you what you want to request, i would just be cautious of multiple users with full root. it usually becomes a manual setup that is diffucult to recreate really quick
[18:44:00] <mutante>	 i also just asked because of the naming of the group
[18:44:11] <mutante>	 -admins vs. -roots vs. -users and stuff
[18:45:35] <mutante>	 ottomata: http://piwik.org/blog/2012/08/get-started-with-piwik-development-with-puppet-and-vagrant/
[18:46:03] <mutante>	 https://github.com/piwik/puppet-piwik
[18:46:14] <mutante>	 maybe we can import that module?
[18:46:32] <mutante>	 bah, talks about outdated :p
[18:46:45] <mutante>	 but here https://github.com/piwik/piwik-dev-environment
[18:48:50] <wikibugs>	 Analytics-Backlog, Wikipedia-iOS-App-Product-Backlog, Zero, operations, and 3 others: Request one server to suport piwik analytics - https://phabricator.wikimedia.org/T116312#1901490 (Dzahn) The analytics-admins group is just 2 people. We briefly talked on IRC and agreed we should create a new admin...
[18:50:09] <ottomata>	 oh! ja
[18:50:13] <ottomata>	 thanks, haven't seen this one
[18:50:25] <ottomata>	 oh i did see this dev-env one
[18:50:30] <ottomata>	 yeah, i will look at the puppet stuff
[18:50:37] <mutante>	 cool
[18:50:42] <mutante>	 how about the db part? do we know yet?
[18:50:48] <ottomata>	 mysql whatever
[18:50:50] <mutante>	 like where is that gonna run
[18:50:52] <ottomata>	 going to just use the maridb module
[18:50:54] <ottomata>	 on the same box
[18:50:55] <mutante>	 on a db server?
[18:51:00] <ottomata>	 no
[18:51:17] <mutante>	 ok, you could also simply request one from jynus
[18:51:27] <mutante>	 and then not worry about runnign it i guess
[18:51:34] <ottomata>	 naw, i mean, mysql is easy enough
[18:51:43] <ottomata>	 this thing is a pretty normal lamp stack kinda thing
[18:51:52] <ottomata>	 (simple mysql :) )
[18:51:59] <mutante>	 yea, but even simpler is not running it :)
[18:52:09] <mutante>	 and use the stable cluster
[18:52:14] <mutante>	 just thoughts
[18:52:18] <mutante>	 not telling you how to do it
[18:56:58] <ottomata>	 yeah except for the idea with this was just a simple one off that ops wouldn't have to deal with i geuss
[18:58:30] <mutante>	 i think more automation = less dealing with it
[19:01:40] <mutante>	 from my experience all the "simple one-offs" became less simple over time and then caused maintenance work because they were one-off
[19:10:57] <ottomata>	 aye, either way mutante, but this was specifically asked for as a one off, if it was somethign else, we probably wouldn't be doing piwik
[19:11:15] <ottomata>	 supposed to be something that if it goes down, its ok, doesn't need to be fixed within any given amount of time
[19:11:20] <ottomata>	 i don't care either way.  man though
[19:11:28] <ottomata>	 it looks as though piwik has no way to easily install via cli
[19:11:35] <ottomata>	 i'm looking for table creation scripts or something
[19:11:46] <ottomata>	 its all within an installation plugin controller gui
[19:18:23] <ottomata>	 nuria:  have you talked with dan about how he set up piwik?
[19:23:39] <wikibugs>	 Analytics-Backlog, Wikipedia-iOS-App-Product-Backlog, Zero, operations, and 3 others: Request one server to suport piwik analytics - https://phabricator.wikimedia.org/T116312#1901584 (Dzahn) Here's the access request ticket to handle the root access: T122325
[19:29:55] <wikibugs>	 Analytics-Backlog, Wikipedia-iOS-App-Product-Backlog, Zero, operations, and 3 others: Request one server to suport piwik analytics - https://phabricator.wikimedia.org/T116312#1901605 (Dzahn) So the server is installed and running and @ottomata has access and the rest of the access is going to be han...
[19:30:51] <wikibugs>	 Analytics-Backlog, Wikipedia-iOS-App-Product-Backlog, iOS-app-v5-production: Support Piwik in production - https://phabricator.wikimedia.org/T116308#1901615 (Dzahn)
[19:30:54] <wikibugs>	 Analytics-Backlog, Wikipedia-iOS-App-Product-Backlog, Zero, operations, and 3 others: Request one server to suport piwik analytics - https://phabricator.wikimedia.org/T116312#1901613 (Dzahn) Open>Resolved please feel free to reopen it if you think something is missing (besides the access for m...
[19:31:07] <wikibugs>	 Analytics-Backlog, Wikipedia-iOS-App-Product-Backlog, Zero, operations, and 2 others: Request one server to suport piwik analytics - https://phabricator.wikimedia.org/T116312#1901617 (Dzahn)
[19:40:29] <wikibugs>	 Analytics-Backlog, Analytics-Cluster: https://yarn.wikimedia.org/cluster/scheduler should be behind ldap - https://phabricator.wikimedia.org/T116192#1901628 (Nuria)
[19:40:56] <wikibugs>	 Analytics-Kanban: Move App session data to 7 day counts - https://phabricator.wikimedia.org/T117637#1901629 (Nuria)
[19:41:26] <wikibugs>	 Analytics-Kanban: Provide weekly app session metrics separately for Android and iOS - https://phabricator.wikimedia.org/T117615#1901632 (Nuria)
[19:42:45] <wikibugs>	 Analytics-Cluster, Analytics-Kanban: Research whether no cookie header numbers improve Last access uniques {bear} [13 pts] - https://phabricator.wikimedia.org/T115350#1901645 (Nuria) a:madhuvishy>None
[19:44:44] <wikibugs>	 Analytics-Kanban, Wikipedia-iOS-App-Product-Backlog, Zero, operations, and 2 others: Request one server to suport piwik analytics - https://phabricator.wikimedia.org/T116312#1746196 (Nuria)
[19:45:03] <wikibugs>	 Analytics-Engineering, operations: kafka broker monitoring broken - https://phabricator.wikimedia.org/T122330#1901648 (Dzahn) NEW
[19:46:04] <wikibugs>	 Analytics-Cluster, Analytics-Kanban: Research whether no cookie header numbers improve Last access uniques {bear} [13 pts] - https://phabricator.wikimedia.org/T115350#1901662 (Nuria) a:Nuria
[19:51:19] <wikibugs>	 Analytics-Backlog, Ops-Access-Requests, operations: add mforns, milimetric, nuria,ottomata, madhuvishy and joal to piwik-roots - https://phabricator.wikimedia.org/T122325#1901690 (Nuria)
[19:52:41] <wikibugs>	 Analytics-EventLogging, Analytics-Kanban, Patch-For-Review: EventLogging Kafka consumer stops consuming after Kafka metadata change. See if upgrade fixes it. {oryx} [13 pts] - https://phabricator.wikimedia.org/T118315#1901696 (Nuria) Open>Resolved
[19:53:00] <wikibugs>	 Analytics-Kanban, EventBus: LVS/PyBal for eventbus [8 pts] - https://phabricator.wikimedia.org/T122217#1901697 (Nuria) Open>Resolved
[19:53:16] <wikibugs>	 Analytics-Kanban: Change e-mail list on oozie communications to e-mail alias {hawk} [1 pts] - https://phabricator.wikimedia.org/T121241#1901698 (Nuria) Open>Resolved
[19:53:37] <wikibugs>	 Analytics-Kanban: Write pageview API blogpost  {melc} [21 pts] - https://phabricator.wikimedia.org/T118471#1901699 (Nuria) Open>Resolved
[19:54:49] <wikibugs>	 Analytics-Kanban, Patch-For-Review, Puppet: Puppet support for multiple Dashiki instances running on one server [8 pts] - https://phabricator.wikimedia.org/T120891#1901703 (Nuria) Open>Resolved
[19:55:17] <wikibugs>	 Analytics-Kanban, DBA: 2 hour outage to update mysql  on EL slaves {oryx} [3 pts] - https://phabricator.wikimedia.org/T121120#1901705 (Nuria)
[19:55:19] <wikibugs>	 Analytics-Kanban, Patch-For-Review: Prepare EL queue sizes for backfilling {oryx} [3 pts] - https://phabricator.wikimedia.org/T121384#1901704 (Nuria) Open>Resolved
[19:57:12] <wikibugs>	 Analytics-Kanban: Quaterly review 2016/01/22 - https://phabricator.wikimedia.org/T120844#1901709 (Nuria)
[19:57:47] <wikibugs>	 Analytics-Kanban: Gather metrics about cluster usage - https://phabricator.wikimedia.org/T121783#1901711 (Nuria)
[19:58:05] <wikibugs>	 Analytics-Kanban: Gather preliminary metrics of Pageview API usage for quaterly review {slug} - https://phabricator.wikimedia.org/T120845#1901712 (Nuria)
[19:58:59] <wikibugs>	 Analytics-Kanban: Gather phabricator metrics for quaterly review - https://phabricator.wikimedia.org/T122333#1901714 (Nuria) NEW
[19:59:48] <wikibugs>	 Analytics-Kanban: Put quaterly review deck together - https://phabricator.wikimedia.org/T122334#1901720 (Nuria) NEW
[20:03:15] <wikibugs>	 Analytics-Engineering, operations: kafka broker monitoring broken - https://phabricator.wikimedia.org/T122330#1901742 (Ottomata) a:Ottomata
[20:04:04] <wikibugs>	 Analytics-Kanban: Quaterly review 2016/01/22 (slides due on 19th) - https://phabricator.wikimedia.org/T120844#1901744 (Nuria)
[20:12:29] <wikibugs>	 Analytics-Kanban: Create fake data for beta AQS deployment - https://phabricator.wikimedia.org/T120841#1901777 (Nuria) >"What we'd need from you guys, @Milimetric / @JAllemandou, is some sample or fake data that we can store into Cassandra there so queries succeed. 10GB of data or less will do."  Can't we get...
[20:18:41] <wikibugs>	 Analytics-Backlog, Analytics-Engineering, operations: kafka broker monitoring broken - https://phabricator.wikimedia.org/T122330#1901787 (Nuria)
[20:19:34] <wikibugs>	 Analytics-Kanban: Create fake data for beta AQS deployment - https://phabricator.wikimedia.org/T120841#1901798 (mobrovac) >>! In T120841#1901777, @Nuria wrote: > Can't we get a snippet of data from production? That should do fine right?  Yup, precisely. It's up to you guys which chunk to use.
[20:38:11] <wikibugs>	 Analytics-Backlog, Analytics-Engineering, operations, Patch-For-Review: kafka broker monitoring broken - https://phabricator.wikimedia.org/T122330#1901864 (Ottomata) Open>Resolved Thanks @dzahn!  I saw those, but hadn't gotten a chance to look into them yet.  This reminded me.  Fixed!
[20:39:27] <wikibugs>	 Analytics-Backlog, Analytics-Engineering, operations, Patch-For-Review: kafka broker monitoring broken - https://phabricator.wikimedia.org/T122330#1901867 (Dzahn) @ottomata wow, that was a really fast fix. thank!
[20:43:57] <wikibugs>	 Analytics-Backlog, Ops-Access-Requests, operations: add mforns, milimetric, nuria,ottomata, madhuvishy and joal to piwik-roots - https://phabricator.wikimedia.org/T122325#1901891 (RobH) I'm on ops clinic duty this week, but since this is a sudo request, it will require the approval of an operations tea...
[20:44:31] <wikibugs>	 Analytics-Backlog, Ops-Access-Requests, operations: add mforns, milimetric, nuria,ottomata, madhuvishy and joal to piwik-roots - https://phabricator.wikimedia.org/T122325#1901893 (RobH) Additionally, all of these users should have previously been setup with shell access.  If any have not, they need to...
[20:48:39] <wikibugs>	 Analytics-Backlog, Wikimedia-Developer-Summit-2016: Developer summit session:  Pageview API  overview - https://phabricator.wikimedia.org/T112956#1901909 (Base) It would be nice if the API was available from api.php on wikis, like the rest of APIs are, instead of that separate place you've got to know of....
[21:00:15] <wikibugs>	 Analytics-Kanban: Set up piwik on given hardware - https://phabricator.wikimedia.org/T122313#1901956 (Ottomata)
[21:00:17] <wikibugs>	 Analytics-Backlog, Wikipedia-iOS-App-Product-Backlog, Patch-For-Review, iOS-app-v5-production: Puppetize Piwik to prepare for production deployment - https://phabricator.wikimedia.org/T103577#1901957 (Ottomata)
[21:05:36] <grrrit-wm>	 (CR) Bearloga: "Going to test it on the cluster per @nuria's request." (2 comments) [analytics/refinery/source] - https://gerrit.wikimedia.org/r/247601 (https://phabricator.wikimedia.org/T115919) (owner: OliverKeyes)
[21:44:20] <grrrit-wm>	 (PS10) Bearloga: Functions for identifying search engines as referers. [analytics/refinery/source] - https://gerrit.wikimedia.org/r/247601 (https://phabricator.wikimedia.org/T115919) (owner: OliverKeyes)
[21:58:03] <grrrit-wm>	 (CR) Bearloga: "Ok, seems to work." [analytics/refinery/source] - https://gerrit.wikimedia.org/r/247601 (https://phabricator.wikimedia.org/T115919) (owner: OliverKeyes)
[22:02:20] <wikibugs>	 Analytics-Backlog, Security, Zero, operations: Purge > 90 days stat1002:/a/squid/archive/sampled - https://phabricator.wikimedia.org/T92342#1902263 (csteipp) >>! In T92342#1127252, @kevinator wrote: > These logs are presently being used for QA tests on the new pageview definition.  That QA should wra...
[22:04:14] <wikibugs>	 Analytics-Backlog, Ops-Access-Requests, operations: add mforns, milimetric, nuria,ottomata, madhuvishy and joal to piwik-roots - https://phabricator.wikimedia.org/T122325#1902277 (akosiaris) This lack some more information. What kind of access is required ? starting/stopping mysql ? apache? seeing logs...
[22:51:57] <wikibugs>	 Analytics-Backlog, Ops-Access-Requests, operations: add mforns, milimetric, nuria,ottomata, madhuvishy and joal to piwik-roots - https://phabricator.wikimedia.org/T122325#1902508 (Nuria) We will need to be able to see logs, do queries and  start an stop the web application at least.
[23:26:12] <grrrit-wm>	 (PS2) Madhuvishy: Initial commit - Setup fabric deployment for wikimetrics [analytics/wikimetrics-deploy] - https://gerrit.wikimedia.org/r/260686
[23:26:55] <grrrit-wm>	 (CR) Madhuvishy: [C: 2 V: 2] "Self merging initial commit" [analytics/wikimetrics-deploy] - https://gerrit.wikimedia.org/r/260686 (owner: Madhuvishy)
[23:40:06] <wikibugs>	 Analytics-Backlog, Wikimedia-Developer-Summit-2016: Developer summit session:  Pageview API  overview - https://phabricator.wikimedia.org/T112956#1902709 (Anomie) >>! In T112956#1901909, @Base wrote: > It would be nice if the API was available from api.php on wikis,  I agree, that would be nice.  > It was...