[00:06:21] <ottomata>	 madhuvishy:  i am not around, but yes i think you can
[00:09:44] <madhuvishy>	 ottomata: okay thanks :)
[00:24:57] <wikibugs>	 Analytics-Kanban: Archive obsolete schema pages {tick} - https://phabricator.wikimedia.org/T110247#1577978 (madhuvishy) The Schema pages associated with these schemas were deleted in the past (Except Analytics). Marked their status as obsolete in the talk page.
[00:36:32] <wikibugs>	 Analytics-Kanban: {flea} Teaching people to fish - https://phabricator.wikimedia.org/T107955#1577989 (kevinator)
[00:37:58] <wikibugs>	 Analytics-Kanban: {flea} Teaching people to fish - https://phabricator.wikimedia.org/T107955#1508246 (kevinator) an idea was thrown around (and we're not committing to it... it's just an idea): turn this into a KPI: what is the percentage of people that should be trained in this who have been trained.
[00:44:30] <bd808>	 AndyRussG|a-whey, milimetric: https://gerrit.wikimedia.org/r/#/c/234194/ -- not sure how to test live via api.php
[00:45:07] <bd808>	 also you could skip all this mess by just switching to formatversion=2 for your api call
[01:10:36] <AndyRussG>	 bd808: You could try with the same contents as this old verison of the schema: https://meta.wikimedia.org/w/index.php?title=Schema:CentralNoticeBannerHistory&oldid=13172419
[01:11:49] <AndyRussG>	 bd808: ...which gives this output: https://meta.wikimedia.org/w/api.php?action=jsonschema&title=CentralNoticeBannerHistory&revid=13172419
[02:17:52] <wikibugs>	 Analytics-Backlog: Use formatversion=2 API to fetch EventLogging schemas - https://phabricator.wikimedia.org/T110450#1578238 (Milimetric) NEW
[02:19:03] <AndyRussG>	 Hi ottomata! Schema is working now, thanks so much for spotting the API issue :D Quick question: how do I get the now-validated data into mysql? I do "andyrussg@deployment-eventlogging02:/var/log/eventlogging$ sudo mysql -h 127.0.0.1 -p" but I don't see a table for my schema in the log database
[02:26:26] <wikibugs>	 Analytics-Backlog: Allow clicking on links in Dashiki annotations - https://phabricator.wikimedia.org/T110459#1578337 (Milimetric)
[02:27:25] <milimetric>	 AndyRussG: it's possible that mysql filled up the logs again on that machine, lemme check
[02:27:56] <AndyRussG>	 milimetric: cool beans, thanks!
[02:28:18] <milimetric>	 uh... df is taking a really long time to run, me scared
[02:30:34] <AndyRussG>	 ?
[02:30:35] <AndyRussG>	 andyrussg@deployment-eventlogging02:~$ df -h
[02:30:35] <AndyRussG>	 Filesystem                                                 Size  Used Avail Use% Mounted on
[02:30:35] <AndyRussG>	 /dev/vda1                                                  7.6G  5.5G  1.7G  77% /
[02:30:35] <AndyRussG>	 udev                                                       998M   12K  998M   1% /dev
[02:30:36] <AndyRussG>	 tmpfs                                                      401M  300K  401M   1% /run
[02:30:38] <AndyRussG>	 none                                                       5.0M     0  5.0M   0% /run/lock
[02:30:41] <AndyRussG>	 none                                                      1002M     0 1002M   0% /run/shm
[02:30:42] <AndyRussG>	 /dev/vda2                                                  1.9G 1019M  806M  56% /var
[02:30:44] <AndyRussG>	 /dev/mapper/vd-second--local--disk                         8.5G  169M  7.9G   3% /srv
[02:30:47] <AndyRussG>	 labstore.svc.eqiad.wmnet:/project/deployment-prep/project   11T  3.0T  7.9T  28% /data/project
[02:32:06] <milimetric>	 AndyRussG: sorry, no it ran fine, the error is that we haven't deployed the latest code on here or something
[02:32:07] <milimetric>	 TypeError: 'statsd_host' is an invalid keyword argument for this function
[02:32:16] <milimetric>	 that's an arg we added recently
[02:32:30] <milimetric>	 I'll open an issue with the team and we'll look at this tomorrow I think
[02:32:51] <AndyRussG>	 milimetric: OK! yeah many thanks sorry to be pinging about so late ;)
[02:33:59] <AndyRussG>	 Surely not related to the automatic deployments of MW code to the beta cluster, right? I had some issues with that earlier...
[02:34:10] <wikibugs>	 Analytics-Backlog: Beta Cluster Event Logging mysql consumer not working - https://phabricator.wikimedia.org/T110462#1578363 (Milimetric) NEW
[02:34:24] <milimetric>	 AndyRussG: https://phabricator.wikimedia.org/T110462
[02:34:52] <AndyRussG>	 milimetric: cool thanks!
[02:34:55] <milimetric>	 no, it's probably not, it's probably our bad
[02:35:22] <milimetric>	 AndyRussG: no prob, sorry this was such a slow process for you today.  If we somehow don't address it tomorrow, please bug us, but I'll do my best to remember
[02:35:59] <AndyRussG>	 milimetric: ah no, on the contrary, the help has been speedy and incredibly useful, much appreciated
[02:36:57] <AndyRussG>	 The schema issue turned out to be an EL bug related to the new API code.... heh boolean parameters in JSON aren't, or shouldn't be, like URL params....
[02:38:02] <milimetric>	 no, it's because we're using formatversion=1 and Bryan hacked a fix for us to get around the problem that format has rendering JSON
[02:38:12] <milimetric>	 I filed a ticket to switch to formatversion=2
[02:40:38] <AndyRussG>	 mmm right... I mean, I'm pretty sure I came up against exactly the same problem in CentralNotice when the "new" API stuff came out a few months ago
[03:01:32] <wikibugs>	 Analytics-Cluster, operations, Interdatacenter-IPsec: Secure inter-datacenter web request log (Kafka) traffic - https://phabricator.wikimedia.org/T92602#1578528 (BBlack)
[03:02:02] <wikibugs>	 Analytics-Cluster, Traffic, operations, Interdatacenter-IPsec: Secure inter-datacenter web request log (Kafka) traffic - https://phabricator.wikimedia.org/T92602#1115779 (BBlack)
[03:12:21] <wikibugs>	 Analytics-EventLogging, MediaWiki-API, Patch-For-Review: Mediawiki API is returning empty strings for 'required' boolean fields - https://phabricator.wikimedia.org/T97487#1578552 (Legoktm) a:Legoktm>bd808
[05:23:24] <wikibugs>	 Analytics-Backlog: Beta Cluster Event Logging mysql consumer not working - https://phabricator.wikimedia.org/T110462#1578664 (madhuvishy) Is this set up through puppet?
[07:42:10] <wikibugs>	 Analytics-Tech-community-metrics, ECT-August-2015, Patch-For-Review: Fine tune "Code Review overview" metrics page in Korma - https://phabricator.wikimedia.org/T97118#1578915 (Nemo_bis) My proposal doesn't use the word "code review".
[08:35:44] <wikibugs>	 Analytics-Tech-community-metrics, ECT-August-2015, Patch-For-Review: Fine tune "Code Review overview" metrics page in Korma - https://phabricator.wikimedia.org/T97118#1579052 (Aklapper) Yeah. But your proposal cannot be used in other concatenated strings. See the upstream ticket, discuss in the upstrea...
[08:58:52] <wikibugs>	 Analytics-Tech-community-metrics, ECT-August-2015: Remove deprecated repositories from korma.wmflabs.org code review metrics - https://phabricator.wikimedia.org/T101777#1579123 (Dicortazar) Ok, assuming that deprecated repositories are those that are in the database, but not in the list of projects provid...
[09:04:24] <grrrit-wm>	 (CR) Gilles: [C: 2] Add statsvr, a reverse statsv [analytics/statsv] - https://gerrit.wikimedia.org/r/232836 (https://phabricator.wikimedia.org/T109753) (owner: Ori.livneh)
[10:14:45] <wikibugs>	 Analytics-Tech-community-metrics, ECT-August-2015: Remove deprecated repositories from korma.wmflabs.org code review metrics - https://phabricator.wikimedia.org/T101777#1579296 (Aklapper) >>! In T101777#1579123, @Dicortazar wrote: > Ok, assuming that deprecated repositories are those that are in the datab...
[10:40:50] <wikibugs>	 Analytics-Tech-community-metrics: Improve Key performance indicator: code contributors new / gone - https://phabricator.wikimedia.org/T63563#1579356 (Aklapper)
[10:47:07] <wikibugs>	 Analytics-Tech-community-metrics, JavaScript: Failed to load resource: the server responded with a status of 404 (Not Found) - https://phabricator.wikimedia.org/T65061#1579383 (Aklapper) For some of the 404 URLs listed I really wonder where that request is triggered, e.g. for http://korma.wmflabs.org/brow...
[11:10:44] <wikibugs>	 Analytics-Tech-community-metrics, JavaScript: Failed to load resource: the server responded with a status of 404 (Not Found) - https://phabricator.wikimedia.org/T65061#1579448 (Dicortazar) Basically VizGrimoireJS does not control if some JSON files should exist. This only control a subset of them what pro...
[11:39:58] <mforns>	 hi a-team!
[12:04:29] <wikibugs>	 Analytics-Tech-community-metrics, ECT-August-2015: Tech community KPIs for the WMF metrics meeting - https://phabricator.wikimedia.org/T107562#1579585 (Qgil) I have started "moving" content to https://www.mediawiki.org/wiki/Community_metrics#Key_performance_indicators. @aklapper, unless you have a better...
[12:38:00] <wikibugs>	 Analytics-Backlog: Beta Cluster Event Logging mysql consumer not working - https://phabricator.wikimedia.org/T110462#1579665 (Ottomata) Yes, it sounds like beta just needs a deploy.
[12:44:44] <ottomata>	 morning!  joal, all partitions off of an21! :)   i'm going to run a leader election now, wait for things to settle and then take analytics1021 out
[13:16:43] <wikibugs>	 Analytics-Tech-community-metrics: Checking code review metrics for a specific repository may take dozens of clicks - https://phabricator.wikimedia.org/T110520#1579783 (Qgil) NEW
[13:35:26] <wikibugs>	 Analytics-Cluster, Traffic, operations: Secure inter-datacenter web request log (Kafka) traffic - https://phabricator.wikimedia.org/T92602#1579863 (Ottomata) FYI, our Kafka upgrade and expansion is complete.  All Kafka brokers are now Jessie, so I think this can proceed.
[13:39:10] <mforns>	 ottomata, do you have the task from Nick Dawbarn?
[13:39:38] <wikibugs>	 Analytics-Tech-community-metrics: Data in korma project pages has confusing labels, is difficult to understand - https://phabricator.wikimedia.org/T110524#1579875 (Qgil) NEW
[13:39:43] <ottomata>	 yes mforns
[13:39:51] <mforns>	 can I see it?
[13:39:53] <mforns>	 :]
[13:40:13] <ottomata>	 emailed
[13:40:33] <mforns>	 thanks!
[13:59:21] <mforns>	 joal|away, yt?
[14:43:36] <joal|away>	 mforns: debrief in cave?
[14:43:41] <joal|away>	 oops
[14:43:41] <mforns>	 omw
[15:46:42] <wikibugs>	 Analytics-Dashiki, Analytics-Kanban, Browser-Support-Firefox: vital-signs doesn't display pageviews graph in Firefox 41, 42 {crow} [3 pts] - https://phabricator.wikimedia.org/T109693#1580305 (Milimetric) a:Milimetric
[15:53:49] <wikibugs>	 Analytics-Kanban: back up data used to crunch numbers - https://phabricator.wikimedia.org/T110255#1580329 (Milimetric) a:Milimetric>Ottomata
[16:05:39] <ottomata>	 JOAL
[16:05:40] <ottomata>	 BAH
[16:05:42] <ottomata>	 HAHA
[16:06:05] <ottomata>	 joal: kafka1013
[16:06:09] <ottomata>	 Version: 0.8.2.1-2~jessie1
[16:06:15] <ottomata>	 everywhere else
[16:06:15] <ottomata>	 Version: 0.8.2.1-3~jessie1
[16:06:21] <ottomata>	 ITS GOT THE BAD SNAPPY
[16:06:22] <ottomata>	 WHODUNTHAT!?!
[16:09:07] <ottomata>	 ha, may also be why moving parittions took so long
[16:09:12] <ottomata>	 geez
[16:09:42] <wikibugs>	 Analytics-Kanban: Beta Cluster Event Logging mysql consumer not working {oryx} [5 pts] - https://phabricator.wikimedia.org/T110462#1580404 (Milimetric) a:Milimetric
[16:11:01] <joal>	 ottomata: HOW THE FxCK 1
[16:11:25] <joal>	 When did we change kafka1013 ?
[16:14:02] <ottomata>	 i installed jessie on them a while ago, but we installed kafka on those guys on monday via puppet.  i bet i did some experiementation and debugging using 1013 or something, and had installed the old version, and puppet doesn't install new versions automatically
[16:21:10] <ottomata>	 milimetric:  statsd host hiera lgtm, should I merge?
[16:21:42] <milimetric>	 ottomata: sure, I'll make the change on wikitech
[16:21:51] <milimetric>	 (you saw madhu's comment right?
[16:21:59] <milimetric>	 and my update)
[16:22:06] <wikibugs>	 Analytics-Tech-community-metrics, ECT-August-2015: Remove deprecated repositories from korma.wmflabs.org code review metrics - https://phabricator.wikimedia.org/T101777#1580427 (Dicortazar) ok, data are now updated for all of the gerrit repositories.  If there were repositories such as ExternalArticles in...
[16:22:45] <wikibugs>	 Analytics-Tech-community-metrics, ECT-August-2015: Tech community KPIs for the WMF metrics meeting - https://phabricator.wikimedia.org/T107562#1580431 (Dicortazar)
[16:22:48] <wikibugs>	 Analytics-Tech-community-metrics, ECT-August-2015: Remove deprecated repositories from korma.wmflabs.org code review metrics - https://phabricator.wikimedia.org/T101777#1580429 (Dicortazar) Open>Resolved
[16:22:55] <wikibugs>	 Analytics-Tech-community-metrics, ECT-August-2015: Labeling some bots as bots - https://phabricator.wikimedia.org/T110545#1580433 (jgbarah) NEW a:jgbarah
[16:23:24] <milimetric>	 ottomata: hm, what's the statsd host on beta?
[16:24:47] <madhuvishy>	 milimetric: labmon1001.eqiad.wmnet
[16:24:50] <ottomata>	 i thikn
[16:24:50] <ottomata>	 labmon1001.eqiad.wmnet
[16:24:52] <ottomata>	 or hm
[16:24:53] <ottomata>	 no
[16:25:02] <ottomata>	 hm, yeah
[16:25:03] <ottomata>	 i think thats it
[16:25:04] <milimetric>	 :)
[16:25:06] <madhuvishy>	 ottomata: that's the one :)
[16:25:43] <milimetric>	 done: https://wikitech.wikimedia.org/w/index.php?title=Hiera%3ADeployment-prep&type=revision&diff=175270&oldid=173016
[16:29:09] <milimetric>	 so yeah, ottomata, you can merge in my opinion
[16:29:27] <wikibugs>	 Analytics-Tech-community-metrics, Engineering-Community, ECT-August-2015: Automated generation of repositories for Korma - https://phabricator.wikimedia.org/T104845#1580462 (Dicortazar) Some extra steps: - Octopus is now reliable retrieving information from Gerrit - Automator is able to deal with infor...
[16:34:02] <wikibugs>	 Analytics-Tech-community-metrics, ECT-August-2015: Tech community KPIs for the WMF metrics meeting - https://phabricator.wikimedia.org/T107562#1580477 (jgbarah)
[16:34:03] <wikibugs>	 Analytics-Tech-community-metrics, ECT-August-2015: Labeling some bots as bots - https://phabricator.wikimedia.org/T110545#1580475 (jgbarah) Open>Resolved After looking at the available information, the current list of identities labeled as "bot" is:  * l10n-bot, l10n-bot@translatewiki.net * jenkins-...
[16:38:38] <wikibugs>	 Analytics-Tech-community-metrics, ECT-August-2015: Labeling some bots as bots - https://phabricator.wikimedia.org/T110545#1580501 (Legoktm) Resolved>Open https://gerrit.wikimedia.org/r/#/admin/groups/4,members has a list of bots.
[16:38:39] <wikibugs>	 Analytics-Tech-community-metrics, ECT-August-2015: Tech community KPIs for the WMF metrics meeting - https://phabricator.wikimedia.org/T107562#1580503 (Legoktm)
[16:58:17] <wikibugs>	 Analytics-Tech-community-metrics, ECT-August-2015: Exclude third-party / pulled upstream code repositories from metrics - https://phabricator.wikimedia.org/T103984#1580624 (Aklapper) >>! In T103984#1570832, @Qgil wrote: > Varnish [...]  is still scoring 5th in gerrit_review_queue.html  Varnish not listed...
[17:12:03] <wikibugs>	 Analytics-Backlog: Allow clicking on links in Dashiki annotations - https://phabricator.wikimedia.org/T110459#1580684 (Milimetric) p:Triage>Low
[17:12:55] <wikibugs>	 Analytics-Backlog: Puppetize dashiki dashboard deployments - https://phabricator.wikimedia.org/T110351#1580689 (Milimetric) p:Triage>Normal
[17:15:35] <wikibugs>	 Analytics-Backlog, Analytics-Cluster: Create and maintain an Analytics Cluster in Beta Cluster in labs. - https://phabricator.wikimedia.org/T109859#1580710 (Milimetric) p:Triage>Low
[17:16:03] <wikibugs>	 Analytics-Backlog, Analytics-Cluster: Audit kernel version on analytics worker nodes - https://phabricator.wikimedia.org/T109834#1580714 (Milimetric) p:Triage>Normal
[17:16:23] <wikibugs>	 Analytics-Backlog, Analytics-Cluster: Implement better Camus monitoring - https://phabricator.wikimedia.org/T109192#1580718 (Milimetric) p:Triage>Normal
[17:22:39] <wikibugs>	 Analytics-Backlog, Analytics-Dashiki, Editing-Analysis, Research-and-Data, VisualEditor: Start generating a visual editor adoption metric - https://phabricator.wikimedia.org/T109158#1541915 (Milimetric)
[17:27:52] <wikibugs>	 Analytics-Kanban, RESTBase-API: create third RESTBase endpoint [8 pts] {slug} - https://phabricator.wikimedia.org/T107055#1580775 (Milimetric)
[17:27:54] <wikibugs>	 Analytics-Kanban, RESTBase-API: create second RESTBase endpoint [8 pts] {slug} - https://phabricator.wikimedia.org/T107054#1580776 (Milimetric)
[17:27:57] <wikibugs>	 Analytics-Kanban, RESTBase-API: create first RESTBase endpoint [8 pts] {slug} - https://phabricator.wikimedia.org/T107053#1580777 (Milimetric)
[17:29:04] <wikibugs>	 Analytics-Kanban, RESTBase-API: create RESTBase endpoints [21 pts] {slug} - https://phabricator.wikimedia.org/T107053#1580783 (Milimetric)
[17:29:26] <milimetric>	 madhuvishy: I merged that restbase endpoint cluster  of tasks ^
[17:29:34] <milimetric>	 it's still paused / blocked on the conversation with ops
[17:29:43] <milimetric>	 but we decided to do this last time and I forgot
[17:29:52] * milimetric lunching
[17:43:28] <Ironholds>	 hmn. Where's kevin?
[17:45:45] <wikibugs>	 Analytics-Tech-community-metrics, ECT-August-2015: Mysterious repository breakdown(s)/sorting order - https://phabricator.wikimedia.org/T103474#1580861 (Lcanasdiaz) I've been working on this bug the last couple of days. It affects all the lists we offer in the dashboard. The list is ordered with different...
[17:47:34] <wikibugs>	 Analytics-Cluster, operations, ops-eqiad, Patch-For-Review: rack new hadoop worker nodes - https://phabricator.wikimedia.org/T104463#1580863 (Cmjohnson) Received 1 of 2 replacement servers
[18:03:05] <wikibugs>	 Analytics-Tech-community-metrics, ECT-August-2015: "Median time to review for Gerrit Changesets, per month": External vs. WMF/WMDE/etc patch authors - https://phabricator.wikimedia.org/T100189#1580920 (jgbarah) We've removed a bunch of organizations (see below), but I'm going to explain the situation, jus...
[18:07:28] <madhuvishy>	 Ironholds: Engg managers offsite
[18:09:05] <Ironholds>	 madhuvishy, ta
[18:10:02] <ottomata>	 joal: still running camus ( i had forgotten to reenable the cron while I ate lunch :( )
[18:10:06] <ottomata>	 but, am here if you wanna chat
[19:04:58] <joal>	 ottomata: I am there :)
[19:05:13] <joal>	 ottomata: camus still catching back from what the charts tell us
[19:06:24] <ottomata>	 ja
[19:06:26] <ottomata>	 indeed
[19:07:06] <joal>	 Maybe ok to deploy new pageviews even if ?
[19:10:09] <joal>	 ottomata: --^
[19:10:26] <ottomata>	 joal: i think its fine
[19:10:40] <joal>	 let's go then!
[19:22:01] <grrrit-wm>	 (PS1) Joal: Amend changelog before deployment of 0.0.16 [analytics/refinery/source] - https://gerrit.wikimedia.org/r/234351
[19:22:26] <joal>	 ottomata: if you don't mind --^
[19:28:08] <grrrit-wm>	 (CR) Ottomata: [C: 2 V: 2] Amend changelog before deployment of 0.0.16 [analytics/refinery/source] - https://gerrit.wikimedia.org/r/234351 (owner: Joal)
[19:30:47] <ottomata>	 madhuvishy: hiya!
[19:32:03] <ottomata>	 joal: want to opine on some topic names?  I'm getting ready to repuppetize eventlogging with madhu's new changes
[19:32:16] <ottomata>	 this will create new topics
[19:32:36] <joal>	 hm, naming !
[19:35:02] <ottomata>	 so
[19:35:08] <ottomata>	 two things to think about
[19:35:14] <ottomata>	 previously we were doing eventlogging_%(schema)s
[19:35:19] <ottomata>	 which is fine with me.  but also we had
[19:35:27] <ottomata>	 eventlogging-client-side
[19:35:27] <ottomata>	 eventlogging-server-side
[19:35:27] <ottomata>	 eventlogging-all
[19:35:35] <ottomata>	 it is too late for eventlogging-client-side
[19:35:35] <ottomata>	 eventlogging-server-side
[19:35:39] <ottomata>	 those topics already exist :(
[19:35:52] <ottomata>	 because for some unknown reason I did not stop the forwarder on analytisc1010
[19:36:15] <joal>	 hm
[19:36:20] <ottomata>	 but, eventlogging all
[19:36:24] <ottomata>	 we can call eventlogging-mixed
[19:36:25] <ottomata>	 or something
[19:36:33] <ottomata>	 but, i think you wanted to think a little harder about that convention
[19:36:42] <ottomata>	 i had suggested to use underscore for _schema
[19:36:47] <ottomata>	 but hyphen for non schema based
[19:36:52] <ottomata>	 but you said maybe that is too unclear?
[19:37:12] <joal>	 Only question is: do we want to more explicit ?
[19:37:34] <joal>	 If not, hyphen vs. underscore works for me :)
[19:37:42] <ottomata>	 ah, heh
[19:37:43] <ottomata>	 i mean, not sure.
[19:37:50] <ottomata>	 i think eventlogging prefix is good
[19:37:54] <joal>	 sure
[19:38:03] <ottomata>	 how else would you name these?
[19:38:05] <ottomata>	 suggestions?
[19:38:32] <joal>	 hm, eventlogging_sch_<schema_name> ?
[19:38:40] <joal>	 hm, eventlogging_schema_<schema_name> ?
[19:38:53] <joal>	 But it will get very very verbose
[19:38:59] <ottomata>	 yeah, hm. i would rather do something exceptional for the non schema topics
[19:39:02] <ottomata>	 schema topics are the norm
[19:39:30] <joal>	 Yeah, but having eventlogging-server-side  makes the convention existing :0
[19:39:33] <joal>	 :)
[19:39:46] <ottomata>	 ya :(
[19:39:48] <ottomata>	 sorry bout that
[19:39:54] <ottomata>	 but
[19:39:56] <ottomata>	 eventlogging-mixed
[19:39:57] <joal>	 not to worry :)
[19:39:57] <ottomata>	 is different
[19:40:02] <ottomata>	 both -client-side and -server-side are raw.
[19:40:13] <joal>	 maybe eventlogging-raw-mixed ?
[19:40:13] <ottomata>	 eventlogging-mixed is valid non raw
[19:40:16] <joal>	 To make it clear
[19:40:21] <ottomata>	 naw, its not raw
[19:40:31] <joal>	 oh, ok
[19:40:38] <joal>	 makes sense
[19:41:05] <joal>	 eventlogging-validated-mixed
[19:41:06] <joal>	 ?
[19:41:59] <ottomata>	 hm, if we could change the client side one
[19:42:03] <ottomata>	 what woudl we call it?
[19:42:06] <joal>	 yup :)
[19:42:08] <ottomata>	 eventlogging-raw-client-side?
[19:42:12] <ottomata>	 eventlogging-client-side-raw
[19:42:13] <ottomata>	 ?
[19:42:23] <joal>	 eventlogging-raw-client|serverside
[19:42:30] <ottomata>	 you like raw first?
[19:42:30] <ottomata>	 hm.
[19:42:34] <ottomata>	 i gues so
[19:42:40] <joal>	 then eventlogging-validated-mixed
[19:42:44] <ottomata>	 eventlogging-raw
[19:42:44] <ottomata>	 vs
[19:42:44] <ottomata>	 eventloging-valid
[19:42:54] <joal>	 yup
[19:42:57] <joal>	 for instance
[19:42:58] <ottomata>	 eventlogging-valid-mixed
[19:42:59] <ottomata>	 ?
[19:43:27] <ottomata>	 i like that
[19:43:29] <joal>	 hm :)
[19:44:40] <joal>	 But how do we remove that topic then ?
[19:46:01] <ottomata>	 we dont.
[19:46:04] <ottomata>	 we just deal :/
[19:46:06] <ottomata>	 maybe one day we can remove
[19:46:13] <ottomata>	 i was just going to leave the old names
[19:46:17] <ottomata>	 for the two raw topics
[19:46:31] <joal>	 Sounds good to me !
[19:47:39] <joal>	 Let's go this way
[19:50:48] <ottomata>	 ok!
[19:51:01] <joal>	 I think there is nothing better :)
[19:51:07] <joal>	 given what we have !
[20:04:43] <grrrit-wm>	 (CR) Gilles: [V: 2] Add statsvr, a reverse statsv [analytics/statsv] - https://gerrit.wikimedia.org/r/232836 (https://phabricator.wikimedia.org/T109753) (owner: Ori.livneh)
[20:16:22] <wikibugs>	 Analytics-Tech-community-metrics, ECT-August-2015: "Median time to review for Gerrit Changesets, per month": External vs. WMF/WMDE/etc patch authors - https://phabricator.wikimedia.org/T100189#1581570 (Aklapper) >>! In T100189#1580920, @jgbarah wrote: > In your case, it seems that you only want to have so...
[20:18:12] <wikibugs>	 Analytics-Tech-community-metrics, ECT-August-2015: Mysterious repository breakdown(s)/sorting order - https://phabricator.wikimedia.org/T103474#1581597 (Aklapper) a:Dicortazar>Lcanasdiaz
[20:23:12] <wikibugs>	 Analytics-Tech-community-metrics, ECT-August-2015: Labeling some bots (active in Git/Gerrit) as bots - https://phabricator.wikimedia.org/T110545#1581634 (Aklapper)
[20:25:12] <joal>	 !log releasing version 0.0.16 of refinery jars to archiva
[20:33:15] <madhuvishy>	 ottomata: was just reading your puppet code
[20:33:29] <madhuvishy>	 it would be nice to have a number to control the number of consumers
[20:33:44] <madhuvishy>	 rather than manually defining no.. not sure if it's possible
[20:33:48] <madhuvishy>	 but would be awesome
[20:34:43] <ottomata>	 yeah
[20:34:54] <ottomata>	 madhuvishy:  i think we will have to do it via hiera, but it will still be like that
[20:34:59] <ottomata>	 list the names of them.
[20:35:02] <ottomata>	 instead of passing a number
[20:35:04] <ottomata>	 puppet is dumb
[20:35:08] <madhuvishy>	 ottomata: aaah
[20:35:10] <ottomata>	 there is no iteration construct
[20:35:41] <madhuvishy>	 spawn n instances is not a thing huh. sad
[20:36:19] <ottomata>	 naw, kinda lame, i know.  i mean, all this is doing is installing N config files
[20:36:20] <ottomata>	 right?
[20:36:36] <ottomata>	 we made it that way, eventlogging python stuff knows nothing about number instances either
[20:36:40] <ottomata>	 its just N config files
[20:37:37] <ottomata>	 at least i can hack around it by using resource array declaration
[20:37:37] <madhuvishy>	 ottomata: right
[20:37:44] <ottomata>	 if they had different parameters at all
[20:37:45] <ottomata>	 OH
[20:37:46] <ottomata>	 hm.
[20:37:48] <ottomata>	 that's not going to work
[20:37:51] <ottomata>	 i ahve to set sid manually
[20:37:55] <ottomata>	 otherswise it will use name
[20:38:03] <madhuvishy>	 https://gerrit.wikimedia.org/r/#/c/234415/1/manifests/role/eventlogging.pp how does the part on line 317 work
[20:38:39] <ottomata>	 like this:
[20:38:54] <ottomata>	 define afilething ($dir) {
[20:38:54] <ottomata>	 	file { "$dir/$name":
[20:38:54] <ottomata>	 		content => "$name\n",
[20:38:54] <ottomata>	 	}
[20:38:54] <ottomata>	 }
[20:38:55] <ottomata>	 afilething { ['f1', 'f2']:
[20:38:56] <ottomata>	 	dir => '/tmp',
[20:38:56] <ottomata>	 }
[20:39:02] <ottomata>	 that makes
[20:39:05] <ottomata>	  /tmp/f1 and /tmpf2
[20:39:45] <ottomata>	 that's puppet array resource declaration
[20:39:46] <ottomata>	 um
[20:39:49] <ottomata>	 you can do it with native resources too
[20:39:51] <ottomata>	 like
[20:40:03] <ottomata>	 file { '/tmp/f1', '/tmp'f2': content => 'ohboy' }
[20:40:05] <ottomata>	 oops
[20:40:15] <ottomata>	 file { ['/tmp/f1', '/tmp'f2']: content => 'ohboy' }
[20:40:17] <ottomata>	 like that ^
[20:40:22] <madhuvishy>	 aah
[20:41:21] <grrrit-wm>	 (PS1) Joal: Bump jars to 0.0.16 update refine record version [analytics/refinery] - https://gerrit.wikimedia.org/r/234422
[20:41:44] <madhuvishy>	 ottomata: cool. should we merge this yet? I see this is a temp class for testing
[20:41:56] <joal>	 ottomata: another quick review and I'm good to deploy
[20:42:01] <joal>	 Pliz :)
[20:43:04] <grrrit-wm>	 (CR) Ottomata: [C: 2 V: 2] Bump jars to 0.0.16 update refine record version [analytics/refinery] - https://gerrit.wikimedia.org/r/234422 (owner: Joal)
[20:43:46] <joal>	 awesome thx ottomata
[20:46:38] <joal>	 ottomata: I see you have suspended the load bundles
[20:47:08] <ottomata>	 joal!  AHHH
[20:47:10] <ottomata>	 thank you for the reminder
[20:47:11] <ottomata>	 GEEZ
[20:47:12] <joal>	 :)
[20:47:22] <ottomata>	 madhuvishy: let's not merge tonight, i'm heading out soon
[20:47:28] <joal>	 ok, please let me turn this back on
[20:47:28] <ottomata>	 just submitted a nother patch
[20:47:31] <ottomata>	 joal, i think i would have remembered!
[20:47:35] <ottomata>	 was making sure camus was ok
[20:47:36] <joal>	 no bother
[20:47:36] <ottomata>	 meant to tell you
[20:47:37] <madhuvishy>	 ottomata: yeah alright
[20:47:38] <ottomata>	 very sorry
[20:47:43] <joal>	 no prob :)
[20:47:49] <joal>	 Lucky I have deplyed ;)
[20:47:54] <ottomata>	 Hm
[20:47:58] <ottomata>	 i am worried about camus...
[20:48:02] <ottomata>	 i saw it do this before
[20:48:07] <ottomata>	 task error: Error: java.io.IOException: Failed to move from hdfs://analytics-hadoop/wmf/camus/webrequest/2015-08-27-20-46-03/_temporary/1/_temporary/attempt_1434651818028_141747_m_000040_0/data.webrequest_misc.18.3.1440702000000-m-00040 to hdfs://analytics-hadoop/wmf/data/raw/webrequest/webrequest_misc/hourly/2015/08/27/19/webrequest_misc.18.3.175.7913701.1440702000000
[20:48:13] <joal>	 I'll take care of that, ensuring that I restart refine before resuming
[20:48:16] <ottomata>	 it can't move because the file exists
[20:48:32] <ottomata>	 it was doing this earlier today
[20:48:49] <ottomata>	 but i thought it was because I had killed some camus jobs when I was having kafka trouble, and something wierd happened
[20:48:53] <ottomata>	 now its just been camus as usual
[20:48:53] <ottomata>	 hm.
[20:49:50] <joal>	 ottomata: is that error hapenning whule you were restarting kfka1013?
[20:49:57] <ottomata>	 its happening now.
[20:50:01] <joal>	 wow
[20:50:02] <ottomata>	 joal, batcave?
[20:50:04] <joal>	 sure
[20:53:56] <wikibugs>	 Analytics-Backlog, Analytics-Cluster: logrotate camus logs on analytics1027 - https://phabricator.wikimedia.org/T110598#1581799 (Ottomata) NEW a:Ottomata
[21:12:29] <ottomata>	 joal:  application_1434651818028_141693
[21:13:17] <wikibugs>	 Analytics-Backlog: Provide the Wikimedia DE folks with Hive access/training {flea} [8 pts] - https://phabricator.wikimedia.org/T106042#1581932 (Milimetric)
[21:17:31] <wikibugs>	 Analytics-Dashiki, Analytics-Kanban, Browser-Support-Firefox: vital-signs doesn't display pageviews graph in Firefox 41, 42 {crow} [3 pts] - https://phabricator.wikimedia.org/T109693#1581947 (Milimetric) @Nemo_bis, that bug was fixed a while back, can you clear your cache for vital-signs and try again?...
[21:20:35] <wikibugs>	 Analytics-Backlog, Analytics-Dashiki, Editing-Analysis, Research-and-Data, VisualEditor: Start generating a visual editor adoption metric - https://phabricator.wikimedia.org/T109158#1581965 (Milimetric) Dear editing team folks, please chime in with more requirements for this metric.  Dear resear...
[21:33:54] <milimetric>	 AndyRussG: we patched the config for EL and re-deployed
[21:34:09] <milimetric>	 I tried to use your link to test that the events were getting through, but it wasn't generating any events
[21:34:16] <milimetric>	 give it a go and let me know how it goes
[21:34:42] <AndyRussG>	 milimetric: cool! That's OK, it may be a different URL now... in a bit I'll try it!
[21:35:11] <milimetric>	 also, remember that the consumer inserts in batches, so you have to send it one event, then wait 300 seconds and insert another
[21:35:15] <milimetric>	 because of https://github.com/wikimedia/mediawiki-extensions-EventLogging/blob/master/server/eventlogging/handlers.py#L274
[21:35:39] <AndyRussG>	 ok cool, thx!
[21:35:39] <milimetric>	 we should change that setting on labs maybe, or maybe someone else already did and I don't know about it
[21:35:52] <mforns>	 hey team, see you tomorrow! good night
[21:36:15] <milimetric>	 nite everyone
[21:41:58] <joal>	 G'night milimetric
[21:45:01] <wikibugs>	 Analytics-Tech-community-metrics: Key performance indicator: Top contributors - https://phabricator.wikimedia.org/T64221#1582067 (Aklapper) The page seems to have become rather unreliable over the time:  It currently lists only three people, the displayed data (e.g. does "Tickets" use the Maniphest backend f...
[22:44:30] <wikibugs>	 Analytics-Tech-community-metrics, ECT-August-2015: Remove deprecated repositories from korma.wmflabs.org code review metrics - https://phabricator.wikimedia.org/T101777#1582295 (Qgil) I still see ExternalArticles at the top of the list...
[22:52:58] <wikibugs>	 Analytics-EventLogging, Analytics-Kanban: Update Schema Talk pages {tick} [8 pts] - https://phabricator.wikimedia.org/T103133#1582321 (kevinator)
[22:53:07] <wikibugs>	 Analytics-EventLogging, Analytics-Kanban: {tick} Schema Audit - https://phabricator.wikimedia.org/T102224#1582323 (kevinator)
[22:53:09] <wikibugs>	 Analytics-EventLogging, Analytics-Kanban: Update Schema Talk pages {tick} [8 pts] - https://phabricator.wikimedia.org/T103133#1582322 (kevinator) Open>Resolved
[23:02:19] <wikibugs>	 Analytics-Kanban: Analyze webrequest data issue on August 3/4 and 10/11 [?pts] {hawk} - https://phabricator.wikimedia.org/T107893#1582347 (kevinator)
[23:02:47] <wikibugs>	 Analytics-Kanban: Analyze webrequest data issue on August 3/4 and 10/11 [?pts] {hawk} - https://phabricator.wikimedia.org/T107893#1582349 (kevinator) Open>Resolved email went out to analytics list: https://lists.wikimedia.org/pipermail/analytics/2015-August/004218.html
[23:03:33] <wikibugs>	 Analytics-Kanban, Patch-For-Review: Foundation-only Geowiki stopped updating - https://phabricator.wikimedia.org/T106229#1582354 (kevinator) Open>Resolved
[23:11:37] <wikibugs>	 Analytics-Backlog: Backfill pageview data correcting space in title bug - https://phabricator.wikimedia.org/T110614#1582393 (JAllemandou) NEW
[23:15:40] <wikibugs>	 Analytics-Kanban, Research-and-Data: Bug in pageview title extraction: change spaces to underscores after percent_decode (not only plus signs) - https://phabricator.wikimedia.org/T108866#1582415 (JAllemandou) @DarTar : your comment passed through without me noticing, I am sorry. Data can be fixed and reagg...
[23:58:29] <wikibugs>	 Analytics-Backlog, Research-and-Data: Backfill pageview data correcting space in title bug - https://phabricator.wikimedia.org/T110614#1582532 (DarTar)