[00:28:51] <wikibugs>	 Analytics: Update http://reportcard.wmflabs.org/ (and Wikistats) with June 2015 dump data - https://phabricator.wikimedia.org/T106505#1497435 (Tbayer) Leaving this open until the task is done as described, but @ezachte already provided the missing June data by email, in time for the publication of the report...
[00:43:53] <wikibugs>	 Analytics-Cluster, Analytics-Kanban, operations, Patch-For-Review: Build new latest stable (0.8.2.1?) Kafka package and upgrade Kafka brokers - https://phabricator.wikimedia.org/T106581#1497466 (Ottomata) Working on migration plan:  https://etherpad.wikimedia.org/p/kafka_0.8.2.1_migration
[03:33:50] <wikibugs>	 Analytics-Tech-community-metrics, ECT-July-2015, Patch-For-Review: "Age of unreviewed changesets by affiliation" shows negative number of changesets - https://phabricator.wikimedia.org/T72600#1497647 (jayvdb) >>! In T72600#1495009, @Acs wrote: > http://korma.wmflabs.org/browser/gerrit_review_queue.html...
[07:21:23] <wikibugs>	 Analytics-Kanban: {lama} Wikistats 2.0 - https://phabricator.wikimedia.org/T107175#1497788 (Nemo_bis) I'm confused by the mention of new articles. Are we expected to mention *all* the metrics and plots we find useful in stats.wikimedia.org? Even from the standard tables like https://stats.wikimedia.org/wikisp...
[07:22:10] <wikibugs>	 Analytics-Kanban, Analytics-Wikistats: {lama} Wikistats 2.0 - https://phabricator.wikimedia.org/T107175#1497789 (Nemo_bis)
[07:24:42] <wikibugs>	 Analytics-General-or-Unknown: Stats for Wikidata exports - https://phabricator.wikimedia.org/T64874#1497791 (Nemo_bis) Open>stalled
[07:24:55] <wikibugs>	 Analytics-General-or-Unknown: Statistics for Wikidata API usage - https://phabricator.wikimedia.org/T64873#1497795 (Nemo_bis)
[07:27:11] <wikibugs>	 Analytics-Wikistats: Wikistats total article count for SV and ID are too high. - https://phabricator.wikimedia.org/T93683#1497798 (Nemo_bis) Open>Resolved > for e.g. Swedish the first count is 3.1 M and the second 1.9 M  Now it's 2 M vs. 1.9 M and https://sv.wikipedia.org/wiki/Special:Statistik agrees.
[07:33:40] <wikibugs>	 Analytics-Wikistats: add talk pages count to project statistics - https://phabricator.wikimedia.org/T71742#1497808 (Nemo_bis)
[07:33:42] <wikibugs>	 Analytics-Wikistats: for all namespaces show page count without redirects - https://phabricator.wikimedia.org/T71743#1497807 (Nemo_bis)
[07:33:44] <wikibugs>	 Analytics-Wikistats: figure out process for adding new wikis to wikistats - https://phabricator.wikimedia.org/T64739#1497809 (Nemo_bis)
[07:34:33] <wikibugs>	 Analytics-Kanban, Analytics-Wikistats: {lama} Wikistats 2.0 - https://phabricator.wikimedia.org/T107175#1488807 (Nemo_bis) For now I added the metrics and modes of access which are missing from the current wikistats and have a report: there is no gain in repeating everything here.
[07:38:20] <wikibugs>	 Analytics-Wikistats: WikiStats claims 217% of es.wiktionary entries were created by bots - https://phabricator.wikimedia.org/T87723#1497820 (Nemo_bis) Now it says 703 k created by bot out of 835 k total.
[07:38:31] <wikibugs>	 Analytics-Wikistats: WikiStats claims 217% of es.wiktionary entries were created by bots - https://phabricator.wikimedia.org/T87723#1497821 (Nemo_bis) Open>Resolved a:ezachte
[10:08:29] <wikibugs>	 Analytics-Tech-community-metrics, ECT-August-2015: Tech community KPIs for the WMF metrics meeting - https://phabricator.wikimedia.org/T107562#1498048 (Qgil) NEW
[10:32:03] <wikibugs>	 Analytics-Tech-community-metrics, ECT-July-2015, Patch-For-Review: "Age of unreviewed changesets by affiliation" shows negative number of changesets - https://phabricator.wikimedia.org/T72600#1498089 (Qgil) @acs, this looks good to me now. Thank you!  @jayvdb, removing the false affiliations is being a...
[10:33:17] <wikibugs>	 Analytics-Tech-community-metrics, ECT-July-2015, Patch-For-Review: "Age of unreviewed changesets by affiliation" shows negative number of changesets - https://phabricator.wikimedia.org/T72600#1498091 (Qgil) Open>Resolved
[10:35:51] <wikibugs>	 Analytics-Tech-community-metrics, ECT-August-2015: Tech community KPIs for the WMF metrics meeting - https://phabricator.wikimedia.org/T107562#1498097 (Qgil)
[13:05:10] <joal>	 Hey ottomata ! Good MooooooOOOOOOooooorning !
[13:05:25] <joal>	 Let me know when you have some time for me (pageview stuff)
[13:05:27] <joal>	 Thx ;)
[13:15:45] <ottomata>	 good morning!
[13:15:51] <ottomata>	 sorry was making some tea
[13:15:59] <joal>	 No problem at all :)
[13:16:47] <ottomata>	 what's up?
[13:17:24] <joal>	 Some comments on adding UAMap to intermediate PV
[13:17:45] <joal>	 I want to move that one fast if possible :)
[13:19:09] <ottomata>	 okok, i just thought that we wanted to export this data somehow
[13:19:20] <ottomata>	 we just hadn't done it yet
[13:19:49] <joal>	 ottomata: We'lll do that at some point, but with some fuzziness for low view_counts points
[13:20:13] <joal>	 The reason why we add is to prepare wikistat 2.0
[13:20:20] <ottomata>	 hm, ok.
[13:20:37] <joal>	 We've had 3 +1 in one day to get UA info on pageviews
[13:20:48] <joal>	 So, we better prepare to be asked so !
[13:21:30] <joal>	 We discussed with milimetric about how to prevent PII issues, and he says ezachte uses additionsal fuzziness
[13:21:45] <joal>	 So we can do that as well when publicly releasing data I guess
[13:21:49] <joal>	 ottomata: --^
[13:22:39] <ottomata>	 hm joal, just curious, is it possible to still put view_count at the end of the table?
[13:22:42] <ottomata>	 i guess not, huh?
[13:23:24] <joal>	 ottomata: only way would be to copy adding empty for april/may, then drop and recreate
[13:23:35] <joal>	 Feasible though
[13:23:41] <joal>	 But more work
[13:23:57] <ottomata>	 aye not worth it
[13:23:57] <ottomata>	 k
[13:24:08] <grrrit-wm>	 (CR) Ottomata: [C: 2 V: 2] Add user_agent_map to intermediate pageview [analytics/refinery] - https://gerrit.wikimedia.org/r/228010 (https://phabricator.wikimedia.org/T107436) (owner: Joal)
[13:24:34] <joal>	 ottomata: I need to change the commit for the empt project bug
[13:24:41] <joal>	 please give me a minute
[13:25:00] <ottomata>	 k
[13:28:18] <grrrit-wm>	 (PS1) Joal: Remove empty projects from intermediate pageviews [analytics/refinery] - https://gerrit.wikimedia.org/r/228247
[13:28:45] <joal>	 ottomata: new commit to fix my mess --^
[13:30:21] <grrrit-wm>	 (Abandoned) Joal: Remove empty projects from intermediate pageviews [analytics/refinery] - https://gerrit.wikimedia.org/r/228011 (owner: Joal)
[13:30:40] <ottomata>	 hm, k
[13:30:44] <grrrit-wm>	 (CR) Ottomata: [C: 2 V: 2] Remove empty projects from intermediate pageviews [analytics/refinery] - https://gerrit.wikimedia.org/r/228247 (owner: Joal)
[13:31:01] <joal>	 ottomata: Aggregator issue comes from that last one
[13:31:15] <joal>	 Thank you for merging !
[13:31:26] <joal>	 I am going to deploy that latter today
[13:31:55] <ottomata>	 k you arewelcome!
[13:53:22] <wikibugs>	 Analytics, Labs, Labs-Infrastructure: Set up cron job on labstore to rsync data from stat* boxes into labs. - https://phabricator.wikimedia.org/T107576#1498336 (Ottomata) NEW a:Ottomata
[14:03:12] <wikibugs>	 Analytics, Labs, Labs-Infrastructure, Patch-For-Review: Set up cron job on labstore to rsync data from stat* boxes into labs. - https://phabricator.wikimedia.org/T107576#1498355 (Ottomata) That patch ^ will allow labstore1003 to rsync from stat*::srv/...  No idea where to put a cronjob on labstore1...
[14:05:41] <wikibugs>	 Analytics, Security, operations: Purge > 90 days stat1002:/a/squid/archive/glam_nara - https://phabricator.wikimedia.org/T92340#1498366 (Ottomata) Q: does the mediacounts dataset not cover these needs?  http://dumps.wikimedia.org/other/mediacounts/README.txt
[14:06:21] <wikibugs>	 Analytics, MediaWiki-Vagrant: fuse fails on vagrant - https://phabricator.wikimedia.org/T103484#1498368 (Ottomata) Open>declined
[14:06:34] <wikibugs>	 Analytics: Vowpal Wabbit on stat1002 - https://phabricator.wikimedia.org/T93537#1498370 (Ottomata) Open>declined a:Ottomata
[14:06:50] <wikibugs>	 Analytics, operations: Upgrade stat1001 to Debian Jessie - https://phabricator.wikimedia.org/T76348#1498372 (Ottomata)
[14:08:00] <wikibugs>	 Analytics-Backlog, Analytics-Cluster: Expand people's ability to use Hive/Cluster {hawk} - https://phabricator.wikimedia.org/T94903#1498374 (Ottomata) Still unsure what this ticket is.  Can we close?
[14:09:04] <wikibugs>	 Analytics-Cluster, operations, Interdatacenter-IPsec: Secure inter-datacenter web request log (Kafka) traffic - https://phabricator.wikimedia.org/T92602#1498385 (Ottomata)
[14:09:07] <wikibugs>	 Analytics-Cluster, Analytics-Kanban, operations, Patch-For-Review: Build new latest stable (0.8.2.1?) Kafka package and upgrade Kafka brokers - https://phabricator.wikimedia.org/T106581#1472141 (Ottomata)
[14:10:38] <wikibugs>	 Analytics-Cluster, Analytics-Kanban, operations, Patch-For-Review: Build new latest stable (0.8.2.1?) Kafka package and upgrade Kafka brokers - https://phabricator.wikimedia.org/T106581#1472141 (Ottomata)
[14:10:41] <wikibugs>	 Analytics-Cluster, operations, Interdatacenter-IPsec: Secure inter-datacenter web request log (Kafka) traffic - https://phabricator.wikimedia.org/T92602#1498387 (Ottomata)
[14:23:48] <wikibugs>	 Analytics-Cluster: Audit hyperthreading on analytics nodes. - https://phabricator.wikimedia.org/T90640#1498396 (Ottomata)
[14:23:50] <wikibugs>	 Analytics-Cluster, Analytics-Kanban, operations, Patch-For-Review: Build new latest stable (0.8.2.1?) Kafka package and upgrade Kafka brokers - https://phabricator.wikimedia.org/T106581#1498395 (Ottomata)
[14:37:49] <milimetric>	 joal: hey
[14:37:59] <milimetric>	 where's your code for the RESTBase endpoints so far?  I should study up
[14:40:40] <joal>	 Hi milimetric
[14:40:52] <joal>	 Last versions are not commited
[14:40:56] <joal>	 I shall do that now
[14:41:01] <milimetric>	 are they on labs or local?
[14:41:07] <joal>	 I have both
[14:41:30] <joal>	 But managed to get the thing running on lcal, using cassandra on docker
[14:42:56] <joal>	 Do you want us to pair program until standup ?
[14:43:03] <milimetric>	 yeah, that'd be great
[14:43:07] <joal>	 cool
[14:43:09] <joal>	 let's batcave
[14:43:12] <milimetric>	 omw
[14:48:30] <icinga-wm>	 PROBLEM - Difference between raw and validated EventLogging overall message rates on graphite1001 is CRITICAL 20.00% of data above the critical threshold [30.0]
[14:50:31] <icinga-wm>	 RECOVERY - Difference between raw and validated EventLogging overall message rates on graphite1001 is OK Less than 15.00% above the threshold [20.0]
[15:21:37] <wikibugs>	 Analytics-Cluster, Analytics-Kanban: Test Cassandra as a storage strategy {slug} [5 pts] - https://phabricator.wikimedia.org/T101786#1498533 (kevinator) Open>Resolved
[15:22:05] <wikibugs>	 Analytics-EventLogging, Analytics-Kanban: {tick} Schema Audit - https://phabricator.wikimedia.org/T102224#1498535 (kevinator)
[15:22:07] <wikibugs>	 Analytics-EventLogging, Analytics-Kanban: Reach out to half the schema owners [8 pts] {tick} - https://phabricator.wikimedia.org/T103380#1498534 (kevinator) Open>Resolved
[15:22:15] <icinga-wm>	 PROBLEM - Difference between raw and validated EventLogging overall message rates on graphite1001 is CRITICAL 20.00% of data above the critical threshold [30.0]
[15:22:33] <wikibugs>	 Analytics-EventLogging, Analytics-Kanban: Build .deb package for pykafka {stag} [3 pts] - https://phabricator.wikimedia.org/T106252#1498537 (kevinator) Open>Resolved
[15:22:34] <wikibugs>	 Analytics-EventLogging, Analytics-Kanban: {stag} EventLogging on Kafka - https://phabricator.wikimedia.org/T102225#1498538 (kevinator)
[15:22:52] <wikibugs>	 Analytics-EventLogging, Analytics-Kanban: Event Logging doesn't seem to handle unicode strings {oryx} [8 pts] - https://phabricator.wikimedia.org/T99572#1498539 (kevinator) Open>Resolved
[15:24:24] <icinga-wm>	 RECOVERY - Difference between raw and validated EventLogging overall message rates on graphite1001 is OK Less than 15.00% above the threshold [20.0]
[15:37:10] <wikibugs>	 Analytics-Kanban, Patch-For-Review: Add User Agent refined data to intermediate pageview aggregation. [5 pts] {hawk} - https://phabricator.wikimedia.org/T107436#1498578 (kevinator)
[15:51:42] <wikibugs>	 Analytics-General-or-Unknown: Stats for Wikidata exports - https://phabricator.wikimedia.org/T64874#1498669 (Lydia_Pintscher) It is still important for us, yes.
[15:52:04] <wikibugs>	 Analytics-General-or-Unknown: Stats for Wikidata exports - https://phabricator.wikimedia.org/T64874#1498670 (Lydia_Pintscher) stalled>Open
[15:52:22] <wikibugs>	 Analytics-General-or-Unknown, Wikidata: Stats for Wikidata exports - https://phabricator.wikimedia.org/T64874#676394 (Lydia_Pintscher)
[15:53:06] <grrrit-wm>	 (PS3) Mforns: Clean up mobile-reportcard reports and dashboards [analytics/limn-mobile-data] - https://gerrit.wikimedia.org/r/227911 (https://phabricator.wikimedia.org/T104379)
[15:55:43] <grrrit-wm>	 (CR) Mforns: Clean up mobile-reportcard reports and dashboards (1 comment) [analytics/limn-mobile-data] - https://gerrit.wikimedia.org/r/227911 (https://phabricator.wikimedia.org/T104379) (owner: Mforns)
[16:06:59] <ottomata>	 madhuvishy: i'm here whenever
[16:06:59] <ottomata>	 https://plus.google.com/hangouts/_/wikimedia.org/stroganoffsets
[16:08:54] <joal>	 the name of the hangout is tasty ottomata !
[16:08:58] <ottomata>	 heheh
[16:09:05] <joal>	 milimetric: when you wznt 1
[16:09:14] <joal>	 batcave ?
[16:09:22] <milimetric>	 i'm in the batcave, but i was also listening to lila
[16:09:24] <milimetric>	 https://www.youtube.com/watch?v=5ENmiN4XNM4&feature=youtu.be
[16:09:30] <milimetric>	 how long are you around today?
[16:09:36] <milimetric>	 I'll work with you if you're leaving soon
[16:16:13] <madhuvishy>	 ottomata: I'm in the hangout :)
[16:20:51] <joal>	 ottomata: trying to deploy from tin --> only 1 of 2 minions complete fetch :(
[16:20:59] <joal>	 any idea ?
[16:21:15] <ottomata>	 retry?  somties is funky
[16:21:33] <joal>	 d
[16:23:00] <joal>	 ottomata: I get this error:
[16:23:01] <joal>	 stat1002.eqiad.wmnet:  fetch status: 128 [started: 0 mins ago, last-return: 0 mins ago]
[16:33:31] <joal>	 ottomata: That error seems to come from my ssh key change :(
[16:33:36] <joal>	 Could it be so ?
[16:35:41] <ottomata>	 hey sorry am talking to madhu
[16:35:42] <ottomata>	 uhhh
[16:35:50] <ottomata>	 shouldnt' be so I think
[16:35:59] <ottomata>	 if you can log into stat1002 and you can log into tin
[16:36:08] <ottomata>	 hmmm
[16:36:18] <ottomata>	 joal can I try
[16:36:18] <ottomata>	 ?
[16:36:19] <joal>	 hm.
[16:36:22] <ottomata>	 git deploy abort?
[16:36:26] <joal>	 Please :)
[16:36:37] <wikibugs>	 Analytics-Kanban, Analytics-Wikistats: {lama} Wikistats 2.0 - https://phabricator.wikimedia.org/T107175#1498819 (ezachte) Hmm, I would recommend keeping Wikistats dump based stats and Wikistats traffic stats totally separate.  Otherwise scope will be overwhelming and confusion amounts. The projects are ne...
[16:36:42] <joal>	 ottomata: aborted
[16:37:05] <ottomata>	 doesn't work for me either, checking on stat1002
[16:37:10] <joal>	 k
[16:37:16] <joal>	 ottomata: sorry :S
[16:37:26] <ottomata>	 going to try to force it to re clone...
[16:37:29] <ottomata>	 dunno what's up
[16:39:33] <wikibugs>	 Analytics-Wikistats: Wikistats total article count for SV and ID are too high. - https://phabricator.wikimedia.org/T93683#1498836 (ezachte) That's because all Wikipedias are now generated from stub dumps, no exceptions for SV, ID.
[16:39:33] <ottomata>	 hm, joal, dunno what was up there
[16:39:45] <ottomata>	 i moved the dir on stat1002 to a different name, then did git deloy, and it worked
[16:39:48] <ottomata>	 so it recloned, dunno!
[16:39:56] <joal>	 weirdo
[16:40:06] <joal>	 Thanks sir :)
[16:40:41] <joal>	 ottomata: by the way: I'm deploying ;)
[16:40:52] <joal>	 or more precisely, you are doing it !
[16:44:20] <ottomata>	 do it! :)
[16:44:21] <ottomata>	 :D
[16:47:48] <joal>	 ottomata: you're in verve ! is labeouf related to stroganoof ?
[16:48:04] <joal>	 sorry, very french joke (beef is boeuf in french)
[17:34:33] <wikibugs>	 Analytics-Backlog, Research-and-Data, Fundraising research: What's our projected ability to fundraise in the coming years - https://phabricator.wikimedia.org/T107606#1499030 (DarTar) NEW
[17:35:29] <wikibugs>	 Analytics, Analytics-Kanban, Research-and-Data, Research consulting: Too few page views for June/July 2015 - https://phabricator.wikimedia.org/T106034#1499044 (ezachte) comScore provides another data point about low pageviews in June we know comScore has its own issues, and doesn't track all our tra...
[17:47:59] <wikibugs>	 Analytics-Tech-community-metrics, ECT-August-2015: Tech community KPIs for the WMF metrics meeting - https://phabricator.wikimedia.org/T107562#1499106 (jgbarah) Dani is on vacation these days, and he is the most knowledgeable about those PKIs. We are already working on this, anyway. In particular, we're t...
[17:55:20] <ottomata>	 hehe joal :)
[18:01:19] <wikibugs>	 Analytics, Discovery, MediaWiki-General-or-Unknown, Services, and 5 others: Reliable publish / subscribe event bus - https://phabricator.wikimedia.org/T84923#1499169 (GWicke)
[18:06:42] <joal>	 milimetric: sorry, I won't have time to pair program this evening
[18:08:01] <joal>	 milimetric: I am in a mess for backfilling ua data into intermediate pageviews, and will solve that
[18:08:01] <joal>	 milimetric: monday is ok for you ?
[18:08:01] <milimetric>	 no worries joal, i took lunch and will go through the code
[18:08:01] <milimetric>	 monday's fine
[18:08:01] <joal>	 awesome
[18:08:01] <milimetric>	 good luck with the mess...
[18:08:01] <joal>	 let's fight pageviews again !
[18:08:01] <joal>	 ;)
[18:26:45] <wikibugs>	 Analytics, Analytics-Kanban, Research-and-Data, Research consulting: Too few page views for June/July 2015 - https://phabricator.wikimedia.org/T106034#1499214 (Tbayer) comScore uniques also saw an unusually large drop in June (375M, the lowest since August 2010).
[18:30:19] <madhuvishy>	 ottomata: I realized why I did the ascii ignore stuff
[18:30:40] <madhuvishy>	 it's because path.strip('/') returns type unicode
[18:30:58] <madhuvishy>	 and pykafka expects string
[18:31:13] <madhuvishy>	 so it fails without the conversion to ascii
[18:52:03] <ottomata>	 right, makes sense
[18:52:05] <ottomata>	 cool.
[18:52:08] <ottomata>	 add a comment saying htat
[18:53:07] <madhuvishy>	 ottomata: okay will do
[18:53:37] <madhuvishy>	 also flake8 validation keeps flagging this error with the Kafka Writer
[18:53:50] <madhuvishy>	 ottomata: https://integration.wikimedia.org/ci/job/tox-flake8/6973/console
[18:54:32] <madhuvishy>	 I know how to fix it, should I do it as part of this patch? jenkins-bot keeps -1 ing me
[18:59:04] <madhuvishy>	 ottomata: okay, feel free to review it when you get a chance. also does analytics 1004 have kafka 0.8.2?
[19:01:54] <ottomata>	 eee, no, it does not :(
[19:02:02] <ottomata>	 right i forgot that was the blocker, duh
[19:02:28] <ottomata>	 madhuvishy:  remove the imports
[19:02:33] <ottomata>	 on line 21 and 22
[19:02:47] <ottomata>	 and maybe on 142 too?
[19:03:06] <wikibugs>	 Analytics-Cluster, operations, ops-eqiad, Patch-For-Review: rack new hadoop worker nodes - https://phabricator.wikimedia.org/T104463#1499295 (Cmjohnson) 1046-1049 are racked and setup in row B and ready for installs  DNS/DHCP/Raid Cfg/Switch Cfg has been completed
[19:03:46] <wikibugs>	 Analytics, Editing-Department: Investigate drop-off in global edit save rate starting 27 June 2015 - https://phabricator.wikimedia.org/T105215#1499298 (Neil_P._Quinn_WMF) Open>Resolved For posterity, here's a screenshot of the data that caused us concern (from [[https://edit-analysis.wmflabs.org/com...
[19:04:39] <madhuvishy>	 ottomata: yeah doing that.
[19:12:41] <madhuvishy>	 I think no more flake8 errors :) going for lunch now
[19:40:05] <joal>	 Guys, I'm off for today
[19:40:24] <joal>	 pageview backfilling is started, I'll monitor that over the weekend
[19:40:31] <joal>	 Have a good one !
[20:26:51] <wikibugs>	 Analytics-Backlog, Research-and-Data, Fundraising research: What's our projected ability to fundraise in the coming years - https://phabricator.wikimedia.org/T107606#1499480 (DarTar) Workplan: https://docs.google.com/document/d/1htMGoux82i0885T2XxhlE6tOCW5thACfwE3_V7mN_9E/edit
[20:27:03] <wikibugs>	 Analytics-Backlog, Research-and-Data, Fundraising research: What's our projected ability to fundraise in the coming years - https://phabricator.wikimedia.org/T107606#1499481 (DarTar)
[20:36:27] <wikibugs>	 Analytics-EventLogging, Analytics-Kanban: Load test parallel eventlogging-processor  {stag} [3 pts] - https://phabricator.wikimedia.org/T104229#1499513 (madhuvishy) a:madhuvishy
[20:37:48] <mforns>	 ottomata, do you know if joseph or you have looked into python aggregator problems? can I help?
[20:39:00] <ottomata>	 i think joal did, yes
[20:39:32] <mforns>	 ottomata, so is there something more to do?
[20:39:59] <ottomata>	 id o'nt know
[20:40:04] <ottomata>	 i think he fixed it, but has to fix some pageview data or something
[20:40:08] <ottomata>	 had to do with empty projets?
[20:40:55] <Deskana>	 kevinator: I set something up for us to talk at 3pm. :-)
[20:41:53] <mforns>	 ottomata, OK I guess I'll do other stuff
[20:41:56] <mforns>	 thanks!
[20:43:15] <mforns>	 kevinator, is it OK if I start with the 3 new {tick} tasks that I created yesterday (prepare limn-reports to work with the auto-purged data)?
[20:43:28] <kevinator>	 mforns: yes
[20:43:45] <mforns>	 I don't want to start anything today, that another person will need to follow up next week
[20:43:50] <mforns>	 kevinator, OK
[21:00:36] <grrrit-wm>	 (CR) Milimetric: [C: 2 V: 2] Clean up mobile-reportcard reports and dashboards [analytics/limn-mobile-data] - https://gerrit.wikimedia.org/r/227911 (https://phabricator.wikimedia.org/T104379) (owner: Mforns)
[21:00:48] <mforns>	 milimetric, hey thanks
[21:01:25] <milimetric>	 mforns: that was awesome, everything that we needed to keep was basically already timeboxed
[21:01:26] <milimetric>	 sweet
[21:01:36] <mforns>	 yes, I was lucky
[21:01:40] <milimetric>	 i don't understand how they were working before if they weren't selecting the date...
[21:01:54] <milimetric>	 maybe that's why things would fail in such weird ways...
[21:02:21] <mforns>	 mmm, I assumed generate.py would add the date column
[21:02:46] <wikibugs>	 Analytics-Cluster, Analytics-Kanban, operations, Patch-For-Review: Build new latest stable (0.8.2.1?) Kafka package and upgrade Kafka brokers - https://phabricator.wikimedia.org/T106581#1499614 (Ottomata) analytics1046-1049 are online as of today!  I have started the decommission process of analytic...
[21:02:59] <milimetric>	 oh yeah, you're right, for timebox it would
[21:03:29] <milimetric>	 http://mobile-reportcard.wmflabs.org/
[21:03:32] <milimetric>	 so that's all updated now
[21:03:39] <milimetric>	 we just have to wait for the datas
[21:04:13] <milimetric>	 mforns: hope you have a great vacation man, thanks for finishing this up
[21:04:51] <mforns>	 milimetric, oh, thanks for the deployment
[21:05:06] <mforns>	 and yes, thanks! I see you in one week :]
[21:06:07] <icinga-wm>	 PROBLEM - Difference between raw and validated EventLogging overall message rates on graphite1001 is CRITICAL 20.00% of data above the critical threshold [30.0]
[21:08:16] <icinga-wm>	 RECOVERY - Difference between raw and validated EventLogging overall message rates on graphite1001 is OK Less than 15.00% above the threshold [20.0]
[21:21:33] <joal|weekend>	 mforns: Heya !
[21:21:40] <mforns>	 joal|weekend, hey!
[21:21:44] <joal|weekend>	 Just saw your talk with ottomata
[21:21:49] <mforns>	 aha
[21:22:07] <joal|weekend>	 He's right: problem comes from empty project leading to bad line format
[21:22:28] <mforns>	 so, not related to latest changes?
[21:22:34] <joal|weekend>	 Nope
[21:22:40] <mforns>	 can I help in that?
[21:22:50] <joal|weekend>	 Just a special case not appearing before
[21:22:54] <mforns>	 aha
[21:23:18] <joal|weekend>	 no need mforns, code is corrected and I am backfilling both for that issue and UA data
[21:23:30] <mforns>	 cool!
[21:23:31] <joal|weekend>	 Thank you for asking :)
[21:24:09] <madhuvishy|lunch>	  mforns Have an awesome vacation :D
[21:24:19] <mforns>	 np, so I see you in a week!
[21:24:36] <joal|weekend>	 For sure !
[21:24:38] <mforns>	 thanks joal|weekend!
[21:24:44] <joal|weekend>	 Enjoy your holidays :)
[21:24:47] <mforns>	 :]
[21:24:53] <joal|weekend>	 Going abroad ?
[21:25:40] <wikibugs>	 Quarry, HTTPS: Quarry should be HTTPS-only - https://phabricator.wikimedia.org/T107627#1499757 (Legoktm) NEW
[21:36:58] <wikibugs>	 Quarry, HTTPS: Quarry should be HTTPS-only - https://phabricator.wikimedia.org/T107627#1499816 (Legoktm) In the meantime... https://github.com/EFForg/https-everywhere/pull/2353
[21:37:50] <mforns>	 joal|weekend, sorry, no I'll stay, my family is coming :]
[21:38:01] <joal|weekend>	 np mforns ;)
[21:38:09] <joal|weekend>	 Enjoy your time !
[21:38:12] <mforns>	 yeah
[21:38:15] <joal|weekend>	 See you the week after !
[21:38:34] <mforns>	 ok! see you then, have a nice week, too!
[21:38:40] <joal|weekend>	 thx !
[21:44:36] <joal|weekend>	 ottomata: 30 active nodes !
[21:44:42] <joal|weekend>	 How cool :)
[21:45:04] <joal|weekend>	 With that, I'm really off for tonight ;)
[21:45:25] <ottomata>	 joal|weekend: yup! but i've already started decomissioning 3 of them :)
[21:45:31] <joal|weekend>	 hahaha
[21:45:35] <ottomata>	 that'll take a while, so i figured i'd let it run over the weekend
[21:45:40] <joal|weekend>	 those things never last ;)
[21:45:53] <joal|weekend>	 Thanks for managing that !
[21:46:36] <joal|weekend>	 ottomata: I'd love to learn some on kafka install / test next week with you :)
[21:46:57] <joal|weekend>	 we'll see !
[21:47:05] <joal|weekend>	 Ciao !
[21:47:27] <ottomata>	 sure!
[21:47:31] <ottomata>	 its going to be...EXPERIMENTAL!
[21:47:33] <ottomata>	 :)
[21:47:36] <ottomata>	 laters!
[22:20:04] <grrrit-wm>	 (PS1) Mforns: Make reports compatible with EL auto-purging [analytics/limn-extdist-data] - https://gerrit.wikimedia.org/r/228416 (https://phabricator.wikimedia.org/T107506)
[22:20:50] <wikibugs>	 Analytics-Kanban, Patch-For-Review: Check and potentially timebox limn-extdist-data reports {Tick} - https://phabricator.wikimedia.org/T107506#1499968 (mforns) a:mforns
[22:21:40] <wikibugs>	 Analytics-Kanban, Patch-For-Review: Check and potentially timebox limn-extdist-data reports [3 pts] {tick} - https://phabricator.wikimedia.org/T107506#1499978 (mforns)
[22:35:19] <wikibugs>	 Analytics-Kanban, Patch-For-Review: Clean up mobile-reportcard dashboards {frog} [13 pts] - https://phabricator.wikimedia.org/T104379#1415097 (mforns) There's one thing missing! We need to enable the reportcard in puppet. Will do.
[22:49:43] <wikibugs>	 Analytics-Kanban, Patch-For-Review: Clean up mobile-reportcard dashboards {frog} [13 pts] - https://phabricator.wikimedia.org/T104379#1500013 (mforns) So we should wait for this to be merged and shall see the mobile-reportcard graphs again :]
[22:50:52] <wikibugs>	 Analytics-EventLogging, Analytics-Kanban: Reach out to half the schema owners [8 pts] {tick} - https://phabricator.wikimedia.org/T102517#1366373 (mforns) Moved to "paused" because I'll be on vacation for 1 week, will be back Aug 10.
[23:21:53] <mforns>	 hey team, have a nice week! and see you soon :] signing off for vacation, take care!
[23:30:02] <wikibugs>	 Analytics, Analytics-Kanban, Research-and-Data, Research consulting: Too few page views for June/July 2015 - https://phabricator.wikimedia.org/T106034#1500135 (DarTar) @kevinator can you share on this thread a link to the summary of the HTTPS analysis, if it has been published? I can't comment on co...