[05:37:08] Analytics-Cluster, Datasets-Archiving, Datasets-Webstatscollector, Patch-For-Review: Mediacounts stalled after 2015-04-26 - https://phabricator.wikimedia.org/T97753#1278465 (Nemo_bis) Thanks! I've already used them. [07:53:52] Analytics-Engineering, operations: Honor DNT header for access logs & varnish logs - https://phabricator.wikimedia.org/T98831#1278628 (Gilles) NEW [10:09:22] hi we have a weird problem that one table, ContentTranslationError is not getting any new events which it should [10:09:29] can someone help to debug this issue? [10:10:52] (Also noticed https://wikitech.wikimedia.org/wiki/EventLogging#Check_if_the_data_I_am_logging_is_coming_through_properly.3F is outdated) [10:15:15] filed https://phabricator.wikimedia.org/T98842 - we are in the conference with limited connectivity [10:27:50] Analytics-EventLogging: ContentTranslationError event logging table is not receiving new events - https://phabricator.wikimedia.org/T98842#1278939 (Nemo_bis) [12:48:44] Analytics-Engineering: VE-related data for the Galician Wikipedia - https://phabricator.wikimedia.org/T86944#1279184 (Elitre) @neilpquinn or @gpaumier, can you please find out if I assigned this request correctly? Thank you! [13:11:25] milimetric: Heya :) [13:12:27] hi joal [13:12:47] Do we checkpoint even if aaron is not here ? [13:13:11] um, I was skipping it, but you wanna chat? [13:13:31] Why not :) [13:13:46] depends if you have time as well [13:14:00] joal: let's jump in the batcave [13:14:03] k [14:09:07] joal, I'm here, sorry for the delay [14:09:21] hi mforns, talking with Dan, no problemo :) [14:09:35] joal, ok [14:09:53] joal, let me know when you're done and want to get on EL [14:09:59] sure, thx :) [14:12:41] Analytics, Ops-Access-Requests, operations: Access to stat1003 for jdouglas - https://phabricator.wikimedia.org/T98209#1279457 (ArielGlenn) [14:47:47] mforns: I am ready ! [14:47:52] sorry for being late :S [14:47:53] joal, OK [14:48:07] joal, it was me who was late, heheh [14:48:12] :) [14:48:13] joal, so batcave? [14:48:20] hok [14:49:42] Nikerabbit: hello ! [14:49:47] are you there ? [14:59:51] (PS1) Milimetric: Disable 19 queries from the scheduler [analytics/limn-mobile-data] - https://gerrit.wikimedia.org/r/210364 [15:02:56] Analytics-Wikistats: Discrepancies in historical total active editor numbers - https://phabricator.wikimedia.org/T87738#1279687 (ezachte) Spreadsheet with deduped 5+ editors, like in Tbayer's table, but all months, and with extra column for new data from May 2015 Also a chart which shows strange pattern, w... [15:18:27] Analytics-Wikistats: Discrepancies in historical total active editor numbers - https://phabricator.wikimedia.org/T87738#1279741 (ezachte) Csv file with edits on all Wikipedias (only) combined, from 5 releases The data in Wikistats are presented with M for million and k for thousand, after these symbols were... [15:25:07] Analytics-Wikistats: Discrepancies in historical total active editor numbers - https://phabricator.wikimedia.org/T87738#1279759 (ezachte) Caveat: deduplication in Wikistats was based on user name only, and thus imprecise. We always assumed that accounts that were still active were nearly all unique. The rece... [15:26:40] joal: I am now but battery soon empty [15:27:37] Analytics-EventLogging: ContentTranslationError event logging table is not receiving new events - https://phabricator.wikimedia.org/T98842#1279790 (mforns) A recent deployment to optimize mysql insertion is buffering events by schema until they reach a number of 100 before inserting to the db. I can see tha... [15:30:04] thanks for the update [15:30:19] less than 100 events since may 1 sounds a bit unlikely but we will see [15:35:16] Nikerabbit: sorry, in stand up [15:35:21] I have some news for you [15:35:47] well, mforns have been quicker .. [15:35:56] Nikerabbit: nevermind :) [15:38:09] Analytics-EventLogging: ContentTranslationError event logging table is not receiving new events - https://phabricator.wikimedia.org/T98842#1279851 (Milimetric) I looked into this this morning, this schema hasn't had 100 events since May 1st, that's the problem as Marcel guessed. [15:41:14] Analytics-EventLogging, Analytics-Kanban: ContentTranslationError event logging table is not receiving new events - https://phabricator.wikimedia.org/T98842#1279874 (Milimetric) [15:42:03] Analytics-Kanban, Analytics-Wikimetrics, Community-Wikimetrics, Patch-For-Review: Utf-8 names on json reports appear as unicode code points: "\u0623\u0645\u064a\u0646" {dove} - https://phabricator.wikimedia.org/T93023#1279881 (mforns) Open>Resolved [15:42:18] Analytics-Kanban: Kafka with current python code (EL re-architecture spike) - https://phabricator.wikimedia.org/T98022#1279884 (JAllemandou) Open>Resolved [15:42:47] Analytics-Kanban: Kafka + Spark Streaming (EL re-architecture spike) - https://phabricator.wikimedia.org/T98023#1279889 (JAllemandou) Open>Resolved [15:43:52] joal, short pause and continue with EL? [15:46:48] Analytics-Kanban: Processor writes valid and invalid events to separate Kafka topics [13 points] {oryx} - https://phabricator.wikimedia.org/T98781#1277532 (Milimetric) [15:48:41] Analytics-Wikistats: Discrepancies in historical total active editor numbers - https://phabricator.wikimedia.org/T87738#1279939 (Nemo_bis) > Is that in line with Nemo_bis' observation that "Interestingly, there is almost no difference in the 1+ and 3+ levels." I'd say it is, because users with a single edit... [15:55:10] hey mforns, ready when you want :) [16:39:49] Hey mforns [16:39:52] You there ? [16:39:56] joal, hi [16:40:07] back to the python ? :) [16:40:42] joal, yes, batcave [17:30:11] Analytics-EventLogging, Beta-Cluster, VisualEditor: Beta cluster is sending VisualEditor events to production bits.wikimedia.org/statsv - https://phabricator.wikimedia.org/T98196#1280307 (ori) Open>Resolved a:ori No, this problem would predate that, and setting the URL to be relative actuall... [17:30:34] Analytics-EventLogging, Beta-Cluster, VisualEditor: Beta cluster is sending VisualEditor events to production bits.wikimedia.org/statsv - https://phabricator.wikimedia.org/T98196#1280315 (Jdforrester-WMF) Aha, thanks! [19:03:55] joal, hey dude. Altiscale sync is political stuff today. [19:04:01] I'm sorry I should have said sooner. [19:04:18] If you'd like to connect, I'll set up the call, but you should probably enjoy your evening instead :) [19:23:57] Hi halfak [19:24:27] Thanks for letting me know, I have indeed enjoyed my free slot :) [19:24:33] \o/ [19:24:35] Lino sleeps well now ;) [19:24:44] How about you ? [19:24:53] Do you have a minute for me now ? [19:25:25] halfak: --^ [19:25:35] Still meeting. [19:25:49] depending on your schedule and jetlag, maybe after ? [19:27:16] Gotta get food afterwards. Maybe early tomorrow. 8AM PDT? [19:27:54] Yop, sounds good :) [19:28:01] thx :) [19:28:09] Have a good west coast day ! [19:28:39] milimetric: are you around ? [19:29:08] joal: hi [19:29:12] Analytics: Update http://reportcard.wmflabs.org/ with March 2015 dump data - https://phabricator.wikimedia.org/T97379#1280594 (Tbayer) [19:29:30] We have made some good progress with Marcel on EL [19:29:34] oh awesome [19:29:40] I'm still a bit stuck staring at the code [19:29:42] Wanted to let you know, in case you start with Madhu :) [19:30:07] Let's spend some time together if you wish, I now feel more confident about it :) [19:30:33] uh... it's late for you. I'll finish looking at it today and I'll join early tomorrow [19:30:36] is it ok if we talk then? [19:30:48] Oh yeah, that's what I meant :) [19:30:54] baaaaaaatcave ! [19:31:24] cool, have a good night [19:31:33] oops sorry missed a line :) [19:31:36] Sounds good [19:31:43] Tomorrow, whenever you want :) [19:31:50] Good end of day [19:31:52] ! [19:33:51] Analytics: Update http://reportcard.wmflabs.org/ with March 2015 dump data - https://phabricator.wikimedia.org/T97379#1280611 (Tbayer) Ariel has now provided the stub dumps necessary for this task (while the full content dumps may still be running), and Erik calculated the numbers required for the quarterly... [19:33:58] Analytics, WMF-Product-Strategy: Provide metrics for WMF quarterly report on January-March 2015 - https://phabricator.wikimedia.org/T97344#1280613 (Tbayer) [19:34:00] Analytics: Update http://reportcard.wmflabs.org/ with March 2015 dump data - https://phabricator.wikimedia.org/T97379#1280614 (Tbayer) [19:39:13] (PS1) Milimetric: Update core metrics due to late dumps [analytics/reportcard/data] - https://gerrit.wikimedia.org/r/210412 [19:39:29] (CR) Milimetric: [C: 2 V: 2] Update core metrics due to late dumps [analytics/reportcard/data] - https://gerrit.wikimedia.org/r/210412 (owner: Milimetric) [19:42:15] milimetric, rfarrand wants to know who should be personally invited to the graph talk on th [19:42:20] anythoughts? [19:43:06] yurik: no specific people came to mind, no [20:09:11] anyone know the zookeeper url on deployment eventlogging? [20:09:19] *beta labs [20:33:23] Analytics: Update http://reportcard.wmflabs.org/ with March 2015 dump data - https://phabricator.wikimedia.org/T97379#1280789 (Tbayer) Open>Resolved [20:35:31] milimetric: It seems like EL on deployment-eventlogging02.eqiad.wmflabs doesn't provide any events. I've used both http://bits.beta.wmflabs.org/event.gif and the new http://deployment.wikimedia.beta.wmflabs.org/beacon/event URI. Still no events [20:49:50] o/ milimetric [20:52:04] -._.-._.-._.-._.-._.- [20:52:16] halfak: is that crying? [20:52:36] The ASCII equivalent of thumb twiddling. [21:03:15] halfak: hey [21:03:17] just got off a call [21:03:33] bearND: there were some problems there yesterday, I think /var was full? [21:03:41] (checking) [21:04:01] Ha! I just got into a meeting. [21:04:11] bearND: yep, /var is full again [21:04:13] milimetric, will ping later about work for the VE A/B [21:04:21] halfak: cool, look forward to talking about it [21:04:37] milimetric: ah, that explains [21:05:01] bearND: not sure what to do about it in the long run, because we deleted some logs and it just filled up again [21:05:14] I think we needs to talk to some opsy folks, I'll mention it tomorrow at SoS [21:08:28] Analytics-Kanban: Processor writes valid and invalid events to separate Kafka topics [13 points] {oryx} - https://phabricator.wikimedia.org/T98781#1280962 (Milimetric) Progress so far - I have a code change that should work but I don't know how to use kafka on beta labs. Zookeeper seems to not be running there. [21:11:19] milimetric: have you cleared it again? [21:12:06] bearND: not yet, was in the middle of something else. I'll try in a bit and ping you [21:14:09] woo, other problem solved [23:28:25] o/ milimetric, yt? [23:48:48] hey halfak [23:48:56] sorry was talking to vega folks [23:51:39] milimetric: Do you know what arrival and departure dates to put for wikimania? [23:52:24] rachel knows them better than me, I don't have them written down anywhere madhuvishy [23:53:31] milimetric: Hmmm - this? https://docs.google.com/spreadsheets/d/1y6fqbD09fE-9XbQ1W4MwypuAqM6P-tHyC_qFjLYPIoE/edit#gid=0 [23:53:58] madhuvishy: thanks :) [23:54:53] and yes, that's authoritative from the looks of it [23:56:20] milimetric: cool [23:59:47] milimetric: sorry i haven't gotten to the EL task yet. a bit under the weather today and working lazily from home