[00:06:51] (03PS6) 10Awight: Reject invalid Page titles [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/498702 (https://phabricator.wikimedia.org/T144100) [00:07:07] (03CR) 10Awight: "> One last nit for me: Can you please add the length-check in commit" [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/498702 (https://phabricator.wikimedia.org/T144100) (owner: 10Awight) [00:50:20] (03CR) 10Neil P. Quinn-WMF: "This change is ready for review." (031 comment) [analytics/refinery] - 10https://gerrit.wikimedia.org/r/499917 (https://phabricator.wikimedia.org/T211173) (owner: 10Mforns) [01:34:15] 10Analytics, 10Analytics-Wikistats: All Metrics link doesn't show up on mobile - https://phabricator.wikimedia.org/T219581 (10Milimetric) [03:17:16] (03PS4) 10Fdans: Extract loadData method to GraphModel [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/498002 [04:30:21] (03PS5) 10Fdans: Extract loadData method to GraphModel [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/498002 [04:30:23] (03PS1) 10Fdans: Replace time range selector [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/499968 (https://phabricator.wikimedia.org/T219112) [04:32:29] (03CR) 10jerkins-bot: [V: 04-1] Replace time range selector [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/499968 (https://phabricator.wikimedia.org/T219112) (owner: 10Fdans) [06:45:33] (03CR) 10Mforns: [C: 04-2] Modify mediawiki/history/druid job to ingest a simpler data set to druid (031 comment) [analytics/refinery] - 10https://gerrit.wikimedia.org/r/499917 (https://phabricator.wikimedia.org/T211173) (owner: 10Mforns) [06:50:32] (03PS1) 10Fdans: Enable All Metrics in mobile top menu [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/499976 (https://phabricator.wikimedia.org/T219581) [07:46:16] o/ [08:07:55] (03CR) 10Joal: [C: 03+2] "Merging - Thanks a lot @Awight :)" [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/498702 (https://phabricator.wikimedia.org/T144100) (owner: 10Awight) [08:12:19] (03Merged) 10jenkins-bot: Reject invalid Page titles [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/498702 (https://phabricator.wikimedia.org/T144100) (owner: 10Awight) [08:48:19] (03PS2) 10Fdans: Replace time range selector [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/499968 (https://phabricator.wikimedia.org/T219112) [09:52:56] 10Analytics, 10Analytics-EventLogging, 10Performance-Team: ElementTiming table not getting created in Hive, events are nowhere to be found, no validation errors - https://phabricator.wikimedia.org/T219602 (10Gilles) [10:02:33] fdans: o/ [10:02:44] if you have 5 mins I'd need a JS consult for Superset [10:05:08] ah wait I found the bug https://github.com/apache/incubator-superset/issues/6500 [10:05:11] ahhaha [10:17:47] what a nightmare [10:23:05] mmm but this bug seems an old one [10:23:17] there is not reactable anymore in the package.json [10:25:17] but I get "The only possible children of are , , or one ." [10:25:21] in the js console [10:37:32] 10Analytics-Kanban, 10Product-Analytics: Superset Updates - https://phabricator.wikimedia.org/T211706 (10elukey) [10:37:49] filed https://github.com/apache/incubator-superset/issues/7171 [11:08:05] 10Analytics, 10Analytics-EventLogging, 10Performance-Team: ElementTiming table not getting created in Hive, events are nowhere to be found, no validation errors - https://phabricator.wikimedia.org/T219602 (10Gilles) 05Open→03Invalid Seems to have fixed itself. [11:10:38] !log Restarted Turnilo to refresh deleted test datasource [11:10:40] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [11:21:50] 10Analytics, 10User-Elukey: Upgrade matomo1001 to latest upstream - https://phabricator.wikimedia.org/T218037 (10elukey) [11:21:59] 10Analytics, 10User-Elukey: Upgrade matomo1001 to latest upstream - https://phabricator.wikimedia.org/T218037 (10elukey) [11:52:12] !log Restarted Turnilo to refresh deleted test datasource [11:52:14] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [12:06:59] 10Analytics, 10EventBus, 10Core Platform Team Backlog (Watching / External), 10Services (watching): Schema Registry HTTP Service - https://phabricator.wikimedia.org/T219552 (10Pchelolo) [12:07:08] 10Analytics, 10EventBus, 10Operations, 10vm-requests, 10Services (watching): Create schema[12]00[12] (schema.svc.{eqiad,codfw}.wmnet) - https://phabricator.wikimedia.org/T219556 (10Pchelolo) [12:07:38] 10Analytics, 10EventBus, 10Operations, 10vm-requests, and 2 others: Create schema[12]00[12] (schema.svc.{eqiad,codfw}.wmnet) - https://phabricator.wikimedia.org/T219556 (10Pchelolo) [12:08:25] you're early today u [12:08:34] ups, sorry, wrong channel [12:11:59] !log Restarted Turnilo to refresh deleted test datasource [12:12:00] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [12:16:08] Pchelolo: o/ - the analytics team loves you even if you make mistakes and don't think about us [12:16:58] oh, elukey... [12:29:43] !log Restarted Turnilo to refresh deleted test datasource [12:29:44] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [12:35:55] 10Analytics, 10Patch-For-Review, 10User-Elukey: Upgrade matomo1001 to latest upstream - https://phabricator.wikimedia.org/T218037 (10elukey) Filed https://github.com/matomo-org/matomo/issues/14286 since in debian.piwik.org there is only the package for 3.8.1. Since 3.9.1 contains security fixes as well bette... [12:36:05] 10Analytics, 10Analytics-Kanban, 10Patch-For-Review, 10User-Elukey: Upgrade matomo1001 to latest upstream - https://phabricator.wikimedia.org/T218037 (10elukey) [13:27:55] a-team: logging off earlier today, everything seems quiet from what I can see. I'll be afk from late afteroon to sunday morning more or less (EU time), Andrew already knows it :) [13:28:21] if anybody needs me please ping me during the next 30 mins :) [13:39:30] byeee elukey :] [14:56:51] 10Analytics, 10Analytics-Kanban, 10Datasets-General-or-Unknown, 10Patch-For-Review, and 2 others: Pageview dumps incorrectly formatted, need to escape special characters - https://phabricator.wikimedia.org/T144100 (10Nuria) [14:57:54] 10Analytics, 10Analytics-Kanban, 10MediaWiki-Vagrant, 10Patch-For-Review: Vagrant initial provision fails on NodeJS version mismatch - https://phabricator.wikimedia.org/T218238 (10Nuria) [14:58:09] 10Analytics, 10Analytics-Kanban, 10EventBus, 10Patch-For-Review, 10Services (watching): EventGate wikimedia implementation should emit rdkafka stats - https://phabricator.wikimedia.org/T218305 (10Nuria) 05Open→03Resolved [14:58:12] 10Analytics, 10Analytics-EventLogging, 10EventBus, 10Core Platform Team Backlog (Watching / External), and 2 others: Modern Event Platform: Stream Intake Service: Implementation - https://phabricator.wikimedia.org/T206785 (10Nuria) [15:28:16] (03PS2) 10Mforns: Modify mediawiki/history/druid job to ingest a simpler data set to druid [analytics/refinery] - 10https://gerrit.wikimedia.org/r/499917 (https://phabricator.wikimedia.org/T211173) [16:01:18] ping fdans milimetric standdduppp [17:05:45] a-team, making turnilo config explicit, did not fix the issue with edits_hourly... [17:06:30] now trying to make a small version of the mediawiki_history in my database to make testing faster... [17:06:49] mforns I can help rubber duck, but I need a few minutes, are you working longer tonight [17:09:41] 10Analytics, 10Research, 10Article-Recommendation, 10Patch-For-Review: Generate article recommendations in Hadoop for use in production - https://phabricator.wikimedia.org/T210844 (10bmansurov) [17:13:48] elukey: o/ Could you take a look at comments here: https://gerrit.wikimedia.org/r/c/analytics/refinery/+/496885 [17:13:56] elukey: I'd appreciate your input. [17:13:58] Thanks! [17:27:29] milimetric, yes, for a couple more hours [17:27:50] milimetric, please ping when you're available :] [17:33:41] ok mforns, ready, cave? [17:33:57] milimetric, yes, omw [17:34:01] bmansurov: he's off today, maybe send an email so he doesn't lose it [17:57:45] milimetric: ok, thanks [19:35:46] 10Analytics, 10EventBus, 10Core Platform Team (Modern Event Platform (TEC2)), 10Core Platform Team Backlog (Watching / External), 10Services (watching): Schema Registry HTTP Service - https://phabricator.wikimedia.org/T219552 (10mobrovac) [19:36:24] 10Analytics, 10EventBus, 10Operations, 10vm-requests, and 3 others: Create schema[12]00[12] (schema.svc.{eqiad,codfw}.wmnet) - https://phabricator.wikimedia.org/T219556 (10mobrovac) [20:25:42] 10Analytics, 10Analytics-Wikimetrics, 10Epic: EPIC: Productionizing Wikimetrics {dove} - https://phabricator.wikimedia.org/T76726 (10sbassett) [20:25:47] 10Analytics, 10Analytics-Wikimetrics, 10Security-Team-Reviews, 10Security: security review of Wikimetrics - https://phabricator.wikimedia.org/T76782 (10sbassett) 05Stalled→03Resolved p:05Normal→03Lowest [20:56:33] mforns: still fighting with turilo? [20:56:38] ahem turnilo [21:14:57] 10Analytics, 10Analytics-EventLogging, 10Analytics-Kanban, 10Fundraising-Backlog, and 2 others: Fix EventLogging schemas that use array for items type - https://phabricator.wikimedia.org/T218617 (10Nuria) So, from : https://tools.ietf.org/html/draft-zyp-json-schema-03#section-5.5 "When this attribute val... [21:38:42] so what kind of implications (if any) does this have on our webrequest analytics pipeline ? https://phabricator.wikimedia.org/phame/post/view/115/switching_production_traffic_to_apache_traffic_server/ [21:51:37] HaeB: none, that is a backend cache [21:51:51] HaeB: frontend cache is varnish [21:52:41] HaeB: while things are moved and puppet code merged and systems restarted we might see some issues operationally but it should have no effect on data [21:56:19] nuria: i see, thanks - so we are only replacing varnish on the backend. (i was also thinking about e.g. the varnish code that populates the x-analytics field, but i guess that's all frontend?) [21:56:36] HaeB: yes [22:07:41] 10Analytics, 10Product-Analytics, 10MW-1.33-notes (1.33.0-wmf.21; 2019-03-12), 10Patch-For-Review: Standardize datetimes/timestamps in the Data Lake - https://phabricator.wikimedia.org/T212529 (10Neil_P._Quinn_WMF) @Ottomata, @JAllemandou it sounds like the long-term vision you have is using ISO strings f...