[08:13:14] 10Quarry: No data after 20170517193000 available via Quarry from tables (recentchanges, revision, logging) for several Mediawiki databases (svwiki_p, fiwiki_p, nowiki_p, ...) - https://phabricator.wikimedia.org/T165705#3274765 (10Larske) [09:48:48] 10Quarry: No data after 20170517193000 available via Quarry from tables (recentchanges, revision, logging) for several Mediawiki databases (svwiki_p, fiwiki_p, nowiki_p, ...) - https://phabricator.wikimedia.org/T165705#3275136 (10jcrespo) 05Open>03Resolved a:03jcrespo You can check the replication lag at... [09:51:14] 10Quarry: No data after 20170517193000 available via Quarry from tables (recentchanges, revision, logging) for several Mediawiki databases (svwiki_p, fiwiki_p, nowiki_p, ...) - https://phabricator.wikimedia.org/T165705#3275144 (10jcrespo) Note that only 1 server (c1) was affected. c2 was unaffected, and that co... [09:58:25] (03CR) 10Ottomata: [WIP] UDF to tag requests (036 comments) [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/353287 (https://phabricator.wikimedia.org/T164021) (owner: 10Nuria) [10:32:33] 10Analytics, 06Operations, 10Traffic, 15User-Elukey: Update Varnishkafka to support TLS encryption/authentication - https://phabricator.wikimedia.org/T165736#3275487 (10elukey) [10:33:20] 10Analytics-Cluster, 06Analytics-Kanban: Provision new Kafka cluster(s) with security features - https://phabricator.wikimedia.org/T152015#3275502 (10Ottomata) Luca and I have started an etherpad to plan work here: https://etherpad.wikimedia.org/p/analytics-ops-kafka These will be converted to phab tasks as w... [10:33:54] 10Analytics, 06Operations, 10Traffic, 15User-Elukey: Update Varnishkafka to support TLS encryption/authentication - https://phabricator.wikimedia.org/T165736#3275506 (10elukey) [10:35:09] 10Analytics, 10ChangeProp, 10EventBus, 06Services (later), 15User-mobrovac: [EPIC] Develop a JobQueue backend based on EventBus - https://phabricator.wikimedia.org/T157088#3275507 (10Ottomata) Ya, if we are going to do this, we should get a procurement ticket up early next week. Thanks! [10:46:43] 10Analytics, 10Analytics-Cluster, 06Operations, 10Traffic, 15User-Elukey: Encrypt Kafka traffic, and restrict access via ACLs - https://phabricator.wikimedia.org/T121561#3275543 (10elukey) [10:55:17] 10Quarry: No data after 20170517193000 available via Quarry from tables (recentchanges, revision, logging) for several Mediawiki databases (svwiki_p, fiwiki_p, nowiki_p, ...) - https://phabricator.wikimedia.org/T165705#3275551 (10Larske) Thanks for the prompt response with explanation on what was ongoing. The c... [11:00:42] 10Quarry: No data after 20170517193000 available via Quarry from tables (recentchanges, revision, logging) for several Mediawiki databases (svwiki_p, fiwiki_p, nowiki_p, ...) - https://phabricator.wikimedia.org/T165705#3275557 (10jcrespo) I highly recomend your code to integrate some kind of check for the heart... [14:51:31] 06Analytics-Kanban, 10Analytics-Wikistats: Backend for wikistats 2.0 - https://phabricator.wikimedia.org/T156384#2973128 (10bd808) I see that this epic has #wmcs-team as a dependency on https://www.mediawiki.org/wiki/Wikimedia_Technology/Goals/2017-18_Q1#Analytics_Engineering. Is there a specific ask of Cloud... [14:52:44] (03PS3) 10Nuria: [WIP] UDF to tag requests [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/353287 (https://phabricator.wikimedia.org/T164021) [14:55:09] (03CR) 10jerkins-bot: [V: 04-1] [WIP] UDF to tag requests [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/353287 (https://phabricator.wikimedia.org/T164021) (owner: 10Nuria) [14:55:29] (03CR) 10Nuria: [WIP] UDF to tag requests (034 comments) [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/353287 (https://phabricator.wikimedia.org/T164021) (owner: 10Nuria) [14:57:38] 06Analytics-Kanban, 10Analytics-Wikistats: Backend for wikistats 2.0 - https://phabricator.wikimedia.org/T156384#3276538 (10Nuria) Just support, we plan to deploy a storage (druid? clickhouse? other?) to labs with the data from data lake for public access, I think labs team support would mean doing code revie... [15:55:59] in pagecounts-ez, does en.z include en.m? [17:08:04] 10Analytics, 06Research-and-Data: clientIP needs to be collected as part of the schema or ... - https://phabricator.wikimedia.org/T165678#3277074 (10schana) @leila I'm moving this to done based on the latest emails. Let me know if anything further is required. [17:52:56] Hi there, I would highly appreciate if anyone could provide a suggestion on the following: I need a storage resource that is shared between production (stat1003, namely) and Labs instances; i.e. a place where I can store results obtained from production and reach them from my Labs instance, and vice versa. Any ideas? Thanks so much! [19:20:32] 06Analytics-Kanban, 10Analytics-Wikistats: Backend for wikistats 2.0 - https://phabricator.wikimedia.org/T156384#3277280 (10bd808) @Nuria thanks for the clarification. I think we can handle helping with that. If you don't have hardware budget for deploying the new datastore we'll probably have to scrounge aro... [22:21:03] 10Analytics-EventLogging, 06Analytics-Kanban, 10DBA, 05WMF-NDA: Drop tables with no events in last 90 days. - https://phabricator.wikimedia.org/T161855#3145199 (10Tbayer) @Ottomata: Do we have a list of the 124 tables that were dropped? More generally, the script should log deletions if it doesn't already.... [23:39:50] musikanimal: https://twitter.com/sarahjeong/status/865703724135481344/photo/1