[00:09:51] 10Analytics, 10DC-Ops, 10Operations, 10decommission, 10ops-eqiad: Decommission old Kafka analytics brokers: kafka1012,kafka1013,kafka1014,kafka1020,kafka1022,kafka1023 - https://phabricator.wikimedia.org/T226517 (10Jclark-ctr) [01:30:59] 10Analytics, 10Editing-team, 10observability, 10Performance-Team (Radar): VE edit data stopped at ~2019-11-24Z01:25 - https://phabricator.wikimedia.org/T239121 (10Krinkle) Moving to our Radar as the MW parts that we're familiar with seem to be working fine. Next suspect seems to the the Varnish/Kafka/stats... [02:38:31] 10Analytics, 10Better Use Of Data, 10Product-Analytics: Identify next steps needed for Product Analytics to approve switching mw.user.sessionId back to session-cookie persistence - https://phabricator.wikimedia.org/T238434 (10Krinkle) [07:46:10] 10Analytics, 10Operations, 10ops-eqiad: Degraded RAID on an-worker1089 - https://phabricator.wikimedia.org/T239365 (10elukey) [07:46:13] 10Analytics, 10Operations, 10ops-eqiad: Degraded RAID on an-worker1089 - https://phabricator.wikimedia.org/T239365 (10elukey) Thanks a lot! [07:48:09] this is the root partition --^ [07:48:22] we have a hardware raid1, so it will keep going fine [08:03:54] Hi elukey :) [08:04:48] bonjour! [08:13:37] very weird, I can't find the commit that caused https://github.com/apache/incubator-superset/issues/8676 [08:14:27] I am checking https://github.com/apache/incubator-superset/blame/master/superset/connectors/druid/models.py and all seems the sme [08:14:30] *same [08:15:16] :( [08:19:30] but there is clearly something weird, def get_filters(cls, raw_filters, num_cols, columns_dict) -> "Filter" is not right since I found that sometimes it returns a bool :D [08:20:26] 10Analytics-EventLogging, 10Analytics-Kanban: Sunset MySQL data store for eventlogging - https://phabricator.wikimedia.org/T159170 (10Marostegui) As per my chat with Luca: https://wikitech.wikimedia.org/w/index.php?title=MariaDB%2Fmisc&type=revision&diff=1846268&oldid=1831838 [08:38:48] elukey: would you have a minute for naming bikeshedding? [08:39:33] joal: need to go afk very soon but if quick yes [08:39:42] should be fast [08:39:52] elukey: https://gerrit.wikimedia.org/r/#/c/analytics/refinery/+/553160/4/python/refinery/util.py@133 [08:40:25] actually elukey, I'd like you to review that patch as it touches stuff you wrote - I can wait and discuss later :) [08:41:23] sure will try to read them later :) [08:41:30] ttl! [08:41:33] Bye!P [09:49:39] (03CR) 10Joal: "More comments, patch to come" (038 comments) [analytics/refinery] - 10https://gerrit.wikimedia.org/r/553160 (https://phabricator.wikimedia.org/T239127) (owner: 10Joal) [09:49:58] (03PS8) 10Joal: Add slot, slot_roles and wbc_entity_usage to sqoop [analytics/refinery] - 10https://gerrit.wikimedia.org/r/553160 (https://phabricator.wikimedia.org/T239127) [10:08:55] (03PS4) 10Joal: Update geoeditors_daily - new dimensions and name [analytics/refinery] - 10https://gerrit.wikimedia.org/r/552510 (https://phabricator.wikimedia.org/T238855) [10:12:20] (03PS9) 10Joal: Add new tables and features to sqoop script [analytics/refinery] - 10https://gerrit.wikimedia.org/r/553160 (https://phabricator.wikimedia.org/T239127) [10:12:33] (03PS10) 10Joal: Add new tables and features to sqoop script [analytics/refinery] - 10https://gerrit.wikimedia.org/r/553160 (https://phabricator.wikimedia.org/T239127) [10:17:54] 10Analytics, 10WMDE-Analytics-Engineering, 10User-GoranSMilovanovic: Public data set review for T237728 - https://phabricator.wikimedia.org/T239393 (10GoranSMilovanovic) [10:23:37] (03PS11) 10Joal: Add new tables and features to sqoop script [analytics/refinery] - 10https://gerrit.wikimedia.org/r/553160 (https://phabricator.wikimedia.org/T239127) [10:28:22] (03PS2) 10Joal: Add newly sqooped tables to hive and mw-load job [analytics/refinery] - 10https://gerrit.wikimedia.org/r/553405 (https://phabricator.wikimedia.org/T239127) [11:21:40] (03CR) 10Elukey: "Left some comments about nomenclature, not about the code, to unblock Joseph.. If needed I'll do a second pass testing the code. Please ma" (034 comments) [analytics/refinery] - 10https://gerrit.wikimedia.org/r/553160 (https://phabricator.wikimedia.org/T239127) (owner: 10Joal) [11:42:39] 10Analytics, 10Release Pipeline, 10Patch-For-Review, 10Release-Engineering-Team (Pipeline), 10Services (watching): Migrate EventStreams to k8s deployment pipeline - https://phabricator.wikimedia.org/T238658 (10akosiaris) >>! In T238658#5675793, @Ottomata wrote: > I can't seem to develop this locally due... [12:15:11] elukey: Thanks for the review :) [12:15:52] elukey: about the method name (get_dbnames_from_dblist), I like better get_dbnames_from_mw_config [12:16:12] I assume it would work for you as you suggested it :D [12:17:29] +1! [12:19:08] lunch! [12:24:21] (03PS12) 10Joal: Add new tables and features to sqoop script [analytics/refinery] - 10https://gerrit.wikimedia.org/r/553160 (https://phabricator.wikimedia.org/T239127) [12:27:29] (03PS3) 10Joal: Add newly sqooped tables to hive and mw-load job [analytics/refinery] - 10https://gerrit.wikimedia.org/r/553405 (https://phabricator.wikimedia.org/T239127) [12:45:02] (03CR) 10Joal: "analytics-mysql script works (tested on various databases, including x1 ones)" (034 comments) [analytics/refinery] - 10https://gerrit.wikimedia.org/r/553160 (https://phabricator.wikimedia.org/T239127) (owner: 10Joal) [13:30:54] 10Analytics, 10Discovery, 10Event-Platform, 10Wikidata, and 3 others: Log Wikidata Query Service queries to the event gate infrastructure - https://phabricator.wikimedia.org/T101013 (10dcausse) @JAllemandou no, I moved this done too early and it was closed before being available. The code is not yet deploy... [13:32:01] 10Analytics, 10Discovery, 10Event-Platform, 10Wikidata, and 3 others: Log Wikidata Query Service queries to the event gate infrastructure - https://phabricator.wikimedia.org/T101013 (10dcausse) 05Resolved→03Open [13:56:35] 10Analytics, 10Analytics-Kanban: Create kerberos principals for users - https://phabricator.wikimedia.org/T237605 (10MGerlach) I would also like to request access. username: mgerlach Thanks. [14:14:28] 10Analytics, 10Analytics-Kanban: Create kerberos principals for users - https://phabricator.wikimedia.org/T237605 (10elukey) >>! In T237605#5699960, @MGerlach wrote: > I would also like to request access. username: mgerlach > Thanks. ` elukey@krb1001:~$ sudo manage_principals.py create mgerlach --email_addres... [16:38:38] (03PS6) 10Mforns: Add data quality metric: traffic variations per country [analytics/refinery] - 10https://gerrit.wikimedia.org/r/550498 (https://phabricator.wikimedia.org/T234484) [16:38:52] (03CR) 10Mforns: Add data quality metric: traffic variations per country (031 comment) [analytics/refinery] - 10https://gerrit.wikimedia.org/r/550498 (https://phabricator.wikimedia.org/T234484) (owner: 10Mforns) [17:12:08] joal: hola! [17:12:39] hi nuria [17:13:04] joal: for the scoop [17:13:15] we're in standup [17:14:28] ah yes, will join for a sec [17:14:35] nuria: sqoop has failed for content table: more rows in that table than in the revision one - I need to tweak the jobs [17:29:05] 10Analytics, 10Product-Analytics, 10SDC General, 10Wikidata: Data about how many file pages on Commons contain at least one structured data element - https://phabricator.wikimedia.org/T238878 (10Nuria) Can someone explain why the content table is as large as the revision table? I though these tables were... [17:35:00] (03PS13) 10Joal: Add new tables and features to sqoop script [analytics/refinery] - 10https://gerrit.wikimedia.org/r/553160 (https://phabricator.wikimedia.org/T239127) [17:35:50] (03PS4) 10Joal: Add newly sqooped tables to hive and mw-load job [analytics/refinery] - 10https://gerrit.wikimedia.org/r/553405 (https://phabricator.wikimedia.org/T239127) [17:49:19] Gone for diner [17:53:32] * elukey ofF! [18:03:38] 10Analytics, 10Analytics-Kanban: Create kerberos principals for users - https://phabricator.wikimedia.org/T237605 (10Miriam) Hi! Can I have access too please? My username is mirrys @tizianopiccardi you might want to request this too. [18:07:49] 10Analytics, 10Product-Analytics, 10SDC General, 10Wikidata: Data about how many file pages on Commons contain at least one structured data element - https://phabricator.wikimedia.org/T238878 (10daniel) >>! In T238878#5700408, @Nuria wrote: > Can someone explain why the content table is as large as the rev... [18:49:49] 10Analytics, 10Analytics-Kanban: Create kerberos principals for users - https://phabricator.wikimedia.org/T237605 (10elukey) >>! In T237605#5700493, @Miriam wrote: > Hi! Can I have access too please? My username is mirrys ` elukey@krb1001:~$ sudo manage_principals.py create mirrys --email_address=mredi@wikime...