[04:59:39] (03PS2) 10Ladsgroup: Send aggregated entity usage data per dbname and per aspect as well [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/688216 (https://phabricator.wikimedia.org/T279762) [05:21:14] (03PS3) 10Ladsgroup: Send aggregated entity usage data per dbname and per aspect as well [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/688216 (https://phabricator.wikimedia.org/T279762) [05:22:00] (03CR) 10jerkins-bot: [V: 04-1] Send aggregated entity usage data per dbname and per aspect as well [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/688216 (https://phabricator.wikimedia.org/T279762) (owner: 10Ladsgroup) [05:35:44] (03PS4) 10Ladsgroup: Send aggregated entity usage data per dbname and per aspect as well [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/688216 (https://phabricator.wikimedia.org/T279762) [06:29:13] 10Analytics-EventLogging, 10Analytics-Radar: eventlogging Dockerfile doesn't work - https://phabricator.wikimedia.org/T208679 (10santhosh) For the modern eventlogging platform, here is the Dockerfile you can use to get eventlogging dev server running. `lang=Dockerfile FROM node:10-buster WORKDIR /opt/eventl... [06:29:19] (03PS7) 10Ladsgroup: Add scala job for reliability metrics of Wikidata [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/686066 (https://phabricator.wikimedia.org/T274413) [06:30:15] (03CR) 10Ladsgroup: "Thank you so much for the detailed and thorough review and the suggestions. I applied all (at least I think I did :D)" (034 comments) [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/686066 (https://phabricator.wikimedia.org/T274413) (owner: 10Ladsgroup) [06:44:57] (03CR) 10Ladsgroup: Send aggregated entity usage data per dbname and per aspect as well (031 comment) [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/688216 (https://phabricator.wikimedia.org/T279762) (owner: 10Ladsgroup) [06:46:11] hello folks [06:46:17] I created https://gerrit.wikimedia.org/r/c/operations/puppet/+/688778 to add a new HDFS Namenode alert [06:46:33] as reminder to bump the heap size after crossing a certain threshold [06:46:53] the next bump is 70M, we are still far from it but better be safe :) [06:48:11] (03CR) 10Joal: [C: 03+1] "Thank you for applying the suggestion :) Ready to merged from code perspective for me, can you please confirm you have tested the job on t" [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/686066 (https://phabricator.wikimedia.org/T274413) (owner: 10Ladsgroup) [06:52:18] I'll be on-and-off this morning, and fully on this afternoon :) [06:55:55] hnowlan: how is going on cassandra3-repair side? [07:13:50] (03CR) 10Ladsgroup: "> Patch Set 7: Code-Review+1" [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/686066 (https://phabricator.wikimedia.org/T274413) (owner: 10Ladsgroup) [07:14:15] (03PS8) 10Ladsgroup: Add scala job for reliability metrics of Wikidata [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/686066 (https://phabricator.wikimedia.org/T274413) [07:17:09] (03PS2) 10Ladsgroup: oozie: Add oozie job for gather wikidata reliability metrics [analytics/refinery] - 10https://gerrit.wikimedia.org/r/686383 (https://phabricator.wikimedia.org/T274413) [07:17:36] (03CR) 10Ladsgroup: oozie: Add oozie job for gather wikidata reliability metrics (032 comments) [analytics/refinery] - 10https://gerrit.wikimedia.org/r/686383 (https://phabricator.wikimedia.org/T274413) (owner: 10Ladsgroup) [08:51:51] joal2: still going! [08:54:52] 10Analytics, 10WMDE-Analytics-Engineering, 10WMDE-New-Editors-Banner-Campaigns: Drop old WMDEBanner events from Hive - https://phabricator.wikimedia.org/T281300 (10GoranSMilovanovic) @Ottomata @Milimetric > Do you need historical data (older than 90 days) in the event.wmdebanner* tables? I can see the tas... [09:53:21] (03CR) 10Silvan Heintze: [C: 03+2] "LGTM" (031 comment) [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/688216 (https://phabricator.wikimedia.org/T279762) (owner: 10Ladsgroup) [09:55:17] (03Merged) 10jenkins-bot: Send aggregated entity usage data per dbname and per aspect as well [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/688216 (https://phabricator.wikimedia.org/T279762) (owner: 10Ladsgroup) [09:57:47] (03PS1) 10Ladsgroup: Send aggregated entity usage data per dbname and per aspect as well [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/688305 (https://phabricator.wikimedia.org/T279762) [09:57:53] (03CR) 10Ladsgroup: [C: 03+2] Send aggregated entity usage data per dbname and per aspect as well [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/688305 (https://phabricator.wikimedia.org/T279762) (owner: 10Ladsgroup) [09:58:56] (03Merged) 10jenkins-bot: Send aggregated entity usage data per dbname and per aspect as well [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/688305 (https://phabricator.wikimedia.org/T279762) (owner: 10Ladsgroup) [10:22:20] 10Analytics, 10Analytics-EventLogging, 10Analytics-Kanban, 10Better Use Of Data, and 3 others: Determine which remaining legacy EventLogging schemas need to be migrated or decommissioned - https://phabricator.wikimedia.org/T282131 (10Gilles) [10:35:23] * elukey lunch! [11:06:44] (03PS19) 10Kosta Harlan: Create structured_task/article/link_suggestion_interaction schema [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/681052 (https://phabricator.wikimedia.org/T278177) [11:24:55] 10Analytics, 10Analytics-Kanban, 10Cassandra: Store AQS schema and grants in git - https://phabricator.wikimedia.org/T278701 (10hnowlan) 05Open→03Resolved [11:24:57] 10Analytics, 10Cassandra: Cassandra3 migration for Analytics AQS - https://phabricator.wikimedia.org/T249755 (10hnowlan) [12:26:25] (03PS20) 10Kosta Harlan: Create structured_task/article/link_suggestion_interaction schema [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/681052 (https://phabricator.wikimedia.org/T278177) [13:03:53] 10Analytics, 10WMDE-Analytics-Engineering, 10WMDE-New-Editors-Banner-Campaigns: Drop old WMDEBanner events from Hive - https://phabricator.wikimedia.org/T281300 (10kai.nissen) @Ottomata Sorry for keeping you waiting. The schemas prefixed by `WMDE` are used for either fundraising (`event.wmdebannersizeissue`... [13:06:26] 10Analytics, 10Event-Platform: Schema tests should validate examples - https://phabricator.wikimedia.org/T275143 (10Ottomata) There's no promotion process; you'd just make a new schema and new instrumentation that calls `mw.eventLog.submit` (or whatever interface Metrics Platform cc @jlinehan advises you to) i... [13:08:20] 10Analytics, 10Analytics-EventLogging, 10QuickSurveys, 10WMDE-TechWish, 10Readers-Web-Backlog (Tracking): QuickSurveys should show an error when response is blocked - https://phabricator.wikimedia.org/T256463 (10Ottomata) 1. Yeah ask @jlinehan I think. 2. See {T263049} [13:09:50] 10Analytics, 10Analytics-Kanban, 10WMDE-TechWish: Deployment access request for some analytics repos - https://phabricator.wikimedia.org/T274880 (10Ottomata) {T279089} [13:10:33] 10Analytics, 10Analytics-EventLogging, 10Vector: EventLogging revision popup gets hidden behind content in Vector - https://phabricator.wikimedia.org/T282550 (10Aklapper) [13:18:35] hello teammm [13:45:22] yoohoo [13:46:46] 10Analytics, 10Analytics-EventLogging, 10Analytics-Kanban, 10Better Use Of Data, and 3 others: Determine which remaining legacy EventLogging schemas need to be migrated or decommissioned - https://phabricator.wikimedia.org/T282131 (10Ottomata) [13:47:49] ottomata: I'm responding to the WMDEBanner task, I looked and could not find any task for migration of those schemas to EP [13:47:56] ottomata: I will create one, OK? [13:48:02] 10Analytics, 10Analytics-EventLogging, 10Analytics-Kanban, 10Better Use Of Data, and 3 others: Determine which remaining legacy EventLogging schemas need to be migrated or decommissioned - https://phabricator.wikimedia.org/T282131 (10Ottomata) From @MMiller_WMF: > But we should migrate and keep these: > -... [13:48:16] ottomata: Couldn't find them in the migration spreadsheet either, should I add them? [13:49:30] 10Analytics, 10Analytics-EventLogging, 10Analytics-Kanban, 10Better Use Of Data, and 3 others: Determine which remaining legacy EventLogging schemas need to be migrated or decommissioned - https://phabricator.wikimedia.org/T282131 (10Ottomata) [13:50:51] 10Analytics, 10Analytics-EventLogging, 10Analytics-Kanban, 10Better Use Of Data, and 3 others: Determine which remaining legacy EventLogging schemas need to be migrated or decommissioned - https://phabricator.wikimedia.org/T282131 (10Ottomata) From @kai.nissen in https://phabricator.wikimedia.org/T281300#7... [13:55:06] 10Analytics, 10Event-Platform, 10Platform Team Workboards (Clinic Duty Team): Add expiry info to mediawiki.page-restrictions-change stream - https://phabricator.wikimedia.org/T282057 (10AMooney) [14:00:07] 10Analytics, 10Event-Platform: WMDEBanner* Event Platform Migration - https://phabricator.wikimedia.org/T282562 (10mforns) [14:00:33] 10Analytics, 10Event-Platform: WMDEBanner* Event Platform Migration - https://phabricator.wikimedia.org/T282562 (10mforns) [14:00:36] 10Analytics, 10Analytics-EventLogging, 10Analytics-Kanban, 10Better Use Of Data, and 5 others: Migrate legacy metawiki schemas to Event Platform - https://phabricator.wikimedia.org/T259163 (10mforns) [14:03:09] 10Analytics, 10WMDE-Analytics-Engineering, 10WMDE-New-Editors-Banner-Campaigns: Drop old WMDEBanner events from Hive - https://phabricator.wikimedia.org/T281300 (10mforns) @kai.nissen, @GoranSMilovanovic and @Merle_von_Wittich_WMDE Thanks all for the details and confirmation! For each of the schemas prefixe... [14:03:41] mforns: in interview, they are there and i marked them [14:03:41] no task yet [14:03:50] k [14:03:53] just https://phabricator.wikimedia.org/T282131 [14:04:27] I created this one: https://phabricator.wikimedia.org/T282562 [14:13:21] 10Analytics, 10WMDE-Analytics-Engineering, 10WMDE-New-Editors-Banner-Campaigns: Drop old WMDEBanner events from Hive - https://phabricator.wikimedia.org/T281300 (10mforns) Oh! If you ever want to keep WMDEBanner* data (or any other Event Platform stream) for longer than 90 days, please add the schema to the... [14:32:36] Hi mforns - is there q a train today? [14:33:15] joal2: haven't checked whether there's stuff to deploy, but sure I was planning to do a train, yes [14:34:08] ack - will see with Amir1 if he can change his CR - He reacted fast enough that he can be in this week trqin so the version number I gave him is wrong :) [14:44:08] k [14:53:01] (03CR) 10Joal: [C: 03+2] "Merging for today's train." [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/686066 (https://phabricator.wikimedia.org/T274413) (owner: 10Ladsgroup) [14:57:43] (03PS3) 10Joal: oozie: Add oozie job for gather wikidata reliability metrics [analytics/refinery] - 10https://gerrit.wikimedia.org/r/686383 (https://phabricator.wikimedia.org/T274413) (owner: 10Ladsgroup) [15:00:21] Amir1: I have updated your patch to update the refinery version to the deployed today - you'r going with today's train :) [15:03:35] mforns: etherpad updated :) [15:03:55] thanks joal2! [15:06:28] (03Merged) 10jenkins-bot: Add scala job for reliability metrics of Wikidata [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/686066 (https://phabricator.wikimedia.org/T274413) (owner: 10Ladsgroup) [15:08:59] ottomata: so, I believe we are free to proceed with the deletion of data older than 90 days under /wmf/data/event [15:09:09] ottomata: wanna do it today? [15:10:38] ottomata: also, I wanted to deploy VirtualPageView's migration to testwiki, but today's next backport window is at 1am my time, if you're OK with waiting until tomorrow I'll do it then, otherwise we can pair on that today [15:17:57] mforns: i'm in meetings pretty much all day today, so let's do deletion tomorrow [15:18:05] 10Analytics, 10Analytics-Kanban, 10WMDE-TechWish: Deployment access request for some analytics repos - https://phabricator.wikimedia.org/T274880 (10mforns) @awight > Are we also discussing deployment? If so, automatic deployment would be nice, or else my team would need some way to scap etc. . Reportupdater... [15:18:10] ottomata: OK, np! [15:18:18] testwiki migration: i'll have a window somewhere to deploy it if you like [15:18:26] you can make a patch and i can ping to see if you are around and deploy [15:18:59] ottomata: ping me if you have time, the patch is ready: https://gerrit.wikimedia.org/r/c/operations/mediawiki-config/+/685928 [15:19:02] if we do'nt get to that today we can do tomorrow too [15:19:03] ok [15:19:10] k, no rush! [15:28:49] 10Analytics, 10Analytics-Kanban, 10Machine-Learning-Team, 10ORES, and 2 others: Generate dump of scored-revisions from 2018-2020 for Wikis except English Wikipedia - https://phabricator.wikimedia.org/T280107 (10JAllemandou) Hi - I am trying to make this happen. Data for the `wikidata` project is very big... [15:30:32] 10Analytics, 10Event-Platform: WMDEBanner* Event Platform Migration - https://phabricator.wikimedia.org/T282562 (10Ottomata) a:03mforns [15:32:03] 10Analytics, 10Analytics-Kanban, 10Machine-Learning-Team, 10ORES, and 2 others: Generate dump of scored-revisions from 2018-2020 for Wikis except English Wikipedia - https://phabricator.wikimedia.org/T280107 (10elukey) >>! In T280107#7078709, @JAllemandou wrote: > Hi - I am trying to make this happen. > D... [15:46:37] * elukey afk! [15:53:51] (03PS1) 10Mforns: Update changelog.md for v0.1.11 [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/689112 [15:54:07] a-team i'm in the tech managers meeting today discussing for some planning/OKR stuff so will miss standup today [15:54:18] will be there for retro othouogh [15:54:22] (03CR) 10Mforns: [V: 03+2 C: 03+2] Update changelog.md for v0.1.11 [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/689112 (owner: 10Mforns) [16:04:31] 10Analytics, 10Analytics-EventLogging, 10Wikimedia-Developer-Portal, 10Documentation: Clean up EventLogging Schema: pages on meta - https://phabricator.wikimedia.org/T282584 (10Aklapper) [16:24:58] 10Quarry, 10cloud-services-team (Kanban): Support queries against Quarry's own database and ToolsDB - https://phabricator.wikimedia.org/T151158 (10aborrero) p:05Triage→03Low a:03Bstorm [16:30:25] (03PS1) 10Martaannaj: Create wd_propertysuggester/client_ab_testing and wd_propertysuggester/server_ab_testing [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/689152 [16:30:33] I think we'll miss a bit of retro too, manager's meeting is running late [16:30:41] (03PS1) 10Maven-release-user: Add refinery-source jars for v0.1.11 to artifacts [analytics/refinery] - 10https://gerrit.wikimedia.org/r/689153 [16:41:21] 10Analytics-Radar, 10Data-Services, 10cloud-services-team (Kanban): labstore1006 persistent high iowait - https://phabricator.wikimedia.org/T263329 (10aborrero) 05Open→03Resolved a:03aborrero This happens from time to time. These aren't high performant boxes anyway. We don't have a more specific fix to... [17:26:18] (03CR) 10Mforns: [V: 03+2 C: 03+2] Add refinery-source jars for v0.1.11 to artifacts [analytics/refinery] - 10https://gerrit.wikimedia.org/r/689153 (owner: 10Maven-release-user) [17:26:50] !log deployed refinery-source v0.1.11 [17:26:52] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [18:41:47] !log starting refinery deployment (matching source v0.1.11) [18:41:49] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [18:46:30] 10Quarry, 10cloud-services-team (Kanban): Support queries against Quarry's own database and ToolsDB - https://phabricator.wikimedia.org/T151158 (10Bstorm) There's a clear path to adding database patterns to talk to toolsdb. The quarry database is how quarry works in dev mode, so it clearly works. However, I th... [18:53:26] ottomata: testing it now [18:54:04] ottomata: I don't think the Popups extension is deployed to testwiki, but I'll use the dev console to send events [18:54:53] k [18:57:03] ottomata: confirmed the event landed in kafka! [18:59:30] yeheaw [19:00:19] ottomata: will create a patch for prod, then [19:09:27] https://gerrit.wikimedia.org/r/c/operations/mediawiki-config/+/689205 [19:10:06] I guess we can do it when we both have some free time, in case of fireworks [19:13:13] yeah [19:13:24] mforns: i wonder if we should do that one a little more incrementally [19:13:34] it is pretty high volume (relatively) [19:13:45] maybe go to group0 and group1 wikis first? [19:13:48] before we go to all? [19:29:19] ottomata: oh, makes sense, will change the patch [19:53:21] !log finished refinery deployment (matching source v0.1.11) [19:53:23] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [19:54:30] 10Analytics, 10Analytics-Kanban, 10WMDE-TechWish: Deployment access request for some analytics repos - https://phabricator.wikimedia.org/T274880 (10awight) >>! In T274880#7078665, @mforns wrote: > Do you have access to the cluster? Meaning can any of you ssh into an-launcher1002.eqiad.wmnet? We don't have a... [19:56:19] (03CR) 10Mforns: [V: 03+2 C: 03+2] "Merging for deployment train" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/686383 (https://phabricator.wikimedia.org/T274413) (owner: 10Ladsgroup) [19:59:40] !log repeating refinery deployment (matching source v0.1.11) - missed unmerged change [19:59:41] razzi: will be afew mins late to sync but will be there [19:59:43] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [19:59:49] ottomata: sg [20:12:30] 10Analytics, 10Analytics-Kanban, 10WMDE-TechWish: Deployment access request for some analytics repos - https://phabricator.wikimedia.org/T274880 (10mforns) >>! In T274880#7079790, @awight wrote: > We don't have access. A few members of my team can ssh to the stat* machines, in case that makes it simpler (e.... [20:13:04] fdans: is the last pageview-historical alert also related to backfilling? [20:14:53] mforns: yes, my bad [20:15:07] these alerts seem to be delayed by a bit [20:16:46] fdans: no problemo, just making sure [21:00:18] !log finished repeated refinery deployment (matching source v0.1.11) - missed unmerged change [21:00:20] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [21:00:51] 10Analytics-Clusters, 10Analytics-Kanban: Upgrade the Hadoop masters to Debian Buster - https://phabricator.wikimedia.org/T278423 (10razzi) Ok, here's my new plan, including draining the cluster and using safemode to take a stable fsimage. If this looks good to you @elukey we can pick a day at least a week awa... [21:43:49] 10Analytics: Superset query timeouts for charts using Druid table - https://phabricator.wikimedia.org/T282618 (10cchen) [22:57:21] 10Analytics: Superset query timeouts for charts using Druid table - https://phabricator.wikimedia.org/T282618 (10kzimmerman) Interestingly, the `GROUP BY` splits work with (deprecated) Druid Datasources (e.g. [[ https://superset.wikimedia.org/r/547 | this chart created using pageviews_daily ]] ) {F34450935}