[01:50:59] 10Data-Engineering (Q4 2025 April 1st - June 30th), 10DPE-Mediawiki-Content: Add metrics for monthly reconciles - https://phabricator.wikimedia.org/T388439#10949145 (10tchin) The metrics table has no unique index I can match on to update rows so I had to match on almost every column but it worked I guess `lan... [03:18:31] FIRING: [2x] AlertLintProblem: Linting problems found for HaproxyKafkaDeliveryErrors - https://wikitech.wikimedia.org/wiki/Alertmanager#Alert_linting_found_problems - TODO - https://alerts.wikimedia.org/?q=alertname%3DAlertLintProblem [07:18:31] FIRING: [2x] AlertLintProblem: Linting problems found for HaproxyKafkaDeliveryErrors - https://wikitech.wikimedia.org/wiki/Alertmanager#Alert_linting_found_problems - TODO - https://alerts.wikimedia.org/?q=alertname%3DAlertLintProblem [08:26:04] 10Data-Engineering (Q4 2025 April 1st - June 30th): Determine how many admins are there in English Wikipedia and French Wikipedia from sub-Saharan Africa - https://phabricator.wikimedia.org/T395279#10949453 (10Trizek-WMF) I checked current French Wikipedia admins' user pages and application pages, and none of th... [09:18:57] 06Data-Engineering, 06Data-Engineering-Radar, 06DBA, 07Schema-change-in-production: Drop afl_patrolled_by from abuse_filter_log in production - https://phabricator.wikimedia.org/T391056#10949578 (10ops-monitoring-bot) Start pool of db2161 gradually with 4 steps - Pooling in - fceratto@cumin1002 [10:04:25] 06Data-Engineering, 06Data-Engineering-Radar, 06DBA, 07Schema-change-in-production: Drop afl_patrolled_by from abuse_filter_log in production - https://phabricator.wikimedia.org/T391056#10949758 (10ops-monitoring-bot) Completed pool of db2161 gradually with 4 steps - Pooling in - fceratto@cumin1002 [11:18:31] FIRING: [2x] AlertLintProblem: Linting problems found for HaproxyKafkaDeliveryErrors - https://wikitech.wikimedia.org/wiki/Alertmanager#Alert_linting_found_problems - TODO - https://alerts.wikimedia.org/?q=alertname%3DAlertLintProblem [11:23:06] (03CR) 10Jforrester: [C:03+1] "Neither can any of us — access is only for https://gerrit.wikimedia.org/r/admin/groups/3c7d8446c870e8716da6e083dbf795bc6c36cdd7,members an" [analytics/reportupdater-queries] - 10https://gerrit.wikimedia.org/r/1162101 (https://phabricator.wikimedia.org/T359271) (owner: 10Andrea Denisse) [12:34:21] (03CR) 10Joal: [V:03+2 C:03+2] "I'll merge this patch. The repo is not used anymore, we've migrated away from reportupdater. We should have deprecated the repo. sorry abo" [analytics/reportupdater-queries] - 10https://gerrit.wikimedia.org/r/1162101 (https://phabricator.wikimedia.org/T359271) (owner: 10Andrea Denisse) [13:01:28] 06Data-Engineering: Archive the `reportupdater` and `reportupdater-queries` gerrit repos - https://phabricator.wikimedia.org/T397922 (10JAllemandou) 03NEW [13:03:28] 06Data-Engineering, 06Experimentation Lab: Adapt Sqoop for categorylinks schema change - https://phabricator.wikimedia.org/T397923 (10Zabe) 03NEW [13:05:20] 06Data-Engineering, 10Data-Platform, 05http-client-hints: Client hints not recorded in the webrequest table - https://phabricator.wikimedia.org/T397464#10950255 (10A_smart_kitten) (given the description of #data-platform, should there be a Herald rule for #data-platform -> #data-engineering?) [13:06:21] (03PS1) 10Joal: Archiving - Delete all files but README.md [analytics/reportupdater] - 10https://gerrit.wikimedia.org/r/1164194 (https://phabricator.wikimedia.org/T397922) [13:06:36] (03CR) 10CI reject: [V:04-1] Archiving - Delete all files but README.md [analytics/reportupdater] - 10https://gerrit.wikimedia.org/r/1164194 (https://phabricator.wikimedia.org/T397922) (owner: 10Joal) [13:09:26] (03PS1) 10Joal: Archiving - Delete all files and create README.md [analytics/reportupdater-queries] - 10https://gerrit.wikimedia.org/r/1164195 (https://phabricator.wikimedia.org/T397922) [13:10:15] (03CR) 10TChin: [V:03+2 C:03+2] Archiving - Delete all files and create README.md [analytics/reportupdater-queries] - 10https://gerrit.wikimedia.org/r/1164195 (https://phabricator.wikimedia.org/T397922) (owner: 10Joal) [13:11:06] 10Data-Engineering (Q4 2025 April 1st - June 30th), 13Patch-For-Review: Archive the `reportupdater` and `reportupdater-queries` gerrit repos - https://phabricator.wikimedia.org/T397922#10950277 (10JAllemandou) [13:21:09] (03CR) 10TChin: [V:03+2 C:03+2] Archiving - Delete all files but README.md [analytics/reportupdater] - 10https://gerrit.wikimedia.org/r/1164194 (https://phabricator.wikimedia.org/T397922) (owner: 10Joal) [13:21:34] (03CR) 10TChin: [V:03+2 C:03+2] "Removed the -1 from CI since it's being deleted anyways" [analytics/reportupdater] - 10https://gerrit.wikimedia.org/r/1164194 (https://phabricator.wikimedia.org/T397922) (owner: 10Joal) [13:23:14] 10Data-Engineering (Q4 2025 April 1st - June 30th), 13Patch-For-Review: Archive the `reportupdater` and `reportupdater-queries` gerrit repos - https://phabricator.wikimedia.org/T397922#10950313 (10JAllemandou) [13:25:38] 10Data-Engineering (Q4 2025 April 1st - June 30th), 13Patch-For-Review: Archive the `reportupdater` and `reportupdater-queries` gerrit repos - https://phabricator.wikimedia.org/T397922#10950338 (10JAllemandou) Hi @hashar , I could with some help for deactivating the two Diffusion repos listed in the task. I do... [13:27:27] 10Data-Engineering (Q4 2025 April 1st - June 30th), 06Diffusion-Repository-Administrators, 10Projects-Cleanup, 13Patch-For-Review: Archive the `reportupdater` and `reportupdater-queries` gerrit repos - https://phabricator.wikimedia.org/T397922#10950351 (10A_smart_kitten) [13:28:11] 10Data-Engineering (Q4 2025 April 1st - June 30th), 10DPE-Mediawiki-Content: Add metrics for monthly reconciles - https://phabricator.wikimedia.org/T388439#10950355 (10tchin) Just noticed that in the metrics computation script, it deletes any duplicated metrics `WHERE partition_ts = CAST('{args.min_timestamp}'... [13:34:41] 10Data-Engineering (Q4 2025 April 1st - June 30th), 10DPE-Mediawiki-Content: Add metrics for monthly reconciles - https://phabricator.wikimedia.org/T388439#10950393 (10xcollazo) >>! In T388439#10949145, @tchin wrote: > The metrics table has no unique index I can match on to update rows so I had to match on alm... [13:39:12] 06Data-Engineering, 06Data-Engineering-Radar, 06DBA, 07Schema-change-in-production: Drop afl_patrolled_by from abuse_filter_log in production - https://phabricator.wikimedia.org/T391056#10950429 (10ops-monitoring-bot) Start pool of db2240 gradually with 4 steps - Pooling in - fceratto@cumin1002 [13:39:22] (03PS1) 10Joal: Improve the automated traffic detection pipeline [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1163417 (owner: 10Mforns) [13:39:23] (03CR) 10Joal: "One nit and one idea." [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1163417 (owner: 10Mforns) [13:42:40] (03CR) 10Xcollazo: Improve the automated traffic detection pipeline (031 comment) [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1163417 (owner: 10Mforns) [13:43:36] (03CR) 10Joal: Improve the automated traffic detection pipeline (031 comment) [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1163417 (owner: 10Mforns) [13:44:30] 06Data-Engineering, 06Data-Engineering-Radar, 06DBA, 07Schema-change-in-production: Drop afl_patrolled_by from abuse_filter_log in production - https://phabricator.wikimedia.org/T391056#10950441 (10FCeratto-WMF) [13:49:27] 10Data-Engineering (Q4 2025 April 1st - June 30th), 10DPE-Data-Quality, 10DPE-Mediawiki-Content: Duplicate rows on wmf_content.mediawiki_content_history_v1 after big reconcile - https://phabricator.wikimedia.org/T397525#10950472 (10xcollazo) Latest `wait_for_event_mediawiki_content_history_reconcile_enriched... [13:50:57] 06Data-Engineering, 06Data-Engineering-Radar, 06DBA, 07Schema-change-in-production: Drop afl_patrolled_by from abuse_filter_log in production - https://phabricator.wikimedia.org/T391056#10950485 (10Ladsgroup) I think we still need to do s4 and s8 in eqiad too? Their switchover is a different beast though s... [13:59:00] 10Data-Engineering (Q4 2025 April 1st - June 30th), 06Diffusion-Repository-Administrators, 10Projects-Cleanup: Archive the `reportupdater` and `reportupdater-queries` gerrit repos - https://phabricator.wikimedia.org/T397922#10950540 (10JAllemandou) [13:59:08] 10Data-Engineering (Q4 2025 April 1st - June 30th), 06Diffusion-Repository-Administrators, 10Projects-Cleanup: Archive the `reportupdater` and `reportupdater-queries` gerrit repos - https://phabricator.wikimedia.org/T397922#10950541 (10JAllemandou) a:03JAllemandou [14:02:24] 07Analytics-Data-Problem, 10Data-Engineering (Q4 2025 April 1st - June 30th), 06Movement-Insights: NEW BUG REPORT <"Domain" field issue: some domains have trailing dots> - https://phabricator.wikimedia.org/T395963#10950575 (10JAllemandou) This was a known change when we migrated from Varnish to HAProxy. We d... [14:24:36] 06Data-Engineering, 06Data-Engineering-Radar, 06DBA, 07Schema-change-in-production: Drop afl_patrolled_by from abuse_filter_log in production - https://phabricator.wikimedia.org/T391056#10950729 (10ops-monitoring-bot) Completed pool of db2240 gradually with 4 steps - Pooling in - fceratto@cumin1002 [14:53:18] 10Data-Engineering (Q4 2025 April 1st - June 30th), 06Diffusion-Repository-Administrators, 10Projects-Cleanup, 13Patch-For-Review: Archive the `reportupdater` and `reportupdater-queries` gerrit repos - https://phabricator.wikimedia.org/T397922#10950924 (10thcipriani) [15:18:31] FIRING: [2x] AlertLintProblem: Linting problems found for HaproxyKafkaDeliveryErrors - https://wikitech.wikimedia.org/wiki/Alertmanager#Alert_linting_found_problems - TODO - https://alerts.wikimedia.org/?q=alertname%3DAlertLintProblem [15:31:51] (03CR) 10Xcollazo: "Just noting here that we need to bump the `version` of the algorithm if we move forward with this. I believe this is a setting in Airflow?" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1163417 (owner: 10Mforns) [16:09:01] 06Data-Engineering, 06Data-Engineering-Radar, 06DBA, 07Schema-change-in-production: Drop afl_patrolled_by from abuse_filter_log in production - https://phabricator.wikimedia.org/T391056#10951328 (10FCeratto-WMF) [17:33:22] 06Data-Engineering, 06Data-Engineering-Radar, 10Wmfdata-Python, 10Movement-Insights (FY2025-26 H1): Support creating a Spark session with a GitLab-built Conda environment - https://phabricator.wikimedia.org/T378253#10951628 (10nshahquinn-wmf) [17:33:46] 10Analytics-Canonical-Data, 10Movement-Insights (FY2025-26 H1): Create a canonical dataset for incubating wikis - https://phabricator.wikimedia.org/T393075#10951641 (10nshahquinn-wmf) [17:42:22] 06Data-Engineering, 06Movement-Insights, 10Wmfdata-Python, 10GitLab (Project Migration), 13Patch-For-Review: Move Wmfdata-Python from Github to Gitlab - https://phabricator.wikimedia.org/T304544#10951667 (10nshahquinn-wmf) [17:42:32] 06Data-Engineering, 06Movement-Insights, 10Wmfdata-Python, 10GitLab (Project Migration), 13Patch-For-Review: Move Wmfdata-Python from Github to Gitlab - https://phabricator.wikimedia.org/T304544#10951668 (10nshahquinn-wmf) 05Open→03Resolved [19:18:31] FIRING: [2x] AlertLintProblem: Linting problems found for HaproxyKafkaDeliveryErrors - https://wikitech.wikimedia.org/wiki/Alertmanager#Alert_linting_found_problems - TODO - https://alerts.wikimedia.org/?q=alertname%3DAlertLintProblem [23:18:31] FIRING: [2x] AlertLintProblem: Linting problems found for HaproxyKafkaDeliveryErrors - https://wikitech.wikimedia.org/wiki/Alertmanager#Alert_linting_found_problems - TODO - https://alerts.wikimedia.org/?q=alertname%3DAlertLintProblem