[09:32:24] 06Data-Engineering (Q2 FS26/27 October 1st - December 31th)): Refine: product_metrics.app_base hourly jobs failing, bump ingestion scale to medium - https://phabricator.wikimedia.org/T444095 (10Antoine_Quhen) 03NEW [09:33:52] 06Data-Engineering (Q2 FS26/27 October 1st - December 31th)): Refine: product_metrics.app_base hourly jobs failing, bump ingestion scale to medium - https://phabricator.wikimedia.org/T444095#12532182 (10Antoine_Quhen) [14:49:43] 06Data-Engineering: Dumps download metrics do not seem to include 404s on v1 brownout days - https://phabricator.wikimedia.org/T444174 (10xcollazo) 03NEW [14:50:27] 06Data-Engineering: Dumps download metrics do not seem to include 404s on v1 brownout days - https://phabricator.wikimedia.org/T444174#12534062 (10xcollazo) CC @KCVelaga_WMF, @GGoncalves-WMF [14:50:43] 06Data-Engineering: Dumps download metrics do not seem to include 404s on v1 brownout days - https://phabricator.wikimedia.org/T444174#12534063 (10xcollazo) [14:50:44] 06Data-Engineering (Q2 FS26/27 October 1st - December 31th)), 07Epic: XML Dumps v1 sunset - https://phabricator.wikimedia.org/T437518#12534064 (10xcollazo) [14:54:43] 06Data-Engineering (Q2 FS26/27 October 1st - December 31th)): IR2.1.2d: Feature count data product [Attribution API] - https://phabricator.wikimedia.org/T432604#12534112 (10Ottomata) > Do we want to persist the feature counts with event_sanitized! Yes! The stream is still at .dev0 though, let's do this when we... [15:06:42] 06Data-Engineering: Consider gating File Exports on a quality check - https://phabricator.wikimedia.org/T444189 (10xcollazo) 03NEW [15:06:58] 06Data-Engineering: Consider gating File Exports on a quality check - https://phabricator.wikimedia.org/T444189#12534315 (10xcollazo) [15:06:59] 06Data-Engineering (Q2 FS26/27 October 1st - December 31th)), 07Epic: XML Dumps v1 sunset - https://phabricator.wikimedia.org/T437518#12534316 (10xcollazo) [16:46:55] 06Data-Engineering, 05acl*data-engineering, 06Data-Platform-SRE (2026-10-30 - 2026-11-20), 07Essential-Work, 13Patch-For-Review: Upgrade airflow-main to 3.3.x - https://phabricator.wikimedia.org/T435480#12534981 (10Ahoelzl) a:05Ahoelzl→03None [16:47:03] 06Data-Engineering, 05acl*data-engineering, 07Essential-Work: Refactor create_dagrun tests for Airflow 3 - https://phabricator.wikimedia.org/T440709#12534983 (10Ahoelzl) a:05Ahoelzl→03None [16:48:18] 06Data-Engineering, 07Epic: AI-assisted data discoverability - https://phabricator.wikimedia.org/T424228#12534995 (10Ahoelzl) a:05Ahoelzl→03None [16:50:37] 06Data-Engineering: Backfill event_sanitized.mediawiki_page_outlink_topic_prediction_change_v1 with predictions for all existing wiki pages - https://phabricator.wikimedia.org/T431601#12535003 (10Ottomata) a:05Snwachukwu→03None DYK is on hold. We can unassign this from Sandra and put it back to the backlog.... [17:10:14] 06Data-Engineering (Q2 FS26/27 October 1st - December 31th)), 13Patch-For-Review: Zombie Airflow DagRun try resulted in an Incremental MWH failure - https://phabricator.wikimedia.org/T443787#12535078 (10xcollazo) Couple days later we are still good here. [17:12:20] 06Data-Engineering (Q2 FS26/27 October 1st - December 31th)), 06Data-Platform-SRE (2026-10-30 - 2026-11-20), 07Essential-Work: Define intake workflow for WMCS ingress logs - https://phabricator.wikimedia.org/T441140#12535086 (10Ahoelzl) a:05Ahoelzl→03JMonton-WMF [17:13:31] 06Data-Engineering (Q2 FS26/27 October 1st - December 31th)): Allow per-namespace breakdowns in wmf.geoeditors_monthly, wmf.geoeditors_edits_monthly and wmf.editors_daily. - https://phabricator.wikimedia.org/T441291#12535089 (10Ahoelzl) a:05Ahoelzl→03Milimetric [17:14:26] 06Data-Engineering (Q2 FS26/27 October 1st - December 31th)): airflow-dags: Replace getpass.getuser() with the Airflow app owner - https://phabricator.wikimedia.org/T443056#12535092 (10Ahoelzl) a:05Ahoelzl→03xcollazo [17:18:46] 14Data-Engineering (Q4 FS25/26 April 1st - June 30st), 10DPE-MediaWiki-Incremental-History: mediawiki_history_incremental_v1: schema specification for stakeholder review - https://phabricator.wikimedia.org/T425573#12535110 (10Pablo) A huge belated thank you, @Ottomata! [17:51:54] 14Analytics, 14Analytics-Kanban, 06Data-Engineering, 10Dumps-Generation, 10Wikimedia-Portals: dumps.wikimedia.org/other/pageviews/ appears to be stalled at 20210106-140000 - https://phabricator.wikimedia.org/T271561#12535236 (10bd808) >>! In T271561#12530711, @Superyetkin wrote: > The problem has just re... [18:13:24] 06Data-Engineering, 10DPE-MediaWiki-Incremental-History, 06MediaWiki-API-Platform-Team, 05MW-1.47-notes (1.47.0-wmf.18; 2026-09-01), 13Patch-For-Review: MediaWiki DomainEvents - Include LogEntry - https://phabricator.wikimedia.org/T427815#12535324 (10Ottomata) We met with the MWAPI team today and [[ http... [18:46:01] 06Data-Engineering (Q2 FS26/27 October 1st - December 31th)), 13Patch-For-Review: hdfs-rsync: Skip incomplete source directories - https://phabricator.wikimedia.org/T440383#12535445 (10xcollazo) >>! In T440383#12535409, @gerritbot wrote: > Change #1367918 had a related patch set uploaded (by Xcollazo; author:... [18:57:23] 14Analytics, 14Analytics-Kanban, 06Data-Engineering, 10Dumps-Generation, 10Wikimedia-Portals: dumps.wikimedia.org/other/pageviews/ appears to be stalled at 20210106-140000 - https://phabricator.wikimedia.org/T271561#12535466 (10Superyetkin) 05Open→03Resolved The dumps have arrived in the correct... [19:15:49] 06Data-Engineering, 10EditCheck, 10VisualEditor: Emit revision edit_suggestions_counts change as an event data product. - https://phabricator.wikimedia.org/T444212 (10Ottomata) 03NEW [19:23:12] 06Data-Engineering (Q2 FS26/27 October 1st - December 31th)), 07Epic: XML Dumps v1 sunset - https://phabricator.wikimedia.org/T437518#12535560 (10xcollazo) [19:29:36] 06Data-Engineering (Q2 FS26/27 October 1st - December 31th)), 13Patch-For-Review: hdfs-rsync: Skip incomplete source directories - https://phabricator.wikimedia.org/T440383#12535580 (10xcollazo) >>! In T440383#12535460, @gerritbot wrote: > Change #1367918 **merged** by Btullis: > %%%[operations/puppet@producti... [19:29:54] 06Data-Engineering (Q2 FS26/27 October 1st - December 31th)), 07Epic: XML Dumps v1 sunset - https://phabricator.wikimedia.org/T437518#12535583 (10xcollazo) [19:29:55] 06Data-Engineering (Q2 FS26/27 October 1st - December 31th)), 13Patch-For-Review: hdfs-rsync: Skip incomplete source directories - https://phabricator.wikimedia.org/T440383#12535582 (10xcollazo) [19:30:34] 06Data-Engineering, 13Patch-For-Review: hdfs-rsync: Skip incomplete source directories - https://phabricator.wikimedia.org/T440383#12535587 (10xcollazo) p:05Triage→03Low [19:30:43] 06Data-Engineering, 13Patch-For-Review: hdfs-rsync: Skip incomplete source directories - https://phabricator.wikimedia.org/T440383#12535589 (10xcollazo) a:05xcollazo→03None [19:39:18] 06Data-Engineering: MediawikiDumper: Move the XML export job to Spark 3.5 - https://phabricator.wikimedia.org/T444216 (10xcollazo) 03NEW [19:39:56] 06Data-Engineering: MediawikiDumper: Move the XML export job to Spark 3.5 - https://phabricator.wikimedia.org/T444216#12535619 (10xcollazo) [19:39:57] 06Data-Engineering: File Exports: Read one frozen Iceberg snapshot for each export run - https://phabricator.wikimedia.org/T439759#12535618 (10xcollazo) [19:39:58] 06Data-Engineering (Q2 FS26/27 October 1st - December 31th)), 07Epic: XML Dumps v1 sunset - https://phabricator.wikimedia.org/T437518#12535620 (10xcollazo) [19:40:06] 06Data-Engineering, 10EditCheck, 10VisualEditor: Emit revision edit_suggestions_counts change as an event data product. - https://phabricator.wikimedia.org/T444212#12535621 (10Ottomata) [20:16:49] 06Data-Engineering: Communicate directly to mirrors the v1 sunset and other recent changes - https://phabricator.wikimedia.org/T444215#12535722 (10Aklapper) [20:36:29] 06Data-Engineering (Q2 FS26/27 October 1st - December 31th)), 10Dumps-Generation, 13Patch-For-Review: Data missing from en.wiktionary.org "MediaWiki Content File Exports" compared to "XML Database dump" - https://phabricator.wikimedia.org/T417596#12535816 (10xcollazo) **Verification of the 2026-11-01 File Ex... [22:46:53] 06Data-Engineering (Q2 FS26/27 October 1st - December 31th)): Dumps download metrics do not seem to include 404s on v1 brownout days - https://phabricator.wikimedia.org/T444174#12536346 (10Ahoelzl) [22:47:04] 06Data-Engineering (Q2 FS26/27 October 1st - December 31th)): Dumps download metrics do not seem to include 404s on v1 brownout days - https://phabricator.wikimedia.org/T444174#12536347 (10Ahoelzl) a:03Ahoelzl [22:47:16] 06Data-Engineering (Q2 FS26/27 October 1st - December 31th)): Dbt backfill: heartbeat_active_editors_weekly - https://phabricator.wikimedia.org/T443865#12536350 (10Ahoelzl) [22:49:42] 06Data-Engineering, 06Data-Engineering-Radar, 06SRE, 10SRE-Access-Requests, 13Patch-For-Review: Requesting access to Analytics Data Lake for Federico Ceratto - https://phabricator.wikimedia.org/T443235#12536370 (10Ahoelzl) [22:58:01] 06Data-Engineering (Q2 FS26/27 October 1st - December 31th)): Truncate Google Search Console BigQuery tables to 1 month data retention - https://phabricator.wikimedia.org/T444242 (10Ahoelzl) 03NEW [22:59:28] 06Data-Engineering (Q2 FS26/27 October 1st - December 31th)): Truncate Google Search Console BigQuery tables to 1 month data retention - https://phabricator.wikimedia.org/T444242#12536433 (10Ahoelzl) [22:59:30] 14Data-Engineering (Q1 FS26/27 July 1st - September 30th), 07Epic: Load Google Search Console data into the Data Lake - https://phabricator.wikimedia.org/T420996#12536434 (10Ahoelzl) [23:06:10] 06Data-Engineering (Q2 FS26/27 October 1st - December 31th)): Truncate Google Search Console BigQuery tables to 1 month data retention - https://phabricator.wikimedia.org/T444242#12536455 (10Ahoelzl)