[02:19:20] 06Data-Engineering, 10ActiveAbstract, 10Dumps-Generation, 10Projects-Cleanup, 13Patch-For-Review: Undeploy and archive ActiveAbstract - https://phabricator.wikimedia.org/T382069#10621872 (10Novem_Linguae) >>! In T382069#10621024, @A_smart_kitten wrote: > For clarity, is the plan to archive the ActiveAbst... [04:32:01] 10Data-Engineering (Q3 2025 January 1st - March 31th), 10function-evaluator, 10function-orchestrator, 10Abstract Wikipedia team (25Q3 (Jan–Mar)), 07Essential-Work: WF service logging seems to be partially missing - https://phabricator.wikimedia.org/T386972#10622072 (10ecarg) 05In progressβ†’03Resolv... [10:23:29] 06Data-Engineering, 06Data-Engineering-Radar, 06DBA, 10Charts (Sprint 17), 07Schema-change-in-production: Deploy patch-gjlw_namespace_text.sql on x1.commonswiki for JsonConfig - https://phabricator.wikimedia.org/T385917#10622806 (10Marostegui) >>! In T385917#10620291, @bvibber wrote: >>>! In T385917#1060... [11:49:35] 06Data-Engineering, 10Data-Platform-SRE (2025.03.01 - 2025.03.21): Some refinery jobs have not been setting smtp_uri, resulting in possibly lost emails - https://phabricator.wikimedia.org/T388417#10623136 (10BTullis) 05Openβ†’03Resolved I think that we can close this now. [12:04:01] 06Data-Engineering, 10ActiveAbstract, 10Dumps-Generation, 10Projects-Cleanup, 13Patch-For-Review: Undeploy and archive ActiveAbstract - https://phabricator.wikimedia.org/T382069#10623165 (10A_smart_kitten) >>! In T382069#10621872, @Novem_Linguae wrote: >>>! In T382069#10621024, @A_smart_kitten wrote: >>... [12:26:49] 10Data-Engineering (Q3 2025 January 1st - March 31th), 10Data Pipelines, 10Observability-Metrics, 07Essential-Work, and 2 others: Disable Data Platform Engineering generated graphite metrics and dashboards - https://phabricator.wikimedia.org/T372855#10623214 (10AndrewTavis_WMDE) Hey @Snwachukwu πŸ‘‹ We're abl... [12:53:44] 06Data-Engineering, 06Data-Engineering-Radar, 06DBA, 07Schema-change-in-production: Change page.page_links_updated to fixed-length timestamp in wmf wikis - https://phabricator.wikimedia.org/T371742#10623306 (10Ladsgroup) [12:55:41] 06Data-Engineering, 06Data-Engineering-Radar, 06DBA, 07Schema-change-in-production: Change page.page_links_updated to fixed-length timestamp in wmf wikis - https://phabricator.wikimedia.org/T371742#10623315 (10Ladsgroup) [12:57:48] 06Data-Engineering, 10Dumps-Generation, 10Projects-Cleanup, 13Patch-For-Review: Undeploy and archive ActiveAbstract - https://phabricator.wikimedia.org/T382069#10623331 (10Jdforrester-WMF) >>! In T382069#10623165, @A_smart_kitten wrote: >>>! In T382069#10621872, @Novem_Linguae wrote: >>>>! In T382069#10621... [13:04:55] 06Data-Engineering, 10Dumps-Generation, 10Projects-Cleanup, 13Patch-For-Review: Undeploy and archive ActiveAbstract - https://phabricator.wikimedia.org/T382069#10623360 (10A_smart_kitten) >>! In T382069#10623331, @Jdforrester-WMF wrote: > Most of the complexity of that task is for human-facing extensions t... [13:12:24] 06Data-Engineering, 06Diffusion-Repository-Administrators, 10Dumps-Generation, 10Projects-Cleanup, and 3 others: Undeploy and archive ActiveAbstract - https://phabricator.wikimedia.org/T382069#10623410 (10A_smart_kitten) [13:12:31] 06Data-Engineering, 06Diffusion-Repository-Administrators, 10Dumps-Generation, 10Projects-Cleanup, and 3 others: Undeploy and archive ActiveAbstract - https://phabricator.wikimedia.org/T382069#10623412 (10A_smart_kitten) > Feel free to add checkboxes to this task description if you wish, but please do not... [13:13:38] 06Data-Engineering, 06Diffusion-Repository-Administrators, 10Dumps-Generation, 10Projects-Cleanup, and 3 others: Undeploy and archive ActiveAbstract - https://phabricator.wikimedia.org/T382069#10623424 (10Ladsgroup) [13:19:55] 06Data-Engineering, 06Diffusion-Repository-Administrators, 10Dumps-Generation, 10Projects-Cleanup, and 3 others: Undeploy and archive ActiveAbstract - https://phabricator.wikimedia.org/T382069#10623459 (10A_smart_kitten) [13:40:14] 10Data-Engineering (Q3 2025 January 1st - March 31th), 10Data Pipelines, 10Observability-Metrics, 07Essential-Work, and 2 others: Disable Data Platform Engineering generated graphite metrics and dashboards - https://phabricator.wikimedia.org/T372855#10623646 (10Snwachukwu) Hi @AndrewTavis_WMDE . Thank you... [13:54:55] 10Data-Engineering (Q3 2025 January 1st - March 31th), 10Dumps-Generation: mediawiki_history dumps missing for 2025-01 and 2025-02 - https://phabricator.wikimedia.org/T388410#10623741 (10xcollazo) 05In progressβ†’03Resolved Thanks @BTullis. Confirming that I can now see `2025-01` and `2025-02` at https:... [14:04:10] 06Data-Engineering, 06Diffusion-Repository-Administrators, 10Dumps-Generation, 10Projects-Cleanup, and 3 others: Undeploy and archive ActiveAbstract - https://phabricator.wikimedia.org/T382069#10623793 (10A_smart_kitten) [14:40:42] 06Data-Engineering, 06serviceops: Migrate data-engineering jobs to mw-cron - https://phabricator.wikimedia.org/T388537#10623962 (10Clement_Goubert) [16:02:22] 06Data-Engineering, 06Diffusion-Repository-Administrators, 10Dumps-Generation, 10Projects-Cleanup, and 2 others: Undeploy and archive ActiveAbstract - https://phabricator.wikimedia.org/T382069#10624554 (10Pppery) [16:35:46] 10Data-Engineering (Q3 2025 January 1st - March 31th), 10Dumps-Generation, 10Data-Platform-SRE (2025.03.01 - 2025.03.21): mediawiki_history dumps missing for 2025-01 and 2025-02 - https://phabricator.wikimedia.org/T388410#10624841 (10Gehel) [16:39:15] 06Data-Engineering, 06Data-Engineering-Radar, 10BDC-Implementation, 06Data-Platform-SRE, and 2 others: [Trino] Develop procedure and scripting for Trino cluster maintenance. - https://phabricator.wikimedia.org/T386391#10624861 (10Jgreen) [16:41:54] 06Data-Engineering, 06Data-Engineering-Radar, 10BDC-Implementation, 06Data-Platform-SRE, and 2 others: [Trino] Develop procedure and scripting for Trino cluster maintenance. - https://phabricator.wikimedia.org/T386391#10624866 (10Jgreen) We can use python's trino client to query system.runtime.(tasks|queri... [16:44:10] 10Data-Engineering (Q3 2025 January 1st - March 31th), 07Essential-Work: Analyze Dumps Usage Through Apache Logs - https://phabricator.wikimedia.org/T383175#10624873 (10Ahoelzl) @HCoplin-WMF added a search box ("contains"), prefix search does not seem to be available out of the box. [17:08:50] 06Data-Engineering-Radar, 10BDC-Implementation, 06Data-Platform-SRE, 07Epic: [Trino] Connect to Google Sheets - https://phabricator.wikimedia.org/T385748#10624994 (10IAckerman-WMF) a:03AStein-WMF [17:47:33] 06Data-Engineering, 06Data-Engineering-Radar, 06SRE, 10SRE-Access-Requests: Requesting access to analytics-privatedata-users ssh access and Kerberos identity for YLiou_WMF - https://phabricator.wikimedia.org/T385220#10625346 (10BCornwall) 05Stalledβ†’03Resolved Hi, @YLiou_WMF, I'm going to close this... [17:50:24] 06Data-Engineering, 10Data Pipelines, 07Epic: [Epic] Create Lifecycle Diagrams for Webrequests - https://phabricator.wikimedia.org/T363836#10625362 (10Ahoelzl) @VirginiaPoundstone is this still needed given that we have column-level data lineage for webrequest --> pageviews? [17:56:52] 10Data-Engineering-Roadmap, 07Epic: [Epic] Each AQS 2.0 Service must have a clearly defined SLO with a process for ongoing ownership - https://phabricator.wikimedia.org/T348014#10625460 (10Ahoelzl) [18:01:51] 06Data-Engineering, 06Data-Engineering-Radar, 06DBA, 10Charts (Sprint 17), 07Schema-change-in-production: Deploy patch-gjlw_namespace_text.sql on x1.commonswiki for JsonConfig - https://phabricator.wikimedia.org/T385917#10625493 (10bvibber) Woohoo, thanks! I'll get on the after config updates. :D [18:22:17] 10Data-Engineering (Q3 2025 January 1st - March 31th), 10MediaWiki-DomainEvents, 06MW-Interfaces-Team, 07Epic: DomainEvents - Broadcasting and receiving cross-process events - https://phabricator.wikimedia.org/T379935#10625666 (10Ottomata) Update: Daniel spent some time thinking about this, and came up wit... [19:52:15] 10Data-Engineering (Q3 2025 January 1st - March 31th), 10MediaWiki-DomainEvents, 06MW-Interfaces-Team, 07Epic: DomainEvents - Broadcasting and receiving cross-process events - https://phabricator.wikimedia.org/T379935#10626004 (10Ottomata) @daniel, I'm doing a little more thinking on how JsonCodec and mars... [20:27:48] 10Data-Engineering (Q3 2025 January 1st - March 31th), 10MediaWiki-DomainEvents, 06MW-Interfaces-Team, 07Epic: DomainEvents - Broadcasting and receiving cross-process events - https://phabricator.wikimedia.org/T379935#10626160 (10daniel) > So, as long as serialized event contains some information about the... [20:36:53] 06Data-Engineering, 06Diffusion-Repository-Administrators, 10Dumps-Generation, 10Projects-Cleanup, and 2 others: Undeploy and archive ActiveAbstract - https://phabricator.wikimedia.org/T382069#10626204 (10MGChecker) [20:58:00] 10Data-Engineering (Q3 2025 January 1st - March 31th), 10DPE HAProxy Migration, 13Patch-For-Review: [HAProxy migration] HAProxy and VarnishKafka should produce compatible datasets - https://phabricator.wikimedia.org/T382571#10626301 (10Ahoelzl) a:05JAllemandouβ†’03Antoine_Quhen [20:58:32] 10Data-Engineering (Q3 2025 January 1st - March 31th), 07Essential-Work, 13Patch-For-Review: Migrate analytics Airflow DAGs to k8s Airflow deployment - https://phabricator.wikimedia.org/T386282#10626303 (10Ahoelzl) [21:09:04] 10Data-Engineering (Q3 2025 January 1st - March 31th): Enable Spark data lineage for all Airflow instances - https://phabricator.wikimedia.org/T386862#10626394 (10Ahoelzl) a:05tchinβ†’03Ahoelzl [21:15:14] 07Analytics-Data-Problem, 06Data-Engineering, 06Abstract Wikipedia team, 06Movement-Insights: Unique devices per country spikes on wikifunctions - https://phabricator.wikimedia.org/T364872#10626443 (10Ahoelzl) @OSefu-WMF is this related to the unique devices issues we fixed in October? [21:18:52] 06Data-Engineering, 06Movement-Insights: Fix pageviews datasets in Druid/Turnilo/Superset - https://phabricator.wikimedia.org/T380754#10626457 (10Ahoelzl) @mpopov thanks for reporting this. Could you explain the impact of these inconsistencies? Trying to gauge priority. Thanks! [21:27:38] 06Data-Engineering, 06Movement-Insights, 07Epic: Establish a standard set of data domains - https://phabricator.wikimedia.org/T365892#10626488 (10Ahoelzl) [21:52:37] 06Data-Engineering: Airflow table maintenance auto-create execution pools - https://phabricator.wikimedia.org/T388612 (10amastilovic) 03NEW [21:54:43] 06Data-Engineering: Airflow table maintenance auto-create execution pools - https://phabricator.wikimedia.org/T388612#10626579 (10xcollazo) [22:33:38] 07Analytics-Data-Problem, 06Data-Engineering, 06Abstract Wikipedia team, 06Movement-Insights: Unique devices per country spikes on wikifunctions - https://phabricator.wikimedia.org/T364872#10626720 (10Mayakp.wiki) at first thought its not, because the October issue focussed on **Wikipedia** unique devices...