[00:03:27] 06Data-Engineering, 06Data-Engineering-Icebox, 10Data-Engineering-Wikistats, 10Data Pipelines, and 3 others: Merge ks-Arab and ks-Deva to ks - https://phabricator.wikimedia.org/T314476#10802876 (10srishakatux) PR to redirect `ks-arab` to `ks`: https://github.com/wikimedia/language-data/pull/428 [00:14:30] 06Data-Engineering, 06Data-Engineering-Icebox, 10Data-Engineering-Wikistats, 10Data Pipelines, and 3 others: Merge ks-Arab and ks-Deva to ks - https://phabricator.wikimedia.org/T314476#10802884 (10srishakatux) [01:02:21] 06Data-Engineering, 06Data-Engineering-Icebox, 10Data-Engineering-Wikistats, 10Data Pipelines, and 3 others: Merge ks-Arab and ks-Deva to ks - https://phabricator.wikimedia.org/T314476#10802975 (10srishakatux) Resolved merge conflicts in this old patch: https://gerrit.wikimedia.org/r/c/mediawiki/core/+/948987 [12:54:00] 06Data-Engineering, 06MW-Interfaces-Team, 10observability: [Needs grooming] Turnilo: include authentication status in request data cube - https://phabricator.wikimedia.org/T332864#10804226 (10daniel) [13:17:08] 06Data-Engineering, 06Data-Engineering-Radar, 10BDC-Implementation, 06Data-Platform-SRE, 07Epic: EPIC: Trino/MinIO/Hive-Standalone-Metaserver/Dagster/Metabase/Superset Implementation - https://phabricator.wikimedia.org/T377362#10804341 (10Jgreen) [13:51:53] 06Data-Engineering, 06Data-Engineering-Radar, 10BDC-Implementation, 10Data-Platform, and 2 others: [Trino] Develop procedure and scripting for Trino cluster maintenance. - https://phabricator.wikimedia.org/T386391#10804502 (10Gehel) [13:57:55] 06Data-Engineering, 06Discovery-Search, 06Java-Scala-Standardization, 10Data-Platform-SRE (2025.05.02 - 2025.05.23), 07Epic: [Epic] Replace Archiva with Gitlab artifact repositories - https://phabricator.wikimedia.org/T367315#10804580 (10Gehel) [14:34:41] 10Data-Engineering (Q4 2025 April 1st - June 30th), 10DPE-Mediawiki-Content, 13Patch-For-Review: Create table and pyspark job to produce wmf_content.mediawiki_content_current_v1 - https://phabricator.wikimedia.org/T391282#10804867 (10xcollazo) 05Open→03Resolved [14:36:04] 10Data-Engineering (Q4 2025 April 1st - June 30th), 10DPE-Mediawiki-Content: Create Airflow pipeline to produce wmf_content.mediawiki_content_current_v1 - https://phabricator.wikimedia.org/T391283#10804871 (10xcollazo) 05Open→03Resolved [14:36:56] 10Data-Engineering (Q4 2025 April 1st - June 30th), 10DPE-Mediawiki-Content: Enable merge-on-read for wmf_content.mediawiki_content_history_v1 - https://phabricator.wikimedia.org/T393012#10804878 (10xcollazo) [14:36:57] 10Data-Engineering-Roadmap, 10DPE-Mediawiki-Content, 07Epic: Dumps 2.0 Phase III: Production level dumps - https://phabricator.wikimedia.org/T366752#10804880 (10xcollazo) [14:36:57] 10Data-Engineering-Roadmap, 10DPE-Mediawiki-Content, 07Epic: Daily updated wmf_content.mediawiki_content_current_v1 - https://phabricator.wikimedia.org/T391279#10804879 (10xcollazo) [14:37:32] 10Data-Engineering (Q4 2025 April 1st - June 30th), 10DPE-Mediawiki-Content: Enable merge-on-read for wmf_content.mediawiki_content_history_v1 - https://phabricator.wikimedia.org/T393012#10804882 (10xcollazo) (Pulled this task in to be under {T391279} as this is highly related work.) [14:54:25] 10Quarry: Find somewhere else (not NFS) to store Quarry's resultsets - https://phabricator.wikimedia.org/T178520#10804962 (10taavi) Relating to this: does anyone happen to know if there's a specific reason why Quarry stores results as sqlite files and not, say, CSVs or some other format that the frontend could p... [14:55:18] poking again since no-one replied yesterday: how do I move T392468 forward? it's apparently been moved to 'Needs Clarification' without any further explanation on what needs to happen [14:55:19] T392468: Add new WMCS IP ranges to analytics - https://phabricator.wikimedia.org/T392468 [15:00:25] joal: --^ [15:02:37] taavi: I'll make sure we discuss your ticket in next team sync up [15:04:06] 10Data-Engineering (Q4 2025 April 1st - June 30th), 06cloud-services-team, 10Cloud-VPS, 07IPv6, 13Patch-For-Review: Add new WMCS IP ranges to analytics - https://phabricator.wikimedia.org/T392468#10805008 (10xcollazo) Looks like we need to do this soon as it is essential work. [15:09:07] 06Data-Engineering, 10MediaWiki-DomainEvents, 06MW-Interfaces-Team, 10Event-Platform: PageDeleted event should contain outgoing redirect target information - https://phabricator.wikimedia.org/T393633#10805034 (10gmodena) a:03gmodena [15:09:31] 10Data-Engineering (Q4 2025 April 1st - June 30th), 10MediaWiki-DomainEvents, 06MW-Interfaces-Team, 10Event-Platform: PageDeleted event should contain outgoing redirect target information - https://phabricator.wikimedia.org/T393633#10805037 (10gmodena) [16:15:23] 10Data-Engineering (Q4 2025 April 1st - June 30th), 10MediaWiki-DomainEvents, 07Epic, 10Event-Platform, and 3 others: EventBus: replace PageDeleteCompleteHook with PageDeletedListener - https://phabricator.wikimedia.org/T392205#10805209 (10gmodena) While working on this we've learn that it's currently not... [16:34:35] 10Data-Engineering (Q4 2025 April 1st - June 30th): Gobblin test jobs for event and eventlogging_legacy are misconfigured - https://phabricator.wikimedia.org/T393645#10805288 (10amastilovic) Seems like the integration between Phabricator and GitLab is broken at the moment, but this has been addressed in this MR:... [17:11:38] 14Analytics, 06Data-Engineering, 06Data-Engineering-Icebox, 10Observability-Logging, and 2 others: Augment NEL reports with a computed timestamp-of-generation - https://phabricator.wikimedia.org/T266886#10805362 (10colewhite) 05Open→03Resolved The "generated" field is is now calculated from meta.dt... [17:16:11] 10Data-Engineering (Q4 2025 April 1st - June 30th): Avoid Gobblin SimpleSkein DAG runs queuing up by disabling "catchup" - https://phabricator.wikimedia.org/T393618#10805389 (10amastilovic) @xcollazo it just sounds like such a complicated solution to something we're not even sure is a problem to begin with. What... [19:56:20] 10Data-Engineering (Q4 2025 April 1st - June 30th), 10DPE-Mediawiki-Content, 13Patch-For-Review: Investigate reasons for remaining inconsistencies - https://phabricator.wikimedia.org/T385112#10805838 (10xcollazo) 05Open→03In progress p:05Triage→03Medium a:03xcollazo [20:18:42] 10Data-Engineering (Q4 2025 April 1st - June 30th), 10DPE-Mediawiki-Content, 13Patch-For-Review: Investigate reasons for remaining inconsistencies - https://phabricator.wikimedia.org/T385112#10805897 (10xcollazo) [20:19:20] 10Data-Engineering (Q4 2025 April 1st - June 30th), 10DPE-Mediawiki-Content, 13Patch-For-Review: Investigate reasons for remaining inconsistencies - https://phabricator.wikimedia.org/T385112#10805900 (10xcollazo) (Updated description above to reflect inconsistencies as of `2025-05-01`.)