[06:10:47] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th), 06Movement-Insights: mediawiki_history - account for temp accounts in mediawiki_user_history_check_error - https://phabricator.wikimedia.org/T401325#11137775 (10JAllemandou) Great! Thank you :) [10:12:46] 06Data-Engineering, 06Infrastructure-Foundations, 06Traffic: Export development_network_probe data to Puppet servers for CDN deployment - https://phabricator.wikimedia.org/T402512#11138219 (10elukey) We discussed the use case during the I/F meeting and we don't have any concern. I guess that we'll create a n... [10:14:11] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th): Update MediaWiki Content History SLO draft for SRE review - https://phabricator.wikimedia.org/T401892#11138238 (10GGoncalves-WMF) Excellent, thanks for coming up with this! It's very cool to see the performance of the real pipeline. My thoughts the initi... [10:22:22] 06Data-Engineering, 06Data-Engineering-Radar, 10AbuseFilter, 06DBA, 07Schema-change-in-production: Add default value for afl_ip and remove default value for afl_ip_hex in abuse_filter_log table - https://phabricator.wikimedia.org/T401906#11138275 (10FCeratto-WMF) [10:42:06] 06Data-Engineering, 06Infrastructure-Foundations, 06Traffic: Export development_network_probe data to Puppet servers for CDN deployment - https://phabricator.wikimedia.org/T402512#11138372 (10Vgutierrez) @brouberol hey! it looks like we split airflow airflow instances by team and we don't currently have an i... [11:07:29] 06Data-Engineering, 06Data-Engineering-Radar, 06DBA, 13Patch-For-Review, 07Schema-change-in-production: Drop cl_to and cl_collation from categorylinks in wmf production - https://phabricator.wikimedia.org/T402925#11138410 (10Ladsgroup) [11:35:43] 06Data-Engineering, 06DBA, 13Patch-For-Review, 07Schema-change-in-production: Change row format of cx_corpora - https://phabricator.wikimedia.org/T403362#11138500 (10Ladsgroup) [13:27:09] 06Data-Engineering, 06Data-Engineering-Radar, 06DBA, 13Patch-For-Review, 07Schema-change-in-production: Drop rc_new from recentchanges table in wmf production - https://phabricator.wikimedia.org/T402763#11138970 (10Ladsgroup) a:03Ladsgroup [13:42:19] 06Data-Engineering, 06Data-Platform-SRE: ERROR AsyncEventQueue: Listener DatahubSparkListener threw an exception - https://phabricator.wikimedia.org/T400207#11139120 (10Gehel) p:05Triage→03High [13:43:11] 06Data-Engineering, 10Data-Platform-SRE (2025.08.16 - 2025.09.05): ERROR AsyncEventQueue: Listener DatahubSparkListener threw an exception - https://phabricator.wikimedia.org/T400207#11139138 (10Gehel) [13:52:11] 06Data-Engineering, 06Infrastructure-Foundations, 06Traffic: Export development_network_probe data to Puppet servers for CDN deployment - https://phabricator.wikimedia.org/T402512#11139224 (10brouberol) We could do this, however there's a fixed operational cost induced by creating an Airflow instance, in ter... [13:56:20] 06Data-Engineering, 06Data-Engineering-Radar, 06DBA, 13Patch-For-Review, 07Schema-change-in-production: Drop cl_to and cl_collation from categorylinks in wmf production - https://phabricator.wikimedia.org/T402925#11139245 (10Ladsgroup) [14:31:32] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th), 10Event-Platform: Event Platform schemas should not support type changes to structs as array element or map value types - https://phabricator.wikimedia.org/T366487#11139505 (10Ottomata) [14:43:33] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th), 13Patch-For-Review: Improve handling of new stream onboarding in Refine - https://phabricator.wikimedia.org/T402186#11139618 (10Antoine_Quhen) This could be a solution but it's much simpler to filter out the new streams at beginning in place of adding... [14:49:12] 06Data-Engineering, 06Data-Persistence, 06Growth-Team, 10Improve-Tone-Structured-Task, and 2 others: Data Persistence Design Review: Improve Tone Suggested Edits newcomer task - https://phabricator.wikimedia.org/T401021#11139666 (10Ottomata) a:03Ottomata [14:49:27] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th), 06Data-Persistence, 06Growth-Team, 10Improve-Tone-Structured-Task, and 2 others: Data Persistence Design Review: Improve Tone Suggested Edits newcomer task - https://phabricator.wikimedia.org/T401021#11139669 (10Ottomata) [14:53:50] 06Data-Engineering, 06DBA, 07Schema-change-in-production: Add cl_timestamp_id index to categorylinks table - https://phabricator.wikimedia.org/T399249#11139699 (10Ladsgroup) [14:53:58] 06Data-Engineering, 06DBA, 07Schema-change-in-production: Add cl_timestamp_id index to categorylinks table - https://phabricator.wikimedia.org/T399249#11139701 (10Ladsgroup) 05Open→03Resolved [14:56:12] 06Data-Engineering, 06Infrastructure-Foundations, 06Traffic: Export development_network_probe data to Puppet servers for CDN deployment - https://phabricator.wikimedia.org/T402512#11139713 (10brouberol) Also, small nit: we split airflow instance by domain (ML, analytics, search, research, etc), as they tend... [14:58:56] 06Data-Engineering-Radar, 10CheckUser, 06DBA, 06Trust and Safety Product Team, 07Schema-change-in-production: Add '*_actor_ip_hex_time' indexes to 'cu_changes', 'cu_log_event', and 'cu_private_event' on WMF wikis - https://phabricator.wikimedia.org/T399728#11139717 (10Ladsgroup) [15:17:43] 06Data-Engineering, 06Data-Engineering-Radar, 06DBA, 07Schema-change-in-production: Drop afl_patrolled_by from abuse_filter_log in production - https://phabricator.wikimedia.org/T391056#11139812 (10Ladsgroup) [17:01:05] 06Data-Engineering, 10CirrusSearch, 10DPE-Mediawiki-Content, 10Discovery-Search (2025.08.15 - 2025.09.05), 13Patch-For-Review: Source the CirrusSearch index dumps from hadoop instead of a MW maintenance script - https://phabricator.wikimedia.org/T366248#11140357 (10EBernhardson) Dumping to hdfs is basica... [17:30:40] 06Data-Engineering, 10CirrusSearch, 10DPE-Mediawiki-Content, 10Discovery-Search (2025.08.15 - 2025.09.05), 13Patch-For-Review: Source the CirrusSearch index dumps from hadoop instead of a MW maintenance script - https://phabricator.wikimedia.org/T366248#11140514 (10EBernhardson) I suppose a side benefit... [17:36:37] 06Data-Engineering, 06SRE, 06Traffic-Icebox, 10MobileFrontend (Tracking): RFC: Remove m-dot subdomain, serve mobile and desktop variants through the same URL - https://phabricator.wikimedia.org/T214998#11140566 (10Krinkle) [17:51:54] 06Data-Engineering-Radar, 06Data-Platform-SRE, 10Research-engineering: Add analytics-research user to stat boxes - https://phabricator.wikimedia.org/T403207#11140629 (10Ottomata) [18:16:55] 06Data-Engineering, 06SRE, 06Traffic-Icebox, 10MobileFrontend (Tracking): RFC: Remove m-dot subdomain, serve mobile and desktop variants through the same URL - https://phabricator.wikimedia.org/T214998#11140708 (10Krinkle) [18:52:41] 06Data-Engineering, 06Data-Engineering-Radar, 06DBA, 13Patch-For-Review, 07Schema-change-in-production: Drop cl_to and cl_collation from categorylinks in wmf production - https://phabricator.wikimedia.org/T402925#11140799 (10Ladsgroup) [18:56:12] 06Data-Engineering, 06Data-Engineering-Radar, 10AbuseFilter, 06DBA, 07Schema-change-in-production: Add default value for afl_ip and remove default value for afl_ip_hex in abuse_filter_log table - https://phabricator.wikimedia.org/T401906#11140809 (10FCeratto-WMF) [19:35:07] 06Data-Engineering, 06Infrastructure-Foundations, 06Traffic: Export development_network_probe data to Puppet servers for CDN deployment - https://phabricator.wikimedia.org/T402512#11140960 (10Ottomata) platform_eng instance is becoming a catchall, perhaps that one would be okay here? [21:02:26] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th), 10Event-Platform, 13Patch-For-Review: Update event-producing tools to overwrite `meta.dt` - https://phabricator.wikimedia.org/T376026#11141591 (10colewhite) > 17:15:15 : ottomata: ~3k/sec of `Overriding meta.dt in event` logs have reappeared....