[01:25:51] 06Data-Engineering, 06DBA: Move GloballyWantedFiles computation to Hadoop - https://phabricator.wikimedia.org/T422894 (10Zabe) 03NEW [01:26:13] 06Data-Engineering, 06DBA: Move GloballyWantedFiles computation to Hadoop - https://phabricator.wikimedia.org/T422894#11807118 (10Zabe) p:05Triage→03Medium [01:26:32] 06Data-Engineering, 06DBA: Move GloballyWantedFiles computation to Hadoop - https://phabricator.wikimedia.org/T422894#11807120 (10Zabe) [05:45:44] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 10Event-Platform: page_change.v1 increate partitions to 3 - https://phabricator.wikimedia.org/T422511#11807443 (10JMonton-WMF) Ok! we can wait until everything works. I still believe 3 partitions for a topic like this is better than 1, from the Kafka persp... [07:22:18] 06Data-Engineering, 06Data-Engineering-Radar, 06cloud-services-team, 10Data-Services, 06DBA: Re-run maintainviews on all clouddb* and an-redacteddb1001.eqiad.wmnet - https://phabricator.wikimedia.org/T422459#11807510 (10Marostegui) @FCeratto-WMF has the parent's schema change progressed in any section th... [07:54:31] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 10Event-Platform: page_change.v1 increate partitions to 3 - https://phabricator.wikimedia.org/T422511#11807568 (10gmodena) > Unless flink is doing something special during dynamic partition discovery it might use its default offset reset strategy? If yes a... [08:03:31] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st): Weekly delivery cadence of core contributor metrics - https://phabricator.wikimedia.org/T418032#11807599 (10JAllemandou) Here's my proposed plan for an Incremental-Mediawiki-History: https://docs.google.com/document/d/1QZNCZhsBCxEKwogI8S1GFtELTPa0t9DYUBFoc3j... [08:06:00] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 06Traffic: Investigate raise in Invalid HAProxyKafka messages in esams - https://phabricator.wikimedia.org/T422033#11807603 (10JAllemandou) 05Open→03Resolved Having discussed this with Traffic, this was related to SSL handshake problem (regular tra... [08:07:08] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 06Traffic, 06Data-Platform-SRE (2026-03-27 - 2026-04-17), 13Patch-For-Review: Surge in webrequest validation check - https://phabricator.wikimedia.org/T422030#11807606 (10JAllemandou) Removing myself as the task assignee so that someone else take it wh... [08:07:14] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 06Traffic, 06Data-Platform-SRE (2026-03-27 - 2026-04-17), 13Patch-For-Review: Surge in webrequest validation check - https://phabricator.wikimedia.org/T422030#11807611 (10JAllemandou) a:05JAllemandou→03None [08:09:01] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 06Data-Platform-SRE (2026-03-27 - 2026-04-17): Analyze SQL queries generating metrics - https://phabricator.wikimedia.org/T420434#11807627 (10JAllemandou) 05Open→03Resolved I've written a plan for Incremental-Mediawiki-History here: https://docs.go... [08:09:03] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 06Traffic, 06Data-Platform-SRE (2026-03-27 - 2026-04-17), 13Patch-For-Review: Surge in webrequest validation check - https://phabricator.wikimedia.org/T422030#11807625 (10Vgutierrez) 05Open→03Resolved a:03Vgutierrez Closing the task as this h... [08:19:20] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 10Event-Platform, 13Patch-For-Review: HTML Enrichment - Tuning & Backfilling configuration - https://phabricator.wikimedia.org/T421216#11807653 (10JMonton-WMF) It looks like it has been working and catching up a bit {F75475714} [08:48:08] 06Data-Engineering, 06Data-Platform-SRE, 10Wikidata, 10Wikidata Analytics: Bug: Published datasets/reports directory sync fails when incompatible files are saved - https://phabricator.wikimedia.org/T412108#11807722 (10Lena_WMDE) 05Open→03Resolved a:03Lena_WMDE @AndrewTavis_WMDE Please create the... [08:52:01] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 10Event-Platform: page_change.v1 increate partitions to 3 - https://phabricator.wikimedia.org/T422511#11807727 (10dcausse) >>! In T422511#11807568, @gmodena wrote: >> Unless flink is doing something special during dynamic partition discovery it might use i... [09:07:52] 06Data-Engineering, 06Data-Engineering-Radar, 06cloud-services-team, 10Data-Services, 06DBA: Re-run maintainviews on all clouddb* and an-redacteddb1001.eqiad.wmnet - https://phabricator.wikimedia.org/T422459#11807745 (10FCeratto-WMF) Not yet, I'm looking at an error while updating s6 but in the meantime... [10:12:46] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 10Event-Platform: HTML Pipeline - Performance improvements - https://phabricator.wikimedia.org/T422928 (10JMonton-WMF) 03NEW [12:08:56] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 10Event-Platform, 13Patch-For-Review: HTML Enrichment - Tuning & Backfilling configuration - https://phabricator.wikimedia.org/T421216#11808420 (10JMonton-WMF) ` helmfile apply -i -e dse-k8s-eqiad \ --set app.version=v1.49.0 \ --set app.taskManager.r... [13:55:34] 06Data-Engineering, 06Commons, 10Commons-Datasets, 10Datasets-Archiving, and 2 others: Produce regular public dumps of Commons media files - https://phabricator.wikimedia.org/T298394#11808727 (10NotKlea) [14:30:41] 06Data-Engineering, 06Data-Engineering-Radar, 06Commons, 06Data-Persistence, and 5 others: Migrate file tables to a modern layout (image/oldimage; file/filerevision; add primary keys) - https://phabricator.wikimedia.org/T28741#11808834 (10Zabe) [14:47:37] 06Data-Engineering: Requesting Kerberos access for Daniel Kinzler - https://phabricator.wikimedia.org/T422947 (10daniel) 03NEW [14:54:13] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 06Traffic, 06Data-Platform-SRE (2026-03-27 - 2026-04-17), 13Patch-For-Review: Surge in webrequest validation check - https://phabricator.wikimedia.org/T422030#11808900 (10xcollazo) 05Resolved→03Open Reopening and tagging #data-engineering since we... [14:54:52] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 06Traffic, 06Data-Platform-SRE (2026-03-27 - 2026-04-17), 13Patch-For-Review: Surge in webrequest validation check - https://phabricator.wikimedia.org/T422030#11808902 (10xcollazo) p:05Triage→03Medium a:05Vgutierrez→03None [16:05:54] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 10Event-Platform, 13Patch-For-Review: HTML Enrichment - Tuning & Backfilling configuration - https://phabricator.wikimedia.org/T421216#11809025 (10JMonton-WMF) This is the last configuration I'm using, I tried to reduce buffers, use unaligned checkpoints... [17:05:18] 06Data-Engineering, 06Product-Analytics: Iceberg table maintenance for tables under wmf_product database - https://phabricator.wikimedia.org/T391135#11809215 (10xcollazo) I think we implemented this via T373693. @KCVelaga_WMF can you confirm? [18:58:20] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 07Essential-Work: Perform a one-time clean up of retained data sets in event_sanitize - https://phabricator.wikimedia.org/T417694#11809583 (10SNowick_WMF) Confirming we aren't using the data in any of the `/wmf/data/event_sanitized/mobilewikiapp* ` schemas... [19:39:17] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 07Essential-Work: Perform a one-time clean up of retained data sets in event_sanitize - https://phabricator.wikimedia.org/T417694#11809614 (10xcollazo) >>! In T417694#11809583, @SNowick_WMF wrote: > Confirming we aren't using the data in any of the `/wmf/d... [19:49:19] !log Test Kitchen edge-unique experiments (poll 94611) - adds: none; removes: mobile-toc-abc2; fields: none - xLab/MPIC/TK tips at https://w.wiki/FwuD [19:49:20] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [21:56:45] !log Test Kitchen edge-unique experiments (poll 94989) - adds: none; removes: none; fields: logged-out-retention-round4 - xLab/MPIC/TK tips at https://w.wiki/FwuD [21:56:47] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [21:57:30] !log Test Kitchen edge-unique experiments (poll 94991) - adds: none; removes: none; fields: logged-out-retention-round5 - xLab/MPIC/TK tips at https://w.wiki/FwuD [21:57:32] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log