[06:08:25] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 10MediaWiki-Core-Revision-backend, 10MediaWiki-DomainEvents, 06MW-Interfaces-Team, and 5 others: MediaWiki\Revision\RevisionAccessException: Unable to load fresh row for rev_id: {rev_id} - https://phabricator.wikimedia.org/T400380#11802950 (10aaron) >>... [08:04:32] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 06Traffic, 06Data-Platform-SRE (2026-03-27 - 2026-04-17): Surge in webrequest validation check - https://phabricator.wikimedia.org/T422030#11803118 (10JAllemandou) [08:29:00] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 10Event-Platform: page_change.v1 increate partitions to 3 - https://phabricator.wikimedia.org/T422511#11803188 (10gmodena) >>! In T422511#11800369, @Ahoelzl wrote: > @dcausse @gmodena @gkyziridis please provide your respective team input. +1 from me. Do y... [08:57:52] 06Data-Engineering, 06Data-Engineering-Radar, 06DBA, 07Schema-change-in-production: Drop il_to column from imagelinks table in wmf production - https://phabricator.wikimedia.org/T419635#11803316 (10ops-monitoring-bot) Starting pool of db2157 by fceratto@cumin1003: Pooling in [09:42:28] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 10Event-Platform: page_change.v1 increate partitions to 3 - https://phabricator.wikimedia.org/T422511#11803519 (10JMonton-WMF) > Do you have a timeline in mind? It's very quick, so as soon as people agree with doing it, we can do it. [09:43:20] 06Data-Engineering, 06Data-Engineering-Radar, 06DBA, 07Schema-change-in-production: Drop il_to column from imagelinks table in wmf production - https://phabricator.wikimedia.org/T419635#11803534 (10ops-monitoring-bot) Completed pooling of db2157 by fceratto@cumin1003: Pooling in [11:21:40] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 10Event-Platform, 13Patch-For-Review: HTML Enrichment - Tuning & Backfilling configuration - https://phabricator.wikimedia.org/T421216#11803851 (10JMonton-WMF) I'm testing a new approach on the `-next` deployment. I change the code so there are 2 topolog... [12:27:43] 06Data-Engineering, 10Data-Engineering-Jupyter, 10Cloud Services Proposals, 06cloud-services-team, 10Wikibase GraphQL: GraphQL frontend challenges: evaluate better integrations with PAWS (Jupyter) - https://phabricator.wikimedia.org/T422817#11804077 (10valerio.bozzolan) Kindly adding under the attention... [12:31:44] 06Data-Engineering, 10Data-Engineering-Jupyter, 10Cloud Services Proposals, 06cloud-services-team, and 2 others: GraphQL frontend challenges: evaluate better integrations with PAWS (Jupyter) - https://phabricator.wikimedia.org/T422817#11804099 (10valerio.bozzolan) If taken in consideration, a subtask could... [12:44:07] 06Data-Engineering, 10Data-Engineering-Jupyter, 06cloud-services-team, 10PAWS, and 2 others: GraphQL frontend challenges: evaluate better integrations with PAWS (Jupyter) - https://phabricator.wikimedia.org/T422817#11804131 (10taavi) [13:45:39] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 10Event-Platform, 13Patch-For-Review: HTML Enrichment - Tuning & Backfilling configuration - https://phabricator.wikimedia.org/T421216#11804460 (10Ottomata) Wow nice! [13:46:23] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 10Event-Platform, 13Patch-For-Review: HTML Enrichment - Tuning & Backfilling configuration - https://phabricator.wikimedia.org/T421216#11804468 (10Ottomata) Deploying content length fix in prod, and also avoiding retries on 504 server timeouts. ` hel... [13:51:55] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 07Essential-Work: Perform a one-time clean up of retained data sets in event_sanitize - https://phabricator.wikimedia.org/T417694#11804488 (10xcollazo) [14:06:14] !log Test Kitchen edge-unique experiments (poll 89319) - adds: none; removes: none; fields: logged-out-retention-round6 - xLab/MPIC/TK tips at https://w.wiki/FwuD [14:06:15] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [14:13:38] 06Data-Engineering, 10Dumps-Generation, 10Wikidata: Json wikidata dumps incomplete - https://phabricator.wikimedia.org/T422303#11804622 (10Melderick) New dumps of this week (20260406) were generated correctly. Thanks [14:46:53] 06Data-Engineering, 10Dumps-Generation, 10Wikidata: Json wikidata dumps incomplete - https://phabricator.wikimedia.org/T422303#11804863 (10Ifrahkhanyaree_WMDE) Hey @Ahoelzl, we're not looking into anything Dumps related since we've been asked not to from the WMF. And, as of the last comment, seems like all i... [15:10:13] 06Data-Engineering, 10Dumps-Generation, 10Wikidata: Json wikidata dumps incomplete - https://phabricator.wikimedia.org/T422303#11804981 (10davidebbo) Yep, https://dumps.wikimedia.org/wikidatawiki/entities/20260406/ is looking as expected now, thanks. [15:12:49] 06Data-Engineering, 10Beta-Cluster-Infrastructure, 10WMF-JobQueue, 10Event-Platform: Kafka-topics broken in beta: "zookeeper is not a recognized option" - https://phabricator.wikimedia.org/T422842 (10Daimona) 03NEW [15:54:17] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 10Event-Platform: page_change.v1 increate partitions to 3 - https://phabricator.wikimedia.org/T422511#11805447 (10dcausse) >>! In T422511#11800369, @Ahoelzl wrote: > @dcausse @gmodena @gkyziridis please provide your respective team input. Unless flink is... [16:21:27] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 10AQS2.0: Consider updating our heuristics for media type classification in AQS / wikistats - https://phabricator.wikimedia.org/T419882#11805581 (10Snwachukwu) > A couple of links to the heuristics for reference (Sandra, please correct me if these are wron... [16:30:14] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 10Event-Platform: page_change.v1 increate partitions to 3 - https://phabricator.wikimedia.org/T422511#11805626 (10Ottomata) > if the canary events only flow to a single partition this might create an imbalance on flink applications Uh, wow no I have never... [17:00:22] 06Data-Engineering, 10Beta-Cluster-Infrastructure, 10WMF-JobQueue, 10Event-Platform: Kafka-topics broken in beta: "zookeeper is not a recognized option" - https://phabricator.wikimedia.org/T422842#11805798 (10BPirkle) [17:07:35] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 10Event-Platform: page_change.v1 increate partitions to 3 - https://phabricator.wikimedia.org/T422511#11805826 (10dcausse) >>! In T422511#11805626, @Ottomata wrote: > But, perhaps it would be better if applications didn't rely on canaries for watermark adv... [17:47:20] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 10Event-Platform: page_change.v1 increate partitions to 3 - https://phabricator.wikimedia.org/T422511#11805948 (10Ottomata) Based on a meeting today ([[ https://docs.google.com/document/d/1aIM6vKMqd5a0sWO1OuTsqsppEbVY24LDIyazY4u2b9I/edit?tab=t.voenkwuh52z#... [19:05:51] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 10Event-Platform, 13Patch-For-Review: HTML Enrichment - Tuning & Backfilling configuration - https://phabricator.wikimedia.org/T421216#11806183 (10Ottomata) I am trying `process_async_enabled_default=False` in staging (T421965). ` helmfile apply -e dse-... [19:12:42] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 10Event-Platform, 13Patch-For-Review: HTML Enrichment - Tuning & Backfilling configuration - https://phabricator.wikimedia.org/T421216#11806201 (10Ottomata) BTW, I tried [[ https://nightlies.apache.org/flink/flink-docs-release-1.20/docs/deployment/config... [19:15:00] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st): Backfill newly productionized edit types dataset - https://phabricator.wikimedia.org/T421919#11806244 (10AKhatun_WMF) Update: - Caroline shared the query she is using to get the metrics from edit-types. [The Query is here](https://docs.google.com/document/d/... [19:18:55] 06Data-Engineering, 06Data-Engineering-Radar, 10MediaWiki-DomainEvents, 05MW-1.45-release, and 3 others: Page-related DomainEvent classes with "@deprecated temporary alias, remove before 1.45 release" - https://phabricator.wikimedia.org/T417721#11806262 (10HCoplin-WMF) 05Open→03Resolved Marking as...