[00:36:42] 06Data-Engineering, 10EventStreams: Support new fields: (1) namespace textual prefix and (2) page title without prefix - https://phabricator.wikimedia.org/T426268#11938815 (10Ottomata) > why include the namespace name if it's not relevant for any data joins? That is a very good point. If MW stores `page_title`... [00:57:43] 06Data-Engineering, 07Sustainability: Move some analytics jobs to day time in Virginia - https://phabricator.wikimedia.org/T384166#11938851 (10Ottomata) And/or, [[ https://archive.apache.org/dist/spark/docs/3.1.2/sql-ref-syntax-qry-select-sampling.html | TABLESAMPLE ]]? Although I'm not sure if on our version... [01:12:14] 06Data-Engineering, 05FY2025-26 KR 5.1, 06MediaWiki-Platform-Team (Kanban Board), 07OKR-Work, 13Patch-For-Review: redioscope: periodically publish top clients to the data lake - https://phabricator.wikimedia.org/T424823#11938856 (10Ottomata) The best docs I have for you are unfortunately focused on Event... [01:18:34] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 10DPE-MediaWiki-Incremental-History: Iceberg 1.2.1 JAR seems to clash with 1.6.1 on Spark 3.5 executor classpath - https://phabricator.wikimedia.org/T426801 (10xcollazo) 03NEW [01:20:18] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 10DPE-MediaWiki-Incremental-History: Iceberg 1.2.1 JAR seems to clash with 1.6.1 on Spark 3.5 executor classpath - https://phabricator.wikimedia.org/T426801#11938883 (10xcollazo) Full working command: ` spark35-submit \ --master yarn \ --d... [03:21:20] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st): Load Google Search Console data into the Data Lake - https://phabricator.wikimedia.org/T420996#11938971 (10nshahquinn-wmf) > The site-level table includes impressions and clicks for anonymized queries (long-tail queries Google strips from URL-level data for... [04:03:29] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 10DPE-MediaWiki-Incremental-History: mediawiki_history_incremental_v1: schema specification for stakeholder review - https://phabricator.wikimedia.org/T425573#11938982 (10nshahquinn-wmf) >>! In T425573#11938074, @xcollazo wrote: > @nshahquinn-wmf and @Isaa... [04:24:43] 06Data-Engineering, 06Data-Platform-SRE (2026-04-24 - 2026-05-15), 07Epic, 13Patch-For-Review: Upgrade Spark to a version with long term Iceberg support - https://phabricator.wikimedia.org/T338057#11938993 (10nshahquinn-wmf) @BTullis thank you for all the responses! Sounds like you're basically ahead of me... [06:38:50] 06Data-Engineering, 07Sustainability: Move some analytics jobs to day time in Virginia - https://phabricator.wikimedia.org/T384166#11939167 (10JAllemandou) We also download the 1:128 webrequest sampled data on the hadoop cluster, but we have not created a table of it. Could be worth it. [06:44:51] (03CR) 10Joal: [C:03+1] "LGTM!" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1288444 (https://phabricator.wikimedia.org/T419522) (owner: 10KCVelaga) [09:07:36] 06Data-Engineering, 10ChangeProp, 10EventStreams, 06MediaWiki-Engineering, and 15 others: Migrate node-based services in production to node22 - https://phabricator.wikimedia.org/T393434#11939596 (10Sfaci) [10:00:35] (03PS3) 10KCVelaga: Determine API requests in webrequest refine job [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1288444 (https://phabricator.wikimedia.org/T419522) [10:08:45] 06Data-Engineering, 10MediaWiki-User-management, 06Stewards-and-global-tools, 10Event-Platform, and 2 others: userrights-interwiki fails with server error - https://phabricator.wikimedia.org/T426832#11939824 (10taavi) [10:10:12] 06Data-Engineering, 10MediaWiki-User-management, 06Stewards-and-global-tools, 10Event-Platform, and 2 others: userrights-interwiki fails with server error - https://phabricator.wikimedia.org/T426832#11939827 (10Urbanecm_WMF) p:05High→03Unbreak! This is a critical bug, as it means the Stewards cannot hi... [10:10:25] 06Data-Engineering, 10MediaWiki-User-management, 06Stewards-and-global-tools, 10Event-Platform, and 2 others: userrights-interwiki fails with server error - https://phabricator.wikimedia.org/T426832#11939829 (10Xaosflux) Not limited to webui, api same fail: { "error": { "code": "internal_api_e... [10:10:26] 06Data-Engineering, 10MediaWiki-User-management, 06Stewards-and-global-tools, 10Event-Platform, and 2 others: userrights-interwiki fails with server error - https://phabricator.wikimedia.org/T426832#11939831 (10Urbanecm_WMF) [10:19:42] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 06SRE, 10Event-Platform, 13Patch-For-Review: Flink Page View: Create K8s resources - https://phabricator.wikimedia.org/T426425#11939866 (10JMonton-WMF) [10:19:56] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 06SRE, 10Event-Platform, 13Patch-For-Review: Flink Page View: Create K8s resources - https://phabricator.wikimedia.org/T426425#11939867 (10JMonton-WMF) [10:29:43] 06Data-Engineering, 06Data-Engineering-Radar, 10Event-Platform, 06Machine-Learning-Team (Q4 FY2025-26): Add Multilingual RevertRisk predictions to mediawiki.page_revert_risk_prediction_change - https://phabricator.wikimedia.org/T415892#11939878 (10Samwalton9-WMF) Thanks folks!! This will make our analysis... [10:48:57] 06Data-Engineering, 10MediaWiki-User-management, 06Stewards-and-global-tools, 10Event-Platform, and 3 others: userrights-interwiki fails with server error - https://phabricator.wikimedia.org/T426832#11939931 (10mszwarc) 05Open→03In progress a:03mszwarc [10:58:30] 06Data-Engineering, 06Data-Engineering-Radar, 10Event-Platform, 06Machine-Learning-Team (Q4 FY2025-26): Add Multilingual RevertRisk predictions to mediawiki.page_revert_risk_prediction_change - https://phabricator.wikimedia.org/T415892#11939962 (10gkyziridis) 05Open→03Resolved [10:59:49] 06Data-Engineering, 06Data-Engineering-Radar, 06Machine-Learning-Team, 10Event-Platform: Add Multilingual RevertRisk predictions to mediawiki.page_revert_risk_prediction_change - https://phabricator.wikimedia.org/T415892#11939966 (10gkyziridis) [11:07:48] 06Data-Engineering, 06Data-Engineering-Radar, 10Event-Platform, 06Machine-Learning-Team (Q4 FY2025-26): Add Multilingual RevertRisk predictions to mediawiki.page_revert_risk_prediction_change - https://phabricator.wikimedia.org/T415892#11940008 (10isarantopoulos) [11:51:11] 06Data-Engineering, 10MediaWiki-User-management, 06Stewards-and-global-tools, 10Event-Platform, and 4 others: userrights-interwiki fails with server error - https://phabricator.wikimedia.org/T426832#11940236 (10hashar) It is probably unrelated, this morning I have filed a task about group permissions T426820. [12:00:09] 06Data-Engineering, 10MediaWiki-User-management, 06Stewards-and-global-tools, 10Event-Platform, and 4 others: userrights-interwiki fails with server error - https://phabricator.wikimedia.org/T426832#11940293 (10mszwarc) Fix deployed. Let's wait for confirmation that the issue is gone in prod [12:03:36] 06Data-Engineering, 10MediaWiki-User-management, 06Stewards-and-global-tools, 10Event-Platform, and 5 others: userrights-interwiki fails with server error - https://phabricator.wikimedia.org/T426832#11940307 (10Xaosflux) This issue is still occurring in production > [b247c032-6181-4a96-851f-5fb39a961c8f] 2... [12:08:59] 06Data-Engineering, 10MediaWiki-User-management, 06Stewards-and-global-tools, 10Event-Platform, and 5 others: userrights-interwiki fails with server error - https://phabricator.wikimedia.org/T426832#11940318 (10mszwarc) >>! In T426832#11940307, @Xaosflux wrote: > This issue is still occurring in production... [13:09:00] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 06Data-Platform-SRE (2026-04-24 - 2026-05-15), 13Patch-For-Review: Support for Java 25 and Flink 2 - https://phabricator.wikimedia.org/T412978#11940644 (10JMonton-WMF) So far everything is working with Flink 2.0.2 and Java 25, docker images are built and... [13:15:25] 06Data-Engineering, 07Sustainability: Move some analytics jobs to day time in Virginia - https://phabricator.wikimedia.org/T384166#11940670 (10Ladsgroup) Having a table for that would be really nice for me. I used pageview_actor and it worked sometimes but all cases (e.g. when I'm working to extract insight on... [13:30:31] (03PS10) 10Xcollazo: Add MWHistoryDeltaWriter and MWHistorySnapshotMerger to refinery-job-35 [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1284858 (https://phabricator.wikimedia.org/T424350) [13:32:18] (03PS11) 10Xcollazo: Add MWHistoryDeltaWriter and MWHistorySnapshotMerger to refinery-job-35 [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1284858 (https://phabricator.wikimedia.org/T425729) [13:40:37] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 10DPE-MediaWiki-Incremental-History, 13Patch-For-Review: Implement MERGE INTO writers for mediawiki_history_incremental_v1 - https://phabricator.wikimedia.org/T425729#11940893 (10xcollazo) **MWHistoryDeltaWriter — end-to-end cluster testing complete (sta... [13:44:05] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 10DPE-MediaWiki-Incremental-History: Iceberg 1.2.1 JAR seems to clash with 1.6.1 on Spark 3.5 executor classpath - https://phabricator.wikimedia.org/T426801#11940920 (10xcollazo) This could very well be a legit Iceberg bug as well. [13:46:28] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 06Data-Platform-SRE (2026-04-24 - 2026-05-15), 13Patch-For-Review: Support for Java 25 and Flink 2 - https://phabricator.wikimedia.org/T412978#11940938 (10JMonton-WMF) [13:57:09] 06Data-Engineering, 07Epic, 10Event-Platform: Flink 2 migration - https://phabricator.wikimedia.org/T426863 (10JMonton-WMF) 03NEW [13:57:47] 06Data-Engineering, 07Epic, 10Event-Platform: Flink 2 migration - https://phabricator.wikimedia.org/T426863#11941006 (10JMonton-WMF) [13:57:48] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 06Data-Platform-SRE (2026-04-24 - 2026-05-15), 13Patch-For-Review: Support for Java 25 and Flink 2 - https://phabricator.wikimedia.org/T412978#11941005 (10JMonton-WMF) [14:01:36] (03PS3) 10Xcollazo: Add DDL for mediawiki_history_incremental_v1 Iceberg table [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1287959 (https://phabricator.wikimedia.org/T425729) [14:04:16] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 10DPE-MediaWiki-Incremental-History: mediawiki_history_incremental_v1: schema specification for stakeholder review - https://phabricator.wikimedia.org/T425573#11941048 (10AKhatun_WMF) Following up on my comment T425573#11913740 and adding to @nshahquinn-wm... [14:07:04] 06Data-Engineering, 10EventStreams: Support new fields: (1) namespace textual prefix and (2) page title without prefix - https://phabricator.wikimedia.org/T426268#11941056 (10dr0ptp4kt) In terms of guarantees on the data, changing the present emission behavior on `page_title` constitutes a breaking change. Fo... [14:14:33] (03CR) 10Joal: Add DDL for mediawiki_history_incremental_v1 Iceberg table (035 comments) [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1287959 (https://phabricator.wikimedia.org/T425729) (owner: 10Xcollazo) [14:26:21] (03CR) 10Xcollazo: Add DDL for mediawiki_history_incremental_v1 Iceberg table (035 comments) [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1287959 (https://phabricator.wikimedia.org/T425729) (owner: 10Xcollazo) [14:40:03] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 10Event-Platform: Streaming HTML & Edit Types - productionization checklist - https://phabricator.wikimedia.org/T423920#11941190 (10AKhatun_WMF) Wanted to note here: - The html counts dataset has data from `2026-05-17 14` since the change was merged/deplo... [14:40:40] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 10Event-Platform: Streaming HTML & Edit Types - productionization checklist - https://phabricator.wikimedia.org/T423920#11941196 (10AKhatun_WMF) [14:43:34] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 10Event-Platform: Delete old edit-type stream - https://phabricator.wikimedia.org/T424364#11941221 (10AKhatun_WMF) [14:56:26] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 06SRE, 10Event-Platform, 13Patch-For-Review: Flink Page View: Create K8s resources - https://phabricator.wikimedia.org/T426425#11941291 (10brouberol) I created the s3 user, added the keypair into the `webrequest-page-view-next` secrets and created the... [15:14:20] 06Data-Engineering: Move away from redacteddb for sqoop jobs - https://phabricator.wikimedia.org/T426870 (10AKhatun_WMF) 03NEW [15:15:47] 06Data-Engineering: Move away from redacteddb for sqoop jobs - https://phabricator.wikimedia.org/T426870#11941394 (10AKhatun_WMF) [15:19:44] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 10DPE-MediaWiki-Incremental-History: Iceberg 1.2.1 JAR seems to clash with 1.6.1 on Spark 3.5 executor classpath - https://phabricator.wikimedia.org/T426801#11941396 (10BTullis) > Both Iceberg runtime JARs end up on the executor classpath when submitting a... [15:32:01] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 10DPE-MediaWiki-Incremental-History: Spike: full-history revert detection for `mediawiki_history_incremental_v1` - https://phabricator.wikimedia.org/T426469#11941436 (10Isaac) Thanks @xcollazo for this data and the details around back-filling the revision... [15:39:29] 06Data-Engineering, 10MediaWiki-User-management, 06Stewards-and-global-tools, 10Event-Platform, and 5 others: userrights-interwiki fails with server error - https://phabricator.wikimedia.org/T426832#11941458 (10DerHexer) >>! In T426832#11939827, @Urbanecm_WMF wrote: > This is a critical bug, as it means th... [15:43:13] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 06SRE, 10Event-Platform, 13Patch-For-Review: Flink Page View: Create K8s resources - https://phabricator.wikimedia.org/T426425#11941499 (10brouberol) [15:43:39] !log Test Kitchen mw-user experiment (poll 20765) - adds: none; removes: none; fields: growthexperiments-revise-tone - xLab/MPIC/TK tips at https://w.wiki/FwuD [15:43:41] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [15:57:46] 06Data-Engineering, 10MediaWiki-User-management, 06Stewards-and-global-tools, 10Event-Platform, and 5 others: userrights-interwiki fails with server error - https://phabricator.wikimedia.org/T426832#11941581 (10Urbanecm_WMF) >>! In T426832#11941458, @DerHexer wrote: > Not sure if I get it right: Because we... [17:08:05] 06Data-Engineering, 07Epic, 10Event-Platform: Flink 2 migration - https://phabricator.wikimedia.org/T426863#11941902 (10dcausse) [17:30:34] 06Data-Engineering, 10AbuseFilter, 06DBA, 07Schema-change-in-production: Drop AbuseFilter tables from closed wikis - https://phabricator.wikimedia.org/T425066#11942003 (10Ahoelzl) @JAllemandou I assume there is no impact on DPE, please confirm. [17:43:58] 06Data-Engineering, 10ChangeProp, 10EventStreams, 10Proton, and 5 others: Migrate node-based services in production to node20 - https://phabricator.wikimedia.org/T364779#11942031 (10Ahoelzl) [17:45:09] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 06Data-Engineering-Radar, 06ServiceOps new, 10ServiceOps-Services-Oids, and 3 others: Make eventstreams-internal available to WMF staff without an ssh tunnel - https://phabricator.wikimedia.org/T348763#11942037 (10atsuko) Got service working on dpe-k8s... [18:04:00] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 10DPE-MediaWiki-Incremental-History, 13Patch-For-Review: Implement MERGE INTO writers for mediawiki_history_incremental_v1 - https://phabricator.wikimedia.org/T425729#11942088 (10xcollazo) **Partition granularity: days(event_timestamp) → months(event_tim... [19:23:24] 06Data-Engineering, 10EventStreams: Support new fields: (1) namespace textual prefix and (2) page title without prefix - https://phabricator.wikimedia.org/T426268#11942415 (10Ottomata) > changing the present emission behavior on page_title constitutes a breaking change. Indeed. Okay new field. --- For namespa... [19:31:08] 06Data-Engineering, 10AbuseFilter, 06DBA, 07Schema-change-in-production: Drop AbuseFilter tables from closed wikis - https://phabricator.wikimedia.org/T425066#11942424 (10JAllemandou) >>! In T425066#11942002, @Ahoelzl wrote: > @JAllemandou I assume there is no impact on DPE, please confirm. Indeed we don'... [19:31:24] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 10Event-Platform: Delete old edit-type stream - https://phabricator.wikimedia.org/T424364#11942426 (10AKhatun_WMF) [19:32:20] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 10DPE-MediaWiki-Incremental-History: Spike: full-history revert detection for `mediawiki_history_incremental_v1` - https://phabricator.wikimedia.org/T426469#11942434 (10Ottomata) > Rerunning your queries but with the WHERE ARRAY_CONTAINS(revision_tags, 'mw... [19:42:06] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 10Event-Platform: Streaming HTML & Edit Types - productionization checklist - https://phabricator.wikimedia.org/T423920#11942446 (10Ottomata) > I assumed it would take all data available. https://wikitech.wikimedia.org/wiki/Data_Platform/Event_Sanitizati... [19:46:22] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 10Event-Platform: Streaming HTML & Edit Types - productionization checklist - https://phabricator.wikimedia.org/T423920#11942472 (10AKhatun_WMF) Ah, that makes sense! We don't need to get data into sanitized right now. Just wanted to inform. But looks like... [20:15:38] 06Data-Engineering, 10EventStreams: Support new fields: (1) namespace textual prefix and (2) page title without prefix - https://phabricator.wikimedia.org/T426268#11942560 (10dr0ptp4kt) >>! In T426268#11942415, @Ottomata wrote: >> changing the present emission behavior on page_title constitutes a breaking chan... [20:18:39] 06Data-Engineering, 10EventStreams: Support new fields: (1) namespace textual prefix and (2) page title without prefix - https://phabricator.wikimedia.org/T426268#11942578 (10dr0ptp4kt) Hmm, `page_title_no_ns`...? [20:21:27] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 06Data-Platform-SRE (2026-04-24 - 2026-05-15), 13Patch-For-Review: Enable the opt-in use of conda-analytics-next with the DbtSkeinOperator in Airflow - https://phabricator.wikimedia.org/T426728#11942582 (10amastilovic) a:03amastilovic [20:29:41] (03CR) 10Aleksandar Mastilovic: [V:03+2 C:03+2] "LGTM!" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1288444 (https://phabricator.wikimedia.org/T419522) (owner: 10KCVelaga) [21:05:46] (03PS1) 10Xcollazo: Ingest revision_visibility_change to populate revision_deleted_parts [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1290064 (https://phabricator.wikimedia.org/T425573) [21:10:50] (03CR) 10Xcollazo: Ingest revision_visibility_change to populate revision_deleted_parts (031 comment) [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1290064 (https://phabricator.wikimedia.org/T425573) (owner: 10Xcollazo) [21:27:54] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st): Improve DbtSkeinOperator usability - https://phabricator.wikimedia.org/T426911 (10amastilovic) 03NEW [21:30:32] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 10DPE-MediaWiki-Incremental-History: Spike: full-history revert detection for `mediawiki_history_incremental_v1` - https://phabricator.wikimedia.org/T426469#11942830 (10Isaac) > Huh! In my revert spelunking in T423583, I learned that mw-reverted is only ad... [21:35:24] 06Data-Engineering, 10MediaWiki-User-management, 06Stewards-and-global-tools, 10Event-Platform, and 4 others: userrights-interwiki fails with server error - https://phabricator.wikimedia.org/T426832#11942842 (10Xaosflux) FYI: Just tried and PASSED against the original user story in production. [22:07:54] !log Test Kitchen mw-user experiment (poll 21910) - adds: none; removes: none; fields: fy25-26-we-1-7-8-suggestion-mode-beta - xLab/MPIC/TK tips at https://w.wiki/FwuD [22:07:56] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log