[04:50:21] 07Analytics-Data-Problem, 06Data-Engineering, 10Data-Platform: Inconsistent counts of global account registrations in analytics datasets - https://phabricator.wikimedia.org/T429061#12016927 (10nshahquinn-wmf) Related: I've drafted [a Dbt model for global registrations](https://gitlab.wikimedia.org/repos/data... [08:18:06] 06Data-Engineering, 06Data-Platform-SRE, 10Kafka-Infrastructure, 07Wikimedia-Incident: staging.webrequest.page_view.dev0 taking up most space on kafka-jumbo - https://phabricator.wikimedia.org/T429088#12017432 (10MLechvien-WMF) p:05Triage→03Unbreak! Incident was only mitigated by expanding filesystem b... [08:21:15] 06Data-Engineering, 06Data-Platform-SRE, 10Kafka-Infrastructure, 07Wikimedia-Incident: staging.webrequest.page_view.dev0 taking up most space on kafka-jumbo - https://phabricator.wikimedia.org/T429088#12017441 (10fgiunchedi) [08:32:21] 06Data-Engineering, 06Data-Platform-SRE, 10Kafka-Infrastructure, 07Wikimedia-Incident: staging.webrequest.page_view.dev0 taking up most space on kafka-jumbo - https://phabricator.wikimedia.org/T429088#12017472 (10brouberol) [08:39:52] 06Data-Engineering, 06Data-Platform-SRE, 10Kafka-Infrastructure, 07Incident Severity 3, 07Wikimedia-Incident: staging.webrequest.page_view.dev0 taking up most space on kafka-jumbo - https://phabricator.wikimedia.org/T429088#12017537 (10MLechvien-WMF) [09:19:37] 06Data-Engineering, 06Data-Platform-SRE, 10Kafka-Infrastructure, 07Incident Severity 3, 07Wikimedia-Incident: staging.webrequest.page_view.dev0 taking up most space on kafka-jumbo - https://phabricator.wikimedia.org/T429088#12017716 (10fgiunchedi) p:05Unbreak!→03Medium Issue has been fixed, though I'... [09:37:15] 06Data-Engineering, 06Data-Platform-SRE, 10Kafka-Infrastructure, 07Incident Severity 3, 07Wikimedia-Incident: staging.webrequest.page_view.dev0 taking up most space on kafka-jumbo - https://phabricator.wikimedia.org/T429088#12017793 (10JMonton-WMF) I believe @brouberol reduced the retention of the topic... [09:37:38] 06Data-Engineering, 06Data-Engineering-Radar, 06DBA, 07Schema-change-in-production: Drop il_to column from imagelinks table in wmf production - https://phabricator.wikimedia.org/T419635#12017796 (10FCeratto-WMF) [09:39:08] 06Data-Engineering, 06Data-Engineering-Radar, 06DBA, 07Schema-change-in-production: Drop il_to column from imagelinks table in wmf production - https://phabricator.wikimedia.org/T419635#12017805 (10FCeratto-WMF) The rollout on the database hosts is completed (See https://zarcillo.wikimedia.org/ui/schema_ch... [09:45:12] 06Data-Engineering, 06Data-Engineering-Radar, 06DBA, 07Schema-change-in-production: Drop il_to column from imagelinks table in wmf production - https://phabricator.wikimedia.org/T419635#12017813 (10Marostegui) Cool - then just remove the colum from modules/role/files/mariadb/filtered_tables.txt and this ca... [09:45:34] 06Data-Engineering, 06Data-Platform-SRE, 10FR-Tech-Analytics, 07Epic: Add FR Tech s3 secrets to airflow vars - https://phabricator.wikimedia.org/T429048#12017814 (10brouberol) What is your minio https endpoint, and (possibly) region? [09:51:12] (03CR) 10A-pizzata: [C:03+1] incremental mediawiki history: Add ingestion pipeline diagram [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1301381 (https://phabricator.wikimedia.org/T428824) (owner: 10Xcollazo) [09:55:01] (03CR) 10A-pizzata: [C:03+2] incremental mediawiki history: Add ingestion pipeline diagram [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1301381 (https://phabricator.wikimedia.org/T428824) (owner: 10Xcollazo) [09:55:57] 06Data-Engineering, 06Data-Platform-SRE, 10Kafka-Infrastructure, 07Incident Severity 3, 07Wikimedia-Incident: staging.webrequest.page_view.dev0 taking up most space on kafka-jumbo - https://phabricator.wikimedia.org/T429088#12017837 (10fgiunchedi) 05Open→03Resolved a:03fgiunchedi >>! In T429088... [10:11:49] (03Merged) 10jenkins-bot: incremental mediawiki history: Add ingestion pipeline diagram [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1301381 (https://phabricator.wikimedia.org/T428824) (owner: 10Xcollazo) [10:30:42] 06Data-Engineering, 06Data-Engineering-Radar, 06DBA, 13Patch-For-Review, 07Schema-change-in-production: Drop il_to column from imagelinks table in wmf production - https://phabricator.wikimedia.org/T419635#12017985 (10FCeratto-WMF) [10:30:56] 06Data-Engineering, 06Data-Engineering-Radar, 06DBA, 13Patch-For-Review, 07Schema-change-in-production: Drop il_to column from imagelinks table in wmf production - https://phabricator.wikimedia.org/T419635#12017986 (10FCeratto-WMF) puppet-merged, can we close this? [10:33:48] 06Data-Engineering, 06Data-Engineering-Radar, 06DBA, 07Schema-change-in-production: Drop il_to column from imagelinks table in wmf production - https://phabricator.wikimedia.org/T419635#12018000 (10Marostegui) >>! In T419635#12017985, @FCeratto-WMF wrote: > puppet-merged, can we close this? T419635#12017813 [11:58:58] !log Test Kitchen experiment (poll 1) - adds: ncs-cors-test, fy25-26-we-1-7-8-suggestion-mode-beta, attribution-research-2026-06-run, we-1-8-account-creation-form-v2, we-1-8-mobile-account-menu, growthexperiments-revise-tone, account-creation-reading-list-cta, share-highlight, logged-out-retention-round13, logged-out-retention-round15, incident_reporting_system_interaction, we-1-10-articleguidance... [11:59:00] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [12:17:39] 06Data-Engineering, 06Data-Platform-SRE, 10FR-Tech-Analytics, 07Epic: Add FR Tech s3 secrets to airflow vars - https://phabricator.wikimedia.org/T429048#12018364 (10AStein-WMF) https://franio1001.frack.eqiad.wmnet:9000 us-east-1 [12:48:13] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st): Add support for multiple teams email alerts on Airflow DBT DAG failures - https://phabricator.wikimedia.org/T429166 (10amastilovic) 03NEW [13:03:41] FYI, dse-k8s-worker1009 is down since almost five days [13:07:51] Starting build #13 for job wikimedia-event-utilities-maven-release [13:13:34] Project wikimedia-event-utilities-maven-release build #13: 09SUCCESS in 5 min 43 sec: https://integration.wikimedia.org/ci/job/wikimedia-event-utilities-maven-release/13/ [13:53:21] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 10DPE-Mediawiki-Content, 13Patch-For-Review: Missing/inconsistent page_redirect_target field for redirects in Mediawiki content current v1 dumps - https://phabricator.wikimedia.org/T400632#12019048 (10APizzata-WMF) ` spark.sql(""" select distinct p... [14:30:03] !log Test Kitchen experiment (poll 902) - adds: none; removes: ncs-cors-test; fields: none - TK tips at https://w.wiki/FwuD [14:30:05] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [14:47:36] 06Data-Engineering: Track mobile app and api account registration separately - https://phabricator.wikimedia.org/T429211 (10Ahoelzl) 03NEW [15:02:41] (03PS1) 10Gerrit maintenance bot: Add nyn.wikipedia to pageview allowlist [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1302183 (https://phabricator.wikimedia.org/T429217) [15:07:09] (03CR) 10Joal: [V:03+2 C:03+2] "Merging for later deploy" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1302183 (https://phabricator.wikimedia.org/T429217) (owner: 10Gerrit maintenance bot) [15:24:33] 06Data-Engineering: Analyze Superset virtual datasets to find candidates for materialization - https://phabricator.wikimedia.org/T429226 (10GGoncalves-WMF) 03NEW [15:25:53] 06Data-Engineering: Analyze Superset virtual datasets to find candidates for materialization - https://phabricator.wikimedia.org/T429226#12020036 (10GGoncalves-WMF) [15:27:08] 06Data-Engineering: Analyze Superset virtual datasets to find candidates for materialization - https://phabricator.wikimedia.org/T429226#12020048 (10GGoncalves-WMF) [15:30:08] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 13Patch-For-Review: Sqoop globalimagelinks and filerevision - https://phabricator.wikimedia.org/T427532#12020061 (10Antoine_Quhen) [15:31:47] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 13Patch-For-Review: Sqoop globalimagelinks and filerevision - https://phabricator.wikimedia.org/T427532#12020079 (10Antoine_Quhen) [15:39:04] 06Data-Engineering, 06Data-Engineering-Radar, 06Data-Platform-SRE (2026-06-05 - 2026-06-26), 10Event-Platform: Delete some unused development topics on Kafka Jumbo - https://phabricator.wikimedia.org/T427951#12020119 (10AKhatun_WMF) rc0 is not running anywhere and I've checked, everything deployed is on HE... [15:49:11] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 10DPE-Mediawiki-Content: mw_content_reconcile_mw_content_history_monthly failed on rerun - https://phabricator.wikimedia.org/T428999#12020170 (10APizzata-WMF) Since the `page_title` for the `redirect_page_link` is optional, possible solution could be to av... [16:07:08] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 10DPE-MediaWiki-Incremental-History: Bug fix: populate event_user_groups_historical for revisions and pages - https://phabricator.wikimedia.org/T428928#12020282 (10JAllemandou) [18:35:35] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 10DPE-MediaWiki-Incremental-History: Add source='snapshot+events' for incrementally-enriched snapshot rows - https://phabricator.wikimedia.org/T428969#12020918 (10AKhatun_WMF) For contributor counts use case, we don't care where the data is coming from. If... [20:12:15] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st): WE5.3.3b: Contributor Count Per Page [Attribution API] - https://phabricator.wikimedia.org/T426316#12021238 (10AKhatun_WMF) @Ottomata: so I ended up discarding `updated_at`, unfortunately. - One way I was thinking was to do `max(updated_at, current_load_time... [20:43:41] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st): WE5.3.3b: Contributor Count Per Page [Attribution API] - https://phabricator.wikimedia.org/T426316#12021317 (10AKhatun_WMF) [21:22:22] 06Data-Engineering, 06SRE, 10SRE-Access-Requests, 13Patch-For-Review: Requesting access to analytics-privatedata-users for Bliviero - https://phabricator.wikimedia.org/T428815#12021470 (10BCornwall) I apologize, but there was one important bit that I forgot to do - that's been fixed and your access sho... [21:28:54] 06Data-Engineering, 06SRE, 10SRE-Access-Requests, 13Patch-For-Review: Requesting access to analytics-privatedata-users for Bliviero - https://phabricator.wikimedia.org/T428815#12021477 (10BLiviero-WMF) thank you! i was still having trouble getting to some data cubes but was afraid to ask, glad it is g... [22:52:40] 06Data-Engineering, 10Data-Engineering-Wikistats, 10Pageviews-Anomaly: Sudden traffic increase on 1 November 2025 - https://phabricator.wikimedia.org/T412655#12021679 (10kzimmerman) [22:53:26] 06Data-Engineering, 10Data-Engineering-Wikistats, 10Pageviews-Anomaly: Sudden traffic increase on 1 November 2025 - https://phabricator.wikimedia.org/T412655#12021681 (10kzimmerman) I've updated the ticket to include the link to the data issue report: >ℹ️ **Update 2026-06-15: the data issue report about...