[03:25:10] 10Analytics-Canonical-Data, 06Movement-Insights (FY26-27 H1): Update canonical wiki dataset generation based on changes in language name data - https://phabricator.wikimedia.org/T420126#12102853 (10nshahquinn-wmf) [03:25:20] 10Analytics-Canonical-Data, 06Movement-Insights (FY26-27 H1): Upload canonical datasets to the Data Lake using Wmfdata's spark.upload_pandas - https://phabricator.wikimedia.org/T355847#12102857 (10nshahquinn-wmf) [03:25:26] 06Data-Engineering, 06Data-Engineering-Radar, 10Wmfdata-Python, 06Movement-Insights (FY26-27 H1): Fix lint issues in Wmfdata-Python and make the linting CI blocking - https://phabricator.wikimedia.org/T381657#12102859 (10nshahquinn-wmf) [03:25:31] 10Analytics-Canonical-Data, 06Movement-Insights: Review and support addition of language and incubating wikis to canonical data - https://phabricator.wikimedia.org/T401149#12102861 (10nshahquinn-wmf) [03:25:36] 06Data-Engineering, 06Movement-Insights, 10Wmfdata-Python: spark.run returns SQL dates as Python datetime.date, not Pandas datetime - https://phabricator.wikimedia.org/T384548#12102863 (10nshahquinn-wmf) [03:25:40] 06Data-Engineering, 06Data-Engineering-Radar, 06Movement-Insights, 10Wmfdata-Python: Support creating a Spark session with a GitLab-built Conda environment - https://phabricator.wikimedia.org/T378253#12102865 (10nshahquinn-wmf) [03:25:42] 06Data-Engineering, 06Movement-Insights, 10Wmfdata-Python: mariadb.run returns SQL dates as Python datetime.date, not Pandas datetime - https://phabricator.wikimedia.org/T384546#12102867 (10nshahquinn-wmf) [03:25:45] 10Analytics-Canonical-Data, 06Movement-Insights, 06Product-Analytics: Add a column to differentiate various wiki-types on canonical_data.wikis - https://phabricator.wikimedia.org/T361211#12102869 (10nshahquinn-wmf) [04:58:03] 14Analytics-Radar, 06Data-Engineering, 10Kafka-Infrastructure, 06serviceops-radar, and 4 others: Configuration Management for Kafka settings - https://phabricator.wikimedia.org/T276088#12102950 (10RKemper) We've got the third broker up now that some old instances have been cleaned up, so we're all set to s... [05:16:08] 06Data-Engineering, 10MediaWiki-Logevents, 10MediaWiki-User-management, 06Stewards-and-global-tools, and 3 others: User right log doesn't tally on a wiki and Meta - https://phabricator.wikimedia.org/T431176#12102968 (10Johannnes89) [05:53:43] 06Data-Engineering, 10BetaFeatures, 06cloud-services-team, 10Data-Services, and 5 others: Create view for betafeatures_user_counts table in wiki replicas - https://phabricator.wikimedia.org/T402145#12102995 (10Marostegui) [08:47:32] (03CR) 10Joal: [C:03+1] "LGTM!" [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1308685 (https://phabricator.wikimedia.org/T428961) (owner: 10A-pizzata) [08:52:12] (03CR) 10Joal: "All good for the streaming ingestion, but you also need to patch the associated batch job in hql/druid_load/generate_hourly_druid_webreque" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1308121 (https://phabricator.wikimedia.org/T427068) (owner: 10Elukey) [08:59:20] 06Data-Engineering, 10MediaWiki-Logevents, 10MediaWiki-User-management, 06Stewards-and-global-tools, and 4 others: User right log doesn't tally on a wiki and Meta - https://phabricator.wikimedia.org/T431176#12103522 (10mszwarc) The fix for this issue has been merged, I'll backport it today. In the meantime... [09:03:41] (03CR) 10Elukey: "Okok TIl. I guess that we need to modify the Airflow job first right? That produces the data, or in some other order?" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1308121 (https://phabricator.wikimedia.org/T427068) (owner: 10Elukey) [09:08:34] (03CR) 10Joal: [C:03+1] "LGTM" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1308190 (owner: 10Astein) [09:08:43] (03PS2) 10Elukey: druid: add two new dimensions to the webrequest sampled's indexing [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1308121 (https://phabricator.wikimedia.org/T427068) [09:16:12] (03CR) 10Joal: [C:03+1] "LGTM!" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1308121 (https://phabricator.wikimedia.org/T427068) (owner: 10Elukey) [09:17:38] (03CR) 10Joal: [C:03+1] "Actually you need the HQL change first, as the airflow code generates a spark job that'll need the new fields present for indexation :)" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1308121 (https://phabricator.wikimedia.org/T427068) (owner: 10Elukey) [09:23:39] (03CR) 10Joal: "Actually: can you please change the comit message to let reader know what the HQL is about (Add fr_tech/banner_activity_minutely.ql for in" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1308190 (owner: 10Astein) [09:32:22] (03CR) 10A-pizzata: [C:03+2] Remove any reference to the windowing of 90 Days. [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1308685 (https://phabricator.wikimedia.org/T428961) (owner: 10A-pizzata) [09:32:42] (03CR) 10A-pizzata: [V:03+2 C:03+2] Remove any reference to the windowing of 90 Days. [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1308685 (https://phabricator.wikimedia.org/T428961) (owner: 10A-pizzata) [09:49:39] (03Merged) 10jenkins-bot: Remove any reference to the windowing of 90 Days. [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1308685 (https://phabricator.wikimedia.org/T428961) (owner: 10A-pizzata) [10:26:25] (03CR) 10Elukey: [V:03+2 C:03+2] druid: add two new dimensions to the webrequest sampled's indexing [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1308121 (https://phabricator.wikimedia.org/T427068) (owner: 10Elukey) [11:14:04] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10Event-Platform: Relative Trending - Milestone 3 - K8s resources - https://phabricator.wikimedia.org/T430136#12104331 (10Ahoelzl) @BTullis can we get some love on this one? It's blocking our milestone due tomorrow. Thank you! [11:20:21] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10Event-Platform: Relative Trending - Milestone 3 - K8s resources - https://phabricator.wikimedia.org/T430136#12104344 (10BTullis) I have created the users: ` btullis@cephosd1001:~$ sudo radosgw-admin user create --uid=pageview-trending-relative --disp... [11:20:31] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10Event-Platform: Relative Trending - Milestone 3 - K8s resources - https://phabricator.wikimedia.org/T430136#12104347 (10BTullis) [11:49:10] (03CR) 10Joal: [V:03+2 C:03+2] "Merging" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1306491 (https://phabricator.wikimedia.org/T430020) (owner: 10KCVelaga) [12:00:53] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10Event-Platform: Relative Trending - Milestone 3 - K8s resources - https://phabricator.wikimedia.org/T430136#12104704 (10BTullis) I've added the secrets to the namespaces, so they should be accessible by deployers and by the flink apps. @JMonton-WMF h... [12:24:57] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 06Data-Platform-SRE: Metrics Superset dashboard access for all WMF - https://phabricator.wikimedia.org/T431697 (10Ahoelzl) 03NEW [12:25:07] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 06Data-Platform-SRE, 05Metrics-Sprint-2026-2027: Metrics Superset dashboard access for all WMF - https://phabricator.wikimedia.org/T431697#12104853 (10Ahoelzl) [12:40:37] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10DPE-MediaWiki-Incremental-History, 10Event-Platform: MediaWiki state change streams- add access_method & platform details - https://phabricator.wikimedia.org/T424887#12105031 (10Milimetric) The DPE definition of `access_method` is pretty consistent... [13:02:08] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 06Data-Platform-SRE (2026-07-03 - 2026-07-31), 05Metrics-Sprint-2026-2027: Metrics Superset dashboard access for all WMF - https://phabricator.wikimedia.org/T431697#12105094 (10Gehel) p:05Triage→03High [13:44:01] 06Data-Engineering, 10MediaWiki-Logevents, 10MediaWiki-User-management, 06Stewards-and-global-tools, and 5 others: User right log doesn't tally on a wiki and Meta - https://phabricator.wikimedia.org/T431176#12105297 (10mszwarc) The issue is fixed now and the fix backported. I also updated the database to f... [13:46:06] 06Data-Engineering, 10MediaWiki-Logevents, 10MediaWiki-User-management, 06Stewards-and-global-tools, and 5 others: User right log doesn't tally on a wiki and Meta - https://phabricator.wikimedia.org/T431176#12105303 (10mszwarc) 05In progress→03Resolved [13:50:11] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st): Secret management on airflow for the automated transfer of (public) datasets from stats infra --> WME AWS - https://phabricator.wikimedia.org/T415208#12105323 (10Htriedman) Hi! Sorry for the delay here, this is in the midst of getting resolved right now. See... [14:28:33] (03PS4) 10Astein: Add fr_tech/banner_activity_minutely.hql This file generats banner activity data to be pushed to fr tech's data lake [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1308190 [14:36:35] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10Event-Platform: Relative Trending - Milestone 3 - K8s resources - https://phabricator.wikimedia.org/T430136#12105631 (10JMonton-WMF) [14:36:54] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10Event-Platform: Relative Trending - Milestone 3 - K8s resources - https://phabricator.wikimedia.org/T430136#12105636 (10JMonton-WMF) Buckets created. The application is running now. I'll move the task to Done. Thanks! [14:47:47] 06Data-Engineering, 10Dumps-Generation: MediaWiki Content File Exports are incomplete - https://phabricator.wikimedia.org/T431723 (10jberkel) 03NEW [14:53:14] 06Data-Engineering, 10Dumps-Generation: MediaWiki Content File Exports are incomplete - https://phabricator.wikimedia.org/T431723#12105778 (10jberkel) [15:05:35] (03PS5) 10JavierMonton: Add hql/fr_tech/banner_activity_minutely.hql This file generats banner activity data to be pushed to fr tech's data lake [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1308190 (owner: 10Astein) [15:05:59] (03CR) 10JavierMonton: [C:03+2] Add hql/fr_tech/banner_activity_minutely.hql This file generats banner activity data to be pushed to fr tech's data lake [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1308190 (owner: 10Astein) [15:48:31] 06Data-Engineering: Master's Thesis Proposal: Contributing to Wikimedia's Data Platform - https://phabricator.wikimedia.org/T428674#12106065 (10JaimeAvaloss) Dear @Ahoelz, did you have the chance to look into this? To be honest I did not apply to any other company, time passes by fast and I will need to start my... [17:28:43] 06Data-Engineering, 06Product-Analytics: Dbt backfill: signal_driven_handling_bad_faith_accounts - https://phabricator.wikimedia.org/T431279#12106390 (10amastilovic) Backfill completed. [20:08:52] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 07OKR-Work (WE1 FY2025-26): [Spike] Adding access_method metadata to moderator action event streams - https://phabricator.wikimedia.org/T419019#12106876 (10Ottomata) BTW, I think we are being asked for more than just access_method: {T429211}. (cc @Ahoelzl ) [20:16:28] 06Data-Engineering, 06SRE, 06Data-Platform-SRE (2026-07-03 - 2026-07-31), 07Sustainability (Incident Followup): The webrequest_sampled_live data pipeline and its query tools have become mission-critical and require re-engineering for resilience - https://phabricator.wikimedia.org/T431112#12106896 (10bd8...