[03:07:10] 06Data-Engineering, 06Research, 10Event-Platform: Implement stream of HTML content on mw.page_change event - https://phabricator.wikimedia.org/T360794#11399251 (10fkaelin) It would be great if you pick this up @JMonton-WMF . Regarding kafka cluster, jumbo would seem ok, I defer to DPEon that; our main usage... [06:35:50] 06Data-Engineering, 06DBA, 13Patch-For-Review, 07Schema-change-in-production: Drop rc_type from recentchanges in wmf production - https://phabricator.wikimedia.org/T410531#11399306 (10Marostegui) p:05Triage→03Medium [06:36:19] 06Data-Engineering, 06DBA, 13Patch-For-Review, 07Schema-change-in-production: Drop rc_type from recentchanges in wmf production - https://phabricator.wikimedia.org/T410531#11399308 (10Marostegui) [06:44:55] 06Data-Engineering, 06DBA, 13Patch-For-Review, 07Schema-change-in-production: Drop rc_type from recentchanges in wmf production - https://phabricator.wikimedia.org/T410531#11399310 (10Marostegui) [06:51:02] 06Data-Engineering, 06DBA, 13Patch-For-Review, 07Schema-change-in-production: Drop rc_type from recentchanges in wmf production - https://phabricator.wikimedia.org/T410531#11399317 (10Marostegui) [08:42:08] 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 06Movement-Insights, 06Data-Platform-SRE (2025.11.07 - 2025.11.28): Run dbt from Airflow - https://phabricator.wikimedia.org/T410268#11399404 (10Gehel) [08:44:31] 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 06SRE, 06Traffic, 06Data-Platform-SRE (2025.11.07 - 2025.11.28), 07Sustainability (Incident Followup): alerts should be triggered if druid fails to consume webrequest_sampled kafka topic - https://phabricator.wikimedia.org/T410019#11399416 (10Ge... [09:05:21] 06Data-Engineering, 06Data-Engineering-Radar, 10Observability-Logging, 06serviceops, and 2 others: Fix Kafka replicas skew - https://phabricator.wikimedia.org/T407185#11399489 (10brouberol) I've started rebalancing `kafka-logging-eqiad` with the following overall plan: ` Storage free change estimations:... [10:22:09] 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 06SRE, 06Traffic, 06Data-Platform-SRE (2025.11.07 - 2025.11.28), 07Sustainability (Incident Followup): alerts should be triggered if druid fails to consume webrequest_sampled kafka topic - https://phabricator.wikimedia.org/T410019#11399911 (10Ge... [11:23:45] 06Data-Engineering, 10MediaWiki-extensions-EventLogging, 10mwcli: Update eventlogging image for MWCLI - https://phabricator.wikimedia.org/T406317#11400086 (10JoelyRooke-WMDE) [11:27:46] 06Data-Engineering, 06Data-Engineering-Radar, 10Observability-Logging, 06serviceops, and 2 others: Fix Kafka replicas skew - https://phabricator.wikimedia.org/T407185#11400092 (10brouberol) {F70572765} All done [11:29:44] 06Data-Engineering, 06Data-Engineering-Radar, 10Observability-Logging, 06serviceops, and 2 others: Fix Kafka replicas skew - https://phabricator.wikimedia.org/T407185#11400103 (10brouberol) Because kafka-logging has heterogeneous partition sizes, the leadership count is expected, as it leads to traffic and... [11:55:06] 06Data-Engineering (Q2 FY25/26 October 1st - December 31th): Update MediaWiki Content History SLO draft for SRE review - https://phabricator.wikimedia.org/T401892#11400167 (10APizzata-WMF) Action items on the previous linked document: - AP to expand regarding the testing and reason behind the 99. - AP to c... [12:52:23] 06Data-Engineering, 06Reader Growth Team, 06Wikipedia-Android-App-Backlog, 06Wikipedia-iOS-App-Backlog, and 2 others: Add page_id and namespace to X-Analytics header in Mobile App requests (2025 remake) - https://phabricator.wikimedia.org/T409358#11400287 (10Jgiannelos) From what I understand there are 2 m... [13:29:51] 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 10Event-Platform, 13Patch-For-Review: Add CI step to event schema repositories to test to fail if a schema is deleted - https://phabricator.wikimedia.org/T377023#11400376 (10JMonton-WMF) In aims to move this check to the CI, but keeping it standard... [14:11:50] 06Data-Engineering, 10Data-Engineering-Wikistats, 06Movement-Insights: NEW FEATURE REQUEST: Temp Accounts on Wikistats - https://phabricator.wikimedia.org/T410796#11400535 (10GGoncalves-WMF) This looks like a very reasonable change, and Q3 sounds feasible; I'm not entirely sure how complex this is, but it l... [14:22:15] 06Data-Engineering, 06DBA, 07Schema-change-in-production: Drop rc_type from recentchanges in wmf production - https://phabricator.wikimedia.org/T410531#11400553 (10Marostegui) [14:28:26] 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 06SRE, 06Traffic, 06Data-Platform-SRE (2025.11.07 - 2025.11.28), 07Sustainability (Incident Followup): alerts should be triggered if druid fails to consume webrequest_sampled kafka topic - https://phabricator.wikimedia.org/T410019#11400587 (10Ge... [14:34:56] 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 10observability, 06SRE, 06Traffic, and 3 others: alerts should be triggered if druid fails to consume webrequest_sampled kafka topic - https://phabricator.wikimedia.org/T410019#11400611 (10Gehel) [14:35:49] 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 10observability, 06SRE, 06Traffic, and 3 others: alerts should be triggered if druid fails to consume webrequest_sampled kafka topic - https://phabricator.wikimedia.org/T410019#11400632 (10Gehel) As webrequest is critical for operational support,... [14:42:03] (03CR) 10Mforns: [C:03+2] "LGTM!" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1207489 (owner: 10Conniecc1) [14:50:36] 06Data-Engineering, 06Data-Engineering-Radar, 10Observability-Logging, 06serviceops, and 2 others: Fix Kafka replicas skew - https://phabricator.wikimedia.org/T407185#11400705 (10brouberol) a:05brouberol→03Clement_Goubert [15:13:56] 06Data-Engineering, 06Reader Growth Team, 06Wikipedia-Android-App-Backlog, 06Wikipedia-iOS-App-Backlog, and 2 others: Add page_id and namespace to X-Analytics header in Mobile App requests (2025 remake) - https://phabricator.wikimedia.org/T409358#11400817 (10Dbrant) If XAnalytics can be added at the PCS le... [15:23:59] 06Data-Engineering, 06Reader Growth Team, 06Wikipedia-Android-App-Backlog, 06Wikipedia-iOS-App-Backlog, and 2 others: Add page_id and namespace to X-Analytics header in Mobile App requests (2025 remake) - https://phabricator.wikimedia.org/T409358#11400893 (10Jgiannelos) I think that webrequest data stream... [15:34:43] 06Data-Engineering, 06Reader Growth Team, 06Wikipedia-Android-App-Backlog, 06Wikipedia-iOS-App-Backlog, and 3 others: Add page_id and namespace to X-Analytics header in Mobile App requests (2025 remake) - https://phabricator.wikimedia.org/T409358#11400996 (10MSantos) [15:39:13] 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 10observability, 06SRE, 06Traffic, and 3 others: alerts should be triggered if druid fails to consume webrequest_sampled kafka topic - https://phabricator.wikimedia.org/T410019#11401023 (10Gehel) 05Open→03Resolved [16:34:55] 06Data-Engineering, 06Reader Growth Team, 06Wikipedia-Android-App-Backlog, 06Wikipedia-iOS-App-Backlog, and 3 others: Add page_id and namespace to X-Analytics header in Mobile App requests (2025 remake) - https://phabricator.wikimedia.org/T409358#11401339 (10Ottomata) > If we implement it on PCS level that... [16:44:37] 06Data-Engineering, 06Reader Growth Team, 06Wikipedia-Android-App-Backlog, 06Wikipedia-iOS-App-Backlog, and 3 others: Add page_id and namespace to X-Analytics header in Mobile App requests (2025 remake) - https://phabricator.wikimedia.org/T409358#11401416 (10Jgiannelos) Ok, that makes more sense now, thank... [17:58:55] 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 06Research, 10Event-Platform: Implement stream of HTML content on mw.page_change event - https://phabricator.wikimedia.org/T360794#11402001 (10JMonton-WMF) a:03JMonton-WMF [18:04:55] 06Data-Engineering, 10Data-Engineering-Wikistats, 06Movement-Insights: NEW FEATURE REQUEST: Temp Accounts on Wikistats - https://phabricator.wikimedia.org/T410796#11402038 (10GGoncalves-WMF) From a quick discussion at the DE team meeting: - Temp accounts are supposed to be [[ https://github.com/wikimedia/a... [18:24:41] (03CR) 10Jforrester: "check experimental" [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/1191319 (owner: 10Lucas Werkmeister (WMDE)) [18:42:32] (03Abandoned) 10Conniecc1: Add the Incident reporting System interaction schema to the allowlist [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1117633 (https://phabricator.wikimedia.org/T384650) (owner: 10Conniecc1) [18:47:35] 06Data-Engineering: Productize Data for Monthly Active Moderator Actions - https://phabricator.wikimedia.org/T410940 (10SonjaPerry) 03NEW [19:13:34] 06Data-Engineering: Productize Data for Monthly Active Moderator Actions - https://phabricator.wikimedia.org/T410940#11402555 (10JMoore-WMF) adding here that the 1) content diffs and 2)edit types pipelines are key to making this workflow easier. awaiting documentation on these pipelines from @fkaelin [19:24:18] 06Data-Engineering, 10Data-Engineering-Wikistats, 06Movement-Insights: NEW FEATURE REQUEST: Temp Accounts on Wikistats - https://phabricator.wikimedia.org/T410796#11402586 (10Mayakp.wiki) hey @GGoncalves-WMF , thanks for that info! I wasnt aware that temp edits and temp editors are being counted under Anony... [20:22:28] (03PS1) 10Aqu: Add Spur datasets HQLs [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1210696 (https://phabricator.wikimedia.org/T410285) [21:32:19] 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 10Event-Platform, 13Patch-For-Review: Add CI step to event schema repositories to test to fail if a schema is deleted - https://phabricator.wikimedia.org/T377023#11403134 (10xcollazo) >I'm not sure if we have similar cases in other repositories. @... [22:09:08] !log failing over the Hadoop nameserver from an-master1003 to an-master1004 for T405943 [22:09:11] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [22:09:12] T405943: eqiad row C/D Data Platform host migrations - https://phabricator.wikimedia.org/T405943 [22:23:36] 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 06Data-Persistence: Provision Global Editor Metrics tables & endpoints - https://phabricator.wikimedia.org/T410962 (10Eevans) 03NEW [22:36:52] 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 06Data-Persistence, 13Patch-For-Review: Provision Global Editor Metrics tables & endpoints - https://phabricator.wikimedia.org/T410962#11403368 (10Eevans) p:05Triage→03Medium @mforns, @amastilovic I opened https://gitlab.wikimedia.org/repos/sre... [22:39:06] 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 07Essential-Work, 13Patch-For-Review: Upgrade gitlab-docker-runner to latest debian version - https://phabricator.wikimedia.org/T408019#11403376 (10xcollazo) Had to restart the VM, and lost the mounted volume. We were missing a mount definition... [22:50:27] 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 06Data-Persistence, 13Patch-For-Review: Provision Global Editor Metrics tables & endpoints - https://phabricator.wikimedia.org/T410962#11403410 (10amastilovic) @Eevans thank you for that MR! You are correct, `wiki_id` should be `TEXT` - we've alrea... [23:39:07] 06Data-Engineering, 06Data-Platform-SRE: Bump hadoop container maximum memory size - https://phabricator.wikimedia.org/T410966 (10JAllemandou) 03NEW