[00:47:42] FIRING: [2x] AlertLintProblem: Linting problems found for HaproxyKafkaDeliveryErrors - https://wikitech.wikimedia.org/wiki/Alertmanager#Alert_linting_found_problems - TODO - https://alerts.wikimedia.org/?q=alertname%3DAlertLintProblem [04:47:37] FIRING: [2x] AlertLintProblem: Linting problems found for HaproxyKafkaDeliveryErrors - https://wikitech.wikimedia.org/wiki/Alertmanager#Alert_linting_found_problems - TODO - https://alerts.wikimedia.org/?q=alertname%3DAlertLintProblem [06:35:53] 06Data-Engineering, 10Data-Platform-SRE (2025.05.24 - 2025.06.13), 10Event-Platform: Inconsistent state visibility for Flink deployments on dse-k8s-eqiad - https://phabricator.wikimedia.org/T395984#10889945 (10gmodena) >>! In T395984#10884447, @xcollazo wrote: > Seems like production Flink apps like [[ https... [06:50:33] 06Data-Engineering, 10Data-Platform-SRE (2025.05.24 - 2025.06.13), 10Event-Platform: Inconsistent state visibility for Flink deployments on dse-k8s-eqiad - https://phabricator.wikimedia.org/T395984#10889951 (10gmodena) >>! In T395984#10889945, @gmodena wrote: [...] > I need some help to inspect what's inside... [07:01:54] 06Data-Engineering, 06Data-Engineering-Radar, 10LDAP-Access-Requests, 06SRE, 10SRE-Access-Requests: Grant Access to analytics-privatedata-user for Anton Kokh (WMDE) - https://phabricator.wikimedia.org/T396190 (10Rosalie_WMDE) 03NEW [07:02:26] 06Data-Engineering, 06Data-Engineering-Radar, 10LDAP-Access-Requests, 06SRE, 10SRE-Access-Requests: Grant Access to analytics-privatedata-user for Rosalie_WMDE - https://phabricator.wikimedia.org/T396190#10889993 (10Rosalie_WMDE) [07:17:45] 06Data-Engineering, 06Data-Engineering-Radar, 10LDAP-Access-Requests, 06SRE, 10SRE-Access-Requests: Grant Access to analytics-privatedata-user for Anton Kokh (WMDE) - https://phabricator.wikimedia.org/T395917#10890001 (10SLyngshede-WMF) @KFrancis I believe this requires a signed NDA. @WMDECyn we also n... [07:26:07] 06Data-Engineering, 06Data-Engineering-Radar, 10LDAP-Access-Requests, 06SRE, and 2 others: Grant Access to analytics-privatedata-user for "Dena WMDE" - https://phabricator.wikimedia.org/T396129#10890004 (10SLyngshede-WMF) p:05Triage→03Medium a:03SLyngshede-WMF [07:26:18] 06Data-Engineering, 06Data-Engineering-Radar, 10LDAP-Access-Requests, 06SRE, 10SRE-Access-Requests: Grant Access to analytics-privatedata-user for Rosalie_WMDE - https://phabricator.wikimedia.org/T396190#10890006 (10SLyngshede-WMF) p:05Triage→03Medium a:03SLyngshede-WMF [07:33:14] 06Data-Engineering, 06Data-Engineering-Radar, 10LDAP-Access-Requests, 06SRE, 10SRE-Access-Requests: Grant Access to analytics-privatedata-user for Rosalie_WMDE - https://phabricator.wikimedia.org/T396190#10890010 (10SLyngshede-WMF) User already have NDA and WMDE LDAP groups. [07:44:47] 06Data-Engineering, 06Data-Engineering-Radar, 10LDAP-Access-Requests, 06SRE, and 2 others: Grant Access to analytics-privatedata-user for Rosalie_WMDE - https://phabricator.wikimedia.org/T396190#10890032 (10SLyngshede-WMF) @WMDE-leszek or @WMDECyn we just need an approval from a WMDE manager. [07:52:34] 06Data-Engineering, 06Data-Engineering-Radar, 10LDAP-Access-Requests, 06SRE, and 2 others: Grant Access to analytics-privatedata-user for Rosalie_WMDE - https://phabricator.wikimedia.org/T396190#10890040 (10WMDE-leszek) Thanks @SLyngshede-WMF - approved on WMDE's behalf. [07:53:32] 06Data-Engineering, 06Data-Engineering-Radar, 10LDAP-Access-Requests, 06SRE, 10SRE-Access-Requests: Grant Access to analytics-privatedata-user for Anton Kokh (WMDE) - https://phabricator.wikimedia.org/T395917#10890042 (10WMDE-leszek) Hey @SLyngshede-WMF - I have approved for WMDE above T395917#10880432 [07:53:46] 06Data-Engineering, 06Data-Engineering-Radar, 10LDAP-Access-Requests, 06SRE, and 2 others: Grant Access to analytics-privatedata-user for "Dena WMDE" - https://phabricator.wikimedia.org/T396129#10890043 (10SLyngshede-WMF) 05Open→03Resolved [07:54:51] 06Data-Engineering, 06Data-Engineering-Radar, 10LDAP-Access-Requests, 06SRE, 10SRE-Access-Requests: Grant Access to analytics-privatedata-user for Anton Kokh (WMDE) - https://phabricator.wikimedia.org/T395917#10890044 (10SLyngshede-WMF) @WMDE-leszek Sorry, I completely missed that. Thank you. [08:04:03] 06Data-Engineering, 06Data-Engineering-Radar, 10LDAP-Access-Requests, 06SRE, and 2 others: Grant Access to analytics-privatedata-user for Rosalie_WMDE - https://phabricator.wikimedia.org/T396190#10890051 (10SLyngshede-WMF) 05Open→03Resolved [08:47:37] FIRING: [2x] AlertLintProblem: Linting problems found for HaproxyKafkaDeliveryErrors - https://wikitech.wikimedia.org/wiki/Alertmanager#Alert_linting_found_problems - TODO - https://alerts.wikimedia.org/?q=alertname%3DAlertLintProblem [09:01:01] 10Data-Engineering (Q4 2025 April 1st - June 30th), 10MediaWiki-DomainEvents, 07Epic, 10Event-Platform, and 3 others: Testing the domain event refactoring with production data - https://phabricator.wikimedia.org/T394899#10890132 (10gmodena) >>! In T394899#10888603, @gmodena wrote: > - asymmetric difference... [09:29:29] 06Data-Engineering, 10LDAP-Access-Requests, 06SRE: Grant Access to Product's Superset & Turnilo for SKivlehan - https://phabricator.wikimedia.org/T393626#10890244 (10SLyngshede-WMF) 05Open→03Resolved User can reopen if access if not working. [11:59:37] 10Data-Engineering (Q4 2025 April 1st - June 30th), 10MediaWiki-DomainEvents, 07Epic, 10Event-Platform, and 3 others: EventBus: replace PageMoveCompleteHook with PageMovedEvent - https://phabricator.wikimedia.org/T393890#10890673 (10gmodena) [12:02:09] 10Data-Engineering (Q4 2025 April 1st - June 30th), 10MediaWiki-DomainEvents, 07Epic, 10Event-Platform, and 2 others: EventBus: replace ArticleRevisionVisibilitySetHook with a RevisionVisibilityChangedEvent listener - https://phabricator.wikimedia.org/T396213 (10gmodena) 03NEW [12:41:52] 10Data-Engineering (Q4 2025 April 1st - June 30th), 10MediaWiki-DomainEvents, 07Epic, 10Event-Platform, and 3 others: EventBus: Replace PageUndeleteCompleteHook with PageRevisionUpdated - https://phabricator.wikimedia.org/T393891#10890784 (10gmodena) [12:47:37] FIRING: [2x] AlertLintProblem: Linting problems found for HaproxyKafkaDeliveryErrors - https://wikitech.wikimedia.org/wiki/Alertmanager#Alert_linting_found_problems - TODO - https://alerts.wikimedia.org/?q=alertname%3DAlertLintProblem [12:47:49] 06Data-Engineering, 06DBA, 13Patch-For-Review, 07Schema-change-in-production: Add afl_ip_hex column and afl_var_dump_timestamp index to abuse_filter_log - https://phabricator.wikimedia.org/T396130#10890799 (10Marostegui) p:05Triage→03Medium [14:13:57] 10Data-Engineering (Q4 2025 April 1st - June 30th), 10MediaWiki-DomainEvents, 07Epic, 10Event-Platform, and 3 others: Testing the domain event refactoring with production data - https://phabricator.wikimedia.org/T394899#10891114 (10daniel) > In the domain event handler we instantiate one from the delete pa... [15:44:00] 10Data-Engineering (Q4 2025 April 1st - June 30th), 10Data-Platform-SRE (2025.05.24 - 2025.06.13), 13Patch-For-Review: Enable lock transaction management on the Hive Metastore - https://phabricator.wikimedia.org/T386854#10891488 (10xcollazo) [15:44:42] 10Data-Engineering (Q4 2025 April 1st - June 30th), 10Data-Platform-SRE (2025.05.24 - 2025.06.13), 13Patch-For-Review: Enable lock transaction management on the Hive Metastore - https://phabricator.wikimedia.org/T386854#10891494 (10xcollazo) >>! In T386854#10871191, @xcollazo wrote: > Work remaining here as... [16:10:26] 10Data-Engineering (Q4 2025 April 1st - June 30th): Define SDS 2.1.11 hypothesis - ExP threats and mitigations - https://phabricator.wikimedia.org/T396078#10891617 (10JVanderhoop-WMF) I believe so. I suggest a meeting with you, @dr0ptp4kt, @Gehel, and a data engineer or two to work through the _how_ of these ite... [16:47:42] FIRING: [2x] AlertLintProblem: Linting problems found for HaproxyKafkaDeliveryErrors - https://wikitech.wikimedia.org/wiki/Alertmanager#Alert_linting_found_problems - TODO - https://alerts.wikimedia.org/?q=alertname%3DAlertLintProblem [18:58:43] 10Data-Engineering (Q4 2025 April 1st - June 30th), 10Data-Platform-SRE (2025.05.24 - 2025.06.13): Enable lock transaction management on the Hive Metastore - https://phabricator.wikimedia.org/T386854#10892294 (10xcollazo) (Manually deleted pool `mutex_for_wmf_data_ops_data_quality_metrics` via Airflow UI) [19:19:55] 06Data-Engineering, 06Data-Engineering-Radar, 10LDAP-Access-Requests, 06SRE, 10SRE-Access-Requests: Grant Access to analytics-privatedata-user for Anton Kokh (WMDE) - https://phabricator.wikimedia.org/T395917#10892387 (10KFrancis) Happy to help. I'll need the user's full name and email address. If they... [19:37:01] 06Data-Engineering, 10DPE-Mediawiki-Content: Consider whether we want to dump private and/or closed wikis - https://phabricator.wikimedia.org/T371509#10892435 (10xcollazo) 05Open→03Resolved a:03xcollazo We have had the datalake table `wmf_content.mediawiki_content_history` for a while, and now we als... [19:45:55] 10Data-Engineering-Roadmap, 10DPE-Mediawiki-Content, 07Epic: Support downstream users in adopting mediawiki_content_history_v1 - https://phabricator.wikimedia.org/T387021#10892446 (10xcollazo) 05Open→03Resolved [19:46:45] 10Data-Engineering (Q4 2025 April 1st - June 30th), 10DPE-Data-Quality, 10DPE-Mediawiki-Content: [Data Quality] Add ability to add tags to alerts - https://phabricator.wikimedia.org/T389162#10892449 (10xcollazo) 05Open→03Resolved [20:47:42] FIRING: [2x] AlertLintProblem: Linting problems found for HaproxyKafkaDeliveryErrors - https://wikitech.wikimedia.org/wiki/Alertmanager#Alert_linting_found_problems - TODO - https://alerts.wikimedia.org/?q=alertname%3DAlertLintProblem [22:27:11] 10Data-Engineering (Q4 2025 April 1st - June 30th), 06Movement-Insights: Investigate rise in May 2025 unique devices and reader metrics - https://phabricator.wikimedia.org/T395934#10892732 (10Ahoelzl)