[01:41:32] 06Data-Engineering, 10Data-Engineering-Jupyter: Jupyter spawner's list of Conda environments only updates when an environment is spawned - https://phabricator.wikimedia.org/T391894#10741930 (10nshahquinn-wmf) p:05Triage→03Low This can be occasionally be confusing and require time-consuming workarounds, but... [02:24:00] 06Data-Engineering, 10Data-Engineering-Jupyter: Conda-Analytics has package conflict when trying to install key packages (R-Arrow and R-Stringi) - https://phabricator.wikimedia.org/T391911 (10nshahquinn-wmf) 03NEW [02:36:30] 06Data-Engineering, 10Data-Engineering-Jupyter: Conda-Analytics has package conflict when trying to install R with key packages (R-Arrow and R-Stringi) - https://phabricator.wikimedia.org/T391911#10742004 (10nshahquinn-wmf) [06:23:42] 06Data-Engineering, 06Machine-Learning-Team, 06Research, 10Event-Platform: Emit revision revert risk scores as a stream and expose in EventStreams API - https://phabricator.wikimedia.org/T326179#10742272 (10isarantopoulos) >>! In T326179#10718156, @Ottomata wrote: > Once this stream is deployed and active,... [08:47:59] 06Data-Engineering, 06Discovery-Search, 06Infrastructure-Foundations, 10Data-Platform-SRE (2025-04-12 - 2025-05-02): Elasticsearch dependency upgrade in spicerack - https://phabricator.wikimedia.org/T390860#10742657 (10Gehel) We should probably remove the dependency on the python-elasticsearch library. Wha... [09:48:18] 06Data-Engineering, 06Data-Engineering-Radar, 06DBA, 07Schema-change-in-production: Drop afl_patrolled_by from abuse_filter_log in production - https://phabricator.wikimedia.org/T391056#10742784 (10FCeratto-WMF) [09:54:43] 06Data-Engineering, 06Data-Engineering-Radar, 06DBA, 07Schema-change-in-production: Drop afl_patrolled_by from abuse_filter_log in production - https://phabricator.wikimedia.org/T391056#10742788 (10FCeratto-WMF) [13:12:41] (03PS1) 10Milimetric: Release 2.10.4 [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/1136723 [13:13:50] (03PS2) 10Milimetric: Release 2.10.4 [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/1136723 [13:14:08] (03CR) 10Milimetric: [C:03+2] Release 2.10.4 [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/1136723 (owner: 10Milimetric) [13:14:57] 06Data-Engineering, 06Machine-Learning-Team, 06Research, 10Event-Platform: Emit revision revert risk scores as a stream and expose in EventStreams API - https://phabricator.wikimedia.org/T326179#10743606 (10Ottomata) I don't think so! The data in these streams is the same as in `mediawiki.page_change.v1`,... [13:15:27] (03Merged) 10jenkins-bot: Release 2.10.4 [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/1136723 (owner: 10Milimetric) [13:18:16] 06Data-Engineering, 10observability, 10Event-Platform: Data Platform, SRE Observability, overlaps, use cases, and potential - https://phabricator.wikimedia.org/T390323#10743612 (10Ottomata) [13:22:29] (03CR) 10Lucas Werkmeister (WMDE): Add Prometheus stats push (0311 comments) [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/1136417 (https://phabricator.wikimedia.org/T389344) (owner: 10Hasan Akgün (WMDE)) [13:36:50] (03PS6) 10Hasan Akgün (WMDE): Add Prometheus stats push [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/1136417 (https://phabricator.wikimedia.org/T389344) [13:42:48] (03CR) 10Hasan Akgün (WMDE): "About the naming debate; I have pretty much no idea about the context here so I couldn't come up with good stats names, and imho we don't " [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/1136417 (https://phabricator.wikimedia.org/T389344) (owner: 10Hasan Akgün (WMDE)) [13:46:46] 10Data-Engineering (Q4 2025 April 1st - June 30th), 10MediaWiki-DomainEvents, 07Epic, 10Event-Platform, and 2 others: Hypothesis 5.2.13: EventBus Adoption of Domain Events - https://phabricator.wikimedia.org/T391254#10743764 (10Ottomata) a:03gmodena [13:51:47] (03PS7) 10Hasan Akgün (WMDE): Add Prometheus stats push [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/1136417 (https://phabricator.wikimedia.org/T389344) [14:05:19] (03CR) 10Lucas Werkmeister (WMDE): Add Prometheus stats push (031 comment) [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/1136417 (https://phabricator.wikimedia.org/T389344) (owner: 10Hasan Akgün (WMDE)) [14:18:03] (03CR) 10Lucas Werkmeister (WMDE): Add Prometheus stats push (031 comment) [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/1136417 (https://phabricator.wikimedia.org/T389344) (owner: 10Hasan Akgün (WMDE)) [14:31:20] (03CR) 10Hasan Akgün (WMDE): Add Prometheus stats push (033 comments) [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/1136417 (https://phabricator.wikimedia.org/T389344) (owner: 10Hasan Akgün (WMDE)) [14:32:47] (03PS8) 10Hasan Akgün (WMDE): Add Prometheus stats push [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/1136417 (https://phabricator.wikimedia.org/T389344) [14:33:36] 10Data-Engineering (Q4 2025 April 1st - June 30th), 10Event-Platform: Some events in mediawiki.page_change.v1 refers to auth.wikimedia.org in meta.uri and meta.domain - https://phabricator.wikimedia.org/T388825#10743988 (10Ottomata) I asked MW folks about this [[ https://wikimedia.slack.com/archives/C05D7UDJZ5... [14:40:19] (03CR) 10Lucas Werkmeister (WMDE): Add Prometheus stats push (031 comment) [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/1136417 (https://phabricator.wikimedia.org/T389344) (owner: 10Hasan Akgün (WMDE)) [14:45:18] (03CR) 10Lucas Werkmeister (WMDE): Add Prometheus stats push (031 comment) [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/1136417 (https://phabricator.wikimedia.org/T389344) (owner: 10Hasan Akgün (WMDE)) [14:51:04] (03CR) 10Lucas Werkmeister (WMDE): Add Prometheus stats push (031 comment) [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/1136417 (https://phabricator.wikimedia.org/T389344) (owner: 10Hasan Akgün (WMDE)) [14:52:18] (03CR) 10Hasan Akgün (WMDE): Add Prometheus stats push (031 comment) [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/1136417 (https://phabricator.wikimedia.org/T389344) (owner: 10Hasan Akgün (WMDE)) [15:03:24] 06Data-Engineering, 10observability, 10Event-Platform: Data Platform, SRE Observability, overlaps, use cases, and potential - https://phabricator.wikimedia.org/T390323#10744131 (10Ottomata) [15:08:27] 06Data-Engineering, 10observability, 10Event-Platform: Data Platform, SRE Observability, overlaps, use cases, and potential - https://phabricator.wikimedia.org/T390323#10744159 (10Ottomata) [15:09:21] 06Data-Engineering, 10LDAP-Access-Requests, 06SRE, 10SRE-Access-Requests: Requesting access to analytics-privatedata-users for kcoleman - https://phabricator.wikimedia.org/T391861#10744161 (10MatthewVernon) [15:20:29] 06Data-Engineering, 10LDAP-Access-Requests, 06SRE, 10SRE-Access-Requests: Requesting access to analytics-privatedata-users for kcoleman - https://phabricator.wikimedia.org/T391861#10744224 (10MatthewVernon) [15:22:01] 06Data-Engineering, 10LDAP-Access-Requests, 06SRE, 10SRE-Access-Requests: Requesting access to analytics-privatedata-users for kcoleman - https://phabricator.wikimedia.org/T391861#10744247 (10MatthewVernon) @RHo can you approve this request, please? Once that's done, this request can proceed. [15:26:44] 06Data-Engineering, 10LDAP-Access-Requests, 06SRE, 10SRE-Access-Requests: Requesting access to analytics-privatedata-users for Lena Meintrup - https://phabricator.wikimedia.org/T391820#10744259 (10MatthewVernon) [15:47:00] 10Data-Engineering (Q4 2025 April 1st - June 30th), 10Event-Platform, 13Patch-For-Review: Some events in mediawiki.page_change.v1 refers to auth.wikimedia.org in meta.uri and meta.domain - https://phabricator.wikimedia.org/T388825#10744377 (10Ottomata) a:03Ottomata [15:52:59] 06Data-Engineering, 10LDAP-Access-Requests, 06SRE, 10SRE-Access-Requests, 13Patch-For-Review: Requesting access to analytics-privatedata-users for Lena Meintrup - https://phabricator.wikimedia.org/T391820#10744409 (10MatthewVernon) 05Open→03Resolved a:03MatthewVernon @Lena_WMDE this is done now... [16:15:54] 06Data-Engineering, 06Data-Engineering-Radar, 07Epic: Data Platform Data Incidents - https://phabricator.wikimedia.org/T378559#10744529 (10Ahoelzl) [16:16:16] 10Data-Engineering (Q4 2025 April 1st - June 30th), 10Commons-Impact-Metrics, 13Patch-For-Review: [CIM] Skewed ranking with the top Editors monthly API - https://phabricator.wikimedia.org/T370470#10744534 (10mforns) The Commons Impact Metrics AQS service has been deployed. Also the re-loading of the Cassandr... [16:17:07] 10Data-Engineering (Q4 2025 April 1st - June 30th), 10Commons-Impact-Metrics: [Commons Impact Metrics] Add page wiki to the corresponding top endpoints - https://phabricator.wikimedia.org/T372805#10744542 (10mforns) This issue has been solved by the changes in T370470. [16:18:35] 10Data-Engineering (Q4 2025 April 1st - June 30th), 10Commons-Impact-Metrics, 13Patch-For-Review: [CIM] Skewed ranking with the top Editors monthly API - https://phabricator.wikimedia.org/T370470#10744547 (10EChukwukere-WMF) @mforns it was a long journey ;) but thanks alot! I will now run tests in production [16:34:45] 10Data-Engineering (Q4 2025 April 1st - June 30th), 10Commons-Impact-Metrics, 13Patch-For-Review: [CIM] Skewed ranking with the top Editors monthly API - https://phabricator.wikimedia.org/T370470#10744634 (10mforns) > @mforns it was a long journey ;) but thanks alot! I will now run tests in production Yes, i... [16:41:52] 06Data-Engineering, 10LDAP-Access-Requests, 06SRE, 10SRE-Access-Requests: Requesting access to analytics-privatedata-users for kcoleman - https://phabricator.wikimedia.org/T391861#10744645 (10RHo) >>! In T391861#10744224, @MatthewVernon wrote: > @RHo can you approve this request, please? Once that's done,... [16:43:40] 10Data-Engineering (Q4 2025 April 1st - June 30th): Enable Spark data lineage for all Airflow instances - https://phabricator.wikimedia.org/T386862#10744648 (10tchin) Throwing out a guess, it seems like because where the lineage runs depends on the driver, it needs to somehow be aware of whether or not it's runn... [16:49:04] 06Data-Engineering, 10observability, 10Observability-Metrics, 10Event-Platform: Produce MediaWiki client emitted operational metrics into Event Platform, allowing them to be queried in the WMF Data Lake with SQL - https://phabricator.wikimedia.org/T390328#10744656 (10Ottomata) [17:20:58] 10Data-Engineering-Jupyter, 06Data-Platform-SRE: Upgrade to JupyterLab ≥ 4.2 - https://phabricator.wikimedia.org/T391905#10744744 (10Ahoelzl) [17:23:22] 06Data-Engineering, 10LDAP-Access-Requests, 06SRE, 10SRE-Access-Requests: Requesting access to analytics-privatedata-users for kcoleman - https://phabricator.wikimedia.org/T391861#10744752 (10Ahoelzl) Approved from DPE DE. [17:48:18] 10Data-Engineering (Q4 2025 April 1st - June 30th), 10DPE-Mediawiki-Content: Modify table maintenance mechanism to support Iceberg's rewrite_position_delete_files() - https://phabricator.wikimedia.org/T391280#10744839 (10xcollazo) Running [[ https://airflow.wikimedia.org/dags/table_maintenance_iceberg_monthly/... [17:50:06] 10Data-Engineering (Q4 2025 April 1st - June 30th), 10DPE-Mediawiki-Content: Modify table maintenance mechanism to support Iceberg's rewrite_position_delete_files() - https://phabricator.wikimedia.org/T391280#10744842 (10xcollazo) [18:02:35] 06Data-Engineering, 10Data Pipelines: Provide an easy way for MediaWiki to fetch aggregate statistics from the data lake - https://phabricator.wikimedia.org/T341649#10744904 (10Ahoelzl) Thanks for filing, added this to our essential work catalog. [18:55:58] 06Data-Engineering, 06Data-Engineering-Radar, 10Dumps-Generation, 06MediaWiki-Platform-Team, 06serviceops: Migrate WMF production from PHP 7.4 to PHP 8.1 - https://phabricator.wikimedia.org/T319432#10745119 (10Scott_French) Following up on discussion out of band about remaining hosts that install PHP 7.4... [19:38:35] 06Data-Engineering, 06Discovery-Search, 06Infrastructure-Foundations, 10Data-Platform-SRE (2025-04-12 - 2025-05-02): Elasticsearch dependency upgrade in spicerack - https://phabricator.wikimedia.org/T390860#10745276 (10bking) @Volans answers inline: > Do you have a timeline for the completion the project... [20:58:01] 06Data-Engineering, 10Data-Engineering-Jupyter: Conda-Analytics has package conflict when trying to install R with key packages (R-Arrow and R-Stringi) - https://phabricator.wikimedia.org/T391911#10745663 (10nshahquinn-wmf) @Ahoelzl what clarification are you looking for? [22:47:59] 06Data-Engineering, 10Data-Engineering-Jupyter: Conda-Analytics has package conflict when trying to install R with key packages (R-Arrow and R-Stringi) - https://phabricator.wikimedia.org/T391911#10745876 (10nshahquinn-wmf) [23:26:59] 06Data-Engineering, 10Data-Engineering-Jupyter: Conda-Analytics has package conflict when trying to install R with key packages (R-Arrow and R-Stringi) - https://phabricator.wikimedia.org/T391911#10745959 (10nshahquinn-wmf)