[09:01:13] 06Data-Engineering, 10Phabricator: Data Engineering's Herald rule (H126) might not currently react to any tasks - https://phabricator.wikimedia.org/T410248 (10A_smart_kitten) 03NEW [09:04:34] 06Data-Engineering, 10Phabricator: Data Engineering's Herald rule (H126) might not currently react to any tasks - https://phabricator.wikimedia.org/T410248#11377811 (10Aklapper) Thanks for finding this. Indeed `Project tags incl their milestones` is a hack from T144041 and can only work with "include none of" [09:19:23] 06Data-Engineering, 06Machine-Learning-Team, 06serviceops: Enable ChangeProp to consume mediawiki.page_content_change.v1 - https://phabricator.wikimedia.org/T409469#11377845 (10JMonton-WMF) That sounds good. Then, we could consider increasing the partitions in Jumbo too, `codfw.mediawiki.page_content_change.... [10:06:40] 06Data-Engineering, 06Data-Engineering-Radar, 06Experimentation Lab, 10MediaWiki-extensions-EventLogging, and 2 others: Deprecate and remove MetricsClient#dispatch() - https://phabricator.wikimedia.org/T352969#11378230 (10Sfaci) [10:46:49] 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 10Event-Platform: Explore how to migrate PyFlink to Java/Scala - https://phabricator.wikimedia.org/T410266 (10JMonton-WMF) 03NEW [11:11:18] 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 06Data-Platform-SRE, 06Movement-Insights, 07Epic: Run dbt from Airflow - https://phabricator.wikimedia.org/T410268 (10JMonton-WMF) 03NEW [11:11:31] 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 06Data-Platform-SRE, 06Movement-Insights: Run dbt from Airflow - https://phabricator.wikimedia.org/T410268#11378441 (10JMonton-WMF) [11:14:55] 06Data-Engineering, 06Machine-Learning-Team, 06serviceops: Enable ChangeProp to consume mediawiki.page_content_change.v1 - https://phabricator.wikimedia.org/T409469#11378447 (10jijiki) Thank you for the discussion everyone! Reading through, I would suggest proceeding with Option D for the time being. This ap... [14:21:54] 06Data-Engineering, 06SRE, 10SRE-Access-Requests, 13Patch-For-Review: Requesting access to analytics-privatedata-users for AnkitaM - https://phabricator.wikimedia.org/T409893#11379026 (10Volans) Adding #data-engineering for visibility and @Milimetric, @Ahoelzl for approval (either of them) from the data en... [15:06:03] 06Data-Engineering, 06SRE, 10SRE-Access-Requests, 13Patch-For-Review: Requesting access to analytics-privatedata-users for AnkitaM - https://phabricator.wikimedia.org/T409893#11379193 (10Milimetric) Approved! Thank you @Volans [15:09:59] 06Data-Engineering (Q2 FY25/26 October 1st - December 31th): Certain languages on wmf_raw.mediawiki_project_namespace_map appear wrong - https://phabricator.wikimedia.org/T407902#11379211 (10xcollazo) 05Open→03Resolved [15:13:23] 06Data-Engineering (Q2 FY25/26 October 1st - December 31th): enwiki file export failed due to OOM - https://phabricator.wikimedia.org/T409565#11379223 (10xcollazo) 05Open→03Resolved [15:43:49] 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 13Patch-For-Review: Implement the data layout, UI, and documentation for the XML file export - https://phabricator.wikimedia.org/T401022#11379363 (10xcollazo) Marked https://wikitech.wikimedia.org/wiki/MediaWiki_Content_File_Exports as paused. [16:12:52] 06Data-Engineering, 06SRE, 10SRE-Access-Requests, 13Patch-For-Review: Requesting access to analytics-privatedata-users for AnkitaM - https://phabricator.wikimedia.org/T409893#11379541 (10Volans) p:05Triage→03Medium [16:33:28] 06Data-Engineering (Q2 FY25/26 October 1st - December 31th): SDS 1.3.6 SPUR bot detection - Productionize SPUR datasets import - https://phabricator.wikimedia.org/T410285 (10Antoine_Quhen) 03NEW [16:35:13] 06Data-Engineering (Q2 FY25/26 October 1st - December 31th): SDS 1.3.6 SPUR bot detection - Productionize SPUR datasets import - https://phabricator.wikimedia.org/T410285#11379706 (10Antoine_Quhen) Lets create dags to import datasets from spur.us: * anonymous+residential * dc * geoips [16:54:34] 06Data-Engineering (Q2 FY25/26 October 1st - December 31th): Develop HQL Scripts for Creating Global Editor Metrics Cassandra Tables in Hive. - https://phabricator.wikimedia.org/T410289 (10Snwachukwu) 03NEW [16:55:16] 06Data-Engineering (Q2 FY25/26 October 1st - December 31th): Develop HQL Scripts for Creating Global Editor Metrics Cassandra Tables in Hive. - https://phabricator.wikimedia.org/T410289#11379868 (10Snwachukwu) 05Open→03In progress [17:26:20] 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 07Essential-Work: Upgrade gitlab-docker-runner to latest debian version - https://phabricator.wikimedia.org/T408019#11380117 (10xcollazo) Ok I think I found root cause beinga mismatch MTU between host network and bridge network that docker creates: `... [18:35:04] !log Test Kitchen mw-user experiment (poll 47865) - adds: we-3-3-4-reading-list-test1-en; removes: none; fields: none - xLab/MPIC/TK tips at https://w.wiki/FwuD [18:35:06] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [18:39:36] 06Data-Engineering (Q2 FY25/26 October 1st - December 31th): Develop HQL Scripts for Creating Global Editor Metrics Cassandra Tables in Hive. - https://phabricator.wikimedia.org/T410289#11380548 (10Snwachukwu) [18:39:42] 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 10MediaWiki-Page-derived-data, 07OKR-Work, 13Patch-For-Review: Global Editor Metrics - Data Pipeline - https://phabricator.wikimedia.org/T405039#11380549 (10Snwachukwu) [18:39:53] 06Data-Engineering (Q2 FY25/26 October 1st - December 31th): Develop HQL Scripts for Creating Global Editor Metrics Cassandra Tables in Hive. - https://phabricator.wikimedia.org/T410289#11380550 (10Snwachukwu) a:03Snwachukwu [20:45:50] 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 07Essential-Work, 13Patch-For-Review: Upgrade gitlab-docker-runner to latest debian version - https://phabricator.wikimedia.org/T408019#11381091 (10xcollazo) >>! In T408019#11380723, @CodeReviewBot wrote: > xcollazo **merged** https://gitlab.wikime... [21:15:25] 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 07Essential-Work, 13Patch-For-Review: Upgrade gitlab-docker-runner to latest debian version - https://phabricator.wikimedia.org/T408019#11381222 (10xcollazo) `gitlab-docker-runner-v2` [[ https://gitlab.wikimedia.org/repos/data-engineering/conda-ana... [23:18:53] 06Data-Engineering, 06Data-Engineering-Radar, 06Discovery-Search, 06Infrastructure-Foundations, and 2 others: Elasticsearch dependency upgrade in spicerack - https://phabricator.wikimedia.org/T390860#11381611 (10bking) 05In progress→03Resolved Since the above patch was merged, cookbook CI seems bac... [23:24:55] (03CR) 10Aleksandar Mastilovic: Add HQL for edit_per_editor_per_page_daily and pageview_per_editor_per_page_daily (032 comments) [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1196892 (https://phabricator.wikimedia.org/T407559) (owner: 10Ottomata) [23:26:03] (03CR) 10Aleksandar Mastilovic: [V:03+2 C:03+2] Add HQL for edit_per_editor_per_page_daily and pageview_per_editor_per_page_daily (031 comment) [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1196892 (https://phabricator.wikimedia.org/T407559) (owner: 10Ottomata)