[02:34:46] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th), 13Patch-For-Review: Fix CommonsCategoryGraphBuilder to reflect latest changes to categorylinks table - https://phabricator.wikimedia.org/T404735#11187925 (10amastilovic) The new SQL query is: ` SELECT cl.cl_from,... [07:11:00] 06Data-Engineering, 06Discovery-Search, 07Epic, 07Essential-Work: [EPIC] Upgrade flink jobs to java 17 - https://phabricator.wikimedia.org/T404340#11188148 (10dcausse) >>! In T404340#11187739, @Ottomata wrote: > IIUC, recent 1.20.2 [[ https://docker-registry.wikimedia.org/flink/tags/ | flink image versions... [07:25:09] 06Data-Engineering, 06Discovery-Search, 07Epic, 07Essential-Work: [EPIC] Upgrade flink jobs to java 17 - https://phabricator.wikimedia.org/T404340#11188172 (10dcausse) A quick note on the //Java 17 is marked as experimental//. This mostly applies for java17 features, say you're building your job using java... [09:03:15] (03CR) 10Joal: [C:03+2] "LGTM!" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1184925 (https://phabricator.wikimedia.org/T389666) (owner: 10Ottomata) [09:05:44] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th), 10Event-Platform: mediawiki.content_history: flink applications experiencing frequent restarts due to JobManager OOMs - https://phabricator.wikimedia.org/T397330#11188416 (10dcausse) >>! In T397330#11187169, @tchin wrote: > I'm going to try to upgrade... [09:09:54] 06Data-Engineering, 10CampaignEvents, 06DBA, 10Connection-Team (Connection-Current-Sprint), 07Schema-change-in-production: Create DB column campaign_events.event_track_contributions in production (x1) - https://phabricator.wikimedia.org/T404789#11188419 (10Ladsgroup) 05Open→03Resolved a:03Ladsgr... [09:26:43] (03CR) 10Joal: "Two minimal nits, then ready! Good stuff, thanks a lot!" [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1187584 (https://phabricator.wikimedia.org/T401325) (owner: 10Aleksandar Mastilovic) [11:22:44] 14Analytics-Radar, 06Data-Engineering, 06Data-Engineering-Radar, 10MediaWiki-Recent-changes, and 3 others: Remove deprecated RCFeedEngine support - https://phabricator.wikimedia.org/T250628#11188962 (10Bugreporter) 05Resolved→03Open Reopen. $wgRCEngines is currently only deprecated; it should be removed. [11:45:30] 06Data-Engineering, 06Data-Engineering-Radar, 10CampaignEvents, 06Data-Persistence (work done), and 4 others: Update DB schema to store whether contribution tracking is enabled for a given event - https://phabricator.wikimedia.org/T402816#11189052 (10Daimona) [12:43:50] 06Data-Engineering-Radar, 10Fundraising analytics stack, 07Epic: [MinIO] Improve cluster to minimum system configuration for production - https://phabricator.wikimedia.org/T392112#11189278 (10Jgreen) [12:52:35] PROBLEM - statsv Varnishkafka log producer on cp7007 is CRITICAL: PROCS CRITICAL: 3 processes with args /usr/bin/varnishkafka -S /etc/varnishkafka/statsv.conf https://wikitech.wikimedia.org/wiki/Analytics/Systems/Varnishkafka [12:53:35] RECOVERY - statsv Varnishkafka log producer on cp7007 is OK: PROCS OK: 1 process with args /usr/bin/varnishkafka -S /etc/varnishkafka/statsv.conf https://wikitech.wikimedia.org/wiki/Analytics/Systems/Varnishkafka [13:18:47] 06Data-Engineering, 06Privacy Engineering, 06Research: Release dataset on top search engine referrers by country, device, and language - https://phabricator.wikimedia.org/T270140#11189378 (10Isaac) Hey @Alexey_Skripnik -- glad you discovered the dataset! What you're running into is not the anonymity thre... [15:25:21] 06Data-Engineering, 06Discovery-Search, 07Epic, 07Essential-Work: [EPIC] Upgrade flink jobs to java 17 - https://phabricator.wikimedia.org/T404340#11190209 (10Ottomata) Okay, ^ makes is sounds much less risky. Thanks. [15:39:05] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th), 06Growth-Team, 10MediaWiki-Page-derived-data, 06Wikipedia-Android-App-Backlog, 06Wikipedia-iOS-App-Backlog: Global Editor Metrics for YiR, Apps Activity Tab, and Growth Impact Module - https://phabricator.wikimedia.org/T403660#11190306 (10Ottomata... [16:14:01] 06Data-Engineering, 06Discovery-Search, 07Epic, 07Essential-Work: [EPIC] Upgrade flink jobs to java 17 - https://phabricator.wikimedia.org/T404340#11190607 (10MoritzMuehlenhoff) >>! In T404340#11187743, @Ottomata wrote: > Oh, or do we need T401694 first? JFTR, maintaining Java 11 in parallel is a signific... [16:16:39] 06Data-Engineering, 10Data-Platform-SRE (2025.09.05 - 2025.09.26), 07Epic: Upgrade Hadoop to version 3.3.6 and Hive to version 4.0.1 - https://phabricator.wikimedia.org/T379385#11190609 (10BTullis) 05Open→03Declined We have decided not to upgrade to Hadoop 3 at present, but to invest our time in de-r... [16:54:40] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th), 06Data-Persistence, 10Data-Persistence-Design-Review, 06Growth-Team, and 3 others: Data Persistence Design Review: Improve Tone Suggested Edits newcomer task - https://phabricator.wikimedia.org/T401021#11190742 (10achou) Here's my proposed schema:... [17:11:14] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th), 06Data-Persistence, 10Data-Persistence-Design-Review, 06Growth-Team, and 3 others: Data Persistence Design Review: Improve Tone Suggested Edits newcomer task - https://phabricator.wikimedia.org/T401021#11190788 (10Ottomata) Nice! Very quick though... [18:07:17] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th), 06Growth-Team, 10MediaWiki-Page-derived-data, 06Wikipedia-Android-App-Backlog, 06Wikipedia-iOS-App-Backlog: Global Editor Metrics for YiR, Apps Activity Tab, and Growth Impact Module - https://phabricator.wikimedia.org/T403660#11190981 (10Ottomata... [18:09:35] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th), 06Growth-Team, 10MediaWiki-Page-derived-data, 06Wikipedia-Android-App-Backlog, 06Wikipedia-iOS-App-Backlog: Global Editor Metrics for YiR, Apps Activity Tab, and Growth Impact Module - https://phabricator.wikimedia.org/T403660#11190995 (10mforns)... [18:23:39] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th): Optimize metrics computation for the MW Content Pipeline - https://phabricator.wikimedia.org/T401010#11191053 (10xcollazo) [[ https://gitlab.wikimedia.org/repos/data-engineering/airflow-dags/-/merge_requests/1676 | Elsewhere ]] we are seeing presurre fro... [18:38:27] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th), 10Data-Platform, 10Event-Platform: Warnings from handlePageHistoryVisibilityChangedEvent in EventBus from revision deletion - https://phabricator.wikimedia.org/T403648#11191135 (10Ahoelzl) [18:38:28] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th), 10Data-Platform, 10Event-Platform: Warnings from handlePageHistoryVisibilityChangedEvent in EventBus from revision deletion - https://phabricator.wikimedia.org/T403648#11191136 (10Ottomata) p:05Triage→03High [18:41:01] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th): Do not set WMF-Last-Access cookie when Sec-Fetch-Dest is not 'document' - https://phabricator.wikimedia.org/T403897#11191146 (10Ahoelzl) [18:41:48] 06Data-Engineering, 06Data-Engineering-Radar, 06Data-Platform-SRE: Move the dumps_v1 DAGs from the Airflow test_k8s instance to the main instance - https://phabricator.wikimedia.org/T404084#11191153 (10Ottomata) [18:43:21] 06Data-Engineering, 06Data-Engineering-Radar, 06Infrastructure-Foundations, 13Patch-For-Review: proposal: allow analytics-admins to also trigger puppet runs - https://phabricator.wikimedia.org/T404630#11191167 (10Ottomata) [18:43:43] 06Data-Engineering, 06Data-Engineering-Radar, 06Data-Platform-SRE, 06Infrastructure-Foundations, 13Patch-For-Review: proposal: allow analytics-admins to also trigger puppet runs - https://phabricator.wikimedia.org/T404630#11191168 (10Ottomata) [18:45:50] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th), 06Discovery-Search, 07Epic, 07Essential-Work: [EPIC] Upgrade flink jobs to java 17 - https://phabricator.wikimedia.org/T404340#11191178 (10Ahoelzl) [18:46:43] 06Data-Engineering, 10CirrusSearch, 10Discovery-Search (2025.09.05 - 2025.09.26), 07Essential-Work, 10Event-Platform: SUP: Serde w/o RowTypeInfo - https://phabricator.wikimedia.org/T404597#11191181 (10Ottomata) [18:46:51] 06Data-Engineering, 06Data-Engineering-Radar, 10CirrusSearch, 10Discovery-Search (2025.09.05 - 2025.09.26), and 2 others: SUP: Serde w/o RowTypeInfo - https://phabricator.wikimedia.org/T404597#11191183 (10Ottomata) [18:50:04] 10Data-Engineering-Roadmap, 06Data-Persistence, 10MediaWiki-Page-derived-data, 07Community-Wishlist, and 2 others: Add page_is_redirect/page_namespace/page_title index - https://phabricator.wikimedia.org/T387537#11191186 (10Ahoelzl) [18:52:26] 06Data-Engineering, 06MW-Interfaces-Team, 06Product-Analytics, 10Event-Platform, 13Patch-For-Review: performer struct fields NULL in event_sanitized.mediawiki_revision_tags_change - https://phabricator.wikimedia.org/T352899#11191192 (10Ottomata) [18:55:11] 06Data-Engineering, 06Abstract Wikipedia team, 06Movement-Insights, 10Wikifunctions: Bug: Cassandra Unique Devices data quality issue: mobile data - https://phabricator.wikimedia.org/T370551#11191197 (10Ottomata) @JAllemandou, do you have any understanding of this in your head right now since you just fini... [19:00:29] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th), 10Event-Platform: Bug: event validation error: mediawiki.page-restrictions-change - https://phabricator.wikimedia.org/T390012#11191220 (10Ahoelzl) [19:50:49] 06Data-Engineering, 10ChangeProp, 10WMF-JobQueue, 10Continuous-Integration-Config, and 2 others: Run EventBus tests in MediaWiki core CI - https://phabricator.wikimedia.org/T257583#11191416 (10BPirkle) Untagging MWI, and also removing a bunch of obsolete tags. [19:55:21] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th), 06Discovery-Search, 07Epic, 07Essential-Work: [EPIC] Upgrade flink jobs to java 17 - https://phabricator.wikimedia.org/T404340#11191436 (10gmodena) We need to spike readyness of `eventutilities_python` to adopt Java17. In _theory_ there should not... [19:56:02] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th), 06Discovery-Search, 10Wikidata-Query-Service, 07Epic, 07Essential-Work: [EPIC] Upgrade flink jobs to java 17 - https://phabricator.wikimedia.org/T404340#11191438 (10gmodena) [20:31:19] (03PS1) 10Aleksandar Mastilovic: Additional constraints to the CommonsCategoryGraphBuilder query [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1189323 (https://phabricator.wikimedia.org/T404735) [20:32:23] (03CR) 10Mforns: [C:03+2] "LGTM!" [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1189323 (https://phabricator.wikimedia.org/T404735) (owner: 10Aleksandar Mastilovic) [20:45:22] (03Merged) 10jenkins-bot: Additional constraints to the CommonsCategoryGraphBuilder query [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1189323 (https://phabricator.wikimedia.org/T404735) (owner: 10Aleksandar Mastilovic) [21:01:20] Starting build #44 for job analytics-refinery-maven-release [21:29:12] Project analytics-refinery-maven-release build #44: 09SUCCESS in 27 min: https://integration.wikimedia.org/ci/job/analytics-refinery-maven-release/44/