[07:15:59] 14Data-Engineering (Q1 FS26/27 July 1st - September 30th), 06Commons, 06Data-Persistence, 06DBA, and 3 others: FY2025-26 WE 6.4.1: Move links tables of commons to a dedicated cluster - https://phabricator.wikimedia.org/T398709#12553593 (10awight) The task description mentions reconnecting the wikirepli... [07:17:19] 06Data-Engineering (Q2 FS26/27 October 1st - December 31th)): KAPOW initial backfill - https://phabricator.wikimedia.org/T442233#12553598 (10mforns) [07:18:59] 14Data-Engineering (Q1 FS26/27 July 1st - September 30th), 06Commons, 06Data-Persistence, 06DBA, and 3 others: FY2025-26 WE 6.4.1: Move links tables of commons to a dedicated cluster - https://phabricator.wikimedia.org/T398709#12553600 (10awight) I think I found the answer, documented very well already... [09:14:27] (03CR) 10A-pizzata: Sqoop wbc_entity_usage from x1 (031 comment) [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1369088 (https://phabricator.wikimedia.org/T431477) (owner: 10Milimetric) [10:47:41] 06Data-Engineering (Q2 FS26/27 October 1st - December 31th)), 10Citoid, 10CXServer, 10EventStreams, and 21 others: Migrate node-based services in production to node26 - https://phabricator.wikimedia.org/T437512#12554368 (10Aklapper) [10:50:46] 06Data-Engineering, 06Data-Engineering-Icebox, 10Data-Services, 06Privacy Engineering, 06tools-platform-team: Increased visibility in wiki-replicas for volunteers fighting vandals - https://phabricator.wikimedia.org/T284944#12554390 (10fnegri) [13:50:47] 06Data-Engineering (Q2 FS26/27 October 1st - December 31th)): Spark 3.5.8 + Iceberg 1.6.1: vectorized reads return wrong values after the first 5,000 rows of each data file - https://phabricator.wikimedia.org/T441704#12555361 (10Antoine_Quhen) [14:05:38] 06Data-Engineering (Q2 FS26/27 October 1st - December 31th)): Spark 3.5.8 + Iceberg 1.6.1: vectorized reads return wrong values after the first 5,000 rows of each data file - https://phabricator.wikimedia.org/T441704#12555404 (10Antoine_Quhen) == How the vectorized reader works, and why it breaks == === Two way... [14:25:13] 06Data-Engineering (Q2 FS26/27 October 1st - December 31th)), 13Patch-For-Review: Spark 3.5.8 + Iceberg 1.6.1: vectorized reads return wrong values after the first 5,000 rows of each data file - https://phabricator.wikimedia.org/T441704#12555494 (10Antoine_Quhen) == Short term: turn off Iceberg vectorized read... [15:33:37] 06Data-Engineering (Q2 FS26/27 October 1st - December 31th)): KAPOW initial backfill - https://phabricator.wikimedia.org/T442233#12555812 (10mforns) [18:10:15] 06Data-Engineering, 06App Experience, 10Data-Platform: [Spike] Improved threshold for Country top read API - https://phabricator.wikimedia.org/T444828#12556424 (10Seddon) [20:29:13] 06Data-Engineering (Q2 FS26/27 October 1st - December 31th)), 13Patch-For-Review: MediawikiDumper: Reduce the memory that the huge wiki exports reserve - https://phabricator.wikimedia.org/T438245#12556732 (10xcollazo) **November run** This is the first run with the October retune, Kryo and the checksum fold t... [20:39:51] 06Data-Engineering: MediawikiDumper: Move the XML export job to Spark 3.5 - https://phabricator.wikimedia.org/T444216#12556752 (10xcollazo) [20:53:24] 06Data-Engineering (Q2 FS26/27 October 1st - December 31th)): Fine-tune SLAs for default dbt tasks and mediawiki_history - https://phabricator.wikimedia.org/T444835 (10amastilovic) 03NEW [21:10:13] 06Data-Engineering (Q2 FS26/27 October 1st - December 31th)), 07Essential-Work, 13Patch-For-Review: Disable vectorization by default in the Spark 3.5 profile - https://phabricator.wikimedia.org/T442016#12556863 (10xcollazo) a:03Antoine_Quhen [21:12:18] 06Data-Engineering: MediawikiDumper: Move the XML export job to Spark 3.5 - https://phabricator.wikimedia.org/T444216#12556867 (10xcollazo) [21:12:25] 06Data-Engineering (Q2 FS26/27 October 1st - December 31th)), 06Data-Platform-SRE, 07Epic, 13Patch-For-Review: Upgrade to Spark 3.5 - https://phabricator.wikimedia.org/T338057#12556866 (10xcollazo)