[03:19:26] FIRING: [2x] AlertLintProblem: Linting problems found for HaproxyKafkaDeliveryErrors - https://wikitech.wikimedia.org/wiki/Alertmanager#Alert_linting_found_problems - TODO - https://alerts.wikimedia.org/?q=alertname%3DAlertLintProblem [04:32:19] 06Data-Engineering, 06Data-Engineering-Radar, 10Data-Services, 06DBA, 06Privacy Engineering: Create views for SecurePoll db tables on Wiki Replicas - https://phabricator.wikimedia.org/T381197#11019054 (10Novem_Linguae) I agree with SD0001's choices for public tables and private tables in the original pos... [07:19:26] FIRING: [2x] AlertLintProblem: Linting problems found for HaproxyKafkaDeliveryErrors - https://wikitech.wikimedia.org/wiki/Alertmanager#Alert_linting_found_problems - TODO - https://alerts.wikimedia.org/?q=alertname%3DAlertLintProblem [07:55:48] 06Data-Engineering, 06DBA, 07Schema-change-in-production: Add cl_timestamp_id index to categorylinks table - https://phabricator.wikimedia.org/T399249#11019386 (10Marostegui) [09:38:21] 06Data-Engineering, 06Data-Engineering-Radar, 10MediaWiki-extensions-EventLogging, 10Temporary accounts, and 2 others: Prepare EventLogging for temp accounts - https://phabricator.wikimedia.org/T374812#11019671 (10phuedx) * https://wikitech.wikimedia.org/w/index.php?title=Experimentation_Lab/Contextual_att... [10:23:56] 06Data-Engineering, 06Data-Persistence, 10GlobalBlocking, 06Trust and Safety Product Team, 07Schema-change: globalblocks table: SQL in extension and production have different type for gb_address - https://phabricator.wikimedia.org/T395669#11019834 (10Marostegui) [10:51:44] 06Data-Engineering, 06Data-Persistence, 10GlobalBlocking, 06Trust and Safety Product Team, and 2 others: globalblocks table: SQL in extension and production have different type for gb_address - https://phabricator.wikimedia.org/T395669#11019948 (10Dreamy_Jazz) [11:07:32] 14Data-Engineering-Kanban: Determine IP ranges for dse-k8s cluster - https://phabricator.wikimedia.org/T310169#11019972 (10cmooney) No problem with the proposed allocations here. In fact homer already has all these allocations (v4, v6 and the ASN) set up for this cluster. Afaik the POD IPv4 ranges are anno... [11:19:26] FIRING: [2x] AlertLintProblem: Linting problems found for HaproxyKafkaDeliveryErrors - https://wikitech.wikimedia.org/wiki/Alertmanager#Alert_linting_found_problems - TODO - https://alerts.wikimedia.org/?q=alertname%3DAlertLintProblem [14:08:15] 10Data-Engineering (Q4 2025 April 1st - June 30th): Adapt Sqoop for categorylinks schema change - https://phabricator.wikimedia.org/T397923#11020399 (10xcollazo) a:03xcollazo >>! In T397923#11010124, @Ottomata wrote: > @xcollazo , Dan and I are grooming, and this needs to happen soon. We'd like to spread a bi... [14:22:31] 10Data-Engineering (Q4 2025 April 1st - June 30th), 06Experimentation Lab, 10Event-Platform: EventGate: Add Prometheus metric for hoisting errors - https://phabricator.wikimedia.org/T398922#11020434 (10tchin) If you want to drive it, be my guest and I can help you out if needed. Or we can pair program togeth... [14:28:25] 10Data-Engineering (Q4 2025 April 1st - June 30th), 06Movement-Insights, 06Traffic: NEW BUG REPORT: Investigate rise in May 2025 Reader metrics - https://phabricator.wikimedia.org/T395934#11020480 (10Ahoelzl) a:03mforns [14:37:45] 10Data-Engineering (Q4 2025 April 1st - June 30th): Define SDS 2.1.11 hypothesis - ExP threats and mitigations - https://phabricator.wikimedia.org/T396078#11020549 (10Ahoelzl) 05Open→03Declined Closing. Not pursuing this in the near future. [15:10:47] 06Data-Engineering, 06Data-Engineering-Radar, 10MediaWiki-extensions-EventLogging, 10Temporary accounts, and 2 others: Prepare EventLogging for temp accounts - https://phabricator.wikimedia.org/T374812#11020763 (10Milimetric) 05Open→03Resolved [15:19:22] 06Data-Engineering, 06Data-Engineering-Radar, 10CampaignEvents, 10EntitySchema, and 18 others: Add namespace descriptions for Special:NamespaceInfo in WMF-deployed extensions - https://phabricator.wikimedia.org/T373070#11020792 (10Milimetric) (we think we did our little part here, feel free to move it back... [15:19:26] FIRING: [2x] AlertLintProblem: Linting problems found for HaproxyKafkaDeliveryErrors - https://wikitech.wikimedia.org/wiki/Alertmanager#Alert_linting_found_problems - TODO - https://alerts.wikimedia.org/?q=alertname%3DAlertLintProblem [15:24:50] 10Data-Engineering (Q4 2025 April 1st - June 30th): Implement full parity between HiveSensor and RESTExternalTaskSensor - https://phabricator.wikimedia.org/T384726#11020818 (10amastilovic) [15:26:00] 10Data-Engineering (Q4 2025 April 1st - June 30th), 06Release-Engineering-Team, 06SRE: Archiva Mirror Maven Central cache no space left on device - https://phabricator.wikimedia.org/T399679#11020835 (10amastilovic) 05Open→03Resolved [15:27:13] 10Data-Engineering (Q4 2025 April 1st - June 30th): [Airflow-test] refine_to_hive_hourly_test.refine_hive_dataset.wait_for_gobblin_export is failing recurrently - https://phabricator.wikimedia.org/T382901#11020839 (10Antoine_Quhen) 05Open→03Resolved Since a while. New code has been deployed for refine_to... [15:30:45] 06Data-Engineering, 06Data-Engineering-Icebox, 07Epic: Bot Detection - https://phabricator.wikimedia.org/T321707#11020888 (10Milimetric) we can support bot detection with our platform, but we're not directly responsible [17:02:25] 06Data-Engineering, 06Data-Engineering-Radar, 06DBA, 07Schema-change-in-production: Drop afl_patrolled_by from abuse_filter_log in production - https://phabricator.wikimedia.org/T391056#11021402 (10Marostegui) @FCeratto-WMF now that the s1 codfw master is switched, remember to apply this schema change ther... [17:09:07] looks like some other contact method might be better [17:53:19] 10Data-Engineering (Q4 2025 April 1st - June 30th), 10Dumps-Generation: wikidatawiki fails dumps of the wbt_* tables, also lagging on XML Dumps - https://phabricator.wikimedia.org/T396125#11021579 (10xcollazo) After the recent changes to dumps, we no longer see this issue, but this is because we are no longer... [17:58:29] 10Data-Engineering (Q4 2025 April 1st - June 30th), 06Structured-Data-Backlog: Bump memory to enable large artifacts sync on HDFS - https://phabricator.wikimedia.org/T348958#11021599 (10xcollazo) @mfossati and @fkaelin: On {T392244}, we migrated Airflow artifact deployment from scap to a new system we call 'b... [18:06:14] 10Data-Engineering (Q4 2025 April 1st - June 30th): Spike on choosing a solution for DagProperties - https://phabricator.wikimedia.org/T394541#11021629 (10Ottomata) Should we close T348963 as a dup and roll into this one? [18:32:33] 10Data-Engineering (Q4 2025 April 1st - June 30th): Adapt Sqoop for categorylinks schema change - https://phabricator.wikimedia.org/T397923#11021700 (10Ahoelzl) a:05xcollazo→03amastilovic [18:34:22] 10Data-Engineering (Q4 2025 April 1st - June 30th): Spike on choosing a solution for DagProperties - https://phabricator.wikimedia.org/T394541#11021705 (10Ottomata) Just chiming in to +1 the Option 1 conclusion! Thanks yall! [18:41:14] 07Analytics-Data-Problem, 10Data-Engineering (Q4 2025 April 1st - June 30th), 10Event-Platform, 10MediaWiki-Platform-Team (Radar), 05SUL3: [EventBus] Fix incorrect CentralAuth meta.domain values for relevant streams - https://phabricator.wikimedia.org/T400093 (10Ottomata) 03NEW [18:42:21] 07Analytics-Data-Problem, 10Data-Engineering (Q4 2025 April 1st - June 30th), 10Event-Platform, 10MediaWiki-Platform-Team (Radar), 05SUL3: Some events in mediawiki.page_change.v1 refers to auth.wikimedia.org in meta.uri and meta.domain - https://phabricator.wikimedia.org/T388825#11021745 (10Ottomata) I f... [18:42:35] 07Analytics-Data-Problem, 10Data-Engineering (Q4 2025 April 1st - June 30th), 10Event-Platform, 10MediaWiki-Platform-Team (Radar), 05SUL3: Some events in mediawiki.page_change.v1 refers to auth.wikimedia.org in meta.uri and meta.domain - https://phabricator.wikimedia.org/T388825#11021748 (10Ottomata) p:... [18:43:08] 07Analytics-Data-Problem, 06Data-Engineering, 10Event-Platform, 10MediaWiki-Platform-Team (Radar), 05SUL3: [EventBus] Fix incorrect CentralAuth meta.domain values for relevant streams - https://phabricator.wikimedia.org/T400093#11021751 (10Ottomata) [18:49:13] 10Data-Engineering (Q4 2025 April 1st - June 30th), 10MediaWiki-DomainEvents: Finalize and move Cross-Service Integration events design document to mediawiki.org - https://phabricator.wikimedia.org/T400095 (10Ottomata) 03NEW [18:59:54] !log manual run pageview_actor.hql for pageview_actor_hourly__compute_pageview_actor_hourly__20250720 [18:59:56] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [19:07:58] 14Analytics, 07Analytics-Data-Problem, 10Data-Engineering (Q4 2025 April 1st - June 30th), 10Data-Engineering-Wikistats, 06Movement-Insights: Sharp spike in unique devices for past month on all projects - https://phabricator.wikimedia.org/T395727#11021846 (10Mayakp.wiki) [19:09:01] 14Analytics, 07Analytics-Data-Problem, 10Data-Engineering (Q4 2025 April 1st - June 30th), 10Data-Engineering-Wikistats, 06Movement-Insights: Sharp spike in unique devices for past month on all projects - https://phabricator.wikimedia.org/T395727#11021851 (10Mayakp.wiki) [19:19:26] FIRING: [2x] AlertLintProblem: Linting problems found for HaproxyKafkaDeliveryErrors - https://wikitech.wikimedia.org/wiki/Alertmanager#Alert_linting_found_problems - TODO - https://alerts.wikimedia.org/?q=alertname%3DAlertLintProblem [20:22:07] 10Data-Engineering (Q4 2025 April 1st - June 30th), 10EventStreams, 10Event-Platform: EventStreams: duplicate events from double compute (wdqs/rdf) streams - https://phabricator.wikimedia.org/T396564#11022103 (10Ottomata) [23:19:26] FIRING: [2x] AlertLintProblem: Linting problems found for HaproxyKafkaDeliveryErrors - https://wikitech.wikimedia.org/wiki/Alertmanager#Alert_linting_found_problems - TODO - https://alerts.wikimedia.org/?q=alertname%3DAlertLintProblem