[00:21:30] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 10MediaWiki-Incremental-History, 13Patch-For-Review: Add log_id to wmf.mediawiki_history - https://phabricator.wikimedia.org/T425986#11910575 (10xcollazo) a:03xcollazo [02:01:41] FIRING: MediawikiPageHtmlContentChangeEnrichHighKafkaConsumerLag: ... [02:01:41] High Kafka consumer lag for mw_page_html_content_change_enrich in eqiad - https://wikitech.wikimedia.org/wiki/MediaWiki_Event_Enrichment/HTML_Enrichment#Alerting - https://grafana.wikimedia.org/d/K9x0c4aVk/flink-app?orgId=1&var-datasource=eqiad%20prometheus/k8s-dse&var-namespace=mw-page-html-content-change-enrich&var-helm_release=production&var-operator_name=All&var-flink_job_name=mw_page_html_content_change_enrich - ... [02:01:41] https://alerts.wikimedia.org/?q=alertname%3DMediawikiPageHtmlContentChangeEnrichHighKafkaConsumerLag [02:02:00] FIRING: MediawikiPageHtmlFeatureCountsChangeEnrichHighKafkaConsumerLag: ... [02:02:01] High Kafka consumer lag for mw_page_html_feature_counts_change_enrich in eqiad - https://wikitech.wikimedia.org/wiki/MediaWiki_Event_Enrichment/HTML_Feature_Counts_Enrichment#Alerting - ... [02:02:01] https://grafana.wikimedia.org/d/K9x0c4aVk/flink-app?orgId=1&var-datasource=eqiad%20prometheus/k8s-dse&var-namespace=mw-page-html-feature-counts-change-enrich&var-helm_release=production&var-operator_name=All&var-flink_job_name=mw_page_html_feature_counts_change_enrich - https://alerts.wikimedia.org/?q=alertname%3DMediawikiPageHtmlFeatureCountsChangeEnrichHighKafkaConsumerLag [02:06:41] RESOLVED: MediawikiPageHtmlContentChangeEnrichHighKafkaConsumerLag: ... [02:06:41] High Kafka consumer lag for mw_page_html_content_change_enrich in eqiad - https://wikitech.wikimedia.org/wiki/MediaWiki_Event_Enrichment/HTML_Enrichment#Alerting - https://grafana.wikimedia.org/d/K9x0c4aVk/flink-app?orgId=1&var-datasource=eqiad%20prometheus/k8s-dse&var-namespace=mw-page-html-content-change-enrich&var-helm_release=production&var-operator_name=All&var-flink_job_name=mw_page_html_content_change_enrich - ... [02:06:41] https://alerts.wikimedia.org/?q=alertname%3DMediawikiPageHtmlContentChangeEnrichHighKafkaConsumerLag [02:07:00] FIRING: [4x] MediawikiPageHtmlFeatureCountsChangeEnrichHighKafkaConsumerLag: ... [02:07:00] High Kafka consumer lag for mw_page_html_feature_counts_change_enrich in eqiad - https://wikitech.wikimedia.org/wiki/MediaWiki_Event_Enrichment/HTML_Feature_Counts_Enrichment#Alerting - ... [02:07:01] https://grafana.wikimedia.org/d/K9x0c4aVk/flink-app?orgId=1&var-datasource=eqiad%20prometheus/k8s-dse&var-namespace=mw-page-html-feature-counts-change-enrich&var-helm_release=production&var-operator_name=All&var-flink_job_name=mw_page_html_feature_counts_change_enrich - https://alerts.wikimedia.org/?q=alertname%3DMediawikiPageHtmlFeatureCountsChangeEnrichHighKafkaConsumerLag [02:17:01] FIRING: [4x] MediawikiPageHtmlFeatureCountsChangeEnrichHighKafkaConsumerLag: ... [02:17:01] High Kafka consumer lag for mw_page_html_feature_counts_change_enrich in eqiad - https://wikitech.wikimedia.org/wiki/MediaWiki_Event_Enrichment/HTML_Feature_Counts_Enrichment#Alerting - ... [02:17:01] https://grafana.wikimedia.org/d/K9x0c4aVk/flink-app?orgId=1&var-datasource=eqiad%20prometheus/k8s-dse&var-namespace=mw-page-html-feature-counts-change-enrich&var-helm_release=production&var-operator_name=All&var-flink_job_name=mw_page_html_feature_counts_change_enrich - https://alerts.wikimedia.org/?q=alertname%3DMediawikiPageHtmlFeatureCountsChangeEnrichHighKafkaConsumerLag [02:39:22] 06Data-Engineering, 06Commons, 10MediaWiki-File-management, 07Schema-change: Future of filearchive table - https://phabricator.wikimedia.org/T425897#11910740 (10Bugreporter) [02:52:01] RESOLVED: [2x] MediawikiPageHtmlFeatureCountsChangeEnrichHighKafkaConsumerLag: ... [02:52:01] High Kafka consumer lag for mw_page_html_feature_counts_change_enrich in eqiad - https://wikitech.wikimedia.org/wiki/MediaWiki_Event_Enrichment/HTML_Feature_Counts_Enrichment#Alerting - ... [02:52:01] https://grafana.wikimedia.org/d/K9x0c4aVk/flink-app?orgId=1&var-datasource=eqiad%20prometheus/k8s-dse&var-namespace=mw-page-html-feature-counts-change-enrich&var-helm_release=production&var-operator_name=All&var-flink_job_name=mw_page_html_feature_counts_change_enrich - https://alerts.wikimedia.org/?q=alertname%3DMediawikiPageHtmlFeatureCountsChangeEnrichHighKafkaConsumerLag [04:57:00] 06Data-Engineering, 06Wikimedia Enterprise: WME Pageviews DAG for HDFS to S3 Transfer - https://phabricator.wikimedia.org/T426017#11910821 (10SGupta-WMF) 05Open→03In progress [06:32:14] (03CR) 10Joal: [C:03+1] "LGTM" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1285903 (https://phabricator.wikimedia.org/T425986) (owner: 10Xcollazo) [06:42:21] (03CR) 10Joal: [C:03+1] "LGTM!" [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1285904 (https://phabricator.wikimedia.org/T425986) (owner: 10Xcollazo) [06:54:31] (03CR) 10A-pizzata: change create table for mediawiki_content to become private (031 comment) [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1285337 (https://phabricator.wikimedia.org/T424355) (owner: 10A-pizzata) [07:08:18] 06Data-Engineering, 06SRE, 10SRE-Access-Requests: Requesting access to analytics_privatedata_users & Kerberos & SQL Lab for catherinekelsey - https://phabricator.wikimedia.org/T425565#11910958 (10catherine.kelsey.wmde) Thanks @Dzahn for following up! And to answer your questions / comments: - @Lena_WMDE... [07:50:01] 06Data-Engineering, 06SRE, 10SRE-Access-Requests: Requesting access to analytics_privatedata_users & Kerberos & SQL Lab for catherinekelsey - https://phabricator.wikimedia.org/T425565#11911032 (10Lena_WMDE) Hi everyone, I can confirm that @catherine.kelsey.wmde is working at WMDE as a data analyst and I appr... [08:11:30] 06Data-Engineering, 06SRE, 10SRE-Access-Requests: Requesting access to analytics_privatedata_users & Kerberos & SQL Lab for catherinekelsey - https://phabricator.wikimedia.org/T425565#11911075 (10Marostegui) [08:11:46] 06Data-Engineering, 06SRE, 10SRE-Access-Requests: Requesting access to analytics_privatedata_users & Kerberos & SQL Lab for catherinekelsey - https://phabricator.wikimedia.org/T425565#11911076 (10Marostegui) [08:32:19] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st): Backfill datasets affected by Nov 2025 automated traffic incident - https://phabricator.wikimedia.org/T421735#11911141 (10mforns) [08:43:25] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st): Backfill datasets affected by Nov 2025 automated traffic incident - https://phabricator.wikimedia.org/T421735#11911155 (10mforns) [08:46:25] 06Data-Engineering, 10MediaWiki-extensions-WikimediaEvents, 10Event-Platform, 07Wikimedia-production-error: ArgumentCountError: Too few arguments to function MediaWiki\Extension\EventBus\Serializers\MediaWiki\UserEntitySerializer::__construct(), 3 passed in /srv/me... - https://phabricator.wikimedia.org/T426026 [08:52:01] 06Data-Engineering, 06Data-Platform-SRE: Enable Ceph S3 locations for Hive Metastore tables - https://phabricator.wikimedia.org/T425673#11911186 (10BTullis) [08:52:02] 06Data-Engineering, 06Data-Engineering-Radar, 06Data-Platform-SRE (2026-04-24 - 2026-05-15), 07Essential-Work: Do performance testing of a big Hadoop Table hosted by Ceph - https://phabricator.wikimedia.org/T381416#11911187 (10BTullis) [08:53:52] 06Data-Engineering, 06SRE, 10SRE-Access-Requests: Requesting access to analytics_privatedata_users & Kerberos & SQL Lab for catherinekelsey - https://phabricator.wikimedia.org/T425565#11911191 (10Marostegui) SSH key verified out of band [09:03:55] 06Data-Engineering, 10MediaWiki-extensions-WikimediaEvents, 06Product Safety and Integrity, 10Event-Platform, 07Wikimedia-production-error: ArgumentCountError: Too few arguments to function MediaWiki\Extension\EventBus\Serializers\MediaWiki\UserEntitySer... - https://phabricator.wikimedia.org/T426026#11911277 [09:05:49] 06Data-Engineering, 10MediaWiki-extensions-WikimediaEvents, 06Product Safety and Integrity, 10Event-Platform, 07Wikimedia-production-error: ArgumentCountError: Too few arguments to function MediaWiki\Extension\EventBus\Serializers\MediaWiki\UserEntitySer... - https://phabricator.wikimedia.org/T426026#11911288 [09:20:55] 06Data-Engineering, 06SRE, 10SRE-Access-Requests: Requesting access to analytics_privatedata_users & Kerberos & SQL Lab for catherinekelsey - https://phabricator.wikimedia.org/T425565#11911344 (10Marostegui) [09:28:27] 06Data-Engineering, 10MediaWiki-extensions-WikimediaEvents, 06Product Safety and Integrity, 10Event-Platform, 07Wikimedia-production-error: ArgumentCountError: Too few arguments to function MediaWiki\Extension\EventBus\Serializers\MediaWiki\UserEntitySer... - https://phabricator.wikimedia.org/T426026#11911366 [09:28:40] 06Data-Engineering, 10MediaWiki-extensions-WikimediaEvents, 06Product Safety and Integrity, 10Event-Platform, 07Wikimedia-production-error: ArgumentCountError: Too few arguments to function MediaWiki\Extension\EventBus\Serializers\MediaWiki\UserEntitySer... - https://phabricator.wikimedia.org/T426026#11911368 [09:29:12] 06Data-Engineering, 10MediaWiki-extensions-WikimediaEvents, 06Product Safety and Integrity, 10Event-Platform, 07Wikimedia-production-error: ArgumentCountError: Too few arguments to function MediaWiki\Extension\EventBus\Serializers\MediaWiki\UserEntitySer... - https://phabricator.wikimedia.org/T426026#11911385 [09:37:29] 06Data-Engineering, 10MediaWiki-extensions-WikimediaEvents, 06Product Safety and Integrity, 10Event-Platform, 07Wikimedia-production-error: ArgumentCountError: Too few arguments to function MediaWiki\Extension\EventBus\Serializers\MediaWiki\UserEntitySer... - https://phabricator.wikimedia.org/T426026#11911452 [09:54:02] 06Data-Engineering, 10MediaWiki-extensions-WikimediaEvents, 06Product Safety and Integrity, 10Event-Platform, and 2 others: ArgumentCountError: Too few arguments to function MediaWiki\Extension\EventBus\Serializers\MediaWiki\UserEntitySerializer::__constru... - https://phabricator.wikimedia.org/T426026#11911565 [09:59:40] 06Data-Engineering, 10MediaWiki-extensions-WikimediaEvents, 06Product Safety and Integrity, 10Event-Platform, and 2 others: ArgumentCountError: Too few arguments to function MediaWiki\Extension\EventBus\Serializers\MediaWiki\UserEntitySerializer::__constr... - https://phabricator.wikimedia.org/T426026#11911591 [10:00:10] 06Data-Engineering, 10MediaWiki-extensions-WikimediaEvents, 06Product Safety and Integrity, 10Event-Platform, and 2 others: ArgumentCountError: Too few arguments to function MediaWiki\Extension\EventBus\Serializers\MediaWiki\UserEntitySerializer::__constr... - https://phabricator.wikimedia.org/T426026#11911594 [11:10:08] 06Data-Engineering, 06SRE, 10SRE-Access-Requests, 13Patch-For-Review: Requesting access to analytics_privatedata_users & Kerberos & SQL Lab for catherinekelsey - https://phabricator.wikimedia.org/T425565#11911764 (10Marostegui) Waiting for patch review - also no specific group approval is needed per this c... [13:14:33] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 10MediaWiki-Incremental-History, 13Patch-For-Review: Add log_id to wmf.mediawiki_history - https://phabricator.wikimedia.org/T425986#11912527 (10xcollazo) [13:48:32] 06Data-Engineering, 10AQS2.0, 10Cassandra: Golang-based Cassandra clients do not perform TLS host verification - https://phabricator.wikimedia.org/T361964#11912741 (10Eevans) [13:55:45] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 10MediaWiki-Incremental-History: mediawiki_history_incremental_v1: schema specification for stakeholder review - https://phabricator.wikimedia.org/T425573#11912779 (10Isaac) Big thanks to all working on this and clearly laying it out! I know we're going to... [14:10:09] 06Data-Engineering, 06Movement-Insights: interwiki imports and its effects on revision data - https://phabricator.wikimedia.org/T425735#11912849 (10xcollazo) Discussed this with @JAllemandou. We agree that having a field `event_user_is_cross_wiki` makes sense. Since we are doing high priority `mediawiki_histo... [14:10:40] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 06Movement-Insights: interwiki imports and its effects on revision data - https://phabricator.wikimedia.org/T425735#11912852 (10xcollazo) 05Open→03In progress a:03xcollazo [14:14:42] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st): Add new API rate limiting fields from webrequest_logs to Turnilo view - https://phabricator.wikimedia.org/T419736#11912880 (10JAllemandou) Something is not right with the batch job: when looking for `X-WMF-RateLimit-Class` in turnilo, we get the last hour wi... [14:27:47] (03CR) 10Joal: [C:03+1] "One comment nit, +1 for the code" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1285337 (https://phabricator.wikimedia.org/T424355) (owner: 10A-pizzata) [14:38:39] 06Data-Engineering, 06Data-Engineering-Radar, 06DBA, 07Schema-change-in-production: Drop il_to column from imagelinks table in wmf production - https://phabricator.wikimedia.org/T419635#11913053 (10FCeratto-WMF) [14:43:08] 06Data-Engineering, 06Data-Engineering-Radar, 06cloud-services-team, 10Data-Services, 06DBA: Re-run maintainviews on all clouddb* and an-redacteddb1001.eqiad.wmnet - https://phabricator.wikimedia.org/T422459#11913065 (10FCeratto-WMF) [14:43:39] 06Data-Engineering, 06Data-Engineering-Radar, 06cloud-services-team, 10Data-Services, 06DBA: Re-run maintainviews on all clouddb* and an-redacteddb1001.eqiad.wmnet - https://phabricator.wikimedia.org/T422459#11913069 (10FCeratto-WMF) 05Open→03Resolved Done on cloudb* hosts after schema changes re... [14:44:58] Starting build #11 for job wikimedia-event-utilities-maven-release [14:46:07] (03PS1) 10Xcollazo: Add event_user_is_cross_wiki to mediawiki_history DDL [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1286383 (https://phabricator.wikimedia.org/T425735) [14:47:49] (03PS1) 10Xcollazo: Add event_user_is_cross_wiki to wmf.mediawiki_history [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1286385 (https://phabricator.wikimedia.org/T425735) [14:50:49] Project wikimedia-event-utilities-maven-release build #11: 09SUCCESS in 5 min 51 sec: https://integration.wikimedia.org/ci/job/wikimedia-event-utilities-maven-release/11/ [15:16:01] (03CR) 10Xcollazo: [C:03+1] "Likewise +1 code, but let's fix comment, and perhaps source comments as well" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1285337 (https://phabricator.wikimedia.org/T424355) (owner: 10A-pizzata) [15:18:04] (03CR) 10CI reject: [V:04-1] Add event_user_is_cross_wiki to wmf.mediawiki_history [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1286385 (https://phabricator.wikimedia.org/T425735) (owner: 10Xcollazo) [15:19:18] (03PS1) 10Xcollazo: Refactor MediawikiEvent.fromRow to use named column access [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1286397 (https://phabricator.wikimedia.org/T425735) [15:33:31] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st): Backfill datasets affected by Nov 2025 automated traffic incident - https://phabricator.wikimedia.org/T421735#11913398 (10mforns) [15:34:11] (03CR) 10Joal: [C:03+1] "2 comments about comments. +1 for code." [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1286397 (https://phabricator.wikimedia.org/T425735) (owner: 10Xcollazo) [15:46:41] (03PS3) 10Joal: Add MWHistoryDeltaWriter and MWHistorySnapshotMerger to refinery-job-35 [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1284858 (https://phabricator.wikimedia.org/T425729) (owner: 10Xcollazo) [15:46:42] (03CR) 10Joal: "Nits. I wonder if we should be using more scala intermediate dataframes in the daily job instead of CTEs, for caching for instance. But th" [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1284858 (https://phabricator.wikimedia.org/T425729) (owner: 10Xcollazo) [15:53:13] (03PS2) 10Xcollazo: Refactor MediawikiEvent.fromRow to use named column access [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1286397 (https://phabricator.wikimedia.org/T425735) [15:53:28] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 10Event-Platform: Schema and Stream for "mediawiki.page_view" - https://phabricator.wikimedia.org/T426091 (10JMonton-WMF) 03NEW [15:53:58] (03CR) 10Xcollazo: Refactor MediawikiEvent.fromRow to use named column access (032 comments) [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1286397 (https://phabricator.wikimedia.org/T425735) (owner: 10Xcollazo) [15:57:43] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 10Event-Platform: Schema and Stream for "webrequest_frontend_text" - https://phabricator.wikimedia.org/T426092 (10JMonton-WMF) 03NEW [16:01:23] (03PS2) 10Xcollazo: Add event_log_id to wmf.mediawiki_history (T425986) [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1285904 (https://phabricator.wikimedia.org/T425986) [16:02:19] (03PS2) 10Xcollazo: Add event_user_is_cross_wiki to wmf.mediawiki_history [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1286385 (https://phabricator.wikimedia.org/T425735) [16:03:15] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 10MediaWiki-Incremental-History: mediawiki_history_incremental_v1: schema specification for stakeholder review - https://phabricator.wikimedia.org/T425573#11913605 (10Ottomata) > What I really want is for us to further split by event_type I was going to a... [16:06:50] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 10MediaWiki-Incremental-History: mediawiki_history_incremental_v1: schema specification for stakeholder review - https://phabricator.wikimedia.org/T425573#11913638 (10xcollazo) >>! In T425573#11913605, @Ottomata wrote: >> What I really want is for us to fu... [16:11:13] 06Data-Engineering, 06Data-Engineering-Radar, 06DBA, 07Schema-change-in-production: Drop il_to column from imagelinks table in wmf production - https://phabricator.wikimedia.org/T419635#11913667 (10FCeratto-WMF) [16:12:05] 06Data-Engineering, 10ChangeProp, 10EventStreams, 06MediaWiki-Engineering, and 15 others: Migrate node-based services in production to node22 - https://phabricator.wikimedia.org/T393434#11913671 (10JVanderhoop-WMF) [16:12:11] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 10Event-Platform: Schema and Stream for "webrequest_frontend_text" - https://phabricator.wikimedia.org/T426092#11913673 (10Ottomata) [16:12:17] 06Data-Engineering, 10Event-Platform, 13Patch-For-Review: [Event Platform] Declare webrequest as an Event Platform stream - https://phabricator.wikimedia.org/T314956#11913674 (10Ottomata) [16:12:58] 06Data-Engineering, 10Event-Platform, 13Patch-For-Review: [Event Platform] Declare webrequest as an Event Platform stream - https://phabricator.wikimedia.org/T314956#11913680 (10Ottomata) @JMonton-WMF will look at doing this partially in T426092 so that we can use event platform tooling to automate consumpt... [16:15:12] 06Data-Engineering, 10ChangeProp, 10EventStreams, 06MediaWiki-Engineering, and 15 others: Migrate node-based services in production to node22 - https://phabricator.wikimedia.org/T393434#11913704 (10JVanderhoop-WMF) [16:15:22] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 10MediaWiki-Incremental-History, 13Patch-For-Review: Add log_id to wmf.mediawiki_history - https://phabricator.wikimedia.org/T425986#11913705 (10Ottomata) > event_log_id will be NULL for revision rows, which use revision_id as their identity column. Wha... [16:15:31] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 10MediaWiki-Incremental-History: mediawiki_history_incremental_v1: schema specification for stakeholder review - https://phabricator.wikimedia.org/T425573#11913707 (10Ottomata) Ah okay. I think I get it! [16:19:51] 06Data-Engineering, 10MediaWiki-extensions-WikimediaEvents, 06Product Safety and Integrity, 10Event-Platform, and 2 others: ArgumentCountError: Too few arguments to function MediaWiki\Extension\EventBus\Serializers\MediaWiki\UserEntitySerializer::__constr... - https://phabricator.wikimedia.org/T426026#11913728 [16:22:07] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 10MediaWiki-Incremental-History: mediawiki_history_incremental_v1: schema specification for stakeholder review - https://phabricator.wikimedia.org/T425573#11913740 (10AKhatun_WMF) Unrelated to above. We have another use-case that wants to use MWH (hopeful... [16:31:40] (03CR) 10CI reject: [V:04-1] Add event_log_id to wmf.mediawiki_history (T425986) [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1285904 (https://phabricator.wikimedia.org/T425986) (owner: 10Xcollazo) [16:32:31] (03CR) 10CI reject: [V:04-1] Add event_user_is_cross_wiki to wmf.mediawiki_history [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1286385 (https://phabricator.wikimedia.org/T425735) (owner: 10Xcollazo) [16:38:46] 06Data-Engineering, 10MediaWiki-extensions-WikimediaEvents, 06Product Safety and Integrity, 10Event-Platform, and 2 others: ArgumentCountError: Too few arguments to function MediaWiki\Extension\EventBus\Serializers\MediaWiki\UserEntitySerializer::__constr... - https://phabricator.wikimedia.org/T426026#11913877 [16:42:30] 06Data-Engineering, 10ChangeProp, 10EventStreams, 06MediaWiki-Engineering, and 15 others: Migrate node-based services in production to node22 - https://phabricator.wikimedia.org/T393434#11913889 (10Jdforrester-WMF) [16:45:50] (03CR) 10Joal: [C:03+1] "LGTM!" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1286383 (https://phabricator.wikimedia.org/T425735) (owner: 10Xcollazo) [16:49:39] (03CR) 10Joal: Refactor MediawikiEvent.fromRow to use named column access (032 comments) [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1286397 (https://phabricator.wikimedia.org/T425735) (owner: 10Xcollazo) [16:51:35] (03CR) 10Joal: [C:03+1] "LGTM!" [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1286385 (https://phabricator.wikimedia.org/T425735) (owner: 10Xcollazo) [16:59:36] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 10Event-Platform, 05MW-1.47-notes (1.47.0-wmf.2; 2026-05-12): mediawiki.page_change.v1 event - Add revision revert details - https://phabricator.wikimedia.org/T423583#11913968 (10Ottomata) It looks like in the effort of moving fast for {T418032}, I merge... [17:05:54] 06Data-Engineering, 10MediaWiki-extensions-WikimediaEvents, 06Product Safety and Integrity, 10Event-Platform, and 2 others: ArgumentCountError: Too few arguments to function MediaWiki\Extension\EventBus\Serializers\MediaWiki\UserEntitySerializer::__constr... - https://phabricator.wikimedia.org/T426026#11913995 [17:22:21] (03PS3) 10Xcollazo: Refactor MediawikiEvent.fromRow to use named column access [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1286397 (https://phabricator.wikimedia.org/T425735) [17:22:37] (03PS3) 10Xcollazo: Add event_log_id to wmf.mediawiki_history (T425986) [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1285904 (https://phabricator.wikimedia.org/T425986) [17:22:52] (03PS3) 10Xcollazo: Add event_user_is_cross_wiki to wmf.mediawiki_history [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1286385 (https://phabricator.wikimedia.org/T425735) [17:24:44] (03CR) 10Xcollazo: Refactor MediawikiEvent.fromRow to use named column access (032 comments) [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1286397 (https://phabricator.wikimedia.org/T425735) (owner: 10Xcollazo) [17:35:49] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 10Event-Platform, 05MW-1.47-notes (1.47.0-wmf.2; 2026-05-12): mediawiki.page_change.v1 event - Add revision revert details - https://phabricator.wikimedia.org/T423583#11914118 (10Ottomata) I am pretty sure that I can remove `revision.revert.rev_reverted_... [17:36:20] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 10Event-Platform, 05MW-1.47-notes (1.47.0-wmf.2; 2026-05-12): mediawiki.page_change.v1 event - Add revision revert details - https://phabricator.wikimedia.org/T423583#11914122 (10Ottomata) I'm considering adding a `rev_reverted_oldest_id` and `rev_revert... [17:52:32] (03CR) 10CI reject: [V:04-1] Refactor MediawikiEvent.fromRow to use named column access [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1286397 (https://phabricator.wikimedia.org/T425735) (owner: 10Xcollazo) [17:52:49] (03CR) 10CI reject: [V:04-1] Add event_log_id to wmf.mediawiki_history (T425986) [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1285904 (https://phabricator.wikimedia.org/T425986) (owner: 10Xcollazo) [17:53:44] (03CR) 10CI reject: [V:04-1] Add event_user_is_cross_wiki to wmf.mediawiki_history [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1286385 (https://phabricator.wikimedia.org/T425735) (owner: 10Xcollazo) [18:03:48] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 10Event-Platform, 05MW-1.47-notes (1.47.0-wmf.2; 2026-05-12): mediawiki.page_change.v1 event - Add revision revert details - https://phabricator.wikimedia.org/T423583#11914255 (10Ottomata) It looks like that without a full list of rev_reverted_ids, revis... [18:10:14] 06Data-Engineering, 06Data-Engineering-Radar, 06SRE, 10SRE-Access-Requests: Requesting access to analytics-privatedata-users ssh access and Kerberos identity for YLiou_WMF - https://phabricator.wikimedia.org/T385220#11914322 (10YLiou_WMF) 05Resolved→03Open [18:10:43] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st): Add support for the initialization SQL file to SparkSqlOperator in Airflow - https://phabricator.wikimedia.org/T426111 (10amastilovic) 03NEW [18:12:06] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st): Add new API rate limiting fields from webrequest_logs to Turnilo view - https://phabricator.wikimedia.org/T419736#11914339 (10amastilovic) @JAllemandou true, I forgot to do that step :( Thanks for taking care of it! [18:13:55] 06Data-Engineering, 06Data-Engineering-Radar, 06SRE, 10SRE-Access-Requests: Requesting access to analytics-privatedata-users ssh access and Kerberos identity for YLiou_WMF - https://phabricator.wikimedia.org/T385220#11914341 (10YLiou_WMF) 05Open→03Resolved [19:08:00] hello! i'm just wondering if it would be possible to get some clarification on what the https://phabricator.wikimedia.org/project/profile/8694/ phab project represents (currently named 'MediaWiki-Incremental-History') [19:08:06] i'm only asking as, to my knowledge/in my experience, the `MediaWiki-FooBar` format for Phab project names seems to normally indicate that it represents a part of the MediaWiki core software; but I'm not sure if this project represents a component of MW core(?) [19:10:26] (I guess as some related feedback... the project could probably have a better description IMO, as the current description of "Incremental (daily) Mediawiki History" imo doesn't do a great job of describing what the project represents to [I assume] someone not familiar with the Data Engineering team's plans :) ) [19:46:34] (03PS1) 10Xcollazo: Upgrade graphframes to 0.11.0 from Maven Central, drop Archiva repos [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1286481 (https://phabricator.wikimedia.org/T424350) [19:47:27] (03CR) 10CI reject: [V:04-1] Upgrade graphframes to 0.11.0 from Maven Central, drop Archiva repos [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1286481 (https://phabricator.wikimedia.org/T424350) (owner: 10Xcollazo) [19:52:03] (03CR) 10Xcollazo: "recheck" [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1286397 (https://phabricator.wikimedia.org/T425735) (owner: 10Xcollazo) [20:03:35] (03CR) 10Xcollazo: "recheck" [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1286481 (https://phabricator.wikimedia.org/T424350) (owner: 10Xcollazo) [20:07:27] (03PS2) 10Xcollazo: Upgrade graphframes to 0.11.0 from Maven Central, drop Archiva repos [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1286481 (https://phabricator.wikimedia.org/T424350) [20:23:13] 06Data-Engineering, 05FY2025-26 KR 5.1, 06MediaWiki-Platform-Team (Kanban Board), 07OKR-Work, 13Patch-For-Review: redioscope: periodically publish top clients to the data lake - https://phabricator.wikimedia.org/T424823#11914748 (10Ottomata) Hm. @daniel let's discuss! Just putting data in Kafka does n... [20:42:48] (03PS3) 10Xcollazo: Upgrade graphframes to 0.11.0 from Maven Central, drop Archiva repos [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1286481 (https://phabricator.wikimedia.org/T426114) [20:45:08] (03CR) 10Xcollazo: "recheck" [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1286385 (https://phabricator.wikimedia.org/T425735) (owner: 10Xcollazo) [20:45:36] (03PS4) 10Xcollazo: Add event_log_id to wmf.mediawiki_history [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1285904 (https://phabricator.wikimedia.org/T425986) [20:46:19] (03CR) 10Xcollazo: [C:03+2] Refactor MediawikiEvent.fromRow to use named column access [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1286397 (https://phabricator.wikimedia.org/T425735) (owner: 10Xcollazo) [20:53:45] 06Data-Engineering, 06SRE, 10SRE-Access-Requests, 13Patch-For-Review: Requesting access to analytics_privatedata_users & Kerberos & SQL Lab for catherinekelsey - https://phabricator.wikimedia.org/T425565#11914811 (10Dzahn) 05Stalled→03In progress [20:55:59] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 10MediaWiki-Incremental-History, 13Patch-For-Review: Add log_id to wmf.mediawiki_history - https://phabricator.wikimedia.org/T425986#11914829 (10xcollazo) >>! In T425986#11913705, @Ottomata wrote: >> event_log_id will be NULL for revision rows, which use... [20:57:38] (03Merged) 10jenkins-bot: Refactor MediawikiEvent.fromRow to use named column access [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1286397 (https://phabricator.wikimedia.org/T425735) (owner: 10Xcollazo) [21:05:19] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st): Remove airflow-dags unit test dependency on Archiva service availability - https://phabricator.wikimedia.org/T426125 (10amastilovic) 03NEW [21:15:03] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st): Load Google Search Console data into the Data Lake - https://phabricator.wikimedia.org/T420996#11914927 (10nshahquinn-wmf) Thank you for putting this together! Yes, it makes good sense to me. > We are not considering Export Table logs (retrospective changes... [21:19:13] 06Data-Engineering, 10MediaWiki-extensions-WikimediaEvents, 06Product Safety and Integrity, 10Event-Platform, and 2 others: ArgumentCountError: Too few arguments to function MediaWiki\Extension\EventBus\Serializers\MediaWiki\UserEntitySerializer::__constr... - https://phabricator.wikimedia.org/T426026#11914929 [21:39:45] (03CR) 10Xcollazo: [C:03+2] querypage: Add UncategorizedImages.hql [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1285527 (https://phabricator.wikimedia.org/T422449) (owner: 10Zabe) [21:40:12] (03CR) 10Xcollazo: [V:03+2 C:03+2] querypage: Add UncategorizedImages.hql [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1285527 (https://phabricator.wikimedia.org/T422449) (owner: 10Zabe) [23:29:43] 06Data-Engineering, 10Event-Platform: Edit type enrichment: Add timeout - https://phabricator.wikimedia.org/T424547#11915298 (10AKhatun_WMF)