[09:31:47] 06Project-Admins: Create project tag for MediaWiki-Contributions - https://phabricator.wikimedia.org/T444967 (10neriah) 03NEW [09:31:50] 06Project-Admins: Create project tag for MediaWiki-Contributions - https://phabricator.wikimedia.org/T444967#12562103 (10neriah) After it's created, the list in the details of the #mediaWiki-special-pages tag should be updated to include the new tag. [11:26:10] (03PS1) 10Peter Li: Zuul: Add waki285 to CI allowlist [integration/config] - 10https://gerrit.wikimedia.org/r/1369688 [14:57:10] (03CR) 10SomeRandomDeveloper: [C:03+1] Zuul: Add waki285 to CI allowlist [integration/config] - 10https://gerrit.wikimedia.org/r/1369688 (owner: 10Peter Li) [16:34:28] 10Beta-Cluster-Infrastructure, 10Cloud-VPS (Debian Bullseye Deprecation), 13Patch-For-Review: Replace deployment-zookeeper-3 (Bullseye deprecation) - https://phabricator.wikimedia.org/T436481#12562896 (10Southparkfan) 05Open→03In progress a:03Southparkfan [16:53:18] (03PS2) 10Krinkle: docs: Fix welcome text instruction [fresh] - 10https://gerrit.wikimedia.org/r/1369134 (https://phabricator.wikimedia.org/T439828) [16:53:26] (03PS3) 10Krinkle: docs: Fix welcome text instruction [fresh] - 10https://gerrit.wikimedia.org/r/1369134 (https://phabricator.wikimedia.org/T439828) [17:17:18] 10GitLab (Account Approval), 06Release-Engineering-Team: Requesting GitLab account activation for [nelutubalu] - https://phabricator.wikimedia.org/T444992 (10Nelutu.balu) 03NEW [17:22:19] 10GitLab (Project and group requests), 06Release-Engineering-Team: Create new GitLab project group: - https://phabricator.wikimedia.org/T444993 (10Nelutu.balu) 03NEW [17:23:06] FIRING: [2x] PuppetAgentStaleLastRun: Last Puppet run was over 24 hours ago on instance deployment-webperf31 in project deployment-prep - https://prometheus-alerts.wmcloud.org/?q=alertname%3DPuppetAgentStaleLastRun [18:00:10] FIRING: [4x] PuppetAgentFailure: Puppet agent failure detected on instance deployment-cp-text09 in project deployment-prep - https://prometheus-alerts.wmcloud.org/?q=alertname%3DPuppetAgentFailure [18:17:17] 10GitLab (Infrastructure), 06Collaboration-Services: Improve error handling in sre.gitlab.upgrade cookbook - https://phabricator.wikimedia.org/T443192#12563013 (10Lenap) a:03Lenap [18:19:58] 10Continuous-Integration-Infrastructure, 06MediaWiki-Core-Platform-Team, 10OOjs core, 07ci-test-error: oojs ci: All new oojs-core-node26-runjenkins tasks FAILS due to timeouts - https://phabricator.wikimedia.org/T444995 (10Les4353) 03NEW [18:21:35] 10Continuous-Integration-Infrastructure, 06MediaWiki-Core-Platform-Team, 10OOjs core, 07ci-test-error: oojs ci: All new oojs-core-node26-runjenkins tasks FAILS due to timeouts - https://phabricator.wikimedia.org/T444995#12563028 (10Les4353) [18:23:18] 10Continuous-Integration-Config, 06MediaWiki-Core-Platform-Team, 10OOjs core, 07ci-test-error: oojs ci: All new oojs-core-node26-runjenkins tasks FAILS due to timeouts - https://phabricator.wikimedia.org/T444995#12563029 (10Les4353) [18:23:48] 10Continuous-Integration-Config, 06MediaWiki-Core-Platform-Team, 10OOjs core, 07ci-test-error: oojs-ci: New oojs-core-node26-runjenkin FAILS on firefox test, looks like WebDriver problem - https://phabricator.wikimedia.org/T444996 (10Les4353) 03NEW [18:24:09] 10Continuous-Integration-Config, 06MediaWiki-Core-Platform-Team, 10OOjs core, 07ci-test-error: oojs-ci: New oojs-core-node26-runjenkins FAILS on firefox test, looks like WebDriver problem - https://phabricator.wikimedia.org/T444996#12563041 (10Les4353) [18:25:12] 10Continuous-Integration-Config, 06MediaWiki-Core-Platform-Team, 10OOjs core, 07ci-test-error: oojs ci: All new oojs-core-node26-runjenkins tasks FAILS due to timeouts - https://phabricator.wikimedia.org/T444995#12563055 (10Les4353) [18:25:14] 10Continuous-Integration-Config, 06MediaWiki-Core-Platform-Team, 10OOjs core, 07ci-test-error: oojs-ci: New oojs-core-node26-runjenkins FAILS on firefox test, looks like WebDriver problem - https://phabricator.wikimedia.org/T444996#12563054 (10Les4353) [18:25:51] 10Continuous-Integration-Config, 06MediaWiki-Core-Platform-Team, 10OOjs core, 07ci-test-error: oojs-ci: New oojs-core-node26-runjenkins tasks FAILS due to timeouts on chrome - https://phabricator.wikimedia.org/T444995#12563057 (10Les4353) [18:26:37] 10Continuous-Integration-Config, 06MediaWiki-Core-Platform-Team, 10OOjs core, 07ci-test-error: oojs-ci: New oojs-core-node26-runjenkins tasks FAILS due to WebDriver error on firefox - https://phabricator.wikimedia.org/T444996#12563059 (10Les4353) [20:00:50] 10Beta-Cluster-Infrastructure, 10Cloud-VPS (Debian Bullseye Deprecation), 13Patch-For-Review: Replace deployment-zookeeper-3 (Bullseye deprecation) - https://phabricator.wikimedia.org/T436481#12563207 (10Southparkfan) Tentative plan: - [] Provision `deployment-zookeeper04` *without* adding it to `zookeeper_c... [20:19:27] 10Beta-Cluster-Infrastructure, 06Data-Engineering, 10Kafka-Infrastructure: beta - Run a single event platform Kafka cluster in beta - https://phabricator.wikimedia.org/T437541#12563222 (10Southparkfan) Hi @tchin, I am working on T436481. I noticed `kafka_clusters` still contains references to the jumbo clust... [20:25:51] 10Beta-Cluster-Infrastructure, 06tools-infrastructure-team: Secure deployment-prep against php2shell and restore access - https://phabricator.wikimedia.org/T442482#12563228 (10Southparkfan) [20:28:41] 10Beta-Cluster-Infrastructure, 06tools-infrastructure-team: Secure deployment-prep against php2shell and restore access - https://phabricator.wikimedia.org/T442482#12563237 (10Southparkfan) 05Open→03Resolved a:03Southparkfan An updated version of Chart Renderer (T443048) has been deployed now. That s... [22:00:23] (03PS2) 10Addshore: Allow opt-in wiki environment overrides for browser tests and commands [integration/quibble] - 10https://gerrit.wikimedia.org/r/1361209 (https://phabricator.wikimedia.org/T252883) [22:00:39] (03CR) 10Addshore: Allow opt-in wiki environment overrides for browser tests and commands (031 comment) [integration/quibble] - 10https://gerrit.wikimedia.org/r/1361209 (https://phabricator.wikimedia.org/T252883) (owner: 10Addshore) [22:04:07] FIRING: PuppetAgentNoResources: No Puppet resources found on instance deployment-webperf31 on project deployment-prep - https://prometheus-alerts.wmcloud.org/?q=alertname%3DPuppetAgentNoResources [22:49:46] 10Beta-Cluster-Infrastructure, 06Data-Engineering, 10Kafka-Infrastructure: beta - Run a single event platform Kafka cluster in beta - https://phabricator.wikimedia.org/T437541#12563397 (10Krinkle) I'm not sure if related, but note that https://gerrit.wikimedia.org/r/c/operations/puppet/+/941475 has been cher... [22:51:08] FIRING: PuppetStaleCertificates: Found non-revoked Puppet certificates for 1 deleted instances on deployment-puppetserver-1 - https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/PuppetStaleCertificates - https://prometheus-alerts.wmcloud.org/?q=alertname%3DPuppetStaleCertificates [22:56:33] Krinkle: Thanks for linking that cherry-pick. I think we can drop the cherry-pick, but let me verify that. [23:13:41] (03PS1) 10DatGuy: Zuul: [mediawiki/extensions/IPInfo] Add AbuseFilter phan dependency [integration/config] - 10https://gerrit.wikimedia.org/r/1369716 [23:18:56] 10Beta-Cluster-Infrastructure: navtiming is broken on the Beta Cluster because kafka-jumbo has been removed - https://phabricator.wikimedia.org/T445011 (10Southparkfan) 03NEW [23:19:07] RESOLVED: PuppetAgentNoResources: No Puppet resources found on instance deployment-webperf31 on project deployment-prep - https://prometheus-alerts.wmcloud.org/?q=alertname%3DPuppetAgentNoResources [23:20:22] FIRING: [2x] PuppetAgentStaleLastRun: Last Puppet run was over 24 hours ago on instance deployment-webperf31 in project deployment-prep - https://prometheus-alerts.wmcloud.org/?q=alertname%3DPuppetAgentStaleLastRun [23:20:31] 10Beta-Cluster-Infrastructure: Last Puppet run was over 24 hours ago on instance deployment-zookeeper04 in project deployment-prep - https://phabricator.wikimedia.org/T445012 (10wmcs-alerts) 03NEW [23:24:43] 10Beta-Cluster-Infrastructure, 06Data-Engineering, 10Kafka-Infrastructure: beta - Run a single event platform Kafka cluster in beta - https://phabricator.wikimedia.org/T437541#12563473 (10Southparkfan) >>! In T437541#12563397, @Krinkle wrote: > I'm not sure if related, but note that https://gerrit.wikimedia.... [23:25:54] 10Beta-Cluster-Infrastructure: navtiming is broken on the Beta Cluster because kafka-jumbo has been removed - https://phabricator.wikimedia.org/T445011#12563475 (10Southparkfan)