[00:01:44] 10GitLab (Account Approval), 06Release-Engineering-Team: Requesting GitLab account activation for Egezort - https://phabricator.wikimedia.org/T424163#11849667 (10Pppery) 05Open→03Invalid The bot auto-approved you since you have access to Toolforge. Good luck! [00:02:49] 10GitLab: Can't login to gitlab.wikimedia.org - https://phabricator.wikimedia.org/T422105#11849672 (10Pppery) [00:22:32] FIRING: PuppetAgentFailure: Puppet agent failure detected on instance deployment-deploy05 in project deployment-prep - https://prometheus-alerts.wmcloud.org/?q=alertname%3DPuppetAgentFailure [03:41:46] 10GitLab (Account Approval), 06Release-Engineering-Team: Requesting GitLab account activation for Rishabh23 - https://phabricator.wikimedia.org/T424149#11849796 (10Rishabh23) Hi @Aklapper, thanks for looking into this. I'm planning to work on mediawiki and it's extensions. Also, there were few tickets related... [04:13:08] 10GitLab (Account Approval), 06Release-Engineering-Team (Doing 😎): Requesting GitLab account activation for Rishabh23 - https://phabricator.wikimedia.org/T424149#11849805 (10Aklapper) 05Open→03Resolved a:03Aklapper Here you go! Happy hacking :) [05:45:30] 10Gerrit, 06Release-Engineering-Team, 06collaboration-services, 13Patch-For-Review, 07Sustainability (Incident Followup): Move Gerrit data out of root partition - https://phabricator.wikimedia.org/T333143#11849833 (10Jelto) Runbook for the production host: Migrate: * `sudo cookbook sre.hosts.downtime -... [05:45:45] Gerrit needs a short maintenance in 15 minutes [05:57:42] 10Gerrit, 06Release-Engineering-Team, 06collaboration-services, 13Patch-For-Review, 07Sustainability (Incident Followup): Move Gerrit data out of root partition - https://phabricator.wikimedia.org/T333143#11849835 (10ops-monitoring-bot) Icinga downtime and Alertmanager silence (ID=a9ab2e33-702e-4e70-a1fb... [06:05:10] Project beta-code-update-eqiad build #597316: 04FAILURE in 2 min 10 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/597316/ [06:15:17] Yippee, build fixed! [06:15:17] Project beta-code-update-eqiad build #597317: 09FIXED in 2 min 17 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/597317/ [06:29:35] 10Gerrit, 06Release-Engineering-Team, 06collaboration-services, 13Patch-For-Review, 07Sustainability (Incident Followup): Move Gerrit data out of root partition - https://phabricator.wikimedia.org/T333143#11849893 (10Jelto) Data on `gerrit2003` production gerrit has also been moved to `/srv/gerrit`. [06:29:56] 10Gerrit, 06Release-Engineering-Team, 06collaboration-services, 13Patch-For-Review, 07Sustainability (Incident Followup): Move Gerrit data out of root partition - https://phabricator.wikimedia.org/T333143#11849895 (10Jelto) [06:34:17] 10Gerrit, 06Release-Engineering-Team, 06collaboration-services, 07Sustainability (Incident Followup): gerrit: document replication re-runs to Github - https://phabricator.wikimedia.org/T424172 (10ABran-WMF) 03NEW [06:48:02] 10Phabricator, 10Bitu, 06collaboration-services, 06Infrastructure-Foundations, 10VPS-project-Phabricator: Allow Bitu to link Phabricator account - https://phabricator.wikimedia.org/T406495#11849932 (10SLyngshede-WMF) 05Open→03Resolved a:03SLyngshede-WMF @Dzahn Yes. We'll figure out if we need t... [06:48:18] 10Phabricator, 10Bitu, 06collaboration-services, 06Infrastructure-Foundations, 10VPS-project-Phabricator: Allow Bitu to link Phabricator account - https://phabricator.wikimedia.org/T406495#11849936 (10SLyngshede-WMF) [07:05:07] 10Continuous-Integration-Config, 10Wikidata, 10Wikidata Lexicographical data, 10wmde-wikidata-tech, 13Patch-For-Review: Move Wikibase Lexeme's New Lexeme Special Page component's repository to Wikimedia Gerrit - https://phabricator.wikimedia.org/T424098#11849969 (10A_smart_kitten) [07:12:44] 10Gerrit, 06Release-Engineering-Team, 06collaboration-services, 10Wikimedia-GitHub, and 2 others: gerrit: document replication re-runs to Github - https://phabricator.wikimedia.org/T424172#11850020 (10A_smart_kitten) [08:18:02] 10Gerrit, 06Release-Engineering-Team, 06collaboration-services, 13Patch-For-Review, 07Sustainability (Incident Followup): Move Gerrit data out of root partition - https://phabricator.wikimedia.org/T333143#11850223 (10Jelto) [09:10:00] 10Gerrit, 06Release-Engineering-Team, 06collaboration-services, 13Patch-For-Review, 07Sustainability (Incident Followup): Move Gerrit data out of root partition - https://phabricator.wikimedia.org/T333143#11850406 (10Jelto) [09:16:15] 10Gerrit, 06Release-Engineering-Team, 06collaboration-services, 13Patch-For-Review, 07Sustainability (Incident Followup): Move Gerrit data out of root partition - https://phabricator.wikimedia.org/T333143#11850440 (10Jelto) All hosts are migrated and cleanup has happened on gerrit-replica and gerrit-spar... [09:25:20] 10Gerrit, 06Release-Engineering-Team, 06collaboration-services, 06Traffic, and 2 others: gerrit: Adapt timeouts to avoid 502 errors in CI jobs - https://phabricator.wikimedia.org/T421827#11850467 (10ABran-WMF) I've been running Envoy with a `per_connection_buffer_limit_bytes` set to `64MiB`. It seems to ha... [09:30:50] 10Gerrit, 06Release-Engineering-Team, 06collaboration-services, 07Documentation, 07Sustainability (Incident Followup): Document how to restart CI when Gerrit had a production issue - https://phabricator.wikimedia.org/T424196 (10ABran-WMF) 03NEW [09:31:28] 10Gerrit, 06collaboration-services, 07Documentation, 07Sustainability (Incident Followup): Update and improve operation runbooks and documentation for Gerrit - https://phabricator.wikimedia.org/T423601#11850496 (10ABran-WMF) [09:33:31] 10Gerrit, 06Release-Engineering-Team, 06collaboration-services, 07Documentation, 07Sustainability (Incident Followup): Document how to restart CI when Gerrit had a production issue - https://phabricator.wikimedia.org/T424196#11850511 (10ABran-WMF) p:05Triage→03High [10:19:48] 10Continuous-Integration-Infrastructure, 10Gerrit, 06Release-Engineering-Team, 06collaboration-services, and 2 others: Document how to restart CI when Gerrit had a production issue - https://phabricator.wikimedia.org/T424196#11850662 (10A_smart_kitten) [11:32:28] (03CR) 10EMcFarland: "Hi Jdforrester, thanks for the feedback. You're correct, I was referring to the proposed new patch. I'll edit the commit message to make" [integration/config] - 10https://gerrit.wikimedia.org/r/1275969 (https://phabricator.wikimedia.org/T422082) (owner: 10EMcFarland) [11:34:10] Project mediawiki-core-doxygen build #19856: 04FAILURE in 14 min: https://integration.wikimedia.org/ci/job/mediawiki-core-doxygen/19856/ [11:38:10] (03PS2) 10EMcFarland: GrowthExperiments: Add CentralNotice as a dependency [integration/config] - 10https://gerrit.wikimedia.org/r/1275969 (https://phabricator.wikimedia.org/T422082) [12:33:01] Yippee, build fixed! [12:33:01] Project mediawiki-core-doxygen build #19857: 09FIXED in 14 min: https://integration.wikimedia.org/ci/job/mediawiki-core-doxygen/19857/ [12:51:54] (03PS3) 10Jforrester: Zuul: [mediawiki/extensions/GrowthExperiments] Add CentralNotice dependency [integration/config] - 10https://gerrit.wikimedia.org/r/1275969 (https://phabricator.wikimedia.org/T422082) (owner: 10EMcFarland) [12:51:57] (03CR) 10Jforrester: [C:03+2] Zuul: [mediawiki/extensions/GrowthExperiments] Add CentralNotice dependency [integration/config] - 10https://gerrit.wikimedia.org/r/1275969 (https://phabricator.wikimedia.org/T422082) (owner: 10EMcFarland) [12:53:47] (03Merged) 10jenkins-bot: Zuul: [mediawiki/extensions/GrowthExperiments] Add CentralNotice dependency [integration/config] - 10https://gerrit.wikimedia.org/r/1275969 (https://phabricator.wikimedia.org/T422082) (owner: 10EMcFarland) [12:56:32] !log Zuul: [mediawiki/extensions/GrowthExperiments] Add CentralNotice dependency, for T422082 [12:56:34] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [12:56:34] T422082: "Get started here" incorrectly points to central notice banner - https://phabricator.wikimedia.org/T422082 [13:31:52] 10Gerrit, 07Upstream: Clicking the 'View Diff' button sometimes displays the diff between the latest patchset & the one before it, rather than the diff to the chosen patchset - https://phabricator.wikimedia.org/T424156#11851382 (10A_smart_kitten) > (Side-note: How Gerrit seems to work out which diff to show wh... [14:20:54] !log ssh integration-castor06.integration.eqiad1.wikimedia.cloud sudo -u jenkins-deploy rm -rf /srv/castor/castor-mw-ext-and-skins/master/mediawiki-node24 # fix failure seen in mediawiki-node24 8385 and 8405 [14:20:55] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [14:32:22] 10Gerrit, 06collaboration-services, 07Wikimedia-Incident: 2026-04-12 Gerrit Outage (was: DiskSpace) - https://phabricator.wikimedia.org/T423027#11851605 (10Jelto) 05Open→03Resolved I'll resolve this task. Sub-tasks have been open for the follow up action items. The successful migration in {T333143} w... [15:06:00] 10Beta-Cluster-Infrastructure, 10Continuous-Integration-Config, 10Continuous-Integration-Infrastructure, 07Jenkins, 06Quality-and-Test-Engineering-Team (Test Infrastructure): Move beta cluster automatic deployment to a dedicated infrastructure - https://phabricator.wikimedia.org/T256168#11851752 (10bd808) [15:06:02] 10Continuous-Integration-Infrastructure, 07Jenkins, 06collaboration-services, 13Patch-For-Review: Update Jenkins hosts from Java 17 to Java 21 - https://phabricator.wikimedia.org/T418109#11851753 (10bd808) [15:07:30] 10Beta-Cluster-Infrastructure, 10Continuous-Integration-Config, 10Continuous-Integration-Infrastructure, 07Jenkins, and 2 others: Move beta cluster automatic deployment to a dedicated infrastructure - https://phabricator.wikimedia.org/T256168#11851754 (10bd808) 05Open→03In progress a:03bd808 [15:09:44] 06Release-Engineering-Team (Radar), 10QS-Test-Automation, 07Epic: [EPIC] Create Automated Supervision test automation for CI - https://phabricator.wikimedia.org/T422555#11851766 (10zeljkofilipin) [15:24:05] 10Beta-Cluster-Infrastructure, 10Continuous-Integration-Config, 10Continuous-Integration-Infrastructure, 07Jenkins, and 2 others: Move beta cluster automatic deployment to a dedicated infrastructure - https://phabricator.wikimedia.org/T256168#11851888 (10Dzahn) [15:24:06] 10Continuous-Integration-Infrastructure, 06Release-Engineering-Team, 06collaboration-services, 13Patch-For-Review: setup 2 contint machines for jenkins - https://phabricator.wikimedia.org/T418521#11851886 (10Dzahn) [15:24:07] 10Beta-Cluster-Infrastructure, 06Release-Engineering-Team, 13Patch-For-Review: Replace deployment-deploy04 with a Bookworm instance with Java 21 - https://phabricator.wikimedia.org/T421244#11851887 (10Dzahn) [15:37:39] (03PS1) 10Aude: 1275487: Zuul: [mediawiki/extensions/WikimediaCustomizations] Add AntiSpoof dependency [integration/config] - 10https://gerrit.wikimedia.org/r/1276725 (https://phabricator.wikimedia.org/T420548) [15:38:21] (03CR) 10Jforrester: "Do you need these for phan tests too, or is it just for CA's test suite and won't be used directly?" [integration/config] - 10https://gerrit.wikimedia.org/r/1276725 (https://phabricator.wikimedia.org/T420548) (owner: 10Aude) [15:39:43] (03CR) 10CI reject: [V:04-1] 1275487: Zuul: [mediawiki/extensions/WikimediaCustomizations] Add AntiSpoof dependency [integration/config] - 10https://gerrit.wikimedia.org/r/1276725 (https://phabricator.wikimedia.org/T420548) (owner: 10Aude) [15:41:11] (03PS2) 10Aude: 1275487: Zuul: [mediawiki/extensions/WikimediaCustomizations] Add AntiSpoof dependency [integration/config] - 10https://gerrit.wikimedia.org/r/1276725 (https://phabricator.wikimedia.org/T420548) [15:41:52] (03CR) 10Aude: "Not sure we need them for phan, but went ahead and added them anyway." [integration/config] - 10https://gerrit.wikimedia.org/r/1276725 (https://phabricator.wikimedia.org/T420548) (owner: 10Aude) [15:42:45] (03CR) 10CI reject: [V:04-1] 1275487: Zuul: [mediawiki/extensions/WikimediaCustomizations] Add AntiSpoof dependency [integration/config] - 10https://gerrit.wikimedia.org/r/1276725 (https://phabricator.wikimedia.org/T420548) (owner: 10Aude) [15:43:33] (03PS3) 10Aude: Zuul: [mediawiki/extensions/WikimediaCustomizations] Add AntiSpoof dependency [integration/config] - 10https://gerrit.wikimedia.org/r/1276725 (https://phabricator.wikimedia.org/T420548) [15:45:18] (03CR) 10Jforrester: [C:03+2] Zuul: [mediawiki/extensions/WikimediaCustomizations] Add AntiSpoof dependency [integration/config] - 10https://gerrit.wikimedia.org/r/1276725 (https://phabricator.wikimedia.org/T420548) (owner: 10Aude) [15:47:00] (03Merged) 10jenkins-bot: Zuul: [mediawiki/extensions/WikimediaCustomizations] Add AntiSpoof dependency [integration/config] - 10https://gerrit.wikimedia.org/r/1276725 (https://phabricator.wikimedia.org/T420548) (owner: 10Aude) [15:47:16] !log Zuul: [mediawiki/extensions/WikimediaCustomizations] Add AntiSpoof dependency, for T420548 [15:47:19] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [15:47:19] T420548: Finalize the maintenance import script - https://phabricator.wikimedia.org/T420548 [16:11:22] (03PS1) 10Jforrester: Zuul: [mediawiki/services/parsoid] Enable PHP 8.5 CI [integration/config] - 10https://gerrit.wikimedia.org/r/1276732 [16:11:22] (03PS1) 10Jforrester: Zuul: Enforce PHP 8.5 CI for MW things in master (and REL1_46) [integration/config] - 10https://gerrit.wikimedia.org/r/1276733 (https://phabricator.wikimedia.org/T411814) [16:11:27] (03PS1) 10Jforrester: Zuul: Provide Node 24 templates to go with Node 20 [integration/config] - 10https://gerrit.wikimedia.org/r/1276734 [16:14:44] (03CR) 10Jforrester: [C:03+2] Zuul: [mediawiki/services/parsoid] Enable PHP 8.5 CI [integration/config] - 10https://gerrit.wikimedia.org/r/1276732 (owner: 10Jforrester) [16:15:45] (03PS1) 10Bartosz Dziewoński: OAuth: Run tests with CentralAuth [integration/config] - 10https://gerrit.wikimedia.org/r/1276735 (https://phabricator.wikimedia.org/T415281) [16:16:27] (03Merged) 10jenkins-bot: Zuul: [mediawiki/services/parsoid] Enable PHP 8.5 CI [integration/config] - 10https://gerrit.wikimedia.org/r/1276732 (owner: 10Jforrester) [16:16:38] (03CR) 10Aude: OAuth: Run tests with CentralAuth (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/1276735 (https://phabricator.wikimedia.org/T415281) (owner: 10Bartosz Dziewoński) [16:16:53] (03PS2) 10Bartosz Dziewoński: OAuth: Run tests with CentralAuth [integration/config] - 10https://gerrit.wikimedia.org/r/1276735 (https://phabricator.wikimedia.org/T415281) [16:17:12] (03CR) 10Bartosz Dziewoński: OAuth: Run tests with CentralAuth (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/1276735 (https://phabricator.wikimedia.org/T415281) (owner: 10Bartosz Dziewoński) [16:19:02] !log Zuul: [mediawiki/services/parsoid] Enable PHP 8.5 CI [16:19:02] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [16:27:46] (03update) 10brennen: WIP: hide events from non-public projects [repos/releng/gitlab-webhooks] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-webhooks/-/merge_requests/40 [16:29:04] (03update) 10brennen: WIP: hide events from non-public projects [repos/releng/gitlab-webhooks] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-webhooks/-/merge_requests/40 [16:30:11] (03update) 10brennen: Hide events from non-public projects [repos/releng/gitlab-webhooks] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-webhooks/-/merge_requests/40 [16:32:24] 10MediaWiki-Releasing, 05MW-1.46-release: Announce 1.46 "pencils down" and likely timeline to wikitech-l etc. - https://phabricator.wikimedia.org/T423256#11852192 (10A_smart_kitten) Noting for posterity: - Original email thread: https://lists.wikimedia.org/hyperkitty/list/wikitech-l@lists.wikimedia.org/th... [16:32:37] (03CR) 10Jforrester: [C:03+2] Zuul: Enforce PHP 8.5 CI for MW things in master (and REL1_46) [integration/config] - 10https://gerrit.wikimedia.org/r/1276733 (https://phabricator.wikimedia.org/T411814) (owner: 10Jforrester) [16:34:39] 10Beta-Cluster-Infrastructure, 10Continuous-Integration-Config, 10Continuous-Integration-Infrastructure, 07Jenkins, and 2 others: Move beta cluster automatic deployment to a dedicated infrastructure - https://phabricator.wikimedia.org/T256168#11852212 (10bd808) Having discovered that the Debian Bookworm OS... [16:34:44] (03Merged) 10jenkins-bot: Zuul: Enforce PHP 8.5 CI for MW things in master (and REL1_46) [integration/config] - 10https://gerrit.wikimedia.org/r/1276733 (https://phabricator.wikimedia.org/T411814) (owner: 10Jforrester) [16:35:15] !log Zuul: Enforce PHP 8.5 CI for MW things in master (and REL1_46), for T411814 [16:35:17] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [16:35:18] T411814: Make PHP 8.5 voting on development (master) branch of MW ecosystem (core, vendor, extensions, skins, libraries) in CI - https://phabricator.wikimedia.org/T411814 [16:37:36] 10Gerrit, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 03Fundraising Sprint Hutch Ado About Nothing: Figure out how to maintain cv repo - given it is primarily committed to by non-WMF - https://phabricator.wikimedia.org/T423961#11852223 (10Lars) If we want to just do a squashed commit again for... [16:38:36] 10Continuous-Integration-Config, 07Epic, 13Patch-For-Review, 07PHP 8.5 support: Make PHP 8.5 voting on development (master) branch of MW ecosystem (core, vendor, extensions, skins, libraries) in CI - https://phabricator.wikimedia.org/T411814#11852228 (10Jdforrester-WMF) 05Open→03Resolved a:03Jdfor... [16:44:07] 10Continuous-Integration-Config, 07Epic, 13Patch-For-Review, 07PHP 8.5 support: Make PHP 8.5 voting on development (master) branch of MW ecosystem (core, vendor, extensions, skins, libraries) in CI - https://phabricator.wikimedia.org/T411814#11852250 (10neriah) [16:59:16] (03PS3) 10Jforrester: Zuul: [mediawiki/extensions/OAuth] Add dependency on CentralAuth [integration/config] - 10https://gerrit.wikimedia.org/r/1276735 (https://phabricator.wikimedia.org/T415281) (owner: 10Bartosz Dziewoński) [17:31:38] (03CR) 10Jforrester: [C:03+2] Zuul: [mediawiki/extensions/OAuth] Add dependency on CentralAuth [integration/config] - 10https://gerrit.wikimedia.org/r/1276735 (https://phabricator.wikimedia.org/T415281) (owner: 10Bartosz Dziewoński) [17:32:03] (03CR) 10Jforrester: [C:03+2] Zuul: Provide Node 24 templates to go with Node 20 [integration/config] - 10https://gerrit.wikimedia.org/r/1276734 (owner: 10Jforrester) [17:33:20] (03Merged) 10jenkins-bot: Zuul: [mediawiki/extensions/OAuth] Add dependency on CentralAuth [integration/config] - 10https://gerrit.wikimedia.org/r/1276735 (https://phabricator.wikimedia.org/T415281) (owner: 10Bartosz Dziewoński) [17:33:43] (03Merged) 10jenkins-bot: Zuul: Provide Node 24 templates to go with Node 20 [integration/config] - 10https://gerrit.wikimedia.org/r/1276734 (owner: 10Jforrester) [17:56:32] !log Upgrading gitlab cloud runners (prod) k8s from 1.32.13-do.2 to 1.33.9-do.3 (T423726) [17:56:34] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [17:56:34] T423726: Update gitlab-cloud-runners kubernetes - https://phabricator.wikimedia.org/T423726 [17:58:19] !log Zuul: [mediawiki/extensions/OAuth] Add dependency on CentralAuth, for T415281 [17:58:22] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [17:58:22] T415281: [EPIC] OAuth extension critical workflows (for automated tests enhancement) - https://phabricator.wikimedia.org/T415281 [18:15:52] (03open) 10dancy: production/digitalocean.tfvars: kubernetes_version = "1.33.9-do.3" [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/580 (https://phabricator.wikimedia.org/T423726) [18:15:54] (03update) 10dancy: production/digitalocean.tfvars: kubernetes_version = "1.33.9-do.3" [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/580 (https://phabricator.wikimedia.org/T423726) [18:17:16] (03merge) 10dancy: production/digitalocean.tfvars: kubernetes_version = "1.33.9-do.3" [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/580 (https://phabricator.wikimedia.org/T423726) [18:18:26] !log Upgrading gitlab cloud runners (staging) k8s from 1.33.9-do.2 to 1.33.9-do.3 (T423726) [18:18:28] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [18:18:28] T423726: Update gitlab-cloud-runners kubernetes - https://phabricator.wikimedia.org/T423726 [18:18:32] FIRING: PuppetAgentStaleLastRun: Last Puppet run was over 24 hours ago on instance deployment-eventgate-4 in project deployment-prep - https://prometheus-alerts.wmcloud.org/?q=alertname%3DPuppetAgentStaleLastRun [18:18:45] 10Beta-Cluster-Infrastructure: Last Puppet run was over 24 hours ago on instance deployment-eventgate-4 in project deployment-prep - https://phabricator.wikimedia.org/T424253 (10wmcs-alerts) 03NEW [18:35:15] (03open) 10dancy: staging/digitalocean.tfvars: kubernetes_version = "1.33.9-do.3" [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/581 (https://phabricator.wikimedia.org/T423726) [18:35:16] (03update) 10dancy: staging/digitalocean.tfvars: kubernetes_version = "1.33.9-do.3" [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/581 (https://phabricator.wikimedia.org/T423726) [18:36:37] (03merge) 10dancy: staging/digitalocean.tfvars: kubernetes_version = "1.33.9-do.3" [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/581 (https://phabricator.wikimedia.org/T423726) [18:39:37] !log Upgrading gitlab cloud runners (staging) k8s from 1.33.9-do.3 to 1.34.5-do.3 (T423726) [18:39:40] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [18:39:40] T423726: Update gitlab-cloud-runners kubernetes - https://phabricator.wikimedia.org/T423726 [18:45:03] 10Beta-Cluster-Infrastructure, 10Continuous-Integration-Config, 10Continuous-Integration-Infrastructure, 07Jenkins, and 2 others: Move beta cluster automatic deployment to a dedicated infrastructure - https://phabricator.wikimedia.org/T256168#11852610 (10Jdforrester-WMF) >>! In T256168#11852212, @bd808 wro... [18:56:19] (03open) 10dancy: staging/digitalocean.tfvars: kubernetes_version = "1.34.5-do.3" [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/582 (https://phabricator.wikimedia.org/T423726) [18:56:23] (03update) 10dancy: staging/digitalocean.tfvars: kubernetes_version = "1.34.5-do.3" [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/582 (https://phabricator.wikimedia.org/T423726) [18:57:25] (03merge) 10dancy: staging/digitalocean.tfvars: kubernetes_version = "1.34.5-do.3" [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/582 (https://phabricator.wikimedia.org/T423726) [18:57:57] !log Upgrading gitlab cloud runners (prod) k8s from 1.33.9-do.3 to 1.34.5-do.3 (T423726) [18:58:00] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [18:58:00] T423726: Update gitlab-cloud-runners kubernetes - https://phabricator.wikimedia.org/T423726 [19:28:30] (03PS1) 10Jforrester: Zuul: [wikimedia/portals] Drop CI testing in Node 20 and Node 22 [integration/config] - 10https://gerrit.wikimedia.org/r/1276765 [19:28:30] (03PS1) 10Jforrester: Zuul: [unicodejs] Replace CI testing in Node 20 with Node 24 [integration/config] - 10https://gerrit.wikimedia.org/r/1276766 [19:28:30] (03PS1) 10Jforrester: Zuul: [oojs/js] Drop CI testing in Node 20 and Node 22 [integration/config] - 10https://gerrit.wikimedia.org/r/1276767 [19:28:31] (03PS1) 10Jforrester: Zuul: [oojs/ui] Drop CI testing in Node 20 and Node 22 [integration/config] - 10https://gerrit.wikimedia.org/r/1276768 [19:28:31] (03PS1) 10Jforrester: jjb: Drop special node-plus-php jobs for OOUI on Node 20/Node 22 [integration/config] - 10https://gerrit.wikimedia.org/r/1276769 [19:28:34] (03PS1) 10Jforrester: Zuul: [wikipeg] Drop testing in Node 20 and Node 22 [integration/config] - 10https://gerrit.wikimedia.org/r/1276770 [19:28:38] (03PS1) 10Jforrester: jjb: Drop special node-plus-php jobs for Wikipeg on Node 20/Node 22 [integration/config] - 10https://gerrit.wikimedia.org/r/1276771 [19:28:42] (03PS1) 10Jforrester: Zuul: [jquery-client] Replace CI testing in Node 20 with Node 24 [integration/config] - 10https://gerrit.wikimedia.org/r/1276772 [19:28:46] (03PS1) 10Jforrester: Zuul: [mediawiki/tools/*] Replace CI testing in Node 20 with Node 24 [integration/config] - 10https://gerrit.wikimedia.org/r/1276773 [19:28:50] (03PS1) 10Jforrester: Zuul: [analytics/*] Replace CI testing in Node 20 with Node 24 [integration/config] - 10https://gerrit.wikimedia.org/r/1276774 [19:28:54] (03PS1) 10Jforrester: Zuul: [wikidata/query/*] Replace CI testing in Node 20 with Node 24 [integration/config] - 10https://gerrit.wikimedia.org/r/1276775 [19:28:58] (03PS1) 10Jforrester: Zuul: [wikibase/*] Replace CI testing in Node 20 with Node 24 [integration/config] - 10https://gerrit.wikimedia.org/r/1276776 [19:29:02] (03PS1) 10Jforrester: Zuul: [mediawiki/libs/node-cssjanus] Replace CI testing in Node 20 with Node 24 [integration/config] - 10https://gerrit.wikimedia.org/r/1276777 [19:33:16] (03open) 10dancy: production/digitalocean.tfvars: kubernetes_version = "1.34.5-do.3" [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/583 (https://phabricator.wikimedia.org/T423726) [19:33:18] (03update) 10dancy: production/digitalocean.tfvars: kubernetes_version = "1.34.5-do.3" [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/583 (https://phabricator.wikimedia.org/T423726) [19:33:53] (03CR) 10Jforrester: [C:03+2] Zuul: [wikimedia/portals] Drop CI testing in Node 20 and Node 22 [integration/config] - 10https://gerrit.wikimedia.org/r/1276765 (owner: 10Jforrester) [19:33:56] (03CR) 10Jforrester: [C:03+2] Zuul: [unicodejs] Replace CI testing in Node 20 with Node 24 [integration/config] - 10https://gerrit.wikimedia.org/r/1276766 (owner: 10Jforrester) [19:33:59] (03CR) 10Jforrester: [C:03+2] Zuul: [oojs/js] Drop CI testing in Node 20 and Node 22 [integration/config] - 10https://gerrit.wikimedia.org/r/1276767 (owner: 10Jforrester) [19:34:02] (03CR) 10Jforrester: [C:03+2] Zuul: [oojs/ui] Drop CI testing in Node 20 and Node 22 [integration/config] - 10https://gerrit.wikimedia.org/r/1276768 (owner: 10Jforrester) [19:34:45] (03merge) 10dancy: production/digitalocean.tfvars: kubernetes_version = "1.34.5-do.3" [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/583 (https://phabricator.wikimedia.org/T423726) [19:35:18] (03CR) 10CI reject: [V:04-1] Zuul: [wikidata/query/*] Replace CI testing in Node 20 with Node 24 [integration/config] - 10https://gerrit.wikimedia.org/r/1276775 (owner: 10Jforrester) [19:35:18] (03CR) 10CI reject: [V:04-1] Zuul: [wikibase/*] Replace CI testing in Node 20 with Node 24 [integration/config] - 10https://gerrit.wikimedia.org/r/1276776 (owner: 10Jforrester) [19:35:19] (03CR) 10CI reject: [V:04-1] Zuul: [mediawiki/libs/node-cssjanus] Replace CI testing in Node 20 with Node 24 [integration/config] - 10https://gerrit.wikimedia.org/r/1276777 (owner: 10Jforrester) [19:35:57] (03Merged) 10jenkins-bot: Zuul: [wikimedia/portals] Drop CI testing in Node 20 and Node 22 [integration/config] - 10https://gerrit.wikimedia.org/r/1276765 (owner: 10Jforrester) [19:35:58] (03Merged) 10jenkins-bot: Zuul: [unicodejs] Replace CI testing in Node 20 with Node 24 [integration/config] - 10https://gerrit.wikimedia.org/r/1276766 (owner: 10Jforrester) [19:36:01] (03Merged) 10jenkins-bot: Zuul: [oojs/js] Drop CI testing in Node 20 and Node 22 [integration/config] - 10https://gerrit.wikimedia.org/r/1276767 (owner: 10Jforrester) [19:36:07] (03Merged) 10jenkins-bot: Zuul: [oojs/ui] Drop CI testing in Node 20 and Node 22 [integration/config] - 10https://gerrit.wikimedia.org/r/1276768 (owner: 10Jforrester) [19:36:55] !log Zuul: [wikimedia/portals] Drop CI testing in Node 20 and Node 22 [19:36:56] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [19:37:00] !log Zuul: [unicodejs] Replace CI testing in Node 20 with Node 24 [19:37:01] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [19:37:06] !log Zuul: [oojs/js] Drop CI testing in Node 20 and Node 22 [19:37:07] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [19:37:14] !log Zuul: [oojs/ui] Drop CI testing in Node 20 and Node 22 [19:37:15] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [19:38:49] (03PS2) 10Jforrester: jjb: Drop special node-plus-php jobs for OOUI on Node 20/Node 22 [integration/config] - 10https://gerrit.wikimedia.org/r/1276769 [19:38:49] (03PS2) 10Jforrester: Zuul: [wikipeg] Drop testing in Node 20 and Node 22 [integration/config] - 10https://gerrit.wikimedia.org/r/1276770 [19:38:49] (03PS2) 10Jforrester: jjb: Drop special node-plus-php jobs for Wikipeg on Node 20/Node 22 [integration/config] - 10https://gerrit.wikimedia.org/r/1276771 [19:38:50] (03PS2) 10Jforrester: Zuul: [jquery-client] Replace CI testing in Node 20 with Node 24 [integration/config] - 10https://gerrit.wikimedia.org/r/1276772 [19:38:50] (03PS2) 10Jforrester: Zuul: [mediawiki/tools/*] Replace CI testing in Node 20 with Node 24 [integration/config] - 10https://gerrit.wikimedia.org/r/1276773 [19:38:52] (03PS2) 10Jforrester: Zuul: [analytics/*] Replace CI testing in Node 20 with Node 24 [integration/config] - 10https://gerrit.wikimedia.org/r/1276774 [19:38:56] (03PS2) 10Jforrester: Zuul: [wikidata/query/*] Replace CI testing in Node 20 with Node 24 [integration/config] - 10https://gerrit.wikimedia.org/r/1276775 [19:39:00] (03PS2) 10Jforrester: Zuul: [wikibase/*] Replace CI testing in Node 20 with Node 24 [integration/config] - 10https://gerrit.wikimedia.org/r/1276776 [19:39:04] (03PS2) 10Jforrester: Zuul: [mediawiki/libs/node-cssjanus] Replace CI testing in Node 20 with Node 24 [integration/config] - 10https://gerrit.wikimedia.org/r/1276777 [19:39:10] (03CR) 10Jforrester: [C:03+2] jjb: Drop special node-plus-php jobs for OOUI on Node 20/Node 22 [integration/config] - 10https://gerrit.wikimedia.org/r/1276769 (owner: 10Jforrester) [19:39:40] (03CR) 10Jforrester: [C:03+2] Zuul: [wikipeg] Drop testing in Node 20 and Node 22 [integration/config] - 10https://gerrit.wikimedia.org/r/1276770 (owner: 10Jforrester) [19:40:40] (03CR) 10Jforrester: [C:03+2] Zuul: [jquery-client] Replace CI testing in Node 20 with Node 24 [integration/config] - 10https://gerrit.wikimedia.org/r/1276772 (owner: 10Jforrester) [19:44:20] (03CR) 10CI reject: [V:04-1] Zuul: [wikidata/query/*] Replace CI testing in Node 20 with Node 24 [integration/config] - 10https://gerrit.wikimedia.org/r/1276775 (owner: 10Jforrester) [19:44:40] (03CR) 10CI reject: [V:04-1] Zuul: [wikibase/*] Replace CI testing in Node 20 with Node 24 [integration/config] - 10https://gerrit.wikimedia.org/r/1276776 (owner: 10Jforrester) [19:44:48] (03CR) 10CI reject: [V:04-1] jjb: Drop special node-plus-php jobs for OOUI on Node 20/Node 22 [integration/config] - 10https://gerrit.wikimedia.org/r/1276769 (owner: 10Jforrester) [19:44:49] (03CR) 10CI reject: [V:04-1] Zuul: [wikipeg] Drop testing in Node 20 and Node 22 [integration/config] - 10https://gerrit.wikimedia.org/r/1276770 (owner: 10Jforrester) [19:44:58] (03CR) 10CI reject: [V:04-1] Zuul: [mediawiki/libs/node-cssjanus] Replace CI testing in Node 20 with Node 24 [integration/config] - 10https://gerrit.wikimedia.org/r/1276777 (owner: 10Jforrester) [19:45:14] (03CR) 10Jforrester: [V:03+2 C:03+2] jjb: Drop special node-plus-php jobs for OOUI on Node 20/Node 22 [integration/config] - 10https://gerrit.wikimedia.org/r/1276769 (owner: 10Jforrester) [19:46:57] (03CR) 10CI reject: [V:04-1] jjb: Drop special node-plus-php jobs for OOUI on Node 20/Node 22 [integration/config] - 10https://gerrit.wikimedia.org/r/1276769 (owner: 10Jforrester) [19:46:58] (03CR) 10CI reject: [V:04-1] Zuul: [wikipeg] Drop testing in Node 20 and Node 22 [integration/config] - 10https://gerrit.wikimedia.org/r/1276770 (owner: 10Jforrester) [19:47:55] !log Upgrading gitlab cloud runners (staging) k8s from 1.34.5-do.3 to 1.35.1-do.3 (T423726) [19:47:57] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [19:47:58] T423726: Update gitlab-cloud-runners kubernetes - https://phabricator.wikimedia.org/T423726 [19:48:33] (03PS3) 10Jforrester: Zuul: [wikipeg] Drop testing in Node 20 and Node 22 [integration/config] - 10https://gerrit.wikimedia.org/r/1276770 [19:48:33] (03PS3) 10Jforrester: jjb: Drop special node-plus-php jobs for OOUI on Node 20/Node 22 [integration/config] - 10https://gerrit.wikimedia.org/r/1276769 [19:48:33] (03PS3) 10Jforrester: jjb: Drop special node-plus-php jobs for Wikipeg on Node 20/Node 22 [integration/config] - 10https://gerrit.wikimedia.org/r/1276771 [19:48:34] (03PS3) 10Jforrester: Zuul: [jquery-client] Replace CI testing in Node 20 with Node 24 [integration/config] - 10https://gerrit.wikimedia.org/r/1276772 [19:48:43] (03CR) 10Jforrester: "…" [integration/config] - 10https://gerrit.wikimedia.org/r/1276770 (owner: 10Jforrester) [19:51:22] (03Merged) 10jenkins-bot: Zuul: [wikipeg] Drop testing in Node 20 and Node 22 [integration/config] - 10https://gerrit.wikimedia.org/r/1276770 (owner: 10Jforrester) [19:51:24] (03Merged) 10jenkins-bot: jjb: Drop special node-plus-php jobs for OOUI on Node 20/Node 22 [integration/config] - 10https://gerrit.wikimedia.org/r/1276769 (owner: 10Jforrester) [19:51:39] !log Zuul: [wikipeg] Drop testing in Node 20 and Node 22 [19:51:40] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [19:51:47] (03CR) 10Jforrester: [C:03+2] jjb: Drop special node-plus-php jobs for Wikipeg on Node 20/Node 22 [integration/config] - 10https://gerrit.wikimedia.org/r/1276771 (owner: 10Jforrester) [19:54:44] (03Merged) 10jenkins-bot: jjb: Drop special node-plus-php jobs for Wikipeg on Node 20/Node 22 [integration/config] - 10https://gerrit.wikimedia.org/r/1276771 (owner: 10Jforrester) [19:54:46] (03Merged) 10jenkins-bot: Zuul: [jquery-client] Replace CI testing in Node 20 with Node 24 [integration/config] - 10https://gerrit.wikimedia.org/r/1276772 (owner: 10Jforrester) [19:55:10] !log Zuul: [jquery-client] Replace CI testing in Node 20 with Node 24 [19:55:11] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [19:59:55] (03PS3) 10Jforrester: Zuul: [mediawiki/tools/*] Replace CI testing in Node 20 with Node 24 [integration/config] - 10https://gerrit.wikimedia.org/r/1276773 [19:59:55] (03PS3) 10Jforrester: Zuul: [analytics/*] Replace CI testing in Node 20 with Node 24 [integration/config] - 10https://gerrit.wikimedia.org/r/1276774 [19:59:55] (03PS3) 10Jforrester: Zuul: [wikidata/query/*] Replace CI testing in Node 20 with Node 24 [integration/config] - 10https://gerrit.wikimedia.org/r/1276775 [19:59:56] (03PS3) 10Jforrester: Zuul: [wikibase/*] Replace CI testing in Node 20 with Node 24 [integration/config] - 10https://gerrit.wikimedia.org/r/1276776 [19:59:56] (03PS3) 10Jforrester: Zuul: [mediawiki/libs/node-cssjanus] Replace CI testing in Node 20 with Node 24 [integration/config] - 10https://gerrit.wikimedia.org/r/1276777 [19:59:58] (03PS1) 10Jforrester: jjb: Provide branchdeploy-wikidata-query-builder-node24-npm [integration/config] - 10https://gerrit.wikimedia.org/r/1276781 [20:00:01] (03PS1) 10Jforrester: Zuul: [VisualEditor/VisualEditor] Replace Node 20 testing with Node 24 [integration/config] - 10https://gerrit.wikimedia.org/r/1276782 [20:05:01] (03open) 10dancy: staging/digitalocean.tfvars: kubernetes_version = "1.35.1-do.3" [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/584 (https://phabricator.wikimedia.org/T423726) [20:05:07] (03update) 10dancy: staging/digitalocean.tfvars: kubernetes_version = "1.35.1-do.3" [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/584 (https://phabricator.wikimedia.org/T423726) [20:05:46] (03merge) 10dancy: staging/digitalocean.tfvars: kubernetes_version = "1.35.1-do.3" [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/584 (https://phabricator.wikimedia.org/T423726) [20:06:34] !log Upgrading gitlab cloud runners (prod) k8s from 1.34.5-do.3 to 1.35.1-do.3 (T423726) [20:06:36] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [20:06:37] T423726: Update gitlab-cloud-runners kubernetes - https://phabricator.wikimedia.org/T423726 [20:07:59] (03CR) 10Jforrester: [C:03+2] Zuul: [mediawiki/tools/*] Replace CI testing in Node 20 with Node 24 [integration/config] - 10https://gerrit.wikimedia.org/r/1276773 (owner: 10Jforrester) [20:08:04] (03CR) 10Jforrester: [C:03+2] Zuul: [analytics/*] Replace CI testing in Node 20 with Node 24 [integration/config] - 10https://gerrit.wikimedia.org/r/1276774 (owner: 10Jforrester) [20:08:08] (03CR) 10Jforrester: [C:03+2] jjb: Provide branchdeploy-wikidata-query-builder-node24-npm [integration/config] - 10https://gerrit.wikimedia.org/r/1276781 (owner: 10Jforrester) [20:08:14] (03CR) 10Jforrester: [C:03+2] Zuul: [wikidata/query/*] Replace CI testing in Node 20 with Node 24 [integration/config] - 10https://gerrit.wikimedia.org/r/1276775 (owner: 10Jforrester) [20:08:18] (03CR) 10Jforrester: [C:03+2] Zuul: [wikibase/*] Replace CI testing in Node 20 with Node 24 [integration/config] - 10https://gerrit.wikimedia.org/r/1276776 (owner: 10Jforrester) [20:10:22] (03Merged) 10jenkins-bot: Zuul: [mediawiki/tools/*] Replace CI testing in Node 20 with Node 24 [integration/config] - 10https://gerrit.wikimedia.org/r/1276773 (owner: 10Jforrester) [20:10:23] (03Merged) 10jenkins-bot: Zuul: [analytics/*] Replace CI testing in Node 20 with Node 24 [integration/config] - 10https://gerrit.wikimedia.org/r/1276774 (owner: 10Jforrester) [20:10:25] (03Merged) 10jenkins-bot: jjb: Provide branchdeploy-wikidata-query-builder-node24-npm [integration/config] - 10https://gerrit.wikimedia.org/r/1276781 (owner: 10Jforrester) [20:10:45] (03Merged) 10jenkins-bot: Zuul: [wikidata/query/*] Replace CI testing in Node 20 with Node 24 [integration/config] - 10https://gerrit.wikimedia.org/r/1276775 (owner: 10Jforrester) [20:10:51] (03Merged) 10jenkins-bot: Zuul: [wikibase/*] Replace CI testing in Node 20 with Node 24 [integration/config] - 10https://gerrit.wikimedia.org/r/1276776 (owner: 10Jforrester) [20:10:55] !log Zuul: [mediawiki/tools/*] Replace CI testing in Node 20 with Node 24 [20:10:56] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [20:11:05] !log Zuul: [analytics/*] Replace CI testing in Node 20 with Node 24 [20:11:06] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [20:11:12] !log Zuul: [wikidata/query/*] Replace CI testing in Node 20 with Node 24 [20:11:12] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [20:11:27] !log Zuul: [wikibase/*] Replace CI testing in Node 20 with Node 24 [20:11:28] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [20:20:12] (03update) 10dancy: production/digitalocean.tfvars: kubernetes_version = "1.35.1-do.3" [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/585 (https://phabricator.wikimedia.org/T423726) [20:20:15] (03open) 10dancy: production/digitalocean.tfvars: kubernetes_version = "1.35.1-do.3" [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/585 (https://phabricator.wikimedia.org/T423726) [20:20:58] (03merge) 10dancy: production/digitalocean.tfvars: kubernetes_version = "1.35.1-do.3" [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/585 (https://phabricator.wikimedia.org/T423726) [20:28:02] 10Continuous-Integration-Config, 10Continuous-Integration-Infrastructure, 10Castor, 07ci-test-error (WMF-deployed Build Failure): PostBuild changing the status of successful builds to failure for no apparent reason - https://phabricator.wikimedia.org/T419488#11852991 (10Umherirrender) It seems the castor b... [20:31:42] 10MediaWiki-Releasing, 10MediaWiki-General, 07PHP 8.4 support: Backport various things in MW core and tarball extensions so we can enforce PHP 8.4 as voting on REL1_45 - https://phabricator.wikimedia.org/T424270 (10Jdforrester-WMF) 03NEW [20:32:22] 10MediaWiki-Releasing, 10MediaWiki-General, 07PHP 8.4 support: Backport various things in MW core and tarball extensions so we can enforce PHP 8.4 as voting on REL1_43 - https://phabricator.wikimedia.org/T424272 (10Jdforrester-WMF) 03NEW [20:32:53] 10MediaWiki-Releasing, 10MediaWiki-General, 07PHP 8.4 support: Backport various things in MW core and tarball extensions so we can enforce PHP 8.4 as voting on REL1_44 - https://phabricator.wikimedia.org/T424271#11853031 (10Jdforrester-WMF) [21:05:20] (03open) 10dancy: backport: Only consider CI votes after backport approval [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/1136 (https://phabricator.wikimedia.org/T420501) [21:05:23] (03update) 10dancy: backport: Only consider CI votes after backport approval [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/1136 (https://phabricator.wikimedia.org/T420501) [21:07:42] (03update) 10dancy: backport: Only consider CI votes after backport approval [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/1136 (https://phabricator.wikimedia.org/T420501) [21:10:35] (03open) 10jgleeson: Add age to fundraising-tools-bookworm [repos/releng/dev-images] - 10https://gitlab.wikimedia.org/repos/releng/dev-images/-/merge_requests/102 [21:11:33] 10MediaWiki-Releasing, 10MediaWiki-General, 05MW-1.43-release, 07PHP 8.4 support: Backport various things in MW core and tarball extensions so we can enforce PHP 8.4 as voting on REL1_43 - https://phabricator.wikimedia.org/T424272#11853149 (10Reedy) Can we get some experimental jobs for these three branche... [21:11:55] 10MediaWiki-Releasing, 10MediaWiki-General, 05MW-1.45-release, 07PHP 8.4 support: Backport various things in MW core and tarball extensions so we can enforce PHP 8.4 as voting on REL1_45 - https://phabricator.wikimedia.org/T424270#11853151 (10Reedy) [21:12:03] 10MediaWiki-Releasing, 10MediaWiki-General, 05MW-1.44-release, 07PHP 8.4 support: Backport various things in MW core and tarball extensions so we can enforce PHP 8.4 as voting on REL1_44 - https://phabricator.wikimedia.org/T424271#11853152 (10Reedy) [21:13:31] 10MediaWiki-Releasing, 10MediaWiki-General, 05MW-1.43-release, 07PHP 8.4 support: Backport various things in MW core and tarball extensions so we can enforce PHP 8.4 as voting on REL1_43 - https://phabricator.wikimedia.org/T424272#11853153 (10Reedy) >>! In T424272#11853149, @Reedy wrote: > Can we get some... [21:19:56] (03update) 10jgleeson: Add age to fundraising-tools-bookworm [repos/releng/dev-images] - 10https://gitlab.wikimedia.org/repos/releng/dev-images/-/merge_requests/102 [21:20:39] (03update) 10jgleeson: Add age to fundraising-tools-bookworm [repos/releng/dev-images] - 10https://gitlab.wikimedia.org/repos/releng/dev-images/-/merge_requests/102 [21:23:47] 10MediaWiki-Releasing, 10MediaWiki-General, 05MW-1.43-release, 07PHP 8.4 support: Backport various things in MW core and tarball extensions so we can enforce PHP 8.4 as voting on REL1_43 - https://phabricator.wikimedia.org/T424272#11853197 (10Reedy) https://integration.wikimedia.org/ci/job/quibble-for-medi... [21:28:50] 10MediaWiki-Releasing, 10MediaWiki-General, 05MW-1.43-release, 13Patch-For-Review, 07PHP 8.4 support: Backport various things in MW core and tarball extensions so we can enforce PHP 8.4 as voting on REL1_43 - https://phabricator.wikimedia.org/T424272#11853208 (10Jdforrester-WMF) >>! In T424272#11853153,... [21:52:44] 10MediaWiki-Releasing, 10MediaWiki-General, 05MW-1.45-release, 07PHP 8.4 support: Backport various things in MW core and tarball extensions so we can enforce PHP 8.4 as voting on REL1_45 - https://phabricator.wikimedia.org/T424270#11853296 (10Reedy) https://integration.wikimedia.org/ci/job/quibble-for-medi... [22:01:58] !log Cherry-picked {{gerrit|1276813}} to deployment-puppetserver-1 (T256168) [22:02:00] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [22:02:01] T256168: Move beta cluster automatic deployment to a dedicated infrastructure - https://phabricator.wikimedia.org/T256168 [22:12:44] !log Disabled https://integration.wikimedia.org/ci/job/beta-code-update-eqiad so that replacement script can be tested (T256168) [22:12:46] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [22:12:46] T256168: Move beta cluster automatic deployment to a dedicated infrastructure - https://phabricator.wikimedia.org/T256168 [22:14:04] 10MediaWiki-Releasing, 10MediaWiki-General, 05MW-1.43-release, 13Patch-For-Review, 07PHP 8.4 support: Backport various things in MW core and tarball extensions so we can enforce PHP 8.4 as voting on REL1_43 - https://phabricator.wikimedia.org/T424272#11853352 (10Reedy) https://integration.wikimedia.org/c... [22:16:15] !log Disabled https://integration.wikimedia.org/ci/view/Beta/job/beta-update-databases-eqiad so that replacement script can be tested (T256168) [22:16:17] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [22:18:13] 10Beta-Cluster-Infrastructure, 10Continuous-Integration-Config, 10Continuous-Integration-Infrastructure, 07Jenkins, and 3 others: Move beta cluster automatic deployment to a dedicated infrastructure - https://phabricator.wikimedia.org/T256168#11853356 (10bd808) [22:20:20] (03PS1) 10WMDE-leszek: Set up CI for wikibase/new-lexeme-special-page repository [integration/config] - 10https://gerrit.wikimedia.org/r/1276428 (https://phabricator.wikimedia.org/T424098) [22:23:42] 10MediaWiki-Releasing, 10MediaWiki-General, 05MW-1.44-release, 13Patch-For-Review, 07PHP 8.4 support: Backport various things in MW core and tarball extensions so we can enforce PHP 8.4 as voting on REL1_44 - https://phabricator.wikimedia.org/T424271#11853368 (10Reedy) https://integration.wikimedia.org/c... [22:36:21] !log bd808@deployment-deploy04 `sudo -u mwdeploy /usr/local/bin/wmf-beta-update-all` [22:36:22] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [22:36:52] "[22:36:19] error: cannot open .git/FETCH_HEAD: Permission denied" failing fast :) [22:38:02] Looks like I need to use jenkins-deploy as the runtime user. Makes sense I guess. [22:58:44] !log bd808@deployment-deploy04 `sudo -u jenkins-deploy /usr/local/bin/wmf-beta-update-all` [22:58:45] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [23:20:05] 10Beta-Cluster-Infrastructure, 10Continuous-Integration-Config, 10Continuous-Integration-Infrastructure, 07Jenkins, and 3 others: Move beta cluster automatic deployment to a dedicated infrastructure - https://phabricator.wikimedia.org/T256168#11853470 (10bd808) The manual run of `sudo -u jenkins-deploy /us... [23:57:17] !Log Set `profile::beta::autoupdater::run_updater: true` for deployment-deploy04 via Horizon (T256168) [23:57:18] T256168: Move beta cluster automatic deployment to a dedicated infrastructure - https://phabricator.wikimedia.org/T256168 [23:57:58] !log Set `profile::beta::autoupdater::run_updater: true` for deployment-deploy04 via Horizon (T256168) [23:58:00] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL