[00:27:34] 10GitLab (Account Approval), 06Release-Engineering-Team: Requesting GitLab account activation for Pxxlhxslxn - https://phabricator.wikimedia.org/T426548 (10Pxxlhxslxn) 03NEW [00:29:18] 10GitLab (Account Approval), 06Release-Engineering-Team: Requesting GitLab account activation for Pxxlhxslxn - https://phabricator.wikimedia.org/T426548#11929120 (10Pxxlhxslxn) As discussed in channel https://phabricator.wikimedia.org/T419770 I was seeking approval to access the wikimedia gitlab specifically t... [02:09:27] (03CR) 10Hashar: [C:03+2] "I am not sure whether the `debian-glue` job (which builds the Debian packages) will still be passing, but that should be fixable ;)" [integration/config] - 10https://gerrit.wikimedia.org/r/1287921 (owner: 10BCornwall) [02:15:22] (03Merged) 10jenkins-bot: Revert "Archive operations/debs/gdnsd" [integration/config] - 10https://gerrit.wikimedia.org/r/1287921 (owner: 10BCornwall) [04:15:35] 10Continuous-Integration-Infrastructure, 06Release-Engineering-Team, 10QS-Test-Automation, 13Patch-For-Review, 06Quality-and-Test-Engineering-Team (Quality Engineering): Better prevent changes in MW core from breaking WMF production extensions - https://phabricator.wikimedia.org/T404403#11929192 (10vaughn... [07:01:50] 10GitLab (Project Migration), 10Wikispeech-Jobrunner, 10Wikispeech-Text-to-Speech, 06Wikispeech-WMSE: Move Speechoid components to Gitlab - https://phabricator.wikimedia.org/T360758#11929334 (10Sebastian_Berlin-WMSE) [07:05:49] 10GitLab (Account Approval), 06Release-Engineering-Team (Doing 😎): Requesting GitLab account activation for Pxxlhxslxn - https://phabricator.wikimedia.org/T426548#11929347 (10Aklapper) 05Open→03Resolved a:03Aklapper Account approved. [07:43:23] 10Phabricator (2026-02-24), 06Release-Engineering-Team (Doing 😎), 07Essential-Work: Uninstall Countdown (Phabricator application) - https://phabricator.wikimedia.org/T418033#11929447 (10A_smart_kitten) (For the record, it seems like the Countdown application [[https://phabricator.wikimedia.org/applicatio... [08:05:49] 10Phabricator (2026-02-24), 06Release-Engineering-Team (Doing 😎), 07Essential-Work: Uninstall Countdown (Phabricator application) - https://phabricator.wikimedia.org/T418033#11929506 (10Aklapper) Uff, thanks for catching that. Now I wonder what I did on that Wednesday...maybe I mixed up testing stuff on... [08:38:09] 10Scap: Wrong path patch in SecurityPatchBot automated messages - https://phabricator.wikimedia.org/T426572 (10jnuche) 03NEW [08:42:39] (03open) 10jnuche: scap/patches.py: fix notifications patches path [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/1192 (https://phabricator.wikimedia.org/T426572) [08:43:32] 06Release-Engineering-Team (Priority Backlog 📥), 07Essential-Work, 05Release, 05Train Deployments: 1.47.0-wmf.3 deployment blockers - https://phabricator.wikimedia.org/T423912#11929818 (10hashar) @Lucas_Werkmeister_WMDE I am the one running the train this week and will thus roll it during european morning... [08:44:38] 10Scap, 13Patch-For-Review: Wrong path patch in SecurityPatchBot automated messages - https://phabricator.wikimedia.org/T426572#11929820 (10jnuche) [08:47:19] (03merge) 10jnuche: scap/patches.py: fix notifications patches path [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/1192 (https://phabricator.wikimedia.org/T426572) [08:52:43] (03PS1) 10Hashar: Unarchive the repository [debs/gdnsd] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/1288469 [08:53:33] (03CR) 10Hashar: [V:03+2 C:03+2] Unarchive the repository [debs/gdnsd] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/1288469 (owner: 10Hashar) [08:53:42] (03open) 10jnuche: Release 4.265.2 [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/1193 [08:56:03] (03merge) 10jnuche: Release 4.265.2 [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/1193 [09:12:31] 06Release-Engineering-Team (Doing 😎), 10Scap, 07Essential-Work, 13Patch-For-Review: Wrong path patch in SecurityPatchBot automated messages - https://phabricator.wikimedia.org/T426572#11930030 (10jnuche) [09:12:43] 06Release-Engineering-Team (Doing 😎), 10Scap, 07Essential-Work, 13Patch-For-Review: Wrong path patch in SecurityPatchBot automated messages - https://phabricator.wikimedia.org/T426572#11930032 (10jnuche) 05Open→03Resolved Fix is in prod [09:19:59] 10Phabricator (phabricator-next), 06Release-Engineering-Team (Doing 😎), 10Wikimedia-Phabricator-Extensions: Have Phabricator link Gerrit change-id to Gerrit search query - https://phabricator.wikimedia.org/T420363#11930059 (10Aklapper) 05Open→03Stalled I don't have a strong opinion but I think we don't l... [09:29:06] !log ssh integration-castor06.integration.eqiad1.wikimedia.cloud sudo -u jenkins-deploy rm -rf /srv/castor/castor-mw-ext-and-skins/master/mediawiki-node24 # fix failure seen in mediawiki-node24 22260 [09:29:07] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [09:37:14] 10Continuous-Integration-Infrastructure, 10Gerrit, 06Release-Engineering-Team, 06collaboration-services, and 2 others: Fetches from Gerrit aborted due to: GnuTLS recv error (-54): Error in the pull function - https://phabricator.wikimedia.org/T420865#11930135 (10hashar) [09:49:58] 10Phabricator, 06Release-Engineering-Team (Priority Backlog 📥): Phab Scap template vs actual value out of sync for maniphest.custom-field-definitions - https://phabricator.wikimedia.org/T398460#11930205 (10Aklapper) * On https://phabricator.wmcloud.org/config/edit/maniphest.custom-field-definitions/ , changed... [10:10:40] 10Continuous-Integration-Infrastructure, 10Gerrit, 06Release-Engineering-Team, 06collaboration-services, and 2 others: Fetches from Gerrit aborted due to: GnuTLS recv error (-54): Error in the pull function - https://phabricator.wikimedia.org/T420865#11930288 (10A_smart_kitten) [12:03:39] 06Release-Engineering-Team (Priority Backlog 📥), 07Essential-Work, 05Release, 05Train Deployments: 1.47.0-wmf.3 deployment blockers - https://phabricator.wikimedia.org/T423912#11930647 (10Dreamy_Jazz) [12:57:29] 10Continuous-Integration-Infrastructure, 07Jenkins, 10Castor, 07Upstream: castor-save-workspace-cache aborted during postbuild - https://phabricator.wikimedia.org/T352319#11930993 (10Novem_Linguae) Still happening. Example from today: * https://gerrit.wikimedia.org/r/c/mediawiki/extensions/MultimediaViewe... [14:04:45] (03Abandoned) 10Hashar: jjb: enable git curl trace dump for Quibble [integration/config] - 10https://gerrit.wikimedia.org/r/1283846 (https://phabricator.wikimedia.org/T420865) (owner: 10Hashar) [14:07:53] (03PS1) 10Hashar: dockerfiles: update Quibble to 1.18.0 [integration/config] - 10https://gerrit.wikimedia.org/r/1288867 [14:08:31] (03CR) 10Hashar: [C:03+2] dockerfiles: update Quibble to 1.18.0 [integration/config] - 10https://gerrit.wikimedia.org/r/1288867 (owner: 10Hashar) [14:10:22] (03Merged) 10jenkins-bot: dockerfiles: update Quibble to 1.18.0 [integration/config] - 10https://gerrit.wikimedia.org/r/1288867 (owner: 10Hashar) [14:17:22] (03PS1) 10Hashar: jjb: Upgrade Quibble to 1.18.0 [integration/config] - 10https://gerrit.wikimedia.org/r/1288870 [14:27:33] !log Upgrading Quibble jobs to 1.18.0 [14:27:39] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [14:33:23] (03CR) 10Jforrester: [C:03+2] "Deployed." [integration/config] - 10https://gerrit.wikimedia.org/r/1285872 (https://phabricator.wikimedia.org/T425968) (owner: 10Jforrester) [14:34:33] (03CR) 10Hashar: [C:03+2] "Deployed with @zfilipin@wikimedia.org @pwangai@wikimedia.org and @phedenskog@wikimedia.org" [integration/config] - 10https://gerrit.wikimedia.org/r/1288870 (owner: 10Hashar) [14:35:30] (03Merged) 10jenkins-bot: jjb: [wikilambda-catalyst-end-to-end*] Bump runner to Node 24 [integration/config] - 10https://gerrit.wikimedia.org/r/1285872 (https://phabricator.wikimedia.org/T425968) (owner: 10Jforrester) [14:36:20] (03Merged) 10jenkins-bot: jjb: Upgrade Quibble to 1.18.0 [integration/config] - 10https://gerrit.wikimedia.org/r/1288870 (owner: 10Hashar) [14:45:18] wb hashar! [14:57:24] 10GitLab (CI & Job Runners), 06Release-Engineering-Team (Priority Backlog 📥): Jobs on Digital Ocean Cloud Runners are being OOM killed - https://phabricator.wikimedia.org/T387886#11931689 (10dancy) @Don-vip, please try adding the following to your `.gitlab-ci.yml` file: ` default: tags: - memory-optimiz... [15:09:58] (03open) 10dancy: Revert "Chart 1.7.0: Add workaround for https://github.com/distribution/distribution/issues/2367" [repos/releng/docker-hub-mirror] - 10https://gitlab.wikimedia.org/repos/releng/docker-hub-mirror/-/merge_requests/43 (https://phabricator.wikimedia.org/T354879) [15:10:00] (03update) 10dancy: Revert "Chart 1.7.0: Add workaround for https://github.com/distribution/distribution/issues/2367" [repos/releng/docker-hub-mirror] - 10https://gitlab.wikimedia.org/repos/releng/docker-hub-mirror/-/merge_requests/43 (https://phabricator.wikimedia.org/T354879) [15:11:32] (03merge) 10dancy: Revert "Chart 1.7.0: Add workaround for https://github.com/distribution/distribution/issues/2367" [repos/releng/docker-hub-mirror] - 10https://gitlab.wikimedia.org/repos/releng/docker-hub-mirror/-/merge_requests/43 (https://phabricator.wikimedia.org/T354879) [15:13:46] (03open) 10dancy: docker-hub-mirror/main.tf: Use chart version 1.12.0 [auto-deploy] [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/596 (https://phabricator.wikimedia.org/T354879) [15:13:47] (03update) 10dancy: docker-hub-mirror/main.tf: Use chart version 1.12.0 [auto-deploy] [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/596 (https://phabricator.wikimedia.org/T354879) [15:14:58] (03merge) 10dancy: docker-hub-mirror/main.tf: Use chart version 1.12.0 [auto-deploy] [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/596 (https://phabricator.wikimedia.org/T354879) [15:17:55] 10GitLab (CI & Job Runners), 06Release-Engineering-Team (Priority Backlog 📥): Jobs on Digital Ocean Cloud Runners are being OOM killed - https://phabricator.wikimedia.org/T387886#11931806 (10Don-vip) It [[ https://gitlab.wikimedia.org/toolforge-repos/spacemedia/-/jobs/826682 | didn't help ]], sadly. [15:22:58] 10GitLab (CI & Job Runners), 06Release-Engineering-Team (Priority Backlog 📥): Jobs on Digital Ocean Cloud Runners are being OOM killed - https://phabricator.wikimedia.org/T387886#11931883 (10dancy) >>! In T387886#11931806, @Don-vip wrote: > It [[ https://gitlab.wikimedia.org/toolforge-repos/spacemedia/-/jobs/8... [15:40:50] 10Gerrit, 07Incident Severity 2, 07Wikimedia-Incident: Gerrit is down - https://phabricator.wikimedia.org/T407200#11931972 (10hnowlan) [15:44:04] 10Phabricator: Make it possible for users to self-claim the "Volunteer" badge - https://phabricator.wikimedia.org/T426638 (10bd808) 03NEW [15:46:24] 10Phabricator: Make it possible for users to self-claim the "Volunteer" badge - https://phabricator.wikimedia.org/T426638#11932008 (10bd808) I suppose one option available could be a tool hosted on Toolforge or elsewhere that would perform the granting action on behalf of an authenticated user. That is more movi... [15:47:55] (03open) 10dancy: Increase memopt helper memory req/limit to 1024Mi [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/597 (https://phabricator.wikimedia.org/T387886) [15:47:57] (03update) 10dancy: Increase memopt helper memory req/limit to 1024Mi [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/597 (https://phabricator.wikimedia.org/T387886) [15:48:55] (03update) 10dancy: Increase memopt helper memory req/limit to 1024Mi [auto-deploy] [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/597 (https://phabricator.wikimedia.org/T387886) [15:48:59] (03update) 10dancy: Increase memopt helper memory req/limit to 1024Mi [auto-deploy] [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/597 (https://phabricator.wikimedia.org/T387886) [15:52:55] !log gitlab-cloud-runners are in a broken state. I'm investigating [15:52:56] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [15:54:11] (03open) 10dancy: production/digitalocean.tfvars: kubernetes_version = "1.35.1-do.6" [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/598 (https://phabricator.wikimedia.org/T426436) [15:54:12] (03update) 10dancy: production/digitalocean.tfvars: kubernetes_version = "1.35.1-do.6" [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/598 (https://phabricator.wikimedia.org/T426436) [15:56:07] (03merge) 10dancy: production/digitalocean.tfvars: kubernetes_version = "1.35.1-do.6" [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/598 (https://phabricator.wikimedia.org/T426436) [16:05:55] (03open) 10dancy: Default to wmcs runners while rebuild [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/599 [16:05:57] (03update) 10dancy: Default to wmcs runners while rebuild [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/599 [16:08:59] (03update) 10dancy: Default to wmcs runners during rebuild [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/599 [16:09:02] (03update) 10dancy: Default to wmcs runners during rebuild [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/599 [16:09:17] (03merge) 10dancy: Default to wmcs runners during rebuild [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/599 [16:25:51] PROBLEM - Host contint1003 is DOWN: PING CRITICAL - Packet loss = 100% [16:27:23] RECOVERY - Host contint1003 is UP: PING OK - Packet loss = 0%, RTA = 0.29 ms [16:27:51] ^ reboots for kernel [16:30:45] PROBLEM - Host contint2003 is DOWN: PING CRITICAL - Packet loss = 100% [16:31:13] RECOVERY - Host contint2003 is UP: PING OK - Packet loss = 0%, RTA = 31.65 ms [16:34:35] (03open) 10dancy: variables.tf: ingress_cluster_ip = 10.108.30.9 [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/600 [16:34:37] (03update) 10dancy: variables.tf: ingress_cluster_ip = 10.108.30.9 [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/600 [16:34:49] (03merge) 10dancy: variables.tf: ingress_cluster_ip = 10.108.30.9 [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/600 [16:50:17] (03open) 10dancy: Fix ingress_cluster_ip output address [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/601 [16:50:20] (03update) 10dancy: Fix ingress_cluster_ip output address [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/601 [16:50:29] (03update) 10dancy: Fix ingress_cluster_ip output address [auto-deploy] [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/601 [16:50:35] (03update) 10dancy: Fix ingress_cluster_ip output address [auto-deploy] [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/601 [16:53:55] (03merge) 10dancy: Fix ingress_cluster_ip output address [auto-deploy] [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/601 [17:06:11] 06Release-Engineering-Team: gitlab: Trusted runners for mediawiki/services/smokepy/ - https://phabricator.wikimedia.org/T426665 (10daniel) 03NEW [17:06:45] PROBLEM - Host contint2002 is DOWN: PING CRITICAL - Packet loss = 100% [17:07:13] RECOVERY - Host contint2002 is UP: PING OK - Packet loss = 0%, RTA = 30.45 ms [17:07:18] (03open) 10dancy: digitalocean/outputs.tf: Generate ingress_cluster_ip [auto-deploy] [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/602 [17:07:20] (03update) 10dancy: digitalocean/outputs.tf: Generate ingress_cluster_ip [auto-deploy] [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/602 [17:07:27] still reboots - we are not touching the prod contint server just yet [17:07:48] (03merge) 10dancy: digitalocean/outputs.tf: Generate ingress_cluster_ip [auto-deploy] [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/602 [17:15:27] 06Release-Engineering-Team: gitlab: Trusted runners for mediawiki/services/smokepy/ - https://phabricator.wikimedia.org/T426665#11932626 (10taavi) This repository seems to be missing a software license. [17:29:20] (03open) 10dancy: digitalocean/outputs.tf: Generate ingress_cluster_ip (v2) [auto-deploy] [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/603 [17:29:24] (03update) 10dancy: digitalocean/outputs.tf: Generate ingress_cluster_ip (v2) [auto-deploy] [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/603 [17:29:34] (03merge) 10dancy: digitalocean/outputs.tf: Generate ingress_cluster_ip (v2) [auto-deploy] [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/603 [17:42:45] (03update) 10dancy: Increase memopt helper memory req/limit to 1024Mi [auto-deploy] [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/597 (https://phabricator.wikimedia.org/T387886) [18:02:13] (03PS1) 10Jforrester: Zuul: [design/codex] Switch CI to Node 24 [integration/config] - 10https://gerrit.wikimedia.org/r/1288933 [18:02:54] (03CR) 10Jforrester: [C:03+2] Zuul: [design/codex] Switch CI to Node 24 [integration/config] - 10https://gerrit.wikimedia.org/r/1288933 (owner: 10Jforrester) [18:03:53] (03CR) 10CI reject: [V:04-1] Zuul: [design/codex] Switch CI to Node 24 [integration/config] - 10https://gerrit.wikimedia.org/r/1288933 (owner: 10Jforrester) [18:06:49] (03PS2) 10Jforrester: Zuul: [design/codex] Switch CI to Node 24 [integration/config] - 10https://gerrit.wikimedia.org/r/1288933 [18:06:49] (03PS1) 10Jforrester: jjb: Provide codex-node24-doc* [integration/config] - 10https://gerrit.wikimedia.org/r/1288938 [18:08:45] (03CR) 10Jforrester: [C:03+2] jjb: Provide codex-node24-doc* [integration/config] - 10https://gerrit.wikimedia.org/r/1288938 (owner: 10Jforrester) [18:10:24] (03merge) 10dancy: Increase memopt helper memory req/limit to 1024Mi [auto-deploy] [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/597 (https://phabricator.wikimedia.org/T387886) [18:11:16] (03Merged) 10jenkins-bot: jjb: Provide codex-node24-doc* [integration/config] - 10https://gerrit.wikimedia.org/r/1288938 (owner: 10Jforrester) [18:11:18] (03Merged) 10jenkins-bot: Zuul: [design/codex] Switch CI to Node 24 [integration/config] - 10https://gerrit.wikimedia.org/r/1288933 (owner: 10Jforrester) [18:11:29] !log Zuul: [design/codex] Switch CI to Node 24 [18:11:30] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [18:11:47] (03PS1) 10Jforrester: Zuul: [design/codex] Add experimental branchdeploy-codex-node26-npm [integration/config] - 10https://gerrit.wikimedia.org/r/1288942 [18:11:47] (03PS1) 10Jforrester: jjb: Drop codex-node20* [integration/config] - 10https://gerrit.wikimedia.org/r/1288943 [18:11:47] (03PS1) 10Jforrester: jjb: Drop branchdeploy-codex-node20-npm [integration/config] - 10https://gerrit.wikimedia.org/r/1288944 [18:12:52] !log gitlab-cloud-runners have been revived. [18:12:53] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [18:14:49] (03CR) 10Jforrester: [C:03+2] Zuul: [design/codex] Add experimental branchdeploy-codex-node26-npm [integration/config] - 10https://gerrit.wikimedia.org/r/1288942 (owner: 10Jforrester) [18:14:49] !log rebooting production gitlab-runners [18:14:50] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [18:15:57] (03CR) 10Jforrester: [C:03+2] jjb: Drop codex-node20* [integration/config] - 10https://gerrit.wikimedia.org/r/1288943 (owner: 10Jforrester) [18:16:03] (03CR) 10Jforrester: [C:03+2] jjb: Drop branchdeploy-codex-node20-npm [integration/config] - 10https://gerrit.wikimedia.org/r/1288944 (owner: 10Jforrester) [18:17:03] !log releases.wikimedia.org - rebooting backends [18:17:03] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [18:17:23] (03Merged) 10jenkins-bot: Zuul: [design/codex] Add experimental branchdeploy-codex-node26-npm [integration/config] - 10https://gerrit.wikimedia.org/r/1288942 (owner: 10Jforrester) [18:18:28] 10GitLab (CI & Job Runners), 06Release-Engineering-Team (Priority Backlog 📥), 13Patch-For-Review: Jobs on Digital Ocean Cloud Runners are being OOM killed - https://phabricator.wikimedia.org/T387886#11932845 (10dancy) @Don-vip, I've made a configuration change which might help with your job. Please retry an... [18:19:16] (03Merged) 10jenkins-bot: jjb: Drop codex-node20* [integration/config] - 10https://gerrit.wikimedia.org/r/1288943 (owner: 10Jforrester) [18:19:27] (03Merged) 10jenkins-bot: jjb: Drop branchdeploy-codex-node20-npm [integration/config] - 10https://gerrit.wikimedia.org/r/1288944 (owner: 10Jforrester) [18:21:49] (03open) 10dancy: Chart 1.12.1: Use blank value for REGISTRY_STORAGE_CACHE_BLOBDESCRIPTOR [repos/releng/docker-hub-mirror] - 10https://gitlab.wikimedia.org/repos/releng/docker-hub-mirror/-/merge_requests/44 (https://phabricator.wikimedia.org/T354879) [18:21:50] (03update) 10dancy: Chart 1.12.1: Use blank value for REGISTRY_STORAGE_CACHE_BLOBDESCRIPTOR [repos/releng/docker-hub-mirror] - 10https://gitlab.wikimedia.org/repos/releng/docker-hub-mirror/-/merge_requests/44 (https://phabricator.wikimedia.org/T354879) [18:22:55] (03merge) 10dancy: Chart 1.12.1: Use blank value for REGISTRY_STORAGE_CACHE_BLOBDESCRIPTOR [repos/releng/docker-hub-mirror] - 10https://gitlab.wikimedia.org/repos/releng/docker-hub-mirror/-/merge_requests/44 (https://phabricator.wikimedia.org/T354879) [18:23:49] (03open) 10dancy: Revert "Default to wmcs runners during rebuild" [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/604 [18:23:53] (03update) 10dancy: Revert "Default to wmcs runners during rebuild" [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/604 [18:25:24] (03merge) 10dancy: Revert "Default to wmcs runners during rebuild" [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/604 [18:25:30] (03open) 10dancy: docker-hub-mirror/main.tf: Use chart 1.12.1 [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/605 (https://phabricator.wikimedia.org/T354879) [18:25:33] (03update) 10dancy: docker-hub-mirror/main.tf: Use chart 1.12.1 [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/605 (https://phabricator.wikimedia.org/T354879) [18:26:23] (03update) 10dancy: docker-hub-mirror/main.tf: Use chart 1.12.1 [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/605 (https://phabricator.wikimedia.org/T354879) [18:26:37] (03update) 10dancy: docker-hub-mirror/main.tf: Use chart 1.12.1 [auto-deploy] [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/605 (https://phabricator.wikimedia.org/T354879) [18:26:44] (03update) 10dancy: docker-hub-mirror/main.tf: Use chart 1.12.1 [auto-deploy] [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/605 (https://phabricator.wikimedia.org/T354879) [18:27:51] (03merge) 10dancy: docker-hub-mirror/main.tf: Use chart 1.12.1 [auto-deploy] [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/605 (https://phabricator.wikimedia.org/T354879) [18:48:19] (03PS1) 10BCornwall: Revert^2 "Archive operations/debs/gdnsd" [integration/config] - 10https://gerrit.wikimedia.org/r/1288954 [18:56:22] (03CR) 10CI reject: [V:04-1] Revert^2 "Archive operations/debs/gdnsd" [integration/config] - 10https://gerrit.wikimedia.org/r/1288954 (owner: 10BCornwall) [19:01:17] (03PS2) 10BCornwall: Revert^2 "Archive operations/debs/gdnsd" [integration/config] - 10https://gerrit.wikimedia.org/r/1288954 [19:11:01] (03PS2) 10Vaughn Walters: jjb: [catalyst-daily-CampaignEvents] Add CampaignEvents job [integration/config] - 10https://gerrit.wikimedia.org/r/1287941 (https://phabricator.wikimedia.org/T426677) [19:32:04] (03PS2) 10LazyShrey: fresh-node: Add proper --help docs [fresh] - 10https://gerrit.wikimedia.org/r/1287901 (https://phabricator.wikimedia.org/T424867) [19:41:42] (03PS1) 10Jforrester: jjb: Migrate various jobs from Node 20 to Node 24 [integration/config] - 10https://gerrit.wikimedia.org/r/1288959 [19:41:42] (03PS1) 10Jforrester: Zuul: Migrate various production/CI things to Node 24 [integration/config] - 10https://gerrit.wikimedia.org/r/1288960 [19:41:42] (03PS1) 10Jforrester: Docker: [ajv] Migrate to Node 24 [integration/config] - 10https://gerrit.wikimedia.org/r/1288961 [19:41:43] (03PS1) 10Jforrester: Docker: [sonar-scanner] Migrate to Node 24 [integration/config] - 10https://gerrit.wikimedia.org/r/1288962 [19:41:44] (03PS1) 10Jforrester: Zuul: Migrate various labs things to Node 24 [integration/config] - 10https://gerrit.wikimedia.org/r/1288963 [19:41:45] (03PS1) 10Jforrester: Zuul: [wikimedia/fundraising/dash] Fold template into only user [integration/config] - 10https://gerrit.wikimedia.org/r/1288964 [19:41:49] (03PS1) 10Jforrester: Zuul: [wikimedia/fundraising/dash] Replace Node 20 testing with Node 24 [integration/config] - 10https://gerrit.wikimedia.org/r/1288965 [19:41:53] (03PS1) 10Jforrester: Zuul: Drop last Node 20 template, now unused [integration/config] - 10https://gerrit.wikimedia.org/r/1288966 [19:41:57] (03PS1) 10Jforrester: jjb: Drop node20 jobs, unused [integration/config] - 10https://gerrit.wikimedia.org/r/1288967 [19:42:01] (03PS1) 10Jforrester: Docker: Drop Node 20 and Node 22 images, no longer used [integration/config] - 10https://gerrit.wikimedia.org/r/1288968 [19:49:09] (03PS2) 10Jforrester: jjb: Migrate various jobs from Node 20 to Node 24 [integration/config] - 10https://gerrit.wikimedia.org/r/1288959 [19:49:09] (03PS2) 10Jforrester: Zuul: Migrate various production/CI things to Node 24 [integration/config] - 10https://gerrit.wikimedia.org/r/1288960 [19:49:09] (03PS2) 10Jforrester: Docker: [ajv] Migrate to Node 24 [integration/config] - 10https://gerrit.wikimedia.org/r/1288961 [19:49:10] (03PS2) 10Jforrester: Docker: [sonar-scanner] Migrate to Node 24 [integration/config] - 10https://gerrit.wikimedia.org/r/1288962 [19:49:11] (03PS2) 10Jforrester: Zuul: Migrate various labs things to Node 24 [integration/config] - 10https://gerrit.wikimedia.org/r/1288963 [19:49:13] (03PS2) 10Jforrester: Zuul: [wikimedia/fundraising/dash] Fold template into only user [integration/config] - 10https://gerrit.wikimedia.org/r/1288964 [19:49:17] (03PS2) 10Jforrester: Zuul: [wikimedia/fundraising/dash] Replace Node 20 testing with Node 24 [integration/config] - 10https://gerrit.wikimedia.org/r/1288965 [19:49:21] (03PS2) 10Jforrester: Zuul: Drop last Node 20 template, now unused [integration/config] - 10https://gerrit.wikimedia.org/r/1288966 [19:49:25] (03PS2) 10Jforrester: jjb: Drop node20 jobs, unused [integration/config] - 10https://gerrit.wikimedia.org/r/1288967 [19:49:29] (03PS2) 10Jforrester: Docker: Drop Node 20 and Node 22 images, no longer used [integration/config] - 10https://gerrit.wikimedia.org/r/1288968 [19:49:40] (03CR) 10Jforrester: [C:03+2] "Deployed." [integration/config] - 10https://gerrit.wikimedia.org/r/1288959 (owner: 10Jforrester) [19:49:49] (03CR) 10Jforrester: [C:03+2] Zuul: Migrate various production/CI things to Node 24 [integration/config] - 10https://gerrit.wikimedia.org/r/1288960 (owner: 10Jforrester) [19:49:55] (03CR) 10Jforrester: [C:03+2] Docker: [ajv] Migrate to Node 24 [integration/config] - 10https://gerrit.wikimedia.org/r/1288961 (owner: 10Jforrester) [19:49:59] (03CR) 10Jforrester: [C:03+2] Docker: [sonar-scanner] Migrate to Node 24 [integration/config] - 10https://gerrit.wikimedia.org/r/1288962 (owner: 10Jforrester) [19:50:51] 10GitLab (CI & Job Runners), 06Release-Engineering-Team (Priority Backlog 📥): Jobs on Digital Ocean Cloud Runners are being OOM killed - https://phabricator.wikimedia.org/T387886#11933316 (10Don-vip) @dancy [[ https://gitlab.wikimedia.org/toolforge-repos/spacemedia/-/pipelines/188190 | it worked ]]! Thanks a lot! [19:51:29] (03CR) 10CI reject: [V:04-1] Zuul: Migrate various labs things to Node 24 [integration/config] - 10https://gerrit.wikimedia.org/r/1288963 (owner: 10Jforrester) [19:52:53] (03CR) 10CI reject: [V:04-1] Docker: Drop Node 20 and Node 22 images, no longer used [integration/config] - 10https://gerrit.wikimedia.org/r/1288968 (owner: 10Jforrester) [19:54:11] (03CR) 10CI reject: [V:04-1] jjb: Migrate various jobs from Node 20 to Node 24 [integration/config] - 10https://gerrit.wikimedia.org/r/1288959 (owner: 10Jforrester) [19:54:12] (03CR) 10CI reject: [V:04-1] Zuul: Migrate various production/CI things to Node 24 [integration/config] - 10https://gerrit.wikimedia.org/r/1288960 (owner: 10Jforrester) [19:54:13] (03CR) 10CI reject: [V:04-1] Docker: [ajv] Migrate to Node 24 [integration/config] - 10https://gerrit.wikimedia.org/r/1288961 (owner: 10Jforrester) [19:54:14] (03CR) 10CI reject: [V:04-1] Docker: [sonar-scanner] Migrate to Node 24 [integration/config] - 10https://gerrit.wikimedia.org/r/1288962 (owner: 10Jforrester) [19:54:27] (03CR) 10Jforrester: [C:03+2] "…" [integration/config] - 10https://gerrit.wikimedia.org/r/1288959 (owner: 10Jforrester) [19:57:36] (03Merged) 10jenkins-bot: jjb: Migrate various jobs from Node 20 to Node 24 [integration/config] - 10https://gerrit.wikimedia.org/r/1288959 (owner: 10Jforrester) [19:57:38] (03Merged) 10jenkins-bot: Zuul: Migrate various production/CI things to Node 24 [integration/config] - 10https://gerrit.wikimedia.org/r/1288960 (owner: 10Jforrester) [19:58:00] !log Zuul: Migrate various production/CI things to Node 24 [19:58:01] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [20:02:21] (03Merged) 10jenkins-bot: Docker: [ajv] Migrate to Node 24 [integration/config] - 10https://gerrit.wikimedia.org/r/1288961 (owner: 10Jforrester) [20:02:22] (03Merged) 10jenkins-bot: Docker: [sonar-scanner] Migrate to Node 24 [integration/config] - 10https://gerrit.wikimedia.org/r/1288962 (owner: 10Jforrester) [20:02:44] !log Docker: [ajv, sonar-scanner] Migrate to Node 24 [20:02:45] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [20:03:09] (03CR) 10Jforrester: [C:03+2] Zuul: [wikimedia/fundraising/dash] Fold template into only user [integration/config] - 10https://gerrit.wikimedia.org/r/1288964 (owner: 10Jforrester) [20:03:12] (03CR) 10Jforrester: [C:03+2] Zuul: Migrate various labs things to Node 24 [integration/config] - 10https://gerrit.wikimedia.org/r/1288963 (owner: 10Jforrester) [20:06:40] (03open) 10dhardy: PersonalDashboard: Add example pages [repos/releng/dev-images] - 10https://gitlab.wikimedia.org/repos/releng/dev-images/-/merge_requests/106 (https://phabricator.wikimedia.org/T424663) [20:07:09] (03update) 10neriah: phui-timeline-view-wikimedia: remove blur on hidden entry reveal [repos/phabricator/phabricator] (wmf/stable) - 10https://gitlab.wikimedia.org/repos/phabricator/phabricator/-/merge_requests/116 (https://phabricator.wikimedia.org/T425283) [20:07:53] (03CR) 10Jforrester: [C:03+2] Zuul: [wikimedia/fundraising/dash] Replace Node 20 testing with Node 24 [integration/config] - 10https://gerrit.wikimedia.org/r/1288965 (owner: 10Jforrester) [20:07:56] (03CR) 10Jforrester: [C:03+2] Zuul: Drop last Node 20 template, now unused [integration/config] - 10https://gerrit.wikimedia.org/r/1288966 (owner: 10Jforrester) [20:13:20] I am using spiderpig to deploy to 1.47.0-wmf2 but it says there are unexpected commits pulled from origin. Looks like a submodule update, from https://gerrit.wikimedia.org/r/c/mediawiki/extensions/ReaderExperiments/+/1288871 [20:13:34] Is there a process to follow? Or just cancel deployment and send a message? [20:14:01] ebernhardson: Yeah, looks like Matthias self-merged and self-reverted-ish in https://gerrit.wikimedia.org/r/c/mediawiki/extensions/ReaderExperiments/+/1288877 but didn't deploy that? [20:14:15] ebernhardson: Let's talk in -operations. [20:14:20] kk [20:14:53] (03Merged) 10jenkins-bot: Zuul: Migrate various labs things to Node 24 [integration/config] - 10https://gerrit.wikimedia.org/r/1288963 (owner: 10Jforrester) [20:14:54] (03Merged) 10jenkins-bot: Zuul: [wikimedia/fundraising/dash] Fold template into only user [integration/config] - 10https://gerrit.wikimedia.org/r/1288964 (owner: 10Jforrester) [20:15:38] (03Merged) 10jenkins-bot: Zuul: [wikimedia/fundraising/dash] Replace Node 20 testing with Node 24 [integration/config] - 10https://gerrit.wikimedia.org/r/1288965 (owner: 10Jforrester) [20:15:55] (03CR) 10CI reject: [V:04-1] Zuul: Drop last Node 20 template, now unused [integration/config] - 10https://gerrit.wikimedia.org/r/1288966 (owner: 10Jforrester) [20:18:05] !log Zuul: Migrate various labs things to Node 24 [20:18:06] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [20:18:13] !log Zuul: [wikimedia/fundraising/dash] Replace Node 20 testing with Node 24 [20:18:15] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [20:18:22] (03CR) 10Jforrester: [C:03+2] "…" [integration/config] - 10https://gerrit.wikimedia.org/r/1288966 (owner: 10Jforrester) [20:21:02] (03PS3) 10Jforrester: jjb: Drop node20 jobs, unused [integration/config] - 10https://gerrit.wikimedia.org/r/1288967 [20:21:02] (03PS3) 10Jforrester: Docker: Drop Node 20 and Node 22 images, no longer used [integration/config] - 10https://gerrit.wikimedia.org/r/1288968 [20:21:02] (03PS1) 10Jforrester: jjb: Bump codehalth jobs to newer sonar-scanner on Node 24 [integration/config] - 10https://gerrit.wikimedia.org/r/1288979 [20:21:15] (03CR) 10Jforrester: [C:03+2] "Deployed." [integration/config] - 10https://gerrit.wikimedia.org/r/1288979 (owner: 10Jforrester) [20:23:24] (03CR) 10CI reject: [V:04-1] Zuul: Drop last Node 20 template, now unused [integration/config] - 10https://gerrit.wikimedia.org/r/1288966 (owner: 10Jforrester) [20:23:26] (03CR) 10CI reject: [V:04-1] jjb: Bump codehalth jobs to newer sonar-scanner on Node 24 [integration/config] - 10https://gerrit.wikimedia.org/r/1288979 (owner: 10Jforrester) [20:24:28] (03CR) 10Jforrester: [C:03+2] "…" [integration/config] - 10https://gerrit.wikimedia.org/r/1288966 (owner: 10Jforrester) [20:30:53] (03Merged) 10jenkins-bot: Zuul: Drop last Node 20 template, now unused [integration/config] - 10https://gerrit.wikimedia.org/r/1288966 (owner: 10Jforrester) [20:30:55] (03Merged) 10jenkins-bot: jjb: Bump codehalth jobs to newer sonar-scanner on Node 24 [integration/config] - 10https://gerrit.wikimedia.org/r/1288979 (owner: 10Jforrester) [20:32:35] (03CR) 10Jforrester: [C:03+2] jjb: Drop node20 jobs, unused [integration/config] - 10https://gerrit.wikimedia.org/r/1288967 (owner: 10Jforrester) [20:32:41] (03CR) 10Jforrester: [C:03+2] Docker: Drop Node 20 and Node 22 images, no longer used [integration/config] - 10https://gerrit.wikimedia.org/r/1288968 (owner: 10Jforrester) [20:32:58] (03CR) 10Jforrester: [C:03+2] jjb: [catalyst-daily-CampaignEvents] Add CampaignEvents job [integration/config] - 10https://gerrit.wikimedia.org/r/1287941 (https://phabricator.wikimedia.org/T426677) (owner: 10Vaughn Walters) [20:36:49] (03Merged) 10jenkins-bot: jjb: Drop node20 jobs, unused [integration/config] - 10https://gerrit.wikimedia.org/r/1288967 (owner: 10Jforrester) [20:37:08] (03Merged) 10jenkins-bot: Docker: Drop Node 20 and Node 22 images, no longer used [integration/config] - 10https://gerrit.wikimedia.org/r/1288968 (owner: 10Jforrester) [20:37:15] (03Merged) 10jenkins-bot: jjb: [catalyst-daily-CampaignEvents] Add CampaignEvents job [integration/config] - 10https://gerrit.wikimedia.org/r/1287941 (https://phabricator.wikimedia.org/T426677) (owner: 10Vaughn Walters) [20:40:08] (03open) 10dancy: Chart 1.12.2: Use empty string for REGISTRY_STORAGE_CACHE_BLOBDESCRIPTOR [repos/releng/docker-hub-mirror] - 10https://gitlab.wikimedia.org/repos/releng/docker-hub-mirror/-/merge_requests/45 (https://phabricator.wikimedia.org/T354879) [20:40:10] (03update) 10dancy: Chart 1.12.2: Use empty string for REGISTRY_STORAGE_CACHE_BLOBDESCRIPTOR [repos/releng/docker-hub-mirror] - 10https://gitlab.wikimedia.org/repos/releng/docker-hub-mirror/-/merge_requests/45 (https://phabricator.wikimedia.org/T354879) [20:40:42] (03merge) 10dancy: Chart 1.12.2: Use empty string for REGISTRY_STORAGE_CACHE_BLOBDESCRIPTOR [repos/releng/docker-hub-mirror] - 10https://gitlab.wikimedia.org/repos/releng/docker-hub-mirror/-/merge_requests/45 (https://phabricator.wikimedia.org/T354879) [20:46:41] 10Continuous-Integration-Infrastructure, 07Jenkins, 10Castor, 07Upstream: castor-save-workspace-cache aborted during postbuild - https://phabricator.wikimedia.org/T352319#11933465 (10Michael) >>! In T352319#11930993, @Novem_Linguae wrote: > Still happening. Example from today: > > * https://gerrit.wikimed... [20:47:12] (03open) 10dancy: docker-hub-mirror/main.tf: Use chart version 1.12.2 [auto-deploy] [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/606 [20:47:13] (03update) 10dancy: docker-hub-mirror/main.tf: Use chart version 1.12.2 [auto-deploy] [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/606 [20:47:54] (03merge) 10dancy: docker-hub-mirror/main.tf: Use chart version 1.12.2 [auto-deploy] [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/606 [20:53:23] (03PS3) 10Jforrester: Zuul: [analytics/wmde/scripts] Test in PHP 8.3+, dropping 8.2 [integration/config] - 10https://gerrit.wikimedia.org/r/1281300 [20:53:26] (03CR) 10Jforrester: [C:03+2] Zuul: [analytics/wmde/scripts] Test in PHP 8.3+, dropping 8.2 [integration/config] - 10https://gerrit.wikimedia.org/r/1281300 (owner: 10Jforrester) [20:53:31] (03PS3) 10Jforrester: Zuul: [integration/docroot] Test in PHP 8.3+, dropping 8.2 [integration/config] - 10https://gerrit.wikimedia.org/r/1281301 [20:53:54] (03CR) 10Jforrester: "Might as well; repo is deployed to a production on PHP 7.4 (!!!) that we're not testing anyway." [integration/config] - 10https://gerrit.wikimedia.org/r/1281301 (owner: 10Jforrester) [20:53:58] (03CR) 10Jforrester: [C:03+2] Zuul: [integration/docroot] Test in PHP 8.3+, dropping 8.2 [integration/config] - 10https://gerrit.wikimedia.org/r/1281301 (owner: 10Jforrester) [20:55:57] (03Merged) 10jenkins-bot: Zuul: [analytics/wmde/scripts] Test in PHP 8.3+, dropping 8.2 [integration/config] - 10https://gerrit.wikimedia.org/r/1281300 (owner: 10Jforrester) [20:56:15] !log Zuul: [analytics/wmde/scripts] Test in PHP 8.3+, dropping 8. [20:56:16] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [20:56:41] (03Merged) 10jenkins-bot: Zuul: [integration/docroot] Test in PHP 8.3+, dropping 8.2 [integration/config] - 10https://gerrit.wikimedia.org/r/1281301 (owner: 10Jforrester) [20:57:03] !log Zuul: [integration/docroot] Test in PHP 8.3+, dropping 8.2 [20:57:06] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [21:00:10] 06Release-Engineering-Team: gitlab: Trusted runners for mediawiki/services/smokepy/ - https://phabricator.wikimedia.org/T426665#11933473 (10A_smart_kitten) IIUC from [[https://gitlab.wikimedia.org/repos/mediawiki/services/smokepy/-/commit/1b53e9c947836c3b88f01cb707fbd14dff8ff014|this commit message]], the code i... [21:04:09] (03PS1) 10Jforrester: Zuul: [operations/software/gerrit] Add Node26 as experimental [integration/config] - 10https://gerrit.wikimedia.org/r/1288985 [21:04:17] (03CR) 10Jforrester: [C:03+2] Zuul: [operations/software/gerrit] Add Node26 as experimental [integration/config] - 10https://gerrit.wikimedia.org/r/1288985 (owner: 10Jforrester) [21:06:27] 06Release-Engineering-Team: gitlab: Trusted runners for mediawiki/services/smokepy/ - https://phabricator.wikimedia.org/T426665#11933482 (10daniel) >>! In T426665#11932626, @taavi wrote: > This repository seems to be missing a software license. Good catch, I'll fix that tomorrow. I wrote that code, so it's not... [21:07:46] (03CR) 10CI reject: [V:04-1] Zuul: [operations/software/gerrit] Add Node26 as experimental [integration/config] - 10https://gerrit.wikimedia.org/r/1288985 (owner: 10Jforrester) [21:08:13] (03CR) 10Jforrester: [C:03+2] "…" [integration/config] - 10https://gerrit.wikimedia.org/r/1288985 (owner: 10Jforrester) [21:10:56] !log gerrit-replica.wikimedia.org, gerrit-spare.wikimedia.org - rebooting backends [21:10:56] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [21:12:31] (03Merged) 10jenkins-bot: Zuul: [operations/software/gerrit] Add Node26 as experimental [integration/config] - 10https://gerrit.wikimedia.org/r/1288985 (owner: 10Jforrester) [21:12:43] !log Zuul: [operations/software/gerrit] Add Node26 as experimental [21:12:43] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [21:32:16] (03open) 10dancy: Drop cluster.ingress_cluster_ip [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/607 [21:32:20] (03update) 10dancy: Drop cluster.ingress_cluster_ip [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/607 [21:32:28] (03update) 10dancy: Drop cluster.ingress_cluster_ip [auto-deploy] [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/607 [21:32:33] (03update) 10dancy: Drop cluster.ingress_cluster_ip [auto-deploy] [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/607 [21:33:51] (03merge) 10dancy: Drop cluster.ingress_cluster_ip [auto-deploy] [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/607 [21:51:51] (03approved) 10thcipriani: backport: Warn when a l10n-touching change is backported [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/1187 (https://phabricator.wikimedia.org/T397089) (owner: 10dancy) [22:44:37] 10Continuous-Integration-Infrastructure, 06Release-Engineering-Team, 10QS-Test-Automation, 13Patch-For-Review, 06Quality-and-Test-Engineering-Team (Quality Engineering): Better prevent changes in MW core from breaking WMF production extensions - https://phabricator.wikimedia.org/T404403#11933809 (10SLong-...