[05:44:03] 10GitLab (Project Migration), 10Release-Engineering-Team (Escape Goats🐐), 10collaboration-services: Sync ldap/ops users to group on GitLab and define permissions for repos/sre - https://phabricator.wikimedia.org/T343035 (10Joe) I would ask why the "Developer" role was chosen instead of the "Owner" one. Speci... [06:06:51] 10Continuous-Integration-Config, 10Release-Engineering-Team (Radar), 10MediaWiki-Vendor, 10Parsoid (Tracking), 10ci-test-error (WMF-deployed Build Failure): `mediawiki-core-php72-phan-docker` job runs `composer install` instead of using packages from mediawiki/v... - https://phabricator.wikimedia.org/T287419 [09:23:34] 10Release-Engineering-Team (Seen), 10MW-on-K8s, 10SRE, 10Traffic, and 2 others: Serve production traffic via Kubernetes - https://phabricator.wikimedia.org/T290536 (10JMeybohm) [09:35:52] 10GitLab (Pipeline Services Migration🐤), 10collaboration-services: Move micro sites from Ganeti to Kubernetes and from Gerrit to GitLab - https://phabricator.wikimedia.org/T300171 (10Jelto) [11:11:36] hi all wondering if someone could help. We published a new version of the operations-puppet CI image on friday. version 0.8.12 which you can see is available here https://docker-registry.wikimedia.org/releng/operations-puppet/tags/. however the CI job is failing to pull this image in [11:12:53] you can see on the line "12:56:16 + exec docker run" that it is using operations-puppet:0.8.11-s1 not the 0.8.12 version. [11:13:36] i suspect i have missed some step but im not surte which so if someone could proviode a pointer that would be super helpfull has.har normally dose this process for me and have only done it i think once before [11:50:56] PROBLEM - Gerrit Health Check on gerrit.wikimedia.org is CRITICAL: CRITICAL - Socket timeout after 10 seconds https://gerrit.wikimedia.org/r/config/server/healthcheck%7Estatus [11:51:19] PROBLEM - Gerrit Health Check SSL Expiry on gerrit.wikimedia.org is CRITICAL: CRITICAL - Socket timeout after 10 seconds https://gerrit.wikimedia.org/r/config/server/healthcheck%7Estatus [11:51:36] PROBLEM - Gerrit JSON on gerrit.wikimedia.org is CRITICAL: CRITICAL - Socket timeout after 10 seconds https://gerrit.wikimedia.org/r/config/server/healthcheck%7Estatus [11:53:32] 10GitLab (CI & Job Runners), 10Release-Engineering-Team (Escape Goats🐐), 10Patch-For-Review: Replace deprecated `CI_JOB_JWT` CI variable in Kokkuri - https://phabricator.wikimedia.org/T337474 (10CodeReviewBot) jnuche opened https://gitlab.wikimedia.org/repos/releng/jwt-authorizer/-/merge_requests/13 blubber... [11:56:48] RECOVERY - Gerrit Health Check on gerrit.wikimedia.org is OK: HTTP OK: HTTP/1.1 200 OK - 973 bytes in 2.847 second response time https://gerrit.wikimedia.org/r/config/server/healthcheck%7Estatus [11:57:09] RECOVERY - Gerrit Health Check SSL Expiry on gerrit.wikimedia.org is OK: OK - Certificate gerrit.wikimedia.org will expire on Sun 08 Oct 2023 09:52:13 PM GMT +0000. https://gerrit.wikimedia.org/r/config/server/healthcheck%7Estatus [11:57:26] RECOVERY - Gerrit JSON on gerrit.wikimedia.org is OK: HTTP OK: HTTP/1.1 200 OK - 62843 bytes in 0.044 second response time https://gerrit.wikimedia.org/r/config/server/healthcheck%7Estatus [11:58:09] 10GitLab (CI & Job Runners), 10Release-Engineering-Team (Escape Goats🐐), 10Patch-For-Review: Replace deprecated `CI_JOB_JWT` CI variable in Kokkuri - https://phabricator.wikimedia.org/T337474 (10CodeReviewBot) jnuche merged https://gitlab.wikimedia.org/repos/releng/jwt-authorizer/-/merge_requests/13 blubber... [11:58:12] 10Beta-Cluster-Infrastructure: Puppet broken on mediawiki instances in deployment-prep - https://phabricator.wikimedia.org/T344147 (10ArielGlenn) p:05Triage→03Medium [11:58:48] 10Beta-Cluster-Infrastructure: Puppet broken on mediawiki instances in deployment-prep - https://phabricator.wikimedia.org/T344147 (10ArielGlenn) Note that since dumps snapshot instances are sortsa-kinda mediawiki instances, this affects them too. [12:01:51] 10Beta-Cluster-Infrastructure, 10User-ArielGlenn: Puppet broken on mediawiki instances in deployment-prep - https://phabricator.wikimedia.org/T344147 (10ArielGlenn) [13:03:38] (03CR) 10Michael Große: "This is probably not going to work if it is merged as-is because of the issues described in T285049#7311916 and the reason why the others " [integration/config] - 10https://gerrit.wikimedia.org/r/948558 (https://phabricator.wikimedia.org/T333660) (owner: 10Michael Große) [13:47:30] 10Phabricator, 10Release-Engineering-Team (Escape Goats🐐), 10Patch-For-Review: Require WMF email address when registering Phab user account with a WMF SUL account - https://phabricator.wikimedia.org/T343647 (10Aklapper) > Hmm, how would that work with my volunteer account `@Urbanecm`? I have it connected to... [13:59:33] 10GitLab, 10Release-Engineering-Team: Strange gitlab behavior - https://phabricator.wikimedia.org/T344156 (10fkaelin) [14:10:56] 10Release-Engineering-Team (Deployment Training Requests): Deployment training request for dbrant - https://phabricator.wikimedia.org/T344157 (10Dbrant) [14:26:20] 10Release-Engineering-Team (Priority Backlog 📥), 10wikimedia.biterg.io, 10Developer-Advocacy (Jul-Sep 2023): Bitergia: ssh and Hatstall access for thcipriani - https://phabricator.wikimedia.org/T335700 (10Aklapper) [14:26:22] 10Release-Engineering-Team (Priority Backlog 📥), 10wikimedia.biterg.io, 10Developer-Advocacy (Jul-Sep 2023): Adjust data update workflow in Bitergia DB to grimoirelab-sortinghat 0.8 changes - https://phabricator.wikimedia.org/T335577 (10Aklapper) [14:30:28] 10Release-Engineering-Team (Priority Backlog 📥), 10wikimedia.biterg.io: Enable domain matching in wikimedia.biterg.io configuration - https://phabricator.wikimedia.org/T327785 (10Aklapper) [14:52:57] 10GitLab, 10Release-Engineering-Team: Strange gitlab behavior - https://phabricator.wikimedia.org/T344156 (10Jelto) Your screenshot shows you are using https://gitlab-replica.wikimedia.org. Is this desired? Gitlab replica is our standby host and is deleted and restored every 24h (thus the data loss). I'd do... [15:11:05] 10GitLab, 10Release-Engineering-Team: Strange gitlab behavior - https://phabricator.wikimedia.org/T344156 (10fkaelin) I never nagivated to the replica on purpose, I noticed being redirected a lot. E.g. clicking on a link to a branch from the command line sends me to the replica showing as signed out, clicking... [15:40:42] 10Phabricator: Custom task form for Research - https://phabricator.wikimedia.org/T343923 (10Aklapper) @KHernandez-WMF I think that this should work?: https://phabricator.wikimedia.org/maniphest/task/edit/form/120/ [16:07:57] 10GitLab (Account Approval), 10Release-Engineering-Team: Requesting GitLab account activation for Isochrone - https://phabricator.wikimedia.org/T344103 (10thcipriani) [16:08:54] 10GitLab (Account Approval), 10Release-Engineering-Team: Requesting GitLab account activation for Isochrone - https://phabricator.wikimedia.org/T344103 (10thcipriani) 05Open→03Resolved a:03thcipriani @Isochrone you should be approved now. Thanks @Chlod for the comment! [18:44:01] 10Phabricator, 10Release-Engineering-Team (Priority Backlog 📥), 10User-brennen: Clean up Phabricator production error logs - https://phabricator.wikimedia.org/T337500 (10brennen) a:05brennen→03None > Are there more specific things to do here? Yeah, I think there's still some amount of noise to be tidied... [18:44:05] 10Release-Engineering-Team (Priority Backlog 📥), 10Scap, 10Data-Platform-SRE, 10Wikidata, 10Wikidata-Query-Service: wdqs: replace git-fat with git-lfs - https://phabricator.wikimedia.org/T316876 (10RKemper) Patch was merged here: https://gerrit.wikimedia.org/r/947928 [19:45:41] (03PS1) 10Umherirrender: zuul: Disable quibble-fundraising-*-REL1_39-php74-docker from test runs [integration/config] - 10https://gerrit.wikimedia.org/r/948653 (https://phabricator.wikimedia.org/T328240) [19:47:03] (03CR) 10CI reject: [V: 04-1] zuul: Disable quibble-fundraising-*-REL1_39-php74-docker from test runs [integration/config] - 10https://gerrit.wikimedia.org/r/948653 (https://phabricator.wikimedia.org/T328240) (owner: 10Umherirrender) [19:56:52] (03PS2) 10Umherirrender: zuul: Disable quibble-fundraising-*-REL1_39-php74-docker from test runs [integration/config] - 10https://gerrit.wikimedia.org/r/948653 (https://phabricator.wikimedia.org/T328240) [20:36:29] 10Release-Engineering-Team (Escape Goats🐐), 10Release, 10Train Deployments: 1.41.0-wmf.22 deployment blockers - https://phabricator.wikimedia.org/T343724 (10Umherirrender) [21:09:06] preparing to do a security deploy [21:17:39] 10Phabricator, 10Release-Engineering-Team (Priority Backlog 📥), 10User-brennen: Clean up Phabricator production error logs - https://phabricator.wikimedia.org/T337500 (10Aklapper) For the records, upstreamed `Call to undefined method PhutilJSON::encodeAsObject()` as https://we.phorge.it/T15603 / https://we.p... [21:43:12] 10Phabricator, 10Dumps-Generation, 10Patch-For-Review: Compress phabricator dump - https://phabricator.wikimedia.org/T262744 (10CodeReviewBot) dancy merged https://gitlab.wikimedia.org/repos/phabricator/tools/-/merge_requests/1 Make the dump compressed [21:54:52] 10GitLab (Project Migration), 10Release-Engineering-Team (Escape Goats🐐), 10collaboration-services: Sync ldap/ops users to group on GitLab and define permissions for repos/sre - https://phabricator.wikimedia.org/T343035 (10thcipriani) >>! In T343035#9089005, @Joe wrote: > I would ask why the "Developer" role... [22:00:06] (03PS1) 10Krinkle: Enable CI for tools-wikiinfo [integration/config] - 10https://gerrit.wikimedia.org/r/948667 [22:25:54] 10Release-Engineering-Team (Escape Goats🐐), 10Release, 10Train Deployments: 1.41.0-wmf.22 deployment blockers - https://phabricator.wikimedia.org/T343724 (10Umherirrender) [22:27:38] (03CR) 10Krinkle: [C: 03+2] Enable CI for tools-wikiinfo [integration/config] - 10https://gerrit.wikimedia.org/r/948667 (owner: 10Krinkle) [22:28:43] (03Merged) 10jenkins-bot: Enable CI for tools-wikiinfo [integration/config] - 10https://gerrit.wikimedia.org/r/948667 (owner: 10Krinkle) [23:18:32] 10Phabricator, 10Release-Engineering-Team (Priority Backlog 📥), 10Patch-For-Review, 10User-brennen: Clean up Phabricator production error logs - https://phabricator.wikimedia.org/T337500 (10CodeReviewBot) aklapper opened https://gitlab.wikimedia.org/repos/phabricator/extensions/-/merge_requests/17 Securit...