[00:10:37] 10Beta-Cluster-Infrastructure, 06Traffic: Puppet agent failure detected on instance deployment-cache-upload08 in project deployment-prep - https://phabricator.wikimedia.org/T427819#11983571 (10bd808) →14Duplicate dup:03T428052 [00:10:38] 10Beta-Cluster-Infrastructure, 06SRE, 06Traffic: Beta cluster haproxy does not support `warn-blocked-traffic-after` keyword - https://phabricator.wikimedia.org/T428052#11983573 (10bd808) [00:10:43] 10Beta-Cluster-Infrastructure, 06Traffic: Puppet agent failure detected on instance deployment-cache-text08 in project deployment-prep - https://phabricator.wikimedia.org/T427813#11983576 (10bd808) →14Duplicate dup:03T428052 [00:10:46] 10Beta-Cluster-Infrastructure, 06SRE, 06Traffic: Beta cluster haproxy does not support `warn-blocked-traffic-after` keyword - https://phabricator.wikimedia.org/T428052#11983578 (10bd808) [03:21:32] (03update) 10kineticpelagic: Clarify license for OAD example [repos/ci-tools/wikimedia-spectral-ruleset] - 10https://gitlab.wikimedia.org/repos/ci-tools/wikimedia-spectral-ruleset/-/merge_requests/10 (owner: 10kbach) [03:21:42] (03update) 10kineticpelagic: Clarify license for OAD example [repos/ci-tools/wikimedia-spectral-ruleset] - 10https://gitlab.wikimedia.org/repos/ci-tools/wikimedia-spectral-ruleset/-/merge_requests/10 (owner: 10kbach) [03:21:42] (03approved) 10kineticpelagic: Clarify license for OAD example [repos/ci-tools/wikimedia-spectral-ruleset] - 10https://gitlab.wikimedia.org/repos/ci-tools/wikimedia-spectral-ruleset/-/merge_requests/10 (owner: 10kbach) [03:22:11] (03update) 10kineticpelagic: Clarify license for OAD example [repos/ci-tools/wikimedia-spectral-ruleset] - 10https://gitlab.wikimedia.org/repos/ci-tools/wikimedia-spectral-ruleset/-/merge_requests/10 (owner: 10kbach) [03:22:33] (03merge) 10kineticpelagic: Clarify license for OAD example [repos/ci-tools/wikimedia-spectral-ruleset] - 10https://gitlab.wikimedia.org/repos/ci-tools/wikimedia-spectral-ruleset/-/merge_requests/10 (owner: 10kbach) [04:07:37] RECOVERY - jenkins_service_running on contint1003 is OK: PROCS OK: 1 process with regex args .*/bin/java .*-jar /usr/share/java/jenkins.war https://wikitech.wikimedia.org/wiki/Jenkins [04:10:37] PROBLEM - jenkins_service_running on contint1003 is CRITICAL: PROCS CRITICAL: 0 processes with regex args .*/bin/java .*-jar /usr/share/java/jenkins.war https://wikitech.wikimedia.org/wiki/Jenkins [06:12:48] (03CR) 10Hashar: "*posting a draft comment that was pending and I did not sent at the time.*" [integration/config] - 10https://gerrit.wikimedia.org/r/1294992 (https://phabricator.wikimedia.org/T427471) (owner: 10Phedenskog) [07:30:30] (03update) 10kineticpelagic: feat(linter): Improve linting by validating examples in nested schemas (T424002) [repos/ci-tools/wikimedia-spectral-ruleset] - 10https://gitlab.wikimedia.org/repos/ci-tools/wikimedia-spectral-ruleset/-/merge_requests/11 [07:32:38] Project mediawiki-core-doxygen build #20993: 04FAILURE in 14 min: https://integration.wikimedia.org/ci/job/mediawiki-core-doxygen/20993/ [07:44:53] 10GitLab (Project Migration), 06Release-Engineering-Team (Priority Backlog 📥), 06collaboration-services, 10Fundraising analytics stack, and 2 others: Move wikimedia/fundraising/analytics from Gerrit to Gitlab - https://phabricator.wikimedia.org/T391404#11984102 (10ABran-WMF) @AStein-WMF @CHudson-WMF @Pcoom... [07:46:11] (03update) 10kineticpelagic: feat(linter): Improve linting by validating examples in nested schemas (T424002) [repos/ci-tools/wikimedia-spectral-ruleset] - 10https://gitlab.wikimedia.org/repos/ci-tools/wikimedia-spectral-ruleset/-/merge_requests/11 [07:47:09] Yippee, build fixed! [07:47:09] Project mediawiki-core-doxygen build #20994: 09FIXED in 14 min: https://integration.wikimedia.org/ci/job/mediawiki-core-doxygen/20994/ [08:08:29] 10GitLab (CI & Job Runners), 06Release-Engineering-Team, 06collaboration-services, 13Patch-For-Review: Remove buildkit helper image docker/dockerfile-copy from build pipeline - https://phabricator.wikimedia.org/T321316#11984138 (10Jelto) [08:08:59] 10GitLab (CI & Job Runners), 06Release-Engineering-Team, 06collaboration-services, 13Patch-For-Review: Remove buildkit helper image docker/dockerfile-copy from build pipeline - https://phabricator.wikimedia.org/T321316#11984140 (10Jelto) [08:28:22] (03update) 10kineticpelagic: feat(linter): Improve linting by validating examples in nested schemas (T424002) [repos/ci-tools/wikimedia-spectral-ruleset] - 10https://gitlab.wikimedia.org/repos/ci-tools/wikimedia-spectral-ruleset/-/merge_requests/11 [08:29:28] (03CR) 10Hashar: [C:03+2] "My only concern was whether that image would be used for a production deployment. Javier confirmed the team went to use the SRE provided i" [integration/config] - 10https://gerrit.wikimedia.org/r/1293758 (https://phabricator.wikimedia.org/T412978) (owner: 10JavierMonton) [08:30:24] (03update) 10kineticpelagic: feat(linter): Improve linting by validating examples in nested schemas (T424002) [repos/ci-tools/wikimedia-spectral-ruleset] - 10https://gitlab.wikimedia.org/repos/ci-tools/wikimedia-spectral-ruleset/-/merge_requests/11 [08:31:11] (03Merged) 10jenkins-bot: images: maven-21 [integration/config] - 10https://gerrit.wikimedia.org/r/1293758 (https://phabricator.wikimedia.org/T412978) (owner: 10JavierMonton) [08:35:41] !log Built Docker images `docker-registry.wikimedia.org/releng/java21:0.1` and `docker-registry.wikimedia.org/releng/maven-java21:0.1` # T412978 [08:35:43] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [08:35:44] T412978: Support for Java 21 and Flink 2 - https://phabricator.wikimedia.org/T412978 [09:45:20] (03CR) 10Hashar: [C:03+2] "This does not change any dependency because CheckUser dependencies are still processed recursively. It thus receives TestKichen as a trans" [integration/config] - 10https://gerrit.wikimedia.org/r/1295469 (https://phabricator.wikimedia.org/T414572) (owner: 10Kareid) [09:47:03] (03Merged) 10jenkins-bot: zuul: [mediawiki/extensions/CheckUser] Add TestKitchen dependency [integration/config] - 10https://gerrit.wikimedia.org/r/1295469 (https://phabricator.wikimedia.org/T414572) (owner: 10Kareid) [09:53:12] (03CR) 10Hashar: [C:03+2] Use standalone jobs for Wikibase Selenium tests (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/676107 (https://phabricator.wikimedia.org/T287582) (owner: 10Hashar) [09:53:27] (03CR) 10Hashar: [C:03+2] Zuul: drop browser tests from GrowthExperiments wmf branches [integration/config] - 10https://gerrit.wikimedia.org/r/1296667 (https://phabricator.wikimedia.org/T417412) (owner: 10Hashar) [09:54:10] (03update) 10kineticpelagic: feat(T424210): add enum-description checks for requestBody and response [repos/ci-tools/wikimedia-spectral-ruleset] - 10https://gitlab.wikimedia.org/repos/ci-tools/wikimedia-spectral-ruleset/-/merge_requests/8 (owner: 10aghirelli) [09:55:13] (03Merged) 10jenkins-bot: Zuul: drop browser tests from GrowthExperiments wmf branches [integration/config] - 10https://gerrit.wikimedia.org/r/1296667 (https://phabricator.wikimedia.org/T417412) (owner: 10Hashar) [10:56:47] (03open) 10phedenskog: Add dashboard with CI time spent by repo/jobs [repos/releng/develstats] - 10https://gitlab.wikimedia.org/repos/releng/develstats/-/merge_requests/6 [11:08:57] (03update) 10phedenskog: Add dashboard with CI time spent by repo/jobs [repos/releng/develstats] - 10https://gitlab.wikimedia.org/repos/releng/develstats/-/merge_requests/6 [12:14:56] (03update) 10phedenskog: Add dashboard with CI time spent by repo/jobs [repos/releng/develstats] - 10https://gitlab.wikimedia.org/repos/releng/develstats/-/merge_requests/6 [12:20:31] 10Phabricator: EXCEPTION: (AphrontSchemaQueryException) #1054: Unknown column 'projectGroupName.indexedObjectName' in 'HAVING' - https://phabricator.wikimedia.org/T428155 (10Aklapper) 03NEW [12:30:59] !log ssh integration-castor06.integration.eqiad1.wikimedia.cloud sudo -u jenkins-deploy rm -rf /srv/castor/castor-mw-ext-and-skins/master/mwext-node24-rundoc # fix failure seen in mwext-node24-rundoc 4812 [12:31:01] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [12:37:53] (03update) 10phedenskog: Add dashboard with CI time spent by repo/jobs [repos/releng/develstats] - 10https://gitlab.wikimedia.org/repos/releng/develstats/-/merge_requests/6 [13:23:29] 10Phabricator, 06Release-Engineering-Team (Priority Backlog 📥): Remove acl*Batch-Editors members who have not executed bulk jobs in the last 4 years - https://phabricator.wikimedia.org/T428167 (10Aklapper) 03NEW [13:29:27] 10Phabricator, 06Release-Engineering-Team (Doing 😎): Remove acl*Batch-Editors members who have not executed bulk jobs in the last 4 years - https://phabricator.wikimedia.org/T428167#11985289 (10Aklapper) 05Open→03Resolved a:03Aklapper Done; we can always easily add people back. [14:02:10] 10GitLab (Project Migration), 06Release-Engineering-Team (Priority Backlog 📥), 06collaboration-services, 10Fundraising analytics stack, and 2 others: Move wikimedia/fundraising/analytics from Gerrit to Gitlab - https://phabricator.wikimedia.org/T391404#11985513 (10AStein-WMF) Hey @ABran-WMF, we've just com... [14:02:47] 10GitLab (Project Migration), 06Release-Engineering-Team (Priority Backlog 📥), 06collaboration-services, 10Fundraising analytics stack, and 2 others: Move wikimedia/fundraising/analytics from Gerrit to Gitlab - https://phabricator.wikimedia.org/T391404#11985515 (10ABran-WMF) >>! In T391404#11985513, @AStei... [14:22:49] (03CR) 10Hashar: "Thank you Lucas!" [integration/config] - 10https://gerrit.wikimedia.org/r/1295049 (https://phabricator.wikimedia.org/T426089) (owner: 10Kosta Harlan) [14:46:39] (03update) 10phedenskog: Add dashboard with CI time spent by repo/jobs [repos/releng/develstats] - 10https://gitlab.wikimedia.org/repos/releng/develstats/-/merge_requests/6 [14:57:13] (03update) 10phedenskog: Add dashboard with CI time spent by repo/jobs [repos/releng/develstats] - 10https://gitlab.wikimedia.org/repos/releng/develstats/-/merge_requests/6 [15:05:13] 10Beta-Cluster-Infrastructure, 10hCaptcha, 06Product Safety and Integrity: Beta deployments are not working because $doesEditApiInterfaceSupportHCaptcha is undefined - https://phabricator.wikimedia.org/T428183 (10Urbanecm_WMF) 03NEW [15:07:43] 10Beta-Cluster-Infrastructure, 10hCaptcha, 06Product Safety and Integrity: Beta deployments are not working because $doesEditApiInterfaceSupportHCaptcha is undefined - https://phabricator.wikimedia.org/T428183#11985928 (10Urbanecm_WMF) p:05Triage→03Unbreak! Breaks beta deployment. [15:12:26] 10Continuous-Integration-Infrastructure, 10Castor, 06Test Platform: Investigate multiple npm cache folders for mwext-codehealth-master-non-voting - https://phabricator.wikimedia.org/T427822#11985948 (10Peter) [15:12:28] 10Beta-Cluster-Infrastructure, 10Continuous-Integration-Config, 10Continuous-Integration-Infrastructure, 07Jenkins, and 3 others: Move beta cluster automatic deployment to a dedicated infrastructure - https://phabricator.wikimedia.org/T256168#11985947 (10dancy) >>! In T256168#11960221, @bd808 wrote: >>>! I... [15:17:39] 10Continuous-Integration-Infrastructure, 07Jenkins, 10Castor, 06Test Platform, 07Spike: POC: Try to make Castor save async (to remove queue time from job times) - https://phabricator.wikimedia.org/T425411#11985981 (10Peter) [15:19:26] 10Continuous-Integration-Infrastructure, 10Castor, 06Test Platform (Tallinn 27): Speedup mwext-codehealth-master-non-voting Castor job - https://phabricator.wikimedia.org/T427471#11985986 (10Peter) [15:41:57] 10Beta-Cluster-Infrastructure, 10hCaptcha, 06Product Safety and Integrity (Sprint Iris (May 25 - Jun 12)): Beta deployments are not working because $doesEditApiInterfaceSupportHCaptcha is undefined - https://phabricator.wikimedia.org/T428183#11986023 (10Dreamy_Jazz) [15:42:02] 10Beta-Cluster-Infrastructure, 10hCaptcha, 06Product Safety and Integrity (Sprint Iris (May 25 - Jun 12)): Beta deployments are not working because $doesEditApiInterfaceSupportHCaptcha is undefined - https://phabricator.wikimedia.org/T428183#11986024 (10Dreamy_Jazz) a:03Dreamy_Jazz [16:43:55] 10Beta-Cluster-Infrastructure, 10hCaptcha, 06Product Safety and Integrity (Sprint Iris (May 25 - Jun 12)): Beta deployments are not working because $doesEditApiInterfaceSupportHCaptcha is undefined - https://phabricator.wikimedia.org/T428183#11986242 (10Dreamy_Jazz) 05Open→03Resolved Appears fixed ba... [16:59:53] 10GitLab (Project Migration), 06Release-Engineering-Team (Priority Backlog 📥), 06collaboration-services, 10Fundraising analytics stack, and 2 others: Move wikimedia/fundraising/analytics from Gerrit to Gitlab - https://phabricator.wikimedia.org/T391404#11986290 (10AStein-WMF) 05In progress→03Resolved [17:21:58] 10Beta-Cluster-Infrastructure, 10hCaptcha, 06Product Safety and Integrity (Sprint Iris (May 25 - Jun 12)): Beta deployments are not working because $doesEditApiInterfaceSupportHCaptcha is undefined - https://phabricator.wikimedia.org/T428183#11986352 (10Dreamy_Jazz) https://en.wikipedia.beta.wmcloud.org/... [18:01:24] (03approved) 10ebernhardson: dps: bump image and allow setting custom options [repos/releng/cli] - 10https://gitlab.wikimedia.org/repos/releng/cli/-/merge_requests/651 (owner: 10dcausse) [19:08:44] (03PS1) 10Ottomata: phan: Add Wikibase as EventBus phan dependency [integration/config] - 10https://gerrit.wikimedia.org/r/1297767 (https://phabricator.wikimedia.org/T428176) [19:08:47] 06Release-Engineering-Team (Doing 😎), 06WMF-NDA-Requests: Add MSantos to WMF-NDA group in Phabricator - https://phabricator.wikimedia.org/T424025#11986711 (10MSantos) Thank you so much! [19:10:20] (03CR) 10CI reject: [V:04-1] phan: Add Wikibase as EventBus phan dependency [integration/config] - 10https://gerrit.wikimedia.org/r/1297767 (https://phabricator.wikimedia.org/T428176) (owner: 10Ottomata) [19:46:16] (03PS2) 10Ottomata: phan: Add Wikibase as EventBus phan dependency [integration/config] - 10https://gerrit.wikimedia.org/r/1297767 (https://phabricator.wikimedia.org/T428176) [20:15:40] RECOVERY - jenkins_service_running on contint1003 is OK: PROCS OK: 1 process with regex args .*/bin/java .*-jar /usr/share/java/jenkins.war https://wikitech.wikimedia.org/wiki/Jenkins [20:18:40] PROBLEM - jenkins_service_running on contint1003 is CRITICAL: PROCS CRITICAL: 0 processes with regex args .*/bin/java .*-jar /usr/share/java/jenkins.war https://wikitech.wikimedia.org/wiki/Jenkins [21:23:57] Hi team! I am trying to create my gitlab account, but am running into the message "Your account is pending approval from your GitLab administrator and hence blocked." I was wondering if I could please get some helping out who to reach out to? Thanks! [22:15:12] danielfm: I don't recognize your nick to quickly sort you into technical community or WMF staff, but https://www.mediawiki.org/wiki/GitLab/Workflows/Registering_an_account_on_GitLab has the process for both. [23:36:24] (03open) 10jhuneidi: catalyst-code-server: create User directories [repos/releng/dev-images] - 10https://gitlab.wikimedia.org/repos/releng/dev-images/-/merge_requests/108 (https://phabricator.wikimedia.org/T424691) [23:36:57] (03update) 10jhuneidi: catalyst-code-server: create User directories [repos/releng/dev-images] - 10https://gitlab.wikimedia.org/repos/releng/dev-images/-/merge_requests/108 (https://phabricator.wikimedia.org/T424691) [23:37:10] (03merge) 10jhuneidi: catalyst-code-server: create User directories [repos/releng/dev-images] - 10https://gitlab.wikimedia.org/repos/releng/dev-images/-/merge_requests/108 (https://phabricator.wikimedia.org/T424691) [23:39:28] !log Updating development images on contint primary for T424691 [23:39:31] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [23:39:31] T424691: Code server should not have access to extension store - https://phabricator.wikimedia.org/T424691