[06:44:24] 10Release-Engineering-Team (Radar), 10MediaWiki-Engineering: Audit all existing code to ensure that any extension currently or previously adding blobs to ExternalStore has been registering a reference in the text table (and fix up if wrong) - https://phabricator.wikimedia.org/T106388 (10larissagaulia) [08:03:50] 10Release-Engineering-Team (Priority Backlog šŸ“„), 10Patch-For-Review, 10Release, 10Train Deployments: 1.41.0-wmf.30 deployment blockers - https://phabricator.wikimedia.org/T347081 (10hashar) [09:25:13] 10Release-Engineering-Team, 10Scap, 10Wikimedia-production-error: Maintenance script appservers running code from wmf.20 when version not live - https://phabricator.wikimedia.org/T344929 (10hashar) I have filed the same stacktrace with a background job T348614. The Autoloader fails to find `/srv/mediawiki/ph... [09:44:09] 10GitLab (Pipeline Services MigrationšŸ¤), 10Math, 10Texvcjs: Migrate texvcjs to GitLab - https://phabricator.wikimedia.org/T348384 (10Physikerwelt) p:05Triageā†’03Medium [13:13:41] 10GitLab (CI & Job Runners), 10collaboration-services, 10serviceops: Standardize Debian package builds on GitLab CI - https://phabricator.wikimedia.org/T304491 (10MatthewVernon) Documentation has now been updated in the main namespace - https://wikitech.wikimedia.org/wiki/Debian_packaging_with_dgit_and_CI an... [13:18:20] 10Continuous-Integration-Config, 10Wikidata, 10Wikidata Query Builder, 10Wikidata Query UI, and 6 others: [QB] [WDQS-GUI] Move build scripts from CI to the repository - https://phabricator.wikimedia.org/T328543 (10noarave) I think this is done on the Wikidata side. [13:27:45] (03CR) 10Jforrester: [C: 03+2] Zuul: [mediawiki/extensions/Checklists] Add basic composer CI [integration/config] - 10https://gerrit.wikimedia.org/r/965073 (owner: 10Driedmueller) [13:28:58] (03Merged) 10jenkins-bot: Zuul: [mediawiki/extensions/Checklists] Add basic composer CI [integration/config] - 10https://gerrit.wikimedia.org/r/965073 (owner: 10Driedmueller) [13:29:45] !log Zuul: [mediawiki/extensions/Checklists] Add basic composer CI [13:29:47] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [13:36:37] FYI, https://integration.wikimedia.org/ci/job/mediawiki-core-php81-phan-docker/4453/console got an error ā€œmkdir: cannot create directory ā€˜logā€™: Permission deniedā€ on integration-agent-docker-1055 ā€“ does that resolve itself or does the agent need manual fixing by someoneā„¢? [14:13:51] a recheck of that build worked now (on another agent), so as far as Iā€™m concerned itā€™s all good, but in case it does need fixing I thought it better to mention here :) [14:42:49] 10Release-Engineering-Team (Seen), 10MW-on-K8s, 10SRE, 10Traffic, 10serviceops: Serve production traffic via Kubernetes - https://phabricator.wikimedia.org/T290536 (10Clement_Goubert) [14:42:57] 10Release-Engineering-Team (Seen), 10MW-on-K8s, 10SRE, 10Traffic, and 2 others: Move 25% of mediawiki external requests to mw on k8s - https://phabricator.wikimedia.org/T348122 (10Clement_Goubert) 05Openā†’03In progress [15:53:16] 10GitLab (Pipeline Services MigrationšŸ¤), 10Metrics Platform Backlog, 10Data Products (Sprint 01), 10Patch-For-Review: Migrate metrics-platform repo to GitLab - https://phabricator.wikimedia.org/T344733 (10thcipriani) So, it sounds like it'd be fine to: * Archive the gerrit repo with a pointer to GitLab *... [15:54:10] Lucas_WMDE: that happens from time to time yes but I never managed to find the root cause :/ [15:54:50] ok [15:56:13] Lucas_WMDE: my assumption is that a previous build left over a `log` dir owned by root and the agent is thus unable to create it [15:56:59] the task is T282893 [15:57:00] T282893: Various CI jobs failing after "mkdir: cannot create directory ā€˜logā€™: Permission denied" - https://phabricator.wikimedia.org/T282893 [16:20:16] (03PS1) 10Hashar: jjb: ls WORKSPACE after it got wiped [integration/config] - 10https://gerrit.wikimedia.org/r/965199 (https://phabricator.wikimedia.org/T282893) [16:21:51] 10Release-Engineering-Team (Priority Backlog šŸ“„), 10Patch-For-Review, 10Release, 10Train Deployments: 1.41.0-wmf.30 deployment blockers - https://phabricator.wikimedia.org/T347081 (10taavi) {T348669} is a regression in this train, although it only affects group1. [16:33:40] 10Diffusion, 10Phabricator, 10Release-Engineering-Team, 10User-brennen: Understand which repositories we mirror, observe, host in Diffusion (and fix some findings) - https://phabricator.wikimedia.org/T347577 (10brennen) [16:34:09] 10Diffusion, 10Phabricator, 10Release-Engineering-Team (Priority Backlog šŸ“„), 10User-brennen: Understand which repositories we mirror, observe, host in Diffusion (and fix some findings) - https://phabricator.wikimedia.org/T347577 (10thcipriani) [16:39:07] 10Deployments, 10Release-Engineering-Team: Deployment calendar shows deployments windows on no-deploy days - https://phabricator.wikimedia.org/T348447 (10thcipriani) Bah, yes. During US holidays, non-US backport windows should still exist. Need to reflect this on Yearly calendar and deployment calendar. [16:41:02] 10Deployments, 10Release-Engineering-Team: Deployment calendar shows deployments windows on no-deploy days - https://phabricator.wikimedia.org/T348447 (10thcipriani) p:05Triageā†’03Low In the short term I'll update the documentation to reflect the Right Thingā„¢ [16:42:38] 10Continuous-Integration-Config, 10Release-Engineering-Team (Seen), 10Quibble: tox v4 recreate test environment sharing the same envdir / env_dir - https://phabricator.wikimedia.org/T348434 (10thcipriani) Plan is to document this for folks migrating from toxv3ā†’toxv4 [17:04:49] 10Release-Engineering-Team (Priority Backlog šŸ“„), 10Patch-For-Review, 10Release, 10Train Deployments: 1.41.0-wmf.30 deployment blockers - https://phabricator.wikimedia.org/T347081 (10Jdlrobson) [17:24:27] 10Release-Engineering-Team (Priority Backlog šŸ“„), 10Patch-For-Review, 10Release, 10Train Deployments: 1.41.0-wmf.30 deployment blockers - https://phabricator.wikimedia.org/T347081 (10hashar) [17:25:07] 10Release-Engineering-Team (Priority Backlog šŸ“„), 10Patch-For-Review, 10Release, 10Train Deployments: 1.41.0-wmf.30 deployment blockers - https://phabricator.wikimedia.org/T347081 (10hashar) >>! In T347081#9243632, @taavi wrote: > {T348669} is a regression in this train, although it only affects group1. Al... [17:49:23] 10GitLab (Pipeline Services MigrationšŸ¤), 10Wikimedia-Portals, 10Web-Team-Backlog (Web Team FY2023-24 Q2 Sprint 2): Migrate Wikimedia Portals to GitLab - https://phabricator.wikimedia.org/T344743 (10Jdlrobson) [18:44:25] 10GitLab (Project Migration), 10Release-Engineering-Team (Priority Backlog šŸ“„), 10User-brennen: Early adoption signup for WMF GitLab - https://phabricator.wikimedia.org/T282842 (10brennen) 05Openā†’03Resolved > @brennen is it possible to use the import tool https://gitlab.wikimedia.org/projects/new#import_p... [20:30:15] Project beta-update-databases-eqiad build #70885: 04FAILURE in 10 min: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/70885/ [20:35:23] looks like parsoid bumps upsetting it [20:48:27] Yippee, build fixed! [20:48:27] Project beta-update-databases-eqiad build #70886: 09FIXED in 10 min: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/70886/