[00:00:40] FIRING: DatasourceError: Queue (Jenkins jobs + Zuul functions) alert - https://grafana.wikimedia.org/alerting/grafana/iS0FSjJ4z/view - https://wikitech.wikimedia.org/wiki/Monitoring/DatasourceError - https://alerts.wikimedia.org/?q=alertname%3DDatasourceError [00:05:40] RESOLVED: DatasourceError: Queue (Jenkins jobs + Zuul functions) alert - https://grafana.wikimedia.org/alerting/grafana/iS0FSjJ4z/view - https://wikitech.wikimedia.org/wiki/Monitoring/DatasourceError - https://alerts.wikimedia.org/?q=alertname%3DDatasourceError [00:05:54] FIRING: DatasourceError: Queue (Jenkins jobs + Zuul functions) alert - https://grafana.wikimedia.org/alerting/grafana/iS0FSjJ4z/view - https://wikitech.wikimedia.org/wiki/Monitoring/DatasourceError - https://alerts.wikimedia.org/?q=alertname%3DDatasourceError [00:10:54] RESOLVED: DatasourceError: Queue (Jenkins jobs + Zuul functions) alert - https://grafana.wikimedia.org/alerting/grafana/iS0FSjJ4z/view - https://wikitech.wikimedia.org/wiki/Monitoring/DatasourceError - https://alerts.wikimedia.org/?q=alertname%3DDatasourceError [09:34:12] (03update) 10samtar: Add CommunityRequests to wmf_core [repos/releng/release] - 10https://gitlab.wikimedia.org/repos/releng/release/-/merge_requests/106 (https://phabricator.wikimedia.org/T372527) [09:42:36] helllo lovely RelEngs — who can I poke to take a quick look at ^ (https://gitlab.wikimedia.org/repos/releng/release/-/merge_requests/106) ? [09:48:57] (03merge) 10aklapper: Sync "Duplicate Form" menu item appearance with user permissions [repos/phabricator/phabricator] (wmf/stable) - 10https://gitlab.wikimedia.org/repos/phabricator/phabricator/-/merge_requests/65 (https://phabricator.wikimedia.org/T371805) [09:50:00] (03update) 10aklapper: Set new Diffusion repository URIs to No I/O by default [repos/phabricator/phabricator] (wmf/stable) - 10https://gitlab.wikimedia.org/repos/phabricator/phabricator/-/merge_requests/66 (https://phabricator.wikimedia.org/T224753) [09:50:20] (03merge) 10aklapper: Set new Diffusion repository URIs to No I/O by default [repos/phabricator/phabricator] (wmf/stable) - 10https://gitlab.wikimedia.org/repos/phabricator/phabricator/-/merge_requests/66 (https://phabricator.wikimedia.org/T224753) [09:50:35] 10Diffusion, 10Phabricator (phabricator-next), 10Release-Engineering-Team (Priority Backlog 📥): Set new Diffusion repos URIs to No I/O by default - https://phabricator.wikimedia.org/T224753#10072565 (10Aklapper) [09:54:05] (03merge) 10aklapper: Remove misleading warning from security escalation interface [repos/phabricator/extensions] (wmf/stable) - 10https://gitlab.wikimedia.org/repos/phabricator/extensions/-/merge_requests/39 (https://phabricator.wikimedia.org/T372335) [09:54:27] 10Phabricator (phabricator-next), 10Release-Engineering-Team (Priority Backlog 📥), 10Wikimedia-Phabricator-Extensions: Remove misleading warning from security escalation interface - https://phabricator.wikimedia.org/T372335#10072583 (10Aklapper) [09:56:02] (03merge) 10aklapper: fix: typo in policy warning [repos/phabricator/deployment] (wmf/stable) - 10https://gitlab.wikimedia.org/repos/phabricator/deployment/-/merge_requests/51 (owner: 10regox) [11:28:21] 06Project-Admins: Create project tag for Extension:Cookiecutter - https://phabricator.wikimedia.org/T372699#10072830 (10Elcapitan68) >>! In T372699#10071330, @Aklapper wrote: > This looks like https://www.mediawiki.org/wiki/Extension:Cookiecutter ; are you involved in its development? Yes, it is https://www.med... [11:56:13] 06Project-Admins: Create project tag for Extension:Cookiecutter - https://phabricator.wikimedia.org/T372699#10072882 (10Elcapitan68) [11:56:59] 06Project-Admins: Create project tag for Extension:Cookiecutter - https://phabricator.wikimedia.org/T372699#10072883 (10Elcapitan68) >>! In T372699#10071390, @Tgr wrote: > Note there is also https://gerrit.wikimedia.org/r/plugins/gitiles/mediawiki/tools/cookiecutter-library/. Probably the same tag can be used fo... [12:11:58] I have a MR (https://gitlab.wikimedia.org/repos/releng/release/-/merge_requests/106) for `releng/release` — on Gerrit I'd add a few reviewers but you can't do that on GitLab. Anything else I should do to ensure it gets attention? [13:39:29] 06Gerrit-Privilege-Requests, 10LDAP-Access-Requests, 10SRE-Access-Requests: Offboard Guergana Tzatchkova (WMDE) and Frederik Ring from WMF systems - https://phabricator.wikimedia.org/T372767 (10karapayneWMDE) 03NEW [14:22:30] 06Release-Engineering-Team, 10MediaWiki-Core-Tests, 07Developer Productivity, 10MediaWiki-Platform-Team (Radar): Create a daily job running core + extension PHPUnit tests serially - https://phabricator.wikimedia.org/T372618#10073449 (10pmiazga) [14:40:51] 10Beta-Cluster-Infrastructure, 06MediaWiki-Platform-Team, 10MW-1.43-notes (1.43.0-wmf.18; 2024-08-13), 05SUL3: Set up sso.wikimedia.beta.wmflabs.org with config-layer routing to other wikis - https://phabricator.wikimedia.org/T365162#10073624 (10Krinkle) 05Open→03Resolved Left to do in setting up t... [14:45:51] 06Project-Admins: Create project tag for Metrics Platform - https://phabricator.wikimedia.org/T372368#10073653 (10phuedx) >>! In T372368#10069353, @Aklapper wrote: > See https://www.mediawiki.org/wiki/Phabricator/Project_management#Types_of_Projects for our taxonomy. Should Metrics Platform be treated as an umb... [15:07:31] (03open) 10dancy: Fix: Remove TLS certs during `train-dev clean` [repos/releng/train-dev] - 10https://gitlab.wikimedia.org/repos/releng/train-dev/-/merge_requests/84 [15:07:34] (03update) 10dancy: Fix: Remove TLS certs during `train-dev clean` [repos/releng/train-dev] - 10https://gitlab.wikimedia.org/repos/releng/train-dev/-/merge_requests/84 [15:08:10] (03update) 10dancy: Fix: Remove TLS certs during `train-dev clean` [repos/releng/train-dev] - 10https://gitlab.wikimedia.org/repos/releng/train-dev/-/merge_requests/84 [15:08:38] (03update) 10dancy: Add CommunityRequests to wmf_core [repos/releng/release] - 10https://gitlab.wikimedia.org/repos/releng/release/-/merge_requests/106 (https://phabricator.wikimedia.org/T372527) (owner: 10samtar) [15:09:04] TheresNoTime: I added Jforrester as a reviewer. [15:09:16] Ah, appreciate it, thank you [15:15:39] (03merge) 10dancy: branch.py: Improve error reporting when branch creation fails [repos/releng/release] - 10https://gitlab.wikimedia.org/repos/releng/release/-/merge_requests/105 [15:16:18] (03update) 10dancy: make-release/mwrelease/branch.py: Rename a do_core_work parameter [repos/releng/release] - 10https://gitlab.wikimedia.org/repos/releng/release/-/merge_requests/101 [15:17:56] (03merge) 10dancy: make-release/mwrelease/branch.py: Rename a do_core_work parameter [repos/releng/release] - 10https://gitlab.wikimedia.org/repos/releng/release/-/merge_requests/101 [15:30:45] 06Release-Engineering-Team, 06collaboration-services: Upgrade phab (phorge) hosts to bookworm - https://phabricator.wikimedia.org/T372619#10073908 (10LSobanski) p:05Triage→03Low [15:31:09] (03update) 10jforrester: Add CommunityRequests to wmf_core [repos/releng/release] - 10https://gitlab.wikimedia.org/repos/releng/release/-/merge_requests/106 (https://phabricator.wikimedia.org/T372527) (owner: 10samtar) [15:31:56] (03approved) 10jforrester: Add CommunityRequests to wmf_core [repos/releng/release] - 10https://gitlab.wikimedia.org/repos/releng/release/-/merge_requests/106 (https://phabricator.wikimedia.org/T372527) (owner: 10samtar) [15:32:48] (03merge) 10jforrester: Add CommunityRequests to wmf_core [repos/releng/release] - 10https://gitlab.wikimedia.org/repos/releng/release/-/merge_requests/106 (https://phabricator.wikimedia.org/T372527) (owner: 10samtar) [15:33:50] (ty!) [15:36:47] (03merge) 10dancy: Add chart-renderer to trusted projects [repos/releng/gitlab-trusted-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-trusted-runner/-/merge_requests/96 (https://phabricator.wikimedia.org/T371278) (owner: 10aude) [15:53:08] 06Release-Engineering-Team, 07Developer Productivity: Add link to gerrit repo settings in description of mirrored github repos - https://phabricator.wikimedia.org/T372791 (10Ladsgroup) 03NEW [16:01:39] 10Release-Engineering-Team (Priority Backlog 📥), 07Developer Productivity: Add link to gerrit repo settings in description of mirrored github repos - https://phabricator.wikimedia.org/T372791#10074101 (10thcipriani) p:05Triage→03Medium I like this idea! We have scripts that know how to figure out what ger... [16:02:00] (03open) 10dancy: build-images.py: Add --mediawiki-versions flag [repos/releng/release] - 10https://gitlab.wikimedia.org/repos/releng/release/-/merge_requests/107 (https://phabricator.wikimedia.org/T371904) [16:02:01] (03update) 10dancy: build-images.py: Add --mediawiki-versions flag [repos/releng/release] - 10https://gitlab.wikimedia.org/repos/releng/release/-/merge_requests/107 (https://phabricator.wikimedia.org/T371904) [16:02:44] (03open) 10dancy: k8s: Pass the list of live mediawiki versions to build-images.py [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/405 (https://phabricator.wikimedia.org/T371904) [16:02:46] (03update) 10dancy: k8s: Pass the list of live mediawiki versions to build-images.py [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/405 (https://phabricator.wikimedia.org/T371904) [16:04:26] (03update) 10dancy: build-images.py: Add --mediawiki-versions flag [repos/releng/release] - 10https://gitlab.wikimedia.org/repos/releng/release/-/merge_requests/107 (https://phabricator.wikimedia.org/T371904) [16:04:32] (03update) 10dancy: build-images.py: Add --mediawiki-versions flag [repos/releng/release] - 10https://gitlab.wikimedia.org/repos/releng/release/-/merge_requests/107 (https://phabricator.wikimedia.org/T371904) [16:05:13] (03update) 10dancy: k8s: Pass the list of live mediawiki versions to build-images.py [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/405 (https://phabricator.wikimedia.org/T371904) [16:05:17] (03update) 10dancy: k8s: Pass the list of live mediawiki versions to build-images.py [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/405 (https://phabricator.wikimedia.org/T371904) [16:06:31] (03update) 10dancy: build-images.py: Add --mediawiki-versions flag [repos/releng/release] - 10https://gitlab.wikimedia.org/repos/releng/release/-/merge_requests/107 (https://phabricator.wikimedia.org/T371904) [16:06:34] (03update) 10dancy: k8s: Pass the list of live mediawiki versions to build-images.py [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/405 (https://phabricator.wikimedia.org/T371904) [16:11:57] 10Release-Engineering-Team (Priority Backlog 📥), 07Developer Productivity: Add link to gerrit repo settings in description of mirrored github repos - https://phabricator.wikimedia.org/T372791#10074156 (10Krinkle) There is a clone command on top of the linked Gitiles landing pages already. When using the recom... [16:13:02] 10Phabricator, 10Release-Engineering-Team (Priority Backlog 📥), 06collaboration-services, 10Wikimedia-Apache-configuration, and 3 others: Apache 2.4.61 throws a 403 Forbidden for links containing %3F - https://phabricator.wikimedia.org/T370110#10074161 (10Mstyles) @Aklapper are you okay to resolve this tic... [18:17:56] (03update) 10dancy: sync-world: Announce end of operation when --stop-before-sync is used [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/403 [18:52:05] (03open) 10dancy: snapshot/containerd: fix wrong errdefs package import [repos/releng/buildkit] (wmf/v0.15) - 10https://gitlab.wikimedia.org/repos/releng/buildkit/-/merge_requests/68 [18:54:19] (03close) 10dancy: snapshot/containerd: fix wrong errdefs package import [repos/releng/buildkit] (wmf/v0.15) - 10https://gitlab.wikimedia.org/repos/releng/buildkit/-/merge_requests/68 [19:09:38] (03approved) 10swfrench: build-images.py: Add --mediawiki-versions flag [repos/releng/release] - 10https://gitlab.wikimedia.org/repos/releng/release/-/merge_requests/107 (https://phabricator.wikimedia.org/T371904) (owner: 10dancy) [19:13:05] 06Release-Engineering-Team: Buildkit 0.15.2 released - https://phabricator.wikimedia.org/T372820 (10dancy) 03NEW [19:16:25] (03open) 10dancy: staging: Use buildkitd wmf-v0.15.2-1 [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/404 (https://phabricator.wikimedia.org/T372820) [19:16:28] (03update) 10dancy: staging: Use buildkitd wmf-v0.15.2-1 [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/404 (https://phabricator.wikimedia.org/T372820) [19:17:27] (03merge) 10dancy: staging: Use buildkitd wmf-v0.15.2-1 [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/404 (https://phabricator.wikimedia.org/T372820) [19:18:50] (03approved) 10swfrench: k8s: Pass the list of live mediawiki versions to build-images.py [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/405 (https://phabricator.wikimedia.org/T371904) (owner: 10dancy) [19:28:22] (03open) 10dancy: prod: Use buildkitd wmf-v0.15.2-1 [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/405 (https://phabricator.wikimedia.org/T372820) [19:28:23] (03update) 10dancy: prod: Use buildkitd wmf-v0.15.2-1 [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/405 (https://phabricator.wikimedia.org/T372820) [19:29:21] (03merge) 10dancy: prod: Use buildkitd wmf-v0.15.2-1 [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/405 (https://phabricator.wikimedia.org/T372820) [19:38:56] !log Updating buildkitd to v0.15.2 in gitlab-cloud-runners [19:38:57] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [19:39:39] 06Release-Engineering-Team, 13Patch-For-Review: Buildkit 0.15.2 released - https://phabricator.wikimedia.org/T372820#10075260 (10dancy) [19:41:07] 06Release-Engineering-Team, 13Patch-For-Review: Buildkit 0.15.2 released - https://phabricator.wikimedia.org/T372820#10075261 (10dancy) 05Open→03In progress p:05Triage→03Medium [19:46:29] (03merge) 10dancy: k8s: Pass the list of live mediawiki versions to build-images.py [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/405 (https://phabricator.wikimedia.org/T371904) [19:47:11] (03open) 10dancy: Release 4.98.0-1 [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/406 [19:48:14] (03merge) 10dancy: Release 4.98.0-1 [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/406 [19:52:49] (03merge) 10dancy: build-images.py: Add --mediawiki-versions flag [repos/releng/release] - 10https://gitlab.wikimedia.org/repos/releng/release/-/merge_requests/107 (https://phabricator.wikimedia.org/T371904) [19:55:52] 10Release-Engineering-Team (Priority Backlog 📥), 13Patch-For-Review: Rewrite remaining make-container-image code in Python - https://phabricator.wikimedia.org/T371904#10075350 (10dancy) 05In progress→03Resolved [19:59:43] 10Phabricator, 10Release-Engineering-Team (Priority Backlog 📥), 06collaboration-services, 10Wikimedia-Apache-configuration, and 3 others: Apache 2.4.61 throws a 403 Forbidden for links containing %3F - https://phabricator.wikimedia.org/T370110#10075380 (10Aklapper) See the previous three comments [19:59:55] (03open) 10dancy: README.md: Initial notes on handling new releases [repos/releng/buildkit] (wmf/v0.15) - 10https://gitlab.wikimedia.org/repos/releng/buildkit/-/merge_requests/69 [19:59:58] (03update) 10dancy: README.md: Initial notes on handling new releases [repos/releng/buildkit] (wmf/v0.15) - 10https://gitlab.wikimedia.org/repos/releng/buildkit/-/merge_requests/69 [20:01:27] (03update) 10dancy: README.md: Initial notes on handling new releases [repos/releng/buildkit] (wmf/v0.15) - 10https://gitlab.wikimedia.org/repos/releng/buildkit/-/merge_requests/69 [20:02:02] (03update) 10dancy: README.md: Initial notes on handling new releases [repos/releng/buildkit] (wmf/v0.15) - 10https://gitlab.wikimedia.org/repos/releng/buildkit/-/merge_requests/69 [20:10:56] 06Project-Admins, 10Outreach-Programs-Projects: Add to a few Outreachy admin projects / boards - https://phabricator.wikimedia.org/T372807#10075438 (10Aklapper) 05Open→03Resolved a:03Aklapper @debt: I've added you as a member to #acl_outreachy-mentors as that's the only "join-restricted" project; any... [20:14:49] (03update) 10dancy: README.md: Initial notes on handling new releases [repos/releng/buildkit] (wmf/v0.15) - 10https://gitlab.wikimedia.org/repos/releng/buildkit/-/merge_requests/69 [20:15:08] (03update) 10dancy: README.md: Initial notes on handling new releases [repos/releng/buildkit] (wmf/v0.15) - 10https://gitlab.wikimedia.org/repos/releng/buildkit/-/merge_requests/69 [20:15:38] 10GitLab, 06Release-Engineering-Team, 06collaboration-services, 10VPS-project-devtools, 13Patch-For-Review: https://gitlab.devtools.wmcloud.org is being indexed by google (and scoring pretty high) - https://phabricator.wikimedia.org/T372538#10075462 (10Dzahn) The gitlab test instance now has a robots.txt... [20:16:08] (03update) 10dancy: README.md: Initial notes on handling new releases [repos/releng/buildkit] (wmf/v0.15) - 10https://gitlab.wikimedia.org/repos/releng/buildkit/-/merge_requests/69 [20:40:59] 06Project-Admins, 10Outreach-Programs-Projects: Add to a few Outreachy admin projects / boards - https://phabricator.wikimedia.org/T372807#10075541 (10debt) 05Resolved→03Open ah, @Aklapper - maybe I should have also asked for this group so that I can create the next milestone for Outreachy? {F57281807} [20:52:50] Can anyone tell me why scap wouldn't be honoring `--environment`? [20:53:24] I feel like I must be doing something dumb, this configuration has been around forever... [20:54:40] dduvall: when I am using kokkuri from a cloud runner (not a trusted runner) should it be possible for me to use the `.kokkuri:build-and-publish-image` target? I thought this was working for me last week, but https://gitlab.wikimedia.org/bd808/deployment-prep-opentofu/-/jobs/346763#L64 is very much failing today. [20:59:23] urandom: is there a particular place that `--environment ENV` is not working for you that folks to look at? [20:59:41] restbase [21:00:06] /srv/deployment/restbase/deploy [21:00:46] I'm trying to use the `beta` environment, but it seems to ignore that and tries to deploy to the default targets [21:01:54] though it is logging the environment name... [21:03:45] Oh, interesting: /srv/deployment/cassandra/logstash-logback-encoder is also doing this, and it that has been a working config for years too... [21:03:51] And the failures are happening from deployment-deploy04.deployment-prep.eqiad1.wikimedia.cloud? [21:05:45] ha! [21:05:54] I was right, I was being dumb! [21:07:33] * bd808 assumes that a prod deploy host was being used and it couldn't reach deployment-restbase04.deployment-prep.eqiad1.wikimedia.cloud [21:08:40] urandom: don't forget to update restbase/deploy/scap/environments/beta/betacluster to target the new instance you are trying to get working [21:08:53] bd808: yeah, that's what I was doing [21:08:57] and I did [21:09:11] excellent [21:09:24] https://www.irccloud.com/pastebin/rH2GzJAh/ [21:09:45] {} [21:10:12] so informative :/ [21:11:29] yaa [21:12:23] https://phabricator.wikimedia.org/T294936 [21:15:51] `SSH_AUTH_SOCK=/run/keyholder/proxy.sock ssh -l deploy-service -oIdentitiesOnly=yes -oIdentityFile=/etc/keyholder.d/deploy_service.pub deployment-restbase05.deployment-prep.eqiad1.wikimedia.cloud scap version` shows the same 4.91.0-1 that is running on deployment-deploy04 [21:16:10] let's see if I can get more from running the actual command [21:17:51] AttributeError: 'OverrideCheck' object has no attribute 'before' from ling 539 of /var/lib/scap/scap/lib/python3.9/site-packages/scap/deploy.py [21:17:56] *line [21:18:29] https://phabricator.wikimedia.org/P67390 [21:31:04] urandom: it looks like the code that is crashing was introduced as part of a fix for a restbase deploy crashing in prod last fall. T346354 && https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/187 [21:31:04] T346354: restbase deploys via scap lead to all hosts being disabled in conftool - https://phabricator.wikimedia.org/T346354 [21:33:08] bd808: we need to go deeper [21:33:46] (it's an Inception reference) [21:34:24] * bd808 tests the balance of his unicorn totem [21:37:52] I'm at the edge of my scap3 knowing. This isn't code I touch or use often. I wonder if dancy, dduvall, or jeena have any time to try and help figure out what the malfunction is? Fun times from spinning up a new runner once ever 2+ years. [21:38:29] o/ I can take a look. [21:39:19] thanks dancy [21:48:41] (03update) 10thcipriani: sync-world: Announce end of operation when --stop-before-sync is used [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/403 (owner: 10dancy) [21:51:15] 06Project-Admins: Create project tag for #Future-Audiences - https://phabricator.wikimedia.org/T343775#10075715 (10FNavas-foundation) @Aklapper - sorry for the delay on this. totally makes sense. I later added this tag for add a fact tickets - https://phabricator.wikimedia.org/tag/add_a_fact/ which we lat... [21:52:31] (03merge) 10thcipriani: sync-world: Announce end of operation when --stop-before-sync is used [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/403 (owner: 10dancy) [22:03:20] 06Project-Admins, 07Tracking-Neverending: Requests for addition to the #acl*Project-Admins group (in comments) - https://phabricator.wikimedia.org/T706#10075752 (10debt) Hello, can I be added in so I can make [[ https://phabricator.wikimedia.org/project/subprojects/2206/ | milestones ]] in my Developer Outreac... [22:03:45] urandom: I am seeing that confusing behavior with `--environment` too. [22:05:29] 06Project-Admins, 10Outreach-Programs-Projects: Add to a few Outreachy admin projects / boards - https://phabricator.wikimedia.org/T372807#10075754 (10debt) 05Open→03Resolved Nevermind, closing this and adding a ticket where it [[ https://phabricator.wikimedia.org/T706#10075752 | needs to go ]] ;) [22:11:11] 06Project-Admins, 07Tracking-Neverending: Requests for addition to the #acl*Project-Admins group (in comments) - https://phabricator.wikimedia.org/T706#10075759 (10brennen) > Hello, can I be added in so I can make milestones in my Developer Outreach role? Done! (Please see earlier standard disclaimers on this... [22:18:04] urandom: Nevermind.. That was just confusion [22:22:53] 10GitLab (CI & Job Runners): Push by kokkuri to registry.cloud.releng.team/bd808/deployment-prep-opentofu failing after working last week - https://phabricator.wikimedia.org/T372835 (10bd808) 03NEW [22:24:37] 10Beta-Cluster-Infrastructure: Figure out how to provision a Kubernetes cluster using Magnum and OpenTofu - https://phabricator.wikimedia.org/T372498#10075781 (10bd808) [22:24:38] 10GitLab (CI & Job Runners): Push by kokkuri to registry.cloud.releng.team/bd808/deployment-prep-opentofu failing after working last week - https://phabricator.wikimedia.org/T372835#10075782 (10bd808) [22:24:39] (03open) 10sandeeps: cli.py: add scap version to fatal error meessages for better logging [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/407 [22:29:19] dancy: mine was the result of the environment being unreachable from the prod deploy host....but, it's probably worth noting that didn't result in any kind of error, it just silently fell back to the default targets. [22:30:11] bd808: re: kokkuri and the untrusted registry, i'm not sure what happened there [22:30:18] i'll check reggie's logs [22:36:05] dduvall: thanks. I made T372835 to track my confusion [22:36:06] T372835: Push by kokkuri to registry.cloud.releng.team/bd808/deployment-prep-opentofu failing after working last week - https://phabricator.wikimedia.org/T372835 [22:38:28] (03PS1) 10Krinkle: Remove update.php --skip-external-dependencies in favor of MW_SKIP_EXTERNAL_DEPENDENCIES [integration/quibble] - 10https://gerrit.wikimedia.org/r/1063912 (https://phabricator.wikimedia.org/T370380) [23:08:21] urandom: I have a general handle on what the bug is. I'm wiped out for the day so I'll continue working on it tomorrow morning. [23:08:47] ok, thanks dancy! [23:30:57] 10GitLab (CI & Job Runners): Push by kokkuri to registry.cloud.releng.team/bd808/deployment-prep-opentofu failing after working last week - https://phabricator.wikimedia.org/T372835#10075939 (10bd808) This may have all been PEBCAK in some form. I rolled back to the blubber and kokkuri config that worked for http... [23:50:32] 10Release-Engineering-Team (Priority Backlog 📥), 07Developer Productivity: Add link to gerrit repo settings in description of mirrored github repos - https://phabricator.wikimedia.org/T372791#10075952 (10thcipriani) >>! In T372791#10074156, @Krinkle wrote: > There is a clone command on top of the linked Gitile...