[05:32:23] (03PS26) 10Raymond Ndibe: toolforge: run specific tests on deploy [cloud/wmcs-cookbooks] - 10https://gerrit.wikimedia.org/r/1140246 (https://phabricator.wikimedia.org/T381011) [05:35:20] (03update) 10raymond-ndibe: [toolforge-deploy] add test tags to component charts [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/755 (https://phabricator.wikimedia.org/T381011) [05:46:12] (03update) 10raymond-ndibe: [toolforge-deploy] add test tags to component charts [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/755 (https://phabricator.wikimedia.org/T381011) [06:00:50] (03update) 10raymond-ndibe: [toolforge-deploy] run specific tests on deploy [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/755 (https://phabricator.wikimedia.org/T381011) [06:01:11] (03update) 10raymond-ndibe: [toolforge-deploy] run specific tests on deploy [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/755 (https://phabricator.wikimedia.org/T381011) [06:19:18] 06cloud-services-team, 10Toolforge (Toolforge iteration 19), 13Patch-For-Review: [builds-builder] Add support for Heroku's "24" builder stack based on Ubuntu 2024.04 noble - https://phabricator.wikimedia.org/T380127#10806473 (10Sascha) Much looking forward to this change, thanks so much for doing it! Can't w... [06:48:39] (03update) 10raymond-ndibe: [toolforge-deploy] run specific tests on deploy [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/755 (https://phabricator.wikimedia.org/T381011) [07:04:28] (03update) 10raymond-ndibe: [toolforge-deploy] run specific tests on deploy [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/755 (https://phabricator.wikimedia.org/T381011) [07:05:20] (03update) 10raymond-ndibe: [toolforge-deploy] run specific tests on deploy [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/755 (https://phabricator.wikimedia.org/T381011) [07:06:11] (03update) 10raymond-ndibe: [toolforge-deploy] run specific tests on deploy [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/755 (https://phabricator.wikimedia.org/T381011) [07:10:29] 06cloud-services-team, 10Toolforge: Toolforge bastion sssd/LDAP flakiness (May 2025) - https://phabricator.wikimedia.org/T393732#10806555 (10taavi) [07:13:18] (03update) 10raymond-ndibe: [toolforge-deploy] run specific tests on deploy [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/755 (https://phabricator.wikimedia.org/T381011) [07:15:22] 06cloud-services-team, 10Toolforge: Toolforge bastion sssd/LDAP flakiness (May 2025) - https://phabricator.wikimedia.org/T393732#10806561 (10taavi) [07:15:51] 06cloud-services-team, 10Toolforge: Toolforge bastion sssd/LDAP flakiness (May 2025) - https://phabricator.wikimedia.org/T393732#10806563 (10taavi) [08:21:32] FIRING: PuppetCertificateAboutToExpire: Puppet CA certificate Puppet CA: project-proxy-puppetmaster-01.project-proxy.eqiad.wmflabs is about to expire in 16d 18h 14m 54s - https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/PuppetCertificateAboutToExpire - https://prometheus-alerts.wmcloud.org/?q=alertname%3DPuppetCertificateAboutToExpire [08:31:23] 06cloud-services-team, 10Cloud-VPS: Upgrade metricsinfra Grafana hosts (grafana.wmcloud.org) to Bookworm / Grafana v11 - https://phabricator.wikimedia.org/T393735#10806664 (10taavi) a:03taavi [08:41:59] (03CR) 10Jforrester: [C:03+2] build: Updating mediawiki/mediawiki-codesniffer to 47.0.0 [labs/tools/coverme] - 10https://gerrit.wikimedia.org/r/1143222 (owner: 10Libraryupgrader) [08:43:32] !log taavi@cloudcumin1001 metricsinfra START - Cookbook wmcs.vps.refresh_puppet_certs on metricsinfra-grafana-2.metricsinfra.eqiad1.wikimedia.cloud [08:44:21] !log taavi@cloudcumin1001 metricsinfra END (PASS) - Cookbook wmcs.vps.refresh_puppet_certs (exit_code=0) on metricsinfra-grafana-2.metricsinfra.eqiad1.wikimedia.cloud [08:44:49] 06cloud-services-team, 10Cloud-VPS: trove: Unable to create user with IPv6 address as host - https://phabricator.wikimedia.org/T393760 (10taavi) 03NEW [08:55:06] 06cloud-services-team, 10Cloud-VPS: Upgrade metricsinfra Grafana hosts (grafana.wmcloud.org) to Bookworm / Grafana v11 - https://phabricator.wikimedia.org/T393735#10806704 (10taavi) 05Open→03Resolved [09:03:31] 10Cloud-VPS (Quota-requests), 06Moderator-Tools-Team, 10Wikilink-Tool: Request to increase object storage capacity - Wikilink project - https://phabricator.wikimedia.org/T392870#10806757 (10aborrero) Just to be clear, the requested quota bump is for: * max number of objects: 20K * max size: 20K * 700Kb = 140... [09:06:26] 10Cloud-VPS (Quota-requests), 06Moderator-Tools-Team, 10Wikilink-Tool: Request to increase object storage capacity - Wikilink project - https://phabricator.wikimedia.org/T392870#10806766 (10aborrero) 05Open→03Resolved a:03aborrero [09:07:11] 10Cloud-VPS (Quota-requests), 06Moderator-Tools-Team, 10Wikilink-Tool: Request to increase object storage capacity - Wikilink project - https://phabricator.wikimedia.org/T392870#10806769 (10aborrero) I set 15GB instead of 14GB on purpose, so they have some extra room. [09:21:42] (03merge) 10taavi: proxies: handle 400 return code from proxy API [repos/cloud/cloud-vps/go-cloudvps] - 10https://gitlab.wikimedia.org/repos/cloud/cloud-vps/go-cloudvps/-/merge_requests/2 (https://phabricator.wikimedia.org/T391718) (owner: 10andrew) [09:23:50] (03update) 10taavi: Upgrade go-cloudvps [repos/cloud/cloud-vps/terraform-cloudvps] - 10https://gitlab.wikimedia.org/repos/cloud/cloud-vps/terraform-cloudvps/-/merge_requests/5 [09:25:16] (03merge) 10taavi: Upgrade go-cloudvps [repos/cloud/cloud-vps/terraform-cloudvps] - 10https://gitlab.wikimedia.org/repos/cloud/cloud-vps/terraform-cloudvps/-/merge_requests/5 [09:25:47] (03update) 10taavi: build: Fix builds with forks [repos/cloud/cloud-vps/terraform-cloudvps] - 10https://gitlab.wikimedia.org/repos/cloud/cloud-vps/terraform-cloudvps/-/merge_requests/4 [09:27:54] (03merge) 10taavi: build: Fix builds with forks [repos/cloud/cloud-vps/terraform-cloudvps] - 10https://gitlab.wikimedia.org/repos/cloud/cloud-vps/terraform-cloudvps/-/merge_requests/4 [09:32:29] (03update) 10taavi: Allow configuring the provider by environment variables [repos/cloud/cloud-vps/terraform-cloudvps] - 10https://gitlab.wikimedia.org/repos/cloud/cloud-vps/terraform-cloudvps/-/merge_requests/2 (owner: 10stwalkerster) [09:33:59] (03update) 10taavi: web proxy: don't error out if a proxy doesn't exist. [repos/cloud/cloud-vps/terraform-cloudvps] - 10https://gitlab.wikimedia.org/repos/cloud/cloud-vps/terraform-cloudvps/-/merge_requests/3 (https://phabricator.wikimedia.org/T391718) (owner: 10andrew) [09:36:13] (03merge) 10taavi: web proxy: don't error out if a proxy doesn't exist. [repos/cloud/cloud-vps/terraform-cloudvps] - 10https://gitlab.wikimedia.org/repos/cloud/cloud-vps/terraform-cloudvps/-/merge_requests/3 (https://phabricator.wikimedia.org/T391718) (owner: 10andrew) [09:43:12] (03close) 10taavi: Allow configuring the provider by environment variables [repos/cloud/cloud-vps/terraform-cloudvps] - 10https://gitlab.wikimedia.org/repos/cloud/cloud-vps/terraform-cloudvps/-/merge_requests/2 (owner: 10stwalkerster) [09:54:57] 06cloud-services-team, 10Cloud-VPS: Extend Tofu provider to allow configuration via environment variables - https://phabricator.wikimedia.org/T321250#10806837 (10taavi) 05Open→03Resolved I've just published v0.3.0 of the provider with this included. [09:57:38] (03open) 10taavi: Upgrade cloudvps provider to v0.3.0 [repos/cloud/cloud-vps/tf-infra-test] - 10https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tf-infra-test/-/merge_requests/3 [09:58:47] (03approved) 10fnegri: Upgrade cloudvps provider to v0.3.0 [repos/cloud/cloud-vps/tf-infra-test] - 10https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tf-infra-test/-/merge_requests/3 (owner: 10taavi) [09:59:06] (03merge) 10taavi: Upgrade cloudvps provider to v0.3.0 [repos/cloud/cloud-vps/tf-infra-test] - 10https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tf-infra-test/-/merge_requests/3 [10:24:17] 06cloud-services-team, 10Cloud-VPS: openstack magnum (or heat) resource leak - https://phabricator.wikimedia.org/T392031#10806882 (10fnegri) Tofuinfratest is also failing to create Magnum clusters, though //some// runs are successful. I've seen it fail twice with a Heat stack ending in "CREATE_FAILED", and sh... [10:53:49] 06cloud-services-team, 10Toolforge: [toolsdb] ToolsToolsDBReplicationLagIsTooHigh - 2025-05-09 - https://phabricator.wikimedia.org/T393766 (10fnegri) 03NEW [10:54:00] 10cloud-services-team (FY2024/2025-Q3-Q4), 10Toolforge: [toolsdb] ToolsToolsDBReplicationLagIsTooHigh - 2025-05-09 - https://phabricator.wikimedia.org/T393766#10806964 (10fnegri) 05Open→03In progress p:05Triage→03High [10:55:11] 10cloud-services-team (FY2024/2025-Q3-Q4), 10Toolforge: [toolsdb] ToolsToolsDBReplicationLagIsTooHigh - 2025-05-09 - https://phabricator.wikimedia.org/T393766#10806968 (10fnegri) I expect the replica will eventually catch up, but based on previous experience it might take multiple days. If it's still lagging o... [11:02:44] 10Tool-inteGraality, 10VerySmallGLAM, 10Wikibase (3rd party installations), 06Wikibase Suite Team, 07Product-Feature: integraality for Wikibases? - https://phabricator.wikimedia.org/T294892#10806970 (10Addshore) >>! In T294892#10803277, @Olea wrote: >> Perhaps we need a centeralized tool to enable other... [11:14:58] (03update) 10aborrero: gitlab-ci: introduce tofu-provisioning code [repos/cloud/cicd/gitlab-ci] - 10https://gitlab.wikimedia.org/repos/cloud/cicd/gitlab-ci/-/merge_requests/51 (https://phabricator.wikimedia.org/T393686) [11:15:05] (03update) 10aborrero: gitlab-ci: replace local logic with included one [repos/cloud/cloud-vps/networktests-tofu-provisioning] - 10https://gitlab.wikimedia.org/repos/cloud/cloud-vps/networktests-tofu-provisioning/-/merge_requests/23 (https://phabricator.wikimedia.org/T393686) [11:15:38] (03update) 10aborrero: gitlab-ci: replace local logic with included one [repos/cloud/cloud-vps/networktests-tofu-provisioning] - 10https://gitlab.wikimedia.org/repos/cloud/cloud-vps/networktests-tofu-provisioning/-/merge_requests/23 (https://phabricator.wikimedia.org/T393686) [11:16:37] (03update) 10aborrero: gitlab-ci: replace local logic with included one [repos/cloud/cloud-vps/networktests-tofu-provisioning] - 10https://gitlab.wikimedia.org/repos/cloud/cloud-vps/networktests-tofu-provisioning/-/merge_requests/23 (https://phabricator.wikimedia.org/T393686) [11:17:25] (03update) 10aborrero: gitlab-ci: replace local logic with included one [repos/cloud/cloud-vps/networktests-tofu-provisioning] - 10https://gitlab.wikimedia.org/repos/cloud/cloud-vps/networktests-tofu-provisioning/-/merge_requests/23 (https://phabricator.wikimedia.org/T393686) [11:17:26] (03update) 10aborrero: gitlab-ci: introduce tofu-provisioning code [repos/cloud/cicd/gitlab-ci] - 10https://gitlab.wikimedia.org/repos/cloud/cicd/gitlab-ci/-/merge_requests/51 (https://phabricator.wikimedia.org/T393686) [11:33:52] (03update) 10aborrero: gitlab-ci: introduce tofu-provisioning code [repos/cloud/cicd/gitlab-ci] - 10https://gitlab.wikimedia.org/repos/cloud/cicd/gitlab-ci/-/merge_requests/51 (https://phabricator.wikimedia.org/T393686) [11:55:12] (03update) 10aborrero: gitlab-ci: introduce tofu-provisioning code [repos/cloud/cicd/gitlab-ci] - 10https://gitlab.wikimedia.org/repos/cloud/cicd/gitlab-ci/-/merge_requests/51 (https://phabricator.wikimedia.org/T393686) [11:58:17] (03update) 10aborrero: gitlab-ci: introduce tofu-provisioning code [repos/cloud/cicd/gitlab-ci] - 10https://gitlab.wikimedia.org/repos/cloud/cicd/gitlab-ci/-/merge_requests/51 (https://phabricator.wikimedia.org/T393686) [12:01:18] (03update) 10aborrero: gitlab-ci: introduce tofu-provisioning code [repos/cloud/cicd/gitlab-ci] - 10https://gitlab.wikimedia.org/repos/cloud/cicd/gitlab-ci/-/merge_requests/51 (https://phabricator.wikimedia.org/T393686) [12:03:25] (03update) 10aborrero: gitlab-ci: introduce tofu-provisioning code [repos/cloud/cicd/gitlab-ci] - 10https://gitlab.wikimedia.org/repos/cloud/cicd/gitlab-ci/-/merge_requests/51 (https://phabricator.wikimedia.org/T393686) [12:07:37] (03PS1) 10Slyngshede: Build: Update build system [labs/countervandalism/CVNBot] - 10https://gerrit.wikimedia.org/r/1143806 [12:08:09] (03CR) 10CI reject: [V:04-1] Build: Update build system [labs/countervandalism/CVNBot] - 10https://gerrit.wikimedia.org/r/1143806 (owner: 10Slyngshede) [12:10:47] (03update) 10aborrero: gitlab-ci: introduce tofu-provisioning code [repos/cloud/cicd/gitlab-ci] - 10https://gitlab.wikimedia.org/repos/cloud/cicd/gitlab-ci/-/merge_requests/51 (https://phabricator.wikimedia.org/T393686) [12:15:33] (03update) 10aborrero: gitlab-ci: introduce tofu-provisioning code [repos/cloud/cicd/gitlab-ci] - 10https://gitlab.wikimedia.org/repos/cloud/cicd/gitlab-ci/-/merge_requests/51 (https://phabricator.wikimedia.org/T393686) [12:17:48] (03update) 10aborrero: gitlab-ci: introduce tofu-provisioning code [repos/cloud/cicd/gitlab-ci] - 10https://gitlab.wikimedia.org/repos/cloud/cicd/gitlab-ci/-/merge_requests/51 (https://phabricator.wikimedia.org/T393686) [12:20:29] (03update) 10aborrero: gitlab-ci: introduce tofu-provisioning code [repos/cloud/cicd/gitlab-ci] - 10https://gitlab.wikimedia.org/repos/cloud/cicd/gitlab-ci/-/merge_requests/51 (https://phabricator.wikimedia.org/T393686) [12:22:45] (03update) 10aborrero: gitlab-ci: introduce tofu-provisioning code [repos/cloud/cicd/gitlab-ci] - 10https://gitlab.wikimedia.org/repos/cloud/cicd/gitlab-ci/-/merge_requests/51 (https://phabricator.wikimedia.org/T393686) [12:33:21] (03update) 10aborrero: gitlab-ci: introduce tofu-provisioning code [repos/cloud/cicd/gitlab-ci] - 10https://gitlab.wikimedia.org/repos/cloud/cicd/gitlab-ci/-/merge_requests/51 (https://phabricator.wikimedia.org/T393686) [12:42:38] (03update) 10aborrero: gitlab-ci: introduce tofu-provisioning code [repos/cloud/cicd/gitlab-ci] - 10https://gitlab.wikimedia.org/repos/cloud/cicd/gitlab-ci/-/merge_requests/51 (https://phabricator.wikimedia.org/T393686) [12:44:05] (03CR) 10Slyngshede: "Is this something that's worth spending time on? I have a few other patches and ideas, but the CI pipeline needs to be updated as well and" [labs/countervandalism/CVNBot] - 10https://gerrit.wikimedia.org/r/1143806 (owner: 10Slyngshede) [12:46:05] (03update) 10aborrero: gitlab-ci: introduce tofu-provisioning code [repos/cloud/cicd/gitlab-ci] - 10https://gitlab.wikimedia.org/repos/cloud/cicd/gitlab-ci/-/merge_requests/51 (https://phabricator.wikimedia.org/T393686) [12:49:19] (03update) 10aborrero: gitlab-ci: introduce tofu-provisioning code [repos/cloud/cicd/gitlab-ci] - 10https://gitlab.wikimedia.org/repos/cloud/cicd/gitlab-ci/-/merge_requests/51 (https://phabricator.wikimedia.org/T393686) [12:54:06] 06cloud-services-team, 10Toolforge, 07Security: Remove srv-networktests from tools.admin - https://phabricator.wikimedia.org/T393775 (10taavi) 03NEW [12:54:20] (03update) 10aborrero: gitlab-ci: introduce tofu-provisioning code [repos/cloud/cicd/gitlab-ci] - 10https://gitlab.wikimedia.org/repos/cloud/cicd/gitlab-ci/-/merge_requests/51 (https://phabricator.wikimedia.org/T393686) [12:55:20] 06cloud-services-team, 10Toolforge, 07Security: Remove srv-networktests from tools.admin - https://phabricator.wikimedia.org/T393775#10807263 (10aborrero) +1 [12:55:26] 06cloud-services-team, 10Toolforge, 07Security: Remove srv-networktests from tools.admin - https://phabricator.wikimedia.org/T393775#10807264 (10taavi) [13:22:50] 06cloud-services-team, 10Toolforge: Unable to become hedgehogbot - https://phabricator.wikimedia.org/T393780 (10Newmcpe) 03NEW [13:24:10] 06cloud-services-team, 10Toolforge: Unable to become hedgehogbot - https://phabricator.wikimedia.org/T393780#10807409 (10taavi) →14Duplicate dup:03T393732 [13:24:11] 06cloud-services-team, 10Toolforge: Toolforge bastion sssd/LDAP flakiness (May 2025) - https://phabricator.wikimedia.org/T393732#10807411 (10taavi) [13:33:37] (03approved) 10fnegri: build.start: add use-latest-versions option [repos/cloud/toolforge/builds-cli] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/builds-cli/-/merge_requests/103 (https://phabricator.wikimedia.org/T380127) (owner: 10dcaro) [13:34:03] (03update) 10fnegri: build.start: add use-latest-versions option [repos/cloud/toolforge/builds-cli] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/builds-cli/-/merge_requests/103 (https://phabricator.wikimedia.org/T380127) (owner: 10dcaro) [13:46:19] 06cloud-services-team, 10Cloud-VPS: Investigate new Magnum drivers - https://phabricator.wikimedia.org/T393782 (10Andrew) 03NEW [13:47:01] 06cloud-services-team, 10Cloud-VPS: Test (and implement?) Openstack Octavia lbaas - https://phabricator.wikimedia.org/T393783 (10Andrew) 03NEW [14:10:18] 10Tool-fault-tolerance: Fault-tolerance tool should have a backend option - https://phabricator.wikimedia.org/T389612#10807538 (10Ladsgroup) 05Open→03Resolved a:03Ladsgroup https://fault-tolerance.toolforge.org/map?cluster=ms+backend [14:39:03] (03open) 10aborrero: tools: dns: drop docker-registry.tools.wmcloud.org [repos/cloud/toolforge/tofu-provisioning] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/tofu-provisioning/-/merge_requests/21 [14:39:21] (03update) 10aborrero: tools: dns: drop docker-registry.tools.wmcloud.org [repos/cloud/toolforge/tofu-provisioning] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/tofu-provisioning/-/merge_requests/21 [14:43:59] (03update) 10aborrero: tools: dns: drop docker-registry.tools.wmcloud.org [repos/cloud/toolforge/tofu-provisioning] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/tofu-provisioning/-/merge_requests/21 [14:45:53] 06cloud-services-team, 10Toolforge: [build-service] We should document which versions of Node.js, PHP, Go, etc. are supported - https://phabricator.wikimedia.org/T393789 (10fnegri) 03NEW [14:47:08] (03update) 10aborrero: dns: use zonename_recordname as opentofu state key [repos/cloud/toolforge/tofu-provisioning] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/tofu-provisioning/-/merge_requests/22 [14:47:10] (03open) 10aborrero: dns: use zonename_recordname as opentofu state key [repos/cloud/toolforge/tofu-provisioning] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/tofu-provisioning/-/merge_requests/22 [14:47:59] 10cloud-services-team (FY2024/2025-Q3-Q4), 10Toolforge (Toolforge iteration 19): [toolsdb] ToolsToolsDBReplicationLagIsTooHigh - 2025-05-09 - https://phabricator.wikimedia.org/T393766#10807705 (10fnegri) [14:49:08] (03update) 10aborrero: tofu-provisioning: drop imports [repos/cloud/toolforge/tofu-provisioning] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/tofu-provisioning/-/merge_requests/23 [14:49:11] (03open) 10aborrero: tofu-provisioning: drop imports [repos/cloud/toolforge/tofu-provisioning] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/tofu-provisioning/-/merge_requests/23 [15:00:03] 06cloud-services-team, 10Cloud-VPS: magnum/heat/cinder: "HTTP exception thrown: Invalid filters is_public are found in query options." - https://phabricator.wikimedia.org/T393791 (10Andrew) 03NEW [15:01:13] 06cloud-services-team, 10Cloud-VPS: magnum/heat/cinder: "HTTP exception thrown: Invalid filters is_public are found in query options." - https://phabricator.wikimedia.org/T393791#10807778 (10Andrew) Backend looks like this: ` 2025-05-09 14:56:54.119 3278 INFO cinder.api.openstack.wsgi [None req-dbfc2fcd-2826... [15:03:57] 06cloud-services-team, 10Cloud-VPS: trove: Unable to create user with IPv6 address as host - https://phabricator.wikimedia.org/T393760#10807796 (10Andrew) a:03Andrew [15:08:30] (03update) 10aborrero: gitlab-ci: introduce tofu-provisioning code [repos/cloud/cicd/gitlab-ci] - 10https://gitlab.wikimedia.org/repos/cloud/cicd/gitlab-ci/-/merge_requests/51 (https://phabricator.wikimedia.org/T393686) [16:23:41] 06cloud-services-team, 10Cloud-VPS, 13Patch-For-Review: magnum/heat/cinder: "HTTP exception thrown: Invalid filters is_public are found in query options." - https://phabricator.wikimedia.org/T393791#10808057 (10Andrew) 05Open→03Resolved This was because of resource_filters.json -- long ago we added a... [16:54:31] 06cloud-services-team, 10Toolforge: [build-service] We should document which versions of Node.js, PHP, Go, etc. are supported - https://phabricator.wikimedia.org/T393789#10808111 (10fnegri) [16:54:44] 10Tool-gitlab-content, 07Documentation: Add maintainer docs and user usage instructions to wikitech:Tool:Gitlab-content - https://phabricator.wikimedia.org/T393330#10808112 (10bd808) 05Open→03Resolved Things are happening at https://wikitech.wikimedia.org/wiki/Tool:Gitlab-content now. [16:55:22] 06cloud-services-team, 10Toolforge: [build-service] We should document which versions of Node.js, PHP, Go, etc. are supported - https://phabricator.wikimedia.org/T393789#10808114 (10fnegri) [17:29:06] 10cloud-services-team (Hardware), 06DC-Ops, 10ops-eqiad, 06SRE, 13Patch-For-Review: Q4:rack/setup/install clouddb102[1-4] - https://phabricator.wikimedia.org/T393733#10808192 (10fnegri) a:05fnegri→03None > update the site.pp file with the insetup role for your team Done in https://gerrit.wikimedia.o... [17:29:54] 10cloud-services-team (Hardware), 06DC-Ops, 10ops-eqiad, 06SRE, 13Patch-For-Review: Q4:rack/setup/install clouddb102[2-5] - https://phabricator.wikimedia.org/T393733#10808200 (10fnegri) [17:30:47] 10cloud-services-team (Hardware), 06DC-Ops, 10ops-eqiad, 06SRE: Q4:rack/setup/install clouddb102[2-5] - https://phabricator.wikimedia.org/T393733#10808204 (10fnegri) Please note that we should skip clouddb1021 as it existed in the past and was decom'd in {T368518}. I updated the task to rename the 4 new h... [17:31:33] !log raymond-ndibe@cloudcumin1001 toolsbeta START - Cookbook wmcs.toolforge.component.deploy for component api-gateway [17:31:37] !log raymond-ndibe@cloudcumin1001 toolsbeta END (ERROR) - Cookbook wmcs.toolforge.component.deploy (exit_code=97) for component api-gateway [17:31:53] !log raymond-ndibe@cloudcumin1001 toolsbeta START - Cookbook wmcs.toolforge.component.deploy for component api-gateway [17:38:30] (03update) 10chuckonwumelu: Importing: Floating IPs from Tools & Toolsbeta [repos/cloud/toolforge/tofu-provisioning] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/tofu-provisioning/-/merge_requests/20 (https://phabricator.wikimedia.org/T390056) [17:43:34] !log raymond-ndibe@cloudcumin1001 toolsbeta END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component api-gateway [17:49:42] (03update) 10raymond-ndibe: [toolforge-deploy] run specific tests on deploy [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/755 (https://phabricator.wikimedia.org/T381011) [17:50:14] (03update) 10raymond-ndibe: [toolforge-deploy] run specific tests on deploy [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/755 (https://phabricator.wikimedia.org/T381011) [17:51:43] (03update) 10chuckonwumelu: Importing: Floating IPs from Tools & Toolsbeta [repos/cloud/toolforge/tofu-provisioning] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/tofu-provisioning/-/merge_requests/20 (https://phabricator.wikimedia.org/T390056) [17:59:14] (03update) 10chuckonwumelu: Importing: Floating IPs from Tools & Toolsbeta [repos/cloud/toolforge/tofu-provisioning] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/tofu-provisioning/-/merge_requests/20 (https://phabricator.wikimedia.org/T390056) [19:26:20] 10Cloud-VPS (Quota-requests), 06Moderator-Tools-Team, 10Wikilink-Tool: Request to increase object storage capacity - Wikilink project - https://phabricator.wikimedia.org/T392870#10808452 (10Scardenasmolinar) Many thanks! This should be more than enough for the long term! [19:36:32] (03open) 10tburmeister: Finish styling of results, add legend, and fix a bug [toolforge-repos/tech-doc-metrics] - 10https://gitlab.wikimedia.org/toolforge-repos/tech-doc-metrics/-/merge_requests/4 [19:38:45] (03update) 10tburmeister: Finish styling of results, add legend, and fix a bug [toolforge-repos/tech-doc-metrics] - 10https://gitlab.wikimedia.org/toolforge-repos/tech-doc-metrics/-/merge_requests/4 (https://phabricator.wikimedia.org/T390390) [20:44:18] (03update) 10chuckonwumelu: Importing: Floating IPs from Tools & Toolsbeta [repos/cloud/toolforge/tofu-provisioning] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/tofu-provisioning/-/merge_requests/20 (https://phabricator.wikimedia.org/T390056) [20:49:24] (03update) 10raymond-ndibe: [toolforge-deploy] run specific tests on deploy [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/755 (https://phabricator.wikimedia.org/T381011) [20:52:03] (03update) 10chuckonwumelu: Importing: Floating IPs from Tools & Toolsbeta [repos/cloud/toolforge/tofu-provisioning] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/tofu-provisioning/-/merge_requests/20 (https://phabricator.wikimedia.org/T390056) [20:55:09] (03update) 10raymond-ndibe: [toolforge-deploy] run specific tests on deploy [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/755 (https://phabricator.wikimedia.org/T381011) [20:56:17] (03update) 10chuckonwumelu: Importing: Floating IPs from Tools & Toolsbeta [repos/cloud/toolforge/tofu-provisioning] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/tofu-provisioning/-/merge_requests/20 (https://phabricator.wikimedia.org/T390056) [20:57:38] (03update) 10raymond-ndibe: [toolforge-deploy] run specific tests on deploy [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/755 (https://phabricator.wikimedia.org/T381011) [20:58:48] (03update) 10chuckonwumelu: Importing: Floating IPs from Tools & Toolsbeta [repos/cloud/toolforge/tofu-provisioning] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/tofu-provisioning/-/merge_requests/20 (https://phabricator.wikimedia.org/T390056) [21:05:48] (03update) 10raymond-ndibe: [toolforge-deploy] run specific tests on deploy [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/755 (https://phabricator.wikimedia.org/T381011) [21:06:28] (03CR) 10Raymond Ndibe: "Done" [cloud/wmcs-cookbooks] - 10https://gerrit.wikimedia.org/r/1140246 (https://phabricator.wikimedia.org/T381011) (owner: 10Raymond Ndibe) [21:09:55] !log raymond-ndibe@cloudcumin1001 toolsbeta START - Cookbook wmcs.toolforge.component.deploy for component builds-api [21:10:13] !log raymond-ndibe@cloudcumin1001 toolsbeta END (FAIL) - Cookbook wmcs.toolforge.component.deploy (exit_code=99) for component builds-api [21:15:54] (03PS27) 10Raymond Ndibe: toolforge: run specific tests on deploy [cloud/wmcs-cookbooks] - 10https://gerrit.wikimedia.org/r/1140246 (https://phabricator.wikimedia.org/T381011) [21:16:06] !log raymond-ndibe@cloudcumin1001 toolsbeta START - Cookbook wmcs.toolforge.component.deploy for component builds-api [21:16:28] !log raymond-ndibe@cloudcumin1001 toolsbeta END (FAIL) - Cookbook wmcs.toolforge.component.deploy (exit_code=99) for component builds-api [21:17:06] !log raymond-ndibe@cloudcumin1001 toolsbeta START - Cookbook wmcs.toolforge.component.deploy for component builds-api [21:17:07] !log raymond-ndibe@cloudcumin1001 toolsbeta END (ERROR) - Cookbook wmcs.toolforge.component.deploy (exit_code=97) for component builds-api [21:19:17] !log raymond-ndibe@cloudcumin1001 toolsbeta START - Cookbook wmcs.toolforge.component.deploy for component builds-api [21:19:34] !log raymond-ndibe@cloudcumin1001 toolsbeta END (FAIL) - Cookbook wmcs.toolforge.component.deploy (exit_code=99) for component builds-api [21:19:56] !log raymond-ndibe@cloudcumin1001 toolsbeta START - Cookbook wmcs.toolforge.component.deploy for component builds-api [21:20:12] !log raymond-ndibe@cloudcumin1001 toolsbeta END (FAIL) - Cookbook wmcs.toolforge.component.deploy (exit_code=99) for component builds-api [21:44:29] (03PS28) 10Raymond Ndibe: toolforge: run specific tests on deploy [cloud/wmcs-cookbooks] - 10https://gerrit.wikimedia.org/r/1140246 (https://phabricator.wikimedia.org/T381011) [21:44:57] !log raymond-ndibe@cloudcumin1001 toolsbeta START - Cookbook wmcs.toolforge.component.deploy for component builds-api [21:45:18] !log raymond-ndibe@cloudcumin1001 toolsbeta END (FAIL) - Cookbook wmcs.toolforge.component.deploy (exit_code=99) for component builds-api [21:47:01] !log raymond-ndibe@cloudcumin1001 toolsbeta START - Cookbook wmcs.toolforge.component.deploy for component builds-api [21:47:18] !log raymond-ndibe@cloudcumin1001 toolsbeta END (FAIL) - Cookbook wmcs.toolforge.component.deploy (exit_code=99) for component builds-api [21:49:11] !log raymond-ndibe@cloudcumin1001 toolsbeta START - Cookbook wmcs.toolforge.component.deploy for component builds-api [21:49:28] !log raymond-ndibe@cloudcumin1001 toolsbeta END (FAIL) - Cookbook wmcs.toolforge.component.deploy (exit_code=99) for component builds-api [21:53:26] (03open) 10bd808: Improve help text [toolforge-repos/gitlab-content] - 10https://gitlab.wikimedia.org/toolforge-repos/gitlab-content/-/merge_requests/5 [21:53:44] (03PS29) 10Raymond Ndibe: toolforge: run specific tests on deploy [cloud/wmcs-cookbooks] - 10https://gerrit.wikimedia.org/r/1140246 (https://phabricator.wikimedia.org/T381011) [21:54:07] 06cloud-services-team, 10Toolforge: [build-service] We should document which versions of Node.js, PHP, Go, etc. are supported - https://phabricator.wikimedia.org/T393789#10808762 (10dcaro) It's a bit tricky to get the exact version the builder has. You can get to it following the link https://github.com/herok... [21:54:25] !log raymond-ndibe@cloudcumin1001 toolsbeta START - Cookbook wmcs.toolforge.component.deploy for component builds-api [21:54:44] !log raymond-ndibe@cloudcumin1001 toolsbeta END (FAIL) - Cookbook wmcs.toolforge.component.deploy (exit_code=99) for component builds-api [21:56:25] 06cloud-services-team, 10Toolforge: [build-service] We should document which versions of Node.js, PHP, Go, etc. are supported - https://phabricator.wikimedia.org/T393789#10808763 (10dcaro) Note also that he build packs might or might not limit the runtime version (ex. Nodes) to some extent. Some build packs in... [21:56:38] !log raymond-ndibe@cloudcumin1001 toolsbeta START - Cookbook wmcs.toolforge.component.deploy for component builds-api [21:56:54] !log raymond-ndibe@cloudcumin1001 toolsbeta END (FAIL) - Cookbook wmcs.toolforge.component.deploy (exit_code=99) for component builds-api [22:00:40] !log raymond-ndibe@cloudcumin1001 toolsbeta START - Cookbook wmcs.toolforge.component.deploy for component builds-api [22:01:00] !log raymond-ndibe@cloudcumin1001 toolsbeta END (FAIL) - Cookbook wmcs.toolforge.component.deploy (exit_code=99) for component builds-api [22:01:20] (03update) 10bd808: Improve help text [toolforge-repos/gitlab-content] - 10https://gitlab.wikimedia.org/toolforge-repos/gitlab-content/-/merge_requests/5 [22:06:28] (03merge) 10bd808: Improve help text [toolforge-repos/gitlab-content] - 10https://gitlab.wikimedia.org/toolforge-repos/gitlab-content/-/merge_requests/5 [22:07:54] (03PS30) 10Raymond Ndibe: toolforge: run specific tests on deploy [cloud/wmcs-cookbooks] - 10https://gerrit.wikimedia.org/r/1140246 (https://phabricator.wikimedia.org/T381011) [22:08:12] !log raymond-ndibe@cloudcumin1001 toolsbeta START - Cookbook wmcs.toolforge.component.deploy for component builds-api [22:10:23] !log raymond-ndibe@cloudcumin1001 toolsbeta END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component builds-api [22:11:49] !log raymond-ndibe@cloudcumin1001 toolsbeta START - Cookbook wmcs.toolforge.component.deploy for component builds-api [22:18:19] !log raymond-ndibe@cloudcumin1001 toolsbeta END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component builds-api [22:39:03] 10Tool-gitlab-content, 07User-notice, 03Wikimedia-Hackathon-2025: Implement a reverse proxy for gitlab.wikimedia.org raw content that supports mime-type specification - https://phabricator.wikimedia.org/T392431#10808844 (10bd808) Announced to wikitech-l: https://lists.wikimedia.org/hyperkitty/list/wikitech-l... [22:46:35] 10Tool-gitlab-content, 07User-notice, 03Wikimedia-Hackathon-2025: Implement a reverse proxy for gitlab.wikimedia.org raw content that supports mime-type specification - https://phabricator.wikimedia.org/T392431#10808847 (10bd808) >>! In T392431#10802966, @UOzurumba wrote: > Hello @bd808, for tech news - What... [23:03:52] (03CR) 10Krinkle: "Much welcomed! I recommend creating a Phab task for this to track the various patches and make it easier to find one from the other." [labs/countervandalism/CVNBot] - 10https://gerrit.wikimedia.org/r/1143806 (owner: 10Slyngshede)