[00:05:32] <wikibugs>	 06cloud-services-team, 10Cloud-VPS: Prepare cloud-vps haproxy configs to work on debian trixie - https://phabricator.wikimedia.org/T409580#11357023 (10Andrew) 05Open→03Resolved
[05:06:17] <wikibugs>	 10Tool-extjsonuploader, 07Code-Health, 13Patch-Needs-Improvement, 07Test-Coverage: Display extension test coverage in infobox - https://phabricator.wikimedia.org/T220939#11357133 (10Pppery)
[05:26:25] <wikibugs>	 06cloud-services-team, 10Quarry: [quarry] ensure that the DB and the models are in sync - https://phabricator.wikimedia.org/T288523#11357202 (10Pppery)
[06:45:51] <wikibugs>	 (03update) 10nurahwakili: T407551-Add author form [toolforge-repos/paulina] - 10https://gitlab.wikimedia.org/toolforge-repos/paulina/-/merge_requests/124
[08:48:07] <wikibugs>	 (03open) 10dcaro: core: move images code here [repos/cloud/toolforge/jobs-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/jobs-api/-/merge_requests/247
[09:00:22] <wikibugs>	 10Tool-yearinreview, 10MediaWiki-extensions-Translate, 06LPL Essential (FY26 Q2), 07Unplanned-Sprint-Work, 06Wikipedia-Android-App-Backlog (Android Release - FY2025-26): PLURAL syntax validator gets confused by other uses of equals signs in the message, ... - https://phabricator.wikimedia.org/T409655#11357417
[09:02:46] <wikibugs>	 (03update) 10volans: logging: add tracing loki instance [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1040 (https://phabricator.wikimedia.org/T399313)
[09:08:00] <wikibugs>	 06cloud-services-team, 10Cloud-VPS, 10VideoCutTool: [alerting] Create alerts for cloud-vps/VideoCutTool app - https://phabricator.wikimedia.org/T409668#11357438 (10fnegri) a:03fnegri
[09:17:23] <wikibugs>	 06cloud-services-team, 10Cloud-VPS, 10VideoCutTool: [alerting] Create alerts for cloud-vps/VideoCutTool app - https://phabricator.wikimedia.org/T409668#11357482 (10fnegri) p:05Triage→03Medium
[09:17:33] <wikibugs>	 06cloud-services-team, 10Cloud-VPS: Upgrade cloud-vps hosts to Debian Trixie - https://phabricator.wikimedia.org/T409579#11357483 (10fnegri) p:05Triage→03Medium
[09:17:46] <wikibugs>	 06cloud-services-team, 10Data-Services, 13Patch-For-Review: Add support for x1 and x4 sections on wiki replicas on the load balancer layer - https://phabricator.wikimedia.org/T409560#11357484 (10fnegri) p:05Triage→03Medium
[09:17:57] <wikibugs>	 06cloud-services-team, 10Toolforge, 07Sustainability (Incident Followup): Add filesystem space alerts for tools(db) - https://phabricator.wikimedia.org/T409404#11357485 (10fnegri) p:05Triage→03High
[10:08:16] <wikibugs>	 06cloud-services-team, 10Toolforge, 10Tools: Geohack tool frequently triggers the Toolforge front proxy's per-tool rate limit due to too much traffic - https://phabricator.wikimedia.org/T409185#11357778 (10Magnus) Would it help if I rewrote it in Rust, with some caching? Should at least lower the CPU load...
[10:16:57] <wikibugs>	 06cloud-services-team, 10Cloud-VPS: Tell Neutron the physical network has jumbo frames enabled - https://phabricator.wikimedia.org/T409544#11357851 (10taavi) a:03taavi
[10:31:06] <wikibugs>	 06cloud-services-team, 10Cloud-VPS (Project-requests): CloudVPS instance for ProVe - https://phabricator.wikimedia.org/T408387#11357872 (10Odinaldo) Hi Andrew,  Many thanks for your response. We are trying to find out whom to contact to move this forward and understand all that is involved. Do you know who we...
[10:52:38] <wikibugs>	 (03PS1) 10Tiziano Fogli: metamonitoring/icinga/ext-mon: add dummy basic auth info [labs/private] - 10https://gerrit.wikimedia.org/r/1203405 (https://phabricator.wikimedia.org/T397003)
[10:52:45] <wikibugs>	 (03CR) 10Tiziano Fogli: [C:03+2] metamonitoring/icinga/ext-mon: add dummy basic auth info [labs/private] - 10https://gerrit.wikimedia.org/r/1203405 (https://phabricator.wikimedia.org/T397003) (owner: 10Tiziano Fogli)
[10:52:47] <wikibugs>	 (03CR) 10Tiziano Fogli: [V:03+2 C:03+2] metamonitoring/icinga/ext-mon: add dummy basic auth info [labs/private] - 10https://gerrit.wikimedia.org/r/1203405 (https://phabricator.wikimedia.org/T397003) (owner: 10Tiziano Fogli)
[11:35:52] <wikibugs>	 06cloud-services-team (FY2025/26-Q1), 10Toolforge, 07Sustainability (Incident Followup): [toolsdb] ibdata1 growing on primary - https://phabricator.wikimedia.org/T409716 (10fnegri) 03NEW
[11:38:36] <wikibugs>	 06cloud-services-team (FY2025/26-Q1), 10Toolforge, 07Sustainability (Incident Followup): [toolsdb] ibdata1 growing on primary - https://phabricator.wikimedia.org/T409716#11358079 (10fnegri) 05Open→03In progress p:05Triage→03High
[11:58:12] <wikibugs>	 06cloud-services-team, 10Cloud-VPS, 05Cloud-Services-Origin-Team, 07Cloud-Services-Worktype-Unplanned: [ceph] Investigate if there's a way to degrade instead of failing when jumbo frames are being dropped in the network - https://phabricator.wikimedia.org/T329778#11358179 (10cmooney) I think there are esse...
[12:00:54] <wikibugs>	 06cloud-services-team (FY2025/26-Q1), 10Toolforge, 07Sustainability (Incident Followup): [toolsdb] ibdata1 growing on primary - https://phabricator.wikimedia.org/T409716#11358186 (10fnegri) Looking at `SHOW ENGINE INNODB STATUS` I can see some slow transactions with a big "undo log". These transactions seem...
[12:02:57] <wikibugs>	 06cloud-services-team (FY2025/26-Q1), 10Toolforge, 07Sustainability (Incident Followup): [toolsdb] ibdata1 growing on primary - https://phabricator.wikimedia.org/T409716#11358205 (10fnegri)
[12:11:47] <wikibugs>	 06cloud-services-team (FY2025/26-Q1), 10Toolforge, 07Sustainability (Incident Followup): [toolsdb] ibdata1 growing on primary - https://phabricator.wikimedia.org/T409716#11358232 (10fnegri) @JeanFred @Multichill it looks like the `heritage` tool is using very long transactions on ToolsDB (see the one below t...
[12:16:31] <wikibugs>	 (03update) 10volans: logging: add tracing loki instance [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1040 (https://phabricator.wikimedia.org/T399313)
[12:19:35] <wikibugs>	 (03update) 10volans: logging: add tracing loki instance [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1040 (https://phabricator.wikimedia.org/T399313)
[12:23:29] <wikibugs>	 (03update) 10volans: logging: add tracing loki instance [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1040 (https://phabricator.wikimedia.org/T399313)
[12:41:07] <wikibugs>	 (03open) 10l10n-bot: Localisation updates from https://translatewiki.net. [toolforge-repos/wd-image-positions] - 10https://gitlab.wikimedia.org/toolforge-repos/wd-image-positions/-/merge_requests/52
[12:41:09] <wikibugs>	 (03open) 10l10n-bot: Localisation updates from https://translatewiki.net. [toolforge-repos/lexeme-forms] - 10https://gitlab.wikimedia.org/toolforge-repos/lexeme-forms/-/merge_requests/20
[12:42:54] <wikibugs>	 (03approved) 10dcaro: kind: add port 30004 for loki-tracing [repos/cloud/toolforge/lima-kilo] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/lima-kilo/-/merge_requests/294 (https://phabricator.wikimedia.org/T399313) (owner: 10volans)
[12:43:29] <wikibugs>	 (03CR) 10CI reject: [V:04-1] Localisation updates from https://translatewiki.net. [labs/tools/massmailer] - 10https://gerrit.wikimedia.org/r/1203438 (owner: 10L10n-bot)
[12:43:30] <wikibugs>	 (03CR) 10CI reject: [V:04-1] Localisation updates from https://translatewiki.net. [labs/tools/commons-mass-description] - 10https://gerrit.wikimedia.org/r/1203436 (owner: 10L10n-bot)
[12:43:33] <wikibugs>	 (03CR) 10CI reject: [V:04-1] Localisation updates from https://translatewiki.net. [labs/tools/map-of-monuments] - 10https://gerrit.wikimedia.org/r/1203440 (owner: 10L10n-bot)
[12:43:34] <wikibugs>	 (03CR) 10CI reject: [V:04-1] Localisation updates from https://translatewiki.net. [labs/tools/weapon-of-mass-description] - 10https://gerrit.wikimedia.org/r/1203442 (owner: 10L10n-bot)
[12:50:19] <wikibugs>	 (03update) 10dcaro: core: move images code here [repos/cloud/toolforge/jobs-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/jobs-api/-/merge_requests/247
[12:53:15] <wikibugs>	 (03update) 10dcaro: [build] run pipeline cleanup per repo [repos/cloud/toolforge/builds-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/builds-api/-/merge_requests/142 (https://phabricator.wikimedia.org/T404157) (owner: 10raymond-ndibe)
[13:04:15] <wikibugs>	 (03open) 10taavi: Move web alerts to a new group [repos/cloud/toolforge/alerts] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/alerts/-/merge_requests/47 (https://phabricator.wikimedia.org/T408457)
[13:04:52] <wikibugs>	 (03update) 10taavi: Add toolviews alerting [repos/cloud/toolforge/alerts] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/alerts/-/merge_requests/47 (https://phabricator.wikimedia.org/T408457)
[13:06:41] <wikibugs>	 06cloud-services-team, 10Toolforge (Toolforge iteration 25): [jobs-api,webservice] Fetch images from builds-api - https://phabricator.wikimedia.org/T409725 (10dcaro) 03NEW
[13:07:43] <wikibugs>	 06cloud-services-team, 10Toolforge (Toolforge iteration 25): [builds-api] Add an endpoint to get all available images - https://phabricator.wikimedia.org/T409726 (10dcaro) 03NEW
[13:16:29] <wikibugs>	 06cloud-services-team, 10Toolforge (Toolforge iteration 25): [builds-api,harbor,image-config] Move pre-built images to harbor - https://phabricator.wikimedia.org/T409727 (10dcaro) 03NEW
[13:17:21] <wikibugs>	 06cloud-services-team, 10Toolforge (Toolforge iteration 25): [builds-api] Add an endpoint to get all available images - https://phabricator.wikimedia.org/T409726#11358468 (10dcaro)
[13:17:48] <wikibugs>	 06cloud-services-team, 10Toolforge (Toolforge iteration 25): [jobs-api,webservice] Fetch images from builds-api - https://phabricator.wikimedia.org/T409725#11358470 (10dcaro)
[13:19:39] <wikibugs>	 06cloud-services-team, 10Toolforge (Toolforge iteration 25): [image-config] deprecate and move all data to builds-api - https://phabricator.wikimedia.org/T409728 (10dcaro) 03NEW
[13:19:48] <wikibugs>	 06cloud-services-team, 10Toolforge (Toolforge iteration 25): [image-config] deprecate and move all data to builds-api - https://phabricator.wikimedia.org/T409728#11358491 (10dcaro)
[13:19:56] <wikibugs>	 06cloud-services-team, 10Toolforge (Toolforge iteration 25): [jobs-api,webservice] Fetch images from builds-api - https://phabricator.wikimedia.org/T409725#11358492 (10dcaro)
[13:20:05] <wikibugs>	 06cloud-services-team, 10Toolforge (Toolforge iteration 25): [jobs-api,webservice] Fetch images from builds-api - https://phabricator.wikimedia.org/T409725#11358493 (10dcaro)
[13:20:14] <wikibugs>	 06cloud-services-team, 10Toolforge (Toolforge iteration 25), 07Epic: [jobs-api,webservice] Run webservices via the jobs framework - https://phabricator.wikimedia.org/T348755#11358494 (10dcaro)
[13:32:13] <wikibugs>	 10Toolforge, 06tools-infrastructure-team, 13Patch-For-Review: Add monitoring to check that toolviews process is successfully working - https://phabricator.wikimedia.org/T408457#11358554 (10taavi)
[13:32:16] <wikibugs>	 (03update) 10dcaro: core: move images code here [repos/cloud/toolforge/jobs-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/jobs-api/-/merge_requests/247
[13:38:48] <wikibugs>	 (03update) 10dcaro: runtime - move image from url logic to class [repos/cloud/toolforge/jobs-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/jobs-api/-/merge_requests/246 (owner: 10damian)
[13:38:53] <wikibugs>	 (03update) 10dcaro: runtime - move image from url logic to class [repos/cloud/toolforge/jobs-api] (move_images) - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/jobs-api/-/merge_requests/246 (owner: 10damian)
[13:39:43] <wikibugs>	 (03update) 10dcaro: runtime - move image from url logic to class [repos/cloud/toolforge/jobs-api] (move_images) - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/jobs-api/-/merge_requests/246 (owner: 10damian)
[13:42:15] <wikibugs>	 (03update) 10dcaro: runtime - move image from url logic to class [repos/cloud/toolforge/jobs-api] (move_images) - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/jobs-api/-/merge_requests/246 (owner: 10damian)
[13:42:27] <wikibugs>	 (03approved) 10dcaro: runtime - move image from url logic to class [repos/cloud/toolforge/jobs-api] (move_images) - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/jobs-api/-/merge_requests/246 (owner: 10damian)
[13:43:42] <wikibugs>	 (03update) 10dcaro: [build] run pipeline cleanup per repo [repos/cloud/toolforge/builds-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/builds-api/-/merge_requests/142 (https://phabricator.wikimedia.org/T404157) (owner: 10raymond-ndibe)
[13:43:44] <wikibugs>	 06cloud-services-team, 10Cloud-VPS: MTU setting in IPv6 VMs causes issues with Docker - https://phabricator.wikimedia.org/T408543#11358595 (10taavi) a:03taavi
[13:44:31] <wikibugs>	 (03open) 10taavi: Set MTU 1500 for VXLAN networks in codfw1dev [repos/cloud/cloud-vps/tofu-infra] - 10https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/280 (https://phabricator.wikimedia.org/T408543)
[13:44:35] <wikibugs>	 (03update) 10taavi: Set MTU 1500 for VXLAN networks in codfw1dev [repos/cloud/cloud-vps/tofu-infra] - 10https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/280 (https://phabricator.wikimedia.org/T408543)
[13:45:14] <wikibugs>	 (03update) 10dcaro: core: normalize job images [repos/cloud/toolforge/jobs-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/jobs-api/-/merge_requests/245 (owner: 10damian)
[13:45:35] <wikibugs>	 (03update) 10dcaro: core: normalize job images [repos/cloud/toolforge/jobs-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/jobs-api/-/merge_requests/245 (owner: 10damian)
[13:49:30] <wikibugs>	 (03update) 10dcaro: core: normalize job images [repos/cloud/toolforge/jobs-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/jobs-api/-/merge_requests/245 (owner: 10damian)
[13:50:13] <wikibugs>	 (03update) 10dcaro: core: normalize job images [repos/cloud/toolforge/jobs-api] (move_images) - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/jobs-api/-/merge_requests/245 (owner: 10damian)
[13:52:20] <wikibugs>	 10Tool-yearinreview, 10MediaWiki-extensions-Translate, 06Wikipedia-Android-App-Backlog, 06LPL Essential (FY26 Q2), 07Unplanned-Sprint-Work: PLURAL syntax validator gets confused by other uses of equals signs in the message, as seen at [[Wikimedia:Wikiped... - https://phabricator.wikimedia.org/T409655#11358653
[13:55:53] <wikibugs>	 10Tool-yearinreview, 10MediaWiki-extensions-Translate, 06Wikipedia-Android-App-Backlog, 06LPL Essential (FY26 Q2), 07Unplanned-Sprint-Work: PLURAL syntax validator gets confused by other uses of equals signs in the message, as seen at [[Wikimedia:Wikiped... - https://phabricator.wikimedia.org/T409655#11358674
[14:00:34] <wikibugs>	 10Tool-yearinreview, 10MediaWiki-extensions-Translate, 06Wikipedia-Android-App-Backlog, 06LPL Essential (FY26 Q2), 07Unplanned-Sprint-Work: PLURAL syntax validator gets confused by other uses of equals signs in the message, as seen at [[Wikimedia:Wikiped... - https://phabricator.wikimedia.org/T409655#11358692
[14:25:42] <logmsgbot_cloud>	 !log taavi@cloudcumin1001 admin START - Cookbook wmcs.openstack.restart_openstack on deployment codfw1dev for service: project,neutron
[14:27:12] <logmsgbot_cloud>	 !log taavi@cloudcumin1001 admin END (PASS) - Cookbook wmcs.openstack.restart_openstack (exit_code=0) on deployment codfw1dev for service: project,neutron
[14:28:39] <wikibugs>	 (03update) 10nurahwakili: T407551-Add author form [toolforge-repos/paulina] - 10https://gitlab.wikimedia.org/toolforge-repos/paulina/-/merge_requests/124
[14:28:52] <logmsgbot_cloud>	 !log taavi@cloudcumin1001 admin START - Cookbook wmcs.openstack.roll_reboot_cloudnets
[14:28:56] <logmsgbot_cloud>	 !log taavi@cloudcumin1001 admin END (FAIL) - Cookbook wmcs.openstack.roll_reboot_cloudnets (exit_code=99)
[14:35:05] <wikibugs>	 06cloud-services-team, 10Data-Services, 10Toolforge, 06Product-Analytics: Tools Automoderator and Content Translation metrics can't access tools.db.svc.eqiad.wmflabs - https://phabricator.wikimedia.org/T409734 (10KCVelaga_WMF) 03NEW
[14:35:51] <wikibugs>	 06cloud-services-team, 10Data-Services, 10Toolforge, 06Product-Analytics: Tools Automoderator and Content Translation metrics can't access tools.db.svc.eqiad.wmflabs - https://phabricator.wikimedia.org/T409734#11358855 (10KCVelaga_WMF) p:05Triage→03High Triaging this as high as it affecting at least tw...
[14:36:38] <wikibugs>	 06cloud-services-team, 10Data-Services, 10Toolforge, 06Product-Analytics: Tools Automoderator and Content Translation metrics can't access tools.db.svc.eqiad.wmflabs - https://phabricator.wikimedia.org/T409734#11358861 (10KCVelaga_WMF)
[14:38:13] <wikibugs>	 06cloud-services-team, 10Data-Services, 10Toolforge, 06Product-Analytics: Tools Automoderator and Content Translation metrics can't access tools.db.svc.eqiad.wmflabs - https://phabricator.wikimedia.org/T409734#11358876 (10KCVelaga_WMF) @bd808 Any thoughts on this? As the errors seem similar to T189386 & T1...
[14:39:21] <wikibugs>	 06cloud-services-team, 10Toolforge, 06Product-Analytics: Tools Automoderator and Content Translation metrics can't access tools.db.svc.eqiad.wmflabs - https://phabricator.wikimedia.org/T409734#11358880 (10taavi) p:05High→03Triage
[14:39:33] <wikibugs>	 (03update) 10dcaro: core: move images code here [repos/cloud/toolforge/jobs-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/jobs-api/-/merge_requests/247
[14:41:26] <wikibugs>	 (03approved) 10dcaro: core: move images code here [repos/cloud/toolforge/jobs-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/jobs-api/-/merge_requests/247
[14:42:09] <wikibugs>	 (03merge) 10dcaro: core: move images code here [repos/cloud/toolforge/jobs-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/jobs-api/-/merge_requests/247
[14:42:22] <wikibugs>	 06cloud-services-team, 10Cloud-VPS, 07Upstream: codfw1dev has seen neutron metadata agents down since epoxy upgrade - https://phabricator.wikimedia.org/T395255#11358902 (10Andrew) This wasn't applied yet on codfw1dev but now it is.
[14:43:13] <logmsgbot_cloud>	 !log taavi@cloudcumin1001 admin START - Cookbook wmcs.openstack.roll_reboot_cloudnets
[14:43:27] <wikibugs>	 (03update) 10dcaro: runtime - move image from url logic to class [repos/cloud/toolforge/jobs-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/jobs-api/-/merge_requests/246 (owner: 10damian)
[14:44:42] <wikibugs>	 (03update) 10group_203_bot_f4d95069bb2675e4ce1fff090c1c1620: jobs-api: bump to 0.0.450-20251110144221-8123c149 [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1062
[14:44:46] <wikibugs>	 (03open) 10group_203_bot_f4d95069bb2675e4ce1fff090c1c1620: jobs-api: bump to 0.0.450-20251110144221-8123c149 [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1062
[14:47:36] <wikibugs>	 (03update) 10dcaro: runtime - move image from url logic to class [repos/cloud/toolforge/jobs-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/jobs-api/-/merge_requests/246 (owner: 10damian)
[14:50:40] <wikibugs>	 (03update) 10dcaro: core: normalize job images [repos/cloud/toolforge/jobs-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/jobs-api/-/merge_requests/245 (owner: 10damian)
[14:52:07] <wikibugs>	 06cloud-services-team, 10Toolforge, 06Product-Analytics: Tools Automoderator and Content Translation metrics can't access tools.db.svc.eqiad.wmflabs - https://phabricator.wikimedia.org/T409734#11358983 (10fnegri) I can connect successfully using the credentials found in both `replica.my.cnf` and in the toolf...
[14:53:30] <logmsgbot_cloud>	 !log taavi@cloudcumin1001 admin END (PASS) - Cookbook wmcs.openstack.roll_reboot_cloudnets (exit_code=0)
[14:55:54] <wikibugs>	 (03merge) 10dcaro: runtime - move image from url logic to class [repos/cloud/toolforge/jobs-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/jobs-api/-/merge_requests/246 (owner: 10damian)
[14:58:18] <wikibugs>	 (03update) 10group_203_bot_f4d95069bb2675e4ce1fff090c1c1620: jobs-api: bump to 0.0.451-20251110145609-be3599fb [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1062
[14:58:22] <wikibugs>	 (03update) 10group_203_bot_f4d95069bb2675e4ce1fff090c1c1620: jobs-api: bump to 0.0.451-20251110145609-be3599fb [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1062
[15:00:25] <wikibugs>	 06cloud-services-team, 10Toolforge, 06Product-Analytics: Tools Automoderator and Content Translation metrics can't access tools.db.svc.eqiad.wmflabs - https://phabricator.wikimedia.org/T409734#11359019 (10fnegri) This is also working fine from inside a pod using the same image as your tool:  `lang=shell-sess...
[15:06:15] <wikibugs>	 (03approved) 10dcaro: Add toolviews alerting [repos/cloud/toolforge/alerts] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/alerts/-/merge_requests/47 (https://phabricator.wikimedia.org/T408457) (owner: 10taavi)
[15:07:22] <wikibugs>	 10Tool-yearinreview, 10MediaWiki-extensions-Translate, 06Wikipedia-Android-App-Backlog, 06LPL Essential (FY26 Q2), 07Unplanned-Sprint-Work: PLURAL syntax validator gets confused by other uses of equals signs in the message, as seen at [[Wikimedia:Wikiped... - https://phabricator.wikimedia.org/T409655#11359074
[15:08:32] <wikibugs>	 (03merge) 10taavi: Add toolviews alerting [repos/cloud/toolforge/alerts] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/alerts/-/merge_requests/47 (https://phabricator.wikimedia.org/T408457)
[15:09:00] <wikibugs>	 10Toolforge, 06tools-infrastructure-team, 13Patch-For-Review: Add monitoring to check that toolviews process is successfully working - https://phabricator.wikimedia.org/T408457#11359082 (10taavi) 05Open→03Resolved
[15:11:06] <wikibugs>	 (03update) 10fnegri: core: move images code here [repos/cloud/toolforge/jobs-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/jobs-api/-/merge_requests/247 (owner: 10dcaro)
[15:12:20] <wikibugs>	 10Tool-yearinreview, 10MediaWiki-extensions-Translate, 06Wikipedia-Android-App-Backlog, 06LPL Essential (FY26 Q2), 07Unplanned-Sprint-Work: PLURAL syntax validator gets confused by other uses of equals signs in the message, as seen at [[Wikimedia:Wikiped... - https://phabricator.wikimedia.org/T409655#11359122
[15:14:43] <logmsgbot_cloud>	 !log dcaro@cloudcumin1001 toolsbeta START - Cookbook wmcs.toolforge.component.deploy for component jobs-api
[15:20:26] <wikibugs>	 06cloud-services-team, 10Toolforge, 06Product-Analytics: Tools Automoderator and Content Translation metrics can't access tools.db.svc.eqiad.wmflabs - https://phabricator.wikimedia.org/T409734#11359138 (10KCVelaga_WMF) Okay, I don't know what happened, I re-ran the scripts manually again, they ran fine. Not...
[15:27:10] <logmsgbot_cloud>	 !log dcaro@cloudcumin1001 toolsbeta END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component jobs-api
[15:30:03] <wikibugs>	 10Tool-yearinreview, 10MediaWiki-extensions-Translate, 06Wikipedia-Android-App-Backlog, 06LPL Essential (FY26 Q2), 07Unplanned-Sprint-Work: PLURAL syntax validator gets confused by other uses of equals signs in the message, as seen at [[Wikimedia:Wikiped... - https://phabricator.wikimedia.org/T409655#11359166
[15:32:33] <logmsgbot_cloud>	 !log dcaro@cloudcumin1001 tools START - Cookbook wmcs.toolforge.component.deploy for component jobs-api
[15:33:19] <logmsgbot_cloud>	 !log taavi@cloudcumin1001 admin START - Cookbook wmcs.openstack.tofu running tofu plan for https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/280
[15:33:54] <logmsgbot_cloud>	 !log taavi@cloudcumin1001 admin END (PASS) - Cookbook wmcs.openstack.tofu (exit_code=0) running tofu plan for https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/280
[15:35:05] <logmsgbot_cloud>	 !log taavi@cloudcumin1001 admin START - Cookbook wmcs.openstack.tofu running tofu plan for https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/280
[15:35:05] <wikibugs>	 (03update) 10taavi: Set MTU 1500 for VXLAN networks in codfw1dev [repos/cloud/cloud-vps/tofu-infra] - 10https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/280 (https://phabricator.wikimedia.org/T408543)
[15:35:40] <logmsgbot_cloud>	 !log taavi@cloudcumin1001 admin END (PASS) - Cookbook wmcs.openstack.tofu (exit_code=0) running tofu plan for https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/280
[15:36:42] <wikibugs>	 (03update) 10taavi: Set MTU 1500 for VXLAN networks in codfw1dev [repos/cloud/cloud-vps/tofu-infra] - 10https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/280 (https://phabricator.wikimedia.org/T408543)
[15:36:43] <logmsgbot_cloud>	 !log taavi@cloudcumin1001 admin START - Cookbook wmcs.openstack.tofu running tofu plan for https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/280
[15:37:18] <logmsgbot_cloud>	 !log taavi@cloudcumin1001 admin END (PASS) - Cookbook wmcs.openstack.tofu (exit_code=0) running tofu plan for https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/280
[15:37:50] <wikibugs>	 (03update) 10taavi: Set MTU 1500 for VXLAN networks in codfw1dev [repos/cloud/cloud-vps/tofu-infra] - 10https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/280 (https://phabricator.wikimedia.org/T408543)
[15:39:08] <wikibugs>	 06cloud-services-team, 10Cloud-VPS: cookbooks group GitLab access token about to expire - https://phabricator.wikimedia.org/T409741 (10taavi) 03NEW p:05Triage→03High
[15:40:02] <wikibugs>	 06cloud-services-team, 10Toolforge, 06Product-Analytics: Tools Automoderator and Content Translation metrics can't access tools.db.svc.eqiad.wmflabs - https://phabricator.wikimedia.org/T409734#11359229 (10fnegri) Maybe related to this ToolsDB outage last week? Does the timing match? {T409244}
[15:41:06] <wikibugs>	 06cloud-services-team, 10Toolforge, 06Infrastructure-Foundations, 10netops: Create new VRF and networks for Toolforge-on-Metal - https://phabricator.wikimedia.org/T409309#11359235 (10cmooney) p:05Triage→03Medium
[15:43:34] <wikibugs>	 06cloud-services-team (FY2025/26-Q1), 10Toolforge, 07Sustainability (Incident Followup): [toolsdb] ibdata1 growing on primary - https://phabricator.wikimedia.org/T409716#11359250 (10fnegri) This is another very long active transaction, this time for tool [kiranbot4](https://toolsadmin.wikimedia.org/tools/id/...
[15:43:47] <wikibugs>	 (03approved) 10filippo: Set MTU 1500 for VXLAN networks in codfw1dev [repos/cloud/cloud-vps/tofu-infra] - 10https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/280 (https://phabricator.wikimedia.org/T408543) (owner: 10taavi)
[15:45:11] <wikibugs>	 (03merge) 10taavi: Set MTU 1500 for VXLAN networks in codfw1dev [repos/cloud/cloud-vps/tofu-infra] - 10https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/280 (https://phabricator.wikimedia.org/T408543)
[15:45:44] <logmsgbot_cloud>	 !log dcaro@cloudcumin1001 tools END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component jobs-api
[15:45:55] <logmsgbot_cloud>	 !log taavi@cloudcumin1001 admin START - Cookbook wmcs.openstack.tofu running tofu plan+apply for main branch
[15:46:42] <logmsgbot_cloud>	 !log taavi@cloudcumin1001 admin END (PASS) - Cookbook wmcs.openstack.tofu (exit_code=0) running tofu plan+apply for main branch
[15:49:07] <wikibugs>	 (03approved) 10dcaro: jobs-api: bump to 0.0.451-20251110145609-be3599fb [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1062 (owner: 10group_203_bot_f4d95069bb2675e4ce1fff090c1c1620)
[15:49:09] <wikibugs>	 (03merge) 10dcaro: jobs-api: bump to 0.0.451-20251110145609-be3599fb [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1062 (owner: 10group_203_bot_f4d95069bb2675e4ce1fff090c1c1620)
[16:00:43] <wikibugs>	 06cloud-services-team, 10Toolforge, 06Product-Analytics: Tools Automoderator and Content Translation metrics can't access tools.db.svc.eqiad.wmflabs - https://phabricator.wikimedia.org/T409734#11359333 (10KCVelaga_WMF) Seems like it coincides, the jobs were scheduled to run on 5th of everything.
[16:05:45] <wikibugs>	 06cloud-services-team, 10Cloud-VPS, 13Patch-For-Review: cookbooks group GitLab access token about to expire - https://phabricator.wikimedia.org/T409741#11359358 (10taavi) 05Open→03Resolved
[16:24:55] <wikibugs>	 10Tool-ghanasupremecases1: Navigation Bar (Multi-Country Integration) - https://phabricator.wikimedia.org/T409158#11359448 (10JorisDarlingtonQuarshie)
[16:27:39] <wikibugs>	 10Tool-ghanasupremecases1: Translation Button (Multilingual Access via Wikisource) - https://phabricator.wikimedia.org/T409745 (10JorisDarlingtonQuarshie) 03NEW
[16:30:04] <wikibugs>	 10Tool-ghanasupremecases1: Interface Improvement (User Experience & Visual Design) - https://phabricator.wikimedia.org/T409746 (10JorisDarlingtonQuarshie) 03NEW
[16:33:48] <wikibugs>	 10Tool-ghanasupremecases1: Filter Button (Advanced Search Filters) - https://phabricator.wikimedia.org/T409748 (10JorisDarlingtonQuarshie) 03NEW
[16:36:11] <wikibugs>	 10Tool-ghanasupremecases1: About Us - https://phabricator.wikimedia.org/T409749 (10JorisDarlingtonQuarshie) 03NEW
[16:39:21] <wikibugs>	 10Tool-ghanasupremecases1: Wikisource Integration (Case Visualization via Wikisource API) - https://phabricator.wikimedia.org/T409750 (10JorisDarlingtonQuarshie) 03NEW
[16:57:14] <wikibugs>	 10Tool-ghanasupremecases1, 06Wiki-Mentor-Africa, 03WikiIndaba-Hackathon-2025: Supreme Court Cases Web App - https://phabricator.wikimedia.org/T409753 (10JorisDarlingtonQuarshie) 03NEW
[16:58:16] <wikibugs>	 06cloud-services-team (FY2025/26-Q1), 10Toolforge, 07Sustainability (Incident Followup): [toolsdb] ibdata1 growing on primary - https://phabricator.wikimedia.org/T409716#11359689 (10fnegri) The thread id for the kiranbot4 transaction is on Sleep:  ` |    13106 | s54990          | 172.16.1.100:60640  | s54990...
[16:58:52] <wikibugs>	 10Tool-ghanasupremecases1, 06Wiki-Mentor-Africa, 03WikiIndaba-Hackathon-2025: Supreme Court Cases Web App - https://phabricator.wikimedia.org/T409753#11359691 (10JorisDarlingtonQuarshie) a:03Sunkanmi12
[17:00:34] <wikibugs>	 10Tool-ghanasupremecases1, 03WikiIndaba-Hackathon-2025: Wikisource Integration (Case Visualization via Wikisource API) - https://phabricator.wikimedia.org/T409750#11359708 (10JorisDarlingtonQuarshie)
[17:02:40] <wikibugs>	 10Tool-ghanasupremecases1: Wikisource Integration (Case Visualization via Wikisource API) - https://phabricator.wikimedia.org/T409750#11359719 (10JorisDarlingtonQuarshie)
[17:05:19] <wikibugs>	 06cloud-services-team (FY2025/26-Q1), 10Toolforge, 07Sustainability (Incident Followup): [toolsdb] ibdata1 growing on primary - https://phabricator.wikimedia.org/T409716#11359750 (10fnegri) @Usernamekiran I see that you are listed as the maintainer for kiranbot4, it looks like the tool creates a SQL transact...
[17:05:44] <wikibugs>	 06cloud-services-team, 10Toolforge, 06Product-Analytics: Tools Automoderator and Content Translation metrics can't access tools.db.svc.eqiad.wmflabs - https://phabricator.wikimedia.org/T409734#11359763 (10fnegri) 05Open→03Resolved a:03fnegri Thanks for confirming, marking this as Resolved.
[17:14:48] <jinxer-wm>	 FIRING: PuppetFailure: Puppet has failed on cloudcontrol1011:9100 - https://puppetboard.wikimedia.org/nodes?status=failed - https://grafana.wikimedia.org/d/yOxVDGvWk/puppet - https://alerts.wikimedia.org/?q=alertname%3DPuppetFailure
[17:19:48] <jinxer-wm>	 FIRING: [2x] PuppetFailure: Puppet has failed on cloudcontrol1007:9100 - https://puppetboard.wikimedia.org/nodes?status=failed - https://grafana.wikimedia.org/d/yOxVDGvWk/puppet - https://alerts.wikimedia.org/?q=alertname%3DPuppetFailure
[17:24:48] <jinxer-wm>	 FIRING: [2x] PuppetFailure: Puppet has failed on cloudcontrol1007:9100 - https://puppetboard.wikimedia.org/nodes?status=failed - https://grafana.wikimedia.org/d/yOxVDGvWk/puppet - https://alerts.wikimedia.org/?q=alertname%3DPuppetFailure
[17:28:57] <wikibugs>	 06cloud-services-team, 10Toolforge: See if we can borrow parts of the wikiprod WAF for Toolforge - https://phabricator.wikimedia.org/T409759 (10taavi) 03NEW
[17:29:48] <jinxer-wm>	 FIRING: [3x] PuppetFailure: Puppet has failed on cloudcontrol1007:9100 - https://puppetboard.wikimedia.org/nodes?status=failed - https://grafana.wikimedia.org/d/yOxVDGvWk/puppet - https://alerts.wikimedia.org/?q=alertname%3DPuppetFailure
[18:12:10] <wikibugs>	 (03update) 10raymond-ndibe: README: update deployment instructions [repos/cloud/toolforge/jobs-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/jobs-api/-/merge_requests/230 (owner: 10dcaro)
[18:13:09] <wikibugs>	 (03update) 10raymond-ndibe: README: update with deploy and local deploy instructions [repos/cloud/toolforge/logs-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/logs-api/-/merge_requests/4 (owner: 10dcaro)
[18:16:21] <wikibugs>	 (03update) 10raymond-ndibe: [dev] add  CONTRIBUTING.md [repos/cloud/toolforge/disable-tool] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/disable-tool/-/merge_requests/24 (https://phabricator.wikimedia.org/T408783)
[18:18:03] <wikibugs>	 (03update) 10raymond-ndibe: [dev] add  CONTRIBUTING.md [repos/cloud/toolforge/disable-tool] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/disable-tool/-/merge_requests/24 (https://phabricator.wikimedia.org/T408783)
[18:18:05] <wikibugs>	 (03approved) 10raymond-ndibe: [dev] add  CONTRIBUTING.md [repos/cloud/toolforge/disable-tool] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/disable-tool/-/merge_requests/24 (https://phabricator.wikimedia.org/T408783)
[18:18:26] <wikibugs>	 (03merge) 10raymond-ndibe: [dev] add  CONTRIBUTING.md [repos/cloud/toolforge/disable-tool] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/disable-tool/-/merge_requests/24 (https://phabricator.wikimedia.org/T408783)
[18:19:15] <wikibugs>	 (03update) 10raymond-ndibe: [storage.kubernetes] remove _remove_none_values method [repos/cloud/toolforge/components-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/components-api/-/merge_requests/145 (https://phabricator.wikimedia.org/T401648 https://phabricator.wikimedia.org/T402572)
[18:19:20] <wikibugs>	 (03approved) 10raymond-ndibe: [storage.kubernetes] remove _remove_none_values method [repos/cloud/toolforge/components-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/components-api/-/merge_requests/145 (https://phabricator.wikimedia.org/T401648 https://phabricator.wikimedia.org/T402572)
[18:19:40] <wikibugs>	 (03merge) 10raymond-ndibe: [storage.kubernetes] remove _remove_none_values method [repos/cloud/toolforge/components-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/components-api/-/merge_requests/145 (https://phabricator.wikimedia.org/T401648 https://phabricator.wikimedia.org/T402572)
[18:19:49] <wikibugs>	 (03update) 10raymond-ndibe: [dev] fix/add README.md, CONTRIBUTING.md [repos/cloud/toolforge/jobs-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/jobs-api/-/merge_requests/243 (https://phabricator.wikimedia.org/T408783)
[18:19:52] <wikibugs>	 (03approved) 10raymond-ndibe: [dev] fix/add README.md, CONTRIBUTING.md [repos/cloud/toolforge/jobs-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/jobs-api/-/merge_requests/243 (https://phabricator.wikimedia.org/T408783)
[18:19:54] <wikibugs>	 (03update) 10raymond-ndibe: [dev] fix/add README.md, CONTRIBUTING.md [repos/cloud/toolforge/jobs-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/jobs-api/-/merge_requests/243 (https://phabricator.wikimedia.org/T408783)
[18:20:08] <wikibugs>	 (03update) 10raymond-ndibe: [dev] add CONTRIBUTING.md [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1059 (https://phabricator.wikimedia.org/T408783)
[18:20:11] <wikibugs>	 (03approved) 10raymond-ndibe: [dev] add CONTRIBUTING.md [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1059 (https://phabricator.wikimedia.org/T408783)
[18:20:13] <wikibugs>	 (03update) 10raymond-ndibe: [dev] add CONTRIBUTING.md [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1059 (https://phabricator.wikimedia.org/T408783)
[18:20:34] <wikibugs>	 (03update) 10raymond-ndibe: [dev] add  CONTRIBUTING.md, LICENSE [repos/cloud/toolforge/packaging-helmfile] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/packaging-helmfile/-/merge_requests/3 (https://phabricator.wikimedia.org/T408783)
[18:20:35] <wikibugs>	 (03approved) 10raymond-ndibe: [dev] add  CONTRIBUTING.md, LICENSE [repos/cloud/toolforge/packaging-helmfile] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/packaging-helmfile/-/merge_requests/3 (https://phabricator.wikimedia.org/T408783)
[18:20:41] <wikibugs>	 (03merge) 10raymond-ndibe: [dev] add  CONTRIBUTING.md, LICENSE [repos/cloud/toolforge/packaging-helmfile] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/packaging-helmfile/-/merge_requests/3 (https://phabricator.wikimedia.org/T408783)
[18:20:43] <wikibugs>	 (03merge) 10raymond-ndibe: [dev] add CONTRIBUTING.md [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1059 (https://phabricator.wikimedia.org/T408783)
[18:20:45] <wikibugs>	 (03update) 10raymond-ndibe: [dev] add  CONTRIBUTING.md [repos/cloud/toolforge/toolforge-weld] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-weld/-/merge_requests/87 (https://phabricator.wikimedia.org/T408783)
[18:20:46] <wikibugs>	 (03approved) 10raymond-ndibe: [dev] add  CONTRIBUTING.md [repos/cloud/toolforge/toolforge-weld] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-weld/-/merge_requests/87 (https://phabricator.wikimedia.org/T408783)
[18:20:51] <wikibugs>	 (03merge) 10raymond-ndibe: [dev] add  CONTRIBUTING.md [repos/cloud/toolforge/toolforge-weld] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-weld/-/merge_requests/87 (https://phabricator.wikimedia.org/T408783)
[18:21:00] <wikibugs>	 (03update) 10raymond-ndibe: [dev] add  CONTRIBUTING.md [repos/cloud/toolforge/toolforge-gen-cli] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-gen-cli/-/merge_requests/4 (https://phabricator.wikimedia.org/T408783)
[18:21:03] <wikibugs>	 (03approved) 10raymond-ndibe: [dev] add  CONTRIBUTING.md [repos/cloud/toolforge/toolforge-gen-cli] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-gen-cli/-/merge_requests/4 (https://phabricator.wikimedia.org/T408783)
[18:21:10] <wikibugs>	 (03merge) 10raymond-ndibe: [dev] add  CONTRIBUTING.md [repos/cloud/toolforge/toolforge-gen-cli] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-gen-cli/-/merge_requests/4 (https://phabricator.wikimedia.org/T408783)
[18:21:16] <wikibugs>	 (03update) 10raymond-ndibe: [dev] add  CONTRIBUTING.md, LICENSE [repos/cloud/toolforge/wmcs-k8s-metrics] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/wmcs-k8s-metrics/-/merge_requests/12 (https://phabricator.wikimedia.org/T408783)
[18:21:18] <wikibugs>	 (03approved) 10raymond-ndibe: [dev] add  CONTRIBUTING.md, LICENSE [repos/cloud/toolforge/wmcs-k8s-metrics] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/wmcs-k8s-metrics/-/merge_requests/12 (https://phabricator.wikimedia.org/T408783)
[18:21:21] <wikibugs>	 (03merge) 10raymond-ndibe: [dev] add  CONTRIBUTING.md, LICENSE [repos/cloud/toolforge/wmcs-k8s-metrics] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/wmcs-k8s-metrics/-/merge_requests/12 (https://phabricator.wikimedia.org/T408783)
[18:21:26] <wikibugs>	 (03update) 10raymond-ndibe: [dev] add  CONTRIBUTING.md [repos/cloud/toolforge/image-config] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/image-config/-/merge_requests/16 (https://phabricator.wikimedia.org/T408783)
[18:21:29] <wikibugs>	 (03approved) 10raymond-ndibe: [dev] add  CONTRIBUTING.md [repos/cloud/toolforge/image-config] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/image-config/-/merge_requests/16 (https://phabricator.wikimedia.org/T408783)
[18:21:33] <wikibugs>	 (03merge) 10raymond-ndibe: [dev] add  CONTRIBUTING.md [repos/cloud/toolforge/image-config] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/image-config/-/merge_requests/16 (https://phabricator.wikimedia.org/T408783)
[18:21:36] <wikibugs>	 (03update) 10raymond-ndibe: [dev] add  CONTRIBUTING.md, LICENSE [repos/cloud/toolforge/misctools-cli] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/misctools-cli/-/merge_requests/9 (https://phabricator.wikimedia.org/T408783)
[18:21:40] <wikibugs>	 (03approved) 10raymond-ndibe: [dev] add  CONTRIBUTING.md, LICENSE [repos/cloud/toolforge/misctools-cli] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/misctools-cli/-/merge_requests/9 (https://phabricator.wikimedia.org/T408783)
[18:21:44] <wikibugs>	 (03merge) 10raymond-ndibe: [dev] add  CONTRIBUTING.md, LICENSE [repos/cloud/toolforge/misctools-cli] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/misctools-cli/-/merge_requests/9 (https://phabricator.wikimedia.org/T408783)
[18:21:52] <wikibugs>	 (03update) 10raymond-ndibe: [dev] add CONTRIBUTING.md, LICENSE [repos/cloud/toolforge/alerts] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/alerts/-/merge_requests/45 (https://phabricator.wikimedia.org/T408783)
[18:21:56] <wikibugs>	 (03approved) 10raymond-ndibe: [dev] add CONTRIBUTING.md, LICENSE [repos/cloud/toolforge/alerts] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/alerts/-/merge_requests/45 (https://phabricator.wikimedia.org/T408783)
[18:22:04] <wikibugs>	 (03update) 10raymond-ndibe: [dev] add CONTRIBUTING.md, LICENSE [repos/cloud/toolforge/alerts] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/alerts/-/merge_requests/45 (https://phabricator.wikimedia.org/T408783)
[18:22:08] <wikibugs>	 (03update) 10raymond-ndibe: [dev] add CONTRIBUTING.md, LICENSE [repos/cloud/toolforge/calico] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/calico/-/merge_requests/21 (https://phabricator.wikimedia.org/T408783)
[18:22:13] <wikibugs>	 (03approved) 10raymond-ndibe: [dev] add CONTRIBUTING.md, LICENSE [repos/cloud/toolforge/calico] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/calico/-/merge_requests/21 (https://phabricator.wikimedia.org/T408783)
[18:22:21] <wikibugs>	 (03merge) 10raymond-ndibe: [dev] add CONTRIBUTING.md, LICENSE [repos/cloud/toolforge/calico] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/calico/-/merge_requests/21 (https://phabricator.wikimedia.org/T408783)
[18:22:25] <wikibugs>	 (03update) 10raymond-ndibe: [dev] add  CONTRIBUTING.md [repos/cloud/toolforge/foxtrot-ldap] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/foxtrot-ldap/-/merge_requests/12 (https://phabricator.wikimedia.org/T408783)
[18:22:31] <wikibugs>	 (03approved) 10raymond-ndibe: [dev] add  CONTRIBUTING.md [repos/cloud/toolforge/foxtrot-ldap] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/foxtrot-ldap/-/merge_requests/12 (https://phabricator.wikimedia.org/T408783)
[18:22:39] <wikibugs>	 (03update) 10raymond-ndibe: [dev] add  CONTRIBUTING.md [repos/cloud/toolforge/envvars-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/envvars-api/-/merge_requests/67 (https://phabricator.wikimedia.org/T408783)
[18:22:43] <wikibugs>	 (03merge) 10raymond-ndibe: [dev] add  CONTRIBUTING.md [repos/cloud/toolforge/foxtrot-ldap] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/foxtrot-ldap/-/merge_requests/12 (https://phabricator.wikimedia.org/T408783)
[18:22:47] <wikibugs>	 (03approved) 10raymond-ndibe: [dev] add  CONTRIBUTING.md [repos/cloud/toolforge/envvars-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/envvars-api/-/merge_requests/67 (https://phabricator.wikimedia.org/T408783)
[18:22:51] <wikibugs>	 (03update) 10raymond-ndibe: [dev] add  CONTRIBUTING.md, LICENSE [repos/cloud/toolforge/tofu-provisioning] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/tofu-provisioning/-/merge_requests/99 (https://phabricator.wikimedia.org/T408783)
[18:22:55] <wikibugs>	 (03merge) 10raymond-ndibe: [dev] add  CONTRIBUTING.md [repos/cloud/toolforge/envvars-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/envvars-api/-/merge_requests/67 (https://phabricator.wikimedia.org/T408783)
[18:22:59] <wikibugs>	 (03approved) 10raymond-ndibe: [dev] add  CONTRIBUTING.md, LICENSE [repos/cloud/toolforge/tofu-provisioning] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/tofu-provisioning/-/merge_requests/99 (https://phabricator.wikimedia.org/T408783)
[18:23:07] <wikibugs>	 (03update) 10group_203_bot_f4d95069bb2675e4ce1fff090c1c1620: components-api: bump to 0.0.178-20251110181950-c253f049 [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1063 (https://phabricator.wikimedia.org/T401648 https://phabricator.wikimedia.org/T402572)
[18:23:11] <wikibugs>	 (03update) 10raymond-ndibe: [dev] add  CONTRIBUTING.md, LICENSE [repos/cloud/toolforge/tofu-provisioning] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/tofu-provisioning/-/merge_requests/99 (https://phabricator.wikimedia.org/T408783)
[18:23:15] <wikibugs>	 (03open) 10group_203_bot_f4d95069bb2675e4ce1fff090c1c1620: components-api: bump to 0.0.178-20251110181950-c253f049 [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1063 (https://phabricator.wikimedia.org/T401648 https://phabricator.wikimedia.org/T402572)
[18:23:25] <wikibugs>	 (03merge) 10raymond-ndibe: [dev] fix/add README.md, CONTRIBUTING.md [repos/cloud/toolforge/jobs-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/jobs-api/-/merge_requests/243 (https://phabricator.wikimedia.org/T408783)
[18:23:29] <wikibugs>	 (03update) 10raymond-ndibe: [dev] add  CONTRIBUTING.md [repos/cloud/toolforge/builds-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/builds-api/-/merge_requests/149 (https://phabricator.wikimedia.org/T408783)
[18:23:33] <wikibugs>	 (03open) 10group_203_bot_f4d95069bb2675e4ce1fff090c1c1620: wmcs-k8s-metrics: bump to 0.0.23-20251110182132-11bda1bb [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1064 (https://phabricator.wikimedia.org/T408783)
[18:23:37] <wikibugs>	 (03update) 10group_203_bot_f4d95069bb2675e4ce1fff090c1c1620: wmcs-k8s-metrics: bump to 0.0.23-20251110182132-11bda1bb [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1064 (https://phabricator.wikimedia.org/T408783)
[18:23:41] <wikibugs>	 (03approved) 10raymond-ndibe: [dev] add  CONTRIBUTING.md [repos/cloud/toolforge/builds-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/builds-api/-/merge_requests/149 (https://phabricator.wikimedia.org/T408783)
[18:23:45] <wikibugs>	 (03update) 10raymond-ndibe: [dev] add  CONTRIBUTING.md [repos/cloud/toolforge/volume-admission] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/volume-admission/-/merge_requests/40 (https://phabricator.wikimedia.org/T408783)
[18:23:53] <wikibugs>	 (03approved) 10raymond-ndibe: [dev] add  CONTRIBUTING.md [repos/cloud/toolforge/volume-admission] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/volume-admission/-/merge_requests/40 (https://phabricator.wikimedia.org/T408783)
[18:23:57] <wikibugs>	 (03merge) 10raymond-ndibe: [dev] add  CONTRIBUTING.md [repos/cloud/toolforge/builds-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/builds-api/-/merge_requests/149 (https://phabricator.wikimedia.org/T408783)
[18:24:05] <wikibugs>	 (03merge) 10raymond-ndibe: [dev] add  CONTRIBUTING.md [repos/cloud/toolforge/volume-admission] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/volume-admission/-/merge_requests/40 (https://phabricator.wikimedia.org/T408783)
[18:24:09] <wikibugs>	 (03merge) 10raymond-ndibe: [dev] add CONTRIBUTING.md, LICENSE [repos/cloud/toolforge/alerts] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/alerts/-/merge_requests/45 (https://phabricator.wikimedia.org/T408783)
[18:24:15] <wikibugs>	 (03merge) 10raymond-ndibe: [dev] add  CONTRIBUTING.md, LICENSE [repos/cloud/toolforge/tofu-provisioning] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/tofu-provisioning/-/merge_requests/99 (https://phabricator.wikimedia.org/T408783)
[18:24:18] <wikibugs>	 (03update) 10raymond-ndibe: [dev] add  CONTRIBUTING.md [repos/cloud/toolforge/envvars-admission] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/envvars-admission/-/merge_requests/28 (https://phabricator.wikimedia.org/T408783)
[18:24:27] <wikibugs>	 (03update) 10group_203_bot_f4d95069bb2675e4ce1fff090c1c1620: calico: bump to 0.0.20-20251110182231-f8df7655 [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1065 (https://phabricator.wikimedia.org/T408783)
[18:24:29] <wikibugs>	 (03open) 10group_203_bot_f4d95069bb2675e4ce1fff090c1c1620: calico: bump to 0.0.20-20251110182231-f8df7655 [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1065 (https://phabricator.wikimedia.org/T408783)
[18:24:32] <wikibugs>	 (03merge) 10raymond-ndibe: [dev] add  CONTRIBUTING.md [repos/cloud/toolforge/envvars-admission] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/envvars-admission/-/merge_requests/28 (https://phabricator.wikimedia.org/T408783)
[18:24:54] <wikibugs>	 (03approved) 10raymond-ndibe: [dev] add  CONTRIBUTING.md [repos/cloud/toolforge/builds-builder] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/builds-builder/-/merge_requests/78 (https://phabricator.wikimedia.org/T408783)
[18:24:55] <wikibugs>	 (03update) 10raymond-ndibe: [dev] add  CONTRIBUTING.md [repos/cloud/toolforge/builds-builder] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/builds-builder/-/merge_requests/78 (https://phabricator.wikimedia.org/T408783)
[18:25:05] <wikibugs>	 (03merge) 10raymond-ndibe: [dev] add  CONTRIBUTING.md [repos/cloud/toolforge/builds-builder] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/builds-builder/-/merge_requests/78 (https://phabricator.wikimedia.org/T408783)
[18:25:07] <wikibugs>	 (03open) 10group_203_bot_f4d95069bb2675e4ce1fff090c1c1620: image-config: bump to 0.0.23-20251110182303-7f45fa53 [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1066 (https://phabricator.wikimedia.org/T408783)
[18:25:21] <wikibugs>	 (03update) 10raymond-ndibe: [dev] add  CONTRIBUTING.md [repos/cloud/toolforge/maintain-harbor] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/maintain-harbor/-/merge_requests/58 (https://phabricator.wikimedia.org/T408783)
[18:25:21] <wikibugs>	 (03approved) 10raymond-ndibe: [dev] add  CONTRIBUTING.md [repos/cloud/toolforge/maintain-harbor] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/maintain-harbor/-/merge_requests/58 (https://phabricator.wikimedia.org/T408783)
[18:25:26] <wikibugs>	 (03merge) 10raymond-ndibe: [dev] add  CONTRIBUTING.md [repos/cloud/toolforge/maintain-harbor] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/maintain-harbor/-/merge_requests/58 (https://phabricator.wikimedia.org/T408783)
[18:27:07] <wikibugs>	 (03update) 10raymond-ndibe: [dev] add  CONTRIBUTING.md [repos/cloud/toolforge/jobs-emailer] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/jobs-emailer/-/merge_requests/35 (https://phabricator.wikimedia.org/T408783)
[18:27:10] <wikibugs>	 (03approved) 10raymond-ndibe: [dev] add  CONTRIBUTING.md [repos/cloud/toolforge/jobs-emailer] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/jobs-emailer/-/merge_requests/35 (https://phabricator.wikimedia.org/T408783)
[18:27:24] <wikibugs>	 (03update) 10raymond-ndibe: [dev] add  CONTRIBUTING.md [repos/cloud/toolforge/components-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/components-api/-/merge_requests/149 (https://phabricator.wikimedia.org/T408783)
[18:27:24] <wikibugs>	 (03update) 10group_203_bot_f4d95069bb2675e4ce1fff090c1c1620: builds-builder: bump to 0.0.138-20251110182519-45843faa [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1068 (https://phabricator.wikimedia.org/T408783)
[18:27:26] <wikibugs>	 (03merge) 10raymond-ndibe: [dev] add  CONTRIBUTING.md [repos/cloud/toolforge/jobs-emailer] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/jobs-emailer/-/merge_requests/35 (https://phabricator.wikimedia.org/T408783)
[18:27:27] <wikibugs>	 (03open) 10group_203_bot_f4d95069bb2675e4ce1fff090c1c1620: jobs-api: bump to 0.0.452-20251110182401-c5c5c1c0 [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1067 (https://phabricator.wikimedia.org/T408783)
[18:27:29] <wikibugs>	 (03open) 10group_203_bot_f4d95069bb2675e4ce1fff090c1c1620: builds-builder: bump to 0.0.138-20251110182519-45843faa [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1068 (https://phabricator.wikimedia.org/T408783)
[18:27:30] <wikibugs>	 (03approved) 10raymond-ndibe: [dev] add  CONTRIBUTING.md [repos/cloud/toolforge/components-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/components-api/-/merge_requests/149 (https://phabricator.wikimedia.org/T408783)
[18:27:43] <wikibugs>	 (03update) 10raymond-ndibe: [dev] add  CONTRIBUTING.md [repos/cloud/toolforge/components-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/components-api/-/merge_requests/149 (https://phabricator.wikimedia.org/T408783)
[18:27:52] <wikibugs>	 (03update) 10raymond-ndibe: [dev] add  CONTRIBUTING.md [repos/cloud/toolforge/ingress-admission] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/ingress-admission/-/merge_requests/31 (https://phabricator.wikimedia.org/T408783)
[18:27:56] <wikibugs>	 (03approved) 10raymond-ndibe: [dev] add  CONTRIBUTING.md [repos/cloud/toolforge/ingress-admission] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/ingress-admission/-/merge_requests/31 (https://phabricator.wikimedia.org/T408783)
[18:28:10] <wikibugs>	 (03merge) 10raymond-ndibe: [dev] add  CONTRIBUTING.md [repos/cloud/toolforge/ingress-admission] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/ingress-admission/-/merge_requests/31 (https://phabricator.wikimedia.org/T408783)
[18:28:14] <wikibugs>	 (03update) 10raymond-ndibe: [dev] add CONTRIBUTING.md [repos/cloud/toolforge/buildpacks/apt-buildpack] (move_to_api_0.10) - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/buildpacks/apt-buildpack/-/merge_requests/4 (https://phabricator.wikimedia.org/T408783)
[18:28:18] <wikibugs>	 (03approved) 10raymond-ndibe: [dev] add CONTRIBUTING.md [repos/cloud/toolforge/buildpacks/apt-buildpack] (move_to_api_0.10) - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/buildpacks/apt-buildpack/-/merge_requests/4 (https://phabricator.wikimedia.org/T408783)
[18:28:22] <wikibugs>	 (03merge) 10raymond-ndibe: [dev] add CONTRIBUTING.md [repos/cloud/toolforge/buildpacks/apt-buildpack] (move_to_api_0.10) - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/buildpacks/apt-buildpack/-/merge_requests/4 (https://phabricator.wikimedia.org/T408783)
[18:30:07] <wikibugs>	 (03update) 10group_203_bot_f4d95069bb2675e4ce1fff090c1c1620: jobs-emailer: bump to 0.0.71-20251110182740-ba8232f8 [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1069 (https://phabricator.wikimedia.org/T408783)
[18:30:14] <wikibugs>	 (03open) 10group_203_bot_f4d95069bb2675e4ce1fff090c1c1620: jobs-emailer: bump to 0.0.71-20251110182740-ba8232f8 [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1069 (https://phabricator.wikimedia.org/T408783)
[18:30:25] <wikibugs>	 (03merge) 10raymond-ndibe: [dev] add  CONTRIBUTING.md [repos/cloud/toolforge/components-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/components-api/-/merge_requests/149 (https://phabricator.wikimedia.org/T408783)
[18:30:50] <wikibugs>	 (03open) 10group_203_bot_f4d95069bb2675e4ce1fff090c1c1620: maintain-harbor: bump to 0.0.65-20251110182534-e1f714a4 [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1070 (https://phabricator.wikimedia.org/T408783)
[18:30:50] <wikibugs>	 (03open) 10group_203_bot_f4d95069bb2675e4ce1fff090c1c1620: volume-admission: bump to 0.0.76-20251110182416-16924db0 [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1071 (https://phabricator.wikimedia.org/T408783)
[18:31:40] <wikibugs>	 (03update) 10group_203_bot_f4d95069bb2675e4ce1fff090c1c1620: envvars-admission: bump to 0.0.35-20251110182447-94859fd1 [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1072 (https://phabricator.wikimedia.org/T408783)
[18:31:45] <wikibugs>	 (03open) 10group_203_bot_f4d95069bb2675e4ce1fff090c1c1620: envvars-admission: bump to 0.0.35-20251110182447-94859fd1 [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1072 (https://phabricator.wikimedia.org/T408783)
[18:33:13] <wikibugs>	 (03update) 10group_203_bot_f4d95069bb2675e4ce1fff090c1c1620: envvars-api: bump to 0.0.78-20251110182323-0b17af8c [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1074 (https://phabricator.wikimedia.org/T408783)
[18:33:14] <wikibugs>	 (03open) 10group_203_bot_f4d95069bb2675e4ce1fff090c1c1620: ingress-admission: bump to 0.0.70-20251110182813-e6936b2b [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1073 (https://phabricator.wikimedia.org/T408783)
[18:33:14] <wikibugs>	 (03open) 10group_203_bot_f4d95069bb2675e4ce1fff090c1c1620: envvars-api: bump to 0.0.78-20251110182323-0b17af8c [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1074 (https://phabricator.wikimedia.org/T408783)
[18:33:46] <wikibugs>	 (03update) 10raymond-ndibe: [build] run pipeline cleanup per repo [repos/cloud/toolforge/builds-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/builds-api/-/merge_requests/142 (https://phabricator.wikimedia.org/T404157)
[18:34:18] <wikibugs>	 (03update) 10group_203_bot_f4d95069bb2675e4ce1fff090c1c1620: components-api: bump to 0.0.179-20251110183040-e85bd1d8 [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1063 (https://phabricator.wikimedia.org/T401648 https://phabricator.wikimedia.org/T402572 https://phabricator.wikimedia.org/T408783)
[18:34:25] <wikibugs>	 (03update) 10group_203_bot_f4d95069bb2675e4ce1fff090c1c1620: components-api: bump to 0.0.179-20251110183040-e85bd1d8 [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1063 (https://phabricator.wikimedia.org/T401648 https://phabricator.wikimedia.org/T402572 https://phabricator.wikimedia.org/T408783)
[18:37:22] <wikibugs>	 (03open) 10group_203_bot_f4d95069bb2675e4ce1fff090c1c1620: builds-api: bump to 0.0.205-20251110182408-280ae482 [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1075 (https://phabricator.wikimedia.org/T408783)
[18:45:24] <wikibugs>	 (03approved) 10lucaswerkmeister: Localisation updates from https://translatewiki.net. [toolforge-repos/wd-image-positions] - 10https://gitlab.wikimedia.org/toolforge-repos/wd-image-positions/-/merge_requests/52 (owner: 10l10n-bot)
[18:45:27] <wikibugs>	 (03merge) 10lucaswerkmeister: Localisation updates from https://translatewiki.net. [toolforge-repos/wd-image-positions] - 10https://gitlab.wikimedia.org/toolforge-repos/wd-image-positions/-/merge_requests/52 (owner: 10l10n-bot)
[18:45:45] <logmsgbot_cloud>	 !log raymond-ndibe@cloudcumin1001 toolsbeta START - Cookbook wmcs.toolforge.component.deploy for component builds-api
[18:46:17] <wikibugs>	 (03approved) 10lucaswerkmeister: Localisation updates from https://translatewiki.net. [toolforge-repos/lexeme-forms] - 10https://gitlab.wikimedia.org/toolforge-repos/lexeme-forms/-/merge_requests/20 (owner: 10l10n-bot)
[18:46:19] <wikibugs>	 (03merge) 10lucaswerkmeister: Localisation updates from https://translatewiki.net. [toolforge-repos/lexeme-forms] - 10https://gitlab.wikimedia.org/toolforge-repos/lexeme-forms/-/merge_requests/20 (owner: 10l10n-bot)
[18:50:41] <logmsgbot_cloud>	 !log raymond-ndibe@cloudcumin1001 toolsbeta END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component builds-api
[18:50:41] <logmsgbot_cloud>	 !log raymond-ndibe@cloudcumin1001 tools START - Cookbook wmcs.toolforge.component.deploy for component builds-api
[18:55:57] <logmsgbot_cloud>	 !log raymond-ndibe@cloudcumin1001 tools END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component builds-api
[18:55:59] <logmsgbot_cloud>	 !log raymond-ndibe@cloudcumin1001 toolsbeta START - Cookbook wmcs.toolforge.component.deploy for component components-api
[19:01:02] <logmsgbot_cloud>	 !log raymond-ndibe@cloudcumin1001 toolsbeta END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component components-api
[19:01:03] <logmsgbot_cloud>	 !log raymond-ndibe@cloudcumin1001 tools START - Cookbook wmcs.toolforge.component.deploy for component components-api
[19:06:16] <logmsgbot_cloud>	 !log raymond-ndibe@cloudcumin1001 tools END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component components-api
[19:06:17] <logmsgbot_cloud>	 !log raymond-ndibe@cloudcumin1001 toolsbeta START - Cookbook wmcs.toolforge.component.deploy for component envvars-api
[19:07:44] <logmsgbot_cloud>	 !log raymond-ndibe@cloudcumin1001 toolsbeta END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component envvars-api
[19:07:45] <logmsgbot_cloud>	 !log raymond-ndibe@cloudcumin1001 tools START - Cookbook wmcs.toolforge.component.deploy for component envvars-api
[19:09:10] <logmsgbot_cloud>	 !log raymond-ndibe@cloudcumin1001 tools END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component envvars-api
[19:09:11] <logmsgbot_cloud>	 !log raymond-ndibe@cloudcumin1001 toolsbeta START - Cookbook wmcs.toolforge.component.deploy for component ingress-admission
[19:17:55] <logmsgbot_cloud>	 !log raymond-ndibe@cloudcumin1001 toolsbeta END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component ingress-admission
[19:17:56] <logmsgbot_cloud>	 !log raymond-ndibe@cloudcumin1001 tools START - Cookbook wmcs.toolforge.component.deploy for component ingress-admission
[19:22:43] <wikibugs>	 (03update) 10raymond-ndibe: [build] run pipeline cleanup per repo [repos/cloud/toolforge/builds-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/builds-api/-/merge_requests/142 (https://phabricator.wikimedia.org/T404157)
[19:23:05] <wikibugs>	 (03update) 10raymond-ndibe: [build] run pipeline cleanup per repo [repos/cloud/toolforge/builds-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/builds-api/-/merge_requests/142 (https://phabricator.wikimedia.org/T404157)
[19:27:52] <logmsgbot_cloud>	 !log raymond-ndibe@cloudcumin1001 tools END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component ingress-admission
[19:27:53] <logmsgbot_cloud>	 !log raymond-ndibe@cloudcumin1001 toolsbeta START - Cookbook wmcs.toolforge.component.deploy for component envvars-admission
[19:36:13] <logmsgbot_cloud>	 !log raymond-ndibe@cloudcumin1001 toolsbeta END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component envvars-admission
[19:36:13] <logmsgbot_cloud>	 !log raymond-ndibe@cloudcumin1001 tools START - Cookbook wmcs.toolforge.component.deploy for component envvars-admission
[19:39:48] <jinxer-wm>	 RESOLVED: PuppetFailure: Puppet has failed on cloudcontrol2006-dev:9100 - https://puppetboard.wikimedia.org/nodes?status=failed - https://grafana.wikimedia.org/d/yOxVDGvWk/puppet - https://alerts.wikimedia.org/?q=alertname%3DPuppetFailure
[19:44:10] <logmsgbot_cloud>	 !log raymond-ndibe@cloudcumin1001 tools END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component envvars-admission
[19:44:11] <logmsgbot_cloud>	 !log raymond-ndibe@cloudcumin1001 toolsbeta START - Cookbook wmcs.toolforge.component.deploy for component volume-admission
[19:46:28] <logmsgbot_cloud>	 !log raymond-ndibe@cloudcumin1001 toolsbeta END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component volume-admission
[19:46:29] <logmsgbot_cloud>	 !log raymond-ndibe@cloudcumin1001 tools START - Cookbook wmcs.toolforge.component.deploy for component volume-admission
[19:47:29] <wmcs-alerts>	 FIRING: ToolforgeToolviewsStale: Toolviews data is stale - https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/ToolforgeToolviewsStale  - https://prometheus-alerts.wmcloud.org/?q=alertname%3DToolforgeToolviewsStale
[19:48:45] <logmsgbot_cloud>	 !log raymond-ndibe@cloudcumin1001 tools END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component volume-admission
[19:48:46] <logmsgbot_cloud>	 !log raymond-ndibe@cloudcumin1001 toolsbeta START - Cookbook wmcs.toolforge.component.deploy for component maintain-harbor
[19:51:02] <logmsgbot_cloud>	 !log raymond-ndibe@cloudcumin1001 toolsbeta END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component maintain-harbor
[19:51:04] <logmsgbot_cloud>	 !log raymond-ndibe@cloudcumin1001 tools START - Cookbook wmcs.toolforge.component.deploy for component maintain-harbor
[19:52:29] <wmcs-alerts>	 RESOLVED: ToolforgeToolviewsStale: Toolviews data is stale - https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/ToolforgeToolviewsStale  - https://prometheus-alerts.wmcloud.org/?q=alertname%3DToolforgeToolviewsStale
[19:55:09] <logmsgbot_cloud>	 !log raymond-ndibe@cloudcumin1001 tools END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component maintain-harbor
[19:55:10] <logmsgbot_cloud>	 !log raymond-ndibe@cloudcumin1001 toolsbeta START - Cookbook wmcs.toolforge.component.deploy for component jobs-emailer
[20:10:13] <logmsgbot_cloud>	 !log raymond-ndibe@cloudcumin1001 toolsbeta END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component jobs-emailer
[20:10:14] <logmsgbot_cloud>	 !log raymond-ndibe@cloudcumin1001 tools START - Cookbook wmcs.toolforge.component.deploy for component jobs-emailer
[20:27:44] <logmsgbot_cloud>	 !log raymond-ndibe@cloudcumin1001 tools END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component jobs-emailer
[20:27:45] <logmsgbot_cloud>	 !log raymond-ndibe@cloudcumin1001 toolsbeta START - Cookbook wmcs.toolforge.component.deploy for component builds-builder
[20:32:06] <logmsgbot_cloud>	 !log raymond-ndibe@cloudcumin1001 toolsbeta END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component builds-builder
[20:32:07] <logmsgbot_cloud>	 !log raymond-ndibe@cloudcumin1001 tools START - Cookbook wmcs.toolforge.component.deploy for component builds-builder
[20:36:39] <logmsgbot_cloud>	 !log raymond-ndibe@cloudcumin1001 tools END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component builds-builder
[20:36:40] <logmsgbot_cloud>	 !log raymond-ndibe@cloudcumin1001 toolsbeta START - Cookbook wmcs.toolforge.component.deploy for component jobs-api
[20:38:38] <wikibugs>	 06cloud-services-team, 06SRE: latest Trixie image (as of 2025-10-16) grub failure on R450 hardware - https://phabricator.wikimedia.org/T407586#11360708 (10Andrew) On @fgiunchedi's request I tried dd'ing every drive on a server before reimaging but grub still exhibits the issue.
[20:48:11] <logmsgbot_cloud>	 !log raymond-ndibe@cloudcumin1001 toolsbeta END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component jobs-api
[20:48:12] <logmsgbot_cloud>	 !log raymond-ndibe@cloudcumin1001 tools START - Cookbook wmcs.toolforge.component.deploy for component jobs-api
[21:01:17] <logmsgbot_cloud>	 !log raymond-ndibe@cloudcumin1001 tools END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component jobs-api
[21:01:18] <logmsgbot_cloud>	 !log raymond-ndibe@cloudcumin1001 toolsbeta START - Cookbook wmcs.toolforge.component.deploy for component image-config
[21:08:56] <logmsgbot_cloud>	 !log raymond-ndibe@cloudcumin1001 toolsbeta END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component image-config
[21:08:57] <logmsgbot_cloud>	 !log raymond-ndibe@cloudcumin1001 tools START - Cookbook wmcs.toolforge.component.deploy for component image-config
[21:18:19] <logmsgbot_cloud>	 !log raymond-ndibe@cloudcumin1001 tools END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component image-config
[21:18:20] <logmsgbot_cloud>	 !log raymond-ndibe@cloudcumin1001 toolsbeta START - Cookbook wmcs.toolforge.component.deploy for component calico
[21:34:03] <logmsgbot_cloud>	 !log raymond-ndibe@cloudcumin1001 toolsbeta END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component calico
[21:34:05] <logmsgbot_cloud>	 !log raymond-ndibe@cloudcumin1001 tools START - Cookbook wmcs.toolforge.component.deploy for component calico
[21:39:09] <wikibugs>	 10wikitech.wikimedia.org, 10Wikimedia-Site-requests: Enable protection indicators for wikitech - https://phabricator.wikimedia.org/T409785 (10bd808) 03NEW
[21:47:12] <wikibugs>	 10wikitech.wikimedia.org, 10Wikimedia-Site-requests, 13Patch-For-Review: Enable protection indicators for wikitech - https://phabricator.wikimedia.org/T409785#11361018 (10bd808) Announced in the wikimedia-cloud and wikimedia-operations irc channels: `lang=irc [21:43]  <    bd808> wikitech doesn't have a hist...
[21:51:39] <logmsgbot_cloud>	 !log raymond-ndibe@cloudcumin1001 tools END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component calico
[21:51:40] <logmsgbot_cloud>	 !log raymond-ndibe@cloudcumin1001 toolsbeta START - Cookbook wmcs.toolforge.component.deploy for component wmcs-k8s-metrics
[22:06:19] <logmsgbot_cloud>	 !log raymond-ndibe@cloudcumin1001 toolsbeta END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component wmcs-k8s-metrics
[22:06:20] <logmsgbot_cloud>	 !log raymond-ndibe@cloudcumin1001 tools START - Cookbook wmcs.toolforge.component.deploy for component wmcs-k8s-metrics
[22:08:23] <logmsgbot_cloud>	 !log raymond-ndibe@cloudcumin1001 tools START - Cookbook wmcs.toolforge.k8s.image.copy_to_registry
[22:08:23] <logmsgbot_cloud>	 !log raymond-ndibe@cloudcumin1001 tools Updating container image toolsbeta-harbor.wmcloud.org/toolforge-pre-built/toolforge-bookworm-sssd:latest:latest
[22:08:25] <logmsgbot_cloud>	 !log raymond-ndibe@cloudcumin1001 tools END (FAIL) - Cookbook wmcs.toolforge.k8s.image.copy_to_registry (exit_code=99)
[22:14:06] <logmsgbot_cloud>	 !log raymond-ndibe@cloudcumin1001 tools START - Cookbook wmcs.toolforge.k8s.image.copy_to_registry
[22:14:06] <logmsgbot_cloud>	 !log raymond-ndibe@cloudcumin1001 tools Updating container image toolsbeta-harbor.wmcloud.org/toolforge-pre-built/toolforge-bookworm-sssd:latest
[22:14:13] <logmsgbot_cloud>	 !log raymond-ndibe@cloudcumin1001 tools END (FAIL) - Cookbook wmcs.toolforge.k8s.image.copy_to_registry (exit_code=99)
[22:16:12] <logmsgbot_cloud>	 !log raymond-ndibe@cloudcumin1001 tools START - Cookbook wmcs.toolforge.k8s.image.copy_to_registry
[22:16:12] <logmsgbot_cloud>	 !log raymond-ndibe@cloudcumin1001 tools Updating container image toolsbeta-harbor.wmcloud.org/toolforge-pre-built/toolforge-bookworm-sssd:latest
[22:16:13] <logmsgbot_cloud>	 !log raymond-ndibe@cloudcumin1001 tools END (FAIL) - Cookbook wmcs.toolforge.k8s.image.copy_to_registry (exit_code=99)
[22:23:54] <logmsgbot_cloud>	 !log raymond-ndibe@cloudcumin1001 tools END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component wmcs-k8s-metrics
[22:35:54] <wikibugs>	 (03update) 10raymond-ndibe: wmcs-k8s-metrics: bump to 0.0.23-20251110182132-11bda1bb [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1064 (https://phabricator.wikimedia.org/T408783) (owner: 10group_203_bot_f4d95069bb2675e4ce1fff090c1c1620)
[22:35:59] <wikibugs>	 (03approved) 10raymond-ndibe: wmcs-k8s-metrics: bump to 0.0.23-20251110182132-11bda1bb [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1064 (https://phabricator.wikimedia.org/T408783) (owner: 10group_203_bot_f4d95069bb2675e4ce1fff090c1c1620)
[22:36:03] <wikibugs>	 (03merge) 10raymond-ndibe: wmcs-k8s-metrics: bump to 0.0.23-20251110182132-11bda1bb [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1064 (https://phabricator.wikimedia.org/T408783) (owner: 10group_203_bot_f4d95069bb2675e4ce1fff090c1c1620)
[22:36:52] <wikibugs>	 (03update) 10raymond-ndibe: calico: bump to 0.0.20-20251110182231-f8df7655 [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1065 (https://phabricator.wikimedia.org/T408783) (owner: 10group_203_bot_f4d95069bb2675e4ce1fff090c1c1620)
[22:36:54] <wikibugs>	 (03update) 10raymond-ndibe: calico: bump to 0.0.20-20251110182231-f8df7655 [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1065 (https://phabricator.wikimedia.org/T408783) (owner: 10group_203_bot_f4d95069bb2675e4ce1fff090c1c1620)
[22:36:55] <wikibugs>	 (03approved) 10raymond-ndibe: calico: bump to 0.0.20-20251110182231-f8df7655 [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1065 (https://phabricator.wikimedia.org/T408783) (owner: 10group_203_bot_f4d95069bb2675e4ce1fff090c1c1620)
[22:37:57] <wikibugs>	 (03merge) 10raymond-ndibe: calico: bump to 0.0.20-20251110182231-f8df7655 [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1065 (https://phabricator.wikimedia.org/T408783) (owner: 10group_203_bot_f4d95069bb2675e4ce1fff090c1c1620)
[22:38:02] <wikibugs>	 (03update) 10raymond-ndibe: image-config: bump to 0.0.23-20251110182303-7f45fa53 [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1066 (https://phabricator.wikimedia.org/T408783) (owner: 10group_203_bot_f4d95069bb2675e4ce1fff090c1c1620)
[22:38:06] <wikibugs>	 (03approved) 10raymond-ndibe: image-config: bump to 0.0.23-20251110182303-7f45fa53 [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1066 (https://phabricator.wikimedia.org/T408783) (owner: 10group_203_bot_f4d95069bb2675e4ce1fff090c1c1620)
[22:38:09] <wikibugs>	 (03update) 10raymond-ndibe: image-config: bump to 0.0.23-20251110182303-7f45fa53 [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1066 (https://phabricator.wikimedia.org/T408783) (owner: 10group_203_bot_f4d95069bb2675e4ce1fff090c1c1620)
[22:38:44] <wikibugs>	 (03merge) 10raymond-ndibe: image-config: bump to 0.0.23-20251110182303-7f45fa53 [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1066 (https://phabricator.wikimedia.org/T408783) (owner: 10group_203_bot_f4d95069bb2675e4ce1fff090c1c1620)
[22:50:08] <wikibugs>	 (03update) 10raymond-ndibe: jobs-api: bump to 0.0.452-20251110182401-c5c5c1c0 [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1067 (https://phabricator.wikimedia.org/T408783) (owner: 10group_203_bot_f4d95069bb2675e4ce1fff090c1c1620)
[22:50:11] <wikibugs>	 (03approved) 10raymond-ndibe: jobs-api: bump to 0.0.452-20251110182401-c5c5c1c0 [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1067 (https://phabricator.wikimedia.org/T408783) (owner: 10group_203_bot_f4d95069bb2675e4ce1fff090c1c1620)
[22:50:13] <wikibugs>	 (03update) 10raymond-ndibe: jobs-api: bump to 0.0.452-20251110182401-c5c5c1c0 [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1067 (https://phabricator.wikimedia.org/T408783) (owner: 10group_203_bot_f4d95069bb2675e4ce1fff090c1c1620)
[22:50:39] <wikibugs>	 (03merge) 10raymond-ndibe: jobs-api: bump to 0.0.452-20251110182401-c5c5c1c0 [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1067 (https://phabricator.wikimedia.org/T408783) (owner: 10group_203_bot_f4d95069bb2675e4ce1fff090c1c1620)
[22:50:56] <wikibugs>	 (03open) 10raymond-ndibe: [maintain-harbor] set quota for toolforge-pre-built [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1076 (https://phabricator.wikimedia.org/T409727)
[22:51:00] <wikibugs>	 (03update) 10raymond-ndibe: [maintain-harbor] set quota for toolforge-pre-built [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1076 (https://phabricator.wikimedia.org/T409727)
[22:51:11] <wikibugs>	 (03update) 10raymond-ndibe: builds-builder: bump to 0.0.138-20251110182519-45843faa [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1068 (https://phabricator.wikimedia.org/T408783) (owner: 10group_203_bot_f4d95069bb2675e4ce1fff090c1c1620)
[22:51:14] <wikibugs>	 (03approved) 10raymond-ndibe: builds-builder: bump to 0.0.138-20251110182519-45843faa [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1068 (https://phabricator.wikimedia.org/T408783) (owner: 10group_203_bot_f4d95069bb2675e4ce1fff090c1c1620)
[22:51:16] <wikibugs>	 (03update) 10raymond-ndibe: builds-builder: bump to 0.0.138-20251110182519-45843faa [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1068 (https://phabricator.wikimedia.org/T408783) (owner: 10group_203_bot_f4d95069bb2675e4ce1fff090c1c1620)
[22:51:45] <wikibugs>	 (03merge) 10raymond-ndibe: builds-builder: bump to 0.0.138-20251110182519-45843faa [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1068 (https://phabricator.wikimedia.org/T408783) (owner: 10group_203_bot_f4d95069bb2675e4ce1fff090c1c1620)
[23:03:29] <wikibugs>	 (03update) 10raymond-ndibe: [maintain-harbor] set quota for toolforge-pre-built [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1076 (https://phabricator.wikimedia.org/T409727)
[23:05:07] <wikibugs>	 (03update) 10raymond-ndibe: jobs-emailer: bump to 0.0.71-20251110182740-ba8232f8 [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1069 (https://phabricator.wikimedia.org/T408783) (owner: 10group_203_bot_f4d95069bb2675e4ce1fff090c1c1620)
[23:05:12] <wikibugs>	 (03approved) 10raymond-ndibe: jobs-emailer: bump to 0.0.71-20251110182740-ba8232f8 [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1069 (https://phabricator.wikimedia.org/T408783) (owner: 10group_203_bot_f4d95069bb2675e4ce1fff090c1c1620)
[23:05:13] <wikibugs>	 (03update) 10raymond-ndibe: jobs-emailer: bump to 0.0.71-20251110182740-ba8232f8 [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1069 (https://phabricator.wikimedia.org/T408783) (owner: 10group_203_bot_f4d95069bb2675e4ce1fff090c1c1620)
[23:05:42] <wikibugs>	 (03merge) 10raymond-ndibe: jobs-emailer: bump to 0.0.71-20251110182740-ba8232f8 [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1069 (https://phabricator.wikimedia.org/T408783) (owner: 10group_203_bot_f4d95069bb2675e4ce1fff090c1c1620)
[23:05:50] <wikibugs>	 (03update) 10raymond-ndibe: volume-admission: bump to 0.0.76-20251110182416-16924db0 [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1071 (https://phabricator.wikimedia.org/T408783) (owner: 10group_203_bot_f4d95069bb2675e4ce1fff090c1c1620)
[23:05:53] <wikibugs>	 (03approved) 10raymond-ndibe: volume-admission: bump to 0.0.76-20251110182416-16924db0 [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1071 (https://phabricator.wikimedia.org/T408783) (owner: 10group_203_bot_f4d95069bb2675e4ce1fff090c1c1620)
[23:05:55] <wikibugs>	 (03update) 10raymond-ndibe: volume-admission: bump to 0.0.76-20251110182416-16924db0 [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1071 (https://phabricator.wikimedia.org/T408783) (owner: 10group_203_bot_f4d95069bb2675e4ce1fff090c1c1620)
[23:06:20] <wikibugs>	 (03merge) 10raymond-ndibe: volume-admission: bump to 0.0.76-20251110182416-16924db0 [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1071 (https://phabricator.wikimedia.org/T408783) (owner: 10group_203_bot_f4d95069bb2675e4ce1fff090c1c1620)
[23:06:29] <wikibugs>	 (03update) 10raymond-ndibe: maintain-harbor: bump to 0.0.65-20251110182534-e1f714a4 [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1070 (https://phabricator.wikimedia.org/T408783) (owner: 10group_203_bot_f4d95069bb2675e4ce1fff090c1c1620)
[23:06:30] <wikibugs>	 (03approved) 10raymond-ndibe: maintain-harbor: bump to 0.0.65-20251110182534-e1f714a4 [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1070 (https://phabricator.wikimedia.org/T408783) (owner: 10group_203_bot_f4d95069bb2675e4ce1fff090c1c1620)
[23:06:34] <wikibugs>	 (03update) 10raymond-ndibe: maintain-harbor: bump to 0.0.65-20251110182534-e1f714a4 [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1070 (https://phabricator.wikimedia.org/T408783) (owner: 10group_203_bot_f4d95069bb2675e4ce1fff090c1c1620)
[23:06:59] <wikibugs>	 (03merge) 10raymond-ndibe: maintain-harbor: bump to 0.0.65-20251110182534-e1f714a4 [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1070 (https://phabricator.wikimedia.org/T408783) (owner: 10group_203_bot_f4d95069bb2675e4ce1fff090c1c1620)
[23:07:26] <wikibugs>	 (03update) 10raymond-ndibe: envvars-admission: bump to 0.0.35-20251110182447-94859fd1 [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1072 (https://phabricator.wikimedia.org/T408783) (owner: 10group_203_bot_f4d95069bb2675e4ce1fff090c1c1620)
[23:07:28] <wikibugs>	 (03approved) 10raymond-ndibe: envvars-admission: bump to 0.0.35-20251110182447-94859fd1 [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1072 (https://phabricator.wikimedia.org/T408783) (owner: 10group_203_bot_f4d95069bb2675e4ce1fff090c1c1620)
[23:07:30] <wikibugs>	 (03update) 10raymond-ndibe: envvars-admission: bump to 0.0.35-20251110182447-94859fd1 [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1072 (https://phabricator.wikimedia.org/T408783) (owner: 10group_203_bot_f4d95069bb2675e4ce1fff090c1c1620)
[23:07:53] <wikibugs>	 (03merge) 10raymond-ndibe: envvars-admission: bump to 0.0.35-20251110182447-94859fd1 [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1072 (https://phabricator.wikimedia.org/T408783) (owner: 10group_203_bot_f4d95069bb2675e4ce1fff090c1c1620)
[23:08:02] <wikibugs>	 (03update) 10raymond-ndibe: ingress-admission: bump to 0.0.70-20251110182813-e6936b2b [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1073 (https://phabricator.wikimedia.org/T408783) (owner: 10group_203_bot_f4d95069bb2675e4ce1fff090c1c1620)
[23:08:03] <wikibugs>	 (03approved) 10raymond-ndibe: ingress-admission: bump to 0.0.70-20251110182813-e6936b2b [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1073 (https://phabricator.wikimedia.org/T408783) (owner: 10group_203_bot_f4d95069bb2675e4ce1fff090c1c1620)
[23:08:05] <wikibugs>	 (03update) 10raymond-ndibe: ingress-admission: bump to 0.0.70-20251110182813-e6936b2b [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1073 (https://phabricator.wikimedia.org/T408783) (owner: 10group_203_bot_f4d95069bb2675e4ce1fff090c1c1620)
[23:08:15] <wikibugs>	 (03update) 10raymond-ndibe: envvars-api: bump to 0.0.78-20251110182323-0b17af8c [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1074 (https://phabricator.wikimedia.org/T408783) (owner: 10group_203_bot_f4d95069bb2675e4ce1fff090c1c1620)
[23:08:16] <wikibugs>	 (03approved) 10raymond-ndibe: envvars-api: bump to 0.0.78-20251110182323-0b17af8c [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1074 (https://phabricator.wikimedia.org/T408783) (owner: 10group_203_bot_f4d95069bb2675e4ce1fff090c1c1620)
[23:08:26] <wikibugs>	 (03update) 10raymond-ndibe: components-api: bump to 0.0.179-20251110183040-e85bd1d8 [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1063 (https://phabricator.wikimedia.org/T401648 https://phabricator.wikimedia.org/T402572 https://phabricator.wikimedia.org/T408783) (owner: 10group_203_bot_f4d95069bb2675e4ce1fff090c1c1620)
[23:08:28] <wikibugs>	 (03approved) 10raymond-ndibe: components-api: bump to 0.0.179-20251110183040-e85bd1d8 [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1063 (https://phabricator.wikimedia.org/T401648 https://phabricator.wikimedia.org/T402572 https://phabricator.wikimedia.org/T408783) (owner: 10group_203_bot_f4d95069bb2675e4ce1fff090c1c1620)
[23:08:41] <wikibugs>	 (03update) 10raymond-ndibe: builds-api: bump to 0.0.205-20251110182408-280ae482 [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1075 (https://phabricator.wikimedia.org/T408783) (owner: 10group_203_bot_f4d95069bb2675e4ce1fff090c1c1620)
[23:08:42] <wikibugs>	 (03approved) 10raymond-ndibe: builds-api: bump to 0.0.205-20251110182408-280ae482 [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1075 (https://phabricator.wikimedia.org/T408783) (owner: 10group_203_bot_f4d95069bb2675e4ce1fff090c1c1620)
[23:09:05] <wikibugs>	 (03merge) 10raymond-ndibe: ingress-admission: bump to 0.0.70-20251110182813-e6936b2b [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1073 (https://phabricator.wikimedia.org/T408783) (owner: 10group_203_bot_f4d95069bb2675e4ce1fff090c1c1620)
[23:09:14] <wikibugs>	 (03update) 10raymond-ndibe: builds-api: bump to 0.0.205-20251110182408-280ae482 [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1075 (https://phabricator.wikimedia.org/T408783) (owner: 10group_203_bot_f4d95069bb2675e4ce1fff090c1c1620)
[23:09:28] <wikibugs>	 (03update) 10raymond-ndibe: components-api: bump to 0.0.179-20251110183040-e85bd1d8 [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1063 (https://phabricator.wikimedia.org/T401648 https://phabricator.wikimedia.org/T402572 https://phabricator.wikimedia.org/T408783) (owner: 10group_203_bot_f4d95069bb2675e4ce1fff090c1c1620)
[23:09:40] <wikibugs>	 (03merge) 10raymond-ndibe: builds-api: bump to 0.0.205-20251110182408-280ae482 [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1075 (https://phabricator.wikimedia.org/T408783) (owner: 10group_203_bot_f4d95069bb2675e4ce1fff090c1c1620)
[23:10:12] <wikibugs>	 (03update) 10raymond-ndibe: components-api: bump to 0.0.179-20251110183040-e85bd1d8 [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1063 (https://phabricator.wikimedia.org/T401648 https://phabricator.wikimedia.org/T402572 https://phabricator.wikimedia.org/T408783) (owner: 10group_203_bot_f4d95069bb2675e4ce1fff090c1c1620)
[23:10:35] <wikibugs>	 (03merge) 10raymond-ndibe: components-api: bump to 0.0.179-20251110183040-e85bd1d8 [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1063 (https://phabricator.wikimedia.org/T401648 https://phabricator.wikimedia.org/T402572 https://phabricator.wikimedia.org/T408783) (owner: 10group_203_bot_f4d95069bb2675e4ce1fff090c1c1620)
[23:10:48] <wikibugs>	 (03update) 10raymond-ndibe: envvars-api: bump to 0.0.78-20251110182323-0b17af8c [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1074 (https://phabricator.wikimedia.org/T408783) (owner: 10group_203_bot_f4d95069bb2675e4ce1fff090c1c1620)
[23:11:23] <wikibugs>	 (03merge) 10raymond-ndibe: envvars-api: bump to 0.0.78-20251110182323-0b17af8c [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1074 (https://phabricator.wikimedia.org/T408783) (owner: 10group_203_bot_f4d95069bb2675e4ce1fff090c1c1620)
[23:29:01] <wikibugs>	 (03open) 10raymond-ndibe: values.yml: use harbor images [repos/cloud/toolforge/image-config] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/image-config/-/merge_requests/17 (https://phabricator.wikimedia.org/T409727)
[23:30:23] <wikibugs>	 06cloud-services-team, 10Toolforge (Toolforge iteration 25), 13Patch-For-Review: [builds-api,harbor,image-config] Move pre-built images to harbor - https://phabricator.wikimedia.org/T409727#11361475 (10Raymond_Ndibe) a:03Raymond_Ndibe
[23:34:14] <wikibugs>	 06cloud-services-team, 10Toolforge (Toolforge iteration 25), 13Patch-For-Review: [builds-api,harbor,image-config] Move pre-built images to harbor - https://phabricator.wikimedia.org/T409727#11361485 (10Raymond_Ndibe)
[23:34:41] <wikibugs>	 06cloud-services-team, 10Toolforge (Toolforge iteration 25), 13Patch-For-Review: [builds-api,harbor,image-config] Move pre-built images to harbor - https://phabricator.wikimedia.org/T409727#11361492 (10Raymond_Ndibe)
[23:35:02] <wikibugs>	 06cloud-services-team, 10Toolforge (Toolforge iteration 25), 13Patch-For-Review: [builds-api,harbor,image-config] Move pre-built images to harbor - https://phabricator.wikimedia.org/T409727#11361493 (10Raymond_Ndibe)
[23:36:13] <wikibugs>	 06cloud-services-team, 10Toolforge (Toolforge iteration 25), 13Patch-For-Review: [builds-api,harbor,image-config] Move pre-built images to harbor - https://phabricator.wikimedia.org/T409727#11361494 (10Raymond_Ndibe)
[23:44:29] <wmcs-alerts>	 FIRING: ToolforgeToolviewsStale: Toolviews data is stale - https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/ToolforgeToolviewsStale  - https://prometheus-alerts.wmcloud.org/?q=alertname%3DToolforgeToolviewsStale
[23:50:35] <wikibugs>	 06cloud-services-team, 10Toolforge: See if we can borrow parts of the wikiprod WAF for Toolforge - https://phabricator.wikimedia.org/T409759#11361531 (10bd808) One of the big things that makes hiddenparma useful on the prod edge is the `webrequest-live` traffic analysis dashboard on superset.wikimedia.org. I'm...
[23:59:29] <wmcs-alerts>	 RESOLVED: ToolforgeToolviewsStale: Toolviews data is stale - https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/ToolforgeToolviewsStale  - https://prometheus-alerts.wmcloud.org/?q=alertname%3DToolforgeToolviewsStale