[00:06:17] (03PS3) 10Novem Linguae: eslint: autofix several rules [labs/xtools] - 10https://gerrit.wikimedia.org/r/1260605 (https://phabricator.wikimedia.org/T392531) [00:06:27] (03CR) 10Novem Linguae: "Done" [labs/xtools] - 10https://gerrit.wikimedia.org/r/1260605 (https://phabricator.wikimedia.org/T392531) (owner: 10Novem Linguae) [00:06:41] (03PS2) 10Novem Linguae: eslint: add spaces inside parentheses and brackets [labs/xtools] - 10https://gerrit.wikimedia.org/r/1260608 (https://phabricator.wikimedia.org/T392531) [00:06:47] (03PS2) 10Novem Linguae: eslint: autofix several rules [labs/xtools] - 10https://gerrit.wikimedia.org/r/1260616 (https://phabricator.wikimedia.org/T392531) [00:22:05] 10Tool-whattodo: Add support for suggestions by category to Whattodo - https://phabricator.wikimedia.org/T421332 (10Ijon) 03NEW [00:58:36] 10Wikibugs: Wikibugs should ignore V+1 from Cindy The Browser Test Bot - https://phabricator.wikimedia.org/T421334 (10SomeRandomDeveloper) 03NEW [05:20:09] 06cloud-services-team (FY2025/2026-Q3-Q4), 10Data-Services, 06Data-Persistence: clouddb1013 crashed after the upgrade to mariadb 10.11.16 - https://phabricator.wikimedia.org/T420177#11752431 (10Marostegui) clouddb1022 has had some SEGV without any other traces on the logs. I am trying to see if I can get so... [05:27:20] 06cloud-services-team (FY2025/2026-Q3-Q4), 10Data-Services, 06Data-Persistence: clouddb1013 crashed after the upgrade to mariadb 10.11.16 - https://phabricator.wikimedia.org/T420177#11752434 (10Marostegui) I got some stack traces and I need to see if I can find something obvious there to report to MariaDB. I... [05:27:22] FIRING: [2x] HAProxyBackendUnavailable: HAProxy service wikireplica-db-web-s3 backend clouddb1022.eqiad.wmnet is DOWN - https://wikitech.wikimedia.org/wiki/HAProxy - TODO - https://alerts.wikimedia.org/?q=alertname%3DHAProxyBackendUnavailable [05:32:22] RESOLVED: [2x] HAProxyBackendUnavailable: HAProxy service wikireplica-db-web-s3 backend clouddb1022.eqiad.wmnet is DOWN - https://wikitech.wikimedia.org/wiki/HAProxy - TODO - https://alerts.wikimedia.org/?q=alertname%3DHAProxyBackendUnavailable [05:50:22] FIRING: HAProxyBackendUnavailable: HAProxy service wikireplica-db-web-s3 backend clouddb1022.eqiad.wmnet is DOWN - https://wikitech.wikimedia.org/wiki/HAProxy - TODO - https://alerts.wikimedia.org/?q=alertname%3DHAProxyBackendUnavailable [05:55:22] RESOLVED: HAProxyBackendUnavailable: HAProxy service wikireplica-db-web-s3 backend clouddb1022.eqiad.wmnet is DOWN - https://wikitech.wikimedia.org/wiki/HAProxy - TODO - https://alerts.wikimedia.org/?q=alertname%3DHAProxyBackendUnavailable [06:42:29] 06cloud-services-team (FY2025/2026-Q3-Q4), 10Data-Services, 06Data-Persistence, 06DBA: clouddb1013 crashed after the upgrade to mariadb 10.11.16 - https://phabricator.wikimedia.org/T420177#11752454 (10Marostegui) [07:10:27] (03PS2) 10Lokal Profil: Recreate source tables as part of deployment [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/1259245 (owner: 10Jean-Frédéric) [07:11:21] (03CR) 10Lokal Profil: Recreate source tables as part of deployment (032 comments) [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/1259245 (owner: 10Jean-Frédéric) [07:53:43] 06cloud-services-team (FY2025/2026-Q3-Q4), 10Data-Services, 06Data-Persistence, 06DBA: clouddb1013 crashed after the upgrade to mariadb 10.11.16 - https://phabricator.wikimedia.org/T420177#11752539 (10Marostegui) I am running a live gdb attached to s3 in clouddb1022 to see if I can capture more information... [07:53:48] 06cloud-services-team (FY2025/2026-Q3-Q4), 10Data-Services, 06Data-Persistence, 06DBA: clouddb1013 crashed after the upgrade to mariadb 10.11.16 - https://phabricator.wikimedia.org/T420177#11752541 (10Marostegui) a:03Marostegui [08:24:20] (03PS1) 10Akoopal: unused_monuments_images run broken [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/1261338 (https://phabricator.wikimedia.org/T421295) [08:26:00] 10Toolforge (Quota-requests): Request increased quota for techacitivty Toolforge tool - https://phabricator.wikimedia.org/T421292#11752584 (10Addshore) [08:29:44] FIRING: MaintainDBUsersManyErrors: Maintain-dbusers is having sustained errors - https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/MaintainDBUsersManyErrors - https://grafana.wikimedia.org/d/ae240a06-c13e-49f3-b12c-58432c551e85/wmcs-maintain-dbusers - https://alerts.wikimedia.org/?q=alertname%3DMaintainDBUsersManyErrors [08:33:54] (03open) 10isaranto: Add per-watch event type filtering for project watches [toolforge-repos/phabricator-slack-bot] - 10https://gitlab.wikimedia.org/toolforge-repos/phabricator-slack-bot/-/merge_requests/1 [08:37:42] (03update) 10isaranto: Add per-watch event type filtering for project watches [toolforge-repos/phabricator-slack-bot] - 10https://gitlab.wikimedia.org/toolforge-repos/phabricator-slack-bot/-/merge_requests/1 [08:40:12] (03update) 10isaranto: Add per-watch event type filtering for project watches [toolforge-repos/phabricator-slack-bot] - 10https://gitlab.wikimedia.org/toolforge-repos/phabricator-slack-bot/-/merge_requests/1 [08:54:30] (03open) 10vriaa: fix: resolve dependency vulnerabilities [toolforge-repos/centralnotice-banner-editor] - 10https://gitlab.wikimedia.org/toolforge-repos/centralnotice-banner-editor/-/merge_requests/35 [08:54:42] (03merge) 10vriaa: fix: resolve dependency vulnerabilities [toolforge-repos/centralnotice-banner-editor] - 10https://gitlab.wikimedia.org/toolforge-repos/centralnotice-banner-editor/-/merge_requests/35 [09:14:44] RESOLVED: MaintainDBUsersManyErrors: Maintain-dbusers is having sustained errors - https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/MaintainDBUsersManyErrors - https://grafana.wikimedia.org/d/ae240a06-c13e-49f3-b12c-58432c551e85/wmcs-maintain-dbusers - https://alerts.wikimedia.org/?q=alertname%3DMaintainDBUsersManyErrors [09:29:38] 10Toolforge (Quota-requests): Request increased quota for techacitivty Toolforge tool - https://phabricator.wikimedia.org/T421292#11752709 (10dcaro) A couple questions: * +14/15 pods/jobs will mean +15 jobs, is that ok? (we don't have a separated pod limit) * The increases in CPU/RAM are for a single pod, or in... [09:30:12] 10Toolforge (Quota-requests): Request increased quota for techacitivty Toolforge tool - https://phabricator.wikimedia.org/T421292#11752713 (10dcaro) Once clarified, +1 from me (for the clinic duty to apply) [09:31:25] (03merge) 10dcaro: build: add use_deprecated_versions [repos/cloud/toolforge/builds-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/builds-api/-/merge_requests/155 (https://phabricator.wikimedia.org/T380127) [09:36:37] (03open) 10vriaa: chore: apply eslint comma-dangle style fixes introduced by eslint-config-wikimedia@0.31.0 [toolforge-repos/centralnotice-banner-editor] - 10https://gitlab.wikimedia.org/toolforge-repos/centralnotice-banner-editor/-/merge_requests/36 [09:36:39] (03merge) 10vriaa: chore: apply eslint comma-dangle style fixes introduced by eslint-config-wikimedia@0.31.0 [toolforge-repos/centralnotice-banner-editor] - 10https://gitlab.wikimedia.org/toolforge-repos/centralnotice-banner-editor/-/merge_requests/36 [09:40:11] 10Toolforge (Quota-requests): Request increased quota for techacitivty Toolforge tool - https://phabricator.wikimedia.org/T421292#11752732 (10Addshore) > +14/15 pods/jobs will mean +15 jobs, is that ok? (we don't have a separated pod limit) Yes +15 jobs (I essentially only use jobs right now), reading the docs... [09:48:29] (03update) 10group_203_bot_f4d95069bb2675e4ce1fff090c1c1620: builds-api: bump to 0.0.210-20260326093139-b2f70662 [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1183 (https://phabricator.wikimedia.org/T380127) [09:48:37] (03open) 10group_203_bot_f4d95069bb2675e4ce1fff090c1c1620: builds-api: bump to 0.0.210-20260326093139-b2f70662 [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1183 (https://phabricator.wikimedia.org/T380127) [09:58:47] 10Tool-campwiz-nxt: CampWiz Nxt Redesign: Root Path - https://phabricator.wikimedia.org/T415408#11752799 (10Dipanshu1223) →14Duplicate dup:03T421342 [09:58:49] 10Tool-campwiz-nxt, 10Google-Summer-of-Code (2026): GSoC 2026: CampWiz NxT Redesign - https://phabricator.wikimedia.org/T414269#11752798 (10Dipanshu1223) →14Duplicate dup:03T421342 [09:59:56] !log dcaro@cloudcumin1001 toolsbeta START - Cookbook wmcs.toolforge.component.deploy for component builds-api [10:01:50] 10Tool-campwiz-nxt: CampWiz Nxt Redesign: Root Path - https://phabricator.wikimedia.org/T415408#11752804 (10Dipanshu1223) [10:05:15] !log dcaro@cloudcumin1001 toolsbeta END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component builds-api [10:07:18] 10Tool-campwiz-nxt, 10Google-Summer-of-Code (2026): GSoC 2026: CampWiz NxT Redesign - https://phabricator.wikimedia.org/T414269#11752841 (10Dipanshu1223) [10:07:19] 10Tool-campwiz-nxt: CampWiz Nxt Redesign: Root Path - https://phabricator.wikimedia.org/T415408#11752840 (10Dipanshu1223) [10:09:16] 06cloud-services-team, 10Toolforge: QuickStatements not working since a couple of days (Item not available) - https://phabricator.wikimedia.org/T421345 (10pere_prlpz) 03NEW [10:16:43] !log dcaro@cloudcumin1001 tools START - Cookbook wmcs.toolforge.component.deploy for component builds-api [10:22:32] !log dcaro@cloudcumin1001 tools END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component builds-api [10:25:08] 10Tools: QuickStatements not working since a couple of days (Item not available) - https://phabricator.wikimedia.org/T421345#11752909 (10dcaro) [10:37:36] 10Tool-campwiz-nxt, 10Google-Summer-of-Code (2026): GSoC 2026: CampWiz NxT Redesign - https://phabricator.wikimedia.org/T414269#11752935 (10Aklapper) [10:37:37] 10Tool-campwiz-nxt: CampWiz Nxt Redesign: Root Path - https://phabricator.wikimedia.org/T415408#11752934 (10Aklapper) [10:38:57] 10Tool-campwiz-nxt, 10Google-Summer-of-Code (2026): GSoC 2026: CampWiz NxT Redesign - https://phabricator.wikimedia.org/T414269#11752942 (10Aklapper) 05Duplicate→03Open [10:39:09] 10Tool-campwiz-nxt: CampWiz Nxt Redesign: Root Path - https://phabricator.wikimedia.org/T415408#11752944 (10Aklapper) 05Duplicate→03Open [10:57:05] 06cloud-services-team (FY2025/2026-Q3-Q4), 06Infrastructure-Foundations, 10Puppet-Core, 13Patch-For-Review: Puppet types causing issues around nftables::service - https://phabricator.wikimedia.org/T411102#11752999 (10taavi) 05Open→03Resolved [11:50:00] (03CR) 10Lokal Profil: [C:03+2] Recreate source tables as part of deployment [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/1259245 (owner: 10Jean-Frédéric) [11:51:53] (03Merged) 10jenkins-bot: Recreate source tables as part of deployment [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/1259245 (owner: 10Jean-Frédéric) [12:24:16] 10Tool-paulina, 10Outreachy (Round 31): Outreachy 31: Features to edit author and work data on Wikidata directly from Paulina - https://phabricator.wikimedia.org/T392429#11753266 (10Pepe_piton) 05Open→03Resolved [12:25:04] (03open) 10l10n-bot: Localisation updates from https://translatewiki.net. [toolforge-repos/lexeme-forms] - 10https://gitlab.wikimedia.org/toolforge-repos/lexeme-forms/-/merge_requests/37 [12:25:22] 10Tool-paulina, 10Outreachy (Round 31): OAuth Implementation - https://phabricator.wikimedia.org/T412023#11753275 (10Pepe_piton) 05Open→03Resolved [12:47:08] (03approved) 10dcaro: builds-api: bump to 0.0.210-20260326093139-b2f70662 [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1183 (https://phabricator.wikimedia.org/T380127) (owner: 10group_203_bot_f4d95069bb2675e4ce1fff090c1c1620) [12:47:16] (03merge) 10dcaro: builds-api: bump to 0.0.210-20260326093139-b2f70662 [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1183 (https://phabricator.wikimedia.org/T380127) (owner: 10group_203_bot_f4d95069bb2675e4ce1fff090c1c1620) [12:51:27] 06cloud-services-team, 10Toolforge: [components-api] Use ISO 8601 date formats in API responses - https://phabricator.wikimedia.org/T421369 (10fnegri) 03NEW [12:51:33] (03update) 10dcaro: builds-api: update buildpacks to 24_0.20.7/24_0.21.5 [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1175 [12:52:16] (03update) 10raymond-ndibe: support since and until params in logs endpoints [repos/cloud/toolforge/logs-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/logs-api/-/merge_requests/12 (https://phabricator.wikimedia.org/T400917) [12:52:37] (03update) 10dcaro: builds-api: update buildpacks to 24_0.21.5 [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1175 [12:53:39] (03update) 10dcaro: builds-api: update buildpacks to 24_0.21.5 [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1175 [12:54:03] (03open) 10fnegri: Store and return valid ISO 8601 timestamps [repos/cloud/toolforge/components-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/components-api/-/merge_requests/157 [12:54:23] (03update) 10fnegri: Store and return valid ISO 8601 timestamps [repos/cloud/toolforge/components-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/components-api/-/merge_requests/157 [12:54:30] (03update) 10dcaro: builds-api: update buildpacks to 24_0.21.5 [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1175 [12:55:29] (03update) 10dcaro: builds-api: update buildpacks to 24_0.21.5 [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1175 [12:58:16] 06cloud-services-team (FY2025/2026-Q3-Q4), 10Toolforge (Toolforge iteration 26), 13Patch-For-Review: [builds-builder] Add support for Heroku's "24" builder stack based on Ubuntu 2024.04 noble - https://phabricator.wikimedia.org/T380127#11753521 (10dcaro) [13:01:49] (03update) 10raymond-ndibe: support since and until params in logs endpoints [repos/cloud/toolforge/logs-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/logs-api/-/merge_requests/12 (https://phabricator.wikimedia.org/T400917) [13:24:07] 10Tool-wmf-openapi-linter, 06MW-Interfaces-Team: Improve linting - requestBody and response examples - https://phabricator.wikimedia.org/T421375 (10KBach) 03NEW [13:26:12] (03update) 10raymond-ndibe: support since and until params in logs endpoints [repos/cloud/toolforge/logs-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/logs-api/-/merge_requests/12 (https://phabricator.wikimedia.org/T400917) [13:33:54] !log root@cloudcumin1001 admin START - Cookbook wmcs.openstack.restart_openstack on deployment codfw1dev for all services [13:38:03] !log root@cloudcumin1001 admin END (PASS) - Cookbook wmcs.openstack.restart_openstack (exit_code=0) on deployment codfw1dev for all services [13:42:53] 10Tool-campwiz-nxt, 10Google-Summer-of-Code (2026): GSoC 2026: CampWiz NxT Redesign - https://phabricator.wikimedia.org/T414269#11753772 (10Aklapper) [14:14:00] 10Tool-wikimedia-attribution: [WAF] Exploration: Make Attribution Configurator use the Attribution API - https://phabricator.wikimedia.org/T416990#11753903 (10RHo) [14:18:00] 10Tool-wikimedia-attribution: Update data links to the Attribution API Beta - https://phabricator.wikimedia.org/T421385 (10RHo) 03NEW [14:19:43] 10Tool-wikimedia-attribution: Update data links to the Attribution API Beta - https://phabricator.wikimedia.org/T421385#11753961 (10RHo) hi @HCoplin-WMF - can you please advise on the API beta URL and expected date once ready? Thank you! [14:20:28] !log taavi@cloudcumin1001 tools START - Cookbook wmcs.toolforge.k8s.image.copy_to_registry for image docker-registry.svc.toolforge.org/cadvisor:0.56.2 [14:20:32] !log taavi@cloudcumin1001 tools END (FAIL) - Cookbook wmcs.toolforge.k8s.image.copy_to_registry (exit_code=99) for image docker-registry.svc.toolforge.org/cadvisor:0.56.2 [14:20:48] !log taavi@cloudcumin1001 tools START - Cookbook wmcs.toolforge.k8s.image.copy_to_registry for image docker-registry.svc.toolforge.org/cadvisor:0.56.2 [14:21:00] !log taavi@cloudcumin1001 tools END (PASS) - Cookbook wmcs.toolforge.k8s.image.copy_to_registry (exit_code=0) for image docker-registry.svc.toolforge.org/cadvisor:0.56.2 [14:21:52] (03update) 10dcaro: [status] make job status an enum, with clearly defined states [repos/cloud/toolforge/jobs-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/jobs-api/-/merge_requests/208 (https://phabricator.wikimedia.org/T401172) (owner: 10raymond-ndibe) [14:22:40] 06cloud-services-team (FY2025/2026-Q3-Q4), 10Toolforge: cadvisor-reported Istio network usage is way too high - https://phabricator.wikimedia.org/T421386 (10taavi) 03NEW [14:25:20] (03open) 10taavi: chart: Upgrade cadvisor to 0.56.2 [repos/cloud/toolforge/wmcs-k8s-metrics] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/wmcs-k8s-metrics/-/merge_requests/13 (https://phabricator.wikimedia.org/T421386) [14:25:47] (03update) 10dcaro: [status] make job status an enum, with clearly defined states [repos/cloud/toolforge/jobs-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/jobs-api/-/merge_requests/208 (https://phabricator.wikimedia.org/T401172) (owner: 10raymond-ndibe) [14:28:24] (03update) 10raymond-ndibe: support since and until params in logs endpoints [repos/cloud/toolforge/logs-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/logs-api/-/merge_requests/12 (https://phabricator.wikimedia.org/T400917) [14:29:20] (03update) 10raymond-ndibe: support since and until params in logs endpoints [repos/cloud/toolforge/logs-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/logs-api/-/merge_requests/12 (https://phabricator.wikimedia.org/T400917) [14:32:52] 06cloud-services-team, 10Toolforge: [components-api] Use ISO 8601 date formats in API responses - https://phabricator.wikimedia.org/T421369#11754067 (10fnegri) https://gitlab.wikimedia.org/repos/cloud/toolforge/components-api/-/merge_requests/157 [14:34:28] (03update) 10fnegri: Store and return valid ISO 8601 timestamps [repos/cloud/toolforge/components-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/components-api/-/merge_requests/157 [14:39:09] (03update) 10fnegri: Store and return valid ISO 8601 timestamps [repos/cloud/toolforge/components-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/components-api/-/merge_requests/157 [14:47:08] (03update) 10fnegri: Store and return valid ISO 8601 timestamps [repos/cloud/toolforge/components-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/components-api/-/merge_requests/157 [14:47:53] (03update) 10taavi: Store and return valid ISO 8601 timestamps [repos/cloud/toolforge/components-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/components-api/-/merge_requests/157 (https://phabricator.wikimedia.org/T421369) (owner: 10fnegri) [14:51:52] (03update) 10dcaro: [status] make job status an enum, with clearly defined states [repos/cloud/toolforge/jobs-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/jobs-api/-/merge_requests/208 (https://phabricator.wikimedia.org/T401172) (owner: 10raymond-ndibe) [14:53:35] 10Tool-campwiz-nxt: CampWiz Nxt Redesign: Root Path - https://phabricator.wikimedia.org/T415408#11754180 (10Sabee_06) Hi, I’m Mohamed Sabeek. I’m interested in contributing to CampWiz NxT Redesign for GSoC 2026. I have experience in React and frontend development. I would like to start working on microtasks.... [14:54:47] (03update) 10fnegri: Store and return valid ISO 8601 timestamps [repos/cloud/toolforge/components-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/components-api/-/merge_requests/157 (https://phabricator.wikimedia.org/T421369) [14:55:30] (03update) 10fnegri: Store and return valid ISO 8601 timestamps [repos/cloud/toolforge/components-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/components-api/-/merge_requests/157 (https://phabricator.wikimedia.org/T421369) [14:57:46] (03update) 10dcaro: [status] make job status an enum, with clearly defined states [repos/cloud/toolforge/jobs-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/jobs-api/-/merge_requests/208 (https://phabricator.wikimedia.org/T401172) (owner: 10raymond-ndibe) [15:02:45] 10Cloud-VPS (Quota-requests), 10Catalyst: Disk quota increase for catalyst-dev - https://phabricator.wikimedia.org/T420611#11754224 (10fnegri) +1 [15:15:11] 10Tool-delintbot: Add ability to only enable or disable certain fixes - https://phabricator.wikimedia.org/T416550#11754325 (10Redmin) 05Open→03In progress [15:59:32] (03approved) 10dcaro: chart: Upgrade cadvisor to 0.56.2 [repos/cloud/toolforge/wmcs-k8s-metrics] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/wmcs-k8s-metrics/-/merge_requests/13 (https://phabricator.wikimedia.org/T421386) (owner: 10taavi) [16:40:47] 10Cloud-VPS (Quota-requests), 10Browser Test Platform, 10Continuous-Integration-Infrastructure, 10Continuous-Integration-Config, 07Jenkins: New flavor for the integration project with more vCPU and ephemeral disk space - https://phabricator.wikimedia.org/T421242#11754852 (10Andrew) +1 this seems fine; wo... [17:07:54] !log taavi@cloudcumin1001 catalyst-dev START - Cookbook wmcs.openstack.quota_increase by 320 gigabytes (T420611) [17:07:58] T420611: Disk quota increase for catalyst-dev - https://phabricator.wikimedia.org/T420611 [17:08:02] !log taavi@cloudcumin1001 catalyst-dev END (PASS) - Cookbook wmcs.openstack.quota_increase (exit_code=0) by 320 gigabytes (T420611) [17:08:44] 10Cloud-VPS (Quota-requests), 10Catalyst: Disk quota increase for catalyst-dev - https://phabricator.wikimedia.org/T420611#11754927 (10taavi) 05Open→03Resolved a:03taavi [17:10:03] (03merge) 10taavi: chart: Upgrade cadvisor to 0.56.2 [repos/cloud/toolforge/wmcs-k8s-metrics] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/wmcs-k8s-metrics/-/merge_requests/13 (https://phabricator.wikimedia.org/T421386) [17:11:55] 10Toolforge (Quota-requests): Request increased quota for techactivity Toolforge tool - https://phabricator.wikimedia.org/T421292#11754938 (10taavi) [17:12:01] (03update) 10group_203_bot_f4d95069bb2675e4ce1fff090c1c1620: wmcs-k8s-metrics: bump to 0.0.24-20260326171011-f1ad4b3c [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1184 (https://phabricator.wikimedia.org/T421386) [17:12:28] 10Cloud-VPS (Quota-requests), 10Browser Test Platform, 10Continuous-Integration-Infrastructure, 10Continuous-Integration-Config, 07Jenkins: New flavor for the integration project with more vCPU and ephemeral disk space - https://phabricator.wikimedia.org/T421242#11754940 (10hashar) The 8cores one (`g4.co... [17:13:02] !log taavi@cloudcumin1001 toolsbeta START - Cookbook wmcs.toolforge.component.deploy for component wmcs-k8s-metrics [17:14:08] 10Toolforge (Quota-requests): Request increased quota for techactivity Toolforge tool - https://phabricator.wikimedia.org/T421292#11754943 (10taavi) I am still not fully clear on whether this is to bump the total RAM allowance within the namespace by 8G, increase the per-pod RAM limit to 8G, or both. Please upda... [17:14:36] !log taavi@cloudcumin1001 toolsbeta END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component wmcs-k8s-metrics [17:19:09] 06cloud-services-team, 10Cloud-VPS (Quota-requests): Add floating IP and vanity domain for azwikimedia project - https://phabricator.wikimedia.org/T419582#11754949 (10dcaro) Hi @Nemoralis, is there anything else needed here? Can we close the task? [17:19:09] (03approved) 10lucaswerkmeister: Localisation updates from https://translatewiki.net. [toolforge-repos/lexeme-forms] - 10https://gitlab.wikimedia.org/toolforge-repos/lexeme-forms/-/merge_requests/37 (owner: 10l10n-bot) [17:19:13] (03merge) 10lucaswerkmeister: Localisation updates from https://translatewiki.net. [toolforge-repos/lexeme-forms] - 10https://gitlab.wikimedia.org/toolforge-repos/lexeme-forms/-/merge_requests/37 (owner: 10l10n-bot) [17:25:37] !log taavi@cloudcumin1001 tools START - Cookbook wmcs.toolforge.component.deploy for component wmcs-k8s-metrics [17:25:57] (03merge) 10taavi: wmcs-k8s-metrics: bump to 0.0.24-20260326171011-f1ad4b3c [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1184 (https://phabricator.wikimedia.org/T421386) (owner: 10group_203_bot_f4d95069bb2675e4ce1fff090c1c1620) [17:30:51] !log taavi@cloudcumin1001 tools END (FAIL) - Cookbook wmcs.toolforge.component.deploy (exit_code=99) for component wmcs-k8s-metrics [17:33:16] 10Toolforge (Quota-requests): Request increased quota for techactivity Toolforge tool - https://phabricator.wikimedia.org/T421292#11754971 (10Addshore) [17:36:11] 10VPS-project-Codesearch, 10MediaWiki-extensions-General, 10MediaWiki-libs-HTTP, 10MediaWiki-libs-utfnormal, and 4 others: Deprecation Notice: Function curl_close() is deprecated since 8.5, as it has no effect since PHP 8.0 - https://phabricator.wikimedia.org/T413538#11754976 (10A_smart_kitten) (restor... [17:43:30] 06cloud-services-team (FY2025/2026-Q3-Q4), 10Toolforge: cadvisor-reported Istio network usage is way too high - https://phabricator.wikimedia.org/T421386#11754986 (10taavi) New theory: this is a frankly way-too-high amount of Prometheus metrics the pod is emitting. [18:03:52] 06cloud-services-team, 10Toolforge: Alert on Prometheus instability / unexpected restarts - https://phabricator.wikimedia.org/T421416 (10taavi) 03NEW p:05Triage→03High [18:04:16] 06cloud-services-team (FY2025/2026-Q3-Q4), 10Toolforge, 13Patch-For-Review: cadvisor-reported Istio network usage is way too high - https://phabricator.wikimedia.org/T421386#11755119 (10taavi) p:05Triage→03High [18:04:40] 06cloud-services-team, 10Toolforge: [components-api] Use ISO 8601 date formats in API responses - https://phabricator.wikimedia.org/T421369#11755123 (10taavi) p:05Triage→03Medium [18:04:55] 06cloud-services-team, 10Cloud-VPS, 13Patch-For-Review: Bind all cloudlb services to specific service VIPs only - https://phabricator.wikimedia.org/T420921#11755128 (10taavi) p:05Triage→03Medium [18:31:00] 10Tool-curator: Curator should handle MediaWiki\Upload\Exception\UploadStashFileException Commons failure during uploads - https://phabricator.wikimedia.org/T420959#11755283 (10DaxServer) 05Open→03In progress [19:13:17] 06cloud-services-team, 10Toolforge: Fatal error in Free image search tool - https://phabricator.wikimedia.org/T421429 (10Mathglot) 03NEW [19:15:51] 06cloud-services-team, 10Toolforge: Fatal error in Free image search tool - https://phabricator.wikimedia.org/T421429#11755514 (10Mathglot) [19:17:38] 10Tools: Fatal error in Free image search tool - https://phabricator.wikimedia.org/T421429#11755526 (10JJMC89) [19:49:01] 10Tool-wmf-openapi-linter, 06MW-Interfaces-Team: Improve linting - requestBody and response examples - https://phabricator.wikimedia.org/T421375#11755729 (10Atieno) p:05Triage→03Medium [20:31:45] (03PS1) 10Lokal Profil: set new deploy scripts as executables [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/1261574 [20:38:56] (03PS2) 10Jean-Frédéric: Set new deploy scripts as executables [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/1261574 (owner: 10Lokal Profil) [20:39:06] (03CR) 10Jean-Frédéric: [C:03+2] "zaz" [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/1261574 (owner: 10Lokal Profil) [20:41:01] (03Merged) 10jenkins-bot: Set new deploy scripts as executables [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/1261574 (owner: 10Lokal Profil) [20:45:42] (03CR) 10Lokal Profil: [C:03+2] unused_monuments_images run broken [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/1261338 (https://phabricator.wikimedia.org/T421295) (owner: 10Akoopal) [20:47:54] (03Merged) 10jenkins-bot: unused_monuments_images run broken [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/1261338 (https://phabricator.wikimedia.org/T421295) (owner: 10Akoopal) [21:16:16] (03CR) 10Lokal Profil: [C:03+2] cleanup of nl-gem fields [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/1260777 (owner: 10Akoopal) [21:18:12] (03Merged) 10jenkins-bot: cleanup of nl-gem fields [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/1260777 (owner: 10Akoopal) [21:53:51] (03open) 10vriaa: fix: prevent banner link input from overflowing in small screen sizes [toolforge-repos/centralnotice-banner-editor] - 10https://gitlab.wikimedia.org/toolforge-repos/centralnotice-banner-editor/-/merge_requests/37 [21:54:49] (03open) 10vriaa: fix: prevent image fields from overflowing the inputs sidebar [toolforge-repos/centralnotice-banner-editor] - 10https://gitlab.wikimedia.org/toolforge-repos/centralnotice-banner-editor/-/merge_requests/38 (https://phabricator.wikimedia.org/T421120) [21:57:33] (03open) 10vriaa: fix: preserve line breaks in text elements [toolforge-repos/centralnotice-banner-editor] - 10https://gitlab.wikimedia.org/toolforge-repos/centralnotice-banner-editor/-/merge_requests/39 (https://phabricator.wikimedia.org/T420920) [22:01:02] (03open) 10vriaa: fix: prevent alignment buttons from overflowing in small screen sizes [toolforge-repos/centralnotice-banner-editor] - 10https://gitlab.wikimedia.org/toolforge-repos/centralnotice-banner-editor/-/merge_requests/40 (https://phabricator.wikimedia.org/T420940) [22:04:46] (03open) 10danyya: Draft: Optimisation and date stats [toolforge-repos/humaniki] - 10https://gitlab.wikimedia.org/toolforge-repos/humaniki/-/merge_requests/1 [22:12:09] 06cloud-services-team, 10Cloud-VPS (Quota-requests): Add floating IP and vanity domain for azwikimedia project - https://phabricator.wikimedia.org/T419582#11756236 (10Nemoralis) >>! In T419582#11754949, @dcaro wrote: > Hi @Nemoralis, is there anything else needed here? Can we close the task? Yes, you can clos... [22:16:29] 06cloud-services-team, 10Cloud-VPS (Quota-requests): Add floating IP and vanity domain for azwikimedia project - https://phabricator.wikimedia.org/T419582#11756238 (10PixDeVl) 05Open→03Resolved a:03dcaro Marking as assigned to David since he was the one who added the floating IP (title of the task) [23:56:08] 10Cloud-VPS (Debian Bullseye Deprecation), 10Beta-Cluster-Infrastructure, 07Epic, 06Release-Engineering-Team (Priority Backlog 📥): Migrate deployment-prep away from Debian Bullseye to Bookworm/Trixie - https://phabricator.wikimedia.org/T401839#11756483 (10bd808)