[01:53:35] 06serviceops, 10DiscussionTools, 10MediaWiki-REST-API, 10RESTBase Sunsetting, and 3 others: Reroute RESTbase /page/lint/ endpoints to MediaWiki REST endpoints - https://phabricator.wikimedia.org/T384216#11248291 (10aaron) [08:51:26] 06serviceops, 10envoy, 06SRE, 06Data-Platform-SRE (2025.09.26 - 2025.10.17), 07Essential-Work: Upgrade Envoy to v1.29.12 on wcqs and wdqs hosts - https://phabricator.wikimedia.org/T404867#11248912 (10Gehel) [09:06:47] 06serviceops, 06MediaWiki-Engineering: Fold services recommendations into Standards for services RfC - https://phabricator.wikimedia.org/T239856#11249002 (10Joe) 05Open→03Resolved a:05Joe→03None Marking as resolved as this task is obsolete at this point IMO. [11:55:15] 06serviceops, 07Epic, 06MW-Interfaces-Team (MWI-Roadmap), 07OKR-Work, 13Patch-For-Review: Revisit backend routing for rest-gateway - https://phabricator.wikimedia.org/T401396#11249688 (10hnowlan) 05In progress→03Resolved We're now using mw-api-ext as appropriate for rest.php and mw-api-related APIs. [13:06:02] 06serviceops, 06DC-Ops, 10ops-codfw, 06SRE: Q1:rack/setup/install wikikube-ctrl2006 - https://phabricator.wikimedia.org/T400661#11249917 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage started by jhancock@cumin1002 for host wikikube-ctrl2006.codfw.wmnet with OS bookworm executed with errors: -... [13:41:28] 06serviceops, 06DC-Ops, 10ops-codfw, 06SRE: Q1:rack/setup/install wikikube-ctrl2006 - https://phabricator.wikimedia.org/T400661#11250063 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage was started by jhancock@cumin1002 for host wikikube-ctrl2006.codfw.wmnet with OS bookworm [14:21:23] 06serviceops, 06DC-Ops, 10ops-codfw, 06SRE: Q1:rack/setup/install wikikube-ctrl2006 - https://phabricator.wikimedia.org/T400661#11250311 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage started by jhancock@cumin1002 for host wikikube-ctrl2006.codfw.wmnet with OS bookworm completed: - wikikube-ct... [14:21:41] 06serviceops, 06DC-Ops, 10ops-codfw, 06SRE: Q1:rack/setup/install wikikube-ctrl2006 - https://phabricator.wikimedia.org/T400661#11250314 (10Jhancock.wm) [14:22:08] 06serviceops, 06DC-Ops, 10ops-codfw, 06SRE: Q1:rack/setup/install wikikube-ctrl2006 - https://phabricator.wikimedia.org/T400661#11250317 (10Jhancock.wm) 05Open→03Resolved a:03Jhancock.wm @Clement_Goubert this one is ready to go. thanks for your patience! [14:23:33] 06serviceops, 06DC-Ops, 10ops-codfw, 06SRE: Q1:rack/setup/install wikikube-ctrl2006 - https://phabricator.wikimedia.org/T400661#11250327 (10Clement_Goubert) >>! In T400661#11250317, @Jhancock.wm wrote: > @Clement_Goubert this one is ready to go. thanks for your patience! Thanks a bunch <3 [14:25:47] 06serviceops, 06SRE: wikikube-ctrl2006 implementation tracking - https://phabricator.wikimedia.org/T406596 (10Clement_Goubert) 03NEW [14:26:08] 06serviceops, 06SRE: wikikube-ctrl2006 implementation tracking - https://phabricator.wikimedia.org/T406596#11250355 (10Clement_Goubert) p:05Triage→03Medium [15:00:20] 06serviceops, 10GitLab (CI & Job Runners): failed to push docker-registry.discovery.wmnet/repos/data-engineering/airflow-dags:airflow-2.10.5-py3.11-2025-10-03-192132-3003d4328df66a0086a350fdd2ba1dbd80a235c5: unknown: blob upload invalid - https://phabricator.wikimedia.org/T406392#11250573 (10dancy) >>! In T406... [15:09:41] 06serviceops, 10DiscussionTools, 10MediaWiki-REST-API, 10RESTBase Sunsetting, and 3 others: Reroute RESTbase /page/lint/ endpoints to MediaWiki REST endpoints - https://phabricator.wikimedia.org/T384216#11250630 (10OWresch-WMF) [15:10:54] 06serviceops, 10RESTBase Sunsetting, 07Essential-Work, 06MW-Interfaces-Team (MWI-Sprint-20 (2025-10-07 to 2025-10-21)), 13Patch-For-Review: [BLOCKED] Reroute /api/rest_v1 documentation to REST Sandbox - https://phabricator.wikimedia.org/T396807#11250655 (10OWresch-WMF) [15:47:57] 06serviceops, 10decommission-hardware, 13Patch-For-Review: decommission mw135[8-9], mw136[4-6], mw137[2-3], mw140[0-4], mw1406, mw14[11-13] - https://phabricator.wikimedia.org/T383227#11250851 (10ops-monitoring-bot) cookbooks.sre.hosts.decommission executed by jasmine@cumin1003 for hosts: `wikikube-ctrl1001.... [15:53:41] 06serviceops, 06SRE: deploy1003 running out of disk space - https://phabricator.wikimedia.org/T401647#11250907 (10dancy) 05Open→03Resolved We now have a systemd timer which runs `scap clean-images` weekly. And users in the `deployment` group can now run `scap clean-images` successfully. [16:04:54] 06serviceops, 10decommission-hardware, 13Patch-For-Review: decommission mw135[8-9], mw136[4-6], mw137[2-3], mw140[0-4], mw1406, mw14[11-13] - https://phabricator.wikimedia.org/T383227#11251021 (10jasmine_) [17:13:09] 06serviceops, 10decommission-hardware, 13Patch-For-Review: decommission mw135[8-9], mw136[4-6], mw137[2-3], mw140[0-4], mw1406, mw14[11-13] - https://phabricator.wikimedia.org/T383227#11251361 (10Jclark-ctr) @Jasmin when you finish these up when it is ready Please assign over to me and add ops-eqiad tag T... [17:50:40] 06serviceops, 10decommission-hardware, 13Patch-For-Review: decommission mw135[8-9], mw136[4-6], mw137[2-3], mw140[0-4], mw1406, mw14[11-13] - https://phabricator.wikimedia.org/T383227#11251569 (10jasmine_) [17:58:16] 06serviceops, 06DC-Ops, 10decommission-hardware, 10ops-eqiad, 13Patch-For-Review: decommission mw135[8-9], mw136[4-6], mw137[2-3], mw140[0-4], mw1406, mw14[11-13] - https://phabricator.wikimedia.org/T383227#11251601 (10jasmine_) [17:59:05] 06serviceops, 06DC-Ops, 10decommission-hardware, 10ops-eqiad, 13Patch-For-Review: decommission mw135[8-9], mw136[4-6], mw137[2-3], mw140[0-4], mw1406, mw14[11-13] - https://phabricator.wikimedia.org/T383227#11251604 (10jasmine_) >>! In T383227#11251360, @Jclark-ctr wrote: > @Jasmin when you finish these... [20:13:03] 06serviceops, 06DC-Ops, 10decommission-hardware, 10ops-eqiad, and 2 others: decommission mw135[8-9], mw136[4-6], mw137[2-3], mw140[0-4], mw1406, mw14[11-13] - https://phabricator.wikimedia.org/T383227#11252077 (10Jclark-ctr) a:03Jclark-ctr [20:36:51] 06serviceops, 10GitLab (CI & Job Runners): failed to push docker-registry.discovery.wmnet/repos/data-engineering/airflow-dags:airflow-2.10.5-py3.11-2025-10-03-192132-3003d4328df66a0086a350fdd2ba1dbd80a235c5: unknown: blob upload invalid - https://phabricator.wikimedia.org/T406392#11252254 (10amastilovic) >>! I... [21:24:46] 06serviceops, 07Epic, 06MW-Interfaces-Team (MWI-Roadmap), 07OKR-Work: Add support to rest-gateway for action API - https://phabricator.wikimedia.org/T406324#11252415 (10HCoplin-WMF) [23:46:15] 06serviceops, 10GitLab (CI & Job Runners): failed to push docker-registry.discovery.wmnet/repos/data-engineering/airflow-dags:airflow-2.10.5-py3.11-2025-10-03-192132-3003d4328df66a0086a350fdd2ba1dbd80a235c5: unknown: blob upload invalid - https://phabricator.wikimedia.org/T406392#11252870 (10Scott_French) @ama...