[09:37:00] 06serviceops, 10requestctl, 06Traffic, 07Sustainability (Incident Followup): requestctl clearing all fields on error is not user-friendly when combined with stricter checking - https://phabricator.wikimedia.org/T406309 (10MatthewVernon) 03NEW [09:37:31] 06serviceops, 10requestctl, 06Traffic, 07Sustainability (Incident Followup): requestctl clearing all fields on error is not user-friendly when combined with stricter checking - https://phabricator.wikimedia.org/T406309#11239961 (10MatthewVernon) [10:54:48] 06serviceops, 07Epic, 06MW-Interfaces-Team (MWI-Roadmap), 07OKR-Work, 13Patch-For-Review: Revisit backend routing for rest-gateway - https://phabricator.wikimedia.org/T401396#11240538 (10hnowlan) 05Open→03In progress a:03hnowlan [11:19:05] 06serviceops, 06MW-Interfaces-Team, 07OKR-Work: Ensure REST Gateway headers don't conflict with Mediawiki headers - https://phabricator.wikimedia.org/T400346#11240584 (10hnowlan) 05In progress→03Resolved I think everything here has been taken care of. [11:19:59] 06serviceops, 06MW-Interfaces-Team, 07OKR-Work, 13Patch-For-Review: Improved API rerouting strategy for REST gateway - https://phabricator.wikimedia.org/T400131#11240588 (10hnowlan) 05In progress→03Resolved We've implemented rest-gateway-ro in multi-dc.lua, traffic flows moving as expected. [11:23:41] 06serviceops, 07Epic, 06MW-Interfaces-Team (MWI-Roadmap), 07OKR-Work: rest.php via rest-gateway production rollout - https://phabricator.wikimedia.org/T406318 (10hnowlan) 03NEW [11:49:10] 06serviceops, 10requestctl, 06Traffic, 07Sustainability (Incident Followup): requestctl clearing all fields on error is not user-friendly when combined with stricter checking - https://phabricator.wikimedia.org/T406309#11240694 (10Aklapper) [12:03:13] 06serviceops, 07Epic, 06MW-Interfaces-Team (MWI-Roadmap), 07OKR-Work: Add support to rest-gateway for action API - https://phabricator.wikimedia.org/T406324 (10hnowlan) 03NEW [14:22:23] 06serviceops, 10Hiddenparma, 10requestctl, 06Traffic, 07Sustainability (Incident Followup): requestctl clearing all fields on error is not user-friendly when combined with stricter checking - https://phabricator.wikimedia.org/T406309#11241318 (10Scott_French) It's certainly the intention of the code to [... [15:24:21] 06serviceops, 10Citoid, 06Data-Engineering, 06Data-Engineering-Radar, and 7 others: Migrate node-based services in production to node18 - https://phabricator.wikimedia.org/T349118#11241631 (10Dreamy_Jazz) [15:44:03] 06serviceops, 10Hiddenparma, 10requestctl, 06Traffic, 07Sustainability (Incident Followup): requestctl clearing all fields on error is not user-friendly when combined with stricter checking - https://phabricator.wikimedia.org/T406309#11241796 (10Scott_French) 05Open→03Resolved a:03Scott_French... [15:52:34] 06serviceops, 10Prod-Kubernetes, 07Kubernetes: charlie wiped cluster redeployment use-case - https://phabricator.wikimedia.org/T406212#11241946 (10CDanis) >>! In T406212#11238224, @RLazarus wrote: > What's the best query to check the cluster is wiped? One option is just a command-line flag like `--i_solemnly... [16:05:25] 06serviceops, 06SRE-OnFire, 07Sustainability (Incident Followup): Update Etcd/Main cluster#Replication documentation with safe restart conditions and information - https://phabricator.wikimedia.org/T317537#11242099 (10Aklapper) [16:05:31] 06serviceops, 06SRE-OnFire, 07Sustainability (Incident Followup): Add etcdmirror connection retry on etcd-tls-proxy unavailability - https://phabricator.wikimedia.org/T317535#11242100 (10Aklapper) [16:56:53] 06serviceops: mysql.get_core_dbs() exception raised due to missing section - https://phabricator.wikimedia.org/T404464#11242285 (10jasmine_) >>! In T404464#11193685, @jcrespo wrote: > minor followup (just affects documentation): https://github.com/wikimedia/operations-cookbooks/blob/master/cookbooks/sre/switchdc... [16:57:10] 06serviceops: mysql.get_core_dbs() exception raised due to missing section - https://phabricator.wikimedia.org/T404464#11242286 (10jasmine_) 05Open→03Resolved [20:30:10] 06serviceops, 13Patch-For-Review: MediaWiki on PHP 8.3 production workload migration - https://phabricator.wikimedia.org/T405955#11242887 (10Scott_French) [21:17:06] 06serviceops, 10GitLab (CI & Job Runners): failed to push docker-registry.discovery.wmnet/repos/data-engineering/airflow-dags:airflow-2.10.5-py3.11-2025-10-03-192132-3003d4328df66a0086a350fdd2ba1dbd80a235c5: unknown: blob upload invalid - https://phabricator.wikimedia.org/T406392 (10dancy) 03NEW [21:20:46] 06serviceops, 10GitLab (CI & Job Runners): failed to push docker-registry.discovery.wmnet/repos/data-engineering/airflow-dags:airflow-2.10.5-py3.11-2025-10-03-192132-3003d4328df66a0086a350fdd2ba1dbd80a235c5: unknown: blob upload invalid - https://phabricator.wikimedia.org/T406392#11243074 (10dancy) [21:51:14] 06serviceops, 10GitLab (CI & Job Runners): failed to push docker-registry.discovery.wmnet/repos/data-engineering/airflow-dags:airflow-2.10.5-py3.11-2025-10-03-192132-3003d4328df66a0086a350fdd2ba1dbd80a235c5: unknown: blob upload invalid - https://phabricator.wikimedia.org/T406392#11243129 (10Scott_French) In t... [21:53:00] 06serviceops, 10GitLab (CI & Job Runners): failed to push docker-registry.discovery.wmnet/repos/data-engineering/airflow-dags:airflow-2.10.5-py3.11-2025-10-03-192132-3003d4328df66a0086a350fdd2ba1dbd80a235c5: unknown: blob upload invalid - https://phabricator.wikimedia.org/T406392#11243132 (10Scott_French) @dan... [21:55:08] 06serviceops, 10GitLab (CI & Job Runners): failed to push docker-registry.discovery.wmnet/repos/data-engineering/airflow-dags:airflow-2.10.5-py3.11-2025-10-03-192132-3003d4328df66a0086a350fdd2ba1dbd80a235c5: unknown: blob upload invalid - https://phabricator.wikimedia.org/T406392#11243139 (10dancy) >>! In T406... [21:58:53] 06serviceops, 10GitLab (CI & Job Runners): failed to push docker-registry.discovery.wmnet/repos/data-engineering/airflow-dags:airflow-2.10.5-py3.11-2025-10-03-192132-3003d4328df66a0086a350fdd2ba1dbd80a235c5: unknown: blob upload invalid - https://phabricator.wikimedia.org/T406392#11243143 (10dancy) >>! In T406... [22:45:42] 06serviceops, 10GitLab (CI & Job Runners): failed to push docker-registry.discovery.wmnet/repos/data-engineering/airflow-dags:airflow-2.10.5-py3.11-2025-10-03-192132-3003d4328df66a0086a350fdd2ba1dbd80a235c5: unknown: blob upload invalid - https://phabricator.wikimedia.org/T406392#11243219 (10Scott_French) Than...