[13:10:52] 10GitLab (CI & Job Runners): registry.cloud.releng.team returning 503s - https://phabricator.wikimedia.org/T406733 (10Vgutierrez) 03NEW [13:15:11] 10GitLab (CI & Job Runners): registry.cloud.releng.team returning 503s - https://phabricator.wikimedia.org/T406733#11255061 (10hashar) That registry is powered by Reggie and is hosted on our Digital Ocean cluster. [13:33:16] 10GitLab (CI & Job Runners): registry.cloud.releng.team returning 503s - https://phabricator.wikimedia.org/T406733#11255113 (10Jelto) The `reggie-01` pod was moved to another node and the pvc was still stuck on the old node. I guess that happened during automatic scale down of the cluster. ` kubectl -n gitlab-... [13:43:26] 10GitLab (CI & Job Runners): registry.cloud.releng.team returning 503s - https://phabricator.wikimedia.org/T406733#11255146 (10Jelto) reggie is quite a critical component of the non-production/dev CI stack. So maybe it's possible to make it a bit more resilient or HA (which is probably tricky because of the pers... [13:43:49] 10GitLab (CI & Job Runners), 06collaboration-services: registry.cloud.releng.team returning 503s - https://phabricator.wikimedia.org/T406733#11255148 (10Jelto) [13:57:25] 10GitLab (Infrastructure), 10Ceph, 06collaboration-services, 10Data-Persistence-Backup, and 3 others: Migrate gitlab storage to apus (also: backups from S3?) - https://phabricator.wikimedia.org/T378922#11255228 (10Jelto) [14:03:55] 10GitLab (Infrastructure), 10Ceph, 06collaboration-services, 10Data-Persistence-Backup, and 3 others: Migrate gitlab storage to apus (also: backups from S3?) - https://phabricator.wikimedia.org/T378922#11255295 (10Jelto) Deployment-wise everything is done, gitlab artifacts and packages use the object stora... [14:27:12] 10GitLab (Infrastructure), 10Ceph, 06collaboration-services, 10Data-Persistence-Backup, and 3 others: Migrate gitlab storage to apus (also: backups from S3?) - https://phabricator.wikimedia.org/T378922#11255415 (10jcrespo) All good to me to close an follow up later, but please let's merge T403946 asap (not... [14:36:58] 10GitLab (Account Approval), 06Release-Engineering-Team: Requesting GitLab account activation for Dipanshu - https://phabricator.wikimedia.org/T406742 (10Dipanshu) 03NEW [17:45:11] 10GitLab (CI & Job Runners), 06collaboration-services, 10function-evaluator, 10function-orchestrator, and 4 others: Wikifunctions function orchestrator and evaluator test suites failing on GitLab CI with OOM errors - https://phabricator.wikimedia.org/T399348#11256384 (10Jdforrester-WMF) [18:38:16] 10GitLab (CI & Job Runners), 06Release-Engineering-Team, 07Essential-Work: buildkit v0.25.1 released - https://phabricator.wikimedia.org/T406772 (10dancy) 03NEW [18:38:41] 10GitLab (CI & Job Runners), 06Release-Engineering-Team, 07Essential-Work: buildkit v0.25.1 released - https://phabricator.wikimedia.org/T406772#11256604 (10dancy) [18:58:49] 10GitLab (CI & Job Runners), 06serviceops: failed to push docker-registry.discovery.wmnet/repos/data-engineering/airflow-dags:airflow-2.10.5-py3.11-2025-10-03-192132-3003d4328df66a0086a350fdd2ba1dbd80a235c5: unknown: blob upload invalid - https://phabricator.wikimedia.org/T406392#11256660 (10dancy) >>! In T406... [19:04:56] 10GitLab (Account Approval), 06Release-Engineering-Team: Requesting GitLab account activation for [YOUR DEVELOPER ACCOUNT USERNAME HERE] - https://phabricator.wikimedia.org/T405600#11256673 (10Pppery) 05Stalled→03Invalid Closing due to lack of response. [19:25:04] 10GitLab (Account Approval), 06Release-Engineering-Team: Requesting GitLab account activation for [YOUR DEVELOPER ACCOUNT USERNAME HERE] - https://phabricator.wikimedia.org/T406776 (10Olatundeawo) 03NEW [19:59:40] 10GitLab (Account Approval), 06Release-Engineering-Team: Requesting GitLab account activation for Angelkay - https://phabricator.wikimedia.org/T406776#11256812 (10Pppery)