[00:20:45] <Guest37>	 Ee
[01:00:24] <wikibugs>	 10GitLab (Infrastructure), 10Cloud-VPS, 06collaboration-services, 10cloud-services-team (FY2024/2025-Q3-Q4): Volume is stuck to deleted instance in devtools project - https://phabricator.wikimedia.org/T396739#10945531 (10Andrew)
[07:17:08] <wikibugs>	 10GitLab (CI & Job Runners), 10Beta-Cluster-Infrastructure, 06collaboration-services, 10m3api: Unable to connect to Beta Cluster from WMCS GitLab CI runners - https://phabricator.wikimedia.org/T397591#10945896 (10Jelto) >>! In T397591#10943336, @LucasWerkmeister wrote: > According to https://wikitech.wikim...
[13:58:18] <wikibugs>	 10GitLab (Infrastructure), 06collaboration-services, 06Release-Engineering-Team, 13Patch-For-Review: Re-create GitLab test instance - https://phabricator.wikimedia.org/T396622#10947262 (10Jelto) I was able to re-create the test instance at https://gitlab.devtools.wmcloud.org/ using the backup which was sto...
[14:18:35] <wikibugs>	 10GitLab (Infrastructure), 06collaboration-services, 06Release-Engineering-Team, 13Patch-For-Review: Re-create GitLab test instance - https://phabricator.wikimedia.org/T396622#10947393 (10Jelto) >>! In T396622#10947262, @Jelto wrote: > Login/OIDC seems broken  The test instance used the `gitlab_replica_oid...
[14:23:23] <wikibugs>	 10GitLab (Infrastructure), 06collaboration-services, 06Release-Engineering-Team: Upgrade GitLab to major version 18 - https://phabricator.wikimedia.org/T394382#10947437 (10Jelto)
[14:23:27] <wikibugs>	 10GitLab (Infrastructure), 06collaboration-services, 06Release-Engineering-Team, 13Patch-For-Review: Re-create GitLab test instance - https://phabricator.wikimedia.org/T396622#10947438 (10Jelto)
[14:23:39] <wikibugs>	 10GitLab (Infrastructure), 06collaboration-services, 06Release-Engineering-Team: Upgrade GitLab to major version 18 - https://phabricator.wikimedia.org/T394382#10947440 (10Jelto)
[14:23:45] <wikibugs>	 10GitLab (Infrastructure), 06collaboration-services, 06Release-Engineering-Team, 13Patch-For-Review: Re-create GitLab test instance - https://phabricator.wikimedia.org/T396622#10947441 (10Jelto)
[14:43:41] <wikibugs>	 10GitLab (CI & Job Runners), 06collaboration-services: Persistent puppet failure on gitlab-runner-1008.devtools.eqiad1.wikimedia.cloud - https://phabricator.wikimedia.org/T397641#10947571 (10Jelto) 05Open→03Resolved p:05Triage→03Medium a:03Jelto This should be fixed, the test instance is working...
[14:44:18] <wikibugs>	 10GitLab (CI & Job Runners), 06collaboration-services: Persistent puppet failure on gitlab-runner-1008.devtools.eqiad1.wikimedia.cloud - https://phabricator.wikimedia.org/T397641#10947584 (10dancy) Thanks @Jelto !
[16:27:46] <taavi>	 I'm trying to merge some MRs but GitLab is getting stuck on "Checking pipeline status.".. nothing in the console or network inspector that looks suspicious
[16:28:01] <taavi>	 happens on https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/823 and any other patch I try to look at in that repo
[16:31:28] <dancy>	 Hmmm
[16:49:50] <taavi>	 well, no, only some patches in that repo have the same thing. but it's consistent per patch. tried logging out, clearing caches, etc
[17:02:27] <bd808>	 the MRs on both sides seem to be reporting ok, but 823 lost track of something I guess.
[17:05:33] <bd808>	 https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/pipelines/116993 seems to be the pipeline that it should find.
[17:06:07] * bd808 tries rerunning that pipeline
[17:16:44] <bd808>	 taavi: no change from my attempts to re-run the pipeline. They succeeded, but that doesn't seem to have made MR!823 find the status. I guess the next thing I would try is some change to the MR content to start things over again. Maybe even just some small touch of the commit message and a force push would do it?
[17:17:31] <dancy>	 That's all I can think of trying too.  <shakes a fist at GitLab>
[17:24:54] <taavi>	 yeah, just a force push helped unstuck it. thanks
[17:25:26] <taavi>	 aaand now the rest of the stack needs rebasing :/
[17:33:29] <dancy>	 "You should run a new pipeline, because the target branch has changed for this merge request."  But it doesn't provide a button for you to do so.
[17:33:52] <dancy>	 And.. why doesn't it just do it? 
[17:33:57] <dancy>	 <shakes a fist again>
[19:31:32] <wikibugs>	 10GitLab (Infrastructure), 10Cloud-VPS, 06collaboration-services, 10cloud-services-team (FY2024/2025-Q3-Q4): Volume is stuck to deleted instance in devtools project - https://phabricator.wikimedia.org/T396739#10948470 (10Andrew) 05Open→03Resolved I think that gitlab-prod-backup is now unstuck, so c...
[22:12:40] <wikibugs>	 10GitLab (Project Migration), 10Phabricator Antivandalism Extension: Move https://gerrit.wikimedia.org/r/phabricator/antivandalism to GitLab - https://phabricator.wikimedia.org/T349662#10948921 (10A_smart_kitten)
[23:33:05] <wikibugs>	 10GitLab (CI & Job Runners), 10Beta-Cluster-Infrastructure, 06collaboration-services, 10m3api: Unable to connect to Beta Cluster from WMCS GitLab CI runners - https://phabricator.wikimedia.org/T397591#10949028 (10bd808) >>! In T397591#10945896, @Jelto wrote: > The current process of explicitly allow-listin...