[09:53:49] <wikibugs>	 10GitLab (Infrastructure), 10serviceops-collab, 10Datacenter-Switchover, 10Patch-For-Review: Switchover gitlab-replica (gitlab2002 -> gitlab1003) - https://phabricator.wikimedia.org/T329930 (10Jelto)
[10:17:05] <wikibugs>	 10GitLab (Infrastructure), 10serviceops-collab, 10Datacenter-Switchover, 10Patch-For-Review: Switchover gitlab-replica (gitlab2002 -> gitlab1003) - https://phabricator.wikimedia.org/T329930 (10Jelto)
[10:17:39] <wikibugs>	 10GitLab (Infrastructure), 10serviceops-collab, 10Datacenter-Switchover, 10Patch-For-Review: Switchover gitlab-replica (gitlab2002 -> gitlab1003) - https://phabricator.wikimedia.org/T329930 (10Jelto)
[10:43:59] <wikibugs>	 10GitLab (Infrastructure), 10serviceops-collab, 10Datacenter-Switchover, 10Patch-For-Review: Switchover gitlab-replica (gitlab2002 -> gitlab1003) - https://phabricator.wikimedia.org/T329930 (10Jelto)
[10:45:36] <wikibugs>	 10GitLab (Infrastructure), 10serviceops-collab, 10Datacenter-Switchover, 10Patch-For-Review: Switchover gitlab-replica (gitlab2002 -> gitlab1003) - https://phabricator.wikimedia.org/T329930 (10Jelto)
[10:48:28] <wikibugs>	 10GitLab (Infrastructure), 10serviceops-collab, 10Datacenter-Switchover, 10Patch-For-Review: Switchover gitlab-replica (gitlab2002 -> gitlab1003) - https://phabricator.wikimedia.org/T329930 (10Jelto)
[11:16:30] <wikibugs>	 10GitLab (Infrastructure), 10serviceops-collab, 10Datacenter-Switchover, 10Patch-For-Review: Switchover gitlab-replica (gitlab2002 -> gitlab1003) - https://phabricator.wikimedia.org/T329930 (10Jelto)
[11:20:40] <wikibugs>	 10GitLab (Infrastructure), 10serviceops-collab, 10Datacenter-Switchover, 10Patch-For-Review: Switchover gitlab-replica (gitlab2002 -> gitlab1003) - https://phabricator.wikimedia.org/T329930 (10eoghan)
[11:24:54] <wikibugs>	 10GitLab (Infrastructure), 10serviceops-collab, 10Datacenter-Switchover, 10Patch-For-Review: Switchover gitlab-replica (gitlab2002 -> gitlab1003) - https://phabricator.wikimedia.org/T329930 (10Jelto)
[11:35:00] <gmodena>	 hey Gitlab team. Could anyone help me rubber duck this kokkuri build error? https://gitlab.wikimedia.org/repos/data-engineering/mediawiki-event-enrichment/-/jobs/67543#L464 ? I'm trying to copy a file from a variant to a destination inside an image. I understand what it complains about (mkdir on an existing path), but I don't understand the execution path. FWIW I can build this (and other) variants declared in the blubber file locally. The
[11:35:00] <gmodena>	  Dockerfile generated on my machine (via blubberoid) seems to match the one failing in CI.
[11:35:09] <gmodena>	 Happy to open a phab task if more appropriate
[11:36:38] <wikibugs>	 10GitLab (Infrastructure), 10serviceops-collab, 10Datacenter-Switchover, 10Patch-For-Review: Switchover gitlab-replica (gitlab2002 -> gitlab1003) - https://phabricator.wikimedia.org/T329930 (10Jelto)
[11:37:25] <wikibugs>	 10GitLab (Infrastructure), 10serviceops-collab, 10Datacenter-Switchover, 10Patch-For-Review: Switchover gitlab-replica (gitlab2002 -> gitlab1003) - https://phabricator.wikimedia.org/T329930 (10Jelto)
[11:37:37] <wikibugs>	 10GitLab (Infrastructure), 10serviceops-collab: Investigate gitlab maintenance/read-only mode - https://phabricator.wikimedia.org/T330277 (10eoghan)
[12:03:31] <wikibugs>	 10GitLab (Infrastructure), 10serviceops-collab, 10Datacenter-Switchover, 10Patch-For-Review: Switchover gitlab-replica (gitlab2002 -> gitlab1003) - https://phabricator.wikimedia.org/T329930 (10eoghan)
[12:10:44] <wikibugs>	 10GitLab (Infrastructure), 10serviceops-collab, 10Datacenter-Switchover: Switchover gitlab-replica (gitlab2002 -> gitlab1003) - https://phabricator.wikimedia.org/T329930 (10eoghan)
[12:12:29] <wikibugs>	 10GitLab (Infrastructure), 10serviceops-collab: gitlab_default_can_create_group setting deprecation - https://phabricator.wikimedia.org/T330282 (10eoghan)
[12:27:58] <wikibugs>	 10GitLab (Infrastructure), 10serviceops-collab, 10Datacenter-Switchover: Switchover gitlab-replica (gitlab2002 -> gitlab1003) - https://phabricator.wikimedia.org/T329930 (10eoghan)
[12:32:19] <wikibugs>	 10GitLab (Infrastructure), 10serviceops-collab, 10Datacenter-Switchover: Switchover gitlab-replica (gitlab2002 -> gitlab1003) - https://phabricator.wikimedia.org/T329930 (10Jelto)
[14:57:00] <wikibugs>	 10GitLab (Infrastructure), 10serviceops-collab, 10Datacenter-Switchover: Switchover gitlab-replica (gitlab2002 -> gitlab1003) - https://phabricator.wikimedia.org/T329930 (10Jelto) After switching `gitlab2002` and `gitlab1003` I get a SSH key warning, although the hosts use the same host key:  ` $ git push Wa...
[14:57:32] <arturo>	 feedback: I find the RelEng survey notice in every gitlab page to be invasive and distracting. I need to close by hand it in every browser tab. Moreover, I've already filled the survey...
[15:00:17] <jelto>	 arturo: I closed it once and it stayed closed. Are you logged in/accept cookies? For me the message does not come back
[15:30:42] <brennen>	 arturo: thx for feedback.  i'll limit it to / just in case.
[15:32:02] <brennen>	 (though, yeah, it _should_ stay dismissed, but i would not be surprised by a bug there.)
[15:32:10] <arturo>	 jelto: I think I used 3 different computers today, so perhaps that's why it feel a bit more annoying to me that to you. I see now that it doesn't reappear
[15:32:18] <arturo>	 brennen: ^^^
[15:33:03] <arturo>	 perhaps no action is required
[15:33:16] <arturo>	 it was just me using different laptops
[15:38:38] <brennen>	 ack, no worries.  i went ahead and limited it to the home page, since i agree it can be a bit much.
[15:39:09] <arturo>	 <3
[16:09:28] <wikibugs>	 10GitLab (CI & Job Runners), 10serviceops-collab, 10Release-Engineering-Team (GitLab V: Event Horizon 🌄): Disallow direct access to the docker.io registry from gitlab runners (setup a mirror of docker hub) - https://phabricator.wikimedia.org/T329679 (10Dzahn)
[16:09:54] <wikibugs>	 10GitLab (CI & Job Runners), 10serviceops-collab, 10serviceops-radar, 10Release-Engineering-Team (GitLab V: Event Horizon 🌄): Disallow direct access to the docker.io registry from gitlab runners (setup a mirror of docker hub) - https://phabricator.wikimedia.org/T329679 (10Dzahn)
[16:14:46] <wikibugs>	 10GitLab (Infrastructure), 10serviceops-collab, 10Datacenter-Switchover: Switchover gitlab-replica (gitlab2002 -> gitlab1003) - https://phabricator.wikimedia.org/T329930 (10Dzahn) >>! In T329930#8637475, @Jelto wrote: > I'm not sure how we handled that last time. I think we announced the warning will appear...
[18:02:29] <wikibugs>	 10GitLab (CI & Job Runners), 10serviceops-collab, 10serviceops-radar, 10Release-Engineering-Team (GitLab V: Event Horizon 🌄): Disallow direct access to the docker.io registry from gitlab runners (setup a mirror of docker hub) - https://phabricator.wikimedia.org/T329679 (10dancy)
[19:43:37] <wikibugs>	 10GitLab (Auth & Access), 10Desktop Improvements (Vector 2022), 10Readers-Web-Backlog: Update label for TOC navigation region and heading - https://phabricator.wikimedia.org/T330325 (10bwang)
[19:48:17] <wikibugs>	 10GitLab (Auth & Access), 10Desktop Improvements (Vector 2022), 10Readers-Web-Backlog: Update label for TOC navigation region and heading - https://phabricator.wikimedia.org/T330325 (10bwang) p:05Triage→03Low
[21:10:18] <hashar>	 brennen: thcipriani: do we have a task about getting logged out off of GitLab  when closing the browser ?  I don't mind filing one if we don't have any 
[21:13:38] <hashar>	 anyway from their doc at https://docs.gitlab.com/ee/user/profile/index.html#cookies-used-for-sign-in ,  there should be a `remember_user_token`  which is set when one uses "Remember me"
[21:13:41] <hashar>	 and I don't have it ;)
[21:19:31] <bd808>	 hashar: I don't have one either, but I wonder if that is due to not using their password auth more than anything else? The login flow we use never has "remember me" field that is hosted by gitlab does it?
[21:19:59] <hashar>	 yeah I think that is the issue
[21:20:18] <hashar>	 the auth provider is CAS OmniAuth if I got it right (which is deprecated)
[21:20:36] <hashar>	 and even if check remember me on our idp.wikimedia.org, the cookie is not set on gitlab
[21:20:44] <hashar>	 so I guess that provider doesn't set the cookie
[21:20:58] <bd808>	 there's a task somewhere about finding a different plugin to switch to other than OmniAuth
[21:21:08] <hashar>	 fun thing, the sessions are still known to gitlab, I can see them in https://gitlab.wikimedia.org/-/profile/active_sessions
[21:21:34] <hashar>	 maybe we could use LDAP  *grin*
[21:22:40] <hashar>	 there is some upstream task https://gitlab.com/gitlab-org/gitlab/-/issues/370083  "Remember me cookie not set when bypassing 2fa in omniauth"
[21:23:22] <bd808>	 I don't think we run with omniauth_allow_bypass_two_factor=true
[21:24:30] <hashar>	 indeed 
[21:44:34] <wikibugs>	 10GitLab (Integrations), 10GitLab-Test, 10Phabricator, 10serviceops-radar, and 2 others: Experiment with GitLab-Phabricator integration - https://phabricator.wikimedia.org/T265617 (10hashar)
[21:44:49] <wikibugs>	 10GitLab (Integrations), 10Phabricator, 10Release-Engineering-Team (Priority Backlog 📥), 10User-brennen: Comment on Phabricator tasks for new, merged, and abandoned changes on GitLab - https://phabricator.wikimedia.org/T324150 (10hashar) 05Resolved→03Open >>! In T324150#8474354, @hashar wrote: > The Gi...
[21:53:04] <thcipriani>	 there wasn't a task when I dug around for one the other day
[21:54:12] <thcipriani>	 we talked about it in the team meeting and I confirmed that the headers looked right for setting a cookie that *should* last 7 days (although in practice, mine doesn't seem to for whatever reason: maybe a "my weird setup" problem)
[21:56:22] <thcipriani>	 well. I confirmed at least that the "expires" looks right. On Feb 16th I got the header: set-cookie: known_sign_in=XXX; path=/; expires=Thu, 02 Mar 2023 16:21:06 GMT; secure; HttpOnly; SameSite=None
[21:57:25] <legoktm>	 I definitely get logged out more frequently than I expect, what's really annoying though is when I click on a gitlab link and then get redirected to the IDP login page rather than just seeing the thing I clicked on as a logged-out user
[21:57:55] <bd808>	 yes, that ^ is very annoying
[21:58:50] <thcipriani>	 I've also noticed that when I guess something: have to login to get a 404
[22:00:56] <thcipriani>	 I guess I have not noticed that I have to login to see public repos and the like though
[22:01:40] <thcipriani>	 like: https://gitlab.wikimedia.org/repos/releng/train-stats (works logged out) https://gitlab.wikimedia.org/repos/releng/train-stas (typo—redirects to login)
[22:02:33] <thcipriani>	 what redirects to login when you click the link?
[22:04:50] <legoktm>	 I think it's something related to the gitlab session expiring (expired?) so it redirects to idp to reauth you or whatever, but then you hit the login page because your idp session also expired
[22:05:14] <legoktm>	 because after the redirect, if I go back to gitlab it doesn't redirect me and shows me the interface as if I'm logged out
[22:07:09] <legoktm>	 (I will file a task for this later, I never got around to it before because it only hits you when you're in the middle of something else!)
[22:09:28] <wikibugs>	 10GitLab (Project Migration), 10Gerrit, 10Release-Engineering-Team (GitLab V: Event Horizon 🌄), 10User-brennen: Script closing/archiving of migrated repositories on Gerrit - https://phabricator.wikimedia.org/T330345 (10brennen)
[22:10:30] <wikibugs>	 10GitLab (Project Migration), 10Gerrit, 10Release-Engineering-Team (GitLab V: Event Horizon 🌄), 10User-brennen: Script closing/archiving of migrated repositories on Gerrit - https://phabricator.wikimedia.org/T330345 (10brennen) 05Open→03In progress
[22:17:44] <wikibugs>	 10GitLab (Misc), 10Gerrit, 10Release-Engineering-Team, 10Wikimedia-GitHub, 10User-brennen: A tool for displaying the canonical location of all Wikimedia repositories and any known mirrors - https://phabricator.wikimedia.org/T330347 (10brennen)
[22:35:07] <thcipriani>	 weird
[22:37:31] <thcipriani>	 needs some digging into what the available dials are in this space given we use idp. The only dial I'm aware of is the ssession length one whhich might be a good dial to crank up a bit :) (7 days feels short vs. gerrit's 90 days)
[22:55:26] <wikibugs>	 10GitLab (Integrations), 10Phabricator, 10Release-Engineering-Team (Priority Backlog 📥), 10User-brennen: Comment on Phabricator tasks for new, merged, and abandoned changes on GitLab - https://phabricator.wikimedia.org/T324150 (10brennen) > I am reopening the task since it is still reporting Gitlab actions...
[23:47:23] <wikibugs>	 10GitLab (Project Migration), 10Gerrit, 10Release-Engineering-Team (GitLab V: Event Horizon 🌄), 10User-brennen: Script closing/archiving of migrated repositories on Gerrit - https://phabricator.wikimedia.org/T330345 (10Aklapper) Kind of piggyback riding: Somehow updating the custom `Source Repo` field in P...
[23:50:37] <wikibugs>	 10GitLab (Project Migration), 10Gerrit, 10Release-Engineering-Team (GitLab V: Event Horizon 🌄), 10User-brennen: Script closing/archiving of migrated repositories on Gerrit - https://phabricator.wikimedia.org/T330345 (10brennen) > Kind of piggyback riding: Somehow updating the custom Source Repo field in Ph...