[07:32:32] Hi! I'm seeing 500 errors coming from our docker registry: https://gitlab.wikimedia.org/repos/data-engineering/airflow-dags/-/jobs/835700 [07:32:32] Does that ring a bell for someone? Thanks! [07:34:39] elukey: I just saw your message on #-sre. Could this be related? [07:35:42] brouberol: o/ [07:35:45] in theory no, but lemme check [07:38:00] thanks [07:38:18] never seen https://registry.cloud.releng.team, I guess that it is an alias [07:40:03] oh, sorry, that's probably the registry for the gitlab CI/CD, so that's the one hosted on Digital Ocean, not docker-registry.w.o /me thinks [07:41:55] ah okok because I don't find anything weird on registry2* [07:42:17] first time that I hear about the registry on DO :D [07:43:32] I think it's what being used to store cached layers between builds [07:44:46] well, CI builds [07:46:38] okok TIL, so probably that one is having troubles [07:47:14] (need to step afk for some time) [07:48:14] yep, thanks for taking a look :) [09:59:06] btullis: has this been done? https://phabricator.wikimedia.org/T407166 [10:03:09] b.tullis is OOO, let me check [10:03:34] jayme: No, not yet. Although the current version of the CSI plugin is working fine. We just had to pin to an older version because of k8s version 1.23. [10:04:22] ack [10:04:40] I forgot to switch off my IRC Cloud notifications :-) [10:05:02] haha