[08:27:16] 10serviceops, 10SRE: Publish wikimedia-bullseye base docker image - https://phabricator.wikimedia.org/T281596 (10Joe) For the record, I considered using the "official" dockerhub debian images as a base, but: - It's not an official debian effort (for now) - The build process includes downloading artifacts from... [09:41:05] 10serviceops, 10SRE-swift-storage: Corrupted helm charts in Swift that are not properly showing up in chartmuseum - https://phabricator.wikimedia.org/T283147 (10akosiaris) [09:41:13] 10serviceops, 10SRE-swift-storage: Corrupted helm charts in Swift that are not properly showing up in chartmuseum - https://phabricator.wikimedia.org/T283147 (10akosiaris) p:05Triage→03High This is not good, it could baldy affect deploys. Setting to `High`. I am wondering whether setting `RandomizedDelay... [09:41:43] 10serviceops, 10SRE-swift-storage: Corrupted helm charts in Swift that are not properly showing up in chartmuseum - https://phabricator.wikimedia.org/T283147 (10Mvolz) [09:50:55] 10serviceops, 10SRE-swift-storage: Corrupted helm charts in Swift that are not properly showing up in chartmuseum - https://phabricator.wikimedia.org/T283147 (10Mvolz) [10:23:03] 10serviceops, 10SRE-swift-storage: Corrupted helm charts in Swift that are not properly showing up in chartmuseum - https://phabricator.wikimedia.org/T283147 (10fgiunchedi) I agree with the analysis @akosiaris, if two processes are racing to update the same file(s) then anything could happen. As for the fix, d... [10:54:41] 10serviceops, 10SRE, 10Patch-For-Review, 10Release-Engineering-Team (Radar): Upgrade MediaWiki clusters to Debian Buster (debian 10) - https://phabricator.wikimedia.org/T245757 (10jijiki) [10:57:51] 10serviceops, 10Analytics, 10User-jijiki: Clarify multi-service instance concepts in helm charts and enable canary releases - https://phabricator.wikimedia.org/T242861 (10jijiki) @akosiaris @Ottomata should we resolve this in favour of T282148 ? [10:58:00] 10serviceops, 10Analytics: Clarify multi-service instance concepts in helm charts and enable canary releases - https://phabricator.wikimedia.org/T242861 (10jijiki) [10:58:51] 10serviceops, 10Maps, 10SRE-swift-storage, 10User-jijiki: Swift account to store pre-rendered vector-tiles - https://phabricator.wikimedia.org/T283049 (10jijiki) [11:06:33] 10serviceops, 10Analytics: Clarify multi-service instance concepts in helm charts and enable canary releases - https://phabricator.wikimedia.org/T242861 (10akosiaris) >>! In T242861#7098031, @jijiki wrote: > @akosiaris @Ottomata should we resolve this in favour of T282148 ? +1 [12:19:06] 10serviceops, 10Analytics: Clarify multi-service instance concepts in helm charts and enable canary releases - https://phabricator.wikimedia.org/T242861 (10jijiki) 05Stalled→03Resolved Continued in T282148 [12:51:15] 10serviceops, 10MW-on-K8s, 10Release Pipeline, 10Patch-For-Review: Create restricted docker-registry namespace for security patched images - https://phabricator.wikimedia.org/T273521 (10JMeybohm) I needed the credentials on production nodes now, so I did set the password for production clusters now as well. [13:42:09] 10serviceops, 10Maps, 10User-jijiki: Deploy maps-vector-server to kubernetes - https://phabricator.wikimedia.org/T283159 (10jijiki) [13:47:32] 10serviceops, 10Analytics: Clarify multi-service instance concepts in helm charts and enable canary releases - https://phabricator.wikimedia.org/T242861 (10Ottomata) +1 [21:21:31] _joe_: I've been, mostly for fun, poking the image verification feature you added to docker-pkg, I've tried to do some 'docker run' inside my newly created image to verify it works, but seems like docker-pkg is running test.sh in a very bare env, so it can't actually find docker executable. Am I using the feature wrong? [21:22:14] <_joe_> uhhh it definitely works on my computer :P [21:22:18] <_joe_> Pchelolo: mac? [21:22:21] yup [21:22:34] <_joe_> ok, I'm sure I messed something up by making some assumption [21:24:07] okey, so I'm not doing an entirely crazy thing here? https://gerrit.wikimedia.org/r/c/operations/docker-images/production-images/+/692983 [21:25:25] I'll poke more at it, just wanted to make sure I'm not using a microscope as a screwdriver [22:04:10] <_joe_> no it makes sense [22:04:19] <_joe_> I'll poke at it tomorrow morning [22:06:29] _joe_: https://gerrit.wikimedia.org/r/c/operations/docker-images/docker-pkg/+/692995 fixes it for me [22:06:45] but might break it for everybody else.. [22:10:13] <_joe_> Pchelolo: yeah let me look into it a bit better [22:10:34] <_joe_> can you post a comment indicating your python version? [22:11:02] <_joe_> and where it comes from (apple, homebrew, macports...) [22:11:13] yup.