[08:42:30] bjensen, marostegui: quick headsup, I'm repooling puppetserver1002. it had some issues yesterday (see corto log), so it was depooled. but the errors couldn't be reproduced further and were likely fallout of the PKI refresh and/or esams network maint. I'm keeping an eye on Puppetboard and if they still reproduce, I'll depool 1002 again [08:42:42] thanks moritzm [08:43:18] ack, thanks! [09:01:06] seems all stable indeed [10:16:20] What is the best way for me to raise a request for WikiCommons Thumbnail size allowance for wiki.openstreetmap.org? (IPs: 184.104.226.103, 2001:470:1:b3b::7, 87.252.214.103, 2001:4d78:fe03:1c::7) We use LTS release of Mediawiki + QuickInstantCommons (HTTP/2) and User-Agent: "https://osm.wiki/" [10:19:16] We will upgrade to next LTS release once available, which enables $wgThumbLimits. If absolutely required I can bump mediawiki version sooner if needed. [10:22:11] Happy to make any suggested changes our side if needed. [10:22:20] (our side = OpenStreetMap) [10:24:45] Firefishy: file a phabricator ticket https://phabricator.wikimedia.org maybe add #sre as tag [10:25:23] that will make sure it is not forgotten [10:26:03] Will do. [10:26:07] Thanks. [10:27:08] Firefishy: I wonder if the issue comes from not using our standard thumb sizes, I know other are heavily throlled [10:27:18] *throttled [10:28:38] let me find the docs for that, and that may require no action from us [10:28:44] Yes, I believe it is. We are a known heavy user. We've tried hard to fix all our standard thumb sizes, but the LTS mediawiki release is somewhat limited. [10:28:54] ah, I understand [10:29:16] please add that to the ticket as info [10:29:48] I believe wgThumbLimits is the main fix, but hasn't been backported to the LTS mediawiki release yet AFAIK. [10:30:24] let me see if I can convice someone to do that, as that would work in our favour [10:30:44] but I don't know how the policy works regarding new features and lts [10:31:37] please add that to the ticket, if it is on phab, it is tracked [10:32:29] feel free to share it afterwards here for awerness [10:38:42] s/wgThumbLimits/wgThumbnailSteps/ - fixing config name mistake from earlier ;-) [10:41:16] 1.43.8 should have the steps stuff backported i think (based on https://www.mediawiki.org/wiki/Extension_talk:QuickInstantCommons#User-Agent) [10:41:54] yeah, and people may be able to help if something can be done without upgrading, like ^ [10:47:46] https://phabricator.wikimedia.org/T423570 [16:06:21] does anyone know if we are running any services outside k8s that use containers, besides Ceph? I'm thinking about it for OpenSearch since we have OCI images now, and the "host a subset of multiple Opensearch instances on each server" thing is a bit unwieldy [16:31:47] inflatador: I'm generally in favor of building some very lightweight puppetization around k8s-yaml format systemd container units [16:31:59] but I don't think we are actually doing it anywhere yet [16:36:58] cdanis cool, I thought we did that somewhere in DPE but b-tullis confirmed that I hallucinated it ;) I was thinking of trying something like https://www.thelinuxvault.net/blog/how-to-run-podman-containers-under-systemd-with-quadlet/ but if you have a link for the k8s yaml format stuff I'm happy to start there instead [16:38:26] that's exactly what I meant -- podman/quadlet supports a lot of k8s-style yaml definitions [16:44:48] cool, I'll play around in WMCS a bit and get back to y'all