[01:31:45] 10serviceops, 10Operations, 10ops-eqsin: ganeti5002 was down / powered off, machine check entries in SEL - https://phabricator.wikimedia.org/T261130 (10RobH) For some reason (we found this out a few months ago), Dell Singapore part replacements don't go out with return tags. They require you to call and sch... [07:28:00] 10serviceops, 10Prod-Kubernetes, 10observability, 10Kubernetes, 10Patch-For-Review: Store Kubernetes events for more than one hour - https://phabricator.wikimedia.org/T262675 (10JMeybohm) Two more eventrouter patches in I must say I'm a bit disappointed by my decision to go with that one but I *think* it... [10:55:38] moritzm: guten tag ;) sorry about the base::service_auto_restart , I am afraid of having the CI Jenkins to be restarted at some arbitrary time :-\ [10:56:02] I also noticed the cron / timer might run late on Friday if I have read its definition properly [10:56:26] (or super early on monday) [10:58:17] I'll update the patch to only apply to release jenkins, it was only meant to fix the absent/present case, not to extend it to CI jenkins [11:03:02] ahh [11:03:23] there is still a race condition on the release jenkins though, but it seems very unlikely it will ever trigger [11:03:26] so it is probably fine [11:04:22] yeah, given it worked fine for 2.5 years it seems like an acceptable tradeoff :-) [11:15:34] godog: sorry for the non sense about python ldap / sitepackages . I +1ed https://gerrit.wikimedia.org/r/c/operations/puppet/+/635559 ;) [11:17:23] hashar: haha! no worries, thanks for taking a look and help on the integration-config change [12:14:08] i've just removed myself from the sre-service-ops group and made wolfgang the owner [12:59:09] 10serviceops, 10Product-Infrastructure-Team-Backlog, 10Proton: PDF download generates invalid PDF files - https://phabricator.wikimedia.org/T266559 (10Urbanecm) [13:03:28] akosiaris: so unfortunately, kubeval is way less picky than kubeyaml is. I guess that's simply because it just validates against the spec rather then actually parsing into the go structures (which I think kubeyaml did) [13:04:37] means we won't get those "type errors" we had seen (like "[spec.template.spec.volumes] key volumes has wrong type (should be []interface{})") [13:07:07] umf [13:09:53] the nodejs kubeyaml otoh still seems to detect those [13:10:20] and still has this weird issue of just parsing the first object of a yaml stream :-) [13:17:52] but that difference also means that kubeyaml still uses go for the backend, which turns out to be true... [13:17:55] sooo...we could a) run the kubeyaml backend internally or b) hack together a cli [13:21:51] 10serviceops, 10Desktop Improvements, 10Operations, 10Product-Infrastructure-Team-Backlog, and 3 others: Connection closed while downloading PDF of articles - https://phabricator.wikimedia.org/T266373 (10akosiaris) >>! In T266373#6576166, @CDanis wrote: >>>! In T266373#6576161, @Framawiki wrote: >> See als... [13:31:11] jayme: there is a c). Just figure out what needs to be done to import the versions we are missing to the current one [13:31:26] it means we are forking it of course. [13:31:55] Which given upstream's stance, it might not be a bad idea. I am just not sure we want to pay that cost. Lemme try to do it and gauge how much of a pain it is [13:32:51] akosiaris: oh, yeah. That ofc...no problem - I can figure out what it needs to add 1.19, I'm looking into all that now anyways [13:33:14] on the long run, maybe someone will re-add CLI to the current backend code ... [13:46:44] akosiaris: the backend code seems to be API compatible to the old CLI interface :D [13:47:05] the guy just did not copy the files for whatever reason... [13:47:27] makes sense, I think he just wrapped the server in a react project and only copied what he felt he needed [13:47:49] "sense"...yeah :) [13:48:23] lol, true [13:49:10] I'll wrap that up, prepare a MR and import the V2 branch + patch to our gerrit mirror [16:09:38] 10serviceops, 10Product-Infrastructure-Team-Backlog, 10Proton: PDF download generates invalid PDF files - https://phabricator.wikimedia.org/T266559 (10Ammarpad) I couldn't reproduce this with Chrome 86. Also couldn't with Mac's Preview. I am not sure whether this might be caused by Chrome's upstream change... [16:11:36] 10serviceops, 10Product-Infrastructure-Team-Backlog, 10Proton, 10Browser-support-print-media: PDF download generates invalid PDF files - https://phabricator.wikimedia.org/T266559 (10Ammarpad) [16:25:38] 10serviceops, 10Operations, 10ops-codfw: codfw: relocate sessionstore2002 and mc2029 from C4 to C3 - https://phabricator.wikimedia.org/T266577 (10Papaul) [16:51:51] 10serviceops, 10Operations, 10Product-Infrastructure-Team-Backlog, 10Proton, and 2 others: PDF download generates invalid PDF files - https://phabricator.wikimedia.org/T266559 (10Urbanecm) @Ammarpad Thansk for your comment. I wasn't able to open any of those PDFs with any PDF viewer installed (all browsers... [16:54:27] 10serviceops, 10Operations, 10Product-Infrastructure-Team-Backlog, 10Proton, and 2 others: PDF download generates invalid PDF files - https://phabricator.wikimedia.org/T266559 (10RhinosF1) I get ERR_CONNECTION_CLOSED on https://en.wikipedia.org/api/rest_v1/page/pdf/Rail_transport_modelling [17:05:55] 10serviceops, 10Prod-Kubernetes, 10Kubernetes: Test deployment-charts for kubernetes 1.19 compatibility - https://phabricator.wikimedia.org/T266032 (10JMeybohm) ` [27.10.20 14:03] akosiaris: so unfortunately, kubeval is way less picky than kubeyaml is. I guess that's simply because it just validates... [20:11:29] 10serviceops, 10Operations, 10ops-codfw: codfw: relocate sessionstore2002 and mc2029 from C4 to C3 - https://phabricator.wikimedia.org/T266577 (10Peachey88) [20:55:09] 10serviceops, 10Operations, 10ops-codfw, 10User-jijiki: codfw: relocate sessionstore2002 and mc2029 from C4 to C3 - https://phabricator.wikimedia.org/T266577 (10jijiki) [22:23:34] 10serviceops, 10Operations, 10Datacenter-Switchover: Siteinfo timeout during switch datacenter - https://phabricator.wikimedia.org/T266618 (10Volans) p:05Triage→03Medium