[02:52:39] Hi, the mw-script I'm running suddenly dies and I don't know where it's coming from, see the logs here: https://logstash.wikimedia.org/goto/3fcf417110a2b774c8a3c2fac8ada648 [02:52:51] it consistently dies halfway through bgwiki [12:48:57] Amir1: I'll look in about an hour (if nobody beats me to it) [14:35:06] Amir1: so the one you sent above is no longer around, but a more recent pod of that job got oomkilled [14:35:57] also on bgwiki [14:40:11] see https://grafana.wikimedia.org/goto/HWusqzGvR?orgId=1 [14:40:39] is it expected to need that much memory? [14:44:26] (if yes, I can bump the limit, just want to ask if it's needed first :D) [16:49:39] 06serviceops, 06Data-Platform-SRE, 10Prod-Kubernetes, 07Kubernetes, 13Patch-For-Review: Ensure the correct helm version is used for each cluster - https://phabricator.wikimedia.org/T388390#11441088 (10LSobanski) [16:49:47] 06serviceops, 10Prod-Kubernetes, 07Kubernetes: Update kube-state-metrics for k8s 1.31 - https://phabricator.wikimedia.org/T388387#11441091 (10LSobanski) [16:49:59] 06serviceops, 06Data-Platform-SRE, 10Prod-Kubernetes, 07Kubernetes: Migrate release template inheritance in helmfiles from YAML anchors to the inherit field - https://phabricator.wikimedia.org/T387760#11441092 (10LSobanski) [16:50:24] 06serviceops, 06Data-Platform-SRE, 10Prod-Kubernetes, 07Kubernetes: Set cert-manager leader election namespace to cert-manager - https://phabricator.wikimedia.org/T383553#11441094 (10LSobanski) [16:50:31] 06serviceops, 10Prod-Kubernetes, 07Kubernetes: Replace k8s-controller-sidecars with built in Sidecar containers on k8s 1.31 - https://phabricator.wikimedia.org/T386694#11441095 (10LSobanski) [18:22:01] 06serviceops, 06DC-Ops, 10ops-eqiad, 06SRE: Q2:rack/setup/install wikikube-worker refresh - https://phabricator.wikimedia.org/T408760#11441361 (10Jclark-ctr) a:05Jhancock.wm→03None [23:13:02] 06serviceops, 10Citoid, 10VisualEditor, 10VisualEditor-MediaWiki-References, and 3 others: Register Citoid as a "friendly bot" (or alternatively verified bot) with Cloudflare - https://phabricator.wikimedia.org/T370118#11442481 (10VPuffetMichel) [23:35:57] 06serviceops, 10Wikifunctions, 06Abstract Wikipedia team (26Q2 (Oct–Dec)), 07Essential-Work: WF memcached service is dc-local but used for dc-global content - https://phabricator.wikimedia.org/T411807#11442523 (10Kappakayala) @jijiki Could you please help look into it?