[08:00:36] <wm-bot2>	 Cteam: welcome to today 🦄! Don’t forget to post your update in thread.
[08:00:36] <wm-bot2>	 Feel free to include:
[08:00:36] <wm-bot2>	 1. 🕫 Anything you'd like to share about your work
[08:00:36] <wm-bot2>	 2. ☏ Anything you'd like to get help with
[08:00:36] <wm-bot2>	 3. ⚠ Anything you're currently blocked on
[08:00:36] <wm-bot2>	 (this message is from a toolforge job under the admin project)
[13:05:39] <dhinus>	 Done:
[13:05:41] <dhinus>	 * [toolsdb] Resolved T386240 and T385900 as things look stable
[13:05:43] <dhinus>	 ** I will upgrade the primary next Monday (T385885)
[13:05:45] <dhinus>	 * [toolforge] merged a k8s patch from Raymond that resolved both T370245 and T374193
[13:05:47] <dhinus>	 * T386850 more tweaks to the KernelErrors alerts
[13:05:49] <dhinus>	 Working on:
[13:05:51] <dhinus>	 * T362868 [toolforge] upgrade k8s to 1.29
[13:05:53] <dhinus>	 ** testing in lima-kilo
[13:05:55] <dhinus>	 ** reviewing the upgrade procedure for toolsbeta
[18:41:27] <dcaro>	 Done:
[18:41:27] <dcaro>	 * [jobs-api,jobs-emailer] added alerts for them being up, and stats for jobs-emailer, deployed jobs-emailer with prometheus stats in tools
[18:41:27] <dcaro>	 * [toolforge-ui] had a session with sarai to keep clarifying the flows and such
[18:41:27] <dcaro>	 Doing:
[18:41:27] <dcaro>	 * [kyverno] started playing with the new cluster wide policies, not working yet, those things are complicated :/
[18:41:28] <dcaro>	 * [ceph] continued looking into performance numbers for the Dell proposal
[18:41:28] <dcaro>	 * [ceph] have to give a check to the new drives https://phabricator.wikimedia.org/T386725 see if they help
[18:41:28] <dcaro>	 * [toolforge] have to give a look at the sustainability score kr, see exactly what's left
[18:41:29] <dcaro>	 * [ceph,QoS] have to finish up the patches for persisting the config (https://gerrit.wikimedia.org/r/c/operations/puppet/+/1109454), and see if we can add a new host to test the load
[18:41:30] <dcaro>	 * [toolforge,bastion container] I have to retake this, now that we can load configs from the environment for toolforge clis
[18:41:30] <dcaro>	 * [jobs-api] continue with reviews for the refactor (got distracted today)
[18:41:31] <dcaro>	 Blockers:
[18:41:42] <dcaro>	 * [jobs-api,jobs-cli] got a couple patches to add timeout to scheduled jobs (helps when they get stuck due to NFS), https://gitlab.wikimedia.org/repos/cloud/toolforge/jobs-cli/-/merge_requests/76 and https://gitlab.wikimedia.org/repos/cloud/toolforge/jobs-api/-/merge_requests/129
[18:41:46] <dcaro>	 * [ceph,grafana/gnmi] this is blocked until we have green light from infra network that gnmi is stable
[18:41:51] <dcaro>	 * [toolforge] planning blocked as I don't have a license for Miro and the board became read-only https://miro.com/app/board/uXjVLti6_Lw=/ , waiting for its to give me one