[08:00:41] Cteam: welcome to today 🦄! Don’t forget to post your update in thread. [08:00:41] Feel free to include: [08:00:41] 1. 🕫 Anything you'd like to share about your work [08:00:41] 2. ☏ Anything you'd like to get help with [08:00:41] 3. ⚠ Anything you're currently blocked on [08:00:41] (this message is from a toolforge job under the admin project) [17:58:31] Done: [17:58:31] * [lima-kilo] Fix network policy for loki preventing logs from being gathered https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/963 [17:58:31] * [functional tests] fix log checking test that never fails https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/961 [17:58:31] * [lima-kilo] fixed a breaking issue missing clouds.yaml file [17:58:31] * [horizon] did some debugging of packaging issues with andrewbogott [17:58:31] * [components-api] reviewed one mr for handling defaults (something is something) [17:58:32] * [tools workers failing to mount dumps nfs] did a bit of digging before handing over to godog (thanks!) [17:58:32] Doing: [17:58:33] * [tools-prometheus] debugged some the failure from tools-prometheus-9, checked queries and logs, but did not find the issue yet (no very suspicious queries, or query load, logs say the network just stopped) [17:58:33] * [jobs-api] still want to do another pass at manually testing the model split MR [17:58:34] * [components-api,builds-api] review the queueing patches [17:58:34] * [team] recheck the team split document and add more comments [17:58:48] * [kyverno] look into VAPs and what would it take to replace it (stretch) [17:58:52] Blockers: [17:58:55] * [logs-api] stack of patches adding the new component https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/911 (and linked ones) [17:58:59] * [loki,alloy] decrease the frequency for checking new logs, to avoid ephemeral pods (<10s) from not being collected, and not having to wait 10s for logs https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/962 [17:59:03] * [jobs-cli] don't expect replicas field always being sent from the API https://gitlab.wikimedia.org/repos/cloud/toolforge/jobs-cli/-/merge_requests/129 [19:58:37] Done: [19:58:37] * A ton of Horizon refactoring [19:58:37] ** Removed a couple of forked projects that we no longer need to fork [19:58:37] ** Merged forked projects with upstream latest [19:58:37] ** Branch reform: now each repo has just a 'main' and an 'upstream' repo (as per taavi's request) [19:58:37] * Moved a few more ceph nodes to bookwork/reef. Still only moved the things in C8 so far [19:58:37] * Prepared cephosd1050-1053 for pooling with reef/bookworm but have not pooled yet