[06:26:48] morning morning o/ [06:26:48] I run a helm diff on both staging and prod and it looks like this change was deployed: https://gerrit.wikimedia.org/r/c/operations/deployment-charts/+/1153266 [06:26:48] all pods are running and the error we expect is thrown when lang is missing: https://phabricator.wikimedia.org/P76975$41 [06:54:46] Good morning! [06:55:14] kevinbazira: o/ I merged and deployed that yesterday evening [06:55:27] ty! [07:04:36] Good morning [07:17:55] kevinbazira: where can I find this file `summaries/enwiki-20250529/evaluation_results.json` mentioned in https://phabricator.wikimedia.org/T395246#10878919? [07:20:29] our primary goal was to generate the summaries but we want to also have the evaluation metrics for each of the summaries. I'll write an update on the task describing the exact format [07:21:41] isaranto: the evaluation metrics are generated by this notebook: [07:21:42] https://gitlab.wikimedia.org/repos/machine-learning/exploratory-notebook/-/blob/main/simple-summaries/regenerate_enwiki_summaries.ipynb?ref_type=heads [07:21:42] an example can be found here: `/home/kevinbazira/quick_test/exploratory-notebook/simple-summaries/summaries/enwiki-20250529/evaluation_results.json` [07:22:22] godd morning [07:30:47] 06Machine-Learning-Team: Article Summary Generation and Evaluation Pipeline using vLLM image - https://phabricator.wikimedia.org/T395246#10882715 (10isarantopoulos) Thank you for generating the summaries! Can we us this pipeline/notebook to do the following? First step would be to read the titles and generate th... [07:33:26] we also want the generated evaluation metrics -- not just an example of how to generate them. sorry if I didn't make that clear when we were discussing about it [07:37:19] sure sure, np! let me work on generating the evaluation metrics too. [07:38:01] thank you! [07:38:39] which directory should I share with the web team `enwiki-20250601-initial` or `enwiki-20250601`? [07:40:21] please share: `/home/kevinbazira/exploratory-notebook/simple-summaries/summaries/enwiki-20250601` [07:40:47] ack. weebale! [07:41:55] kalós írthes :) [07:43:37] :) [08:43:48] Morning! [08:46:56] guten morgen [08:49:11] \o [09:36:06] 06Machine-Learning-Team: Article Summary Generation and Evaluation Pipeline using vLLM image - https://phabricator.wikimedia.org/T395246#10883027 (10isarantopoulos) Looking at the summaries available in `/home/kevinbazira/simple-summaries/summaries/enwiki-2025060` I've noticed the following inconsistencies with... [09:40:30] 06Machine-Learning-Team: Article Summary Generation and Evaluation Pipeline using vLLM image - https://phabricator.wikimedia.org/T395246#10883035 (10kevinbazira) >>! In T395246#10883027, @isarantopoulos wrote: > Looking at the summaries available in `/home/kevinbazira/simple-summaries/summaries/enwiki-2025060` I... [09:48:22] 06Machine-Learning-Team: Article Summary Generation and Evaluation Pipeline using vLLM image - https://phabricator.wikimedia.org/T395246#10883043 (10isarantopoulos) Ack! sorry for the confusion. Also there is no missing summary, as it was listed as a hidden file :) We can totally disregard my previous comment th... [10:59:46] 10Lift-Wing, 06Machine-Learning-Team, 13Patch-For-Review: Host an OpenVINO model in LiftWing - https://phabricator.wikimedia.org/T395012#10883264 (10santhosh) I am trying to build a production docker image with WMF debian bookworm+python3.11+openvino 2025.1.0+ OVMS 2025.1.0. I am referring the [[ https://git... [11:09:28] * klausman lunch [11:35:27] * isaranto ditto [12:58:42] elukey: o/ I'm looking at the pyrra dashboards in grafana and they seem different than yesterday (or 2 days ago) [12:58:42] https://grafana.wikimedia.org/goto/J0BkjeBNR?orgId=1 [12:58:42] iirc there were some panels on the top that showed the % for availability, remaining budget etc. [12:58:42] Do I remember correctly or was it in a different page? [15:36:09] Going afk folks,have a nice evening /rest of day! [16:24:58] isaranto: o/ Keith is working on improving them, so yes you are right! Lemme know if the new panels are more intuitive or not (I was mostly afk today so I haven't fully reviewed them) [16:27:59] Ok, Thanks! I really liked the previous ones because we could see the percentages right away. [16:31:26] what percentage do you mean? [16:31:52] ah the error budget displayed not in a graph but as raw percentage? [16:32:08] we can re-add it [16:40:29] isaranto: all info in https://phabricator.wikimedia.org/T395916