[10:06:32] (03PS2) 10Gkyziridis: revertrisk_wikidata: Integrate LAC (on-demand) flow [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1359881 (https://phabricator.wikimedia.org/T433699) [10:18:21] 06Machine-Learning-Team (Q2 FY2026-27), 06Data-Persistence, 10Data-Persistence-Design-Review: Integrate RevertRisk-Wikidata model with the Linked Artifacts Cache (Hoarde) - https://phabricator.wikimedia.org/T442542#12514716 (10gkyziridis) Hi @Eevans thank you for your comments. > Will this be enabled for ev... [10:26:19] 06Machine-Learning-Team (Q2 FY2026-27), 13Patch-For-Review: Migrate jina-embeddings GPU placement to vram-based node labels - https://phabricator.wikimedia.org/T443256#12514723 (10gkyziridis) ==== Deployed ===== `lang=Shell $ kube_env llm ml-serve-eqiad $ kubectl get pods -o wide | grep jina jina-embedding... [10:26:23] 06Machine-Learning-Team (Q2 FY2026-27), 13Patch-For-Review: Migrate jina-embeddings GPU placement to vram-based node labels - https://phabricator.wikimedia.org/T443256#12514724 (10gkyziridis) 05Open→03Resolved [10:27:41] 06Machine-Learning-Team (Q2 FY2026-27), 13Patch-For-Review: Migrate ml-services GPU placement to vram-based node labels - https://phabricator.wikimedia.org/T441680#12514731 (10gkyziridis) [10:40:56] 06Machine-Learning-Team, 07Essential-Work: Override KServe default OpenAPI specs with the custom specs in docs - https://phabricator.wikimedia.org/T429305#12514822 (10gkyziridis) I’m declining this task since we already have an OpenAPI server deployed for our LiftWing models, where users can experiment with re... [10:41:17] 06Machine-Learning-Team, 07Essential-Work: Override KServe default OpenAPI specs with the custom specs in docs - https://phabricator.wikimedia.org/T429305#12514823 (10gkyziridis) 05Open→03Declined a:03gkyziridis [12:28:46] 06Machine-Learning-Team (Q2 FY2026-27), 10CampaignEvents, 06Connection-Team (FY2627 Q2 sprint 3), 05MW-1.47-notes (1.47.0-wmf.24; 2026-10-13), 13Patch-For-Review: Make the LiftWing endpoint configurable, and use the internal one in production - https://phabricator.wikimedia.org/T440360#12515252 (10Daimona... [12:34:04] 06Machine-Learning-Team (Q2 FY2026-27): Pangram Pilot Test 2 Usefulness (AfC dataset) - Collecting a sample of articles - https://phabricator.wikimedia.org/T443589 (10OKarakaya-WMF) 03NEW [12:37:21] 06Machine-Learning-Team (Q2 FY2026-27): Pangram Pilot Test 2 Usefulness (AfC dataset) - Collecting a sample of articles - https://phabricator.wikimedia.org/T443589#12515297 (10OKarakaya-WMF) I've picked some articles from the queue, cleaned up the articles as we discussed and sampled 100 that are above the 50 wo... [12:41:25] 06Machine-Learning-Team (Q2 FY2026-27): Pangram Pilot Test 2 Usefulness (AfC dataset) - Collecting a sample of articles - https://phabricator.wikimedia.org/T443589#12515314 (10OKarakaya-WMF) repo: https://gitlab.wikimedia.org/repos/machine-learning/exploratory-notebook/-/blob/pangram/pangram/afc_sample.ipynb?ref... [13:31:57] 06Machine-Learning-Team (Q2 FY2026-27), 06Data-Platform-SRE (2026-10-30 - 2026-11-20), 07Essential-Work: Remove article-descriptions model from LiftWing - https://phabricator.wikimedia.org/T438033#12515588 (10Gehel) Done on the DPE SRE side, ML has more work to do [16:42:28] 06Machine-Learning-Team (Q2 FY2026-27), 06Data-Platform-SRE (2026-10-30 - 2026-11-20): Hummingbird: Enable Lift Wing MCP tools in LibreChat - https://phabricator.wikimedia.org/T441786#12517367 (10Gehel) [16:42:34] 06Machine-Learning-Team (Q2 FY2026-27), 06Data-Platform-SRE (2026-10-30 - 2026-11-20): knative-serving: Test load-aware routing with the activator in the experimental namespace - https://phabricator.wikimedia.org/T441393#12517368 (10Gehel) [16:42:40] 06Machine-Learning-Team (Q2 FY2026-27), 06Data-Platform-SRE (2026-10-30 - 2026-11-20), 13Patch-For-Review: Allow deploy users to delete Knative revisions - https://phabricator.wikimedia.org/T442872#12517366 (10Gehel) [16:42:50] 10Lift-Wing, 06Machine-Learning-Team (Q2 FY2026-27), 06Traffic, 06Data-Platform-SRE (2026-10-30 - 2026-11-20): Migrate inference and inference-staging to IPIP - https://phabricator.wikimedia.org/T441352#12517369 (10Gehel) [16:43:37] 06Machine-Learning-Team (Q2 FY2026-27), 06Data-Platform-SRE (2026-10-30 - 2026-11-20), 07Essential-Work, 13Patch-For-Review: Allow deploy users to delete Knative revisions - https://phabricator.wikimedia.org/T442872#12517381 (10Gehel) p:05Triage→03Medium [16:44:05] 06Machine-Learning-Team (Q2 FY2026-27), 06Data-Platform-SRE (2026-10-30 - 2026-11-20), 07Essential-Work: Hummingbird: Enable Lift Wing MCP tools in LibreChat - https://phabricator.wikimedia.org/T441786#12517388 (10Gehel) p:05Triage→03Medium [16:44:29] 10Lift-Wing, 06Machine-Learning-Team (Q2 FY2026-27), 06Traffic, 06Data-Platform-SRE (2026-10-30 - 2026-11-20), 07Essential-Work: Migrate inference and inference-staging to IPIP - https://phabricator.wikimedia.org/T441352#12517395 (10Gehel) p:05Triage→03Medium [16:44:37] 06Machine-Learning-Team (Q2 FY2026-27), 06Data-Platform-SRE (2026-10-30 - 2026-11-20), 07Essential-Work: knative-serving: Test load-aware routing with the activator in the experimental namespace - https://phabricator.wikimedia.org/T441393#12517398 (10Gehel) p:05Triage→03Medium [20:40:43] 06Machine-Learning-Team (Q2 FY2026-27), 06Data-Platform-SRE (2026-10-30 - 2026-11-20), 07Essential-Work: Upgrade airflow-ml to 3.3.x - https://phabricator.wikimedia.org/T435481#12519204 (10RKemper) I've ran `example_training_dag` both in the old env and in an airflow 3 devenv, and it worked without a hitch.... [20:52:06] 06Machine-Learning-Team (Q2 FY2026-27), 06Data-Platform-SRE (2026-10-30 - 2026-11-20), 07Essential-Work, 13Patch-For-Review: Upgrade airflow-ml to 3.3.x - https://phabricator.wikimedia.org/T435481#12519307 (10RKemper) @kevinbazira How does `Monday Nov 9, 17:00 UTC` sound? (20:00 your time afaict) You don'...