[06:41:19] Good morning [06:47:41] 06Machine-Learning-Team: Build model training pipeline using WMF ML Airflow instance - https://phabricator.wikimedia.org/T396495#10907674 (10achou) Thank Kevin for working on this! I have some thoughts on these questions. Let me know what you think. :) > **2.What is the repo that we're going to use as a codeba... [06:59:24] o/ good morning! [07:02:17] georgekyz: in the mediawiki-config patch that is going to be deployed today I added the second phabricator task in the commit message and changed the order in some config. just mentioning it so that you pull before you push in case you want to make any change [07:30:40] good morning! [07:32:12] (03PS1) 10Bartosz Wójtowicz: ci: Test new pre-commit CI stage. [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1156234 (https://phabricator.wikimedia.org/T393865) [07:54:54] good morning [08:03:35] 06Machine-Learning-Team, 10MediaWiki-extensions-ORES, 10MediaWiki-Recent-changes, 06Moderator-Tools-Team, and 4 others: [batch #2] Enable revertrisk filters in recent changes in multiple wikis - https://phabricator.wikimedia.org/T395823#10907938 (10isarantopoulos) [08:03:47] 06Machine-Learning-Team, 10MediaWiki-extensions-ORES, 10MediaWiki-Recent-changes, 06Moderator-Tools-Team, and 4 others: [batch #2] Enable revertrisk filters in recent changes in multiple wikis - https://phabricator.wikimedia.org/T395823#10907939 (10isarantopoulos) [08:04:14] It seems the new CI job I’ve added for pre-commit is not getting triggered properly :( It got deployed on Jenkins side yesterday here https://gerrit.wikimedia.org/r/c/integration/config/+/1155161 and I’ve added the code to inference-services here https://gerrit.wikimedia.org/r/c/machinelearning/liftwing/inference-services/+/1154242 [08:04:35] I’ve been trying to trigger it with some changes on this patch, but I can’t seem to trigger it https://gerrit.wikimedia.org/r/c/machinelearning/liftwing/inference-services/+/1156234 [08:05:11] Do you have some ideas to try out or why it wouldn’t work? How should I go about debugging this? [08:13:27] bartosz: o/ it is weird that no CI job has been triggered [08:13:39] have you tried to test the patch without the Work in Progress status? [08:14:51] o/ elukey: Yes, I've tried without WIP initially as well. When I do some changes on a specific model with WIP status, the CI for this model gets triggered properly. [08:20:00] Ahh I think I know - I missed one place in CI config repo where I need to add my trigger [08:21:46] yeah I was about to say that, it seems that zuul didn't trigger at all [08:21:53] so something is surely missing there [08:25:43] This piece seems to be missing https://gerrit.wikimedia.org/r/c/integration/config/+/1156254 [08:26:29] thank you for looking into this Luca! [08:26:54] makes sense yes! You did all the work :) [08:27:09] I am not sure how to deploy the change otherwise I'd do it [08:30:42] o/ bartosz sorry I missed that during the review [08:31:44] I support blaming Ilias for this, +1 [08:32:30] I did it to test everyone [08:32:31] :P [08:32:41] bartosz you passed the test [08:38:39] haha I'm glad! I’ll assign you as reviewer as my test reward Ilias :D [11:25:14] (03PS11) 10Bartosz Wójtowicz: ci: Fix blubber file for pre-commit-check CI job. [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1156234 (https://phabricator.wikimedia.org/T393865) [11:28:19] ^ The CI stage is now triggered correctly, but it needs the fix above to work 😇 I think I introduced this bug by changing the blubber buildkit version last second before merging without re-testing locally if it still works :( [11:32:25] * bartosz afk for medical visit, should be back ~3:30pm [11:48:47] (03CR) 10Ilias Sarantopoulos: ci: Fix blubber file for pre-commit-check CI job. (031 comment) [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1156234 (https://phabricator.wikimedia.org/T393865) (owner: 10Bartosz Wójtowicz) [13:01:19] (03PS12) 10Bartosz Wójtowicz: ci: Fix blubber file for pre-commit-check CI job. [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1156234 (https://phabricator.wikimedia.org/T393865) [13:02:00] (03CR) 10Bartosz Wójtowicz: ci: Fix blubber file for pre-commit-check CI job. (031 comment) [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1156234 (https://phabricator.wikimedia.org/T393865) (owner: 10Bartosz Wójtowicz) [13:27:04] 06Machine-Learning-Team: Build model training pipeline using WMF ML Airflow instance - https://phabricator.wikimedia.org/T396495#10909120 (10achou) > For workloads on dse-k8s, we might want to explore using Docker images. There is a workflow util that DPE built for building generic artifacts via Dockerfile, and... [13:52:09] 06Machine-Learning-Team, 10MediaWiki-extensions-ORES, 10MediaWiki-Recent-changes, 06Moderator-Tools-Team, and 4 others: [batch #2] Enable revertrisk filters in recent changes in multiple wikis - https://phabricator.wikimedia.org/T395823#10909248 (10gkyziridis) [18:05:32] 06Machine-Learning-Team, 06Research: AI/ML Model Request: "Improve Tone" Suggested Edit - https://phabricator.wikimedia.org/T392283#10910590 (10KStoller-WMF) [18:06:34] 06Machine-Learning-Team, 06Research: AI/ML Model Request: "Improve Tone" Suggested Edit - https://phabricator.wikimedia.org/T392283#10910592 (10KStoller-WMF) [18:18:24] 06Machine-Learning-Team, 10MediaWiki-Recent-changes, 06Moderator-Tools-Team: Persist historical Revertrisk Multilingual data for threshold analysis - https://phabricator.wikimedia.org/T396788 (10Kgraessle) 03NEW [18:19:02] 06Machine-Learning-Team, 10MediaWiki-Recent-changes, 06Moderator-Tools-Team: Persist historical Revertrisk Multilingual data for threshold analysis - https://phabricator.wikimedia.org/T396788#10910659 (10Kgraessle) [18:28:58] 06Machine-Learning-Team: Article Summary Generation and Evaluation Pipeline using vLLM image - https://phabricator.wikimedia.org/T395246#10910675 (10sumanah) Question about the `SummaryEvaluationModel` service: >>! In T395246#10866605, @kevinbazira wrote: > =====2. Summary Evaluation Server > > A KServe custo...