[06:46:25] Guten Tag o/ [07:01:44] good morning [07:13:47] good morning [07:22:14] good morning :) [07:31:02] (03CR) 10Bartosz Wójtowicz: [C:03+1] "Thank you for your work on this Kevin! LGTM :)" [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1169195 (https://phabricator.wikimedia.org/T399437) (owner: 10Kevin Bazira) [07:44:17] 06Machine-Learning-Team: Configure autoscaling for tone-check model server - https://phabricator.wikimedia.org/T400162#11026726 (10isarantopoulos) [07:44:50] georgekyz: o/ I have added additional information in the task above for autoscaling. let me know if you have any questions [07:58:22] isaranto: thnx [08:04:21] (03CR) 10AikoChou: [C:03+1] "LGTM!" [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1169195 (https://phabricator.wikimedia.org/T399437) (owner: 10Kevin Bazira) [08:05:24] (03CR) 10Kevin Bazira: [C:03+2] "Thanks for the reviews :)" [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1169195 (https://phabricator.wikimedia.org/T399437) (owner: 10Kevin Bazira) [08:06:43] (03CR) 10CI reject: [V:04-1] RR: Validate lang parameter against canonical wikis [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1169195 (https://phabricator.wikimedia.org/T399437) (owner: 10Kevin Bazira) [08:22:53] 10Lift-Wing, 06Machine-Learning-Team, 13Patch-For-Review: revertrisk model servers should return a 400 response for non canonical language names - https://phabricator.wikimedia.org/T399437#11026780 (10kevinbazira) The patch in T399437#11001304 is running into a CI failure when merging, due to the error below... [08:36:21] Hey folks there is an update on ToneCheck retraining pipeline ticket from Ben, please have a look and feel free to add any comments. We will probably continue on this next week: https://phabricator.wikimedia.org/T396495#11025158 [08:39:01] ack! [08:40:41] (03CR) 10Kevin Bazira: [C:03+2] "recheck" [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1169195 (https://phabricator.wikimedia.org/T399437) (owner: 10Kevin Bazira) [08:42:11] (03CR) 10CI reject: [V:04-1] RR: Validate lang parameter against canonical wikis [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1169195 (https://phabricator.wikimedia.org/T399437) (owner: 10Kevin Bazira) [08:42:48] (03CR) 10Kevin Bazira: [C:03+2] "recheck" [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1169195 (https://phabricator.wikimedia.org/T399437) (owner: 10Kevin Bazira) [08:44:10] (03CR) 10CI reject: [V:04-1] RR: Validate lang parameter against canonical wikis [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1169195 (https://phabricator.wikimedia.org/T399437) (owner: 10Kevin Bazira) [09:04:47] ^--- CI is failing: https://phabricator.wikimedia.org/T399437#11001304 [09:04:50] going to follow up with RelEng [09:07:21] this doesn't seem to be the first occurrence: https://phabricator.wikimedia.org/T399437#11026780 [09:30:25] as of ~ 02:00 UTC on 2025-07-23: bullseye-backports were removed: https://phabricator.wikimedia.org/T383557 [09:35:51] CI images were affected and are yet to be rebuilt. [09:38:28] kevinbazira: o/ I think that you can patch the issue updating "FROM docker-registry.wikimedia.org/bullseye:20231126" in the dockerfile to the latest available version [09:41:44] elukey: o/ let me do that as I see the latest image was built today [09:48:26] (03PS6) 10Kevin Bazira: RR: Validate lang parameter against canonical wikis [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1169195 (https://phabricator.wikimedia.org/T399437) [09:55:05] (03CR) 10Kevin Bazira: [C:03+2] "trying the merge again after updtading RR base image to the latest, following:" [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1169195 (https://phabricator.wikimedia.org/T399437) (owner: 10Kevin Bazira) [09:59:13] (03Merged) 10jenkins-bot: RR: Validate lang parameter against canonical wikis [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1169195 (https://phabricator.wikimedia.org/T399437) (owner: 10Kevin Bazira) [10:03:52] 10Lift-Wing, 06Machine-Learning-Team, 13Patch-For-Review: revertrisk model servers should return a 400 response for non canonical language names - https://phabricator.wikimedia.org/T399437#11027131 (10kevinbazira) >>! In T399437#11026780, @kevinbazira wrote: > The patch in T399437#11001304 is running into a... [10:39:38] elukey: CI succeeded. thanks alot for the pointer! [10:39:39] I will test the latest RR images in staging after review: https://gerrit.wikimedia.org/r/1172011 [10:43:08] np! [12:15:27] 07artificial-intelligence, 10ContentTranslation: Add AI-based translation and post-editing to Content Translation tool - https://phabricator.wikimedia.org/T395160#11027554 (10Nikerabbit) p:05Triage→03Medium [14:11:26] 06Machine-Learning-Team, 07Essential-Work: Upgrade revertrisk model server from the debian bullseye base image to bookworm. - https://phabricator.wikimedia.org/T400266 (10gkyziridis) 03NEW [14:20:39] 06Machine-Learning-Team, 07Essential-Work: Upgrade revertrisk model server from the debian bullseye base image to bookworm. - https://phabricator.wikimedia.org/T400266#11028047 (10isarantopoulos) Since the purpose of this work is to update any bullseye images that are used in production since bullseye is reach... [14:21:54] 10Lift-Wing, 06Machine-Learning-Team, 10EditCheck, 10SRE-SLO, 10Editing-team (Tracking): Create SLO dashboard for tone (peacock) check model - https://phabricator.wikimedia.org/T390706#11028049 (10elukey) [14:52:10] 06Machine-Learning-Team, 07Essential-Work: Upgrade revertrisk model server from the debian bullseye base image to bookworm. - https://phabricator.wikimedia.org/T400266#11028175 (10gkyziridis) == Testing revertrisk on bookworm image == I used the following process for testing the image: ` ssh ml-testing.machin... [15:15:57] 10Lift-Wing, 06Machine-Learning-Team: Request to host kid-friendly-classifier on Lift Wing - https://phabricator.wikimedia.org/T399872#11028291 (10derenrich) the model is still being evaluated so as such we do not have a specific product that is going to make requests. likely the requests would come from the w... [17:12:36] 06Machine-Learning-Team, 06DC-Ops, 10ops-eqiad, 06SRE: Q4:rack/setup/install ml-serve101[2345] - https://phabricator.wikimedia.org/T393948#11028786 (10elukey) @Jclark-ctr we have found a workaround for provisioning and reimage that seems to have worked for ml-serve1012, I'll have to do more tests so for th...