[06:48:48] (03CR) 10Kevin Bazira: [C:03+1] feat(add-ml-service-skill): claude skill for scaffolding an inference service [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1285367 (owner: 10AikoChou) [09:00:21] 10Lift-Wing, 06Machine-Learning-Team (Q4 FY2025-26), 13Patch-For-Review: Host Qwen 3.6-27B as an inference service - https://phabricator.wikimedia.org/T425680#11911259 (10isarantopoulos) [09:26:14] 10Lift-Wing, 06Machine-Learning-Team, 06ServiceOps new, 10ServiceOps-SharedInfra, and 5 others: Reroute LiftWing endpoints - https://phabricator.wikimedia.org/T422804#11911356 (10Blake) Next set complete: ` blake@cp6009:~$ curl -si -o /dev/null -w "%{http_code} %header{via}\n" -X POST -H "Host: api.wikime... [09:27:09] 10Lift-Wing, 06Machine-Learning-Team, 06ServiceOps new, 10ServiceOps-SharedInfra, and 5 others: Reroute LiftWing endpoints - https://phabricator.wikimedia.org/T422804#11911359 (10Blake) [10:45:07] (03PS2) 10Gkyziridis: feat(openapi-specs): Add OpenAPI specs for publicly available Lift Wing models. [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1285735 (https://phabricator.wikimedia.org/T419455) [11:18:03] 10Lift-Wing, 06Machine-Learning-Team (Q4 FY2025-26), 13Patch-For-Review: Host Qwen 3.6-27B as an inference service - https://phabricator.wikimedia.org/T425680#11911802 (10isarantopoulos) [11:56:13] 10Lift-Wing, 06Machine-Learning-Team (Q4 FY2025-26), 13Patch-For-Review: Host Qwen 3.6-27B as an inference service - https://phabricator.wikimedia.org/T425680#11911967 (10isarantopoulos) [12:16:56] (03CR) 10Ilias Sarantopoulos: [C:03+1] "Thanks for pulling this together!" [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1285735 (https://phabricator.wikimedia.org/T419455) (owner: 10Gkyziridis) [12:23:09] 10Lift-Wing, 06Machine-Learning-Team (Q4 FY2025-26), 13Patch-For-Review: Host Qwen 3.6-27B as an inference service - https://phabricator.wikimedia.org/T425680#11912237 (10isarantopoulos) The model has been uploaded to swift under `s3://wmf-ml-models/llm/Qwen3.6-27B-FP8` ✅ [12:42:04] (03CR) 10Gkyziridis: [C:03+2] "Nice catch! It was accidentally pasted like this testing explicitly the edit-check endpoint." [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1285735 (https://phabricator.wikimedia.org/T419455) (owner: 10Gkyziridis) [12:43:15] (03Merged) 10jenkins-bot: feat(openapi-specs): Add OpenAPI specs for publicly available Lift Wing models. [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1285735 (https://phabricator.wikimedia.org/T419455) (owner: 10Gkyziridis) [12:55:56] 06Machine-Learning-Team (Q4 FY2025-26): Editing Suggestions - Eval pipeline for enwiki - https://phabricator.wikimedia.org/T425957#11912359 (10OKarakaya-WMF) updating the pipeline design: {F81134749} [13:09:04] 06Machine-Learning-Team (Q4 FY2025-26), 13Patch-For-Review: Experiment with new kserve version on ml-staging-codfw - https://phabricator.wikimedia.org/T419722#11912512 (10isarantopoulos) everything in staging seems to be going fine and no issue has been reported. We have decided to move forward and roll these... [13:40:31] 10Lift-Wing, 06Machine-Learning-Team, 06ServiceOps new, 10ServiceOps-SharedInfra, and 5 others: Reroute LiftWing endpoints - https://phabricator.wikimedia.org/T422804#11912704 (10Blake) Final set complete: ` blake@cp6009:~$ curl -si -o /dev/null -w "%{http_code} %header{via}\n" -X POST -H "Host: api.wikim... [13:52:05] 10Lift-Wing, 06Machine-Learning-Team, 06ServiceOps new, 10ServiceOps-SharedInfra, and 5 others: Reroute LiftWing endpoints - https://phabricator.wikimedia.org/T422804#11912758 (10Blake) [14:14:49] (03PS4) 10Ilias Sarantopoulos: qwen36-27b: add model server for Qwen 3.6 FP8 inference [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1285375 (https://phabricator.wikimedia.org/T425680) [14:15:02] (03CR) 10Ilias Sarantopoulos: "recheck" [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1285375 (https://phabricator.wikimedia.org/T425680) (owner: 10Ilias Sarantopoulos) [14:15:38] (03PS5) 10Ilias Sarantopoulos: qwen36-27b: add model server for Qwen 3.6 FP8 inference [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1285375 (https://phabricator.wikimedia.org/T425680) [14:26:38] (03CR) 10CI reject: [V:04-1] qwen36-27b: add model server for Qwen 3.6 FP8 inference [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1285375 (https://phabricator.wikimedia.org/T425680) (owner: 10Ilias Sarantopoulos) [14:40:13] 06Machine-Learning-Team (Q4 FY2025-26): Add ml-serve101[45] to production cluster - https://phabricator.wikimedia.org/T424318#11913057 (10isarantopoulos) 05Open→03Resolved [14:41:56] 06Machine-Learning-Team (Q4 FY2025-26), 13Patch-For-Review: Investigate how to enable the swagger UI for InferenceService resources - https://phabricator.wikimedia.org/T332602#11913063 (10isarantopoulos) 05Open→03Resolved a:03isarantopoulos [14:51:23] 06Machine-Learning-Team (Q4 FY2025-26), 10Cloud-VPS (Project-requests): Request creation of wikitts VPS project - https://phabricator.wikimedia.org/T425909#11913090 (10komla) @kevinbazira, we need your feedback here: T425804#11907981 [14:55:12] 06Machine-Learning-Team (Q4 FY2025-26), 10Toolforge (Quota-requests): Request increased quota for wiki-tts Toolforge tool - https://phabricator.wikimedia.org/T425804#11913105 (10kevinbazira) >>! In T425804#11907981, @Andrew wrote: > Hi folks! We are discussing this task during our weekly meeting. > > We would... [14:56:29] 06Machine-Learning-Team (Q4 FY2025-26), 10Cloud-VPS (Project-requests): Request creation of wikitts VPS project - https://phabricator.wikimedia.org/T425909#11913111 (10kevinbazira) Thanks @komla! I shared feedback from the ML and APPs team: T425804#11913105 [15:00:49] (03CR) 10Ilias Sarantopoulos: "recheck" [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1285375 (https://phabricator.wikimedia.org/T425680) (owner: 10Ilias Sarantopoulos) [15:11:30] (03PS6) 10Ilias Sarantopoulos: qwen36-27b: add model server for Qwen 3.6 FP8 inference [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1285375 (https://phabricator.wikimedia.org/T425680) [15:15:40] 10Lift-Wing, 06Machine-Learning-Team (Q4 FY2025-26): Configure LiftWing's openAPI specs into mediawiki-config - https://phabricator.wikimedia.org/T426081 (10gkyziridis) 03NEW [15:21:46] (03CR) 10CI reject: [V:04-1] qwen36-27b: add model server for Qwen 3.6 FP8 inference [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1285375 (https://phabricator.wikimedia.org/T425680) (owner: 10Ilias Sarantopoulos) [15:23:33] 06Machine-Learning-Team (Q4 FY2025-26), 10Toolforge (Quota-requests): Request increased quota for wiki-tts Toolforge tool - https://phabricator.wikimedia.org/T425804#11913285 (10Andrew) > it would be great if this requirement is fulfilled this week Unfortunately, I think it's unlikely that the toolforge node... [15:33:28] (03PS1) 10Gkyziridis: feat(openapi-specs): Use OpenAPI 3.0.0 for broader Swagger UI compatibility [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1286414 (https://phabricator.wikimedia.org/T426081) [15:35:04] 10Lift-Wing, 06Machine-Learning-Team (Q4 FY2025-26): Generate OpenAPI descriptions for Lift Wing APIs - https://phabricator.wikimedia.org/T419455#11913421 (10gkyziridis) I created a subtask for configuring the openapi specs in the mediawiki-config: https://phabricator.wikimedia.org/T426081 I will paste there m... [15:35:58] (03PS2) 10Gkyziridis: feat(openapi-specs): Use OpenAPI 3.0.0 for broader Swagger UI compatibility [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1286414 (https://phabricator.wikimedia.org/T426081) [15:37:51] (03CR) 10Gkyziridis: "This is very minor change I will merge it in order to test it on the RestSandbox locally." [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1286414 (https://phabricator.wikimedia.org/T426081) (owner: 10Gkyziridis) [15:40:26] 10Lift-Wing, 06Machine-Learning-Team (Q4 FY2025-26), 13Patch-For-Review: Configure LiftWing's openAPI specs into mediawiki-config - https://phabricator.wikimedia.org/T426081#11913432 (10gkyziridis) [15:41:31] (03CR) 10Gkyziridis: [C:03+2] feat(openapi-specs): Use OpenAPI 3.0.0 for broader Swagger UI compatibility [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1286414 (https://phabricator.wikimedia.org/T426081) (owner: 10Gkyziridis) [15:42:08] (03Merged) 10jenkins-bot: feat(openapi-specs): Use OpenAPI 3.0.0 for broader Swagger UI compatibility [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1286414 (https://phabricator.wikimedia.org/T426081) (owner: 10Gkyziridis) [17:38:05] (03PS8) 10Ilias Sarantopoulos: qwen36-27b: add model server for Qwen 3.6 FP8 inference [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1285375 (https://phabricator.wikimedia.org/T425680) [17:40:12] 10Lift-Wing, 06Machine-Learning-Team (Q4 FY2025-26), 13Patch-For-Review: Host Qwen 3.6-27B as an inference service - https://phabricator.wikimedia.org/T425680#11914127 (10isarantopoulos) @gkyziridis has added the CI pipelines for this service. The patch that adds the model is now ready for review https://ger... [18:08:48] 06Machine-Learning-Team (Q4 FY2025-26), 10Toolforge (Quota-requests): Request increased quota for wiki-tts Toolforge tool - https://phabricator.wikimedia.org/T425804#11914308 (10kevinbazira) >>! In T425804#11913283, @Andrew wrote: > Do you have the option of scaling horizontally, having many small pods rather...