[06:50:08] (03PS7) 10Ilias Sarantopoulos: outlink-topic-model: enable KServe v2 protocol (REST and gRPC) [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1275413 (https://phabricator.wikimedia.org/T423582) [06:53:19] (03PS8) 10Ilias Sarantopoulos: outlink-topic-model: enable KServe v2 protocol (REST and gRPC) [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1275413 (https://phabricator.wikimedia.org/T423582) [07:04:08] 07artificial-intelligence, 10MediaWiki-Page-editing: Automatic edit summary generation based on analyzing the change made - https://phabricator.wikimedia.org/T14411#11842644 (1034DSSDS) Can we prioritize this ticket - since we have now AI [07:07:17] (03CR) 10Gkyziridis: [C:03+2] revertrisk-multilingual: Optimize rr-multilingual model for asynchronous predictions. [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1275362 (https://phabricator.wikimedia.org/T415892) (owner: 10Gkyziridis) [07:10:51] (03Merged) 10jenkins-bot: revertrisk-multilingual: Optimize rr-multilingual model for asynchronous predictions. [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1275362 (https://phabricator.wikimedia.org/T415892) (owner: 10Gkyziridis) [08:44:42] (03CR) 10Ilias Sarantopoulos: [C:03+1] revscoring: add threshold to elapsed_time logging [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1270917 (https://phabricator.wikimedia.org/T416384) (owner: 10AikoChou) [09:13:00] 06Machine-Learning-Team: Build the debian packages for amd node labeller and gpu plugin to pick up the new changes - https://phabricator.wikimedia.org/T423459#11843102 (10elukey) ` root@apt1002:/srv/wikimedia# reprepro lsbycomponent amd-k8s-node-labeller amd-k8s-node-labeller | 1.31.0.8-7 | bookworm-wikimedia |... [09:14:52] 07artificial-intelligence, 10MediaWiki-Page-editing: Automatic edit summary generation based on analyzing the change made - https://phabricator.wikimedia.org/T14411#11843103 (10Aklapper) @34DSSDS On behalf of which community? Please point to the discussion - thanks. [09:15:04] (03CR) 10Gkyziridis: [C:03+1] "LGTM! Thnx for working on this." [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1275413 (https://phabricator.wikimedia.org/T423582) (owner: 10Ilias Sarantopoulos) [10:14:25] 10Lift-Wing, 06Machine-Learning-Team, 06ServiceOps new, 10ServiceOps-SharedInfra, and 5 others: Reroute LiftWing endpoints - https://phabricator.wikimedia.org/T422804#11843300 (10Clement_Goubert) [11:01:44] FIRING: LiftWingServiceErrorRate: ... [11:01:44] LiftWing service has a high rate of non 2/3/400 error code responses - https://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing/Alerts#LiftWingServiceErrorRate - https://grafana.wikimedia.org/d/G7yj84Vnk/istio?orgId=1&refresh=30s&var-cluster=codfw%20prometheus/k8s-mlserve&var-namespace=article-models&var-backend=articlequality-predictor.%2A - https://alerts.wikimedia.org/?q=alertname%3DLiftWingServiceErrorRate [11:14:36] (03PS1) 10AikoChou: revertrisk: improve logging levels and replace InvalidInput with HTTPException [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1275867 (https://phabricator.wikimedia.org/T416384) [11:16:42] 10Lift-Wing, 06Machine-Learning-Team, 06ServiceOps new, 10ServiceOps-SharedInfra, and 5 others: Reroute LiftWing endpoints - https://phabricator.wikimedia.org/T422804#11843519 (10Clement_Goubert) [11:22:12] 10Lift-Wing, 06Machine-Learning-Team, 06ServiceOps new, 10ServiceOps-SharedInfra, and 5 others: Reroute LiftWing endpoints - https://phabricator.wikimedia.org/T422804#11843524 (10Clement_Goubert) 05In progress→03Stalled After some finaggling with lua patterns, everything on our side is now in place to... [12:16:27] (03CR) 10Ilias Sarantopoulos: [C:03+2] outlink-topic-model: enable KServe v2 protocol (REST and gRPC) [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1275413 (https://phabricator.wikimedia.org/T423582) (owner: 10Ilias Sarantopoulos) [12:20:51] (03Merged) 10jenkins-bot: outlink-topic-model: enable KServe v2 protocol (REST and gRPC) [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1275413 (https://phabricator.wikimedia.org/T423582) (owner: 10Ilias Sarantopoulos) [13:46:52] (03CR) 10Gkyziridis: [C:03+1] "LGTM!" [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1275867 (https://phabricator.wikimedia.org/T416384) (owner: 10AikoChou) [13:50:46] (03CR) 10Ozge: [C:03+1] revertrisk: improve logging levels and replace InvalidInput with HTTPException [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1275867 (https://phabricator.wikimedia.org/T416384) (owner: 10AikoChou) [14:58:20] 06Machine-Learning-Team: k8s changes needed to allow article topic (and other future isvcs) to use the kserve v2 inference protocol (and gRPC) - https://phabricator.wikimedia.org/T424049 (10klausman) 03NEW [15:01:59] FIRING: LiftWingServiceErrorRate: ... [15:01:59] LiftWing service has a high rate of non 2/3/400 error code responses - https://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing/Alerts#LiftWingServiceErrorRate - https://grafana.wikimedia.org/d/G7yj84Vnk/istio?orgId=1&refresh=30s&var-cluster=codfw%20prometheus/k8s-mlserve&var-namespace=article-models&var-backend=articlequality-predictor.%2A - https://alerts.wikimedia.org/?q=alertname%3DLiftWingServiceErrorRate [16:34:54] (03CR) 10AikoChou: [C:03+2] "Thanks for the review!" [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1275867 (https://phabricator.wikimedia.org/T416384) (owner: 10AikoChou) [16:38:53] (03Merged) 10jenkins-bot: revertrisk: improve logging levels and replace InvalidInput with HTTPException [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1275867 (https://phabricator.wikimedia.org/T416384) (owner: 10AikoChou) [17:23:05] (03PS1) 10AikoChou: revertrisk: move GPU model import into multilingual branch [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1275983 [17:28:44] 10Lift-Wing, 06Machine-Learning-Team (Q4 FY2025-26): Generate OpenAPI descriptions for Lift Wing APIs - https://phabricator.wikimedia.org/T419455#11846182 (10apaskulin) [17:51:43] 06Machine-Learning-Team, 10VisualEditor Suggestion Mode: Update "Add a link" model to generate suggestions based on changes you make within an edit session - https://phabricator.wikimedia.org/T424070 (10ppelberg) 03NEW [17:52:47] 06Machine-Learning-Team, 10VisualEditor Suggestion Mode: [Suggestion] Suggest links on text people add within an edit session - https://phabricator.wikimedia.org/T423546#11846322 (10ppelberg) [17:53:00] 06Machine-Learning-Team, 10VisualEditor Suggestion Mode: Update "Add a link" model to generate suggestions based on changes you make within an edit session - https://phabricator.wikimedia.org/T424070#11846325 (10ppelberg) →14Duplicate dup:03T423546 [17:53:02] 06Machine-Learning-Team, 10VisualEditor Suggestion Mode: [Suggestion] Suggest links on text people add within an edit session - https://phabricator.wikimedia.org/T423546#11846327 (10ppelberg)