[02:14:44] <jinxer-wm>	 FIRING: LiftWingServiceErrorRate: ...
[02:14:44] <jinxer-wm>	 LiftWing service has a high rate of non 2/3/400 error code responses - https://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing/Alerts#LiftWingServiceErrorRate - https://grafana.wikimedia.org/d/G7yj84Vnk/istio?orgId=1&refresh=30s&var-cluster=codfw%20prometheus/k8s-mlserve&var-namespace=article-models&var-backend=articlequality-predictor.%2A - https://alerts.wikimedia.org/?q=alertname%3DLiftWingServiceErrorRate
[02:39:44] <jinxer-wm>	 RESOLVED: LiftWingServiceErrorRate: ...
[02:39:44] <jinxer-wm>	 LiftWing service has a high rate of non 2/3/400 error code responses - https://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing/Alerts#LiftWingServiceErrorRate - https://grafana.wikimedia.org/d/G7yj84Vnk/istio?orgId=1&refresh=30s&var-cluster=codfw%20prometheus/k8s-mlserve&var-namespace=article-models&var-backend=articlequality-predictor.%2A - https://alerts.wikimedia.org/?q=alertname%3DLiftWingServiceErrorRate
[03:38:44] <jinxer-wm>	 FIRING: LiftWingServiceErrorRate: ...
[03:38:44] <jinxer-wm>	 LiftWing service has a high rate of non 2/3/400 error code responses - https://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing/Alerts#LiftWingServiceErrorRate - https://grafana.wikimedia.org/d/G7yj84Vnk/istio?orgId=1&refresh=30s&var-cluster=codfw%20prometheus/k8s-mlserve&var-namespace=article-models&var-backend=articlequality-predictor.%2A - https://alerts.wikimedia.org/?q=alertname%3DLiftWingServiceErrorRate
[03:43:44] <jinxer-wm>	 RESOLVED: LiftWingServiceErrorRate: ...
[03:43:44] <jinxer-wm>	 LiftWing service has a high rate of non 2/3/400 error code responses - https://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing/Alerts#LiftWingServiceErrorRate - https://grafana.wikimedia.org/d/G7yj84Vnk/istio?orgId=1&refresh=30s&var-cluster=codfw%20prometheus/k8s-mlserve&var-namespace=article-models&var-backend=articlequality-predictor.%2A - https://alerts.wikimedia.org/?q=alertname%3DLiftWingServiceErrorRate
[08:39:33] <wikibugs>	 (03CR) 10Kevin Bazira: [C:03+1] revertrisk: move GPU model import into multilingual branch [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1275983 (owner: 10AikoChou)
[08:42:05] <wikibugs>	 (03CR) 10AikoChou: [C:03+2] revertrisk: move GPU model import into multilingual branch [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1275983 (owner: 10AikoChou)
[08:45:49] <wikibugs>	 (03Merged) 10jenkins-bot: revertrisk: move GPU model import into multilingual branch [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1275983 (owner: 10AikoChou)
[10:20:09] <wikibugs>	 (03PS1) 10AikoChou: revertrisk: suppress FastAPIDeprecationWarning from upstream KServe [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1276644 (https://phabricator.wikimedia.org/T416384)
[11:48:08] <wikibugs>	 (03Abandoned) 10Ilias Sarantopoulos: logo-detection: update kserve to 0.14.1 [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1113099 (https://phabricator.wikimedia.org/T367048) (owner: 10Ilias Sarantopoulos)
[12:50:26] <wikibugs>	 10Lift-Wing, 06Machine-Learning-Team (Q4 FY2025-26): Investigate enabling gRPC in LiftWing model servers - https://phabricator.wikimedia.org/T421903#11851242 (10isarantopoulos) We’ve filed {T424049}, which aims to address the minimum Kubernetes changes required to support gRPC requests to the articletopic service
[19:11:28] <wikibugs>	 (03PS1) 10AikoChou: revscoring: fix SudachiPy 0.5.2 build [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1276755 (https://phabricator.wikimedia.org/T416384)