[00:01:49] <jinxer-wm>	 FIRING: KubernetesDeploymentUnavailableReplicas: ...
[00:01:49] <jinxer-wm>	 Deployment reference-need-predictor-00005-deployment in revision-models at eqiad has persistently unavailable replicas - https://wikitech.wikimedia.org/wiki/Kubernetes/Troubleshooting#Troubleshooting_a_deployment - https://grafana.wikimedia.org/d/a260da06-259a-4ee4-9540-5cab01a246c8/kubernetes-deployment-details?var-site=eqiad&var-cluster=k8s-mlserve&var-namespace=revision-models&var-deployment=reference-need-predictor-00005-deployment - ...
[00:01:49] <jinxer-wm>	 https://alerts.wikimedia.org/?q=alertname%3DKubernetesDeploymentUnavailableReplicas
[00:06:49] <jinxer-wm>	 RESOLVED: KubernetesDeploymentUnavailableReplicas: ...
[00:06:49] <jinxer-wm>	 Deployment reference-need-predictor-00005-deployment in revision-models at eqiad has persistently unavailable replicas - https://wikitech.wikimedia.org/wiki/Kubernetes/Troubleshooting#Troubleshooting_a_deployment - https://grafana.wikimedia.org/d/a260da06-259a-4ee4-9540-5cab01a246c8/kubernetes-deployment-details?var-site=eqiad&var-cluster=k8s-mlserve&var-namespace=revision-models&var-deployment=reference-need-predictor-00005-deployment - ...
[00:06:49] <jinxer-wm>	 https://alerts.wikimedia.org/?q=alertname%3DKubernetesDeploymentUnavailableReplicas
[05:23:57] <wikibugs>	 (03PS2) 10Kevin Bazira: article-country: add support for wikilink-related predictions [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1125661 (https://phabricator.wikimedia.org/T385970)
[05:25:19] <wikibugs>	 (03CR) 10CI reject: [V:04-1] article-country: add support for wikilink-related predictions [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1125661 (https://phabricator.wikimedia.org/T385970) (owner: 10Kevin Bazira)
[05:28:14] <wikibugs>	 (03PS3) 10Kevin Bazira: article-country: add support for wikilink-related predictions [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1125661 (https://phabricator.wikimedia.org/T385970)
[05:32:20] <wikibugs>	 (03CR) 10Kevin Bazira: article-country: add support for wikilink-related predictions (033 comments) [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1125661 (https://phabricator.wikimedia.org/T385970) (owner: 10Kevin Bazira)
[08:17:32] <isaranto>	 hello wonderful ppl!
[08:23:06] <elukey>	 o/
[08:23:21] <elukey>	 I noticed https://gerrit.wikimedia.org/r/c/machinelearning/liftwing/inference-services/+/1126070, wondering how batch works in this case 
[08:23:48] <isaranto>	 \ο
[08:25:52] <georgekyz>	 morning folks!
[08:26:02] <isaranto>	 batch in this case doesnt mean many requests at once. The model scores sentences so batching is applied on the sentence level. This is why predict for this service is so intensive as it scores many sentences. So bigger articles > higher latency
[08:32:58] <elukey>	 ahh right make more sense thanks!
[08:33:03] <elukey>	 hope it alleviates the issue
[08:40:54] <isaranto>	 I hope too! 
[08:56:02] <wikibugs>	 06Machine-Learning-Team, 10Wikilabels: Admin interface for WPX UI - https://phabricator.wikimedia.org/T120902#10627485 (10Aklapper)
[09:10:10] <wikibugs>	 (03CR) 10AikoChou: [C:03+1] "LGTM!" [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1125661 (https://phabricator.wikimedia.org/T385970) (owner: 10Kevin Bazira)
[09:12:51] <wikibugs>	 (03CR) 10Kevin Bazira: [C:03+2] "thanks for the review :)" [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1125661 (https://phabricator.wikimedia.org/T385970) (owner: 10Kevin Bazira)
[09:13:36] <wikibugs>	 (03Merged) 10jenkins-bot: article-country: add support for wikilink-related predictions [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1125661 (https://phabricator.wikimedia.org/T385970) (owner: 10Kevin Bazira)
[09:23:57] <wikibugs>	 (03PS8) 10Gkyziridis: inference-services: Develop loading peacock model logic. [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1126012 (https://phabricator.wikimedia.org/T386100)
[09:25:57] <wikibugs>	 (03CR) 10Ilias Sarantopoulos: "Thanks for working on this! This is nice I added a couple of suggestions. Ping me if you need to discuss any of these further" [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1126012 (https://phabricator.wikimedia.org/T386100) (owner: 10Gkyziridis)