[05:38:38] good morning! [06:12:03] morning morning [06:14:34] hey Kevin [06:15:01] I was able to deploy in beta your trwiki changes, but so far no feedback from the community [06:15:16] do you have some ORES urls that we can tesT? [06:15:22] just to make sure it works [06:16:31] Great, thank you for deploying trwiki to beta. [06:16:56] re: urls to test, let me check ... [06:20:28] This url seems to work fine: https://ores.wikimedia.org/v3/scores/trwiki/123456 [06:22:28] The beta one should be https://ores-beta.wmflabs.org/v3/scores/trwiki/123456, looks working [06:24:48] in this case I am not sure if we should just deploy or wait for some community member to be ready [06:25:21] let's try to ping other people just in case [06:26:41] 10Machine-Learning-Team, 10artificial-intelligence, 10editquality-modeling, 10Patch-For-Review, 10Turkish-Sites: Update Turkish Wikipedia's labeling campaign for 2020 - https://phabricator.wikimedia.org/T257359 (10elukey) @Evrifaessa @Vito-Genovese @Mavrikant hi! The new models should be ready to deploy,... [06:27:09] kevinbazira: I'll ask to Chris the green light to deploy, we can do it later on in case (or tomorrow) [06:28:32] That's alright. Will wait for Chris' green light. [06:29:00] +1 perfect [10:32:51] 10Lift-Wing, 10Machine-Learning-Team, 10Patch-For-Review: Install Istio on ml-serve cluster - https://phabricator.wikimedia.org/T278192 (10elukey) I was able to test the httppbin example with Ingress gateway following https://istio.io/latest/docs/tasks/traffic-management/ingress/ingress-control, and I got it... [11:29:02] 10Machine-Learning-Team, 10Wikilabels: Translations updates are blocked - https://phabricator.wikimedia.org/T282449 (10Nikerabbit) Either the protection needs to be lifted, or translatewiki account needs to be given an exception, or we can also submit pull requests if that works better with your workflow. [11:29:11] 10Lift-Wing, 10Machine-Learning-Team: Install Knative on ml-serve cluster - https://phabricator.wikimedia.org/T278194 (10elukey) The docs in https://knative.dev/docs/install/install-serving-with-yaml/ looks reproducible on minikube nicely: ` kubectl apply -f https://github.com/knative/serving/releases/downloa... [11:39:25] * elukey lunch [11:47:05] 10Lift-Wing, 10Machine-Learning-Team, 10Patch-For-Review: Install Istio on ml-serve cluster - https://phabricator.wikimedia.org/T278192 (10Theofpa) Since we're not planning to use the service-mesh functionality of istio but the ingress-gateway only, there is no reason to connect istio with prometheus. [14:20:47] 10Lift-Wing, 10Machine-Learning-Team, 10Patch-For-Review: Install Istio on ml-serve cluster - https://phabricator.wikimedia.org/T278192 (10elukey) >>! In T278192#7092437, @Theofpa wrote: > Since we're not planning to use the service-mesh functionality of istio but the ingress-gateway only, there is no reason... [15:08:03] folks I am deploying the new editquality version for the trwiki task [15:08:08] (for ORES) [15:26:32] deployment done [15:26:42] kevinbazira: your changes are live :) [15:34:07] Nice ... thank you for deploying them 👏👏👏 [15:37:53] well thank you for all the work :) [15:46:03] 10Machine-Learning-Team, 10drafttopic-modeling, 10Discovery-Search (Current work), 10Epic: [Epic] Add drafttopic predictions to ElasticSearch index for the Draft namespace where available - https://phabricator.wikimedia.org/T249341 (10MPhamWMF) Is this epic ready to be closed out? [16:00:05] 10Machine-Learning-Team, 10artificial-intelligence, 10editquality-modeling, 10Patch-For-Review, 10Turkish-Sites: Update Turkish Wikipedia's labeling campaign for 2020 - https://phabricator.wikimedia.org/T257359 (10elukey) New models deployed! [16:07:36] 10Machine-Learning-Team, 10artificial-intelligence, 10editquality-modeling, 10Patch-For-Review, 10Turkish-Sites: Update Turkish Wikipedia's labeling campaign for 2020 - https://phabricator.wikimedia.org/T257359 (10Halfak) I just had a chance to take a look at this. Sorry I was AFK this weekend. But all... [16:10:05] 10Machine-Learning-Team, 10artificial-intelligence, 10editquality-modeling, 10Patch-For-Review, 10Turkish-Sites: Update Turkish Wikipedia's labeling campaign for 2020 - https://phabricator.wikimedia.org/T257359 (10Superyetkin) Thanks for the deployment. Does this instantly affect [[https://ores.wikimedia... [16:42:34] 10Lift-Wing, 10Machine-Learning-Team: Upgrade Istio & Knative on sandbox cluster - https://phabricator.wikimedia.org/T282752 (10ACraze) Spun up a new VM running Kubeflow v1.3: k8s: 1.16 istio: 1.9.0 knative: v0.14.3 kfserving: v0.5.1 Kubeflow v.1.3 fully supports on-prem installs, however there is a big API... [16:46:42] 10Lift-Wing, 10Machine-Learning-Team, 10artificial-intelligence, 10revscoring: Implement model storage for enwiki-goodfaith inference service - https://phabricator.wikimedia.org/T282802 (10ACraze) Awesome, thank you both! Next I'm going to wire up the storage_uri , but I'll need to setup a custom s3 endpo... [16:54:40] 10Lift-Wing, 10Machine-Learning-Team: Upgrade Istio & Knative on sandbox cluster - https://phabricator.wikimedia.org/T282752 (10elukey) @ACraze we are aiming to target Istio 1.6.x and knative 0.18 following T278194#6964746, but we can always try different combinations. My fear is that we'll have to move to Kub... [17:33:12] elukey: the diagram here does a better job of explaining the request flow - https://github.com/kubeflow/kfserving/tree/master/docs#control-plane [17:39:30] ahhh nice [17:45:08] accraze: I am reading some docs and I think that we should be able to point our LVS infra to any worker node on the cluster, hopefully running the istio ingress gw pod [17:45:31] so we'll have something like inference.svc.$dc.wmnet [17:46:01] that will connect to the various ingress gateway pods, that in turn will route reqs to other pods [17:46:12] how to do it I am not sure yet :D [17:46:41] (probably via helm rather than istioctl) [17:47:01] anyway, some ideas for tomorrow, will report findings :) [17:47:05] * elukey afk! [19:01:19] 10Machine-Learning-Team, 10artificial-intelligence, 10editquality-modeling, 10Patch-For-Review, 10Turkish-Sites: Update Turkish Wikipedia's labeling campaign for 2020 - https://phabricator.wikimedia.org/T257359 (10Halfak) It does! [19:25:15] 10Machine-Learning-Team, 10artificial-intelligence, 10Wikilabels, 10editquality-modeling: Complete viwiki edit quality campaign - https://phabricator.wikimedia.org/T130273 (10Halfak) Nice work! There should not have been bot edits in the dataset. But this dataset is very very old so I wonder if that is w... [20:50:24] 10Machine-Learning-Team, 10Wikilabels: Translations updates are blocked - https://phabricator.wikimedia.org/T282449 (10Rileych) @calbon Are you the right person to ping to see if Language Team can get your help on this? [20:54:43] 10Machine-Learning-Team, 10Wikilabels: Translations updates are blocked - https://phabricator.wikimedia.org/T282449 (10RhinosF1) This sounds like {T281711} by @Ladsgroup and @elukey [20:54:55] Amir1: ^ [21:42:56] 10Machine-Learning-Team, 10artificial-intelligence, 10Wikilabels, 10articlequality-modeling: Build article quality model for Dutch Wikipedia - https://phabricator.wikimedia.org/T223782 (10RonnieV) Thank you, @Psingh07, it does look great indeed! I agree with @Ciell on the label name: "Kwaliteitsinschattin... [22:33:48] 10Machine-Learning-Team, 10artificial-intelligence, 10Wikilabels, 10articlequality-modeling: Build article quality model for Dutch Wikipedia - https://phabricator.wikimedia.org/T223782 (10Halfak) I updated the language for the tool so that it should show the dutch version now. Re. templates, you can see...