[06:09:30] 10Machine-Learning-Team, 10ORES, 10artificial-intelligence, 10articlequality-modeling, 10drafttopic-modeling: ORES deployment - Spring 2021 - https://phabricator.wikimedia.org/T278723 (10elukey) @Halfak quick check in to understand the status of the fix (and if my team should follow up to fix the regress... [07:19:35] good morning :) [07:19:50] it seems that istio provides a "make deb" that produces two packages [07:19:55] 1) istio [07:19:59] 2) istio-sidecar.deb [07:20:32] istio contains the pilot-discovery and istioctl binaries [07:21:54] and istio-sidecar envoy + pilot-agent + node-agent [07:23:38] but strangely no istio operator [08:36:27] TIL: https://hub.docker.com/layers/istio/base/1.11-dev.0/images/sha256-f765d3c3a23b4d59c6a4ea6f4cbfa1b44bb76a3ef086c59580b7725051f217cd?context=explore [08:36:35] on dockerhub it is possible to see layers [10:12:48] after a lot of scaffolding I have something more stable [10:12:49] https://gerrit.wikimedia.org/r/c/operations/docker-images/production-images/+/688211/ [10:13:01] the proxyv2 image builds on my laptop [10:13:12] (that is not == it works on k8s of course :D) [10:35:21] * elukey lunch! [10:56:40] 10Machine-Learning-Team, 10artificial-intelligence, 10editquality-modeling, 10Turkish-Sites: Update Turkish Wikipedia's labeling campaign for 2020 - https://phabricator.wikimedia.org/T257359 (10kevinbazira) Thank you for the review @Halfak, I have updated the PR with the suggestions you made. [11:23:52] elukey: so building the proxy image should be entirely independent of the host OS (aside from docker itself and docker-pkg being around), right? [11:24:12] Because for me, building the proxy image fails when it can't install iptables and iproute2 [12:02:11] Ah, found it. Running "apt-get update" before the install line helps [12:03:03] $ docker images|grep wikimedia.*latest [12:03:06] docker-registry.wikimedia.org/proxyv2 latest a4d348ed1278 6 minutes ago 264MB [12:03:07] docker-registry.wikimedia.org/operator latest f51f834b07c2 47 minutes ago 154MB [12:03:09] docker-registry.wikimedia.org/pilot latest b4e0c50e53e3 55 minutes ago 171MB [12:03:16] So I can confirm your Dockerfile template is *almost* perfect ;) [12:29:56] klausman: ah!!! [12:29:59] thanks!! [12:30:10] I have no idea if it works [12:30:16] the sudoers rules etc.. is a little worrying [12:39:24] also the docker images change between versions (of course) [12:39:26] for extra fun [12:42:40] I've added a comment on Gerrit, so it doesn't get lost [12:42:58] going to follow up in a bit after a meeting! [12:50:22] Ack! [15:28:49] 10Machine-Learning-Team, 10ORES, 10artificial-intelligence, 10Analytics, and 2 others: Generate dump of scored-revisions from 2018-2020 for Wikis except English Wikipedia - https://phabricator.wikimedia.org/T280107 (10JAllemandou) Hi - I am trying to make this happen. Data for the `wikidata` project is ve... [15:32:04] 10Machine-Learning-Team, 10ORES, 10artificial-intelligence, 10Analytics, and 2 others: Generate dump of scored-revisions from 2018-2020 for Wikis except English Wikipedia - https://phabricator.wikimedia.org/T280107 (10elukey) >>! In T280107#7078709, @JAllemandou wrote: > Hi - I am trying to make this happ... [15:45:06] 10Machine-Learning-Team, 10ORES, 10artificial-intelligence, 10articlequality-modeling, 10drafttopic-modeling: ORES deployment - Spring 2021 - https://phabricator.wikimedia.org/T278723 (10Halfak) The fix is merged. Because of T212818, you'll need to manually propagate the changes to gerrit for the draftt... [15:46:31] * elukey afk! [16:57:30] 10Lift-Wing, 10Machine-Learning-Team: Load a fastText model in to KFServing - https://phabricator.wikimedia.org/T276862 (10Isaac) Yay! > Are the only two required parameters are lang and page_title? There should be three (also `threshold` -- see below). Regarding `lang` and `page_title` though: as it is curre... [19:52:40] 10Machine-Learning-Team, 10artificial-intelligence, 10editquality-modeling, 10Turkish-Sites: Update Turkish Wikipedia's labeling campaign for 2020 - https://phabricator.wikimedia.org/T257359 (10Halfak) Looks good. I made a parallel PR to fix a weird travis issue that was preventing your tests from passing... [22:24:24] 10Lift-Wing, 10Machine-Learning-Team, 10artificial-intelligence, 10revscoring: Load a revscoring model into KFServing - https://phabricator.wikimedia.org/T279000 (10ACraze) As mentioned in T279004, we have successfully deployed the enwiki-goodfaith model as a custom KFServing inference service based off of... [22:34:55] been doing some load testing with kevinbazira's revscoring container deployed as an inference service [22:34:59] results: https://phabricator.wikimedia.org/P15917 [22:35:40] (also vegeta is a great tool for load testing jobs on k8s) [22:41:36] currently trying to configure a more resource-intensive job so I can watch how the Knative queue-proxy enforces pod concurrency, auto-scaling, timeouts and graceful shutdown [22:48:01] I think Knative's activator acts as a load-balancer of sorts that prevents each inference service from bursts as we scale-up additional pods