[01:06:26] wiki-ai/revscoring#558 (format_json - 63519b3 : halfak): The build was fixed. https://travis-ci.org/wiki-ai/revscoring/builds/110855659 [17:25:38] o/ sabya [17:25:46] welcome to the AI channel :) [17:26:28] thank you, halfak [17:26:48] Amir1 is my primary collaborator on the Revision scoring as a service project. He's currently funded by Wikimedia Deutschland and focusing on Wikidata -- which presents a very different prediction/feature-extraction context. [17:27:08] violetto has been doing some design work with us. [17:27:12] o/ sabya [17:27:32] legoktm has been helping us navigate MediaWiki and contribution processes for it. [17:27:37] I do lots of other things too ;) [17:28:02] bmansurov is working on the "labeling" service we have -- how we gather human judgement for training/testing new prediction models. [17:28:16] That is called "Wiki labels". https://meta.wikimedia.org/wiki/Wiki_labels [17:28:17] o/ Amir1 [17:28:58] sabya is an engineer who is looking for some opportunities to contribute to Wikimedia projects so I'm trying to rope him into working on ours :D [17:29:04] He's specifically interested in backend work. [17:29:22] sabya: I'm here to help if you need anything and halfak is not around or available [17:29:46] I've done a little backend for ores [17:29:52] not so much [17:30:09] but it would be great to have someone on board wrt backend [17:30:51] Oh! I forgot to mention yuvipanda. he's been a prime contributor to our backend/devops work so far. He's primarily worked with us as an advisor. [17:31:20] Otherwise, most of our volunteers primarily work with us on-wiki to help us gather false-positive reports or label edits as vandalism/not. [17:31:22] that's a great. [17:31:51] intro [17:32:05] :) [17:32:16] Welcome! [17:32:30] Most of our code lives here: https://github.com/wiki-ai/ [17:32:49] E.g. https://github.com/wiki-ai/ores is the web service that hosts prediction models. [17:33:02] https://github.com/wiki-ai/revscoring is the library for building new prediction models. [17:33:15] https://github.com/wiki-ai/wikilabels is the web service and javascript gadget for gathering labels [17:37:12] ok [17:45:44] halfak, making a robust job queue seems interesting. Let me know where to get started. [17:46:39] sabya, So, right now, we use redis as a backend and broker for set of celery workers. [17:50:12] ok... [17:50:40] Sorry, getting you a good link to where these are defined in the code. [17:51:00] OK. here's the score processor for celery: https://github.com/wiki-ai/ores/blob/master/ores/score_processors/celery.py [17:51:14] We also have a basic timeout score processor that does all the work on a local CPU. [17:51:19] https://github.com/wiki-ai/ores/blob/master/ores/score_processors/timeout.py [17:51:26] That's usually only used for dev work. [17:51:37] But it's nice to see the simple version. [17:52:29] Right now, we're experiencing intermittent failures of worker nodes. [17:52:40] No errors are reported -- the workers just stop getting jobs (I think) [17:52:50] And I suspect that it is because they lose connection to the redis queue. [17:56:47] where can i see the code for submitting a job to the job queue [17:56:55] ? [17:57:25] halfak, what's your next move regarding plwiki? [18:00:15] TarLocesilion, as soon as I can get some time, I'll construct a "reverted" model that make pproblematic, but useful predictioons about what edits might need to be reverted. [18:00:42] Then I'll load up edits into the Wiki labels system for plwiki so that we can start gathering human judgement for training the better "damaging" and "goodfaith" models. [18:00:56] I'll let you know when either of those are ready for you. [18:01:11] I'm going to be at a conference this week, so it might be two weeks before I can get back to you. [18:01:25] got it. great, thanks :) [19:02:58] (03PS1) 10Legoktm: Fix typo in extension.json "author" property [extensions/ORES] - 10https://gerrit.wikimedia.org/r/272519 [19:04:56] (03CR) 10Ladsgroup: [C: 032] Fix typo in extension.json "author" property [extensions/ORES] - 10https://gerrit.wikimedia.org/r/272519 (owner: 10Legoktm) [19:32:29] bye all, going to bed