[01:26:10] 06Revision-Scoring-As-A-Service, 10Mobile-Content-Service, 10ORES, 10RESTBase-API, and 2 others: Add ORES WP10 data to summaries? - https://phabricator.wikimedia.org/T157132#3056787 (10Tgr) `wp10` scores revisions; `damaging` etc. score diffs between subsequent revisions. (Conceptually, anyway. Technically... [01:28:28] 06Revision-Scoring-As-A-Service, 10Mobile-Content-Service, 10ORES, 10RESTBase-API, and 2 others: Add ORES WP10 data to summaries? - https://phabricator.wikimedia.org/T157132#3056788 (10Pchelolo) Thanks for the context @Tgr. Sounds convincing that it's better to do it in two steps in RESTBase instead of man... [07:06:41] 10Revision-Scoring-As-A-Service-Backlog, 10MediaWiki-Vagrant, 10ORES, 10Wikilabels: ORES services should have vagrant roles - https://phabricator.wikimedia.org/T159105#3056869 (10Tgr) [08:11:50] 06Revision-Scoring-As-A-Service, 10MediaWiki-Recent-changes, 10MediaWiki-Watchlist, 10MediaWiki-extensions-ORES, and 4 others: Add class to diff and history links in changes lists for easier selecting in CSS/javascript - https://phabricator.wikimedia.org/T157178#3056939 (10EddieGP) 05Resolved>03Open So... [16:12:21] 06Revision-Scoring-As-A-Service, 06Research-and-Data, 07Epic: Estimate ORES capex for FY2017-18 - https://phabricator.wikimedia.org/T157222#3058323 (10EBernhardson) I don't know if ores is already doing this, but we've been interested in including ores wp10 score in the search indices as a scoring factor. To... [17:02:13] Hey Amir1 [17:02:23] I'm running late. Am at a conference [17:02:30] halfak|Mobile: Hey, okay [17:02:49] halfak|Mobile: do you know how much? [17:02:55] Got pulled into an emergency discussion with DarTar [17:03:01] 15 mins [17:18:29] 06Revision-Scoring-As-A-Service, 06Research-and-Data, 07Epic: Estimate ORES capex for FY2017-18 - https://phabricator.wikimedia.org/T157222#3058557 (10Ladsgroup) >>! In T157222#3058323, @EBernhardson wrote: > I don't know if ores is already doing this, but we've been interested in including ores wp10 score i... [17:25:41] 10Revision-Scoring-As-A-Service-Backlog, 10revscoring, 07Chinese-Sites: Chinese language utilities - https://phabricator.wikimedia.org/T109366#3058575 (10Halfak) https://meta.wikimedia.org/wiki/Research:Revision_scoring_as_a_service/Word_lists/zh still looks messy. @Cosine02, was there any response on the V... [17:28:21] 06Revision-Scoring-As-A-Service, 06Research-and-Data, 07Epic: Estimate ORES capex for FY2017-18 - https://phabricator.wikimedia.org/T157222#3058582 (10Ottomata) FYI, over in T143743, we are talking about creating a public stream endpoint that contains various ORES scores. I betcha @ebernhardson could use th... [17:30:14] Just got booted. Trying to rejoin [17:32:47] 06Revision-Scoring-As-A-Service, 06Research-and-Data, 07Epic: Estimate ORES capex for FY2017-18 - https://phabricator.wikimedia.org/T157222#3058602 (10EBernhardson) > If the wp10 gets done alongside other precaching tasks, it would have virtually no impact on computational resources (due to sharing features,... [17:34:35] o/ I don't have my audio working, but am lurking in the etherpad [17:37:54] 06Revision-Scoring-As-A-Service, 06Labs, 10Labs-Infrastructure, 07artificial-intelligence: GPU resources for Labs - https://phabricator.wikimedia.org/T159165#3058608 (10Halfak) [17:39:23] 06Revision-Scoring-As-A-Service, 06Research-and-Data, 07Epic: Estimate ORES capex for FY2017-18 - https://phabricator.wikimedia.org/T157222#3058624 (10Ottomata) Interesting. Adding your use case to https://etherpad.wikimedia.org/p/stream-processing [17:57:15] 06Revision-Scoring-As-A-Service, 10Analytics, 10ChangeProp, 10EventBus, and 3 others: Create generalized "precache" endpoint for ORES - https://phabricator.wikimedia.org/T148714#3058705 (10Halfak) a:05Halfak>03Ladsgroup [17:59:35] Hey! I'll have an update re. annual planning stuff towards the end of this week [17:59:37] awight, ^ [17:59:44] * halfak runs back to conference [17:59:58] Iiinteresting! [18:12:17] Amir1, one more thing. I need a rough estimate of the number of workers (both uwsgi and celery) we have in prod. I've been looking through puppet and I can't find this defined. Where is prod hiera defined? [18:12:43] halfak: 45 celery worker per node [18:12:53] let me get the uwsgi [18:13:44] looks like 48 per node [18:13:53] But that's based on a "ps" of scb1002 [18:14:15] halfak: nope, 45 https://github.com/wikimedia/puppet/blob/production/modules/ores/manifests/web.pp [18:14:44] and also two uwsgi per CPU (I forgot how many CPUs we have in scb) [18:15:05] halfak: I think the 3 more there are the shepherding processes [18:15:08] Gotcha. [18:15:23] So we do roughly 2 uwsgi and 2 celery per CPU? [18:16:07] how many CPUs in scb? [18:16:19] 32? [18:17:44] 06Revision-Scoring-As-A-Service, 10Analytics, 10ChangeProp, 10EventBus, and 3 others: Create generalized "precache" endpoint for ORES - https://phabricator.wikimedia.org/T148714#3058764 (10Ottomata) If there's enough need, we could set up a Kafka cluster in labs that is mirrored from Prod. And/or we can e... [18:17:47] 24 on scb1002 [18:18:04] in that case you're right [18:18:07] 32 on scb1003 [18:18:12] wtf [18:18:15] lol [18:18:51] OK now I'm going to run away, but I think I have a good enough sense of this to get back to Mark. I'll CC you on the hardware discussions so you can help check on my estimates :) [18:18:53] o/ [18:19:02] halfak: o/ [23:26:31] 06Revision-Scoring-As-A-Service, 10Bad-Words-Detection-System, 10revscoring, 15User-Ladsgroup: Add language support for Finnish - https://phabricator.wikimedia.org/T158587#3059728 (10Ladsgroup) https://github.com/wiki-ai/revscoring/pull/301 [23:27:02] wiki-ai/revscoring#886 (finnish - 2a84551 : Amir Sarabadani): The build passed. https://travis-ci.org/wiki-ai/revscoring/builds/205996378