[00:22:17] thx, biab [02:58:59] halfak: oic now--the test directories in the ores backend aren't being run from WMF CI, but from Travis instead. [02:59:28] I'm sure that's fine [03:17:18] halfak: I found the new changeprop configuration by the way: https://github.com/wikimedia/mediawiki-services-change-propagation-deploy/blob/master/scap/templates/config.yaml.j2#L327 [03:54:55] (03CR) 10Ladsgroup: "https://github.com/wikimedia/mediawiki-extensions-ORES/blob/master/includes/Hooks.php#L411 It requires two arguments now. Please update th" [extensions/ORES] - 10https://gerrit.wikimedia.org/r/315661 (https://phabricator.wikimedia.org/T146560) (owner: 10Ladsgroup) [06:42:14] 06Revision-Scoring-As-A-Service, 10ORES: Planning long-term ORES architecture - https://phabricator.wikimedia.org/T137125#2358215 (10awight) I just started a wiki page which overlaps with this task, https://www.mediawiki.org/wiki/Extension:ORES/Components -- so I'm curious to know why this was marked invalid? [07:37:33] halfak: Well, I feel refreshed on the current architecture. Please take a look at the TODOs when you have the time, they're for other people to fill in: https://www.mediawiki.org/wiki/Extension:ORES/Components [08:01:43] (03CR) 10Awight: [C: 032] "I'm easily fooled by rebase issues! Lmk what you think about test doubles vs calling setContext directly--your approach here seems cleane" [extensions/ORES] - 10https://gerrit.wikimedia.org/r/315661 (https://phabricator.wikimedia.org/T146560) (owner: 10Ladsgroup) [08:03:02] (03Merged) 10jenkins-bot: Extensive CI tests, part II [extensions/ORES] - 10https://gerrit.wikimedia.org/r/315661 (https://phabricator.wikimedia.org/T146560) (owner: 10Ladsgroup) [10:30:47] Amir1: halfak: FWIW we are doubling SCB capacity today [11:24:56] akosiaris: thanks for the update. Is there anything we should do? [11:27:48] Amir1: I don't think so [11:45:50] kk [11:45:54] So excited! [14:02:01] o/ [14:02:46] halfak: o/ as a note, Ops are doubling number of scb nodes \o/ [14:03:02] Yeah. Saw the message from akosiaris [14:03:13] I'm doing paper reviews today, so I'll be in and out. [14:08:59] Amir1: halfak: So the machines have been added to the cluster. ORES uwsgi has been pooled and accepting requests and I do see celery workers consuming CPU as well [14:09:08] Nice [14:09:36] This + new work on prioritizing requests in ORES should have a pretty massive benefit. [14:09:46] We'll almost never reach capacity. [14:09:50] We need to update some of our charts I guess: https://grafana.wikimedia.org/dashboard/db/ores [14:09:55] Indeed. [14:10:12] akosiaris: Can you point out to the phab card so we add our project tag? [14:10:38] https://phabricator.wikimedia.org/T147903 [14:16:18] thanks [14:59:32] (03CR) 10Thiemo Mättig (WMDE): [C: 031] Soften dependency on the BetaFeatures extension (031 comment) [extensions/ORES] - 10https://gerrit.wikimedia.org/r/316701 (owner: 10Awight) [15:01:46] (03CR) 10Ladsgroup: [C: 032] Soften dependency on the BetaFeatures extension (031 comment) [extensions/ORES] - 10https://gerrit.wikimedia.org/r/316701 (owner: 10Awight) [15:02:45] (03Merged) 10jenkins-bot: Soften dependency on the BetaFeatures extension [extensions/ORES] - 10https://gerrit.wikimedia.org/r/316701 (owner: 10Awight) [15:04:40] (03CR) 10Thiemo Mättig (WMDE): Soften dependency on the BetaFeatures extension (031 comment) [extensions/ORES] - 10https://gerrit.wikimedia.org/r/316701 (owner: 10Awight) [16:43:22] I have a very large file ~1.3gb consisting of wiki articles whose tfidf I want to know, is there a way in sklearn to do that by not having to load the entire file in memory altogether? [21:15:31] halfak: bonjour [21:15:42] Not sure if you harvest nighttime backscroll? [21:15:49] * halfak is meeting. will be back soon [21:16:22] Also--did you ever identify the source of that high load? The dkinzler bot wasn't the one, I hear? [21:16:55] 10-4! [22:21:41] 06Revision-Scoring-As-A-Service, 10Research Ideas, 10Wikimedia-Developer-Summit (2017): Where to surface AI in Wikimedia Projects - https://phabricator.wikimedia.org/T148690#2730145 (10Halfak) [22:31:04] 10Revision-Scoring-As-A-Service-Backlog, 10ORES, 10revscoring: Build a sketch of basic ORES structure - https://phabricator.wikimedia.org/T148692#2730166 (10Halfak)