[00:30:22] <wikibugs>	 10Jade, 10Scoring-platform-team (Current), 10Patch-For-Review: Address Jade UI issues. - https://phabricator.wikimedia.org/T245311 (10ACraze) @Halfak re: UI3 (`"‎jade-deleteproposal|0"`),  0 is supposed to be the number of endorsements, but seems to be broken at the moment and stuck at 0. Do we want to keep...
[14:00:36] <halfak>	 o/
[14:00:48] <apergos>	 __ο__
[14:04:47] <halfak>	 Just got back from a vacation.  Catching up on email. 
[14:46:06] <wikibugs>	 10ORES, 10Scoring-platform-team: Implement sentinel for ORES production Redis - https://phabricator.wikimedia.org/T122676 (10Halfak)
[14:46:07] <wikibugs>	 10ORES, 10Scoring-platform-team, 10Operations, 10vm-requests: New node request: oresrdb[12]003 - https://phabricator.wikimedia.org/T210582 (10Halfak) 05Declined→03Stalled Sounds reasonable.  Thanks for circling back @akosiaris
[14:46:07] <AsimovBot>	 El búfer 12 está vacío.
[17:28:52] <wikibugs>	 10ORES, 10Scoring-platform-team (Current), 10Operations: ORES uwsgi consumes a large amount of memory and CPU when shutting down (as part of a restart) - https://phabricator.wikimedia.org/T242705 (10Halfak) @akosiaris, any updates on testing with gunicorn?
[17:29:26] <wikibugs>	 10Jade, 10Growth-Team, 10MassMessage, 10MediaWiki-General, and 9 others: Hard deprecate Title::userCan - https://phabricator.wikimedia.org/T244923 (10DannyS712)
[17:54:59] <wikibugs>	 10Scoring-platform-team (Current), 10Discovery-Search (Current work), 10Growth-Team (Current Sprint): Newcomer tasks: set initial thresholds for ORES articletopic - https://phabricator.wikimedia.org/T244297 (10EBernhardson) The per-topic thresholding is now deployed. I ran only the thresholding and extractio...
[18:11:38] <wikibugs>	 10Scoring-platform-team (Current), 10Discovery-Search (Current work), 10Growth-Team (Current Sprint): Newcomer tasks: set initial thresholds for ORES articletopic - https://phabricator.wikimedia.org/T244297 (10Tgr) Enwiki has 750K content edits per week, so given not all of those are to different articles, i...
[18:19:00] <wikibugs>	 10Jade, 10Scoring-platform-team (Current), 10MW-1.35-notes (1.35.0-wmf.21; 2020-02-25): Address Jade UI issues. - https://phabricator.wikimedia.org/T245311 (10ACraze)
[18:42:48] <halfak>	 grabbing lunch. 
[19:43:39] <halfak>	 back!
[19:56:59] <haksoat64>	 Okay. I'm back in.
[19:57:10] <haksoat64>	 I was banned. Don't know what I did wrong.
[19:58:05] <haksoat64>	 Hello halfak I saw Wikimedia was accepted as an organization for this year's GSoC. Any idea if there'll be ORES project ideas listed? I'll be interested in them.
[19:59:12] <halfak>	 Yeah!  We are developing some.  E.g. isaacj is developing a proposal for implementing his wikidata-based topic modeling work in ORES.  
[20:02:29] <wikibugs>	 10ORES, 10Scoring-platform-team: ORES precache endpoint Swagger docs are incorrect - https://phabricator.wikimedia.org/T245774 (10Tgr)
[20:04:11] <tgr>	 halfak: I'd like to get started with T243357 in the hope of getting through all articles by Sunday (when the ES update runs) so we'd have ORES search testable by end of next week
[20:04:12] <stashbot>	 T243357: Once the ORES drafttopic - ElasticSearch pipeline is set up, update data about all articles - https://phabricator.wikimedia.org/T243357
[20:04:21] <tgr>	 first, do you have any concerns about that?
[20:04:38] <tgr>	 second, can you recommed a safe request rate?
[20:04:55] <isaacj>	 yeah, working on getting that project uploaded to phabricator so it should appear in the official list soon. it'll be under the Outreachy program
[20:05:51] <tgr>	 third, is the precache API syntax documented somewhere? the Swagger docs seem outdated
[20:09:42] <haksoat64>	 Okay great news then! I'll be looking forward to seeing them halfak
[20:11:56] <tgr>	 re: safe request rate, this would be from a bot (probably just pwb unless there is some dedicated tool for ORES) running on terbium or maybe wmcloud and hitting the precache endpoint
[20:30:32] <halfak>	 Hey!  Sorry was in a meeting.  Got like 5 pings as soon as it started. 
[20:31:42] <halfak>	 tgr, we have an ORES library for supporting high speed requests.  Regretfully, it's a bit under-documented, but I can give you some pointers. 
[20:32:03] <halfak>	 https://github.com/halfak/oresapi
[20:32:10] <halfak>	 You can install this through pypi. 
[20:32:29] <halfak>	 The defaults for this system should allow you to max your requests to ORES without knocking us over. 
[20:32:45] <halfak>	 It handles batches and parallelization for you. 
[20:33:46] <tgr>	 halfak: yeah, you've shown that to me when I was doing ORES analytics for huwiki
[20:33:55] <tgr>	 it doesn't seem to handle precache requests though
[20:34:01] <halfak>	 awesome.  So it should be somewhat familiar.  
[20:34:39] <halfak>	 Yes.  It doesn't handle precache.  I'm not sure precache is a good strategy for this though unless it's important that you mimic changeprop. 
[20:34:57] <halfak>	 But I can certainly get the docs for precache updated. 
[20:35:24] <tgr>	 well, I want to trigger changeprop's ORES -> HDFS pipeline
[20:35:59] <halfak>	 Aha!  Right now, it's more like ChangeProp --> ORES --> ChangeProp --> HDFS
[20:36:06] <halfak>	 ORES doesn't write to HDFS or eventgate directly. 
[20:36:59] <halfak>	 We don't have the same batching facilities for ChangeProp as we do for the public API
[20:37:09] <tgr>	 hm, right, changeprop doesn't actually listen to ORES, it just calls it and takes the results
[20:37:38] <tgr>	 I guess I'll have to trigger article updates then
[20:40:29] <halfak>	 Changeprop requires us to process one request at a time which is our least efficient strategy.  It's about 5 times slower than the batch strategy that oresapi allows. 
[20:40:47] <halfak>	 I wonder if it would be possible to use the batch strategy and load HDFS manually.
[20:41:27] <tgr>	 this is a one time thing so I don't think efficiency matters much
[20:41:49] <tgr>	 OTOH changeprop is only triggered on revision creation, not null edits or such
[20:44:07] <tgr>	 ...yeah, loading manually might be the least painful way to do it. I'll think on it a bit more.
[20:45:14] <halfak>	 OK.  I'm still happy to get this documentation updated.  Thanks for the pointer. 
[21:26:42] <accraze>	 afk for a bit, gonna walk into town and grab lunch + run a few errands
[21:40:20] <wikibugs>	 10Jade, 10Scoring-platform-team (Current), 10MW-1.35-notes (1.35.0-wmf.21; 2020-02-25), 10Patch-For-Review: Address Jade UI issues. - https://phabricator.wikimedia.org/T245311 (10Halfak) >>! In T245311#5899635, @ACraze wrote: > @Halfak re: UI3 (`"‎jade-deleteproposal|0"`),  0 is supposed to be the number o...
[22:58:11] <wikibugs>	 10Scoring-platform-team (Current), 10Discovery-Search (Current work), 10Growth-Team (Current Sprint): Newcomer tasks: ORES ontology mapping and score thresholds - https://phabricator.wikimedia.org/T244192 (10Tgr) @Halfak what do you think about applying P10407 within ORES and already outputting predictions i...