[01:34:49] /23/5 [08:43:45] 10Revision-Scoring-As-A-Service-Backlog, 05Wikimania-Hackathon-2016: A training session on supporting ORES in more languages in Wikimania Hackathon - https://phabricator.wikimedia.org/T134628#2382046 (10Ladsgroup) https://wikimania2016.wikimedia.org/wiki/Hackathon/Program#Thursday.2C_23_June 16:00 at Cinque [09:29:34] (03CR) 10Ladsgroup: [C: 031] "Tested it in http://mw-revscoring.wmflabs.org/, works just fine" [extensions/ORES] - 10https://gerrit.wikimedia.org/r/294398 (https://phabricator.wikimedia.org/T137854) (owner: 10Ladsgroup) [10:28:18] (03CR) 10Daniel Kinzler: [C: 031] "Ok to merge, but I'd prefer a different approach, see comment" (031 comment) [extensions/ORES] - 10https://gerrit.wikimedia.org/r/294398 (https://phabricator.wikimedia.org/T137854) (owner: 10Ladsgroup) [12:57:24] (03PS2) 10Ladsgroup: Skip when an edit is errored in PopulateDatabase.php [extensions/ORES] - 10https://gerrit.wikimedia.org/r/294398 (https://phabricator.wikimedia.org/T137854) [13:00:04] 10Revision-Scoring-As-A-Service-Backlog, 10MediaWiki-extensions-ORES: More robust way of handling errors in Cache.php - https://phabricator.wikimedia.org/T137880#2382366 (10Ladsgroup) [13:00:23] (03CR) 10Ladsgroup: [C: 032] "PS2 is just adding docs. I will implement a more robust method: https://phabricator.wikimedia.org/T137880" [extensions/ORES] - 10https://gerrit.wikimedia.org/r/294398 (https://phabricator.wikimedia.org/T137854) (owner: 10Ladsgroup) [13:01:26] (03Merged) 10jenkins-bot: Skip when an edit is errored in PopulateDatabase.php [extensions/ORES] - 10https://gerrit.wikimedia.org/r/294398 (https://phabricator.wikimedia.org/T137854) (owner: 10Ladsgroup) [13:02:30] 10Revision-Scoring-As-A-Service-Backlog, 10MediaWiki-extensions-ORES: More robust way of handling errors in Cache.php - https://phabricator.wikimedia.org/T137880#2382380 (10Ladsgroup) From: I would suggest a different approach: - define a member variable $errorHandler that contains a callback function.... [13:29:41] (03PS1) 10Ladsgroup: Skip when an edit is errored in PopulateDatabase.php [extensions/ORES] (wmf/1.28.0-wmf.5) - 10https://gerrit.wikimedia.org/r/294491 (https://phabricator.wikimedia.org/T137854) [13:30:44] (03CR) 10Ladsgroup: "Backport from 294398" [extensions/ORES] (wmf/1.28.0-wmf.5) - 10https://gerrit.wikimedia.org/r/294491 (https://phabricator.wikimedia.org/T137854) (owner: 10Ladsgroup) [13:57:02] o/ [13:57:15] Working on some laptop issues this morning [13:59:01] halfak|Mobile: o/ [14:04:24] Doing some laptop maintenance today [15:07:43] (03CR) 10Thcipriani: [C: 032] "SWAT" [extensions/ORES] (wmf/1.28.0-wmf.5) - 10https://gerrit.wikimedia.org/r/294491 (https://phabricator.wikimedia.org/T137854) (owner: 10Ladsgroup) [15:08:49] (03Merged) 10jenkins-bot: Skip when an edit is errored in PopulateDatabase.php [extensions/ORES] (wmf/1.28.0-wmf.5) - 10https://gerrit.wikimedia.org/r/294491 (https://phabricator.wikimedia.org/T137854) (owner: 10Ladsgroup) [16:28:23] 06Revision-Scoring-As-A-Service, 10MediaWiki-extensions-ORES: hidenondamaging is slow - https://phabricator.wikimedia.org/T137895#2382984 (10Ladsgroup) [16:29:03] 06Revision-Scoring-As-A-Service, 10MediaWiki-extensions-ORES: hidenondamaging is slow - https://phabricator.wikimedia.org/T137895#2382997 (10Ladsgroup) Schema: https://github.com/wikimedia/mediawiki-extensions-ORES/blob/master/sql/ores_classification.sql Query conditions: https://github.com/wikimedia/mediawiki... [17:13:27] 06Revision-Scoring-As-A-Service, 10MediaWiki-extensions-ORES: hidenondamaging is slow - https://phabricator.wikimedia.org/T137895#2383180 (10jcrespo) This is the query that activating ORES does, taking between 1 minute and 20 seconds to execute, including a **DEPENDENT SUBQUERY** and **reading 5 million rows**... [17:39:34] 06Revision-Scoring-As-A-Service, 10DBA, 10MediaWiki-extensions-ORES: hidenondamaging is slow - https://phabricator.wikimedia.org/T137895#2383255 (10jcrespo) [19:46:04] I'm back! [19:46:10] Finally I have a functional OS! [20:35:17] o/ schana [20:35:20] Still on? [21:48:30] * halfak reinstalls all the BS necessary for wikilabels [21:50:51] well done, halfak [21:51:00] :D [21:51:31] Fun story. Since I switched from 14.04 to 16.04, I'm getting much better performance. [21:51:39] I wonder if I'll also get better battery life too :) [21:51:58] probably not [21:53:09] halfak did I show you https://paws-public.wmflabs.org/paws-public/user/YuviPanda/notebooks/NamespaceEdits.ipynb [21:53:24] * halfak clicks [21:53:55] it's very rough, but the interesting bit is the import [21:54:14] it doesn't work universally yet - I just hacked it up yesterday, but that's the underlying idea for building abstractions in this system [21:54:24] I didn't know you could do comma-separated values that way! [21:54:25] Nice. [21:55:00] halfak which way? the join? [21:55:45] Just the parameterization that the sql() function is handling [21:56:03] ah right [21:56:20] I think that archive_userindex is missing a compound index on ar_user/ar_timestamp that would be killer for this query. [21:56:24] I have an old bug about that. [21:56:31] yeah [21:56:35] it still completes pretty quickly though [21:57:12] https://rt.wikimedia.org/Ticket/Display.html?id=6806 [21:57:16] halfak if you refresh now you should see timing stats [21:57:39] Hmm.. MySQL will cache query results. [21:59:30] halfak yeah, and I haven't edited much :D [21:59:52] halfak my next step is to build simple widgets for picking lists of usernames, lists of wikis, etc [22:00:19] yuvipanda, has the bot-cron functionality been implemented in PAWS yet? [22:00:36] nope [22:00:42] I've had no time at all the last few months [22:00:44] unfortunately [22:03:13] Gotcha. No worries. Was just curious as I'm eyeing up converting HostBot [22:04:47] halfak yeah. I've cleared up next quarter for mostly PAWS stuff [23:14:37] 06Revision-Scoring-As-A-Service, 10Wikilabels: Sometimes, tasks get more labels than they should - https://phabricator.wikimedia.org/T131997#2384205 (10Halfak) I just pushed a change to https://github.com/wiki-ai/wikilabels/pull/127. Please review @Ladsgroup [23:14:56] 06Revision-Scoring-As-A-Service, 10ORES: Move ores_(wsgi|celery).py to ores package - https://phabricator.wikimedia.org/T137820#2384206 (10Halfak) https://github.com/wiki-ai/ores/pull/147 [23:15:26] 06Revision-Scoring-As-A-Service, 10ORES: Move ores_(wsgi|celery).py to ores package - https://phabricator.wikimedia.org/T137820#2384208 (10Halfak) a:03Halfak