[09:03:17] (03CR) 10Hoo man: Better performance in changeslist query by using rc_timestamp index (031 comment) [extensions/ORES] - 10https://gerrit.wikimedia.org/r/295528 (owner: 10Ladsgroup) [11:56:15] 06Revision-Scoring-As-A-Service, 10MediaWiki-extensions-ORES, 05Wikimania-Hackathon-2016: Make hidenondamaging=1 faster - https://phabricator.wikimedia.org/T138444#2404435 (10jcrespo) After checking the performance of both options, I can conclude that the second option, using the revision table is a bad idea... [11:57:44] 06Revision-Scoring-As-A-Service, 10MediaWiki-extensions-ORES, 05Wikimania-Hackathon-2016: Make hidenondamaging=1 faster - https://phabricator.wikimedia.org/T138444#2404439 (10jcrespo) In general, please avoid touching the revision table except for individual (point SELECTs) queries. [13:26:26] (03CR) 10Jcrespo: [C: 04-1] "As per https://phabricator.wikimedia.org/T138444#2404435" [extensions/ORES] - 10https://gerrit.wikimedia.org/r/295528 (owner: 10Ladsgroup) [13:34:18] 06Revision-Scoring-As-A-Service, 10MediaWiki-extensions-ORES, 05Wikimania-Hackathon-2016: Make hidenondamaging=1 faster - https://phabricator.wikimedia.org/T138444#2400491 (10daniel) @jcrespo it seems to me that The Roight Thing (tm) would be to add an index to rc_this_oldid. Looking up RC entries by their r... [13:36:29] 06Revision-Scoring-As-A-Service, 10MediaWiki-extensions-ORES, 05Wikimania-Hackathon-2016: Make hidenondamaging=1 faster - https://phabricator.wikimedia.org/T138444#2404710 (10jcrespo) `rc_this_oldid` which table? [13:54:38] 06Revision-Scoring-As-A-Service, 10Wikilabels: Edit quality campaign for Hungarian Wikipedia - https://phabricator.wikimedia.org/T131446#2404744 (10Tgr) I think there was an error in populating the wikilabels data. See T138576. [13:54:49] 06Revision-Scoring-As-A-Service, 10Wikilabels: Edit quality campaign for Hungarian Wikipedia - https://phabricator.wikimedia.org/T131446#2404746 (10Tgr) 05Resolved>03Open [14:06:50] 06Revision-Scoring-As-A-Service, 10MediaWiki-extensions-ORES, 05Wikimania-Hackathon-2016: Make hidenondamaging=1 faster - https://phabricator.wikimedia.org/T138444#2400491 (10hoo) >>! In T138444#2404710, @jcrespo wrote: > `rc_this_oldid` which table? recentchanges [14:34:22] 06Revision-Scoring-As-A-Service, 10MediaWiki-extensions-ORES, 05Wikimania-Hackathon-2016: Make hidenondamaging=1 faster - https://phabricator.wikimedia.org/T138444#2404904 (10jcrespo) The table needs some clean up, this is enwiki master: ``` PRIMARY KEY (`rc_id`), KEY `rc_timestamp` (`rc_timestamp`), K... [14:42:13] 06Revision-Scoring-As-A-Service, 10ORES: Planning long-term ORES architecture - https://phabricator.wikimedia.org/T137125#2404937 (10schana) [17:10:48] Amir1, if you have a few minutes, see https://github.com/wiki-ai/ores-wmflabs-deploy/pull/64 [17:12:03] halfak: nice, I will check it in five min. Would it work for you? [17:12:11] totally :) [17:12:52] Oops. I have an issue in there :@ [17:21:26] * halfak fixes his git to behave better [17:25:36] 06Revision-Scoring-As-A-Service, 10Wikilabels, 05Wikimania-Hackathon-2016: Cannot read property 'badrevids' of undefined - https://phabricator.wikimedia.org/T138576#2405523 (10Ladsgroup) [17:27:06] 06Revision-Scoring-As-A-Service, 10Wikilabels, 05Wikimania-Hackathon-2016: Cannot read property 'badrevids' of undefined - https://phabricator.wikimedia.org/T138576#2404252 (10Ladsgroup) There was an error while importing data for huwiki. It's fixed now. [17:29:51] \o/ [17:30:31] (03Abandoned) 10Ladsgroup: Better performance in changeslist query by using rc_timestamp index [extensions/ORES] - 10https://gerrit.wikimedia.org/r/295528 (owner: 10Ladsgroup) [17:30:51] Amir1, one thing I've noticed switching from python 3.4 to python 3.5 is that I don't need to compile scipy anymore. [17:31:00] Not sure what's going on there, but it is magical [17:32:25] :D [17:32:32] I haven't tried python 3.5 [17:37:47] 06Revision-Scoring-As-A-Service, 10Wikilabels, 05Wikimania-Hackathon-2016: Cannot read property 'badrevids' of undefined - https://phabricator.wikimedia.org/T138576#2405566 (10Ladsgroup) a:03Ladsgroup [17:37:56] 06Revision-Scoring-As-A-Service, 10Wikilabels, 05Wikimania-Hackathon-2016: Cannot read property 'badrevids' of undefined - https://phabricator.wikimedia.org/T138576#2404252 (10Ladsgroup) Works now. [17:39:01] \o/ [17:39:23] Amir1, should I expect our fabric to work on the main wmflabs deploy? [17:39:57] halfak: it should, didn't try it for a very long time [17:40:33] OK. We'll find out! [19:26:54] 06Revision-Scoring-As-A-Service, 10ORES: New ORES deployment - https://phabricator.wikimedia.org/T137828#2405668 (10Halfak) This deployment went to wmflabs today. [19:27:01] 06Revision-Scoring-As-A-Service, 10ORES: New ORES deployment - https://phabricator.wikimedia.org/T137828#2405669 (10Halfak) a:03Halfak [19:28:41] 06Revision-Scoring-As-A-Service, 10rsaas-articlequality : Article quality models for Russian Wikipedia - https://phabricator.wikimedia.org/T131635#2405671 (10Halfak) @putnik, this is now deployed. Check it out: https://ores.wmflabs.org/v2/scores/ruwiki/wp10/79170638/ [19:29:49] 10Revision-Scoring-As-A-Service-Backlog, 10ORES: Announce deployment of wp10 models to ruwiki community - https://phabricator.wikimedia.org/T138623#2405672 (10Halfak) [19:30:11] 10Revision-Scoring-As-A-Service-Backlog: Announce deployment of reverted models to svwiki community - https://phabricator.wikimedia.org/T138624#2405685 (10Halfak) [19:30:22] 10Revision-Scoring-As-A-Service-Backlog: Announce deployment of reverted model to nowiki - https://phabricator.wikimedia.org/T138625#2405698 (10Halfak) [19:30:32] 10Revision-Scoring-As-A-Service-Backlog: Announce deployment of reverted model to svwiki community - https://phabricator.wikimedia.org/T138624#2405711 (10Halfak) [19:30:38] 10Revision-Scoring-As-A-Service-Backlog, 10ORES: Announce deployment of reverted model to svwiki community - https://phabricator.wikimedia.org/T138624#2405685 (10Halfak) [19:31:14] 10Revision-Scoring-As-A-Service-Backlog, 10ORES: Announce deployment of reverted model to svwiki community - https://phabricator.wikimedia.org/T138624#2405685 (10Halfak) [19:31:28] 10Revision-Scoring-As-A-Service-Backlog: Announce deployment of reverted model to nowiki - https://phabricator.wikimedia.org/T138625#2405714 (10Halfak) [19:59:12] 06Revision-Scoring-As-A-Service, 10EventBus, 06Services, 15User-mobrovac, 05Wikimania-Hackathon-2016: [Discuss] Switch from precached utility to Change Propagation - https://phabricator.wikimedia.org/T138090#2405729 (10Halfak) Looks like Change Propagation is live right now. [19:59:37] 06Revision-Scoring-As-A-Service, 10bwds, 10revscoring, 05Wikimania-Hackathon-2016: Language assets for Czech - https://phabricator.wikimedia.org/T131637#2405731 (10Ladsgroup) a:03Ladsgroup [20:00:04] 06Revision-Scoring-As-A-Service, 10ORES: Deploy ores precaching in production - https://phabricator.wikimedia.org/T137370#2405734 (10Halfak) And it looks like Change Propagation is running in production. Marking this invalid. [20:00:16] 06Revision-Scoring-As-A-Service, 10ORES: Deploy ores precaching in production - https://phabricator.wikimedia.org/T137370#2405737 (10Halfak) 05Open>03declined [20:00:18] 06Revision-Scoring-As-A-Service, 10MediaWiki-extensions-ORES, 10ORES: [Epic] Complete outstanding tasks for ORES extension deployments - https://phabricator.wikimedia.org/T138251#2405738 (10Halfak) [20:06:26] 06Revision-Scoring-As-A-Service, 10Wikilabels: Load full campaign for WikiEd article topic - https://phabricator.wikimedia.org/T138626#2405739 (10Halfak) [20:10:28] halfak: o/ [20:10:40] Sitting with James Heilman, doing some WP MED stuff [20:10:41] :) [20:11:17] "Hi" to DocJames! [20:11:42] he says "Hi back" [20:47:27] halfak: https://github.com/wiki-ai/revscoring/pull/280 [20:47:40] 06Revision-Scoring-As-A-Service, 10bwds, 10revscoring, 05Wikimania-Hackathon-2016: Language assets for Czech - https://phabricator.wikimedia.org/T131637#2405778 (10Ladsgroup) https://github.com/wiki-ai/revscoring/pull/280 [20:50:40] wiki-ai/revscoring#741 (cswiki - 9f6b885 : Amir Sarabadani): The build failed. https://travis-ci.org/wiki-ai/revscoring/builds/140118546 [20:50:54] halfak: https://www.youtube.com/watch?v=dPs1evXFZa0 [20:58:43] * halfak clicks the PR and then starts up the youtube [20:59:03] Nooo WHere are the slides [20:59:05] Noo [21:07:06] Luckily I have the slide deck :) [21:14:45] halfak: I uploaded the slides in the commons [21:14:46] wiki-ai/revscoring#743 (cswiki - db8a704 : Amir Sarabadani): The build was fixed. https://travis-ci.org/wiki-ai/revscoring/builds/140123835 [21:15:06] halfak: https://commons.wikimedia.org/wiki/File:Lessons_learned_building_machine_learning_models_for_Wikidata.pdf [21:15:44] Well... glad to have the talk. I'm sad that the camera angle was so bad. [21:15:53] It seems that it went over pretty well :) [21:16:13] 06Revision-Scoring-As-A-Service, 10MediaWiki-extensions-ORES, 10ORES, 05Wikimania-Hackathon-2016: Present Wikidata AI work at Wikimania - https://phabricator.wikimedia.org/T138351#2405826 (10Halfak) See https://www.youtube.com/watch?v=dPs1evXFZa0 and https://commons.wikimedia.org/wiki/File:Lessons_learned_... [21:16:25] I don't call it a failure, definitely I need some feedback from you to improve [21:17:34] Next time, we're going to work on your flow and that will help your confidence. [21:17:39] :) [21:17:55] But the most important thing is getting the message across and being welcoming -- and you did those well. [21:20:08] thanks :) let's talk about it when I'm more soer [21:20:10] *sober [21:22:36] Horray for partying Amir1 :D [21:22:39] Have fun! [21:23:37] I actually went there to find some CLs to change a page in fawiki to Flow page, but they gave me free bourbon instead :D [21:24:12] btw. Someone here wants ORES for enwikitionary, I think we can do that :D [21:24:29] Amir1, indeed. It should be pretty straightforward. [21:24:37] * halfak files a task. [21:24:41] What's their username? [21:25:17] 10Revision-Scoring-As-A-Service-Backlog, 10revscoring, 10rsaas-editquality: Train/test reverted model for enwiktionary - https://phabricator.wikimedia.org/T138630#2405839 (10Halfak) [21:25:57] let me ask [21:26:03] he's sitting next to me [21:26:40] jberkel [21:27:16] halfak: https://phabricator.wikimedia.org/p/jberkel/ [21:27:58] 10Revision-Scoring-As-A-Service-Backlog, 10revscoring, 10rsaas-editquality: Train/test reverted model for enwiktionary - https://phabricator.wikimedia.org/T138630#2405853 (10Halfak) [21:28:08] Got it. Thansk :) [21:32:43] halfak: first, have I talked to you about beta cluster? more precisely https://phabricator.wikimedia.org/T138445 [21:34:38] Amir1, will need to check out in ~ 10 mins [21:34:41] But having a quick look [21:35:04] okay, nice [21:35:26] i brought back the beta cluster but with ores in prod roles in puppet [21:36:34] everything now looks like the ores in prod [21:36:45] I might set up a grafana dashboard for it [21:36:54] but it seems pretty useless [21:39:38] Yeah. Probably don't need grafana