[01:28:30] so for funsies i adjusted revscoring tune to parallelize the work with spark, quick/hacky job. tried with enwiki damaging, it runs a bit faster even compared to running it on the mostly-idle 40 core stat1005. Really though the time to run this isn't so bad by itself, perhaps because its just 40k observations. 4m39s vs 3m48s. Amdahl's law is in effect here because the amount of work to [01:28:36] parallelize isn't that high. It takes ~1m30s just to read in observations and spin up spark. [01:29:05] actually not even 40k, its 19k [01:46:52] hacking around a few things brings it to 1m51s, but still. [01:55:17] 10Scoring-platform-team-Backlog: [Investigate] Hadoop integration for ORES training - https://phabricator.wikimedia.org/T170650#3440950 (10EBernhardson) I toyed around a bit with adjusting `revscoring tune` to use spark for the parallelization. Running against the enwiki damaging model i get a runtime without sp... [06:31:55] 10Scoring-platform-team, 10Wikilabels, 10User-Ladsgroup: Apply mediawiki core styling convention on javascript files of wikilabels - https://phabricator.wikimedia.org/T169578#3402366 (10AnotherLadsgroup) https://github.com/wiki-ai/wikilabels/pull/191 [14:44:43] PROBLEM - puppet on ores-worker-08 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues [15:14:39] RECOVERY - puppet on ores-worker-08 is OK: OK: Puppet is currently enabled, last run 42 seconds ago with 0 failures [15:33:15] o/ [15:33:30] I'm working on getting some models together and then I need to edit a paper [15:36:59] OK. Not sure how I crossed wires on this one, but the English Wiktionary edit quality labeling campaign is very much *not* done. [15:37:00] lol [15:37:19] There have been *no* labels saved at all. [15:44:14] 10Scoring-platform-team-Backlog, 10editquality-modeling, 10artificial-intelligence: Train damaging/goodfaith model for English Wiktionary - https://phabricator.wikimedia.org/T170487#3441405 (10Halfak) a:05Halfak>03None [15:44:32] 10Scoring-platform-team-Backlog, 10editquality-modeling, 10artificial-intelligence: Train damaging/goodfaith model for English Wiktionary - https://phabricator.wikimedia.org/T170487#3433018 (10Halfak) [15:44:34] 10Scoring-platform-team, 10ORES, 10editquality-modeling, 10artificial-intelligence: ORES deployment - Mid July, 2017 - https://phabricator.wikimedia.org/T170485#3441407 (10Halfak) [16:15:22] Amir1, ^ [19:43:30] PROBLEM - puppet on ores-web-04 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues [20:13:57] RECOVERY - puppet on ores-web-04 is OK: OK: Puppet is currently enabled, last run 53 seconds ago with 0 failures [20:21:16] hello! [20:22:59] o/ [20:33:05] halfak did you see my ai message from yesterday? [20:33:19] (it may of been thrusday) [20:33:33] ? [20:33:35] Nope [20:33:54] Or rather, I don't think you have given me enough information to know what you are talking about. [20:34:05] halfak https://lists.wikimedia.org/pipermail/ai/2017-July/000189.html [20:34:29] Oh yeah. I saw that. How come you thought it was worth a post on the mailing list? [20:35:25] halfak because its a new standard for code that were implementing instead of having confused developers why not inform them of said change? [20:35:41] OK :) [20:35:54] i knew thats what you would say :P [20:37:09] halfak i know (i may not have the correct dept name) tech is taking over ui of our projects are they taking over ores only or all of them UI wise? [20:38:26] Just the part of the ORES extension that changes the UI of MediaWiki [20:38:29] So no wikilabels [20:38:33] No UI for ORES itself. [20:40:22] quick hurry make everything a child project of the ext :P [20:40:52] lol They aren't even necessarily going to take care of all the ext stuff :\ [20:41:26] any major changes planned for anything? [20:41:46] It's funny how our totally understaffed team gets stuck with maintaining a bunch of UI and the team with three engineers, a designer, a liaison, a QA analyst, and a product manager only manages a narrow slice of functionality. [20:42:25] halfak to be fair we kinda just officially became a team [20:56:20] That is a fair point. [20:56:27] But seems like that should go in the other way. [20:59:41] halfak maybe we could ask services to assist until we get more people to help out? [21:00:22] yeah. I don't think they're equipped very well either. [21:00:25] WRT Ui design [21:00:28] And engineering [21:01:19] Really, I think we'll just wind up continuing to slowly iterate on UI stuff except for when Amir or I get inspired and binge-build some of the UI we've been wanting for a while. [21:01:46] E.g. https://phabricator.wikimedia.org/T102335 [21:02:04] That task is so old that it references trello! [21:02:11] The task manager we used back in 2014 [21:02:28] hey halfak! [21:02:39] o/ Amir1 [21:02:49] Thanks for fixing the eslint problem [21:04:54] No problem :) [21:05:33] halfak: btw. My main account in phab is also blocked now, For now, use "AnotherLadsgroup" [21:08:09] Amir1 why is it blocked? [21:08:26] long story, ask halfak :D [21:08:30] halfak ^ [21:20:36] story delivered [21:22:36] add the price to my tab :P [21:24:37] :D [21:24:56] halfak: thanks halfak [21:33:19] am i needed to merge anything or look at something or anything [21:50:24] Nah, thanks [21:53:26] k [22:02:11] halfak: tell me when you're around please [22:02:16] yes [22:02:25] Amir1, ^ [22:02:36] oh you are, first, please check telegram [22:02:48] secondly, is there anything I can do beside the wikidata thing? [22:03:37] right now, I'm running the next round of eslint [22:05:20] Amir1, can you review the discussions about the future of the ORES Review Tool [22:05:27] Roan and Adam came up with some serious proposals. [22:06:01] halfak: hmm, okay, I don't think it will take lot of time, so other things too? [22:06:51] Wikidata badwords? [22:07:07] If not that then maybe looking at the flagged revs for fiwiki model [22:07:29] Adam is kind of stuck on what to do. Maybe you have some insights into how MediaWiki flagged revs works and can help? [22:08:50] I didn't know that [22:08:51] okay [22:16:02] * halfak finishes his cleanup of the Keilana Effect paper [22:16:14] At some point I'm going to have to re-cleanup the wiki page. [22:26:12] Arg. Looks like I'm still waiting on copyright info. Otherwise, this is ready to go :) [22:26:15] https://github.com/halfak/keilana-effect/blob/master/halfaker2017keilana.with_fonts.pdf [22:35:51] halfak: is wikilabels/wsgi/static/js/oo.util.js written and maintained by us? [22:39:59] Amir1, yeah. Eventually it was going to become part of oojs but then someone left the team (forget the name) and work stopped on those things. [22:40:08] So it's basically a collection of hacks due to missing functionality. :) [22:40:33] okay, I see :D [22:46:02] OK I'm outta here. [22:46:03] o/ [22:46:06] Have a good one. [22:49:23] halfak: have fun [23:09:38] 10Scoring-platform-team, 10Wikilabels: Wikilabels uses deprecated api calls - https://phabricator.wikimedia.org/T170758#3441712 (10AnotherLadsgroup)