[02:19:14] 10Scoring-platform-team (Current), 10JADE: Write user-facing documentation for JADE - https://phabricator.wikimedia.org/T199069 (10Harej) [04:27:22] 10Scoring-platform-team (Current), 10drafttopic-modeling: Rebuild drafttopic with corrected data - https://phabricator.wikimedia.org/T193834 (10Sumit) ROC_AUC: roc_auc (micro=0.943, macro=0.948):... [09:34:17] 10Scoring-platform-team (Current), 10articlequality-modeling, 10User-Ladsgroup, 10artificial-intelligence: Article quality campaign for Persian Wikipedia - https://phabricator.wikimedia.org/T174684 (10Ladsgroup) My friend took it over and finished it \o/ [09:34:43] 10Scoring-platform-team (Current), 10articlequality-modeling, 10User-Ladsgroup, 10artificial-intelligence: Train and test wp10 model for fawiki - https://phabricator.wikimedia.org/T190050 (10Ladsgroup) [09:44:58] 10Scoring-platform-team, 10Release-Engineering-Team (Watching / External): Another round of discussion about wiki-ai's GitHub->gerrit mirroring - https://phabricator.wikimedia.org/T194212 (10Ladsgroup) I'm all for it. [10:20:42] 10Scoring-platform-team, 10Global-Collaboration, 10JADE, 10MediaWiki-extensions-ORES, 10Design: Integrate JADE with ORES extension - https://phabricator.wikimedia.org/T198542 (10Ladsgroup) I think there should be some integration but I disagree about this approach for several reasons: 1- human judgments... [11:45:46] 10Scoring-platform-team, 10Growth-Team (Current Sprint), 10Patch-For-Review: Enable srwiki edit quality filters in RecentChanges - https://phabricator.wikimedia.org/T197012 (10Acamicamacaraca) @Catrope What are you thinking about restarting edits review. Maybe we can get better-quality filters in second try? [11:46:12] 10Scoring-platform-team, 10Growth-Team (Current Sprint), 10Patch-For-Review: Enable srwiki edit quality filters in RecentChanges - https://phabricator.wikimedia.org/T197012 (10Acamicamacaraca) Is that possible? [13:38:14] o/ [13:42:28] 10Scoring-platform-team (Current), 10articlequality-modeling, 10User-Ladsgroup, 10artificial-intelligence: Train and test wp10 model for fawiki - https://phabricator.wikimedia.org/T190050 (10Ladsgroup) I added the new campaign to the PR: https://github.com/wiki-ai/articlequality/pull/63/commits/32337bd97ff... [13:49:09] o/ Amir1 [13:49:24] halfak: hey [13:49:24] are you around today? Or maybe just picking up some loose ends? [13:49:41] I'm on vacation but doing minor things here and there [13:50:46] OK :) Should I cancel our 1:1 today? [13:50:59] Amir1, ^ [13:51:12] yeah that would be great [13:51:19] I'm in Poland actually [13:54:28] kk :) [13:58:42] 10Scoring-platform-team (Current), 10ORES, 10Wikidata, 10User-Ladsgroup: new ORES labeling campaign for Wikidata - https://phabricator.wikimedia.org/T195701 (10Halfak) Merged. Ready for loading into Wiki labels. [16:02:37] halfak: I won't be able to make the sync meeting today, sorry! [16:02:49] No worries! Enjoy the hour! [16:25:51] 10Scoring-platform-team, 10JADE: JADE: UI/API for reviewing/refuting how ORES classifies you and your stuff - https://phabricator.wikimedia.org/T148700 (10Harej) [16:25:53] 10Scoring-platform-team, 10JADE: JADE: MVP UI affordances - https://phabricator.wikimedia.org/T153148 (10Harej) 05Open>03Resolved [16:57:42] 10Scoring-platform-team, 10Wikilabels, 10artificial-intelligence: Implement a modeling self-check process - https://phabricator.wikimedia.org/T198144 (10notconfusing) ### From meeting notes: + My goal is to work on _enwiki_ first so that I can review the underlying data. + In addition I would like to extend... [17:00:04] o/ hoo [17:00:07] hey :) [17:00:42] So! Have you ever developed anything with revscoring before? [17:00:49] Should we set up your env first? [17:00:49] Nothing at all [17:00:52] yeah [17:01:01] do you have a checklist for that? [17:01:06] The readme is your best reference: https://github.com/wiki-ai/revscoring [17:01:15] Note the installation section. [17:01:19] Revscoring is python 3 only. [17:01:37] There are a set of packages to install via apt (assuming you're debian-ish) [17:01:57] fedora, but I think I should already have these [17:02:44] Gotcha. You'll need a ton of dictionaries to get all tests passing. [17:02:52] We use pytests. Have you used that before? [17:03:07] Ages ago [17:03:32] halfak: I think this was implied a lot but never outright said... How often do we expect manual creation/edits of judgment pages? What would be a valid use case for doing so? [17:04:19] pytest is newish [17:04:30] It's the new hot. :) we converted from nose. [17:04:55] Doh… yeah, I used nose before [17:05:06] way to long ago apparently [17:05:14] hoo, pytest is very similar with a little less boilerplate than nose. [17:05:26] Nose had way less boilerplate than the old standard python framework [17:05:43] keep it simple :) [17:05:46] harej, manual would be rare. mostly in the case of vandalism or when there's a debate about a judgement. [17:05:54] 10Scoring-platform-team, 10JADE: Create overlay UI for editing Judgement pages - https://phabricator.wikimedia.org/T199128 (10Harej) [17:05:56] 10Scoring-platform-team, 10JADE: Create overlay UI for editing Judgement pages - https://phabricator.wikimedia.org/T199128 (10Harej) p:05Triage>03Low [17:06:02] I would like people to see and challenge judgments while doing their patrolling. [17:06:33] 10Scoring-platform-team, 10JADE: Create overlay UI for editing Judgement pages - https://phabricator.wikimedia.org/T199128 (10Harej) [17:06:33] harej, It might be that a vandal submits a lot of bogus judgments and a patroller would revert them en mass from their contribs page [17:06:35] 10Scoring-platform-team, 10JADE: JADE: MVP UI affordances - https://phabricator.wikimedia.org/T153148 (10Harej) [17:06:37] 10Scoring-platform-team, 10JADE, 10Design: Discuss and create a UI mockup for the JADE editor interface - https://phabricator.wikimedia.org/T168993 (10Harej) [17:09:40] hoo, I'd like to grab some lunch. If you get stuck on setting up revscoring, I bet notconfusing can help (that's Max) [17:09:54] Let's see [17:10:00] Hmm... but he's not here. [17:10:26] it's already past 7pm here, so I probably wont do much on this today anymore [17:14:04] OK no worries. Have a good evening, hoo :) [17:14:12] * halfak --> lunch [17:14:20] See you :) [17:33:28] Amir1: it looks like the ORES support report is down: https://tools.wmflabs.org/ores-support-checklist/ [18:04:46] halfak|Lunch: meeting? [18:11:53] I need a bit of point in the right direction. Last week I followed the editquality ipython tutorial which made a dataset by pulling it live over the API (or skipping to premade sets included in the gitrepo). Now I'm trying to investigate "bad labels" in the English wiki dataset. Where should I find it, or what should I run to start creating it? [18:12:15] whoops, paprika, is me, notconfusing aka. Max Klein [18:23:27] I can start with the the data in editquality/datasets/demo for now [18:47:58] I'd love to know how JADE works. I'm playing around on Beta Wikipedia and don't see any intuitive way to render judgments or anything like that. [19:03:40] (03PS1) 10Catrope: Hooks\Helpers: Fix check for whether a model is enabled [extensions/ORES] - 10https://gerrit.wikimedia.org/r/444653 [19:04:01] Oops --^^ (cc Amir1) [19:04:22] (03PS1) 10Catrope: Hooks\Helpers: Fix check for whether a model is enabled [extensions/ORES] (wmf/1.32.0-wmf.10) - 10https://gerrit.wikimedia.org/r/444654 [19:04:33] (03CR) 10Catrope: [C: 032] Hooks\Helpers: Fix check for whether a model is enabled [extensions/ORES] (wmf/1.32.0-wmf.10) - 10https://gerrit.wikimedia.org/r/444654 (owner: 10Catrope) [19:05:13] Cherry-picking that to production now so that the config disabling goodfaith on arwiki and now also on srwiki actually works [19:06:31] (03CR) 10jerkins-bot: [V: 04-1] Hooks\Helpers: Fix check for whether a model is enabled [extensions/ORES] (wmf/1.32.0-wmf.10) - 10https://gerrit.wikimedia.org/r/444654 (owner: 10Catrope) [19:07:24] (03CR) 10jerkins-bot: [V: 04-1] Hooks\Helpers: Fix check for whether a model is enabled [extensions/ORES] (wmf/1.32.0-wmf.10) - 10https://gerrit.wikimedia.org/r/444654 (owner: 10Catrope) [19:07:35] (03CR) 10jerkins-bot: [V: 04-1] Hooks\Helpers: Fix check for whether a model is enabled [extensions/ORES] - 10https://gerrit.wikimedia.org/r/444653 (owner: 10Catrope) [19:11:50] (03PS2) 10Catrope: Hooks\Helpers: Fix check for whether a model is enabled [extensions/ORES] - 10https://gerrit.wikimedia.org/r/444653 [19:15:34] (03CR) 10jerkins-bot: [V: 04-1] Hooks\Helpers: Fix check for whether a model is enabled [extensions/ORES] - 10https://gerrit.wikimedia.org/r/444653 (owner: 10Catrope) [19:15:51] (03CR) 10jerkins-bot: [V: 04-1] Hooks\Helpers: Fix check for whether a model is enabled [extensions/ORES] - 10https://gerrit.wikimedia.org/r/444653 (owner: 10Catrope) [19:20:38] (03CR) 10Sbisson: "tests/selenium/LocalSettings.php also need to be updated" [extensions/ORES] - 10https://gerrit.wikimedia.org/r/444653 (owner: 10Catrope) [20:35:00] (03CR) 10jenkins-bot: Localisation updates from https://translatewiki.net. [extensions/JADE] - 10https://gerrit.wikimedia.org/r/444702 (owner: 10L10n-bot) [20:46:32] harej: yes, the growth team is working on integrating ORES with the New Pages Feed https://phabricator.wikimedia.org/T196178 [20:53:01] kostajh: excellent! i'm the new product manager on the team that made ORES [20:56:42] harej: cool! Are you in the office by chance? I'm here visiting for the week [20:56:59] kostajh: alas, i'm currently on my way to cape town [20:57:30] ah, well I'll look for you next time. safe travels! [20:58:55] (03PS3) 10Catrope: Hooks\Helpers: Fix check for whether a model is enabled [extensions/ORES] - 10https://gerrit.wikimedia.org/r/444653 [21:01:16] harej, I can talk to you more about JADE [21:01:27] (03CR) 10Jforrester: [C: 031] "Looks sane." [extensions/ORES] - 10https://gerrit.wikimedia.org/r/444653 (owner: 10Catrope) [21:03:37] Sure [21:05:32] (03PS2) 10Catrope: Hooks\Helpers: Fix check for whether a model is enabled [extensions/ORES] (wmf/1.32.0-wmf.10) - 10https://gerrit.wikimedia.org/r/444654 [21:05:53] Re. a visual means for editing judgements, I think that Prateek's mockup is helpful. [21:05:54] * halfak gets [21:06:56] https://en.wikipedia.org/wiki/User:EpochFail/common.js [21:07:01] ^ last line [21:07:05] harej, [21:12:08] halfak: I'm assuming that script doesn't do anything. But how do you actually create judgement pages? Is there a way to do so through MediaWiki's user interface, or is it only exposed as API methods? [21:12:30] Same as creating a normal page. [21:12:55] See https://meta.wikimedia.org/wiki/Schema:Edit for an example of a JSON page [21:14:29] harej, we might want something like https://www.wikidata.org/wiki/Special:NewItem [21:14:36] *blinks* now I can [21:14:40] I guess it was shut off for logged-out users? [21:19:53] I'm confused. [21:20:04] The script should only work if you have installed it as a user-script for your account. [21:22:08] No, in terms of creating new items in the Jade namespace [21:22:19] I was not able to before, but now I am, I guess after logging in. [21:23:06] I see. Must have been turned off. [21:42:33] And I see that the rules on page naming are not enforced at a software level. But I presume, like MediaWiki, the software isn't going to prevent you from filling the system up with garbage. [21:42:54] What are your thoughts on allowing parameters other than those defined in the schema? [21:54:44] (03CR) 10Jforrester: [C: 032] Hooks\Helpers: Fix check for whether a model is enabled [extensions/ORES] - 10https://gerrit.wikimedia.org/r/444653 (owner: 10Catrope) [21:56:06] harej, we have schema validation that prevents nonsense in the JSON (or invalid JSON) [21:56:40] Presumably, we can also enforce title constraints. E.g. no making the page called "Judgement:Foobar" [21:59:27] That sounds like a good idea. [21:59:43] The more vandalism vectors we can take away, the better. [22:07:11] (03Merged) 10jenkins-bot: Hooks\Helpers: Fix check for whether a model is enabled [extensions/ORES] - 10https://gerrit.wikimedia.org/r/444653 (owner: 10Catrope) [22:08:08] (03PS3) 10Jforrester: Hooks\Helpers: Fix check for whether a model is enabled [extensions/ORES] (wmf/1.32.0-wmf.10) - 10https://gerrit.wikimedia.org/r/444654 (owner: 10Catrope) [22:08:24] (03CR) 10jenkins-bot: Hooks\Helpers: Fix check for whether a model is enabled [extensions/ORES] - 10https://gerrit.wikimedia.org/r/444653 (owner: 10Catrope) [23:00:39] (03CR) 10Jforrester: [C: 032] Hooks\Helpers: Fix check for whether a model is enabled [extensions/ORES] (wmf/1.32.0-wmf.10) - 10https://gerrit.wikimedia.org/r/444654 (owner: 10Catrope) [23:02:25] (03Merged) 10jenkins-bot: Hooks\Helpers: Fix check for whether a model is enabled [extensions/ORES] (wmf/1.32.0-wmf.10) - 10https://gerrit.wikimedia.org/r/444654 (owner: 10Catrope) [23:04:08] (03CR) 10jenkins-bot: Hooks\Helpers: Fix check for whether a model is enabled [extensions/ORES] (wmf/1.32.0-wmf.10) - 10https://gerrit.wikimedia.org/r/444654 (owner: 10Catrope)