[14:11:05] o/ [14:14:17] o/ halfak [14:14:25] Hey Amir1 [14:14:42] Didn't get back to my deak yesterday, so I'm picking up the anon bias report this morning. [14:14:47] Anything you are blocked on right now? [14:14:56] Hey, There is some stuff you need to check [14:15:04] first is https://git.io/vVHUR [14:15:12] second is https://git.io/vVQiB [14:15:24] I wanted to merge the second one but I thought you know better [14:16:18] and lastly this: https://github.com/wiki-ai/editquality/pull/24 [14:16:32] you need to check the tuning report [14:16:52] https://github.com/wiki-ai/revscoring/tree/master/revscoring/scorer_models [14:17:05] Woah. Those scores are bad. [14:17:19] https://github.com/wiki-ai/editquality/pull/24/files#diff-a7b2f7f1768b4cf555de61021ad17a91R13 [14:17:42] because we don't have dictionary for ja [14:17:47] that's my guess [14:18:09] Hmm... I don't think that'd account for so much. [14:18:33] Could be that the reverted detection is overly broad/narrow [14:20:04] hmm [14:20:10] I can wait until you check it [14:21:04] Amir1, where can I find the rev_reverted dataset? [14:26:10] halfak: it's in my home folder in ores-compute-01 [14:26:41] OK thanks [14:56:06] halfak: one thing: https://phabricator.wikimedia.org/T105521 [14:56:10] I want to work on this [14:56:18] you told me that we have API [14:56:29] but it seems we have API for abandoning worksets [14:56:33] not a task [14:56:57] Yeah... that's right. [14:57:01] Sorry for the confusion. [14:57:18] We'll need a new endpoing for abandoning an individual task. [14:57:20] no, actually it's really good [14:57:45] my question is that what would be the best approach to abandon a task within a workset [14:58:44] I think that, within a transaction, (1) remove any labels this user has associated with task and (2) remove workset_task row. [15:00:34] okay, I take a look and ask again if I had any [15:00:39] *have [15:00:50] ORES is down [15:00:56] waat [15:01:15] Looks like labs just blew up [15:01:24] https://ores-beta.wmflabs.org/ [15:01:36] And we're back? maybe? [15:01:54] Kinda slow [15:01:59] https://labels.wmflabs.org/campaigns/fawiki/?campaigns=stats [15:02:05] labels is up [15:02:13] I'm checking several project [15:02:49] it seems all of ores instances are down [15:02:59] is it related to my patches? [15:03:05] Unlikely [15:03:15] in puppet, but they are merged a very long time ago [15:05:36] I haven't deployed anything new to the ores in beta, so probably a puppet issue [15:05:58] yeah. I think this is labs DNS exploding [15:35:23] halfak: and we are back [15:35:35] \o/ [15:36:05] Got my last icinga ping about it 20 mins ago [17:28:16] OKAY! [17:28:33] Now, next thing for me is to work on the quarterly review stuff for Dar.Tar. [17:28:39] But first, I need lunch [17:36:07] halfak|Lunch: https://phabricator.wikimedia.org/T131857 [17:36:10] for when you're back [18:15:37] 06Revision-Scoring-As-A-Service, 10MediaWiki-extensions-ORES, 13Patch-For-Review: Templatize Special:Contributions lines and add proper hooks - https://phabricator.wikimedia.org/T122537#2196005 (10Ladsgroup) [18:16:38] 06Revision-Scoring-As-A-Service, 10MediaWiki-extensions-ORES: Integrate ORES extension with Special:Contributions - https://phabricator.wikimedia.org/T132371#2196024 (10Ladsgroup) [18:17:58] 06Revision-Scoring-As-A-Service, 10MediaWiki-General-or-Unknown, 10MediaWiki-extensions-ORES, 13Patch-For-Review: Templatize Special:Contributions lines and add proper hooks - https://phabricator.wikimedia.org/T122537#2196041 (10Ladsgroup) [18:18:43] 06Revision-Scoring-As-A-Service, 10MediaWiki-General-or-Unknown, 10MediaWiki-extensions-ORES, 13Patch-For-Review: Templatize Special:Contributions lines and add proper hooks - https://phabricator.wikimedia.org/T122537#1906810 (10Ladsgroup) [18:20:03] 06Revision-Scoring-As-A-Service, 10MediaWiki-extensions-ORES: Integrate ORES extension with Special:Contributions - https://phabricator.wikimedia.org/T132371#2196050 (10Ladsgroup) [18:20:06] 06Revision-Scoring-As-A-Service, 10MediaWiki-General-or-Unknown, 10MediaWiki-extensions-ORES, 13Patch-For-Review: Templatize Special:Contributions lines and add proper hooks - https://phabricator.wikimedia.org/T122537#2196049 (10Ladsgroup) [18:20:38] \o/ [18:22:32] 06Revision-Scoring-As-A-Service, 10MediaWiki-General-or-Unknown, 10MediaWiki-extensions-ORES, 13Patch-For-Review: Templatize Special:Contributions lines and add proper hooks - https://phabricator.wikimedia.org/T122537#2196087 (10Ladsgroup) [18:22:35] 06Revision-Scoring-As-A-Service, 10MediaWiki-extensions-ORES: Integrate ORES extension with Special:Contributions - https://phabricator.wikimedia.org/T132371#2196086 (10Ladsgroup) [18:23:39] halfak|Lunch: ^ [18:23:44] that's me :D [18:23:54] just got back. [18:24:13] I made changes you told me in the meeting [18:24:20] Great :) [18:24:46] OK! QR stuff. [18:25:35] I also picked the task: https://phabricator.wikimedia.org/T130872 it is super important [18:26:59] +1 [18:27:27] 06Revision-Scoring-As-A-Service: [Spike] investigate using compression ratios in revscoring - https://phabricator.wikimedia.org/T132375#2196145 (10Ladsgroup) [18:37:12] I really have this temptation to change our phab cards so they show up here :D [18:41:37] ^ change in what way? [18:42:18] just null changes [18:42:20] :D [18:42:31] Oh! [18:42:32] :P [18:49:46] * halfak experiments with a simple ORES api library [18:49:50] QR stuff is done. [18:49:56] Now working on analysis of bias. [19:13:47] halfak: Hm.. so the probability numbers are now in a different range? The new models may be live, but it doesn't seem like it has changed much from what I can tell. [19:13:58] It feels a bit strange to lower it now from 0.8 to 0.4 [19:14:04] seems like that would greatly increase false positives. [19:14:07] I'll check it out though [19:15:14] Krinkle, Essentially, 0.45 in the new model == 0.8 in the old model [19:15:42] But the actual of using it do patrolling will tell the real story. [19:15:49] We can always make adjustments. [19:17:07] OK. I'm convinced [19:17:18] It just helped me catch a vandal edit at 50% :) [19:17:53] and another at 75% [19:18:10] :D [19:18:13] \o/ [19:19:12] Krinkle, I'll have some plots of how the scores have changed for you to look at soon. I think they'll help understand the score-range-change.