[01:01:16] 06Revision-Scoring-As-A-Service, 10Edit-Review-Improvements, 10rsaas-editquality, 06Collaboration-Team-Triage (Collab-Team-Q2-Oct-Dec-2016): Implement new precision-based test stats for editquality models - https://phabricator.wikimedia.org/T151970#2833819 (10Halfak) [01:01:28] 06Revision-Scoring-As-A-Service, 10Edit-Review-Improvements, 10rsaas-editquality, 06Collaboration-Team-Triage (Collab-Team-Q2-Oct-Dec-2016): Implement new precision-based test stats for editquality models - https://phabricator.wikimedia.org/T151970#2833743 (10Halfak) a:03Halfak [01:13:54] 06Revision-Scoring-As-A-Service, 10Edit-Review-Improvements, 10rsaas-editquality, 06Collaboration-Team-Triage (Collab-Team-Q2-Oct-Dec-2016): Implement new precision-based test stats for editquality models - https://phabricator.wikimedia.org/T151970#2833839 (10Halfak) @jmatazzoni may I suggest that we use t... [01:21:07] (03CR) 10Catrope: [C: 04-1] goodfaith filter (032 comments) [extensions/ORES] - 10https://gerrit.wikimedia.org/r/323328 (https://phabricator.wikimedia.org/T149853) (owner: 10Sbisson) [01:24:27] 10Revision-Scoring-As-A-Service-Backlog: Wikidata label quality model - https://phabricator.wikimedia.org/T151975#2833864 (10Halfak) [01:25:20] 10Revision-Scoring-As-A-Service-Backlog: Wikidata label quality model - https://phabricator.wikimedia.org/T151975#2833877 (10Halfak) This would require substantial new development. Not clear that this is a pressing issue, so it will be hard to prioritize research and modeling time. Not to say it isn't important,... [01:28:47] 10Revision-Scoring-As-A-Service-Backlog, 10ORES, 07Easy, 03Google-Code-In-2016: Quiet TimeoutError in celery logging - https://phabricator.wikimedia.org/T146681#2833881 (10Dargasea) a:05Dargasea>03None [02:45:21] 10Revision-Scoring-As-A-Service-Backlog, 10ORES, 07Easy, 03Google-Code-In-2016: Quiet TimeoutError in celery logging - https://phabricator.wikimedia.org/T146681#2833974 (10Dargasea) 05Open>03Resolved a:03Halfak [[ https://github.com/wiki-ai/ores/pull/179 | PR 179 ]] should solve this. Can you check? [02:45:21] 10[1] 04https://meta.wikimedia.org/wiki/https://github.com/wiki%2Dai/ores/pull/179 [02:47:11] 10Revision-Scoring-As-A-Service-Backlog, 10ORES, 07Easy, 03Google-Code-In-2016: Quiet TimeoutError in celery logging - https://phabricator.wikimedia.org/T146681#2833977 (10Dargasea) 05Resolved>03Open [[ https://github.com/wiki-ai/ores/pull/179 | PR 179 ]] should solve this. Can you check? (comment rem... [02:47:12] 10[2] 04https://meta.wikimedia.org/wiki/https://github.com/wiki%2Dai/ores/pull/179 [09:21:19] 10Revision-Scoring-As-A-Service-Backlog, 10ORES, 07Easy, 03Google-Code-In-2016: Quiet TimeoutError in celery logging - https://phabricator.wikimedia.org/T146681#2834333 (10Ladsgroup) Looks alright. Merged [09:23:48] 06Revision-Scoring-As-A-Service, 10ORES, 07Easy, 03Google-Code-In-2016: Quiet TimeoutError in celery logging - https://phabricator.wikimedia.org/T146681#2834334 (10Ladsgroup) a:05Halfak>03Dargasea [11:52:29] 06Revision-Scoring-As-A-Service, 10ORES, 07Easy, 03Google-Code-In-2016: Quiet TimeoutError in celery logging - https://phabricator.wikimedia.org/T146681#2834636 (10Aklapper) >>! In T146681#2834333, @Ladsgroup wrote: > Looks alright. Merged ...and task in the GCI system is now also closed as resolved. Than... [12:14:04] (03CR) 10Sbisson: goodfaith filter (032 comments) [extensions/ORES] - 10https://gerrit.wikimedia.org/r/323328 (https://phabricator.wikimedia.org/T149853) (owner: 10Sbisson) [15:00:23] 10Revision-Scoring-As-A-Service-Backlog: Wikidata label quality model - https://phabricator.wikimedia.org/T151975#2835064 (10Halfak) We'll want to check on the performance of the current model for differentiating good/bad label edits by newcomers/anons (readers). I'm guessing that it doesn't work that well yet... [15:15:49] 06Revision-Scoring-As-A-Service, 10MediaWiki-extensions-ORES, 07Accessibility, 13Patch-For-Review, and 5 others: Visually report damaging confidence - https://phabricator.wikimedia.org/T144922#2835085 (10Trizek-WMF) [15:31:19] halfak: hey [15:31:23] Hey! [15:31:24] why? [15:31:29] I think that merge was premptive. [15:31:35] It looked okay. I checked everything [15:31:52] So I think we should be catching that celery timeout error earlier. [15:32:42] Here: https://github.com/wiki-ai/ores/blob/master/ores/scoring_systems/celery_queue.py#L92 [15:33:10] We do catch it here: https://github.com/wiki-ai/ores/blob/master/ores/scoring_systems/celery_queue.py#L151 [15:35:47] halfak: I remember when we talked about it it was only about logging but I might be wrong [15:37:27] OK. Upon re-review, I don't think this is obviously bad. [15:38:17] I still think that I like having the error handled better. [15:46:00] (03PS10) 10Sbisson: goodfaith filter [extensions/ORES] - 10https://gerrit.wikimedia.org/r/323328 (https://phabricator.wikimedia.org/T149853) [16:09:01] 10Revision-Scoring-As-A-Service-Backlog, 10ORES: Silence or address E_WOULDBLOCK warning - https://phabricator.wikimedia.org/T152012#2835200 (10Halfak) [16:09:13] 10Revision-Scoring-As-A-Service-Backlog, 10ORES: Silence or address E_WOULDBLOCK warning - https://phabricator.wikimedia.org/T152012#2835225 (10Halfak) p:05Triage>03Normal [16:16:38] Amir1, here's something like what I had in mind: https://github.com/wiki-ai/ores/pull/181 [16:17:07] I noticed that the stopit warning was filling our logs so I'm going to check out if we have that problem in prod now. [17:22:22] (03PS11) 10Sbisson: goodfaith filter [extensions/ORES] - 10https://gerrit.wikimedia.org/r/323328 (https://phabricator.wikimedia.org/T149853) [17:56:07] (03PS1) 10Sbisson: [WIP] 'damaging' filter [extensions/ORES] - 10https://gerrit.wikimedia.org/r/324507 (https://phabricator.wikimedia.org/T149734) [18:05:51] (03CR) 10MarcoAurelio: [C: 04-1] "I feel the commit message needs improvement. Please see for guidance. Th" [extensions/ORES] - 10https://gerrit.wikimedia.org/r/323328 (https://phabricator.wikimedia.org/T149853) (owner: 10Sbisson) [18:27:16] (03PS12) 10Sbisson: 'goodfaith' filter on Special:RC / Special:Watchlist [extensions/ORES] - 10https://gerrit.wikimedia.org/r/323328 (https://phabricator.wikimedia.org/T149853) [18:38:17] (03PS2) 10Sbisson: [WIP] 'damaging' filter [extensions/ORES] - 10https://gerrit.wikimedia.org/r/324507 (https://phabricator.wikimedia.org/T149734) [18:41:55] (03PS3) 10Sbisson: 'damaging' filter on Special:RC / Special:Watchlist [extensions/ORES] - 10https://gerrit.wikimedia.org/r/324507 (https://phabricator.wikimedia.org/T149734) [19:00:33] (03CR) 10jenkins-bot: [V: 04-1] 'goodfaith' filter on Special:RC / Special:Watchlist [extensions/ORES] - 10https://gerrit.wikimedia.org/r/323328 (https://phabricator.wikimedia.org/T149853) (owner: 10Sbisson) [19:01:14] (03CR) 10jenkins-bot: [V: 04-1] 'damaging' filter on Special:RC / Special:Watchlist [extensions/ORES] - 10https://gerrit.wikimedia.org/r/324507 (https://phabricator.wikimedia.org/T149734) (owner: 10Sbisson) [19:22:28] (03PS1) 10Ladsgroup: Use darker shade of yellow [extensions/ORES] (wmf/1.29.0-wmf.4) - 10https://gerrit.wikimedia.org/r/324541 [19:29:52] (03CR) 10Thcipriani: [C: 032] "SWAT" [extensions/ORES] (wmf/1.29.0-wmf.4) - 10https://gerrit.wikimedia.org/r/324541 (owner: 10Ladsgroup) [19:32:28] (03Merged) 10jenkins-bot: Use darker shade of yellow [extensions/ORES] (wmf/1.29.0-wmf.4) - 10https://gerrit.wikimedia.org/r/324541 (owner: 10Ladsgroup) [19:48:55] legoktm: around? I have a quick admin request in enwiki [20:28:00] (03CR) 10Sbisson: "recheck" [extensions/ORES] - 10https://gerrit.wikimedia.org/r/323328 (https://phabricator.wikimedia.org/T149853) (owner: 10Sbisson) [20:41:00] (03CR) 10Sbisson: "recheck" [extensions/ORES] - 10https://gerrit.wikimedia.org/r/324507 (https://phabricator.wikimedia.org/T149734) (owner: 10Sbisson) [21:05:20] FOrgot to resolve tasks yesterday [21:05:23] Here comes the spam! [21:05:34] 06Revision-Scoring-As-A-Service, 10Wikilabels, 15User-Ladsgroup: Update bundled OOJS-ui with Wikilabels - https://phabricator.wikimedia.org/T151222#2836396 (10Halfak) 05Open>03Resolved [21:05:36] \o/ [21:05:37] 06Revision-Scoring-As-A-Service, 10rsaas-articlequality : Basic analysis of Wikipedia quality using monthly predictions - https://phabricator.wikimedia.org/T151214#2836397 (10Halfak) 05Open>03Resolved [21:05:38] 06Revision-Scoring-As-A-Service, 10ORES: ORES ui is broken (text field disabled) - https://phabricator.wikimedia.org/T150961#2836399 (10Halfak) 05Open>03Resolved [21:05:40] _o/ [21:05:41] 06Revision-Scoring-As-A-Service, 10UI-Standardization, 10Wikilabels, 07Easy, 15User-Ladsgroup: Apply ui standardization color palette to Wikilabels - https://phabricator.wikimedia.org/T151119#2836398 (10Halfak) 05Open>03Resolved [21:05:43] 06Revision-Scoring-As-A-Service, 06Collaboration-Team-Triage, 10Edit-Review-Improvements, 10MediaWiki-extensions-ORES: Post about ORES review tool including ERI filters - https://phabricator.wikimedia.org/T150858#2836400 (10Halfak) 05Open>03Resolved [21:05:46] _o_ [21:05:47] 06Revision-Scoring-As-A-Service, 10ORES, 06Research-and-Data, 10Research-management: ORES (a 2-3 minute presentation) - https://phabricator.wikimedia.org/T150544#2836401 (10Halfak) 05Open>03Resolved [21:05:49] 06Revision-Scoring-As-A-Service, 10rsaas-articlequality : Create manually vetted dataset of spam/vandalism/attack pages - https://phabricator.wikimedia.org/T150307#2836403 (10Halfak) 05Open>03Resolved [21:05:51] 06Revision-Scoring-As-A-Service, 10rsaas-articlequality , 10rsaas-draftquality, 03Research-and-Data-2016-17-Q2: Build draft quality model (spam, vandalism, attack, or OK) - https://phabricator.wikimedia.org/T148038#2836404 (10Halfak) [21:05:53] 06Revision-Scoring-As-A-Service, 10MediaWiki-extensions-ORES, 13Patch-For-Review, 15User-Ladsgroup, 05WMF-deploy-2016-11-29_(1.29.0-wmf.4): Add "Lowest" ORES sensitivity for fpr=0.1 - https://phabricator.wikimedia.org/T150224#2836405 (10Halfak) 05Open>03Resolved [21:05:55] 06Revision-Scoring-As-A-Service, 10MediaWiki-extensions-ORES, 07Accessibility, 13Patch-For-Review, and 5 others: Visually report damaging confidence - https://phabricator.wikimedia.org/T144922#2836406 (10Halfak) 05Open>03Resolved [21:31:24] 06Revision-Scoring-As-A-Service, 10rsaas-draftquality: Analyze differentiation of FA, Spam, Vandalism, and Attack models/sentences. - https://phabricator.wikimedia.org/T151819#2836492 (10Halfak) I have some progress to show here, but I found an issue in the spacy parser. So I'm working on that first. [21:36:32] Amir1: sup [21:36:48] legoktm: nvm, got it sorted out :) [21:36:51] thanks [21:37:01] OMG I've wasted 2 hours now chasing a weird import error. [21:37:13] * halfak takes the opportunity to complain [21:49:59] Solution was to just start deleting __pycache__ everywhere [22:46:41] halfak: https://www.wikidata.org/w/index.php?title=Special:RecentChanges&hidenondamaging=1 [22:46:45] \o/ [23:03:19] * halfak looks [23:03:30] Awesome! [23:04:36] I don't see any of the saturated yellow [23:12:16] halfak: probably happens too low [23:12:41] Could be. Either way, it looks pretty good. [23:12:48] There's a thread on the ORES review tool page. [23:12:50] Want ot piung it? [23:13:02] sure [23:13:12] https://www.mediawiki.org/wiki/Topic:Tb34n8tdmpv4vc38 [23:13:15] Amir1, ^ [23:13:23] Thanks [23:14:31] * halfak hides the wall of text [23:17:46] halfak: One thing. I think using this reporting confidence it conveys to people that false positives are okay [23:18:05] the thing that we are emphasizing for the past six months [23:18:09] Exactly :) [23:18:18] This will be great for trust in ORES [23:18:44] The problem before wasn't that ORES wasn't trustworthy, but rather, there was no indication of how much to trust it. [23:18:45] :D [23:18:58] This is yuge! [23:19:01] Too soon? [23:20:51] Tomorrow will be fun [23:21:31] I just realized that wmf.5 will go normally too. I thought the train will be stopped during December [23:21:39] probably after wmf.5