[10:57:25] (03CR) 10Thiemo Mättig (WMDE): "But you are introducing a third threshold. All three qqq messages only talk about the previously existing two thresholds. I understand tha" [extensions/ORES] - 10https://gerrit.wikimedia.org/r/320328 (https://phabricator.wikimedia.org/T150224) (owner: 10Ladsgroup) [14:46:16] o/ [15:07:08] 10Revision-Scoring-As-A-Service-Backlog: WikiTrust style scoring - https://phabricator.wikimedia.org/T150360#2785803 (10Halfak) [15:07:56] 10Revision-Scoring-As-A-Service-Backlog: WikiTrust style scoring - https://phabricator.wikimedia.org/T150360#2783492 (10Halfak) p:05Triage>03Lowest [15:08:44] 10Revision-Scoring-As-A-Service-Backlog: WikiTrust style scoring - https://phabricator.wikimedia.org/T150360#2783492 (10Halfak) @JKatzWMF, I think you'd brought up the idea of getting trustworthiness scores from ORES. Is that right? If so, I think here is where we'll want to continue that conversation. [15:09:55] 10Revision-Scoring-As-A-Service-Backlog, 10Wikilabels: Rename "abandon" button to something less confusing - https://phabricator.wikimedia.org/T138736#2785815 (10Halfak) [15:10:10] 10Revision-Scoring-As-A-Service-Backlog, 10Wikilabels: Rename "abandon" button to something less confusing - https://phabricator.wikimedia.org/T138736#2408412 (10Halfak) [15:13:39] 10Revision-Scoring-As-A-Service-Backlog, 10Editing-UX-Research, 10Wikilabels: Rename "abandon" button to something less confusing - https://phabricator.wikimedia.org/T138736#2785826 (10Halfak) [15:14:13] 10Revision-Scoring-As-A-Service-Backlog, 10Editing-UX-Research, 10Wikilabels: Rename "abandon" button to something less confusing - https://phabricator.wikimedia.org/T138736#2408412 (10Halfak) Adding #Editing-UX-Research because it seems we're speculating about the problem and a good solution. I wonder if w... [15:15:51] 10Revision-Scoring-As-A-Service-Backlog, 10Wikilabels: Improve error message for suppressed changes shown in WikiLabels - https://phabricator.wikimedia.org/T138563#2785834 (10Halfak) [15:16:37] 10Revision-Scoring-As-A-Service-Backlog, 10Wikilabels: Improve error message for suppressed changes shown in WikiLabels - https://phabricator.wikimedia.org/T138563#2403958 (10Halfak) We should be able to look into the API result to find out if a revision was suppressed. [15:20:07] 10Revision-Scoring-As-A-Service-Backlog, 10Wikilabels: Improve error message for suppressed changes shown in WikiLabels - https://phabricator.wikimedia.org/T138563#2785846 (10Halfak) https://en.wikipedia.org/w/api.php?action=query&prop=revisions&rvprop=content&revids=743862977&format=json returns: ``` { "b... [15:21:28] 10Revision-Scoring-As-A-Service-Backlog, 10ORES, 06Operations, 07Puppet: Clean up puppet & configs for ORES - https://phabricator.wikimedia.org/T142002#2785849 (10Halfak) p:05Normal>03Low [15:27:16] 10Revision-Scoring-As-A-Service-Backlog, 10ORES: Spike: Is Varnish caching ORES responses? - https://phabricator.wikimedia.org/T149223#2785854 (10Halfak) [15:27:46] 10Revision-Scoring-As-A-Service-Backlog, 10ORES: Spike: Is Varnish caching ORES responses? - https://phabricator.wikimedia.org/T149223#2745755 (10Halfak) p:05Triage>03Normal [15:28:45] 10Revision-Scoring-As-A-Service-Backlog, 10ORES, 07Spike: [Spike] Is Varnish caching ORES responses? - https://phabricator.wikimedia.org/T149223#2785861 (10Ladsgroup) [15:38:55] 06Revision-Scoring-As-A-Service, 10revscoring: Implement sentences datascources & experiment with normalization. - https://phabricator.wikimedia.org/T148867#2785917 (10Halfak) I have a working scorer model trained on Featured Article sentences. ``` $ ./utility score models/enwiki.fa_sentence.model 'Don Henley... [15:49:32] 06Revision-Scoring-As-A-Service, 10DBA, 06Labs, 10Labs-Infrastructure, 10MediaWiki-extensions-ORES: Replicate ores_classification and ores_model tables in labs - https://phabricator.wikimedia.org/T148561#2726255 (10Halfak) @jcrespo, I see that this is placed in the "Blocked external/Not db team" on the D... [15:52:45] 06Revision-Scoring-As-A-Service, 10DBA, 06Labs, 10Labs-Infrastructure, 10MediaWiki-extensions-ORES: Replicate ores_classification and ores_model tables in labs - https://phabricator.wikimedia.org/T148561#2785996 (10Halfak) Maybe we should be talking to @chasemp and @madhuvishy about getting this done... ? [15:57:17] 06Revision-Scoring-As-A-Service, 10revscoring, 03Research-and-Data-2016-17-Q2: Implement PCFG features for editquality - https://phabricator.wikimedia.org/T144636#2605842 (10Halfak) p:05Low>03High [15:57:53] 06Revision-Scoring-As-A-Service, 10MediaWiki-API, 10MediaWiki-extensions-ORES, 07Epic: [Epic] Implement ORES service proxy in api.php - https://phabricator.wikimedia.org/T143895#2786011 (10Halfak) It looks like this is ready to be resolved. Is that right, @Anomie? [15:58:31] 06Revision-Scoring-As-A-Service, 10revscoring, 07Epic, 03Research-and-Data-2016-17-Q2: [Epic] Implement PCFG features for editquality - https://phabricator.wikimedia.org/T144636#2605842 (10Halfak) [15:59:16] 06Revision-Scoring-As-A-Service, 10MediaWiki-API, 10MediaWiki-extensions-ORES, 07Epic: [Epic] Implement ORES service proxy in api.php - https://phabricator.wikimedia.org/T143895#2786014 (10Halfak) 05Open>03Resolved [16:03:32] 06Revision-Scoring-As-A-Service, 10rsaas-articlequality , 03Research-and-Data-2016-17-Q2: Build draft quality model (spam, vandalism, attack, or OK) - https://phabricator.wikimedia.org/T148038#2786031 (10Halfak) [16:04:16] 06Revision-Scoring-As-A-Service, 10rsaas-articlequality : Create manually vetted dataset of spam/vandalism/attack pages - https://phabricator.wikimedia.org/T150307#2786034 (10Halfak) [16:04:18] 06Revision-Scoring-As-A-Service, 10rsaas-articlequality , 03Research-and-Data-2016-17-Q2: Build draft quality model (spam, vandalism, attack, or OK) - https://phabricator.wikimedia.org/T148038#2712869 (10Halfak) [16:27:36] 06Revision-Scoring-As-A-Service, 10DBA, 06Labs, 10Labs-Infrastructure, 10MediaWiki-extensions-ORES: Replicate ores_classification and ores_model tables in labs - https://phabricator.wikimedia.org/T148561#2786145 (10jcrespo) I believe now that it is unblocked, the tables are actually replicated, so labs t... [16:29:42] 06Revision-Scoring-As-A-Service, 10DBA, 06Labs, 10Labs-Infrastructure, 10MediaWiki-extensions-ORES: Replicate ores_classification and ores_model tables in labs - https://phabricator.wikimedia.org/T148561#2786150 (10jcrespo) I can confirm they are in labs: ``` $ mysql -h labsdb1001 wikidatawiki -e "SELE... [16:54:51] 06Revision-Scoring-As-A-Service, 10DBA, 06Labs, 10Labs-Infrastructure, 10MediaWiki-extensions-ORES: Replicate ores_classification and ores_model tables in labs - https://phabricator.wikimedia.org/T148561#2786222 (10Halfak) Great! Thanks. Resolving [16:55:08] 06Revision-Scoring-As-A-Service, 10DBA, 06Labs, 10Labs-Infrastructure, 10MediaWiki-extensions-ORES: Replicate ores_classification and ores_model tables in labs - https://phabricator.wikimedia.org/T148561#2726255 (10Halfak) 05Open>03Resolved [16:56:12] 06Revision-Scoring-As-A-Service, 10DBA, 06Labs, 10Labs-Infrastructure, 10MediaWiki-extensions-ORES: Replicate ores_classification and ores_model tables in labs - https://phabricator.wikimedia.org/T148561#2786227 (10jcrespo) Sorry I was not clear enough- the tables are replicated, but they are probably no... [16:56:19] 06Revision-Scoring-As-A-Service, 10DBA, 06Labs, 10Labs-Infrastructure, 10MediaWiki-extensions-ORES: Replicate ores_classification and ores_model tables in labs - https://phabricator.wikimedia.org/T148561#2786228 (10jcrespo) 05Resolved>03Open [16:56:25] Working on https://etherpad.wikimedia.org/p/ores_weekly_update [16:57:26] 06Revision-Scoring-As-A-Service, 10DBA, 06Labs, 10Labs-Infrastructure, 10MediaWiki-extensions-ORES: Replicate ores_classification and ores_model tables in labs - https://phabricator.wikimedia.org/T148561#2786230 (10Ladsgroup) @jcrespo is right: ``` ladsgroup@tools-bastion-03:~$ sql fawiki "select oresm_i... [16:58:44] 06Revision-Scoring-As-A-Service, 10ORES: Deploy revscoring 1.3.0 and updated editquality and wikiclass to wmflabs - https://phabricator.wikimedia.org/T150447#2786233 (10Halfak) [16:59:36] 06Revision-Scoring-As-A-Service, 10ORES: Deploy revscoring 1.3.0 and updated editquality and wikiclass to wmflabs - https://phabricator.wikimedia.org/T150447#2786250 (10Halfak) This was actually done on 11/3, but I'm recording it as a task retroactively. ``` 17:36 halfak: manually ran "sudo mkdir /srv/log;... [17:33:34] 06Revision-Scoring-As-A-Service, 10DBA, 06Labs, 10Labs-Infrastructure, 10MediaWiki-extensions-ORES: Replicate ores_classification and ores_model tables in labs - https://phabricator.wikimedia.org/T148561#2786420 (10Halfak) @jcrespo I see. Who should figure this out? [17:34:13] 10Revision-Scoring-As-A-Service-Backlog: WikiTrust style scoring - https://phabricator.wikimedia.org/T150360#2786427 (10JKatzWMF) @Halfak Thanks! I will reword this a bit to be a little more explicitly value-driven, because I don't think we know yet what the most valuable signal for scoring validity is. I thin... [17:39:53] 10Revision-Scoring-As-A-Service-Backlog: Give readers guidance on content "trustworthiness" - https://phabricator.wikimedia.org/T150360#2786438 (10JKatzWMF) [17:40:00] 06Revision-Scoring-As-A-Service, 10DBA, 06Labs, 10Labs-Infrastructure, 10MediaWiki-extensions-ORES: Replicate ores_classification and ores_model tables in labs - https://phabricator.wikimedia.org/T148561#2786440 (10jcrespo) I think labs ops will know, but they are mostly unavailable/busy this week, so I... [17:44:21] 06Revision-Scoring-As-A-Service, 10DBA, 06Labs, 10Labs-Infrastructure, 10MediaWiki-extensions-ORES: Replicate ores_classification and ores_model tables in labs - https://phabricator.wikimedia.org/T148561#2786444 (10Ladsgroup) I do the amending. [18:12:48] Amir1, please review: https://etherpad.wikimedia.org/p/ores_weekly_update [18:13:23] 06Revision-Scoring-As-A-Service, 10DBA, 06Labs, 10Labs-Infrastructure, and 3 others: Replicate ores_classification and ores_model tables in labs - https://phabricator.wikimedia.org/T148561#2786574 (10Halfak) a:03Ladsgroup [18:13:56] halfak: Do you think you can some WIP stuff [18:14:29] Sure! [18:14:50] Would be happy to WIP some progress on releasing the spam/attack/vandalism dataset and the sentence grammar models. [18:15:05] Awesome [18:15:35] 06Revision-Scoring-As-A-Service, 10DBA, 06Labs, 10Labs-Infrastructure, and 3 others: Replicate ores_classification and ores_model tables in labs - https://phabricator.wikimedia.org/T148561#2726255 (10AlexMonk-WMF) >>! In T148561#2786440, @jcrespo wrote: > @Krenair may know, but it is not something he has t... [18:35:03] Amir1, please re-review https://etherpad.wikimedia.org/p/ores_weekly_update [18:46:37] Done halfak : [18:48:04] cool [18:52:52] 06Revision-Scoring-As-A-Service, 10ORES: Deploy revscoring 1.3.0 and updated editquality and wikiclass to wmflabs - https://phabricator.wikimedia.org/T150447#2786794 (10Halfak) a:03Halfak [18:53:10] Spam coming [18:53:21] 06Revision-Scoring-As-A-Service, 10ORES: Deploy revscoring 1.3.0 and updated editquality and wikiclass to wmflabs - https://phabricator.wikimedia.org/T150447#2786798 (10Halfak) 05Open>03Resolved [18:53:22] \o/ [18:53:23] 06Revision-Scoring-As-A-Service, 10ORES, 13Patch-For-Review, 15User-Ladsgroup: /srv/log/ores/ not created on worker nodes - https://phabricator.wikimedia.org/T149925#2786799 (10Halfak) 05Open>03Resolved [18:53:25] 06Revision-Scoring-As-A-Service, 10revscoring: Implement recall at precision (and fix FPR metrics) - https://phabricator.wikimedia.org/T149825#2786800 (10Halfak) 05Open>03Resolved [18:53:28] 06Revision-Scoring-As-A-Service, 10ORES, 13Patch-For-Review, 15User-Ladsgroup: Deploy logging changes to ORES - https://phabricator.wikimedia.org/T149730#2786801 (10Halfak) 05Open>03Resolved [18:53:32] _o/ [18:54:32] o/ [18:54:51] * halfak swims in the phab spam :) [19:33:14] 06Revision-Scoring-As-A-Service, 10DBA, 06Labs, 10Labs-Infrastructure, and 3 others: Replicate ores_classification and ores_model tables in labs - https://phabricator.wikimedia.org/T148561#2787048 (10AlexMonk-WMF) [19:35:29] 06Revision-Scoring-As-A-Service, 10DBA, 06Labs, 10Labs-Infrastructure, and 3 others: Replicate ores_classification and ores_model tables in labs - https://phabricator.wikimedia.org/T148561#2787065 (10jcrespo) @AlexMonk-WMF, this is not a replication or Database issue, as I just demonstrated. [19:35:43] 06Revision-Scoring-As-A-Service, 10DBA, 06Labs, 10Labs-Infrastructure, and 3 others: Replicate ores_classification and ores_model tables in labs - https://phabricator.wikimedia.org/T148561#2787066 (10jcrespo) [20:01:14] 06Revision-Scoring-As-A-Service, 10DBA, 06Labs, 10Labs-Infrastructure, and 3 others: Replicate ores_classification and ores_model tables in labs - https://phabricator.wikimedia.org/T148561#2787171 (10AlexMonk-WMF) >>! In T148561#2787065, @jcrespo wrote: > @AlexMonk-WMF, this is not a replication or Databas... [20:01:28] 06Revision-Scoring-As-A-Service, 10DBA, 06Labs, 10Labs-Infrastructure, and 3 others: Replicate ores_classification and ores_model tables in labs - https://phabricator.wikimedia.org/T148561#2787186 (10AlexMonk-WMF) [20:54:24] (03PS1) 10Legoktm: Only check isInGeneratorMode() on instances of ApiQueryGeneratorBase [extensions/ORES] - 10https://gerrit.wikimedia.org/r/320843 [20:55:38] (03PS1) 1020after4: Only check isInGeneratorMode() on instances of ApiQueryGeneratorBase [extensions/ORES] (wmf/1.29.0-wmf.2) - 10https://gerrit.wikimedia.org/r/320844 [20:55:55] (03CR) 1020after4: [C: 032] Only check isInGeneratorMode() on instances of ApiQueryGeneratorBase [extensions/ORES] (wmf/1.29.0-wmf.2) - 10https://gerrit.wikimedia.org/r/320844 (owner: 1020after4) [20:56:26] (03CR) 1020after4: [C: 032] "Cherry-picked to 1.29.0-wmf.2" [extensions/ORES] - 10https://gerrit.wikimedia.org/r/320843 (owner: 10Legoktm) [21:05:05] (03Merged) 10jenkins-bot: Only check isInGeneratorMode() on instances of ApiQueryGeneratorBase [extensions/ORES] (wmf/1.29.0-wmf.2) - 10https://gerrit.wikimedia.org/r/320844 (owner: 1020after4) [21:07:28] (03Merged) 10jenkins-bot: Only check isInGeneratorMode() on instances of ApiQueryGeneratorBase [extensions/ORES] - 10https://gerrit.wikimedia.org/r/320843 (owner: 10Legoktm) [22:03:10] IT WORKS [22:03:11] https://en.wikipedia.org/w/api.php?action=query&prop=revisions&rvprop=oresscores&revids=743862977 [22:03:12] \o/ [22:03:16] anomie, <3 [22:04:16] We'll make an announcement -- probably tomorrow. I'll send you a draft to review around 9AM PST