[00:46:08] 06Revision-Scoring-As-A-Service, 10MediaWiki-extensions-ORES, 15User-Ladsgroup: Change default threshold for Wikidata to high - https://phabricator.wikimedia.org/T144784#2610074 (10Ladsgroup) [13:39:39] o/ [13:40:07] I've got some stuff to do this morning so I won't be starting properly until 1830 UTC [19:05:17] 06Revision-Scoring-As-A-Service, 06Research-and-Data-Backlog, 10Research-outreach: Track the WSDM Cup 2017 challenge - https://phabricator.wikimedia.org/T142407#2612142 (10leila) [19:14:14] o/ [19:14:20] Just got out of meeting #1 [19:14:26] Sync meeting is next \o/ [19:21:14] :) [19:58:36] 06Revision-Scoring-As-A-Service, 10revscoring: Update yamlconf so that import_path can handle deep attributes - https://phabricator.wikimedia.org/T144430#2612407 (10Halfak) https://github.com/halfak/yamlconf/issues/4 Woops [20:06:00] 06Revision-Scoring-As-A-Service, 10rsaas-editquality: Increment ruwiki editquality models - https://phabricator.wikimedia.org/T144855#2612458 (10Halfak) [20:12:10] 10Revision-Scoring-As-A-Service-Backlog, 10MediaWiki-extensions-ORES: Expose ores_model data in API using meta=ores - https://phabricator.wikimedia.org/T143617#2612529 (10Anomie) A few questions: * Should non-current models in `ores_models` be exposed in the action API, or is that not useful? * Are the model... [20:21:54] 06Revision-Scoring-As-A-Service, 10rsaas-articlequality , 03Research-and-Data-2017-Q1, 15User-Ladsgroup: Generate recent article quality scores for English Wikipedia - https://phabricator.wikimedia.org/T135684#2612569 (10Halfak) New PR: https://github.com/wiki-ai/wikiclass/pull/27 [20:24:04] 06Revision-Scoring-As-A-Service, 10ORES, 13Patch-For-Review, 15User-Ladsgroup: Move from mediawiki/services/ores/deploy to research/ores/deploy or research/ores/deploy-prod - https://phabricator.wikimedia.org/T139008#2612581 (10Halfak) @akosiaris can you review and merge? [20:30:08] 06Revision-Scoring-As-A-Service, 10MediaWiki-extensions-ORES, 07Schema-change, 15User-Ladsgroup: oresm_model index should not be unique - https://phabricator.wikimedia.org/T144432#2599649 (10Halfak) Maybe we want to explicitly clean out these rows while we clean up old rows from ores_model before loading i... [20:31:52] 06Revision-Scoring-As-A-Service, 10MediaWiki-extensions-ORES, 07Schema-change, 15User-Ladsgroup: oresm_model index should not be unique - https://phabricator.wikimedia.org/T144432#2612600 (10Halfak) Just to be clear. We should have two rows per model in `ores_model` [20:59:56] o/ Amir1 [21:00:13] How did you recommend that I look at your work re. duplicate rows query? [21:01:12] halfak: login to mw-revscoring [21:01:32] mediawiki-ores.eqiad.wmflabs (or ores-mediakiwiki) [21:01:40] cd /srv/mediawiki [21:01:42] vagrant ssh [21:02:10] * halfak follows along [21:03:35] SELECT /* SpecialRecentChanges::doMainQuery Someone */ rc_id,rc_timestamp,rc_user,rc_user_text,rc_namespace,rc_title,rc_comment,rc_minor,rc_bot,rc_new,rc_cur_id,rc_this_oldid,rc_last_oldid,rc_type,rc_source,rc_patrolled,rc_ip,rc_old_len,rc_new_len,rc_deleted,rc_logid,rc_log_type,rc_log_action,rc_params,wl_user,wl_notificationtimestamp,page_latest,(SELECT [21:03:35] GROUP_CONCAT(ct_tag SEPARATOR ',') FROM `change_tag` WHERE ct_rc_id=rc_id ) AS `ts_tags`,oresc_probability,'0.4' AS ores_threshold FROM `recentchanges` LEFT JOIN `watchlist` ON (wl_user = '4' AND (wl_title=rc_title) AND (wl_namespace=rc_namespace)) LEFT JOIN `page` ON ((rc_cur_id=page_id)) LEFT JOIN `ores_classification` ON ((rc_this_oldid = oresc_rev [21:03:35] AND oresc_class = 1)) LEFT JOIN `ores_model` ON ((oresc_model = oresm_id AND oresm_is_current = 1)) WHERE rc_bot = '0' AND (rc_timestamp >= '20160830000000') AND ((oresm_name = 'damaging' OR oresm_name IS NULL)) AND rc_new IN ('0','1') ORDER BY rc_timestamp DESC LIMIT 50 [21:03:50] (Oh! I thought this would go to pastebin, sorry) [21:04:32] in vagrant ssh [21:04:36] mysql [21:04:39] and play with the db [21:05:34] btw. the gen system errored again, I fixed it and re-ran it. It will be done around 30-40 hours from now [21:06:41] halfak: keep in mind we might have cases that we have rev_id but we don't keep the row in the ores_classification and we want to get them too [21:07:56] +1 [21:11:18] Amir1, oresc_class is a tinyint? [21:11:36] yeah, "true" = 1 [21:11:40] "false" = 0 [21:11:55] So we can't just load in article quality predictions :/ [21:12:11] no [21:12:24] tinyint can go up to 255 [21:12:32] 0 = stub, 1 = start, .. [21:13:47] Amir1, gotcha. So we'll just spec a mapping for each. [21:13:56] I already did [21:14:02] it's in the code base [21:14:09] we are moving out to config [21:14:14] (Roan's patch) [21:15:30] Amir1, OK. Query makes sense to me. This is a bit awk though. I'll review and see if I think it's worth writing up a proposal for change. [21:16:17] awesome, thanks [21:19:07] Oh yeah I need to fix up that patch [21:19:23] Some people reviewed it and -1ed it but I never got back to it [21:20:47] halfak: If you look at the LHS of https://gerrit.wikimedia.org/r/#/c/306316/1/includes/Cache.php you'll see that lines 13-15 already define a mapping from article quality to numbers [21:21:06] Which my (unmerged) patch moves to https://gerrit.wikimedia.org/r/#/c/306316/1/extension.json [21:22:31] RoanKattouw, gotcha. Thanks for the info [21:42:14] 10Revision-Scoring-As-A-Service-Backlog, 10ORES: ORES vision blog post - https://phabricator.wikimedia.org/T141275#2612846 (10Halfak) [21:43:30] Amir1: Do we have goodfaith scores in the DB yet? [21:43:36] I think I saw a phab task that suggested we didn't [22:12:51] 06Revision-Scoring-As-A-Service, 06Research-and-Data, 10Research-outreach, 07Epic, 03Research-and-Data-2017-Q1: Announce prod deployment of ORES - https://phabricator.wikimedia.org/T144867#2612985 (10Halfak) [22:13:04] 06Revision-Scoring-As-A-Service, 10Research-outreach: Announce prod deployment of ORES - https://phabricator.wikimedia.org/T144867#2612985 (10Halfak) [22:28:02] 10Revision-Scoring-As-A-Service-Backlog, 10ORES: ORES vision blog post - https://phabricator.wikimedia.org/T141275#2613054 (10Halfak) [22:28:04] 06Revision-Scoring-As-A-Service, 06Research-and-Data, 10Research-outreach, 07Epic, 03Research-and-Data-2017-Q1: [Epic] Write a comprehensive story on ORES (covering productization and research reports) - https://phabricator.wikimedia.org/T140429#2613053 (10Halfak) [22:29:16] 06Revision-Scoring-As-A-Service, 06Research-and-Data: Present on user-feedback stories at Research Showcase - https://phabricator.wikimedia.org/T143275#2613056 (10Halfak) [22:29:18] 06Revision-Scoring-As-A-Service, 06Research-and-Data, 10Research-outreach, 07Epic, 03Research-and-Data-2017-Q1: [Epic] Write a comprehensive story on ORES (covering productization and research reports) - https://phabricator.wikimedia.org/T140429#2464519 (10Halfak) [22:29:54] 06Revision-Scoring-As-A-Service, 10Research-outreach: Announce prod deployment of ORES - https://phabricator.wikimedia.org/T144867#2613058 (10Halfak) See https://etherpad.wikimedia.org/p/ores_prod_announcement And https://meta.wikimedia.org/wiki/Objective_Revision_Evaluation_Service/Production_announcement L... [22:31:38] 06Revision-Scoring-As-A-Service, 06Research-and-Data, 10Research-outreach, 07Epic, 03Research-and-Data-2017-Q1: [Epic] Write a comprehensive story on ORES (covering productization and research reports) - https://phabricator.wikimedia.org/T140429#2613062 (10Halfak) [22:31:41] 06Revision-Scoring-As-A-Service, 10Research-outreach: Announce prod deployment of ORES - https://phabricator.wikimedia.org/T144867#2612985 (10Halfak) 05Open>03Resolved [22:40:43] Amir1, https://github.com/wiki-ai/editquality/pull/47 [22:40:50] (if you have time) [22:40:55] I'll be working on the weekly report soon [22:43:26] Meh. I'm self-merging. This one is pretty safe. [23:10:31] Ready for review: https://etherpad.wikimedia.org/p/ores_weekly_update [23:10:33] Amir1, ^ [23:58:24] OK. Posting update