[11:44:09] (03PS9) 10Addshore: Action API integration for ORES [extensions/ORES] - 10https://gerrit.wikimedia.org/r/313831 (https://phabricator.wikimedia.org/T143614) (owner: 10Anomie) [11:48:22] (03CR) 10Addshore: [C: 032] Action API integration for ORES [extensions/ORES] - 10https://gerrit.wikimedia.org/r/313831 (https://phabricator.wikimedia.org/T143614) (owner: 10Anomie) [11:59:12] (03Merged) 10jenkins-bot: Action API integration for ORES [extensions/ORES] - 10https://gerrit.wikimedia.org/r/313831 (https://phabricator.wikimedia.org/T143614) (owner: 10Anomie) [14:09:39] 10Revision-Scoring-As-A-Service-Backlog, 10Wikilabels, 10rsaas-articlequality : Deploy article quality labeling campaign for Portuguese Wikipedia - https://phabricator.wikimedia.org/T138726#2768370 (10Halfak) [14:11:04] 10Revision-Scoring-As-A-Service-Backlog, 10Wikilabels, 10rsaas-articlequality : Deploy article quality labeling campaign for Portuguese Wikipedia - https://phabricator.wikimedia.org/T138726#2408195 (10Halfak) Took a look at this and did some cleanup. I think the best next step is looking into how many artic... [14:11:33] 10Revision-Scoring-As-A-Service-Backlog, 10rsaas-edittypes: Train edit types model on labeled data for English Wikipedia - https://phabricator.wikimedia.org/T121715#2768377 (10Halfak) [14:13:07] 06Revision-Scoring-As-A-Service, 10Wikilabels: Load new stratified edit_type campaign - https://phabricator.wikimedia.org/T149256#2768380 (10Halfak) p:05Triage>03Normal [14:15:11] 10Revision-Scoring-As-A-Service-Backlog, 10Wikilabels: "Abandon" button is confusing - https://phabricator.wikimedia.org/T138736#2768389 (10Halfak) [14:15:50] 10Revision-Scoring-As-A-Service-Backlog, 10Wikilabels: "Abandon" button is confusing - https://phabricator.wikimedia.org/T138736#2408412 (10Halfak) Not sure about "Skip", but generally I agree that "Abandon" isn't the best language. Maybe we could be explicit about "Skip task" or "Abandon task". [14:17:13] 10Revision-Scoring-As-A-Service-Backlog, 10Wikilabels: "Abandon" button is confusing - https://phabricator.wikimedia.org/T138736#2768394 (10Halfak) p:05Triage>03Low [14:17:55] 06Revision-Scoring-As-A-Service, 10MediaWiki-extensions-ORES, 05MW-1.28-release-notes, 13Patch-For-Review: Introduce rcshow=oresreview and similar ones - https://phabricator.wikimedia.org/T143616#2768396 (10Anomie) [14:17:58] 06Revision-Scoring-As-A-Service, 10MediaWiki-extensions-ORES, 13Patch-For-Review: Introduce ORES rvprop - https://phabricator.wikimedia.org/T143614#2768397 (10Anomie) [14:18:46] 06Revision-Scoring-As-A-Service, 10MediaWiki-API, 10MediaWiki-extensions-ORES, 07Epic: [Epic] Implement ORES service proxy in api.php - https://phabricator.wikimedia.org/T143895#2768402 (10Anomie) [14:18:49] 06Revision-Scoring-As-A-Service, 10MediaWiki-extensions-ORES, 13Patch-For-Review, 05WMF-deploy-2016-11-08_(1.29.0-wmf.2): Expose ores_model data in API using meta=ores - https://phabricator.wikimedia.org/T143617#2768401 (10Anomie) 05Open>03Resolved [14:18:55] 06Revision-Scoring-As-A-Service, 10MediaWiki-API, 10MediaWiki-extensions-ORES, 07Epic: [Epic] Implement ORES service proxy in api.php - https://phabricator.wikimedia.org/T143895#2582434 (10Anomie) [14:19:01] 06Revision-Scoring-As-A-Service, 10MediaWiki-extensions-ORES, 13Patch-For-Review: Introduce ORES rvprop - https://phabricator.wikimedia.org/T143614#2573432 (10Anomie) 05Open>03Resolved [14:19:04] 06Revision-Scoring-As-A-Service, 10MediaWiki-extensions-ORES, 05MW-1.28-release-notes, 13Patch-For-Review: Introduce rcshow=oresreview and similar ones - https://phabricator.wikimedia.org/T143616#2573460 (10Anomie) 05Open>03Resolved [14:19:07] 06Revision-Scoring-As-A-Service, 10MediaWiki-API, 10MediaWiki-extensions-ORES, 07Epic: [Epic] Implement ORES service proxy in api.php - https://phabricator.wikimedia.org/T143895#2582434 (10Anomie) [14:21:42] 10Revision-Scoring-As-A-Service-Backlog, 10Wikilabels, 07Community-consensus-needed, 07JavaScript: Configure WikiLabels as a MediaWiki gadget - https://phabricator.wikimedia.org/T102333#2768439 (10Halfak) @Mooeypoo & @Catrope looked at WikiLabels and they suggest that we move away from the gadget pattern a... [14:22:21] 10Revision-Scoring-As-A-Service-Backlog, 10Wikilabels: Implement single column diff option (from mobile app) - https://phabricator.wikimedia.org/T104072#2768441 (10Halfak) p:05Lowest>03Low [14:27:08] 10Revision-Scoring-As-A-Service-Backlog, 10Wikilabels: Implement single column diff option (from mobile app) - https://phabricator.wikimedia.org/T104072#2768444 (10Halfak) [14:27:28] 10Revision-Scoring-As-A-Service-Backlog, 10Wikilabels: Make Wiki Labels mobile compatible - https://phabricator.wikimedia.org/T105518#2768446 (10Halfak) p:05Lowest>03Low [14:27:37] 10Revision-Scoring-As-A-Service-Backlog, 10Wikilabels: [Mock] Wiki labels support on a mobile device. - https://phabricator.wikimedia.org/T123339#2768448 (10Halfak) p:05Lowest>03Low [14:29:37] 10Revision-Scoring-As-A-Service-Backlog, 10Wikilabels: Implement admin actions for wikilabels - https://phabricator.wikimedia.org/T102335#2768451 (10Halfak) p:05Low>03Normal [14:31:02] 10Revision-Scoring-As-A-Service-Backlog, 10Wikilabels: [Spec] Implement admin actions for wikilabels - https://phabricator.wikimedia.org/T102335#1362778 (10Halfak) [14:32:14] 10Revision-Scoring-As-A-Service-Backlog, 10Wikilabels: [Spec] Implement admin actions for wikilabels - https://phabricator.wikimedia.org/T102335#2768455 (10Halfak) @Catrope and @Pginer-WMF, when we do pick up work for Wiki labels, this is one of the places I want to start. [14:32:43] 10Revision-Scoring-As-A-Service-Backlog, 10Wikilabels, 07Wikimedia-Incident: [Discussion] Move wikilabels js to another place? - https://phabricator.wikimedia.org/T137626#2768457 (10Halfak) 05Open>03Invalid [14:34:13] 10Revision-Scoring-As-A-Service-Backlog, 10Wikilabels, 10rsaas-editquality: Complete frwiki edit quality campaign - https://phabricator.wikimedia.org/T130261#2768463 (10Halfak) @Niharika just asked me about completing the "damaging" model for FR wiki. This is the tracking task for completing the labeling ca... [14:35:01] 10Revision-Scoring-As-A-Service-Backlog, 10Wikilabels, 10rsaas-editquality: Complete frwiki edit quality campaign - https://phabricator.wikimedia.org/T130261#2768467 (10Halfak) See https://meta.wikimedia.org/wiki/Talk:Objective_Revision_Evaluation_Service#Damaging_model_for_frwiki [14:37:12] 10Revision-Scoring-As-A-Service-Backlog, 10Wikilabels: suppressed changes shown in WikiLabels - https://phabricator.wikimedia.org/T138563#2768469 (10Halfak) [14:37:34] 10Revision-Scoring-As-A-Service-Backlog, 10Wikilabels, 10rsaas-editquality: Complete eswiki edit quality campaign - https://phabricator.wikimedia.org/T129701#2768471 (10Halfak) [14:38:13] 10Revision-Scoring-As-A-Service-Backlog, 10Wikilabels, 10rsaas-editquality: Complete frwiki edit quality campaign - https://phabricator.wikimedia.org/T130261#2768472 (10Halfak) [14:46:25] Amir1, forgot to say that I was hoping to get ORES deployed today. [14:46:34] Did you get a chance to look into the problems with the last deploy? [14:46:53] not yet but I can re-prioritize it [14:48:11] I'll work towards getting new ORES out to wmflabs in the meantime. [14:48:23] It'll include revscoring 1.3.0 and a set of new models, FYI. [14:48:46] Awesome [15:10:22] halfak: It's fixed now [15:10:27] I deployed it in beta [15:10:54] failed, got it fixed and deployed it again it works now [15:17:56] Amir1, great! What was the issue? [15:20:37] https://gerrit.wikimedia.org/r/#/c/319583/1/logging_config.yaml [15:20:38] I see [15:24:19] I was afk [15:24:25] halfak: yes, that was it [15:55:31] Amir1, I'm looking at cutting out the weird gerrit wheels repo from ores-wmflabs-deploy. What do you think? [15:56:13] halfak: I don't get it, I think labs uses wheels too [15:56:44] Amir1, oh yeah totally. I think we should either have a github repo for them or just include them in the ores-wmflabs-deploy repo [15:57:24] hmm, yeah but it would make things super duplicate [15:57:50] maybe we have a repo in github and mirrored to gerrit [15:57:50] Amir1, I need to upgrade some wheels for wmflabs deploy and we're not ready to do that for wikimedi.org [15:58:04] Maybe we could have a specific branch for labs [15:58:05] halfak: that's totally okay [15:58:28] since the prod deploy repo submodule isn't updated [15:59:09] Amir1, OK. Yeah. I guess that'll work for now, but it's going to get weird. [16:00:09] maybe we should revive my old proposal. cut wheels and deploy repo into wiki-ai-1.1 branches [16:00:28] and we deploy wiki-ai-1.1 in labs [16:00:41] after a week deploy that branch into prod [16:01:04] (more like mediawiki releases) [16:04:59] Amir1, that's a fine proposal for the prod deploy repo. [16:05:27] But eventually wmflabs is going to be running models that aren't ready for prod. [16:05:45] I expect wmflabs and prod to diverge [16:13:33] Amir1, https://gerrit.wikimedia.org/r/319597 [16:17:46] {{merged}} [16:21:17] Nice [16:23:38] 10Revision-Scoring-As-A-Service-Backlog, 10Wikilabels, 07Wikimedia-Incident: [Discussion] Move wikilabels js to another place? - https://phabricator.wikimedia.org/T137626#2373608 (10greg) @Halfak This was a follow-up from an incident. Can you elaborate on why it is now Invalid? It very well can be, just, it... [16:29:31] 10Revision-Scoring-As-A-Service-Backlog, 10Wikilabels, 07Wikimedia-Incident: [Discussion] Move wikilabels js to another place? - https://phabricator.wikimedia.org/T137626#2768779 (10Halfak) ... this isn't followup from an incident? It looks like you're the one who added that project. Might that have been... [16:36:01] Amir1, https://gerrit.wikimedia.org/r/319607 [16:39:05] 10Revision-Scoring-As-A-Service-Backlog, 10Wikilabels, 07Wikimedia-Incident: [Discussion] Move wikilabels js to another place? - https://phabricator.wikimedia.org/T137626#2768797 (10Halfak) Ahha! I found that it was related to an incident. https://wikitech.wikimedia.org/wiki/Incident_documentation/20160531-... [16:42:18] 10Revision-Scoring-As-A-Service-Backlog, 10Wikilabels, 07Wikimedia-Incident: [Discussion] Move wikilabels js to another place? - https://phabricator.wikimedia.org/T137626#2768801 (10greg) Thanks. [17:00:44] Amir1, are we ready for the prod ORES deploy? I'm just about ready to send a hyper new one to wmflabs. [17:01:43] the prod is ready but they are working on upgrading CI infra (finally) [17:18:44] woops. Looks like we have a new bug in ORES. [17:18:46] Weird. https://ores-staging.wmflabs.org/v2/scores/testwiki/damaging/999?features [17:19:18] https://ores-staging.wmflabs.org/v2/scores/testwiki/damaging/999?features [17:19:24] WTF... it works now [17:19:42] hmmm [17:19:45] hmmm [17:20:25] well... I can't seem to replicate it now [17:20:26] Weird. [17:21:09] All seems to be good. [17:21:37] I'm going to declare victory [17:22:12] \o/ [17:22:30] OK here we go [17:29:52] halfak: please review https://etherpad.wikimedia.org/p/ores_weekly_update [17:34:18] PROBLEM - ORES web node labs ores-web-05 on ores.wmflabs.org is CRITICAL: HTTP CRITICAL: HTTP/1.1 503 SERVICE UNAVAILABLE - 463 bytes in 0.050 second response time [17:34:23] Yup [17:35:18] RECOVERY - ORES web node labs ores-web-05 on ores.wmflabs.org is OK: HTTP OK: HTTP/1.1 200 OK - 457 bytes in 0.555 second response time [17:36:55] 06Revision-Scoring-As-A-Service, 10ORES: /srv/log/ores/ not created on worker nodes - https://phabricator.wikimedia.org/T149925#2769035 (10Halfak) [17:37:27] Amir1, ^ I'm guessing this is due to logging stuff going in the web role. [17:37:29] ARG [17:37:42] halfak: I fix it soon [17:38:04] 06Revision-Scoring-As-A-Service, 10ORES, 15User-Ladsgroup: /srv/log/ores/ not created on worker nodes - https://phabricator.wikimedia.org/T149925#2769049 (10Ladsgroup) a:03Ladsgroup [17:38:24] kk [17:40:28] halfak: did you review this? https://etherpad.wikimedia.org/p/ores_weekly_update [17:40:48] Amir1, no putting out fires [17:41:17] halfak: How can I help? [17:41:33] Nothing right now [17:42:47] OK we're back online. [17:42:53] Will review quick and then I need to run for lunch [17:44:32] Amir1, done reviewing. [17:44:37] Running away for lunch [17:45:02] have fun [17:46:25] Sent [18:28:11] Back [18:28:14] o/ Adamwight [19:23:26] Looks like we'll get about 1m sentences from all the featured articles in English Wikipedia [19:23:49] Somewhere between 1m and 2m [19:24:11] It's pretty cool to watch the # of sentence per article fly by [19:24:20] We get about 50 in the smallest featured articles [19:24:30] And 700 in the biggest [19:38:01] OK. I need to do some cleanup, but it looks like I get roughy 1.4 million sentences. [19:45:32] I just made some adjustments to the sentence segmenter. We should see the number of sentences drop slightly. [20:08:13] 10Revision-Scoring-As-A-Service-Backlog, 10ORES, 07Easy, 03Google-Code-In-2016: Quiet TimeoutError in celery logging - https://phabricator.wikimedia.org/T146681#2769681 (10Ladsgroup) [20:09:38] Down to 1.3 million sentences. [20:09:48] There's a lot of crap in here that doesn't look like a sentence. [20:10:05] Looks like spacy need to parse them into *something* [20:13:59] 06Revision-Scoring-As-A-Service, 10Bad-Words-Detection-System, 10revscoring, 15User-Ladsgroup: Add language support for Tagalog - https://phabricator.wikimedia.org/T149475#2769706 (10Ladsgroup) Okay, I started the job in tools: ``` tools.dexbot@tools-bastion-03:~/pywikibot-core$ jsub -once -N tl_bwds -mem... [20:44:38] SPAM [20:45:10] 06Revision-Scoring-As-A-Service, 10rsaas-articlequality : Explore quality prediction valleys for en:Biology - https://phabricator.wikimedia.org/T149354#2769771 (10Halfak) 05Open>03Resolved [20:45:12] 06Revision-Scoring-As-A-Service, 10Wikilabels: Load new stratified edit_type campaign - https://phabricator.wikimedia.org/T149256#2769773 (10Halfak) 05Open>03Resolved [20:45:14] 06Revision-Scoring-As-A-Service, 15User-Ladsgroup: Revscoring grafana dashboards in a repo - https://phabricator.wikimedia.org/T149347#2769772 (10Halfak) 05Open>03Resolved [20:45:16] 06Revision-Scoring-As-A-Service, 10Data-release, 06Research-and-Data, 10rsaas-articlequality : Mini blogpost for Article Quality Score dataset - https://phabricator.wikimedia.org/T146709#2769774 (10Halfak) 05Open>03Resolved [20:45:18] 06Revision-Scoring-As-A-Service, 10Data-release, 06Research-and-Data, 10rsaas-articlequality : Formal publication of article quality score dataset - https://phabricator.wikimedia.org/T145332#2769775 (10Halfak) [20:45:20] 06Revision-Scoring-As-A-Service, 10ORES: Implement datasources_extracted metric - https://phabricator.wikimedia.org/T149199#2769776 (10Halfak) 05Open>03Resolved [20:45:22] 06Revision-Scoring-As-A-Service, 10Data-release, 06Research-and-Data, 10rsaas-articlequality : Formal publication of article quality score dataset - https://phabricator.wikimedia.org/T145332#2626819 (10Halfak) 05Open>03Resolved [20:45:25] 06Revision-Scoring-As-A-Service, 10MediaWiki-extensions-ORES, 13Patch-For-Review, 15User-Ladsgroup, and 2 others: Extensive CI tests for ORES extension - https://phabricator.wikimedia.org/T146560#2769777 (10Halfak) 05Open>03Resolved [20:53:40] 10Revision-Scoring-As-A-Service-Backlog, 10revscoring: Sentence bank for Featured Articles - https://phabricator.wikimedia.org/T148033#2769818 (10Halfak) I wrote a query to get the most recent version of FA articles. See https://quarry.wmflabs.org/query/13818 Here are my notes from IRC today. ``` [14:23:... [21:26:16] 06Revision-Scoring-As-A-Service, 10Bad-Words-Detection-System, 10revscoring, 15User-Ladsgroup: Add language support for Tagalog - https://phabricator.wikimedia.org/T149475#2770057 (10Ladsgroup) It is done now. We need a native speaker to review it based on [[https://meta.wikimedia.org/wiki/Objective_Revisi... [21:26:25] 06Revision-Scoring-As-A-Service, 10Bad-Words-Detection-System, 10revscoring, 15User-Ladsgroup: Add language support for Tagalog - https://phabricator.wikimedia.org/T149475#2770058 (10Ladsgroup) a:05Ladsgroup>03None