[07:54:15] 06Revision-Scoring-As-A-Service, 10ORES: Expose version of the service and its dependencies - https://phabricator.wikimedia.org/T155814#3113676 (10Tgr) https://github.com/wiki-ai/ores/pull/190 https://github.com/wiki-ai/wikilabels/pull/166 [09:04:12] 06Revision-Scoring-As-A-Service, 10Edit-Review-Improvements-RC-Page, 10ORES, 06Collaboration-Team-Triage (Collab-Team-Q3-Jan-Mar-2017), 07User-notice: Enable the ORES good faith and damaging UI by default, on wikis that have these ORES models available (i... - https://phabricator.wikimedia.org/T158225#3113719 [13:05:02] o/ [13:22:27] ㅇ/ [13:27:08] o/ glorian_wd [13:27:18] o/ halfak [13:27:28] any more progress on rendering items? [13:28:41] halfak: havent yet started working on it again. I did my other stuffs this morning. I will continue doing it, maybe in 30 mins [13:28:49] Hello, you have clue how resolve this problem? http://prnt.sc/em8job In Python . [13:28:55] glorian_wd, ok. was about ready to take a look at it. [13:28:59] o/ Maxulica [13:29:00] looking [13:29:25] halfak: I will try to wrap everything by today :) [13:30:44] Maxulica, sorry, but I'm not even quite sure what this question is asking. [13:31:05] glorian_wd, if you have something to submit as a PR, I can work from that right now. [13:31:25] o/ Amir1 [13:31:32] How can you solve this problem? [13:31:35] halfak [13:31:38] How can you solve this problem? [13:31:38] glorian_wd: not now. But maybe yes, in the next couple of hours [13:31:56] I meant, I may have something for PR in the next couple of hours [13:33:51] Maxulica, sorry, I'm not sure what it's asking. What do gbfs and wfs mean in this instance? [13:34:18] * halfak watches glorian_wd ping himself. [13:34:22] Need some coffee? :P [13:34:28] ops :p [13:34:32] glorian_wd, ok that'll work [13:34:45] Amir1, when you get back, I've been looking seriously at pywikibase. [13:34:51] GBFS and WFS is algorithm . [13:35:45] https://github.com/NABSA/gbfs [13:35:57] https://en.wikipedia.org/wiki/Network_File_System [13:36:04] :D [13:36:33] Amir1, check out https://gist.github.com/halfak/9bc54af1c278c66af0026835c2a94927 [13:36:55] It turns out that the most useful part of pywikibase to me is how it normalizes the shape of wikidata entities. [13:41:36] I just happened to be doing some work with pywikibase yesterday and thought it would be nice to have something a bit more basic and simplistic. [14:16:13] * glorian_wd halfak [14:16:22] * glorian_wd working on WikiLabels now [14:17:28] cool [14:17:43] * halfak halfaks [14:41:37] (03PS1) 10Esanders: build: Update stylelint to 0.4.1 [extensions/ORES] - 10https://gerrit.wikimedia.org/r/343653 [14:47:32] halfak: hey [14:47:34] what's up [14:47:49] Check out that gist I linked to and tell me what you think. [14:48:11] I'm looking at implementing a super-basic normalizer for wikidata JSON [14:48:18] Based on pywikibase. [14:48:46] Looks like we might want to extend `dict` so that pywikibase can inherit the types. [14:53:39] Amir1, ^ [14:55:56] sorry was on phone [14:56:14] halfak: It looks like a basic gist of pywikibase [14:56:21] pywikibase does much more than that [14:56:44] if you want to build something simple, this might work [14:57:03] but if you want to do the scoring, I doubt it would cover all edge cases [14:57:25] Amir1, yeah, was thinking that I want to build something that just reads the ugly blob that pywikibase could then use. [14:57:36] "scoring" and "edge cases"? [14:58:05] I'm thinking that we'd solve the edge cases at the data type rather than the operational level. [14:58:18] pywikibase affords operations, but usually I just want data type. [14:58:34] okay, now you lost me. Pywikibase already takes the ugly blob and returns objectified results [14:59:38] Right. It does both [14:59:47] And I want a library that is intended to just do one thing well. [15:00:20] pywikibase is ugly for just doing datatypes because of integration points with pywikibot. [15:00:25] * halfak heads to meeting. [15:01:59] let's talk about it later [15:13:53] can we update bad words after we start running ORES? [15:14:15] or are we going to stick to one list as much as it can? [15:14:23] revi, yeah. Can always rebuild models and re-deploy :D [15:14:32] great... [15:14:46] so I can be less paranoid on being complete [15:15:20] indeed :) [15:19:42] 10Revision-Scoring-As-A-Service-Backlog, 10Bad-Words-Detection-System, 10revscoring: Add language support for Korean - https://phabricator.wikimedia.org/T160757#3114550 (10revi) (Just FYI:) P5072 was added few minutes before halfak made 5073, and 5072 is the authoritative list. [15:26:45] (03CR) 10Jforrester: [C: 032] build: Update stylelint to 0.4.1 [extensions/ORES] - 10https://gerrit.wikimedia.org/r/343653 (owner: 10Esanders) [15:41:01] 06Revision-Scoring-As-A-Service, 10Edit-Review-Improvements-RC-Page, 10ORES, 06Collaboration-Team-Triage (Collab-Team-Q3-Jan-Mar-2017): Conform ORES sensitivity levels to the new ERI standards - https://phabricator.wikimedia.org/T160575#3114648 (10jmatazzoni) I assume you mean the //negative// of likelygoo... [15:44:19] (03Merged) 10jenkins-bot: build: Update stylelint to 0.4.1 [extensions/ORES] - 10https://gerrit.wikimedia.org/r/343653 (owner: 10Esanders) [15:49:22] halfak: I have created the PR. However, it seems there were old updated from the branch in which I submitted my change [15:50:31] In fact, my intention was to only submit new views.js. But there are some other changes detected between branch and master directory. So please let me know if I need to resubmit the PR with different branch. [15:50:50] old updates* [15:51:45] Will have a look in a bit. [15:52:31] okay [16:03:29] 10Revision-Scoring-As-A-Service-Backlog, 10ORES: Use redis to handle number of connections to ores uwsgi - https://phabricator.wikimedia.org/T160692#3114778 (10Halfak) @akosiaris, we're considering using Redis to track open connections to ORES so we can more effectively do rate limiting. What do you think? [16:04:53] 10Revision-Scoring-As-A-Service-Backlog, 10ORES: [Spec] Tracking and blocking specific IP/user-agent combinations - https://phabricator.wikimedia.org/T137962#3114785 (10Halfak) [16:04:56] 10Revision-Scoring-As-A-Service-Backlog, 10ORES: Implement parallel connection limit for querying ORES - https://phabricator.wikimedia.org/T148997#3114784 (10Halfak) [16:04:57] 10Revision-Scoring-As-A-Service-Backlog, 10ORES: Use redis to handle number of connections to ores uwsgi - https://phabricator.wikimedia.org/T160692#3114783 (10Halfak) [16:39:33] halfak: I am going to AFK. I will be back around 18.30 UTC [16:39:48] just drop me a comment regarding to the PR. I will have a look at it [16:39:51] thanks [16:41:26] kk [16:51:24] 06Revision-Scoring-As-A-Service, 10revscoring: Fix tokenization for Korean - https://phabricator.wikimedia.org/T160755#3114950 (10Halfak) https://github.com/halfak/deltas/commit/36a51c23f4c6dd93bda3c0662d0607078e72828a [16:51:57] 06Revision-Scoring-As-A-Service, 10revscoring: Fix tokenization for Korean - https://phabricator.wikimedia.org/T160755#3114951 (10Halfak) This is now fixed in version 0.4.5 of deltas [16:52:19] 06Revision-Scoring-As-A-Service, 10revscoring: Fix tokenization for Korean - https://phabricator.wikimedia.org/T160755#3109850 (10Halfak) a:03Halfak [17:07:28] 06Revision-Scoring-As-A-Service, 10Edit-Review-Improvements-RC-Page, 10ORES, 06Collaboration-Team-Triage (Collab-Team-Q3-Jan-Mar-2017), 07User-notice: Enable the ORES good faith and damaging UI by default, on wikis that have these ORES models available (i... - https://phabricator.wikimedia.org/T158225#3115021 [17:14:55] hmmm… my list of interesting WPMED examples slowly grows, just found “Alexander Fleming” is Low-importance [18:08:31] 06Revision-Scoring-As-A-Service, 10Edit-Review-Improvements-RC-Page, 10ORES, 06Collaboration-Team-Triage (Collab-Team-Q3-Jan-Mar-2017): Conform ORES sensitivity levels to the new ERI standards - https://phabricator.wikimedia.org/T160575#3115233 (10Catrope) We discussed the possibility of eliminating the "l... [18:37:50] 06Revision-Scoring-As-A-Service, 10Wikilabels, 10rsaas-editquality: Complete hewiki edit quality campaign - https://phabricator.wikimedia.org/T130263#3115367 (10Halfak) [18:38:35] 06Revision-Scoring-As-A-Service, 10Wikilabels, 10rsaas-editquality: Complete hewiki edit quality campaign - https://phabricator.wikimedia.org/T130263#2131236 (10Halfak) \o/ We'll pick this up and trains some models soon. [18:39:10] 06Revision-Scoring-As-A-Service, 10rsaas-editquality: Train damaging and goodfaith models for hewiki - https://phabricator.wikimedia.org/T160930#3115376 (10Halfak) [18:39:41] 06Revision-Scoring-As-A-Service, 10Wikilabels, 10rsaas-editquality: Complete hewiki edit quality campaign - https://phabricator.wikimedia.org/T130263#3115390 (10Halfak) [18:39:43] 10Revision-Scoring-As-A-Service-Backlog, 10rsaas-editquality: Deploy edit quality models for hewiki - https://phabricator.wikimedia.org/T130284#2131647 (10Halfak) [18:39:50] 06Revision-Scoring-As-A-Service, 10Wikilabels, 10rsaas-editquality: Complete hewiki edit quality campaign - https://phabricator.wikimedia.org/T130263#2131236 (10Halfak) [18:39:52] 06Revision-Scoring-As-A-Service, 10rsaas-editquality: Train damaging and goodfaith models for hewiki - https://phabricator.wikimedia.org/T160930#3115376 (10Halfak) [18:49:57] 06Revision-Scoring-As-A-Service, 10Edit-Review-Improvements-RC-Page, 10ORES, 06Collaboration-Team-Triage (Collab-Team-Q3-Jan-Mar-2017): Conform ORES sensitivity levels to the new ERI standards - https://phabricator.wikimedia.org/T160575#3115486 (10jmatazzoni) @Halfak, the reason Roan is asking for guidance... [18:52:00] halfak: I am back. I guess you have not reviewed the PR? [18:52:23] glorian_wd, nope. [18:52:39] hmm ok [18:56:20] 10Revision-Scoring-As-A-Service-Backlog, 10ORES: Use redis to handle number of connections to ores uwsgi - https://phabricator.wikimedia.org/T160692#3115531 (10akosiaris) @Halfak, overall the idea sounds ok. It would be great if we could build rate limiting at higher levels and ORES didn't really have to care... [18:56:27] 06Revision-Scoring-As-A-Service, 10Edit-Review-Improvements-RC-Page, 10ORES, 06Collaboration-Team-Triage (Collab-Team-Q3-Jan-Mar-2017): Conform ORES sensitivity levels to the new ERI standards - https://phabricator.wikimedia.org/T160575#3115533 (10Catrope) >>! In T160575#3115486, @jmatazzoni wrote: > that... [21:42:01] 10Revision-Scoring-As-A-Service-Backlog, 10ORES, 06Operations: [spec] Active-active setup for ORES across datacenters (eqiad, codfw) - https://phabricator.wikimedia.org/T159615#3116226 (10mobrovac) How about replicating the precaching redis instance across DCs? Would that be feasible? It seems slightly less... [21:46:57] 10Revision-Scoring-As-A-Service-Backlog, 10ORES, 06Operations: [spec] Active-active setup for ORES across datacenters (eqiad, codfw) - https://phabricator.wikimedia.org/T159615#3116244 (10Pchelolo) > How about replicating the precaching redis instance across DCs? Would that be feasible? It seems slightly les... [22:06:14] 06Revision-Scoring-As-A-Service, 10ORES, 10Wikimedia-Logstash, 13Patch-For-Review, 15User-Ladsgroup: Send ORES logs to logstash - https://phabricator.wikimedia.org/T149010#3116288 (10Ladsgroup) I think I know why it's happening. See: T143172#2577829 >I theory the log-route settings are not needed, but in... [22:08:09] 10Revision-Scoring-As-A-Service-Backlog, 10ORES, 06Operations: [spec] Active-active setup for ORES across datacenters (eqiad, codfw) - https://phabricator.wikimedia.org/T159615#3116308 (10mobrovac) >>! In T159615#3116244, @Pchelolo wrote: > Having the mirror-maker we can configure the ORES rule in #changepro... [22:09:27] 10Revision-Scoring-As-A-Service-Backlog, 10ORES, 06Operations: [spec] Active-active setup for ORES across datacenters (eqiad, codfw) - https://phabricator.wikimedia.org/T159615#3116331 (10Pchelolo) > Hm, that would activate CP for the whole ensemble of messages for the other DC. We can make the `consume_dc... [22:14:27] 06Revision-Scoring-As-A-Service, 10ORES, 10Wikimedia-Logstash, 13Patch-For-Review, 15User-Ladsgroup: Send ORES logs to logstash - https://phabricator.wikimedia.org/T149010#3116348 (10Ladsgroup) https://gerrit.wikimedia.org/r/343772 [22:28:50] 06Revision-Scoring-As-A-Service, 10MediaWiki-extensions-ORES, 15User-Ladsgroup: Deploy ORES review tool to etwiki - https://phabricator.wikimedia.org/T159609#3116387 (10Ladsgroup) https://gerrit.wikimedia.org/r/343777 [22:54:26] (03PS1) 10Mooeypoo: Add conflicts for category changes [extensions/ORES] - 10https://gerrit.wikimedia.org/r/343783 (https://phabricator.wikimedia.org/T160803) [23:05:59] 06Revision-Scoring-As-A-Service, 10Wikidata, 10Wikilabels, 15User-Ladsgroup: Wikidata items render badly in Wikilabels - https://phabricator.wikimedia.org/T160256#3116442 (10Halfak) https://github.com/wiki-ai/wikilabels/pull/168 This works OK. [23:06:04] halfak: do you remember when the ORES extension was deployed to enwiki? [23:06:19] when it started to add DB rows, to be more precise [23:07:13] 06Revision-Scoring-As-A-Service, 10Wikidata, 10Wikilabels, 15User-Ladsgroup: Wikidata items render badly in Wikilabels - https://phabricator.wikimedia.org/T160256#3116445 (10Halfak) See M208 [23:07:22] tgr, as in what was the date? [23:07:28] yes [23:07:52] tgr: https://gerrit.wikimedia.org/r/#/c/306028/ [23:08:13] thx [23:10:49] (03PS2) 10Mooeypoo: Add conflicts for category changes [extensions/ORES] - 10https://gerrit.wikimedia.org/r/343783 (https://phabricator.wikimedia.org/T160803) [23:12:03] nice [23:12:18] Amir1, I think I have the rendering issue for wikidata worked out. I feel like I need a shower though. [23:12:24] (using iframes will do that) [23:12:45] I saw it [23:12:53] I wanted to note about all terms [23:13:04] it seems it shows only a few [23:13:42] You can click on "more languages" [23:14:03] Note the "fewer languages" here: https://phabricator.wikimedia.org/M208 [23:14:12] okay cool [23:14:17] :) [23:14:25] I wish I could make those edit links go away :( [23:14:52] OK I'm out of here. Have a good one folks. [23:14:53] o/ [23:39:02] (03CR) 10jerkins-bot: [V: 04-1] Add conflicts for category changes [extensions/ORES] - 10https://gerrit.wikimedia.org/r/343783 (https://phabricator.wikimedia.org/T160803) (owner: 10Mooeypoo) [23:42:02] 06Revision-Scoring-As-A-Service, 10Edit-Review-Improvements-RC-Page, 10ORES, 06Collaboration-Team-Triage (Collab-Team-Q4-Apr-Jun-2017): Conform ORES sensitivity levels to the new ERI standards - https://phabricator.wikimedia.org/T160575#3116566 (10jmatazzoni) [23:56:04] 06Revision-Scoring-As-A-Service, 10Edit-Review-Improvements-RC-Page, 10ORES, 06Collaboration-Team-Triage (Collab-Team-Q3-Jan-Mar-2017): Conform ORES sensitivity levels to the new ERI standards - https://phabricator.wikimedia.org/T160575#3116619 (10jmatazzoni)