[07:24:49] 06Revision-Scoring-As-A-Service, 10Wikimania-Hackathon-2016, 10bwds: Generate bad words for all languages more than 100K articles - https://phabricator.wikimedia.org/T134629#2296363 (10Ladsgroup) [12:05:15] YuviPanda: hey, if you are around. What do you think of this settings for CORS? https://github.com/wiki-ai/wikilabels-wikimedia-config/pull/25/files [12:05:30] The origin sounds good enough? [12:11:53] 06Revision-Scoring-As-A-Service, 10wikilabels: Enable CORS for wikilabels - https://phabricator.wikimedia.org/T135377#2296885 (10Ladsgroup) [12:29:11] going to staging [12:55:14] staging is super slow [12:55:18] strange [12:57:30] can't connect to the redis [12:59:39] okay it was puppet issues [12:59:45] fixed now [13:14:11] and we are set :) [13:15:34] 06Revision-Scoring-As-A-Service, 10ORES, 10revscoring: Deploy revscoring 1.2.4 and new versions of ORES - https://phabricator.wikimedia.org/T135381#2297006 (10Ladsgroup) [13:34:49] Amir1: it does yes :) [13:45:36] YuviPanda: \o/ [13:45:45] I tested it and it worked like a charm [14:12:53] 06Revision-Scoring-As-A-Service, 10Wikimania-Hackathon-2016, 10bwds: Generate bad words for all languages more than 100K articles - https://phabricator.wikimedia.org/T134629#2297155 (10Ladsgroup) [14:43:46] o/ [14:43:47] Hey Amir1 [14:43:55] can you help me set up the Etherpad for the meeting? [14:43:59] https://etherpad.wikimedia.org/p/revscoring [14:44:04] halfak: hey [14:44:09] sure [14:52:55] Amir1, anything you want me to review quick before the meeting? [14:53:05] hmm [14:53:16] halfak: there is a regex for fa in revscoring [14:53:40] the other two are about wikilabels CORS [14:53:54] Saw the PR-AUC pull request [14:54:04] https://github.com/wiki-ai/revscoring/pull/273 [14:54:26] halfak: no, that one is just for view, feel free to just close it if you want [14:56:14] Amir1, any stats on the performance improvement with Persian regexes? [14:56:32] hmm, no [14:56:40] but it was pretty straightforward [14:56:50] I can generate after the meeting if you want [14:56:55] OK. no worries. [14:57:01] Na. [14:57:02] Merged [14:57:51] ruwiki reverted wins with a GaussianNB!!?! [14:58:18] Weird! [14:58:29] Will be interesting to build that model and compare ROC-AUC [15:01:55] Amir1, joining us? [15:02:10] halfak: bathroom break [15:02:13] in one min [15:44:28] 06Revision-Scoring-As-A-Service, 10revscoring, 10rsaas-editquality: [Spike] Explore using PR-AUC to score when tuning - https://phabricator.wikimedia.org/T133698#2297543 (10Halfak) [15:46:00] 06Revision-Scoring-As-A-Service, 10ORES: Add more logging around errors in ORES - https://phabricator.wikimedia.org/T135399#2297550 (10Halfak) [15:46:27] 06Revision-Scoring-As-A-Service, 10wikilabels: Write script to remove expired tasks from worksets - https://phabricator.wikimedia.org/T134619#2297565 (10Halfak) [15:47:10] 06Revision-Scoring-As-A-Service, 10wikilabels: Set up cron job for running expired task removal script. - https://phabricator.wikimedia.org/T135400#2297567 (10Halfak) [15:47:22] 06Revision-Scoring-As-A-Service, 10revscoring, 10rsaas-editquality: [Spike] Explore using PR-AUC to score when tuning - https://phabricator.wikimedia.org/T133698#2297581 (10Halfak) a:03Ladsgroup [15:50:38] 06Revision-Scoring-As-A-Service: Develop training session material for Wikimania Hackathon - https://phabricator.wikimedia.org/T134785#2297603 (10Halfak) a:03Halfak [15:52:14] 10Revision-Scoring-As-A-Service-Backlog, 10ORES, 10revscoring: Score multiple models with the same cached dependencies - https://phabricator.wikimedia.org/T134606#2297610 (10Halfak) [15:52:26] 10Revision-Scoring-As-A-Service-Backlog, 10ORES, 10revscoring: Score multiple models with the same cached dependencies - https://phabricator.wikimedia.org/T134606#2271181 (10Halfak) a:05Ladsgroup>03None [15:53:11] 06Revision-Scoring-As-A-Service: Develop training session material for Wikimania Hackathon - https://phabricator.wikimedia.org/T134785#2297620 (10Halfak) [15:53:33] 10Revision-Scoring-As-A-Service-Backlog, 10revscoring: Tamil language utilities - https://phabricator.wikimedia.org/T134105#2297621 (10Halfak) [15:54:12] 10Revision-Scoring-As-A-Service-Backlog, 10rsaas-articlequality : Convert to nettrom style WP 1.0 label extraction process - https://phabricator.wikimedia.org/T130312#2297622 (10Halfak) [15:56:41] 06Revision-Scoring-As-A-Service, 10ORES, 10wikilabels, 07Icinga, 13Patch-For-Review: icinga-wm and shinken report on wikimedia-ai too for ores and wikilabels nodes - https://phabricator.wikimedia.org/T134726#2297627 (10Halfak) [15:58:26] 06Revision-Scoring-As-A-Service, 10bwds, 10revscoring: Gather language assets for Swedish - https://phabricator.wikimedia.org/T131450#2167477 (10Halfak) a:03Ladsgroup [16:05:47] 06Revision-Scoring-As-A-Service, 10Wikimania-Hackathon-2016, 10bwds: Generate bad words for all languages more than 100K articles - https://phabricator.wikimedia.org/T134629#2271709 (10Psychoslave) I'm curious about this task. Could you please sum up what is it about, how this words are generated. I'm especi... [17:15:03] CRITICAL - nothing is broken, test notification for T134726 [17:15:10] ^ :) [17:16:14] 06Revision-Scoring-As-A-Service, 10ORES, 10wikilabels, 07Icinga, 13Patch-For-Review: icinga-wm and shinken report on wikimedia-ai too for ores and wikilabels nodes - https://phabricator.wikimedia.org/T134726#2297962 (10Dzahn) I created the icinga contact in the private repo, then rebased and merged @Lads... [17:17:04] 06Revision-Scoring-As-A-Service, 10ORES, 10wikilabels, 07Icinga, 13Patch-For-Review: icinga-wm and shinken report on wikimedia-ai too for ores and wikilabels nodes - https://phabricator.wikimedia.org/T134726#2297963 (10Dzahn) Did this resolve it or is there a shinken part to this that wasn't done yet? [17:21:01] 06Revision-Scoring-As-A-Service, 10ORES, 10wikilabels, 07Icinga, 13Patch-For-Review: icinga-wm and shinken report on wikimedia-ai too for ores and wikilabels nodes - https://phabricator.wikimedia.org/T134726#2297990 (10Dzahn) Note that only the services "ores_main_page" and "ores_worker" have "team-ores... [17:21:18] 06Revision-Scoring-As-A-Service, 10ORES, 10wikilabels, 07Icinga, 13Patch-For-Review: icinga-wm and shinken report on wikimedia-ai too for ores and wikilabels nodes - https://phabricator.wikimedia.org/T134726#2297991 (10Dzahn) 05Open>03Resolved a:03Dzahn [17:38:36] \o/ [17:54:13] * halfak travels from University to Home [18:33:59] halfak: o/ [18:38:50] o/ [18:49:16] o/ YuviPanda -- Do you have a few minutes for some advice? [18:49:22] sure halfak [18:49:24] 'sup [18:49:29] Looking at https://github.com/wiki-ai/wikilabels/pull/122 and being skeptical that we should implement CORS in flask. [18:49:41] Seems like we should implement this with some uwsgi config. [18:49:46] ah [18:49:48] yes I agree [18:49:50] on putting it in uwsgi [18:49:56] Is there a *good* way to set up a CORS for *all* wikimedia domains? [18:50:07] unfortunately nope, not without enumeration [18:50:20] Gotcha. Has this been done before? Can we copy-paste? [18:50:33] madhuvishy: did this for some other thing [18:51:32] halfak: in uwsgi config there's a key called 'add-header' [18:51:40] so you can just set that as the key and the header as value [18:51:52] so "add-header" => "" [18:52:03] We did some looking at that. Seems we need to enumerate a lot there. [18:52:14] Apparently the CORS lib for flask will get us make a regex. [18:52:34] CORS already lets you use wildcards for subdomains [18:52:54] so assuming you use it only on wikimedia.org, *.wikipedia.org and *.wikidata.org... [18:53:08] wikimedia.org, wikipedia.org, wiktionary.org, wikisource.org, ... [18:53:19] Yeah... [18:53:25] * halfak reads docs on how that will look [18:59:34] https://usercontent.irccloud-cdn.com/file/qQdFvsG3/ [18:59:46] halfak: the thing is, based on standards, it's better to send the origin [19:00:22] yeah, if you want it to be super dynamic, you have to do it in flask [19:00:32] instead of sending something like access-control-allow-origin: * [19:00:45] YuviPanda: we already did [19:00:54] right [19:00:58] but the thing is, we are not sure if flask is the best place [19:01:06] or we should move to uwsgi [19:01:07] if it has to be dynamic, then flask is the best place. [19:01:10] if it is static then uwsgi [19:01:27] thanks :) [19:03:29] halfak: https://etherpad.wikimedia.org/p/ores_weekly_update [19:03:35] Seems like static can work if it's OK to have a very long line in the header. [19:03:55] and YuviPanda if you want to check that [19:04:35] it should be ok [19:04:43] as long as it is not 'too long' [19:05:04] http://stackoverflow.com/questions/25309318/best-method-access-control-allow-origin-multiple-origin-domains [19:05:14] "the Access-Control-Allow-Origin header should be the same value as the Origin header as long as you want to allow it." [19:05:47] that's somehow a good practice, a little bit more secure [19:05:50] halfak: I redact what I had said earlier and agree with Amir1 now [19:05:54] on putting it in flask [19:06:38] Cool. Let's do that then. [19:06:41] apoogies for the confusion [19:06:44] * halfak moves to merge [19:06:46] No worries [19:06:48] It's confusing. [19:06:50] yeah [19:06:55] Thanks for your patience Amir :) [19:07:05] thank you for hearing [19:07:07] brb [19:07:07] :) [19:07:19] halfak: want anything else before I go afk for food? [19:07:28] Na. Thanks YuviPanda [19:07:32] :) [19:07:43] halfak: Have you checked the weekly update before I send it? [19:07:53] Amir1, let me merge first and then will check. [19:08:19] sure, the weekly update can wait a little :D [19:08:57] \o/ [19:09:00] thanks halfak :) [19:09:21] halfak: one thing I want to mention is that precaching goes down sometimes [19:09:32] I'm investigating it [19:09:55] it seems the service is up, otherwise the puppet would bring it back online [19:10:27] so the best solution is that the service should crash once the utility gets error [19:10:46] and then simply puppet re-run the service [19:11:12] Looks to me like the service simply hangs all of a sudden. It could be that our socketIO adapter is bad. [19:12:07] I should check the logs in more depth [19:16:31] halfak: "our mail work channel"? I changed it to "our main work channel" [19:16:47] Woops! Yes [19:16:55] Otherwise, I'm done with edits [19:17:02] I want to double check if I understood your edit [19:17:07] awesome [19:17:10] let's send it [19:21:04] halfak: sent [19:29:25] 06Revision-Scoring-As-A-Service, 10Wikimania-Hackathon-2016, 10bwds: Generate bad words for all languages more than 100K articles - https://phabricator.wikimedia.org/T134629#2298649 (10Ladsgroup) >>! In T134629#2297674, @Psychoslave wrote: > I'm curious about this task. Could you please sum up what is it abo... [19:32:37] afk doing more dishes [19:32:38] :(((( [20:15:20] 06Revision-Scoring-As-A-Service, 10Wikimania-Hackathon-2016, 10bwds: Generate bad words for all languages more than 100K articles - https://phabricator.wikimedia.org/T134629#2298969 (10Ladsgroup) [20:37:17] 06Revision-Scoring-As-A-Service, 10ORES: [Investigate] Precaching goes down sometimes - https://phabricator.wikimedia.org/T135444#2298990 (10Ladsgroup) [20:42:08] 06Revision-Scoring-As-A-Service, 10ORES: [Investigate] Precaching goes down sometimes - https://phabricator.wikimedia.org/T135444#2299007 (10Ladsgroup) It was down starting from May 15th until now. I want to turn on logging to see what's going on. [20:44:03] halfak: https://phabricator.wikimedia.org/T132747#2298270 [20:44:04] FYI [20:45:24] yay progress! [20:49:42] Okay, I go to bed [20:49:49] be back in a few hours [20:50:10] o/ [20:51:14] o/ [20:51:17] Have a good night!