[00:08:35] A good goal, yet ambitious [00:25:00] lol [00:25:07] maybe WMF has some resources that would help with that [10:49:52] o/ [13:43:07] o/ [14:02:11] 10Scoring-platform-team (Current), 10ORES, 10User-Ladsgroup: Merge logging config to the main config in ORES - https://phabricator.wikimedia.org/T206221 (10Ladsgroup) [14:12:35] I really need my patch merged for logstash :/ [14:12:54] It's not affecting prod unless we turn it on [14:18:16] afk for lunch, will be back soon [14:24:04] 10Scoring-platform-team, 10Wikilabels, 10articlequality-modeling, 10artificial-intelligence: Build article quality model for Galician Wikipedia - https://phabricator.wikimedia.org/T201146 (10Halfak) I got most of the translations but it looks like there was a key translation that I missed. To save time, w... [14:52:38] 10Scoring-platform-team, 10ORES: Silence or address E_WOULDBLOCK warning - https://phabricator.wikimedia.org/T152012 (10Ladsgroup) I want to get back on this. I deep dived into celery docs, watched several conference presentations and changed my mind several times until I decided that lock manager (PoolCounter... [15:56:00] halfak: Around? I have a question regarding celery [15:58:34] o/ yeah. what;s up? [16:01:02] so https://github.com/wikimedia/ores/blob/master/ores/scoring_systems/celery_queue.py#L168 [16:01:21] in this line we are sending a home-made task id to celery [16:01:47] Is celery's UUID something random or you can compose it? [16:01:55] I thought it's random [16:04:57] and if you can compose it, this doesn't seem right. halfak ^ [16:05:22] hmm one sec [16:07:27] I think it's asking status of the wrong task (_lookup_score_in_map instead of _process_missing_scores) [16:17:12] sorry. I have a meeting going over, but it's really useful so I'm not exiting :) [16:21:11] no worries, take your time [16:21:14] Back! [16:21:27] Was talking to product teams about future AI directions :) [16:21:46] Ahh yeah so celery can generate its own IDs or accept the IDs that we make,. [16:21:50] Either way works. [16:21:51] Hi Everyone. i would like to deploy some campaigns to Wikilabels-production today. Is there anything I should know before I do that? [16:22:18] notconfusing, do you have translations ready? [16:22:44] Amir1, some responses above. [16:23:36] I did make some translations, I have to remind myself if/how they get pushed/read from translatewiki [16:24:28] I might just do it for en, fr at the moment as a soft launch, i know the french translation is good, i asked some tourists to help me in haight [16:27:59] If the translations are in translate wiki then they should be in the repo. [16:28:03] * halfak checks. [16:28:46] halfak: okay, I still don't get how ID of _lookup_score_in_map can be composed like this because the task's arguments are ID of another job + model name, and context.format_id_string doesn't compose such ID [16:28:52] notconfusing, I don't see a form for newcomer quality. [16:29:13] Amir1, ... yes it does? [16:29:48] This line doesn't make sense to me https://github.com/wikimedia/ores/blob/master/ores/scoring_systems/celery_queue.py#L168 [16:29:51] task_id = context.format_id_string(model_name, rev_id, request, injection_cache=injection_cache) [16:30:04] I sorta can understand everything else [16:30:29] That is asking celery to get us an in-progress result based on the ID string. [16:30:43] I know that part :D [16:30:56] the ID that is being made is weird [16:31:11] What is weird? [16:31:21] https://github.com/wikimedia/ores/blob/master/ores/scoring_systems/celery_queue.py#L78 [16:31:34] Right. [16:31:47] ID of _lookup_score_in_map should be composed out of its arguments [16:31:57] Oh this ID is auto-generated. [16:32:30] random? [16:32:30] https://github.com/wikimedia/ores/blob/master/ores/scoring_systems/celery_queue.py#L115 [16:32:37] Yeah. Random. [16:33:00] Random ID (General a score map) --> Named ID (Extract a specific score from the map) [16:33:46] https://www.mediawiki.org/wiki/ORES/Multiscore_problem [16:33:49] This might help [16:35:22] "https://github.com/wikimedia/ores/blob/master/ores/scoring_systems/celery_queue.py#L115" <- I definitely understand how this works [16:35:29] it's very clear [16:35:42] Right. [16:35:50] These two things work together. [16:36:01] halfak: my thought was to use the same form as edit-quality, this way we can determine a relationship between edit-quality and newcomer-session-quality. For instance is newcomerqual = max([editqual],[editqual])? Of course we'll use ML to figure out newcomersession-quality, but this way we can find a relationship along the way too. [16:36:15] notconfusing, OK that works. [16:36:19] No translations necessary then [16:36:20] the part I don't get is how we handle named ID of _lookup_score_in_map.AsyncResult [16:36:28] I made a small write-up about this, I'll find it. [16:36:37] Amir, the secondary task is named. [16:36:45] So that we can de-dupe specific scores. [16:37:00] The primary task is not named because deduplication is unnecessary [16:37:24] notconfusing: Would we need an introduction still, to explain to labelers what an edit session is and how to evaluate? [16:37:41] I have that, let me pull it up. [16:38:06] awight, right, notconfusing and I already discussed that one. [16:38:08] awight, halfak: I'd appreciate your comments https://www.mediawiki.org/wiki/ORES/Sessions [16:38:34] Ahh. That is useful. But it'd be better to make a page on the local wikis involved. [16:38:42] It's really good to include a sign-up list. [16:39:05] We can then use that sign-up list to ping people with status updates and draw them back to labeling work. [16:46:55] OK, I'll make a similar page on both en, and fr, and I'll include a sign-up list. [16:46:59] thanks for the tip [16:48:15] Check out the example I gave from enwiki. I used that page to ping people and deliver status updates on the talk page. [16:48:24] 10Scoring-platform-team (Current), 10Wikilabels: Extend wikilabels to support session-labelling - https://phabricator.wikimedia.org/T201370 (10notconfusing) ## TODO Aug 27 + (Done) I18n'ize, the revision tags ## TODO Oct 3 + Make a page on the local wikis involved. + It's really good to include a sign-up li... [17:07:36] PROBLEM - check load on ORES-redis02.experimental is WARNING: Could not resolve hostname ores-redis-02.ores.eqiad.wmflabs: Name or service not known [17:07:36] PROBLEM - check disk on ORES-web02.Experimental is WARNING: Could not resolve hostname ores-web-02.ores.eqiad.wmflabs: Name or service not known [17:07:36] PROBLEM - ssh on ORES-redis02.experimental is UNKNOWN: Usage:check_ssh [-4 [17:08:51] PROBLEM - ssh on ORES-redis02.experimental is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:08:52] RECOVERY - Host ORES-web01.Experimental is UP: PING OK - Packet loss = 0%, RTA = 2.44 ms [17:08:56] PROBLEM - check users on ORES-web02.Experimental is UNKNOWN: [17:08:56] PROBLEM - check disk on ORES-web01.Experimental is UNKNOWN: [17:09:03] PROBLEM - puppet on ORES-redis02.experimental is UNKNOWN: [17:09:14] PROBLEM - check load on ORES-web01.Experimental is UNKNOWN: [17:09:14] RECOVERY - ping4 on Experimental ORES Website is OK: PING OK - Packet loss = 0%, RTA = 2.24 ms [17:09:20] PROBLEM - check disk on ORES-web02.Experimental is UNKNOWN: [17:09:22] RECOVERY - Host ORES-worker02.experimental is UP: PING OK - Packet loss = 0%, RTA = 3.36 ms [17:09:28] RECOVERY - Host ORES-worker01.experimental is UP: PING OK - Packet loss = 0%, RTA = 1.62 ms [17:09:31] RECOVERY - ping4 on ORES-web02.Experimental is OK: PING OK - Packet loss = 0%, RTA = 1.37 ms [17:09:49] Is there a standard way to read task results from Wikilabels, or is it basically just reading the raw data from Mysql? Amir1? [17:10:00] PROBLEM - puppet on ORES-worker01.experimental is UNKNOWN: [17:10:01] PROBLEM - puppet on ORES-web02.Experimental is UNKNOWN: [17:10:10] PROBLEM - check disk on ORES-worker01.experimental is UNKNOWN: [17:10:15] notconfusing: you can get it from the API [17:10:17] PROBLEM - check users on ORES-worker01.experimental is UNKNOWN: [17:10:18] PROBLEM - check load on ORES-web02.Experimental is UNKNOWN: [17:10:21] PROBLEM - check disk on ORES-redis02.experimental is UNKNOWN: [17:10:22] RECOVERY - ping4 on ORES-worker02.experimental is OK: PING OK - Packet loss = 0%, RTA = 1.14 ms [17:10:26] let me find the route [17:10:26] PROBLEM - check load on ORES-worker02.experimental is UNKNOWN: [17:10:33] PROBLEM - check users on ORES-web01.Experimental is UNKNOWN: [17:10:33] PROBLEM - check users on ORES-redis02.experimental is UNKNOWN: [17:10:33] PROBLEM - check disk on ORES-worker02.experimental is UNKNOWN: [17:10:36] PROBLEM - check load on ORES-worker01.experimental is WARNING: Could not resolve hostname ores-worker-01.ores.eqiad.wmflabs: Name or service not known [17:10:37] PROBLEM - puppet on ORES-worker02.experimental is UNKNOWN: [17:10:46] PROBLEM - check load on ORES-redis02.experimental is UNKNOWN: [17:10:55] PROBLEM - check users on ORES-web02.Experimental is WARNING: Could not resolve hostname ores-web-02.ores.eqiad.wmflabs: Name or service not known [17:11:09] PROBLEM - check load on ORES-web01.Experimental is WARNING: Could not resolve hostname ores-web-01.ores.eqiad.wmflabs: Name or service not known [17:11:19] notconfusing: https://labels.wmflabs.org/campaigns/enwiki/82/?tasks [17:11:22] example [17:11:53] ty! [17:13:31] PROBLEM - check load on ORES-worker01.experimental is UNKNOWN: [17:13:36] yw [17:13:55] PROBLEM - check users on ORES-web02.Experimental is UNKNOWN: [17:14:03] PROBLEM - check load on ORES-web01.Experimental is UNKNOWN: [17:27:18] I'm leaving for the day [17:27:27] see you tomorrow, won't work much tomorrow though [17:31:24] o/ [17:33:46] Oh, I'm sorry that Amir just left. I had some campaigns on labels-experiment that don't appear to be there any more. [17:36:59] notconfusing: I think I have access if you need debugging or deployment help. [17:39:12] thanks i'll ping you as needed [17:42:09] notconfusing: I think I see your campaigns. [17:42:27] e.g. 47 | جلسات المستخدمين الجدد (تجربة 1) | arwiki | damaging_and_goodfaith | MultiDiffToPrevious | 2018-09-10 03:37:59.196023 | 1 | 10 | t | [17:42:37] 40 | Sesiones de usarios nuevos (Ensayo 1) | eswiki | damaging_and_goodfaith | MultiDiffToPrevious | 2018-09-10 03:23:15.173962 | 1 | 10 | t | [17:43:09] the .active column is true for those, fwiw [17:43:39] What's the public FQDN for this box? [17:43:57] labels-experiment.wmflabs.org [17:44:23] https://labels-experiment.wmflabs.org/campaigns/eswiki/ [17:44:44] Oh, yes, I see why. Is there any way to see all the campaigns at once? [17:45:07] Answer yes, don't provide a wikiname. OK thanks [17:45:15] I don't think so [17:53:29] I'm looking to do a wikilabels deployment today. [17:53:34] notconfusing, ^ FYI [17:54:06] Ok, that's great, that means that MultiDiffToPrevious should be in there, right? [17:55:33] It will be, yes. I'll be doing this at 1PM PDT [17:55:42] taking lunch now [18:06:57] ACKNOWLEDGEMENT - check load on ORES-redis02.experimental is UNKNOWN: paladox ack [18:06:57] ACKNOWLEDGEMENT - check load on ORES-worker01.experimental is UNKNOWN: paladox ack [18:06:57] ACKNOWLEDGEMENT - check load on ORES-web01.Experimental is UNKNOWN: paladox ack [18:06:58] ACKNOWLEDGEMENT - check users on ORES-web02.Experimental is UNKNOWN: paladox ack [18:06:59] ACKNOWLEDGEMENT - check users on ORES-redis02.experimental is UNKNOWN: paladox ack [18:07:00] ACKNOWLEDGEMENT - ssh on ORES-web01.Experimental is CRITICAL: CRITICAL - Socket timeout after 10 seconds paladox ack [18:07:00] ACKNOWLEDGEMENT - puppet on ORES-worker02.experimental is UNKNOWN: paladox ack [18:07:01] ACKNOWLEDGEMENT - ssh on ORES-redis02.experimental is CRITICAL: CRITICAL - Socket timeout after 10 seconds paladox ack [18:07:02] ACKNOWLEDGEMENT - ssh on ORES-worker01.experimental is CRITICAL: CRITICAL - Socket timeout after 10 seconds paladox ack [18:07:14] ACKNOWLEDGEMENT - check disk on ORES-redis02.experimental is UNKNOWN: paladox Ack [18:07:14] ACKNOWLEDGEMENT - check disk on ORES-web02.Experimental is UNKNOWN: paladox Ack [18:07:15] ACKNOWLEDGEMENT - check disk on ORES-worker01.experimental is UNKNOWN: paladox Ack [18:07:15] ACKNOWLEDGEMENT - check disk on ORES-worker02.experimental is UNKNOWN: paladox Ack [18:07:17] ACKNOWLEDGEMENT - check load on ORES-web02.Experimental is UNKNOWN: paladox Ack [18:07:17] ACKNOWLEDGEMENT - check load on ORES-worker02.experimental is UNKNOWN: paladox Ack [18:07:18] ACKNOWLEDGEMENT - check users on ORES-worker01.experimental is UNKNOWN: paladox Ack [18:07:19] ACKNOWLEDGEMENT - check users on ORES-web01.Experimental is UNKNOWN: paladox Ack [18:07:20] ACKNOWLEDGEMENT - puppet on ORES-web02.Experimental is UNKNOWN: paladox Ack [18:07:21] ACKNOWLEDGEMENT - puppet on ORES-worker01.experimental is UNKNOWN: paladox Ack [18:07:26] ACKNOWLEDGEMENT - check disk on ORES-web01.Experimental is UNKNOWN: paladox ack [18:07:26] ACKNOWLEDGEMENT - puppet on ORES-redis02.experimental is UNKNOWN: paladox ack [18:07:26] ACKNOWLEDGEMENT - check users on ORES-worker02.experimental is UNKNOWN: paladox ack [18:07:26] ACKNOWLEDGEMENT - puppet on ORES-web01.Experimental is UNKNOWN: paladox ack [18:07:36] oh my 43 pings [18:40:29] o/ [19:10:56] ohey [19:17:07] Apparently ORES considers the main page of English Wikipedia to be a stub. [19:22:51] :) [19:23:02] It's best to be objective about these things [19:38:30] 10Scoring-platform-team (Current), 10JADE, 10SpamBlacklist: SpamBlacklist integration for JADE - https://phabricator.wikimedia.org/T206255 (10awight) [19:39:39] 10Scoring-platform-team (Current), 10JADE, 10SpamBlacklist: SpamBlacklist integration for JADE - https://phabricator.wikimedia.org/T206255 (10Harej) p:05Triage>03High [19:40:19] ty ^ [19:40:27] 10Scoring-platform-team (Current), 10JADE, 10SpamBlacklist: SpamBlacklist integration for JADE - https://phabricator.wikimedia.org/T206255 (10awight) p:05High>03Triage [19:44:24] awight: did you intend to change the priority to needs triage? [19:44:27] 10Scoring-platform-team (Current), 10DBA, 10JADE, 10Operations, and 3 others: Write our anticipated "phase two" schemas and submit for review - https://phabricator.wikimedia.org/T202596 (10awight) [19:44:38] harej: no, it must have been an edit conflict [19:44:55] Thanks for flagging! [19:45:07] I like this ordering glitch, > raised the priority of this task from High to Needs Triage [19:45:26] 10Scoring-platform-team (Current), 10JADE, 10SpamBlacklist: SpamBlacklist integration for JADE - https://phabricator.wikimedia.org/T206255 (10awight) p:05Triage>03High [19:45:54] harej: Where should we put "done" tasks on the JADE board? For example, T206037 is done for JADE but still open for ORES. [19:45:57] T206037: Rename articlequality and itemquality to "contentquality" - https://phabricator.wikimedia.org/T206037 [19:46:04] Review? [19:46:43] It's merged, though. I took a shortcut and removed the JADE tag, feel free to say I shouldn't be doing that. [19:47:07] subtasks! [19:47:11] 10Scoring-platform-team, 10Growth-Team, 10MediaWiki-extensions-PageCuration, 10ORES, and 2 others: Rename articlequality and itemquality to "contentquality" - https://phabricator.wikimedia.org/T206037 (10awight) [19:47:12] One for JADE one for ORES [19:47:27] 10Scoring-platform-team (Current), 10JADE, 10MW-1.32-notes (WMF-deploy-2018-10-02 (1.32.0-wmf.24)), 10Patch-For-Review: Support namespace alias between Judgement: and Judgment: - https://phabricator.wikimedia.org/T205548 (10awight) 05Open>03Resolved [19:48:06] That would have been the right thing to do ;-) [19:55:17] 10Scoring-platform-team (Current), 10JADE, 10SpamBlacklist: SpamBlacklist integration for JADE - https://phabricator.wikimedia.org/T206255 (10Legoktm) As long as JADE is registering external links with ParserOutput in the standard way, there should be no extra changes needed for SpamBlacklist integration. [20:04:03] DEPLPOYMENT TIEME :D [20:16:18] notconf[TAB] ... damn [20:16:20] Just finished. [20:46:53] (03PS1) 10Awight: AbuseFilter integration test [extensions/JADE] - 10https://gerrit.wikimedia.org/r/464716 (https://phabricator.wikimedia.org/T201365) [20:48:07] 10Scoring-platform-team (Current), 10AbuseFilter, 10JADE, 10Patch-For-Review: AbuseFilter integration for JADE - https://phabricator.wikimedia.org/T201365 (10awight) Looks like text filtering will work out of the box. [20:48:43] (03CR) 10jerkins-bot: [V: 04-1] AbuseFilter integration test [extensions/JADE] - 10https://gerrit.wikimedia.org/r/464716 (https://phabricator.wikimedia.org/T201365) (owner: 10Awight) [20:49:12] 10Scoring-platform-team (Current), 10JADE, 10SpamBlacklist: SpamBlacklist integration for JADE - https://phabricator.wikimedia.org/T206255 (10awight) >>! In T206255#4643497, @Legoktm wrote: > As long as JADE is registering external links with ParserOutput in the standard way, there should be no extra changes... [20:50:33] (03CR) 10jerkins-bot: [V: 04-1] AbuseFilter integration test [extensions/JADE] - 10https://gerrit.wikimedia.org/r/464716 (https://phabricator.wikimedia.org/T201365) (owner: 10Awight) [20:50:40] (03PS2) 10Awight: AbuseFilter integration test [extensions/JADE] - 10https://gerrit.wikimedia.org/r/464716 (https://phabricator.wikimedia.org/T201365) [20:57:20] (03CR) 10jenkins-bot: Localisation updates from https://translatewiki.net. [extensions/JADE] - 10https://gerrit.wikimedia.org/r/464685 (owner: 10L10n-bot) [20:57:45] (03CR) 10Awight: "recheck" [extensions/JADE] - 10https://gerrit.wikimedia.org/r/464716 (https://phabricator.wikimedia.org/T201365) (owner: 10Awight) [21:37:35] o/ [21:43:21] notconfusing: hola. Looks like the wikilabels deployment went as planned, FYI. [21:43:28] halfak: I am clear to deploy newcomer sessions on wikilabels-02.wikilabels.eqiad.wmflabs? [21:44:03] Oops awight, you answered me. Is "-02" the right place? That's what I have in my history, can't quite remember why it was that one. [21:45:18] o/ notconfusing [21:45:18] ues [21:45:20] *yes [21:45:37] But you should let me walk you through it. I have some time now if you want to get on a call :) [21:47:11] Ok, no problem. Last time I followed Amir's instructions and it went well. https://wikitech.wikimedia.org/wiki/Wikilabels#A_new_labeling_campaign [21:47:22] But I'll also walk through it with you. [21:48:45] Na. That's OK then. Just so long as you have some experience. I'm just gonna take a quick snapshot backup :D [22:04:03] On production is it more than `wikilabels new_campaign ...` then `tasks | wikilabels task_inserts `? [22:04:05] https://www.mediawiki.org/wiki/ORES/Thresholds#Worked_example [22:04:14] nope. That'll work. [22:05:01] 10Scoring-platform-team, 10Growth-Team, 10ORES: RC filters: Un-scored Bot edits in Namespaces displayed with ORES full-coverage filters - https://phabricator.wikimedia.org/T206271 (10Etonkovidova) [22:05:13] awight, https://www.mediawiki.org/wiki/ORES/Thresholds#Worked_example [22:05:24] Feel free to edit! [22:05:47] oh hey [22:05:59] * halfak runs away [22:06:02] have a good evening :D [22:06:53] (03PS1) 10Awight: [WIP] Tests for SpamBlacklist integration [extensions/JADE] - 10https://gerrit.wikimedia.org/r/464727 (https://phabricator.wikimedia.org/T206255) [22:08:47] (03CR) 10jerkins-bot: [V: 04-1] [WIP] Tests for SpamBlacklist integration [extensions/JADE] - 10https://gerrit.wikimedia.org/r/464727 (https://phabricator.wikimedia.org/T206255) (owner: 10Awight) [22:10:22] (03CR) 10jerkins-bot: [V: 04-1] [WIP] Tests for SpamBlacklist integration [extensions/JADE] - 10https://gerrit.wikimedia.org/r/464727 (https://phabricator.wikimedia.org/T206255) (owner: 10Awight) [23:24:06] 10Scoring-platform-team (Current), 10JADE, 10SpamBlacklist, 10Patch-For-Review: SpamBlacklist integration for JADE - https://phabricator.wikimedia.org/T206255 (10awight) So far, it's looking like we'll need to mess with ParserOutput hooks. I don't understand what's involved yet, only that we're in an awkw... [23:40:57] OK, Sessions experiment is live and tested working!