[06:33:15] 10Scoring-platform-team (Current): Investigate word2vec memory issues with multiprocessing - https://phabricator.wikimedia.org/T189364#4039997 (10Sumit) [06:39:05] 10Scoring-platform-team (Current): Investigate word2vec memory issues with multiprocessing - https://phabricator.wikimedia.org/T189364#4040009 (10Sumit) Test code for benchmarking vectorizers with a global keyed_vector in the file: ``` from multiprocessing import Pool, cpu_count import functools from revscoring... [06:47:03] 10Scoring-platform-team (Current): Investigate word2vec memory issues with multiprocessing - https://phabricator.wikimedia.org/T189364#4040012 (10Sumit) Test code for benchmarking using an word2vec as an external module contained in english_vectors: ``` from multiprocessing import Pool, cpu_count import functool... [07:00:29] 10Scoring-platform-team (Current), 10JADE, 10Security-Reviews: Security review for Extension:JADE - https://phabricator.wikimedia.org/T188308#4040024 (10Bawolff) a:03Bawolff [07:21:57] 10Scoring-platform-team (Current), 10JADE, 10Patch-For-Review: [Blocked] Deploy JADE prototype in Beta Cluster - https://phabricator.wikimedia.org/T176333#4040040 (10Bawolff) [07:21:57] 10Scoring-platform-team (Current), 10JADE, 10Security-Reviews: Security review for Extension:JADE - https://phabricator.wikimedia.org/T188308#4040037 (10Bawolff) 05Open>03Resolved Review passed. Some minor comments * "JudgmentValidator.php" line 172 - should probably be $wgContLang->ucfirst() unless yo... [07:41:51] 10Scoring-platform-team, 10editquality-modeling, 10artificial-intelligence: Complete edit quality campaign for Arabic Wikipedia - https://phabricator.wikimedia.org/T131669#4040045 (10alanajjar) Hello, Is there any help that I can do? [07:43:01] 10Scoring-platform-team, 10editquality-modeling, 10artificial-intelligence: Complete edit quality campaign for Arabic Wikipedia - https://phabricator.wikimedia.org/T131669#4040046 (10alanajjar) >>! In T131669#4039465, @Halfak wrote: > Hi @Ghassanmas! It looks like this campaign has stalled out at 53%. I th... [10:06:00] PROBLEM - https://grafana.wikimedia.org/dashboard/db/ores grafana alert on einsteinium is CRITICAL: CRITICAL: https://grafana.wikimedia.org/dashboard/db/ores is alerting: 5xx rate (Change prop) alert. [10:25:10] RECOVERY - https://grafana.wikimedia.org/dashboard/db/ores grafana alert on einsteinium is OK: OK: https://grafana.wikimedia.org/dashboard/db/ores is not alerting. [10:30:11] PROBLEM - https://grafana.wikimedia.org/dashboard/db/ores grafana alert on einsteinium is CRITICAL: CRITICAL: https://grafana.wikimedia.org/dashboard/db/ores is alerting: 5xx rate (Change prop) alert. [10:39:20] RECOVERY - https://grafana.wikimedia.org/dashboard/db/ores grafana alert on einsteinium is OK: OK: https://grafana.wikimedia.org/dashboard/db/ores is not alerting. [10:59:13] PROBLEM - https://grafana.wikimedia.org/dashboard/db/ores grafana alert on einsteinium is CRITICAL: CRITICAL: https://grafana.wikimedia.org/dashboard/db/ores is alerting: 5xx rate (Change prop) alert. [11:23:34] RECOVERY - https://grafana.wikimedia.org/dashboard/db/ores grafana alert on einsteinium is OK: OK: https://grafana.wikimedia.org/dashboard/db/ores is not alerting. [11:35:53] PROBLEM - https://grafana.wikimedia.org/dashboard/db/ores grafana alert on einsteinium is CRITICAL: CRITICAL: https://grafana.wikimedia.org/dashboard/db/ores is alerting: 5xx rate (Change prop) alert. [11:44:06] halfak|Network_d Amir1 ^^ [11:58:04] RECOVERY - https://grafana.wikimedia.org/dashboard/db/ores grafana alert on einsteinium is OK: OK: https://grafana.wikimedia.org/dashboard/db/ores is not alerting. [13:05:52] (03PS1) 10Umherirrender: Rename test classes to end with Test [extensions/JADE] - 10https://gerrit.wikimedia.org/r/418578 [13:13:03] PROBLEM - https://grafana.wikimedia.org/dashboard/db/ores grafana alert on einsteinium is CRITICAL: CRITICAL: https://grafana.wikimedia.org/dashboard/db/ores is alerting: 5xx rate (Change prop) alert. [13:27:13] RECOVERY - https://grafana.wikimedia.org/dashboard/db/ores grafana alert on einsteinium is OK: OK: https://grafana.wikimedia.org/dashboard/db/ores is not alerting. [13:30:34] PROBLEM - https://grafana.wikimedia.org/dashboard/db/ores grafana alert on einsteinium is CRITICAL: CRITICAL: https://grafana.wikimedia.org/dashboard/db/ores is alerting: 5xx rate (Change prop) alert. [13:46:43] RECOVERY - https://grafana.wikimedia.org/dashboard/db/ores grafana alert on einsteinium is OK: OK: https://grafana.wikimedia.org/dashboard/db/ores is not alerting. [15:29:32] 10Scoring-platform-team, 10ORES, 10Reading-Admin: Announce presence of "oresscores" in api.php - https://phabricator.wikimedia.org/T153688#4040264 (10dr0ptp4kt) I think that would be great, especially with a few cool examples - maybe show some stuff around the pageviews and ORES combined? [15:49:40] o/ [15:49:42] Been a long time since I've been around for the hack session. [15:49:44] I'm working on rebuilding for revscoring 2.2.0 :) [15:50:31] Looks like editquality is done :) [15:50:39] Now for draftquality and wikiclass. [16:17:20] 10Scoring-platform-team, 10editquality-modeling, 10artificial-intelligence: Complete edit quality campaign for Arabic Wikipedia - https://phabricator.wikimedia.org/T131669#4040337 (10Halfak) Hi @alanajjar! Thanks for chiming in. Right now, I think the labeling campaign needs another announcement / status u... [16:46:01] o/ Amir1 [16:46:15] Hey [16:46:16] Ahh. I see you're away. [16:46:21] Maybe not :) [16:46:29] Was just observing that the fawiki pilot is done. [16:46:39] \o/ [16:46:42] Do you want to do the next step? [16:46:49] Wondering if you have enough on your plate or not. [16:49:19] amir1: ^ [16:49:40] I don't have enough in my plate ^_^ [16:49:47] (hungry Amir) [16:51:02] lol [16:51:04] I change locations, will be back in a sec [16:51:07] it's a buffet :) [16:52:26] kk [16:52:29] :) [16:52:38] We have a HUGE buffet of work to do [16:52:40] Is common [18:34:24] 10Scoring-platform-team (Current): Investigate word2vec memory issues with multiprocessing - https://phabricator.wikimedia.org/T189364#4040486 (10Halfak) wow! So strange. Nice work on the test. Let's figure out a clean way to use a global. :) [18:53:19] halfak: i think the problem even with a global module is because of self.keyed_vectors = keyed_vectors, when we make vectors as data members we're making them part of the datasource object [18:53:31] this is avoided when a global word2vec is used [18:53:47] codezee, my thought is that globals are imported rather than serialized when pickling [18:54:27] In your scenario, you still assigned the value to a member, right? It was just also in global scope. [18:54:50] yes [18:55:59] halfak: btw, the first step in edittype will be repo setup like drafttopic, right? [19:15:02] i'll do that tomorrow, too sleepy now... Zzzzzz [21:39:11] (03CR) 10jenkins-bot: Localisation updates from https://translatewiki.net. [extensions/ORES] - 10https://gerrit.wikimedia.org/r/418662 (owner: 10L10n-bot)