[08:54:09] 10Scoring-platform-team, 10ORES, 10Quibble, 10Browser-Tests, and 4 others: Quibble must include tests/selenium/LocalSettings.php (was ORES webdriver.io selenium test fail on CI due to lack of ORES server) - https://phabricator.wikimedia.org/T198201 (10hashar) I have a patch for Quibble to make it include t... [10:09:46] o/ [10:10:05] (03CR) 10Ladsgroup: "I will merge this after the branch cut. I hope that's fine" [extensions/ORES] - 10https://gerrit.wikimedia.org/r/444252 (https://phabricator.wikimedia.org/T198748) (owner: 10Sbisson) [10:34:10] 10Scoring-platform-team, 10ORES, 10Quibble, 10Browser-Tests, and 4 others: Quibble must include tests/selenium/LocalSettings.php (was ORES webdriver.io selenium test fail on CI due to lack of ORES server) - https://phabricator.wikimedia.org/T198201 (10hashar) I thought about loadig `test/selenium/LocalSett... [12:26:46] 10Scoring-platform-team, 10MediaWiki-extensions-ORES, 10User-Ladsgroup: Write a maintaince script to populate wp10 data for articles - https://phabricator.wikimedia.org/T194300 (10Ladsgroup) [13:43:53] Amir1: You here? [13:53:01] hoo: was afk for lunch [13:53:03] now I am [13:54:17] Cool :) [13:54:30] Have you ever tried setting up https://github.com/wiki-ai/revscoring on Fedora? [13:54:49] I'm running into troubles probably related to the dictonaries [13:55:19] I wonder whether this is worth exploring further… or maybe I should just go for a Debian VM [14:01:23] Amir1: ^ [14:01:57] hoo: you need to install lots of dictionaries [14:02:06] I'd go with a VM or cloud VPS [14:02:14] (you can use stat machines) [14:07:36] i read the paper written by halfak et. al. it is good. it has some typos that should be uncovered from a read through. i don't have much to add. [14:12:56] o/ [14:13:07] * halfak packs for cape town ^_^ [14:13:31] halfak: is the sync meeting happening? [14:16:32] Yes. I'll be there. [14:16:35] Amir1, ^ [14:16:41] cool [14:23:08] halfak: i read your paper. it is good. it has some typos that should be uncovered from a read through. i don't have much to add. [14:23:11] Amir1: Ok, I'll go for a local VM then, for development [14:23:37] harej, glad you enjoyed it. Let me know if you want to chat about it. [14:24:23] halfak: I'm particularly pleased to see how in some ways what the ORES team did was the same as before but with the key difference that we are actively interested in feedback/improvements and with a more diverse perspective than sheer quality control. we cultivated community around reviewing the algorithms and we got results, e.g. the italian example [14:25:36] "cultivate" might be a gracious description too. It more happened on its own and we embraced it. [14:26:16] well, you and the rest of the team actively responded to criticism and feedback in a way that was productive. this doesn't happen by accident [14:26:35] Right [14:39:48] harej: https://tools.wmflabs.org/ores-support-checklist/ is back online. Sorry for that, I missed the ping and was on vacation [14:57:52] RoanKattouw: I'm going to disable rc filters for enwiki in beta cluster now for a small period of time to test https://phabricator.wikimedia.org/T198358 [14:58:47] Amir1: sounds good to me, just remember to turn it back on :) [14:59:09] Elena and I are both traveling to Wikimania tomorrow, so if you forget nobody will notice for some time :D [14:59:20] Sure thing :))) [14:59:39] Also thanks for merging my patch on core about Special:Tags, that would solve lots of slow queries [15:02:20] Amir1: oh hi! [15:02:25] https://gerrit.wikimedia.org/r/#/projects/mediawiki/extensions/JADE,dashboards/default [15:03:51] harej: Just to be sure, you have CR+2 in ext-JADE right? [15:05:37] I don't. It may be nice to have, but I am not sure how much active code review I'll be doing. [15:05:59] Strange, I never understand gerrit perms [15:08:10] (03CR) 10Awight: [C: 032] "Self-merging per upgrading harej's +1" [extensions/JADE] - 10https://gerrit.wikimedia.org/r/443649 (owner: 10Awight) [15:08:23] (03CR) 10Awight: [C: 032] "Self-merging per upgrading harej's +1" [extensions/JADE] - 10https://gerrit.wikimedia.org/r/445637 (owner: 10Awight) [15:41:32] awight: Sure thing! [15:45:05] :D Hope your vacation was refreshing... [15:47:11] It was with great beers [15:57:46] https://etherpad.wikimedia.org/p/scoring_current_work [15:58:37] https://etherpad.wikimedia.org/p/scoring_platform [15:58:43] ^ relevant people: please look/update as needed [16:02:28] Amir1: Sounds refreshing indeed! [16:04:37] 10Scoring-platform-team, 10ORES, 10Quibble, 10Browser-Tests, and 4 others: Quibble must include tests/selenium/LocalSettings.php (was ORES webdriver.io selenium test fail on CI due to lack of ORES server) - https://phabricator.wikimedia.org/T198201 (10hashar) @SBisson nop it is broken for good. There are a... [16:08:34] 10Scoring-platform-team (Current), 10Wikidata, 10User-Ladsgroup: Run analysis of revert time and number changes over time for wikidata - https://phabricator.wikimedia.org/T189962 (10Halfak) This is great. Please graph the results, write a report, and give a description of the weirdness in Spanish's dump fil... [16:46:22] hey awight! [16:46:54] Casey was asking if you put in the request for a yubikey with OIT? [16:51:09] I'm going afk for the second lunch as I'm starving (point the stupid person who chose greek salad for lunch) [17:10:16] notconfusing, https://bitbucket.org/grouplens/snuggle/src/f1259a9a14224db1dd62b5943cde788ca8d01a02/snuggle/util/desirability.py?at=default&fileviewer=file-view-default [17:10:26] This is the code that implements the desirability prediction [17:10:47] It includes some hard-coded values from fitting beta distributions (see the paper) [17:23:53] oh i see. [17:24:37] halfak, does this mean that internaltionalizng snuggle would not be easy, since retraining on other languages would be not as simple as using a different ORES model? [17:25:12] Right. In fact, every time we deploy a new ORES model, we'll want to re-fit the distribution. [17:25:31] I undestand that to deploy a new ORES model you [17:25:33] So, e.g. when the model version of enwiki-goodfaith changes [17:25:35] 'd want to retrain [17:25:36] back [17:26:21] On the other hand, we might get decent fitness by just averaging across scores and sorting based on that average :\ [17:26:21] but it would be even more difficult for snuggle, because retraining snuggle on a new language doesn't have the pipeline infrastructure that ORES has? [17:26:28] Not sure if such a naive strategy would work well. [17:26:40] Right. No pipeline for Snuggle (yet) [17:28:56] Hrm... well Nate Mathias is really banking on deploying snuggle in 4 new languages for CivilServant, and that looks likes its going to have challenges either in 1) creating a snuggle training pipeline or 2) having snuggle consuming a meta-model based on ORES. [17:29:28] notconfusing, we don't need to solve all human maintenance problems in order to deploy. [17:29:28] Since I will have to do one of those things anyway, I wonder which one would have the most value to the scoring team. [17:29:50] An ORES meta-model would be an interesting potential approach. [17:31:08] If you make the Snuggle training pipeline something that can be re-used by HostBot, that would be valuable to us too [17:31:15] so you're saying that just manually finding some good /beta values will be sufficient [17:31:52] Right so I don't think this is a blocker to the CS use-case [17:31:56] I see [17:32:28] But it is a good opportunity for Nathan et al. to not get stuck with maintenance/the shame of deploying an unmaintained tool. [17:33:58] What is a good opportunity? Creating a) finding manual /beta values, or b) creating a snuggle training pipeline that can be re-used by HostBot? [17:34:43] Both, I guess. (a) is better for ORES long-term but it is a bit more of an engineering overhead. [17:34:56] And I have some unknowns :| [17:35:07] I think it is do-able. [17:35:34] You'll need to dig deep into ORES dependency solving system, but the system isn't as deep as you might expect/worry. [17:37:57] RoanKattouw: The revert is now merged and will be there in half an hour :) [17:40:15] halfak, did you mean (b) is better in the long-term? i can't see how finding manual values for an unrelated model could be beneficial at all for ORES? [17:41:40] Oh sorry. I meant consuming the meta-model is best long-term. [17:41:54] Creating a re-usable pipeline is second best. [17:42:06] I would like to do (b) because that seems like I can help both CS and WMF foundation at once. I just have to make sure I'm not biting off more than I can chew. [17:42:10] Just doing the math and hard coding is a sad, but easy third best. [17:42:45] notconfusing, maybe we can dig this ditch for a bit to see how it goes and fall back on hard-coding if it looks like we can't complete it in time for the experiments. [17:42:57] Either way, that'll be good for long-term Snuggle maintenance. [17:43:08] OK I like that plan. [17:43:58] Also, general +1 for finding overlap between CS and ORES. good thinking :) [17:45:30] ^_^/ [17:54:45] I need to fo run an errand before I head to the airport. [17:54:56] I'll log on with my phone but I'll be partially AFK for a while [17:56:48] halfak, no problem what i'll work on this week is reading into the snuggle paper and codebase, and then try to put together a small prototype of how ORES (features or predictions not sure yet) could be used for similar predicitons). [18:06:50] Sounds good. If you get bored and have more time before we can talk again, check out the dependency injection system in revscoring [18:07:22] There's a feature engineering ipython notebook in the revscoring repo [18:54:30] (03PS3) 10Awight: Rename namespace from Jade to Judgment [extensions/JADE] - 10https://gerrit.wikimedia.org/r/443649 [18:55:12] (03CR) 10Awight: [C: 032] Rename namespace from Jade to Judgment [extensions/JADE] - 10https://gerrit.wikimedia.org/r/443649 (owner: 10Awight) [19:01:32] (03Merged) 10jenkins-bot: Rename namespace from Jade to Judgment [extensions/JADE] - 10https://gerrit.wikimedia.org/r/443649 (owner: 10Awight) [19:02:51] (03CR) 10jenkins-bot: Rename namespace from Jade to Judgment [extensions/JADE] - 10https://gerrit.wikimedia.org/r/443649 (owner: 10Awight) [19:41:22] (03PS1) 10MaxSem: Disable failing test that prevents merges across WMF-deployed repos [extensions/ORES] - 10https://gerrit.wikimedia.org/r/446095 (https://phabricator.wikimedia.org/T198201) [19:47:44] (03CR) 10Mooeypoo: [C: 032] Disable failing test that prevents merges across WMF-deployed repos [extensions/ORES] - 10https://gerrit.wikimedia.org/r/446095 (https://phabricator.wikimedia.org/T198201) (owner: 10MaxSem) [19:50:56] (03Merged) 10jenkins-bot: Disable failing test that prevents merges across WMF-deployed repos [extensions/ORES] - 10https://gerrit.wikimedia.org/r/446095 (https://phabricator.wikimedia.org/T198201) (owner: 10MaxSem) [19:52:28] (03CR) 10jenkins-bot: Disable failing test that prevents merges across WMF-deployed repos [extensions/ORES] - 10https://gerrit.wikimedia.org/r/446095 (https://phabricator.wikimedia.org/T198201) (owner: 10MaxSem) [20:52:39] (03CR) 10jenkins-bot: Localisation updates from https://translatewiki.net. [extensions/JADE] - 10https://gerrit.wikimedia.org/r/446145 (owner: 10L10n-bot) [20:59:05] (03CR) 10jenkins-bot: Localisation updates from https://translatewiki.net. [extensions/ORES] - 10https://gerrit.wikimedia.org/r/446158 (owner: 10L10n-bot) [21:14:26] 10Scoring-platform-team (Current), 10JADE: JADE pages on beta no longer render - https://phabricator.wikimedia.org/T199750 (10awight) p:05Triage>03Normal [21:27:22] 10Scoring-platform-team (Current), 10JADE: JADE pages on beta no longer render - https://phabricator.wikimedia.org/T199750 (10awight) 05Open>03Resolved I don't like it, but the solution was to overwrite the page with new content... [21:27:24] 10Scoring-platform-team (Current), 10JADE: Deploy JADE prototype in Beta Cluster - https://phabricator.wikimedia.org/T176333 (10awight) [23:16:56] (03PS13) 10Sbisson: Introducing DatabaseQueryBuilder [extensions/ORES] - 10https://gerrit.wikimedia.org/r/444252 (https://phabricator.wikimedia.org/T198748)