[04:01:18] Amir1: https://phabricator.wikimedia.org/T168075 [04:01:18] Can you? [04:02:08] mavrikant_: I will but I don't have access until the next week [04:02:17] so if someone else can do it, it's faster [04:02:39] maybe halfak? [08:34:42] 10Scoring-platform-team-Backlog, 10ORES, 10Patch-For-Review: Stress/capacity test new ores* cluster - https://phabricator.wikimedia.org/T169246#3419654 (10akosiaris) >>! In T169246#3415722, @Halfak wrote: > Great! We'll need a nice way to send the requests and we'll probably want a stupid round-robin strate... [08:42:10] 10Scoring-platform-team, 10Wikilabels: [Discuss] Wikilabels routes refactor - https://phabricator.wikimedia.org/T165046#3419688 (10Pginer-WMF) >>! In T165046#3415745, @Halfak wrote: > It's interesting that you raise this issue. I've not heard from any users that it was a confusing concept. Is having "workset... [09:32:32] 10Scoring-platform-team, 10Bad-Words-Detection-System, 10revscoring, 10artificial-intelligence: Add language support for Albanian - https://phabricator.wikimedia.org/T168369#3419921 (10Arianit) Hi, we're done, please see here https://www.mediawiki.org/wiki/Research:Revision_scoring_as_a_service/Word_lists/... [14:03:19] o/ [14:14:15] (03PS2) 10Gergő Tisza: Remove cached scores when corresponding recentchanges rows are purged [extensions/ORES] - 10https://gerrit.wikimedia.org/r/351147 (https://phabricator.wikimedia.org/T159753) [14:20:09] 10Scoring-platform-team, 10Analytics, 10EventBus, 10ORES, and 3 others: Emit revision-score event to EventBus and expose in EventStreams - https://phabricator.wikimedia.org/T167180#3420786 (10Ottomata) > We don't emit revision-create events in EventStreams at all right now We do now! T167670 Any thoughts... [14:39:39] 10Scoring-platform-team, 10MediaWiki-extensions-ORES, 10MW-1.30-release-notes (WMF-deploy-2017-06-27_(1.30.0-wmf.7)), 10Patch-For-Review, and 2 others: [Discuss] Make ORES Review Tool preferences more prominent - https://phabricator.wikimedia.org/T167910#3420862 (10Halfak) As an example, we've released a "... [15:47:13] 10Scoring-platform-team, 10draftquality-modeling, 10artificial-intelligence: Experiment with Sentiment score feature for draftquality - https://phabricator.wikimedia.org/T167305#3421289 (10awight) Here are the long promised stats for a model trained with the sentiment patch, ``` bzcat datasets/enwiki.draft_... [15:50:22] halfak: I was hoping to start a thread about the language we use to describe what were doing differently than the mainstream of AI practice. [15:50:34] "ethical" presses some of the wrong buttons for me [15:50:52] I'm also interested in understanding what else might be unique about our research. [15:52:05] I assume the level of transparency is similar across academia? Or are we off the bell curve for that as well? [15:52:33] way off the bell curve [15:52:38] :-) [15:53:02] My problem with "ethics" is that it doesn't begin to describe what we actually value, only that we're including moral calculus in our work. [15:53:33] Corporate ethicists can work on ethical application of nukes, for example. [15:53:49] I'm thinking what we really mean is more like "humanism"? [15:53:59] although that comes with its own baggage, of course. [15:55:13] Right. I don't like the stuff that comes with humanism. [15:55:29] Maybe we could somehow say something about distribution of power [15:55:57] Can you elaborate on which parts of humanism bother you? [15:56:33] +1 to leveling power, but that will set off anticommunist dog whistles for a large number of people [15:57:58] Humanism has been adopted by political atheist organizations. I don't have any issue with those organizations. [15:58:10] I guess the association might raise questions. [15:58:13] But that's OK [15:58:22] e.g. https://americanhumanist.org/ [15:58:27] ah yeah that does seem like an issue [15:59:42] Vsya vlast sovyetam! [16:00:06] * awight quickly checks with communist translation engine [16:00:21] O_O [16:21:18] 10Scoring-platform-team, 10draftquality-modeling, 10artificial-intelligence: Experiment with Sentiment score feature for draftquality - https://phabricator.wikimedia.org/T167305#3421449 (10awight) Makefile I used for this fun: {F8691788} [16:24:11] 10Scoring-platform-team, 10draftquality-modeling, 10artificial-intelligence: Experiment with Sentiment score feature for draftquality - https://phabricator.wikimedia.org/T167305#3421459 (10awight) My patch to add the sentiment-laden feature list, ``` --- a/draftquality/feature_lists/enwiki.py +++ b/draftqua... [16:36:23] 10Scoring-platform-team-Backlog: ORES UI could accept more human-readable inputs such as pasted article links - https://phabricator.wikimedia.org/T170168#3421485 (10awight) [16:36:28] 10Scoring-platform-team-Backlog: ORES UI could accept more human-readable inputs such as pasted article links - https://phabricator.wikimedia.org/T170168#3421496 (10awight) p:05Triage>03Low [16:53:35] 10Scoring-platform-team: [Investigate] some revisions frequently return TaskRevokedError - https://phabricator.wikimedia.org/T169367#3421572 (10Halfak) [16:54:13] 10Scoring-platform-team: [Investigate] some revisions frequently return TaskRevokedError - https://phabricator.wikimedia.org/T169367#3396074 (10Halfak) 05Open>03Resolved [16:56:15] 10Scoring-platform-team, 10Documentation: Add ORES technical documentation - https://phabricator.wikimedia.org/T170069#3418525 (10Halfak) https://wikitech.wikimedia.org/wiki/ORES [16:57:24] 10Scoring-platform-team, 10ORES, 10Documentation, 10Epic: [Epic] Clean up ORES service documentation - https://phabricator.wikimedia.org/T148974#3421580 (10Halfak) [16:57:26] 10Scoring-platform-team, 10Documentation: Add ORES technical documentation - https://phabricator.wikimedia.org/T170069#3421579 (10Halfak) [17:00:50] 10Scoring-platform-team-Backlog, 10artificial-intelligence: Draft specification of article importance API - https://phabricator.wikimedia.org/T167362#3421593 (10Halfak) [17:02:42] * halfak wonders where fajne is [17:03:06] 10Scoring-platform-team, 10MediaWiki-JobQueue, 10ORES, 10Performance-Team, and 5 others: Job queue corruption after codfw switch over (Queue growth, duplicate runs) - https://phabricator.wikimedia.org/T163337#3421600 (10elukey) After a chat with the other opsens there seems to be an agreement on the first... [17:17:28] #wiki-ai / #mobrule :p [17:33:05] halfak: you mentioned testing the sentiment feature for editquality, is generating a tuning report for enwiki with sentiment sufficient for that? [17:33:44] Yup! [17:36:33] 10Scoring-platform-team, 10editquality-modeling, 10Spanish-Sites, 10artificial-intelligence: Train/test reverted model for Spanish Wikibooks - https://phabricator.wikimedia.org/T145428#3421798 (10MarcoAurelio) [17:38:07] 10Scoring-platform-team: Test draftquality sentiment feature on Editquality - https://phabricator.wikimedia.org/T170177#3421808 (10Sumit) [18:25:26] This Sandvig 2015 is a good read! [18:44:17] is there any command to run a single nosetest from revscoring? [19:05:44] nvm, got it [19:07:59] :P [19:13:26] 10Scoring-platform-team, 10DBA, 10articlequality-modeling, 10artificial-intelligence: [Discuss] Hosting the monthly article quality dataset on labsDB - https://phabricator.wikimedia.org/T146718#2669300 (10Halfak) https://quarry.wmflabs.org/query/20169 This table is now ready for use. [19:16:26] 10Scoring-platform-team, 10DBA, 10articlequality-modeling, 10artificial-intelligence: [Discuss] Hosting the monthly article quality dataset on labsDB - https://phabricator.wikimedia.org/T146718#3422327 (10Halfak) 05Open>03Resolved [19:18:30] 10Scoring-platform-team, 10Bad-Words-Detection-System, 10revscoring, 10artificial-intelligence: Add language support for Albanian - https://phabricator.wikimedia.org/T168369#3422336 (10Sumit) >>! In T168369#3419921, @Arianit wrote: > Hi, we're done, please see here https://www.mediawiki.org/wiki/Research:R... [19:18:36] 10Scoring-platform-team, 10Bad-Words-Detection-System, 10revscoring, 10artificial-intelligence: Add language support for Albanian - https://phabricator.wikimedia.org/T168369#3422337 (10Sumit) https://github.com/wiki-ai/revscoring/pull/335 [20:49:49] 10Scoring-platform-team, 10Analytics, 10EventBus, 10ORES, and 3 others: Emit revision-score event to EventBus and expose in EventStreams - https://phabricator.wikimedia.org/T167180#3422727 (10Ottomata) Just had a little chat with @halfak and @Pchelolo in IRC. We've actually discussed this before, back at... [21:03:44] 10Scoring-platform-team, 10Analytics, 10EventBus, 10ORES, and 3 others: Emit revision-score event to EventBus and expose in EventStreams - https://phabricator.wikimedia.org/T167180#3422762 (10mobrovac) Yes, that's what I had in mind should happen here. At some point in the discussion I think we started mix... [21:10:43] 10Scoring-platform-team: Add test to ensure timeout of functions taking too long - https://phabricator.wikimedia.org/T170205#3422785 (10Sumit) [21:10:52] 10Scoring-platform-team: Add test to ensure timeout of functions taking too long - https://phabricator.wikimedia.org/T170205#3422799 (10Sumit) https://github.com/wiki-ai/ores/pull/219 [21:11:26] 10Scoring-platform-team: Add test to ensure timeout of functions taking too long - https://phabricator.wikimedia.org/T170205#3422802 (10Sumit) [21:11:28] 10Scoring-platform-team, 10ORES, 10revscoring, 10artificial-intelligence: Why don't timeouts work during long regular expression matching? - https://phabricator.wikimedia.org/T168965#3422801 (10Sumit) [21:20:38] 10Scoring-platform-team, 10Analytics, 10EventBus, 10ORES, and 3 others: Emit revision-score event to EventBus and expose in EventStreams - https://phabricator.wikimedia.org/T167180#3422819 (10Ottomata) Yeah, time erases my memory. Good thing we have phabricator! Ok, I'll take a pass at the revision-score... [21:53:53] awight|lunch, when you are back, c an you help me with the feature parity thing? [21:54:23] I'll brb [21:54:40] solved the problem with overtraining, it was indeed leakage between test and train. tl/dr was basically non-deterministic generation of CV folds and spark's lazy-evaluation calculating the folds multiple times [22:07:55] Aha! I guess that makes sense. Sounds like it wasn't easy to debug [22:19:32] o/ fajne [22:19:40] I heard you got a chance to get lunch with awight :) [22:26:28] fajne, ready to try out some hyperparameter optimization? [22:58:09] halfak: returned! [22:58:46] Hey! I'm just about to head out. I've realized that I'm not as familiar with the ORES extension as I ought to be. [22:58:52] haha [22:58:56] I can sorta help [22:59:05] but sounds like we should wait until tomorrow? [23:00:10] 10Scoring-platform-team, 10MediaWiki-extensions-ORES, 10User-Ladsgroup: Make list of features and locations of ORES Review Tool for handoff - https://phabricator.wikimedia.org/T167911#3423172 (10Halfak) OK. So. For the UI, we have: * Special:Recentchanges (Filtering, highlighting) * Special:Watchlist (High... [23:00:17] I've posted what I know [23:00:24] Any bits you can fill in would be helpful :) [23:00:31] kk [23:01:02] Hey, make me an admin of the internal list, or maybe allow non-members to post in moderation? [23:01:39] non-members can post directly [23:01:49] as of an hour ago [23:01:51] :) [23:02:36] fyi, if it were up to me I'd say that RC filters is expected to have all the feature parity we need [23:02:51] but I'll go through the extension and document, if that's all we want. [23:03:48] awight, right. We're not *asking* for anything. Instead, we're helping the Collab team know what they need to do before they can "take over" deployments of any UI changes. [23:03:59] If they don't want to support something, that's fine. [23:04:10] Sounds right. [23:04:19] Forgot that we could reference https://www.mediawiki.org/wiki/Extension:ORES [23:15:37] who's seen https://en.wikipedia.org/wiki/Madea ? :) [23:20:39] I have not. Looks like it's not really up my alley [23:20:43] :) [23:20:57] lol [23:21:01] I've got to head out. Dog is going to murder me (via cute eyes). [23:21:03] o/ [23:21:23] halfak oh boy it was really funny [23:21:24] and ok [23:21:25] lol [23:25:11] got to commute and finish the day remotely. see ya! [23:27:11] 10Scoring-platform-team, 10MediaWiki-extensions-ORES, 10User-Ladsgroup: Make list of features and locations of ORES Review Tool for handoff - https://phabricator.wikimedia.org/T167911#3349300 (10awight) Neat! I just saw that the RC filters have been implemented in Extension:ORES, which makes migration simpl...