[05:57:56] I did a little exercise on the balance / fairness tradeoff [05:57:57] http://localhost:8080/illustrating-the-tradeoff-between-balance-and-calibration.html [05:58:00] oops [05:58:00] wrong link [05:59:03] https://teblunthuis.cc/illustrating-the-tradeoff-between-balance-and-calibration.html [06:09:47] this was inspired by the Heindorf paper, which rubbed me the wrong way pretty badly [06:10:37] but I got some feedback on the previous memo requesting more explanation of the calibration / balance tradeoff [13:29:43] o/ [14:03:05] \o [14:03:10] Technical Advice IRC meeting starting in 60 minutes in channel #wikimedia-tech, hosts: @tgr & @chiborg - all questions welcome, more infos: https://www.mediawiki.org/wiki/Technical_Advice_IRC_Meeting [14:07:59] 10Scoring-platform-team (Current), 10Wikilabels, 10articlequality-modeling, 10User-Sebastian_Berlin-WMSE, and 2 others: Build article quality model for svwiki - https://phabricator.wikimedia.org/T202202 (10Halfak) Sorry for the delay. I've been on vacation for almost a week. I'll be looking to get this d... [14:21:10] 10Scoring-platform-team, 10Edit-Review-Improvements-Integrated-Filters, 10Growth-Team, 10Patch-For-Review: Enable ORES RCFilters for German Wikipedia (dewiki) - https://phabricator.wikimedia.org/T215354 (10Halfak) You can get fitness statistics directly from the service. Here's some relevant statistics fo... [14:52:37] Technical Advice IRC meeting starting in 10 minutes in channel #wikimedia-tech, hosts: @tgr & @chiborg - all questions welcome, more infos: https://www.mediawiki.org/wiki/Technical_Advice_IRC_Meeting [15:28:58] groceryheist, https://groups.uni-paderborn.de/fg-engels/publications_pdfs/Konferenzbeitraege/heindorf2019_WWW.pdf [15:34:28] groceryheist, standup! [15:47:20] Hi everyone, I was wondering if someone could tell me if the damaging model is trained, in addition to human judgement, on any kind of features (e.g. something similar to the articlequality model analyzing structural characteristics) [16:02:22] halfak: ^ you might know more? [16:05:54] Here's a good way to get a sense for the features of a model: https://ores.wikimedia.org/v3/scores/enwiki/56782332/damaging?features [16:05:57] thresholdT, ^ [16:06:29] These are the "base features" before they get scaled (e.g. log()) or divided by each other (e.g. words_added/total_words). [16:06:49] They are a lot easier to interpret in this "base" form. [16:07:03] If you want the *real* feature list, you'll want to get them from one of our repos. I can show you how to do that. [16:07:18] Oh that's perfect [16:08:15] I believe this is already enough, thank you! [16:09:18] By the way, people at the CHI were really curious to learn about our interface PreCall, we got some great feedback! [17:51:19] Hernán and Robins "Causal Inference" [17:51:26] https://academic.oup.com/aje/article/173/7/761/103691 [17:51:44] \o/ That's great to hear thresholdT! [17:51:54] (Sorry I didn't see your response earlier. Jumped into a meeting) [17:59:53] Aha! It's BS time. I'll jump in for that. [18:20:33] halfak: no worries, see you soon! [18:30:38] groceryheist: We used to collect data on how much each filter was used, but I turned it off a few months ago because nobody had been using this data for over a year [18:32:40] RoanKattouw: ah, well, Good news! I want to take look! It's too bad that it was turned off though since I'll want to look at some of the wikis that only recently enabled the feature. [18:39:01] Hmm I might not have turned all of it off, lemme look [18:39:52] The ChangesListFilters schema is no longer used, but ChangesListFilterGrouping looks like it should still be collecting data [18:40:03] I don't have acecss to the Hadoop cluster though so I can't see what data is there [20:37:20] (03PS1) 10Catrope: Remove all reference to rcenhancedfilters [extensions/ORES] - 10https://gerrit.wikimedia.org/r/508931 (https://phabricator.wikimedia.org/T196033) [20:38:54] (03PS2) 10Catrope: Remove all references to rcenhancedfilters [extensions/ORES] - 10https://gerrit.wikimedia.org/r/508931 (https://phabricator.wikimedia.org/T196033) [20:54:10] (03CR) 10Jforrester: [C: 03+2] Remove all references to rcenhancedfilters [extensions/ORES] - 10https://gerrit.wikimedia.org/r/508931 (https://phabricator.wikimedia.org/T196033) (owner: 10Catrope) [21:12:29] (03Merged) 10jenkins-bot: Remove all references to rcenhancedfilters [extensions/ORES] - 10https://gerrit.wikimedia.org/r/508931 (https://phabricator.wikimedia.org/T196033) (owner: 10Catrope) [21:15:12] (03CR) 10jenkins-bot: Remove all references to rcenhancedfilters [extensions/ORES] - 10https://gerrit.wikimedia.org/r/508931 (https://phabricator.wikimedia.org/T196033) (owner: 10Catrope)