[00:01:32] RoanKattouw "It doesn't even have to mean that A is more likely to be damaging than not damaging. ORES scores have" [00:01:38] Seems to cut off mid sentence [00:04:40] Whoops thanks, will fix [00:05:59] RoanKattouw: to oversimplify, could you call precision and recall the "false positive rate" and the "false negative rate" respectively? [05:53:39] harej: Not quite. The precision is the "true positive rate", or 100% minus the false positive rate. The recall is not at all like the "false negative rate", but more like the "coverage rate" (or 100% minus the "miss rate"). If you have a "may be bad faith" filter with 15% precision and 90% recall, that means that 15% of the results are truly bad faith edits (so the false positive rate is 85%), but that 90% of all bad faith edits are found by [05:53:39] the filter (and 10% are missed) [12:37:37] o/ getting started a bit early today [15:04:00] 10Scoring-platform-team, 10Analytics: [Discuss] ORES model development and deployment processes - https://phabricator.wikimedia.org/T216246 (10Halfak) [15:04:50] 10Scoring-platform-team, 10Analytics: [Discuss] ORES model development and deployment processes - https://phabricator.wikimedia.org/T216246 (10Halfak) In response to T214089#4954811: I think that we build models in hadoop is an excellent proposal. Regretfully, it's very painful as a developer to do something... [15:07:29] 10Scoring-platform-team, 10Analytics: [Discuss] ORES model development and deployment processes - https://phabricator.wikimedia.org/T216246 (10Halfak) [15:15:06] 10Scoring-platform-team (Current), 10Wikilabels, 10articlequality-modeling, 10artificial-intelligence: Build article quality model for Galician Wikipedia - https://phabricator.wikimedia.org/T201146 (10Halfak) The scale is from 1 to 6. See https://gl.wikipedia.org/wiki/Usuario:Elisardojm/ArticleQuality.js... [15:16:03] 10Scoring-platform-team (Current), 10Edit-Review-Improvements-Integrated-Filters, 10editquality-modeling, 10Growth-Team (Current Sprint), and 2 others: Enable ORES filters on RC for Italian Wikipedia - https://phabricator.wikimedia.org/T211032 (10Halfak) We're delayed on getting this deployment out the doo... [15:21:24] OK! I think I'm out of the forest. Now for new work. [15:53:13] Is reading the “op-ed” worth the energy it would take? I’m happy to read upsetting things if it will help me in my job. [19:20:26] 10ORES, 10Scoring-platform-team, 10Operations, 10Release Pipeline, 10Release-Engineering-Team (Backlog): The continuous release pipeline should support more than one service per repo - https://phabricator.wikimedia.org/T210267 (10thcipriani) [19:38:51] harej: Kudpung's op-ed is gross, almost tabloid journalism. If you do read it, keep in mind that the experiment never happened, because the researchers asked for feedback and learned they shouldn't do the study as designed. Which would have been a legitimate article. [19:45:03] Right. It was definitely a *good* example of research/wikipedian interactions -- at least for the researchers' behaviors. [19:45:24] The pitchforks coming out around this is just crazy. [19:52:54] 10Scoring-platform-team, 10Analytics: [Discuss] ORES model development and deployment processes - https://phabricator.wikimedia.org/T216246 (10Halfak) [19:53:31] 10ORES, 10Scoring-platform-team: Finish editquality labeling campaign for fiwiki - https://phabricator.wikimedia.org/T215359 (10Halfak) [19:54:41] 10Scoring-platform-team (Current), 10Wikilabels, 10articlequality-modeling, 10artificial-intelligence: Build article quality model for Galician Wikipedia - https://phabricator.wikimedia.org/T201146 (10Elisardojm) Oh, thanks! And..., I need more help...O:) Galician users don't wanted to activate the tool by... [19:54:50] 10ORES, 10Scoring-platform-team: Create new editquality labeling campaign for ruwiki - https://phabricator.wikimedia.org/T215358 (10Halfak) [19:54:59] 10ORES, 10Scoring-platform-team: Create new editquality labeling campaign for ruwiki - https://phabricator.wikimedia.org/T215358 (10Halfak) p:05Triage→03Normal [19:56:45] 10ORES, 10Scoring-platform-team, 10SEO: Add relevant search terms to ORES docs - https://phabricator.wikimedia.org/T179631 (10Halfak) p:05Triage→03Low [19:57:58] 10Scoring-platform-team (Current), 10Wikilabels, 10editquality-modeling, 10artificial-intelligence: Complete itwiki edit quality campaign - https://phabricator.wikimedia.org/T130265 (10Halfak) [19:58:33] 10Scoring-platform-team (Current), 10editquality-modeling, 10artificial-intelligence: Deploy edit quality models for itwiki - https://phabricator.wikimedia.org/T130286 (10Halfak) [19:59:06] 10Scoring-platform-team, 10WMF-Communications, 10artificial-intelligence: Pitch: How ML saved Wikipedia - https://phabricator.wikimedia.org/T187210 (10Halfak) 05Open→03Declined [19:59:22] 10Scoring-platform-team, 10editquality-modeling, 10artificial-intelligence: Complete edit quality campaign for Bengali Wikipedia - https://phabricator.wikimedia.org/T187339 (10Halfak) p:05Triage→03Normal [19:59:40] 10ORES, 10Scoring-platform-team, 10editquality-modeling, 10artificial-intelligence: arwiki goodfaith model is not usable - https://phabricator.wikimedia.org/T193905 (10Halfak) p:05Triage→03High [19:59:47] 10ORES, 10Scoring-platform-team, 10editquality-modeling, 10artificial-intelligence: arwiki goodfaith model is not usable - https://phabricator.wikimedia.org/T193905 (10Halfak) p:05High→03Low [20:00:00] 10ORES, 10Scoring-platform-team, 10editquality-modeling, 10artificial-intelligence: arwiki goodfaith model is not usable - https://phabricator.wikimedia.org/T193905 (10Halfak) p:05Low→03High [20:00:14] 10ORES, 10Scoring-platform-team: Finish editquality labeling campaign for fiwiki - https://phabricator.wikimedia.org/T215359 (10Halfak) p:05Triage→03Normal [20:00:28] 10ORES, 10Scoring-platform-team: Create new editquality labeling campaign for hewiki - https://phabricator.wikimedia.org/T215363 (10Halfak) p:05Triage→03Normal [20:02:00] 10ORES, 10Scoring-platform-team (Current): ORES vision blog post - https://phabricator.wikimedia.org/T141275 (10Halfak) 05Open→03Resolved [20:02:32] 10ORES, 10Scoring-platform-team, 10Russian-Sites: Announce deployment of articlequality models to ruwiki community - https://phabricator.wikimedia.org/T138623 (10Halfak) p:05Normal→03Low [20:03:00] 10Scoring-platform-team (Current), 10Wikimania-Hackathon-2018, 10articlequality-modeling, 10drafttopic-modeling, 10artificial-intelligence: Create gadgets to inspire the use of ORES models - https://phabricator.wikimedia.org/T195116 (10Halfak) 05Open→03Resolved [20:03:31] 10Scoring-platform-team, 10Wikilabels, 10editquality-modeling, 10Spanish-Sites, 10artificial-intelligence: Edit quality campaign for Spanish Wikiversity - https://phabricator.wikimedia.org/T209670 (10Halfak) p:05Triage→03Normal [20:03:49] 10Scoring-platform-team, 10Wikilabels, 10editquality-modeling, 10Spanish-Sites, 10artificial-intelligence: Create editquality campaign for Spanish Wikiversity - https://phabricator.wikimedia.org/T209670 (10Halfak) [20:05:02] 10ORES, 10Scoring-platform-team (Current), 10Documentation, 10Epic: [Epic] Clean up ORES documentation - https://phabricator.wikimedia.org/T148974 (10Halfak) [20:05:04] 10ORES, 10Scoring-platform-team, 10revscoring, 10artificial-intelligence, 10good first bug: Build a sketch of basic ORES model building patterns - https://phabricator.wikimedia.org/T148692 (10Halfak) 05Open→03Declined Doesn't seem relevant anymore. [20:06:50] 10MediaWiki-extensions-ORES, 10Scoring-platform-team, 10Global-Collaboration, 10Documentation: Document that the ORES UI can be disabled separately from the extension - https://phabricator.wikimedia.org/T182600 (10Halfak) p:05Triage→03Normal @Catrope & @ladsgroup, do you know if this is still relevant?... [20:07:43] 10Scoring-platform-team (Current), 10Wikilabels, 10edittypes-modeling: Complete enwiki edit types campaign - https://phabricator.wikimedia.org/T131260 (10Halfak) 05Open→03Resolved [20:08:46] 10ORES, 10Scoring-platform-team (Current), 10Documentation: Peer review ORES Feature Injection doc page - https://phabricator.wikimedia.org/T213207 (10Halfak) 05Open→03Resolved [20:10:27] 10ORES, 10Scoring-platform-team, 10Documentation: Gather announcement messages for confederates - https://phabricator.wikimedia.org/T211794 (10Halfak) [20:11:38] 10ORES, 10Scoring-platform-team, 10Documentation: Gather announcement messages for confederates - https://phabricator.wikimedia.org/T211794 (10Halfak) Here's an example of an announcement about ORES filter deployments: https://ro.wikipedia.org/w/index.php?title=Wikipedia:Cafenea&diff=11243229&oldid=11243062... [20:11:55] 10ORES, 10Scoring-platform-team, 10Documentation: Gather announcement messages for confederates - https://phabricator.wikimedia.org/T211794 (10Halfak) p:05Triage→03Normal [20:12:39] 10ORES, 10Scoring-platform-team: Validation for code generation inputs - https://phabricator.wikimedia.org/T214620 (10Halfak) p:05Triage→03Lowest [20:13:50] 10ORES, 10Scoring-platform-team, 10revscoring, 10Documentation, and 2 others: Improve revscoring READMEs - https://phabricator.wikimedia.org/T208338 (10Halfak) p:05Triage→03Normal [20:14:42] 10ORES, 10Scoring-platform-team (Current), 10Documentation, 10User-srodlund: Feedback on ORES threshold optimization docs - https://phabricator.wikimedia.org/T203505 (10Halfak) 05Open→03Resolved [20:20:20] 10Scoring-platform-team, 10revscoring, 10Chinese-Sites, 10artificial-intelligence: Chinese language utilities - https://phabricator.wikimedia.org/T109366 (10Halfak) I think the best next step is to provide a starting list of regexes for badwords, informals, or words to watch. Then we can run some experime... [20:21:08] 10Jade, 10Scoring-platform-team: Create a JADE poster - https://phabricator.wikimedia.org/T195759 (10Halfak) @awight, were you able to make progress on this? [20:21:47] 10Scoring-platform-team, 10articlequality-modeling, 10draftquality-modeling, 10drafttopic-modeling, and 3 others: Audit and repair model documentation on mw:ORES/* - https://phabricator.wikimedia.org/T209406 (10Halfak) p:05Triage→03Normal [20:22:53] 10Jade, 10Scoring-platform-team: Measure group polarization in Jade - https://phabricator.wikimedia.org/T208349 (10Halfak) p:05Triage→03Low [20:23:56] 10MediaWiki-extensions-ORES, 10ORES, 10Scoring-platform-team, 10Documentation: Elaborate documentation on how to deploy ORES to a new wiki - https://phabricator.wikimedia.org/T182054 (10Halfak) p:05Triage→03Normal [20:24:59] 10Scoring-platform-team, 10Documentation, 10Wikimedia-Incident: Document ORES architecture from a robustness perspective - https://phabricator.wikimedia.org/T181831 (10Halfak) I'm not sure I understand what's being asked for here. Could you provide examples of where this is documented well for other systems... [20:25:13] 10Scoring-platform-team, 10Documentation, 10Wikimedia-Incident: Document ORES architecture from a robustness perspective - https://phabricator.wikimedia.org/T181831 (10Halfak) p:05Triage→03Low [20:26:05] 10ORES, 10Scoring-platform-team: Streamline workflow for new ORES model lifecycle - https://phabricator.wikimedia.org/T192504 (10Halfak) I'm not sure what is being asked for here. Are you imagine a page documenting steps taken or a specific type of automation? Also what kind of model? [20:28:17] 10ORES, 10Scoring-platform-team, 10Documentation: Gather announcement messages for confederates - https://phabricator.wikimedia.org/T211794 (10Theklan) Simply I added a message in the Village Pump saying that it was available, and after some tests and feedback (mostly offline) I deployed the gadget and made... [20:29:38] 10Scoring-platform-team, 10revscoring, 10artificial-intelligence: Document how to calculate pop-rate - https://phabricator.wikimedia.org/T190691 (10Halfak) I think the best strategy here is to explicitly document the meaning of the param in `revscoring extract`. There are differences depending on how the sa... [20:29:59] 10Scoring-platform-team, 10revscoring, 10artificial-intelligence: Document how to calculate pop-rate - https://phabricator.wikimedia.org/T190691 (10Halfak) p:05Triage→03Normal [20:30:55] 10ORES, 10Scoring-platform-team, 10Documentation, 10Epic: Improve documentation for answering "What is ORES and how can I use it?" - https://phabricator.wikimedia.org/T190814 (10Halfak) p:05Triage→03Low [20:31:41] 10ORES, 10Scoring-platform-team (Current), 10Documentation, 10Epic: [Epic] Write an ORES manual - https://phabricator.wikimedia.org/T188280 (10Halfak) [20:32:58] 10Scoring-platform-team (Current), 10Documentation: Write and update Jupyter notebooks documenting ORES models and components - https://phabricator.wikimedia.org/T194740 (10Halfak) 05Open→03Resolved a:03Halfak [20:34:18] 10ORES, 10Scoring-platform-team, 10Performance: ores sends duplicate page text over the wire - https://phabricator.wikimedia.org/T214841 (10Halfak) p:05Triage→03Normal [20:35:14] 10ORES, 10Scoring-platform-team, 10Documentation: ELI5 ORES docs - https://phabricator.wikimedia.org/T190411 (10Halfak) p:05Triage→03Low [20:41:07] 10Scoring-platform-team (Current), 10Wikilabels, 10articlequality-modeling, 10artificial-intelligence: Build article quality model for Galician Wikipedia - https://phabricator.wikimedia.org/T201146 (10Halfak) I believe that if you remove "|default" from the relevant line in MediaWiki:Gadgets-definition, it... [20:51:52] 10ORES, 10Scoring-platform-team, 10Operations, 10Release Pipeline, 10Release-Engineering-Team (Backlog): The continuous release pipeline should support more than one service per repo - https://phabricator.wikimedia.org/T210267 (10dduvall) I went a little crazy with a new config proposal in anticipation o... [21:49:24] 10Scoring-platform-team (Current), 10Wikilabels, 10articlequality-modeling, 10artificial-intelligence: Build article quality model for Galician Wikipedia - https://phabricator.wikimedia.org/T201146 (10Elisardojm) Yes, I have removed it, now only users that set the tool can view it. The problem is that now,... [22:40:26] 10Scoring-platform-team (Current), 10Wikilabels, 10articlequality-modeling, 10artificial-intelligence: Build article quality model for Galician Wikipedia - https://phabricator.wikimedia.org/T201146 (10Platonides) Easy: https://gl.wikipedia.org/wiki/Wikipedia:Wikiproxecto_1000_artigos_de_calidade_para_alumn... [23:51:27] 10Scoring-platform-team (Current), 10Wikilabels, 10articlequality-modeling, 10artificial-intelligence: Build article quality model for Galician Wikipedia - https://phabricator.wikimedia.org/T201146 (10Elisardojm) But..., IP users will not know that URL... [23:51:59] 10MediaWiki-extensions-ORES, 10Scoring-platform-team, 10Global-Collaboration, 10Documentation: Document that the ORES UI can be disabled separately from the extension - https://phabricator.wikimedia.org/T182600 (10Catrope) It is now present in InitialiseSettings.php. I'm not sure where we would document so...