[00:42:06] 06Revision-Scoring-As-A-Service, 06Design-Research, 10Research Ideas, 10Wikimedia-Developer-Summit (2017): Evaluating the user experience of AI systems - https://phabricator.wikimedia.org/T149373#2750321 (10Tgr) A large part of this seems to be about just having good feedback systems in general. New articl... [01:05:04] 06Revision-Scoring-As-A-Service, 10Research Ideas, 10Wikimedia-Developer-Summit (2017): Where to surface AI in Wikimedia Projects - https://phabricator.wikimedia.org/T148690#2730132 (10Tgr) For the editor-facing models (vandalism/goodfaith/damaging) a lot of it is obvious: show it on diffs, show it on pages... [01:54:00] 06Revision-Scoring-As-A-Service, 10Research Ideas, 10Wikimedia-Developer-Summit (2017): Where to surface AI in Wikimedia Projects - https://phabricator.wikimedia.org/T148690#2730132 (10Sumit) >>! In T148690#2807416, @EBernhardson wrote: > Semi-related, I've got a side project going to try and use machine lea... [06:49:51] 06Revision-Scoring-As-A-Service, 10Research Ideas, 10Wikimedia-Developer-Summit (2017): Building an AI wishlist & working groups for Wikimedia Projects - https://phabricator.wikimedia.org/T147710#2701365 (10Basvb) I won't be at wikidev but am: "an interested party who want to be consulted and made aware of n... [11:40:51] 10Revision-Scoring-As-A-Service-Backlog, 10MediaWiki-extensions-FlaggedRevs: Use revision scoring to trigger flagged protection - https://phabricator.wikimedia.org/T132901#2213665 (10Cenarium) This looks a lot like deferred changes, recently approved on enwiki, see T118696 for the technical implementation for... [12:00:15] 06Revision-Scoring-As-A-Service, 10Research Ideas, 10Wikimedia-Developer-Summit (2017): Where to surface AI in Wikimedia Projects - https://phabricator.wikimedia.org/T148690#2807991 (10Cenarium) >>! In T148690#2807649, @Tgr wrote: > For the editor-facing models (vandalism/goodfaith/damaging) a lot of it is o... [12:01:06] (03PS13) 10Ladsgroup: Visually report damaging confidence [extensions/ORES] - 10https://gerrit.wikimedia.org/r/320341 (https://phabricator.wikimedia.org/T144922) [12:01:58] (03CR) 10Ladsgroup: "PS13 colors are chosen from Wikimedia color pallete: https://phabricator.wikimedia.org/M82" [extensions/ORES] - 10https://gerrit.wikimedia.org/r/320341 (https://phabricator.wikimedia.org/T144922) (owner: 10Ladsgroup) [15:36:18] 06Revision-Scoring-As-A-Service, 10Research Ideas, 10Wikimedia-Developer-Summit (2017): Algorithmic dangers and transparency -- Best practices - https://phabricator.wikimedia.org/T147929#2708826 (10EBernhardson) This is certainly of concern to me in search. I'm starting to evaluate ways to build ML re-rankin... [15:56:12] 06Revision-Scoring-As-A-Service, 10Research Ideas, 10Wikimedia-Developer-Summit (2017): Where to surface AI in Wikimedia Projects - https://phabricator.wikimedia.org/T148690#2808133 (10EBernhardson) >>! In T148690#2807684, @Sumit wrote: >>>! In T148690#2807416, @EBernhardson wrote: >> Semi-related, I've got... [16:51:17] 06Revision-Scoring-As-A-Service, 10Research Ideas, 10Wikimedia-Developer-Summit (2017): Building an AI wishlist & working groups for Wikimedia Projects - https://phabricator.wikimedia.org/T147710#2808170 (10Halfak) Good to know. Thanks @Basvb. I'll ping here with details before we have a session and I'll u... [17:00:51] o/ Amir1 [17:00:54] halfak: I'll be two minutes late [17:00:56] hey [17:00:57] kk [17:01:08] gabbing a snack to eat [17:09:03] 10Revision-Scoring-As-A-Service-Backlog, 10Wikilabels: Apply ui standardization color pallet to Wikilabels - https://phabricator.wikimedia.org/T151119#2808203 (10Halfak) [17:10:14] 10Revision-Scoring-As-A-Service-Backlog, 10UI-Standardization, 10Wikilabels, 07Easy, 15User-Ladsgroup: Apply ui standardization color pallet to Wikilabels - https://phabricator.wikimedia.org/T151119#2808221 (10Halfak) p:05Triage>03Low a:03Ladsgroup [17:21:52] 10Revision-Scoring-As-A-Service-Backlog, 10ORES, 07Easy: Add banner to ORES main and ui pages in labs noting the experimental nature - https://phabricator.wikimedia.org/T150962#2808230 (10Halfak) [17:22:16] 10Revision-Scoring-As-A-Service-Backlog, 10ORES, 07Easy: Add banner to ORES main and ui pages in labs noting the experimental nature - https://phabricator.wikimedia.org/T150962#2802803 (10Halfak) p:05Triage>03Normal [17:24:39] 10Revision-Scoring-As-A-Service-Backlog, 10revscoring: Sentence bank for importance assertions - https://phabricator.wikimedia.org/T150777#2808234 (10Halfak) [17:31:37] 10Revision-Scoring-As-A-Service-Backlog, 10revscoring: Sentence bank for importance assertions - https://phabricator.wikimedia.org/T150777#2808235 (10Halfak) I'm thinking that we'll want to produce a score that look something like: ``` { 'max_proba': 0.95, 'top_sentences': [ {"proba": 0.95, "start": 0,... [17:32:01] 10Revision-Scoring-As-A-Service-Backlog, 10revscoring: Sentence bank for importance assertions - https://phabricator.wikimedia.org/T150777#2808236 (10Halfak) p:05Triage>03Low [17:46:36] 06Revision-Scoring-As-A-Service, 10Wikilabels: Generalize standalone gadget interface - https://phabricator.wikimedia.org/T151120#2808243 (10Halfak) [17:49:31] 06Revision-Scoring-As-A-Service, 10Wikilabels: Generalize standalone gadget interface - https://phabricator.wikimedia.org/T151120#2808256 (10Halfak) We can get RTL from `meta=siteinfo`. E.g. https://fa.wikipedia.org/w/api.php?action=query&meta=siteinfo&siprop=general%7Cnamespaces%7Cnamespacealiases%7Cstatisti... [17:51:47] 10Revision-Scoring-As-A-Service-Backlog, 10Wikilabels: [Epic] Implement fully featured tool in Labs - https://phabricator.wikimedia.org/T151121#2808257 (10Halfak) [17:52:08] 10Revision-Scoring-As-A-Service-Backlog, 10Wikilabels: [Epic] Implement fully featured tool in Labs - https://phabricator.wikimedia.org/T151121#2808270 (10Halfak) [17:52:10] 06Revision-Scoring-As-A-Service, 10Wikilabels: Generalize standalone gadget interface - https://phabricator.wikimedia.org/T151120#2808271 (10Halfak) [17:52:43] 10Revision-Scoring-As-A-Service-Backlog, 10Wikilabels: [Spec] Implement admin actions for wikilabels - https://phabricator.wikimedia.org/T102335#2808273 (10Halfak) [17:55:54] 06Revision-Scoring-As-A-Service, 10Revision-Scoring-As-A-Service-Backlog, 10Wikilabels: [Spec] Implement wiki/campaign browser interface - https://phabricator.wikimedia.org/T151122#2808274 (10Halfak) [17:56:59] 06Revision-Scoring-As-A-Service, 10Revision-Scoring-As-A-Service-Backlog, 10Wikilabels: [Spec] Implement wiki/campaign browser interface - https://phabricator.wikimedia.org/T151122#2808287 (10Halfak) We'll probably need a set of tasks for: 1. Stating a set of use-cases 2. Designing the interface and user ex... [17:57:31] 06Revision-Scoring-As-A-Service, 10Revision-Scoring-As-A-Service-Backlog, 10Wikilabels: [Spec] Implement wiki/campaign browser interface - https://phabricator.wikimedia.org/T151122#2808289 (10Halfak) [17:57:33] 10Revision-Scoring-As-A-Service-Backlog, 10Wikilabels: [Epic] Implement fully featured tool in Labs - https://phabricator.wikimedia.org/T151121#2808288 (10Halfak) [17:59:19] 06Revision-Scoring-As-A-Service, 15User-Ladsgroup: Improve the KDD paper based on the review - https://phabricator.wikimedia.org/T148443#2723197 (10Halfak) https://pandoc.org/try/?text=%3D%3D+FOo+%3D%3D+%0ABar!++%27%27%27Derp%27%27%27&from=mediawiki&to=latex \o/ [18:02:40] 10Revision-Scoring-As-A-Service-Backlog, 10Wikilabels: [Epic] Implement fully featured tool in Labs - https://phabricator.wikimedia.org/T151121#2808292 (10Halfak) @jmatazzoni, @Catrope, @Pginer-WMF: @Ladsgroup and I put together this Epic task for capturing all the things we think we need to do to turn Wiki... [18:03:09] 10Revision-Scoring-As-A-Service-Backlog, 10Wikilabels: [Spec] Implement wiki/campaign browser interface - https://phabricator.wikimedia.org/T151122#2808294 (10Halfak) [18:03:25] 06Revision-Scoring-As-A-Service, 10Wikilabels: [Epic] Implement fully featured tool in Labs - https://phabricator.wikimedia.org/T151121#2808295 (10Halfak) [18:03:43] 10Revision-Scoring-As-A-Service-Backlog, 10Wikilabels: [Spec] Implement wiki/campaign browser interface - https://phabricator.wikimedia.org/T151122#2808274 (10Halfak) p:05Triage>03Normal [18:04:22] 10Revision-Scoring-As-A-Service-Backlog, 10Wikilabels: Generalize standalone gadget interface - https://phabricator.wikimedia.org/T151120#2808299 (10Halfak) [18:06:38] 10Revision-Scoring-As-A-Service-Backlog, 10Wikilabels: Generalize standalone gadget interface - https://phabricator.wikimedia.org/T151120#2808300 (10Halfak) p:05Triage>03Normal [18:45:03] 10Revision-Scoring-As-A-Service-Backlog, 10MediaWiki-extensions-FlaggedRevs: Use revision scoring to trigger flagged protection - https://phabricator.wikimedia.org/T132901#2808307 (10Tgr) Related: {T58526} [18:47:25] 10Revision-Scoring-As-A-Service-Backlog, 10UI-Standardization, 10Wikilabels, 07Easy, 15User-Ladsgroup: Apply ui standardization color pallet to Wikilabels - https://phabricator.wikimedia.org/T151119#2808203 (10Ricordisamoa) color palette? [19:00:27] 10Revision-Scoring-As-A-Service-Backlog, 10UI-Standardization, 10Wikilabels, 07Easy, 15User-Ladsgroup: Apply ui standardization color pallet to Wikilabels - https://phabricator.wikimedia.org/T151119#2808319 (10Ladsgroup) >>! In T151119#2808310, @Ricordisamoa wrote: > color palette? Yes, [[M82]] [19:00:28] 10[1] 04https://meta.wikimedia.org/wiki/M82 [19:02:54] 10Revision-Scoring-As-A-Service-Backlog, 10UI-Standardization, 10Wikilabels, 07Easy, 15User-Ladsgroup: Apply ui standardization color palette to Wikilabels - https://phabricator.wikimedia.org/T151119#2808320 (10Ricordisamoa)