[13:19:36] (03CR) 10jenkins-bot: build: Updating jakub-onderka/php-parallel-lint to 1.0.0 [extensions/JADE] - 10https://gerrit.wikimedia.org/r/417871 (owner: 10Libraryupgrader) [14:45:14] halfak: o/ [14:45:43] Did you want to go over my rambling at an actual time, or just keep it async? [14:46:09] awight, async seems to be working. Have some stuff you want to discuss? [14:46:20] kk [14:46:38] Well, I tore it apart and rewrote it roughly based on our outline, since we last spoke. [14:46:44] The diagram is more fun now, too. [14:46:58] I really hope “conformity cycle” is already a thing [14:48:17] I never found the Solon you said had written about biases [14:48:54] At this point, I’m probably most interested in your suggestions for how to make this appealing enough to be considered for -> expand into a paper -> publishing [14:50:49] Oh, also, if I’m saying anything incorrect about JADE, please call me out. [15:25:34] Solon: https://scholar.google.com/citations?user=rEjgIskAAAAJ&hl=en&oi=ao [15:25:37] awight, ^ [15:26:15] ooh thanks for that! [15:26:23] awight, re. paper, we'll need to do some observations. E.g. I'm talking to Caroline Sinders about doing a study of how people report ORES mistakes now. [15:26:49] very nice [15:31:02] The long paper is obviously iffy, cos JADE needs to be used as you point out [15:31:15] I’m focused on the “considered for” at the moment ;-) [15:31:27] "considered for"? [15:36:33] awight, ^ [15:36:54] Amir1, hows the fawiki pilot going? [15:37:20] halfak: I’m unclear on what the criteria would be for a workshop submission like this, is all. [15:37:23] I haven't announced it yet, first thing in my list for [15:39:08] awight, oh gotcha. I think you're hitting the right level. Not sure if the workshop organizers will find the discussion you want to bring relevant, but that's always a gamble. [15:39:20] Usually any position statement that is at all relevant and coherent gets accepted. [15:39:26] Thanks, hehe that helps [15:39:31] Amir1, roger that. Thanks. [15:39:53] awight, just saw your email re. monday. Would you add anything you want discussed/considered to https://etherpad.wikimedia.org/p/scoring_platform ? [15:40:11] If you let me know the gist of an agenda item, I'll make sure it gets discussed. [15:42:05] Nothing comes to mind at the moment. [15:42:46] halfak: Amir1: We should talk about splitting up JADE work at some point... [15:42:56] Sure [15:43:19] The next task might be kind of fun, it’s to write the ORES connector that listens for JADE events and adds to the database. [15:43:24] Arg. This templating in editquality is driving me crazy [15:43:34] I’ve started it, but direction changed a bit after a chat with halfak. [15:43:41] halfak: :P [15:43:47] I've been trying for 3 days to get trwiki to generate right. [15:43:47] What can I do to help [15:44:57] On the bright side, we’re generating an intermediate file and not going straight from a parameterized thing to building the models, which would take 24hr per failure... [15:45:10] trwiki, enwiki, fawiki, and ptwiki are hacks in the template. [15:45:22] It looks like all were implemented correctly except trwiki [15:45:38] Since they pull the full 20k dataset from wikilabels. [15:46:03] They all use merge_labels on a single file :\ [15:46:07] Amir1: here’s the work on ORES-JADE so far, https://github.com/wiki-ai/ores/compare/jade_data [15:46:26] I'm trying to figure out where trwiki is dropping half of its observations. [15:47:13] Amir1: here are notes about how we’re planning to implement: https://etherpad.wikimedia.org/p/jade_ores_data. https://etherpad.wikimedia.org/p/JADE_extension_implementation [15:47:27] It’s probably unclear and will take conversations... [15:48:08] halfak: oh yeah, I remember fixing fawiki and enwiki. the good thing IMO is that we can fix template and other things and be sure we don't break more things :D [15:48:32] Right. I think I'm performing the first full smoke test :| [15:57:08] o/ gotta run [16:34:16] I'm going to hop off for a bit to pedal to the university. back in ~an hour. [17:30:48] Just announced the labeling campaign for fawiki [17:59:54] Expense reports re-done! Now for lunch. I have a meeting and then for the rest of the day, I'm updating the phab board and and looking for crumbs that fell through the cracks. :) [19:52:28] halfak: people are reporting that getting new workset is not possible anymore. [19:52:38] 70% is done though [19:53:27] which campaign? [19:53:52] Amir1, ^ [19:54:04] wp10 in fawiki [19:54:19] Oh! I bet that someone has already checked out the page-revisions in a workset [19:54:20] They [19:54:27] 'll either label them or they [19:54:31] 'll get recycled soon [19:54:59] We can do a preliminary analysis of the 70 that are already labeled :) [19:55:20] Essentially, we want the distribution of page lengths for all of the labels. [19:55:54] (My "'" key is next to the enter key :/) [19:56:13] yeah of course, I completely forgot about that part [19:56:28] :D [19:56:37] I'm changing locations now. Should be back online in ~15 minutes. [19:56:54] I'm pretty sure I can get it handled, but they are not expired yet [20:49:09] halfak: I removed them [20:49:36] ha! Take that laggards! [20:52:13] :P [20:52:47] I go grab something to eat and will be back to work on wp10 support in the extension, that should be straightforward [20:55:39] \o/ [20:55:41] Great [21:07:53] My internet is terrible. [21:07:56] Sorry for the spam [21:34:07] 10Scoring-platform-team (Current), 10articlequality-modeling, 10draftquality-modeling, 10editquality-modeling, 10artificial-intelligence: Re-train models with revscoring 2.2.0 - https://phabricator.wikimedia.org/T188775#4039315 (10Halfak) I'm competing for CPU with @bmansurov on stat1005 so it's not goin... [21:36:43] 10Scoring-platform-team, 10editquality-modeling, 10artificial-intelligence: Complete edit quality campaign for Bengali Wikipedia - https://phabricator.wikimedia.org/T187339#4039319 (10Halfak) http://labels.wmflabs.org/ui/bnwiki/ [21:37:40] 10Scoring-platform-team, 10editquality-modeling, 10artificial-intelligence: Complete edit quality campaign for Bengali Wikipedia - https://phabricator.wikimedia.org/T187339#4039320 (10Halfak) Hi @Bodhisattwa, it looks like only 88 out of 3000 edits have been labeled. Is everything working OK? See http://l... [21:40:52] 10Scoring-platform-team, 10Wikilabels: Complete edit quality campaign in English Wiktionary - https://phabricator.wikimedia.org/T166910#4039341 (10Halfak) Hi @jberkel, sorry for the delayed reply. I somehow missed your Q and am checking on things now. The major difference with simple patrolling is that Wik... [21:42:23] 10Scoring-platform-team, 10Wikilabels: Complete edit quality campaign v2 in Finnish Wikipedia - https://phabricator.wikimedia.org/T166909#4039342 (10Halfak) Hi @Zache! It looks like this campaign is half-way done. It seems like it is about time to send out another update message. :) [22:23:20] 10Scoring-platform-team, 10Wikilabels, 10editquality-modeling, 10User-revi, 10artificial-intelligence: Complete editquality campaign for Korean Wikipedia - https://phabricator.wikimedia.org/T161627#4039410 (10Halfak) Hi revi! Just checked on the labeling campaign. It looks like the last push worked, bu... [22:23:55] 10Scoring-platform-team, 10Wikilabels, 10editquality-modeling, 10User-revi, 10artificial-intelligence: Complete editquality campaign for Korean Wikipedia - https://phabricator.wikimedia.org/T161627#4039411 (10Halfak) @revi ^. Sorry, I forgot to actually ping in the message above. :| [22:30:08] 10Scoring-platform-team, 10ORES, 10Reading-Admin: Announce presence of "oresscores" in api.php - https://phabricator.wikimedia.org/T153688#4039423 (10Halfak) We never did this. Should we do it or just decline this task? [22:41:02] 10Scoring-platform-team, 10Wikilabels, 10editquality-modeling, 10artificial-intelligence: Complete Latvian Wikipedia editquality campaign - https://phabricator.wikimedia.org/T163005#4039454 (10Halfak) Hi @Papuass! It looks like this labeling campaign is almost done! I think it just needs an announcement... [22:42:07] 10Scoring-platform-team, 10Documentation: Recent performance improvements for revscoring - https://phabricator.wikimedia.org/T136012#4039455 (10Halfak) 05Open>03declined [22:43:55] 10Scoring-platform-team, 10editquality-modeling, 10artificial-intelligence: Complete edit quality campaign for Arabic Wikipedia - https://phabricator.wikimedia.org/T131669#4039465 (10Halfak) Hi @Ghassanmas! It looks like this campaign has stalled out at 53%. I think it's time to give another status update.... [22:46:52] 10Scoring-platform-team, 10Wikilabels, 10editquality-modeling, 10artificial-intelligence: Complete idwiki edit quality campaign - https://phabricator.wikimedia.org/T130264#4039467 (10Halfak) Hi @Kenrick95! This labeling campaign has been stagnant for a while and it looks like you're the only person who su... [23:01:58] OK that's good for today. I'm going to head out. [23:02:18] Have a good rest of your Friday or start of your Saturday :) [23:02:20] o/ [23:05:29] 10Scoring-platform-team, 10ORES, 10Reading-Admin: Announce presence of "oresscores" in api.php - https://phabricator.wikimedia.org/T153688#4039515 (10Tgr) Sorry, I missed that ping somehow. Sure, I can write an email if you think it is still useful. [23:22:03] 10Scoring-platform-team (Current), 10articlequality-modeling, 10draftquality-modeling, 10editquality-modeling, 10artificial-intelligence: Re-train models with revscoring 2.2.0 - https://phabricator.wikimedia.org/T188775#4039563 (10bmansurov) I should be done in a few hours from now. [23:27:18] (03CR) 10jenkins-bot: build: Updating jakub-onderka/php-parallel-lint to 1.0.0 [extensions/ORES] - 10https://gerrit.wikimedia.org/r/418158 (owner: 10Libraryupgrader)