[15:02:54] Technical Advice IRC meeting starting in 60 minutes in channel #wikimedia-tech, hosts: @CFisch_WMDE - all questions welcome, more infos: https://www.mediawiki.org/wiki/Technical_Advice_IRC_Meeting [15:52:42] Technical Advice IRC meeting starting in 10 minutes in channel #wikimedia-tech, hosts: @addshore - all questions welcome, more infos: https://www.mediawiki.org/wiki/Technical_Advice_IRC_Meeting [16:29:59] wikimedia/revscoring#1788 (rate_formatting - f090e79 : halfak): The build passed. https://travis-ci.org/wikimedia/revscoring/builds/626781384 [16:30:39] kevinbazira, hey! I got some hacking done in the waiting room ^_^ Would you be willing to take a look at a PR? See https://github.com/wikimedia/revscoring/pull/463 [16:32:27] I just added a comment on the PR that explains what this does. [16:48:37] Thanks halfak, I'll take a look at this PR [17:00:27] Y: Mostly meetings. But I did manage to get a new topic model trained on the new taxonomy/wikiproject stuff. The model fitness looks pretty good. We're getting some low fitness for STEM.Mathematics so I might look into that. [17:00:27] T: I'm going to try to get the topic stuff into a coherent PR. I'll pick up the work that Kevin has done with vectorization depending on how far he's got with that. [17:00:37] o/ accraze & kevinbazira [17:01:02] I won't make it to standup. I'm sitting in a hospital waiting room (everything is OK, no worries) so I won't be able to connect [17:01:06] See my async above [17:01:37] Oh! Crud. I forgot about the ORES deploy. This morning has been weird. I'll try to get that to beta ASAP. [17:02:19] Probably in a few hours since I'll be transporting my slightly anesthetized partner. [17:12:01] (03CR) 10Halfak: [V: 03+2] Updates for revscoring 2.6.2 and some models. [services/ores/deploy] - 10https://gerrit.wikimedia.org/r/558719 (https://phabricator.wikimedia.org/T240725) (owner: 10Halfak) [17:13:04] thanks for the update halfak, hope everything is ok :) [17:13:44] my plans for today is focus primarily on menus & forms for the Jade UI. [17:15:50] there's 10 menu/form components listed in the etherpad, got a bunch of coffee and music queued up, gonna knock this stuff out [17:16:02] Awesome! [17:16:16] I listened to some of your new album last night. It was pretty weird :P [17:16:21] LOL [17:21:14] See https://github.com/wikimedia/drafttopic/pull/41 for my work on the draftttopic pipeline. New models incoming. I had to retrain due to a label-order issue and so that I could increment the model version since the schema is changing. [17:30:32] Going offline for a bit. Back in an hour, probably. [17:32:02] kevinbazira, do you have a status update on the vectors and doing work to get them incorporated into revscoring? [17:32:17] I'll check the IRC logs later so don't sweat it if I log off. :) [17:33:15] I'll still see any messages [18:15:03] halfak, regarding the vectors I'm a little blocked. Wanted to ask this in today's meetings but we didn't get a chance to meet. If .vec is the input, what should be the output? and where should the output be loaded? If you don't mind sharing details via email, that will be great! [18:57:55] o/ [18:58:01] I'm back to my desk now. [19:14:12] Doing the beta deploy [19:23:08] I just used the nlwiki damaging model to find some vandalism in nlwiki :) [19:23:11] \o/ [19:23:53] Looks like I could hit the deployment window today :) [19:32:34] 10Scoring-platform-team, 10artificial-intelligence: Exclude number of categories from quality models at euwiki - https://phabricator.wikimedia.org/T240467 (10Halfak) I took a look at this today. ` - roc_auc (micro=0.895, macro=0.897): Stub Start C B GA FA... [19:34:32] 10Scoring-platform-team, 10artificial-intelligence: Exclude number of categories from quality models at euwiki - https://phabricator.wikimedia.org/T240467 (10Halfak) I made a PR in anticipation: https://github.com/wikimedia/articlequality/pull/100 [19:34:52] 10Scoring-platform-team (Current), 10articlequality-modeling, 10artificial-intelligence: Exclude number of categories from quality models at euwiki - https://phabricator.wikimedia.org/T240467 (10Halfak) a:03Halfak [19:35:57] wikimedia/articlequality#265 (euwiki_category - b8f4af5 : Aaron Halfaker): The build failed. https://travis-ci.org/wikimedia/articlequality/builds/626861167 [19:38:33] 10Scoring-platform-team (Current), 10articlequality-modeling, 10artificial-intelligence: Exclude number of categories from quality models at euwiki - https://phabricator.wikimedia.org/T240467 (10Theklan) This was existing before, it is not related to the new model. It is weird for stub articles, but the catg... [20:42:00] 10Scoring-platform-team (Current), 10NewcomerTasks 1.1, 10drafttopic-modeling: Re-train English Wikipedia topic model using new WikiProject Taxonomy - https://phabricator.wikimedia.org/T240286 (10Halfak) a:03Halfak [20:43:48] 10Scoring-platform-team (Current), 10revscoring, 10artificial-intelligence: Fix formatting of "rates" for topic models - https://phabricator.wikimedia.org/T241082 (10Halfak) [20:43:58] 10Scoring-platform-team (Current), 10revscoring, 10artificial-intelligence: Fix formatting of "rates" for topic models - https://phabricator.wikimedia.org/T241082 (10Halfak) a:03Halfak https://github.com/wikimedia/revscoring/pull/463 [20:46:12] 10Scoring-platform-team (Current), 10revscoring, 10artificial-intelligence: Fix formatting of "rates" for topic models - https://phabricator.wikimedia.org/T241082 (10Halfak) [20:51:50] 10Scoring-platform-team (Current), 10NewcomerTasks 1.1, 10drafttopic-modeling: Re-train English Wikipedia topic model using new WikiProject Taxonomy - https://phabricator.wikimedia.org/T240286 (10Halfak) https://github.com/wikimedia/drafttopic/pull/41 [20:57:45] I think I'm going to delay deploying until tomorrow because I've got some meetings that will overlap :\ [21:00:41] Bah. Nevermind. I think I can handle it. [21:34:25] Backlog! [21:34:29] * halfak starts grooming [21:35:26] be there in a sec [21:35:57] 10Jade, 10Scoring-platform-team (Current), 10I18n, 10Patch-For-Review: Please document Jade API messages in qqq - https://phabricator.wikimedia.org/T240780 (10Halfak) a:03Halfak [21:39:13] 10Scoring-platform-team, 10Discovery-Search: Consume ORES drafttopic data from Kafka and store it in HDFS - https://phabricator.wikimedia.org/T240553 (10Halfak) We just deployed a change that will make it so that a mediawiki/revision/score event is produced every time an article is edited. So that should show... [21:40:01] 10Scoring-platform-team: Configure ORES to publish new drafttopic scores to Kafka - https://phabricator.wikimedia.org/T240549 (10Halfak) This is not done with T240609 [21:40:31] halfak: q about ^ [21:40:37] ' a mediawiki/revision/score event is produced' [21:40:41] from ORES or change-prop? [21:40:44] yes [21:40:45] Both [21:40:49] ? [21:41:26] the same event from both? [21:41:27] 10Scoring-platform-team: Configure ORES to publish new drafttopic scores to Kafka - https://phabricator.wikimedia.org/T240549 (10Halfak) For clarity, ORES now produces an event every time that an articles is edited in English Wikipedia via the ChangeProp/precache mechanism. [21:41:38] Oh [21:41:47] k, cp's precache req is still what generates [21:41:49] Is that a bit more clear? [21:41:50] not directly from ores [21:41:54] Right [21:41:55] you just added drafttopic to precache? [21:42:00] Right [21:42:00] response? [21:42:03] got it [21:42:04] coooooo [21:42:05] danke [21:42:06] :D [21:42:09] bitte [21:42:38] 10Scoring-platform-team: Configure ORES to publish new drafttopic scores to Kafka - https://phabricator.wikimedia.org/T240549 (10Ottomata) <3 [21:42:49] ottomata, do you want to resolve T240549 if you think it is ready? [21:42:50] T240549: Configure ORES to publish new drafttopic scores to Kafka - https://phabricator.wikimedia.org/T240549 [21:44:47] let's wait til tomorrow, i'll check and see if there are drafttopic entries in the hive table [21:44:52] then i'll resolve! [21:44:53] :) [21:48:09] Awesome. Sounds great :)( [21:48:12] *:) [21:48:17] :)-< [21:50:06] gonna take a quick break and make some food [21:50:25] halfak lemme know when the qqq patchset is ready for another look [21:51:19] Oh no! We got a bunch of translations in so I need to delete this from those translations [21:51:26] oof [21:53:33] OK I think I got it. [21:53:48] Almost wrote a sed script and then just decided to muscle through all the files. [21:54:10] * halfak waits to jenkins [21:54:13] *for [22:03:47] \o/ Jenkins likes it now [22:04:06] accraze|brb, when you're ready, https://gerrit.wikimedia.org/r/c/mediawiki/extensions/Jade/+/558233 [22:04:10] I'm going to hit the road. [22:04:11] o/ [22:12:21] qqq changes look good, i +2'd it [22:12:26] later halfak [23:43:04] 10MediaWiki-extensions-ORES, 10Scoring-platform-team, 10Discovery-Search, 10Growth-Team, 10NewcomerTasks 1.1: Expose ORES drafttopic data in ElasticSearch via a custom CirrusSearch keyword - https://phabricator.wikimedia.org/T240559 (10Tgr) Two things to consider here which might affect other parts of th...