[08:59:03] 10Jade, 10Machine-Learning-Team, 10Project-Admins: Archive Jade project - https://phabricator.wikimedia.org/T281430 (10Aklapper) [08:59:06] 10Jade, 10Beta-Cluster-Infrastructure, 10User-Ladsgroup: Undeploy JADE extension from beta cluster - https://phabricator.wikimedia.org/T281418 (10Aklapper) [08:59:50] 10Jade, 10Machine-Learning-Team, 10Project-Admins: Archive Jade project - https://phabricator.wikimedia.org/T281430 (10Aklapper) For future reference, #projects-cleanup links to a checklist template to use for such tasks [09:04:22] 10Jade, 10Machine-Learning-Team, 10Diffusion-Repository-Administrators, 10Wikimedia-GitHub, 10translatewiki.net: Archive Jade extension - https://phabricator.wikimedia.org/T281430 (10Aklapper) [09:15:46] TIL https://rapids.ai/ [10:36:55] * elukey lunch! [14:06:51] 10Machine-Learning-Team, 10ORES: Add approvals on Github for all the ORES-related repositories - https://phabricator.wikimedia.org/T281711 (10elukey) [14:12:38] 10Machine-Learning-Team, 10ORES: Review pre-cached wikis for ORES - https://phabricator.wikimedia.org/T281713 (10elukey) [15:13:25] 10Machine-Learning-Team, 10ORES: Review pre-cached wikis for ORES - https://phabricator.wikimedia.org/T281713 (10calbon) I like the idea, but instead of the evaluation criteria being small wikis, we should look at popular vs. unpopular wikis in terms of API requests. I just don't want to be in a situation whe... [15:27:04] 10Machine-Learning-Team, 10ORES: Review pre-cached wikis for ORES - https://phabricator.wikimedia.org/T281713 (10elukey) +1 definitely, the right wording is popularity, I agree 100% [16:04:38] 10ORES, 10artificial-intelligence, 10articlequality-modeling, 10drafttopic-modeling, 10Machine-Learning-Team (Active Tasks): ORES deployment - Spring 2021 - https://phabricator.wikimedia.org/T278723 (10Halfak) I totally agree about big deployments! It's been too long. It is a scap deployment. In theo... [16:05:52] 10ORES, 10artificial-intelligence, 10articlequality-modeling, 10drafttopic-modeling, 10Machine-Learning-Team (Active Tasks): ORES deployment - Spring 2021 - https://phabricator.wikimedia.org/T278723 (10Halfak) Here's the initial draft of that work: https://meta.wikimedia.org/wiki/Research:On_the_collabor... [16:21:37] 10Machine-Learning-Team, 10ORES: Review pre-cached wikis for ORES - https://phabricator.wikimedia.org/T281713 (10elukey) Very interestingly, the pre-caching stuff is what powers https://stream.wikimedia.org/?doc#/streams/get_v2_stream_mediawiki_revision_score. The scores are sent to kafka and then exposed, so... [16:33:43] 10Machine-Learning-Team, 10ORES: Review pre-cached wikis for ORES - https://phabricator.wikimedia.org/T281713 (10Ottomata) Ping @Pchelolo [16:34:24] 10Machine-Learning-Team, 10ORES: Review pre-cached wikis for ORES - https://phabricator.wikimedia.org/T281713 (10Ottomata) Could there be a dedicated precache instance/cluster for ORES that didn't serve regular traffic? [16:35:06] 10Machine-Learning-Team, 10ORES: Review pre-cached wikis for ORES - https://phabricator.wikimedia.org/T281713 (10Ladsgroup) Is the stream being used widely for all wikis? during one of my deployments I realized one of models was getting information from the wrong wiki and no one noticed. [16:38:21] 10Machine-Learning-Team, 10ORES: Review pre-cached wikis for ORES - https://phabricator.wikimedia.org/T281713 (10Ottomata) This stream is exposed publicly so may be used by the community for various purposes. It is also ingested into Hive and used by researchers and product analysts, but I don't have an under... [16:48:31] 10Machine-Learning-Team, 10ORES: Review pre-cached wikis for ORES - https://phabricator.wikimedia.org/T281713 (10Pchelolo) This entire piece of infrastructure needs serious refactoring since there's a lot of duplication. Last discussion of this happened in T201868. TLDR as far as I understand, there's a set... [16:56:05] 10ORES, 10artificial-intelligence, 10articlequality-modeling, 10drafttopic-modeling, 10Machine-Learning-Team (Active Tasks): ORES deployment - Spring 2021 - https://phabricator.wikimedia.org/T278723 (10elukey) >>! In T278723#7053702, @Halfak wrote: > I totally agree about big deployments! It's been too... [17:50:36] 10Machine-Learning-Team, 10ORES: Review pre-cached wikis for ORES - https://phabricator.wikimedia.org/T281713 (10elukey) @Pchelolo the summary is great! I can certainly work from the ML/Analytics side when needed, so let me know if we can start scoping out the problem (maybe another task?). One addition to wh... [17:51:04] * elukey afk! [17:55:16] 10Machine-Learning-Team, 10ORES: Review pre-cached wikis for ORES - https://phabricator.wikimedia.org/T281713 (10Pchelolo) > Reduce the number of scores api call from 2/3 to 1 would be great to reduce the traffic to the actual ORES infra. We can just stop precaching it. I have never seen any data suggesting t... [17:56:25] 10Machine-Learning-Team, 10ORES: Review pre-cached wikis for ORES - https://phabricator.wikimedia.org/T281713 (10Ottomata) > more standard model using a hook and EventBus extension. Meaning, EventBus would make a score request to ORES, and then submit the revision-score event? [18:03:13] 10Machine-Learning-Team, 10ORES: Review pre-cached wikis for ORES - https://phabricator.wikimedia.org/T281713 (10Pchelolo) >>! In T281713#7054222, @Ottomata wrote: >> more standard model using a hook and EventBus extension. > Meaning, EventBus would make a score request to ORES, and then submit the revision-sc...