[00:45:31] 10ORES, 10Scoring-platform-team (Current), 10Analytics, 10Patch-For-Review: Wire ORES recent_score events into Hadoop - https://phabricator.wikimedia.org/T209732 (10awight) [00:47:03] 10Scoring-platform-team (Current), 10Wikilabels, 10articlequality-modeling, 10artificial-intelligence: Build article quality model for Galician Wikipedia - https://phabricator.wikimedia.org/T201146 (10Elisardojm) Hi Halfak, I have a last question: How can gl.wiki users install the gadget? :) [01:24:55] 10Jade, 10Scoring-platform-team (Current), 10DBA, 10Operations, and 3 others: Introduce a new namespace for collaborative judgements about wiki entities - https://phabricator.wikimedia.org/T200297 (10awight) >>! In T200297#4903879, @Milimetric wrote: > This wikitext-in-JSON thing seems really complicated.... [01:36:59] 10ORES, 10Scoring-platform-team (Current), 10Analytics: Emit synthetic mediawiki.revision-score events for both datacenters - https://phabricator.wikimedia.org/T214545 (10awight) [01:56:45] 10MediaWiki-extensions-ORES, 10Scoring-platform-team, 10Continuous-Integration-Infrastructure, 10MediaWiki-extensions-Newsletter, and 5 others: Jenkins jobs for npm-test fail on project with deps on node-gyp which requires python2.7 - https://phabricator.wikimedia.org/T213944 (10Krinkle) 05Open→03Resolv... [08:11:38] 10Jade, 10Scoring-platform-team (Current), 10DBA, 10Operations, and 3 others: Introduce a new namespace for collaborative judgements about wiki entities - https://phabricator.wikimedia.org/T200297 (10daniel) > Simple text is a good suggestion, but I'm annoyed that it can't express links. I have a proposal... [09:02:11] (03CR) 10Thiemo Kreuz (WMDE): ext.ores.highlighter: Fix minor memory alloc (032 comments) [extensions/ORES] - 10https://gerrit.wikimedia.org/r/485139 (owner: 10Krinkle) [11:45:42] 10MediaWiki-extensions-ORES, 10Scoring-platform-team, 10Continuous-Integration-Infrastructure, 10MediaWiki-extensions-Newsletter, and 5 others: Jenkins jobs for npm-test fail on project with deps on node-gyp which requires python2.7 - https://phabricator.wikimedia.org/T213944 (10zeljkofilipin) 05Resolved... [12:02:16] 10MediaWiki-extensions-ORES, 10Scoring-platform-team, 10Continuous-Integration-Infrastructure, 10MediaWiki-extensions-Newsletter, and 5 others: Jenkins jobs for npm-test fail on project with deps on node-gyp which requires python2.7 - https://phabricator.wikimedia.org/T213944 (10zeljkofilipin) ` integratio... [13:05:23] 10ORES, 10Scoring-platform-team, 10Graphite, 10Patch-For-Review: Add a graph of ORES Celery task queue length - https://phabricator.wikimedia.org/T182914 (10akosiaris) Change has been merged and deployed but up to now no data has been exported. The `celery` key currently looks empty so I guess this is expe... [13:58:21] 10ORES, 10Scoring-platform-team, 10Graphite, 10Patch-For-Review: Add a graph of ORES Celery task queue length - https://phabricator.wikimedia.org/T182914 (10Halfak) Right. Only when we're approaching overload does the celery key contain entries. All workers need to be busy before we see anything. [14:12:37] 10Scoring-platform-team (Current), 10Wikilabels, 10articlequality-modeling, 10artificial-intelligence: Build article quality model for Galician Wikipedia - https://phabricator.wikimedia.org/T201146 (10Halfak) Yes! See https://gl.wikipedia.org/wiki/Usuario:EpochFail/common.js I've enabled it by adding the... [15:23:47] 10ORES, 10Scoring-platform-team (Current), 10Patch-For-Review, 10User-Ladsgroup: Change default serializer of celery from pickle to json - https://phabricator.wikimedia.org/T206333 (10Ladsgroup) I'm rebuilding models of articlequality and put it in another branch, will deploy it on ores-staging and change... [15:38:21] 10ORES, 10Scoring-platform-team, 10Graphite, 10Patch-For-Review: Add a graph of ORES Celery task queue length - https://phabricator.wikimedia.org/T182914 (10akosiaris) 05Open→03Resolved a:03akosiaris >>! In T182914#4905675, @Halfak wrote: > Right. Only when we're approaching overload does the celery... [15:41:10] 10ORES, 10Scoring-platform-team, 10Analytics, 10Dumps-Generation, and 3 others: Decide whether we will include raw features - https://phabricator.wikimedia.org/T211069 (10Halfak) I think the best way to produce an estimate would be to generate a dataset with root datasources based on a random sample of rev... [15:41:19] 10ORES, 10Scoring-platform-team, 10Graphite, 10Patch-For-Review: Add a graph of ORES Celery task queue length - https://phabricator.wikimedia.org/T182914 (10Ladsgroup) Thank you so much. I moved the panels to below scores. I hope you don't mind. [15:42:43] 10ORES, 10Scoring-platform-team: [Investigate] ORES worker threads shouldn't use Redis connection pool - https://phabricator.wikimedia.org/T174403 (10Halfak) 05Open→03Declined It's not clear that this task is still relevant. I'm going to decline it for not and we can re-open it if we re-open T169246. [15:46:11] 10ORES, 10Scoring-platform-team: [Discuss] Storage of model training/testing datasets - https://phabricator.wikimedia.org/T193789 (10Halfak) [15:48:35] 10ORES, 10Scoring-platform-team: [Discuss] Storage of model training/testing datasets - https://phabricator.wikimedia.org/T193789 (10Halfak) I propose a simple guideline. For cases where a specific version of a dataset is stored long term with a unique identifier, it is OK to not store that dataset in our rep... [16:01:25] 10ORES, 10Scoring-platform-team, 10Graphite, 10Patch-For-Review: Add a graph of ORES Celery task queue length - https://phabricator.wikimedia.org/T182914 (10Halfak) We'll know for sure during the next overload event. [16:33:23] afk for lunch [17:04:24] 10Jade, 10Scoring-platform-team (Current), 10DBA, 10Operations, and 3 others: Introduce a new namespace for collaborative judgements about wiki entities - https://phabricator.wikimedia.org/T200297 (10Harej) How does it relate to the subset of wikitext used for edit summaries? As I understand you can do sim... [17:08:24] !away [17:08:24] 04Error: Command “away” not recognized. Please review and correct what you’ve written. [17:13:31] greetings fuzheado [17:13:35] hello awight [17:22:47] back now [17:31:23] harej: buongiorno! [17:37:17] harej: HOLA [18:27:52] (03PS1) 10Awight: Add documentation for config variables [extensions/JADE] - 10https://gerrit.wikimedia.org/r/486341 [18:30:18] 10Scoring-platform-team, 10editquality-modeling, 10artificial-intelligence: "could not decode as JSON" error during autolabeling - https://phabricator.wikimedia.org/T201434 (10Halfak) Checking in on this after a long time. It's not clear that it is still an issue. It looks like the Makefile recipe used to... [18:30:27] 10Scoring-platform-team, 10editquality-modeling, 10artificial-intelligence: "could not decode as JSON" error during autolabeling - https://phabricator.wikimedia.org/T201434 (10Halfak) 05Open→03Declined [18:33:26] 10ORES, 10Scoring-platform-team: Validation for code generation inputs - https://phabricator.wikimedia.org/T214620 (10awight) [18:33:29] Amir1: ^ something fun [18:35:16] hmm, it seems interesting. Our makefile generator really reminds me of blubber [18:37:28] 10ORES, 10Scoring-platform-team: Investigate replacing Make with Luigi - https://phabricator.wikimedia.org/T207820 (10Halfak) I wonder what it would take to do a short sprint on something like this. Maybe we could test it on one of our repos that doesn't yet have a Makefile generator. E.g. draftquality. [18:37:44] 10ORES, 10Scoring-platform-team: Investigate replacing Make with Luigi - https://phabricator.wikimedia.org/T207820 (10Halfak) p:05Triage→03Low [18:38:17] 10ORES, 10Scoring-platform-team: Investigate replacing Make with Luigi - https://phabricator.wikimedia.org/T207820 (10Halfak) p:05Low→03Triage [18:38:21] 10Scoring-platform-team, 10articlequality-modeling, 10artificial-intelligence: Update monthly article quality datasets - https://phabricator.wikimedia.org/T203468 (10Halfak) p:05Triage→03Normal [18:39:31] 10ORES, 10Scoring-platform-team: Investigate replacing Make with Luigi - https://phabricator.wikimedia.org/T207820 (10Halfak) p:05Triage→03Low [18:40:21] halfak: one thing about the board is that since it's ordered by priority now, if you move things, it changes their priorities too [18:40:31] Just noticed that. [18:40:45] I learned it the hard way too [18:41:19] https://www.yahoo.com/entertainment/unpaid-tsa-agents-no-longer-163400099.html?fbclid=IwAR0EfC-23eWNHLPXC9IsU99JXKtk8zSfcpiQi-QN36n02EYGgPE0F_K1yqI&guccounter=1 [18:42:15] 10ORES, 10Scoring-platform-team: Tuning broken in some repos, needs revscoring 2 update - https://phabricator.wikimedia.org/T184727 (10Halfak) 05Open→03Resolved a:03Halfak Looks like this all worked in my last pass through all of the repos. [18:44:38] Amir1: yeah the code generator was a quick hack and needs some TLC. I'd like to put it into a standalone component and rationalize things. [18:44:49] lmk if you feel like chatting about that one day. [18:45:06] Sure thing [18:45:29] awight, interested in re-visiting my attempt to modularize that? [18:45:42] Or do you think we should invest in something like luigi instead? [18:47:01] halfak: Luigi is just a pipeline scheduler, right? [18:47:38] i.e. they are not mutually exclusive [18:47:42] Not sure. There's a task proposing that we use it in place of Make. [18:47:47] if I understood awight correctly [18:47:56] halfak: Can you remind me where your patch is? [18:48:05] halfak: ah right, thanks for connecting the dots for me! [18:48:06] * halfak digs [18:48:26] I think that the makefiles are a necessary evil for the medium-term [18:48:39] https://github.com/wikimedia/editquality/tree/modular_template [18:49:12] Easier to read: https://github.com/wikimedia/editquality/pull/181 [18:49:48] also, part of the rationale for CG is that we reduce the "business" data to a minimal and clear form which makes it easy to switch out the infrastructure [18:49:51] Hmm. I think I had a task for this with some example code. I wonder if I can find that. [18:50:08] awight, right. Also we don't make little copy-paste mistakes :) [18:50:08] according to that argument, I think we should CG-ify all the other repos too [18:50:22] ah yeah there are lots of motivations [18:50:23] Right. I think that's a good direction to go. [18:51:22] https://phabricator.wikimedia.org/T190968 [18:51:28] awight, ^ that has the "goal config" [18:52:07] brb grabbing food quick before our meetingh. [18:53:54] gotta relocate. Thanks for PR'ing! [18:59:38] back [19:40:10] harej, we still meeting? [19:40:17] yes; I'm writing an email [19:40:19] kk [19:51:36] Sorry I spaced that meeting. Looks like good results though! [20:32:41] is ORES still a Beta Feature anywhere? (I'm updating the page at https://www.mediawiki.org/wiki/Beta_Features ...) [20:32:53] I don't think so. [20:33:31] ok, ty, will remove. (I checked a few wikis where it was previously, and couldn't see it. Just checking it hadn't been used at a different set) [20:34:16] Nope. I think that ORES is now a standard feature of the "new filters" [20:39:01] grabbing lunch [20:50:51] 10ORES, 10Scoring-platform-team: Make ORES articlequality prediction score articles from 0 to 10 in euwiki - https://phabricator.wikimedia.org/T214639 (10Theklan) [20:53:50] actually relocating now.