[10:43:32] 10Scoring-platform-team (Current), 10drafttopic-modeling: Drafttopic breaks ?features parameter - https://phabricator.wikimedia.org/T194322#4253270 (10awight) After trying a few insanely complicated things, I realized this is all we need: https://github.com/wiki-ai/revscoring/pull/401 [11:05:24] (03CR) 10Awight: [C: 032] Make aggregation of score results possible so they take less rows (032 comments) [extensions/ORES] - 10https://gerrit.wikimedia.org/r/434689 (https://phabricator.wikimedia.org/T194297) (owner: 10Ladsgroup) [11:08:11] 10Scoring-platform-team (Current), 10ORES, 10Wikimedia-Hackathon-2018: Rewrite ORES "reference" UI using React - https://phabricator.wikimedia.org/T195274#4253336 (10awight) [11:08:23] (03Merged) 10jenkins-bot: Make aggregation of score results possible so they take less rows [extensions/ORES] - 10https://gerrit.wikimedia.org/r/434689 (https://phabricator.wikimedia.org/T194297) (owner: 10Ladsgroup) [11:09:28] (03CR) 10jenkins-bot: Make aggregation of score results possible so they take less rows [extensions/ORES] - 10https://gerrit.wikimedia.org/r/434689 (https://phabricator.wikimedia.org/T194297) (owner: 10Ladsgroup) [11:18:43] (03CR) 10Awight: [C: 032] Do not retry RevisionNotFound job failures [extensions/ORES] - 10https://gerrit.wikimedia.org/r/436785 (https://phabricator.wikimedia.org/T196076) (owner: 10Ladsgroup) [11:22:31] 10Scoring-platform-team (Current), 10articlequality-modeling, 10User-Ladsgroup, 10artificial-intelligence: Train and test wp10 model for fawiki - https://phabricator.wikimedia.org/T190050#4253360 (10awight) Looks like this is still blocked on the new labeling campaign (at 18%), moving out of the review col... [11:23:35] 10Scoring-platform-team (Current), 10articlequality-modeling, 10User-Ladsgroup, 10artificial-intelligence: Train and test wp10 model for fawiki - https://phabricator.wikimedia.org/T190050#4253367 (10awight) [11:23:38] 10Scoring-platform-team (Current), 10articlequality-modeling, 10User-Ladsgroup, 10artificial-intelligence: Article quality campaign for Persian Wikipedia - https://phabricator.wikimedia.org/T174684#4253364 (10awight) 05Resolved>03Open We're waiting on another iteration of the labeling campaign, there w... [11:24:06] 10Scoring-platform-team (Current), 10articlequality-modeling, 10User-Ladsgroup, 10artificial-intelligence: Article quality campaign for Persian Wikipedia - https://phabricator.wikimedia.org/T174684#4253368 (10awight) Here's the new campaign: http://labels.wmflabs.org/stats/fawiki/77 [11:24:17] (03Merged) 10jenkins-bot: Do not retry RevisionNotFound job failures [extensions/ORES] - 10https://gerrit.wikimedia.org/r/436785 (https://phabricator.wikimedia.org/T196076) (owner: 10Ladsgroup) [11:26:07] 10Scoring-platform-team (Current), 10drafttopic-modeling: Drafttopic breaks ?features parameter - https://phabricator.wikimedia.org/T194322#4253370 (10awight) a:03awight [11:35:35] lunching [11:35:38] (03CR) 10jenkins-bot: Do not retry RevisionNotFound job failures [extensions/ORES] - 10https://gerrit.wikimedia.org/r/436785 (https://phabricator.wikimedia.org/T196076) (owner: 10Ladsgroup) [13:07:29] Amir1: are you awake & want to do the sync meeting? [14:40:57] awight: Good morning [14:40:59] :D [14:42:35] Amir1: I'd better adjust my work schedule :p I'm still in UTC+2 [14:43:30] Amir1: What do you think about this small change... https://github.com/wiki-ai/revscoring/pull/401 [14:45:05] awight: I looked into and I don't know why we are doing it [14:45:18] if you give me some context, it'd be great [14:47:42] This is to fix a crash when trying to serialize an numpy array: https://ores-staging.wmflabs.org/v3/scores/enwiki/123456?models=drafttopic&features [14:48:20] It also seems to be the only place where we use a numpy data type for the final result, and we don't use any of the special functionality. [14:48:41] Also, aaargh: > Microsoft is acquiring GitHub [14:48:49] looks like it's time to move to Gitlab for real [14:51:29] yeah :( [15:03:18] Amir1: Bookkeeping, https://github.com/wiki-ai/drafttopic/pull/26 [15:03:55] waiting for travis [15:24:18] awight: we have an unhappy travis [15:26:15] I think it was just racing on the pypi upload, here's the restarted build: https://travis-ci.org/wiki-ai/drafttopic/builds/387835643 [15:29:52] Dang, some kind of incompatibility when trying to rebuild the ores-deploy wheels: AttributeError: module 'pkg_resources' has no attribute 'iter_entry_points' [15:38:55] got it [15:39:30] (03PS1) 10Awight: Bump revscoring to 2.2.4 [research/ores/wheels] - 10https://gerrit.wikimedia.org/r/437276 [15:41:33] (03PS1) 10Awight: Update revscoring to 2.2.4 [services/ores/deploy] - 10https://gerrit.wikimedia.org/r/437277 [15:41:35] (03PS1) 10Awight: Rename wikiclass -> articlequality in Makefile [services/ores/deploy] - 10https://gerrit.wikimedia.org/r/437278 [15:42:01] (03CR) 10Awight: [C: 032] "Self-merging library bump" [research/ores/wheels] - 10https://gerrit.wikimedia.org/r/437276 (owner: 10Awight) [15:42:28] (03CR) 10Awight: [V: 032 C: 032] "Self-merging library bump" [services/ores/deploy] - 10https://gerrit.wikimedia.org/r/437277 (owner: 10Awight) [15:49:40] Amir1: I have to run soon, but fyi am going to try to deploy drafttopic during our window tonight. [15:50:09] awight: just let me know :) [15:50:13] 10Scoring-platform-team (Current), 10drafttopic-modeling: Drafttopic breaks ?features parameter - https://phabricator.wikimedia.org/T194322#4254180 (10awight) This is happy on beta. [15:50:20] oh you'll know ;-) [15:51:08] https://en.wikipedia.org/wiki/Henny_Penny#Idiomatic_usage [16:02:11] Amir1: bs'ing if interested [16:11:36] awight: I should've said no, I have too many things to do :( [16:14:37] o/ see you in a few hours, if you're still around! [17:28:57] (03PS1) 10Legoktm: Don't use *.json for intentionally invalid JSON file [extensions/JADE] - 10https://gerrit.wikimedia.org/r/437294 (https://phabricator.wikimedia.org/T195343) [18:28:01] (03PS1) 10Ladsgroup: Make ScoreParser aggregate wp10 predictions [extensions/ORES] - 10https://gerrit.wikimedia.org/r/437295 (https://phabricator.wikimedia.org/T194297) [18:31:22] awight: for when you're back :D https://gerrit.wikimedia.org/r/#/c/437295/ [18:43:22] 10Scoring-platform-team, 10ORES, 10editquality-modeling, 10artificial-intelligence: arwiki goodfaith model is not usable - https://phabricator.wikimedia.org/T193905#4254825 (10Ghassanmas) Hello All, While labeling the samples I have always had speculation about how the model could detect good faiths. give... [18:47:41] will be afk for a while [18:47:45] be back soon [19:13:08] (03CR) 10Awight: "Small doc fix suggested" (031 comment) [extensions/ORES] - 10https://gerrit.wikimedia.org/r/437295 (https://phabricator.wikimedia.org/T194297) (owner: 10Ladsgroup) [19:43:04] ewhit_: fwiw, I'll be sort-of around for another hour to deploy a thing [19:43:36] great, I'm working on editing my talk page now, thank you! [19:45:51] :) [20:03:14] I just sent you a draft via email! [20:07:02] back, let me check [20:08:24] (03PS2) 10Ladsgroup: Make ScoreParser aggregate wp10 predictions [extensions/ORES] - 10https://gerrit.wikimedia.org/r/437295 (https://phabricator.wikimedia.org/T194297) [20:08:35] (03CR) 10Ladsgroup: Make ScoreParser aggregate wp10 predictions (031 comment) [extensions/ORES] - 10https://gerrit.wikimedia.org/r/437295 (https://phabricator.wikimedia.org/T194297) (owner: 10Ladsgroup) [20:12:11] awight: https://github.com/adamwight/ores-reference-ui can you delete this? Every time I want to make PR it makes it against this repo and not the main one [20:12:18] It confuses me :( [20:22:11] Let's move to gitlab if they've solved it [20:22:20] but yeah, I can remove and re-own [20:22:43] seems strange, like the default should be to make a PR against the next step upstream rather than the grandparent repo [20:27:34] 10Scoring-platform-team (Current), 10Packaging, 10Epic: [Epic] Support word2vec for production ORES models - https://phabricator.wikimedia.org/T187217#4255167 (10awight) [20:27:37] 10Scoring-platform-team (Current), 10Packaging, 10Patch-For-Review: Package word2vec binaries - https://phabricator.wikimedia.org/T188446#4255165 (10awight) 05stalled>03Resolved [20:38:23] awight: https://phabricator.wikimedia.org/T195979 [20:38:31] Would it be okay if I change this? [20:38:48] I write an announcement if I'm going to change [20:41:05] Great thing to change! [20:42:32] 10Scoring-platform-team, 10ORES, 10editquality-modeling, 10artificial-intelligence: arwiki goodfaith model is not usable - https://phabricator.wikimedia.org/T193905#4255203 (10Ladsgroup) Everything that falls under [[https://en.wikipedia.org/w/index.php?title=Wikipedia:VANDTYPES|vandalism]] should be marke... [20:42:32] 10[1] 04https://meta.wikimedia.org/wiki/https://en.wikipedia.org/w/index.php%3Ftitle%3DWikipedia:VANDTYPES [20:46:20] (03PS1) 10Awight: minimal commit to bump revision [services/ores/deploy] - 10https://gerrit.wikimedia.org/r/437358 [20:46:39] (03CR) 10Awight: [V: 032 C: 032] "self-merging for deployment" [services/ores/deploy] - 10https://gerrit.wikimedia.org/r/437358 (owner: 10Awight) [20:47:23] (03PS2) 10Awight: minimal commit to bump deployment [services/ores/deploy] - 10https://gerrit.wikimedia.org/r/437358 [20:47:26] (03CR) 10Awight: [V: 032 C: 032] minimal commit to bump deployment [services/ores/deploy] - 10https://gerrit.wikimedia.org/r/437358 (owner: 10Awight) [20:50:35] This is annoying, LFS is taking two deployments, and the service won't boot in the intermediate state. [20:51:50] nope, even after two deployments. [20:51:51] -rw-r--r-- 1 deploy-service deploy-service 135 Jun 4 20:49 word2vec/GoogleNews-vectors-negative300.bin.gz [21:03:50] 10Scoring-platform-team, 10ORES, 10Operations, 10Scap, 10Release-Engineering-Team (Next): scap support for git-lfs - https://phabricator.wikimedia.org/T181855#4255246 (10awight) [21:03:54] 10Scoring-platform-team (Current), 10ORES, 10drafttopic-modeling, 10Patch-For-Review, 10artificial-intelligence: Deploy drafttopic model to production ORES - https://phabricator.wikimedia.org/T176336#4255245 (10awight) [21:07:03] 10Scoring-platform-team, 10Scap, 10Patch-For-Review, 10Release-Engineering-Team (Kanban): Support git-lfs - https://phabricator.wikimedia.org/T180627#4255268 (10awight) [21:07:06] 10Scoring-platform-team, 10ORES, 10Operations, 10Scap, 10Release-Engineering-Team (Next): scap support for git-lfs - https://phabricator.wikimedia.org/T181855#4255270 (10awight) [21:07:13] awight: I sent you an email with a draft of the updated talk page, if you have a minute sometime today or tomorrow, would you mind taking a look? Thank you for all your help today! I'm stepping away for the day. Thanks! [21:20:26] 10Scoring-platform-team (Current), 10Analytics, 10EventBus, 10ORES, and 3 others: Numeric keys in ORES models causing downstream Hive ingestion to fail - https://phabricator.wikimedia.org/T195979#4255301 (10Ladsgroup) https://github.com/wiki-ai/articlequality/pull/68 Also announced it in wikisource-l, ai-... [21:28:29] 10Scoring-platform-team (Current), 10ORES, 10drafttopic-modeling, 10Patch-For-Review, 10artificial-intelligence: Deploy drafttopic model to production ORES - https://phabricator.wikimedia.org/T176336#4255356 (10awight) [21:28:31] 10Scoring-platform-team (Current), 10ORES, 10drafttopic-modeling, 10artificial-intelligence: Check drafttopic model memory usage - https://phabricator.wikimedia.org/T192293#4255355 (10awight) 05Open>03Resolved [21:28:59] 10Scoring-platform-team (Current), 10Scap, 10Patch-For-Review, 10Release-Engineering-Team (Kanban): Support git-lfs in scap - https://phabricator.wikimedia.org/T180627#4255367 (10awight) p:05Normal>03High [21:29:55] 10Scoring-platform-team, 10ORES, 10Operations, 10Scap, 10Release-Engineering-Team (Next): scap support for git-lfs - https://phabricator.wikimedia.org/T181855#4255372 (10awight) I tried to do a deployment to ores2001 today, running three passes thus: 1. Deploy the master code (d77e52c) in case LFS works... [21:33:59] 10Scoring-platform-team (Current), 10Scap, 10Patch-For-Review, 10Release-Engineering-Team (Kanban): Support git-lfs in scap - https://phabricator.wikimedia.org/T180627#4255382 (10awight) I tried to do a deployment to ores2001 today, running three passes thus: 1. Deploy the master code (d77e52c) in case LFS... [22:00:42] (03CR) 10Krinkle: [C: 032] "Confirmed no other use of the file." [extensions/JADE] - 10https://gerrit.wikimedia.org/r/437294 (https://phabricator.wikimedia.org/T195343) (owner: 10Legoktm) [22:08:36] (03Merged) 10jenkins-bot: Don't use *.json for intentionally invalid JSON file [extensions/JADE] - 10https://gerrit.wikimedia.org/r/437294 (https://phabricator.wikimedia.org/T195343) (owner: 10Legoktm) [22:10:09] (03CR) 10jenkins-bot: Don't use *.json for intentionally invalid JSON file [extensions/JADE] - 10https://gerrit.wikimedia.org/r/437294 (https://phabricator.wikimedia.org/T195343) (owner: 10Legoktm) [22:36:51] (03CR) 10Awight: [C: 032] Make ScoreParser aggregate wp10 predictions [extensions/ORES] - 10https://gerrit.wikimedia.org/r/437295 (https://phabricator.wikimedia.org/T194297) (owner: 10Ladsgroup) [22:38:26] 10Scoring-platform-team (Current), 10Gerrit, 10ORES, 10Operations, 10Patch-For-Review: Plan migration of ORES repos to git-lfs - https://phabricator.wikimedia.org/T181678#4255531 (10awight) Closing, our plan is simple: * Get deployment working with a single LFS file, in the `submodules/assets` directory.... [22:38:52] 10Scoring-platform-team (Current), 10Packaging, 10Patch-For-Review: Package word2vec binaries - https://phabricator.wikimedia.org/T188446#4255535 (10awight) [22:38:55] 10Scoring-platform-team, 10ORES, 10Operations, 10Scap, 10Release-Engineering-Team (Watching / External): ORES should use a git large file plugin for storing serialized binaries - https://phabricator.wikimedia.org/T171619#4255536 (10awight) [22:39:04] 10Scoring-platform-team (Current), 10Gerrit, 10ORES, 10Operations, 10Patch-For-Review: Plan migration of ORES repos to git-lfs - https://phabricator.wikimedia.org/T181678#4255532 (10awight) 05Open>03Resolved a:03awight [22:41:29] (03Merged) 10jenkins-bot: Make ScoreParser aggregate wp10 predictions [extensions/ORES] - 10https://gerrit.wikimedia.org/r/437295 (https://phabricator.wikimedia.org/T194297) (owner: 10Ladsgroup) [22:42:07] 10Scoring-platform-team, 10Beta-Cluster-Infrastructure, 10ORES: Reimage deployment-ores01 as Stretch - https://phabricator.wikimedia.org/T189790#4255545 (10awight) [22:43:32] (03CR) 10jenkins-bot: Make ScoreParser aggregate wp10 predictions [extensions/ORES] - 10https://gerrit.wikimedia.org/r/437295 (https://phabricator.wikimedia.org/T194297) (owner: 10Ladsgroup) [22:51:45] 10Scoring-platform-team (Current), 10ORES, 10Wikimedia-Hackathon-2018: Rewrite ORES "reference" UI using React - https://phabricator.wikimedia.org/T195274#4255556 (10awight) Latest discussion is about integration. The options that came up so far are, * Replace the UI embedded in the `ores` repo. Include di...