[14:47:00] 10Scoring-platform-team, 10Gerrit, 10GitHub-Mirrors, 10Release-Engineering-Team: articlequality repo mirroring is broken - https://phabricator.wikimedia.org/T212962 (10hashar) From the Gerrit log for git garbage collection: ` gc_log:[2019-01-05 03:48:46,483] [WorkQueue-1] INFO : [scoring/ores/articlequalit... [14:54:00] 10Scoring-platform-team, 10Gerrit, 10GitHub-Mirrors, 10Release-Engineering-Team: articlequality repo mirroring is broken - https://phabricator.wikimedia.org/T212962 (10hashar) > We have several repos which each contain large machine learning model files, and these repos are all configured to mirror *from*... [14:58:47] 10Scoring-platform-team, 10Gerrit, 10GitHub-Mirrors, 10Release-Engineering-Team: articlequality repo mirroring is broken - https://phabricator.wikimedia.org/T212962 (10hashar) [17:01:24] o/ awight & HareJ [17:01:26] Meeting time! [17:01:39] * harej is writing current work then will join [17:01:43] looking for a meating room [17:02:51] I think I'm the host today? [17:08:08] (03PS6) 10Awight: Split apihelp messages to a separate file [extensions/JADE] - 10https://gerrit.wikimedia.org/r/478402 (https://phabricator.wikimedia.org/T189982) (owner: 10Amire80) [17:32:49] 10Scoring-platform-team, 10Diffusion, 10GitHub-Mirrors, 10Release-Engineering-Team: LFS objects are not mirroring from Github through Phab to Gerrit consistently - https://phabricator.wikimedia.org/T212818 (10awight) 05duplicate→03Open Hi! This seems to be a much different issue than the articlequalit... [17:49:10] 10ORES, 10Scoring-platform-team (Current), 10Patch-For-Review, 10User-Ladsgroup: Change default serializer of celery from pickle to json - https://phabricator.wikimedia.org/T206333 (10Halfak) @Ladsgroup looks like this is waiting on you for some work. [17:50:21] 10ORES, 10Scoring-platform-team (Current), 10Patch-For-Review, 10Puppet, and 2 others: ORES services should bind to ores config files - https://phabricator.wikimedia.org/T210719 (10Halfak) @akosiaris what do you think about this strategy? [17:51:34] 10MediaWiki-extensions-ORES, 10Scoring-platform-team (Current), 10Patch-For-Review, 10User-Ladsgroup: Implement JS ORES client in mw-ORES extension - https://phabricator.wikimedia.org/T201691 (10Halfak) @Ladsgroup I made a bunch of notes here. Would you like to implement batching before calling this task... [17:58:24] (03CR) 10Awight: [C: 03+2] Split apihelp messages to a separate file [extensions/JADE] - 10https://gerrit.wikimedia.org/r/478402 (https://phabricator.wikimedia.org/T189982) (owner: 10Amire80) [18:01:44] * halfak --> lunch [18:05:49] (03PS9) 10Awight: Store content quality as an integer index [extensions/JADE] - 10https://gerrit.wikimedia.org/r/476994 [18:05:51] (03PS19) 10Awight: Summarize preferred judgment values in link table [extensions/JADE] - 10https://gerrit.wikimedia.org/r/475932 (https://phabricator.wikimedia.org/T200297) [18:05:53] (03PS16) 10Awight: Add indexes to filter by judgment value [extensions/JADE] - 10https://gerrit.wikimedia.org/r/476447 (https://phabricator.wikimedia.org/T200297) [18:05:55] (03PS12) 10Awight: Throw a fit and s/JADE/Jade/ [extensions/JADE] - 10https://gerrit.wikimedia.org/r/476771 (https://phabricator.wikimedia.org/T211046) [18:05:57] (03PS3) 10Awight: Kludge to localize string constants in template [extensions/JADE] - 10https://gerrit.wikimedia.org/r/479578 (https://phabricator.wikimedia.org/T211346) [18:09:03] 10ORES, 10Scoring-platform-team (Current), 10Patch-For-Review, 10Puppet, and 2 others: ORES services should bind to ores config files - https://phabricator.wikimedia.org/T210719 (10akosiaris) I 've left comments in the change, but to answer the question of the strategy, keep in mind this moves orchestratio... [18:09:28] (03Merged) 10jenkins-bot: Split apihelp messages to a separate file [extensions/JADE] - 10https://gerrit.wikimedia.org/r/478402 (https://phabricator.wikimedia.org/T189982) (owner: 10Amire80) [18:14:12] (03CR) 10jenkins-bot: Split apihelp messages to a separate file [extensions/JADE] - 10https://gerrit.wikimedia.org/r/478402 (https://phabricator.wikimedia.org/T189982) (owner: 10Amire80) [18:17:50] (03PS10) 10Awight: Store content quality as an integer index [extensions/JADE] - 10https://gerrit.wikimedia.org/r/476994 [18:17:51] (03PS20) 10Awight: Summarize preferred judgment values in link table [extensions/JADE] - 10https://gerrit.wikimedia.org/r/475932 (https://phabricator.wikimedia.org/T200297) [18:17:53] (03PS17) 10Awight: Add indexes to filter by judgment value [extensions/JADE] - 10https://gerrit.wikimedia.org/r/476447 (https://phabricator.wikimedia.org/T200297) [18:17:55] (03PS13) 10Awight: Throw a fit and s/JADE/Jade/ [extensions/JADE] - 10https://gerrit.wikimedia.org/r/476771 (https://phabricator.wikimedia.org/T211046) [18:17:57] (03PS4) 10Awight: Kludge to localize string constants in template [extensions/JADE] - 10https://gerrit.wikimedia.org/r/479578 (https://phabricator.wikimedia.org/T211346) [18:43:20] I'm going to try directly pushing references to articlequality. [18:48:10] halfak: I think I was able to restore the articlequality repo [18:49:43] 10Scoring-platform-team, 10Gerrit, 10GitHub-Mirrors, 10Release-Engineering-Team: articlequality repo mirroring is broken - https://phabricator.wikimedia.org/T212962 (10awight) @hashar Thanks for all the helpful diagnostics! I pushed commits straight from my local repo to gerrit, and created a new referenc... [18:50:07] 10ORES, 10Scoring-platform-team, 10Operations, 10Release Pipeline (Blubber), 10Release-Engineering-Team (Backlog): The continuous release pipeline should support more than one service per repo - https://phabricator.wikimedia.org/T210267 (10thcipriani) [18:52:59] (03PS8) 10Awight: Updates for revscoring 2.3.0. [services/ores/deploy] - 10https://gerrit.wikimedia.org/r/481210 (https://phabricator.wikimedia.org/T212530) (owner: 10Halfak) [18:53:53] (03CR) 10Awight: [C: 03+1] "@halfak: looks like we're good to deploy now. Shall we use today's window?" [services/ores/deploy] - 10https://gerrit.wikimedia.org/r/481210 (https://phabricator.wikimedia.org/T212530) (owner: 10Halfak) [19:01:22] akosiaris: I'm trying to figure out how to add some configuration to production ores... do you know, off-hand? [19:02:27] halfak: ^ or maybe you know? [19:03:12] I see the config file built in modules/ores/manifests/web.pp but that feels like the wrong place to add random site-specific config. [19:03:46] I guess this is it. [19:03:47] > # For now puppet ships the config until we migrate it to scap3 as well [19:06:56] 10ORES, 10Scoring-platform-team (Current): Support CIDR range whitelist for ORES throttling - https://phabricator.wikimedia.org/T210103 (10awight) Temporarily whitelisting fu-berlin: 160.45.0.0/16 87.77.0.0/16 [19:07:18] 10ORES, 10Scoring-platform-team, 10Operations, 10Release Pipeline (Blubber), 10Release-Engineering-Team (Backlog): The continuous release pipeline should support more than one service per repo - https://phabricator.wikimedia.org/T210267 (10Ottomata) I'll need multiple service deployments for the same rep... [19:18:36] halfak: deploy today? [19:24:39] like, in 30 min... [19:24:40] I'd like to but I'm in meetings most of today :| [19:24:48] well it's during our meeting [19:25:09] I can deploy and you can have an hour of doing actual work :) [19:26:34] Ha. That could work. Maybe we can co-work on the call :) [19:26:45] we still need to deploy to beta [19:27:09] Good afternoon fine people. [19:27:30] halfak: will do [19:27:44] Hauskatze: hello! how goes it? [19:28:07] (03CR) 10Awight: [C: 03+2] Updates for revscoring 2.3.0. [services/ores/deploy] - 10https://gerrit.wikimedia.org/r/481210 (https://phabricator.wikimedia.org/T212530) (owner: 10Halfak) [19:28:18] awight: hello, well, "it's going" I'd say, which is something at least [19:28:34] :) baseline can be good [19:28:50] as long as it doesn't worsen :) [19:29:56] yikes! [19:30:09] yes that doesn't leave much margin for error, eh [19:30:44] (03CR) 10Awight: [V: 03+2 C: 03+2] Updates for revscoring 2.3.0. [services/ores/deploy] - 10https://gerrit.wikimedia.org/r/481210 (https://phabricator.wikimedia.org/T212530) (owner: 10Halfak) [19:35:18] halfak: we're deployed to beta. [19:36:15] https://ores.wmflabs.org/v3/scores/dewiki/123456 [19:36:45] this might not be working, or the revids are strange: https://ores.wmflabs.org/v3/scores/translatewiki/123 [19:37:35] okay that works: https://ores.wmflabs.org/v3/scores/translatewiki/8570713 [19:50:01] awight, back [19:50:05] * halfak looks at beta [19:50:12] oh! our deployment window has moved to an hour later [19:50:22] or, my calendar is wrong either way [19:50:46] I guess we git the article quality repo squared? [19:51:24] https://ores-beta.wmflabs.org/v3/scores/glwiki/8570713 [19:51:29] "No scorers available for glwiki" [19:51:32] Looks like no. [19:52:40] halfak: I think it's good, not sure what's up with glwiki though. [19:52:51] You saw that translatewiki is available? [19:52:52] The config should have errored on glwiki [19:52:56] Right. [19:53:04] Maybe glwiki didn't make it to the config? [19:53:29] https://ores.wmflabs.org/v3/scores/glwiki [19:53:32] It didn't! [19:53:33] Woops. [19:54:20] halfak: looks like just the scoring_contexts line is missing [19:54:32] thanks for the thorough verification [19:54:37] :| [19:54:46] Should have caught that sooner [19:56:42] Working on it now. Looks like articlequality is still failing for me but I should be able to just submit the config change. [19:57:16] what kind of failing [19:57:24] u tried submodule sync and update? [19:57:51] Aha! Didn't sync [19:57:59] i need to relocate for our chat, brb [19:58:08] kk [20:02:02] (03PS1) 10Halfak: Adds glwiki to contexts [services/ores/deploy] - 10https://gerrit.wikimedia.org/r/482691 [20:02:08] et voila [20:02:08] awight, ^ [20:02:28] (03CR) 10Awight: [V: 03+2 C: 03+2] Adds glwiki to contexts [services/ores/deploy] - 10https://gerrit.wikimedia.org/r/482691 (owner: 10Halfak) [20:02:41] awight, I can see you [20:20:35] halfak: which mockups are you currently working on, or at least you say you are going to work on? i want to update the jade board on phabricator [20:54:46] 10ORES, 10Scoring-platform-team, 10Operations, 10Release Pipeline (Blubber), 10Release-Engineering-Team (Backlog): The continuous release pipeline should support more than one service per repo - https://phabricator.wikimedia.org/T210267 (10Ottomata) Q: would blubber's variants be enough to support the ws... [21:09:55] awight: have a look as well to ores::config(). Send the patch my way and I 'll review it [21:13:18] akosiaris: Thanks, the patch is https://gerrit.wikimedia.org/r/#/c/operations/puppet/+/482683/ but FYI, it depends on new code which is mid-deployment [21:25:02] 10ORES, 10Scoring-platform-team: Investigate: why are we getting overload errors during ORES deployments? - https://phabricator.wikimedia.org/T213116 (10awight) [21:31:26] 10ORES, 10Scoring-platform-team, 10Scap: Investigate: why are we getting overload errors during ORES deployments? - https://phabricator.wikimedia.org/T213116 (10awight) Maybe this is because scap is restarting the services in serial, but not accounting for the long warm-up period for each box. We could add... [21:32:17] akosiaris: We should be good to deploy that config change, pls give me a heads-up if you find time to do that. No rush, if today isn't good for you. [21:32:40] 10ORES, 10Scoring-platform-team (Current), 10Patch-For-Review: Support CIDR range whitelist for ORES throttling - https://phabricator.wikimedia.org/T210103 (10awight) The code is deployed but not config, yet. [21:43:58] 10Jade, 10Scoring-platform-team: Propose Jade integration with countervandalism network (CVN) - https://phabricator.wikimedia.org/T213117 (10awight) [21:44:54] 10Jade, 10Scoring-platform-team: Propose Jade integration with countervandalism network (CVN) - https://phabricator.wikimedia.org/T213117 (10awight) [21:53:07] fud. [21:56:58] MEETINGS [21:57:13] harej, saw your question. I haven't decided on a wireframe yet. [21:57:18] Today is really meeting heavy. [21:57:57] I think I'll tackle the entity view first [21:58:09] https://phabricator.wikimedia.org/T212379 [21:58:30] It's a big, complicated one so I'm going to start with some partial wireframes to try to express some ideas.