[14:03:23] Amir1: hi! I'm having some trouble joining--do you see a request from me? [14:04:13] awight: wait a sec [14:04:55] K I'm in [14:05:07] personal vs work account issue... [14:09:58] 10Scoring-platform-team-Backlog: Bad grep statement in viwiki editquality make rules? - https://phabricator.wikimedia.org/T168594#3370490 (10awight) We should run some data through and inspect the output. [14:15:17] 10Scoring-platform-team-Backlog, 10Collaboration-Team-Triage, 10Edit-Review-Improvements-RC-Page, 10ORES, 10Wikidata: ORES: Don't highlight changes propagated from Wikidata - https://phabricator.wikimedia.org/T168487#3366057 (10Ladsgroup) p:05Triage>03Normal [14:24:30] 10Scoring-platform-team, 10User-Ladsgroup: Grant AWight CR+2 on scoring platform repos - https://phabricator.wikimedia.org/T168443#3370648 (10Ladsgroup) a:03Ladsgroup [14:25:27] 10Scoring-platform-team-Backlog, 10Operations: Grant AWight accounts on ores production clusters - https://phabricator.wikimedia.org/T168442#3370653 (10awight) [14:27:26] 10Scoring-platform-team, 10Bad-Words-Detection-System, 10revscoring, 10artificial-intelligence: Add language support for Albanian - https://phabricator.wikimedia.org/T168369#3370655 (10Ladsgroup) [14:31:03] 10Scoring-platform-team-Backlog, 10ORES, 10revscoring, 10artificial-intelligence: Consider adding a model to ORES for predicting which pages should be protected - https://phabricator.wikimedia.org/T149677#2759493 (10Ladsgroup) p:05Triage>03Normal [14:31:56] 10Scoring-platform-team, 10ORES, 10User-Ladsgroup: ORES UI is broken - https://phabricator.wikimedia.org/T149117#3370666 (10Ladsgroup) a:03Ladsgroup [14:32:27] 10Scoring-platform-team, 10ORES, 10User-Ladsgroup: ORES UI doesn't handle API errors - https://phabricator.wikimedia.org/T149118#3370669 (10Ladsgroup) a:03Ladsgroup [14:42:54] 10Scoring-platform-team-Backlog, 10MediaWiki-extensions-ORES: Wikicode is not interpreted in system message - https://phabricator.wikimedia.org/T142406#3370700 (10Ladsgroup) p:05Triage>03Normal [14:45:29] 10Scoring-platform-team-Backlog, 10ORES: Generate a top stub pageview using ORES - https://phabricator.wikimedia.org/T138560#3370704 (10Ladsgroup) p:05Triage>03Normal [14:47:38] 10Scoring-platform-team, 10Collaboration-Team-Triage, 10Edit-Review-Improvements-RC-Page, 10MediaWiki-Recent-changes, and 2 others: Read timeout on Special:RecentChanges with complex query - https://phabricator.wikimedia.org/T168096#3370706 (10Ladsgroup) [14:50:16] 10Scoring-platform-team-Backlog, 10ORES, 10articlequality-modeling, 10artificial-intelligence: Generate ranked list of likely SM articles for Turkish Wikipedia - https://phabricator.wikimedia.org/T168075#3370723 (10Ladsgroup) p:05Triage>03Normal [14:53:17] 10Scoring-platform-team-Backlog, 10ORES: Switch ORES to dedicated cluster - https://phabricator.wikimedia.org/T168073#3370733 (10Ladsgroup) p:05Triage>03High [14:53:48] 10Scoring-platform-team-Backlog, 10ORES: Add live server monitoring checks to ORES - https://phabricator.wikimedia.org/T168007#3370737 (10awight) [14:55:42] 10Scoring-platform-team-Backlog, 10ORES: Add live server CI checks to ORES - https://phabricator.wikimedia.org/T168007#3352857 (10awight) [14:56:10] 10Scoring-platform-team-Backlog, 10ORES: Add API tests to ORES CI - https://phabricator.wikimedia.org/T168007#3370748 (10awight) [14:59:47] 10Scoring-platform-team-Backlog, 10ORES: Add API tests to ORES CI - https://phabricator.wikimedia.org/T168007#3352857 (10Ladsgroup) p:05Triage>03Low [14:59:47] Amir1: there? [15:02:07] 10Scoring-platform-team-Backlog, 10ORES: Scoring for a new language? - https://phabricator.wikimedia.org/T127058#3370771 (10awight) 05Open>03Resolved a:03awight Looks like we have a nowiki model, now. Thanks for the nudge! [15:03:07] 10Scoring-platform-team, 10ORES, 10crosswatch: Crosswatch should use "damaging" instead of "reverted" model when available for a given wiki - https://phabricator.wikimedia.org/T122306#3370774 (10Ladsgroup) [15:11:27] codezee: hey, I was at a meeting [15:11:28] what's up [15:14:22] Amir1: oh..ok, got a minute now? [15:14:27] yeah [15:15:35] Amir1: I could see that automatic badwords for new languages are generated using tf-idf but is are the badwords and informals generated separated at this stage? [15:15:48] *generated separately [15:16:12] no, a native speaker makes the distinction [15:16:49] ohh I see, also how are the stopwords added for a lang, if nltk does not have for that language? [15:17:34] stopwords is generated [15:17:52] I don't quite remember how we do it but I think it's related to tf-idf too [15:17:59] regarding badwords I think this is the script - https://github.com/wiki-ai/bwds/ I should take help from? although I think its not fully updated with respect to api calls [15:18:08] right? [15:18:51] that script is under major rewrite by Aaron, see the PRs [15:22:18] Amir1: is it safe to take the human labeled +autolabeled revision id list for bwds detection too, or is there any specific way to generate revids for this purpose? [15:22:38] like only taking reverted edits or something? [15:23:39] it only takes reverted edits [15:24:19] ah...thanks for that info, I was taking both and had doubts :) [15:24:52] :) [15:24:57] Thank you for working on this [15:25:22] 10Scoring-platform-team, 10User-Ladsgroup: Grant AWight CR+2 on scoring platform repos - https://phabricator.wikimedia.org/T168443#3370870 (10Ladsgroup) [15:25:31] np, I'm learning a lot...this word list thing is interesting [15:25:51] 10Scoring-platform-team, 10User-Ladsgroup: Grant AWight CR+2 on scoring platform repos - https://phabricator.wikimedia.org/T168443#3364613 (10Ladsgroup) @awight you should have access to everything now, tell me if anything is missing. [15:34:00] 10Scoring-platform-team-Backlog, 10Operations, 10Ops-Access-Requests: Grant AWight accounts on ores production clusters - https://phabricator.wikimedia.org/T168442#3370887 (10Ladsgroup) [15:35:25] 10Scoring-platform-team-Backlog, 10Operations, 10Ops-Access-Requests: Grant AWight accounts on ores production clusters - https://phabricator.wikimedia.org/T168442#3364601 (10Ladsgroup) @akosiaris: Hey, @awight is joing Scoring platform team, do you think this needs to go through normal access requests perio... [16:04:15] 10Scoring-platform-team, 10Operations, 10ops-eqiad: rack/setup/install ores1001-1009 - https://phabricator.wikimedia.org/T165171#3371048 (10Cmjohnson) port assignments 1001 A6 ge-6/0/10 1002 A7 ge-7/0/23 1003 b7 ge-7/0/10 1004 B8 ge-8/0/10 1005 C3 ge-3/0/15 1006 C4 ge-4/0/13 1007 D3 ge-3/0/36 1008 D4 ge-4/... [16:07:32] 10Scoring-platform-team, 10Analytics, 10EventBus, 10ORES, and 3 others: Emit revision-score event to EventBus and expose in EventStreams - https://phabricator.wikimedia.org/T167180#3371058 (10Ottomata) [16:08:28] 10Scoring-platform-team, 10Analytics, 10EventBus, 10ORES, and 3 others: Emit revision-score event to EventBus and expose in EventStreams - https://phabricator.wikimedia.org/T167180#3319947 (10Ottomata) @halfak, could you look over https://gerrit.wikimedia.org/r/#/c/357457/5/jsonschema/mediawiki/revision/sc... [16:10:46] 10Scoring-platform-team, 10Operations, 10ops-eqiad: rack/setup/install ores1001-1009 - https://phabricator.wikimedia.org/T165171#3371064 (10Cmjohnson) [16:25:30] 10Scoring-platform-team, 10Analytics, 10EventBus, 10ORES, and 3 others: Emit revision-score event to EventBus and expose in EventStreams - https://phabricator.wikimedia.org/T167180#3371136 (10Pchelolo) > @Pchelolo, what do we need to do to produce this from changeprop? An hour of time to implement it :) [17:26:28] 10Scoring-platform-team, 10Operations, 10ops-eqiad, 10Patch-For-Review: rack/setup/install ores1001-1009 - https://phabricator.wikimedia.org/T165171#3371441 (10RobH) a:05Cmjohnson>03RobH Chris has done all the on-site required steps, stealing for remote accessible steps/remainder. [17:44:00] 10Scoring-platform-team, 10Operations, 10ops-eqiad, 10Patch-For-Review: rack/setup/install ores1001-1009 - https://phabricator.wikimedia.org/T165171#3371519 (10RobH) [18:02:34] 10Scoring-platform-team, 10User-Ladsgroup: Grant AWight CR+2 on scoring platform repos - https://phabricator.wikimedia.org/T168443#3371582 (10awight) 05Open>03Resolved Verified that I've been added to the research/ores group and seem to have Gerrit rights. Thanks for the blindingly fast work! [18:06:04] 10Scoring-platform-team-Backlog: Grant AWight admin access to ORES pypi repos - https://phabricator.wikimedia.org/T168672#3371593 (10awight) [18:09:44] Amir1: Where is the source for ores.wikimedia.org/ui ? Is it https://github.com/wiki-ai/ORES-GUI ? [18:10:06] awight: it was, now it's in ores itself [18:10:13] we should close that repo [18:10:34] ah cool. I'll see if I can do that [18:10:44] thanks [18:11:08] I'm able to delete it... doing so. [18:15:51] 10Scoring-platform-team, 10Operations, 10ops-eqiad, 10Patch-For-Review: rack/setup/install ores1001-1009 - https://phabricator.wikimedia.org/T165171#3371634 (10RobH) [18:17:35] biab! [18:41:49] 10Scoring-platform-team-Backlog, 10ORES, 10Services (watching), 10User-Ladsgroup: ORES POST precaching always fails with 500 - https://phabricator.wikimedia.org/T168674#3371682 (10Pchelolo) [18:49:34] 10Scoring-platform-team, 10Analytics, 10EventBus, 10ORES, and 3 others: Emit revision-score event to EventBus and expose in EventStreams - https://phabricator.wikimedia.org/T167180#3371721 (10Pchelolo) A couple of open questions we need to answer first: 1. Are we going to post all revision-create events t... [18:58:04] 10Scoring-platform-team, 10Analytics, 10EventBus, 10ORES, and 3 others: Emit revision-score event to EventBus and expose in EventStreams - https://phabricator.wikimedia.org/T167180#3371757 (10Ottomata) > Are we going to post all revision-create events to the new stream even if ORES is not supported there o... [18:58:38] 10Scoring-platform-team-Backlog, 10ORES, 10Services (watching), 10User-Ladsgroup: ORES POST precaching always fails with 500 - https://phabricator.wikimedia.org/T168674#3371759 (10Ladsgroup) https://github.com/wiki-ai/ores/pull/208 [18:58:51] 10Scoring-platform-team, 10ORES, 10Services (watching), 10User-Ladsgroup: ORES POST precaching always fails with 500 - https://phabricator.wikimedia.org/T168674#3371760 (10Ladsgroup) [19:00:15] 10Scoring-platform-team, 10Analytics, 10EventBus, 10ORES, and 3 others: Emit revision-score event to EventBus and expose in EventStreams - https://phabricator.wikimedia.org/T167180#3371764 (10Pchelolo) > Not sure! If change-prop does validation of the events, I think I'm fine with that. It doesn't do it r... [19:33:39] 10Scoring-platform-team, 10Operations, 10ops-eqiad, 10Patch-For-Review: rack/setup/install ores1001-1009 - https://phabricator.wikimedia.org/T165171#3371911 (10RobH) [19:40:05] 10Scoring-platform-team, 10Operations, 10ops-eqiad, 10Patch-For-Review: rack/setup/install ores1001-1009 - https://phabricator.wikimedia.org/T165171#3371924 (10RobH) ores100[789] are not showing active links on the switch. ge-3/0/36 up down ores1007 ge-4/0/33 up down ores1008 ge-6/0/0... [19:49:23] 10Scoring-platform-team, 10Analytics, 10EventBus, 10ORES, and 3 others: Emit revision-score event to EventBus and expose in EventStreams - https://phabricator.wikimedia.org/T167180#3371947 (10Pchelolo) > Not sure! If change-prop does validation of the events, I think I'm fine with that. Hm... looking at t... [19:55:28] 10Scoring-platform-team, 10Analytics, 10EventBus, 10ORES, and 3 others: Emit revision-score event to EventBus and expose in EventStreams - https://phabricator.wikimedia.org/T167180#3319947 (10mobrovac) >>! In T167180#3371757, @Ottomata wrote: >> Are we going to post all revision-create events to the new st... [20:07:15] 10Scoring-platform-team, 10Operations, 10ops-eqiad, 10Patch-For-Review: rack/setup/install ores1001-1009 - https://phabricator.wikimedia.org/T165171#3371997 (10RobH) >>! In T165171#3371924, @RobH wrote: > ores100[789] are not showing active links on the switch. > > ge-3/0/36 up down ores1007 >... [20:07:19] 10Scoring-platform-team, 10Analytics, 10EventBus, 10ORES, and 3 others: Emit revision-score event to EventBus and expose in EventStreams - https://phabricator.wikimedia.org/T167180#3371998 (10Pchelolo) > That. Let's not duplicate if we don't have to. The revision-create traffic is pretty low (a couple doze... [20:10:05] 10Scoring-platform-team, 10Operations, 10Ops-Access-Requests, 10User-Zppix: Graphite access for Zppix - https://phabricator.wikimedia.org/T168014#3372003 (10Zppix) >>! In T168014#3368117, @RobH wrote: > It seems this is awaiting followup from @zppix to work with @Halfak (as the employee who sponsored his a... [20:10:44] 10Scoring-platform-team-Backlog, 10ORES: Switch ORES to dedicated cluster - https://phabricator.wikimedia.org/T168073#3372004 (10awight) @Halfak @Ladsgroup I'm curious about how we plan to use the codfw boxes--will they simply be warm standby, or will they be included in the worker pool? [20:29:02] 10Scoring-platform-team, 10Analytics, 10EventBus, 10ORES, and 3 others: Emit revision-score event to EventBus and expose in EventStreams - https://phabricator.wikimedia.org/T167180#3372019 (10Ottomata) > This sounds like we are pushing this forward without a clear understanding of what we want to get out o... [20:40:35] (03PS1) 10Ladsgroup: Move preferences hooks to a dedicated file [extensions/ORES] - 10https://gerrit.wikimedia.org/r/360918 (https://phabricator.wikimedia.org/T167910) [20:42:35] (03CR) 10jerkins-bot: [V: 04-1] Move preferences hooks to a dedicated file [extensions/ORES] - 10https://gerrit.wikimedia.org/r/360918 (https://phabricator.wikimedia.org/T167910) (owner: 10Ladsgroup) [20:46:22] (03PS2) 10Ladsgroup: Move preferences hooks to a dedicated file [extensions/ORES] - 10https://gerrit.wikimedia.org/r/360918 (https://phabricator.wikimedia.org/T167910) [20:52:06] 10Scoring-platform-team-Backlog, 10Operations, 10Ops-Access-Requests: Grant AWight accounts on ores production clusters - https://phabricator.wikimedia.org/T168442#3372118 (10awight) FWIW, I see that I have access to tin and can presumably deploy there. However, I don't have ssh access to the canary server... [20:54:26] (03CR) 10jerkins-bot: [V: 04-1] Move preferences hooks to a dedicated file [extensions/ORES] - 10https://gerrit.wikimedia.org/r/360918 (https://phabricator.wikimedia.org/T167910) (owner: 10Ladsgroup) [20:56:15] (03PS3) 10Ladsgroup: Move preferences hooks to a dedicated file [extensions/ORES] - 10https://gerrit.wikimedia.org/r/360918 (https://phabricator.wikimedia.org/T167910) [21:07:56] (03CR) 10Awight: [V: 031 C: 032] "Looks good, and verified working locally." [extensions/ORES] - 10https://gerrit.wikimedia.org/r/360918 (https://phabricator.wikimedia.org/T167910) (owner: 10Ladsgroup) [21:13:51] 10Scoring-platform-team-Backlog: Bury horrors of the editquality makefile - https://phabricator.wikimedia.org/T168455#3372277 (10awight) @Ladsgroup identified an important side benefit of doing this work: this will give us the opportunity to evaluate the different ways we generate data sets for each wiki, and de... [21:19:13] 10Scoring-platform-team, 10Operations, 10ops-eqiad, 10Patch-For-Review: rack/setup/install ores1001-1009 - https://phabricator.wikimedia.org/T165171#3372307 (10RobH) [21:21:49] (03Merged) 10jenkins-bot: Move preferences hooks to a dedicated file [extensions/ORES] - 10https://gerrit.wikimedia.org/r/360918 (https://phabricator.wikimedia.org/T167910) (owner: 10Ladsgroup) [21:37:53] (03PS1) 10Ladsgroup: Move ApiHooks.php to Hooks directory and rename it to ApiHooksHandler [extensions/ORES] - 10https://gerrit.wikimedia.org/r/360983 [21:53:41] 10Scoring-platform-team, 10Operations: rack/setup/install ores1001-1009 - https://phabricator.wikimedia.org/T165171#3373452 (10RobH) a:05RobH>03akosiaris All of these systems are now calling into puppet, and are ready for service implementation. The original #hw-request was filied by Alex, so I've assigne... [21:56:50] 10Scoring-platform-team, 10Operations: rack/setup/install ores1001-1009 - https://phabricator.wikimedia.org/T165171#3373513 (10Ladsgroup) I think that part should be handled in {T168073} but not so sure. [22:02:59] 10Scoring-platform-team-Backlog, 10Operations, 10Ops-Access-Requests: Grant AWight accounts on ores production clusters - https://phabricator.wikimedia.org/T168442#3364601 (10RobH) >>! In T168442#3370887, @Ladsgroup wrote: > @akosiaris: Hey, @awight is joing Scoring platform team, do you think this needs to... [22:07:33] 10Scoring-platform-team-Backlog, 10Operations, 10Ops-Access-Requests: Grant AWight accounts on ores production clusters - https://phabricator.wikimedia.org/T168442#3373537 (10awight) 05Open>03Resolved a:03awight @RobH Thanks, I think I've determined I have appropriate access to deploy, and will deal wi... [22:07:35] awight: Is your username in pypi "AWight"? [22:07:50] it returns user does not exist error to me [22:08:43] I don't have a user there, yet... lemme see [22:15:59] Amir1: I created the user "adamw" but am still waiting for a confirmation email. [22:17:09] okay, I'm calling it a day [22:17:17] let's have Aaron handle it [22:17:19] o/ [22:18:24] :) see ya! [22:21:12] 10Scoring-platform-team, 10Operations: rack/setup/install ores1001-1009 - https://phabricator.wikimedia.org/T165171#3373554 (10RobH) More than likely, but I didn't want to assume. If that task does indeed handle it, and everyone involved is aware these servers are ready, this task can be resolved. [22:55:25] Amir1: lol, pypi told me to wait for a confirmation email to click a link, "complete the process" etc, but the email never came and I was able to log in with my new account. [22:55:56] 10Scoring-platform-team-Backlog: Grant AWight admin access to ORES pypi repos - https://phabricator.wikimedia.org/T168672#3373619 (10awight) [23:06:41] (03CR) 10Krinkle: [C: 032] Move ApiHooks.php to Hooks directory and rename it to ApiHooksHandler [extensions/ORES] - 10https://gerrit.wikimedia.org/r/360983 (owner: 10Ladsgroup) [23:12:03] (03Merged) 10jenkins-bot: Move ApiHooks.php to Hooks directory and rename it to ApiHooksHandler [extensions/ORES] - 10https://gerrit.wikimedia.org/r/360983 (owner: 10Ladsgroup)