[00:53:54] going to sleep [00:53:55] o. [00:53:57] *o/ [03:56:54] 06Revision-Scoring-As-A-Service, 10Icinga, 10ORES, 06Operations: Monitor production worker nodes in icinga - https://phabricator.wikimedia.org/T138882#2413619 (10Dzahn) [13:57:46] o/ [13:57:49] Hey Amir1 [13:58:16] halfak: hey [13:58:25] :) [13:59:02] just got home, reading my facebook feed and I'll be working in no time [13:59:38] * halfak looks at activity on https://phabricator.wikimedia.org/T134782 [14:01:28] It looks like we're essentially bypassing lb so that https://ores.wmflabs.org/ores-web-01 would work as expected. [14:01:30] Makes sense. [14:02:02] https://ores.wmflabs.org/ores-web-01/v2/scores/testwiki/reverted/1234567890 [14:02:04] Should work [14:03:36] 06Revision-Scoring-As-A-Service, 10ORES, 07Documentation: Fix circular linking in ORES docs - https://phabricator.wikimedia.org/T138089#2414815 (10Halfak) [14:03:54] 06Revision-Scoring-As-A-Service, 10ORES, 07Documentation: Fix circular linking in ORES docs - https://phabricator.wikimedia.org/T138089#2388853 (10Halfak) a:03Halfak [14:08:34] halfak: Can you take a look at this: https://gerrit.wikimedia.org/r/#/c/296054/ [14:09:17] Also I forgot to mention that I talked with Joe [14:09:24] it was productive [14:09:54] _joe_? [14:10:31] with him to but I mean the one in Collab's team [14:10:35] *too [14:11:36] Oh good :) [14:12:26] it was productive, I think we can provide the data they want [14:14:23] Agreed. [14:14:37] Oh wait. I should ask what project you talked about. [14:15:54] * halfak adds a comment to https://gerrit.wikimedia.org/r/#/c/296054/ [14:18:19] using good faith people who make mistakes [14:18:55] thanks for the comment [14:20:44] Indeed. I really want to get that model in-use. [14:21:02] Once we have calm around the ORES extension, it would be nice to surface that info easily. [14:21:07] *simply [14:21:24] yeah, agreed [14:35:22] Just updated https://meta.wikimedia.org/wiki/Objective_Revision_Evaluation_Service/Support_table and all the linked pages. [14:35:28] brb getting coffee [14:53:57] 06Revision-Scoring-As-A-Service, 10ORES, 13Patch-For-Review: [spike] Find out if we can get health check warnings when a web node goes down from the load balancer's perspective - https://phabricator.wikimedia.org/T134782#2414892 (10schana) I've created a patch, but am unsure how to properly implement the fol... [15:32:13] 06Revision-Scoring-As-A-Service, 10ORES, 07Documentation: Fix circular linking in ORES docs - https://phabricator.wikimedia.org/T138089#2414956 (10Halfak) https://github.com/wiki-ai/ores/pull/154 [15:32:28] 06Revision-Scoring-As-A-Service, 10ORES, 10revscoring: Score multiple models with the same cached dependencies - https://phabricator.wikimedia.org/T134606#2414958 (10Halfak) a:03Halfak [15:33:18] 06Revision-Scoring-As-A-Service, 10ORES, 10revscoring: Score multiple models with the same cached dependencies - https://phabricator.wikimedia.org/T134606#2271181 (10Halfak) Made some substantial progress here: https://github.com/wiki-ai/ores/pull/144 It required some deeper refactoring than expected and mi... [15:59:56] o/ schana [16:00:20] I wanted to confirm that you'll report on ores.wikimedia.org coming online at SoS [16:00:40] I see that https://etherpad.wikimedia.org/p/ResearchStaff has stuff that hasn't been reported for 2 weeks. [18:20:40] * halfak deletes all the branches [18:21:47] Weird. Why didn't we get a barrage of spam for deleting all the revscoring branches. [18:21:50] ? [18:21:52] Hmm [18:31:08] they you could not have pssoibly done something correct [18:31:26] whenever I do something worthwhile my inbox is spammed with angry comments :p [19:13:33] heh [19:37:22] bah. Not feeling good. I'm going to lay down for a bit. [20:31:15] 06Revision-Scoring-As-A-Service, 10Icinga, 10ORES, 06Operations: Monitor production worker nodes in icinga - https://phabricator.wikimedia.org/T138882#2416006 (10Dzahn) https://icinga.wikimedia.org/cgi-bin/icinga/status.cgi?search_string=ores+worker [20:33:58] back [20:34:02] Feeling a bit better [21:08:49] great :D [21:08:54] horray for speedy recovery [21:23:44] oooh. a whole scoring test is working [21:23:48] * halfak fleshes out tests [22:14:26] 06Revision-Scoring-As-A-Service, 10ORES, 13Patch-For-Review: [spike] Find out if we can get health check warnings when a web node goes down from the load balancer's perspective - https://phabricator.wikimedia.org/T134782#2416381 (10Dzahn) @schana I have amended the patch to fix the jenkins-bot downvote and i... [22:16:14] OK. Some tests passing and the timeout error is working [22:16:34] I was able to get a ProcessPool working, so I think that celery should be pretty easy.