[15:44:18] Amir1 could you restart ORES, it is having a busy worker spike https://grafana.wikimedia.org/d/HIRrxQ6mk/ores?viewPanel=13&orgId=1&refresh=1m&from=now-7d&to=now-1m [15:44:45] I'd do it but thanks to Ubuntu's 20.04 failed upgrade I am in the middle of getting a new prod key [15:45:01] chrisalbon: no worries, I do it [15:45:07] Awesome, thank you! [15:51:27] chrisalbon: eqiad done, codfw seems fine. I won't it there [15:52:13] thank you! [17:52:18] I actually have an idea, It might be that the errors cause redis not to close the connections and stay there as a zombie. I will test this hypotheses soon [17:55:14] (03CR) 10Krinkle: [C: 03+1] "recheck" [extensions/ORES] - 10https://gerrit.wikimedia.org/r/634994 (https://phabricator.wikimedia.org/T256950) (owner: 10Harriet Ayugi) [18:01:14] (03CR) 10Ladsgroup: [C: 03+2] Selenium: Delete all tests [extensions/ORES] - 10https://gerrit.wikimedia.org/r/634994 (https://phabricator.wikimedia.org/T256950) (owner: 10Harriet Ayugi) [18:20:57] (03Merged) 10jenkins-bot: Selenium: Delete all tests [extensions/ORES] - 10https://gerrit.wikimedia.org/r/634994 (https://phabricator.wikimedia.org/T256950) (owner: 10Harriet Ayugi) [18:30:41] Yeah, the reset fixed the busy worker issue but I'm still getting a bunch of errors. Odd. Thanks for looking into it