[13:13:06] 10ORES, 10Machine Learning Platform, 10Operations, 10serviceops, 10Wikimedia-production-error: ORES redis: max number of clients reached... - https://phabricator.wikimedia.org/T263910 (10hashar) [17:12:18] hello, world. Requests to ORES ending sometimes with error 500 -- internal server error. Problems with ORES or is something wrong with my tool? [17:59:43] 10ORES, 10Machine Learning Platform, 10Operations, 10serviceops, 10Wikimedia-production-error: ORES redis: max number of clients reached... - https://phabricator.wikimedia.org/T263910 (10SD0001) I have a bot that queries ORES a lot (I believe most of its requests are probably being fulfilled from the cac... [20:03:51] 10ORES, 10Machine Learning Platform, 10Operations, 10serviceops, 10Wikimedia-production-error: ORES redis: max number of clients reached... - https://phabricator.wikimedia.org/T263910 (10calbon) I've `sudo service uwsgi-ores restart` on all ORES200x boxes again. This fixes the problem temporarily (~24 ho... [20:05:07] lluvatar_ ORES is having problems since Sept 25, should be back up now [20:09:42] 10ORES, 10Machine Learning Platform, 10Operations, 10serviceops, 10Wikimedia-production-error: ORES redis: max number of clients reached... - https://phabricator.wikimedia.org/T263910 (10calbon) {F32365787} https://grafana.wikimedia.org/d/HIRrxQ6mk/ores?viewPanel=13&orgId=1&refresh=1m&from=now-7d&to=now-1m [20:29:48] 10ORES, 10Machine Learning Platform, 10Operations, 10serviceops, 10Wikimedia-production-error: ORES redis: max number of clients reached... - https://phabricator.wikimedia.org/T263910 (10calbon) Any ideas on causes and solutions @Halfak?