[06:29:10] PROBLEM - ORES web node labs ores-web-02 on ores.wmflabs.org is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 325 bytes in 0.020 second response time https://wikitech.wikimedia.org/wiki/ORES [06:46:38] RECOVERY - ORES web node labs ores-web-02 on ores.wmflabs.org is OK: HTTP OK: HTTP/1.1 200 OK - 1009 bytes in 0.157 second response time https://wikitech.wikimedia.org/wiki/ORES [07:01:11] PROBLEM - check load on ORES-web02.Experimental is CRITICAL: connect to address 172.16.6.234 port 5666: Connection refusedconnect to host ores-web-02.ores.eqiad.wmflabs port 5666: Connection refused [07:01:12] PROBLEM - puppet on ORES-web02.Experimental is CRITICAL: connect to address 172.16.6.234 port 5666: Connection refusedconnect to host ores-web-02.ores.eqiad.wmflabs port 5666: Connection refused [07:01:47] PROBLEM - check disk on ORES-web02.Experimental is CRITICAL: connect to address 172.16.6.234 port 5666: Connection refusedconnect to host ores-web-02.ores.eqiad.wmflabs port 5666: Connection refused [07:01:52] PROBLEM - check users on ORES-web02.Experimental is CRITICAL: connect to address 172.16.6.234 port 5666: Connection refusedconnect to host ores-web-02.ores.eqiad.wmflabs port 5666: Connection refused [07:45:52] RECOVERY - check users on ORES-web02.Experimental is OK: USERS OK - 1 users currently logged in [07:47:11] RECOVERY - check load on ORES-web02.Experimental is OK: OK - load average: 0.02, 0.05, 0.29 [07:47:47] RECOVERY - check disk on ORES-web02.Experimental is OK: DISK OK [07:50:40] RECOVERY - puppet on ORES-web02.Experimental is OK: OK: Puppet is currently enabled, last run 4 minutes ago with 0 failures [15:03:24] (03PS1) 10Krinkle: ThresholdLookup: Use a more descriptive key class for WANObjectCache [extensions/ORES] - 10https://gerrit.wikimedia.org/r/525969 [15:03:32] (03CR) 10jerkins-bot: [V: 04-1] ThresholdLookup: Use a more descriptive key class for WANObjectCache [extensions/ORES] - 10https://gerrit.wikimedia.org/r/525969 (owner: 10Krinkle) [15:03:34] (03CR) 10jerkins-bot: [V: 04-1] ThresholdLookup: Use a more descriptive key class for WANObjectCache [extensions/ORES] - 10https://gerrit.wikimedia.org/r/525969 (owner: 10Krinkle) [15:03:37] (03CR) 10Krinkle: "https://grafana.wikimedia.org/d/lqE4lcGWz/wanobjectcache-key-group?orgId=1&var-kClass=ORES" [extensions/ORES] - 10https://gerrit.wikimedia.org/r/525969 (owner: 10Krinkle) [15:03:49] (03PS2) 10Krinkle: ThresholdLookup: Use a more descriptive key class for WANObjectCache [extensions/ORES] - 10https://gerrit.wikimedia.org/r/525969 [15:06:51] (03PS3) 10Krinkle: ThresholdLookup: Use a more descriptive key class for WANObjectCache [extensions/ORES] - 10https://gerrit.wikimedia.org/r/525969