[00:03:54] PROBLEM Total processes is now: WARNING on bots-cb.pmtpa.wmflabs 10.4.0.44 output: PROCS WARNING: 190 processes [01:09:53] PROBLEM Total processes is now: CRITICAL on bots-bnr4.pmtpa.wmflabs 10.4.0.59 output: PROCS CRITICAL: 253 processes [01:42:53] PROBLEM Total processes is now: CRITICAL on bots-bnr2.pmtpa.wmflabs 10.4.0.40 output: PROCS CRITICAL: 306 processes [02:02:53] PROBLEM Total processes is now: CRITICAL on bots-bnr3.pmtpa.wmflabs 10.4.0.81 output: PROCS CRITICAL: 259 processes [02:16:43] PROBLEM Total processes is now: CRITICAL on bots-salebot.pmtpa.wmflabs 10.4.0.163 output: PROCS CRITICAL: 295 processes [02:19:43] PROBLEM Total processes is now: CRITICAL on bots-bnr1.pmtpa.wmflabs 10.4.1.68 output: PROCS CRITICAL: 351 processes [02:28:43] PROBLEM Current Load is now: CRITICAL on bots-bsql01.pmtpa.wmflabs 10.4.0.226 output: CRITICAL - load average: 43.37, 35.00, 17.58 [02:29:53] PROBLEM Total processes is now: CRITICAL on bots-bsql01.pmtpa.wmflabs 10.4.0.226 output: PROCS CRITICAL: 201 processes [02:31:43] RECOVERY Total processes is now: OK on bots-salebot.pmtpa.wmflabs 10.4.0.163 output: PROCS OK: 116 processes [02:34:53] PROBLEM Total processes is now: WARNING on bots-bsql01.pmtpa.wmflabs 10.4.0.226 output: PROCS WARNING: 194 processes [02:38:42] PROBLEM Current Load is now: WARNING on bots-bsql01.pmtpa.wmflabs 10.4.0.226 output: WARNING - load average: 8.46, 18.93, 18.51 [03:02:53] PROBLEM Total processes is now: WARNING on bots-cb.pmtpa.wmflabs 10.4.0.44 output: PROCS WARNING: 180 processes [03:17:52] PROBLEM Total processes is now: CRITICAL on bots-cb.pmtpa.wmflabs 10.4.0.44 output: PROCS CRITICAL: 210 processes [03:22:53] PROBLEM Total processes is now: WARNING on bots-cb.pmtpa.wmflabs 10.4.0.44 output: PROCS WARNING: 155 processes [03:28:43] RECOVERY Current Load is now: OK on bots-bsql01.pmtpa.wmflabs 10.4.0.226 output: OK - load average: 4.15, 4.14, 4.86 [06:43:53] PROBLEM Total processes is now: WARNING on bots-cb.pmtpa.wmflabs 10.4.0.44 output: PROCS WARNING: 174 processes [06:53:53] RECOVERY Total processes is now: OK on bots-cb.pmtpa.wmflabs 10.4.0.44 output: PROCS OK: 120 processes [06:56:52] PROBLEM Total processes is now: WARNING on nginx-dev1.pmtpa.wmflabs 10.4.0.68 output: PROCS WARNING: 152 processes [07:32:53] PROBLEM Total processes is now: WARNING on bots-cb.pmtpa.wmflabs 10.4.0.44 output: PROCS WARNING: 156 processes [08:29:52] PROBLEM Total processes is now: WARNING on bots-bnr4.pmtpa.wmflabs 10.4.0.59 output: PROCS WARNING: 196 processes [08:32:53] PROBLEM Total processes is now: WARNING on bots-bnr3.pmtpa.wmflabs 10.4.0.81 output: PROCS WARNING: 194 processes [08:34:53] RECOVERY Total processes is now: OK on bots-bnr4.pmtpa.wmflabs 10.4.0.59 output: PROCS OK: 142 processes [08:37:53] PROBLEM Total processes is now: WARNING on bots-bnr2.pmtpa.wmflabs 10.4.0.40 output: PROCS WARNING: 186 processes [08:49:43] PROBLEM Total processes is now: WARNING on bots-bnr1.pmtpa.wmflabs 10.4.1.68 output: PROCS WARNING: 198 processes [13:39:33] PROBLEM Disk Space is now: CRITICAL on selftest.pmtpa.wmflabs 10.4.1.106 output: Connection refused by host [13:40:12] PROBLEM Free ram is now: CRITICAL on selftest.pmtpa.wmflabs 10.4.1.106 output: Connection refused by host [13:40:52] PROBLEM Current Load is now: CRITICAL on selftest.pmtpa.wmflabs 10.4.1.106 output: Connection refused by host [13:41:42] PROBLEM Total processes is now: CRITICAL on selftest.pmtpa.wmflabs 10.4.1.106 output: Connection refused by host [13:42:22] PROBLEM dpkg-check is now: CRITICAL on selftest.pmtpa.wmflabs 10.4.1.106 output: Connection refused by host [15:03:53] PROBLEM Current Load is now: CRITICAL on selftest1.pmtpa.wmflabs 10.4.1.107 output: Connection refused by host [15:04:33] PROBLEM Disk Space is now: CRITICAL on selftest1.pmtpa.wmflabs 10.4.1.107 output: CHECK_NRPE: Error - Could not complete SSL handshake. [15:05:12] PROBLEM Free ram is now: CRITICAL on selftest1.pmtpa.wmflabs 10.4.1.107 output: CHECK_NRPE: Error - Could not complete SSL handshake. [15:06:42] PROBLEM Total processes is now: CRITICAL on selftest1.pmtpa.wmflabs 10.4.1.107 output: CHECK_NRPE: Error - Could not complete SSL handshake. [15:07:22] PROBLEM dpkg-check is now: CRITICAL on selftest1.pmtpa.wmflabs 10.4.1.107 output: CHECK_NRPE: Error - Could not complete SSL handshake. [15:33:53] PROBLEM Current Load is now: CRITICAL on tools-puppet-master.pmtpa.wmflabs 10.4.1.106 output: CHECK_NRPE: Error - Could not complete SSL handshake. [15:34:33] PROBLEM Disk Space is now: CRITICAL on tools-puppet-master.pmtpa.wmflabs 10.4.1.106 output: CHECK_NRPE: Error - Could not complete SSL handshake. [15:35:13] PROBLEM Free ram is now: CRITICAL on tools-puppet-master.pmtpa.wmflabs 10.4.1.106 output: CHECK_NRPE: Error - Could not complete SSL handshake. [15:36:43] PROBLEM Total processes is now: CRITICAL on tools-puppet-master.pmtpa.wmflabs 10.4.1.106 output: CHECK_NRPE: Error - Could not complete SSL handshake. [15:37:23] PROBLEM dpkg-check is now: CRITICAL on tools-puppet-master.pmtpa.wmflabs 10.4.1.106 output: CHECK_NRPE: Error - Could not complete SSL handshake. [15:38:53] RECOVERY Current Load is now: OK on tools-puppet-master.pmtpa.wmflabs 10.4.1.106 output: OK - load average: 0.85, 0.22, 0.07 [15:39:33] RECOVERY Disk Space is now: OK on tools-puppet-master.pmtpa.wmflabs 10.4.1.106 output: DISK OK [15:40:13] PROBLEM Free ram is now: UNKNOWN on tools-puppet-master.pmtpa.wmflabs 10.4.1.106 output: NRPE: Unable to read output [15:40:53] PROBLEM Current Load is now: CRITICAL on selftest2.pmtpa.wmflabs 10.4.0.240 output: Connection refused by host [15:41:33] PROBLEM Disk Space is now: CRITICAL on selftest2.pmtpa.wmflabs 10.4.0.240 output: Connection refused by host [15:41:43] PROBLEM Total processes is now: CRITICAL on selftest2.pmtpa.wmflabs 10.4.0.240 output: Connection refused by host [15:41:43] RECOVERY Total processes is now: OK on tools-puppet-master.pmtpa.wmflabs 10.4.1.106 output: PROCS OK: 79 processes [15:42:13] PROBLEM Free ram is now: CRITICAL on selftest2.pmtpa.wmflabs 10.4.0.240 output: Connection refused by host [15:42:23] RECOVERY dpkg-check is now: OK on tools-puppet-master.pmtpa.wmflabs 10.4.1.106 output: All packages OK [15:42:23] PROBLEM dpkg-check is now: CRITICAL on selftest2.pmtpa.wmflabs 10.4.0.240 output: Connection refused by host [17:02:52] PROBLEM Total processes is now: WARNING on bots-bnr4.pmtpa.wmflabs 10.4.0.59 output: PROCS WARNING: 151 processes [19:03:53] PROBLEM Current Load is now: CRITICAL on puppet0.pmtpa.wmflabs 10.4.0.100 output: Connection refused by host [19:04:33] PROBLEM Disk Space is now: CRITICAL on puppet0.pmtpa.wmflabs 10.4.0.100 output: Connection refused by host [19:05:14] PROBLEM Free ram is now: CRITICAL on puppet0.pmtpa.wmflabs 10.4.0.100 output: Connection refused by host [19:06:44] PROBLEM Total processes is now: CRITICAL on puppet0.pmtpa.wmflabs 10.4.0.100 output: Connection refused by host [19:07:24] PROBLEM dpkg-check is now: CRITICAL on puppet0.pmtpa.wmflabs 10.4.0.100 output: Connection refused by host [19:12:53] RECOVERY Total processes is now: OK on bots-bnr3.pmtpa.wmflabs 10.4.0.81 output: PROCS OK: 150 processes [19:14:33] PROBLEM Disk Space is now: CRITICAL on kraken0.pmtpa.wmflabs 10.4.0.142 output: Connection refused by host [19:14:33] PROBLEM Free ram is now: CRITICAL on kraken1.pmtpa.wmflabs 10.4.0.240 output: Connection refused by host [19:15:12] PROBLEM Free ram is now: CRITICAL on kraken0.pmtpa.wmflabs 10.4.0.142 output: Connection refused by host [19:15:52] PROBLEM Total processes is now: CRITICAL on kraken1.pmtpa.wmflabs 10.4.0.240 output: Connection refused by host [19:15:52] PROBLEM Current Load is now: CRITICAL on kraken0.pmtpa.wmflabs 10.4.0.142 output: Connection refused by host [19:15:52] PROBLEM Disk Space is now: CRITICAL on kraken1.pmtpa.wmflabs 10.4.0.240 output: Connection refused by host [19:16:42] PROBLEM Total processes is now: CRITICAL on kraken0.pmtpa.wmflabs 10.4.0.142 output: Connection refused by host [19:16:42] PROBLEM dpkg-check is now: CRITICAL on kraken1.pmtpa.wmflabs 10.4.0.240 output: Connection refused by host [19:17:22] PROBLEM dpkg-check is now: CRITICAL on kraken0.pmtpa.wmflabs 10.4.0.142 output: Connection refused by host [19:18:12] PROBLEM Current Load is now: CRITICAL on kraken1.pmtpa.wmflabs 10.4.0.240 output: Connection refused by host [19:36:54] PROBLEM Total processes is now: WARNING on bots-bnr3.pmtpa.wmflabs 10.4.0.81 output: PROCS WARNING: 157 processes [19:42:53] RECOVERY Total processes is now: OK on bots-bnr4.pmtpa.wmflabs 10.4.0.59 output: PROCS OK: 145 processes [21:27:02] PROBLEM Total processes is now: WARNING on tools-exec-02.pmtpa.wmflabs 10.4.1.65 output: PROCS WARNING: 155 processes [22:47:02] RECOVERY Total processes is now: OK on tools-exec-02.pmtpa.wmflabs 10.4.1.65 output: PROCS OK: 150 processes [23:38:52] PROBLEM Current Load is now: CRITICAL on latertoday.pmtpa.wmflabs 10.4.0.96 output: CHECK_NRPE: Error - Could not complete SSL handshake. [23:39:32] PROBLEM Disk Space is now: CRITICAL on latertoday.pmtpa.wmflabs 10.4.0.96 output: CHECK_NRPE: Error - Could not complete SSL handshake. [23:40:13] PROBLEM Free ram is now: CRITICAL on latertoday.pmtpa.wmflabs 10.4.0.96 output: CHECK_NRPE: Error - Could not complete SSL handshake. [23:41:43] PROBLEM Total processes is now: CRITICAL on latertoday.pmtpa.wmflabs 10.4.0.96 output: CHECK_NRPE: Error - Could not complete SSL handshake. [23:42:23] PROBLEM dpkg-check is now: CRITICAL on latertoday.pmtpa.wmflabs 10.4.0.96 output: CHECK_NRPE: Error - Could not complete SSL handshake.