[00:17:32] <labs-nagios-wm>	 PROBLEM Total processes is now: WARNING on bots-salebot.pmtpa.wmflabs 10.4.0.163 output: PROCS WARNING: 171 processes
[00:28:03] <labs-nagios-wm>	 PROBLEM Current Load is now: CRITICAL on bots-sql1.pmtpa.wmflabs 10.4.0.52 output: CRITICAL - load average: 30.60, 19.35, 12.27
[00:33:02] <labs-nagios-wm>	 PROBLEM Current Load is now: WARNING on bots-sql1.pmtpa.wmflabs 10.4.0.52 output: WARNING - load average: 11.82, 24.59, 17.59
[00:37:42] <labs-nagios-wm>	 RECOVERY Free ram is now: OK on mediawiki-bugfix-kozuch.pmtpa.wmflabs 10.4.0.26 output: OK: 25% free memory
[00:38:32] <labs-nagios-wm>	 RECOVERY Free ram is now: OK on nova-precise2.pmtpa.wmflabs 10.4.1.57 output: OK: 22% free memory
[00:39:52] <labs-nagios-wm>	 RECOVERY Free ram is now: OK on conventionextension-trial.pmtpa.wmflabs 10.4.0.165 output: OK: 21% free memory
[00:40:12] <labs-nagios-wm>	 RECOVERY Free ram is now: OK on sube.pmtpa.wmflabs 10.4.0.245 output: OK: 22% free memory
[00:41:52] <labs-nagios-wm>	 RECOVERY Free ram is now: OK on integration-jobbuilder.pmtpa.wmflabs 10.4.0.21 output: OK: 20% free memory
[00:43:02] <labs-nagios-wm>	 PROBLEM Current Load is now: CRITICAL on bots-sql1.pmtpa.wmflabs 10.4.0.52 output: CRITICAL - load average: 31.73, 23.82, 19.94
[00:52:32] <labs-nagios-wm>	 RECOVERY Total processes is now: OK on bots-salebot.pmtpa.wmflabs 10.4.0.163 output: PROCS OK: 95 processes
[01:00:42] <labs-nagios-wm>	 PROBLEM Free ram is now: WARNING on mediawiki-bugfix-kozuch.pmtpa.wmflabs 10.4.0.26 output: Warning: 17% free memory
[01:01:32] <labs-nagios-wm>	 PROBLEM Free ram is now: WARNING on nova-precise2.pmtpa.wmflabs 10.4.1.57 output: Warning: 17% free memory
[01:02:52] <labs-nagios-wm>	 PROBLEM Free ram is now: WARNING on conventionextension-trial.pmtpa.wmflabs 10.4.0.165 output: Warning: 13% free memory
[01:08:12] <labs-nagios-wm>	 PROBLEM Free ram is now: WARNING on sube.pmtpa.wmflabs 10.4.0.245 output: Warning: 14% free memory
[01:09:52] <labs-nagios-wm>	 PROBLEM Free ram is now: WARNING on integration-jobbuilder.pmtpa.wmflabs 10.4.0.21 output: Warning: 16% free memory
[02:01:32] <labs-nagios-wm>	 RECOVERY Free ram is now: OK on nova-precise2.pmtpa.wmflabs 10.4.1.57 output: OK: 20% free memory
[02:40:32] <labs-nagios-wm>	 PROBLEM Free ram is now: WARNING on nova-precise2.pmtpa.wmflabs 10.4.1.57 output: Warning: 18% free memory
[04:08:22] <labs-nagios-wm>	 PROBLEM Free ram is now: WARNING on bots-liwa.pmtpa.wmflabs 10.4.1.65 output: Warning: 19% free memory
[04:37:52] <labs-nagios-wm>	 RECOVERY Free ram is now: OK on conventionextension-trial.pmtpa.wmflabs 10.4.0.165 output: OK: 21% free memory
[04:38:12] <labs-nagios-wm>	 RECOVERY Free ram is now: OK on sube.pmtpa.wmflabs 10.4.0.245 output: OK: 22% free memory
[04:38:22] <labs-nagios-wm>	 RECOVERY Free ram is now: OK on bots-liwa.pmtpa.wmflabs 10.4.1.65 output: OK: 21% free memory
[04:39:52] <labs-nagios-wm>	 RECOVERY Free ram is now: OK on integration-jobbuilder.pmtpa.wmflabs 10.4.0.21 output: OK: 20% free memory
[04:40:33] <labs-nagios-wm>	 RECOVERY Free ram is now: OK on nova-precise2.pmtpa.wmflabs 10.4.1.57 output: OK: 23% free memory
[04:40:43] <labs-nagios-wm>	 RECOVERY Free ram is now: OK on mediawiki-bugfix-kozuch.pmtpa.wmflabs 10.4.0.26 output: OK: 25% free memory
[04:45:52] <labs-nagios-wm>	 PROBLEM Free ram is now: WARNING on conventionextension-trial.pmtpa.wmflabs 10.4.0.165 output: Warning: 13% free memory
[04:58:44] <labs-nagios-wm>	 PROBLEM Free ram is now: WARNING on mediawiki-bugfix-kozuch.pmtpa.wmflabs 10.4.0.26 output: Warning: 17% free memory
[05:03:33] <labs-nagios-wm>	 PROBLEM Free ram is now: WARNING on nova-precise2.pmtpa.wmflabs 10.4.1.57 output: Warning: 18% free memory
[05:06:14] <labs-nagios-wm>	 PROBLEM Free ram is now: WARNING on sube.pmtpa.wmflabs 10.4.0.245 output: Warning: 14% free memory
[05:17:56] <labs-nagios-wm>	 PROBLEM Free ram is now: WARNING on integration-jobbuilder.pmtpa.wmflabs 10.4.0.21 output: Warning: 16% free memory
[05:41:23] <labs-nagios-wm>	 PROBLEM Free ram is now: WARNING on bots-liwa.pmtpa.wmflabs 10.4.1.65 output: Warning: 19% free memory
[06:28:56] <labs-nagios-wm>	 PROBLEM Total processes is now: WARNING on parsoid-roundtrip5-8core.pmtpa.wmflabs 10.4.0.125 output: PROCS WARNING: 151 processes
[06:31:25] <labs-nagios-wm>	 RECOVERY Free ram is now: OK on bots-liwa.pmtpa.wmflabs 10.4.1.65 output: OK: 20% free memory
[06:33:35] <labs-nagios-wm>	 RECOVERY Free ram is now: OK on nova-precise2.pmtpa.wmflabs 10.4.1.57 output: OK: 24% free memory
[06:43:53] <labs-nagios-wm>	 RECOVERY Total processes is now: OK on parsoid-roundtrip5-8core.pmtpa.wmflabs 10.4.0.125 output: PROCS OK: 147 processes
[06:48:44] <labs-nagios-wm>	 RECOVERY Free ram is now: OK on mediawiki-bugfix-kozuch.pmtpa.wmflabs 10.4.0.26 output: OK: 32% free memory
[06:54:53] <labs-nagios-wm>	 PROBLEM Current Load is now: WARNING on bots-liwa.pmtpa.wmflabs 10.4.1.65 output: WARNING - load average: 2.47, 7.53, 5.25
[06:59:24] <labs-nagios-wm>	 PROBLEM Free ram is now: WARNING on bots-liwa.pmtpa.wmflabs 10.4.1.65 output: Warning: 19% free memory
[06:59:54] <labs-nagios-wm>	 RECOVERY Current Load is now: OK on bots-liwa.pmtpa.wmflabs 10.4.1.65 output: OK - load average: 0.34, 3.03, 3.93
[07:24:22] <labs-nagios-wm>	 RECOVERY Free ram is now: OK on bots-liwa.pmtpa.wmflabs 10.4.1.65 output: OK: 20% free memory
[08:07:24] <labs-nagios-wm>	 PROBLEM Free ram is now: WARNING on bots-liwa.pmtpa.wmflabs 10.4.1.65 output: Warning: 19% free memory
[08:37:54] <labs-nagios-wm>	 RECOVERY Free ram is now: OK on integration-jobbuilder.pmtpa.wmflabs 10.4.0.21 output: OK: 20% free memory
[08:40:54] <labs-nagios-wm>	 RECOVERY Free ram is now: OK on conventionextension-trial.pmtpa.wmflabs 10.4.0.165 output: OK: 21% free memory
[08:41:14] <labs-nagios-wm>	 RECOVERY Free ram is now: OK on sube.pmtpa.wmflabs 10.4.0.245 output: OK: 22% free memory
[08:53:52] <labs-nagios-wm>	 PROBLEM Free ram is now: WARNING on conventionextension-trial.pmtpa.wmflabs 10.4.0.165 output: Warning: 13% free memory
[09:00:34] <labs-nagios-wm>	 PROBLEM Total processes is now: WARNING on bots-salebot.pmtpa.wmflabs 10.4.0.163 output: PROCS WARNING: 171 processes
[09:01:04] <labs-nagios-wm>	 PROBLEM Current Load is now: WARNING on bots-sql1.pmtpa.wmflabs 10.4.0.52 output: WARNING - load average: 1.53, 11.38, 8.19
[09:04:14] <labs-nagios-wm>	 PROBLEM Free ram is now: WARNING on sube.pmtpa.wmflabs 10.4.0.245 output: Warning: 14% free memory
[09:05:54] <labs-nagios-wm>	 PROBLEM Free ram is now: WARNING on integration-jobbuilder.pmtpa.wmflabs 10.4.0.21 output: Warning: 16% free memory
[09:06:04] <labs-nagios-wm>	 PROBLEM Current Load is now: CRITICAL on bots-sql1.pmtpa.wmflabs 10.4.0.52 output: CRITICAL - load average: 37.61, 25.76, 15.25
[09:10:35] <labs-nagios-wm>	 RECOVERY Total processes is now: OK on bots-salebot.pmtpa.wmflabs 10.4.0.163 output: PROCS OK: 96 processes
[09:11:05] <labs-nagios-wm>	 PROBLEM Current Load is now: WARNING on bots-sql1.pmtpa.wmflabs 10.4.0.52 output: WARNING - load average: 1.98, 16.63, 15.12
[09:16:24] <labs-nagios-wm>	 PROBLEM Free ram is now: WARNING on bots-liwa.pmtpa.wmflabs 10.4.1.65 output: Warning: 19% free memory
[11:59:24] <labs-nagios-wm>	 PROBLEM Total processes is now: WARNING on bots-bnr1.pmtpa.wmflabs 10.4.1.68 output: PROCS WARNING: 156 processes
[12:38:55] <labs-nagios-wm>	 RECOVERY Free ram is now: OK on conventionextension-trial.pmtpa.wmflabs 10.4.0.165 output: OK: 21% free memory
[12:39:20] <labs-nagios-wm>	 RECOVERY Free ram is now: OK on sube.pmtpa.wmflabs 10.4.0.245 output: OK: 22% free memory
[12:40:53] <labs-nagios-wm>	 RECOVERY Free ram is now: OK on integration-jobbuilder.pmtpa.wmflabs 10.4.0.21 output: OK: 20% free memory
[12:51:53] <labs-nagios-wm>	 PROBLEM Free ram is now: WARNING on conventionextension-trial.pmtpa.wmflabs 10.4.0.165 output: Warning: 19% free memory
[12:53:53] <labs-nagios-wm>	 PROBLEM Free ram is now: WARNING on integration-jobbuilder.pmtpa.wmflabs 10.4.0.21 output: Warning: 16% free memory
[13:07:15] <labs-nagios-wm>	 PROBLEM Free ram is now: WARNING on sube.pmtpa.wmflabs 10.4.0.245 output: Warning: 14% free memory
[14:49:25] <labs-nagios-wm>	 RECOVERY Total processes is now: OK on bots-bnr1.pmtpa.wmflabs 10.4.1.68 output: PROCS OK: 146 processes
[15:30:35] <labs-nagios-wm>	 PROBLEM Free ram is now: UNKNOWN on aggregator2.pmtpa.wmflabs 10.4.0.193 output: NRPE: Call to fork() failed
[15:35:26] <labs-nagios-wm>	 PROBLEM Free ram is now: WARNING on bots-liwa.pmtpa.wmflabs 10.4.1.65 output: Warning: 19% free memory
[15:35:36] <labs-nagios-wm>	 PROBLEM Free ram is now: WARNING on aggregator2.pmtpa.wmflabs 10.4.0.193 output: Warning: 9% free memory
[16:05:34] <labs-nagios-wm>	 PROBLEM Free ram is now: CRITICAL on aggregator2.pmtpa.wmflabs 10.4.0.193 output: NRPE: Unable to read output
[16:37:13] <labs-nagios-wm>	 RECOVERY Free ram is now: OK on sube.pmtpa.wmflabs 10.4.0.245 output: OK: 22% free memory
[16:38:53] <labs-nagios-wm>	 RECOVERY Free ram is now: OK on integration-jobbuilder.pmtpa.wmflabs 10.4.0.21 output: OK: 20% free memory
[16:41:53] <labs-nagios-wm>	 RECOVERY Free ram is now: OK on conventionextension-trial.pmtpa.wmflabs 10.4.0.165 output: OK: 21% free memory
[16:45:15] <labs-nagios-wm>	 PROBLEM Free ram is now: WARNING on sube.pmtpa.wmflabs 10.4.0.245 output: Warning: 15% free memory
[16:45:25] <labs-nagios-wm>	 RECOVERY Free ram is now: OK on bots-liwa.pmtpa.wmflabs 10.4.1.65 output: OK: 20% free memory
[16:45:35] <labs-nagios-wm>	 PROBLEM Free ram is now: WARNING on aggregator2.pmtpa.wmflabs 10.4.0.193 output: Warning: 9% free memory
[16:46:55] <labs-nagios-wm>	 PROBLEM Free ram is now: WARNING on integration-jobbuilder.pmtpa.wmflabs 10.4.0.21 output: Warning: 16% free memory
[16:53:23] <labs-nagios-wm>	 PROBLEM Free ram is now: WARNING on bots-liwa.pmtpa.wmflabs 10.4.1.65 output: Warning: 19% free memory
[17:04:53] <labs-nagios-wm>	 PROBLEM Free ram is now: WARNING on conventionextension-trial.pmtpa.wmflabs 10.4.0.165 output: Warning: 13% free memory
[17:38:55] <labs-nagios-wm>	 PROBLEM Current Load is now: CRITICAL on deployment-puptest.pmtpa.wmflabs 10.4.0.195 output: Connection refused by host
[17:39:34] <labs-nagios-wm>	 PROBLEM Disk Space is now: CRITICAL on deployment-puptest.pmtpa.wmflabs 10.4.0.195 output: Connection refused by host
[17:40:22] <labs-nagios-wm>	 PROBLEM Free ram is now: CRITICAL on deployment-puptest.pmtpa.wmflabs 10.4.0.195 output: Connection refused by host
[17:43:52] <labs-nagios-wm>	 RECOVERY Current Load is now: OK on deployment-puptest.pmtpa.wmflabs 10.4.0.195 output: OK - load average: 0.09, 0.56, 0.44
[17:44:32] <labs-nagios-wm>	 RECOVERY Disk Space is now: OK on deployment-puptest.pmtpa.wmflabs 10.4.0.195 output: DISK OK
[17:45:14] <labs-nagios-wm>	 RECOVERY Free ram is now: OK on deployment-puptest.pmtpa.wmflabs 10.4.0.195 output: OK: 94% free memory
[17:55:35] <labs-nagios-wm>	 PROBLEM Free ram is now: UNKNOWN on aggregator2.pmtpa.wmflabs 10.4.0.193 output: Unknown
[18:00:34] <labs-nagios-wm>	 PROBLEM Free ram is now: WARNING on aggregator2.pmtpa.wmflabs 10.4.0.193 output: Warning: 9% free memory
[20:04:15] <labs-nagios-wm>	 PROBLEM Total processes is now: CRITICAL on deployment-squid.pmtpa.wmflabs 10.4.0.17 output: PROCS CRITICAL: 291 processes
[20:09:23] <labs-nagios-wm>	 PROBLEM Total processes is now: WARNING on deployment-squid.pmtpa.wmflabs 10.4.0.17 output: PROCS WARNING: 188 processes
[20:38:27] <labs-nagios-wm>	 RECOVERY Free ram is now: OK on bots-liwa.pmtpa.wmflabs 10.4.1.65 output: OK: 21% free memory
[20:40:14] <labs-nagios-wm>	 RECOVERY Free ram is now: OK on sube.pmtpa.wmflabs 10.4.0.245 output: OK: 23% free memory
[20:40:54] <labs-nagios-wm>	 PROBLEM Free ram is now: WARNING on stackfarm-sql1.pmtpa.wmflabs 10.4.1.8 output: Warning: 15% free memory
[20:41:54] <labs-nagios-wm>	 RECOVERY Free ram is now: OK on integration-jobbuilder.pmtpa.wmflabs 10.4.0.21 output: OK: 20% free memory
[21:04:53] <labs-nagios-wm>	 PROBLEM Free ram is now: WARNING on integration-jobbuilder.pmtpa.wmflabs 10.4.0.21 output: Warning: 16% free memory
[21:08:15] <labs-nagios-wm>	 PROBLEM Free ram is now: WARNING on sube.pmtpa.wmflabs 10.4.0.245 output: Warning: 15% free memory
[21:11:24] <labs-nagios-wm>	 PROBLEM Free ram is now: WARNING on bots-liwa.pmtpa.wmflabs 10.4.1.65 output: Warning: 19% free memory
[21:26:25] <labs-nagios-wm>	 RECOVERY Free ram is now: OK on bots-liwa.pmtpa.wmflabs 10.4.1.65 output: OK: 20% free memory
[22:20:25] <labs-nagios-wm>	 PROBLEM Free ram is now: WARNING on bots-liwa.pmtpa.wmflabs 10.4.1.65 output: Warning: 19% free memory
[22:30:35] <labs-nagios-wm>	 PROBLEM Free ram is now: CRITICAL on aggregator2.pmtpa.wmflabs 10.4.0.193 output: NRPE: Unable to read output
[22:35:35] <labs-nagios-wm>	 PROBLEM Free ram is now: WARNING on aggregator2.pmtpa.wmflabs 10.4.0.193 output: Warning: 9% free memory