[00:01:03] PROBLEM Current Load is now: CRITICAL on echo-xmpp i-00000351.pmtpa.wmflabs output: CHECK_NRPE: Socket timeout after 10 seconds. [00:01:53] PROBLEM Current Load is now: WARNING on parsoid-roundtrip4 i-000004d7.pmtpa.wmflabs output: WARNING - load average: 9.27, 9.55, 7.28 [00:01:53] PROBLEM Current Load is now: WARNING on parsoid-roundtrip3 i-000004d8.pmtpa.wmflabs output: WARNING - load average: 6.77, 7.79, 5.74 [00:02:03] PROBLEM Disk Space is now: WARNING on ve-roundtrip2 i-0000040d.pmtpa.wmflabs output: DISK WARNING - free space: /run 522 MB (5% inode=99%): [00:02:53] PROBLEM Current Load is now: WARNING on ve-roundtrip2 i-0000040d.pmtpa.wmflabs output: WARNING - load average: 5.61, 13.14, 9.80 [00:05:56] PROBLEM Current Load is now: WARNING on echo-xmpp i-00000351.pmtpa.wmflabs output: WARNING - load average: 7.31, 6.74, 6.64 [00:29:33] PROBLEM host: i-000003ef.pmtpa.wmflabs is DOWN address: i-000003ef.pmtpa.wmflabs CRITICAL - Host Unreachable (i-000003ef.pmtpa.wmflabs) [00:40:52] PROBLEM Free ram is now: WARNING on parsoid-roundtrip3 i-000004d8.pmtpa.wmflabs output: Warning: 6% free memory [00:45:52] RECOVERY Free ram is now: OK on parsoid-roundtrip3 i-000004d8.pmtpa.wmflabs output: OK: 46% free memory [00:47:02] RECOVERY Disk Space is now: OK on ve-roundtrip2 i-0000040d.pmtpa.wmflabs output: DISK OK [00:49:53] PROBLEM Current Load is now: WARNING on parsoid-roundtrip3 i-000004d8.pmtpa.wmflabs output: WARNING - load average: 12.49, 10.87, 9.93 [00:59:33] PROBLEM host: i-000003ef.pmtpa.wmflabs is DOWN address: i-000003ef.pmtpa.wmflabs CRITICAL - Host Unreachable (i-000003ef.pmtpa.wmflabs) [01:07:52] RECOVERY Current Load is now: OK on ve-roundtrip2 i-0000040d.pmtpa.wmflabs output: OK - load average: 3.02, 3.23, 4.69 [01:13:33] RECOVERY Current Users is now: OK on parsoid-spof i-000004d6.pmtpa.wmflabs output: USERS OK - 0 users currently logged in [01:14:23] RECOVERY Total processes is now: OK on parsoid-spof i-000004d6.pmtpa.wmflabs output: PROCS OK: 148 processes [01:20:02] PROBLEM Free ram is now: WARNING on parsoid-roundtrip4 i-000004d7.pmtpa.wmflabs output: Warning: 13% free memory [01:25:22] PROBLEM Disk Space is now: WARNING on labs-nfs1 i-0000005d.pmtpa.wmflabs output: DISK WARNING - free space: /export 1008 MB (5% inode=59%): /home/SAVE 1008 MB (5% inode=59%): [01:29:42] PROBLEM host: i-000003ef.pmtpa.wmflabs is DOWN address: i-000003ef.pmtpa.wmflabs CRITICAL - Host Unreachable (i-000003ef.pmtpa.wmflabs) [01:30:02] RECOVERY Free ram is now: OK on parsoid-roundtrip4 i-000004d7.pmtpa.wmflabs output: OK: 27% free memory [01:36:27] * marktraceur waves and takes credit for the warnings on parsoid VMs :) [01:45:53] PROBLEM Free ram is now: CRITICAL on parsoid-roundtrip4 i-000004d7.pmtpa.wmflabs output: Critical: 4% free memory [01:59:46] PROBLEM host: i-000003ef.pmtpa.wmflabs is DOWN address: i-000003ef.pmtpa.wmflabs CRITICAL - Host Unreachable (i-000003ef.pmtpa.wmflabs) [02:07:54] PROBLEM Free ram is now: CRITICAL on parsoid-roundtrip3 i-000004d8.pmtpa.wmflabs output: Critical: 1% free memory [02:29:43] PROBLEM host: i-000003ef.pmtpa.wmflabs is DOWN address: i-000003ef.pmtpa.wmflabs CRITICAL - Host Unreachable (i-000003ef.pmtpa.wmflabs) [02:39:44] RECOVERY Free ram is now: OK on bots-sql2 i-000000af.pmtpa.wmflabs output: OK: 20% free memory [02:40:54] PROBLEM Free ram is now: WARNING on parsoid-roundtrip3 i-000004d8.pmtpa.wmflabs output: Warning: 8% free memory [03:02:02] PROBLEM host: i-000003ef.pmtpa.wmflabs is DOWN address: i-000003ef.pmtpa.wmflabs CRITICAL - Host Unreachable (i-000003ef.pmtpa.wmflabs) [03:07:46] PROBLEM Free ram is now: WARNING on bots-sql2 i-000000af.pmtpa.wmflabs output: Warning: 14% free memory [03:28:52] PROBLEM Current Load is now: UNKNOWN on wikidata-dev-5 i-000004d3.pmtpa.wmflabs output: Invalid host name i-000004d3.pmtpa.wmflabs [03:32:03] PROBLEM host: i-000003ef.pmtpa.wmflabs is DOWN address: i-000003ef.pmtpa.wmflabs CRITICAL - Host Unreachable (i-000003ef.pmtpa.wmflabs) [03:33:53] PROBLEM Current Load is now: CRITICAL on wikidata-dev-5 i-000004d3.pmtpa.wmflabs output: Connection refused by host [03:45:23] PROBLEM Disk Space is now: CRITICAL on labs-nfs1 i-0000005d.pmtpa.wmflabs output: DISK CRITICAL - free space: /export 514 MB (2% inode=59%): /home/SAVE 514 MB (2% inode=59%): [04:02:57] PROBLEM Free ram is now: WARNING on orgcharts-dev i-0000018f.pmtpa.wmflabs output: Warning: 14% free memory [04:04:21] PROBLEM host: i-000003ef.pmtpa.wmflabs is DOWN address: i-000003ef.pmtpa.wmflabs CRITICAL - Host Unreachable (i-000003ef.pmtpa.wmflabs) [04:24:52] PROBLEM Free ram is now: WARNING on parsoid-roundtrip3 i-000004d8.pmtpa.wmflabs output: Warning: 7% free memory [04:27:55] PROBLEM Free ram is now: CRITICAL on orgcharts-dev i-0000018f.pmtpa.wmflabs output: Critical: 4% free memory [04:34:22] PROBLEM host: i-000003ef.pmtpa.wmflabs is DOWN address: i-000003ef.pmtpa.wmflabs CRITICAL - Host Unreachable (i-000003ef.pmtpa.wmflabs) [04:37:56] RECOVERY Free ram is now: OK on orgcharts-dev i-0000018f.pmtpa.wmflabs output: OK: 95% free memory [05:04:26] PROBLEM host: i-000003ef.pmtpa.wmflabs is DOWN address: i-000003ef.pmtpa.wmflabs CRITICAL - Host Unreachable (i-000003ef.pmtpa.wmflabs) [05:16:52] PROBLEM Free ram is now: WARNING on parsoid-roundtrip3 i-000004d8.pmtpa.wmflabs output: Warning: 16% free memory [05:34:23] PROBLEM host: i-000003ef.pmtpa.wmflabs is DOWN address: i-000003ef.pmtpa.wmflabs CRITICAL - Host Unreachable (i-000003ef.pmtpa.wmflabs) [06:04:25] PROBLEM host: i-000003ef.pmtpa.wmflabs is DOWN address: i-000003ef.pmtpa.wmflabs CRITICAL - Host Unreachable (i-000003ef.pmtpa.wmflabs) [06:04:35] PROBLEM Current Users is now: CRITICAL on maps-test-puppetosm2 i-000004d9.pmtpa.wmflabs output: Connection refused by host [06:05:23] PROBLEM Disk Space is now: CRITICAL on maps-test-puppetosm2 i-000004d9.pmtpa.wmflabs output: Connection refused by host [06:05:55] PROBLEM Free ram is now: CRITICAL on maps-test-puppetosm2 i-000004d9.pmtpa.wmflabs output: Connection refused by host [06:05:55] PROBLEM Current Load is now: CRITICAL on maps-test-puppetosm2 i-000004d9.pmtpa.wmflabs output: Connection refused by host [06:07:23] PROBLEM Total processes is now: CRITICAL on maps-test-puppetosm2 i-000004d9.pmtpa.wmflabs output: Connection refused by host [06:08:16] PROBLEM dpkg-check is now: CRITICAL on maps-test-puppetosm2 i-000004d9.pmtpa.wmflabs output: Connection refused by host [06:08:53] PROBLEM Free ram is now: CRITICAL on parsoid-roundtrip4 i-000004d7.pmtpa.wmflabs output: Critical: 3% free memory [06:10:52] RECOVERY Free ram is now: OK on maps-test-puppetosm2 i-000004d9.pmtpa.wmflabs output: OK: 556% free memory [06:10:52] RECOVERY Current Load is now: OK on maps-test-puppetosm2 i-000004d9.pmtpa.wmflabs output: OK - load average: 0.96, 0.96, 0.53 [06:12:32] RECOVERY Total processes is now: OK on maps-test-puppetosm2 i-000004d9.pmtpa.wmflabs output: PROCS OK: 84 processes [06:13:12] RECOVERY dpkg-check is now: OK on maps-test-puppetosm2 i-000004d9.pmtpa.wmflabs output: All packages OK [06:13:55] RECOVERY Free ram is now: OK on parsoid-roundtrip4 i-000004d7.pmtpa.wmflabs output: OK: 48% free memory [06:14:32] RECOVERY Current Users is now: OK on maps-test-puppetosm2 i-000004d9.pmtpa.wmflabs output: USERS OK - 0 users currently logged in [06:15:23] RECOVERY Disk Space is now: OK on maps-test-puppetosm2 i-000004d9.pmtpa.wmflabs output: DISK OK [06:26:54] PROBLEM Free ram is now: WARNING on parsoid-roundtrip3 i-000004d8.pmtpa.wmflabs output: Warning: 14% free memory [06:26:54] PROBLEM Free ram is now: WARNING on parsoid-roundtrip4 i-000004d7.pmtpa.wmflabs output: Warning: 14% free memory [06:31:37] PROBLEM Current Users is now: WARNING on parsoid-spof i-000004d6.pmtpa.wmflabs output: USERS WARNING - 6 users currently logged in [06:32:23] PROBLEM Total processes is now: WARNING on parsoid-spof i-000004d6.pmtpa.wmflabs output: PROCS WARNING: 160 processes [06:34:33] PROBLEM host: i-000003ef.pmtpa.wmflabs is DOWN address: i-000003ef.pmtpa.wmflabs CRITICAL - Host Unreachable (i-000003ef.pmtpa.wmflabs) [06:38:52] PROBLEM dpkg-check is now: CRITICAL on parsoid-roundtrip3 i-000004d8.pmtpa.wmflabs output: DPKG CRITICAL dpkg reports broken packages [06:50:22] RECOVERY Disk Space is now: OK on labs-nfs1 i-0000005d.pmtpa.wmflabs output: DISK OK [07:04:42] PROBLEM host: i-000003ef.pmtpa.wmflabs is DOWN address: i-000003ef.pmtpa.wmflabs CRITICAL - Host Unreachable (i-000003ef.pmtpa.wmflabs) [07:34:45] PROBLEM host: i-000003ef.pmtpa.wmflabs is DOWN address: i-000003ef.pmtpa.wmflabs CRITICAL - Host Unreachable (i-000003ef.pmtpa.wmflabs) [07:35:00] [bz] (8NEW - created by: 2Jasper Deng, priority: 4Unprioritized - 6major) [Bug 39446] Spamming continuing on beta wikis - https://bugzilla.wikimedia.org/show_bug.cgi?id=39446 [08:04:43] PROBLEM host: i-000003ef.pmtpa.wmflabs is DOWN address: i-000003ef.pmtpa.wmflabs CRITICAL - Host Unreachable (i-000003ef.pmtpa.wmflabs) [08:16:03] 10/20/2012 - 08:16:03 - Created a home directory for hazard-sj in project(s): bots [08:21:00] 10/20/2012 - 08:20:59 - User hazard-sj may have been modified in LDAP or locally, updating key in project(s): bots [08:34:52] PROBLEM host: i-000003ef.pmtpa.wmflabs is DOWN address: i-000003ef.pmtpa.wmflabs CRITICAL - Host Unreachable (i-000003ef.pmtpa.wmflabs) [08:40:53] PROBLEM Free ram is now: WARNING on parsoid-roundtrip3 i-000004d8.pmtpa.wmflabs output: Warning: 7% free memory [08:55:52] RECOVERY Free ram is now: OK on parsoid-roundtrip3 i-000004d8.pmtpa.wmflabs output: OK: 20% free memory [09:05:52] PROBLEM host: i-000003ef.pmtpa.wmflabs is DOWN address: i-000003ef.pmtpa.wmflabs CRITICAL - Host Unreachable (i-000003ef.pmtpa.wmflabs) [09:36:52] PROBLEM host: i-000003ef.pmtpa.wmflabs is DOWN address: i-000003ef.pmtpa.wmflabs CRITICAL - Host Unreachable (i-000003ef.pmtpa.wmflabs) [09:55:22] New patchset: jan; "Update .gitreview" [labs/centralauth] (scripts) - https://gerrit.wikimedia.org/r/28803 [09:55:47] Change merged: jan; [labs/centralauth] (scripts) - https://gerrit.wikimedia.org/r/28803 [10:07:03] PROBLEM host: i-000003ef.pmtpa.wmflabs is DOWN address: i-000003ef.pmtpa.wmflabs CRITICAL - Host Unreachable (i-000003ef.pmtpa.wmflabs) [10:38:53] PROBLEM host: i-000003ef.pmtpa.wmflabs is DOWN address: i-000003ef.pmtpa.wmflabs CRITICAL - Host Unreachable (i-000003ef.pmtpa.wmflabs) [10:51:42] PROBLEM Current Users is now: UNKNOWN on parsoid-spof i-000004d6.pmtpa.wmflabs output: Invalid host name i-000004d6.pmtpa.wmflabs [10:56:33] PROBLEM Current Users is now: WARNING on parsoid-spof i-000004d6.pmtpa.wmflabs output: USERS WARNING - 6 users currently logged in [11:01:52] PROBLEM Free ram is now: WARNING on parsoid-roundtrip3 i-000004d8.pmtpa.wmflabs output: Warning: 12% free memory [11:09:13] PROBLEM host: i-000003ef.pmtpa.wmflabs is DOWN address: i-000003ef.pmtpa.wmflabs CRITICAL - Host Unreachable (i-000003ef.pmtpa.wmflabs) [11:39:15] PROBLEM host: i-000003ef.pmtpa.wmflabs is DOWN address: i-000003ef.pmtpa.wmflabs CRITICAL - Host Unreachable (i-000003ef.pmtpa.wmflabs) [11:43:22] PROBLEM Disk Space is now: WARNING on labs-nfs1 i-0000005d.pmtpa.wmflabs output: DISK WARNING - free space: /export 1004 MB (5% inode=59%): /home/SAVE 1004 MB (5% inode=59%): [12:09:23] PROBLEM host: i-000003ef.pmtpa.wmflabs is DOWN address: i-000003ef.pmtpa.wmflabs CRITICAL - Host Unreachable (i-000003ef.pmtpa.wmflabs) [12:24:52] PROBLEM Free ram is now: WARNING on parsoid-roundtrip4 i-000004d7.pmtpa.wmflabs output: Warning: 14% free memory [12:39:23] PROBLEM host: i-000003ef.pmtpa.wmflabs is DOWN address: i-000003ef.pmtpa.wmflabs CRITICAL - Host Unreachable (i-000003ef.pmtpa.wmflabs) [13:06:32] PROBLEM Total processes is now: WARNING on wikistats-01 i-00000042.pmtpa.wmflabs output: PROCS WARNING: 190 processes [13:09:32] PROBLEM host: i-000003ef.pmtpa.wmflabs is DOWN address: i-000003ef.pmtpa.wmflabs CRITICAL - Host Unreachable (i-000003ef.pmtpa.wmflabs) [13:11:35] RECOVERY Total processes is now: OK on wikistats-01 i-00000042.pmtpa.wmflabs output: PROCS OK: 97 processes [13:13:56] PROBLEM Free ram is now: WARNING on aggregator1 i-0000010c.pmtpa.wmflabs output: Warning: 19% free memory [13:39:32] PROBLEM host: i-000003ef.pmtpa.wmflabs is DOWN address: i-000003ef.pmtpa.wmflabs CRITICAL - Host Unreachable (i-000003ef.pmtpa.wmflabs) [13:58:23] PROBLEM Disk Space is now: CRITICAL on labs-nfs1 i-0000005d.pmtpa.wmflabs output: DISK CRITICAL - free space: /export 507 MB (2% inode=60%): /home/SAVE 507 MB (2% inode=60%): [14:09:32] PROBLEM host: i-000003ef.pmtpa.wmflabs is DOWN address: i-000003ef.pmtpa.wmflabs CRITICAL - Host Unreachable (i-000003ef.pmtpa.wmflabs) [14:20:06] !log deployment-prep csteipp: reimporting enwikivoyage database [14:39:35] PROBLEM host: i-000003ef.pmtpa.wmflabs is DOWN address: i-000003ef.pmtpa.wmflabs CRITICAL - Host Unreachable (i-000003ef.pmtpa.wmflabs) [15:04:32] PROBLEM Total processes is now: WARNING on wikistats-01 i-00000042.pmtpa.wmflabs output: PROCS WARNING: 190 processes [15:09:33] PROBLEM host: i-000003ef.pmtpa.wmflabs is DOWN address: i-000003ef.pmtpa.wmflabs CRITICAL - Host Unreachable (i-000003ef.pmtpa.wmflabs) [15:29:36] RECOVERY Total processes is now: OK on wikistats-01 i-00000042.pmtpa.wmflabs output: PROCS OK: 97 processes [15:39:42] PROBLEM host: i-000003ef.pmtpa.wmflabs is DOWN address: i-000003ef.pmtpa.wmflabs CRITICAL - Host Unreachable (i-000003ef.pmtpa.wmflabs) [16:09:44] PROBLEM host: i-000003ef.pmtpa.wmflabs is DOWN address: i-000003ef.pmtpa.wmflabs CRITICAL - Host Unreachable (i-000003ef.pmtpa.wmflabs) [16:39:42] PROBLEM host: i-000003ef.pmtpa.wmflabs is DOWN address: i-000003ef.pmtpa.wmflabs CRITICAL - Host Unreachable (i-000003ef.pmtpa.wmflabs) [17:06:39] Hello, when I try to login to https://labsconsole.wikimedia.org, I get "Labs uses cookies to log in users. You have cookies disabled. Please enable them and try again." [17:06:50] Cookies are enabled. [17:07:19] Loggingin to Wikipedia works. [17:07:19] same here [17:09:46] PROBLEM host: i-000003ef.pmtpa.wmflabs is DOWN address: i-000003ef.pmtpa.wmflabs CRITICAL - Host Unreachable (i-000003ef.pmtpa.wmflabs) [17:14:54] Same problem for me... [17:39:42] PROBLEM host: i-000003ef.pmtpa.wmflabs is DOWN address: i-000003ef.pmtpa.wmflabs CRITICAL - Host Unreachable (i-000003ef.pmtpa.wmflabs) [17:50:00] seems to work ok for me [18:01:52] Is there a way to figure out why it doesn't work for some? [18:05:35] not sure, it does seem ruddy slow for me though. That might be due to it going over my vpn though [18:09:43] PROBLEM host: i-000003ef.pmtpa.wmflabs is DOWN address: i-000003ef.pmtpa.wmflabs CRITICAL - Host Unreachable (i-000003ef.pmtpa.wmflabs) [18:11:02] Damianz: It is really slow here too [18:27:03] aude: I have updated the repository with the latest packages as well now. [18:36:28] RECOVERY Current Users is now: OK on parsoid-spof i-000004d6.pmtpa.wmflabs output: USERS OK - 0 users currently logged in [18:37:28] RECOVERY Total processes is now: OK on parsoid-spof i-000004d6.pmtpa.wmflabs output: PROCS OK: 150 processes [18:39:48] PROBLEM host: i-000003ef.pmtpa.wmflabs is DOWN address: i-000003ef.pmtpa.wmflabs CRITICAL - Host Unreachable (i-000003ef.pmtpa.wmflabs) [19:07:35] PROBLEM Total processes is now: WARNING on wikistats-01 i-00000042.pmtpa.wmflabs output: PROCS WARNING: 190 processes [19:10:42] PROBLEM host: i-000003ef.pmtpa.wmflabs is DOWN address: i-000003ef.pmtpa.wmflabs CRITICAL - Host Unreachable (i-000003ef.pmtpa.wmflabs) [19:16:53] PROBLEM Free ram is now: WARNING on ipv6test1 i-00000282.pmtpa.wmflabs output: Warning: 19% free memory [19:40:22] PROBLEM Total processes is now: WARNING on parsoid-spof i-000004d6.pmtpa.wmflabs output: PROCS WARNING: 153 processes [19:41:42] PROBLEM host: i-000003ef.pmtpa.wmflabs is DOWN address: i-000003ef.pmtpa.wmflabs CRITICAL - Host Unreachable (i-000003ef.pmtpa.wmflabs) [19:44:32] PROBLEM Current Users is now: WARNING on parsoid-spof i-000004d6.pmtpa.wmflabs output: USERS WARNING - 6 users currently logged in [19:45:24] RECOVERY Total processes is now: OK on parsoid-spof i-000004d6.pmtpa.wmflabs output: PROCS OK: 150 processes [19:54:34] RECOVERY Current Users is now: OK on parsoid-spof i-000004d6.pmtpa.wmflabs output: USERS OK - 0 users currently logged in [20:02:33] PROBLEM Total processes is now: CRITICAL on wikistats-01 i-00000042.pmtpa.wmflabs output: PROCS CRITICAL: 283 processes [20:12:03] PROBLEM host: i-000003ef.pmtpa.wmflabs is DOWN address: i-000003ef.pmtpa.wmflabs CRITICAL - Host Unreachable (i-000003ef.pmtpa.wmflabs) [20:17:33] PROBLEM Total processes is now: WARNING on wikistats-01 i-00000042.pmtpa.wmflabs output: PROCS WARNING: 193 processes [20:42:05] PROBLEM host: i-000003ef.pmtpa.wmflabs is DOWN address: i-000003ef.pmtpa.wmflabs CRITICAL - Host Unreachable (i-000003ef.pmtpa.wmflabs) [21:06:52] PROBLEM Free ram is now: CRITICAL on parsoid-roundtrip4 i-000004d7.pmtpa.wmflabs output: Critical: 2% free memory [21:11:53] RECOVERY Free ram is now: OK on parsoid-roundtrip4 i-000004d7.pmtpa.wmflabs output: OK: 41% free memory [21:14:13] PROBLEM host: i-000003ef.pmtpa.wmflabs is DOWN address: i-000003ef.pmtpa.wmflabs CRITICAL - Host Unreachable (i-000003ef.pmtpa.wmflabs) [21:44:13] PROBLEM host: i-000003ef.pmtpa.wmflabs is DOWN address: i-000003ef.pmtpa.wmflabs CRITICAL - Host Unreachable (i-000003ef.pmtpa.wmflabs) [22:02:35] PROBLEM Total processes is now: CRITICAL on wikistats-01 i-00000042.pmtpa.wmflabs output: PROCS CRITICAL: 283 processes [22:12:35] PROBLEM Total processes is now: WARNING on wikistats-01 i-00000042.pmtpa.wmflabs output: PROCS WARNING: 190 processes [22:14:26] PROBLEM host: i-000003ef.pmtpa.wmflabs is DOWN address: i-000003ef.pmtpa.wmflabs CRITICAL - Host Unreachable (i-000003ef.pmtpa.wmflabs) [22:32:33] RECOVERY Total processes is now: OK on wikistats-01 i-00000042.pmtpa.wmflabs output: PROCS OK: 97 processes [22:37:34] PROBLEM Current Users is now: WARNING on parsoid-spof i-000004d6.pmtpa.wmflabs output: USERS WARNING - 6 users currently logged in [22:43:24] PROBLEM Total processes is now: WARNING on parsoid-spof i-000004d6.pmtpa.wmflabs output: PROCS WARNING: 152 processes [22:44:23] PROBLEM host: i-000003ef.pmtpa.wmflabs is DOWN address: i-000003ef.pmtpa.wmflabs CRITICAL - Host Unreachable (i-000003ef.pmtpa.wmflabs) [22:46:54] RECOVERY Free ram is now: OK on ipv6test1 i-00000282.pmtpa.wmflabs output: OK: 20% free memory [22:54:53] PROBLEM Free ram is now: WARNING on ipv6test1 i-00000282.pmtpa.wmflabs output: Warning: 17% free memory [23:14:24] PROBLEM host: i-000003ef.pmtpa.wmflabs is DOWN address: i-000003ef.pmtpa.wmflabs CRITICAL - Host Unreachable (i-000003ef.pmtpa.wmflabs) [23:19:54] RECOVERY Free ram is now: OK on ipv6test1 i-00000282.pmtpa.wmflabs output: OK: 20% free memory [23:44:32] PROBLEM host: i-000003ef.pmtpa.wmflabs is DOWN address: i-000003ef.pmtpa.wmflabs CRITICAL - Host Unreachable (i-000003ef.pmtpa.wmflabs)