[00:04:18] Free Memory on turnera is CRITICAL: CRITICAL - 3.3% (279564 kB) free! [00:04:56] s4 replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 3645.000000 [00:09:18] Free Memory on turnera is WARNING: WARNING - 5.3% (442916 kB) free! [00:31:37] MySQL slave on z-dat-s2-b is CRITICAL: (Return code of 139 is out of bounds) [00:32:08] wikidata replag on z-dat-s2-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 553104.000000 [00:32:08] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [00:32:26] FC 0/18 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [00:32:37] APT on yucca is CRITICAL: APT CRITICAL: 5 packages available for upgrade (4 critical updates). [00:32:47] FMA on thyme is CRITICAL: ERROR - unexpected output from snmpwalk [00:32:48] NTP on sage is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:32:48] FC 0/0 [SAN far1-n1-oe16-esams A1] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [00:32:48] eth0 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [00:32:57] wikidata replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 50670.000000 [00:33:09] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 790069.000000 [00:33:18] Free Memory on turnera is OK: OK - 7.1% (595304 kB) free. [00:33:29] FMA on amaranth is CRITICAL: ERROR - unexpected output from snmpwalk [00:33:29] NTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:33:29] FC 0/15 [fsw2-n1-oe16-esams] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [00:33:37] FC 0/13 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [00:33:37] FC 0/22 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [00:33:48] NTP on amaranth is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:33:48] MySQL slave on z-dat-s1-b is CRITICAL: Cant connect to MySQL server on z-dat-s1-b (146) [00:33:49] SMTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:33:49] FC 0/23 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [00:33:49] FC 0/14 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [00:33:57] FC 0/16 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [00:33:58] FC 0/6 [rosemary] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [00:34:19] Load avg. on amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [00:34:19] SMF on web.amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [00:34:19] FC 0/3 [cassia] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [00:34:20] RAID on thyme is UNKNOWN: NRPE: Unable to read output [00:34:20] / on thyme is UNKNOWN: NRPE: Unable to read output [00:34:20] wikidata replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 164139.000000 [00:34:20] wikidata replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 968740.000000 [00:34:26] FC 0/5 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [00:34:26] FC 0/4 [hyacinth] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [00:34:38] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A: [00:34:38] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [00:35:47] FC 0/17 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [00:38:09] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [00:38:20] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 74491 MB (12% inode=99%): [00:39:26] aliasd on nightshade is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:39:37] /mnt on thyme is UNKNOWN: NRPE: Unable to read output [00:39:38] FC 0/19 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [00:39:38] FC 0/21 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [00:39:38] FC 0/1 [far1-n1-oe16-esams B1] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [00:39:38] FC 0/8 [adenia] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [00:39:38] FC 0/10 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [00:39:38] s1 replag on thyme is CRITICAL: QUERY CRITICAL: Cant connect to MySQL server on thyme (146) [00:39:38] /tmp on thyme is UNKNOWN: NRPE: Unable to read output [00:39:48] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 286988 MB (5% inode=62%): [00:39:48] MySQL slave on z-dat-s5-b is CRITICAL: (Return code of 139 is out of bounds) [00:39:48] FC 0/2 [hemlock] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [00:39:57] FC 0/7 [daphne] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [00:39:57] FC 0/9 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [00:40:09] APT on sage is CRITICAL: APT CRITICAL: 7 packages available for upgrade (4 critical updates). [00:40:37] FC 0/12 [thyme] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [00:40:47] Environment IPMI on thyme is UNKNOWN: NRPE: Unable to read output [00:40:48] FC 0/20 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [00:40:49] FC 0/11 [fsw2-n1-oe16-esams] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [00:41:18] Free Memory on turnera is WARNING: WARNING - 6.0% (500148 kB) free! [00:42:56] Load avg. on thyme is UNKNOWN: NRPE: Unable to read output [00:43:09] wikidata replag on z-dat-s6-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 597630.000000 [00:43:19] SMF on amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [00:47:09] wikidata replag on z-dat-s7-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 435945.000000 [00:48:48] MySQL on z-dat-s1-b is CRITICAL: Cant connect to MySQL server on z-dat-s1-b (146) [00:56:46] MySQL on z-dat-s1-b is OK: Uptime: 2554 Threads: 7 Questions: 1542 Slow queries: 0 Opens: 52 Flush tables: 1 Open tables: 45 Queries per second avg: 0.603 [00:59:18] Free Memory on turnera is CRITICAL: CRITICAL - 4.2% (352108 kB) free! [00:59:57] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [01:00:19] Free Memory on turnera is WARNING: WARNING - 5.5% (461720 kB) free! [01:02:26] nacht ts [01:04:57] s4 replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 4892.000000 [01:06:59] s4 replag on z-dat-s5-b is WARNING: QUERY WARNING: SELECT ts_rc_age() returned 3054.000000 [01:08:57] s4 replag on z-dat-s5-b is OK: QUERY OK: SELECT ts_rc_age() returned 1695.000000 [01:09:18] Free Memory on turnera is OK: OK - 7.2% (605148 kB) free. [01:31:37] MySQL slave on z-dat-s2-b is CRITICAL: (Return code of 139 is out of bounds) [01:32:09] wikidata replag on z-dat-s2-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 552111.000000 [01:32:09] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [01:32:25] FC 0/18 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [01:32:48] FMA on thyme is CRITICAL: ERROR - unexpected output from snmpwalk [01:32:48] NTP on sage is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:32:48] FC 0/0 [SAN far1-n1-oe16-esams A1] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [01:32:48] eth0 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [01:33:09] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 793463.000000 [01:33:36] APT on yucca is CRITICAL: APT CRITICAL: 5 packages available for upgrade (4 critical updates). [01:33:47] FC 0/13 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [01:33:48] FC 0/22 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [01:33:48] NTP on amaranth is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:33:49] MySQL slave on z-dat-s1-b is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 50470 [01:33:49] SMTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:33:49] FC 0/23 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [01:33:49] FC 0/14 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [01:33:57] FC 0/6 [rosemary] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [01:33:57] FC 0/16 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [01:33:57] wikidata replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 54330.000000 [01:34:27] FMA on amaranth is CRITICAL: ERROR - unexpected output from snmpwalk [01:34:27] NTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:34:27] FC 0/4 [hyacinth] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [01:34:27] FC 0/15 [fsw2-n1-oe16-esams] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [01:34:27] FC 0/5 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [01:34:37] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A: [01:34:37] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [01:35:18] Load avg. on amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [01:35:18] SMF on web.amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [01:35:18] FC 0/3 [cassia] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [01:35:18] RAID on thyme is UNKNOWN: NRPE: Unable to read output [01:35:18] / on thyme is UNKNOWN: NRPE: Unable to read output [01:35:19] wikidata replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 161731.000000 [01:35:19] wikidata replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 969104.000000 [01:35:48] FC 0/17 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [01:38:08] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [01:39:18] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 74136 MB (12% inode=99%): [01:39:39] [[~multichill/commons deletion checker.php]] ! 10https://wiki.toolserver.org/w/index.php?diff=7910&oldid=4762&rcid=21769 * 141.0.8.24 * (-266) (Delete) [01:39:48] FC 0/10 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [01:39:48] FC 0/21 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [01:39:48] FC 0/19 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [01:39:49] FC 0/8 [adenia] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [01:39:49] FC 0/1 [far1-n1-oe16-esams B1] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [01:39:49] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 286856 MB (5% inode=62%): [01:39:49] MySQL slave on z-dat-s5-b is CRITICAL: (Return code of 139 is out of bounds) [01:39:49] FC 0/2 [hemlock] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [01:39:57] FC 0/7 [daphne] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [01:39:57] FC 0/9 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [01:40:09] APT on sage is CRITICAL: APT CRITICAL: 7 packages available for upgrade (4 critical updates). [01:40:26] aliasd on nightshade is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:40:36] /mnt on thyme is UNKNOWN: NRPE: Unable to read output [01:40:36] s1 replag on thyme is CRITICAL: QUERY CRITICAL: Cant connect to MySQL server on thyme (146) [01:40:36] /tmp on thyme is UNKNOWN: NRPE: Unable to read output [01:40:47] FC 0/12 [thyme] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [01:41:46] Environment IPMI on thyme is UNKNOWN: NRPE: Unable to read output [01:41:47] FC 0/11 [fsw2-n1-oe16-esams] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [01:41:47] FC 0/20 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [01:43:56] Load avg. on thyme is UNKNOWN: NRPE: Unable to read output [01:44:08] wikidata replag on z-dat-s6-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 591984.000000 [01:44:11] [[~soxred93/ec]] ! 10https://wiki.toolserver.org/w/index.php?diff=7911&oldid=6966&rcid=21770 * 141.0.8.24 * (-670) (Delete) [01:44:18] SMF on amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [01:47:09] wikidata replag on z-dat-s7-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 433433.000000 [01:49:51] [[WikiProxy/rewrite]] ! 10https://wiki.toolserver.org/w/index.php?diff=7912&oldid=4434&rcid=21771 * 141.0.8.24 * (-309) (Delete) [01:50:49] [[WikiProxy]] ! 10https://wiki.toolserver.org/w/index.php?diff=7913&oldid=7861&rcid=21772 * 141.0.8.24 * (-47) (Delete) [01:59:17] Free Memory on turnera is CRITICAL: CRITICAL - 4.7% (394920 kB) free! [01:59:58] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [02:00:18] Free Memory on turnera is WARNING: WARNING - 5.8% (487356 kB) free! [02:01:04] ummmmm [02:01:07] what is that IP doing? [02:01:17] Susan: ^ [02:05:18] Free Memory on turnera is OK: OK - 7.1% (595640 kB) free. [02:31:37] MySQL slave on z-dat-s2-b is CRITICAL: (Return code of 139 is out of bounds) [02:32:08] wikidata replag on z-dat-s2-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 550759.000000 [02:32:09] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [02:32:25] FC 0/18 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [02:32:49] FMA on thyme is CRITICAL: ERROR - unexpected output from snmpwalk [02:32:49] NTP on sage is CRITICAL: CRITICAL - Socket timeout after 10 seconds [02:32:49] eth0 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [02:32:49] FC 0/0 [SAN far1-n1-oe16-esams A1] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [02:33:09] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 796826.000000 [02:33:37] APT on yucca is CRITICAL: APT CRITICAL: 5 packages available for upgrade (4 critical updates). [02:33:48] FC 0/22 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [02:33:49] NTP on amaranth is CRITICAL: CRITICAL - Socket timeout after 10 seconds [02:33:50] MySQL slave on z-dat-s1-b is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 46881 [02:33:50] SMTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [02:33:50] FC 0/14 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [02:33:50] FC 0/23 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [02:33:57] FC 0/6 [rosemary] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [02:33:58] FC 0/16 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [02:33:58] wikidata replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 57930.000000 [02:34:26] FMA on amaranth is CRITICAL: ERROR - unexpected output from snmpwalk [02:34:26] NTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [02:34:26] FC 0/4 [hyacinth] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [02:34:26] FC 0/15 [fsw2-n1-oe16-esams] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [02:34:37] FC 0/13 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [02:34:37] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A: [02:34:38] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [02:35:18] Load avg. on amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [02:35:18] SMF on web.amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [02:35:18] FC 0/3 [cassia] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [02:35:18] RAID on thyme is UNKNOWN: NRPE: Unable to read output [02:35:18] / on thyme is UNKNOWN: NRPE: Unable to read output [02:35:19] wikidata replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 158960.000000 [02:35:19] wikidata replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 966715.000000 [02:35:25] FC 0/5 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [02:35:47] FC 0/17 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [02:38:09] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [02:39:19] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 72005 MB (11% inode=99%): [02:39:49] FC 0/21 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [02:39:49] FC 0/10 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [02:39:49] FC 0/19 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [02:39:49] FC 0/1 [far1-n1-oe16-esams B1] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [02:39:49] FC 0/8 [adenia] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [02:39:49] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 286675 MB (5% inode=62%): [02:39:50] MySQL slave on z-dat-s5-b is CRITICAL: (Return code of 139 is out of bounds) [02:39:50] FC 0/2 [hemlock] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [02:39:57] FC 0/9 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [02:39:57] FC 0/7 [daphne] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [02:40:09] APT on sage is CRITICAL: APT CRITICAL: 7 packages available for upgrade (4 critical updates). [02:40:26] aliasd on nightshade is CRITICAL: CRITICAL - Socket timeout after 10 seconds [02:40:37] /mnt on thyme is UNKNOWN: NRPE: Unable to read output [02:40:38] s1 replag on thyme is CRITICAL: QUERY CRITICAL: Cant connect to MySQL server on thyme (146) [02:40:38] /tmp on thyme is UNKNOWN: NRPE: Unable to read output [02:40:47] FC 0/12 [thyme] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [02:41:47] Environment IPMI on thyme is UNKNOWN: NRPE: Unable to read output [02:41:47] FC 0/11 [fsw2-n1-oe16-esams] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [02:41:47] FC 0/20 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [02:43:56] Load avg. on thyme is UNKNOWN: NRPE: Unable to read output [02:44:09] wikidata replag on z-dat-s6-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 590501.000000 [02:44:18] SMF on amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [02:45:18] Free Memory on turnera is WARNING: WARNING - 6.5% (543620 kB) free! [02:47:09] wikidata replag on z-dat-s7-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 430870.000000 [02:50:18] Free Memory on turnera is OK: OK - 7.1% (598420 kB) free. [02:53:23] legoktm: Why would I know? [02:53:35] No clue, but you could rollback it. [02:53:53] Why? [02:56:05] Because it blanked a lot of pages? [03:29:57] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [03:31:37] MySQL slave on z-dat-s2-b is CRITICAL: (Return code of 139 is out of bounds) [03:32:09] wikidata replag on z-dat-s2-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 548532.000000 [03:32:10] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [03:32:37] FC 0/18 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [03:33:08] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 800259.000000 [03:33:48] FMA on thyme is CRITICAL: ERROR - unexpected output from snmpwalk [03:33:49] NTP on sage is CRITICAL: CRITICAL - Socket timeout after 10 seconds [03:33:49] FC 0/0 [SAN far1-n1-oe16-esams A1] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [03:33:49] eth0 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [03:33:56] FC 0/6 [rosemary] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [03:33:57] FC 0/16 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [03:33:58] wikidata replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 61530.000000 [03:34:29] FMA on amaranth is CRITICAL: ERROR - unexpected output from snmpwalk [03:34:29] NTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [03:34:29] FC 0/4 [hyacinth] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [03:34:29] FC 0/15 [fsw2-n1-oe16-esams] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [03:34:37] FC 0/13 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [03:34:37] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A: [03:34:37] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [03:34:37] APT on yucca is CRITICAL: APT CRITICAL: 5 packages available for upgrade (4 critical updates). [03:34:47] FC 0/22 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [03:34:47] NTP on amaranth is CRITICAL: CRITICAL - Socket timeout after 10 seconds [03:34:47] SMTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [03:34:47] MySQL slave on z-dat-s1-b is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 43132 [03:34:47] FC 0/14 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [03:34:49] FC 0/23 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [03:35:18] Load avg. on amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [03:35:19] SMF on web.amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [03:35:19] FC 0/3 [cassia] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [03:35:19] RAID on thyme is UNKNOWN: NRPE: Unable to read output [03:35:19] / on thyme is UNKNOWN: NRPE: Unable to read output [03:35:19] wikidata replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 156752.000000 [03:35:38] FC 0/5 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [03:35:48] FC 0/17 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [03:36:17] wikidata replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 964031.000000 [03:38:09] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [03:39:19] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 73705 MB (12% inode=99%): [03:39:57] FC 0/7 [daphne] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [03:39:57] FC 0/9 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [03:40:09] APT on sage is CRITICAL: APT CRITICAL: 7 packages available for upgrade (4 critical updates). [03:40:37] /mnt on thyme is UNKNOWN: NRPE: Unable to read output [03:40:38] aliasd on nightshade is CRITICAL: CRITICAL - Socket timeout after 10 seconds [03:40:38] s1 replag on thyme is CRITICAL: QUERY CRITICAL: Cant connect to MySQL server on thyme (146) [03:40:38] /tmp on thyme is UNKNOWN: NRPE: Unable to read output [03:40:48] FC 0/21 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [03:40:48] FC 0/10 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [03:40:48] FC 0/8 [adenia] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [03:40:48] FC 0/12 [thyme] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [03:40:48] FC 0/1 [far1-n1-oe16-esams B1] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [03:40:48] FC 0/19 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [03:40:49] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 289239 MB (5% inode=62%): [03:40:49] MySQL slave on z-dat-s5-b is CRITICAL: (Return code of 139 is out of bounds) [03:40:49] FC 0/2 [hemlock] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [03:41:48] Environment IPMI on thyme is UNKNOWN: NRPE: Unable to read output [03:41:48] FC 0/20 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [03:41:48] FC 0/11 [fsw2-n1-oe16-esams] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [03:43:58] Load avg. on thyme is UNKNOWN: NRPE: Unable to read output [03:44:09] wikidata replag on z-dat-s6-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 590792.000000 [03:44:19] SMF on amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [03:47:09] wikidata replag on z-dat-s7-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 428287.000000 [03:59:16] Free Memory on turnera is CRITICAL: CRITICAL - 3.2% (266892 kB) free! [04:08:18] Free Memory on turnera is WARNING: WARNING - 5.3% (447916 kB) free! [04:15:17] Free Memory on turnera is OK: OK - 7.2% (600780 kB) free. [04:20:32] [[WikiProxy]] 10https://wiki.toolserver.org/w/index.php?diff=7914&oldid=7913&rcid=21773 * MZMcBride * (+47) (rv) [04:20:39] [[WikiProxy/rewrite]] 10https://wiki.toolserver.org/w/index.php?diff=7915&oldid=7912&rcid=21774 * MZMcBride * (+309) (rv) [04:20:49] [[~soxred93/ec]] 10https://wiki.toolserver.org/w/index.php?diff=7916&oldid=7911&rcid=21775 * MZMcBride * (+670) (rv) [04:20:59] [[~multichill/commons deletion checker.php]] 10https://wiki.toolserver.org/w/index.php?diff=7917&oldid=7910&rcid=21776 * MZMcBride * (+266) (rv) [04:29:57] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [04:32:09] wikidata replag on z-dat-s2-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 545642.000000 [04:32:09] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [04:32:37] FC 0/18 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [04:32:37] MySQL slave on z-dat-s2-b is CRITICAL: (Return code of 139 is out of bounds) [04:33:09] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 803682.000000 [04:33:48] FMA on thyme is CRITICAL: ERROR - unexpected output from snmpwalk [04:33:48] NTP on sage is CRITICAL: CRITICAL - Socket timeout after 10 seconds [04:33:58] eth0 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [04:33:58] FC 0/6 [rosemary] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [04:33:58] FC 0/0 [SAN far1-n1-oe16-esams A1] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [04:33:58] FC 0/16 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [04:33:58] wikidata replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 65130.000000 [04:34:27] FMA on amaranth is CRITICAL: ERROR - unexpected output from snmpwalk [04:34:37] NTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [04:34:37] FC 0/4 [hyacinth] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [04:34:37] FC 0/15 [fsw2-n1-oe16-esams] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [04:34:37] FC 0/13 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [04:34:37] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [04:34:37] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [04:34:38] APT on yucca is CRITICAL: APT CRITICAL: 5 packages available for upgrade (4 critical updates). [04:34:47] FC 0/22 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [04:34:47] NTP on amaranth is CRITICAL: CRITICAL - Socket timeout after 10 seconds [04:34:48] SMTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [04:34:48] MySQL slave on z-dat-s1-b is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 42404 [04:34:48] FC 0/14 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [04:34:57] FC 0/23 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [04:35:18] SMF on web.amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [04:35:19] Load avg. on amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [04:35:19] FC 0/3 [cassia] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [04:35:19] RAID on thyme is UNKNOWN: NRPE: Unable to read output [04:35:19] / on thyme is UNKNOWN: NRPE: Unable to read output [04:35:19] wikidata replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 155180.000000 [04:35:36] FC 0/5 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [04:35:49] FC 0/17 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [04:36:19] wikidata replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 959075.000000 [04:37:18] Free Memory on turnera is WARNING: WARNING - 5.5% (463668 kB) free! [04:38:10] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [04:39:58] FC 0/7 [daphne] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [04:39:58] FC 0/9 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [04:40:09] APT on sage is CRITICAL: APT CRITICAL: 7 packages available for upgrade (4 critical updates). [04:40:18] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 73543 MB (12% inode=99%): [04:40:37] /mnt on thyme is UNKNOWN: NRPE: Unable to read output [04:40:37] aliasd on nightshade is CRITICAL: CRITICAL - Socket timeout after 10 seconds [04:40:37] s1 replag on thyme is CRITICAL: QUERY CRITICAL: Cant connect to MySQL server on thyme (146) [04:40:37] /tmp on thyme is UNKNOWN: NRPE: Unable to read output [04:41:18] Free Memory on turnera is CRITICAL: CRITICAL - 4.8% (401352 kB) free! [04:41:47] FC 0/12 [thyme] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [04:41:47] FC 0/21 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [04:41:48] FC 0/1 [far1-n1-oe16-esams B1] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [04:41:48] FC 0/10 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [04:41:48] FC 0/8 [adenia] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [04:41:48] FC 0/19 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [04:41:48] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 289092 MB (5% inode=62%): [04:41:49] Environment IPMI on thyme is UNKNOWN: NRPE: Unable to read output [04:41:49] MySQL slave on z-dat-s5-b is CRITICAL: (Return code of 139 is out of bounds) [04:41:50] FC 0/2 [hemlock] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [04:41:56] FC 0/11 [fsw2-n1-oe16-esams] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [04:41:56] FC 0/20 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [04:44:58] Load avg. on thyme is UNKNOWN: NRPE: Unable to read output [04:45:34] wikidata replag on z-dat-s6-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 582840.000000 [04:45:35] Sun Grid Engine execd on ortelius is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [04:46:06] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [04:48:05] wikidata replag on z-dat-s7-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 426785.000000 [04:48:45] Free Memory on turnera is OK: OK - 87.1% (7295600 kB) free. [04:57:25] SMF on amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [05:21:55] s4 replag on z-dat-s5-b is WARNING: QUERY WARNING: SELECT ts_rc_age() returned 2212.000000 [05:21:55] s4 replag on cassia is WARNING: QUERY WARNING: SELECT ts_rc_age() returned 2210.000000 [05:32:45] MySQL slave on z-dat-s2-b is CRITICAL: (Return code of 139 is out of bounds) [05:32:55] FC 0/18 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [05:33:05] wikidata replag on z-dat-s2-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 547758.000000 [05:33:55] NTP on sage is CRITICAL: CRITICAL - Socket timeout after 10 seconds [05:34:05] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 807128.000000 [05:34:45] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A: [05:34:45] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [05:34:45] APT on yucca is CRITICAL: APT CRITICAL: 5 packages available for upgrade (4 critical updates). [05:34:45] FMA on amaranth is CRITICAL: ERROR - unexpected output from snmpwalk [05:34:45] FMA on thyme is CRITICAL: ERROR - unexpected output from snmpwalk [05:34:55] NTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [05:34:55] FC 0/13 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [05:34:55] FC 0/4 [hyacinth] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [05:34:55] FC 0/15 [fsw2-n1-oe16-esams] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [05:34:55] SMTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [05:34:56] NTP on amaranth is CRITICAL: CRITICAL - Socket timeout after 10 seconds [05:34:56] FC 0/22 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [05:34:57] FC 0/14 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [05:34:57] FC 0/16 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [05:34:58] FC 0/6 [rosemary] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [05:34:58] FC 0/0 [SAN far1-n1-oe16-esams A1] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [05:34:59] eth0 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [05:34:59] wikidata replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 68790.000000 [05:35:24] Load avg. on amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [05:35:25] SMF on web.amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [05:35:45] RAID on thyme is UNKNOWN: NRPE: Unable to read output [05:35:45] / on thyme is UNKNOWN: NRPE: Unable to read output [05:35:46] wikidata replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 158018.000000 [05:35:46] MySQL slave on z-dat-s1-b is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 41876 [05:35:55] FC 0/5 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [05:35:55] FC 0/17 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [05:35:55] FC 0/23 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [05:36:15] FC 0/3 [cassia] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [05:36:45] wikidata replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 961105.000000 [05:39:05] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [05:40:46] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 73358 MB (12% inode=99%): [05:40:46] /mnt on thyme is UNKNOWN: NRPE: Unable to read output [05:40:46] /tmp on thyme is UNKNOWN: NRPE: Unable to read output [05:40:46] s1 replag on thyme is CRITICAL: QUERY CRITICAL: Cant connect to MySQL server on thyme (146) [05:40:55] aliasd on nightshade is CRITICAL: CRITICAL - Socket timeout after 10 seconds [05:40:55] FC 0/7 [daphne] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [05:40:56] FC 0/9 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [05:41:05] APT on sage is CRITICAL: APT CRITICAL: 7 packages available for upgrade (4 critical updates). [05:41:55] FC 0/21 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [05:41:55] FC 0/12 [thyme] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [05:41:56] FC 0/8 [adenia] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [05:41:56] FC 0/10 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [05:41:56] FC 0/1 [far1-n1-oe16-esams B1] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [05:41:56] FC 0/19 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [05:41:56] FC 0/2 [hemlock] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [05:42:46] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 288897 MB (5% inode=62%): [05:42:46] Environment IPMI on thyme is UNKNOWN: NRPE: Unable to read output [05:42:46] MySQL slave on z-dat-s5-b is CRITICAL: (Return code of 139 is out of bounds) [05:42:55] FC 0/20 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [05:42:55] FC 0/11 [fsw2-n1-oe16-esams] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [05:45:55] s4 replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 3652.000000 [05:45:55] Load avg. on thyme is UNKNOWN: NRPE: Unable to read output [05:45:56] s4 replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 3651.000000 [05:46:04] wikidata replag on z-dat-s6-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 586498.000000 [05:46:05] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [05:48:05] wikidata replag on z-dat-s7-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 430384.000000 [05:57:25] SMF on amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [06:00:05] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [06:32:45] MySQL slave on z-dat-s2-b is CRITICAL: (Return code of 139 is out of bounds) [06:32:55] FC 0/18 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [06:33:05] wikidata replag on z-dat-s2-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 551358.000000 [06:33:55] NTP on sage is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:34:05] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 810427.000000 [06:34:45] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [06:34:45] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [06:34:45] APT on yucca is CRITICAL: APT CRITICAL: 5 packages available for upgrade (4 critical updates). [06:34:45] FMA on amaranth is CRITICAL: ERROR - unexpected output from snmpwalk [06:34:45] FMA on thyme is CRITICAL: ERROR - unexpected output from snmpwalk [06:34:55] NTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:34:55] FC 0/4 [hyacinth] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [06:34:55] FC 0/15 [fsw2-n1-oe16-esams] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [06:34:55] FC 0/13 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [06:34:55] NTP on amaranth is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:34:56] SMTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:34:56] FC 0/22 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [06:34:57] FC 0/14 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [06:34:57] FC 0/0 [SAN far1-n1-oe16-esams A1] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [06:34:58] FC 0/16 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [06:34:58] eth0 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [06:34:59] FC 0/6 [rosemary] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [06:34:59] wikidata replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 72390.000000 [06:35:24] Load avg. on amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [06:35:25] SMF on web.amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [06:35:46] / on thyme is UNKNOWN: NRPE: Unable to read output [06:35:46] RAID on thyme is UNKNOWN: NRPE: Unable to read output [06:35:46] wikidata replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 161618.000000 [06:35:46] MySQL slave on z-dat-s1-b is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 38639 [06:35:55] FC 0/5 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [06:35:55] FC 0/17 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [06:35:55] FC 0/23 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [06:36:15] FC 0/3 [cassia] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [06:36:45] wikidata replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 964705.000000 [06:39:05] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [06:40:46] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 73104 MB (11% inode=99%): [06:40:46] /mnt on thyme is UNKNOWN: NRPE: Unable to read output [06:40:46] /tmp on thyme is UNKNOWN: NRPE: Unable to read output [06:40:46] s1 replag on thyme is CRITICAL: QUERY CRITICAL: Cant connect to MySQL server on thyme (146) [06:40:55] aliasd on nightshade is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:40:55] FC 0/9 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [06:40:56] FC 0/7 [daphne] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [06:41:05] APT on sage is CRITICAL: APT CRITICAL: 7 packages available for upgrade (4 critical updates). [06:41:55] FC 0/21 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [06:41:55] FC 0/1 [far1-n1-oe16-esams B1] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [06:41:55] FC 0/10 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [06:41:55] FC 0/12 [thyme] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [06:41:55] FC 0/2 [hemlock] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [06:41:56] FC 0/19 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [06:41:56] FC 0/8 [adenia] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [06:42:46] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 288605 MB (5% inode=62%): [06:42:46] Environment IPMI on thyme is UNKNOWN: NRPE: Unable to read output [06:42:54] FC 0/11 [fsw2-n1-oe16-esams] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [06:42:55] FC 0/20 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [06:43:45] MySQL slave on z-dat-s5-b is CRITICAL: (Return code of 139 is out of bounds) [06:45:55] s4 replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 7252.000000 [06:45:55] Load avg. on thyme is UNKNOWN: NRPE: Unable to read output [06:45:56] s4 replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 7251.000000 [06:46:04] wikidata replag on z-dat-s6-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 590098.000000 [06:46:05] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [06:48:05] wikidata replag on z-dat-s7-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 433985.000000 [06:57:25] SMF on amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [07:29:55] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [07:32:45] MySQL slave on z-dat-s2-b is CRITICAL: (Return code of 139 is out of bounds) [07:32:55] FC 0/18 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [07:33:05] wikidata replag on z-dat-s2-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 554958.000000 [07:33:54] NTP on sage is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:34:04] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 813731.000000 [07:34:45] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [07:34:45] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [07:34:45] APT on yucca is CRITICAL: APT CRITICAL: 5 packages available for upgrade (4 critical updates). [07:34:46] FMA on amaranth is CRITICAL: ERROR - unexpected output from snmpwalk [07:34:55] NTP on amaranth is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:34:55] SMTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:34:55] NTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:34:55] FC 0/4 [hyacinth] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [07:34:55] FC 0/22 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [07:34:55] FC 0/13 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [07:34:56] FC 0/14 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [07:34:56] FC 0/15 [fsw2-n1-oe16-esams] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [07:34:57] FC 0/0 [SAN far1-n1-oe16-esams A1] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [07:34:57] FC 0/6 [rosemary] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [07:34:58] eth0 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [07:34:58] FC 0/16 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [07:34:59] wikidata replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 75990.000000 [07:35:25] Load avg. on amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [07:35:25] SMF on web.amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [07:35:45] RAID on thyme is UNKNOWN: NRPE: Unable to read output [07:35:45] / on thyme is UNKNOWN: NRPE: Unable to read output [07:35:45] FMA on thyme is CRITICAL: ERROR - unexpected output from snmpwalk [07:35:55] FC 0/17 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [07:35:55] FC 0/5 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [07:35:55] FC 0/23 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [07:36:15] FC 0/3 [cassia] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [07:36:45] wikidata replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 165278.000000 [07:36:45] wikidata replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 968305.000000 [07:36:45] MySQL slave on z-dat-s1-b is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 34135 [07:39:05] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [07:40:45] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 72847 MB (11% inode=99%): [07:40:46] /mnt on thyme is UNKNOWN: NRPE: Unable to read output [07:40:46] /tmp on thyme is UNKNOWN: NRPE: Unable to read output [07:40:55] aliasd on nightshade is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:40:56] FC 0/9 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [07:40:56] FC 0/7 [daphne] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [07:41:05] APT on sage is CRITICAL: APT CRITICAL: 7 packages available for upgrade (4 critical updates). [07:41:45] s1 replag on thyme is CRITICAL: QUERY CRITICAL: Cant connect to MySQL server on thyme (146) [07:41:55] FC 0/12 [thyme] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [07:41:55] FC 0/21 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [07:41:55] FC 0/1 [far1-n1-oe16-esams B1] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [07:41:55] FC 0/10 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [07:41:55] FC 0/2 [hemlock] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [07:41:55] FC 0/8 [adenia] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [07:41:55] FC 0/19 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [07:42:45] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 288343 MB (5% inode=62%): [07:42:45] Environment IPMI on thyme is UNKNOWN: NRPE: Unable to read output [07:42:54] FC 0/20 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [07:42:55] FC 0/11 [fsw2-n1-oe16-esams] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [07:43:45] MySQL slave on z-dat-s5-b is CRITICAL: (Return code of 139 is out of bounds) [07:45:55] s4 replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 10852.000000 [07:45:55] Load avg. on thyme is UNKNOWN: NRPE: Unable to read output [07:45:55] s4 replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 10851.000000 [07:46:05] wikidata replag on z-dat-s6-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 593698.000000 [07:46:05] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [07:48:05] wikidata replag on z-dat-s7-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 437584.000000 [07:57:25] SMF on amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [08:29:55] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [08:32:46] MySQL slave on z-dat-s2-b is CRITICAL: (Return code of 139 is out of bounds) [08:32:55] FC 0/18 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [08:33:05] wikidata replag on z-dat-s2-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 558558.000000 [08:33:55] NTP on sage is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:34:05] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 817029.000000 [08:34:46] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [08:34:46] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [08:34:46] APT on yucca is CRITICAL: APT CRITICAL: 5 packages available for upgrade (4 critical updates). [08:34:46] FMA on amaranth is CRITICAL: ERROR - unexpected output from snmpwalk [08:34:55] SMTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:34:55] NTP on amaranth is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:34:55] NTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:34:55] FC 0/14 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [08:34:55] FC 0/13 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [08:34:55] FC 0/22 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [08:34:55] FC 0/4 [hyacinth] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [08:34:56] FC 0/15 [fsw2-n1-oe16-esams] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [08:35:25] Load avg. on amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [08:35:25] SMF on web.amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [08:35:45] RAID on thyme is UNKNOWN: NRPE: Unable to read output [08:35:45] / on thyme is UNKNOWN: NRPE: Unable to read output [08:35:55] FMA on thyme is CRITICAL: ERROR - unexpected output from snmpwalk [08:35:55] FC 0/17 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [08:35:55] FC 0/5 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [08:35:55] FC 0/0 [SAN far1-n1-oe16-esams A1] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [08:35:55] FC 0/23 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [08:35:56] FC 0/16 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [08:35:56] eth0 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [08:35:57] FC 0/6 [rosemary] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [08:35:57] wikidata replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 79650.000000 [08:36:14] FC 0/3 [cassia] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [08:36:45] wikidata replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 168878.000000 [08:36:45] wikidata replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 971905.000000 [08:36:46] MySQL slave on z-dat-s1-b is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 30096 [08:37:54] MySQL slave on z-dat-s3-a is WARNING: SLOW_SLAVE WARNING: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 2562 [08:39:05] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [08:40:45] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 72558 MB (11% inode=99%): [08:40:45] /mnt on thyme is UNKNOWN: NRPE: Unable to read output [08:40:45] /tmp on thyme is UNKNOWN: NRPE: Unable to read output [08:40:55] aliasd on nightshade is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:40:55] FC 0/9 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [08:40:56] FC 0/7 [daphne] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [08:41:05] APT on sage is CRITICAL: APT CRITICAL: 7 packages available for upgrade (4 critical updates). [08:41:46] s1 replag on thyme is CRITICAL: QUERY CRITICAL: Cant connect to MySQL server on thyme (146) [08:41:55] FC 0/1 [far1-n1-oe16-esams B1] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [08:41:55] FC 0/10 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [08:41:55] FC 0/8 [adenia] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [08:41:55] FC 0/21 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [08:41:55] FC 0/2 [hemlock] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [08:41:55] FC 0/12 [thyme] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [08:41:56] FC 0/19 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [08:42:45] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 288011 MB (5% inode=62%): [08:42:45] Environment IPMI on thyme is UNKNOWN: NRPE: Unable to read output [08:42:55] FC 0/11 [fsw2-n1-oe16-esams] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [08:42:56] FC 0/20 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [08:42:56] MySQL slave on z-dat-s3-a is OK: Uptime: 120669 Threads: 16 Questions: 155243642 Slow queries: 3610 Opens: 1121084 Flush tables: 1 Open tables: 16384 Queries per second avg: 1286.524 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1371 [08:43:46] MySQL slave on z-dat-s5-b is CRITICAL: (Return code of 139 is out of bounds) [08:45:55] s4 replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 14452.000000 [08:45:55] Load avg. on thyme is UNKNOWN: NRPE: Unable to read output [08:45:55] s4 replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 14450.000000 [08:46:05] wikidata replag on z-dat-s6-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 597298.000000 [08:46:05] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [08:48:05] wikidata replag on z-dat-s7-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 441184.000000 [08:57:25] SMF on amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [09:25:55] Free Memory on damiana is WARNING: WARNING - 6.0% (505048 kB) free! [09:27:55] Free Memory on damiana is OK: OK - 8.3% (696868 kB) free. [09:29:55] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [09:32:45] MySQL slave on z-dat-s2-b is CRITICAL: (Return code of 139 is out of bounds) [09:32:55] FC 0/18 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [09:33:04] wikidata replag on z-dat-s2-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 562158.000000 [09:33:55] NTP on sage is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:34:05] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 820199.000000 [09:34:45] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [09:34:46] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [09:34:46] APT on yucca is CRITICAL: APT CRITICAL: 5 packages available for upgrade (4 critical updates). [09:34:46] FMA on amaranth is CRITICAL: ERROR - unexpected output from snmpwalk [09:34:55] NTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:34:55] SMTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:34:55] NTP on amaranth is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:34:56] FC 0/14 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [09:34:56] FC 0/22 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [09:34:56] FC 0/13 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [09:34:56] FC 0/15 [fsw2-n1-oe16-esams] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [09:34:56] FC 0/4 [hyacinth] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [09:35:25] SMF on web.amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [09:35:25] Load avg. on amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [09:35:45] / on thyme is UNKNOWN: NRPE: Unable to read output [09:35:45] RAID on thyme is UNKNOWN: NRPE: Unable to read output [09:35:55] FC 0/17 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [09:35:56] FC 0/5 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [09:35:56] FC 0/6 [rosemary] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [09:35:56] eth0 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [09:35:56] FC 0/16 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [09:35:56] FC 0/0 [SAN far1-n1-oe16-esams A1] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [09:35:56] FC 0/23 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [09:35:57] wikidata replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 83250.000000 [09:36:14] FC 0/3 [cassia] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [09:36:45] wikidata replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 172477.000000 [09:36:46] wikidata replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 975505.000000 [09:36:46] MySQL slave on z-dat-s1-b is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 22985 [09:36:46] FMA on thyme is CRITICAL: ERROR - unexpected output from snmpwalk [09:39:05] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [09:40:45] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 72296 MB (11% inode=99%): [09:40:45] /mnt on thyme is UNKNOWN: NRPE: Unable to read output [09:40:45] /tmp on thyme is UNKNOWN: NRPE: Unable to read output [09:40:55] aliasd on nightshade is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:40:55] FC 0/7 [daphne] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [09:40:55] FC 0/9 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [09:41:05] APT on sage is CRITICAL: APT CRITICAL: 7 packages available for upgrade (4 critical updates). [09:41:45] s1 replag on thyme is CRITICAL: QUERY CRITICAL: Cant connect to MySQL server on thyme (146) [09:41:54] FC 0/10 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [09:41:55] FC 0/1 [far1-n1-oe16-esams B1] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [09:41:55] FC 0/2 [hemlock] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [09:41:55] FC 0/12 [thyme] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [09:41:55] FC 0/21 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [09:41:56] FC 0/8 [adenia] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [09:41:56] FC 0/19 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [09:42:45] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 287606 MB (5% inode=62%): [09:42:45] Environment IPMI on thyme is UNKNOWN: NRPE: Unable to read output [09:42:55] FC 0/11 [fsw2-n1-oe16-esams] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [09:42:55] FC 0/20 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [09:43:46] MySQL slave on z-dat-s5-b is CRITICAL: (Return code of 139 is out of bounds) [09:45:55] s4 replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 18052.000000 [09:45:55] Load avg. on thyme is UNKNOWN: NRPE: Unable to read output [09:45:55] s4 replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 18050.000000 [09:46:06] wikidata replag on z-dat-s6-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 600898.000000 [09:46:06] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [09:48:05] wikidata replag on z-dat-s7-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 444784.000000 [09:57:24] SMF on amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [10:12:55] Free Memory on damiana is WARNING: WARNING - 5.9% (497416 kB) free! [10:16:55] Free Memory on damiana is CRITICAL: CRITICAL - 5.0% (419800 kB) free! [10:17:55] Free Memory on damiana is WARNING: WARNING - 5.1% (426772 kB) free! [10:26:45] /sql on rosemary is CRITICAL: DISK CRITICAL - free space: /sql 18534 MB (1% inode=99%): [10:29:55] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [10:32:45] MySQL slave on z-dat-s2-b is CRITICAL: (Return code of 139 is out of bounds) [10:32:54] FC 0/18 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [10:33:14] wikidata replag on z-dat-s2-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 565758.000000 [10:33:55] NTP on sage is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:34:05] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 823536.000000 [10:34:46] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [10:34:46] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [10:34:46] APT on yucca is CRITICAL: APT CRITICAL: 5 packages available for upgrade (4 critical updates). [10:34:46] FMA on amaranth is CRITICAL: ERROR - unexpected output from snmpwalk [10:34:55] NTP on amaranth is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:34:55] NTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:34:55] SMTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:34:55] FC 0/4 [hyacinth] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [10:34:55] FC 0/14 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [10:34:55] FC 0/13 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [10:34:56] FC 0/22 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [10:34:56] FC 0/15 [fsw2-n1-oe16-esams] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [10:35:25] Load avg. on amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [10:35:25] SMF on web.amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [10:35:45] / on thyme is UNKNOWN: NRPE: Unable to read output [10:35:45] RAID on thyme is UNKNOWN: NRPE: Unable to read output [10:35:55] FC 0/17 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [10:35:55] FC 0/5 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [10:35:55] FC 0/0 [SAN far1-n1-oe16-esams A1] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [10:35:55] eth0 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [10:35:55] FC 0/16 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [10:35:56] FC 0/23 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [10:35:56] FC 0/6 [rosemary] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [10:35:57] wikidata replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 86850.000000 [10:36:14] FC 0/3 [cassia] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [10:36:44] wikidata replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 979105.000000 [10:36:46] wikidata replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 176078.000000 [10:36:46] MySQL slave on z-dat-s1-b is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 12415 [10:36:46] FMA on thyme is CRITICAL: ERROR - unexpected output from snmpwalk [10:39:05] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [10:40:45] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 71994 MB (11% inode=99%): [10:40:46] /mnt on thyme is UNKNOWN: NRPE: Unable to read output [10:40:46] /tmp on thyme is UNKNOWN: NRPE: Unable to read output [10:40:55] aliasd on nightshade is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:40:55] FC 0/7 [daphne] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [10:40:55] FC 0/9 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [10:41:05] APT on sage is CRITICAL: APT CRITICAL: 7 packages available for upgrade (4 critical updates). [10:41:45] s1 replag on thyme is CRITICAL: QUERY CRITICAL: Cant connect to MySQL server on thyme (146) [10:41:54] FC 0/10 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [10:41:55] FC 0/1 [far1-n1-oe16-esams B1] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [10:41:55] FC 0/21 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [10:41:55] FC 0/12 [thyme] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [10:41:55] FC 0/19 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [10:41:56] FC 0/2 [hemlock] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [10:41:56] FC 0/8 [adenia] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [10:42:45] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 287352 MB (5% inode=62%): [10:42:45] Environment IPMI on thyme is UNKNOWN: NRPE: Unable to read output [10:42:55] FC 0/20 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [10:42:55] FC 0/11 [fsw2-n1-oe16-esams] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [10:43:46] MySQL slave on z-dat-s5-b is CRITICAL: (Return code of 139 is out of bounds) [10:45:55] s4 replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 21652.000000 [10:45:55] Load avg. on thyme is UNKNOWN: NRPE: Unable to read output [10:45:55] s4 replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 21651.000000 [10:46:05] wikidata replag on z-dat-s6-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 604498.000000 [10:46:05] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [10:48:05] wikidata replag on z-dat-s7-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 448385.000000 [10:49:55] Free Memory on damiana is CRITICAL: CRITICAL - 4.3% (364368 kB) free! [10:57:24] SMF on amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [11:29:55] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [11:29:56] Free Memory on damiana is WARNING: WARNING - 5.8% (487108 kB) free! [11:30:46] MySQL slave on z-dat-s1-b is WARNING: SLOW_SLAVE WARNING: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 3505 [11:30:55] Free Memory on damiana is CRITICAL: CRITICAL - 4.4% (365808 kB) free! [11:31:55] Free Memory on damiana is WARNING: WARNING - 5.3% (447696 kB) free! [11:32:45] MySQL slave on z-dat-s2-b is CRITICAL: (Return code of 139 is out of bounds) [11:32:55] FC 0/18 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [11:33:55] NTP on sage is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:34:05] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 826878.000000 [11:34:05] wikidata replag on z-dat-s2-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 569414.000000 [11:34:45] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A: [11:34:46] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [11:34:46] APT on yucca is CRITICAL: APT CRITICAL: 5 packages available for upgrade (4 critical updates). [11:34:46] FMA on amaranth is CRITICAL: ERROR - unexpected output from snmpwalk [11:34:54] NTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:34:56] NTP on amaranth is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:34:56] SMTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:34:56] FC 0/15 [fsw2-n1-oe16-esams] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [11:34:56] FC 0/13 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [11:34:56] FC 0/4 [hyacinth] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [11:34:56] FC 0/14 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [11:34:56] FC 0/22 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [11:35:25] Load avg. on amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [11:35:25] SMF on web.amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [11:35:45] RAID on thyme is UNKNOWN: NRPE: Unable to read output [11:35:45] / on thyme is UNKNOWN: NRPE: Unable to read output [11:35:55] FC 0/17 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [11:35:55] FC 0/5 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [11:35:55] FC 0/6 [rosemary] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [11:35:55] FC 0/23 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [11:35:55] FC 0/0 [SAN far1-n1-oe16-esams A1] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [11:35:55] eth0 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [11:35:56] FC 0/16 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [11:35:56] wikidata replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 90450.000000 [11:36:15] FC 0/3 [cassia] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [11:36:45] wikidata replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 179443.000000 [11:36:46] wikidata replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 982451.000000 [11:36:46] FMA on thyme is CRITICAL: ERROR - unexpected output from snmpwalk [11:39:05] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [11:39:46] MySQL slave on z-dat-s1-b is OK: Uptime: 41136 Threads: 8 Questions: 52622509 Slow queries: 541 Opens: 457 Flush tables: 1 Open tables: 350 Queries per second avg: 1279.232 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1780 [11:40:45] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 71678 MB (11% inode=99%): [11:40:46] /mnt on thyme is UNKNOWN: NRPE: Unable to read output [11:40:46] /tmp on thyme is UNKNOWN: NRPE: Unable to read output [11:40:55] aliasd on nightshade is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:40:55] FC 0/7 [daphne] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [11:40:55] FC 0/9 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [11:41:05] APT on sage is CRITICAL: APT CRITICAL: 7 packages available for upgrade (4 critical updates). [11:41:45] s1 replag on thyme is CRITICAL: QUERY CRITICAL: Cant connect to MySQL server on thyme (146) [11:41:54] FC 0/10 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [11:41:55] FC 0/1 [far1-n1-oe16-esams B1] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [11:41:56] FC 0/19 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [11:41:56] FC 0/12 [thyme] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [11:41:56] FC 0/8 [adenia] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [11:41:56] FC 0/21 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [11:41:56] FC 0/2 [hemlock] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [11:42:45] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 287023 MB (5% inode=62%): [11:42:46] Environment IPMI on thyme is UNKNOWN: NRPE: Unable to read output [11:42:55] FC 0/11 [fsw2-n1-oe16-esams] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [11:42:55] FC 0/20 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [11:43:45] MySQL slave on z-dat-s5-b is CRITICAL: (Return code of 139 is out of bounds) [11:45:46] /sql on z-dat-s7-a is CRITICAL: DISK CRITICAL - free space: /sql 21072 MB (3% inode=99%): [11:45:54] s4 replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 23205.000000 [11:45:55] Load avg. on thyme is UNKNOWN: NRPE: Unable to read output [11:45:55] s4 replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 21703.000000 [11:46:05] wikidata replag on z-dat-s6-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 605793.000000 [11:46:05] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [11:48:05] wikidata replag on z-dat-s7-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 450598.000000 [11:54:55] Free Memory on damiana is CRITICAL: CRITICAL - 4.2% (348752 kB) free! [11:57:04] Sumana Harihareswara * [Toolserver-l] Last day to register & request scholarship for Amsterdam hackathon [11:57:24] SMF on amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [12:29:55] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [12:30:05] s4 replag on daphne is WARNING: QUERY WARNING: SELECT ts_rc_age() returned 2173.000000 [12:30:05] MySQL slave on daphne is WARNING: SLOW_SLAVE WARNING: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 2175 [12:32:55] MySQL slave on z-dat-s2-b is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 89864 [12:32:56] FC 0/18 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [12:33:55] NTP on sage is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:34:06] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 830259.000000 [12:34:24] wikidata replag on z-dat-s2-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 571117.000000 [12:34:45] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [12:34:46] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [12:34:46] APT on yucca is CRITICAL: APT CRITICAL: 5 packages available for upgrade (4 critical updates). [12:34:46] FMA on amaranth is CRITICAL: ERROR - unexpected output from snmpwalk [12:34:55] NTP on amaranth is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:34:55] SMTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:34:56] NTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:34:56] FC 0/15 [fsw2-n1-oe16-esams] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [12:34:56] FC 0/4 [hyacinth] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [12:34:56] FC 0/14 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [12:34:56] FC 0/22 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [12:34:56] FC 0/13 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [12:35:25] SMF on web.amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [12:35:25] Load avg. on amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [12:35:45] RAID on thyme is UNKNOWN: NRPE: Unable to read output [12:35:45] / on thyme is UNKNOWN: NRPE: Unable to read output [12:35:55] FC 0/17 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [12:35:55] FC 0/5 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [12:35:55] FC 0/6 [rosemary] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [12:35:55] FC 0/0 [SAN far1-n1-oe16-esams A1] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [12:35:55] FC 0/23 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [12:35:56] eth0 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [12:35:56] FC 0/16 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [12:35:57] wikidata replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 94050.000000 [12:36:14] FC 0/3 [cassia] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [12:36:46] wikidata replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 176945.000000 [12:36:46] wikidata replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 980413.000000 [12:36:55] FMA on thyme is CRITICAL: ERROR - unexpected output from snmpwalk [12:37:55] Free Memory on damiana is WARNING: WARNING - 5.1% (429916 kB) free! [12:38:55] Free Memory on damiana is CRITICAL: CRITICAL - 4.9% (411684 kB) free! [12:39:05] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [12:40:45] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 71290 MB (11% inode=99%): [12:40:46] /sql on z-dat-s1-b is WARNING: DISK WARNING - free space: /sql 99482 MB (10% inode=99%): [12:40:46] /mnt on thyme is UNKNOWN: NRPE: Unable to read output [12:40:46] /tmp on thyme is UNKNOWN: NRPE: Unable to read output [12:40:55] aliasd on nightshade is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:40:55] FC 0/9 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [12:40:55] FC 0/7 [daphne] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [12:41:05] APT on sage is CRITICAL: APT CRITICAL: 7 packages available for upgrade (4 critical updates). [12:41:45] s1 replag on thyme is CRITICAL: QUERY CRITICAL: Cant connect to MySQL server on thyme (146) [12:41:55] FC 0/10 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [12:41:56] FC 0/19 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [12:41:56] FC 0/1 [far1-n1-oe16-esams B1] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [12:41:56] FC 0/21 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [12:41:56] FC 0/8 [adenia] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [12:41:56] FC 0/12 [thyme] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [12:41:56] FC 0/2 [hemlock] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [12:42:45] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 286703 MB (5% inode=62%): [12:42:45] Environment IPMI on thyme is UNKNOWN: NRPE: Unable to read output [12:42:55] FC 0/20 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [12:42:55] FC 0/11 [fsw2-n1-oe16-esams] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [12:43:46] MySQL slave on z-dat-s5-b is CRITICAL: (Return code of 139 is out of bounds) [12:45:55] s4 replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 6025.000000 [12:45:56] Load avg. on thyme is UNKNOWN: NRPE: Unable to read output [12:45:56] s4 replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 5365.000000 [12:46:05] wikidata replag on z-dat-s6-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 596767.000000 [12:46:05] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [12:48:05] wikidata replag on z-dat-s7-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 448848.000000 [12:54:06] s4 replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 3613.000000 [12:54:06] MySQL slave on daphne is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 3615 [12:54:55] s4 replag on cassia is WARNING: QUERY WARNING: SELECT ts_rc_age() returned 3577.000000 [12:57:24] SMF on amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [12:58:55] s4 replag on z-dat-s5-b is WARNING: QUERY WARNING: SELECT ts_rc_age() returned 3411.000000 [13:05:55] s4 replag on cassia is OK: QUERY OK: SELECT ts_rc_age() returned 1744.000000 [13:09:56] s4 replag on z-dat-s5-b is OK: QUERY OK: SELECT ts_rc_age() returned 1622.000000 [13:11:05] FC 0/6 [rosemary] on fsw1-n1-oe16-esams.mgmt is CRITICAL: (Return code of 142 is out of bounds) [13:11:07] FC 0/8 [adenia] on fsw1-n1-oe16-esams.mgmt is CRITICAL: (Return code of 142 is out of bounds) [13:11:55] FC 0/6 [rosemary] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [13:11:57] FC 0/8 [adenia] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [13:22:07] FC 0/15 [fsw2-n1-oe16-esams] on fsw1-n1-oe16-esams.mgmt is CRITICAL: (Return code of 142 is out of bounds) [13:22:11] FC 0/1 [far1-n1-oe16-esams B1] on fsw1-n1-oe16-esams.mgmt is CRITICAL: (Return code of 142 is out of bounds) [13:22:11] FC 0/21 on fsw1-n1-oe16-esams.mgmt is CRITICAL: (Return code of 142 is out of bounds) [13:22:11] FC 0/7 [daphne] on fsw1-n1-oe16-esams.mgmt is CRITICAL: (Return code of 142 is out of bounds) [13:22:55] FC 0/21 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [13:22:56] FC 0/1 [far1-n1-oe16-esams B1] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [13:22:56] FC 0/15 [fsw2-n1-oe16-esams] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [13:22:56] FC 0/7 [daphne] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [13:28:30] FC 0/18 on fsw1-n1-oe16-esams.mgmt is CRITICAL: (Return code of 142 is out of bounds) [13:28:57] FC 0/4 [hyacinth] on fsw1-n1-oe16-esams.mgmt is CRITICAL: (Return code of 142 is out of bounds) [13:29:08] FC 0/11 [fsw2-n1-oe16-esams] on fsw1-n1-oe16-esams.mgmt is CRITICAL: (Return code of 142 is out of bounds) [13:29:08] FC 0/6 [rosemary] on fsw1-n1-oe16-esams.mgmt is CRITICAL: (Return code of 142 is out of bounds) [13:29:08] Sun Grid Engine execd on ortelius is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [13:29:09] Sun Grid Engine execd on wolfsbane is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [13:29:09] FC 0/13 on fsw1-n1-oe16-esams.mgmt is CRITICAL: (Return code of 142 is out of bounds) [13:29:10] FC 0/5 on fsw1-n1-oe16-esams.mgmt is CRITICAL: (Service Check Timed Out) [13:29:10] FC 0/17 on fsw1-n1-oe16-esams.mgmt is CRITICAL: (Service Check Timed Out) [13:29:11] FC 0/19 on fsw1-n1-oe16-esams.mgmt is CRITICAL: (Service Check Timed Out) [13:30:46] /tmp on thyme is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [18:16:32] my cronie lines look like this: [18:16:38] 5 1 * * * qcronsub -N 'wymowa.py' -b y -l h_rt=4:00:00 -l virtual_free=50M /usr/bin/env PYTHONPATH=$HOME/wikt/pywikipedia /usr/bin/python $HOME/wikt/moje/wymowa.py >/dev/null [18:16:44] I get an error "/usr/bin/env: No such file or directory" [18:16:50] what should I put instead? [18:16:57] if I simply put "env" then I get "Unable to run job: Script not executable: env." [20:26:55] wikidata replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 201167.000000 [20:26:55] Load avg. on amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [20:26:55] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [20:26:56] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 68835 MB (11% inode=99%): [20:26:56] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [20:26:56] FC 0/17 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [20:26:56] FC 0/5 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [20:26:57] SMF on web.amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [20:26:57] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [20:26:58] / on thyme is UNKNOWN: NRPE: Unable to read output [20:27:06] FC 0/6 [rosemary] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [20:27:06] FC 0/0 [SAN far1-n1-oe16-esams A1] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [20:27:06] FC 0/18 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [20:27:06] APT on yucca is CRITICAL: APT CRITICAL: 5 packages available for upgrade (4 critical updates). [20:27:06] FC 0/1 [far1-n1-oe16-esams B1] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [20:27:06] FC 0/19 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [20:27:06] FC 0/7 [daphne] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [20:27:15] SMF on amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [20:27:15] MySQL slave on z-dat-s2-b is OK: Uptime: 31804 Threads: 9 Questions: 27255241 Slow queries: 436 Opens: 469848 Flush tables: 1 Open tables: 256 Queries per second avg: 856.975 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 46 [20:32:15] APT on nightshade is CRITICAL: APT CRITICAL: 4 packages available for upgrade (4 critical updates). [20:32:25] APT on yarrow is CRITICAL: APT CRITICAL: 4 packages available for upgrade (4 critical updates). [20:32:35] SMTP on z-dat-s5-b is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:32:35] s4 replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 25464.000000 [20:32:35] s4 replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 25464.000000 [20:32:35] SMTP on z-dat-s1-b is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:34:45] wikidata replag on z-dat-s7-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 473564.000000 [21:26:05] /mnt on thyme is UNKNOWN: NRPE: Unable to read output [21:26:05] s1 replag on thyme is CRITICAL: QUERY CRITICAL: Cant connect to MySQL server on thyme (146) [21:26:05] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [21:26:05] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 281058 MB (5% inode=62%): [21:26:05] /tmp on thyme is UNKNOWN: NRPE: Unable to read output [21:26:05] FC 0/2 [hemlock] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [21:26:06] FC 0/10 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [21:26:06] FC 0/8 [adenia] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [21:26:07] MySQL slave on z-dat-s5-b is CRITICAL: (Return code of 139 is out of bounds) [21:26:15] Environment IPMI on thyme is UNKNOWN: NRPE: Unable to read output [21:26:15] APT on sage is CRITICAL: APT CRITICAL: 7 packages available for upgrade (4 critical updates). [21:26:15] FC 0/11 [fsw2-n1-oe16-esams] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [21:26:15] FC 0/20 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [21:26:15] FC 0/9 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [21:26:16] s4 replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 10717.000000 [21:26:25] FC 0/21 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [21:26:25] FC 0/12 [thyme] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [21:26:25] FMA on amaranth is CRITICAL: ERROR - unexpected output from snmpwalk [21:26:25] aliasd on nightshade is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:26:25] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 861898.000000 [21:26:26] NTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:26:26] FMA on thyme is CRITICAL: ERROR - unexpected output from snmpwalk [21:26:27] Load avg. on thyme is UNKNOWN: NRPE: Unable to read output [21:26:27] FC 0/13 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [21:26:28] FC 0/22 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [21:26:35] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [21:26:35] eth0 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [21:26:35] FC 0/14 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [21:26:36] FC 0/23 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [21:26:45] wikidata replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 125893.000000 [21:26:46] wikidata replag on z-dat-s2-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 598278.000000 [21:26:46] wikidata replag on z-dat-s6-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 623186.000000 [21:26:46] FC 0/3 [cassia] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [21:26:46] FC 0/15 [fsw2-n1-oe16-esams] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [21:26:46] MySQL slave on daphne is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 10742 [21:26:46] NTP on sage is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:26:47] RAID on thyme is UNKNOWN: NRPE: Unable to read output [21:26:47] FC 0/16 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [21:26:48] FC 0/4 [hyacinth] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [21:26:54] wikidata replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 204768.000000 [21:26:55] Load avg. on amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [21:26:56] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 68594 MB (11% inode=99%): [21:26:56] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [21:26:56] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [21:26:56] FC 0/5 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [21:26:56] FC 0/17 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [21:26:56] SMF on web.amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [21:26:57] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [21:26:57] / on thyme is UNKNOWN: NRPE: Unable to read output [21:27:05] FC 0/18 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [21:27:05] FC 0/6 [rosemary] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [21:27:06] FC 0/0 [SAN far1-n1-oe16-esams A1] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [21:27:06] APT on yucca is CRITICAL: APT CRITICAL: 6 packages available for upgrade (5 critical updates). [21:27:06] FC 0/1 [far1-n1-oe16-esams B1] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [21:27:15] SMF on amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [21:27:35] SMTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:27:35] NTP on amaranth is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:27:45] wikidata replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1007507.000000 [21:28:05] FC 0/7 [daphne] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [21:28:05] FC 0/19 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [21:32:15] APT on nightshade is CRITICAL: APT CRITICAL: 4 packages available for upgrade (4 critical updates). [21:32:25] APT on yarrow is CRITICAL: APT CRITICAL: 4 packages available for upgrade (4 critical updates). [21:32:35] SMTP on z-dat-s5-b is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:32:35] s4 replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 29064.000000 [21:32:35] s4 replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 29063.000000 [21:32:35] SMTP on z-dat-s1-b is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:34:45] wikidata replag on z-dat-s7-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 477165.000000 [21:35:06] [[Special:Log/newusers]] create 10 * Hawtin * (New user account) [22:24:45] MySQL slave on daphne is WARNING: SLOW_SLAVE WARNING: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 3556 [22:25:15] s4 replag on daphne is WARNING: QUERY WARNING: SELECT ts_rc_age() returned 3446.000000 [22:26:05] /mnt on thyme is UNKNOWN: NRPE: Unable to read output [22:26:05] s1 replag on thyme is CRITICAL: QUERY CRITICAL: Cant connect to MySQL server on thyme (146) [22:26:05] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [22:26:05] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 280660 MB (5% inode=62%): [22:26:05] /tmp on thyme is UNKNOWN: NRPE: Unable to read output [22:26:06] FC 0/2 [hemlock] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [22:26:15] Environment IPMI on thyme is UNKNOWN: NRPE: Unable to read output [22:26:15] APT on sage is CRITICAL: APT CRITICAL: 7 packages available for upgrade (4 critical updates). [22:26:16] FC 0/11 [fsw2-n1-oe16-esams] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [22:26:16] FC 0/20 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [22:26:16] FC 0/9 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [22:26:25] FC 0/21 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [22:26:26] FC 0/12 [thyme] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [22:26:26] FMA on amaranth is CRITICAL: ERROR - unexpected output from snmpwalk [22:26:26] aliasd on nightshade is CRITICAL: CRITICAL - Socket timeout after 10 seconds [22:26:26] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 865497.000000 [22:26:26] NTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [22:26:26] FMA on thyme is CRITICAL: ERROR - unexpected output from snmpwalk [22:26:27] Load avg. on thyme is UNKNOWN: NRPE: Unable to read output [22:26:27] FC 0/13 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [22:26:28] FC 0/22 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [22:26:34] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [22:26:34] FC 0/23 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [22:26:35] eth0 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [22:26:36] FC 0/14 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [22:26:45] wikidata replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 129493.000000 [22:26:45] wikidata replag on z-dat-s2-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 601878.000000 [22:26:45] wikidata replag on z-dat-s6-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 626785.000000 [22:26:45] FC 0/15 [fsw2-n1-oe16-esams] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [22:26:46] FC 0/3 [cassia] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [22:26:46] NTP on sage is CRITICAL: CRITICAL - Socket timeout after 10 seconds [22:26:46] RAID on thyme is UNKNOWN: NRPE: Unable to read output [22:26:46] FC 0/16 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [22:26:54] wikidata replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 208367.000000 [22:26:55] Load avg. on amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [22:26:55] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 68343 MB (11% inode=99%): [22:26:55] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [22:26:55] FC 0/5 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [22:26:56] FC 0/17 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [22:26:56] SMF on web.amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [22:26:56] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [22:27:05] FC 0/18 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [22:27:05] APT on yucca is CRITICAL: APT CRITICAL: 6 packages available for upgrade (5 critical updates). [22:27:06] FC 0/0 [SAN far1-n1-oe16-esams A1] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [22:27:06] FC 0/6 [rosemary] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [22:27:06] FC 0/1 [far1-n1-oe16-esams B1] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [22:27:06] FC 0/10 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [22:27:06] FC 0/8 [adenia] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [22:27:06] MySQL slave on z-dat-s5-b is CRITICAL: (Return code of 139 is out of bounds) [22:27:15] SMF on amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [22:27:15] /sql on rosemary is CRITICAL: DISK CRITICAL - free space: /sql 18868 MB (1% inode=99%): [22:27:35] SMTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [22:27:35] NTP on amaranth is CRITICAL: CRITICAL - Socket timeout after 10 seconds [22:27:45] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: (Service Check Timed Out) [22:27:45] wikidata replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1011107.000000 [22:27:45] FC 0/4 [hyacinth] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [22:27:55] / on thyme is UNKNOWN: NRPE: Unable to read output [22:28:05] FC 0/7 [daphne] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [22:28:05] FC 0/19 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [22:32:15] APT on nightshade is CRITICAL: APT CRITICAL: 4 packages available for upgrade (4 critical updates). [22:32:25] APT on yarrow is CRITICAL: APT CRITICAL: 4 packages available for upgrade (4 critical updates). [22:32:35] SMTP on z-dat-s5-b is CRITICAL: CRITICAL - Socket timeout after 10 seconds [22:32:35] s4 replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 32664.000000 [22:32:35] s4 replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 32664.000000 [22:32:35] SMTP on z-dat-s1-b is CRITICAL: CRITICAL - Socket timeout after 10 seconds [22:32:45] MySQL slave on daphne is OK: Uptime: 182768 Threads: 117 Questions: 26902973 Slow queries: 40259 Opens: 9070 Flush tables: 1 Open tables: 690 Queries per second avg: 147.197 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1792 [22:33:15] s4 replag on daphne is OK: QUERY OK: SELECT ts_rc_age() returned 1619.000000 [22:34:45] wikidata replag on z-dat-s7-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 480765.000000 [22:40:37] hi [22:40:41] what about my request? https://jira.toolserver.org/browse/ACCAPP-632 [22:40:54] it was created month ago [23:26:05] /mnt on thyme is UNKNOWN: NRPE: Unable to read output [23:26:05] s1 replag on thyme is CRITICAL: QUERY CRITICAL: Cant connect to MySQL server on thyme (146) [23:26:05] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [23:26:05] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 279391 MB (5% inode=62%): [23:26:05] /tmp on thyme is UNKNOWN: NRPE: Unable to read output [23:26:06] FC 0/2 [hemlock] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [23:26:15] Environment IPMI on thyme is UNKNOWN: NRPE: Unable to read output [23:26:15] APT on sage is CRITICAL: APT CRITICAL: 7 packages available for upgrade (4 critical updates). [23:26:15] FC 0/11 [fsw2-n1-oe16-esams] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [23:26:15] FC 0/20 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [23:26:15] FC 0/9 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [23:26:25] FC 0/21 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [23:26:25] FC 0/12 [thyme] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [23:26:25] FMA on amaranth is CRITICAL: ERROR - unexpected output from snmpwalk [23:26:26] aliasd on nightshade is CRITICAL: CRITICAL - Socket timeout after 10 seconds [23:26:26] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 869098.000000 [23:26:26] NTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [23:26:26] FMA on thyme is CRITICAL: ERROR - unexpected output from snmpwalk [23:26:27] Load avg. on thyme is UNKNOWN: NRPE: Unable to read output [23:26:27] FC 0/13 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [23:26:28] FC 0/22 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [23:26:35] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [23:26:35] eth0 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [23:26:36] FC 0/14 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [23:26:36] FC 0/23 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [23:26:44] wikidata replag on z-dat-s2-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 605478.000000 [23:26:45] wikidata replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 133093.000000 [23:26:46] wikidata replag on z-dat-s6-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 630386.000000 [23:26:46] FC 0/3 [cassia] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [23:26:46] FC 0/15 [fsw2-n1-oe16-esams] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [23:26:46] NTP on sage is CRITICAL: CRITICAL - Socket timeout after 10 seconds [23:26:46] RAID on thyme is UNKNOWN: NRPE: Unable to read output [23:26:46] FC 0/16 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [23:26:54] wikidata replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 211968.000000 [23:26:55] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 67723 MB (11% inode=99%): [23:26:55] Load avg. on amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [23:26:55] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [23:26:56] FC 0/5 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [23:26:56] FC 0/17 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [23:26:56] SMF on web.amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [23:26:56] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [23:27:05] APT on yucca is CRITICAL: APT CRITICAL: 6 packages available for upgrade (5 critical updates). [23:27:06] FC 0/6 [rosemary] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [23:27:06] FC 0/0 [SAN far1-n1-oe16-esams A1] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [23:27:06] FC 0/18 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [23:27:06] FC 0/1 [far1-n1-oe16-esams B1] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [23:27:06] FC 0/8 [adenia] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [23:27:06] FC 0/10 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [23:27:06] MySQL slave on z-dat-s5-b is CRITICAL: (Return code of 139 is out of bounds) [23:27:15] SMF on amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [23:27:35] SMTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [23:27:35] NTP on amaranth is CRITICAL: CRITICAL - Socket timeout after 10 seconds [23:27:45] wikidata replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1014707.000000 [23:27:45] FC 0/4 [hyacinth] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [23:27:55] / on thyme is UNKNOWN: NRPE: Unable to read output [23:28:05] FC 0/19 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [23:28:05] FC 0/7 [daphne] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [23:32:14] APT on nightshade is CRITICAL: APT CRITICAL: 4 packages available for upgrade (4 critical updates). [23:32:25] APT on yarrow is CRITICAL: APT CRITICAL: 4 packages available for upgrade (4 critical updates). [23:32:35] SMTP on z-dat-s5-b is CRITICAL: CRITICAL - Socket timeout after 10 seconds [23:32:35] s4 replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 36264.000000 [23:32:35] s4 replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 36264.000000 [23:32:35] SMTP on z-dat-s1-b is CRITICAL: CRITICAL - Socket timeout after 10 seconds [23:34:45] wikidata replag on z-dat-s7-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 484364.000000 [23:45:55] /sql on z-dat-s7-a is CRITICAL: DISK CRITICAL - free space: /sql 21377 MB (4% inode=99%): [23:56:55] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL