[00:06:58] Sun Grid Engine execd on willow is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [00:07:28] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [00:17:09] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [00:35:48] APT on yarrow is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [00:36:19] APT on yarrow is WARNING: APT WARNING: 67 packages available for upgrade (0 critical updates). [00:38:48] APT on yarrow is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [00:40:29] Sun Grid Engine execd on yarrow is UNKNOWN: Execution timeout exceeded [00:41:08] Sun Grid Engine execd on yarrow is OK: Host and Queues Ok [00:46:08] eth0 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [00:46:08] FC 0/23 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [00:46:08] FC 0/14 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [00:46:18] FC 0/12 [thyme] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [00:46:28] FC 0/22 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [00:46:29] FC 0/17 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [00:47:19] Environment IPMI on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [00:47:29] FC 0/21 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [00:47:29] FC 0/13 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [00:47:29] FC 0/4 [hyacinth] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [00:47:29] FC 0/5 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [00:47:48] Load avg. on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [00:47:58] / on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [00:47:58] Sensors on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [00:48:08] /tmp on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [00:48:08] Sun Grid Engine execd on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [00:48:09] aliasd on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [00:48:09] APT on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [00:48:39] MySQL slave on z-dat-s5-b is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 51987 [00:48:39] / on thyme is UNKNOWN: NRPE: Unable to read output [00:48:49] s1 replag on thyme is CRITICAL: QUERY CRITICAL: Cant connect to MySQL server on thyme (146) [00:48:49] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [00:48:49] SMF on web.amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [00:48:59] Environment IPMI on thyme is UNKNOWN: NRPE: Unable to read output [00:48:59] FC 0/9 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [00:48:59] FC 0/11 [fsw2-n1-oe16-esams] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [00:49:09] Load avg. on thyme is UNKNOWN: NRPE: Unable to read output [00:49:09] FMA on thyme is CRITICAL: ERROR - unexpected output from snmpwalk [00:49:19] s4 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 969773.000000 [00:49:19] wikidata replag on z-dat-s6-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 780381.000000 [00:49:19] wikidata replag on z-dat-s7-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 551404.000000 [00:49:19] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [00:49:19] SSH on mayapple is CRITICAL: Server answer: [00:49:28] FMA on amaranth is CRITICAL: ERROR - unexpected output from snmpwalk [00:49:29] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 2170261.000000 [00:49:29] RAID on thyme is UNKNOWN: NRPE: Unable to read output [00:49:29] wikidata replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1375787.000000 [00:49:38] wikidata replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 51767.000000 [00:49:38] APT on z-dat-s2-b is WARNING: APT WARNING: 34 packages available for upgrade (0 critical updates). [00:49:38] APT on yucca is WARNING: APT WARNING: 39 packages available for upgrade (0 critical updates). [00:49:39] FC 0/18 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [00:49:39] APT on z-dat-s1-b is WARNING: APT WARNING: 35 packages available for upgrade (0 critical updates). [00:49:39] FC 0/6 [rosemary] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [00:49:39] FC 0/0 [SAN far1-n1-oe16-esams A1] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [00:49:40] SMTP on nightshade is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:49:48] /mnt on thyme is UNKNOWN: NRPE: Unable to read output [00:49:48] wikidata replag on z-dat-s2-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1318987.000000 [00:49:49] FC 0/7 [daphne] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [00:49:49] FC 0/19 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [00:49:49] FC 0/1 [far1-n1-oe16-esams B1] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [00:49:49] SRaid on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [00:49:49] Load avg. on amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [00:49:50] /tmp on thyme is UNKNOWN: NRPE: Unable to read output [00:49:50] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 258962 MB (4% inode=62%): [00:49:58] APT on sage is WARNING: APT WARNING: 34 packages available for upgrade (0 critical updates). [00:49:59] MySQL slave on z-dat-s2-b is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 30033 [00:49:59] FC 0/20 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [00:49:59] APT on nightshade is WARNING: APT WARNING: 67 packages available for upgrade (0 critical updates). [00:50:08] SMF on amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [00:50:19] SMTP on z-dat-s1-b is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:50:19] SMTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:50:29] NTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:50:29] NTP on amaranth is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:50:29] SMTP on mayapple is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:50:29] SMTP on z-dat-s5-b is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:50:29] SMTP on sage is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:50:29] FC 0/15 [fsw2-n1-oe16-esams] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [00:50:30] FC 0/16 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [00:50:30] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 42475 MB (6% inode=99%): [00:50:39] wikidata replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 366904.000000 [00:50:39] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A: [00:50:49] FC 0/2 [hemlock] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [00:50:49] FC 0/8 [adenia] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [00:50:49] FC 0/10 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [00:51:28] FC 0/3 [cassia] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [00:57:49] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [00:58:19] APT on yarrow is WARNING: APT WARNING: 67 packages available for upgrade (0 critical updates). [01:06:58] Free Memory on damiana is WARNING: WARNING - 6.0% (502984 kB) free! [01:07:39] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [01:17:09] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [01:26:59] Free Memory on damiana is CRITICAL: CRITICAL - 5.0% (415416 kB) free! [01:46:09] eth0 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [01:46:09] FC 0/14 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [01:46:09] FC 0/23 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [01:46:19] FC 0/12 [thyme] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [01:46:29] FC 0/22 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [01:46:29] FC 0/17 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [01:47:18] Environment IPMI on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [01:47:28] FC 0/21 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [01:47:29] FC 0/4 [hyacinth] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [01:47:29] FC 0/13 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [01:47:29] FC 0/5 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [01:47:49] Load avg. on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [01:47:59] / on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [01:47:59] Sensors on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [01:48:09] /tmp on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [01:48:09] Sun Grid Engine execd on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [01:48:09] aliasd on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [01:48:09] APT on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [01:48:38] MySQL slave on z-dat-s5-b is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 39245 [01:48:38] / on thyme is UNKNOWN: NRPE: Unable to read output [01:48:48] s1 replag on thyme is CRITICAL: QUERY CRITICAL: Cant connect to MySQL server on thyme (146) [01:48:48] SMF on web.amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [01:48:48] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [01:48:58] Environment IPMI on thyme is UNKNOWN: NRPE: Unable to read output [01:48:58] FC 0/11 [fsw2-n1-oe16-esams] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [01:48:58] FC 0/9 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [01:49:08] Load avg. on thyme is UNKNOWN: NRPE: Unable to read output [01:49:08] FMA on thyme is CRITICAL: ERROR - unexpected output from snmpwalk [01:49:18] s4 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 973372.000000 [01:49:19] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [01:49:20] wikidata replag on z-dat-s6-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 777149.000000 [01:49:20] wikidata replag on z-dat-s7-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 551399.000000 [01:49:20] SSH on mayapple is CRITICAL: Server answer: [01:49:28] FMA on amaranth is CRITICAL: ERROR - unexpected output from snmpwalk [01:49:29] RAID on thyme is UNKNOWN: NRPE: Unable to read output [01:49:29] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 2172836.000000 [01:49:29] wikidata replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1375294.000000 [01:49:39] wikidata replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 39190.000000 [01:49:39] APT on z-dat-s2-b is WARNING: APT WARNING: 34 packages available for upgrade (0 critical updates). [01:49:39] FC 0/6 [rosemary] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [01:49:39] FC 0/18 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [01:49:39] APT on yucca is WARNING: APT WARNING: 39 packages available for upgrade (0 critical updates). [01:49:39] APT on z-dat-s1-b is WARNING: APT WARNING: 35 packages available for upgrade (0 critical updates). [01:49:39] FC 0/0 [SAN far1-n1-oe16-esams A1] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [01:49:40] SMTP on nightshade is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:49:49] /mnt on thyme is UNKNOWN: NRPE: Unable to read output [01:49:49] wikidata replag on z-dat-s2-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1320931.000000 [01:49:49] FC 0/19 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [01:49:49] FC 0/7 [daphne] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [01:49:49] FC 0/1 [far1-n1-oe16-esams B1] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [01:49:49] SRaid on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [01:49:49] Load avg. on amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [01:49:50] /tmp on thyme is UNKNOWN: NRPE: Unable to read output [01:49:50] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 266135 MB (4% inode=62%): [01:50:02] APT on sage is WARNING: APT WARNING: 34 packages available for upgrade (0 critical updates). [01:50:02] MySQL slave on z-dat-s2-b is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 22744 [01:50:02] FC 0/20 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [01:50:02] APT on nightshade is WARNING: APT WARNING: 67 packages available for upgrade (0 critical updates). [01:50:09] SMF on amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [01:50:19] SMTP on z-dat-s1-b is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:50:19] SMTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:50:29] NTP on amaranth is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:50:29] SMTP on sage is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:50:29] NTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:50:29] SMTP on mayapple is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:50:29] SMTP on z-dat-s5-b is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:50:30] FC 0/15 [fsw2-n1-oe16-esams] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [01:50:30] FC 0/16 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [01:50:31] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 42273 MB (6% inode=99%): [01:50:38] wikidata replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 365678.000000 [01:50:39] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A: [01:50:48] FC 0/8 [adenia] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [01:50:48] FC 0/2 [hemlock] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [01:50:48] FC 0/10 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [01:51:29] FC 0/3 [cassia] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [01:53:19] PING on web.amaranth is WARNING: PING WARNING - Packet loss = 0%, RTA = 216.00 ms [01:53:19] PING on amaranth is WARNING: PING WARNING - Packet loss = 0%, RTA = 160.00 ms [01:54:19] PING on amaranth is OK: PING OK - Packet loss = 0%, RTA = 157.00 ms [01:55:19] PING on web.amaranth is OK: PING OK - Packet loss = 0%, RTA = 138.00 ms [01:57:48] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [01:58:18] APT on yarrow is WARNING: APT WARNING: 67 packages available for upgrade (0 critical updates). [02:08:28] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [02:17:08] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [02:26:59] Free Memory on damiana is CRITICAL: CRITICAL - 2.9% (240028 kB) free! [02:44:00] toolserver.org HTTP on wolfsbane is CRITICAL: CRITICAL - Socket timeout after 10 seconds [02:46:09] FC 0/23 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [02:46:09] FC 0/14 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [02:46:09] eth0 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [02:46:19] FC 0/12 [thyme] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [02:46:28] FC 0/17 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [02:46:29] FC 0/22 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [02:47:19] Environment IPMI on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [02:47:29] FC 0/21 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [02:47:29] FC 0/5 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [02:47:29] FC 0/13 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [02:47:29] FC 0/4 [hyacinth] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [02:47:49] Load avg. on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [02:47:58] / on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [02:47:59] Sensors on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [02:48:08] Sun Grid Engine execd on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [02:48:09] /tmp on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [02:48:09] APT on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [02:48:09] aliasd on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [02:48:38] MySQL slave on z-dat-s5-b is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 24366 [02:48:38] / on thyme is UNKNOWN: NRPE: Unable to read output [02:48:48] s1 replag on thyme is CRITICAL: QUERY CRITICAL: Cant connect to MySQL server on thyme (146) [02:48:49] SMF on web.amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [02:48:49] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [02:48:58] Environment IPMI on thyme is UNKNOWN: NRPE: Unable to read output [02:48:59] FC 0/9 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [02:48:59] FC 0/11 [fsw2-n1-oe16-esams] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [02:49:09] Load avg. on thyme is UNKNOWN: NRPE: Unable to read output [02:49:09] FMA on thyme is CRITICAL: ERROR - unexpected output from snmpwalk [02:49:19] s4 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 976972.000000 [02:49:19] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [02:49:19] wikidata replag on z-dat-s6-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 772424.000000 [02:49:19] wikidata replag on z-dat-s7-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 551174.000000 [02:49:19] SSH on mayapple is CRITICAL: Server answer: [02:49:29] FMA on amaranth is CRITICAL: ERROR - unexpected output from snmpwalk [02:49:29] RAID on thyme is UNKNOWN: NRPE: Unable to read output [02:49:29] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 2175156.000000 [02:49:29] wikidata replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1374549.000000 [02:49:43] wikidata replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 24077.000000 [02:49:43] APT on yucca is WARNING: APT WARNING: 39 packages available for upgrade (0 critical updates). [02:49:43] APT on z-dat-s2-b is WARNING: APT WARNING: 34 packages available for upgrade (0 critical updates). [02:49:43] APT on z-dat-s1-b is WARNING: APT WARNING: 35 packages available for upgrade (0 critical updates). [02:49:43] FC 0/18 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [02:49:43] FC 0/0 [SAN far1-n1-oe16-esams A1] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [02:49:43] FC 0/6 [rosemary] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [02:49:43] SMTP on nightshade is CRITICAL: CRITICAL - Socket timeout after 10 seconds [02:49:48] /mnt on thyme is UNKNOWN: NRPE: Unable to read output [02:49:49] wikidata replag on z-dat-s2-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1322484.000000 [02:49:49] FC 0/1 [far1-n1-oe16-esams B1] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [02:49:49] FC 0/7 [daphne] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [02:49:49] FC 0/19 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [02:49:49] SRaid on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [02:49:50] Load avg. on amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [02:49:50] /tmp on thyme is UNKNOWN: NRPE: Unable to read output [02:49:51] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 270320 MB (5% inode=63%): [02:49:58] APT on sage is WARNING: APT WARNING: 34 packages available for upgrade (0 critical updates). [02:49:58] MySQL slave on z-dat-s2-b is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 9908 [02:49:59] FC 0/20 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [02:49:59] APT on nightshade is WARNING: APT WARNING: 67 packages available for upgrade (0 critical updates). [02:50:08] SMF on amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [02:50:19] SMTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [02:50:19] SMTP on z-dat-s1-b is CRITICAL: CRITICAL - Socket timeout after 10 seconds [02:50:28] NTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [02:50:29] NTP on amaranth is CRITICAL: CRITICAL - Socket timeout after 10 seconds [02:50:29] SMTP on mayapple is CRITICAL: CRITICAL - Socket timeout after 10 seconds [02:50:29] SMTP on sage is CRITICAL: CRITICAL - Socket timeout after 10 seconds [02:50:29] SMTP on z-dat-s5-b is CRITICAL: CRITICAL - Socket timeout after 10 seconds [02:50:29] FC 0/15 [fsw2-n1-oe16-esams] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [02:50:29] FC 0/16 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [02:50:30] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 42607 MB (6% inode=99%): [02:50:38] wikidata replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 363391.000000 [02:50:39] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A: [02:50:49] FC 0/2 [hemlock] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [02:50:49] FC 0/8 [adenia] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [02:50:49] FC 0/10 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [02:51:29] FC 0/3 [cassia] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [02:57:49] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [02:58:19] APT on yarrow is WARNING: APT WARNING: 67 packages available for upgrade (0 critical updates). [02:59:18] / on hemlock is WARNING: DISK WARNING - free space: / 4193 MB (20% inode=88%): [02:59:28] /tmp on hemlock is WARNING: DISK WARNING - free space: / 4193 MB (20% inode=88%): [03:05:02] [[Special:Log/newusers]] create 10 * Mkdw * (New user account) [03:05:19] PING on amaranth is WARNING: PING WARNING - Packet loss = 0%, RTA = 169.00 ms [03:05:28] /sql on z-dat-s1-b is CRITICAL: DISK CRITICAL - free space: /sql 57820 MB (5% inode=99%): [03:06:18] PING on amaranth is OK: PING OK - Packet loss = 0%, RTA = 157.00 ms [03:06:32] [[User talk:Mkdw]] !N 10https://wiki.toolserver.org/w/index.php?oldid=7996&rcid=21888 * Mkdw * (+75) (creating my user talk page) [03:08:29] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [03:10:19] / on hemlock is OK: DISK OK - free space: / 4238 MB (21% inode=88%): [03:10:29] /tmp on hemlock is OK: DISK OK - free space: / 4238 MB (21% inode=88%): [03:10:58] MySQL slave on z-dat-s2-b is WARNING: SLOW_SLAVE WARNING: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 3521 [03:17:09] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [03:17:19] PING on web.amaranth is WARNING: PING WARNING - Packet loss = 0%, RTA = 164.00 ms [03:19:48] toolserver.org HTTP on wolfsbane is OK: HTTP OK: HTTP/1.1 200 OK - 239 bytes in 0.006 second response time [03:22:19] PING on web.amaranth is OK: PING OK - Packet loss = 0%, RTA = 155.00 ms [03:26:58] MySQL slave on z-dat-s2-b is OK: Uptime: 28818 Threads: 12 Questions: 34670620 Slow queries: 477 Opens: 516388 Flush tables: 1 Open tables: 256 Queries per second avg: 1203.89 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1396 [03:26:59] Free Memory on damiana is CRITICAL: CRITICAL - 2.7% (223324 kB) free! [03:41:19] Load avg. on nightshade is WARNING: WARNING - load average: 28.28, 19.76, 10.82 [03:45:29] APT on nightshade is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [03:46:08] APT on nightshade is WARNING: APT WARNING: 67 packages available for upgrade (0 critical updates). [03:46:08] FC 0/14 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [03:46:09] FC 0/23 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [03:46:09] eth0 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [03:46:18] FC 0/12 [thyme] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [03:46:28] FC 0/22 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [03:46:29] FC 0/17 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [03:47:19] Environment IPMI on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [03:47:28] FC 0/5 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [03:47:29] FC 0/4 [hyacinth] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [03:47:29] FC 0/21 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [03:47:29] FC 0/13 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [03:47:48] Load avg. on nightshade is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [03:47:48] Load avg. on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [03:47:58] / on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [03:47:58] Sensors on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [03:48:08] Sun Grid Engine execd on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [03:48:09] /tmp on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [03:48:09] aliasd on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [03:48:09] APT on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [03:48:19] Load avg. on nightshade is WARNING: WARNING - load average: 26.09, 22.09, 14.86 [03:48:39] MySQL slave on z-dat-s5-b is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 8746 [03:48:39] / on thyme is UNKNOWN: NRPE: Unable to read output [03:48:49] s1 replag on thyme is CRITICAL: QUERY CRITICAL: Cant connect to MySQL server on thyme (146) [03:48:49] SMF on web.amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [03:48:49] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [03:48:59] Environment IPMI on thyme is UNKNOWN: NRPE: Unable to read output [03:48:59] FC 0/11 [fsw2-n1-oe16-esams] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [03:48:59] FC 0/9 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [03:49:09] Load avg. on thyme is UNKNOWN: NRPE: Unable to read output [03:49:09] FMA on thyme is CRITICAL: ERROR - unexpected output from snmpwalk [03:49:19] s4 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 980573.000000 [03:49:19] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [03:49:19] wikidata replag on z-dat-s6-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 767634.000000 [03:49:19] wikidata replag on z-dat-s7-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 550348.000000 [03:49:19] SSH on mayapple is CRITICAL: Server answer: [03:49:28] FMA on amaranth is CRITICAL: ERROR - unexpected output from snmpwalk [03:49:28] RAID on thyme is UNKNOWN: NRPE: Unable to read output [03:49:28] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 2177925.000000 [03:49:28] wikidata replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1373852.000000 [03:49:38] wikidata replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 8747.000000 [03:49:38] FC 0/6 [rosemary] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [03:49:38] FC 0/18 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [03:49:38] APT on yucca is WARNING: APT WARNING: 39 packages available for upgrade (0 critical updates). [03:49:39] APT on z-dat-s1-b is WARNING: APT WARNING: 35 packages available for upgrade (0 critical updates). [03:49:39] APT on z-dat-s2-b is WARNING: APT WARNING: 34 packages available for upgrade (0 critical updates). [03:49:39] FC 0/0 [SAN far1-n1-oe16-esams A1] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [03:49:40] SMTP on nightshade is CRITICAL: CRITICAL - Socket timeout after 10 seconds [03:49:48] /mnt on thyme is UNKNOWN: NRPE: Unable to read output [03:49:49] wikidata replag on z-dat-s2-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1324097.000000 [03:49:49] FC 0/1 [far1-n1-oe16-esams B1] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [03:49:49] FC 0/19 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [03:49:49] FC 0/7 [daphne] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [03:49:49] SRaid on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [03:49:49] Load avg. on amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [03:49:50] /tmp on thyme is UNKNOWN: NRPE: Unable to read output [03:49:50] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 276423 MB (5% inode=63%): [03:49:58] APT on sage is WARNING: APT WARNING: 34 packages available for upgrade (0 critical updates). [03:49:59] FC 0/20 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [03:50:09] SMF on amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [03:50:19] SMTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [03:50:20] SMTP on z-dat-s1-b is CRITICAL: CRITICAL - Socket timeout after 10 seconds [03:50:29] SMTP on z-dat-s5-b is CRITICAL: CRITICAL - Socket timeout after 10 seconds [03:50:29] SMTP on sage is CRITICAL: CRITICAL - Socket timeout after 10 seconds [03:50:29] NTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [03:50:29] SMTP on mayapple is CRITICAL: CRITICAL - Socket timeout after 10 seconds [03:50:29] NTP on amaranth is CRITICAL: CRITICAL - Socket timeout after 10 seconds [03:50:29] FC 0/16 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [03:50:30] FC 0/15 [fsw2-n1-oe16-esams] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [03:50:30] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 41966 MB (6% inode=99%): [03:50:39] wikidata replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 362342.000000 [03:50:39] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [03:50:49] FC 0/10 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [03:50:49] FC 0/8 [adenia] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [03:50:49] FC 0/2 [hemlock] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [03:51:28] FC 0/3 [cassia] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [03:57:49] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [03:58:18] APT on yarrow is WARNING: APT WARNING: 67 packages available for upgrade (0 critical updates). [04:08:29] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [04:12:39] MySQL slave on z-dat-s5-b is WARNING: SLOW_SLAVE WARNING: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 3510 [04:12:39] wikidata replag on z-dat-s5-b is WARNING: QUERY WARNING: SELECT ts_rc_age() returned 3510.000000 [04:17:09] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [04:18:39] MySQL slave on z-dat-s5-b is OK: Uptime: 32166 Threads: 5 Questions: 86722888 Slow queries: 308 Opens: 125419 Flush tables: 1 Open tables: 255 Queries per second avg: 2696.104 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1545 [04:18:40] wikidata replag on z-dat-s5-b is OK: QUERY OK: SELECT ts_rc_age() returned 1548.000000 [04:26:59] Free Memory on damiana is CRITICAL: CRITICAL - 2.3% (190188 kB) free! [04:30:18] [[Wiki server assignments]] ! 10https://wiki.toolserver.org/w/index.php?diff=7997&oldid=7948&rcid=21889 * 185.15.59.202 * (+0) (updated page) [04:42:15] FC 0/14 on fsw1-n1-oe16-esams.mgmt is CRITICAL: (Service Check Timed Out) [04:42:22] FC 0/23 on fsw1-n1-oe16-esams.mgmt is CRITICAL: (Service Check Timed Out) [04:42:22] eth0 on fsw1-n1-oe16-esams.mgmt is CRITICAL: (Service Check Timed Out) [04:42:22] RAID on thyme is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [04:42:22] FC 0/12 [thyme] on fsw1-n1-oe16-esams.mgmt is CRITICAL: (Service Check Timed Out) [04:42:22] Sun Grid Engine execd on ortelius is CRITICAL: (Service Check Timed Out) [04:42:23] FC 0/5 on fsw1-n1-oe16-esams.mgmt is CRITICAL: (Service Check Timed Out) [04:42:23] APT on yarrow is CRITICAL: (Service Check Timed Out) [04:42:24] FC 0/22 on fsw1-n1-oe16-esams.mgmt is CRITICAL: (Service Check Timed Out) [04:42:24] FC 0/15 [fsw2-n1-oe16-esams] on fsw1-n1-oe16-esams.mgmt is CRITICAL: (Service Check Timed Out) [04:42:25] FC 0/17 on fsw1-n1-oe16-esams.mgmt is CRITICAL: (Service Check Timed Out) [04:42:25] FC 0/3 [cassia] on fsw1-n1-oe16-esams.mgmt is CRITICAL: (Service Check Timed Out) [04:42:26] FC 0/16 on fsw1-n1-oe16-esams.mgmt is CRITICAL: (Service Check Timed Out) [04:42:26] FC 0/4 [hyacinth] on fsw1-n1-oe16-esams.mgmt is CRITICAL: (Service Check Timed Out) [04:42:27] FC 0/21 on fsw1-n1-oe16-esams.mgmt is CRITICAL: (Service Check Timed Out) [05:21:33] wikidata replag on z-dat-s2-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1327776.000000 [05:21:33] Load avg. on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [05:21:33] wikidata replag on z-dat-s7-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 551746.000000 [05:21:33] FC 0/15 [fsw2-n1-oe16-esams] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [05:21:33] wikidata replag on z-dat-s6-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 768115.000000 [05:21:34] SMTP on mayapple is CRITICAL: CRITICAL - Socket timeout after 10 seconds [05:21:34] FC 0/3 [cassia] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [05:21:35] SSH on mayapple is CRITICAL: Server answer: [05:21:35] wikidata replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1375298.000000 [05:21:36] RAID on thyme is UNKNOWN: NRPE: Unable to read output [05:21:36] FC 0/16 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [05:21:37] FC 0/4 [hyacinth] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [05:21:42] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [05:21:42] wikidata replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 364630.000000 [05:21:42] Load avg. on amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [05:21:42] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 41716 MB (6% inode=99%): [05:21:42] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [05:21:43] FC 0/17 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [05:21:43] FC 0/5 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [05:21:56] FC 0/7 [daphne] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [05:21:56] SRaid on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [05:22:02] SMF on amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [05:22:12] Sensors on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [05:22:12] / on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [05:22:12] /tmp on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [05:22:12] Sun Grid Engine execd on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [05:22:32] wikidata replag on z-dat-s5-b is CRITICAL: (Service Check Timed Out) [05:22:32] /sql on z-dat-s1-b is WARNING: DISK WARNING - free space: /sql 71911 MB (7% inode=99%): [05:27:52] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [05:27:54] /mnt on thyme is UNKNOWN: NRPE: Unable to read output [05:27:54] s1 replag on thyme is CRITICAL: QUERY CRITICAL: Cant connect to MySQL server on thyme (146) [05:27:54] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [05:27:54] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 280160 MB (5% inode=63%): [05:27:54] /tmp on thyme is UNKNOWN: NRPE: Unable to read output [05:28:01] Environment IPMI on thyme is UNKNOWN: NRPE: Unable to read output [05:28:02] MySQL slave on z-dat-s1-b is CRITICAL: (Return code of 139 is out of bounds) [05:28:02] MySQL slave on z-dat-s2-b is CRITICAL: (Return code of 139 is out of bounds) [05:28:13] Load avg. on thyme is UNKNOWN: NRPE: Unable to read output [05:28:22] FMA on thyme is CRITICAL: ERROR - unexpected output from snmpwalk [06:20:53] MySQL slave on z-dat-s5-b is CRITICAL: (Return code of 139 is out of bounds) [06:21:01] FC 0/10 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [06:21:01] FC 0/8 [adenia] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [06:21:02] FC 0/2 [hemlock] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [06:21:11] FC 0/11 [fsw2-n1-oe16-esams] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [06:21:11] FC 0/20 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [06:21:11] FC 0/9 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [06:21:12] FMA on amaranth is CRITICAL: ERROR - unexpected output from snmpwalk [06:21:22] NTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:21:22] FC 0/21 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [06:21:22] FC 0/22 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [06:21:22] FC 0/12 [thyme] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [06:21:22] FC 0/13 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [06:21:23] aliasd on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [06:21:23] APT on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [06:21:24] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [06:21:24] SMTP on z-dat-s5-b is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:21:25] SMTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:21:25] SMTP on z-dat-s1-b is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:21:26] FC 0/14 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [06:21:41] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [06:21:41] Load avg. on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [06:21:42] wikidata replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 364093.000000 [06:21:42] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 41496 MB (6% inode=99%): [06:21:42] Load avg. on amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [06:22:02] FC 0/19 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [06:22:02] FC 0/18 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [06:22:02] FC 0/7 [daphne] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [06:22:02] FC 0/1 [far1-n1-oe16-esams B1] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [06:22:02] SMF on amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [06:22:03] APT on sage is WARNING: APT WARNING: 34 packages available for upgrade (0 critical updates). [06:22:11] APT on nightshade is WARNING: APT WARNING: 67 packages available for upgrade (0 critical updates). [06:22:12] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 2184991.000000 [06:22:12] APT on yarrow is WARNING: APT WARNING: 67 packages available for upgrade (0 critical updates). [06:22:22] Sensors on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [06:22:22] Sun Grid Engine execd on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [06:22:22] /tmp on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [06:22:22] / on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [06:22:32] SMTP on mayapple is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:22:32] wikidata replag on z-dat-s6-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 766638.000000 [06:22:32] SSH on mayapple is CRITICAL: Server answer: [06:22:32] RAID on thyme is UNKNOWN: NRPE: Unable to read output [06:22:32] wikidata replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1374797.000000 [06:22:32] FC 0/3 [cassia] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [06:22:33] FC 0/16 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [06:22:33] FC 0/4 [hyacinth] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [06:22:42] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [06:22:42] SMTP on sage is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:22:42] FC 0/17 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [06:22:42] FC 0/5 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [06:22:42] SMF on web.amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [06:22:43] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [06:22:43] / on thyme is UNKNOWN: NRPE: Unable to read output [06:22:52] SMTP on nightshade is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:22:52] APT on z-dat-s2-b is WARNING: APT WARNING: 34 packages available for upgrade (0 critical updates). [06:22:52] APT on yucca is WARNING: APT WARNING: 39 packages available for upgrade (0 critical updates). [06:22:52] APT on z-dat-s1-b is WARNING: APT WARNING: 35 packages available for upgrade (0 critical updates). [06:22:52] FC 0/0 [SAN far1-n1-oe16-esams A1] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [06:22:53] FC 0/6 [rosemary] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [06:22:53] SRaid on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [06:23:12] wikidata replag on z-dat-s5-b is CRITICAL: (Service Check Timed Out) [06:27:53] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [06:27:53] /mnt on thyme is UNKNOWN: NRPE: Unable to read output [06:27:53] s1 replag on thyme is CRITICAL: QUERY CRITICAL: Cant connect to MySQL server on thyme (146) [06:28:02] Environment IPMI on thyme is UNKNOWN: NRPE: Unable to read output [06:28:02] MySQL slave on z-dat-s1-b is CRITICAL: (Return code of 139 is out of bounds) [06:28:02] MySQL slave on z-dat-s2-b is CRITICAL: (Return code of 139 is out of bounds) [06:28:22] FMA on thyme is CRITICAL: ERROR - unexpected output from snmpwalk [06:28:52] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [06:28:52] /tmp on thyme is UNKNOWN: NRPE: Unable to read output [06:28:52] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 280764 MB (5% inode=63%): [06:29:12] Load avg. on thyme is UNKNOWN: NRPE: Unable to read output [06:45:32] toolserver.org HTTP on ortelius is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:15:32] Load avg. on yarrow is CRITICAL: CRITICAL - load average: 193.64, 111.57, 49.96 [07:21:02] MySQL slave on z-dat-s5-b is CRITICAL: (Return code of 139 is out of bounds) [07:21:02] FC 0/2 [hemlock] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [07:21:02] FC 0/10 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [07:21:02] FC 0/8 [adenia] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [07:21:11] FC 0/20 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [07:21:11] FC 0/11 [fsw2-n1-oe16-esams] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [07:21:11] FC 0/9 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [07:21:22] FMA on amaranth is CRITICAL: ERROR - unexpected output from snmpwalk [07:21:22] aliasd on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [07:21:23] NTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:21:23] APT on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [07:21:23] FC 0/21 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [07:21:23] FC 0/22 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [07:21:24] FC 0/13 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [07:21:24] FC 0/12 [thyme] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [07:21:24] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [07:21:30] s4 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 993299.000000 [07:21:30] SMTP on z-dat-s5-b is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:21:30] NTP on amaranth is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:21:42] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [07:21:43] Load avg. on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [07:21:43] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 41322 MB (6% inode=99%): [07:21:43] wikidata replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 362771.000000 [07:21:43] Load avg. on amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [07:22:02] FC 0/7 [daphne] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [07:22:02] FC 0/1 [far1-n1-oe16-esams B1] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [07:22:03] FC 0/18 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [07:22:03] FC 0/19 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [07:22:03] SMF on amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [07:22:03] APT on sage is WARNING: APT WARNING: 34 packages available for upgrade (0 critical updates). [07:22:12] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 2188032.000000 [07:22:12] APT on yarrow is WARNING: APT WARNING: 67 packages available for upgrade (0 critical updates). [07:22:22] / on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [07:22:22] /tmp on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [07:22:22] Sun Grid Engine execd on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [07:22:23] Sensors on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [07:22:32] wikidata replag on z-dat-s6-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 765665.000000 [07:22:32] SSH on mayapple is CRITICAL: Server answer: [07:22:32] RAID on thyme is UNKNOWN: NRPE: Unable to read output [07:22:32] wikidata replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1373746.000000 [07:22:32] SMTP on mayapple is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:22:33] FC 0/3 [cassia] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [07:22:33] FC 0/16 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [07:22:34] FC 0/4 [hyacinth] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [07:22:42] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [07:22:42] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A: [07:22:42] SMTP on sage is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:22:42] FC 0/17 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [07:22:42] FC 0/5 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [07:22:43] / on thyme is UNKNOWN: NRPE: Unable to read output [07:22:43] SMF on web.amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [07:22:52] SMTP on nightshade is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:22:52] FC 0/0 [SAN far1-n1-oe16-esams A1] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [07:22:52] APT on z-dat-s2-b is WARNING: APT WARNING: 34 packages available for upgrade (0 critical updates). [07:22:52] APT on yucca is WARNING: APT WARNING: 39 packages available for upgrade (0 critical updates). [07:22:52] APT on z-dat-s1-b is WARNING: APT WARNING: 35 packages available for upgrade (0 critical updates). [07:22:53] SRaid on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [07:23:01] FC 0/6 [rosemary] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [07:23:11] APT on nightshade is WARNING: APT WARNING: 67 packages available for upgrade (0 critical updates). [07:23:52] wikidata replag on z-dat-s5-b is CRITICAL: (Service Check Timed Out) [07:28:02] Environment IPMI on thyme is UNKNOWN: NRPE: Unable to read output [07:28:02] MySQL slave on z-dat-s1-b is CRITICAL: (Return code of 139 is out of bounds) [07:28:02] MySQL slave on z-dat-s2-b is CRITICAL: (Return code of 139 is out of bounds) [07:28:22] FMA on thyme is CRITICAL: ERROR - unexpected output from snmpwalk [07:28:52] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [07:28:52] /mnt on thyme is UNKNOWN: NRPE: Unable to read output [07:28:52] s1 replag on thyme is CRITICAL: QUERY CRITICAL: Cant connect to MySQL server on thyme (146) [07:29:11] Load avg. on thyme is UNKNOWN: NRPE: Unable to read output [07:29:51] /tmp on thyme is UNKNOWN: NRPE: Unable to read output [07:29:52] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 282230 MB (5% inode=63%): [07:29:52] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [07:34:32] APT on nightshade is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [07:35:11] APT on nightshade is WARNING: APT WARNING: 67 packages available for upgrade (0 critical updates). [07:46:32] toolserver.org HTTP on ortelius is CRITICAL: Connection refused [07:47:23] toolserver.org HTTP on ortelius is OK: HTTP OK: HTTP/1.1 200 OK - 239 bytes in 0.301 second response time [08:00:11] aliasd on yarrow is CRITICAL: Connection refused [08:15:32] Load avg. on yarrow is CRITICAL: CRITICAL - load average: 1.58, 14.66, 206.69 [08:21:11] FC 0/9 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [08:21:11] FC 0/11 [fsw2-n1-oe16-esams] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [08:21:12] FC 0/20 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [08:21:32] SMTP on z-dat-s1-b is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:21:32] SMTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:21:32] SMTP on z-dat-s5-b is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:21:32] NTP on amaranth is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:21:32] FC 0/14 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [08:21:32] eth0 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [08:21:33] FC 0/23 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [08:21:33] Environment IPMI on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [08:21:34] wikidata replag on z-dat-s2-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1324047.000000 [08:21:34] wikidata replag on z-dat-s7-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 542409.000000 [08:21:35] FC 0/15 [fsw2-n1-oe16-esams] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [08:21:42] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [08:21:42] Load avg. on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [08:21:52] Load avg. on amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [08:22:02] MySQL slave on z-dat-s5-b is CRITICAL: (Return code of 139 is out of bounds) [08:22:02] FC 0/7 [daphne] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [08:22:02] FC 0/2 [hemlock] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [08:22:02] FC 0/10 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [08:22:03] FC 0/19 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [08:22:03] FC 0/1 [far1-n1-oe16-esams B1] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [08:22:03] FC 0/8 [adenia] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [08:22:04] FC 0/18 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [08:22:04] APT on sage is WARNING: APT WARNING: 34 packages available for upgrade (0 critical updates). [08:22:11] SMF on amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [08:22:11] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 2191132.000000 [08:22:11] APT on yarrow is WARNING: APT WARNING: 67 packages available for upgrade (0 critical updates). [08:22:21] FMA on amaranth is CRITICAL: ERROR - unexpected output from snmpwalk [08:22:21] NTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:22:22] / on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [08:22:22] FC 0/22 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [08:22:22] aliasd on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [08:22:22] FC 0/21 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [08:22:22] APT on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [08:22:23] FC 0/13 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [08:22:23] FC 0/12 [thyme] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [08:22:24] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [08:22:24] s4 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 996959.000000 [08:22:31] SSH on mayapple is CRITICAL: Server answer: [08:22:32] RAID on thyme is UNKNOWN: NRPE: Unable to read output [08:22:32] wikidata replag on z-dat-s6-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 765358.000000 [08:22:32] wikidata replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1372997.000000 [08:22:41] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 41098 MB (6% inode=99%): [08:22:41] wikidata replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 362448.000000 [08:22:41] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [08:22:42] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [08:22:51] SMF on web.amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [08:22:51] SMTP on sage is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:22:52] FC 0/17 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [08:22:53] FC 0/5 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [08:22:53] APT on z-dat-s2-b is WARNING: APT WARNING: 34 packages available for upgrade (0 critical updates). [08:22:53] APT on z-dat-s1-b is WARNING: APT WARNING: 35 packages available for upgrade (0 critical updates). [08:22:53] APT on yucca is WARNING: APT WARNING: 39 packages available for upgrade (0 critical updates). [08:22:53] SMTP on nightshade is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:22:53] FC 0/0 [SAN far1-n1-oe16-esams A1] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [08:22:54] SRaid on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [08:23:02] FC 0/6 [rosemary] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [08:23:23] Sensors on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [08:23:23] /tmp on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [08:23:23] Sun Grid Engine execd on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [08:23:32] SMTP on mayapple is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:23:32] FC 0/3 [cassia] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [08:23:32] FC 0/16 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [08:23:32] FC 0/4 [hyacinth] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [08:23:42] / on thyme is UNKNOWN: NRPE: Unable to read output [08:24:32] wikidata replag on z-dat-s5-b is CRITICAL: (Service Check Timed Out) [08:28:02] Environment IPMI on thyme is UNKNOWN: NRPE: Unable to read output [08:28:02] MySQL slave on z-dat-s1-b is CRITICAL: (Return code of 139 is out of bounds) [08:28:03] MySQL slave on z-dat-s2-b is CRITICAL: (Return code of 139 is out of bounds) [08:28:52] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [08:28:52] /mnt on thyme is UNKNOWN: NRPE: Unable to read output [08:28:52] s1 replag on thyme is CRITICAL: QUERY CRITICAL: Cant connect to MySQL server on thyme (146) [08:29:11] Load avg. on thyme is UNKNOWN: NRPE: Unable to read output [08:29:22] FMA on thyme is CRITICAL: ERROR - unexpected output from snmpwalk [08:29:52] /tmp on thyme is UNKNOWN: NRPE: Unable to read output [08:29:53] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 283966 MB (5% inode=63%): [08:30:02] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [08:36:11] APT on nightshade is WARNING: APT WARNING: 67 packages available for upgrade (0 critical updates). [08:53:32] Load avg. on yarrow is WARNING: WARNING - load average: 1.55, 1.62, 19.27 [08:58:02] toolserver.org HTTP on wolfsbane is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:58:31] Load avg. on yarrow is OK: OK - load average: 1.61, 1.62, 14.39 [09:00:11] aliasd on yarrow is CRITICAL: Connection refused [09:21:33] SMTP on z-dat-s1-b is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:21:33] SMTP on z-dat-s5-b is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:21:33] SMTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:21:33] NTP on amaranth is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:21:33] FC 0/14 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [09:21:34] eth0 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [09:21:34] FC 0/23 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [09:21:34] wikidata replag on z-dat-s2-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1322213.000000 [09:21:34] wikidata replag on z-dat-s7-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 536655.000000 [09:21:35] FC 0/15 [fsw2-n1-oe16-esams] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [09:21:35] Environment IPMI on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [09:21:41] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [09:21:41] Load avg. on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [09:21:51] Load avg. on amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [09:22:02] MySQL slave on z-dat-s5-b is CRITICAL: (Return code of 139 is out of bounds) [09:22:02] FC 0/7 [daphne] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [09:22:11] SMF on amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [09:22:11] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 2194168.000000 [09:22:11] FC 0/11 [fsw2-n1-oe16-esams] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [09:22:11] FC 0/9 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [09:22:11] FC 0/20 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [09:22:12] APT on yarrow is WARNING: APT WARNING: 67 packages available for upgrade (0 critical updates). [09:22:21] FMA on amaranth is CRITICAL: ERROR - unexpected output from snmpwalk [09:22:21] NTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:22:22] / on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [09:22:22] aliasd on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [09:22:23] APT on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [09:22:23] FC 0/21 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [09:22:23] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [09:22:23] FC 0/12 [thyme] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [09:22:23] FC 0/22 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [09:22:24] FC 0/13 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [09:22:24] s4 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1000559.000000 [09:22:31] SSH on mayapple is CRITICAL: Server answer: [09:22:32] RAID on thyme is UNKNOWN: NRPE: Unable to read output [09:22:32] wikidata replag on z-dat-s6-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 763804.000000 [09:22:33] wikidata replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1372032.000000 [09:22:42] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 40904 MB (6% inode=99%): [09:22:42] wikidata replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 359531.000000 [09:22:42] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [09:22:42] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A: [09:22:52] SMTP on sage is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:22:52] SMF on web.amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [09:22:52] FC 0/17 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [09:22:52] FC 0/5 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [09:22:52] APT on z-dat-s2-b is WARNING: APT WARNING: 34 packages available for upgrade (0 critical updates). [09:22:53] APT on z-dat-s1-b is WARNING: APT WARNING: 35 packages available for upgrade (0 critical updates). [09:23:02] FC 0/10 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [09:23:02] FC 0/8 [adenia] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [09:23:02] FC 0/2 [hemlock] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [09:23:02] FC 0/19 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [09:23:02] FC 0/6 [rosemary] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [09:23:03] FC 0/18 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [09:23:03] FC 0/1 [far1-n1-oe16-esams B1] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [09:23:04] APT on sage is WARNING: APT WARNING: 34 packages available for upgrade (0 critical updates). [09:23:32] SMTP on mayapple is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:23:32] FC 0/16 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [09:23:32] FC 0/3 [cassia] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [09:23:32] FC 0/4 [hyacinth] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [09:23:41] / on thyme is UNKNOWN: NRPE: Unable to read output [09:23:52] APT on yucca is WARNING: APT WARNING: 39 packages available for upgrade (0 critical updates). [09:23:52] SMTP on nightshade is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:23:52] FC 0/0 [SAN far1-n1-oe16-esams A1] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [09:23:52] SRaid on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [09:24:22] Sensors on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [09:24:22] /tmp on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [09:24:22] Sun Grid Engine execd on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [09:25:11] wikidata replag on z-dat-s5-b is CRITICAL: (Service Check Timed Out) [09:28:02] Environment IPMI on thyme is UNKNOWN: NRPE: Unable to read output [09:28:52] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [09:28:52] /mnt on thyme is UNKNOWN: NRPE: Unable to read output [09:28:53] s1 replag on thyme is CRITICAL: QUERY CRITICAL: Cant connect to MySQL server on thyme (146) [09:29:02] MySQL slave on z-dat-s1-b is CRITICAL: (Return code of 139 is out of bounds) [09:29:02] MySQL slave on z-dat-s2-b is CRITICAL: (Return code of 139 is out of bounds) [09:29:11] Load avg. on thyme is UNKNOWN: NRPE: Unable to read output [09:29:32] FMA on thyme is CRITICAL: ERROR - unexpected output from snmpwalk [09:29:53] /tmp on thyme is UNKNOWN: NRPE: Unable to read output [09:29:53] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 286058 MB (5% inode=63%): [09:30:02] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [09:37:02] APT on nightshade is WARNING: APT WARNING: 67 packages available for upgrade (0 critical updates). [09:38:32] APT on nightshade is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [09:39:11] APT on nightshade is WARNING: APT WARNING: 67 packages available for upgrade (0 critical updates). [09:59:03] toolserver.org HTTP on wolfsbane is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:00:12] aliasd on yarrow is CRITICAL: Connection refused [10:21:31] SMTP on z-dat-s5-b is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:21:31] SMTP on z-dat-s1-b is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:21:32] SMTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:21:32] NTP on amaranth is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:21:32] FC 0/14 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [10:21:32] eth0 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [10:21:32] FC 0/23 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [10:21:41] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [10:21:41] Load avg. on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [10:21:51] Load avg. on amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [10:22:01] MySQL slave on z-dat-s5-b is CRITICAL: (Return code of 139 is out of bounds) [10:22:02] FC 0/7 [daphne] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [10:22:12] SMF on amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [10:22:12] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 2196168.000000 [10:22:12] FC 0/11 [fsw2-n1-oe16-esams] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [10:22:12] FC 0/9 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [10:22:12] APT on yarrow is WARNING: APT WARNING: 67 packages available for upgrade (0 critical updates). [10:22:12] FC 0/20 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [10:22:22] FMA on amaranth is CRITICAL: ERROR - unexpected output from snmpwalk [10:22:22] NTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:22:22] FC 0/21 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [10:22:22] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [10:22:23] aliasd on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [10:22:23] / on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [10:22:23] APT on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [10:22:23] FC 0/13 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [10:22:24] FC 0/22 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [10:22:24] FC 0/12 [thyme] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [10:22:25] s4 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1004159.000000 [10:22:32] wikidata replag on z-dat-s7-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 531578.000000 [10:22:32] wikidata replag on z-dat-s2-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1320062.000000 [10:22:32] SSH on mayapple is CRITICAL: Server answer: [10:22:32] RAID on thyme is UNKNOWN: NRPE: Unable to read output [10:22:32] wikidata replag on z-dat-s6-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 761076.000000 [10:22:33] FC 0/15 [fsw2-n1-oe16-esams] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [10:22:33] Environment IPMI on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [10:22:42] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 40668 MB (6% inode=99%): [10:22:42] wikidata replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 356569.000000 [10:22:42] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [10:22:42] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A: [10:22:52] SMF on web.amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [10:22:52] SMTP on sage is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:22:52] APT on z-dat-s2-b is WARNING: APT WARNING: 34 packages available for upgrade (0 critical updates). [10:22:52] APT on z-dat-s1-b is WARNING: APT WARNING: 35 packages available for upgrade (0 critical updates). [10:22:52] FC 0/17 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [10:22:53] FC 0/5 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [10:23:02] FC 0/10 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [10:23:02] FC 0/2 [hemlock] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [10:23:02] FC 0/19 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [10:23:02] FC 0/8 [adenia] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [10:23:02] FC 0/6 [rosemary] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [10:23:03] FC 0/18 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [10:23:03] FC 0/1 [far1-n1-oe16-esams B1] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [10:23:04] APT on sage is WARNING: APT WARNING: 34 packages available for upgrade (0 critical updates). [10:23:31] wikidata replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1371116.000000 [10:23:32] SMTP on mayapple is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:23:41] / on thyme is UNKNOWN: NRPE: Unable to read output [10:23:52] APT on yucca is WARNING: APT WARNING: 39 packages available for upgrade (0 critical updates). [10:23:52] SMTP on nightshade is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:24:22] Sun Grid Engine execd on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [10:24:22] Sensors on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [10:24:22] /tmp on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [10:24:32] FC 0/16 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [10:24:32] FC 0/4 [hyacinth] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [10:24:32] FC 0/3 [cassia] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [10:24:52] FC 0/0 [SAN far1-n1-oe16-esams A1] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [10:24:52] SRaid on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [10:25:53] wikidata replag on z-dat-s5-b is CRITICAL: (Service Check Timed Out) [10:28:02] Environment IPMI on thyme is UNKNOWN: NRPE: Unable to read output [10:29:03] MySQL slave on z-dat-s1-b is CRITICAL: (Return code of 139 is out of bounds) [10:29:03] MySQL slave on z-dat-s2-b is CRITICAL: (Return code of 139 is out of bounds) [10:29:12] Load avg. on thyme is UNKNOWN: NRPE: Unable to read output [10:29:32] FMA on thyme is CRITICAL: ERROR - unexpected output from snmpwalk [10:29:52] /mnt on thyme is UNKNOWN: NRPE: Unable to read output [10:29:52] s1 replag on thyme is CRITICAL: QUERY CRITICAL: Cant connect to MySQL server on thyme (146) [10:29:52] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [10:29:52] /tmp on thyme is UNKNOWN: NRPE: Unable to read output [10:29:53] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 288167 MB (5% inode=63%): [10:30:02] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [10:37:43] APT on nightshade is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [10:38:12] APT on nightshade is WARNING: APT WARNING: 67 packages available for upgrade (0 critical updates). [10:39:42] APT on nightshade is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [10:59:11] toolserver.org HTTP on wolfsbane is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:59:11] APT on nightshade is WARNING: APT WARNING: 67 packages available for upgrade (0 critical updates). [11:01:11] aliasd on yarrow is CRITICAL: Connection refused [11:21:31] NTP on amaranth is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:21:31] SMTP on z-dat-s5-b is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:21:32] SMTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:21:32] SMTP on z-dat-s1-b is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:21:32] FC 0/14 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [11:21:32] eth0 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [11:21:32] FC 0/23 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [11:21:41] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [11:21:41] Load avg. on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [11:21:52] Load avg. on amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [11:22:02] MySQL slave on z-dat-s5-b is CRITICAL: (Return code of 139 is out of bounds) [11:22:02] FC 0/7 [daphne] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [11:22:12] SMF on amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [11:22:12] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 2198039.000000 [11:22:12] APT on yarrow is WARNING: APT WARNING: 67 packages available for upgrade (0 critical updates). [11:22:12] FC 0/9 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [11:22:12] FC 0/11 [fsw2-n1-oe16-esams] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [11:22:13] FC 0/20 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [11:22:22] FMA on amaranth is CRITICAL: ERROR - unexpected output from snmpwalk [11:22:22] NTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:22:22] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [11:22:22] FC 0/21 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [11:22:32] aliasd on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [11:22:32] wikidata replag on z-dat-s7-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 529358.000000 [11:22:32] wikidata replag on z-dat-s2-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1319369.000000 [11:22:32] SSH on mayapple is CRITICAL: Server answer: [11:22:32] RAID on thyme is UNKNOWN: NRPE: Unable to read output [11:22:33] wikidata replag on z-dat-s6-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 758112.000000 [11:22:33] FC 0/15 [fsw2-n1-oe16-esams] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [11:22:42] Environment IPMI on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [11:22:42] s4 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1007774.000000 [11:22:42] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 40422 MB (6% inode=99%): [11:22:42] wikidata replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 354127.000000 [11:22:42] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [11:22:43] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [11:22:52] SMF on web.amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [11:22:52] APT on z-dat-s2-b is WARNING: APT WARNING: 34 packages available for upgrade (0 critical updates). [11:22:52] APT on z-dat-s1-b is WARNING: APT WARNING: 35 packages available for upgrade (0 critical updates). [11:22:52] SMTP on sage is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:22:52] FC 0/5 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [11:22:53] FC 0/17 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [11:23:02] FC 0/10 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [11:23:02] FC 0/2 [hemlock] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [11:23:02] FC 0/19 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [11:23:21] / on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [11:23:21] FC 0/22 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [11:23:22] APT on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [11:23:22] FC 0/13 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [11:23:22] FC 0/12 [thyme] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [11:23:31] SMTP on mayapple is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:23:42] / on thyme is UNKNOWN: NRPE: Unable to read output [11:23:53] wikidata replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1371593.000000 [11:23:53] APT on yucca is WARNING: APT WARNING: 39 packages available for upgrade (0 critical updates). [11:23:53] SMTP on nightshade is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:24:03] FC 0/1 [far1-n1-oe16-esams B1] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [11:24:03] FC 0/8 [adenia] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [11:24:03] FC 0/6 [rosemary] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [11:24:03] FC 0/18 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [11:24:03] APT on sage is WARNING: APT WARNING: 34 packages available for upgrade (0 critical updates). [11:24:21] Sun Grid Engine execd on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [11:24:22] Sensors on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [11:24:31] /tmp on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [11:24:31] FC 0/3 [cassia] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [11:24:42] FC 0/4 [hyacinth] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [11:24:42] FC 0/16 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [11:24:52] FC 0/0 [SAN far1-n1-oe16-esams A1] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [11:24:52] SRaid on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [11:26:31] wikidata replag on z-dat-s5-b is CRITICAL: (Service Check Timed Out) [11:28:02] Environment IPMI on thyme is UNKNOWN: NRPE: Unable to read output [11:29:02] MySQL slave on z-dat-s1-b is CRITICAL: (Return code of 139 is out of bounds) [11:29:12] Load avg. on thyme is UNKNOWN: NRPE: Unable to read output [11:29:32] FMA on thyme is CRITICAL: ERROR - unexpected output from snmpwalk [11:29:52] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [11:29:52] /mnt on thyme is UNKNOWN: NRPE: Unable to read output [11:29:52] s1 replag on thyme is CRITICAL: QUERY CRITICAL: Cant connect to MySQL server on thyme (146) [11:29:52] /tmp on thyme is UNKNOWN: NRPE: Unable to read output [11:29:52] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 290341 MB (5% inode=64%): [11:30:02] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [11:30:02] MySQL slave on z-dat-s2-b is CRITICAL: (Return code of 139 is out of bounds) [11:40:43] APT on nightshade is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [11:41:11] APT on nightshade is WARNING: APT WARNING: 67 packages available for upgrade (0 critical updates). [11:43:21] Load avg. on nightshade is WARNING: WARNING - load average: 19.46, 17.25, 10.51 [11:44:22] Load avg. on nightshade is OK: OK - load average: 9.49, 14.79, 10.08 [11:59:11] toolserver.org HTTP on wolfsbane is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:01:12] aliasd on yarrow is CRITICAL: Connection refused [12:21:42] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [12:21:42] Load avg. on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [12:21:52] Load avg. on amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [12:22:02] MySQL slave on z-dat-s5-b is CRITICAL: (Return code of 139 is out of bounds) [12:22:02] FC 0/7 [daphne] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [12:22:22] FMA on amaranth is CRITICAL: ERROR - unexpected output from snmpwalk [12:22:22] FC 0/20 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [12:22:22] FC 0/9 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [12:22:22] FC 0/11 [fsw2-n1-oe16-esams] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [12:22:22] NTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:22:23] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [12:22:23] FC 0/21 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [12:22:31] NTP on amaranth is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:22:31] SMTP on z-dat-s5-b is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:22:32] SMTP on z-dat-s1-b is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:22:32] SMTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:22:32] eth0 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [12:22:32] FC 0/14 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [12:22:32] FC 0/23 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [12:22:33] wikidata replag on z-dat-s7-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 528294.000000 [12:22:33] wikidata replag on z-dat-s2-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1316573.000000 [12:22:34] SSH on mayapple is CRITICAL: Server answer: [12:22:34] RAID on thyme is UNKNOWN: NRPE: Unable to read output [12:22:35] aliasd on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [12:22:51] SMF on web.amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [12:22:51] APT on z-dat-s2-b is WARNING: APT WARNING: 34 packages available for upgrade (0 critical updates). [12:22:52] APT on z-dat-s1-b is WARNING: APT WARNING: 35 packages available for upgrade (0 critical updates). [12:22:52] SMTP on sage is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:22:52] FC 0/5 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [12:22:53] FC 0/17 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [12:23:01] FC 0/10 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [12:23:02] FC 0/2 [hemlock] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [12:23:02] FC 0/19 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [12:23:11] SMF on amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [12:23:12] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 2200841.000000 [12:23:12] APT on yarrow is WARNING: APT WARNING: 67 packages available for upgrade (0 critical updates). [12:23:22] FC 0/22 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [12:23:22] / on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [12:23:22] APT on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [12:23:22] FC 0/13 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [12:23:22] FC 0/12 [thyme] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [12:23:42] SMTP on mayapple is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:23:42] / on thyme is UNKNOWN: NRPE: Unable to read output [12:24:11] APT on sage is WARNING: APT WARNING: 34 packages available for upgrade (0 critical updates). [12:24:22] Sun Grid Engine execd on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [12:24:22] Sensors on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [12:24:31] /tmp on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [12:24:42] FC 0/4 [hyacinth] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [12:24:42] FC 0/3 [cassia] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [12:24:43] FC 0/16 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [12:24:52] wikidata replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1371190.000000 [12:24:53] APT on yucca is WARNING: APT WARNING: 39 packages available for upgrade (0 critical updates). [12:24:53] SMTP on nightshade is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:24:53] FC 0/0 [SAN far1-n1-oe16-esams A1] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [12:25:02] SRaid on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [12:25:02] FC 0/1 [far1-n1-oe16-esams B1] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [12:25:02] FC 0/8 [adenia] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [12:25:02] FC 0/6 [rosemary] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [12:25:03] FC 0/18 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [12:27:12] wikidata replag on z-dat-s5-b is CRITICAL: (Service Check Timed Out) [12:28:02] Environment IPMI on thyme is UNKNOWN: NRPE: Unable to read output [12:29:02] MySQL slave on z-dat-s1-b is CRITICAL: (Return code of 139 is out of bounds) [12:29:11] Load avg. on thyme is UNKNOWN: NRPE: Unable to read output [12:29:31] FMA on thyme is CRITICAL: ERROR - unexpected output from snmpwalk [12:29:52] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [12:29:53] /mnt on thyme is UNKNOWN: NRPE: Unable to read output [12:29:53] s1 replag on thyme is CRITICAL: QUERY CRITICAL: Cant connect to MySQL server on thyme (146) [12:29:53] /tmp on thyme is UNKNOWN: NRPE: Unable to read output [12:29:54] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 292473 MB (5% inode=64%): [12:30:12] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [12:31:02] MySQL slave on z-dat-s2-b is CRITICAL: (Return code of 139 is out of bounds) [12:35:52] Load avg. on ortelius is CRITICAL: CRITICAL - load average: 40.00, 60.22, 33.74 [12:41:41] APT on nightshade is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [12:42:12] APT on nightshade is WARNING: APT WARNING: 67 packages available for upgrade (0 critical updates). [12:43:21] Sun Grid Engine execd on nightshade is UNKNOWN: Execution timeout exceeded [12:44:22] Load avg. on nightshade is WARNING: WARNING - load average: 29.06, 21.06, 12.39 [12:44:32] Sun Grid Engine execd on nightshade is OK: Host and Queues Ok [12:44:52] Load avg. on ortelius is WARNING: WARNING - load average: 3.08, 12.18, 19.68 [12:49:22] Load avg. on nightshade is OK: OK - load average: 4.10, 13.05, 11.67 [12:49:52] Load avg. on ortelius is OK: OK - load average: 2.24, 6.16, 14.90 [12:59:12] toolserver.org HTTP on wolfsbane is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:01:11] aliasd on yarrow is CRITICAL: Connection refused [13:03:06] Betacommand: you around? [13:07:42] greenrosetta: what? [13:08:11] did you ever get a chance to try installing my stub application on labs? [13:08:48] greenrosetta: Im not about to start using another framework [13:09:04] Well, I just wanted to see if the instructions made sense [13:09:08] and worked for you [13:18:03] toolserver.org HTTP on wolfsbane is OK: HTTP OK: HTTP/1.1 200 OK - 239 bytes in 0.087 second response time [13:20:27] @replag [13:20:28] liangent: s1-rr-a: 8h 37m 59s [-]; s1-rr-a-wd: 1w 4d 3h 5m 34s [-]; s1-user-c: 1w 4d 17h 54m 9s [-]; s1-user-wd: 2w 1d 20h 44m 54s [-]; s2-rr: 8h 38m 54s [-]; s2-user: 8h 38m 54s [-]; s2-user-c: error; s2-user-wd: 2w 1d 5h 47m 53s [-] [13:20:29] liangent: s3-user-wd: 1w 1d 22h 53m 7s [-]; s4-user-wd: 3w 4d 12h 11m 49s [-]; s5-rr-a-wd: 4d 2h 23m 37s [-]; s5-user: 8h 44m 57s [-]; s6-user-wd: 1w 1d 17h 41m 3s [-]; s7-user-wd: 6d 2h 23m 59s [-] [13:21:42] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [13:21:42] Load avg. on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [13:21:52] Load avg. on amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [13:22:02] MySQL slave on z-dat-s5-b is CRITICAL: (Return code of 139 is out of bounds) [13:22:02] FC 0/7 [daphne] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [13:22:21] FMA on amaranth is CRITICAL: ERROR - unexpected output from snmpwalk [13:22:21] FC 0/11 [fsw2-n1-oe16-esams] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [13:22:21] FC 0/9 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [13:22:21] FC 0/20 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [13:22:22] NTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:22:22] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [13:22:42] Environment IPMI on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [13:22:42] FC 0/15 [fsw2-n1-oe16-esams] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [13:22:42] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 39892 MB (6% inode=99%): [13:22:42] wikidata replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 354249.000000 [13:22:42] s4 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1014973.000000 [13:22:43] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [13:22:43] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A: [13:22:52] SMF on web.amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [13:22:53] APT on z-dat-s2-b is WARNING: APT WARNING: 34 packages available for upgrade (0 critical updates). [13:22:53] APT on z-dat-s1-b is WARNING: APT WARNING: 35 packages available for upgrade (0 critical updates). [13:22:53] SMTP on sage is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:22:53] FC 0/5 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [13:22:53] FC 0/17 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [13:23:02] FC 0/10 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [13:23:02] FC 0/19 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [13:23:03] FC 0/2 [hemlock] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [13:23:12] SMF on amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [13:23:12] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 2204047.000000 [13:23:12] APT on yarrow is WARNING: APT WARNING: 67 packages available for upgrade (0 critical updates). [13:23:22] FC 0/21 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [13:23:22] FC 0/22 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [13:23:22] / on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [13:23:22] APT on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [13:23:22] FC 0/13 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [13:23:23] FC 0/12 [thyme] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [13:23:31] NTP on amaranth is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:23:32] SMTP on z-dat-s1-b is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:23:32] SMTP on z-dat-s5-b is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:23:32] SMTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:23:32] eth0 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [13:23:32] FC 0/14 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [13:23:33] FC 0/23 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [13:23:33] wikidata replag on z-dat-s7-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 526974.000000 [13:23:34] wikidata replag on z-dat-s2-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1316913.000000 [13:23:34] SSH on mayapple is CRITICAL: Server answer: [13:23:35] RAID on thyme is UNKNOWN: NRPE: Unable to read output [13:23:35] wikidata replag on z-dat-s6-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 754914.000000 [13:23:36] aliasd on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [13:23:42] SMTP on mayapple is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:23:42] / on thyme is UNKNOWN: NRPE: Unable to read output [13:24:21] Sun Grid Engine execd on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [13:24:31] /tmp on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [13:24:42] FC 0/4 [hyacinth] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [13:24:53] wikidata replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1370775.000000 [13:24:53] APT on yucca is WARNING: APT WARNING: 39 packages available for upgrade (0 critical updates). [13:24:53] SMTP on nightshade is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:24:53] FC 0/0 [SAN far1-n1-oe16-esams A1] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [13:25:02] SRaid on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [13:25:02] FC 0/1 [far1-n1-oe16-esams B1] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [13:25:02] FC 0/6 [rosemary] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [13:25:02] FC 0/8 [adenia] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [13:25:03] FC 0/18 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [13:25:03] APT on sage is WARNING: APT WARNING: 34 packages available for upgrade (0 critical updates). [13:25:22] Sensors on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [13:25:42] FC 0/16 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [13:25:42] FC 0/3 [cassia] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [13:27:52] wikidata replag on z-dat-s5-b is CRITICAL: (Service Check Timed Out) [13:28:03] Environment IPMI on thyme is UNKNOWN: NRPE: Unable to read output [13:29:02] MySQL slave on z-dat-s1-b is CRITICAL: (Return code of 139 is out of bounds) [13:30:12] Load avg. on thyme is UNKNOWN: NRPE: Unable to read output [13:30:31] FMA on thyme is CRITICAL: ERROR - unexpected output from snmpwalk [13:30:52] /mnt on thyme is UNKNOWN: NRPE: Unable to read output [13:30:52] s1 replag on thyme is CRITICAL: QUERY CRITICAL: Cant connect to MySQL server on thyme (146) [13:30:52] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [13:30:53] /tmp on thyme is UNKNOWN: NRPE: Unable to read output [13:30:53] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 294321 MB (5% inode=64%): [13:31:02] MySQL slave on z-dat-s2-b is CRITICAL: (Return code of 139 is out of bounds) [13:31:02] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [13:35:43] APT on nightshade is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [13:36:21] APT on nightshade is WARNING: APT WARNING: 67 packages available for upgrade (0 critical updates). [14:01:11] aliasd on yarrow is CRITICAL: Connection refused [14:21:42] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [14:21:42] Load avg. on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [14:21:52] Load avg. on amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [14:22:02] MySQL slave on z-dat-s5-b is CRITICAL: (Return code of 139 is out of bounds) [14:22:02] FC 0/7 [daphne] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [14:22:21] FMA on amaranth is CRITICAL: ERROR - unexpected output from snmpwalk [14:22:21] NTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:22:22] FC 0/20 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [14:22:22] FC 0/9 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [14:22:22] FC 0/11 [fsw2-n1-oe16-esams] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [14:22:22] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [14:22:42] s4 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1018573.000000 [14:22:42] FC 0/15 [fsw2-n1-oe16-esams] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [14:22:42] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 39606 MB (6% inode=99%): [14:22:42] wikidata replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 355490.000000 [14:22:42] Environment IPMI on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [14:22:42] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [14:22:43] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A: [14:22:52] SMF on web.amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [14:22:52] APT on z-dat-s2-b is WARNING: APT WARNING: 34 packages available for upgrade (0 critical updates). [14:22:52] APT on z-dat-s1-b is WARNING: APT WARNING: 35 packages available for upgrade (0 critical updates). [14:23:02] FC 0/10 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [14:23:02] FC 0/2 [hemlock] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [14:23:02] FC 0/19 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [14:23:12] SMF on amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [14:23:12] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 2207319.000000 [14:23:12] APT on yarrow is WARNING: APT WARNING: 67 packages available for upgrade (0 critical updates). [14:23:21] FC 0/21 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [14:23:22] FC 0/22 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [14:23:22] FC 0/13 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [14:23:22] FC 0/12 [thyme] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [14:23:32] / on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [14:23:32] APT on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [14:23:32] NTP on amaranth is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:23:32] SMTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:23:32] SMTP on z-dat-s1-b is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:23:33] SMTP on z-dat-s5-b is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:23:33] eth0 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [14:23:34] FC 0/14 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [14:23:34] FC 0/23 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [14:23:35] wikidata replag on z-dat-s7-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 526824.000000 [14:23:35] wikidata replag on z-dat-s2-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1315070.000000 [14:23:36] SSH on mayapple is CRITICAL: Server answer: [14:23:52] SMTP on sage is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:23:52] FC 0/17 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [14:23:53] FC 0/5 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [14:24:32] Sun Grid Engine execd on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [14:24:42] FC 0/4 [hyacinth] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [14:24:42] /tmp on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [14:24:53] wikidata replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1370820.000000 [14:24:53] APT on yucca is WARNING: APT WARNING: 39 packages available for upgrade (0 critical updates). [14:24:53] SMTP on nightshade is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:24:53] FC 0/0 [SAN far1-n1-oe16-esams A1] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [14:25:02] SRaid on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [14:25:02] FC 0/1 [far1-n1-oe16-esams B1] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [14:25:02] FC 0/6 [rosemary] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [14:25:02] FC 0/8 [adenia] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [14:25:03] APT on sage is WARNING: APT WARNING: 34 packages available for upgrade (0 critical updates). [14:25:11] FC 0/18 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [14:25:31] Sensors on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [14:25:42] FC 0/3 [cassia] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [14:25:42] FC 0/16 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [14:28:03] Environment IPMI on thyme is UNKNOWN: NRPE: Unable to read output [14:28:31] wikidata replag on z-dat-s5-b is CRITICAL: (Service Check Timed Out) [14:29:02] MySQL slave on z-dat-s1-b is CRITICAL: (Return code of 139 is out of bounds) [14:30:11] Load avg. on thyme is UNKNOWN: NRPE: Unable to read output [14:30:31] FMA on thyme is CRITICAL: ERROR - unexpected output from snmpwalk [14:31:02] MySQL slave on z-dat-s2-b is CRITICAL: (Return code of 139 is out of bounds) [14:31:52] /mnt on thyme is UNKNOWN: NRPE: Unable to read output [14:31:52] s1 replag on thyme is CRITICAL: QUERY CRITICAL: Cant connect to MySQL server on thyme (146) [14:31:52] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [14:31:52] /tmp on thyme is UNKNOWN: NRPE: Unable to read output [14:31:52] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 295520 MB (5% inode=64%): [14:32:02] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [14:37:12] APT on nightshade is WARNING: APT WARNING: 67 packages available for upgrade (0 critical updates). [14:39:43] APT on nightshade is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [14:40:12] APT on nightshade is WARNING: APT WARNING: 67 packages available for upgrade (0 critical updates). [14:43:22] Load avg. on nightshade is WARNING: WARNING - load average: 19.42, 17.66, 10.54 [14:43:32] /sql on z-dat-s1-b is CRITICAL: DISK CRITICAL - free space: /sql 56273 MB (5% inode=99%): [14:47:22] Load avg. on nightshade is OK: OK - load average: 5.06, 13.29, 10.60 [15:01:11] aliasd on yarrow is CRITICAL: Connection refused [15:21:42] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [15:21:52] Load avg. on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [15:21:52] Load avg. on amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [15:22:02] MySQL slave on z-dat-s5-b is CRITICAL: (Return code of 139 is out of bounds) [15:22:21] FMA on amaranth is CRITICAL: ERROR - unexpected output from snmpwalk [15:22:22] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [15:22:22] NTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:22:22] FC 0/11 [fsw2-n1-oe16-esams] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [15:22:22] FC 0/20 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [15:22:22] FC 0/9 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [15:22:42] s4 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1022174.000000 [15:22:42] FC 0/15 [fsw2-n1-oe16-esams] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [15:22:42] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 39333 MB (6% inode=99%): [15:22:42] wikidata replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 355489.000000 [15:22:42] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [15:22:43] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [15:22:43] Environment IPMI on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [15:22:52] SMF on web.amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [15:22:52] APT on z-dat-s2-b is WARNING: APT WARNING: 34 packages available for upgrade (0 critical updates). [15:22:52] APT on z-dat-s1-b is WARNING: APT WARNING: 35 packages available for upgrade (0 critical updates). [15:23:02] FC 0/7 [daphne] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [15:23:02] FC 0/10 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [15:23:02] FC 0/2 [hemlock] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [15:23:12] FC 0/19 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [15:23:12] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 2210473.000000 [15:23:12] APT on yarrow is WARNING: APT WARNING: 67 packages available for upgrade (0 critical updates). [15:23:12] SMF on amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [15:23:22] FC 0/21 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [15:23:22] FC 0/13 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [15:23:22] FC 0/22 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [15:23:22] FC 0/12 [thyme] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [15:23:31] NTP on amaranth is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:23:31] SMTP on z-dat-s1-b is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:23:31] / on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [15:23:31] APT on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [15:23:32] SMTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:23:32] SMTP on z-dat-s5-b is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:23:32] eth0 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [15:23:33] FC 0/14 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [15:23:42] SMTP on mayapple is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:23:52] aliasd on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [15:23:52] SMTP on sage is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:23:53] FC 0/17 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [15:23:53] FC 0/5 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [15:24:32] FC 0/23 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [15:24:32] Sun Grid Engine execd on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [15:24:32] wikidata replag on z-dat-s7-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 526413.000000 [15:24:32] wikidata replag on z-dat-s2-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1312971.000000 [15:24:32] RAID on thyme is UNKNOWN: NRPE: Unable to read output [15:24:33] SSH on mayapple is CRITICAL: Server answer: [15:24:33] wikidata replag on z-dat-s6-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 752961.000000 [15:24:42] FC 0/4 [hyacinth] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [15:24:42] / on thyme is UNKNOWN: NRPE: Unable to read output [15:24:42] /tmp on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [15:24:52] wikidata replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1370017.000000 [15:24:53] APT on yucca is WARNING: APT WARNING: 39 packages available for upgrade (0 critical updates). [15:24:53] SMTP on nightshade is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:24:53] FC 0/0 [SAN far1-n1-oe16-esams A1] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [15:25:02] SRaid on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [15:25:11] APT on sage is WARNING: APT WARNING: 34 packages available for upgrade (0 critical updates). [15:25:11] FC 0/6 [rosemary] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [15:25:12] FC 0/18 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [15:25:31] Sensors on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [15:25:41] FC 0/3 [cassia] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [15:26:02] FC 0/1 [far1-n1-oe16-esams B1] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [15:26:03] FC 0/8 [adenia] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [15:26:42] FC 0/16 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [15:28:02] Environment IPMI on thyme is UNKNOWN: NRPE: Unable to read output [15:29:12] wikidata replag on z-dat-s5-b is CRITICAL: (Service Check Timed Out) [15:30:02] MySQL slave on z-dat-s1-b is CRITICAL: (Return code of 139 is out of bounds) [15:30:11] Load avg. on thyme is UNKNOWN: NRPE: Unable to read output [15:30:31] FMA on thyme is CRITICAL: ERROR - unexpected output from snmpwalk [15:31:03] MySQL slave on z-dat-s2-b is CRITICAL: (Return code of 139 is out of bounds) [15:31:52] /mnt on thyme is UNKNOWN: NRPE: Unable to read output [15:31:52] s1 replag on thyme is CRITICAL: QUERY CRITICAL: Cant connect to MySQL server on thyme (146) [15:31:52] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [15:31:52] /tmp on thyme is UNKNOWN: NRPE: Unable to read output [15:31:52] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 295220 MB (5% inode=64%): [15:32:02] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [15:39:42] APT on nightshade is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [15:40:12] aliasd on nightshade is CRITICAL: Connection refused [15:40:12] APT on nightshade is WARNING: APT WARNING: 67 packages available for upgrade (0 critical updates). [15:40:12] aliasd on yarrow is OK: TCP OK - 0.002 second response time on port 984 [500 Not found.] [16:21:42] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [16:21:52] Load avg. on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [16:22:02] MySQL slave on z-dat-s5-b is CRITICAL: (Return code of 139 is out of bounds) [16:22:32] FC 0/20 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [16:22:42] s4 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1025775.000000 [16:22:42] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 39094 MB (6% inode=99%): [16:22:42] FC 0/15 [fsw2-n1-oe16-esams] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [16:22:42] wikidata replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 354580.000000 [16:22:42] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [16:22:43] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A: [16:22:52] Environment IPMI on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [16:22:52] Load avg. on amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [16:22:52] SMF on web.amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [16:22:52] APT on z-dat-s2-b is WARNING: APT WARNING: 34 packages available for upgrade (0 critical updates). [16:22:52] APT on z-dat-s1-b is WARNING: APT WARNING: 35 packages available for upgrade (0 critical updates). [16:23:02] FC 0/7 [daphne] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [16:23:02] FC 0/10 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [16:23:02] FC 0/2 [hemlock] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [16:23:11] FC 0/19 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [16:23:11] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 2213598.000000 [16:23:12] APT on yarrow is WARNING: APT WARNING: 67 packages available for upgrade (0 critical updates). [16:23:21] FMA on amaranth is CRITICAL: ERROR - unexpected output from snmpwalk [16:23:21] SMF on amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [16:23:21] NTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:23:21] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [16:23:22] FC 0/21 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [16:23:22] FC 0/11 [fsw2-n1-oe16-esams] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [16:23:22] FC 0/9 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [16:23:31] FC 0/13 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [16:23:32] FC 0/12 [thyme] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [16:23:32] FC 0/22 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [16:23:32] APT on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [16:23:32] / on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [16:23:33] NTP on amaranth is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:23:33] SMTP on z-dat-s1-b is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:23:33] SMTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:23:33] SMTP on z-dat-s5-b is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:23:34] FC 0/14 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [16:23:34] eth0 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [16:23:42] SMTP on mayapple is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:24:03] SMTP on sage is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:24:03] FC 0/5 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [16:24:03] FC 0/17 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [16:24:31] Sun Grid Engine execd on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [16:24:32] FC 0/23 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [16:24:32] wikidata replag on z-dat-s2-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1311740.000000 [16:24:32] RAID on thyme is UNKNOWN: NRPE: Unable to read output [16:24:32] wikidata replag on z-dat-s7-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 524665.000000 [16:24:32] SSH on mayapple is CRITICAL: Server answer: [16:24:33] wikidata replag on z-dat-s6-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 750705.000000 [16:24:42] FC 0/4 [hyacinth] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [16:24:42] / on thyme is UNKNOWN: NRPE: Unable to read output [16:24:52] wikidata replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1369773.000000 [16:24:52] /tmp on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [16:24:52] aliasd on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [16:24:52] APT on yucca is WARNING: APT WARNING: 39 packages available for upgrade (0 critical updates). [16:24:52] SMTP on nightshade is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:25:02] SRaid on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [16:25:02] FC 0/0 [SAN far1-n1-oe16-esams A1] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [16:25:11] APT on sage is WARNING: APT WARNING: 34 packages available for upgrade (0 critical updates). [16:25:12] FC 0/6 [rosemary] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [16:25:12] FC 0/18 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [16:25:32] Sensors on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [16:25:43] FC 0/3 [cassia] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [16:26:02] FC 0/1 [far1-n1-oe16-esams B1] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [16:26:03] FC 0/8 [adenia] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [16:26:42] FC 0/16 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [16:28:02] Environment IPMI on thyme is UNKNOWN: NRPE: Unable to read output [16:29:52] wikidata replag on z-dat-s5-b is CRITICAL: (Service Check Timed Out) [16:30:02] MySQL slave on z-dat-s1-b is CRITICAL: (Return code of 139 is out of bounds) [16:30:11] Load avg. on thyme is UNKNOWN: NRPE: Unable to read output [16:30:32] FMA on thyme is CRITICAL: ERROR - unexpected output from snmpwalk [16:31:02] MySQL slave on z-dat-s2-b is CRITICAL: (Return code of 139 is out of bounds) [16:31:52] /mnt on thyme is UNKNOWN: NRPE: Unable to read output [16:31:52] s1 replag on thyme is CRITICAL: QUERY CRITICAL: Cant connect to MySQL server on thyme (146) [16:32:01] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [16:32:52] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [16:32:52] /tmp on thyme is UNKNOWN: NRPE: Unable to read output [16:32:52] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 294569 MB (5% inode=64%): [16:40:11] APT on nightshade is WARNING: APT WARNING: 67 packages available for upgrade (0 critical updates). [16:41:02] aliasd on nightshade is CRITICAL: Connection refused [16:43:31] /sql on z-dat-s1-b is WARNING: DISK WARNING - free space: /sql 71374 MB (7% inode=99%): [16:56:42] toolserver.org HTTP on ortelius is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:21:42] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [17:21:53] Load avg. on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [17:22:02] MySQL slave on z-dat-s5-b is CRITICAL: (Return code of 139 is out of bounds) [17:22:32] FC 0/20 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [17:22:41] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 38830 MB (6% inode=99%): [17:22:41] s4 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1029375.000000 [17:22:41] FC 0/15 [fsw2-n1-oe16-esams] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [17:22:41] wikidata replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 353409.000000 [17:22:52] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A: [17:22:52] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [17:22:52] Load avg. on amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [17:22:52] SMF on web.amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [17:22:53] Environment IPMI on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [17:22:53] APT on z-dat-s2-b is WARNING: APT WARNING: 34 packages available for upgrade (0 critical updates). [17:22:53] APT on z-dat-s1-b is WARNING: APT WARNING: 35 packages available for upgrade (0 critical updates). [17:23:12] FC 0/7 [daphne] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [17:23:12] FC 0/19 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [17:23:12] FC 0/10 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [17:23:13] FC 0/2 [hemlock] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [17:23:13] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 2216875.000000 [17:23:13] APT on yarrow is WARNING: APT WARNING: 67 packages available for upgrade (0 critical updates). [17:23:21] FMA on amaranth is CRITICAL: ERROR - unexpected output from snmpwalk [17:23:32] NTP on amaranth is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:23:32] SMTP on z-dat-s1-b is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:23:33] SMTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:23:33] SMTP on z-dat-s5-b is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:23:33] FC 0/9 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [17:23:33] FC 0/13 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [17:23:33] FC 0/12 [thyme] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [17:23:34] FC 0/14 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [17:23:34] FC 0/22 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [17:23:35] eth0 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [17:23:35] SMF on amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [17:23:36] / on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [17:23:36] APT on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [17:24:12] SMTP on sage is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:24:12] FC 0/5 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [17:24:12] FC 0/17 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [17:24:21] NTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:24:21] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [17:24:21] FC 0/21 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [17:24:21] FC 0/11 [fsw2-n1-oe16-esams] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [17:24:32] FC 0/23 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [17:24:32] Sun Grid Engine execd on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [17:24:32] RAID on thyme is UNKNOWN: NRPE: Unable to read output [17:24:32] SSH on mayapple is CRITICAL: Server answer: [17:24:32] wikidata replag on z-dat-s2-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1309895.000000 [17:24:33] wikidata replag on z-dat-s6-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 747429.000000 [17:24:33] wikidata replag on z-dat-s7-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 523187.000000 [17:24:42] SMTP on mayapple is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:24:42] FC 0/4 [hyacinth] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [17:24:53] wikidata replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1369714.000000 [17:24:53] /tmp on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [17:24:53] aliasd on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [17:24:53] APT on yucca is WARNING: APT WARNING: 39 packages available for upgrade (0 critical updates). [17:25:03] SRaid on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [17:25:12] SMTP on nightshade is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:25:13] FC 0/0 [SAN far1-n1-oe16-esams A1] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [17:25:13] FC 0/18 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [17:25:13] FC 0/6 [rosemary] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [17:25:32] Sensors on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [17:25:42] / on thyme is UNKNOWN: NRPE: Unable to read output [17:26:02] APT on sage is WARNING: APT WARNING: 34 packages available for upgrade (0 critical updates). [17:26:12] FC 0/1 [far1-n1-oe16-esams B1] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [17:26:12] FC 0/8 [adenia] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [17:26:42] FC 0/3 [cassia] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [17:26:42] FC 0/16 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [17:28:02] Environment IPMI on thyme is UNKNOWN: NRPE: Unable to read output [17:30:02] MySQL slave on z-dat-s1-b is CRITICAL: (Return code of 139 is out of bounds) [17:30:13] Load avg. on thyme is UNKNOWN: NRPE: Unable to read output [17:30:33] FMA on thyme is CRITICAL: ERROR - unexpected output from snmpwalk [17:30:33] wikidata replag on z-dat-s5-b is CRITICAL: (Service Check Timed Out) [17:31:02] MySQL slave on z-dat-s2-b is CRITICAL: (Return code of 139 is out of bounds) [17:31:52] /mnt on thyme is UNKNOWN: NRPE: Unable to read output [17:31:53] s1 replag on thyme is CRITICAL: QUERY CRITICAL: Cant connect to MySQL server on thyme (146) [17:32:02] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [17:32:52] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [17:32:52] /tmp on thyme is UNKNOWN: NRPE: Unable to read output [17:32:52] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 294361 MB (5% inode=64%): [17:40:11] APT on nightshade is WARNING: APT WARNING: 67 packages available for upgrade (0 critical updates). [17:41:02] aliasd on nightshade is CRITICAL: Connection refused [17:57:42] toolserver.org HTTP on ortelius is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:06:32] toolserver.org HTTP on ortelius is OK: HTTP OK: HTTP/1.1 200 OK - 239 bytes in 0.188 second response time [18:21:48] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [18:21:53] Load avg. on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [18:22:03] MySQL slave on z-dat-s5-b is CRITICAL: (Return code of 139 is out of bounds) [18:22:32] FC 0/20 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [18:22:41] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 38514 MB (6% inode=99%): [18:22:41] s4 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1032975.000000 [18:22:42] FC 0/15 [fsw2-n1-oe16-esams] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [18:22:42] wikidata replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 352654.000000 [18:22:53] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A: [18:22:53] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [18:22:54] SMF on web.amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [18:22:54] Load avg. on amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [18:22:54] Environment IPMI on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [18:22:54] APT on z-dat-s2-b is WARNING: APT WARNING: 34 packages available for upgrade (0 critical updates). [18:22:54] APT on z-dat-s1-b is WARNING: APT WARNING: 35 packages available for upgrade (0 critical updates). [18:23:12] FC 0/10 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [18:23:12] FC 0/19 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [18:23:12] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 2220126.000000 [18:23:21] FC 0/7 [daphne] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [18:23:21] FC 0/2 [hemlock] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [18:23:32] FMA on amaranth is CRITICAL: ERROR - unexpected output from snmpwalk [18:23:32] SMTP on z-dat-s1-b is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:23:32] NTP on amaranth is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:23:33] SMTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:23:33] FC 0/14 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [18:23:33] FC 0/13 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [18:23:33] FC 0/22 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [18:23:34] eth0 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [18:23:34] FC 0/9 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [18:23:35] FC 0/12 [thyme] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [18:23:41] APT on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [18:23:42] SMF on amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [18:23:42] / on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [18:24:12] SMTP on sage is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:24:12] FC 0/5 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [18:24:21] APT on yarrow is WARNING: APT WARNING: 67 packages available for upgrade (0 critical updates). [18:24:21] FC 0/17 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [18:24:21] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [18:24:31] NTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:24:32] SMTP on z-dat-s5-b is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:24:32] FC 0/21 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [18:24:32] FC 0/11 [fsw2-n1-oe16-esams] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [18:24:33] FC 0/23 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [18:24:33] RAID on thyme is UNKNOWN: NRPE: Unable to read output [18:24:33] SSH on mayapple is CRITICAL: Server answer: [18:24:33] wikidata replag on z-dat-s2-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1310145.000000 [18:24:33] wikidata replag on z-dat-s6-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 740315.000000 [18:24:34] wikidata replag on z-dat-s7-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 522763.000000 [18:24:42] Sun Grid Engine execd on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [18:24:42] SMTP on mayapple is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:24:42] FC 0/4 [hyacinth] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [18:24:53] wikidata replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1368612.000000 [18:24:53] aliasd on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [18:24:53] /tmp on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [18:24:53] APT on yucca is WARNING: APT WARNING: 39 packages available for upgrade (0 critical updates). [18:25:03] SRaid on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [18:25:12] SMTP on nightshade is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:25:12] FC 0/18 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [18:25:12] FC 0/0 [SAN far1-n1-oe16-esams A1] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [18:25:41] Sensors on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [18:25:41] / on thyme is UNKNOWN: NRPE: Unable to read output [18:26:12] APT on sage is WARNING: APT WARNING: 34 packages available for upgrade (0 critical updates). [18:26:12] FC 0/1 [far1-n1-oe16-esams B1] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [18:26:13] FC 0/6 [rosemary] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [18:26:21] FC 0/8 [adenia] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [18:26:42] FC 0/3 [cassia] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [18:26:42] FC 0/16 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [18:29:03] Environment IPMI on thyme is UNKNOWN: NRPE: Unable to read output [18:30:02] MySQL slave on z-dat-s1-b is CRITICAL: (Return code of 139 is out of bounds) [18:31:02] MySQL slave on z-dat-s2-b is CRITICAL: (Return code of 139 is out of bounds) [18:31:11] wikidata replag on z-dat-s5-b is CRITICAL: (Service Check Timed Out) [18:31:11] Load avg. on thyme is UNKNOWN: NRPE: Unable to read output [18:31:32] FMA on thyme is CRITICAL: ERROR - unexpected output from snmpwalk [18:31:53] /mnt on thyme is UNKNOWN: NRPE: Unable to read output [18:31:53] s1 replag on thyme is CRITICAL: QUERY CRITICAL: Cant connect to MySQL server on thyme (146) [18:32:02] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [18:32:52] /tmp on thyme is UNKNOWN: NRPE: Unable to read output [18:32:52] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 293934 MB (5% inode=64%): [18:33:02] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [18:35:42] APT on nightshade is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [18:35:52] @replag [18:35:53] Betacommand: s1-rr-a: 13h 53m 24s [+1.00 s/s]; s1-rr-a-wd: 1w 4d 3h 37m 53s [+0.10 s/s]; s1-user-c: 1w 4d 23h 9m 34s [+1.00 s/s]; s1-user-wd: 2w 1d 20h 4m 6s [-0.13 s/s]; s2-rr: 13h 54m 19s [+1.00 s/s]; s2-user: 13h 54m 19s [+1.00 s/s]; s2-user-c: error; s2-user-wd: 2w 1d 3h 58m 1s [-0.35 s/s] [18:35:54] Betacommand: s3-user: 19s [-]; s3-user-wd: 1w 1d 20h 54m 50s [-0.38 s/s]; s4-user-wd: 3w 4d 16h 54m 12s [+0.90 s/s]; s5-rr-a: 24m 23s [-]; s5-rr-a-wd: 4d 1h 59m 19s [-0.08 s/s]; s5-user: 14h 21s [+1.00 s/s]; s6-user-wd: 1w 1d 13h 16m 29s [-0.84 s/s]; s7-user-wd: 6d 1h 11m 24s [-0.23 s/s] [18:36:12] APT on nightshade is WARNING: APT WARNING: 67 packages available for upgrade (0 critical updates). [18:41:02] aliasd on nightshade is CRITICAL: Connection refused [18:43:21] Load avg. on nightshade is WARNING: WARNING - load average: 16.22, 20.96, 12.71 [18:44:12] toolserver.org HTTP on wolfsbane is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:46:21] Load avg. on nightshade is OK: OK - load average: 3.93, 12.90, 11.02 [18:51:31] s5 replag on cassia is WARNING: QUERY WARNING: SELECT ts_rc_age() returned 2028.000000 [19:01:18] Is the code for tsbot available somewhere? [19:07:59] Anyone in? [19:08:04] I have a little problem [19:08:29] Qcoder00: just state your issue [19:09:21] I need to identify articles which I edited as Sfan00_IMG where I removed or re-factored a link of the pattern *.google.* or googleid= and where the link concerned was not re-instated [19:10:16] Qcoder00: if you email me the information with exact details and time frames I can look it up [19:10:26] I did [19:10:34] You hadn't responded [19:10:55] you sent me a vague half baked email with almost no information [19:11:20] What additional information is needed? [19:14:53] Qcoder00: you sent me http://pastebin.com/1vz7R3Ts [19:15:19] OK... I'm writing a more detailed query now.. [19:16:30] http://pastebin.com/4ySjnWU4 was the previous request which had more details [19:17:32] best thing to include: when did it start, end? user_id and what Im looking for [19:18:01] and be specific in regards to what you are looking for [19:18:57] Fuller query sent [19:19:26] Username Start date, end date, Text to look for in diff.... [19:19:53] Sun Grid Engine execd on ortelius is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [19:19:53] Qcoder00: when making requests I shouldnt need to ask for more details [19:20:08] Noted [19:20:24] I'm not even sure it's possible to search in diffs [19:20:32] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [19:20:43] I.e find a specfic removed text string in a diff though [19:20:46] Qcoder00: I am a programmer, nothing is impossible [19:21:42] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [19:21:44] Qcoder00: Ive had a functional AI in operation almost continuously since 2007 [19:21:53] Load avg. on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [19:22:14] Betacommand: Are you allowed to do NFUR enforcement at the moment? [19:22:27] Qcoder00: I cant edit [19:22:32] FC 0/20 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [19:22:41] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 38196 MB (6% inode=99%): [19:22:42] s4 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1036575.000000 [19:22:42] FC 0/15 [fsw2-n1-oe16-esams] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [19:22:42] wikidata replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 353348.000000 [19:22:46] OK [19:22:53] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A: [19:22:53] Load avg. on amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [19:22:53] SMF on web.amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [19:22:53] Environment IPMI on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [19:23:02] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [19:23:02] MySQL slave on z-dat-s5-b is CRITICAL: (Return code of 139 is out of bounds) [19:23:02] aliasd on nightshade is OK: TCP OK - 0.005 second response time on port 984 [500 Not found.] [19:23:12] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 2223425.000000 [19:23:22] FC 0/19 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [19:23:22] FC 0/7 [daphne] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [19:23:22] FC 0/2 [hemlock] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [19:23:22] FC 0/10 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [19:23:22] The issue I am finding relates to NFCC #1,#2 which on a LARGE number of images are seemingly stated as n.a [19:23:32] FMA on amaranth is CRITICAL: ERROR - unexpected output from snmpwalk [19:23:32] SMTP on z-dat-s1-b is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:23:32] Sun Grid Engine execd on wolfsbane is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [19:23:52] APT on z-dat-s2-b is WARNING: APT WARNING: 34 packages available for upgrade (0 critical updates). [19:23:52] APT on z-dat-s1-b is WARNING: APT WARNING: 35 packages available for upgrade (0 critical updates). [19:24:02] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [19:24:12] SMTP on sage is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:24:12] FC 0/5 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [19:24:21] APT on yarrow is WARNING: APT WARNING: 67 packages available for upgrade (0 critical updates). [19:24:22] FC 0/17 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [19:24:32] NTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:24:32] SMTP on z-dat-s5-b is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:24:33] NTP on amaranth is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:24:33] SMTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:24:33] FC 0/23 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [19:24:33] eth0 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [19:24:33] FC 0/22 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [19:24:33] FC 0/13 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [19:24:33] FC 0/21 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [19:24:34] FC 0/11 [fsw2-n1-oe16-esams] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [19:24:34] FC 0/12 [thyme] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [19:24:35] FC 0/14 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [19:24:52] /tmp on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [19:24:53] APT on yucca is WARNING: APT WARNING: 39 packages available for upgrade (0 critical updates). [19:24:53] aliasd on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [19:25:02] SRaid on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [19:25:12] SMTP on nightshade is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:25:21] FC 0/18 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [19:25:21] FC 0/0 [SAN far1-n1-oe16-esams A1] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [19:25:41] Sensors on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [19:25:41] / on thyme is UNKNOWN: NRPE: Unable to read output [19:25:52] wikidata replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1366256.000000 [19:26:13] APT on sage is WARNING: APT WARNING: 34 packages available for upgrade (0 critical updates). [19:26:13] FC 0/1 [far1-n1-oe16-esams B1] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [19:26:22] FC 0/8 [adenia] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [19:26:22] FC 0/6 [rosemary] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [19:26:42] FC 0/16 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [19:26:42] FC 0/3 [cassia] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [19:30:02] MySQL slave on z-dat-s1-b is CRITICAL: (Return code of 139 is out of bounds) [19:30:02] Environment IPMI on thyme is UNKNOWN: NRPE: Unable to read output [19:31:01] MySQL slave on z-dat-s2-b is CRITICAL: (Return code of 139 is out of bounds) [19:31:11] Load avg. on thyme is UNKNOWN: NRPE: Unable to read output [19:31:32] FMA on thyme is CRITICAL: ERROR - unexpected output from snmpwalk [19:31:52] wikidata replag on z-dat-s5-b is CRITICAL: (Service Check Timed Out) [19:32:51] /mnt on thyme is UNKNOWN: NRPE: Unable to read output [19:32:52] s1 replag on thyme is CRITICAL: QUERY CRITICAL: Cant connect to MySQL server on thyme (146) [19:33:02] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [19:33:02] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 293666 MB (5% inode=64%): [19:33:52] /tmp on thyme is UNKNOWN: NRPE: Unable to read output [19:34:32] s5 replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 3610.000000 [19:35:42] APT on nightshade is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [19:37:12] APT on nightshade is WARNING: APT WARNING: 67 packages available for upgrade (0 critical updates). [19:40:22] Sun Grid Engine execd on nightshade is UNKNOWN: Execution timeout exceeded [19:40:57] Why our INSERTs gone up and SELECTs down since Feb? http://munin.toolserver.org/Database/Summary/queries.html [19:41:21] Load avg. on nightshade is CRITICAL: CRITICAL - load average: 30.45, 20.70, 11.70 [19:41:31] Sun Grid Engine execd on nightshade is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [19:42:32] Sun Grid Engine execd on nightshade is UNKNOWN: Execution timeout exceeded [19:44:21] toolserver.org HTTP on wolfsbane is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:46:59] What timeframe is that anyway? 345 per second, per minute, per hour? [19:49:12] toolserver.org HTTP on wolfsbane is OK: HTTP OK: HTTP/1.1 200 OK - 239 bytes in 0.014 second response time [19:49:46] APT on nightshade is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [19:59:22] Load avg. on nightshade is WARNING: WARNING - load average: 3.09, 13.60, 19.62 [20:05:23] Load avg. on nightshade is OK: OK - load average: 2.33, 5.97, 14.20 [20:05:39] [[Special:Log/newusers]] create 10 * DONALD HUBBARD * (New user account) [20:09:12] APT on nightshade is WARNING: APT WARNING: 67 packages available for upgrade (0 critical updates). [20:11:21] / on ortelius is WARNING: DISK WARNING - free space: / 6241 MB (20% inode=92%): [20:17:22] toolserver.org HTTP on wolfsbane is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:20:32] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [20:21:53] Load avg. on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [20:22:36] FC 0/20 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [20:22:53] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A: [20:22:53] SMF on web.amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [20:22:53] Load avg. on amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [20:22:53] Environment IPMI on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [20:23:12] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 2226514.000000 [20:23:32] FMA on amaranth is CRITICAL: ERROR - unexpected output from snmpwalk [20:23:32] SMTP on z-dat-s1-b is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:23:40] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 37896 MB (6% inode=99%): [20:23:40] s4 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1040235.000000 [20:23:40] FC 0/15 [fsw2-n1-oe16-esams] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [20:23:41] wikidata replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 354292.000000 [20:23:53] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [20:23:54] APT on z-dat-s2-b is WARNING: APT WARNING: 34 packages available for upgrade (0 critical updates). [20:23:54] APT on z-dat-s1-b is WARNING: APT WARNING: 35 packages available for upgrade (0 critical updates). [20:24:02] MySQL slave on z-dat-s5-b is CRITICAL: (Return code of 139 is out of bounds) [20:24:02] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [20:24:22] APT on yarrow is WARNING: APT WARNING: 67 packages available for upgrade (0 critical updates). [20:24:22] SMTP on sage is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:24:22] FC 0/17 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [20:24:22] FC 0/19 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [20:24:22] FC 0/7 [daphne] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [20:24:23] FC 0/5 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [20:24:23] FC 0/2 [hemlock] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [20:24:24] FC 0/10 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [20:24:33] NTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:24:33] SMTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:24:33] SMTP on z-dat-s5-b is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:24:33] NTP on amaranth is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:24:33] eth0 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [20:24:34] FC 0/12 [thyme] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [20:24:34] FC 0/22 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [20:24:35] FC 0/9 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [20:24:35] FC 0/13 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [20:24:36] FC 0/23 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [20:24:36] FC 0/14 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [20:24:37] FC 0/11 [fsw2-n1-oe16-esams] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [20:24:53] / on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [20:24:53] APT on yucca is WARNING: APT WARNING: 39 packages available for upgrade (0 critical updates). [20:24:53] /tmp on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [20:24:54] aliasd on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [20:25:21] SMTP on nightshade is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:25:21] FC 0/0 [SAN far1-n1-oe16-esams A1] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [20:25:22] FC 0/18 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [20:25:40] SMTP on mayapple is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:25:41] FC 0/4 [hyacinth] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [20:25:41] SMF on amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [20:25:41] APT on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [20:25:41] Sun Grid Engine execd on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [20:25:54] / on thyme is UNKNOWN: NRPE: Unable to read output [20:25:54] wikidata replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1364121.000000 [20:25:54] Sensors on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [20:26:01] SRaid on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [20:26:13] APT on sage is WARNING: APT WARNING: 34 packages available for upgrade (0 critical updates). [20:26:22] FC 0/6 [rosemary] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [20:26:22] FC 0/1 [far1-n1-oe16-esams B1] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [20:26:22] FC 0/8 [adenia] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [20:27:40] FC 0/3 [cassia] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [20:27:40] FC 0/16 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [20:31:01] MySQL slave on z-dat-s1-b is CRITICAL: (Return code of 139 is out of bounds) [20:31:01] Environment IPMI on thyme is UNKNOWN: NRPE: Unable to read output [20:31:12] Load avg. on thyme is UNKNOWN: NRPE: Unable to read output [20:31:32] FMA on thyme is CRITICAL: ERROR - unexpected output from snmpwalk [20:32:01] MySQL slave on z-dat-s2-b is CRITICAL: (Return code of 139 is out of bounds) [20:32:32] wikidata replag on z-dat-s5-b is CRITICAL: (Service Check Timed Out) [20:32:53] /mnt on thyme is UNKNOWN: NRPE: Unable to read output [20:32:53] s1 replag on thyme is CRITICAL: QUERY CRITICAL: Cant connect to MySQL server on thyme (146) [20:33:54] /tmp on thyme is UNKNOWN: NRPE: Unable to read output [20:34:01] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 293260 MB (5% inode=64%): [20:34:02] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [20:34:33] s5 replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 5753.000000 [20:35:40] APT on nightshade is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [20:36:13] APT on nightshade is WARNING: APT WARNING: 67 packages available for upgrade (0 critical updates). [20:40:22] Sun Grid Engine execd on nightshade is UNKNOWN: Execution timeout exceeded [20:41:32] Sun Grid Engine execd on nightshade is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [20:41:40] APT on nightshade is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [20:41:40] Load avg. on nightshade is WARNING: WARNING - load average: 29.03, 21.92, 13.20 [20:42:54] Load avg. on nightshade is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [20:44:34] Sun Grid Engine execd on nightshade is OK: Host and Queues Ok [20:46:22] Load avg. on nightshade is WARNING: WARNING - load average: 8.92, 22.23, 16.40 [20:50:48] Merlissimo: Do you have permissions to look at the mail log on yarrow? [20:51:41] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [21:01:11] APT on nightshade is WARNING: APT WARNING: 67 packages available for upgrade (0 critical updates). [21:11:21] / on ortelius is WARNING: DISK WARNING - free space: / 5779 MB (19% inode=92%): [21:14:22] / on hemlock is WARNING: DISK WARNING - free space: / 4193 MB (20% inode=88%): [21:14:40] /tmp on hemlock is WARNING: DISK WARNING - free space: / 4193 MB (20% inode=88%): [21:17:22] toolserver.org HTTP on wolfsbane is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:20:33] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [21:21:53] Load avg. on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [21:22:32] FC 0/20 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [21:22:53] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A: [21:22:53] SMF on web.amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [21:22:53] Load avg. on amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [21:22:53] Environment IPMI on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [21:23:21] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 2229567.000000 [21:23:41] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 37639 MB (6% inode=99%): [21:23:41] FC 0/15 [fsw2-n1-oe16-esams] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [21:23:41] s4 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1043836.000000 [21:23:41] wikidata replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 354083.000000 [21:23:54] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [21:23:54] APT on z-dat-s2-b is WARNING: APT WARNING: 34 packages available for upgrade (0 critical updates). [21:23:54] APT on z-dat-s1-b is WARNING: APT WARNING: 35 packages available for upgrade (0 critical updates). [21:24:22] APT on yarrow is WARNING: APT WARNING: 67 packages available for upgrade (0 critical updates). [21:24:22] SMTP on sage is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:24:22] FC 0/5 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [21:24:22] FC 0/19 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [21:24:22] FC 0/10 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [21:24:23] FC 0/17 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [21:24:23] FC 0/2 [hemlock] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [21:24:24] FC 0/7 [daphne] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [21:24:32] FMA on amaranth is CRITICAL: ERROR - unexpected output from snmpwalk [21:24:32] NTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:24:32] SMTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:24:32] SMTP on z-dat-s1-b is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:24:33] SMTP on z-dat-s5-b is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:24:33] NTP on amaranth is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:24:33] FC 0/9 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [21:24:34] eth0 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [21:24:34] FC 0/22 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [21:24:35] FC 0/12 [thyme] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [21:24:35] FC 0/14 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [21:24:36] FC 0/13 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [21:24:53] / on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [21:24:53] APT on yucca is WARNING: APT WARNING: 39 packages available for upgrade (0 critical updates). [21:24:53] /tmp on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [21:24:54] aliasd on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [21:25:01] MySQL slave on z-dat-s5-b is CRITICAL: (Return code of 139 is out of bounds) [21:25:02] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [21:25:22] SMTP on nightshade is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:25:22] FC 0/0 [SAN far1-n1-oe16-esams A1] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [21:25:22] FC 0/18 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [21:25:33] FC 0/11 [fsw2-n1-oe16-esams] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [21:25:54] / on thyme is UNKNOWN: NRPE: Unable to read output [21:25:54] wikidata replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1361209.000000 [21:25:54] Sensors on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [21:26:01] SRaid on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [21:26:22] FC 0/6 [rosemary] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [21:26:22] FC 0/1 [far1-n1-oe16-esams B1] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [21:26:22] FC 0/8 [adenia] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [21:26:40] SMTP on mayapple is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:26:40] FC 0/4 [hyacinth] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [21:26:40] SMF on amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [21:26:40] Sun Grid Engine execd on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [21:26:41] APT on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [21:27:12] APT on sage is WARNING: APT WARNING: 34 packages available for upgrade (0 critical updates). [21:27:40] FC 0/16 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [21:27:40] FC 0/3 [cassia] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [21:31:01] MySQL slave on z-dat-s1-b is CRITICAL: (Return code of 139 is out of bounds) [21:31:01] Environment IPMI on thyme is UNKNOWN: NRPE: Unable to read output [21:31:12] Load avg. on thyme is UNKNOWN: NRPE: Unable to read output [21:31:32] FMA on thyme is CRITICAL: ERROR - unexpected output from snmpwalk [21:32:00] MySQL slave on z-dat-s2-b is CRITICAL: (Return code of 139 is out of bounds) [21:32:53] /mnt on thyme is UNKNOWN: NRPE: Unable to read output [21:32:53] s1 replag on thyme is CRITICAL: QUERY CRITICAL: Cant connect to MySQL server on thyme (146) [21:33:12] wikidata replag on z-dat-s5-b is CRITICAL: (Service Check Timed Out) [21:33:54] /tmp on thyme is UNKNOWN: NRPE: Unable to read output [21:34:02] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 292979 MB (5% inode=64%): [21:34:02] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [21:34:32] s5 replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 7868.000000 [21:35:41] APT on nightshade is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [21:36:13] APT on nightshade is WARNING: APT WARNING: 67 packages available for upgrade (0 critical updates). [22:11:21] / on ortelius is WARNING: DISK WARNING - free space: / 5330 MB (17% inode=92%): [22:14:21] / on hemlock is WARNING: DISK WARNING - free space: / 4190 MB (20% inode=88%): [22:15:40] /tmp on hemlock is WARNING: DISK WARNING - free space: / 4190 MB (20% inode=88%): [22:17:22] toolserver.org HTTP on wolfsbane is CRITICAL: CRITICAL - Socket timeout after 10 seconds [22:20:33] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [22:21:40] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [22:22:01] Load avg. on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [22:22:32] FC 0/20 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [22:22:53] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A: [22:23:05] SMF on web.amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [22:23:05] Environment IPMI on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [22:23:05] Load avg. on amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [22:23:41] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 37323 MB (6% inode=99%): [22:23:41] s4 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1047436.000000 [22:23:41] wikidata replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 353857.000000 [22:23:54] FC 0/15 [fsw2-n1-oe16-esams] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [22:23:54] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [22:23:54] APT on z-dat-s1-b is WARNING: APT WARNING: 35 packages available for upgrade (0 critical updates). [22:23:54] APT on z-dat-s2-b is WARNING: APT WARNING: 34 packages available for upgrade (0 critical updates). [22:24:22] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 2231993.000000 [22:24:22] APT on yarrow is WARNING: APT WARNING: 67 packages available for upgrade (0 critical updates). [22:24:22] SMTP on sage is CRITICAL: CRITICAL - Socket timeout after 10 seconds [22:24:22] FC 0/5 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [22:24:22] FC 0/19 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [22:24:32] FMA on amaranth is CRITICAL: ERROR - unexpected output from snmpwalk [22:24:32] FC 0/17 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [22:24:32] FC 0/10 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [22:24:33] FC 0/2 [hemlock] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [22:24:33] FC 0/7 [daphne] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [22:24:33] NTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [22:24:33] SMTP on z-dat-s1-b is CRITICAL: CRITICAL - Socket timeout after 10 seconds [22:24:34] SMTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [22:24:34] NTP on amaranth is CRITICAL: CRITICAL - Socket timeout after 10 seconds [22:24:35] SMTP on z-dat-s5-b is CRITICAL: CRITICAL - Socket timeout after 10 seconds [22:24:35] FC 0/12 [thyme] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [22:24:36] FC 0/22 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [22:24:54] / on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [22:24:54] APT on yucca is WARNING: APT WARNING: 39 packages available for upgrade (0 critical updates). [22:25:01] /tmp on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [22:25:02] aliasd on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [22:25:02] MySQL slave on z-dat-s5-b is CRITICAL: (Return code of 139 is out of bounds) [22:25:02] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [22:25:22] SMTP on nightshade is CRITICAL: CRITICAL - Socket timeout after 10 seconds [22:25:22] FC 0/18 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [22:25:33] FC 0/0 [SAN far1-n1-oe16-esams A1] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [22:25:33] RAID on thyme is UNKNOWN: NRPE: Unable to read output [22:25:33] SSH on mayapple is CRITICAL: Server answer: [22:25:33] FC 0/11 [fsw2-n1-oe16-esams] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [22:25:33] wikidata replag on z-dat-s7-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 521399.000000 [22:25:54] / on thyme is UNKNOWN: NRPE: Unable to read output [22:25:54] wikidata replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1358449.000000 [22:25:54] Sensors on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [22:26:12] SRaid on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [22:26:22] FC 0/6 [rosemary] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [22:26:32] FC 0/1 [far1-n1-oe16-esams B1] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [22:26:32] FC 0/8 [adenia] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [22:26:40] SMTP on mayapple is CRITICAL: CRITICAL - Socket timeout after 10 seconds [22:26:54] SMF on amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [22:26:54] Sun Grid Engine execd on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [22:26:54] APT on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [22:26:54] FC 0/4 [hyacinth] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [22:27:12] APT on sage is WARNING: APT WARNING: 34 packages available for upgrade (0 critical updates). [22:27:54] FC 0/3 [cassia] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [22:27:54] FC 0/16 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [22:31:01] MySQL slave on z-dat-s1-b is CRITICAL: (Return code of 139 is out of bounds) [22:31:01] Environment IPMI on thyme is UNKNOWN: NRPE: Unable to read output [22:31:11] Load avg. on thyme is UNKNOWN: NRPE: Unable to read output [22:31:32] FMA on thyme is CRITICAL: ERROR - unexpected output from snmpwalk [22:32:01] MySQL slave on z-dat-s2-b is CRITICAL: (Return code of 139 is out of bounds) [22:32:53] /mnt on thyme is UNKNOWN: NRPE: Unable to read output [22:32:53] s1 replag on thyme is CRITICAL: QUERY CRITICAL: Cant connect to MySQL server on thyme (146) [22:33:54] wikidata replag on z-dat-s5-b is CRITICAL: (Service Check Timed Out) [22:33:54] /tmp on thyme is UNKNOWN: NRPE: Unable to read output [22:34:02] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 292790 MB (5% inode=64%): [22:34:02] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [22:34:33] s5 replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 9854.000000 [22:37:12] APT on nightshade is WARNING: APT WARNING: 67 packages available for upgrade (0 critical updates). [23:11:22] / on ortelius is WARNING: DISK WARNING - free space: / 5024 MB (16% inode=92%): [23:14:21] / on hemlock is WARNING: DISK WARNING - free space: / 4188 MB (20% inode=88%): [23:15:12] toolserver.org HTTP on wolfsbane is OK: HTTP OK: HTTP/1.1 200 OK - 239 bytes in 0.009 second response time [23:15:40] /tmp on hemlock is WARNING: DISK WARNING - free space: / 4188 MB (20% inode=88%): [23:20:32] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [23:21:40] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [23:22:02] Load avg. on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [23:22:40] FC 0/20 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [23:23:02] SMF on web.amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [23:23:02] Environment IPMI on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [23:23:02] Load avg. on amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [23:23:41] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 37083 MB (6% inode=99%): [23:23:41] s4 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1051036.000000 [23:23:41] wikidata replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 353334.000000 [23:23:53] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A: [23:23:53] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [23:23:54] FC 0/15 [fsw2-n1-oe16-esams] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [23:23:54] APT on z-dat-s2-b is WARNING: APT WARNING: 34 packages available for upgrade (0 critical updates). [23:23:54] APT on z-dat-s1-b is WARNING: APT WARNING: 35 packages available for upgrade (0 critical updates). [23:24:21] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 2234763.000000 [23:24:22] APT on yarrow is WARNING: APT WARNING: 67 packages available for upgrade (0 critical updates). [23:24:22] SMTP on sage is CRITICAL: CRITICAL - Socket timeout after 10 seconds [23:24:32] FMA on amaranth is CRITICAL: ERROR - unexpected output from snmpwalk [23:24:32] FC 0/17 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [23:24:33] FC 0/10 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [23:24:33] FC 0/2 [hemlock] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [23:24:33] FC 0/7 [daphne] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [23:24:33] NTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [23:24:33] SMTP on z-dat-s1-b is CRITICAL: CRITICAL - Socket timeout after 10 seconds [23:24:34] SMTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [23:24:34] NTP on amaranth is CRITICAL: CRITICAL - Socket timeout after 10 seconds [23:24:35] SMTP on z-dat-s5-b is CRITICAL: CRITICAL - Socket timeout after 10 seconds [23:24:35] FC 0/12 [thyme] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [23:24:36] wikidata replag on z-dat-s2-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1304785.000000 [23:24:54] / on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [23:24:54] APT on yucca is WARNING: APT WARNING: 39 packages available for upgrade (0 critical updates). [23:25:02] /tmp on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [23:25:02] aliasd on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [23:25:02] MySQL slave on z-dat-s5-b is CRITICAL: (Return code of 139 is out of bounds) [23:25:02] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [23:25:19] [[Ghel]] ! 10https://wiki.toolserver.org/w/index.php?diff=7998&oldid=7705&rcid=21891 * 88.64.141.88 * (-2361) (/* Python */ ) [23:25:22] SMTP on nightshade is CRITICAL: CRITICAL - Socket timeout after 10 seconds [23:25:22] FC 0/5 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [23:25:22] FC 0/18 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [23:25:22] FC 0/19 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [23:25:33] FC 0/0 [SAN far1-n1-oe16-esams A1] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [23:25:33] RAID on thyme is UNKNOWN: NRPE: Unable to read output [23:25:33] SSH on mayapple is CRITICAL: Server answer: [23:25:33] wikidata replag on z-dat-s7-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 522173.000000 [23:25:33] FC 0/11 [fsw2-n1-oe16-esams] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [23:25:54] / on thyme is UNKNOWN: NRPE: Unable to read output [23:25:54] wikidata replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1356028.000000 [23:25:54] Sensors on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [23:26:11] SRaid on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [23:26:21] FC 0/6 [rosemary] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [23:26:33] FC 0/1 [far1-n1-oe16-esams B1] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [23:26:33] FC 0/8 [adenia] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [23:26:54] Sun Grid Engine execd on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [23:26:54] SMF on amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [23:26:54] APT on mayapple is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [23:26:54] SMTP on mayapple is CRITICAL: CRITICAL - Socket timeout after 10 seconds [23:26:54] FC 0/4 [hyacinth] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [23:27:12] APT on sage is WARNING: APT WARNING: 34 packages available for upgrade (0 critical updates). [23:27:53] FC 0/16 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [23:27:53] FC 0/3 [cassia] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [23:28:40] toolserver.org HTTP on ortelius is CRITICAL: CRITICAL - Socket timeout after 10 seconds [23:28:49] Dispenser: Is the wiki change above legit? [23:31:01] MySQL slave on z-dat-s1-b is CRITICAL: (Return code of 139 is out of bounds) [23:31:01] Environment IPMI on thyme is UNKNOWN: NRPE: Unable to read output [23:31:11] Load avg. on thyme is UNKNOWN: NRPE: Unable to read output [23:31:32] FMA on thyme is CRITICAL: ERROR - unexpected output from snmpwalk [23:32:01] MySQL slave on z-dat-s2-b is CRITICAL: (Return code of 139 is out of bounds) [23:33:54] /mnt on thyme is UNKNOWN: NRPE: Unable to read output [23:33:54] s1 replag on thyme is CRITICAL: QUERY CRITICAL: Cant connect to MySQL server on thyme (146) [23:33:54] /tmp on thyme is UNKNOWN: NRPE: Unable to read output [23:34:02] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 289791 MB (5% inode=64%): [23:34:12] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [23:34:32] wikidata replag on z-dat-s5-b is CRITICAL: (Service Check Timed Out) [23:34:32] s5 replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 11941.000000 [23:37:12] APT on nightshade is WARNING: APT WARNING: 67 packages available for upgrade (0 critical updates). [23:38:41] APT on nightshade is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [23:40:12] APT on nightshade is WARNING: APT WARNING: 67 packages available for upgrade (0 critical updates). [23:48:32] toolserver.org HTTP on ortelius is OK: HTTP OK: HTTP/1.1 200 OK - 239 bytes in 0.014 second response time