[00:10:10] s4 replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 43618.000000 [00:15:20] APT on yarrow is CRITICAL: APT CRITICAL: 3 packages available for upgrade (3 critical updates). [00:23:10] /tmp on hemlock is CRITICAL: Connection refused by host [00:24:11] SMF on hemlock is CRITICAL: Connection refused by host [00:24:49] /aux0 on hemlock is CRITICAL: Connection refused by host [00:25:30] Sun Grid Engine execd on willow is UNKNOWN: CHECK_NRPE: Received 0 bytes from daemon. Check the remote server logs for error messages. [00:26:19] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [00:26:49] CAM on hemlock is CRITICAL: Connection refused by host [00:26:49] /home on hemlock is CRITICAL: Connection refused by host [00:27:10] Environment IPMI on hemlock is CRITICAL: Connection refused by host [00:27:50] Load avg. on hemlock is CRITICAL: Connection refused by host [00:27:50] / on hemlock is CRITICAL: Connection refused by host [00:32:10] MySQL slave on z-dat-s6-a is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 32392 [00:34:10] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [00:39:19] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [00:49:19] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [00:50:29] Sun Grid Engine execd on willow is UNKNOWN: CHECK_NRPE: Received 0 bytes from daemon. Check the remote server logs for error messages. [00:51:28] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [00:52:19] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [00:53:49] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [00:58:10] SMTP on hemlock is CRITICAL: Connection refused [01:11:10] s4 replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 40559.000000 [01:15:19] APT on yarrow is CRITICAL: APT CRITICAL: 3 packages available for upgrade (3 critical updates). [01:23:09] /tmp on hemlock is CRITICAL: Connection refused by host [01:24:10] SMF on hemlock is CRITICAL: Connection refused by host [01:24:49] /aux0 on hemlock is CRITICAL: Connection refused by host [01:26:48] CAM on hemlock is CRITICAL: Connection refused by host [01:26:48] /home on hemlock is CRITICAL: Connection refused by host [01:27:11] Environment IPMI on hemlock is CRITICAL: Connection refused by host [01:28:49] Load avg. on hemlock is CRITICAL: Connection refused by host [01:28:49] / on hemlock is CRITICAL: Connection refused by host [01:32:09] MySQL slave on z-dat-s6-a is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 35101 [01:34:10] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [01:39:20] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [01:49:20] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [01:51:20] /sql on thyme is WARNING: DISK WARNING - free space: /sql 197238 MB (20% inode=99%): [01:52:19] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [01:52:19] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [01:53:49] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [01:59:09] SMTP on hemlock is CRITICAL: Connection refused [02:00:30] Sun Grid Engine execd on willow is UNKNOWN: CHECK_NRPE: Received 0 bytes from daemon. Check the remote server logs for error messages. [02:01:29] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [02:11:10] s4 replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 38054.000000 [02:15:29] APT on yarrow is CRITICAL: APT CRITICAL: 3 packages available for upgrade (3 critical updates). [02:23:10] /tmp on hemlock is CRITICAL: Connection refused by host [02:24:09] SMF on hemlock is CRITICAL: Connection refused by host [02:24:49] /aux0 on hemlock is CRITICAL: Connection refused by host [02:26:49] CAM on hemlock is CRITICAL: Connection refused by host [02:26:49] /home on hemlock is CRITICAL: Connection refused by host [02:28:10] Environment IPMI on hemlock is CRITICAL: Connection refused by host [02:28:49] Load avg. on hemlock is CRITICAL: Connection refused by host [02:28:49] / on hemlock is CRITICAL: Connection refused by host [02:32:10] MySQL slave on z-dat-s6-a is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 37768 [02:34:10] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [02:39:30] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [02:49:30] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [02:52:30] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [02:53:58] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [02:59:09] SMTP on hemlock is CRITICAL: Connection refused [03:02:29] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [03:02:59] RAID on adenia is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [03:11:11] s4 replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 34610.000000 [03:15:30] APT on yarrow is CRITICAL: APT CRITICAL: 3 packages available for upgrade (3 critical updates). [03:23:09] /tmp on hemlock is CRITICAL: Connection refused by host [03:24:49] /aux0 on hemlock is CRITICAL: Connection refused by host [03:25:09] SMF on hemlock is CRITICAL: Connection refused by host [03:26:49] CAM on hemlock is CRITICAL: Connection refused by host [03:26:49] /home on hemlock is CRITICAL: Connection refused by host [03:28:10] Environment IPMI on hemlock is CRITICAL: Connection refused by host [03:28:49] Load avg. on hemlock is CRITICAL: Connection refused by host [03:28:49] / on hemlock is CRITICAL: Connection refused by host [03:32:58] RAID on adenia is OK: OK - TOTAL: 2: FAILED: 0: DEGRADED: 0 [03:33:10] MySQL slave on z-dat-s6-a is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 40477 [03:35:09] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [03:40:29] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [03:44:49] s1 replag on thyme is CRITICAL: (Service Check Timed Out) [03:46:19] s1 replag on thyme is OK: QUERY OK: SELECT ts_rc_age() returned 314.000000 [03:47:59] RAID on adenia is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [03:49:30] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [03:53:29] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [03:53:59] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [03:59:09] SMTP on hemlock is CRITICAL: Connection refused [04:02:29] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [04:12:10] s4 replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 30876.000000 [04:16:29] APT on yarrow is CRITICAL: APT CRITICAL: 3 packages available for upgrade (3 critical updates). [04:23:10] /tmp on hemlock is CRITICAL: Connection refused by host [04:24:49] /aux0 on hemlock is CRITICAL: Connection refused by host [04:25:19] SMF on hemlock is CRITICAL: Connection refused by host [04:26:48] CAM on hemlock is CRITICAL: Connection refused by host [04:26:49] /home on hemlock is CRITICAL: Connection refused by host [04:28:20] Environment IPMI on hemlock is CRITICAL: Connection refused by host [04:28:49] Load avg. on hemlock is CRITICAL: Connection refused by host [04:29:49] / on hemlock is CRITICAL: Connection refused by host [04:33:20] MySQL slave on z-dat-s6-a is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 42963 [04:35:20] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [04:40:29] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [04:50:29] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [04:53:29] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [04:54:09] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [04:59:20] SMTP on hemlock is CRITICAL: Connection refused [05:02:29] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [05:12:20] s4 replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 27808.000000 [05:16:29] APT on yarrow is CRITICAL: APT CRITICAL: 3 packages available for upgrade (3 critical updates). [05:23:20] /tmp on hemlock is CRITICAL: Connection refused by host [05:24:49] /aux0 on hemlock is CRITICAL: Connection refused by host [05:25:20] SMF on hemlock is CRITICAL: Connection refused by host [05:26:49] CAM on hemlock is CRITICAL: Connection refused by host [05:26:59] /home on hemlock is CRITICAL: Connection refused by host [05:28:21] Environment IPMI on hemlock is CRITICAL: Connection refused by host [05:28:49] Load avg. on hemlock is CRITICAL: Connection refused by host [05:30:00] / on hemlock is CRITICAL: Connection refused by host [05:33:19] MySQL slave on z-dat-s6-a is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 45750 [05:35:20] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [05:40:30] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [05:50:29] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [05:53:29] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [05:54:09] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [06:00:20] SMTP on hemlock is CRITICAL: Connection refused [06:02:30] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [06:13:19] s4 replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 23736.000000 [06:16:29] APT on yarrow is CRITICAL: APT CRITICAL: 3 packages available for upgrade (3 critical updates). [06:24:18] /tmp on hemlock is CRITICAL: Connection refused by host [06:24:49] /aux0 on hemlock is CRITICAL: Connection refused by host [06:26:19] SMF on hemlock is CRITICAL: Connection refused by host [06:26:49] CAM on hemlock is CRITICAL: Connection refused by host [06:26:59] /home on hemlock is CRITICAL: Connection refused by host [06:28:49] Load avg. on hemlock is CRITICAL: Connection refused by host [06:29:19] Environment IPMI on hemlock is CRITICAL: Connection refused by host [06:29:59] / on hemlock is CRITICAL: Connection refused by host [06:30:39] Sun Grid Engine execd on willow is UNKNOWN: CHECK_NRPE: Received 0 bytes from daemon. Check the remote server logs for error messages. [06:31:29] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [06:34:20] MySQL slave on z-dat-s6-a is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 48580 [06:35:30] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [06:38:50] Load avg. on hemlock is OK: OK - load average: 2.61, 3.75, 3.04 [06:38:50] CAM on hemlock is OK: OK - cam detected no new errors [06:38:59] / on hemlock is OK: DISK OK - free space: / 5804 MB (29% inode=89%): [06:38:59] /home on hemlock is OK: DISK OK - free space: /home 17748 MB (35% inode=86%): [06:39:19] /tmp on hemlock is OK: DISK OK - free space: /tmp 2338 MB (84% inode=98%): [06:39:19] SMF on hemlock is OK: OK - all services online [06:39:19] SMTP on hemlock is OK: SMTP OK - 0.143 sec. response time [06:39:30] Environment IPMI on hemlock is OK: ok: temperature ok fan ok voltage ok chassis ok [06:40:30] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [06:50:30] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [06:52:59] Load avg. on willow is WARNING: WARNING - load average: 16.00, 14.96, 12.55 [06:53:30] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [06:53:59] Load avg. on willow is OK: OK - load average: 11.19, 13.70, 12.25 [06:54:08] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [07:13:31] s4 replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 17613.000000 [07:16:29] APT on yarrow is CRITICAL: APT CRITICAL: 3 packages available for upgrade (3 critical updates). [07:24:49] /aux0 on hemlock is CRITICAL: DISK CRITICAL - free space: /aux0 305621 MB (5% inode=33%): [07:31:31] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [07:34:31] MySQL slave on z-dat-s6-a is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 51361 [07:35:31] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [07:40:31] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [07:48:08] RAID on adenia is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [07:51:29] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [07:52:10] Load avg. on willow is WARNING: WARNING - load average: 16.03, 13.84, 12.03 [07:53:09] Load avg. on willow is OK: OK - load average: 14.21, 13.57, 12.04 [07:53:32] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [07:54:19] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [08:13:30] s4 replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 12640.000000 [08:16:31] APT on yarrow is CRITICAL: APT CRITICAL: 3 packages available for upgrade (3 critical updates). [08:22:39] RAID on adenia is OK: OK - TOTAL: 2: FAILED: 0: DEGRADED: 0 [08:24:49] /aux0 on hemlock is CRITICAL: DISK CRITICAL - free space: /aux0 305520 MB (5% inode=33%): [08:32:30] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [08:35:31] MySQL slave on z-dat-s6-a is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 53885 [08:36:31] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [08:41:29] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [08:51:30] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [08:54:19] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [08:54:31] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [09:00:39] Sun Grid Engine execd on willow is UNKNOWN: NRPE: Unable to read output [09:01:29] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [09:13:30] s4 replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 8257.000000 [09:16:30] APT on yarrow is CRITICAL: APT CRITICAL: 3 packages available for upgrade (3 critical updates). [09:25:49] /aux0 on hemlock is CRITICAL: DISK CRITICAL - free space: /aux0 303640 MB (5% inode=33%): [09:35:31] MySQL slave on z-dat-s6-a is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 56600 [09:36:30] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [09:41:30] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [09:51:30] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [09:54:19] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [09:54:31] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [09:56:31] /sql on cassia is WARNING: DISK WARNING - free space: /sql 99494 MB (8% inode=99%): [10:01:30] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [10:14:29] s4 replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 3977.000000 [10:16:40] APT on yarrow is CRITICAL: APT CRITICAL: 3 packages available for upgrade (3 critical updates). [10:22:30] s4 replag on cassia is WARNING: QUERY WARNING: SELECT ts_rc_age() returned 3540.000000 [10:24:48] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 361641 MB (6% inode=37%): [10:36:30] MySQL slave on z-dat-s6-a is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 59261 [10:37:29] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [10:41:49] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [10:47:30] s4 replag on cassia is OK: QUERY OK: SELECT ts_rc_age() returned 1791.000000 [10:51:40] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [10:54:19] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [10:54:49] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [11:01:39] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [11:16:39] APT on yarrow is CRITICAL: APT CRITICAL: 3 packages available for upgrade (3 critical updates). [11:24:49] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 459571 MB (8% inode=43%): [11:33:43] 3(created) [ACCAPP-528] Tools for time coorinate; Account Approval; New Account <10https://jira.toolserver.org/browse/ACCAPP-528> (Arnd S.) [11:36:29] MySQL slave on z-dat-s6-a is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 61926 [11:37:30] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [11:41:49] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [11:42:19] RAID on hyacinth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [11:42:39] SSH on z-dat-s7-a is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:42:39] SSH on z-dat-s6-a is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:42:40] SSH on z-dat-s3-a is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:42:40] SSH on z-dat-s4-a is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:42:49] Load avg. on z-dat-s4-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [11:42:59] RAID on hyacinth is OK: OK - TOTAL: 2: FAILED: 0: DEGRADED: 0 [11:43:00] no mysql [11:43:09] RAID on adenia is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [11:43:19] Load avg. on z-dat-s4-a is OK: OK - load average: 0.91, 0.94, 1.12 [11:43:29] SSH on z-dat-s3-a is OK: SSH OK - OpenSSH_5.8p2-hpn13v11 (protocol 2.0) [11:43:29] SSH on z-dat-s7-a is OK: SSH OK - OpenSSH_5.8p2-hpn13v11 (protocol 2.0) [11:43:29] SSH on z-dat-s6-a is OK: SSH OK - OpenSSH_5.8p2-hpn13v11 (protocol 2.0) [11:43:29] SSH on z-dat-s4-a is OK: SSH OK - OpenSSH_5.8p2-hpn13v11 (protocol 2.0) [11:51:39] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [11:54:19] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [11:54:50] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [12:01:39] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [12:02:59] RAID on adenia is OK: OK - TOTAL: 2: FAILED: 0: DEGRADED: 0 [12:16:39] APT on yarrow is CRITICAL: APT CRITICAL: 3 packages available for upgrade (3 critical updates). [12:24:49] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 455566 MB (8% inode=42%): [12:35:44] 3(created) [TS-1401] Nw SSH keypair; Toolserver; Task <10https://jira.toolserver.org/browse/TS-1401> (inductiveload) [12:36:31] MySQL slave on z-dat-s6-a is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 64569 [12:37:30] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [12:37:45] 3(updated) [TS-1401] Nw SSH keypair <10https://jira.toolserver.org/browse/TS-1401> (inductiveload) [12:41:50] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [12:44:47] 3(updated) [TS-1401] New SSH keypair <10https://jira.toolserver.org/browse/TS-1401> (inductiveload) [12:51:39] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [12:54:19] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [12:55:40] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [13:01:39] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [13:17:39] APT on yarrow is CRITICAL: APT CRITICAL: 3 packages available for upgrade (3 critical updates). [13:24:49] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 455449 MB (8% inode=42%): [13:30:45] 3(assigned) [TS-1401] New SSH keypair <10https://jira.toolserver.org/browse/TS-1401> (Marlen Caemmerer) [13:30:47] 3(assigned) [TS-1400] Joining MMP "langlinksbot" <10https://jira.toolserver.org/browse/TS-1400> (Marlen Caemmerer) [13:36:39] MySQL slave on z-dat-s6-a is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 67216 [13:37:40] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [13:42:50] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [13:51:29] /sql on thyme is WARNING: DISK WARNING - free space: /sql 196585 MB (20% inode=99%): [13:51:40] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [13:54:19] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [13:56:39] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [14:01:39] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [14:09:45] 3(created) [TS-1402] Cronie jobs intermittently failing to run; Toolserver: General/Unknown; Bug <10https://jira.toolserver.org/browse/TS-1402> (Russell Blau) [14:18:39] APT on yarrow is CRITICAL: APT CRITICAL: 3 packages available for upgrade (3 critical updates). [14:24:49] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 455335 MB (8% inode=42%): [14:36:39] MySQL slave on z-dat-s6-a is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 69753 [14:38:29] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [14:42:50] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [14:48:44] 3(assigned) [TS-1400] Joining MMP "langlinksbot" <10https://jira.toolserver.org/browse/TS-1400> (DaB.) [14:49:33] [[Special:Log/newusers]] create 10 * Seodistribute6 * (New user account) [14:52:39] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [14:52:44] 3(commented) [TS-1400] Joining MMP "langlinksbot" <10https://jira.toolserver.org/browse/TS-1400> (DaB.) [14:54:19] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [14:56:40] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [15:01:40] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [15:18:39] APT on yarrow is CRITICAL: APT CRITICAL: 3 packages available for upgrade (3 critical updates). [15:24:49] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 461886 MB (8% inode=43%): [15:37:39] MySQL slave on z-dat-s6-a is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 72271 [15:38:30] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [15:43:49] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [15:52:40] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [15:54:20] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [15:56:39] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [16:02:40] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [16:03:09] RAID on adenia is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [16:06:59] /sql on z-dat-s4-a is WARNING: DISK WARNING - free space: /sql 43725 MB (10% inode=99%): [16:13:00] RAID on adenia is OK: OK - TOTAL: 2: FAILED: 0: DEGRADED: 0 [16:18:40] APT on yarrow is CRITICAL: APT CRITICAL: 3 packages available for upgrade (3 critical updates). [16:19:59] /sql on z-dat-s4-a is OK: DISK OK - free space: /sql 66449 MB (16% inode=99%): [16:20:30] s4 replag on cassia is WARNING: QUERY WARNING: SELECT ts_rc_age() returned 1917.000000 [16:25:49] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 455101 MB (8% inode=42%): [16:27:30] s4 replag on cassia is OK: QUERY OK: SELECT ts_rc_age() returned 1773.000000 [16:38:39] MySQL slave on z-dat-s6-a is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 74982 [16:38:39] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [16:43:49] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [16:52:39] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [16:55:19] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [16:57:49] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [17:01:00] /sql on z-dat-s4-a is WARNING: DISK WARNING - free space: /sql 43714 MB (10% inode=99%): [17:02:59] Load avg. on adenia is WARNING: WARNING - load average: 17.29, 12.17, 7.43 [17:03:39] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [17:14:59] /sql on z-dat-s4-a is OK: DISK OK - free space: /sql 72511 MB (17% inode=99%): [17:18:39] APT on yarrow is CRITICAL: APT CRITICAL: 3 packages available for upgrade (3 critical updates). [17:18:59] Load avg. on adenia is OK: OK - load average: 6.16, 13.52, 12.91 [17:25:49] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 455009 MB (8% inode=42%): [17:35:46] 3(commented) [TS-1400] Joining MMP "langlinksbot" <10https://jira.toolserver.org/browse/TS-1400> (reza) [17:38:39] MySQL slave on z-dat-s6-a is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 77414 [17:38:39] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [17:43:49] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [17:52:39] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [17:55:19] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [17:58:39] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [18:03:40] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [18:18:39] APT on yarrow is CRITICAL: APT CRITICAL: 3 packages available for upgrade (3 critical updates). [18:25:50] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 454890 MB (8% inode=42%): [18:39:40] MySQL slave on z-dat-s6-a is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 80088 [18:39:40] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [18:43:50] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [18:52:40] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [18:55:18] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [18:58:39] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [19:03:40] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [19:19:40] APT on yarrow is CRITICAL: APT CRITICAL: 3 packages available for upgrade (3 critical updates). [19:25:49] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 454929 MB (8% inode=42%): [19:32:16] hello all [19:32:22] @replag [19:32:22] DaBPunkt: s1-rr-a: 28s [+0.00 s/s]; s1-user: 28s [+0.00 s/s]; s2-user: 1w 4d 14h 20m 32s [+0.28 s/s]; s6-rr-a: 22h 55m 3s [+0.72 s/s]; s6-user: 22h 55m 3s [+0.72 s/s] [19:40:39] MySQL slave on z-dat-s6-a is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 82843 [19:40:39] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [19:43:49] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [19:53:40] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [19:55:20] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [19:58:40] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [20:03:39] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [20:14:30] s5 replag on cassia is CRITICAL: QUERY CRITICAL: Error with query - FUNCTION dewiki_p.ts_rc_age does not exist [20:15:39] MySQL slave on z-dat-s7-a is CRITICAL: (Return code of 139 is out of bounds) [20:18:59] MySQL on ha-sql.esi is CRITICAL: Access denied for user nagios@damiana (using password: YES) [20:20:39] APT on yarrow is CRITICAL: APT CRITICAL: 3 packages available for upgrade (3 critical updates). [20:25:49] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 454759 MB (8% inode=42%): [20:36:09] MySQL slave on z-dat-s4-a is CRITICAL: Access denied for user nagios@damiana-bge0.esi.toolserver.org (using password: YES) [20:36:09] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: Access denied for user nagios@damiana-bge0.esi.toolserver.org (using password: YES) [20:36:09] s4 replag on rosemary is CRITICAL: QUERY CRITICAL: Access denied for user nagios@damiana-bge0.esi.toolserver.org (using password: YES) [20:36:19] s4 replag on z-dat-s4-a is CRITICAL: QUERY CRITICAL: Access denied for user nagios@damiana-bge0.esi.toolserver.org (using password: YES) [20:36:29] MySQL on rosemary is CRITICAL: Access denied for user nagios@damiana-bge0.esi.toolserver.org (using password: YES) [20:36:29] MySQL on cassia is CRITICAL: Access denied for user nagios@damiana-bge0.esi.toolserver.org (using password: YES) [20:36:30] MySQL on adenia is CRITICAL: Access denied for user nagios@damiana-bge0.esi.toolserver.org (using password: YES) [20:36:30] MySQL slave on rosemary is CRITICAL: Access denied for user nagios@damiana-bge0.esi.toolserver.org (using password: YES) [20:36:30] MySQL slave on daphne is CRITICAL: Access denied for user nagios@damiana-ext-bge0.toolserver.org (using password: YES) [20:36:30] MySQL slave on cassia is CRITICAL: Access denied for user nagios@damiana-bge0.esi.toolserver.org (using password: YES) [20:36:30] MySQL slave on thyme is CRITICAL: Access denied for user nagios@damiana-bge0.esi.toolserver.org (using password: YES) [20:36:31] MySQL on daphne is CRITICAL: Access denied for user nagios@damiana-ext-bge0.toolserver.org (using password: YES) [20:36:31] s4 replag on daphne is CRITICAL: QUERY CRITICAL: Access denied for user nagios@damiana-ext-bge0.toolserver.org (using password: YES) [20:36:32] s4 replag on cassia is CRITICAL: QUERY CRITICAL: Access denied for user nagios@damiana-bge0.esi.toolserver.org (using password: YES) [20:36:39] MySQL on z-dat-s6-a is CRITICAL: Access denied for user nagios@damiana-bge0.esi.toolserver.org (using password: YES) [20:36:39] MySQL on z-dat-s7-a is CRITICAL: Access denied for user nagios@damiana-bge0.esi.toolserver.org (using password: YES) [20:36:39] MySQL on thyme is CRITICAL: Access denied for user nagios@damiana-bge0.esi.toolserver.org (using password: YES) [20:36:49] MySQL on z-dat-s4-a is CRITICAL: Access denied for user nagios@damiana-bge0.esi.toolserver.org (using password: YES) [20:37:00] MySQL on z-dat-s3-a is CRITICAL: Access denied for user nagios@damiana-bge0.esi.toolserver.org (using password: YES) [20:37:00] MySQL slave on z-dat-s3-a is CRITICAL: Access denied for user nagios@damiana-bge0.esi.toolserver.org (using password: YES) [20:37:00] s1 replag on thyme is CRITICAL: QUERY CRITICAL: Access denied for user nagios@damiana-bge0.esi.toolserver.org (using password: YES) [20:38:02] sql-toolserver will be away for a moment [20:39:00] and it is back [20:41:28] MySQL slave on z-dat-s4-a is CRITICAL: Access denied for user nagios@damiana-bge0.esi.toolserver.org (using password: YES) [20:41:38] MySQL slave on z-dat-s6-a is CRITICAL: Access denied for user nagios@damiana-bge0.esi.toolserver.org (using password: YES) [20:41:38] MySQL on thyme is CRITICAL: Access denied for user nagios@damiana-bge0.esi.toolserver.org (using password: YES) [20:41:49] MySQL slave on thyme is CRITICAL: Access denied for user nagios@damiana-bge0.esi.toolserver.org (using password: YES) [20:41:58] MySQL on rosemary is CRITICAL: Access denied for user nagios@damiana-bge0.esi.toolserver.org (using password: YES) [20:41:58] s4 replag on daphne is CRITICAL: QUERY CRITICAL: Access denied for user nagios@damiana-ext-bge0.toolserver.org (using password: YES) [20:41:58] MySQL slave on rosemary is CRITICAL: Access denied for user nagios@damiana-bge0.esi.toolserver.org (using password: YES) [20:42:08] MySQL on adenia is CRITICAL: Access denied for user nagios@damiana-bge0.esi.toolserver.org (using password: YES) [20:42:08] s4 replag on cassia is CRITICAL: QUERY CRITICAL: Access denied for user nagios@damiana-bge0.esi.toolserver.org (using password: YES) [20:42:08] MySQL on daphne is CRITICAL: Access denied for user nagios@damiana-ext-bge0.toolserver.org (using password: YES) [20:42:18] MySQL slave on daphne is CRITICAL: Access denied for user nagios@damiana-ext-bge0.toolserver.org (using password: YES) [20:42:18] MySQL on z-dat-s3-a is CRITICAL: Access denied for user nagios@damiana-bge0.esi.toolserver.org (using password: YES) [20:42:19] MySQL on z-dat-s4-a is CRITICAL: Access denied for user nagios@damiana-bge0.esi.toolserver.org (using password: YES) [20:42:28] MySQL on cassia is CRITICAL: Access denied for user nagios@damiana-bge0.esi.toolserver.org (using password: YES) [20:42:28] MySQL slave on z-dat-s3-a is CRITICAL: Access denied for user nagios@damiana-bge0.esi.toolserver.org (using password: YES) [20:42:28] MySQL on z-dat-s6-a is CRITICAL: Access denied for user nagios@damiana-bge0.esi.toolserver.org (using password: YES) [20:42:29] MySQL on z-dat-s7-a is CRITICAL: Access denied for user nagios@damiana-bge0.esi.toolserver.org (using password: YES) [20:42:29] MySQL slave on cassia is CRITICAL: Access denied for user nagios@damiana-bge0.esi.toolserver.org (using password: YES) [20:42:38] s1 replag on thyme is CRITICAL: QUERY CRITICAL: Access denied for user nagios@damiana-bge0.esi.toolserver.org (using password: YES) [20:44:51] MySQL slave on z-dat-s4-a is CRITICAL: Access denied for user tsnagios@damiana-bge0.esi.toolserver.org (using password: YES) [20:46:01] s1 replag on thyme is CRITICAL: QUERY CRITICAL: Access denied for user tsnagios7643@%.toolserver.org to database enwiki_p [20:46:36] s4 replag on z-dat-s4-a is CRITICAL: QUERY CRITICAL: Access denied for user tsnagios7643@%.toolserver.org to database commonswiki_p [20:46:37] s4 replag on daphne is CRITICAL: QUERY CRITICAL: Access denied for user tsnagios7643@%.toolserver.org to database commonswiki_p [20:46:46] s4 replag on cassia is CRITICAL: QUERY CRITICAL: Access denied for user tsnagios7643@%.toolserver.org to database commonswiki_p [20:46:57] s1 replag on thyme is OK: QUERY OK: SELECT ts_rc_age() returned 166.000000 [20:49:26] s4 replag on rosemary is OK: QUERY OK: SELECT ts_rc_age() returned 4.000000 [20:49:36] s4 replag on daphne is OK: QUERY OK: SELECT ts_rc_age() returned 3.000000 [20:49:46] s4 replag on cassia is OK: QUERY OK: SELECT ts_rc_age() returned 1.000000 [20:50:16] s1 replag on rosemary is OK: QUERY OK: SELECT ts_rc_age() returned 40.000000 [20:53:36] s4 replag on z-dat-s4-a is OK: QUERY OK: SELECT ts_rc_age() returned 2.000000 [20:53:47] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [20:55:57] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [20:58:56] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [21:04:17] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [21:14:57] s5 replag on cassia is CRITICAL: QUERY CRITICAL: Error with query - FUNCTION dewiki_p.ts_rc_age does not exist [21:15:56] MySQL slave on z-dat-s7-a is CRITICAL: (Return code of 139 is out of bounds) [21:19:45] MySQL on ha-sql.esi is CRITICAL: Access denied for user tsnagios7643@damiana (using password: YES) [21:20:56] APT on yarrow is CRITICAL: APT CRITICAL: 3 packages available for upgrade (3 critical updates). [21:26:46] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 454643 MB (8% inode=42%): [21:29:56] APT on yarrow is OK: APT OK: 0 packages available for upgrade (0 critical updates). [21:45:37] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [21:45:57] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [21:45:57] MySQL slave on z-dat-s6-a is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 88270 [21:53:46] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [21:55:18] [[Special:Log/newusers]] create 10 * Vanischenu * (New user account) [21:55:58] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [21:56:37] @replag [21:56:38] Akoopal: s1-rr-a: 34s [+0.00 s/s]; s1-user: 34s [+0.00 s/s]; s2-user: 1w 4d 15h 6m 56s [+0.39 s/s]; s6-rr-a: 1d 39m 16s [+0.72 s/s]; s6-user: 1d 39m 16s [+0.72 s/s]; s7-rr-a: 1h 43m 42s [+1.00 s/s]; s7-user: 1h 43m 42s [+1.00 s/s] [21:57:26] /sql on cassia is WARNING: DISK WARNING - free space: /sql 99406 MB (8% inode=99%): [21:58:57] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [22:04:16] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [22:15:36] /sql on z-dat-s4-a is WARNING: DISK WARNING - free space: /sql 41729 MB (10% inode=99%): [22:15:57] s5 replag on cassia is CRITICAL: QUERY CRITICAL: Error with query - FUNCTION dewiki_p.ts_rc_age does not exist [22:15:57] MySQL slave on z-dat-s7-a is CRITICAL: (Return code of 139 is out of bounds) [22:19:46] MySQL on ha-sql.esi is CRITICAL: Access denied for user tsnagios7643@damiana (using password: YES) [22:26:46] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 454571 MB (8% inode=42%): [22:45:16] Sun Grid Engine execd on willow is UNKNOWN: CHECK_NRPE: Received 0 bytes from daemon. Check the remote server logs for error messages. [22:45:56] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [22:45:56] MySQL slave on z-dat-s6-a is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 90970 [22:46:36] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [22:53:36] /sql on z-dat-s4-a is WARNING: DISK WARNING - free space: /sql 42033 MB (10% inode=99%): [22:53:46] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [22:55:57] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [22:58:57] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [22:59:37] /sql on z-dat-s4-a is OK: DISK OK - free space: /sql 57028 MB (14% inode=99%): [23:08:17] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [23:15:57] s5 replag on cassia is CRITICAL: QUERY CRITICAL: Error with query - FUNCTION dewiki_p.ts_rc_age does not exist [23:15:57] MySQL slave on z-dat-s7-a is CRITICAL: (Return code of 139 is out of bounds) [23:18:36] /sql on z-dat-s4-a is WARNING: DISK WARNING - free space: /sql 43272 MB (10% inode=99%): [23:19:46] MySQL on ha-sql.esi is CRITICAL: Access denied for user tsnagios7643@damiana (using password: YES) [23:20:16] Sun Grid Engine execd on willow is UNKNOWN: CHECK_NRPE: Received 0 bytes from daemon. Check the remote server logs for error messages. [23:21:16] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [23:26:47] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 455051 MB (8% inode=42%): [23:29:36] /sql on z-dat-s4-a is OK: DISK OK - free space: /sql 64580 MB (15% inode=99%): [23:40:16] Sun Grid Engine execd on willow is UNKNOWN: CHECK_NRPE: Received 0 bytes from daemon. Check the remote server logs for error messages. [23:41:16] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [23:45:57] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [23:45:57] MySQL slave on z-dat-s6-a is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 93443 [23:46:36] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [23:53:46] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [23:55:36] /sql on z-dat-s4-a is WARNING: DISK WARNING - free space: /sql 42763 MB (10% inode=99%): [23:55:56] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk