[00:01:40] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [00:03:09] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [00:09:09] RAID on adenia is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [00:14:00] RAID on adenia is OK: OK - TOTAL: 2: FAILED: 0: DEGRADED: 0 [00:17:39] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [00:21:39] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [00:28:59] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 369401 MB (6% inode=37%): [00:31:19] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [00:33:09] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [00:47:59] s4 replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 30716.000000 [01:02:39] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [01:03:10] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [01:17:39] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [01:21:39] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [01:29:59] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 365688 MB (6% inode=37%): [01:31:19] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [01:33:09] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [01:48:20] s4 replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 33310.000000 [02:02:40] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [02:03:20] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [02:17:39] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [02:21:39] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [02:30:20] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 361523 MB (6% inode=37%): [02:31:31] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [02:33:20] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [02:48:21] s4 replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 35998.000000 [03:02:52] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [03:03:37] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [03:17:52] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [03:22:01] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [03:29:11] RAID on adenia is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [03:30:32] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 357020 MB (6% inode=37%): [03:32:11] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [03:33:32] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [03:48:31] s4 replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 38515.000000 [04:03:01] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [04:04:32] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [04:18:00] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [04:22:11] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [04:28:51] RAID on adenia is OK: OK - TOTAL: 2: FAILED: 0: DEGRADED: 0 [04:31:31] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 352202 MB (6% inode=36%): [04:32:11] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [04:33:41] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [04:48:35] s4 replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 38669.000000 [05:03:15] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [05:04:46] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [05:18:04] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [05:22:16] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [05:31:46] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 350023 MB (6% inode=36%): [05:32:25] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [05:33:46] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [05:46:35] s1 replag on thyme is CRITICAL: (Service Check Timed Out) [05:48:24] s1 replag on thyme is OK: QUERY OK: SELECT ts_rc_age() returned 455.000000 [05:48:46] s4 replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 39727.000000 [06:03:19] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [06:05:18] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [06:18:18] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [06:22:18] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [06:30:28] SMF on willow is UNKNOWN: CHECK_NRPE: Received 0 bytes from daemon. Check the remote server logs for error messages. [06:31:29] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [06:32:38] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [06:32:38] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 345701 MB (6% inode=36%): [06:34:18] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [06:48:47] s4 replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 41888.000000 [06:56:38] /sql on z-dat-s4-a is WARNING: DISK WARNING - free space: /sql 41075 MB (10% inode=99%): [07:01:39] Load avg. on willow is WARNING: WARNING - load average: 18.49, 15.72, 12.44 [07:02:39] Load avg. on willow is OK: OK - load average: 14.01, 14.97, 12.39 [07:03:39] /sql on z-dat-s4-a is OK: DISK OK - free space: /sql 69742 MB (17% inode=99%): [07:05:19] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [07:06:38] Load avg. on willow is WARNING: WARNING - load average: 19.54, 17.05, 13.75 [07:13:38] /sql on thyme is WARNING: DISK WARNING - free space: /sql 200093 MB (20% inode=99%): [07:18:28] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [07:22:28] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [07:23:38] /sql on z-dat-s4-a is WARNING: DISK WARNING - free space: /sql 42467 MB (10% inode=99%): [07:30:40] /sql on z-dat-s4-a is OK: DISK OK - free space: /sql 77475 MB (19% inode=99%): [07:31:27] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [07:32:48] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 341569 MB (6% inode=36%): [07:32:48] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [07:34:18] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [07:48:58] s4 replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 44951.000000 [08:05:18] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [08:09:19] RAID on adenia is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [08:13:58] RAID on adenia is OK: OK - TOTAL: 2: FAILED: 0: DEGRADED: 0 [08:18:28] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [08:22:38] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [08:31:39] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [08:32:50] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 338812 MB (6% inode=35%): [08:32:50] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [08:34:18] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [08:45:59] RAID on hyacinth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [08:45:59] SSH on z-dat-s3-a is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:46:08] Load avg. on z-dat-s4-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [08:46:08] SMF on z-dat-s4-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [08:46:19] / on z-dat-s4-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [08:46:19] /sql on z-dat-s4-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [08:46:50] SMF on z-dat-s6-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [08:46:50] /tmp on z-dat-s4-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [08:46:58] MySQL on z-dat-s3-a is CRITICAL: (Service Check Timed Out) [08:46:59] MySQL slave on z-dat-s3-a is CRITICAL: (Service Check Timed Out) [08:46:59] SMTP on z-dat-s6-a is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:46:59] SMTP on z-dat-s3-a is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:46:59] SMTP on z-dat-s4-a is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:47:07] MySQL on z-dat-s3-a is OK: Uptime: 3587180 Threads: 33 Questions: 3786904867 Slow queries: 243566 Opens: 37588021 Flush tables: 1 Open tables: 16384 Queries per second avg: 1055.677 [08:47:08] MySQL slave on z-dat-s3-a is OK: Uptime: 3587180 Threads: 33 Questions: 3786904868 Slow queries: 243566 Opens: 37588021 Flush tables: 1 Open tables: 16384 Queries per second avg: 1055.677 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 219 [08:47:08] s4 replag on z-dat-s4-a is CRITICAL: (Service Check Timed Out) [08:47:19] /tmp on z-dat-s4-a is OK: DISK OK - free space: /tmp 2168 MB (99% inode=99%): [08:47:28] s4 replag on z-dat-s4-a is OK: QUERY OK: SELECT ts_rc_age() returned 226.000000 [08:47:28] SMF on z-dat-s6-a is OK: OK - all services online [08:47:28] RAID on hyacinth is OK: OK - TOTAL: 2: FAILED: 0: DEGRADED: 0 [08:47:38] Load avg. on z-dat-s4-a is OK: OK - load average: 0.62, 1.23, 1.79 [08:47:49] SMF on z-dat-s4-a is OK: OK - all services online [08:47:49] SMTP on z-dat-s6-a is OK: SMTP OK - 0.003 sec. response time [08:47:49] / on z-dat-s4-a is OK: DISK OK - free space: / 8245 MB (27% inode=85%): [08:47:49] SMTP on z-dat-s3-a is OK: SMTP OK - 0.060 sec. response time [08:47:49] SMTP on z-dat-s4-a is OK: SMTP OK - 0.004 sec. response time [08:47:49] /sql on z-dat-s4-a is OK: DISK OK - free space: /sql 69564 MB (17% inode=99%): [08:47:49] SSH on z-dat-s3-a is OK: SSH OK - OpenSSH_5.8p2-hpn13v11 (protocol 2.0) [08:49:08] s4 replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 47318.000000 [08:55:57] RAID on hyacinth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [08:55:58] SMTP on z-dat-s4-a is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:58:08] APT on yarrow is CRITICAL: APT CRITICAL: 1 packages available for upgrade (1 critical updates). [09:05:19] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [09:18:48] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [09:22:48] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [09:31:48] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [09:32:49] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 338427 MB (6% inode=35%): [09:32:58] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [09:33:43] 3(commented) [ACCAPP-520] PendingChanges tool for finnish Wikipedia <10https://jira.toolserver.org/browse/ACCAPP-520> (Kimmo Virtanen) [09:34:18] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [09:49:08] s4 replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 49349.000000 [09:53:28] /sql on cassia is WARNING: DISK WARNING - free space: /sql 104559 MB (8% inode=99%): [09:56:08] RAID on hyacinth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [09:56:48] MySQL slave on z-dat-s3-a is CRITICAL: (Service Check Timed Out) [09:56:48] MySQL on z-dat-s3-a is CRITICAL: (Service Check Timed Out) [09:56:48] RAID on hyacinth is OK: OK - TOTAL: 2: FAILED: 0: DEGRADED: 0 [09:56:57] MySQL slave on z-dat-s3-a is OK: Uptime: 3591370 Threads: 22 Questions: 3790891169 Slow queries: 244256 Opens: 37654971 Flush tables: 1 Open tables: 16384 Queries per second avg: 1055.555 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 209 [09:56:59] MySQL on z-dat-s3-a is OK: Uptime: 3591370 Threads: 23 Questions: 3790891174 Slow queries: 244256 Opens: 37654971 Flush tables: 1 Open tables: 16384 Queries per second avg: 1055.555 [09:58:07] APT on yarrow is CRITICAL: APT CRITICAL: 1 packages available for upgrade (1 critical updates). [10:05:18] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [10:18:49] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [10:22:49] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [10:31:59] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [10:32:48] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 337963 MB (6% inode=35%): [10:33:10] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [10:34:17] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [10:49:09] s4 replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 49438.000000 [10:58:07] APT on yarrow is CRITICAL: APT CRITICAL: 1 packages available for upgrade (1 critical updates). [11:05:18] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [11:19:48] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [11:22:58] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [11:31:58] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [11:32:58] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 337789 MB (6% inode=35%): [11:33:18] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [11:34:20] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [11:49:08] s4 replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 51137.000000 [11:58:18] APT on yarrow is CRITICAL: APT CRITICAL: 1 packages available for upgrade (1 critical updates). [12:05:28] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [12:08:28] Sun Grid Engine execd on wolfsbane is WARNING: short-sol@wolfsbane exceedes load threshold: alarm hl:np_load_short=0.749512/1.10, alarm hl:np_load_long=0.347168/1.55, alarm hl:mem_free=254.000000M/500M, alarm hl:tmp_free=14109M/200M, alarm hl:available=1/0: medium-sol@wolfsbane exceedes load threshold: alarm hl:np_load_short=0.749512/1.00, alarm hl:np_load_long=0.347168/1.50, alarm hl:mem_free=254.000000M/600M, alarm hl:tmp_free= [12:13:28] Sun Grid Engine execd on wolfsbane is OK: short-sol@wolfsbane OK: medium-sol@wolfsbane OK [12:19:49] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [12:23:08] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [12:32:08] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [12:33:09] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 336546 MB (6% inode=35%): [12:33:28] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [12:34:29] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [12:49:17] s4 replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 52760.000000 [12:58:17] APT on yarrow is CRITICAL: APT CRITICAL: 1 packages available for upgrade (1 critical updates). [13:05:39] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [13:19:50] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [13:23:10] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [13:32:10] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [13:33:09] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 336085 MB (6% inode=35%): [13:34:09] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [13:34:20] Free Memory on damiana is WARNING: WARNING - 5.5% (228148 kB) free! [13:34:50] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [13:36:21] Free Memory on damiana is OK: OK - 7.1% (297244 kB) free. [13:49:41] s4 replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 54224.000000 [13:57:51] Sun Grid Engine execd on wolfsbane is WARNING: medium-sol@wolfsbane exceedes load threshold: alarm hl:np_load_short=0.467285/1.00, alarm hl:np_load_long=0.275879/1.50, alarm hl:mem_free=563.000000M/600M, alarm hl:tmp_free=13913M/100M, alarm hl:available=1/0 [13:58:41] APT on yarrow is CRITICAL: APT CRITICAL: 1 packages available for upgrade (1 critical updates). [13:59:50] Sun Grid Engine execd on wolfsbane is OK: short-sol@wolfsbane OK: medium-sol@wolfsbane OK [14:05:51] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [14:06:50] Sun Grid Engine execd on wolfsbane is WARNING: medium-sol@wolfsbane exceedes load threshold: alarm hl:np_load_short=0.500000/1.00, alarm hl:np_load_long=0.390625/1.50, alarm hl:mem_free=570.000000M/600M, alarm hl:tmp_free=13931M/100M, alarm hl:available=1/0 [14:19:51] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [14:23:41] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [14:28:40] Free Memory on damiana is WARNING: WARNING - 6.9% (289084 kB) free! [14:32:44] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [14:33:40] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 336128 MB (6% inode=35%): [14:35:00] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [14:35:01] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [14:49:51] s4 replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 54221.000000 [14:58:51] APT on yarrow is CRITICAL: APT CRITICAL: 1 packages available for upgrade (1 critical updates). [15:05:44] 3(commented) [ACCAPP-523] Content analytics dashboards for WP <10https://jira.toolserver.org/browse/ACCAPP-523> (Marlen Caemmerer) [15:06:03] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [15:15:43] 3(assigned) [ACCAPP-520] PendingChanges tool for finnish Wikipedia <10https://jira.toolserver.org/browse/ACCAPP-520> (Marlen Caemmerer) [15:20:01] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [15:23:50] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [15:29:41] Free Memory on damiana is WARNING: WARNING - 6.4% (267612 kB) free! [15:32:50] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [15:34:48] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 335975 MB (6% inode=35%): [15:35:10] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [15:35:20] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [15:44:20] RAID on adenia is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [15:44:44] 3(commented) [ACCAPP-278] Account creation regarding <10https://jira.toolserver.org/browse/ACCAPP-278> (Marlen Caemmerer) [15:49:39] MySQL slave on z-dat-s6-a is WARNING: SLOW_SLAVE WARNING: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1850 [15:50:50] s4 replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 53676.000000 [15:56:02] John * [Toolserver-l] Login servers [15:59:01] APT on yarrow is CRITICAL: APT CRITICAL: 1 packages available for upgrade (1 critical updates). [16:01:08] [[Special:Log/newusers]] create 10 * Jeffhing34 * (New user account) [16:06:10] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [16:20:10] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [16:24:01] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [16:28:49] RAID on adenia is OK: OK - TOTAL: 2: FAILED: 0: DEGRADED: 0 [16:29:40] Free Memory on damiana is WARNING: WARNING - 6.3% (264700 kB) free! [16:33:01] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [16:34:02] DaB. * Re: [Toolserver-l] Login servers [16:34:51] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 335763 MB (6% inode=35%): [16:35:22] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [16:35:51] Free Memory on damiana is CRITICAL: CRITICAL - 5.0% (209628 kB) free! [16:35:52] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [16:37:50] Free Memory on damiana is WARNING: WARNING - 5.2% (217280 kB) free! [16:40:51] Free Memory on damiana is CRITICAL: CRITICAL - 4.1% (170612 kB) free! [16:49:51] MySQL slave on z-dat-s6-a is WARNING: SLOW_SLAVE WARNING: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 2871 [16:51:00] s4 replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 56611.000000 [16:59:10] APT on yarrow is CRITICAL: APT CRITICAL: 1 packages available for upgrade (1 critical updates). [17:06:21] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [17:14:50] Free Memory on damiana is WARNING: WARNING - 5.8% (243528 kB) free! [17:20:20] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [17:24:00] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [17:29:43] 3(closed) [DRTRIGON-122] Additional options to config sum_disc.py dealing with thread header <10https://jira.toolserver.org/browse/DRTRIGON-122> (drtrigon) [17:32:02] is commons on sql-s1 ? [17:33:05] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [17:35:00] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 335632 MB (6% inode=35%): [17:35:35] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [17:36:22] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [17:36:52] Free Memory on damiana is CRITICAL: CRITICAL - 4.9% (203336 kB) free! [17:37:54] Free Memory on damiana is WARNING: WARNING - 5.9% (245384 kB) free! [17:50:42] MySQL slave on z-dat-s6-a is WARNING: SLOW_SLAVE WARNING: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 2790 [17:51:02] s4 replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 60205.000000 [17:59:32] APT on yarrow is CRITICAL: APT CRITICAL: 1 packages available for upgrade (1 critical updates). [18:00:32] Sun Grid Engine execd on willow is UNKNOWN: CHECK_NRPE: Received 0 bytes from daemon. Check the remote server logs for error messages. [18:01:33] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [18:03:33] Sun Grid Engine execd on wolfsbane is WARNING: medium-sol@wolfsbane exceedes load threshold: alarm hl:np_load_short=0.372070/1.00, alarm hl:np_load_long=0.236328/1.50, alarm hl:mem_free=526.000000M/600M, alarm hl:tmp_free=13775M/100M, alarm hl:available=1/0 [18:05:20] Free Memory on damiana is CRITICAL: CRITICAL - 3.3% (139664 kB) free! [18:06:29] Sun Grid Engine execd on wolfsbane is OK: short-sol@wolfsbane OK: medium-sol@wolfsbane OK [18:20:28] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [18:24:19] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [18:32:31] 3(created) [DRTRIGON-123] sum_disc: all related issues; DrTrigon's tools: DrTrigonBot - pywikipedia; Improvement <10https://jira.toolserver.org/browse/DRTRIGON-123> (drtrigon) [18:32:41] 3(updated) [DRTRIGON-24] F47 (copied from wiki, priority 3) <10https://jira.toolserver.org/browse/DRTRIGON-24> (drtrigon) [18:34:41] 3(updated) [DRTRIGON-32] 30 (copied from wiki) <10https://jira.toolserver.org/browse/DRTRIGON-32> (drtrigon) [18:36:37] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [18:37:43] 3(updated) [DRTRIGON-18] F56 (copied from wiki) <10https://jira.toolserver.org/browse/DRTRIGON-18> (drtrigon) [18:37:45] 3(updated) [DRTRIGON-31] 18 (copied from wiki) <10https://jira.toolserver.org/browse/DRTRIGON-31> (drtrigon) [18:37:46] 3(updated) [DRTRIGON-90] sequence of sometimes occuring "KeyError: u'parse'" <10https://jira.toolserver.org/browse/DRTRIGON-90> (drtrigon) [18:48:43] 3(updated) [DRTRIGON-24] F47 (copied from wiki, priority 3) <10https://jira.toolserver.org/browse/DRTRIGON-24> (drtrigon) [18:48:45] 3(updated) [DRTRIGON-32] 30 (copied from wiki) <10https://jira.toolserver.org/browse/DRTRIGON-32> (drtrigon) [18:49:54] [[List of Wikimedia bots]] ! 10https://wiki.toolserver.org/w/index.php?diff=7373&oldid=7195&rcid=9934 * Bishnu Saikia * (+78) (/* {{#language:as}} */ ) [18:50:44] 3(updated) [DRTRIGON-86] Test the re-write branch an decide what parts to migrate <10https://jira.toolserver.org/browse/DRTRIGON-86> (drtrigon) [18:51:06] s4 replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 63812.000000 [18:51:36] MySQL slave on z-dat-s6-a is WARNING: SLOW_SLAVE WARNING: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 3110 [19:00:16] APT on yarrow is CRITICAL: APT CRITICAL: 1 packages available for upgrade (1 critical updates). [19:01:36] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [19:11:02] Platonides * Re: [Toolserver-l] Login servers [19:12:36] RAID on hyacinth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [19:13:17] RAID on hyacinth is OK: OK - TOTAL: 2: FAILED: 0: DEGRADED: 0 [19:14:17] /sql on thyme is WARNING: DISK WARNING - free space: /sql 198358 MB (20% inode=99%): [19:14:58] MySQL slave on z-dat-s6-a is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 3625 [19:20:58] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [19:24:47] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [19:28:08] SSH on z-dat-s4-a is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:28:08] SSH on z-dat-s6-a is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:28:17] SSH on z-dat-s7-a is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:28:18] SSH on z-dat-s3-a is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:28:28] Load avg. on hyacinth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [19:28:28] SMF on z-dat-s7-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [19:28:28] SMF on z-dat-s6-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [19:28:28] Environment IPMI on hyacinth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [19:28:36] RAID on hyacinth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [19:28:47] Load avg. on z-dat-s3-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [19:28:48] Load avg. on z-dat-s4-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [19:28:48] /tmp on z-dat-s7-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [19:28:48] /tmp on z-dat-s6-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [19:28:48] Load avg. on z-dat-s7-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [19:28:48] Load avg. on z-dat-s6-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [19:28:59] SMF on z-dat-s7-a is OK: OK - all services online [19:29:18] s4 replag on z-dat-s4-a is CRITICAL: (Service Check Timed Out) [19:29:18] / on hyacinth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [19:29:18] /tmp on hyacinth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [19:29:19] Load avg. on z-dat-s4-a is OK: OK - load average: 0.23, 1.32, 1.84 [19:29:19] /tmp on z-dat-s7-a is OK: DISK OK - free space: /tmp 1951 MB (99% inode=99%): [19:29:19] /tmp on z-dat-s6-a is OK: DISK OK - free space: /tmp 1952 MB (99% inode=99%): [19:29:19] Load avg. on z-dat-s7-a is OK: OK - load average: 0.21, 1.29, 1.83 [19:29:19] Load avg. on z-dat-s6-a is OK: OK - load average: 0.21, 1.29, 1.83 [19:29:38] Load avg. on z-dat-s3-a is OK: OK - load average: 0.17, 1.24, 1.81 [19:29:38] s4 replag on z-dat-s4-a is OK: QUERY OK: SELECT ts_rc_age() returned 214.000000 [19:29:47] MySQL on z-dat-s6-a is CRITICAL: (Service Check Timed Out) [19:29:47] /tmp on hyacinth is OK: DISK OK - free space: /tmp 2004 MB (100% inode=99%): [19:29:47] / on hyacinth is OK: DISK OK - free space: / 8242 MB (27% inode=85%): [19:29:58] MySQL on z-dat-s6-a is OK: Uptime: 282845 Threads: 21 Questions: 67373893 Slow queries: 20723 Opens: 540343 Flush tables: 1 Open tables: 2587 Queries per second avg: 238.200 [19:29:58] Load avg. on hyacinth is OK: OK - load average: 1.06, 1.35, 1.83 [19:29:58] SMF on z-dat-s6-a is OK: OK - all services online [19:30:07] SSH on z-dat-s6-a is OK: SSH OK - OpenSSH_5.8p2-hpn13v11 (protocol 2.0) [19:30:07] SSH on z-dat-s4-a is OK: SSH OK - OpenSSH_5.8p2-hpn13v11 (protocol 2.0) [19:30:08] SSH on z-dat-s7-a is OK: SSH OK - OpenSSH_5.8p2-hpn13v11 (protocol 2.0) [19:30:08] SSH on z-dat-s3-a is OK: SSH OK - OpenSSH_5.8p2-hpn13v11 (protocol 2.0) [19:30:17] Environment IPMI on hyacinth is OK: ok: temperature ok fan ok voltage ok chassis ok [19:36:08] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 336073 MB (6% inode=35%): [19:36:08] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [19:36:17] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [19:36:37] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [19:51:07] s4 replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 64623.000000 [19:55:07] SMTP on z-dat-s6-a is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:55:19] SSH on z-dat-s6-a is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:55:19] SSH on z-dat-s3-a is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:55:19] SSH on z-dat-s7-a is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:55:19] SSH on z-dat-s4-a is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:55:37] /sql on z-dat-s4-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [19:55:37] / on z-dat-s6-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [19:55:37] / on z-dat-s7-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [19:55:37] / on z-dat-s3-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [19:55:37] /sql on z-dat-s3-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [19:55:37] / on z-dat-s4-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [19:55:37] SMF on z-dat-s6-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [19:55:38] /sql on z-dat-s6-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [19:55:38] /sql on z-dat-s7-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [19:55:39] /tmp on z-dat-s4-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [19:55:39] /tmp on z-dat-s3-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [19:55:40] RAID on hyacinth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [19:55:47] Load avg. on z-dat-s3-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [19:55:47] /tmp on z-dat-s7-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [19:55:48] Load avg. on z-dat-s4-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [19:55:48] /tmp on z-dat-s6-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [19:55:48] Load avg. on z-dat-s7-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [19:55:48] Load avg. on z-dat-s6-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [19:56:08] SSH on z-dat-s6-a is OK: SSH OK - OpenSSH_5.8p2-hpn13v11 (protocol 2.0) [19:56:08] / on z-dat-s3-a is OK: DISK OK - free space: / 8244 MB (27% inode=85%): [19:56:08] / on z-dat-s6-a is OK: DISK OK - free space: / 8244 MB (27% inode=85%): [19:56:08] / on z-dat-s4-a is OK: DISK OK - free space: / 8244 MB (27% inode=85%): [19:56:08] SMF on z-dat-s6-a is OK: OK - all services online [19:56:08] /sql on z-dat-s6-a is OK: DISK OK - free space: /sql 124643 MB (12% inode=98%): [19:56:08] /sql on z-dat-s7-a is OK: DISK OK - free space: /sql 79142 MB (19% inode=99%): [19:56:09] /tmp on z-dat-s4-a is OK: DISK OK - free space: /tmp 1923 MB (99% inode=99%): [19:56:09] /tmp on z-dat-s3-a is OK: DISK OK - free space: /tmp 1923 MB (99% inode=99%): [19:56:10] /sql on z-dat-s3-a is OK: DISK OK - free space: /sql 124643 MB (12% inode=98%): [19:56:10] / on z-dat-s7-a is OK: DISK OK - free space: / 8244 MB (27% inode=85%): [19:56:11] /sql on z-dat-s4-a is OK: DISK OK - free space: /sql 68977 MB (17% inode=99%): [19:56:18] / on hyacinth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [19:56:18] /tmp on hyacinth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [19:56:18] /tmp on z-dat-s7-a is OK: DISK OK - free space: /tmp 1919 MB (99% inode=99%): [19:56:18] Load avg. on z-dat-s4-a is OK: OK - load average: 0.36, 2.10, 2.74 [19:56:18] /tmp on z-dat-s6-a is OK: DISK OK - free space: /tmp 1922 MB (99% inode=99%): [19:56:18] Load avg. on z-dat-s7-a is OK: OK - load average: 0.38, 2.08, 2.73 [19:56:18] Load avg. on z-dat-s6-a is OK: OK - load average: 0.38, 2.08, 2.73 [19:56:27] Load avg. on z-dat-s3-a is OK: OK - load average: 0.39, 2.06, 2.72 [19:56:28] RAID on hyacinth is OK: OK - TOTAL: 2: FAILED: 0: DEGRADED: 0 [19:56:47] / on hyacinth is OK: DISK OK - free space: / 8242 MB (27% inode=85%): [19:56:48] /tmp on hyacinth is OK: DISK OK - free space: /tmp 1857 MB (99% inode=99%): [19:56:57] SMTP on z-dat-s6-a is OK: SMTP OK - 0.035 sec. response time [19:57:08] SSH on z-dat-s4-a is OK: SSH OK - OpenSSH_5.8p2-hpn13v11 (protocol 2.0) [19:57:08] SSH on z-dat-s7-a is OK: SSH OK - OpenSSH_5.8p2-hpn13v11 (protocol 2.0) [19:57:08] SSH on z-dat-s3-a is OK: SSH OK - OpenSSH_5.8p2-hpn13v11 (protocol 2.0) [20:00:17] APT on yarrow is CRITICAL: APT CRITICAL: 1 packages available for upgrade (1 critical updates). [20:01:47] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [20:15:35] MySQL slave on z-dat-s6-a is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 4386 [20:21:13] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [20:25:46] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [20:26:35] MySQL slave on z-dat-s6-a is WARNING: SLOW_SLAVE WARNING: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 3491 [20:36:30] Is there a set date that you are planning to fix nightshade by? It's been a few months now and there haven't been any updates on its status. [20:36:40] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 336143 MB (6% inode=35%): [20:36:40] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [20:37:02] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [20:37:12] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [20:37:47] Seahorse: no, its in progress [20:37:56] see the recent email thread [20:38:18] alright, thanks. [20:51:58] s4 replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 65729.000000 [20:52:59] MySQL slave on z-dat-s6-a is OK: Uptime: 287826 Threads: 13 Questions: 68001475 Slow queries: 21038 Opens: 546905 Flush tables: 1 Open tables: 2587 Queries per second avg: 236.258 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1777 [20:55:02] DaB. * Re: [Toolserver-l] Login servers [21:01:00] APT on yarrow is CRITICAL: APT CRITICAL: 1 packages available for upgrade (1 critical updates). [21:02:00] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [21:21:18] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [21:21:57] Ok, I think Im doing something wrong with my query, what is the fastest way to find all transclusions of a template via mysql? [21:24:45] never mind, Im an idiot [21:24:57] /facepalm [21:25:59] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [21:37:00] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [21:37:00] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [21:37:29] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [21:37:40] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 337203 MB (6% inode=35%): [21:51:59] s4 replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 65252.000000 [21:54:19] /sql on cassia is WARNING: DISK WARNING - free space: /sql 104969 MB (8% inode=99%): [22:01:00] APT on yarrow is CRITICAL: APT CRITICAL: 1 packages available for upgrade (1 critical updates). [22:02:09] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [22:04:42] Betacommand hah [22:04:46] I thought I was the idiot [22:05:33] ToAruShiroiNeko: I forgot to specify the namespace, so queries that should have taken 2 seconds to run where talking several minutes [22:15:22] Betacommand aw [22:21:29] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [22:26:19] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [22:31:02] Platonides * Re: [Toolserver-l] Login servers [22:37:21] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [22:37:21] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [22:37:50] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 335005 MB (6% inode=35%): [22:38:00] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [22:52:10] s4 replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 64434.000000 [23:00:21] Sun Grid Engine execd on willow is UNKNOWN: CHECK_NRPE: Received 0 bytes from daemon. Check the remote server logs for error messages. [23:00:21] SMF on willow is UNKNOWN: CHECK_NRPE: Received 0 bytes from daemon. Check the remote server logs for error messages. [23:01:20] APT on yarrow is CRITICAL: APT CRITICAL: 1 packages available for upgrade (1 critical updates). [23:01:20] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [23:01:20] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [23:21:51] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [23:26:21] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [23:37:26] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [23:38:15] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 333645 MB (6% inode=35%): [23:38:25] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [23:52:25] s4 replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 60644.000000