[00:00:25] wikidata replag on z-dat-s7-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 39657.000000 [00:02:07] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 39691.000000 [00:02:08] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 74594.000000 [00:03:16] s4 replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 39662.000000 [00:03:25] wikidata replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 39748.000000 [00:04:44] s4 replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 311855.000000 [00:10:16] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [00:10:35] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [00:12:02] DaBPunkt, sge was disable after nightshade reboot 'cause of some trouble with ldap, look like solved now, but I dunno the details [00:12:35] / on damiana is CRITICAL: DISK CRITICAL - free space: / 7827 MB (10% inode=95%): [00:16:06] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [00:18:25] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 74617 [00:28:07] /mnt user-store on rosemary is WARNING: DISK WARNING - free space: /mnt 499943 MB (9% inode=66%): [00:28:15] wikidata replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 90206.000000 [00:28:15] NTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:29:07] aliasd on yarrow is CRITICAL: Connection refused [00:30:15] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [00:37:08] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [00:39:35] / on damiana is OK: DISK OK - free space: / 39323 MB (54% inode=95%): [00:47:16] wikidata replag on z-dat-s2-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 19536.000000 [00:52:25] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 80722 MB (13% inode=99%): [00:53:15] wikidata replag on z-dat-s6-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 12424.000000 [00:54:07] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [00:58:34] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [00:58:44] NTP on sage is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:59:08] Sun Grid Engine execd on nightshade is CRITICAL: CRITICAL: execd not communicating [01:00:25] wikidata replag on z-dat-s7-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 37707.000000 [01:03:07] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 37618.000000 [01:03:07] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 75207.000000 [01:03:25] wikidata replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 37593.000000 [01:04:14] s4 replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 25120.000000 [01:04:44] s4 replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 304132.000000 [01:07:06] /sql on rosemary is CRITICAL: DISK CRITICAL - free space: /sql 35295 MB (3% inode=99%): [01:10:35] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [01:11:15] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [01:18:25] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 75400 [01:28:16] wikidata replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 87033.000000 [01:28:16] NTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:29:06] /mnt user-store on rosemary is WARNING: DISK WARNING - free space: /mnt 502757 MB (9% inode=66%): [01:29:06] aliasd on yarrow is CRITICAL: Connection refused [01:30:16] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [01:37:07] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [01:46:07] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [01:47:16] wikidata replag on z-dat-s2-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 17484.000000 [01:52:25] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 78481 MB (12% inode=99%): [01:53:15] wikidata replag on z-dat-s6-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 12795.000000 [01:54:07] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [01:57:07] Sun Grid Engine execd on nightshade is OK: Host and Queues Ok [01:57:56] started sge on nightshade [01:58:34] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A: [01:58:45] NTP on sage is CRITICAL: CRITICAL - Socket timeout after 10 seconds [02:01:25] wikidata replag on z-dat-s7-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 35463.000000 [02:03:07] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 35394.000000 [02:03:07] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 76347.000000 [02:03:25] wikidata replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 35378.000000 [02:04:16] s4 replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 10572.000000 [02:04:44] s4 replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 282424.000000 [02:10:34] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [02:11:16] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [02:18:25] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 76584 [02:29:07] /mnt user-store on rosemary is WARNING: DISK WARNING - free space: /mnt 500903 MB (9% inode=66%): [02:29:07] aliasd on yarrow is CRITICAL: Connection refused [02:29:15] wikidata replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 83905.000000 [02:29:15] NTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [02:30:16] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [02:37:06] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [02:39:15] s4 replag on cassia is WARNING: QUERY WARNING: SELECT ts_rc_age() returned 3590.000000 [02:41:58] nacht ts [02:46:06] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [02:48:15] wikidata replag on z-dat-s2-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 15417.000000 [02:52:25] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 80214 MB (13% inode=99%): [02:53:15] wikidata replag on z-dat-s6-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 13447.000000 [02:54:07] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [02:58:35] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [02:59:44] NTP on sage is CRITICAL: CRITICAL - Socket timeout after 10 seconds [03:01:25] wikidata replag on z-dat-s7-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 33139.000000 [03:03:25] wikidata replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 33059.000000 [03:04:08] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 33036.000000 [03:04:08] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 76952.000000 [03:04:44] s4 replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 274405.000000 [03:10:34] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [03:11:16] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [03:16:15] s4 replag on cassia is OK: QUERY OK: SELECT ts_rc_age() returned 960.000000 [03:18:25] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 77202 [03:26:26] [[Category:Tools]] !M 10https://wiki.toolserver.org/w/index.php?diff=7889&oldid=7816&rcid=21722 * DGideas * (+3) () [03:29:07] /mnt user-store on rosemary is WARNING: DISK WARNING - free space: /mnt 502133 MB (9% inode=66%): [03:29:07] aliasd on yarrow is CRITICAL: Connection refused [03:29:15] wikidata replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 79969.000000 [03:29:15] NTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [03:30:16] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [03:37:15] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [03:46:08] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [03:48:15] wikidata replag on z-dat-s2-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 16891.000000 [03:52:25] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 79956 MB (13% inode=99%): [03:52:25] /sql on z-dat-s7-a is WARNING: DISK WARNING - free space: /sql 49977 MB (9% inode=99%): [03:53:15] wikidata replag on z-dat-s6-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 13034.000000 [03:54:07] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [03:58:36] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [03:59:44] NTP on sage is CRITICAL: CRITICAL - Socket timeout after 10 seconds [04:01:25] wikidata replag on z-dat-s7-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 30712.000000 [04:03:25] wikidata replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 30627.000000 [04:04:07] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 30602.000000 [04:04:07] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 78164.000000 [04:04:44] s4 replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 270994.000000 [04:10:36] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [04:11:16] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [04:18:37] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 78505 [04:29:06] /mnt user-store on rosemary is WARNING: DISK WARNING - free space: /mnt 501247 MB (9% inode=66%): [04:29:06] aliasd on yarrow is CRITICAL: Connection refused [04:30:19] wikidata replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 77078.000000 [04:30:19] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [04:30:19] NTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [04:38:16] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [04:48:16] wikidata replag on z-dat-s2-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 15372.000000 [04:52:36] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 79688 MB (13% inode=99%): [04:52:36] Load avg. on ortelius is CRITICAL: CRITICAL - load average: 23.21, 42.18, 23.68 [04:53:15] wikidata replag on z-dat-s6-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 11214.000000 [04:54:07] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [04:55:36] Load avg. on ortelius is WARNING: WARNING - load average: 4.95, 24.56, 19.91 [04:58:36] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [04:59:53] NTP on sage is CRITICAL: CRITICAL - Socket timeout after 10 seconds [05:01:36] wikidata replag on z-dat-s7-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 27889.000000 [05:01:36] Load avg. on ortelius is OK: OK - load average: 4.05, 9.89, 14.52 [05:03:36] wikidata replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 27807.000000 [05:04:45] s4 replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 246259.000000 [05:05:06] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 27753.000000 [05:05:06] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 80245.000000 [05:10:35] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [05:11:25] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [05:16:06] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [05:18:35] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 80407 [05:30:06] /mnt user-store on rosemary is WARNING: DISK WARNING - free space: /mnt 502235 MB (9% inode=66%): [05:30:06] aliasd on yarrow is CRITICAL: Connection refused [05:30:25] NTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [05:31:16] wikidata replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 74091.000000 [05:31:16] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [05:39:16] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [05:48:16] wikidata replag on z-dat-s2-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 13102.000000 [05:52:36] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 79403 MB (13% inode=99%): [05:53:16] wikidata replag on z-dat-s6-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 9089.000000 [05:54:06] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [05:58:36] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [05:59:53] NTP on sage is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:01:35] wikidata replag on z-dat-s7-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 25537.000000 [06:03:36] wikidata replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 25446.000000 [06:04:44] s4 replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 231279.000000 [06:06:06] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 25361.000000 [06:06:06] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 81405.000000 [06:10:36] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [06:11:25] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [06:16:06] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [06:18:35] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 81581 [06:30:06] aliasd on yarrow is CRITICAL: Connection refused [06:30:06] /mnt user-store on rosemary is WARNING: DISK WARNING - free space: /mnt 502168 MB (9% inode=66%): [06:30:37] NTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:31:15] wikidata replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 71971.000000 [06:31:16] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [06:40:15] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [06:49:15] wikidata replag on z-dat-s2-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 10723.000000 [06:52:36] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 79125 MB (12% inode=99%): [06:54:14] wikidata replag on z-dat-s6-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 6180.000000 [06:55:06] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [06:58:36] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A: [06:59:54] NTP on sage is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:01:36] wikidata replag on z-dat-s7-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 23242.000000 [07:03:36] wikidata replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 23041.000000 [07:04:44] s4 replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 218300.000000 [07:07:06] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 22895.000000 [07:07:06] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 82164.000000 [07:10:35] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [07:11:25] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [07:16:06] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [07:18:36] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 82265 [07:30:05] aliasd on yarrow is CRITICAL: Connection refused [07:30:05] /mnt user-store on rosemary is WARNING: DISK WARNING - free space: /mnt 502159 MB (9% inode=66%): [07:30:36] NTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:31:16] wikidata replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 70367.000000 [07:31:16] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [07:40:25] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [07:46:15] wikidata replag on z-dat-s6-a is WARNING: QUERY WARNING: SELECT ts_rc_age() returned 3535.000000 [07:49:05] /sql on z-dat-s7-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [07:49:16] wikidata replag on z-dat-s2-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 10137.000000 [07:50:16] wikidata replag on z-dat-s6-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 3647.000000 [07:50:35] /sql on z-dat-s7-a is WARNING: DISK WARNING - free space: /sql 49757 MB (9% inode=99%): [07:53:35] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 78797 MB (12% inode=99%): [07:55:06] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [07:55:25] wikidata replag on z-dat-s6-a is WARNING: QUERY WARNING: SELECT ts_rc_age() returned 3583.000000 [07:59:35] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [07:59:54] NTP on sage is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:01:45] wikidata replag on z-dat-s7-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 21469.000000 [08:04:35] wikidata replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 21151.000000 [08:04:45] s4 replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 195037.000000 [08:07:06] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 21070.000000 [08:07:06] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 83019.000000 [08:11:25] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [08:11:35] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [08:19:35] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 83470 [08:22:25] wikidata replag on z-dat-s6-a is OK: QUERY OK: SELECT ts_rc_age() returned 1758.000000 [08:30:05] aliasd on yarrow is CRITICAL: Connection refused [08:30:06] /mnt user-store on rosemary is WARNING: DISK WARNING - free space: /mnt 501923 MB (9% inode=66%): [08:30:36] NTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:31:15] wikidata replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 69381.000000 [08:31:15] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [08:41:24] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [08:46:04] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [08:50:14] wikidata replag on z-dat-s2-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 7916.000000 [08:54:33] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 78509 MB (12% inode=99%): [08:56:04] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [08:59:54] NTP on sage is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:00:34] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A: [09:02:43] wikidata replag on z-dat-s7-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 19196.000000 [09:05:34] wikidata replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 18900.000000 [09:05:44] s4 replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 176721.000000 [09:08:04] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 18865.000000 [09:08:04] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 84855.000000 [09:12:24] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [09:12:34] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [09:16:04] /sql on z-dat-s7-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [09:16:33] /sql on z-dat-s7-a is WARNING: DISK WARNING - free space: /sql 50038 MB (9% inode=99%): [09:20:34] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 85084 [09:26:04] /sql on z-dat-s7-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [09:31:04] aliasd on yarrow is CRITICAL: Connection refused [09:31:04] /mnt user-store on rosemary is WARNING: DISK WARNING - free space: /mnt 501698 MB (9% inode=66%): [09:31:33] NTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:32:14] wikidata replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 67799.000000 [09:32:14] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [09:33:04] aliasd on yarrow is OK: TCP OK - 0.002 second response time on port 984 [500 Not found.] [09:41:24] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [09:45:33] /sql on z-dat-s7-a is WARNING: DISK WARNING - free space: /sql 49921 MB (9% inode=99%): [09:46:04] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [09:50:14] wikidata replag on z-dat-s2-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 6908.000000 [09:54:34] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 78204 MB (12% inode=99%): [09:56:04] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [09:59:54] NTP on sage is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:00:33] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (3 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.CommunicationLost.desc: [10:03:04] wikidata replag on z-dat-s7-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 16637.000000 [10:05:40] wikidata replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 16063.000000 [10:05:43] s4 replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 159273.000000 [10:07:26] [[Main Page/lang]] ! 10https://wiki.toolserver.org/w/index.php?diff=7890&oldid=7876&rcid=21723 * CoderSI * (+35) () [10:08:04] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 86056.000000 [10:08:04] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 15943.000000 [10:12:23] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [10:12:33] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [10:20:33] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 86300 [10:31:03] /mnt user-store on rosemary is WARNING: DISK WARNING - free space: /mnt 501398 MB (9% inode=66%): [10:31:34] NTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:32:14] wikidata replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 65509.000000 [10:32:14] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [10:41:24] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [10:46:04] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [10:50:14] wikidata replag on z-dat-s2-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 5961.000000 [10:54:34] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 77844 MB (12% inode=99%): [10:56:04] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [10:59:53] NTP on sage is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:00:34] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [11:03:04] wikidata replag on z-dat-s7-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 12641.000000 [11:05:34] wikidata replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 12014.000000 [11:05:44] s4 replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 145034.000000 [11:08:04] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 11843.000000 [11:08:04] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 87170.000000 [11:08:14] SSH on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:12:24] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [11:12:34] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [11:20:33] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 87305 [11:31:05] /mnt user-store on rosemary is WARNING: DISK WARNING - free space: /mnt 500678 MB (9% inode=66%): [11:31:34] NTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:32:14] wikidata replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 63237.000000 [11:32:14] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [11:41:25] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [11:46:14] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [11:50:14] wikidata replag on z-dat-s2-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 7815.000000 [11:54:33] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 77479 MB (12% inode=99%): [11:56:04] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [11:59:53] NTP on sage is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:00:34] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (3 errors): null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.CommunicationLost.desc:S3:oob:S4:2530:S9:ts-array5:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.descri [12:03:04] wikidata replag on z-dat-s7-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 9855.000000 [12:05:34] wikidata replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 9494.000000 [12:05:44] s4 replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 146808.000000 [12:08:03] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 9431.000000 [12:08:03] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 88008.000000 [12:08:13] SSH on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:12:24] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [12:12:34] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [12:20:34] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 88370 [12:22:14] MySQL slave on z-dat-s6-a is WARNING: SLOW_SLAVE WARNING: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1945 [12:22:44] MySQL slave on z-dat-s5-b is WARNING: SLOW_SLAVE WARNING: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 2068 [12:22:54] wikidata replag on z-dat-s5-b is WARNING: QUERY WARNING: SELECT ts_rc_age() returned 2071.000000 [12:26:43] wikidata replag on z-dat-s6-a is WARNING: QUERY WARNING: SELECT ts_rc_age() returned 1927.000000 [12:31:04] /mnt user-store on rosemary is WARNING: DISK WARNING - free space: /mnt 500401 MB (9% inode=66%): [12:31:34] NTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:32:14] wikidata replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 61325.000000 [12:32:14] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [12:35:44] MySQL slave on z-dat-s5-b is OK: Uptime: 49959 Threads: 7 Questions: 129764339 Slow queries: 496 Opens: 63788 Flush tables: 1 Open tables: 256 Queries per second avg: 2597.416 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1739 [12:35:54] wikidata replag on z-dat-s5-b is OK: QUERY OK: SELECT ts_rc_age() returned 1708.000000 [12:41:24] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [12:43:14] MySQL slave on z-dat-s6-a is OK: Uptime: 4234826 Threads: 7 Questions: 2334113000 Slow queries: 248063 Opens: 7499700 Flush tables: 1 Open tables: 4273 Queries per second avg: 551.170 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1784 [12:50:14] wikidata replag on z-dat-s2-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 7330.000000 [12:54:34] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 77112 MB (12% inode=99%): [12:55:04] SSH on yucca is OK: SSH OK - OpenSSH_5.5p1 Debian-6+squeeze3 (protocol 2.0) [12:56:04] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [12:58:44] wikidata replag on z-dat-s6-a is OK: QUERY OK: SELECT ts_rc_age() returned 1800.000000 [12:59:54] NTP on sage is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:00:34] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A: [13:03:04] wikidata replag on z-dat-s7-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 7702.000000 [13:05:34] wikidata replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 7109.000000 [13:05:44] s4 replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 141369.000000 [13:08:05] /sql on rosemary is CRITICAL: DISK CRITICAL - free space: /sql 34324 MB (3% inode=99%): [13:08:05] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 6986.000000 [13:08:05] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 89435.000000 [13:12:24] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [13:12:34] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [13:16:04] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [13:20:37] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 89719 [13:31:04] /mnt user-store on rosemary is WARNING: DISK WARNING - free space: /mnt 499670 MB (9% inode=66%): [13:31:34] NTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:32:14] wikidata replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 58625.000000 [13:32:14] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [13:38:08] Dr. Trigon * Re: [Toolserver-l] mayapple config & cron jobs [13:41:24] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [13:50:14] wikidata replag on z-dat-s2-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 9298.000000 [13:54:34] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 76744 MB (12% inode=99%): [13:56:04] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [13:59:54] NTP on sage is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:00:34] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [14:03:04] wikidata replag on z-dat-s7-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 5721.000000 [14:05:34] wikidata replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 5317.000000 [14:05:43] s4 replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 119105.000000 [14:08:04] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 5265.000000 [14:08:04] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 89419.000000 [14:12:24] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [14:12:34] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [14:16:04] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [14:20:34] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 89236 [14:31:03] /mnt user-store on rosemary is WARNING: DISK WARNING - free space: /mnt 499739 MB (9% inode=66%): [14:31:33] NTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:32:14] wikidata replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 56213.000000 [14:32:14] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [14:41:56] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [14:50:14] wikidata replag on z-dat-s2-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 9147.000000 [14:54:34] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 76345 MB (12% inode=99%): [14:56:04] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [14:59:53] NTP on sage is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:00:34] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A: [15:01:51] Hello room [15:02:08] s/room/channel [15:02:19] Hi Jeremt [15:02:24] jeremy [15:03:05] wikidata replag on z-dat-s7-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 4779.000000 [15:03:13] Are you an Account Creator? [15:04:02] ... [15:04:10] if you have a question just ask it [15:05:35] wikidata replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 4397.000000 [15:05:44] s4 replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 93162.000000 [15:05:58] Well I got the account creator flag because as a Online Ambassador I may need it but, I wanted to know how to set up the accounts for other users. [15:08:05] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 89362.000000 [15:08:05] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 4361.000000 [15:12:10] TucsonDavid: that doesn't seem relevant to this channel in any way [15:12:20] TucsonDavid: try #wikipedia-en [15:12:24] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [15:12:34] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [15:16:04] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [15:20:36] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 89792 [15:31:04] /mnt user-store on rosemary is WARNING: DISK WARNING - free space: /mnt 499455 MB (9% inode=66%): [15:31:34] NTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:32:13] wikidata replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 54006.000000 [15:32:13] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [15:41:26] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [15:50:14] wikidata replag on z-dat-s2-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 11151.000000 [15:54:33] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 75966 MB (12% inode=99%): [15:56:04] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [15:59:53] NTP on sage is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:00:34] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [16:03:04] wikidata replag on z-dat-s7-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 4759.000000 [16:05:34] wikidata replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 4472.000000 [16:05:44] s4 replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 78401.000000 [16:08:04] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 89717.000000 [16:08:04] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 4513.000000 [16:12:24] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [16:12:34] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [16:16:04] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [16:20:34] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 89769 [16:27:52] !replag [16:28:03] (" ) [16:28:06] ( ") [16:31:04] /mnt user-store on rosemary is WARNING: DISK WARNING - free space: /mnt 499113 MB (9% inode=66%): [16:31:34] NTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:32:13] wikidata replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 51525.000000 [16:32:13] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [16:32:51] @replag [16:33:01] (" ) [16:33:03] ( ") [16:33:11] Jim, he's dead! [16:41:24] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [16:50:14] wikidata replag on z-dat-s2-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 11454.000000 [16:54:34] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 75661 MB (12% inode=99%): [16:56:03] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [16:57:35] APT on yarrow is CRITICAL: APT CRITICAL: 9 packages available for upgrade (9 critical updates). [16:59:54] NTP on sage is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:00:34] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [17:03:04] wikidata replag on z-dat-s7-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 4709.000000 [17:05:34] wikidata replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 4412.000000 [17:05:44] s4 replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 64290.000000 [17:08:05] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 4378.000000 [17:08:05] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 89479.000000 [17:12:24] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [17:12:34] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [17:16:04] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [17:20:34] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 89347 [17:31:04] /mnt user-store on rosemary is WARNING: DISK WARNING - free space: /mnt 498746 MB (9% inode=66%): [17:31:34] NTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:32:14] wikidata replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 49316.000000 [17:32:14] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [17:41:26] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [17:50:14] wikidata replag on z-dat-s2-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 11360.000000 [17:54:34] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 75329 MB (12% inode=99%): [17:56:04] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [17:57:44] APT on yarrow is CRITICAL: APT CRITICAL: 9 packages available for upgrade (9 critical updates). [17:59:34] APT on nightshade is CRITICAL: APT CRITICAL: 9 packages available for upgrade (9 critical updates). [17:59:54] NTP on sage is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:00:34] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A: [18:03:04] wikidata replag on z-dat-s7-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 4125.000000 [18:05:34] wikidata replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 3736.000000 [18:05:44] s4 replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 57922.000000 [18:08:04] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 88853.000000 [18:08:04] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 3695.000000 [18:12:23] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [18:12:33] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [18:13:34] wikidata replag on cassia is WARNING: QUERY WARNING: SELECT ts_rc_age() returned 3592.000000 [18:14:05] wikidata replag on daphne is WARNING: QUERY WARNING: SELECT ts_rc_age() returned 3577.000000 [18:16:05] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [18:20:34] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 89081 [18:31:05] /mnt user-store on rosemary is WARNING: DISK WARNING - free space: /mnt 498511 MB (9% inode=66%): [18:31:34] NTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:32:14] wikidata replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 46175.000000 [18:32:14] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [18:34:04] wikidata replag on z-dat-s7-a is WARNING: QUERY WARNING: SELECT ts_rc_age() returned 3599.000000 [18:41:23] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [18:50:14] wikidata replag on z-dat-s2-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 12507.000000 [18:54:34] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 74943 MB (12% inode=99%): [18:56:04] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [18:58:44] APT on yarrow is CRITICAL: APT CRITICAL: 9 packages available for upgrade (9 critical updates). [18:59:34] APT on nightshade is CRITICAL: APT CRITICAL: 9 packages available for upgrade (9 critical updates). [18:59:53] NTP on sage is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:00:34] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [19:05:44] s4 replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 41347.000000 [19:08:04] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 89184.000000 [19:12:03] wikidata replag on daphne is OK: QUERY OK: SELECT ts_rc_age() returned 1793.000000 [19:12:24] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [19:12:34] wikidata replag on cassia is OK: QUERY OK: SELECT ts_rc_age() returned 1785.000000 [19:12:34] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [19:16:04] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [19:20:33] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 89118 [19:31:04] /mnt user-store on rosemary is WARNING: DISK WARNING - free space: /mnt 498237 MB (9% inode=66%): [19:31:34] NTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:32:14] wikidata replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 42896.000000 [19:32:14] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [19:34:03] wikidata replag on z-dat-s7-a is WARNING: QUERY WARNING: SELECT ts_rc_age() returned 2007.000000 [19:41:24] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [19:42:04] wikidata replag on z-dat-s7-a is OK: QUERY OK: SELECT ts_rc_age() returned 1781.000000 [19:50:14] wikidata replag on z-dat-s2-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 13208.000000 [19:54:33] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 74546 MB (12% inode=99%): [19:56:04] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [19:59:34] APT on nightshade is CRITICAL: APT CRITICAL: 9 packages available for upgrade (9 critical updates). [19:59:34] APT on yarrow is CRITICAL: APT CRITICAL: 9 packages available for upgrade (9 critical updates). [19:59:54] NTP on sage is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:00:34] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A: [20:05:44] s4 replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 16568.000000 [20:08:05] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 88519.000000 [20:12:24] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [20:12:34] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [20:16:04] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [20:20:34] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 88655 [20:31:04] /mnt user-store on rosemary is WARNING: DISK WARNING - free space: /mnt 497938 MB (9% inode=65%): [20:31:33] NTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:32:14] wikidata replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 40524.000000 [20:32:14] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [20:41:24] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [20:42:04] wikidata replag on z-dat-s7-a is WARNING: QUERY WARNING: SELECT ts_rc_age() returned 1961.000000 [20:50:14] wikidata replag on z-dat-s2-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 14477.000000 [20:54:04] APT on yucca is CRITICAL: APT CRITICAL: 9 packages available for upgrade (9 critical updates). [20:54:34] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 74152 MB (12% inode=99%): [20:56:04] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [20:59:34] APT on nightshade is CRITICAL: APT CRITICAL: 9 packages available for upgrade (9 critical updates). [20:59:44] APT on yarrow is CRITICAL: APT CRITICAL: 9 packages available for upgrade (9 critical updates). [20:59:54] NTP on sage is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:00:33] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (3 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.CommunicationLost.desc:S3:oob:S4:2530:S9:ts-array5:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.descri [21:05:43] s4 replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 9061.000000 [21:08:04] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 88010.000000 [21:12:23] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [21:12:33] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [21:16:05] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [21:20:34] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 87906 [21:27:44] s4 replag on z-dat-s5-b is WARNING: QUERY WARNING: SELECT ts_rc_age() returned 3157.000000 [21:31:04] /mnt user-store on rosemary is WARNING: DISK WARNING - free space: /mnt 497647 MB (9% inode=65%): [21:31:34] NTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:32:14] wikidata replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 39016.000000 [21:32:15] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [21:41:25] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [21:42:04] wikidata replag on z-dat-s7-a is OK: QUERY OK: SELECT ts_rc_age() returned 1796.000000 [21:42:04] aliasd on nightshade is CRITICAL: Connection refused [21:42:44] s4 replag on z-dat-s5-b is OK: QUERY OK: SELECT ts_rc_age() returned 1570.000000 [21:42:57] s/room/channel [21:43:00] That's not valid syntax. [21:45:34] /sql on z-dat-s7-a is WARNING: DISK WARNING - free space: /sql 48864 MB (9% inode=99%): [21:50:14] wikidata replag on z-dat-s2-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 15263.000000 [21:54:04] APT on yucca is CRITICAL: APT CRITICAL: 9 packages available for upgrade (9 critical updates). [21:54:34] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 73790 MB (12% inode=99%): [21:55:49] Susan: why not? try it in vim. :-) [21:56:01] (afaik, IRC regex is not standardized!) [21:56:04] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [21:59:34] APT on nightshade is CRITICAL: APT CRITICAL: 9 packages available for upgrade (9 critical updates). [21:59:54] NTP on sage is CRITICAL: CRITICAL - Socket timeout after 10 seconds [22:00:34] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A: [22:00:35] APT on yarrow is CRITICAL: APT CRITICAL: 9 packages available for upgrade (9 critical updates). [22:00:52] Try it in sed first. [22:08:04] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 87629.000000 [22:12:23] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [22:12:33] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [22:13:34] jeremyb_: my human regex parser has zero problems with it. [22:16:05] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [22:20:34] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 87431 [22:31:34] NTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [22:32:05] /mnt user-store on rosemary is WARNING: DISK WARNING - free space: /mnt 497458 MB (9% inode=65%): [22:32:14] wikidata replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 36918.000000 [22:33:14] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [22:41:24] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [22:42:04] aliasd on nightshade is CRITICAL: Connection refused [22:46:13] valhallasw: :) [22:50:14] wikidata replag on z-dat-s2-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 16223.000000 [22:54:04] APT on yucca is CRITICAL: APT CRITICAL: 9 packages available for upgrade (9 critical updates). [22:54:34] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 73423 MB (12% inode=99%): [22:56:04] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [22:59:34] APT on nightshade is CRITICAL: APT CRITICAL: 9 packages available for upgrade (9 critical updates). [22:59:54] NTP on sage is CRITICAL: CRITICAL - Socket timeout after 10 seconds [23:00:34] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A: [23:00:35] APT on yarrow is CRITICAL: APT CRITICAL: 9 packages available for upgrade (9 critical updates). [23:05:24] MySQL slave on z-dat-s7-a is WARNING: SLOW_SLAVE WARNING: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 2172 [23:08:04] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 88053.000000 [23:12:23] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [23:12:34] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [23:16:04] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [23:20:34] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 87869 [23:29:23] MySQL slave on z-dat-s7-a is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 3612 [23:31:35] NTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [23:32:04] /mnt user-store on rosemary is WARNING: DISK WARNING - free space: /mnt 495801 MB (9% inode=65%): [23:32:14] wikidata replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 37925.000000 [23:33:14] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [23:41:23] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [23:42:04] aliasd on nightshade is CRITICAL: Connection refused [23:47:24] MySQL slave on z-dat-s7-a is WARNING: SLOW_SLAVE WARNING: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 3489 [23:50:14] wikidata replag on z-dat-s2-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 15210.000000 [23:54:05] APT on yucca is CRITICAL: APT CRITICAL: 9 packages available for upgrade (9 critical updates). [23:54:24] MySQL slave on z-dat-s7-a is OK: Uptime: 4275097 Threads: 6 Questions: 2291782032 Slow queries: 100126 Opens: 6441288 Flush tables: 1 Open tables: 6969 Queries per second avg: 536.77 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1591 [23:54:34] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 73035 MB (11% inode=99%): [23:56:05] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [23:59:34] APT on nightshade is CRITICAL: APT CRITICAL: 9 packages available for upgrade (9 critical updates). [23:59:53] NTP on sage is CRITICAL: CRITICAL - Socket timeout after 10 seconds