[00:04:37] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 35475 MB (5% inode=99%): [00:07:16] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [00:11:37] s4 replag on cassia is CRITICAL: QUERY CRITICAL: Unknown database commonswiki_p [00:22:07] Free Memory on damiana is WARNING: WARNING - 5.9% (493532 kB) free! [00:23:07] Free Memory on damiana is CRITICAL: CRITICAL - 4.5% (374456 kB) free! [00:23:37] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [00:23:57] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [00:28:17] /mnt user-store on rosemary is WARNING: DISK WARNING - free space: /mnt 335714 MB (6% inode=45%): [00:33:07] Free Memory on damiana is WARNING: WARNING - 5.4% (450352 kB) free! [00:37:18] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [00:37:18] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [00:42:17] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [00:47:07] Free Memory on damiana is OK: OK - 7.1% (593668 kB) free. [00:56:07] Free Memory on damiana is WARNING: WARNING - 6.5% (540712 kB) free! [00:57:17] FMA on amaranth is CRITICAL: Failed components: hc://:product-id=SUN-FIRE-X4150:server-id=amaranth:chassis-id=0819QAR1D1:serial=518545072303039020:part=72T256520HFD3SB:revision=--/motherboard=0/memory-controller=1/dram-channel=2/dimm=3/rank=7 [01:04:37] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 35306 MB (5% inode=99%): [01:07:23] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [01:08:07] Free Memory on damiana is OK: OK - 7.2% (606960 kB) free. [01:11:37] s4 replag on cassia is CRITICAL: QUERY CRITICAL: Unknown database commonswiki_p [01:23:37] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [01:23:58] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [01:28:17] /mnt user-store on rosemary is WARNING: DISK WARNING - free space: /mnt 325141 MB (6% inode=44%): [01:30:07] Free Memory on damiana is CRITICAL: CRITICAL - 4.6% (382372 kB) free! [01:32:07] Free Memory on damiana is WARNING: WARNING - 5.4% (452508 kB) free! [01:32:37] /sql on rosemary is WARNING: DISK WARNING - free space: /sql 81536 MB (8% inode=99%): [01:37:07] Free Memory on damiana is OK: OK - 7.2% (601852 kB) free. [01:37:18] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [01:37:18] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [01:42:17] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [01:57:17] FMA on amaranth is CRITICAL: Failed components: hc://:product-id=SUN-FIRE-X4150:server-id=amaranth:chassis-id=0819QAR1D1:serial=518545072303039020:part=72T256520HFD3SB:revision=--/motherboard=0/memory-controller=1/dram-channel=2/dimm=3/rank=7 [02:03:17] Load avg. on ortelius is WARNING: WARNING - load average: 26.36, 23.88, 15.89 [02:04:37] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 33407 MB (5% inode=99%): [02:07:17] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [02:11:38] s4 replag on cassia is CRITICAL: QUERY CRITICAL: Unknown database commonswiki_p [02:13:17] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 319388 MB (5% inode=45%): [02:20:07] Free Memory on damiana is WARNING: WARNING - 6.3% (530912 kB) free! [02:23:17] Load avg. on ortelius is CRITICAL: CRITICAL - load average: 35.08, 22.31, 19.40 [02:23:37] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [02:24:07] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [02:24:17] Load avg. on ortelius is WARNING: WARNING - load average: 27.46, 22.72, 19.75 [02:28:07] Free Memory on damiana is CRITICAL: CRITICAL - 3.8% (314564 kB) free! [02:30:07] Free Memory on damiana is WARNING: WARNING - 5.3% (444240 kB) free! [02:37:17] Load avg. on ortelius is OK: OK - load average: 10.62, 11.82, 14.93 [02:37:18] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [02:37:18] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [02:42:16] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [02:57:18] FMA on amaranth is CRITICAL: Failed components: hc://:product-id=SUN-FIRE-X4150:server-id=amaranth:chassis-id=0819QAR1D1:serial=518545072303039020:part=72T256520HFD3SB:revision=--/motherboard=0/memory-controller=1/dram-channel=2/dimm=3/rank=7 [03:04:37] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 35159 MB (5% inode=99%): [03:07:17] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B: [03:11:37] s4 replag on cassia is CRITICAL: QUERY CRITICAL: Unknown database commonswiki_p [03:13:17] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 305989 MB (5% inode=45%): [03:23:42] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [03:37:17] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [03:37:17] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [03:42:17] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [03:53:57] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [03:57:17] FMA on amaranth is CRITICAL: Failed components: hc://:product-id=SUN-FIRE-X4150:server-id=amaranth:chassis-id=0819QAR1D1:serial=518545072303039020:part=72T256520HFD3SB:revision=--/motherboard=0/memory-controller=1/dram-channel=2/dimm=3/rank=7 [04:04:44] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 35075 MB (5% inode=99%): [04:08:14] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [04:12:04] s4 replag on cassia is CRITICAL: QUERY CRITICAL: Unknown database commonswiki_p [04:13:24] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 299560 MB (5% inode=45%): [04:24:34] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [04:38:13] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [04:38:14] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [04:43:14] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [04:58:14] FMA on amaranth is CRITICAL: Failed components: hc://:product-id=SUN-FIRE-X4150:server-id=amaranth:chassis-id=0819QAR1D1:serial=518545072303039020:part=72T256520HFD3SB:revision=--/motherboard=0/memory-controller=1/dram-channel=2/dimm=3/rank=7 [05:04:44] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 34995 MB (5% inode=99%): [05:08:14] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [05:12:06] s4 replag on cassia is CRITICAL: QUERY CRITICAL: Unknown database commonswiki_p [05:13:29] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 292719 MB (5% inode=46%): [05:23:54] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [05:24:44] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [05:38:14] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [05:38:15] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [05:43:14] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [05:58:14] FMA on amaranth is CRITICAL: Failed components: hc://:product-id=SUN-FIRE-X4150:server-id=amaranth:chassis-id=0819QAR1D1:serial=518545072303039020:part=72T256520HFD3SB:revision=--/motherboard=0/memory-controller=1/dram-channel=2/dimm=3/rank=7 [06:04:44] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 34890 MB (5% inode=99%): [06:08:14] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [06:12:04] s4 replag on cassia is CRITICAL: QUERY CRITICAL: Unknown database commonswiki_p [06:13:25] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 287013 MB (5% inode=46%): [06:18:34] / on wolfsbane is WARNING: DISK WARNING - free space: / 5752 MB (19% inode=93%): [06:18:35] /tmp on wolfsbane is WARNING: DISK WARNING - free space: / 5752 MB (19% inode=93%): [06:23:54] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [06:24:04] Free Memory on damiana is WARNING: WARNING - 5.9% (496384 kB) free! [06:24:44] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [06:28:04] Free Memory on damiana is CRITICAL: CRITICAL - 4.0% (337544 kB) free! [06:32:05] Free Memory on damiana is WARNING: WARNING - 5.2% (436260 kB) free! [06:38:14] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [06:38:15] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [06:43:14] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [06:58:14] FMA on amaranth is CRITICAL: Failed components: hc://:product-id=SUN-FIRE-X4150:server-id=amaranth:chassis-id=0819QAR1D1:serial=518545072303039020:part=72T256520HFD3SB:revision=--/motherboard=0/memory-controller=1/dram-channel=2/dimm=3/rank=7 [07:04:44] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 34753 MB (5% inode=99%): [07:08:14] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [07:11:04] Free Memory on damiana is WARNING: WARNING - 5.2% (432372 kB) free! [07:12:05] s4 replag on cassia is CRITICAL: QUERY CRITICAL: Unknown database commonswiki_p [07:13:04] Free Memory on damiana is CRITICAL: CRITICAL - 5.0% (416192 kB) free! [07:13:34] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 279681 MB (5% inode=47%): [07:14:05] Free Memory on damiana is WARNING: WARNING - 5.1% (429128 kB) free! [07:18:34] / on wolfsbane is WARNING: DISK WARNING - free space: / 5746 MB (19% inode=93%): [07:18:34] /tmp on wolfsbane is WARNING: DISK WARNING - free space: / 5746 MB (19% inode=93%): [07:23:54] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [07:24:44] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [07:38:14] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [07:38:14] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [07:43:14] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [07:58:14] FMA on amaranth is CRITICAL: Failed components: hc://:product-id=SUN-FIRE-X4150:server-id=amaranth:chassis-id=0819QAR1D1:serial=518545072303039020:part=72T256520HFD3SB:revision=--/motherboard=0/memory-controller=1/dram-channel=2/dimm=3/rank=7 [08:02:04] Free Memory on damiana is WARNING: WARNING - 6.2% (520912 kB) free! [08:04:43] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 34626 MB (5% inode=99%): [08:08:14] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [08:12:05] s4 replag on cassia is CRITICAL: QUERY CRITICAL: Unknown database commonswiki_p [08:13:24] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 270813 MB (5% inode=47%): [08:18:34] / on wolfsbane is WARNING: DISK WARNING - free space: / 5692 MB (19% inode=93%): [08:18:34] /tmp on wolfsbane is WARNING: DISK WARNING - free space: / 5692 MB (19% inode=93%): [08:19:05] Free Memory on damiana is OK: OK - 7.1% (593160 kB) free. [08:23:54] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [08:24:44] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [08:37:04] Free Memory on damiana is WARNING: WARNING - 6.7% (565620 kB) free! [08:38:13] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [08:38:15] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [08:43:14] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [08:58:14] FMA on amaranth is CRITICAL: Failed components: hc://:product-id=SUN-FIRE-X4150:server-id=amaranth:chassis-id=0819QAR1D1:serial=518545072303039020:part=72T256520HFD3SB:revision=--/motherboard=0/memory-controller=1/dram-channel=2/dimm=3/rank=7 [09:04:44] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 34494 MB (5% inode=99%): [09:08:14] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [09:13:04] s4 replag on cassia is CRITICAL: QUERY CRITICAL: Unknown database commonswiki_p [09:13:24] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 258712 MB (4% inode=48%): [09:18:34] / on wolfsbane is WARNING: DISK WARNING - free space: / 5643 MB (18% inode=93%): [09:18:34] /tmp on wolfsbane is WARNING: DISK WARNING - free space: / 5643 MB (18% inode=93%): [09:23:54] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [09:24:44] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [09:28:04] Free Memory on damiana is CRITICAL: CRITICAL - 3.8% (320828 kB) free! [09:32:04] Free Memory on damiana is WARNING: WARNING - 5.8% (489876 kB) free! [09:38:14] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [09:38:14] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [09:43:14] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [09:47:05] Free Memory on damiana is OK: OK - 8.3% (692372 kB) free. [09:58:18] FMA on amaranth is CRITICAL: Failed components: hc://:product-id=SUN-FIRE-X4150:server-id=amaranth:chassis-id=0819QAR1D1:serial=518545072303039020:part=72T256520HFD3SB:revision=--/motherboard=0/memory-controller=1/dram-channel=2/dimm=3/rank=7 [10:01:08] Free Memory on damiana is WARNING: WARNING - 5.4% (452456 kB) free! [10:02:08] Free Memory on damiana is CRITICAL: CRITICAL - 4.7% (391752 kB) free! [10:04:48] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 34334 MB (5% inode=99%): [10:08:18] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [10:13:31] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 251192 MB (4% inode=48%): [10:13:58] s4 replag on cassia is CRITICAL: QUERY CRITICAL: Unknown database commonswiki_p [10:18:49] / on wolfsbane is WARNING: DISK WARNING - free space: / 5631 MB (18% inode=93%): [10:18:49] /tmp on wolfsbane is WARNING: DISK WARNING - free space: / 5631 MB (18% inode=93%): [10:22:09] Free Memory on damiana is WARNING: WARNING - 6.2% (519936 kB) free! [10:23:58] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [10:24:48] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [10:28:08] Free Memory on damiana is CRITICAL: CRITICAL - 4.3% (356788 kB) free! [10:30:08] Free Memory on damiana is WARNING: WARNING - 5.3% (440424 kB) free! [10:31:08] Free Memory on damiana is CRITICAL: CRITICAL - 4.9% (412500 kB) free! [10:38:18] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [10:38:19] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [10:43:18] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [10:51:08] Free Memory on damiana is WARNING: WARNING - 5.8% (484756 kB) free! [10:52:08] Free Memory on damiana is CRITICAL: CRITICAL - 4.8% (398568 kB) free! [10:58:18] FMA on amaranth is CRITICAL: Failed components: hc://:product-id=SUN-FIRE-X4150:server-id=amaranth:chassis-id=0819QAR1D1:serial=518545072303039020:part=72T256520HFD3SB:revision=--/motherboard=0/memory-controller=1/dram-channel=2/dimm=3/rank=7 [11:04:48] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 34152 MB (5% inode=99%): [11:07:04] hello all [11:07:06] @replag [11:07:07] DaBPunkt: s1-rr-a-wd: 15s [-0.00 s/s]; s1-user-wd: 15s [-0.00 s/s]; s2-user: 13s [-0.00 s/s]; s2-user-c: error; s2-user-wd: 15s [+0.00 s/s]; s3-user: 16s [-0.00 s/s]; s4-user-wd: 15s [+0.00 s/s]; s5-user-c: error [11:07:08] DaBPunkt: s5-user-wd: 15s [+0.00 s/s]; s7-user-wd: 13s [-0.00 s/s] [11:08:18] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [11:13:28] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 258719 MB (4% inode=48%): [11:13:58] s4 replag on cassia is CRITICAL: QUERY CRITICAL: Unknown database commonswiki_p [11:18:49] / on wolfsbane is WARNING: DISK WARNING - free space: / 5583 MB (18% inode=93%): [11:18:49] /tmp on wolfsbane is WARNING: DISK WARNING - free space: / 5587 MB (18% inode=93%): [11:22:14] Some news: The importer of cassia left the globalimage-table and is now in the logging-table. [11:23:58] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [11:24:48] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [11:33:08] Free Memory on damiana is WARNING: WARNING - 5.2% (432176 kB) free! [11:34:08] Free Memory on damiana is OK: OK - 16.2% (1360940 kB) free. [11:38:17] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [11:38:18] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [11:43:18] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [11:58:17] FMA on amaranth is CRITICAL: Failed components: hc://:product-id=SUN-FIRE-X4150:server-id=amaranth:chassis-id=0819QAR1D1:serial=518545072303039020:part=72T256520HFD3SB:revision=--/motherboard=0/memory-controller=1/dram-channel=2/dimm=3/rank=7 [12:04:48] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 33947 MB (5% inode=99%): [12:08:18] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [12:13:28] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 255409 MB (4% inode=49%): [12:13:58] s4 replag on cassia is CRITICAL: QUERY CRITICAL: Unknown database commonswiki_p [12:18:48] / on wolfsbane is WARNING: DISK WARNING - free space: / 5485 MB (18% inode=93%): [12:18:48] /tmp on wolfsbane is WARNING: DISK WARNING - free space: / 5485 MB (18% inode=93%): [12:23:59] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [12:24:48] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [12:38:18] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [12:38:18] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [12:43:18] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [12:58:18] FMA on amaranth is CRITICAL: Failed components: hc://:product-id=SUN-FIRE-X4150:server-id=amaranth:chassis-id=0819QAR1D1:serial=518545072303039020:part=72T256520HFD3SB:revision=--/motherboard=0/memory-controller=1/dram-channel=2/dimm=3/rank=7 [13:04:49] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 33740 MB (5% inode=99%): [13:08:18] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [13:13:28] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 245430 MB (4% inode=49%): [13:13:58] s4 replag on cassia is CRITICAL: QUERY CRITICAL: Unknown database commonswiki_p [13:18:49] /tmp on wolfsbane is WARNING: DISK WARNING - free space: / 5473 MB (18% inode=93%): [13:18:49] / on wolfsbane is WARNING: DISK WARNING - free space: / 5473 MB (18% inode=93%): [13:23:58] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [13:24:48] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [13:32:48] /sql on rosemary is WARNING: DISK WARNING - free space: /sql 81692 MB (8% inode=99%): [13:38:18] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [13:38:18] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [13:43:18] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [13:58:18] FMA on amaranth is CRITICAL: Failed components: hc://:product-id=SUN-FIRE-X4150:server-id=amaranth:chassis-id=0819QAR1D1:serial=518545072303039020:part=72T256520HFD3SB:revision=--/motherboard=0/memory-controller=1/dram-channel=2/dimm=3/rank=7 [14:04:48] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 33550 MB (5% inode=99%): [14:08:18] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (3 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.CommunicationLost.desc: [14:13:28] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 246294 MB (4% inode=49%): [14:13:58] s4 replag on cassia is CRITICAL: QUERY CRITICAL: Unknown database commonswiki_p [14:18:48] /tmp on wolfsbane is WARNING: DISK WARNING - free space: / 5416 MB (18% inode=93%): [14:18:49] / on wolfsbane is WARNING: DISK WARNING - free space: / 5416 MB (18% inode=93%): [14:23:58] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [14:24:48] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [14:38:18] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [14:38:18] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [14:43:18] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [14:58:19] FMA on amaranth is CRITICAL: Failed components: hc://:product-id=SUN-FIRE-X4150:server-id=amaranth:chassis-id=0819QAR1D1:serial=518545072303039020:part=72T256520HFD3SB:revision=--/motherboard=0/memory-controller=1/dram-channel=2/dimm=3/rank=7 [15:04:48] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 33351 MB (5% inode=99%): [15:08:18] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [15:13:28] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 238611 MB (4% inode=50%): [15:13:58] s4 replag on cassia is CRITICAL: QUERY CRITICAL: Unknown database commonswiki_p [15:18:48] /tmp on wolfsbane is WARNING: DISK WARNING - free space: / 5358 MB (17% inode=93%): [15:18:49] / on wolfsbane is WARNING: DISK WARNING - free space: / 5358 MB (17% inode=93%): [15:23:58] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [15:24:48] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [15:32:11] hi all [15:33:44] as always I'm a bit confused about the status of the db servers. Is Casia being unavailable a problem? Arent there other s2 and s5 copies? Is s2-user a viable option for current commons data? [15:38:18] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [15:38:19] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [15:43:18] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [15:58:18] FMA on amaranth is CRITICAL: Failed components: hc://:product-id=SUN-FIRE-X4150:server-id=amaranth:chassis-id=0819QAR1D1:serial=518545072303039020:part=72T256520HFD3SB:revision=--/motherboard=0/memory-controller=1/dram-channel=2/dimm=3/rank=7 [16:04:48] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 33187 MB (5% inode=99%): [16:08:23] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [16:13:28] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 224522 MB (4% inode=50%): [16:13:58] s4 replag on cassia is CRITICAL: QUERY CRITICAL: Unknown database commonswiki_p [16:18:48] / on wolfsbane is WARNING: DISK WARNING - free space: / 5287 MB (17% inode=93%): [16:18:48] /tmp on wolfsbane is WARNING: DISK WARNING - free space: / 5287 MB (17% inode=93%): [16:23:59] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [16:24:49] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [16:38:18] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [16:38:19] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [16:43:18] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [16:53:26] no.. nothing? [16:58:18] FMA on amaranth is CRITICAL: Failed components: hc://:product-id=SUN-FIRE-X4150:server-id=amaranth:chassis-id=0819QAR1D1:serial=518545072303039020:part=72T256520HFD3SB:revision=--/motherboard=0/memory-controller=1/dram-channel=2/dimm=3/rank=7 [17:04:48] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 32892 MB (5% inode=99%): [17:08:18] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [17:13:28] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 217935 MB (4% inode=50%): [17:14:04] s4 replag on cassia is CRITICAL: QUERY CRITICAL: Unknown database commonswiki_p [17:18:48] /tmp on wolfsbane is WARNING: DISK WARNING - free space: / 5233 MB (17% inode=93%): [17:18:48] / on wolfsbane is WARNING: DISK WARNING - free space: / 5233 MB (17% inode=93%): [17:23:58] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [17:24:49] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [17:38:18] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [17:38:18] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [17:43:18] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [17:58:18] FMA on amaranth is CRITICAL: Failed components: hc://:product-id=SUN-FIRE-X4150:server-id=amaranth:chassis-id=0819QAR1D1:serial=518545072303039020:part=72T256520HFD3SB:revision=--/motherboard=0/memory-controller=1/dram-channel=2/dimm=3/rank=7 [17:59:58] APT on nightshade is WARNING: APT WARNING: 8 packages available for upgrade (0 critical updates). [18:04:48] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 32630 MB (5% inode=99%): [18:08:18] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [18:13:27] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 201476 MB (3% inode=51%): [18:13:58] s4 replag on cassia is CRITICAL: QUERY CRITICAL: Unknown database commonswiki_p [18:18:48] / on wolfsbane is WARNING: DISK WARNING - free space: / 5211 MB (17% inode=93%): [18:18:49] /tmp on wolfsbane is WARNING: DISK WARNING - free space: / 5211 MB (17% inode=93%): [18:23:58] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [18:24:48] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [18:38:18] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [18:38:19] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [18:43:18] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [18:58:18] FMA on amaranth is CRITICAL: Failed components: hc://:product-id=SUN-FIRE-X4150:server-id=amaranth:chassis-id=0819QAR1D1:serial=518545072303039020:part=72T256520HFD3SB:revision=--/motherboard=0/memory-controller=1/dram-channel=2/dimm=3/rank=7 [19:00:09] APT on nightshade is WARNING: APT WARNING: 8 packages available for upgrade (0 critical updates). [19:04:48] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 32433 MB (5% inode=99%): [19:08:18] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [19:13:28] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 188759 MB (3% inode=51%): [19:13:58] s4 replag on cassia is CRITICAL: QUERY CRITICAL: Unknown database commonswiki_p [19:18:48] /tmp on wolfsbane is WARNING: DISK WARNING - free space: / 5154 MB (17% inode=93%): [19:18:48] / on wolfsbane is WARNING: DISK WARNING - free space: / 5154 MB (17% inode=93%): [19:23:59] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [19:24:48] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [19:38:23] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [19:38:24] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [19:43:23] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [19:58:23] FMA on amaranth is CRITICAL: Failed components: hc://:product-id=SUN-FIRE-X4150:server-id=amaranth:chassis-id=0819QAR1D1:serial=518545072303039020:part=72T256520HFD3SB:revision=--/motherboard=0/memory-controller=1/dram-channel=2/dimm=3/rank=7 [20:01:04] APT on nightshade is WARNING: APT WARNING: 8 packages available for upgrade (0 critical updates). [20:04:54] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 32151 MB (5% inode=99%): [20:08:23] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [20:14:03] s4 replag on cassia is CRITICAL: QUERY CRITICAL: Unknown database commonswiki_p [20:14:23] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 213360 MB (4% inode=52%): [20:18:54] / on wolfsbane is WARNING: DISK WARNING - free space: / 5115 MB (17% inode=93%): [20:18:54] /tmp on wolfsbane is WARNING: DISK WARNING - free space: / 5115 MB (17% inode=93%): [20:24:53] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [20:38:23] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [20:39:23] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [20:41:59] / on wolfsbane is OK: DISK OK - free space: / 16868 MB (56% inode=93%): [20:41:59] /tmp on wolfsbane is OK: DISK OK - free space: / 16868 MB (56% inode=93%): [20:43:24] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [20:53:53] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [20:58:24] FMA on amaranth is CRITICAL: Failed components: hc://:product-id=SUN-FIRE-X4150:server-id=amaranth:chassis-id=0819QAR1D1:serial=518545072303039020:part=72T256520HFD3SB:revision=--/motherboard=0/memory-controller=1/dram-channel=2/dimm=3/rank=7 [21:01:03] APT on nightshade is WARNING: APT WARNING: 8 packages available for upgrade (0 critical updates). [21:04:04] APT on nightshade is OK: APT OK: 0 packages available for upgrade (0 critical updates). [21:04:53] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 31923 MB (5% inode=99%): [21:08:23] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [21:14:03] s4 replag on cassia is CRITICAL: QUERY CRITICAL: Unknown database commonswiki_p [21:14:23] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 220241 MB (4% inode=52%): [21:24:53] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [21:38:24] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [21:39:23] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [21:43:23] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [21:53:53] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [21:58:23] FMA on amaranth is CRITICAL: Failed components: hc://:product-id=SUN-FIRE-X4150:server-id=amaranth:chassis-id=0819QAR1D1:serial=518545072303039020:part=72T256520HFD3SB:revision=--/motherboard=0/memory-controller=1/dram-channel=2/dimm=3/rank=7 [22:04:53] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 31695 MB (5% inode=99%): [22:08:23] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [22:14:03] s4 replag on cassia is CRITICAL: QUERY CRITICAL: Unknown database commonswiki_p [22:14:23] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 221546 MB (4% inode=52%): [22:24:53] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [22:38:23] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [22:39:24] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [22:43:23] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [22:53:53] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [22:58:23] FMA on amaranth is CRITICAL: Failed components: hc://:product-id=SUN-FIRE-X4150:server-id=amaranth:chassis-id=0819QAR1D1:serial=518545072303039020:part=72T256520HFD3SB:revision=--/motherboard=0/memory-controller=1/dram-channel=2/dimm=3/rank=7 [23:04:53] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 31412 MB (5% inode=99%): [23:08:23] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (3 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.CommunicationLost.desc: [23:14:03] s4 replag on cassia is CRITICAL: QUERY CRITICAL: Unknown database commonswiki_p [23:14:23] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 221825 MB (4% inode=53%): [23:24:53] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [23:38:23] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [23:39:24] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [23:43:24] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [23:43:44] nacht ts [23:53:54] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [23:58:23] FMA on amaranth is CRITICAL: Failed components: hc://:product-id=SUN-FIRE-X4150:server-id=amaranth:chassis-id=0819QAR1D1:serial=518545072303039020:part=72T256520HFD3SB:revision=--/motherboard=0/memory-controller=1/dram-channel=2/dimm=3/rank=7