[00:02:59] / on ptolemy is CRITICAL: DISK CRITICAL - free space: / 973 MB (4% inode=91%): [00:05:19] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [00:06:09] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [00:18:59] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [00:23:59] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [00:26:19] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 223447 MB (4% inode=24%): [00:27:59] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [00:28:09] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 80253 MB (13% inode=99%): [00:52:39] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [00:55:09] FMA on amaranth is CRITICAL: Failed components: hc://:product-id=SUN-FIRE-X4150:server-id=amaranth:chassis-id=0819QAR1D1:serial=518545072303039020:part=72T256520HFD3SB:revision=--/motherboard=0/memory-controller=1/dram-channel=2/dimm=3/rank=7 [01:03:02] / on ptolemy is CRITICAL: DISK CRITICAL - free space: / 949 MB (4% inode=91%): [01:05:19] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B: [01:06:09] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [01:18:59] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [01:24:00] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [01:26:19] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 225220 MB (4% inode=24%): [01:27:59] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [01:28:09] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 80061 MB (13% inode=99%): [01:52:39] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [01:55:10] FMA on amaranth is CRITICAL: Failed components: hc://:product-id=SUN-FIRE-X4150:server-id=amaranth:chassis-id=0819QAR1D1:serial=518545072303039020:part=72T256520HFD3SB:revision=--/motherboard=0/memory-controller=1/dram-channel=2/dimm=3/rank=7 [02:02:59] / on ptolemy is CRITICAL: DISK CRITICAL - free space: / 929 MB (4% inode=91%): [02:05:19] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (3 errors): null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.CommunicationLost.desc:S3:oob:S4:2530:S9:ts-array5:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.descri [02:06:10] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [02:11:49] /sql on rosemary is WARNING: DISK WARNING - free space: /sql 85115 MB (8% inode=99%): [02:18:59] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [02:23:59] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [02:26:19] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 224433 MB (4% inode=24%): [02:27:59] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [02:28:09] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 78172 MB (12% inode=99%): [02:52:39] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [02:55:10] FMA on amaranth is CRITICAL: Failed components: hc://:product-id=SUN-FIRE-X4150:server-id=amaranth:chassis-id=0819QAR1D1:serial=518545072303039020:part=72T256520HFD3SB:revision=--/motherboard=0/memory-controller=1/dram-channel=2/dimm=3/rank=7 [03:02:59] / on ptolemy is CRITICAL: DISK CRITICAL - free space: / 917 MB (4% inode=91%): [03:05:19] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [03:06:10] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [03:18:59] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [03:24:00] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [03:26:19] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 222197 MB (4% inode=24%): [03:27:59] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [03:28:09] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 79594 MB (13% inode=99%): [03:52:39] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [03:55:09] FMA on amaranth is CRITICAL: Failed components: hc://:product-id=SUN-FIRE-X4150:server-id=amaranth:chassis-id=0819QAR1D1:serial=518545072303039020:part=72T256520HFD3SB:revision=--/motherboard=0/memory-controller=1/dram-channel=2/dimm=3/rank=7 [04:02:59] / on ptolemy is CRITICAL: DISK CRITICAL - free space: / 907 MB (4% inode=91%): [04:05:19] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B: [04:06:10] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [04:19:09] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [04:24:00] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [04:26:19] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 222589 MB (4% inode=24%): [04:28:03] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [04:28:09] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 79408 MB (13% inode=99%): [04:52:39] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [04:55:09] FMA on amaranth is CRITICAL: Failed components: hc://:product-id=SUN-FIRE-X4150:server-id=amaranth:chassis-id=0819QAR1D1:serial=518545072303039020:part=72T256520HFD3SB:revision=--/motherboard=0/memory-controller=1/dram-channel=2/dimm=3/rank=7 [05:02:59] / on ptolemy is CRITICAL: DISK CRITICAL - free space: / 890 MB (4% inode=91%): [05:05:19] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B: [05:06:10] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [05:19:09] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [05:23:58] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [05:26:19] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 222389 MB (4% inode=24%): [05:28:09] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 78990 MB (12% inode=99%): [05:28:59] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [05:52:39] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [05:55:09] FMA on amaranth is CRITICAL: Failed components: hc://:product-id=SUN-FIRE-X4150:server-id=amaranth:chassis-id=0819QAR1D1:serial=518545072303039020:part=72T256520HFD3SB:revision=--/motherboard=0/memory-controller=1/dram-channel=2/dimm=3/rank=7 [06:02:59] / on ptolemy is CRITICAL: DISK CRITICAL - free space: / 861 MB (4% inode=91%): [06:05:19] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [06:06:10] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [06:19:09] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [06:24:00] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [06:26:19] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 222139 MB (4% inode=24%): [06:28:09] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 78857 MB (12% inode=99%): [06:28:59] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [06:52:39] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [06:55:09] FMA on amaranth is CRITICAL: Failed components: hc://:product-id=SUN-FIRE-X4150:server-id=amaranth:chassis-id=0819QAR1D1:serial=518545072303039020:part=72T256520HFD3SB:revision=--/motherboard=0/memory-controller=1/dram-channel=2/dimm=3/rank=7 [07:03:00] / on ptolemy is CRITICAL: DISK CRITICAL - free space: / 810 MB (4% inode=91%): [07:05:29] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [07:06:09] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [07:19:10] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [07:23:59] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [07:26:29] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 221756 MB (4% inode=24%): [07:28:07] Tim Landscheidt * Re: [Toolserver-l] RSA key changed on yarrow? [07:28:09] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 78739 MB (12% inode=99%): [07:28:59] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [07:52:40] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [07:55:09] FMA on amaranth is CRITICAL: Failed components: hc://:product-id=SUN-FIRE-X4150:server-id=amaranth:chassis-id=0819QAR1D1:serial=518545072303039020:part=72T256520HFD3SB:revision=--/motherboard=0/memory-controller=1/dram-channel=2/dimm=3/rank=7 [08:03:00] / on ptolemy is CRITICAL: DISK CRITICAL - free space: / 730 MB (3% inode=91%): [08:05:29] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [08:06:09] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [08:19:09] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [08:23:59] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [08:26:29] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 221378 MB (4% inode=24%): [08:28:10] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 78608 MB (12% inode=99%): [08:28:59] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [08:52:40] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [08:55:09] FMA on amaranth is CRITICAL: Failed components: hc://:product-id=SUN-FIRE-X4150:server-id=amaranth:chassis-id=0819QAR1D1:serial=518545072303039020:part=72T256520HFD3SB:revision=--/motherboard=0/memory-controller=1/dram-channel=2/dimm=3/rank=7 [09:02:59] / on ptolemy is CRITICAL: DISK CRITICAL - free space: / 642 MB (3% inode=91%): [09:05:30] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [09:06:19] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [09:19:09] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [09:23:59] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [09:26:29] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 219181 MB (4% inode=24%): [09:28:09] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 78435 MB (12% inode=99%): [09:28:59] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [09:52:39] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [09:55:10] FMA on amaranth is CRITICAL: Failed components: hc://:product-id=SUN-FIRE-X4150:server-id=amaranth:chassis-id=0819QAR1D1:serial=518545072303039020:part=72T256520HFD3SB:revision=--/motherboard=0/memory-controller=1/dram-channel=2/dimm=3/rank=7 [10:02:59] / on ptolemy is CRITICAL: DISK CRITICAL - free space: / 529 MB (2% inode=91%): [10:05:29] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [10:06:19] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [10:19:09] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [10:24:00] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [10:26:29] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 219921 MB (4% inode=24%): [10:27:49] /sql on cassia is WARNING: DISK WARNING - free space: /sql 84241 MB (7% inode=99%): [10:28:09] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 78250 MB (12% inode=99%): [10:29:00] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [10:52:39] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [10:55:09] FMA on amaranth is CRITICAL: Failed components: hc://:product-id=SUN-FIRE-X4150:server-id=amaranth:chassis-id=0819QAR1D1:serial=518545072303039020:part=72T256520HFD3SB:revision=--/motherboard=0/memory-controller=1/dram-channel=2/dimm=3/rank=7 [11:02:59] / on ptolemy is CRITICAL: DISK CRITICAL - free space: / 414 MB (2% inode=91%): [11:05:29] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [11:06:20] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [11:19:10] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [11:23:59] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [11:26:29] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 219212 MB (4% inode=24%): [11:28:09] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 78059 MB (12% inode=99%): [11:28:59] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [11:52:38] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [11:55:09] FMA on amaranth is CRITICAL: Failed components: hc://:product-id=SUN-FIRE-X4150:server-id=amaranth:chassis-id=0819QAR1D1:serial=518545072303039020:part=72T256520HFD3SB:revision=--/motherboard=0/memory-controller=1/dram-channel=2/dimm=3/rank=7 [12:02:59] / on ptolemy is CRITICAL: DISK CRITICAL - free space: / 306 MB (1% inode=91%): [12:05:29] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [12:06:19] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [12:19:09] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [12:23:59] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [12:26:28] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 218841 MB (4% inode=24%): [12:28:10] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 77904 MB (12% inode=99%): [12:28:59] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [12:52:39] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [12:55:09] FMA on amaranth is CRITICAL: Failed components: hc://:product-id=SUN-FIRE-X4150:server-id=amaranth:chassis-id=0819QAR1D1:serial=518545072303039020:part=72T256520HFD3SB:revision=--/motherboard=0/memory-controller=1/dram-channel=2/dimm=3/rank=7 [13:02:59] / on ptolemy is CRITICAL: DISK CRITICAL - free space: / 182 MB (0% inode=91%): [13:05:28] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [13:06:19] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [13:19:09] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [13:23:59] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [13:26:30] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 218262 MB (4% inode=24%): [13:28:09] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 77725 MB (12% inode=99%): [13:28:59] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [13:52:39] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [13:55:09] FMA on amaranth is CRITICAL: Failed components: hc://:product-id=SUN-FIRE-X4150:server-id=amaranth:chassis-id=0819QAR1D1:serial=518545072303039020:part=72T256520HFD3SB:revision=--/motherboard=0/memory-controller=1/dram-channel=2/dimm=3/rank=7 [14:02:59] / on ptolemy is CRITICAL: DISK CRITICAL - free space: / 43 MB (0% inode=91%): [14:05:29] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [14:06:20] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [14:11:49] /sql on rosemary is WARNING: DISK WARNING - free space: /sql 86677 MB (8% inode=99%): [14:19:09] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [14:23:59] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [14:26:29] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 217164 MB (4% inode=24%): [14:28:09] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 77528 MB (12% inode=99%): [14:28:59] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [14:52:39] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [14:55:09] FMA on amaranth is CRITICAL: Failed components: hc://:product-id=SUN-FIRE-X4150:server-id=amaranth:chassis-id=0819QAR1D1:serial=518545072303039020:part=72T256520HFD3SB:revision=--/motherboard=0/memory-controller=1/dram-channel=2/dimm=3/rank=7 [15:02:59] / on ptolemy is CRITICAL: DISK CRITICAL - free space: / 0 MB (0% inode=91%): [15:05:29] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B: [15:06:20] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [15:19:10] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [15:23:59] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [15:26:29] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 216312 MB (4% inode=24%): [15:28:09] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 77413 MB (12% inode=99%): [15:29:09] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [15:39:10] Sun Grid Engine execd on willow is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [15:40:29] Sun Grid Engine execd on wolfsbane is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [15:41:39] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [15:42:59] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [15:43:09] Sun Grid Engine execd on willow is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [15:44:39] Sun Grid Engine execd on ortelius is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [15:45:09] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [15:48:29] Sun Grid Engine execd on wolfsbane is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [15:52:39] Sun Grid Engine execd on ortelius is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [15:55:09] FMA on amaranth is CRITICAL: Failed components: hc://:product-id=SUN-FIRE-X4150:server-id=amaranth:chassis-id=0819QAR1D1:serial=518545072303039020:part=72T256520HFD3SB:revision=--/motherboard=0/memory-controller=1/dram-channel=2/dimm=3/rank=7 [16:02:59] / on ptolemy is CRITICAL: DISK CRITICAL - free space: / 0 MB (0% inode=91%): [16:05:29] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [16:06:19] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [16:14:59] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [16:15:09] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [16:17:40] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [16:24:06] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [16:26:29] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 215576 MB (4% inode=23%): [16:28:10] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 77276 MB (12% inode=99%): [16:35:34] hello all [16:38:22] DaBPunkt: Unfortunately disk space on ptolemy has run out again :-( [16:38:37] *check* [16:40:00] looks like the ttp-access-log-file is still not rotated [16:40:04] null it now [16:40:25] The idea of keeping the month day and time part of the creation time while setting back the time for expiry turns out to be a bit more complicated than thought [16:40:54] space-proble fixed [16:40:59] / on ptolemy is OK: DISK OK - free space: / 10263 MB (51% inode=91%): [16:41:04] calculating the unix epoch time while considering leap seconds and days seems a little tricky [16:41:20] thanks for fixing [16:41:47] apmon_: the handling of "leap seconds" is a LITTLE extrem here ;) [16:42:26] is there no way get the date (in a class, struct or something) and that just set the day? [16:42:35] that → than [16:43:47] I am calling the C function stat that returns it as unix epoch time [16:46:05] then just substract a constant [16:46:09] I guess I might be able to do a gmtime and mktime [16:55:19] FMA on amaranth is CRITICAL: Failed components: hc://:product-id=SUN-FIRE-X4150:server-id=amaranth:chassis-id=0819QAR1D1:serial=518545072303039020:part=72T256520HFD3SB:revision=--/motherboard=0/memory-controller=1/dram-channel=2/dimm=3/rank=7 [17:05:29] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B: [17:06:19] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [17:14:59] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [17:15:09] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [17:17:39] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [17:23:59] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [17:26:29] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 213754 MB (4% inode=23%): [17:28:09] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 76909 MB (12% inode=99%): [17:45:45] DaBPunkt: The tile expiry process should now reset the creation time by exactly 20 years. So one can still identify when it was actually created by adding 20 years again if it is older than 2005 [17:55:19] FMA on amaranth is CRITICAL: Failed components: hc://:product-id=SUN-FIRE-X4150:server-id=amaranth:chassis-id=0819QAR1D1:serial=518545072303039020:part=72T256520HFD3SB:revision=--/motherboard=0/memory-controller=1/dram-channel=2/dimm=3/rank=7 [18:05:30] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B: [18:06:19] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [18:14:59] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [18:15:09] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [18:17:39] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [18:24:09] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [18:26:29] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 203869 MB (3% inode=22%): [18:28:09] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 76665 MB (12% inode=99%): [18:55:20] FMA on amaranth is CRITICAL: Failed components: hc://:product-id=SUN-FIRE-X4150:server-id=amaranth:chassis-id=0819QAR1D1:serial=518545072303039020:part=72T256520HFD3SB:revision=--/motherboard=0/memory-controller=1/dram-channel=2/dimm=3/rank=7 [19:05:29] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B: [19:06:19] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [19:14:59] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [19:15:09] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [19:17:39] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [19:26:29] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 205029 MB (3% inode=23%): [19:28:09] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 76471 MB (12% inode=99%): [19:53:59] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [19:55:19] FMA on amaranth is CRITICAL: Failed components: hc://:product-id=SUN-FIRE-X4150:server-id=amaranth:chassis-id=0819QAR1D1:serial=518545072303039020:part=72T256520HFD3SB:revision=--/motherboard=0/memory-controller=1/dram-channel=2/dimm=3/rank=7 [20:05:29] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [20:06:19] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [20:15:00] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [20:15:09] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [20:17:39] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [20:26:29] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 213002 MB (4% inode=23%): [20:28:09] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 76118 MB (12% inode=99%): [20:53:58] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [20:55:20] FMA on amaranth is CRITICAL: Failed components: hc://:product-id=SUN-FIRE-X4150:server-id=amaranth:chassis-id=0819QAR1D1:serial=518545072303039020:part=72T256520HFD3SB:revision=--/motherboard=0/memory-controller=1/dram-channel=2/dimm=3/rank=7 [21:05:29] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B: [21:06:20] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [21:15:00] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [21:15:09] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [21:17:39] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [21:26:29] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 212539 MB (4% inode=23%): [21:28:09] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 75963 MB (12% inode=99%): [21:53:59] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [21:55:19] FMA on amaranth is CRITICAL: Failed components: hc://:product-id=SUN-FIRE-X4150:server-id=amaranth:chassis-id=0819QAR1D1:serial=518545072303039020:part=72T256520HFD3SB:revision=--/motherboard=0/memory-controller=1/dram-channel=2/dimm=3/rank=7 [22:05:29] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [22:05:38] nacht ts [22:06:20] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [22:14:59] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [22:15:09] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [22:17:40] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [22:26:28] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 212068 MB (3% inode=23%): [22:27:49] /sql on cassia is WARNING: DISK WARNING - free space: /sql 87058 MB (7% inode=99%): [22:28:09] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 75767 MB (12% inode=99%): [22:53:59] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [22:55:19] FMA on amaranth is CRITICAL: Failed components: hc://:product-id=SUN-FIRE-X4150:server-id=amaranth:chassis-id=0819QAR1D1:serial=518545072303039020:part=72T256520HFD3SB:revision=--/motherboard=0/memory-controller=1/dram-channel=2/dimm=3/rank=7 [23:05:29] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [23:06:19] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [23:14:59] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [23:15:09] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [23:17:39] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [23:26:28] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 235792 MB (4% inode=25%): [23:28:09] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 75593 MB (12% inode=99%): [23:53:59] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [23:55:19] FMA on amaranth is CRITICAL: Failed components: hc://:product-id=SUN-FIRE-X4150:server-id=amaranth:chassis-id=0819QAR1D1:serial=518545072303039020:part=72T256520HFD3SB:revision=--/motherboard=0/memory-controller=1/dram-channel=2/dimm=3/rank=7