[00:01:02] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 104674.000000 [00:03:01] s4 replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 540745.000000 [00:08:32] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [00:13:11] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 105009 [00:16:12] APT on sage is CRITICAL: APT CRITICAL: 2 packages available for upgrade (1 critical updates). [00:23:42] /mnt user-store on rosemary is WARNING: DISK WARNING - free space: /mnt 514679 MB (9% inode=66%): [00:25:42] wikidata replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 64796.000000 [00:25:52] APT on z-dat-s2-b is CRITICAL: APT CRITICAL: 2 packages available for upgrade (1 critical updates). [00:25:52] APT on z-dat-s1-b is CRITICAL: APT CRITICAL: 2 packages available for upgrade (1 critical updates). [00:31:12] APT on nightshade is CRITICAL: APT CRITICAL: 3 packages available for upgrade (3 critical updates). [00:32:32] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [00:34:52] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [00:37:32] APT on yarrow is CRITICAL: APT CRITICAL: 3 packages available for upgrade (3 critical updates). [00:37:33] APT on mayapple is CRITICAL: APT CRITICAL: 3 packages available for upgrade (3 critical updates). [00:40:32] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [00:46:02] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [00:51:22] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 94824 MB (15% inode=99%): [00:51:32] APT on z-dat-s5-b is CRITICAL: APT CRITICAL: 2 packages available for upgrade (1 critical updates). [00:54:33] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A: [00:57:02] NTP on sage is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:01:01] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 106331.000000 [01:03:02] s4 replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 543261.000000 [01:06:01] /sql on rosemary is CRITICAL: DISK CRITICAL - free space: /sql 34976 MB (3% inode=99%): [01:08:32] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [01:13:12] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 106718 [01:16:11] APT on sage is CRITICAL: APT CRITICAL: 2 packages available for upgrade (1 critical updates). [01:23:42] /mnt user-store on rosemary is WARNING: DISK WARNING - free space: /mnt 517223 MB (9% inode=67%): [01:25:42] wikidata replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 68396.000000 [01:25:52] APT on z-dat-s2-b is CRITICAL: APT CRITICAL: 2 packages available for upgrade (1 critical updates). [01:25:52] APT on z-dat-s1-b is CRITICAL: APT CRITICAL: 2 packages available for upgrade (1 critical updates). [01:31:12] APT on nightshade is CRITICAL: APT CRITICAL: 3 packages available for upgrade (3 critical updates). [01:32:32] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [01:34:51] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [01:37:32] APT on yarrow is CRITICAL: APT CRITICAL: 3 packages available for upgrade (3 critical updates). [01:37:32] APT on mayapple is CRITICAL: APT CRITICAL: 3 packages available for upgrade (3 critical updates). [01:40:32] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [01:46:02] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [01:51:22] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 92643 MB (15% inode=99%): [01:51:32] APT on z-dat-s5-b is CRITICAL: APT CRITICAL: 2 packages available for upgrade (1 critical updates). [01:55:31] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A: [01:57:01] NTP on sage is CRITICAL: CRITICAL - Socket timeout after 10 seconds [02:01:02] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 107344.000000 [02:03:02] s4 replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 542436.000000 [02:08:32] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [02:13:12] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 107517 [02:16:12] APT on sage is CRITICAL: APT CRITICAL: 2 packages available for upgrade (1 critical updates). [02:23:42] /mnt user-store on rosemary is WARNING: DISK WARNING - free space: /mnt 517068 MB (9% inode=67%): [02:25:41] wikidata replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 71996.000000 [02:25:52] APT on z-dat-s2-b is CRITICAL: APT CRITICAL: 2 packages available for upgrade (1 critical updates). [02:25:52] APT on z-dat-s1-b is CRITICAL: APT CRITICAL: 2 packages available for upgrade (1 critical updates). [02:31:11] APT on nightshade is CRITICAL: APT CRITICAL: 3 packages available for upgrade (3 critical updates). [02:32:32] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [02:34:52] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [02:37:32] APT on yarrow is CRITICAL: APT CRITICAL: 3 packages available for upgrade (3 critical updates). [02:37:32] APT on mayapple is CRITICAL: APT CRITICAL: 3 packages available for upgrade (3 critical updates). [02:40:32] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [02:41:10] [[Special:Log/newusers]] create 10 * Mrspops * (New user account) [02:44:15] [[User talk:Mrspops]] !N 10https://wiki.toolserver.org/w/index.php?oldid=7886&rcid=21713 * Mrspops * (+301) (Created page with "Play surfing with our best products of surfboards and stand up paddle boards with an affordable price. Pop Paddle Boards has been one of the most famous brand names for the produ...") [02:46:11] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [02:51:21] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 94264 MB (15% inode=99%): [02:51:31] APT on z-dat-s5-b is CRITICAL: APT CRITICAL: 2 packages available for upgrade (1 critical updates). [02:54:50] [[User talk:Mrspops]] ! 10https://wiki.toolserver.org/w/index.php?diff=7887&oldid=7886&rcid=21714 * Tim.Landscheidt * (-285) (Delete.) [02:55:32] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A: [02:57:02] NTP on sage is CRITICAL: CRITICAL - Socket timeout after 10 seconds [03:01:02] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 109224.000000 [03:03:01] s4 replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 522572.000000 [03:08:39] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [03:13:12] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 109438 [03:16:12] APT on sage is CRITICAL: APT CRITICAL: 2 packages available for upgrade (1 critical updates). [03:23:42] /mnt user-store on rosemary is WARNING: DISK WARNING - free space: /mnt 516602 MB (9% inode=67%): [03:25:42] wikidata replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 75597.000000 [03:25:52] APT on z-dat-s2-b is CRITICAL: APT CRITICAL: 2 packages available for upgrade (1 critical updates). [03:25:52] APT on z-dat-s1-b is CRITICAL: APT CRITICAL: 2 packages available for upgrade (1 critical updates). [03:31:12] APT on nightshade is CRITICAL: APT CRITICAL: 3 packages available for upgrade (3 critical updates). [03:32:32] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [03:34:52] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [03:37:32] APT on yarrow is CRITICAL: APT CRITICAL: 3 packages available for upgrade (3 critical updates). [03:37:32] APT on mayapple is CRITICAL: APT CRITICAL: 3 packages available for upgrade (3 critical updates). [03:40:32] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [03:51:11] /sql on z-dat-s7-a is WARNING: DISK WARNING - free space: /sql 53026 MB (10% inode=99%): [03:51:22] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 93991 MB (15% inode=99%): [03:51:32] APT on z-dat-s5-b is CRITICAL: APT CRITICAL: 2 packages available for upgrade (1 critical updates). [03:55:32] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A: [03:57:02] NTP on sage is CRITICAL: CRITICAL - Socket timeout after 10 seconds [04:01:02] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 110653.000000 [04:03:01] s4 replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 504616.000000 [04:08:37] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [04:13:11] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 111039 [04:16:02] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [04:16:12] APT on sage is CRITICAL: APT CRITICAL: 2 packages available for upgrade (1 critical updates). [04:23:52] /mnt user-store on rosemary is WARNING: DISK WARNING - free space: /mnt 515788 MB (9% inode=67%): [04:25:42] wikidata replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 79196.000000 [04:25:52] APT on z-dat-s2-b is CRITICAL: APT CRITICAL: 2 packages available for upgrade (1 critical updates). [04:25:52] APT on z-dat-s1-b is CRITICAL: APT CRITICAL: 2 packages available for upgrade (1 critical updates). [04:31:12] APT on nightshade is CRITICAL: APT CRITICAL: 3 packages available for upgrade (3 critical updates). [04:32:32] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [04:34:52] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [04:37:32] APT on yarrow is CRITICAL: APT CRITICAL: 3 packages available for upgrade (3 critical updates). [04:37:33] APT on mayapple is CRITICAL: APT CRITICAL: 3 packages available for upgrade (3 critical updates). [04:40:31] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [04:51:22] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 93737 MB (15% inode=99%): [04:51:32] APT on z-dat-s5-b is CRITICAL: APT CRITICAL: 2 packages available for upgrade (1 critical updates). [04:55:32] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [04:57:02] NTP on sage is CRITICAL: CRITICAL - Socket timeout after 10 seconds [05:01:02] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 112917.000000 [05:03:02] s4 replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 478060.000000 [05:08:32] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [05:13:12] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 113398 [05:16:02] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [05:16:11] APT on sage is CRITICAL: APT CRITICAL: 2 packages available for upgrade (1 critical updates). [05:24:42] /mnt user-store on rosemary is WARNING: DISK WARNING - free space: /mnt 516829 MB (9% inode=67%): [05:25:42] wikidata replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 82797.000000 [05:25:52] APT on z-dat-s2-b is CRITICAL: APT CRITICAL: 2 packages available for upgrade (1 critical updates). [05:25:52] APT on z-dat-s1-b is CRITICAL: APT CRITICAL: 2 packages available for upgrade (1 critical updates). [05:31:12] APT on nightshade is CRITICAL: APT CRITICAL: 3 packages available for upgrade (3 critical updates). [05:32:32] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [05:34:51] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [05:37:32] APT on yarrow is CRITICAL: APT CRITICAL: 3 packages available for upgrade (3 critical updates). [05:37:42] APT on mayapple is CRITICAL: APT CRITICAL: 3 packages available for upgrade (3 critical updates). [05:40:32] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [05:51:22] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 93505 MB (15% inode=99%): [05:51:32] APT on z-dat-s5-b is CRITICAL: APT CRITICAL: 2 packages available for upgrade (1 critical updates). [05:55:32] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [05:57:02] NTP on sage is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:01:01] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 115153.000000 [06:03:02] s4 replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 471048.000000 [06:08:32] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [06:13:11] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 115690 [06:16:02] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [06:16:12] APT on sage is CRITICAL: APT CRITICAL: 2 packages available for upgrade (1 critical updates). [06:24:42] /mnt user-store on rosemary is WARNING: DISK WARNING - free space: /mnt 516759 MB (9% inode=67%): [06:25:42] wikidata replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 86396.000000 [06:25:52] APT on z-dat-s2-b is CRITICAL: APT CRITICAL: 2 packages available for upgrade (1 critical updates). [06:25:52] APT on z-dat-s1-b is CRITICAL: APT CRITICAL: 2 packages available for upgrade (1 critical updates). [06:31:12] APT on nightshade is CRITICAL: APT CRITICAL: 3 packages available for upgrade (3 critical updates). [06:32:32] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [06:34:52] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [06:37:32] APT on yarrow is CRITICAL: APT CRITICAL: 3 packages available for upgrade (3 critical updates). [06:38:32] APT on mayapple is CRITICAL: APT CRITICAL: 3 packages available for upgrade (3 critical updates). [06:40:32] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [06:43:49] [[Special:Log/delete]] delete 10 * MZMcBride * (deleted "[[02User talk:Mrspops10]]": spam) [06:44:06] [[Special:Log/block]] block 10 * MZMcBride * (blocked [[02User:Mrspops10]] with an expiry time of infinite (account creation disabled): spam) [06:49:51] [[Special:Log/newusers]] create 10 * Golfgreen * (New user account) [06:51:22] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 93264 MB (15% inode=99%): [06:51:32] APT on z-dat-s5-b is CRITICAL: APT CRITICAL: 2 packages available for upgrade (1 critical updates). [06:55:32] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [06:57:02] NTP on sage is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:01:01] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 118169.000000 [07:03:02] s4 replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 456943.000000 [07:08:32] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [07:13:11] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 118677 [07:16:02] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [07:16:12] APT on sage is CRITICAL: APT CRITICAL: 2 packages available for upgrade (1 critical updates). [07:19:36] [[Special:Log/newusers]] create 10 * Grasswholesaleturf * (New user account) [07:22:48] [[User talk:Grasswholesaleturf]] !N 10https://wiki.toolserver.org/w/index.php?oldid=7888&rcid=21719 * Grasswholesaleturf * (+1922) (Created page with "The expert Synthetic Grass & Artificial Grass Distributer Our Artificial Grass can be made use of for many distinctive varieties of playgrounds and play locations. Prevalent use...") [07:23:23] Susan: ^ [07:23:52] [[Special:Log/delete]] delete 10 * Stwalkerster * (deleted "[[02User talk:Grasswholesaleturf10]]": Spam) [07:24:01] ty stwalkerster [07:24:08] [[Special:Log/block]] block 10 * Stwalkerster * (blocked [[02User:Grasswholesaleturf10]] with an expiry time of infinite (account creation disabled): Spam) [07:24:20] np legoktm [07:24:51] /mnt user-store on rosemary is WARNING: DISK WARNING - free space: /mnt 516524 MB (9% inode=67%): [07:25:42] wikidata replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 89996.000000 [07:25:52] APT on z-dat-s1-b is CRITICAL: APT CRITICAL: 2 packages available for upgrade (1 critical updates). [07:25:52] APT on z-dat-s2-b is CRITICAL: APT CRITICAL: 2 packages available for upgrade (1 critical updates). [07:31:12] APT on nightshade is CRITICAL: APT CRITICAL: 3 packages available for upgrade (3 critical updates). [07:32:32] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [07:34:51] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [07:37:32] APT on yarrow is CRITICAL: APT CRITICAL: 3 packages available for upgrade (3 critical updates). [07:38:32] APT on mayapple is CRITICAL: APT CRITICAL: 3 packages available for upgrade (3 critical updates). [07:40:32] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [07:51:22] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 92996 MB (15% inode=99%): [07:51:32] APT on z-dat-s5-b is CRITICAL: APT CRITICAL: 2 packages available for upgrade (1 critical updates). [07:55:32] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A: [07:57:01] NTP on sage is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:01:02] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 120453.000000 [08:02:02] Load avg. on nightshade is WARNING: WARNING - load average: 17.39, 15.93, 13.34 [08:03:02] s4 replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 441143.000000 [08:08:32] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [08:13:12] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 120936 [08:16:01] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [08:16:02] Load avg. on nightshade is OK: OK - load average: 10.53, 14.68, 14.85 [08:16:12] APT on sage is CRITICAL: APT CRITICAL: 2 packages available for upgrade (1 critical updates). [08:24:52] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [08:25:41] wikidata replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 93596.000000 [08:25:42] /mnt user-store on rosemary is WARNING: DISK WARNING - free space: /mnt 516287 MB (9% inode=67%): [08:25:52] APT on z-dat-s2-b is CRITICAL: APT CRITICAL: 2 packages available for upgrade (1 critical updates). [08:25:52] APT on z-dat-s1-b is CRITICAL: APT CRITICAL: 2 packages available for upgrade (1 critical updates). [08:31:12] APT on nightshade is CRITICAL: APT CRITICAL: 3 packages available for upgrade (3 critical updates). [08:32:32] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [08:34:52] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [08:37:32] APT on yarrow is CRITICAL: APT CRITICAL: 3 packages available for upgrade (3 critical updates). [08:38:32] APT on mayapple is CRITICAL: APT CRITICAL: 3 packages available for upgrade (3 critical updates). [08:40:32] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [08:51:21] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 92685 MB (15% inode=99%): [08:51:32] APT on z-dat-s5-b is CRITICAL: APT CRITICAL: 2 packages available for upgrade (1 critical updates). [08:55:32] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A: [08:57:02] NTP on sage is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:01:02] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 122727.000000 [09:03:02] s4 replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 441206.000000 [09:08:31] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [09:13:12] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 123149 [09:16:02] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [09:16:12] APT on sage is CRITICAL: APT CRITICAL: 2 packages available for upgrade (1 critical updates). [09:24:52] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [09:25:41] wikidata replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 97196.000000 [09:25:42] /mnt user-store on rosemary is WARNING: DISK WARNING - free space: /mnt 516065 MB (9% inode=67%): [09:25:53] APT on z-dat-s2-b is CRITICAL: APT CRITICAL: 2 packages available for upgrade (1 critical updates). [09:25:53] APT on z-dat-s1-b is CRITICAL: APT CRITICAL: 2 packages available for upgrade (1 critical updates). [09:31:12] APT on nightshade is CRITICAL: APT CRITICAL: 3 packages available for upgrade (3 critical updates). [09:32:32] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [09:34:52] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [09:37:32] APT on yarrow is CRITICAL: APT CRITICAL: 3 packages available for upgrade (3 critical updates). [09:38:42] APT on mayapple is CRITICAL: APT CRITICAL: 3 packages available for upgrade (3 critical updates). [09:40:32] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [09:51:26] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 92392 MB (15% inode=99%): [09:51:46] APT on z-dat-s5-b is CRITICAL: APT CRITICAL: 2 packages available for upgrade (1 critical updates). [09:55:45] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A: [09:56:05] Load avg. on nightshade is WARNING: WARNING - load average: 21.55, 21.01, 17.09 [09:57:05] NTP on sage is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:01:04] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 123348.000000 [10:02:05] Load avg. on nightshade is OK: OK - load average: 8.44, 13.16, 14.82 [10:03:05] s4 replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 435497.000000 [10:08:08] Russell Blau * Re: [Toolserver-l] enwiki_p [10:08:45] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [10:13:14] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 123659 [10:16:15] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [10:16:15] APT on sage is CRITICAL: APT CRITICAL: 2 packages available for upgrade (1 critical updates). [10:24:55] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [10:25:50] wikidata replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 100796.000000 [10:25:50] /mnt user-store on rosemary is WARNING: DISK WARNING - free space: /mnt 515679 MB (9% inode=66%): [10:25:55] APT on z-dat-s2-b is CRITICAL: APT CRITICAL: 2 packages available for upgrade (1 critical updates). [10:25:55] APT on z-dat-s1-b is CRITICAL: APT CRITICAL: 2 packages available for upgrade (1 critical updates). [10:31:25] APT on nightshade is CRITICAL: APT CRITICAL: 3 packages available for upgrade (3 critical updates). [10:32:45] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [10:34:55] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [10:37:45] APT on yarrow is CRITICAL: APT CRITICAL: 3 packages available for upgrade (3 critical updates). [10:38:45] APT on mayapple is CRITICAL: APT CRITICAL: 3 packages available for upgrade (3 critical updates). [10:40:46] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [10:51:25] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 92040 MB (15% inode=99%): [10:51:45] APT on z-dat-s5-b is CRITICAL: APT CRITICAL: 2 packages available for upgrade (1 critical updates). [10:55:45] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A: [10:57:05] NTP on sage is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:01:04] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 125023.000000 [11:03:05] s4 replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 430576.000000 [11:08:45] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [11:13:15] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 125285 [11:13:25] wikidata replag on z-dat-s2-b is WARNING: QUERY WARNING: SELECT ts_rc_age() returned 2105.000000 [11:16:14] APT on sage is CRITICAL: APT CRITICAL: 2 packages available for upgrade (1 critical updates). [11:25:45] /mnt user-store on rosemary is WARNING: DISK WARNING - free space: /mnt 515284 MB (9% inode=66%): [11:25:45] wikidata replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 104398.000000 [11:25:45] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [11:25:56] APT on z-dat-s2-b is CRITICAL: APT CRITICAL: 2 packages available for upgrade (1 critical updates). [11:25:56] APT on z-dat-s1-b is CRITICAL: APT CRITICAL: 2 packages available for upgrade (1 critical updates). [11:26:55] MySQL slave on z-dat-s2-b is WARNING: SLOW_SLAVE WARNING: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 2150 [11:32:08] APT on nightshade is CRITICAL: APT CRITICAL: 3 packages available for upgrade (3 critical updates). [11:32:45] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [11:34:55] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [11:37:45] APT on yarrow is CRITICAL: APT CRITICAL: 3 packages available for upgrade (3 critical updates). [11:38:45] APT on mayapple is CRITICAL: APT CRITICAL: 3 packages available for upgrade (3 critical updates). [11:38:46] MySQL slave on z-dat-s5-b is WARNING: SLOW_SLAVE WARNING: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1976 [11:39:04] wikidata replag on z-dat-s5-b is WARNING: QUERY WARNING: SELECT ts_rc_age() returned 1961.000000 [11:41:45] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [11:41:45] MySQL slave on z-dat-s5-b is OK: Uptime: 1164547 Threads: 4 Questions: 1906558249 Slow queries: 16850 Opens: 1145266 Flush tables: 1 Open tables: 256 Queries per second avg: 1637.167 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1771 [11:42:05] wikidata replag on z-dat-s5-b is OK: QUERY OK: SELECT ts_rc_age() returned 1746.000000 [11:45:55] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [11:51:25] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 91739 MB (15% inode=99%): [11:51:45] APT on z-dat-s5-b is CRITICAL: APT CRITICAL: 2 packages available for upgrade (1 critical updates). [11:55:45] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A: [11:56:55] MySQL slave on z-dat-s2-b is OK: Uptime: 1169029 Threads: 11 Questions: 1748678630 Slow queries: 16044 Opens: 10612477 Flush tables: 1 Open tables: 256 Queries per second avg: 1495.838 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1795 [11:57:05] NTP on sage is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:01:05] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 126840.000000 [12:03:05] s4 replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 430303.000000 [12:08:45] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [12:13:15] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 127092 [12:13:25] wikidata replag on z-dat-s2-b is WARNING: QUERY WARNING: SELECT ts_rc_age() returned 2411.000000 [12:16:14] APT on sage is CRITICAL: APT CRITICAL: 2 packages available for upgrade (1 critical updates). [12:20:05] wikidata replag on z-dat-s5-b is WARNING: QUERY WARNING: SELECT ts_rc_age() returned 2004.000000 [12:20:45] MySQL slave on z-dat-s5-b is WARNING: SLOW_SLAVE WARNING: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 2008 [12:25:45] /mnt user-store on rosemary is WARNING: DISK WARNING - free space: /mnt 514936 MB (9% inode=66%): [12:25:45] wikidata replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 107998.000000 [12:25:55] APT on z-dat-s1-b is CRITICAL: APT CRITICAL: 2 packages available for upgrade (1 critical updates). [12:25:55] APT on z-dat-s2-b is CRITICAL: APT CRITICAL: 2 packages available for upgrade (1 critical updates). [12:26:45] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [12:31:24] APT on nightshade is CRITICAL: APT CRITICAL: 3 packages available for upgrade (3 critical updates). [12:32:45] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [12:34:55] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [12:37:45] APT on yarrow is CRITICAL: APT CRITICAL: 3 packages available for upgrade (3 critical updates). [12:38:45] APT on mayapple is CRITICAL: APT CRITICAL: 3 packages available for upgrade (3 critical updates). [12:40:24] hello all [12:41:45] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [12:45:55] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [12:49:17] @replag [12:51:25] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 91509 MB (15% inode=99%): [12:51:45] APT on z-dat-s5-b is CRITICAL: APT CRITICAL: 2 packages available for upgrade (1 critical updates). [12:52:29] DaBPunkt: s1-rr-a-wd: 56m 21s [+0.02 s/s]; s1-user: 1d 11h 26m 51s [+0.42 s/s]; s1-user-wd: 1d 6h 26m 46s [+1.00 s/s]; s2-rr: 5m 9s [-0.00 s/s]; s2-user: 5m 9s [-0.00 s/s]; s2-user-c: error; s2-user-wd: 56m 21s [+0.02 s/s]; s5-user: 51m 53s [+0.02 s/s] [12:52:30] DaBPunkt: s5-user-c: 4d 22h 55m 26s [-2.23 s/s]; s7-user: 1m 52s [-0.00 s/s] [12:55:46] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [12:57:04] NTP on sage is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:58:24] wikidata replag on z-dat-s2-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 3636.000000 [13:01:05] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 127849.000000 [13:03:05] s4 replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 427884.000000 [13:05:45] MySQL slave on z-dat-s5-b is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 3629 [13:06:05] wikidata replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 3645.000000 [13:06:15] /sql on rosemary is CRITICAL: DISK CRITICAL - free space: /sql 35061 MB (3% inode=99%): [13:08:45] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [13:13:15] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 128182 [13:16:14] APT on sage is CRITICAL: APT CRITICAL: 2 packages available for upgrade (1 critical updates). [13:25:45] wikidata replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 110743.000000 [13:25:45] /mnt user-store on rosemary is WARNING: DISK WARNING - free space: /mnt 514419 MB (9% inode=66%): [13:25:55] APT on z-dat-s2-b is CRITICAL: APT CRITICAL: 2 packages available for upgrade (1 critical updates). [13:26:46] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [13:31:24] APT on nightshade is CRITICAL: APT CRITICAL: 3 packages available for upgrade (3 critical updates). [13:32:45] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [13:34:55] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [13:37:45] APT on yarrow is CRITICAL: APT CRITICAL: 3 packages available for upgrade (3 critical updates). [13:38:46] APT on mayapple is CRITICAL: APT CRITICAL: 3 packages available for upgrade (3 critical updates). [13:41:45] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [13:45:55] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [13:51:24] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 91282 MB (15% inode=99%): [13:51:45] APT on z-dat-s5-b is CRITICAL: APT CRITICAL: 2 packages available for upgrade (1 critical updates). [13:55:45] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A: [13:57:05] NTP on sage is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:58:25] wikidata replag on z-dat-s2-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 5145.000000 [14:01:05] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 129252.000000 [14:03:05] s4 replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 426398.000000 [14:06:05] wikidata replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 4684.000000 [14:06:45] MySQL slave on z-dat-s5-b is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 4682 [14:08:45] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [14:13:15] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 129609 [14:16:15] APT on sage is CRITICAL: APT CRITICAL: 2 packages available for upgrade (1 critical updates). [14:25:45] wikidata replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 110069.000000 [14:25:56] APT on z-dat-s2-b is CRITICAL: APT CRITICAL: 2 packages available for upgrade (1 critical updates). [14:26:45] MySQL slave on z-dat-s5-b is WARNING: SLOW_SLAVE WARNING: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 3597 [14:26:45] /mnt user-store on rosemary is WARNING: DISK WARNING - free space: /mnt 519933 MB (9% inode=67%): [14:26:55] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [14:27:05] wikidata replag on z-dat-s5-b is WARNING: QUERY WARNING: SELECT ts_rc_age() returned 3572.000000 [14:31:25] APT on nightshade is CRITICAL: APT CRITICAL: 3 packages available for upgrade (3 critical updates). [14:32:45] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [14:34:55] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [14:37:45] APT on yarrow is CRITICAL: APT CRITICAL: 3 packages available for upgrade (3 critical updates). [14:38:45] APT on mayapple is CRITICAL: APT CRITICAL: 3 packages available for upgrade (3 critical updates). [14:41:46] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [14:45:55] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [14:51:24] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 91034 MB (14% inode=99%): [14:51:46] APT on z-dat-s5-b is CRITICAL: APT CRITICAL: 2 packages available for upgrade (1 critical updates). [14:55:45] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A: [14:57:05] NTP on sage is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:58:24] wikidata replag on z-dat-s2-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 6122.000000 [15:01:05] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 130467.000000 [15:02:45] MySQL slave on z-dat-s5-b is OK: Uptime: 1176607 Threads: 3 Questions: 1913387979 Slow queries: 17149 Opens: 1150770 Flush tables: 1 Open tables: 256 Queries per second avg: 1626.191 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1788 [15:03:04] wikidata replag on z-dat-s5-b is OK: QUERY OK: SELECT ts_rc_age() returned 1757.000000 [15:03:04] s4 replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 425412.000000 [15:08:46] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [15:13:15] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 130814 [15:16:15] APT on sage is CRITICAL: APT CRITICAL: 2 packages available for upgrade (1 critical updates). [15:25:46] wikidata replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 108891.000000 [15:25:55] APT on z-dat-s2-b is CRITICAL: APT CRITICAL: 2 packages available for upgrade (1 critical updates). [15:26:45] /mnt user-store on rosemary is WARNING: DISK WARNING - free space: /mnt 519768 MB (9% inode=67%): [15:27:46] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [15:31:25] APT on nightshade is CRITICAL: APT CRITICAL: 3 packages available for upgrade (3 critical updates). [15:32:45] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [15:34:55] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [15:37:48] APT on yarrow is CRITICAL: APT CRITICAL: 3 packages available for upgrade (3 critical updates). [15:38:45] APT on mayapple is CRITICAL: APT CRITICAL: 3 packages available for upgrade (3 critical updates). [15:41:45] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [15:45:54] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [15:46:23] DaBPunkt: hello, any news on the s1 reimport? It seems that sql-s1-rr and sql-s1-user are still pointing to rosemary; your last post on the mailing list said this would change last Sunday or Monday [15:49:37] the replag of commoms there were not decreasing as fast as I thought [15:49:53] but I can give it another try and see what happens [15:51:25] /sql on z-dat-s7-a is WARNING: DISK WARNING - free space: /sql 52184 MB (9% inode=99%): [15:51:25] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 90776 MB (14% inode=99%): [15:51:45] APT on z-dat-s5-b is CRITICAL: APT CRITICAL: 2 packages available for upgrade (1 critical updates). [15:55:45] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [15:57:05] NTP on sage is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:58:25] wikidata replag on z-dat-s2-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 7773.000000 [16:01:05] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 131983.000000 [16:03:04] s4 replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 414368.000000 [16:04:04] @replag [16:07:38] @replag [16:08:45] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [16:10:50] russblau: s1-rr-a: 11m 26s [+0.63 s/s]; s1-rr-a-wd: 2h 15m 5s [+0.27 s/s]; s1-user: 1d 12h 40m 43s [+0.13 s/s]; s1-user-wd: 1d 5h 52m 56s [-0.58 s/s]; s2-rr: 2m 35s [-0.26 s/s]; s2-user: 2m 35s [-0.26 s/s]; s2-user-c: error; s2-user-wd: 2h 15m 5s [+0.27 s/s] [16:10:51] russblau: s3-user: 39s [+0.07 s/s]; s5-user: 3m 38s [+0.71 s/s]; s5-user-c: 4d 18h 44m 26s [-0.16 s/s]; s7-user: 10s [-0.01 s/s] [16:13:14] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 132061 [16:16:15] APT on sage is CRITICAL: APT CRITICAL: 2 packages available for upgrade (1 critical updates). [16:25:46] wikidata replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 106779.000000 [16:25:55] APT on z-dat-s2-b is CRITICAL: APT CRITICAL: 2 packages available for upgrade (1 critical updates). [16:26:45] /mnt user-store on rosemary is WARNING: DISK WARNING - free space: /mnt 519435 MB (9% inode=67%): [16:27:55] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [16:31:25] APT on nightshade is CRITICAL: APT CRITICAL: 3 packages available for upgrade (3 critical updates). [16:32:45] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [16:34:55] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [16:37:45] APT on yarrow is CRITICAL: APT CRITICAL: 3 packages available for upgrade (3 critical updates). [16:38:45] APT on mayapple is CRITICAL: APT CRITICAL: 3 packages available for upgrade (3 critical updates). [16:41:45] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [16:45:55] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [16:51:25] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 90542 MB (14% inode=99%): [16:51:45] APT on z-dat-s5-b is CRITICAL: APT CRITICAL: 2 packages available for upgrade (1 critical updates). [16:55:45] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A: [16:57:05] NTP on sage is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:58:25] wikidata replag on z-dat-s2-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 7899.000000 [17:01:04] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 132262.000000 [17:03:05] s4 replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 402444.000000 [17:08:45] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [17:13:15] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 132307 [17:16:15] APT on sage is CRITICAL: APT CRITICAL: 2 packages available for upgrade (1 critical updates). [17:25:45] wikidata replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 103993.000000 [17:25:55] APT on z-dat-s2-b is CRITICAL: APT CRITICAL: 2 packages available for upgrade (1 critical updates). [17:26:45] /mnt user-store on rosemary is WARNING: DISK WARNING - free space: /mnt 519075 MB (9% inode=67%): [17:28:46] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [17:31:25] APT on nightshade is CRITICAL: APT CRITICAL: 3 packages available for upgrade (3 critical updates). [17:32:46] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [17:34:55] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [17:37:45] APT on yarrow is CRITICAL: APT CRITICAL: 3 packages available for upgrade (3 critical updates). [17:37:50] @replag [17:38:45] APT on mayapple is CRITICAL: APT CRITICAL: 3 packages available for upgrade (3 critical updates). [17:41:02] russblau: s1-rr-a: 1h 18m 31s [+0.74 s/s]; s1-rr-a-wd: 2h 5m 18s [-0.11 s/s]; s1-user: 1d 12h 35m 45s [-0.06 s/s]; s1-user-wd: 1d 4h 37m 13s [-0.84 s/s]; s2-rr: 8m 4s [+0.06 s/s]; s2-user: 8m 4s [+0.06 s/s]; s2-user-c: error; s2-user-wd: 2h 5m 18s [-0.11 s/s] [17:41:03] russblau: s3-user: 1m 11s [+0.01 s/s]; s5-user-c: 4d 11h 13m 9s [-5.00 s/s] [17:41:45] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [17:45:55] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [17:51:25] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 90331 MB (14% inode=99%): [17:51:45] APT on z-dat-s5-b is CRITICAL: APT CRITICAL: 2 packages available for upgrade (1 critical updates). [17:55:46] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A: [17:57:05] NTP on sage is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:58:25] wikidata replag on z-dat-s2-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 8112.000000 [18:01:04] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 131747.000000 [18:03:05] s4 replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 382816.000000 [18:08:45] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [18:13:15] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 131197 [18:16:14] APT on sage is CRITICAL: APT CRITICAL: 2 packages available for upgrade (1 critical updates). [18:25:45] wikidata replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 101046.000000 [18:25:55] APT on z-dat-s2-b is CRITICAL: APT CRITICAL: 2 packages available for upgrade (1 critical updates). [18:26:46] /mnt user-store on rosemary is WARNING: DISK WARNING - free space: /mnt 517147 MB (9% inode=67%): [18:28:45] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [18:31:24] APT on nightshade is CRITICAL: APT CRITICAL: 3 packages available for upgrade (3 critical updates). [18:33:45] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [18:34:55] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [18:37:45] APT on yarrow is CRITICAL: APT CRITICAL: 3 packages available for upgrade (3 critical updates). [18:38:45] APT on mayapple is CRITICAL: APT CRITICAL: 3 packages available for upgrade (3 critical updates). [18:41:46] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [18:45:55] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [18:51:25] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 90152 MB (14% inode=99%): [18:51:45] APT on z-dat-s5-b is CRITICAL: APT CRITICAL: 2 packages available for upgrade (1 critical updates). [18:55:45] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [18:57:04] NTP on sage is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:58:24] wikidata replag on z-dat-s2-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 8534.000000 [19:01:05] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 127410.000000 [19:03:05] s4 replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 374780.000000 [19:08:45] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [19:13:15] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 126260 [19:16:15] APT on sage is CRITICAL: APT CRITICAL: 2 packages available for upgrade (1 critical updates). [19:25:45] wikidata replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 98757.000000 [19:25:54] APT on z-dat-s2-b is CRITICAL: APT CRITICAL: 2 packages available for upgrade (1 critical updates). [19:26:45] /mnt user-store on rosemary is WARNING: DISK WARNING - free space: /mnt 515808 MB (9% inode=66%): [19:28:45] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [19:31:25] APT on nightshade is CRITICAL: APT CRITICAL: 3 packages available for upgrade (3 critical updates). [19:33:45] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [19:34:55] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [19:37:45] APT on yarrow is CRITICAL: APT CRITICAL: 3 packages available for upgrade (3 critical updates). [19:38:45] APT on mayapple is CRITICAL: APT CRITICAL: 3 packages available for upgrade (3 critical updates). [19:41:45] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [19:45:55] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [19:51:24] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 89912 MB (14% inode=99%): [19:51:45] APT on z-dat-s5-b is CRITICAL: APT CRITICAL: 2 packages available for upgrade (1 critical updates). [19:55:45] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A: [19:57:05] NTP on sage is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:58:24] wikidata replag on z-dat-s2-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 9018.000000 [20:01:05] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 122365.000000 [20:03:04] s4 replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 371856.000000 [20:08:46] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [20:09:06] hello [20:09:10] maintenance tonight [20:13:15] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 121159 [20:16:15] APT on sage is CRITICAL: APT CRITICAL: 2 packages available for upgrade (1 critical updates). [20:22:45] APT on mayapple is OK: APT OK: 0 packages available for upgrade (0 critical updates). [20:25:45] wikidata replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 94832.000000 [20:25:55] APT on z-dat-s2-b is CRITICAL: APT CRITICAL: 2 packages available for upgrade (1 critical updates). [20:26:45] /mnt user-store on rosemary is WARNING: DISK WARNING - free space: /mnt 515537 MB (9% inode=66%): [20:28:45] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [20:31:25] APT on nightshade is CRITICAL: APT CRITICAL: 3 packages available for upgrade (3 critical updates). [20:31:55] APT on yucca is CRITICAL: APT CRITICAL: 4 packages available for upgrade (3 critical updates). [20:33:45] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [20:34:55] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [20:37:46] APT on yarrow is CRITICAL: APT CRITICAL: 3 packages available for upgrade (3 critical updates). [20:38:45] APT on yarrow is OK: APT OK: 0 packages available for upgrade (0 critical updates). [20:39:25] APT on nightshade is OK: APT OK: 0 packages available for upgrade (0 critical updates). [20:39:55] APT on yucca is OK: APT OK: 0 packages available for upgrade (0 critical updates). [20:41:45] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [20:43:15] APT on sage is OK: APT OK: 0 packages available for upgrade (0 critical updates). [20:43:55] APT on z-dat-s1-b is OK: APT OK: 0 packages available for upgrade (0 critical updates). [20:44:08] DaB. * [Toolserver-l] Maintenance for sql-s1-rr, sql-s2 and sql-s5-user [20:44:51] APT on z-dat-s5-b is OK: APT OK: 0 packages available for upgrade (0 critical updates). [20:44:55] APT on z-dat-s2-b is OK: APT OK: 0 packages available for upgrade (0 critical updates). [20:45:55] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [20:51:25] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 89631 MB (14% inode=99%): [20:55:49] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A: [20:57:05] NTP on sage is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:58:25] wikidata replag on z-dat-s2-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 7677.000000 [21:01:05] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 118344.000000 [21:03:04] s4 replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 367282.000000 [21:03:19] turnera reboot - cross fingers [21:08:45] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [21:13:54] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 117438 [21:16:44] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 117526 [21:26:24] wikidata replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 91026.000000 [21:26:54] /mnt user-store on rosemary is WARNING: DISK WARNING - free space: /mnt 515299 MB (9% inode=66%): [21:29:44] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [21:34:13] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [21:35:54] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [21:42:34] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [21:51:34] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 89377 MB (14% inode=99%): [21:56:43] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A: [21:57:24] NTP on sage is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:59:24] wikidata replag on z-dat-s2-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 6549.000000 [22:01:14] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 116947.000000 [22:03:14] s4 replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 361656.000000 [22:09:14] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [22:15:53] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [22:16:44] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 116496 [22:26:24] wikidata replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 87206.000000 [22:26:54] /mnt user-store on rosemary is WARNING: DISK WARNING - free space: /mnt 514954 MB (9% inode=66%): [22:29:44] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [22:34:13] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [22:35:54] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [22:42:34] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [22:51:34] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 89139 MB (14% inode=99%): [22:56:44] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [22:57:24] NTP on sage is CRITICAL: CRITICAL - Socket timeout after 10 seconds [22:59:23] wikidata replag on z-dat-s2-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 7037.000000 [23:01:14] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 115786.000000 [23:03:13] s4 replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 352975.000000 [23:09:14] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [23:15:54] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [23:16:43] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 115133 [23:26:24] wikidata replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 82733.000000 [23:26:53] /mnt user-store on rosemary is WARNING: DISK WARNING - free space: /mnt 513364 MB (9% inode=66%): [23:29:54] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [23:34:14] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [23:35:54] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [23:42:34] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [23:51:34] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 88892 MB (14% inode=99%): [23:56:44] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [23:57:24] NTP on sage is CRITICAL: CRITICAL - Socket timeout after 10 seconds [23:59:23] wikidata replag on z-dat-s2-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 5504.000000