[00:05:04] s4 replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 36294.000000 [00:05:05] s4 replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 36298.000000 [00:07:04] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 66829 MB (10% inode=99%): [00:10:04] Avocato * [Toolserver-l] Output files [00:14:04] Patricia Pintilie * Re: [Toolserver-l] Output files [00:19:04] Avocato * Re: [Toolserver-l] Output files [00:22:14] /tmp on thyme is UNKNOWN: NRPE: Unable to read output [00:22:24] FC 0/19 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [00:22:24] FC 0/7 [daphne] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [00:22:24] FC 0/1 [far1-n1-oe16-esams B1] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [00:23:14] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [00:23:14] APT on yucca is WARNING: APT WARNING: 1 packages available for upgrade (0 critical updates). [00:23:14] FC 0/0 [SAN far1-n1-oe16-esams A1] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [00:23:14] FC 0/18 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [00:23:14] FC 0/6 [rosemary] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [00:24:05] /mnt on thyme is UNKNOWN: NRPE: Unable to read output [00:25:23] FC 0/10 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [00:25:23] FC 0/2 [hemlock] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [00:25:23] FC 0/8 [adenia] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [00:26:23] NTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:26:24] FC 0/22 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [00:26:24] FC 0/13 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [00:26:24] FC 0/21 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [00:26:24] FC 0/12 [thyme] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [00:27:04] FMA on thyme is CRITICAL: ERROR - unexpected output from snmpwalk [00:27:04] s1 replag on thyme is CRITICAL: QUERY CRITICAL: Cant connect to MySQL server on thyme (146) [00:27:13] NTP on sage is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:27:14] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 675746.000000 [00:27:14] wikidata replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 852152.000000 [00:27:15] FC 0/3 [cassia] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [00:27:15] FC 0/17 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [00:27:15] FC 0/15 [fsw2-n1-oe16-esams] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [00:27:24] FMA on amaranth is CRITICAL: ERROR - unexpected output from snmpwalk [00:27:34] SMF on web.amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [00:27:34] Load avg. on amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [00:28:14] FC 0/16 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [00:28:14] FC 0/4 [hyacinth] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [00:29:14] NTP on amaranth is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:29:14] FC 0/14 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [00:29:14] FC 0/23 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [00:29:14] eth0 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [00:29:14] APT on sage is WARNING: APT WARNING: 3 packages available for upgrade (0 critical updates). [00:29:34] SMF on amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [00:30:04] Load avg. on thyme is UNKNOWN: NRPE: Unable to read output [00:30:04] Patricia Pintilie * Re: [Toolserver-l] Output files [00:30:04] / on thyme is UNKNOWN: NRPE: Unable to read output [00:30:04] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [00:30:04] wikidata replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 180680.000000 [00:31:14] SMTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:31:14] FC 0/5 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [00:31:24] FC 0/11 [fsw2-n1-oe16-esams] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [00:31:24] FC 0/20 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [00:31:24] FC 0/9 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [00:33:04] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [00:33:05] wikidata replag on z-dat-s2-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 579083.000000 [00:33:05] RAID on thyme is UNKNOWN: NRPE: Unable to read output [00:34:04] Environment IPMI on thyme is UNKNOWN: NRPE: Unable to read output [00:34:04] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A: [00:36:13] Free Memory on damiana is CRITICAL: CRITICAL - 3.0% (249452 kB) free! [00:47:43] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [00:48:13] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 305539 MB (5% inode=63%): [01:05:04] s4 replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 39894.000000 [01:05:05] s4 replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 39898.000000 [01:07:04] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 66614 MB (10% inode=99%): [01:22:14] /tmp on thyme is UNKNOWN: NRPE: Unable to read output [01:22:24] FC 0/7 [daphne] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [01:22:24] FC 0/19 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [01:22:24] FC 0/1 [far1-n1-oe16-esams B1] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [01:23:14] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [01:23:14] APT on yucca is WARNING: APT WARNING: 1 packages available for upgrade (0 critical updates). [01:23:14] FC 0/0 [SAN far1-n1-oe16-esams A1] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [01:23:14] FC 0/18 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [01:24:04] /mnt on thyme is UNKNOWN: NRPE: Unable to read output [01:24:14] FC 0/6 [rosemary] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [01:25:23] FC 0/10 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [01:25:24] FC 0/8 [adenia] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [01:25:24] FC 0/2 [hemlock] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [01:26:23] NTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:26:24] FC 0/12 [thyme] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [01:26:24] FC 0/21 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [01:26:24] FC 0/22 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [01:26:24] FC 0/13 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [01:27:13] NTP on sage is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:27:14] FC 0/17 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [01:27:14] FC 0/3 [cassia] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [01:27:15] FC 0/15 [fsw2-n1-oe16-esams] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [01:27:15] wikidata replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 855754.000000 [01:27:15] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 674676.000000 [01:27:24] FMA on amaranth is CRITICAL: ERROR - unexpected output from snmpwalk [01:27:34] Load avg. on amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [01:27:34] SMF on web.amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [01:28:04] FMA on thyme is CRITICAL: ERROR - unexpected output from snmpwalk [01:28:04] s1 replag on thyme is CRITICAL: QUERY CRITICAL: Cant connect to MySQL server on thyme (146) [01:28:14] FC 0/16 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [01:28:14] FC 0/4 [hyacinth] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [01:29:14] NTP on amaranth is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:29:14] eth0 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [01:29:14] FC 0/23 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [01:29:14] FC 0/14 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [01:29:14] APT on sage is WARNING: APT WARNING: 3 packages available for upgrade (0 critical updates). [01:29:34] SMF on amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [01:30:04] / on thyme is UNKNOWN: NRPE: Unable to read output [01:30:04] wikidata replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 184281.000000 [01:30:04] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [01:31:05] Load avg. on thyme is UNKNOWN: NRPE: Unable to read output [01:31:14] SMTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:31:14] FC 0/5 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [01:31:24] FC 0/20 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [01:31:24] FC 0/9 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [01:31:24] FC 0/11 [fsw2-n1-oe16-esams] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [01:34:04] Environment IPMI on thyme is UNKNOWN: NRPE: Unable to read output [01:34:04] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [01:34:05] wikidata replag on z-dat-s2-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 580776.000000 [01:34:05] RAID on thyme is UNKNOWN: NRPE: Unable to read output [01:34:05] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A: [01:36:14] Free Memory on damiana is CRITICAL: CRITICAL - 2.9% (244096 kB) free! [01:47:43] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [01:48:13] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 305352 MB (5% inode=63%): [02:05:04] s4 replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 43494.000000 [02:05:05] s4 replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 43498.000000 [02:07:04] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 64489 MB (10% inode=99%): [02:22:14] /tmp on thyme is UNKNOWN: NRPE: Unable to read output [02:22:24] FC 0/7 [daphne] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [02:22:24] FC 0/19 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [02:22:24] FC 0/1 [far1-n1-oe16-esams B1] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [02:23:13] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [02:23:14] APT on yucca is WARNING: APT WARNING: 1 packages available for upgrade (0 critical updates). [02:23:14] FC 0/18 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [02:23:14] FC 0/0 [SAN far1-n1-oe16-esams A1] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [02:24:05] /mnt on thyme is UNKNOWN: NRPE: Unable to read output [02:24:14] FC 0/6 [rosemary] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [02:25:24] FC 0/10 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [02:25:24] FC 0/2 [hemlock] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [02:25:24] FC 0/8 [adenia] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [02:26:23] NTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [02:26:23] FC 0/12 [thyme] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [02:26:24] FC 0/22 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [02:26:24] FC 0/21 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [02:26:24] FC 0/13 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [02:27:14] NTP on sage is CRITICAL: CRITICAL - Socket timeout after 10 seconds [02:27:15] FC 0/17 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [02:27:15] FC 0/3 [cassia] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [02:27:15] FC 0/15 [fsw2-n1-oe16-esams] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [02:27:15] wikidata replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 859353.000000 [02:27:15] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 673026.000000 [02:27:24] FMA on amaranth is CRITICAL: ERROR - unexpected output from snmpwalk [02:27:34] SMF on web.amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [02:27:34] Load avg. on amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [02:28:04] FMA on thyme is CRITICAL: ERROR - unexpected output from snmpwalk [02:28:05] s1 replag on thyme is CRITICAL: QUERY CRITICAL: Cant connect to MySQL server on thyme (146) [02:28:14] FC 0/4 [hyacinth] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [02:28:14] FC 0/16 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [02:29:14] NTP on amaranth is CRITICAL: CRITICAL - Socket timeout after 10 seconds [02:29:14] FC 0/14 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [02:29:15] eth0 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [02:29:15] FC 0/23 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [02:29:15] APT on sage is WARNING: APT WARNING: 3 packages available for upgrade (0 critical updates). [02:29:34] SMF on amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [02:30:04] / on thyme is UNKNOWN: NRPE: Unable to read output [02:30:04] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [02:30:04] wikidata replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 187880.000000 [02:31:04] Load avg. on thyme is UNKNOWN: NRPE: Unable to read output [02:31:05] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 67776 MB (11% inode=99%): [02:31:14] SMTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [02:31:14] FC 0/5 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [02:31:24] FC 0/20 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [02:31:24] FC 0/11 [fsw2-n1-oe16-esams] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [02:31:24] FC 0/9 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [02:32:04] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 66897 MB (10% inode=99%): [02:34:04] Environment IPMI on thyme is UNKNOWN: NRPE: Unable to read output [02:34:04] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [02:34:05] wikidata replag on z-dat-s2-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 580637.000000 [02:34:05] RAID on thyme is UNKNOWN: NRPE: Unable to read output [02:34:05] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A: [02:36:14] Free Memory on damiana is CRITICAL: CRITICAL - 3.4% (281604 kB) free! [02:47:43] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [02:48:14] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 305191 MB (5% inode=63%): [07:58:04] MySQL slave on z-dat-s5-b is CRITICAL: (Return code of 139 is out of bounds) [07:58:07] MySQL slave on z-dat-s2-b is CRITICAL: (Return code of 139 is out of bounds) [07:58:07] MySQL slave on z-dat-s1-b is CRITICAL: (Return code of 139 is out of bounds) [07:59:35] wikidata replag on z-dat-s5-b is CRITICAL: (Service Check Timed Out) [08:07:25] s4 replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 65239.000000 [08:07:25] s4 replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 65239.000000 [08:19:56] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [08:48:56] /mnt on thyme is UNKNOWN: NRPE: Unable to read output [08:48:56] s1 replag on thyme is CRITICAL: QUERY CRITICAL: Cant connect to MySQL server on thyme (146) [08:48:57] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 303237 MB (5% inode=63%): [08:48:57] /tmp on thyme is UNKNOWN: NRPE: Unable to read output [08:48:57] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [08:49:05] Environment IPMI on thyme is UNKNOWN: NRPE: Unable to read output [08:49:06] APT on sage is WARNING: APT WARNING: 3 packages available for upgrade (0 critical updates). [08:49:06] FC 0/11 [fsw2-n1-oe16-esams] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [08:49:06] FC 0/9 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [08:49:06] FC 0/1 [far1-n1-oe16-esams B1] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [08:49:07] FC 0/20 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [08:49:07] FC 0/6 [rosemary] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [08:49:25] FMA on thyme is CRITICAL: ERROR - unexpected output from snmpwalk [08:49:36] wikidata replag on z-dat-s2-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 593377.000000 [08:49:36] RAID on thyme is UNKNOWN: NRPE: Unable to read output [08:49:36] wikidata replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 882294.000000 [08:49:36] NTP on sage is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:49:36] FC 0/3 [cassia] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [08:49:36] FC 0/16 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [08:49:36] FC 0/15 [fsw2-n1-oe16-esams] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [08:49:37] FC 0/4 [hyacinth] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [08:49:46] wikidata replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 210654.000000 [08:49:46] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 65388 MB (10% inode=99%): [08:49:46] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [08:49:46] FC 0/5 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [08:49:46] FC 0/17 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [08:49:46] Load avg. on amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [08:49:46] SMF on web.amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [08:49:47] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicati [08:49:47] / on thyme is UNKNOWN: NRPE: Unable to read output [08:49:56] FC 0/0 [SAN far1-n1-oe16-esams A1] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [08:49:56] FC 0/18 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [08:49:56] APT on yucca is WARNING: APT WARNING: 1 packages available for upgrade (0 critical updates). [08:49:56] FC 0/7 [daphne] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [08:49:56] FC 0/8 [adenia] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [08:49:56] FC 0/2 [hemlock] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [08:49:56] FC 0/10 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [08:50:15] FMA on amaranth is CRITICAL: ERROR - unexpected output from snmpwalk [08:50:15] FC 0/21 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [08:50:15] FC 0/12 [thyme] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [08:50:15] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 685699.000000 [08:50:15] NTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:50:15] Load avg. on thyme is UNKNOWN: NRPE: Unable to read output [08:50:25] FC 0/23 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [08:50:25] eth0 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [08:50:25] FC 0/14 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [08:50:25] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [08:50:26] SMTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:50:26] NTP on amaranth is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:50:56] FC 0/19 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [08:51:06] SMF on amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [08:51:15] FC 0/13 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [08:51:15] FC 0/22 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [08:55:56] MySQL slave on z-dat-s5-b is CRITICAL: (Return code of 139 is out of bounds) [08:56:05] MySQL slave on z-dat-s1-b is CRITICAL: (Return code of 139 is out of bounds) [08:56:06] MySQL slave on z-dat-s2-b is CRITICAL: (Return code of 139 is out of bounds) [09:00:15] wikidata replag on z-dat-s5-b is CRITICAL: (Service Check Timed Out) [09:07:25] s4 replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 68839.000000 [09:07:25] s4 replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 68839.000000 [09:23:04] Lydia Pintscher * Re: [Toolserver-l] Wikidata tables [09:49:01] /mnt on thyme is UNKNOWN: NRPE: Unable to read output [09:49:01] s1 replag on thyme is CRITICAL: QUERY CRITICAL: Cant connect to MySQL server on thyme (146) [09:49:02] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [09:49:02] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 302992 MB (5% inode=63%): [09:49:02] /tmp on thyme is UNKNOWN: NRPE: Unable to read output [09:49:19] Environment IPMI on thyme is UNKNOWN: NRPE: Unable to read output [09:49:32] APT on sage is WARNING: APT WARNING: 3 packages available for upgrade (0 critical updates). [09:49:32] FC 0/9 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [09:49:32] FC 0/11 [fsw2-n1-oe16-esams] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [09:49:32] FC 0/1 [far1-n1-oe16-esams B1] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [09:49:32] FC 0/6 [rosemary] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [09:49:33] FC 0/20 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [09:49:40] FMA on thyme is CRITICAL: ERROR - unexpected output from snmpwalk [09:49:41] RAID on thyme is UNKNOWN: NRPE: Unable to read output [09:49:41] wikidata replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 885898.000000 [09:49:41] NTP on sage is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:49:41] FC 0/15 [fsw2-n1-oe16-esams] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [09:49:41] FC 0/16 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [09:49:41] FC 0/4 [hyacinth] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [09:49:42] FC 0/3 [cassia] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [09:49:49] wikidata replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 214260.000000 [09:49:49] FC 0/17 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [09:49:50] FC 0/5 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [09:49:50] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 65090 MB (10% inode=99%): [09:49:50] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [09:50:01] / on thyme is UNKNOWN: NRPE: Unable to read output [09:50:01] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A: [09:50:01] Load avg. on amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [09:50:01] SMF on web.amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [09:50:01] APT on yucca is WARNING: APT WARNING: 1 packages available for upgrade (0 critical updates). [09:50:01] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [09:50:09] FC 0/18 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [09:50:09] FC 0/8 [adenia] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [09:50:09] FC 0/0 [SAN far1-n1-oe16-esams A1] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [09:50:09] FC 0/7 [daphne] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [09:50:09] FC 0/2 [hemlock] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [09:50:09] FC 0/10 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [09:50:21] [[Special:Log/newusers]] create 10 * Ksirini * (New user account) [09:50:32] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 689311.000000 [09:50:32] Load avg. on thyme is UNKNOWN: NRPE: Unable to read output [09:50:32] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [09:50:32] FMA on amaranth is CRITICAL: ERROR - unexpected output from snmpwalk [09:50:32] wikidata replag on z-dat-s2-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 597038.000000 [09:50:40] NTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:50:40] FC 0/12 [thyme] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [09:50:40] FC 0/21 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [09:50:40] SMTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:50:40] FC 0/23 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [09:50:40] FC 0/14 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [09:50:40] eth0 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [09:50:41] NTP on amaranth is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:51:08] FC 0/19 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [09:51:08] SMF on amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [09:51:39] FC 0/13 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [09:51:40] FC 0/22 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [09:56:19] MySQL slave on z-dat-s5-b is CRITICAL: (Return code of 139 is out of bounds) [09:56:32] MySQL slave on z-dat-s1-b is CRITICAL: (Return code of 139 is out of bounds) [09:56:32] MySQL slave on z-dat-s2-b is CRITICAL: (Return code of 139 is out of bounds) [10:01:08] wikidata replag on z-dat-s5-b is CRITICAL: (Service Check Timed Out) [10:07:30] s4 replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 72443.000000 [10:07:32] s4 replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 72441.000000 [10:21:44] [[Category:Tools]] ! 10https://wiki.toolserver.org/w/index.php?diff=7907&oldid=7889&rcid=21764 * Ksirini * (+16442) (Τριάντα χρόνια από τον θάνατο του Σταμάτη Μανούση) [10:23:23] [[Category:Tools]] ! 10https://wiki.toolserver.org/w/index.php?diff=7908&oldid=7907&rcid=21765 * Ksirini * (+5) () [10:26:19] /sql on rosemary is CRITICAL: DISK CRITICAL - free space: /sql 19467 MB (1% inode=99%): [10:43:50] /sql on z-dat-s7-a is CRITICAL: DISK CRITICAL - free space: /sql 22271 MB (4% inode=99%): [10:44:41] wikidata replag on z-dat-s6-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 678768.000000 [10:44:41] wikidata replag on z-dat-s7-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 557160.000000 [10:46:05] Magnus Manske * Re: [Toolserver-l] Wikidata tables [10:49:19] Environment IPMI on thyme is UNKNOWN: NRPE: Unable to read output [10:49:41] RAID on thyme is UNKNOWN: NRPE: Unable to read output [10:49:41] wikidata replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 889499.000000 [10:49:49] FMA on thyme is CRITICAL: ERROR - unexpected output from snmpwalk [10:49:50] wikidata replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 217860.000000 [10:49:50] NTP on sage is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:49:50] FC 0/3 [cassia] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [10:49:50] FC 0/4 [hyacinth] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [10:49:50] FC 0/15 [fsw2-n1-oe16-esams] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [10:49:50] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 64797 MB (10% inode=99%): [10:49:51] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [10:49:51] FC 0/17 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [10:49:52] FC 0/16 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [10:49:52] FC 0/5 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [10:49:59] / on thyme is UNKNOWN: NRPE: Unable to read output [10:50:01] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicati [10:50:01] /mnt on thyme is UNKNOWN: NRPE: Unable to read output [10:50:01] s1 replag on thyme is CRITICAL: QUERY CRITICAL: Cant connect to MySQL server on thyme (146) [10:50:01] /tmp on thyme is UNKNOWN: NRPE: Unable to read output [10:50:01] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 302645 MB (5% inode=62%): [10:50:01] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [10:50:08] FC 0/7 [daphne] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [10:50:08] FC 0/8 [adenia] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [10:50:08] FC 0/0 [SAN far1-n1-oe16-esams A1] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [10:50:08] FC 0/18 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [10:50:08] Load avg. on amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [10:50:09] SMF on web.amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [10:50:30] APT on sage is WARNING: APT WARNING: 3 packages available for upgrade (0 critical updates). [10:50:31] FC 0/1 [far1-n1-oe16-esams B1] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [10:50:31] FC 0/6 [rosemary] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [10:50:31] FC 0/11 [fsw2-n1-oe16-esams] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [10:50:31] FC 0/9 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [10:50:31] FC 0/20 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [10:50:41] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [10:50:41] wikidata replag on z-dat-s2-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 600645.000000 [10:50:50] FMA on amaranth is CRITICAL: ERROR - unexpected output from snmpwalk [10:50:50] NTP on amaranth is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:50:50] NTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:50:50] SMTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:50:50] FC 0/12 [thyme] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [10:50:50] eth0 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [10:50:51] FC 0/21 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [10:50:51] FC 0/14 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [10:50:52] FC 0/23 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [10:50:59] APT on yucca is WARNING: APT WARNING: 1 packages available for upgrade (0 critical updates). [10:51:08] FC 0/10 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [10:51:08] FC 0/19 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [10:51:08] FC 0/2 [hemlock] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [10:51:08] SMF on amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [10:51:31] Load avg. on thyme is UNKNOWN: NRPE: Unable to read output [10:51:32] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 692971.000000 [10:51:49] FC 0/13 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [10:51:50] FC 0/22 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [10:56:19] MySQL slave on z-dat-s5-b is CRITICAL: (Return code of 139 is out of bounds) [10:57:30] MySQL slave on z-dat-s1-b is CRITICAL: (Return code of 139 is out of bounds) [10:57:31] MySQL slave on z-dat-s2-b is CRITICAL: (Return code of 139 is out of bounds) [11:01:50] wikidata replag on z-dat-s5-b is CRITICAL: (Service Check Timed Out) [11:05:31] Free Memory on turnera is WARNING: WARNING - 5.4% (454800 kB) free! [11:08:30] s4 replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 76103.000000 [11:08:30] s4 replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 76101.000000 [11:19:49] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [11:43:31] Free Memory on turnera is CRITICAL: CRITICAL - 5.0% (420732 kB) free! [11:44:40] wikidata replag on z-dat-s6-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 682369.000000 [11:44:50] wikidata replag on z-dat-s7-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 560766.000000 [11:45:31] Free Memory on turnera is WARNING: WARNING - 6.2% (517888 kB) free! [11:49:20] Environment IPMI on thyme is UNKNOWN: NRPE: Unable to read output [11:49:30] Free Memory on turnera is OK: OK - 7.2% (604324 kB) free. [11:49:50] FMA on thyme is CRITICAL: ERROR - unexpected output from snmpwalk [11:49:50] wikidata replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 221461.000000 [11:49:50] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 64534 MB (10% inode=99%): [11:49:50] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [11:49:51] NTP on sage is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:49:51] FC 0/15 [fsw2-n1-oe16-esams] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [11:49:51] FC 0/3 [cassia] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [11:49:52] FC 0/4 [hyacinth] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [11:49:52] FC 0/16 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [11:49:53] FC 0/17 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [11:49:53] FC 0/5 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [11:50:00] / on thyme is UNKNOWN: NRPE: Unable to read output [11:50:01] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A: [11:50:01] /mnt on thyme is UNKNOWN: NRPE: Unable to read output [11:50:01] s1 replag on thyme is CRITICAL: QUERY CRITICAL: Cant connect to MySQL server on thyme (146) [11:50:01] /tmp on thyme is UNKNOWN: NRPE: Unable to read output [11:50:01] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 302359 MB (5% inode=62%): [11:50:01] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [11:50:08] FC 0/0 [SAN far1-n1-oe16-esams A1] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [11:50:09] FC 0/7 [daphne] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [11:50:09] FC 0/8 [adenia] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [11:50:09] FC 0/18 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [11:50:19] SMF on web.amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [11:50:20] Load avg. on amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [11:50:31] APT on sage is WARNING: APT WARNING: 3 packages available for upgrade (0 critical updates). [11:50:31] FC 0/20 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [11:50:31] FC 0/9 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [11:50:31] FC 0/1 [far1-n1-oe16-esams B1] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [11:50:31] FC 0/11 [fsw2-n1-oe16-esams] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [11:50:31] FC 0/6 [rosemary] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [11:50:40] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [11:50:40] RAID on thyme is UNKNOWN: NRPE: Unable to read output [11:50:41] wikidata replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 893160.000000 [11:50:50] FMA on amaranth is CRITICAL: ERROR - unexpected output from snmpwalk [11:50:50] NTP on amaranth is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:50:50] NTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:50:50] SMTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:50:51] FC 0/12 [thyme] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [11:50:51] FC 0/21 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [11:51:01] eth0 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [11:51:01] FC 0/23 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [11:51:01] FC 0/14 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [11:51:01] APT on yucca is WARNING: APT WARNING: 1 packages available for upgrade (0 critical updates). [11:51:08] FC 0/19 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [11:51:08] FC 0/2 [hemlock] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [11:51:08] FC 0/10 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [11:51:19] SMF on amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [11:51:31] Load avg. on thyme is UNKNOWN: NRPE: Unable to read output [11:51:31] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 696571.000000 [11:51:40] wikidata replag on z-dat-s2-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 604306.000000 [11:51:50] FC 0/13 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [11:52:00] FC 0/22 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [11:56:19] MySQL slave on z-dat-s5-b is CRITICAL: (Return code of 139 is out of bounds) [11:57:31] MySQL slave on z-dat-s1-b is CRITICAL: (Return code of 139 is out of bounds) [11:57:31] MySQL slave on z-dat-s2-b is CRITICAL: (Return code of 139 is out of bounds) [12:02:30] wikidata replag on z-dat-s5-b is CRITICAL: (Service Check Timed Out) [12:04:19] / on wolfsbane is WARNING: DISK WARNING - free space: / 6234 MB (20% inode=93%): [12:07:19] /tmp on wolfsbane is WARNING: DISK WARNING - free space: / 6268 MB (20% inode=93%): [12:08:31] s4 replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 79703.000000 [12:08:31] s4 replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 79701.000000 [12:19:50] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [12:24:31] Free Memory on turnera is CRITICAL: CRITICAL - 3.0% (252996 kB) free! [12:28:30] Free Memory on turnera is OK: OK - 9.8% (817284 kB) free. [12:44:41] wikidata replag on z-dat-s6-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 685970.000000 [12:44:50] wikidata replag on z-dat-s7-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 564367.000000 [12:49:19] Environment IPMI on thyme is UNKNOWN: NRPE: Unable to read output [12:49:51] wikidata replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 225061.000000 [12:49:51] FMA on thyme is CRITICAL: ERROR - unexpected output from snmpwalk [12:49:51] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 64275 MB (10% inode=99%): [12:49:51] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [12:49:51] NTP on sage is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:49:52] FC 0/16 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [12:49:52] FC 0/5 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [12:50:00] FC 0/17 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [12:50:00] FC 0/15 [fsw2-n1-oe16-esams] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [12:50:00] / on thyme is UNKNOWN: NRPE: Unable to read output [12:50:00] FC 0/4 [hyacinth] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [12:50:00] /mnt on thyme is UNKNOWN: NRPE: Unable to read output [12:50:01] s1 replag on thyme is CRITICAL: QUERY CRITICAL: Cant connect to MySQL server on thyme (146) [12:50:01] FC 0/3 [cassia] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [12:50:02] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A: [12:50:02] /tmp on thyme is UNKNOWN: NRPE: Unable to read output [12:50:03] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 302035 MB (5% inode=62%): [12:50:03] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [12:50:04] Patricia Pintilie * Re: [Toolserver-l] Wikidata tables [12:50:08] FC 0/7 [daphne] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [12:50:08] FC 0/0 [SAN far1-n1-oe16-esams A1] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [12:50:08] FC 0/8 [adenia] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [12:50:08] FC 0/18 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [12:50:18] Load avg. on amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [12:50:19] SMF on web.amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [12:50:30] APT on sage is WARNING: APT WARNING: 3 packages available for upgrade (0 critical updates). [12:50:31] FC 0/6 [rosemary] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [12:50:31] FC 0/1 [far1-n1-oe16-esams B1] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [12:50:31] FC 0/11 [fsw2-n1-oe16-esams] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [12:50:31] FC 0/20 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [12:50:31] FC 0/9 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [12:50:40] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [12:50:41] RAID on thyme is UNKNOWN: NRPE: Unable to read output [12:50:41] wikidata replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 896760.000000 [12:50:51] FMA on amaranth is CRITICAL: ERROR - unexpected output from snmpwalk [12:50:51] NTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:50:51] NTP on amaranth is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:50:51] SMTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:51:01] eth0 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [12:51:01] FC 0/14 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [12:51:01] FC 0/21 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [12:51:01] FC 0/12 [thyme] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [12:51:01] APT on yucca is WARNING: APT WARNING: 1 packages available for upgrade (0 critical updates). [12:51:08] FC 0/2 [hemlock] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [12:51:08] FC 0/19 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [12:51:08] FC 0/10 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [12:51:19] SMF on amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [12:51:40] wikidata replag on z-dat-s2-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 607906.000000 [12:51:50] FC 0/23 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [12:51:50] FC 0/13 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [12:52:00] FC 0/22 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [12:52:31] Load avg. on thyme is UNKNOWN: NRPE: Unable to read output [12:52:31] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 700232.000000 [12:56:20] MySQL slave on z-dat-s5-b is CRITICAL: (Return code of 139 is out of bounds) [12:57:30] MySQL slave on z-dat-s1-b is CRITICAL: (Return code of 139 is out of bounds) [12:57:30] MySQL slave on z-dat-s2-b is CRITICAL: (Return code of 139 is out of bounds) [13:03:08] wikidata replag on z-dat-s5-b is CRITICAL: (Service Check Timed Out) [13:04:19] / on wolfsbane is WARNING: DISK WARNING - free space: / 6083 MB (20% inode=93%): [13:07:19] /tmp on wolfsbane is WARNING: DISK WARNING - free space: / 6066 MB (20% inode=93%): [13:08:31] s4 replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 83303.000000 [13:08:31] s4 replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 83301.000000 [13:15:57] Hi all, hi Coren! I am looking at the features needed in Tool Labs that was gathered by many of you. It contains the item "end-user support". Who are the end-users supposed to be? Tool maintainers or rather people using tools in the sense of using a webservice offered by tool maintainers? [13:19:50] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [13:44:50] wikidata replag on z-dat-s6-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 689576.000000 [13:44:50] wikidata replag on z-dat-s7-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 567967.000000 [13:49:20] Environment IPMI on thyme is UNKNOWN: NRPE: Unable to read output [13:50:01] FC 0/5 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [13:50:01] FC 0/17 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [13:50:01] FC 0/16 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [13:50:01] / on thyme is UNKNOWN: NRPE: Unable to read output [13:50:01] FC 0/4 [hyacinth] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [13:50:01] FC 0/15 [fsw2-n1-oe16-esams] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [13:50:01] /mnt on thyme is UNKNOWN: NRPE: Unable to read output [13:50:02] s1 replag on thyme is CRITICAL: QUERY CRITICAL: Cant connect to MySQL server on thyme (146) [13:50:02] FC 0/3 [cassia] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [13:50:03] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicati [13:50:03] /tmp on thyme is UNKNOWN: NRPE: Unable to read output [13:50:04] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 301661 MB (5% inode=62%): [13:50:19] Load avg. on amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [13:50:19] SMF on web.amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [13:50:30] APT on sage is WARNING: APT WARNING: 3 packages available for upgrade (0 critical updates). [13:50:31] FC 0/9 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [13:50:32] FC 0/6 [rosemary] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [13:50:40] FC 0/1 [far1-n1-oe16-esams B1] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [13:50:40] FC 0/20 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [13:50:41] FC 0/11 [fsw2-n1-oe16-esams] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [13:50:41] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [13:50:41] RAID on thyme is UNKNOWN: NRPE: Unable to read output [13:50:41] wikidata replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 900360.000000 [13:50:49] wikidata replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 228721.000000 [13:50:50] FMA on thyme is CRITICAL: ERROR - unexpected output from snmpwalk [13:50:50] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 64013 MB (10% inode=99%): [13:50:50] NTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:50:50] NTP on sage is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:50:50] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [13:51:00] FC 0/21 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [13:51:01] FC 0/12 [thyme] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [13:51:01] FC 0/14 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [13:51:01] APT on yucca is WARNING: APT WARNING: 1 packages available for upgrade (0 critical updates). [13:51:08] FC 0/2 [hemlock] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [13:51:09] FC 0/19 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [13:51:09] FC 0/10 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [13:51:19] SMF on amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [13:51:41] wikidata replag on z-dat-s2-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 611506.000000 [13:51:50] FMA on amaranth is CRITICAL: ERROR - unexpected output from snmpwalk [13:51:50] NTP on amaranth is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:51:50] SMTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:52:00] FC 0/23 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [13:52:00] eth0 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [13:52:00] FC 0/13 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [13:52:00] FC 0/22 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [13:52:30] Load avg. on thyme is UNKNOWN: NRPE: Unable to read output [13:52:31] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 703832.000000 [13:56:19] MySQL slave on z-dat-s5-b is CRITICAL: (Return code of 139 is out of bounds) [13:57:31] MySQL slave on z-dat-s1-b is CRITICAL: (Return code of 139 is out of bounds) [13:57:31] MySQL slave on z-dat-s2-b is CRITICAL: (Return code of 139 is out of bounds) [14:01:04] Platonides * Re: [Toolserver-l] Output files [14:03:50] wikidata replag on z-dat-s5-b is CRITICAL: (Service Check Timed Out) [14:04:19] / on wolfsbane is WARNING: DISK WARNING - free space: / 5860 MB (19% inode=93%): [14:04:30] Free Memory on turnera is WARNING: WARNING - 5.1% (424872 kB) free! [14:07:18] /tmp on wolfsbane is WARNING: DISK WARNING - free space: / 5852 MB (19% inode=93%): [14:09:30] Free Memory on turnera is OK: OK - 7.3% (609272 kB) free. [14:09:30] s4 replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 86963.000000 [14:09:30] s4 replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 86961.000000 [14:19:50] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [14:27:30] Free Memory on turnera is CRITICAL: CRITICAL - 4.7% (397564 kB) free! [14:30:30] Free Memory on turnera is WARNING: WARNING - 5.2% (436808 kB) free! [14:44:50] wikidata replag on z-dat-s6-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 693176.000000 [14:44:50] wikidata replag on z-dat-s7-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 571568.000000 [14:49:19] Environment IPMI on thyme is UNKNOWN: NRPE: Unable to read output [14:50:01] / on thyme is UNKNOWN: NRPE: Unable to read output [14:50:01] FC 0/5 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [14:50:01] FC 0/16 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [14:50:01] FC 0/17 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [14:50:01] /mnt on thyme is UNKNOWN: NRPE: Unable to read output [14:50:01] FC 0/15 [fsw2-n1-oe16-esams] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [14:50:01] s1 replag on thyme is CRITICAL: QUERY CRITICAL: Cant connect to MySQL server on thyme (146) [14:50:02] FC 0/3 [cassia] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [14:50:02] FC 0/4 [hyacinth] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [14:50:03] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A: [14:50:03] /tmp on thyme is UNKNOWN: NRPE: Unable to read output [14:50:04] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 301137 MB (5% inode=62%): [14:50:04] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [14:50:08] FC 0/18 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [14:50:08] FC 0/0 [SAN far1-n1-oe16-esams A1] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [14:50:08] FC 0/8 [adenia] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [14:50:08] FC 0/7 [daphne] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [14:50:19] SMF on web.amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [14:50:19] Load avg. on amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [14:50:40] FC 0/9 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [14:50:40] FC 0/20 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [14:50:40] FC 0/11 [fsw2-n1-oe16-esams] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [14:50:40] FC 0/1 [far1-n1-oe16-esams B1] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [14:50:40] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [14:50:41] RAID on thyme is UNKNOWN: NRPE: Unable to read output [14:50:49] wikidata replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 232320.000000 [14:50:49] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 63795 MB (10% inode=99%): [14:50:49] FMA on thyme is CRITICAL: ERROR - unexpected output from snmpwalk [14:51:01] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [14:51:01] NTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:51:02] NTP on sage is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:51:02] FC 0/14 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [14:51:02] FC 0/21 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [14:51:02] FC 0/12 [thyme] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [14:51:02] APT on yucca is WARNING: APT WARNING: 1 packages available for upgrade (0 critical updates). [14:51:08] FC 0/2 [hemlock] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [14:51:09] FC 0/19 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [14:51:09] FC 0/10 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [14:51:18] SMF on amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [14:51:31] APT on sage is WARNING: APT WARNING: 3 packages available for upgrade (0 critical updates). [14:51:31] FC 0/6 [rosemary] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [14:51:40] wikidata replag on z-dat-s2-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 615108.000000 [14:51:40] wikidata replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 904021.000000 [14:51:50] FMA on amaranth is CRITICAL: ERROR - unexpected output from snmpwalk [14:52:01] NTP on amaranth is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:52:01] SMTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:52:01] FC 0/13 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [14:52:01] eth0 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [14:52:01] FC 0/23 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [14:52:01] FC 0/22 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [14:52:30] Load avg. on thyme is UNKNOWN: NRPE: Unable to read output [14:52:30] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 707432.000000 [14:56:19] MySQL slave on z-dat-s5-b is CRITICAL: (Return code of 139 is out of bounds) [14:58:04] Byrial Jensen * Re: [Toolserver-l] Wikidata tables [14:58:30] MySQL slave on z-dat-s1-b is CRITICAL: (Return code of 139 is out of bounds) [14:58:31] MySQL slave on z-dat-s2-b is CRITICAL: (Return code of 139 is out of bounds) [15:04:19] / on wolfsbane is WARNING: DISK WARNING - free space: / 5662 MB (18% inode=93%): [15:04:31] wikidata replag on z-dat-s5-b is CRITICAL: (Service Check Timed Out) [15:07:18] /tmp on wolfsbane is WARNING: DISK WARNING - free space: / 5679 MB (18% inode=93%): [15:09:30] s4 replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 90301.000000 [15:09:31] s4 replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 90436.000000 [15:15:51] Part [15:19:49] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [15:37:31] Free Memory on turnera is WARNING: WARNING - 6.6% (549712 kB) free! [15:44:55] wikidata replag on z-dat-s6-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 694236.000000 [15:44:55] wikidata replag on z-dat-s7-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 568306.000000 [15:49:19] Environment IPMI on thyme is UNKNOWN: NRPE: Unable to read output [15:50:01] / on thyme is UNKNOWN: NRPE: Unable to read output [15:50:01] FC 0/15 [fsw2-n1-oe16-esams] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [15:50:01] FC 0/16 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [15:50:01] FC 0/5 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [15:50:01] s1 replag on thyme is CRITICAL: QUERY CRITICAL: Cant connect to MySQL server on thyme (146) [15:50:01] /mnt on thyme is UNKNOWN: NRPE: Unable to read output [15:50:01] FC 0/17 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [15:50:02] FC 0/4 [hyacinth] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [15:50:02] FC 0/3 [cassia] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [15:50:03] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (3 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.CommunicationLost.desc [15:50:09] FC 0/0 [SAN far1-n1-oe16-esams A1] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [15:50:09] FC 0/18 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [15:50:09] FC 0/7 [daphne] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [15:50:09] FC 0/8 [adenia] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [15:50:24] SMF on web.amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [15:50:24] Load avg. on amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [15:50:40] FC 0/9 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [15:50:40] FC 0/11 [fsw2-n1-oe16-esams] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [15:50:40] FC 0/1 [far1-n1-oe16-esams B1] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [15:50:40] FC 0/20 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [15:50:40] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [15:50:40] RAID on thyme is UNKNOWN: NRPE: Unable to read output [15:51:00] NTP on sage is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:51:00] NTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:51:00] FC 0/14 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [15:51:00] FC 0/21 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [15:51:01] /tmp on thyme is UNKNOWN: NRPE: Unable to read output [15:51:01] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 300782 MB (5% inode=62%): [15:51:01] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [15:51:08] FC 0/19 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [15:51:08] FC 0/2 [hemlock] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [15:51:19] SMF on amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [15:51:30] APT on sage is WARNING: APT WARNING: 3 packages available for upgrade (0 critical updates). [15:51:40] FC 0/6 [rosemary] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [15:51:40] wikidata replag on z-dat-s2-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 614424.000000 [15:51:40] wikidata replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 905499.000000 [15:51:50] wikidata replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 231952.000000 [15:51:50] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 63537 MB (10% inode=99%): [15:51:50] FMA on amaranth is CRITICAL: ERROR - unexpected output from snmpwalk [15:51:50] FMA on thyme is CRITICAL: ERROR - unexpected output from snmpwalk [15:52:01] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [15:52:01] NTP on amaranth is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:52:01] SMTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:52:01] FC 0/13 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [15:52:01] FC 0/23 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [15:52:01] FC 0/12 [thyme] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [15:52:01] FC 0/22 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [15:52:02] eth0 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [15:52:02] APT on yucca is WARNING: APT WARNING: 1 packages available for upgrade (0 critical updates). [15:52:08] FC 0/10 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [15:52:31] Load avg. on thyme is UNKNOWN: NRPE: Unable to read output [15:52:31] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 707490.000000 [15:56:19] MySQL slave on z-dat-s5-b is CRITICAL: (Return code of 139 is out of bounds) [15:58:30] MySQL slave on z-dat-s1-b is CRITICAL: (Return code of 139 is out of bounds) [15:58:31] MySQL slave on z-dat-s2-b is CRITICAL: (Return code of 139 is out of bounds) [15:58:31] Free Memory on turnera is CRITICAL: CRITICAL - 4.1% (343948 kB) free! [16:03:34] Free Memory on turnera is OK: OK - 87.1% (7297692 kB) free. [16:04:23] / on wolfsbane is WARNING: DISK WARNING - free space: / 5505 MB (18% inode=93%): [16:05:34] wikidata replag on z-dat-s5-b is CRITICAL: (Service Check Timed Out) [16:07:34] /tmp on wolfsbane is WARNING: DISK WARNING - free space: / 5492 MB (18% inode=93%): [16:09:44] s4 replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 82647.000000 [16:10:14] s4 replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 85668.000000 [16:22:04] Daniel Schwen * Re: [Toolserver-l] Wikidata tables [16:49:34] Environment IPMI on thyme is UNKNOWN: NRPE: Unable to read output [16:49:44] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [16:50:23] Load avg. on amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [16:50:34] SMF on web.amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [16:50:34] FC 0/15 [fsw2-n1-oe16-esams] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [16:50:34] FC 0/3 [cassia] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [16:50:48] FC 0/4 [hyacinth] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [16:50:48] FC 0/16 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [16:50:48] FC 0/17 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [16:50:48] FC 0/5 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [16:50:54] / on thyme is UNKNOWN: NRPE: Unable to read output [16:50:54] s1 replag on thyme is CRITICAL: QUERY CRITICAL: Cant connect to MySQL server on thyme (146) [16:50:54] /mnt on thyme is UNKNOWN: NRPE: Unable to read output [16:50:54] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [16:51:04] FC 0/1 [far1-n1-oe16-esams B1] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [16:51:04] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [16:51:04] RAID on thyme is UNKNOWN: NRPE: Unable to read output [16:51:04] FC 0/11 [fsw2-n1-oe16-esams] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [16:51:04] FC 0/9 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [16:51:04] FC 0/20 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [16:51:14] FC 0/21 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [16:51:24] FC 0/14 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [16:51:24] NTP on sage is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:51:34] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [16:51:34] SMF on amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [16:51:54] wikidata replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 908618.000000 [16:51:54] FMA on thyme is CRITICAL: ERROR - unexpected output from snmpwalk [16:51:55] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 63264 MB (10% inode=99%): [16:51:55] FC 0/6 [rosemary] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [16:51:55] NTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:51:55] /tmp on thyme is UNKNOWN: NRPE: Unable to read output [16:51:55] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 300402 MB (5% inode=62%): [16:51:56] APT on sage is WARNING: APT WARNING: 3 packages available for upgrade (0 critical updates). [16:52:03] FMA on amaranth is CRITICAL: ERROR - unexpected output from snmpwalk [16:52:04] APT on yucca is WARNING: APT WARNING: 1 packages available for upgrade (0 critical updates). [16:52:04] SMTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:52:15] NTP on amaranth is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:52:15] FC 0/12 [thyme] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [16:52:24] FC 0/13 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [16:52:24] FC 0/22 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [16:52:24] wikidata replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 234644.000000 [16:52:24] eth0 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [16:52:24] FC 0/23 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [16:52:34] wikidata replag on z-dat-s2-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 616563.000000 [16:52:54] Load avg. on thyme is UNKNOWN: NRPE: Unable to read output [16:52:54] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [16:53:23] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 708832.000000 [16:57:14] MySQL slave on z-dat-s5-b is CRITICAL: (Return code of 139 is out of bounds) [16:59:04] MySQL slave on z-dat-s2-b is CRITICAL: (Return code of 139 is out of bounds) [16:59:24] MySQL slave on z-dat-s1-b is CRITICAL: (Return code of 139 is out of bounds) [17:01:14] FC 0/10 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [17:01:14] FC 0/0 [SAN far1-n1-oe16-esams A1] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [17:01:14] FC 0/19 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [17:01:15] FC 0/2 [hemlock] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [17:01:15] FC 0/7 [daphne] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [17:02:14] FC 0/18 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [17:02:14] FC 0/8 [adenia] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [17:04:24] / on wolfsbane is WARNING: DISK WARNING - free space: / 5330 MB (17% inode=93%): [17:06:14] wikidata replag on z-dat-s5-b is CRITICAL: (Service Check Timed Out) [17:07:34] /tmp on wolfsbane is WARNING: DISK WARNING - free space: / 5318 MB (17% inode=93%): [17:09:44] s4 replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 86247.000000 [17:10:14] s4 replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 89268.000000 [17:26:44] Load avg. on daphne is WARNING: WARNING - load average: 16.40, 15.59, 14.18 [17:32:44] Load avg. on daphne is OK: OK - load average: 13.74, 14.96, 14.38 [17:38:23] my cronie lines look like this: [17:38:24] 5 1 * * * qcronsub -N 'wymowa.py' -b y -l h_rt=4:00:00 -l virtual_free=50M /usr/bin/env PYTHONPATH=$HOME/wikt/pywikipedia /usr/bin/python2.7 $HOME/wikt/moje/wymowa.py >/dev/null [17:38:28] sorry, not 2.7 [17:38:34] 5 1 * * * qcronsub -N 'wymowa.py' -b y -l h_rt=4:00:00 -l virtual_free=50M /usr/bin/env PYTHONPATH=$HOME/wikt/pywikipedia /usr/bin/python $HOME/wikt/moje/wymowa.py >/dev/null [17:38:57] I get an error "/usr/bin/env: No such file or directory" [17:39:02] what should I put instead? [17:40:29] if I simply put "env" then I get "Unable to run job: Script not executable: env." [17:49:34] Environment IPMI on thyme is UNKNOWN: NRPE: Unable to read output [17:49:44] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [17:50:24] Load avg. on amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [17:50:34] SMF on web.amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [17:50:34] FC 0/3 [cassia] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [17:50:34] FC 0/15 [fsw2-n1-oe16-esams] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [17:50:44] FC 0/16 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [17:50:44] FC 0/4 [hyacinth] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [17:50:44] FC 0/17 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [17:50:44] FC 0/5 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [17:50:54] / on thyme is UNKNOWN: NRPE: Unable to read output [17:50:54] /mnt on thyme is UNKNOWN: NRPE: Unable to read output [17:50:54] s1 replag on thyme is CRITICAL: QUERY CRITICAL: Cant connect to MySQL server on thyme (146) [17:50:54] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A: [17:51:04] FC 0/1 [far1-n1-oe16-esams B1] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [17:51:04] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [17:51:04] RAID on thyme is UNKNOWN: NRPE: Unable to read output [17:51:04] FC 0/11 [fsw2-n1-oe16-esams] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [17:51:04] FC 0/20 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [17:51:05] FC 0/9 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [17:51:14] FC 0/21 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [17:51:24] FC 0/14 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [17:51:25] NTP on sage is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:51:33] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [17:51:34] SMF on amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [17:51:54] wikidata replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 912217.000000 [17:51:55] FMA on thyme is CRITICAL: ERROR - unexpected output from snmpwalk [17:51:55] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 63047 MB (10% inode=99%): [17:51:55] FC 0/6 [rosemary] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [17:51:55] NTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:52:04] FMA on amaranth is CRITICAL: ERROR - unexpected output from snmpwalk [17:52:04] APT on yucca is WARNING: APT WARNING: 1 packages available for upgrade (0 critical updates). [17:52:04] SMTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:52:14] NTP on amaranth is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:52:14] FC 0/12 [thyme] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [17:52:24] FC 0/13 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [17:52:24] FC 0/22 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [17:52:24] wikidata replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 238245.000000 [17:52:24] FC 0/23 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [17:52:24] eth0 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [17:52:34] wikidata replag on z-dat-s2-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 614487.000000 [17:52:54] Load avg. on thyme is UNKNOWN: NRPE: Unable to read output [17:52:54] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [17:52:54] /tmp on thyme is UNKNOWN: NRPE: Unable to read output [17:52:54] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 299876 MB (5% inode=62%): [17:52:54] APT on sage is WARNING: APT WARNING: 3 packages available for upgrade (0 critical updates). [17:53:24] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 709555.000000 [17:57:14] MySQL slave on z-dat-s5-b is CRITICAL: (Return code of 139 is out of bounds) [17:59:04] MySQL slave on z-dat-s2-b is CRITICAL: (Return code of 139 is out of bounds) [17:59:24] MySQL slave on z-dat-s1-b is CRITICAL: (Return code of 139 is out of bounds) [18:01:14] FC 0/0 [SAN far1-n1-oe16-esams A1] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [18:01:14] FC 0/10 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [18:01:15] FC 0/19 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [18:01:15] FC 0/2 [hemlock] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [18:01:15] FC 0/7 [daphne] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [18:02:13] FC 0/18 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [18:02:14] FC 0/8 [adenia] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [18:03:16] my cronie lines look like this: [18:03:19] 5 1 * * * qcronsub -N 'wymowa.py' -b y -l h_rt=4:00:00 -l virtual_free=50M /usr/bin/env PYTHONPATH=$HOME/wikt/pywikipedia /usr/bin/python $HOME/wikt/moje/wymowa.py >/dev/null [18:03:24] I get an error "/usr/bin/env: No such file or directory" [18:03:29] what should I put instead? [18:03:38] if I simply put "env" then I get "Unable to run job: Script not executable: env." [18:04:24] / on wolfsbane is WARNING: DISK WARNING - free space: / 5145 MB (17% inode=93%): [18:06:54] wikidata replag on z-dat-s5-b is CRITICAL: (Service Check Timed Out) [18:07:33] /tmp on wolfsbane is WARNING: DISK WARNING - free space: / 5129 MB (17% inode=93%): [18:09:44] s4 replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 89848.000000 [18:10:14] s4 replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 92867.000000 [18:42:24] MySQL on z-dat-s1-b is CRITICAL: Cant connect to MySQL server on z-dat-s1-b (146) [18:42:34] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: Cant connect to MySQL server on rosemary (146) [18:42:44] s4 replag on rosemary is CRITICAL: QUERY CRITICAL: Cant connect to MySQL server on rosemary (146) [18:43:24] MySQL on adenia is CRITICAL: Cant connect to MySQL server on adenia (146) [18:43:54] MySQL slave on cassia is CRITICAL: Cant connect to MySQL server on cassia (146) [18:43:54] MySQL on cassia is CRITICAL: Cant connect to MySQL server on cassia (146) [18:43:54] MySQL on rosemary is CRITICAL: Cant connect to MySQL server on rosemary (146) [18:43:54] /sql/data/u_kolossos_tt_p on adenia is CRITICAL: DISK CRITICAL - /sql/data/u_kolossos_tt_p is not accessible: I/O error [18:43:54] MySQL slave on rosemary is CRITICAL: Cant connect to MySQL server on rosemary (146) [18:44:14] s5 replag on cassia is CRITICAL: QUERY CRITICAL: Cant connect to MySQL server on cassia (146) [18:47:24] MySQL on adenia is OK: Uptime: 336 Threads: 28 Questions: 635 Slow queries: 0 Opens: 59 Flush tables: 1 Open tables: 41 Queries per second avg: 1.889 [18:49:33] Environment IPMI on thyme is UNKNOWN: NRPE: Unable to read output [18:49:44] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [18:50:24] Load avg. on amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [18:50:34] SMF on web.amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [18:50:34] FC 0/15 [fsw2-n1-oe16-esams] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [18:50:34] FC 0/3 [cassia] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [18:50:44] FC 0/16 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [18:50:44] FC 0/4 [hyacinth] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [18:50:44] FC 0/5 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [18:50:44] FC 0/17 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [18:50:54] MySQL slave on cassia is OK: Uptime: 341 Threads: 2 Questions: 6763 Slow queries: 1 Opens: 60 Flush tables: 1 Open tables: 53 Queries per second avg: 19.832 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 846 [18:50:54] MySQL on cassia is OK: Uptime: 341 Threads: 2 Questions: 6776 Slow queries: 1 Opens: 60 Flush tables: 1 Open tables: 53 Queries per second avg: 19.870 [18:50:54] / on thyme is UNKNOWN: NRPE: Unable to read output [18:50:54] /mnt on thyme is UNKNOWN: NRPE: Unable to read output [18:50:54] s1 replag on thyme is CRITICAL: QUERY CRITICAL: Cant connect to MySQL server on thyme (146) [18:50:55] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (3 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.CommunicationLost.desc: [18:51:04] FC 0/1 [far1-n1-oe16-esams B1] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [18:51:05] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [18:51:05] RAID on thyme is UNKNOWN: NRPE: Unable to read output [18:51:05] FC 0/11 [fsw2-n1-oe16-esams] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [18:51:05] FC 0/9 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [18:51:05] FC 0/20 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [18:51:18] FC 0/21 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [18:51:18] s5 replag on cassia is OK: QUERY OK: SELECT ts_rc_age() returned 432.000000 [18:51:24] FC 0/14 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [18:51:24] NTP on sage is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:51:34] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [18:51:34] SMF on amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [18:51:44] Load avg. on daphne is WARNING: WARNING - load average: 16.88, 16.00, 12.97 [18:51:54] wikidata replag on rosemary is CRITICAL: QUERY CRITICAL: Cant connect to MySQL server on rosemary (146) [18:51:54] FMA on thyme is CRITICAL: ERROR - unexpected output from snmpwalk [18:51:54] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 62756 MB (10% inode=99%): [18:51:54] FC 0/6 [rosemary] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [18:51:54] NTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:52:04] FMA on amaranth is CRITICAL: ERROR - unexpected output from snmpwalk [18:52:04] APT on yucca is WARNING: APT WARNING: 1 packages available for upgrade (0 critical updates). [18:52:04] SMTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:52:14] NTP on amaranth is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:52:14] FC 0/12 [thyme] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [18:52:24] FC 0/13 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [18:52:24] FC 0/22 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [18:52:24] wikidata replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 241844.000000 [18:52:24] eth0 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [18:52:24] FC 0/23 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [18:52:34] wikidata replag on z-dat-s2-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 611680.000000 [18:52:54] Load avg. on thyme is UNKNOWN: NRPE: Unable to read output [18:52:55] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [18:52:55] /tmp on thyme is UNKNOWN: NRPE: Unable to read output [18:52:55] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 299470 MB (5% inode=62%): [18:52:55] APT on sage is WARNING: APT WARNING: 3 packages available for upgrade (0 critical updates). [18:53:24] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 710074.000000 [18:57:14] MySQL slave on z-dat-s5-b is CRITICAL: (Return code of 139 is out of bounds) [18:59:04] MySQL slave on z-dat-s2-b is CRITICAL: (Return code of 139 is out of bounds) [18:59:24] MySQL slave on z-dat-s1-b is CRITICAL: Cant connect to MySQL server on z-dat-s1-b (146) [19:01:14] FC 0/10 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [19:01:14] FC 0/2 [hemlock] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [19:01:14] FC 0/0 [SAN far1-n1-oe16-esams A1] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [19:01:14] FC 0/19 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [19:01:14] FC 0/7 [daphne] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [19:02:19] FC 0/18 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [19:02:19] FC 0/8 [adenia] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [19:04:24] / on wolfsbane is WARNING: DISK WARNING - free space: / 4918 MB (16% inode=93%): [19:05:44] Load avg. on daphne is OK: OK - load average: 13.77, 14.90, 14.34 [19:07:34] wikidata replag on z-dat-s5-b is CRITICAL: (Service Check Timed Out) [19:07:34] /tmp on wolfsbane is WARNING: DISK WARNING - free space: / 4924 MB (16% inode=93%): [19:08:34] s1 replag on rosemary is WARNING: QUERY WARNING: SELECT ts_rc_age() returned 1970.000000 [19:08:43] s4 replag on rosemary is WARNING: QUERY WARNING: SELECT ts_rc_age() returned 1937.000000 [19:08:55] MySQL on rosemary is OK: Uptime: 1098 Threads: 43 Questions: 7941 Slow queries: 51 Opens: 321 Flush tables: 1 Open tables: 310 Queries per second avg: 7.232 [19:08:55] MySQL slave on rosemary is WARNING: SLOW_SLAVE WARNING: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1981 [19:09:44] s4 replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 93442.000000 [19:10:14] s4 replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 96468.000000 [19:12:44] s4 replag on rosemary is OK: QUERY OK: SELECT ts_rc_age() returned 1726.000000 [19:16:54] /sql/data/u_kolossos_tt_p on adenia is OK: DISK OK - free space: /sql 301341 MB (47% inode=99%): [19:16:54] MySQL slave on rosemary is OK: Uptime: 1582 Threads: 27 Questions: 303197 Slow queries: 480 Opens: 463 Flush tables: 1 Open tables: 442 Queries per second avg: 191.654 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1767 [19:17:34] s1 replag on rosemary is OK: QUERY OK: SELECT ts_rc_age() returned 1711.000000 [19:20:24] / on wolfsbane is OK: DISK OK - free space: / 16095 MB (53% inode=93%): [19:20:34] /tmp on wolfsbane is OK: DISK OK - free space: / 16095 MB (53% inode=93%): [19:25:14] MySQL slave on z-dat-s4-a is CRITICAL: (Return code of 139 is out of bounds) [19:37:14] MySQL slave on z-dat-s4-a is OK: Uptime: 542 Threads: 2 Questions: 4046 Slow queries: 0 Opens: 51 Flush tables: 1 Open tables: 44 Queries per second avg: 7.464 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 451 [19:40:43] Load avg. on daphne is WARNING: WARNING - load average: 16.65, 16.32, 15.34 [19:42:23] MySQL on z-dat-s1-b is CRITICAL: Cant connect to MySQL server on z-dat-s1-b (146) [19:45:45] Load avg. on daphne is OK: OK - load average: 11.46, 14.48, 14.89 [19:49:33] Environment IPMI on thyme is UNKNOWN: NRPE: Unable to read output [19:49:43] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [19:50:24] Load avg. on amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [19:50:34] SMF on web.amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [19:50:34] FC 0/15 [fsw2-n1-oe16-esams] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [19:50:34] FC 0/3 [cassia] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [19:50:44] FC 0/4 [hyacinth] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [19:50:44] FC 0/16 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [19:50:44] FC 0/17 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [19:50:44] FC 0/5 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [19:50:54] / on thyme is UNKNOWN: NRPE: Unable to read output [19:50:54] s1 replag on thyme is CRITICAL: QUERY CRITICAL: Cant connect to MySQL server on thyme (146) [19:50:54] /mnt on thyme is UNKNOWN: NRPE: Unable to read output [19:50:54] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [19:51:04] FC 0/1 [far1-n1-oe16-esams B1] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [19:51:04] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [19:51:05] RAID on thyme is UNKNOWN: NRPE: Unable to read output [19:51:05] FC 0/11 [fsw2-n1-oe16-esams] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [19:51:05] FC 0/20 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [19:51:05] FC 0/9 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [19:51:14] FC 0/21 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [19:51:23] FC 0/14 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [19:51:24] NTP on sage is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:51:36] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [19:51:36] SMF on amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [19:51:54] FMA on thyme is CRITICAL: ERROR - unexpected output from snmpwalk [19:51:54] wikidata replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 919355.000000 [19:51:54] FC 0/6 [rosemary] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [19:51:55] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 62452 MB (10% inode=99%): [19:51:55] NTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:52:04] FMA on amaranth is CRITICAL: ERROR - unexpected output from snmpwalk [19:52:04] APT on yucca is WARNING: APT WARNING: 1 packages available for upgrade (0 critical updates). [19:52:04] SMTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:52:14] NTP on amaranth is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:52:14] FC 0/12 [thyme] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [19:52:24] FC 0/13 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [19:52:24] FC 0/22 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [19:52:24] wikidata replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 244003.000000 [19:52:24] eth0 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [19:52:24] FC 0/23 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [19:52:34] wikidata replag on z-dat-s2-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 613024.000000 [19:52:54] Load avg. on thyme is UNKNOWN: NRPE: Unable to read output [19:52:54] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [19:52:55] /tmp on thyme is UNKNOWN: NRPE: Unable to read output [19:52:55] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 298963 MB (5% inode=62%): [19:52:55] APT on sage is WARNING: APT WARNING: 3 packages available for upgrade (0 critical updates). [19:53:24] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 712483.000000 [19:57:14] MySQL slave on z-dat-s5-b is CRITICAL: Cant connect to MySQL server on z-dat-s5-b (146) [19:59:04] MySQL slave on z-dat-s2-b is CRITICAL: Cant connect to MySQL server on z-dat-s2-b (146) [19:59:24] MySQL slave on z-dat-s1-b is CRITICAL: Cant connect to MySQL server on z-dat-s1-b (146) [20:00:04] MySQL on z-dat-s2-b is CRITICAL: Cant connect to MySQL server on z-dat-s2-b (146) [20:01:14] FC 0/0 [SAN far1-n1-oe16-esams A1] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [20:01:14] FC 0/10 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [20:01:14] FC 0/2 [hemlock] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [20:01:14] FC 0/19 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [20:01:14] FC 0/7 [daphne] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [20:01:54] MySQL on z-dat-s5-b is CRITICAL: Cant connect to MySQL server on z-dat-s5-b (146) [20:02:14] FC 0/18 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [20:02:14] FC 0/8 [adenia] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [20:06:05] DaB. * Re: [Toolserver-l] Wikidata tables [20:07:34] wikidata replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: Cant connect to MySQL server on z-dat-s5-b (146) [20:07:54] MySQL on z-dat-s5-b is OK: Uptime: 755 Threads: 2 Questions: 134 Slow queries: 0 Opens: 40 Flush tables: 1 Open tables: 32 Queries per second avg: 0.177 [20:09:44] s4 replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 93771.000000 [20:10:14] s4 replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 96192.000000 [20:25:38] my cronie lines look like this: [20:25:39] 5 1 * * * qcronsub -N 'wymowa.py' -b y -l h_rt=4:00:00 -l virtual_free=50M /usr/bin/env PYTHONPATH=$HOME/wikt/pywikipedia /usr/bin/python $HOME/wikt/moje/wymowa.py >/dev/null [20:25:43] I get an error "/usr/bin/env: No such file or directory" [20:25:45] what should I put instead? [20:25:47] if I simply put "env" then I get "Unable to run job: Script not executable: env." [20:42:24] MySQL on z-dat-s1-b is CRITICAL: Cant connect to MySQL server on z-dat-s1-b (146) [20:49:04] APT on yucca is CRITICAL: APT CRITICAL: 5 packages available for upgrade (4 critical updates). [20:49:34] Environment IPMI on thyme is UNKNOWN: NRPE: Unable to read output [20:49:43] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [20:50:04] MySQL slave on z-dat-s2-b is OK: Uptime: 3370 Threads: 1 Questions: 3 Slow queries: 0 Opens: 15 Flush tables: 1 Open tables: 8 Queries per second avg: 0.0 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 0 [20:50:24] Load avg. on amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [20:50:34] SMF on web.amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [20:50:34] FC 0/3 [cassia] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [20:50:34] FC 0/15 [fsw2-n1-oe16-esams] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [20:50:44] FC 0/16 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [20:50:44] FC 0/4 [hyacinth] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [20:50:44] FC 0/5 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [20:50:44] FC 0/17 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [20:50:54] / on thyme is UNKNOWN: NRPE: Unable to read output [20:50:54] /mnt on thyme is UNKNOWN: NRPE: Unable to read output [20:50:54] s1 replag on thyme is CRITICAL: QUERY CRITICAL: Cant connect to MySQL server on thyme (146) [20:50:54] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (3 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.CommunicationLost.desc:S3:oob:S4:2530:S9:ts-array5:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.descri [20:51:05] MySQL on z-dat-s2-b is OK: Uptime: 3424 Threads: 10 Questions: 2292 Slow queries: 0 Opens: 190 Flush tables: 1 Open tables: 181 Queries per second avg: 0.669 [20:51:05] FC 0/1 [far1-n1-oe16-esams B1] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [20:51:05] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [20:51:05] RAID on thyme is UNKNOWN: NRPE: Unable to read output [20:51:05] FC 0/11 [fsw2-n1-oe16-esams] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [20:51:05] FC 0/9 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [20:51:05] FC 0/20 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [20:51:13] FC 0/21 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [20:51:24] FC 0/14 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [20:51:24] NTP on sage is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:51:33] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [20:51:34] SMF on amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [20:52:00] wikidata replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 922593.000000 [20:52:00] FMA on thyme is CRITICAL: ERROR - unexpected output from snmpwalk [20:52:00] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 62169 MB (10% inode=99%): [20:52:00] FC 0/6 [rosemary] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [20:52:00] NTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:52:04] FMA on amaranth is CRITICAL: ERROR - unexpected output from snmpwalk [20:52:04] SMTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:52:14] NTP on amaranth is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:52:14] FC 0/12 [thyme] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [20:52:24] FC 0/13 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [20:52:24] FC 0/22 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [20:52:24] wikidata replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 240735.000000 [20:52:24] eth0 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [20:52:24] FC 0/23 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [20:52:34] wikidata replag on z-dat-s2-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 616456.000000 [20:52:54] Load avg. on thyme is UNKNOWN: NRPE: Unable to read output [20:52:55] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [20:52:55] /tmp on thyme is UNKNOWN: NRPE: Unable to read output [20:52:55] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 298651 MB (5% inode=62%): [20:52:55] APT on sage is WARNING: APT WARNING: 3 packages available for upgrade (0 critical updates). [20:53:24] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 712190.000000 [20:57:31] MySQL slave on z-dat-s5-b is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 57027 [20:58:44] MySQL slave on z-dat-s2-b is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 59211 [20:59:24] MySQL slave on z-dat-s1-b is CRITICAL: Cant connect to MySQL server on z-dat-s1-b (146) [21:01:14] FC 0/2 [hemlock] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [21:01:14] FC 0/0 [SAN far1-n1-oe16-esams A1] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [21:01:14] FC 0/19 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [21:01:14] FC 0/10 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [21:01:14] FC 0/7 [daphne] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [21:02:15] FC 0/18 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [21:02:15] FC 0/8 [adenia] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [21:07:34] wikidata replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 54681.000000 [21:09:44] s4 replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 97371.000000 [21:10:14] s4 replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 84853.000000 [21:42:24] MySQL on z-dat-s1-b is CRITICAL: Cant connect to MySQL server on z-dat-s1-b (146) [21:47:04] s4 replag on rosemary is WARNING: QUERY WARNING: SELECT ts_rc_age() returned 1834.000000 [21:49:04] s4 replag on rosemary is OK: QUERY OK: SELECT ts_rc_age() returned 1788.000000 [21:49:04] APT on yucca is CRITICAL: APT CRITICAL: 5 packages available for upgrade (4 critical updates). [21:49:34] Environment IPMI on thyme is UNKNOWN: NRPE: Unable to read output [21:49:43] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [21:50:24] Load avg. on amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [21:50:34] SMF on web.amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [21:50:34] FC 0/3 [cassia] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [21:50:34] FC 0/15 [fsw2-n1-oe16-esams] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [21:50:44] FC 0/4 [hyacinth] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [21:50:44] FC 0/16 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [21:50:44] FC 0/17 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [21:50:44] FC 0/5 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [21:50:54] / on thyme is UNKNOWN: NRPE: Unable to read output [21:50:54] /mnt on thyme is UNKNOWN: NRPE: Unable to read output [21:50:54] s1 replag on thyme is CRITICAL: QUERY CRITICAL: Cant connect to MySQL server on thyme (146) [21:50:54] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (3 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.CommunicationLost.desc:S3:oob:S4:2530:S9:ts-array5:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.descri [21:51:04] FC 0/1 [far1-n1-oe16-esams B1] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [21:51:04] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [21:51:04] RAID on thyme is UNKNOWN: NRPE: Unable to read output [21:51:04] FC 0/11 [fsw2-n1-oe16-esams] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [21:51:04] FC 0/20 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [21:51:05] FC 0/9 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [21:51:14] FC 0/21 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [21:51:24] FC 0/14 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [21:51:24] NTP on sage is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:51:33] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [21:51:34] SMF on amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [21:51:54] wikidata replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 925874.000000 [21:51:54] FMA on thyme is CRITICAL: ERROR - unexpected output from snmpwalk [21:51:55] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 61883 MB (10% inode=99%): [21:51:55] FC 0/6 [rosemary] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [21:51:55] NTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:52:04] FMA on amaranth is CRITICAL: ERROR - unexpected output from snmpwalk [21:52:04] SMTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:52:14] NTP on amaranth is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:52:14] FC 0/12 [thyme] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [21:52:24] FC 0/13 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [21:52:24] FC 0/22 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [21:52:24] wikidata replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 237558.000000 [21:52:24] eth0 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [21:52:24] FC 0/23 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [21:52:34] wikidata replag on z-dat-s2-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 620056.000000 [21:52:54] Load avg. on thyme is UNKNOWN: NRPE: Unable to read output [21:52:54] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [21:52:54] /tmp on thyme is UNKNOWN: NRPE: Unable to read output [21:52:54] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 298357 MB (5% inode=62%): [21:52:54] APT on sage is WARNING: APT WARNING: 3 packages available for upgrade (0 critical updates). [21:53:23] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 712328.000000 [21:57:24] MySQL slave on z-dat-s5-b is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 52802 [21:58:54] MySQL slave on z-dat-s2-b is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 57980 [21:59:24] MySQL slave on z-dat-s1-b is CRITICAL: Cant connect to MySQL server on z-dat-s1-b (146) [22:01:14] FC 0/0 [SAN far1-n1-oe16-esams A1] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [22:01:14] FC 0/19 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [22:01:14] FC 0/2 [hemlock] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [22:02:14] FC 0/18 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [22:02:14] FC 0/10 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [22:02:15] FC 0/7 [daphne] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [22:03:20] FC 0/8 [adenia] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [22:07:33] wikidata replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 53290.000000 [22:10:04] s4 replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 100990.000000 [22:10:14] s4 replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 57776.000000 [22:24:24] wikidata replag on z-dat-s6-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 702131.000000 [22:26:34] /sql on rosemary is CRITICAL: DISK CRITICAL - free space: /sql 18991 MB (1% inode=99%): [22:34:54] MySQL slave on rosemary is WARNING: SLOW_SLAVE WARNING: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1842 [22:36:34] s1 replag on rosemary is WARNING: QUERY WARNING: SELECT ts_rc_age() returned 1833.000000 [22:39:54] MySQL slave on rosemary is OK: Uptime: 13761 Threads: 74 Questions: 5200496 Slow queries: 8160 Opens: 1244 Flush tables: 1 Open tables: 786 Queries per second avg: 377.915 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1800 [22:42:24] MySQL on z-dat-s1-b is CRITICAL: Cant connect to MySQL server on z-dat-s1-b (146) [22:44:04] Daniel Schwen * Re: [Toolserver-l] Wikidata tables [22:45:34] s1 replag on rosemary is OK: QUERY OK: SELECT ts_rc_age() returned 1794.000000 [22:49:04] APT on yucca is CRITICAL: APT CRITICAL: 5 packages available for upgrade (4 critical updates). [22:49:34] Environment IPMI on thyme is UNKNOWN: NRPE: Unable to read output [22:49:44] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [22:50:23] Load avg. on amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [22:50:33] SMF on web.amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [22:50:34] FC 0/3 [cassia] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [22:50:34] FC 0/15 [fsw2-n1-oe16-esams] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [22:50:43] FC 0/16 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [22:50:45] FC 0/4 [hyacinth] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [22:50:45] FC 0/5 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [22:50:45] FC 0/17 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [22:50:54] / on thyme is UNKNOWN: NRPE: Unable to read output [22:50:54] /mnt on thyme is UNKNOWN: NRPE: Unable to read output [22:50:54] s1 replag on thyme is CRITICAL: QUERY CRITICAL: Cant connect to MySQL server on thyme (146) [22:50:54] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A: [22:51:04] FC 0/1 [far1-n1-oe16-esams B1] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [22:51:04] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [22:51:04] RAID on thyme is UNKNOWN: NRPE: Unable to read output [22:51:04] FC 0/11 [fsw2-n1-oe16-esams] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [22:51:04] FC 0/9 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [22:51:04] FC 0/20 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [22:51:14] FC 0/21 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [22:51:24] FC 0/14 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [22:51:24] NTP on sage is CRITICAL: CRITICAL - Socket timeout after 10 seconds [22:51:34] SMF on amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [22:51:34] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [22:51:54] FMA on thyme is CRITICAL: ERROR - unexpected output from snmpwalk [22:51:54] wikidata replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 929117.000000 [22:51:55] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 61608 MB (10% inode=99%): [22:51:55] FC 0/6 [rosemary] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [22:51:55] NTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [22:52:04] FMA on amaranth is CRITICAL: ERROR - unexpected output from snmpwalk [22:52:04] SMTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [22:52:14] NTP on amaranth is CRITICAL: CRITICAL - Socket timeout after 10 seconds [22:52:15] FC 0/12 [thyme] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [22:52:24] FC 0/13 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [22:52:24] FC 0/22 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [22:52:24] wikidata replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 234292.000000 [22:52:24] eth0 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [22:52:24] FC 0/23 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [22:52:34] wikidata replag on z-dat-s2-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 623657.000000 [22:52:54] Load avg. on thyme is UNKNOWN: NRPE: Unable to read output [22:52:54] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [22:52:54] /tmp on thyme is UNKNOWN: NRPE: Unable to read output [22:52:54] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 298049 MB (5% inode=62%): [22:52:55] APT on sage is WARNING: APT WARNING: 3 packages available for upgrade (0 critical updates). [22:53:24] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 713024.000000 [22:57:24] MySQL slave on z-dat-s5-b is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 36855 [22:58:54] MySQL slave on z-dat-s2-b is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 57008 [22:59:24] MySQL slave on z-dat-s1-b is CRITICAL: Cant connect to MySQL server on z-dat-s1-b (146) [23:01:14] FC 0/2 [hemlock] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [23:01:14] FC 0/0 [SAN far1-n1-oe16-esams A1] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [23:01:15] FC 0/19 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [23:02:14] FC 0/18 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [23:02:14] FC 0/10 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [23:02:14] FC 0/7 [daphne] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [23:03:14] FC 0/8 [adenia] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [23:07:34] wikidata replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 36114.000000 [23:10:04] s4 replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 104591.000000 [23:10:14] s4 replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 32388.000000 [23:20:04] DaB. * Re: [Toolserver-l] Wikidata tables [23:24:24] wikidata replag on z-dat-s6-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 699552.000000 [23:30:33] s1 replag on rosemary is WARNING: QUERY WARNING: SELECT ts_rc_age() returned 1914.000000 [23:30:53] MySQL slave on rosemary is WARNING: SLOW_SLAVE WARNING: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1914 [23:42:24] MySQL on z-dat-s1-b is CRITICAL: Cant connect to MySQL server on z-dat-s1-b (146) [23:43:54] MySQL slave on rosemary is OK: Uptime: 17601 Threads: 86 Questions: 6610268 Slow queries: 10787 Opens: 1520 Flush tables: 1 Open tables: 964 Queries per second avg: 375.562 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1794 [23:44:33] s1 replag on rosemary is OK: QUERY OK: SELECT ts_rc_age() returned 1786.000000 [23:49:04] APT on yucca is CRITICAL: APT CRITICAL: 5 packages available for upgrade (4 critical updates). [23:49:34] Environment IPMI on thyme is UNKNOWN: NRPE: Unable to read output [23:49:43] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [23:50:24] Load avg. on amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [23:50:34] SMF on web.amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [23:50:34] FC 0/3 [cassia] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [23:50:34] FC 0/15 [fsw2-n1-oe16-esams] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [23:50:44] FC 0/4 [hyacinth] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [23:50:44] FC 0/16 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [23:50:44] FC 0/5 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [23:50:54] / on thyme is UNKNOWN: NRPE: Unable to read output [23:50:54] /mnt on thyme is UNKNOWN: NRPE: Unable to read output [23:50:54] s1 replag on thyme is CRITICAL: QUERY CRITICAL: Cant connect to MySQL server on thyme (146) [23:50:54] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [23:51:04] FC 0/1 [far1-n1-oe16-esams B1] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [23:51:04] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [23:51:04] RAID on thyme is UNKNOWN: NRPE: Unable to read output [23:51:04] FC 0/11 [fsw2-n1-oe16-esams] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [23:51:04] FC 0/9 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [23:51:05] FC 0/20 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [23:51:14] FC 0/21 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [23:51:24] FC 0/14 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [23:51:24] NTP on sage is CRITICAL: CRITICAL - Socket timeout after 10 seconds [23:51:33] SMF on amaranth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [23:51:33] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [23:51:44] FC 0/17 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [23:51:54] wikidata replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 932270.000000 [23:51:55] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 61311 MB (10% inode=99%): [23:51:55] FMA on thyme is CRITICAL: ERROR - unexpected output from snmpwalk [23:51:55] FC 0/6 [rosemary] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [23:51:55] NTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [23:52:04] FMA on amaranth is CRITICAL: ERROR - unexpected output from snmpwalk [23:52:04] SMTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [23:52:14] NTP on amaranth is CRITICAL: CRITICAL - Socket timeout after 10 seconds [23:52:14] FC 0/12 [thyme] on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [23:52:24] FC 0/22 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [23:52:24] FC 0/13 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [23:52:24] wikidata replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 231438.000000 [23:52:24] FC 0/23 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [23:52:24] eth0 on fsw1-n1-oe16-esams.mgmt is UNKNOWN: ERROR: Description table : No response from remote host fsw1-n1-oe16-esams.mgmt. [23:52:34] wikidata replag on z-dat-s2-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 627257.000000 [23:52:54] Load avg. on thyme is UNKNOWN: NRPE: Unable to read output [23:52:54] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [23:52:54] /tmp on thyme is UNKNOWN: NRPE: Unable to read output [23:52:54] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 296237 MB (5% inode=62%): [23:52:54] APT on sage is WARNING: APT WARNING: 3 packages available for upgrade (0 critical updates). [23:53:23] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 714142.000000 [23:57:24] MySQL slave on z-dat-s5-b is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 31245 [23:58:54] MySQL slave on z-dat-s2-b is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 23514 [23:59:24] MySQL slave on z-dat-s1-b is CRITICAL: Cant connect to MySQL server on z-dat-s1-b (146)