[00:02:54] Load avg. on willow is WARNING: WARNING - load average: 22.22, 19.02, 15.04 [00:15:55] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default [00:18:47] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 2585813 [00:21:56] Sun Grid Engine execd on willow is WARNING: medium-sol@willow exceedes load threshold: alarm hl:np_load_short=2.311035/1.75, alarm hl:np_load_avg=2.461426/2.0, alarm hl:mem_free=690.000000M/350M, alarm hl:available=1/0: longrun-sol@willow exceedes load threshold: alarm hl:np_load_short=2.311035/2.1, alarm hl:np_load_long=2.339355/2.5, alarm hl:cpu=99.600000/97, alarm hl:mem_free=690.000000M/200M, alarm hl:available=1/0 [00:34:14] RAID on adenia is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [00:49:04] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [00:51:55] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [00:53:04] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [00:53:45] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: Unknown database enwiki_p [00:57:25] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 480574 MB (9% inode=45%): [01:01:04] Load avg. on willow is CRITICAL: CRITICAL - load average: 30.59, 20.98, 18.57 [01:02:04] Load avg. on willow is WARNING: WARNING - load average: 24.70, 21.31, 18.86 [01:16:55] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default [01:18:56] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 2543464 [01:21:56] Sun Grid Engine execd on willow is WARNING: medium-sol@willow exceedes load threshold: alarm hl:np_load_short=2.111328/1.75, alarm hl:np_load_avg=2.222168/2.0, alarm hl:mem_free=305.000000M/350M, alarm hl:available=1/0: longrun-sol@willow exceedes load threshold: alarm hl:np_load_short=2.111328/2.1, alarm hl:np_load_long=2.325195/2.5, alarm hl:cpu=100.000000/97, alarm hl:mem_free=305.000000M/200M, alarm hl:available=1/0 [01:38:53] hello, anyone? [01:39:54] 3(resolved) [DBQ-181] Need to access deletion logs of articles by a specific user <10https://jira.toolserver.org/browse/DBQ-181> (Hoo man) [01:39:54] 3(commented) [DBQ-181] Need to access deletion logs of articles by a specific user <10https://jira.toolserver.org/browse/DBQ-181> (Hoo man) [01:48:56] Sun Grid Engine execd on willow is OK: medium-sol@willow OK: longrun-sol@willow OK [01:49:55] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [01:52:04] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [01:52:54] Sun Grid Engine execd on willow is WARNING: medium-sol@willow exceedes load threshold: alarm hl:np_load_short=2.026855/1.75, alarm hl:np_load_avg=1.979004/2.0, alarm hl:mem_free=327.000000M/350M, alarm hl:available=1/0: longrun-sol@willow exceedes load threshold: alarm hl:np_load_short=2.026855/2.1, alarm hl:np_load_long=2.057129/2.5, alarm hl:cpu=100.000000/97, alarm hl:mem_free=327.000000M/200M, alarm hl:available=1/0 [01:53:04] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [01:54:44] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: Unknown database enwiki_p [01:57:25] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 480555 MB (9% inode=45%): [02:02:04] Load avg. on willow is WARNING: WARNING - load average: 18.46, 18.46, 17.51 [02:08:45] Sun Grid Engine execd on ortelius is WARNING: short-sol@ortelius exceedes load threshold: alarm hl:np_load_short=1.544922/1.10, alarm hl:np_load_long=0.771485/1.55, alarm hl:mem_free=17210.000000M/300M, alarm hl:available=1/0: medium-sol@ortelius exceedes load threshold: alarm hl:np_load_short=1.544922/1.00, alarm hl:np_load_long=0.771485/1.50, alarm hl:mem_free=17210.000000M/350M, alarm hl:available=1/0 [02:11:22] <[cera]> how can I see how much MBs of space I've used up on my toolserver? [02:13:45] Sun Grid Engine execd on ortelius is OK: short-sol@ortelius OK: medium-sol@ortelius OK [02:17:04] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default [02:19:54] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 2513082 [02:50:04] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [02:52:14] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [02:53:04] Sun Grid Engine execd on willow is WARNING: medium-sol@willow exceedes load threshold: alarm hl:np_load_short=1.993164/1.75, alarm hl:np_load_avg=2.274414/2.0, alarm hl:mem_free=589.000000M/350M, alarm hl:available=1/0: longrun-sol@willow exceedes load threshold: alarm hl:np_load_short=1.993164/2.1, alarm hl:np_load_long=2.252441/2.5, alarm hl:cpu=99.600000/97, alarm hl:mem_free=589.000000M/200M, alarm hl:available=1/0 [02:53:04] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [02:54:46] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: Unknown database enwiki_p [02:55:47] SSH on z-dat-s6-a is CRITICAL: CRITICAL - Socket timeout after 10 seconds [02:55:47] RAID on hyacinth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [02:56:15] RAID on hyacinth is OK: OK - TOTAL: 2: FAILED: 0: DEGRADED: 0 [02:56:35] SSH on z-dat-s6-a is OK: SSH OK - OpenSSH_5.8p2-hpn13v11 (protocol 2.0) [02:57:36] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 479830 MB (9% inode=45%): [03:02:07] Load avg. on willow is WARNING: WARNING - load average: 21.05, 20.54, 18.86 [03:17:18] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default [03:19:57] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 2467792 [03:41:07] Sun Grid Engine execd on ortelius is WARNING: short-sol@ortelius exceedes load threshold: alarm hl:np_load_short=1.292969/1.10, alarm hl:np_load_long=0.837890/1.55, alarm hl:mem_free=19524.000000M/300M, alarm hl:available=1/0: medium-sol@ortelius exceedes load threshold: alarm hl:np_load_short=1.292969/1.00, alarm hl:np_load_long=0.837890/1.50, alarm hl:mem_free=19524.000000M/350M, alarm hl:available=1/0 [03:44:58] [cera]: quota -v [03:45:09] Sun Grid Engine execd on ortelius is OK: short-sol@ortelius OK: medium-sol@ortelius OK [03:50:18] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [03:52:28] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [03:53:17] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [03:53:27] Sun Grid Engine execd on willow is WARNING: medium-sol@willow exceedes load threshold: alarm hl:np_load_short=1.712891/1.75, alarm hl:np_load_avg=1.873535/2.0, alarm hl:mem_free=245.000000M/350M, alarm hl:available=1/0: longrun-sol@willow exceedes load threshold: alarm hl:np_load_short=1.712891/2.1, alarm hl:np_load_long=2.017578/2.5, alarm hl:cpu=100.000000/97, alarm hl:mem_free=245.000000M/200M, alarm hl:available=1/0 [03:55:10] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: Unknown database enwiki_p [03:57:48] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 478820 MB (9% inode=45%): [03:58:17] Sun Grid Engine execd on willow is OK: medium-sol@willow OK: longrun-sol@willow OK [04:01:17] Load avg. on willow is CRITICAL: CRITICAL - load average: 33.89, 21.62, 18.16 [04:02:17] Load avg. on willow is WARNING: WARNING - load average: 23.28, 20.82, 18.10 [04:02:17] Sun Grid Engine execd on willow is WARNING: medium-sol@willow exceedes load threshold: alarm hl:np_load_short=2.946289/1.75, alarm hl:np_load_avg=2.601074/2.0, alarm hl:mem_free=148.000000M/350M, alarm hl:available=1/0: longrun-sol@willow exceedes load threshold: alarm hl:np_load_short=2.946289/2.1, alarm hl:np_load_long=2.258789/2.5, alarm hl:cpu=99.700000/97, alarm hl:mem_free=148.000000M/200M, alarm hl:available=1/0 [04:18:17] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default [04:20:07] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 2441774 [04:50:28] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [04:52:38] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [04:53:29] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [04:56:08] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: Unknown database enwiki_p [04:58:47] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 478651 MB (9% inode=45%): [05:00:27] Load avg. on willow is CRITICAL: CRITICAL - load average: 34.16, 21.15, 18.56 [05:01:30] Load avg. on willow is WARNING: WARNING - load average: 27.05, 21.69, 18.93 [05:02:30] Sun Grid Engine execd on willow is WARNING: medium-sol@willow exceedes load threshold: alarm hl:np_load_short=2.645996/1.75, alarm hl:np_load_avg=2.606445/2.0, alarm hl:mem_free=379.000000M/350M, alarm hl:available=1/0: longrun-sol@willow exceedes load threshold: alarm hl:np_load_short=2.645996/2.1, alarm hl:np_load_long=2.345215/2.5, alarm hl:cpu=100.000000/97, alarm hl:mem_free=379.000000M/200M, alarm hl:available=1/0 [05:16:27] Load avg. on willow is CRITICAL: CRITICAL - load average: 31.48, 23.32, 20.37 [05:18:28] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default [05:21:09] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 2424646 [05:47:28] Load avg. on willow is WARNING: WARNING - load average: 16.02, 18.18, 19.77 [05:50:38] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [05:52:47] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [05:52:58] [[Special:Log/newusers]] create 10 * Loreinesmith761 * (New user account) [05:53:29] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [05:54:20] [[User talk:Loreinesmith761]] !N 10https://wiki.toolserver.org/w/index.php?oldid=7012&rcid=9241 * Loreinesmith761 * (+89) (Created page with "Looking for cheap ways to [http://flexerildrug.info buy Flexeril] drug? Order online now!") [05:56:07] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: Unknown database enwiki_p [05:58:48] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 478592 MB (9% inode=45%): [06:03:28] Sun Grid Engine execd on willow is WARNING: medium-sol@willow exceedes load threshold: alarm hl:np_load_short=2.320801/1.75, alarm hl:np_load_avg=2.378906/2.0, alarm hl:mem_free=422.000000M/350M, alarm hl:available=1/0: longrun-sol@willow exceedes load threshold: alarm hl:np_load_short=2.320801/2.1, alarm hl:np_load_long=2.414551/2.5, alarm hl:cpu=99.900000/97, alarm hl:mem_free=422.000000M/200M, alarm hl:available=1/0 [06:10:28] Load avg. on willow is CRITICAL: CRITICAL - load average: 30.54, 20.73, 19.53 [06:14:17] RAID on adenia is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [06:18:27] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default [06:22:08] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 2391130 [06:24:17] RAID on adenia is OK: OK - TOTAL: 2: FAILED: 0: DEGRADED: 0 [06:28:27] Load avg. on willow is WARNING: WARNING - load average: 16.54, 18.88, 19.89 [06:30:27] Load avg. on willow is CRITICAL: CRITICAL - load average: 32.96, 22.04, 20.84 [06:38:27] Load avg. on willow is WARNING: WARNING - load average: 17.75, 19.15, 19.94 [06:39:17] RAID on adenia is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [06:50:38] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [06:52:47] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [06:53:37] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [06:57:07] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: Unknown database enwiki_p [06:58:47] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 478508 MB (9% inode=45%): [07:00:28] Load avg. on willow is WARNING: WARNING - load average: 29.91, 18.72, 18.07 [07:03:38] Sun Grid Engine execd on willow is WARNING: medium-sol@willow exceedes load threshold: alarm hl:np_load_short=1.972168/1.75, alarm hl:np_load_avg=2.191895/2.0, alarm hl:mem_free=324.000000M/350M, alarm hl:available=1/0: longrun-sol@willow exceedes load threshold: alarm hl:np_load_short=1.972168/2.1, alarm hl:np_load_long=2.219727/2.5, alarm hl:cpu=100.000000/97, alarm hl:mem_free=324.000000M/200M, alarm hl:available=1/0 [07:15:28] Load avg. on willow is CRITICAL: CRITICAL - load average: 36.05, 21.98, 19.14 [07:16:27] Load avg. on willow is WARNING: WARNING - load average: 23.95, 21.19, 19.05 [07:18:38] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default [07:23:07] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 2360993 [07:30:27] Load avg. on willow is CRITICAL: CRITICAL - load average: 31.86, 20.75, 18.93 [07:50:37] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [07:52:48] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [07:53:37] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [07:57:07] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: Unknown database enwiki_p [07:58:48] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 478414 MB (9% inode=45%): [08:04:37] Sun Grid Engine execd on willow is WARNING: medium-sol@willow exceedes load threshold: alarm hl:np_load_short=1.929199/1.75, alarm hl:np_load_avg=2.822266/2.0, alarm hl:mem_free=281.000000M/350M, alarm hl:available=1/0: longrun-sol@willow exceedes load threshold: alarm hl:np_load_short=1.929199/2.1, alarm hl:np_load_long=4.544434/2.5, alarm hl:cpu=59.300000/99, alarm hl:mem_free=281.000000M/200M, alarm hl:available=1/0 [08:19:38] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default [08:23:06] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 2314985 [08:29:27] Load avg. on willow is WARNING: WARNING - load average: 15.30, 15.54, 19.77 [08:30:28] Load avg. on willow is CRITICAL: CRITICAL - load average: 23.90, 17.61, 20.21 [08:31:27] Load avg. on willow is WARNING: WARNING - load average: 19.41, 17.43, 19.98 [08:50:37] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [08:52:57] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [08:53:38] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [08:57:07] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: Unknown database enwiki_p [08:58:58] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 477844 MB (9% inode=44%): [09:04:38] Sun Grid Engine execd on willow is WARNING: medium-sol@willow exceedes load threshold: alarm hl:np_load_short=1.911621/1.75, alarm hl:np_load_avg=2.175781/2.0, alarm hl:mem_free=260.000000M/350M, alarm hl:available=1/0 [09:23:08] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 2291596 [09:32:27] Load avg. on willow is WARNING: WARNING - load average: 15.63, 15.89, 16.20 [09:34:38] Sun Grid Engine execd on willow is OK: medium-sol@willow OK: longrun-sol@willow OK [09:38:37] Sun Grid Engine execd on willow is WARNING: medium-sol@willow exceedes load threshold: alarm hl:np_load_short=1.830078/1.75, alarm hl:np_load_avg=1.845703/2.0, alarm hl:mem_free=139.000000M/350M, alarm hl:available=1/0: longrun-sol@willow exceedes load threshold: alarm hl:np_load_short=1.830078/2.1, alarm hl:np_load_long=1.942383/2.5, alarm hl:cpu=72.600000/99, alarm hl:mem_free=139.000000M/200M, alarm hl:available=1/0 [09:51:27] Load avg. on willow is OK: OK - load average: 12.69, 14.12, 14.94 [09:51:36] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [09:51:37] Sun Grid Engine execd on willow is OK: medium-sol@willow OK: longrun-sol@willow OK [09:53:57] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [09:54:37] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [09:57:06] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: Unknown database enwiki_p [09:59:06] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 477622 MB (9% inode=44%): [10:02:27] Load avg. on willow is WARNING: WARNING - load average: 18.39, 17.18, 15.68 [10:09:27] Load avg. on willow is OK: OK - load average: 12.92, 14.36, 14.92 [10:19:37] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default [10:23:18] MySQL slave on rosemary is CRITICAL: (Return code of 139 is out of bounds) [10:42:38] Sun Grid Engine execd on willow is WARNING: medium-sol@willow exceedes load threshold: alarm hl:np_load_short=1.567871/1.75, alarm hl:np_load_avg=1.562988/2.0, alarm hl:mem_free=192.000000M/350M, alarm hl:available=1/0: longrun-sol@willow exceedes load threshold: alarm hl:np_load_short=1.567871/2.1, alarm hl:np_load_long=1.646484/2.5, alarm hl:cpu=66.200000/99, alarm hl:mem_free=192.000000M/200M, alarm hl:available=1/0 [10:47:27] Load avg. on willow is WARNING: WARNING - load average: 15.16, 14.21, 13.71 [10:48:27] Load avg. on willow is OK: OK - load average: 13.69, 13.96, 13.66 [10:49:37] Sun Grid Engine execd on willow is OK: medium-sol@willow OK: longrun-sol@willow OK [10:51:38] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [10:53:57] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [10:54:37] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [10:57:18] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1248671.000000 [10:59:07] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 477579 MB (9% inode=44%): [11:00:17] Sun Grid Engine execd on ortelius is WARNING: medium-sol@ortelius exceedes load threshold: alarm hl:np_load_short=1.004883/1.00, alarm hl:np_load_long=0.668945/1.50, alarm hl:mem_free=19503.000000M/350M, alarm hl:available=1/0 [11:01:17] Environment IPMI on adenia is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [11:02:07] Environment IPMI on adenia is OK: ok: temperature ok fan ok voltage ok chassis ok [11:02:38] Sun Grid Engine execd on willow is WARNING: medium-sol@willow exceedes load threshold: alarm hl:np_load_short=1.671875/1.75, alarm hl:np_load_avg=1.672851/2.0, alarm hl:mem_free=240.000000M/350M, alarm hl:available=1/0 [11:06:37] Sun Grid Engine execd on willow is OK: medium-sol@willow OK: longrun-sol@willow OK [11:19:37] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default [11:23:17] MySQL slave on rosemary is CRITICAL: (Return code of 139 is out of bounds) [11:42:27] Sun Grid Engine execd on ortelius is OK: short-sol@ortelius OK: medium-sol@ortelius OK [11:45:28] Sun Grid Engine execd on ortelius is WARNING: short-sol@ortelius exceedes load threshold: alarm hl:np_load_short=1.276367/1.10, alarm hl:np_load_long=1.347656/1.55, alarm hl:mem_free=18842.000000M/300M, alarm hl:available=1/0: medium-sol@ortelius exceedes load threshold: alarm hl:np_load_short=1.276367/1.00, alarm hl:np_load_long=1.347656/1.50, alarm hl:mem_free=18842.000000M/350M, alarm hl:available=1/0 [11:48:27] Sun Grid Engine execd on ortelius is OK: short-sol@ortelius OK: medium-sol@ortelius OK [11:51:37] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [11:53:56] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [11:54:38] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [11:55:17] SSH on z-dat-s7-a is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:55:18] RAID on hyacinth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [11:55:57] SMF on z-dat-s7-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [11:55:57] SMF on z-dat-s6-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [11:55:57] SMF on z-dat-s3-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [11:55:57] /sql on z-dat-s4-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [11:55:57] /sql on z-dat-s7-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [11:55:57] Load avg. on z-dat-s4-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [11:55:57] SMF on hyacinth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [11:56:07] /tmp on z-dat-s7-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [11:56:07] /sql on z-dat-s6-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [11:56:07] /tmp on z-dat-s4-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [11:56:07] / on z-dat-s7-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [11:56:07] /tmp on z-dat-s6-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [11:56:07] Load avg. on z-dat-s7-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [11:56:18] SSH on z-dat-s6-a is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:56:18] SSH on z-dat-s7-a is OK: SSH OK - OpenSSH_5.8p2-hpn13v11 (protocol 2.0) [11:56:28] SMF on z-dat-s7-a is OK: OK - all services online [11:56:28] SMF on z-dat-s6-a is OK: OK - all services online [11:56:28] SMF on z-dat-s3-a is OK: OK - all services online [11:56:28] /sql on z-dat-s4-a is OK: DISK OK - free space: /sql 101695 MB (25% inode=99%): [11:56:28] /sql on z-dat-s7-a is OK: DISK OK - free space: /sql 105504 MB (26% inode=99%): [11:56:28] SMF on hyacinth is OK: OK - all services online [11:56:37] Load avg. on z-dat-s4-a is OK: OK - load average: 1.15, 1.40, 1.61 [11:56:37] /tmp on z-dat-s7-a is OK: DISK OK - free space: /tmp 2609 MB (99% inode=99%): [11:56:37] /sql on z-dat-s6-a is OK: DISK OK - free space: /sql 181647 MB (18% inode=99%): [11:56:37] /tmp on z-dat-s4-a is OK: DISK OK - free space: /tmp 2609 MB (99% inode=99%): [11:56:37] / on z-dat-s7-a is OK: DISK OK - free space: / 8501 MB (28% inode=85%): [11:56:38] Sun Grid Engine execd on willow is WARNING: medium-sol@willow exceedes load threshold: alarm hl:np_load_short=2.057129/1.75, alarm hl:np_load_avg=1.857910/2.0, alarm hl:mem_free=760.000000M/350M, alarm hl:available=1/0 [11:56:38] /tmp on z-dat-s6-a is OK: DISK OK - free space: /tmp 2550 MB (99% inode=99%): [11:56:38] Load avg. on z-dat-s7-a is OK: OK - load average: 1.32, 1.43, 1.62 [11:56:47] RAID on hyacinth is OK: OK - TOTAL: 2: FAILED: 0: DEGRADED: 0 [11:57:06] SSH on z-dat-s6-a is OK: SSH OK - OpenSSH_5.8p2-hpn13v11 (protocol 2.0) [11:58:17] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1252331.000000 [11:59:06] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 477521 MB (9% inode=44%): [11:59:38] Sun Grid Engine execd on willow is OK: medium-sol@willow OK: longrun-sol@willow OK [12:02:27] Load avg. on willow is WARNING: WARNING - load average: 15.21, 15.42, 14.40 [12:02:37] Sun Grid Engine execd on willow is WARNING: medium-sol@willow exceedes load threshold: alarm hl:np_load_short=1.897949/1.75, alarm hl:np_load_avg=1.927246/2.0, alarm hl:mem_free=302.000000M/350M, alarm hl:available=1/0 [12:14:37] Sun Grid Engine execd on willow is OK: medium-sol@willow OK: longrun-sol@willow OK [12:17:29] Load avg. on willow is OK: OK - load average: 12.75, 14.60, 14.86 [12:19:38] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default [12:22:38] Sun Grid Engine execd on willow is WARNING: medium-sol@willow exceedes load threshold: alarm hl:np_load_short=1.792969/1.75, alarm hl:np_load_avg=1.807129/2.0, alarm hl:mem_free=637.000000M/350M, alarm hl:available=1/0 [12:24:16] MySQL slave on rosemary is CRITICAL: (Return code of 139 is out of bounds) [12:51:47] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [12:53:57] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [12:54:47] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [12:58:17] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1255931.000000 [12:59:06] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 477418 MB (9% inode=44%): [13:02:37] Load avg. on willow is WARNING: WARNING - load average: 15.82, 15.65, 14.51 [13:02:47] Sun Grid Engine execd on willow is WARNING: medium-sol@willow exceedes load threshold: alarm hl:np_load_short=1.993164/1.75, alarm hl:np_load_avg=1.958496/2.0, alarm hl:mem_free=362.000000M/350M, alarm hl:available=1/0 [13:03:48] Sun Grid Engine execd on willow is OK: medium-sol@willow OK: longrun-sol@willow OK [13:04:39] Load avg. on willow is OK: OK - load average: 12.99, 14.62, 14.26 [13:12:47] Sun Grid Engine execd on willow is WARNING: medium-sol@willow exceedes load threshold: alarm hl:np_load_short=1.739258/1.75, alarm hl:np_load_avg=1.747559/2.0, alarm hl:mem_free=206.000000M/350M, alarm hl:available=1/0 [13:16:40] [[User:TParis]] !N 10https://wiki.toolserver.org/w/index.php?oldid=7013&rcid=9242 * TParis * (+30) (Redirect to talk page) [13:17:03] [[User talk:TParis]] !N 10https://wiki.toolserver.org/w/index.php?oldid=7014&rcid=9243 * TParis * (+123) (Create) [13:17:38] Load avg. on willow is WARNING: WARNING - load average: 15.19, 14.54, 14.27 [13:17:51] [[User talk:Loreinesmith761]] ! 10https://wiki.toolserver.org/w/index.php?diff=7015&oldid=7012&rcid=9244 * TParis * (+16) (Spam) [13:19:38] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default [13:19:57] [[~TParis/ec]] !N 10https://wiki.toolserver.org/w/index.php?oldid=7016&rcid=9245 * TParis * (+638) (Edit counter) [13:20:09] [[~TParis/ec]] ! 10https://wiki.toolserver.org/w/index.php?diff=7017&oldid=7016&rcid=9246 * TParis * (-17) (No longer expired) [13:24:17] MySQL slave on rosemary is CRITICAL: (Return code of 139 is out of bounds) [13:29:53] 3(commented) [UTRS-95] Blocking admin on appeal form <10https://jira.toolserver.org/browse/UTRS-95> (Martijn Hoekstra) [13:44:52] 3(created) [UTRS-99] dupe merging; UTRS: Main Interface; Minor New Feature <10https://jira.toolserver.org/browse/UTRS-99> (Martijn Hoekstra) [13:52:47] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [13:52:54] 3(created) [TS-1354] Change SSH public key on my toolserver account; Toolserver; Task <10https://jira.toolserver.org/browse/TS-1354> (Vladimir Zapolskiy) [13:53:57] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [13:54:49] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [13:54:54] 3(updated) [TS-1354] Change SSH public key on my toolserver account <10https://jira.toolserver.org/browse/TS-1354> (Vladimir Zapolskiy) [13:58:17] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1259531.000000 [13:59:06] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 477337 MB (9% inode=44%): [14:06:47] Sun Grid Engine execd on willow is WARNING: medium-sol@willow exceedes load threshold: alarm hl:np_load_short=1.850098/1.75, alarm hl:np_load_avg=1.758789/2.0, alarm hl:mem_free=689.000000M/350M, alarm hl:available=1/0 [14:07:48] Sun Grid Engine execd on willow is OK: medium-sol@willow OK: longrun-sol@willow OK [14:12:48] Sun Grid Engine execd on willow is WARNING: medium-sol@willow exceedes load threshold: alarm hl:np_load_short=1.769043/1.75, alarm hl:np_load_avg=1.747559/2.0, alarm hl:mem_free=309.000000M/350M, alarm hl:available=1/0 [14:19:49] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default [14:24:17] MySQL slave on rosemary is CRITICAL: (Return code of 139 is out of bounds) [14:42:47] Sun Grid Engine execd on willow is WARNING: medium-sol@willow exceedes load threshold: alarm hl:np_load_short=1.572266/1.75, alarm hl:np_load_avg=1.624024/2.0, alarm hl:mem_free=243.000000M/350M, alarm hl:available=1/0 [14:48:47] Sun Grid Engine execd on willow is OK: medium-sol@willow OK: longrun-sol@willow OK [14:52:48] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [14:53:58] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [14:55:47] Sun Grid Engine execd on willow is WARNING: medium-sol@willow exceedes load threshold: alarm hl:np_load_short=1.848145/1.75, alarm hl:np_load_avg=1.716797/2.0, alarm hl:mem_free=200.000000M/350M, alarm hl:available=1/0: longrun-sol@willow exceedes load threshold: alarm hl:np_load_short=1.848145/2.1, alarm hl:np_load_long=1.695312/2.5, alarm hl:cpu=86.100000/99, alarm hl:mem_free=200.000000M/200M, alarm hl:available=1/0 [14:55:47] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [14:58:17] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1263131.000000 [14:59:07] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 477270 MB (9% inode=44%): [15:02:37] Load avg. on willow is WARNING: WARNING - load average: 15.45, 15.44, 14.34 [15:04:47] Load avg. on willow is OK: OK - load average: 13.90, 14.75, 14.21 [15:07:47] Sun Grid Engine execd on ortelius is WARNING: medium-sol@ortelius exceedes load threshold: alarm hl:np_load_short=1.002930/1.00, alarm hl:np_load_long=0.744140/1.50, alarm hl:mem_free=19182.000000M/350M, alarm hl:available=1/0 [15:08:46] Sun Grid Engine execd on ortelius is OK: short-sol@ortelius OK: medium-sol@ortelius OK [15:12:48] Sun Grid Engine execd on ortelius is WARNING: short-sol@ortelius exceedes load threshold: alarm hl:np_load_short=1.123047/1.10, alarm hl:np_load_long=0.861328/1.55, alarm hl:mem_free=18938.000000M/300M, alarm hl:available=1/0: medium-sol@ortelius exceedes load threshold: alarm hl:np_load_short=1.123047/1.00, alarm hl:np_load_long=0.861328/1.50, alarm hl:mem_free=18938.000000M/350M, alarm hl:available=1/0 [15:18:58] Sun Grid Engine execd on willow is WARNING: medium-sol@willow exceedes load threshold: alarm hl:np_load_short=1.855469/1.75, alarm hl:np_load_avg=1.777832/2.0, alarm hl:mem_free=234.000000M/350M, alarm hl:available=1/0 [15:20:47] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default [15:23:58] Sun Grid Engine execd on willow is OK: medium-sol@willow OK: longrun-sol@willow OK [15:24:17] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 2310638 [15:25:30] /tmp on wolfsbane is WARNING: DISK WARNING - free space: /tmp 545 MB (15% inode=99%): [15:27:28] /tmp on wolfsbane is OK: DISK OK - free space: /tmp 1276 MB (30% inode=99%): [15:32:59] Sun Grid Engine execd on willow is WARNING: medium-sol@willow exceedes load threshold: alarm hl:np_load_short=1.865723/1.75, alarm hl:np_load_avg=1.830078/2.0, alarm hl:mem_free=410.000000M/350M, alarm hl:available=1/0 [15:34:58] Sun Grid Engine execd on willow is OK: medium-sol@willow OK: longrun-sol@willow OK [15:44:45] Sun Grid Engine execd on ortelius is WARNING: short-sol@ortelius exceedes load threshold: alarm hl:np_load_short=1.701172/1.10, alarm hl:np_load_long=1.212891/1.55, alarm hl:mem_free=18872.000000M/300M, alarm hl:available=1/0: medium-sol@ortelius exceedes load threshold: alarm hl:np_load_short=1.701172/1.00, alarm hl:np_load_long=1.212891/1.50, alarm hl:mem_free=18872.000000M/350M, alarm hl:available=1/0 [15:52:55] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [15:54:04] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [15:55:54] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [15:58:35] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1266744.000000 [15:58:44] Sun Grid Engine execd on ortelius is OK: short-sol@ortelius OK: medium-sol@ortelius OK [16:00:04] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 477195 MB (9% inode=44%): [16:01:44] Sun Grid Engine execd on ortelius is WARNING: short-sol@ortelius exceedes load threshold: alarm hl:np_load_short=1.136719/1.10, alarm hl:np_load_long=1.268555/1.55, alarm hl:mem_free=19155.000000M/300M, alarm hl:available=1/0: medium-sol@ortelius exceedes load threshold: alarm hl:np_load_short=1.136719/1.00, alarm hl:np_load_long=1.268555/1.50, alarm hl:mem_free=19155.000000M/350M, alarm hl:available=1/0 [16:06:36] Load avg. on ortelius is WARNING: WARNING - load average: 17.90, 12.41, 8.09 [16:07:34] Load avg. on ortelius is OK: OK - load average: 8.26, 10.67, 7.75 [16:12:44] Load avg. on willow is WARNING: WARNING - load average: 15.88, 14.53, 14.04 [16:14:44] Sun Grid Engine execd on ortelius is OK: short-sol@ortelius OK: medium-sol@ortelius OK [16:16:43] Load avg. on willow is OK: OK - load average: 13.20, 14.48, 14.19 [16:20:54] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default [16:23:44] Sun Grid Engine execd on ortelius is WARNING: short-sol@ortelius exceedes load threshold: alarm hl:np_load_short=1.106445/1.10, alarm hl:np_load_long=1.243164/1.55, alarm hl:mem_free=19193.000000M/300M, alarm hl:available=1/0: medium-sol@ortelius exceedes load threshold: alarm hl:np_load_short=1.106445/1.00, alarm hl:np_load_long=1.243164/1.50, alarm hl:mem_free=19193.000000M/350M, alarm hl:available=1/0 [16:24:36] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 2292889 [16:25:44] Sun Grid Engine execd on ortelius is OK: short-sol@ortelius OK: medium-sol@ortelius OK [16:32:44] Load avg. on willow is WARNING: WARNING - load average: 14.04, 15.64, 14.88 [16:53:55] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [16:54:03] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [16:55:54] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [16:58:35] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1270344.000000 [17:00:04] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 476696 MB (9% inode=44%): [17:02:44] Load avg. on willow is WARNING: WARNING - load average: 15.04, 15.21, 14.68 [17:03:44] Load avg. on willow is OK: OK - load average: 14.21, 14.93, 14.61 [17:07:44] Load avg. on willow is WARNING: WARNING - load average: 16.07, 15.56, 14.95 [17:17:43] Sun Grid Engine execd on ortelius is WARNING: short-sol@ortelius exceedes load threshold: alarm hl:np_load_short=1.434570/1.10, alarm hl:np_load_long=1.353516/1.55, alarm hl:mem_free=19075.000000M/300M, alarm hl:available=1/0: medium-sol@ortelius exceedes load threshold: alarm hl:np_load_short=1.434570/1.00, alarm hl:np_load_long=1.353516/1.50, alarm hl:mem_free=19075.000000M/350M, alarm hl:available=1/0 [17:19:45] Sun Grid Engine execd on ortelius is OK: short-sol@ortelius OK: medium-sol@ortelius OK [17:21:55] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default [17:24:35] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 2264237 [17:25:54] 3(commented) [UTRS-98] Account creation is impossible <10https://jira.toolserver.org/browse/UTRS-98> (Martijn Hoekstra) [17:26:45] Sun Grid Engine execd on ortelius is WARNING: short-sol@ortelius exceedes load threshold: alarm hl:np_load_short=1.295899/1.10, alarm hl:np_load_long=1.202149/1.55, alarm hl:mem_free=19192.000000M/300M, alarm hl:available=1/0: medium-sol@ortelius exceedes load threshold: alarm hl:np_load_short=1.295899/1.00, alarm hl:np_load_long=1.202149/1.50, alarm hl:mem_free=19192.000000M/350M, alarm hl:available=1/0 [17:32:44] Load avg. on willow is WARNING: WARNING - load average: 15.07, 14.84, 14.37 [17:32:44] Sun Grid Engine execd on ortelius is OK: short-sol@ortelius OK: medium-sol@ortelius OK [17:32:54] Sun Grid Engine execd on willow is WARNING: medium-sol@willow exceedes load threshold: alarm hl:np_load_short=1.874024/1.75, alarm hl:np_load_avg=1.853027/2.0, alarm hl:mem_free=473.000000M/350M, alarm hl:available=1/0 [17:33:44] Load avg. on willow is OK: OK - load average: 14.05, 14.60, 14.32 [17:33:54] Sun Grid Engine execd on willow is OK: medium-sol@willow OK: longrun-sol@willow OK [17:38:53] Sun Grid Engine execd on willow is WARNING: medium-sol@willow exceedes load threshold: alarm hl:np_load_short=1.600098/1.75, alarm hl:np_load_avg=1.700684/2.0, alarm hl:mem_free=298.000000M/350M, alarm hl:available=1/0 [17:42:44] Load avg. on willow is WARNING: WARNING - load average: 15.36, 14.71, 14.35 [17:49:54] Sun Grid Engine execd on willow is OK: medium-sol@willow OK: longrun-sol@willow OK [17:53:55] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [17:54:04] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [17:55:54] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [17:58:34] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1273946.000000 [18:01:04] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 476629 MB (8% inode=44%): [18:02:54] Sun Grid Engine execd on willow is WARNING: medium-sol@willow exceedes load threshold: alarm hl:np_load_short=1.936035/1.75, alarm hl:np_load_avg=1.871094/2.0, alarm hl:mem_free=238.000000M/350M, alarm hl:available=1/0 [18:22:54] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default [18:25:35] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 2249100 [18:28:54] Sun Grid Engine execd on willow is OK: medium-sol@willow OK: longrun-sol@willow OK [18:36:50] Load avg. on willow is WARNING: WARNING - load average: 12.46, 13.68, 16.68 [18:47:50] Load avg. on willow is OK: OK - load average: 14.42, 13.73, 15.00 [18:49:10] RAID on adenia is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [18:54:23] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [18:54:31] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [18:56:23] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [18:59:31] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1277607.000000 [19:00:23] Sun Grid Engine execd on willow is WARNING: medium-sol@willow exceedes load threshold: alarm hl:np_load_short=1.753418/1.75, alarm hl:np_load_avg=1.695801/2.0, alarm hl:mem_free=165.000000M/350M, alarm hl:available=1/0: longrun-sol@willow exceedes load threshold: alarm hl:np_load_short=1.753418/2.1, alarm hl:np_load_long=1.770996/2.5, alarm hl:cpu=66.200000/99, alarm hl:mem_free=165.000000M/200M, alarm hl:available=1/0 [19:01:22] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 476581 MB (8% inode=44%): [19:03:23] Sun Grid Engine execd on willow is OK: medium-sol@willow OK: longrun-sol@willow OK [19:07:21] Sun Grid Engine execd on willow is WARNING: medium-sol@willow exceedes load threshold: alarm hl:np_load_short=1.729492/1.75, alarm hl:np_load_avg=1.756348/2.0, alarm hl:mem_free=290.000000M/350M, alarm hl:available=1/0 [19:08:48] [[Database access]] ! 10https://wiki.toolserver.org/w/index.php?diff=7018&oldid=6994&rcid=9247 * Tb * (+245) (+ Estimating the size of a user database) [19:12:51] Load avg. on willow is WARNING: WARNING - load average: 16.62, 15.50, 14.82 [19:15:53] 3(commented) [ACCAPP-481] I am active user in http://fa.wiktionary.org and i want this account to run bot on this wiki also updating it's statics. <10https://jira.toolserver.org/browse/ACCAPP-481> (Darafsh Kaviyani) [19:17:50] Load avg. on willow is OK: OK - load average: 13.04, 14.64, 14.70 [19:23:22] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default [19:26:31] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 2222444 [19:33:51] RAID on adenia is OK: OK - TOTAL: 2: FAILED: 0: DEGRADED: 0 [19:54:24] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [19:54:54] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [19:56:24] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [19:59:46] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1281218.000000 [20:01:48] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 476514 MB (8% inode=44%): [20:02:24] Sun Grid Engine execd on willow is WARNING: medium-sol@willow exceedes load threshold: alarm hl:np_load_short=1.930176/1.75, alarm hl:np_load_avg=1.817871/2.0, alarm hl:mem_free=528.000000M/350M, alarm hl:available=1/0 [20:03:24] Sun Grid Engine execd on willow is OK: medium-sol@willow OK: longrun-sol@willow OK [20:12:24] Sun Grid Engine execd on willow is WARNING: medium-sol@willow exceedes load threshold: alarm hl:np_load_short=1.774902/1.75, alarm hl:np_load_avg=1.699219/2.0, alarm hl:mem_free=243.000000M/350M, alarm hl:available=1/0 [20:12:55] hello! [20:14:22] can someone help me with getting an account, jira just hates me :( [20:19:47] any admin arround? [20:20:09] I need help getting access to my account [20:23:24] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default [20:23:52] I don't see them connected [20:23:57] you should open a jira ticket [20:24:06] me? [20:24:21] or srikanthlogic? [20:24:53] I have sent an email to ts-admins@toolserver.org [20:25:07] should I also open a Jira ticket? [20:25:19] I was talking to chicocvenancio [20:25:27] well, I think they will answer you there [20:26:29] Platonides: am unable to login to jira even after having an account and password [20:26:45] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 2188856 [20:54:24] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [20:55:14] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [20:56:24] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [21:00:45] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1284880.000000 [21:02:25] Sun Grid Engine execd on willow is WARNING: medium-sol@willow exceedes load threshold: alarm hl:np_load_short=1.784668/1.75, alarm hl:np_load_avg=1.708496/2.0, alarm hl:mem_free=398.000000M/350M, alarm hl:available=1/0 [21:02:45] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 476415 MB (8% inode=44%): [21:03:24] Sun Grid Engine execd on willow is OK: medium-sol@willow OK: longrun-sol@willow OK [21:07:34] Sun Grid Engine execd on willow is WARNING: medium-sol@willow exceedes load threshold: alarm hl:np_load_short=1.772461/1.75, alarm hl:np_load_avg=1.737305/2.0, alarm hl:mem_free=486.000000M/350M, alarm hl:available=1/0 [21:14:13] RAID on adenia is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [21:23:35] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default [21:26:44] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 2167873 [21:38:54] RAID on adenia is OK: OK - TOTAL: 2: FAILED: 0: DEGRADED: 0 [21:54:24] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [21:55:24] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [21:56:33] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [22:00:55] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1288486.000000 [22:02:24] Sun Grid Engine execd on willow is WARNING: medium-sol@willow exceedes load threshold: alarm hl:np_load_short=1.764160/1.75, alarm hl:np_load_avg=1.699219/2.0, alarm hl:mem_free=272.000000M/350M, alarm hl:available=1/0 [22:03:44] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 476375 MB (8% inode=44%): [22:17:34] Sun Grid Engine execd on willow is OK: medium-sol@willow OK: longrun-sol@willow OK [22:22:36] Sun Grid Engine execd on willow is WARNING: medium-sol@willow exceedes load threshold: alarm hl:np_load_short=1.857422/1.75, alarm hl:np_load_avg=1.767578/2.0, alarm hl:mem_free=413.000000M/350M, alarm hl:available=1/0 [22:23:35] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default [22:24:36] Sun Grid Engine execd on willow is OK: medium-sol@willow OK: longrun-sol@willow OK [22:26:54] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 2152168 [22:32:35] Load avg. on willow is WARNING: WARNING - load average: 15.21, 14.88, 14.29 [22:33:37] Load avg. on willow is OK: OK - load average: 14.67, 14.79, 14.29 [22:46:34] Load avg. on willow is WARNING: WARNING - load average: 15.75, 15.17, 14.55 [22:54:36] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [22:55:45] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [22:56:35] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [23:00:54] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1292087.000000 [23:03:45] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 476330 MB (8% inode=44%): [23:14:14] RAID on adenia is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [23:17:04] good night [23:23:34] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default [23:26:53] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 2121064 [23:30:35] Sun Grid Engine execd on willow is WARNING: medium-sol@willow exceedes load threshold: alarm hl:np_load_short=2.716309/1.75, alarm hl:np_load_avg=1.955078/2.0, alarm hl:mem_free=167.000000M/350M, alarm hl:available=1/0: longrun-sol@willow exceedes load threshold: alarm hl:np_load_short=2.716309/2.1, alarm hl:np_load_long=1.885742/2.5, alarm hl:cpu=71.800000/99, alarm hl:mem_free=167.000000M/200M, alarm hl:available=1/0 [23:42:35] Sun Grid Engine execd on willow is OK: medium-sol@willow OK: longrun-sol@willow OK [23:48:44] RAID on adenia is OK: OK - TOTAL: 2: FAILED: 0: DEGRADED: 0 [23:54:36] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [23:55:44] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [23:55:54] 3(resolved) [DBQ-183] SQL Query Issue <10https://jira.toolserver.org/browse/DBQ-183> (Hoo man) [23:56:36] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default