[00:03:00] DiskSuite on turnera is CRITICAL: CRITICAL - submirror d42 of mirror d40 is Needs and submirror d32 of mirror d30 is Needs and submirror d22 of mirror d20 is Needs and submirror d12 of mirror d10 is Needs [00:03:19] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [00:05:30] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [00:20:39] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 319464 MB (6% inode=34%): [00:20:58] 3(created) [ACCAPP-508] I would like to have Toolserver access for running SQL queries against enwiki; Account Approval; New Account <10https://jira.toolserver.org/browse/ACCAPP-508> (Phuzion) [00:21:09] Sun Grid Engine execd on willow is WARNING: medium-sol@willow exceedes load threshold: alarm hl:np_load_short=2.131348/1.95, alarm hl:np_load_avg=2.414062/2.0, alarm hl:mem_free=378.000000M/350M, alarm hl:available=1/0 [00:29:08] Sun Grid Engine execd on willow is OK: medium-sol@willow OK: longrun-sol@willow OK [00:33:09] Sun Grid Engine execd on willow is WARNING: medium-sol@willow exceedes load threshold: alarm hl:np_load_short=1.795899/1.95, alarm hl:np_load_avg=2.402832/2.0, alarm hl:mem_free=733.000000M/350M, alarm hl:available=1/0 [00:36:09] Sun Grid Engine execd on willow is OK: medium-sol@willow OK: longrun-sol@willow OK [00:49:49] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [00:50:58] Load avg. on willow is WARNING: WARNING - load average: 14.73, 16.80, 17.03 [00:57:00] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [01:01:00] Load avg. on willow is CRITICAL: CRITICAL - load average: 47.88, 23.95, 19.01 [01:02:00] Load avg. on willow is WARNING: WARNING - load average: 27.10, 22.51, 18.82 [01:03:02] DiskSuite on turnera is CRITICAL: CRITICAL - submirror d42 of mirror d40 is Needs and submirror d32 of mirror d30 is Needs and submirror d22 of mirror d20 is Needs and submirror d12 of mirror d10 is Needs [01:03:18] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [01:06:39] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [01:07:19] Load avg. on willow is CRITICAL: CRITICAL - load average: 31.38, 23.89, 20.00 [01:16:20] Sun Grid Engine execd on willow is WARNING: medium-sol@willow exceedes load threshold: alarm hl:np_load_short=2.089844/1.95, alarm hl:np_load_avg=2.491211/2.0, alarm hl:mem_free=513.000000M/350M, alarm hl:available=1/0 [01:20:39] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 321749 MB (6% inode=35%): [01:24:29] Sun Grid Engine execd on willow is OK: medium-sol@willow OK: longrun-sol@willow OK [01:27:19] Sun Grid Engine execd on willow is WARNING: medium-sol@willow exceedes load threshold: alarm hl:np_load_short=2.038574/1.95, alarm hl:np_load_avg=2.513672/2.0, alarm hl:mem_free=788.000000M/350M, alarm hl:available=1/0: longrun-sol@willow exceedes load threshold: alarm hl:np_load_short=2.038574/2.3, alarm hl:np_load_long=2.479980/2.5, alarm hl:cpu=99.800000/98, alarm hl:mem_free=788.000000M/200M, alarm hl:available=1/0 [01:35:26] Sun Grid Engine execd on willow is OK: medium-sol@willow OK: longrun-sol@willow OK [01:50:05] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [01:51:15] Load avg. on willow is WARNING: WARNING - load average: 13.57, 16.57, 16.97 [01:51:25] Sun Grid Engine execd on willow is WARNING: medium-sol@willow exceedes load threshold: alarm hl:np_load_short=1.672851/1.95, alarm hl:np_load_avg=2.087402/2.0, alarm hl:mem_free=742.000000M/350M, alarm hl:available=1/0 [01:52:24] Sun Grid Engine execd on willow is OK: medium-sol@willow OK: longrun-sol@willow OK [01:57:15] fisheye.toolserver.org on web.amaranth is CRITICAL: CRITICAL - Socket timeout after 21 seconds [01:57:15] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [02:00:16] fisheye.toolserver.org on web.amaranth is WARNING: HTTP WARNING: HTTP/1.1 200 OK - 274 bytes in 19.435 second response time [02:01:15] Load avg. on willow is CRITICAL: CRITICAL - load average: 47.62, 25.81, 19.91 [02:02:15] Load avg. on willow is WARNING: WARNING - load average: 27.52, 24.00, 19.64 [02:03:15] DiskSuite on turnera is CRITICAL: CRITICAL - submirror d42 of mirror d40 is Needs and submirror d32 of mirror d30 is Needs and submirror d22 of mirror d20 is Needs and submirror d12 of mirror d10 is Needs [02:03:25] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [02:06:55] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [02:12:04] RAID on adenia is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [02:13:15] Load avg. on willow is CRITICAL: CRITICAL - load average: 27.75, 22.93, 20.41 [02:16:15] fisheye.toolserver.org on web.amaranth is OK: HTTP OK: HTTP/1.1 200 OK - 273 bytes in 13.038 second response time [02:18:26] Sun Grid Engine execd on willow is WARNING: medium-sol@willow exceedes load threshold: alarm hl:np_load_short=2.104980/1.95, alarm hl:np_load_avg=2.189941/2.0, alarm hl:mem_free=524.000000M/350M, alarm hl:available=1/0 [02:20:55] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 321083 MB (6% inode=35%): [02:23:25] Sun Grid Engine execd on willow is OK: medium-sol@willow OK: longrun-sol@willow OK [02:26:25] Sun Grid Engine execd on willow is WARNING: medium-sol@willow exceedes load threshold: alarm hl:np_load_short=2.202148/1.95, alarm hl:np_load_avg=2.324707/2.0, alarm hl:mem_free=424.000000M/350M, alarm hl:available=1/0 [02:26:32] [[Special:Log/newusers]] create 10 * Sgolldmis * (New user account) [02:27:27] [[User talk:Sgolldmis]] !N 10https://wiki.toolserver.org/w/index.php?oldid=7215&rcid=9618 * Sgolldmis * (+160) (Created page with "Điện lạnh Sơn Tùng - nhà cung cấp các thiết bị điện lạnh uy tín ở Vinh - Nghệ An [http://dienlanhsontung.com/ điện lạnh nghệ an]") [02:28:22] [[Special:Log/move]] move 10 * Sgolldmis * (moved [[02User talk:Sgolldmis10]] to [[Điện lạnh nghệ an]]) [02:31:55] RAID on adenia is OK: OK - TOTAL: 2: FAILED: 0: DEGRADED: 0 [02:36:25] fisheye.toolserver.org on web.amaranth is WARNING: HTTP WARNING: HTTP/1.1 200 OK - 272 bytes in 15.388 second response time [02:42:25] Sun Grid Engine execd on willow is OK: medium-sol@willow OK: longrun-sol@willow OK [02:45:57] Sun Grid Engine execd on ortelius is WARNING: medium-sol@ortelius exceedes load threshold: alarm hl:np_load_short=1.016601/1.00, alarm hl:np_load_long=0.752930/1.50, alarm hl:mem_free=12841.000000M/600M, alarm hl:available=1/0 [02:46:55] Sun Grid Engine execd on ortelius is OK: short-sol@ortelius OK: medium-sol@ortelius OK [02:50:15] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [02:52:04] RAID on adenia is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [02:55:25] fisheye.toolserver.org on web.amaranth is OK: HTTP OK: HTTP/1.1 200 OK - 274 bytes in 14.537 second response time [02:57:15] Load avg. on willow is WARNING: WARNING - load average: 12.91, 15.76, 17.38 [02:57:25] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [03:01:15] Load avg. on willow is CRITICAL: CRITICAL - load average: 40.77, 22.78, 19.40 [03:02:15] Load avg. on willow is WARNING: WARNING - load average: 24.23, 21.29, 19.09 [03:02:25] fisheye.toolserver.org on web.amaranth is WARNING: HTTP WARNING: HTTP/1.1 200 OK - 272 bytes in 15.294 second response time [03:02:45] @replag [03:02:46] matthewrbowker: s2-user: 31s [+0.00 s/s]; s5-rr-a: 11s [-]; s5-user: 11s [-]; s6-rr-a: 12s [-]; s6-user: 12s [-] [03:03:25] DiskSuite on turnera is CRITICAL: CRITICAL - submirror d42 of mirror d40 is Needs and submirror d32 of mirror d30 is Needs and submirror d22 of mirror d20 is Needs and submirror d12 of mirror d10 is Needs [03:03:26] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [03:07:56] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [03:13:25] Load avg. on willow is CRITICAL: CRITICAL - load average: 27.17, 22.55, 20.25 [03:13:56] Sun Grid Engine execd on ortelius is WARNING: short-sol@ortelius exceedes load threshold: alarm hl:np_load_short=1.467774/1.10, alarm hl:np_load_long=0.935547/1.55, alarm hl:mem_free=13539.000000M/500M, alarm hl:available=1/0: medium-sol@ortelius exceedes load threshold: alarm hl:np_load_short=1.467774/1.00, alarm hl:np_load_long=0.935547/1.50, alarm hl:mem_free=13539.000000M/600M, alarm hl:available=1/0 [03:14:55] Sun Grid Engine execd on ortelius is OK: short-sol@ortelius OK: medium-sol@ortelius OK [03:17:25] Sun Grid Engine execd on willow is WARNING: medium-sol@willow exceedes load threshold: alarm hl:np_load_short=1.864258/1.95, alarm hl:np_load_avg=2.329102/2.0, alarm hl:mem_free=983.000000M/350M, alarm hl:available=1/0 [03:21:05] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 319863 MB (6% inode=34%): [03:33:57] Sun Grid Engine execd on ortelius is WARNING: short-sol@ortelius exceedes load threshold: alarm hl:np_load_short=1.144531/1.10, alarm hl:np_load_long=0.755860/1.55, alarm hl:mem_free=13343.000000M/500M, alarm hl:available=1/0: medium-sol@ortelius exceedes load threshold: alarm hl:np_load_short=1.144531/1.00, alarm hl:np_load_long=0.755860/1.50, alarm hl:mem_free=13343.000000M/600M, alarm hl:available=1/0 [03:39:44] fisheye.toolserver.org on web.amaranth is CRITICAL: CRITICAL - Socket timeout after 21 seconds [03:41:04] [[Special:Log/newusers]] create 10 * VMware-Certification * (New user account) [03:50:25] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [03:57:35] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [03:59:35] Sun Grid Engine execd on willow is OK: medium-sol@willow OK: longrun-sol@willow OK [04:02:35] Sun Grid Engine execd on willow is WARNING: medium-sol@willow exceedes load threshold: alarm hl:np_load_short=3.525391/1.95, alarm hl:np_load_avg=3.143555/2.0, alarm hl:mem_free=446.000000M/350M, alarm hl:available=1/0: longrun-sol@willow exceedes load threshold: alarm hl:np_load_short=3.525391/2.3, alarm hl:np_load_long=2.717773/2.5, alarm hl:cpu=96.700000/98, alarm hl:mem_free=446.000000M/200M, alarm hl:available=1/0 [04:03:35] DiskSuite on turnera is CRITICAL: CRITICAL - submirror d42 of mirror d40 is Needs and submirror d32 of mirror d30 is Needs and submirror d22 of mirror d20 is Needs and submirror d12 of mirror d10 is Needs [04:03:35] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [04:07:36] Sun Grid Engine execd on wolfsbane is WARNING: short-sol@wolfsbane exceedes load threshold: alarm hl:np_load_short=0.554688/1.10, alarm hl:np_load_long=0.408691/1.55, alarm hl:mem_free=422.000000M/500M, alarm hl:available=1/0: medium-sol@wolfsbane exceedes load threshold: alarm hl:np_load_short=0.554688/1.00, alarm hl:np_load_long=0.408691/1.50, alarm hl:mem_free=422.000000M/600M, alarm hl:available=1/0 [04:08:05] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [04:18:36] Sun Grid Engine execd on willow is OK: medium-sol@willow OK: longrun-sol@willow OK [04:21:06] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 319812 MB (6% inode=34%): [04:22:35] Sun Grid Engine execd on wolfsbane is OK: testqueue@wolfsbane OK: short-sol@wolfsbane OK: medium-sol@wolfsbane OK [04:31:45] Sun Grid Engine execd on wolfsbane is WARNING: short-sol@wolfsbane exceedes load threshold: alarm hl:np_load_short=0.451660/1.10, alarm hl:np_load_long=0.440430/1.55, alarm hl:mem_free=354.000000M/500M, alarm hl:available=1/0: medium-sol@wolfsbane exceedes load threshold: alarm hl:np_load_short=0.451660/1.00, alarm hl:np_load_long=0.440430/1.50, alarm hl:mem_free=354.000000M/600M, alarm hl:available=1/0 [04:39:49] fisheye.toolserver.org on web.amaranth is CRITICAL: CRITICAL - Socket timeout after 21 seconds [04:45:59] Sun Grid Engine execd on wolfsbane is OK: testqueue@wolfsbane OK: short-sol@wolfsbane OK: medium-sol@wolfsbane OK [04:50:29] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [04:51:00] Sun Grid Engine execd on willow is CRITICAL: medium-sol@willow in error state: QERROR as result of job 2017271s failure: longrun-sol@willow in error state: QERROR as result of job 2017271s failure [04:56:59] Load avg. on willow is WARNING: WARNING - load average: 14.30, 18.08, 18.73 [04:58:00] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [05:01:00] Load avg. on willow is CRITICAL: CRITICAL - load average: 37.52, 22.73, 20.08 [05:01:59] Load avg. on willow is WARNING: WARNING - load average: 22.55, 21.30, 19.75 [05:03:59] DiskSuite on turnera is CRITICAL: CRITICAL - submirror d42 of mirror d40 is Needs and submirror d32 of mirror d30 is Needs and submirror d22 of mirror d20 is Needs and submirror d12 of mirror d10 is Needs [05:04:00] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [05:07:00] Load avg. on willow is CRITICAL: CRITICAL - load average: 27.87, 21.75, 20.02 [05:08:20] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [05:21:19] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 319766 MB (6% inode=34%): [05:24:14] [[VMware Certification]] !N 10https://wiki.toolserver.org/w/index.php?oldid=7218&rcid=9621 * VMware-Certification * (+282) (Created page with "CertClick VMware Certification Training Materials, include VMware PDF document and VMware test engine...") [05:29:56] [[Special:Log/delete]] delete 10 * Matthewrbowker * (deleted "[[02VMware Certification10]]": Vandalism: Spam) [05:30:45] [[Special:Log/block]] block 10 * Matthewrbowker * (blocked [[02User:VMware-Certification10]] with an expiry time of infinite (account creation disabled): Spamming links to external sites) [05:40:00] fisheye.toolserver.org on web.amaranth is WARNING: HTTP WARNING: HTTP/1.1 200 OK - 272 bytes in 18.097 second response time [05:41:09] fisheye.toolserver.org on web.amaranth is CRITICAL: CRITICAL - Socket timeout after 21 seconds [05:41:59] fisheye.toolserver.org on web.amaranth is WARNING: HTTP WARNING: HTTP/1.1 200 OK - 274 bytes in 17.790 second response time [05:50:49] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [05:50:59] Load avg. on willow is WARNING: WARNING - load average: 22.02, 20.12, 18.19 [05:51:00] Sun Grid Engine execd on willow is CRITICAL: medium-sol@willow in error state: QERROR as result of job 2017271s failure: longrun-sol@willow in error state: QERROR as result of job 2017271s failure [05:52:09] SMTP on hyacinth is CRITICAL: CRITICAL - Socket timeout after 10 seconds [05:52:09] SSH on z-dat-s7-a is CRITICAL: CRITICAL - Socket timeout after 10 seconds [05:52:09] SMTP on z-dat-s4-a is CRITICAL: CRITICAL - Socket timeout after 10 seconds [05:52:09] SMTP on z-dat-s6-a is CRITICAL: CRITICAL - Socket timeout after 10 seconds [05:52:29] /sql on z-dat-s6-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [05:52:38] SSH on z-dat-s6-a is CRITICAL: CRITICAL - Socket timeout after 10 seconds [05:52:38] SSH on z-dat-s3-a is CRITICAL: CRITICAL - Socket timeout after 10 seconds [05:52:38] SSH on z-dat-s4-a is CRITICAL: CRITICAL - Socket timeout after 10 seconds [05:52:38] RAID on hyacinth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [05:53:00] SMF on z-dat-s6-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [05:53:09] Load avg. on z-dat-s3-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [05:53:09] Load avg. on z-dat-s7-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [05:53:19] s4 replag on z-dat-s4-a is CRITICAL: (Service Check Timed Out) [05:53:19] /sql on z-dat-s6-a is OK: DISK OK - free space: /sql 158834 MB (16% inode=99%): [05:53:29] MySQL slave on z-dat-s6-a is CRITICAL: (Service Check Timed Out) [05:53:30] MySQL on z-dat-s6-a is CRITICAL: (Service Check Timed Out) [05:53:30] SMF on z-dat-s6-a is OK: OK - all services online [05:53:39] Load avg. on z-dat-s3-a is OK: OK - load average: 0.52, 2.39, 3.31 [05:53:39] MySQL on z-dat-s3-a is CRITICAL: (Service Check Timed Out) [05:53:39] MySQL slave on z-dat-s3-a is CRITICAL: (Service Check Timed Out) [05:53:39] Load avg. on z-dat-s7-a is OK: OK - load average: 0.52, 2.38, 3.31 [05:53:39] s4 replag on z-dat-s4-a is OK: QUERY OK: SELECT ts_rc_age() returned 224.000000 [05:53:39] MySQL on z-dat-s6-a is OK: Uptime: 1157574 Threads: 5 Questions: 234474378 Slow queries: 78945 Opens: 1698491 Flush tables: 2 Open tables: 2099 Queries per second avg: 202.556 [05:53:39] MySQL slave on z-dat-s6-a is OK: Uptime: 1157574 Threads: 6 Questions: 234474378 Slow queries: 78945 Opens: 1698491 Flush tables: 2 Open tables: 2099 Queries per second avg: 202.556 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 231 [05:53:49] MySQL on z-dat-s3-a is OK: Uptime: 1157581 Threads: 18 Questions: 1199322201 Slow queries: 85497 Opens: 11496990 Flush tables: 1 Open tables: 16384 Queries per second avg: 1036.58 [05:53:49] MySQL slave on z-dat-s3-a is OK: Uptime: 1157581 Threads: 18 Questions: 1199322200 Slow queries: 85497 Opens: 11496990 Flush tables: 1 Open tables: 16384 Queries per second avg: 1036.58 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 221 [05:53:59] SMTP on hyacinth is OK: SMTP OK - 0.018 sec. response time [05:53:59] SSH on z-dat-s7-a is OK: SSH OK - OpenSSH_5.8p2-hpn13v11 (protocol 2.0) [05:53:59] SMTP on z-dat-s4-a is OK: SMTP OK - 0.084 sec. response time [05:53:59] SMTP on z-dat-s6-a is OK: SMTP OK - 0.028 sec. response time [05:54:08] RAID on hyacinth is OK: OK - TOTAL: 2: FAILED: 0: DEGRADED: 0 [05:54:29] SSH on z-dat-s3-a is OK: SSH OK - OpenSSH_5.8p2-hpn13v11 (protocol 2.0) [05:54:30] SSH on z-dat-s6-a is OK: SSH OK - OpenSSH_5.8p2-hpn13v11 (protocol 2.0) [05:54:30] SSH on z-dat-s4-a is OK: SSH OK - OpenSSH_5.8p2-hpn13v11 (protocol 2.0) [05:57:59] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [06:00:59] Load avg. on willow is CRITICAL: CRITICAL - load average: 43.30, 23.07, 19.02 [06:02:00] Load avg. on willow is WARNING: WARNING - load average: 26.09, 22.05, 18.93 [06:02:09] RAID on adenia is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [06:04:00] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [06:04:59] DiskSuite on turnera is CRITICAL: CRITICAL - submirror d42 of mirror d40 is Needs and submirror d32 of mirror d30 is Needs and submirror d22 of mirror d20 is Needs and submirror d12 of mirror d10 is Needs [06:06:59] Load avg. on willow is CRITICAL: CRITICAL - load average: 30.14, 23.65, 20.14 [06:08:29] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [06:11:38] RAID on adenia is OK: OK - TOTAL: 2: FAILED: 0: DEGRADED: 0 [06:11:59] Sun Grid Engine execd on wolfsbane is WARNING: short-sol@wolfsbane exceedes load threshold: alarm hl:np_load_short=0.394531/1.10, alarm hl:np_load_long=0.359375/1.55, alarm hl:mem_free=236.000000M/500M, alarm hl:available=1/0: medium-sol@wolfsbane exceedes load threshold: alarm hl:np_load_short=0.394531/1.00, alarm hl:np_load_long=0.359375/1.50, alarm hl:mem_free=236.000000M/600M, alarm hl:available=1/0 [06:16:59] Sun Grid Engine execd on wolfsbane is OK: testqueue@wolfsbane OK: short-sol@wolfsbane OK: medium-sol@wolfsbane OK [06:21:30] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 319699 MB (6% inode=34%): [06:26:19] Environment IPMI on adenia is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [06:27:09] Environment IPMI on adenia is OK: ok: temperature ok fan ok voltage ok chassis ok [06:27:09] RAID on adenia is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [06:30:09] fisheye.toolserver.org on web.amaranth is CRITICAL: CRITICAL - Socket timeout after 21 seconds [06:36:19] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [06:37:39] Sun Grid Engine execd on willow is CRITICAL: medium-sol@willow in error state: QERROR as result of job 2017271s failure: longrun-sol@willow in error state: QERROR as result of job 2017271s failure [06:50:57] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [06:58:07] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [07:04:38] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [07:05:37] DiskSuite on turnera is CRITICAL: CRITICAL - submirror d42 of mirror d40 is Needs and submirror d32 of mirror d30 is Needs and submirror d22 of mirror d20 is Needs and submirror d12 of mirror d10 is Needs [07:08:47] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [07:12:17] fisheye.toolserver.org on web.amaranth is WARNING: HTTP WARNING: HTTP/1.1 200 OK - 273 bytes in 19.341 second response time [07:14:16] fisheye.toolserver.org on web.amaranth is CRITICAL: HTTP CRITICAL: HTTP/1.1 200 OK - 273 bytes in 20.068 second response time [07:15:16] fisheye.toolserver.org on web.amaranth is WARNING: HTTP WARNING: HTTP/1.1 200 OK - 274 bytes in 19.626 second response time [07:20:49] [[Category:Documentation]] ! 10https://wiki.toolserver.org/w/index.php?diff=7219&oldid=4834&rcid=9624 * 46.185.196.167 * (+1443) () [07:21:47] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 319579 MB (6% inode=34%): [07:27:37] Sun Grid Engine execd on wolfsbane is WARNING: short-sol@wolfsbane exceedes load threshold: alarm hl:np_load_short=0.371582/1.10, alarm hl:np_load_long=0.328125/1.55, alarm hl:mem_free=237.000000M/500M, alarm hl:available=1/0: medium-sol@wolfsbane exceedes load threshold: alarm hl:np_load_short=0.371582/1.00, alarm hl:np_load_long=0.328125/1.50, alarm hl:mem_free=237.000000M/600M, alarm hl:available=1/0 [07:28:39] Sun Grid Engine execd on wolfsbane is OK: testqueue@wolfsbane OK: short-sol@wolfsbane OK: medium-sol@wolfsbane OK [07:35:19] fisheye.toolserver.org on web.amaranth is CRITICAL: CRITICAL - Socket timeout after 21 seconds [07:35:29] Sun Grid Engine execd on wolfsbane is WARNING: short-sol@wolfsbane exceedes load threshold: alarm hl:np_load_short=0.329590/1.10, alarm hl:np_load_long=0.334961/1.55, alarm hl:mem_free=478.000000M/500M, alarm hl:available=1/0: medium-sol@wolfsbane exceedes load threshold: alarm hl:np_load_short=0.329590/1.00, alarm hl:np_load_long=0.334961/1.50, alarm hl:mem_free=478.000000M/600M, alarm hl:available=1/0 [07:37:40] Sun Grid Engine execd on willow is CRITICAL: medium-sol@willow in error state: QERROR as result of job 2017271s failure: longrun-sol@willow in error state: QERROR as result of job 2017271s failure [07:51:09] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [07:54:48] SSH on z-dat-s6-a is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:54:48] SSH on z-dat-s3-a is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:55:08] SSH on z-dat-s4-a is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:55:09] RAID on hyacinth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [07:55:39] SSH on z-dat-s6-a is OK: SSH OK - OpenSSH_5.8p2-hpn13v11 (protocol 2.0) [07:55:39] SSH on z-dat-s3-a is OK: SSH OK - OpenSSH_5.8p2-hpn13v11 (protocol 2.0) [07:55:49] RAID on hyacinth is OK: OK - TOTAL: 2: FAILED: 0: DEGRADED: 0 [07:55:59] SSH on z-dat-s4-a is OK: SSH OK - OpenSSH_5.8p2-hpn13v11 (protocol 2.0) [07:58:09] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [08:03:09] fisheye.toolserver.org on web.amaranth is OK: HTTP OK: HTTP/1.1 200 OK - 274 bytes in 12.093 second response time [08:04:39] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [08:06:29] DiskSuite on turnera is CRITICAL: CRITICAL - submirror d42 of mirror d40 is Needs and submirror d32 of mirror d30 is Needs and submirror d22 of mirror d20 is Needs and submirror d12 of mirror d10 is Needs [08:09:08] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [08:21:58] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 319432 MB (6% inode=34%): [08:27:39] Sun Grid Engine execd on wolfsbane is WARNING: short-sol@wolfsbane exceedes load threshold: alarm hl:np_load_short=0.866211/1.10, alarm hl:np_load_long=0.420899/1.55, alarm hl:mem_free=176.000000M/500M, alarm hl:available=1/0: medium-sol@wolfsbane exceedes load threshold: alarm hl:np_load_short=0.866211/1.00, alarm hl:np_load_long=0.420899/1.50, alarm hl:mem_free=176.000000M/600M, alarm hl:available=1/0 [08:29:39] Sun Grid Engine execd on wolfsbane is OK: testqueue@wolfsbane OK: short-sol@wolfsbane OK: medium-sol@wolfsbane OK [08:37:59] Sun Grid Engine execd on willow is CRITICAL: medium-sol@willow in error state: QERROR as result of job 2017271s failure: longrun-sol@willow in error state: QERROR as result of job 2017271s failure [08:51:39] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [08:56:50] Load avg. on willow is WARNING: WARNING - load average: 14.89, 17.88, 17.73 [08:58:29] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [09:00:49] Load avg. on willow is CRITICAL: CRITICAL - load average: 48.20, 25.32, 20.22 [09:01:48] Load avg. on willow is WARNING: WARNING - load average: 27.03, 23.50, 19.90 [09:02:49] Load avg. on willow is CRITICAL: CRITICAL - load average: 28.62, 24.55, 20.50 [09:04:59] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [09:06:59] DiskSuite on turnera is CRITICAL: CRITICAL - submirror d42 of mirror d40 is Needs and submirror d32 of mirror d30 is Needs and submirror d22 of mirror d20 is Needs and submirror d12 of mirror d10 is Needs [09:09:08] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [09:22:09] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 319294 MB (6% inode=34%): [09:26:10] Sun Grid Engine execd on ortelius is WARNING: medium-sol@ortelius exceedes load threshold: alarm hl:np_load_short=1.094726/1.00, alarm hl:np_load_long=0.781250/1.50, alarm hl:mem_free=11996.000000M/600M, alarm hl:available=1/0 [09:30:09] Sun Grid Engine execd on ortelius is OK: short-sol@ortelius OK: medium-sol@ortelius OK [09:35:09] /aux0 on hemlock is CRITICAL: DISK CRITICAL - free space: /aux0 317925 MB (5% inode=34%): [09:37:59] Sun Grid Engine execd on willow is WARNING: medium-sol@willow exceedes load threshold: alarm hl:np_load_short=2.830078/1.95, alarm hl:np_load_avg=2.963867/2.0, alarm hl:mem_free=325.000000M/350M, alarm hl:available=1/0: longrun-sol@willow exceedes load threshold: alarm hl:np_load_short=2.830078/2.3, alarm hl:np_load_long=2.971191/2.5, alarm hl:cpu=92.800000/98, alarm hl:mem_free=325.000000M/200M, alarm hl:available=1/0 [09:40:10] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 320942 MB (6% inode=35%): [09:47:49] Load avg. on willow is WARNING: WARNING - load average: 11.02, 16.68, 19.85 [09:48:48] Load avg. on willow is CRITICAL: CRITICAL - load average: 33.85, 22.46, 21.70 [09:51:39] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [09:52:49] Load avg. on willow is WARNING: WARNING - load average: 8.54, 16.00, 19.27 [09:53:59] Sun Grid Engine execd on willow is OK: medium-sol@willow OK: longrun-sol@willow OK [09:55:10] SSH on z-dat-s6-a is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:55:10] SSH on z-dat-s3-a is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:55:18] SSH on z-dat-s4-a is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:55:58] SSH on z-dat-s6-a is OK: SSH OK - OpenSSH_5.8p2-hpn13v11 (protocol 2.0) [09:55:59] SSH on z-dat-s3-a is OK: SSH OK - OpenSSH_5.8p2-hpn13v11 (protocol 2.0) [09:56:10] SSH on z-dat-s4-a is OK: SSH OK - OpenSSH_5.8p2-hpn13v11 (protocol 2.0) [09:56:59] Sun Grid Engine execd on willow is WARNING: medium-sol@willow exceedes load threshold: alarm hl:np_load_short=2.032715/1.95, alarm hl:np_load_avg=2.231934/2.0, alarm hl:mem_free=443.000000M/350M, alarm hl:available=1/0 [09:58:29] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [10:05:10] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [10:07:10] DiskSuite on turnera is CRITICAL: CRITICAL - submirror d42 of mirror d40 is Needs and submirror d32 of mirror d30 is Needs and submirror d22 of mirror d20 is Needs and submirror d12 of mirror d10 is Needs [10:09:10] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [10:20:29] /sql on z-dat-s4-a is WARNING: DISK WARNING - free space: /sql 41472 MB (10% inode=99%): [10:22:48] Load avg. on willow is CRITICAL: CRITICAL - load average: 15.85, 20.31, 23.27 [10:26:28] /sql on z-dat-s4-a is OK: DISK OK - free space: /sql 62794 MB (15% inode=99%): [10:40:16] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 318488 MB (6% inode=34%): [10:42:05] Load avg. on willow is WARNING: WARNING - load average: 12.57, 16.54, 19.56 [10:42:46] /sql on z-dat-s4-a is WARNING: DISK WARNING - free space: /sql 41797 MB (10% inode=99%): [10:43:06] Load avg. on willow is CRITICAL: CRITICAL - load average: 23.29, 19.77, 20.57 [10:44:05] Load avg. on willow is WARNING: WARNING - load average: 15.22, 18.18, 19.96 [10:51:47] /sql on z-dat-s4-a is OK: DISK OK - free space: /sql 67977 MB (16% inode=99%): [10:52:06] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [10:57:17] Sun Grid Engine execd on willow is WARNING: medium-sol@willow exceedes load threshold: alarm hl:np_load_short=1.914062/1.95, alarm hl:np_load_avg=2.537598/2.0, alarm hl:mem_free=212.000000M/350M, alarm hl:available=1/0: longrun-sol@willow exceedes load threshold: alarm hl:np_load_short=1.914062/2.3, alarm hl:np_load_long=2.544434/2.5, alarm hl:cpu=86.700000/98, alarm hl:mem_free=212.000000M/200M, alarm hl:available=1/0 [10:58:47] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [11:00:16] Sun Grid Engine execd on willow is UNKNOWN: CHECK_NRPE: Received 0 bytes from daemon. Check the remote server logs for error messages. [11:01:17] Sun Grid Engine execd on willow is WARNING: medium-sol@willow exceedes load threshold: alarm hl:np_load_short=4.762207/1.95, alarm hl:np_load_avg=3.050293/2.0, alarm hl:mem_free=463.000000M/350M, alarm hl:available=1/0: longrun-sol@willow exceedes load threshold: alarm hl:np_load_short=4.762207/2.3, alarm hl:np_load_long=2.701660/2.5, alarm hl:cpu=95.000000/98, alarm hl:mem_free=463.000000M/200M, alarm hl:available=1/0 [11:02:16] Sun Grid Engine execd on ortelius is WARNING: short-sol@ortelius exceedes load threshold: alarm hl:np_load_short=2.064453/1.10, alarm hl:np_load_long=0.885742/1.55, alarm hl:mem_free=13332.000000M/500M, alarm hl:available=1/0: medium-sol@ortelius exceedes load threshold: alarm hl:np_load_short=2.064453/1.00, alarm hl:np_load_long=0.885742/1.50, alarm hl:mem_free=13332.000000M/600M, alarm hl:available=1/0 [11:05:17] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [11:07:16] DiskSuite on turnera is CRITICAL: CRITICAL - submirror d42 of mirror d40 is Needs and submirror d32 of mirror d30 is Needs and submirror d22 of mirror d20 is Needs and submirror d12 of mirror d10 is Needs [11:09:47] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [11:12:17] Sun Grid Engine execd on ortelius is OK: short-sol@ortelius OK: medium-sol@ortelius OK [11:15:17] Sun Grid Engine execd on willow is OK: medium-sol@willow OK: longrun-sol@willow OK [11:17:17] Sun Grid Engine execd on ortelius is WARNING: short-sol@ortelius exceedes load threshold: alarm hl:np_load_short=1.393555/1.10, alarm hl:np_load_long=1.200195/1.55, alarm hl:mem_free=13338.000000M/500M, alarm hl:available=1/0: medium-sol@ortelius exceedes load threshold: alarm hl:np_load_short=1.393555/1.00, alarm hl:np_load_long=1.200195/1.50, alarm hl:mem_free=13338.000000M/600M, alarm hl:available=1/0 [11:21:06] Load avg. on willow is WARNING: WARNING - load average: 14.28, 17.66, 18.83 [11:27:56] hello all [11:27:58] @replag [11:27:59] DaBPunkt: s2-user: 1h 18m 28s [+0.15 s/s]; s3-rr-a: 12s [-0.00 s/s]; s3-user: 12s [-0.00 s/s]; s6-rr-a: 15s [+0.00 s/s]; s6-user: 15s [+0.00 s/s] [11:29:17] Sun Grid Engine execd on ortelius is OK: short-sol@ortelius OK: medium-sol@ortelius OK [11:33:37] [[Saffu]] !N 10https://wiki.toolserver.org/w/index.php?oldid=7220&rcid=9625 * Sufwanmohiudin * (+554) (Created page with "{{BLP sources|date=May 2012}} {{original research|date=May 2012}} {{Infobox person | name = Barun Sobti | image = Barun Sobti.jpg | caption ...") [11:36:33] [[Saffu]] ! 10https://wiki.toolserver.org/w/index.php?diff=7221&oldid=7220&rcid=9626 * Sufwanmohiudin * (-536) (Replaced content with "Name - Syed sufwan") [11:37:44] Sun Grid Engine execd on willow is WARNING: medium-sol@willow exceedes load threshold: alarm hl:np_load_short=2.585938/1.95, alarm hl:np_load_avg=2.358887/2.0, alarm hl:mem_free=358.000000M/350M, alarm hl:available=1/0: longrun-sol@willow exceedes load threshold: alarm hl:np_load_short=2.585938/2.3, alarm hl:np_load_long=2.291504/2.5, alarm hl:cpu=84.000000/98, alarm hl:mem_free=358.000000M/200M, alarm hl:available=1/0 [11:39:26] /aux0 on hemlock is CRITICAL: DISK CRITICAL - free space: /aux0 318350 MB (5% inode=34%): [11:41:35] Sun Grid Engine execd on willow is OK: medium-sol@willow OK: longrun-sol@willow OK [11:44:36] Sun Grid Engine execd on willow is WARNING: medium-sol@willow exceedes load threshold: alarm hl:np_load_short=1.988770/1.95, alarm hl:np_load_avg=2.120117/2.0, alarm hl:mem_free=253.000000M/350M, alarm hl:available=1/0 [11:47:44] [[Special:Log/delete]] delete 10 * Dab * (deleted "[[02Saffu10]]": Spam) [11:52:15] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [11:52:35] Sun Grid Engine execd on willow is OK: medium-sol@willow OK: longrun-sol@willow OK [11:55:26] SSH on z-dat-s6-a is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:55:26] SSH on z-dat-s3-a is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:55:26] RAID on hyacinth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [11:56:05] RAID on hyacinth is OK: OK - TOTAL: 2: FAILED: 0: DEGRADED: 0 [11:56:16] SSH on z-dat-s6-a is OK: SSH OK - OpenSSH_5.8p2-hpn13v11 (protocol 2.0) [11:56:16] SSH on z-dat-s3-a is OK: SSH OK - OpenSSH_5.8p2-hpn13v11 (protocol 2.0) [11:58:56] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [12:01:06] Load avg. on willow is CRITICAL: CRITICAL - load average: 31.61, 20.36, 17.98 [12:02:06] Load avg. on willow is WARNING: WARNING - load average: 20.93, 19.62, 17.89 [12:05:36] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [12:06:26] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 318370 MB (6% inode=34%): [12:07:26] /aux0 on hemlock is CRITICAL: DISK CRITICAL - free space: /aux0 318308 MB (5% inode=34%): [12:07:36] DiskSuite on turnera is CRITICAL: CRITICAL - submirror d42 of mirror d40 is Needs and submirror d32 of mirror d30 is Needs and submirror d22 of mirror d20 is Needs and submirror d12 of mirror d10 is Needs [12:09:56] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [12:23:36] Sun Grid Engine execd on ortelius is WARNING: short-sol@ortelius exceedes load threshold: alarm hl:np_load_short=1.228516/1.10, alarm hl:np_load_long=0.790039/1.55, alarm hl:mem_free=13132.000000M/500M, alarm hl:available=1/0: medium-sol@ortelius exceedes load threshold: alarm hl:np_load_short=1.228516/1.00, alarm hl:np_load_long=0.790039/1.50, alarm hl:mem_free=13132.000000M/600M, alarm hl:available=1/0 [12:24:35] Sun Grid Engine execd on ortelius is OK: short-sol@ortelius OK: medium-sol@ortelius OK [12:29:45] 3(resolved) [TS-1377] Cannot access a number of DBs on the toolserver <10https://jira.toolserver.org/browse/TS-1377> (DaB.) [12:30:16] Load avg. on willow is UNKNOWN: CHECK_NRPE: Received 0 bytes from daemon. Check the remote server logs for error messages. [12:31:19] Load avg. on willow is WARNING: WARNING - load average: 20.85, 16.02, 16.05 [12:31:46] 3(resolved) [TS-1340] Cronie jobs not being run intermittently <10https://jira.toolserver.org/browse/TS-1340> (DaB.) [12:33:48] 3(commented) [TS-1333] Install ack <10https://jira.toolserver.org/browse/TS-1333> (DaB.) [12:34:16] Load avg. on willow is OK: OK - load average: 10.45, 13.39, 15.00 [12:35:44] 3(resolved) [TS-1345] Create (or re-activate) account <10https://jira.toolserver.org/browse/TS-1345> (DaB.) [12:37:43] 3(resolved) [TS-1365] crontab dosent work <10https://jira.toolserver.org/browse/TS-1365> (DaB.) [12:40:46] 3(resolved) [TS-1358] add orwiktionary to toolserver database. <10https://jira.toolserver.org/browse/TS-1358> (DaB.) [12:42:16] RAID on adenia is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [12:43:42] 3(commented) [TS-1356] Public key update needed <10https://jira.toolserver.org/browse/TS-1356> (DaB.) [12:45:43] 3(assigned) [TS-1355] Please reactivate my account (diebuche) <10https://jira.toolserver.org/browse/TS-1355> (DaB.) [12:45:44] 3(resolved) [TS-1355] Please reactivate my account (diebuche) <10https://jira.toolserver.org/browse/TS-1355> (DaB.) [12:46:36] Sun Grid Engine execd on ortelius is WARNING: medium-sol@ortelius exceedes load threshold: alarm hl:np_load_short=1.040039/1.00, alarm hl:np_load_long=0.835938/1.50, alarm hl:mem_free=12184.000000M/600M, alarm hl:available=1/0 [12:47:06] RAID on adenia is OK: OK - TOTAL: 2: FAILED: 0: DEGRADED: 0 [12:47:36] Sun Grid Engine execd on ortelius is OK: short-sol@ortelius OK: medium-sol@ortelius OK [12:50:16] Load avg. on willow is WARNING: WARNING - load average: 19.23, 16.13, 14.80 [12:50:36] Sun Grid Engine execd on ortelius is WARNING: short-sol@ortelius exceedes load threshold: alarm hl:np_load_short=1.335938/1.10, alarm hl:np_load_long=0.900390/1.55, alarm hl:mem_free=12093.000000M/500M, alarm hl:available=1/0: medium-sol@ortelius exceedes load threshold: alarm hl:np_load_short=1.335938/1.00, alarm hl:np_load_long=0.900390/1.50, alarm hl:mem_free=12093.000000M/600M, alarm hl:available=1/0 [12:52:26] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [12:52:47] 3(resolved) [TS-1350] Add new wikis (bewikisource, guwikisource, lezwiki, slwikiversity) <10https://jira.toolserver.org/browse/TS-1350> (DaB.) [12:54:43] 3(created) [MNT-1235] Added views for wikimania2013wiki; Maintenance; Minor work <10https://jira.toolserver.org/browse/MNT-1235> (DaB.) [12:54:45] 3(commented) [TS-1344] socat <10https://jira.toolserver.org/browse/TS-1344> (DaB.) [12:54:47] 3(resolved) [MNT-1235] Added views for wikimania2013wiki <10https://jira.toolserver.org/browse/MNT-1235> (DaB.) [12:55:06] SSH on hyacinth is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:55:26] SMTP on z-dat-s4-a is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:55:26] SMTP on z-dat-s7-a is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:55:26] /tmp on z-dat-s4-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [12:55:26] SSH on z-dat-s7-a is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:55:27] /sql on z-dat-s7-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [12:55:27] / on z-dat-s4-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [12:55:27] /tmp on z-dat-s6-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [12:55:27] / on z-dat-s3-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [12:55:27] /sql on z-dat-s3-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [12:55:28] /sql on z-dat-s4-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [12:55:28] /tmp on z-dat-s3-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [12:55:29] SSH on z-dat-s6-a is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:55:45] SSH on z-dat-s4-a is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:55:46] /sql on z-dat-s6-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [12:55:46] / on z-dat-s7-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [12:55:46] /tmp on hyacinth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [12:55:46] SMF on z-dat-s4-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [12:55:46] Load avg. on z-dat-s4-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [12:55:46] / on hyacinth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [12:55:46] Environment IPMI on hyacinth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [12:55:56] Load avg. on hyacinth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [12:55:56] SSH on hyacinth is OK: SSH OK - OpenSSH_5.8p2-hpn13v11 (protocol 2.0) [12:55:56] /tmp on z-dat-s4-a is OK: DISK OK - free space: /tmp 1895 MB (99% inode=99%): [12:55:56] /sql on z-dat-s7-a is OK: DISK OK - free space: /sql 94461 MB (23% inode=99%): [12:55:57] / on z-dat-s4-a is OK: DISK OK - free space: / 8332 MB (27% inode=85%): [12:55:57] /tmp on z-dat-s6-a is OK: DISK OK - free space: /tmp 1894 MB (99% inode=99%): [12:55:57] / on z-dat-s3-a is OK: DISK OK - free space: / 8332 MB (27% inode=85%): [12:55:57] /sql on z-dat-s4-a is OK: DISK OK - free space: /sql 81514 MB (20% inode=99%): [12:55:57] /tmp on z-dat-s3-a is OK: DISK OK - free space: /tmp 1872 MB (99% inode=99%): [12:55:58] /sql on z-dat-s3-a is OK: DISK OK - free space: /sql 156563 MB (16% inode=99%): [12:56:05] RAID on hyacinth is OK: OK - TOTAL: 2: FAILED: 0: DEGRADED: 0 [12:56:06] Load avg. on z-dat-s6-a is OK: OK - load average: 1.14, 1.92, 2.30 [12:56:16] SMTP on z-dat-s4-a is OK: SMTP OK - 0.004 sec. response time [12:56:16] SMTP on z-dat-s7-a is OK: SMTP OK - 0.003 sec. response time [12:56:16] /sql on z-dat-s6-a is OK: DISK OK - free space: /sql 156559 MB (16% inode=99%): [12:56:16] / on z-dat-s7-a is OK: DISK OK - free space: / 8332 MB (27% inode=85%): [12:56:16] SSH on z-dat-s7-a is OK: SSH OK - OpenSSH_5.8p2-hpn13v11 (protocol 2.0) [12:56:47] 3(commented) [TS-1337] Renew expired account josh <10https://jira.toolserver.org/browse/TS-1337> (DaB.) [12:57:46] Load avg. on hyacinth is OK: OK - load average: 0.61, 1.61, 2.16 [12:57:46] /tmp on hyacinth is OK: DISK OK - free space: /tmp 1886 MB (99% inode=99%): [12:57:46] / on hyacinth is OK: DISK OK - free space: / 8332 MB (27% inode=85%): [12:57:46] Load avg. on z-dat-s4-a is OK: OK - load average: 0.61, 1.61, 2.16 [12:57:46] SMF on z-dat-s4-a is OK: OK - all services online [12:58:16] SSH on z-dat-s3-a is OK: SSH OK - OpenSSH_5.8p2-hpn13v11 (protocol 2.0) [12:58:17] SSH on z-dat-s6-a is OK: SSH OK - OpenSSH_5.8p2-hpn13v11 (protocol 2.0) [12:58:25] Environment IPMI on hyacinth is OK: ok: temperature ok fan ok voltage ok chassis ok [12:58:37] SSH on z-dat-s4-a is OK: SSH OK - OpenSSH_5.8p2-hpn13v11 (protocol 2.0) [12:58:44] 3(resolved) [TS-1326] Database corruption in enwiki_p on thyme <10https://jira.toolserver.org/browse/TS-1326> (DaB.) [12:59:56] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [13:00:43] 3(moved) [ENWPONE-28] Page not listing unassessed articles <10https://jira.toolserver.org/browse/ENWPONE-28> (DaB.) [13:00:44] 3(commented) [ENWPONE-28] Page not listing unassessed articles <10https://jira.toolserver.org/browse/ENWPONE-28> (DaB.) [13:02:17] RAID on adenia is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [13:03:31] Sun Grid Engine execd on wolfsbane is WARNING: medium-sol@wolfsbane exceedes load threshold: alarm hl:np_load_short=0.560059/1.00, alarm hl:np_load_long=0.378418/1.50, alarm hl:mem_free=556.000000M/600M, alarm hl:available=1/0 [13:04:44] 3(created) [MNT-1236] Solve the noboardwiki/noboard_chapterswikimedia-problem; Maintenance; Minor work <10https://jira.toolserver.org/browse/MNT-1236> (DaB.) [13:05:36] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [13:07:25] Sun Grid Engine execd on wolfsbane is OK: testqueue@wolfsbane OK: short-sol@wolfsbane OK: medium-sol@wolfsbane OK [13:07:36] /aux0 on hemlock is CRITICAL: DISK CRITICAL - free space: /aux0 318238 MB (5% inode=34%): [13:07:37] DiskSuite on turnera is CRITICAL: CRITICAL - submirror d42 of mirror d40 is Needs and submirror d32 of mirror d30 is Needs and submirror d22 of mirror d20 is Needs and submirror d12 of mirror d10 is Needs [13:10:47] 3(resolved) [MNT-1236] Solve the noboardwiki/noboard_chapterswikimedia-problem <10https://jira.toolserver.org/browse/MNT-1236> (DaB.) [13:10:50] 3(resolved) [TS-1325] Value of domain field in noboardwiki_p row in wiki table is invalid <10https://jira.toolserver.org/browse/TS-1325> (DaB.) [13:10:55] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [13:16:46] 3(resolved) [TS-1351] Create entry for C=US, O=Equifax, OU=Equifax Secure Certificate Authority for git <10https://jira.toolserver.org/browse/TS-1351> (Marlen Caemmerer) [13:18:45] 3(resolved) [TS-1338] Install site-wide SSL certificates <10https://jira.toolserver.org/browse/TS-1338> (Marlen Caemmerer) [13:26:26] Sun Grid Engine execd on wolfsbane is WARNING: short-sol@wolfsbane exceedes load threshold: alarm hl:np_load_short=0.396484/1.10, alarm hl:np_load_long=0.364258/1.55, alarm hl:mem_free=431.000000M/500M, alarm hl:available=1/0: medium-sol@wolfsbane exceedes load threshold: alarm hl:np_load_short=0.396484/1.00, alarm hl:np_load_long=0.364258/1.50, alarm hl:mem_free=431.000000M/600M, alarm hl:available=1/0 [13:27:47] 3(commented) [TS-883] SVN commit fails with my account <10https://jira.toolserver.org/browse/TS-883> (Marlen Caemmerer) [13:29:46] 3(resolved) [TS-1190] MySQL optimizer regression <10https://jira.toolserver.org/browse/TS-1190> (Marlen Caemmerer) [13:31:43] 3(resolved) [TS-1315] tool for dosplaying basic user info <10https://jira.toolserver.org/browse/TS-1315> (Marlen Caemmerer) [13:32:46] Sun Grid Engine execd on willow is WARNING: medium-sol@willow exceedes load threshold: alarm hl:np_load_short=1.996094/1.95, alarm hl:np_load_avg=2.171875/2.0, alarm hl:mem_free=446.000000M/350M, alarm hl:available=1/0 [13:34:46] Sun Grid Engine execd on willow is OK: medium-sol@willow OK: longrun-sol@willow OK [13:35:48] 3(commented) [TS-902] Help robla with CRstats <10https://jira.toolserver.org/browse/TS-902> (Marlen Caemmerer) [13:35:50] 3(commented) [TS-1111] Please re-activate my TS account <10https://jira.toolserver.org/browse/TS-1111> (Marlen Caemmerer) [13:35:53] 3(commented) [TS-887] Lost Key <10https://jira.toolserver.org/browse/TS-887> (Marlen Caemmerer) [13:35:55] /sql on z-dat-s4-a is WARNING: DISK WARNING - free space: /sql 39487 MB (9% inode=99%): [13:37:43] 3(created) [MAGNUS-319] Make duplicate_images_across work on id-wiki and perhaps all wikis; Magnus' tools; Minor Improvement <10https://jira.toolserver.org/browse/MAGNUS-319> (Michael Andersen) [13:37:44] 3(resolved) [TS-883] SVN commit fails with my account <10https://jira.toolserver.org/browse/TS-883> (Marlen Caemmerer) [13:39:47] Sun Grid Engine execd on ortelius is WARNING: short-sol@ortelius exceedes load threshold: alarm hl:np_load_short=1.154297/1.10, alarm hl:np_load_long=0.774414/1.55, alarm hl:mem_free=11509.000000M/500M, alarm hl:available=1/0: medium-sol@ortelius exceedes load threshold: alarm hl:np_load_short=1.154297/1.00, alarm hl:np_load_long=0.774414/1.50, alarm hl:mem_free=11509.000000M/600M, alarm hl:available=1/0 [13:40:46] Sun Grid Engine execd on ortelius is OK: short-sol@ortelius OK: medium-sol@ortelius OK [13:43:56] /sql on z-dat-s4-a is CRITICAL: DISK CRITICAL - free space: /sql 23720 MB (5% inode=99%): [13:45:46] Sun Grid Engine execd on ortelius is WARNING: short-sol@ortelius exceedes load threshold: alarm hl:np_load_short=1.348633/1.10, alarm hl:np_load_long=0.893555/1.55, alarm hl:mem_free=11223.000000M/500M, alarm hl:available=1/0: medium-sol@ortelius exceedes load threshold: alarm hl:np_load_short=1.348633/1.00, alarm hl:np_load_long=0.893555/1.50, alarm hl:mem_free=11223.000000M/600M, alarm hl:available=1/0 [13:47:56] /sql on z-dat-s4-a is OK: DISK OK - free space: /sql 99471 MB (24% inode=99%): [13:52:36] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [13:59:56] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [14:02:46] Sun Grid Engine execd on willow is WARNING: medium-sol@willow exceedes load threshold: alarm hl:np_load_short=2.053711/1.95, alarm hl:np_load_avg=1.974121/2.0, alarm hl:mem_free=1138.000000M/350M, alarm hl:available=1/0 [14:03:48] Sun Grid Engine execd on willow is OK: medium-sol@willow OK: longrun-sol@willow OK [14:05:46] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [14:07:36] /aux0 on hemlock is CRITICAL: DISK CRITICAL - free space: /aux0 318045 MB (5% inode=34%): [14:07:46] DiskSuite on turnera is CRITICAL: CRITICAL - submirror d42 of mirror d40 is Needs and submirror d32 of mirror d30 is Needs and submirror d22 of mirror d20 is Needs and submirror d12 of mirror d10 is Needs [14:11:06] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [14:13:46] 3(resolved) [TS-902] Help robla with CRstats <10https://jira.toolserver.org/browse/TS-902> (Marlen Caemmerer) [14:20:47] Sun Grid Engine execd on willow is WARNING: medium-sol@willow exceedes load threshold: alarm hl:np_load_short=2.048340/1.95, alarm hl:np_load_avg=1.839844/2.0, alarm hl:mem_free=1193.000000M/350M, alarm hl:available=1/0 [14:52:46] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [14:56:08] @replag [14:56:09] liangent: s2-user: 9m 12s [-0.33 s/s] [15:00:05] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [15:05:57] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [15:07:46] /aux0 on hemlock is CRITICAL: DISK CRITICAL - free space: /aux0 317928 MB (5% inode=34%): [15:07:56] DiskSuite on turnera is CRITICAL: CRITICAL - submirror d42 of mirror d40 is Needs and submirror d32 of mirror d30 is Needs and submirror d22 of mirror d20 is Needs and submirror d12 of mirror d10 is Needs [15:11:16] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [15:23:56] Sun Grid Engine execd on ortelius is WARNING: short-sol@ortelius exceedes load threshold: alarm hl:np_load_short=1.244141/1.10, alarm hl:np_load_long=0.766602/1.55, alarm hl:mem_free=13481.000000M/500M, alarm hl:available=1/0: medium-sol@ortelius exceedes load threshold: alarm hl:np_load_short=1.244141/1.00, alarm hl:np_load_long=0.766602/1.50, alarm hl:mem_free=13481.000000M/600M, alarm hl:available=1/0 [15:24:56] Sun Grid Engine execd on ortelius is OK: short-sol@ortelius OK: medium-sol@ortelius OK [15:30:50] 3(resolved) [TS-887] Lost Key <10https://jira.toolserver.org/browse/TS-887> (DaB.) [15:32:42] 3(assigned) [TS-1289] Give user sgeadmin acces to sql-mapnik <10https://jira.toolserver.org/browse/TS-1289> (Marlen Caemmerer) [15:32:49] 3(commented) [TS-1289] Give user sgeadmin acces to sql-mapnik <10https://jira.toolserver.org/browse/TS-1289> (Marlen Caemmerer) [15:34:48] 3(assigned) [TS-1299] Create user sgeadmin also local on each server <10https://jira.toolserver.org/browse/TS-1299> (Marlen Caemmerer) [15:39:57] Sun Grid Engine execd on ortelius is WARNING: medium-sol@ortelius exceedes load threshold: alarm hl:np_load_short=1.001953/1.00, alarm hl:np_load_long=0.844727/1.50, alarm hl:mem_free=13035.000000M/600M, alarm hl:available=1/0 [15:52:46] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [16:00:06] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [16:06:57] Sun Grid Engine execd on willow is WARNING: medium-sol@willow exceedes load threshold: alarm hl:np_load_short=2.475098/1.95, alarm hl:np_load_avg=2.293457/2.0, alarm hl:mem_free=541.000000M/350M, alarm hl:available=1/0: longrun-sol@willow exceedes load threshold: alarm hl:np_load_short=2.475098/2.3, alarm hl:np_load_long=2.238770/2.5, alarm hl:cpu=70.200000/98, alarm hl:mem_free=541.000000M/200M, alarm hl:available=1/0 [16:06:57] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [16:07:46] /aux0 on hemlock is CRITICAL: DISK CRITICAL - free space: /aux0 317800 MB (5% inode=34%): [16:07:56] DiskSuite on turnera is CRITICAL: CRITICAL - submirror d42 of mirror d40 is Needs and submirror d32 of mirror d30 is Needs and submirror d22 of mirror d20 is Needs and submirror d12 of mirror d10 is Needs [16:08:56] Sun Grid Engine execd on willow is OK: medium-sol@willow OK: longrun-sol@willow OK [16:11:26] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [16:12:56] Sun Grid Engine execd on willow is WARNING: medium-sol@willow exceedes load threshold: alarm hl:np_load_short=2.117676/1.95, alarm hl:np_load_avg=1.939453/2.0, alarm hl:mem_free=549.000000M/350M, alarm hl:available=1/0 [16:16:56] Sun Grid Engine execd on willow is OK: medium-sol@willow OK: longrun-sol@willow OK [16:20:36] Load avg. on willow is WARNING: WARNING - load average: 12.18, 14.30, 15.76 [16:22:36] Load avg. on willow is OK: OK - load average: 8.82, 12.13, 14.75 [16:30:56] SMF on willow is UNKNOWN: CHECK_NRPE: Received 0 bytes from daemon. Check the remote server logs for error messages. [16:31:36] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [16:32:46] Load avg. on willow is WARNING: WARNING - load average: 22.43, 17.58, 15.89 [16:34:46] Load avg. on willow is OK: OK - load average: 9.76, 14.56, 14.97 [16:53:06] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [17:00:15] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [17:02:56] Load avg. on willow is WARNING: WARNING - load average: 15.20, 17.92, 15.77 [17:02:57] Sun Grid Engine execd on willow is WARNING: medium-sol@willow exceedes load threshold: alarm hl:np_load_short=2.075195/1.95, alarm hl:np_load_avg=2.283203/2.0, alarm hl:mem_free=708.000000M/350M, alarm hl:available=1/0 [17:04:57] Sun Grid Engine execd on willow is OK: medium-sol@willow OK: longrun-sol@willow OK [17:07:16] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [17:07:56] /aux0 on hemlock is CRITICAL: DISK CRITICAL - free space: /aux0 317555 MB (5% inode=34%): [17:08:06] DiskSuite on turnera is CRITICAL: CRITICAL - submirror d42 of mirror d40 is Needs and submirror d32 of mirror d30 is Needs and submirror d22 of mirror d20 is Needs and submirror d12 of mirror d10 is Needs [17:12:56] Sun Grid Engine execd on willow is WARNING: medium-sol@willow exceedes load threshold: alarm hl:np_load_short=3.245117/1.95, alarm hl:np_load_avg=2.340332/2.0, alarm hl:mem_free=297.000000M/350M, alarm hl:available=1/0: longrun-sol@willow exceedes load threshold: alarm hl:np_load_short=3.245117/2.3, alarm hl:np_load_long=2.070312/2.5, alarm hl:cpu=94.500000/98, alarm hl:mem_free=297.000000M/200M, alarm hl:available=1/0 [17:21:56] Load avg. on willow is OK: OK - load average: 9.56, 13.60, 14.93 [17:31:37] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [17:32:56] Load avg. on willow is WARNING: WARNING - load average: 11.86, 15.62, 15.15 [17:33:56] Load avg. on willow is OK: OK - load average: 8.86, 14.14, 14.66 [17:53:16] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [18:00:37] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [18:02:07] Sun Grid Engine execd on willow is WARNING: medium-sol@willow exceedes load threshold: alarm hl:np_load_short=2.084961/1.95, alarm hl:np_load_avg=1.970703/2.0, alarm hl:mem_free=199.000000M/350M, alarm hl:available=1/0: longrun-sol@willow exceedes load threshold: alarm hl:np_load_short=2.084961/2.3, alarm hl:np_load_long=1.840820/2.5, alarm hl:cpu=80.600000/98, alarm hl:mem_free=199.000000M/200M, alarm hl:available=1/0 [18:03:06] Load avg. on willow is WARNING: WARNING - load average: 17.24, 16.36, 15.02 [18:05:07] Sun Grid Engine execd on willow is OK: medium-sol@willow OK: longrun-sol@willow OK [18:06:06] Load avg. on willow is OK: OK - load average: 11.58, 14.82, 14.70 [18:07:16] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [18:08:06] /aux0 on hemlock is CRITICAL: DISK CRITICAL - free space: /aux0 317425 MB (5% inode=34%): [18:08:06] Sun Grid Engine execd on ortelius is WARNING: short-sol@ortelius exceedes load threshold: alarm hl:np_load_short=1.105469/1.10, alarm hl:np_load_long=0.757812/1.55, alarm hl:mem_free=13346.000000M/500M, alarm hl:available=1/0: medium-sol@ortelius exceedes load threshold: alarm hl:np_load_short=1.105469/1.00, alarm hl:np_load_long=0.757812/1.50, alarm hl:mem_free=13346.000000M/600M, alarm hl:available=1/0 [18:08:06] DiskSuite on turnera is CRITICAL: CRITICAL - submirror d42 of mirror d40 is Needs and submirror d32 of mirror d30 is Needs and submirror d22 of mirror d20 is Needs and submirror d12 of mirror d10 is Needs [18:10:06] Sun Grid Engine execd on ortelius is OK: short-sol@ortelius OK: medium-sol@ortelius OK [18:13:06] Sun Grid Engine execd on willow is WARNING: medium-sol@willow exceedes load threshold: alarm hl:np_load_short=2.948730/1.95, alarm hl:np_load_avg=2.231445/2.0, alarm hl:mem_free=478.000000M/350M, alarm hl:available=1/0: longrun-sol@willow exceedes load threshold: alarm hl:np_load_short=2.948730/2.3, alarm hl:np_load_long=1.986328/2.5, alarm hl:cpu=86.200000/98, alarm hl:mem_free=478.000000M/200M, alarm hl:available=1/0 [18:15:06] Load avg. on willow is WARNING: WARNING - load average: 11.47, 15.76, 15.38 [18:26:43] 3(commented) [TS-1356] Public key update needed <10https://jira.toolserver.org/browse/TS-1356> (Ahmed Medhat Mohamed) [18:30:45] 3(updated) [TS-1356] Public key update needed <10https://jira.toolserver.org/browse/TS-1356> (Ahmed Medhat Mohamed) [18:30:48] 3(commented) [TS-1356] Public key update needed <10https://jira.toolserver.org/browse/TS-1356> (Ahmed Medhat Mohamed) [18:31:46] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [18:45:16] Sun Grid Engine execd on ortelius is WARNING: short-sol@ortelius exceedes load threshold: alarm hl:np_load_short=1.121094/1.10, alarm hl:np_load_long=0.688477/1.55, alarm hl:mem_free=13039.000000M/500M, alarm hl:available=1/0: medium-sol@ortelius exceedes load threshold: alarm hl:np_load_short=1.121094/1.00, alarm hl:np_load_long=0.688477/1.50, alarm hl:mem_free=13039.000000M/600M, alarm hl:available=1/0 [18:46:16] Sun Grid Engine execd on ortelius is OK: short-sol@ortelius OK: medium-sol@ortelius OK [18:46:44] 3(resolved) [TS-1356] Public key update needed <10https://jira.toolserver.org/browse/TS-1356> (DaB.) [18:48:16] Sun Grid Engine execd on willow is WARNING: medium-sol@willow exceedes load threshold: alarm hl:np_load_short=1.562988/1.95, alarm hl:np_load_avg=1.877930/2.0, alarm hl:mem_free=304.000000M/350M, alarm hl:available=1/0 [18:49:16] Sun Grid Engine execd on willow is CRITICAL: medium-sol@willow in error state: QERROR as result of job 2020656s failure: longrun-sol@willow in error state: QERROR as result of job 2020656s failure [18:53:16] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [18:57:16] Sun Grid Engine execd on ortelius is WARNING: short-sol@ortelius exceedes load threshold: alarm hl:np_load_short=1.942383/1.10, alarm hl:np_load_long=1.119141/1.55, alarm hl:mem_free=12003.000000M/500M, alarm hl:available=1/0: medium-sol@ortelius exceedes load threshold: alarm hl:np_load_short=1.942383/1.00, alarm hl:np_load_long=1.119141/1.50, alarm hl:mem_free=12003.000000M/600M, alarm hl:available=1/0 [19:01:36] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [19:07:16] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [19:08:06] /aux0 on hemlock is CRITICAL: DISK CRITICAL - free space: /aux0 317325 MB (5% inode=34%): [19:08:15] DiskSuite on turnera is CRITICAL: CRITICAL - submirror d42 of mirror d40 is Needs and submirror d32 of mirror d30 is Needs and submirror d22 of mirror d20 is Needs and submirror d12 of mirror d10 is Needs [19:10:16] Sun Grid Engine execd on wolfsbane is WARNING: short-sol@wolfsbane exceedes load threshold: alarm hl:np_load_short=0.295410/1.10, alarm hl:np_load_long=0.316895/1.55, alarm hl:mem_free=410.000000M/500M, alarm hl:available=1/0: medium-sol@wolfsbane exceedes load threshold: alarm hl:np_load_short=0.295410/1.00, alarm hl:np_load_long=0.316895/1.50, alarm hl:mem_free=410.000000M/600M, alarm hl:available=1/0 [19:12:17] Sun Grid Engine execd on wolfsbane is OK: testqueue@wolfsbane OK: short-sol@wolfsbane OK: medium-sol@wolfsbane OK [19:18:16] Load avg. on willow is WARNING: WARNING - load average: 12.80, 13.74, 15.05 [19:20:16] Sun Grid Engine execd on wolfsbane is WARNING: medium-sol@wolfsbane exceedes load threshold: alarm hl:np_load_short=0.398438/1.00, alarm hl:np_load_long=0.304199/1.50, alarm hl:mem_free=564.000000M/600M, alarm hl:available=1/0 [19:23:16] Load avg. on willow is OK: OK - load average: 8.72, 13.27, 14.89 [19:26:08] nosy: How does the new linux server handle :(){:|:&};: [19:30:14] Dispenser: you mean there was some shell problem once 2 or 3 years ago? [19:30:26] or which interpreter do you mean? [19:30:55] The classic fork-bomb in bash [19:31:46] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [19:42:32] Dispenser: my current ubuntu says: [19:42:33] nosy@all:~$ :(){ :|: & };: [19:42:34] [1] 25618 [19:42:34] nosy@all:~$ [19:42:34] [1]+ Done : | : [19:43:16] nosy: your box is named "all"? [19:43:32] DaBPunkt: yes [19:43:43] The one box to rule them all? [19:43:56] lol [19:43:58] nosy: like the german word for universe? [19:44:03] yes [19:44:09] ah ok [19:44:38] Dispenser: second run seems to "have worked" [19:48:24] Dispenser: did you try this on a Solaris? [19:49:09] After river caught me running nmap, I never dared [19:49:16] Sun Grid Engine execd on willow is CRITICAL: medium-sol@willow in error state: QERROR as result of job 2020656s failure: longrun-sol@willow in error state: QERROR as result of job 2020656s failure [19:51:03] thats nearly what i wanted to hear :D [19:51:50] And I need good standing since my tools violates at least one rule [19:53:25] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [20:01:56] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [20:04:18] [[Special:Log/newusers]] create 10 * Shaun9876 * (New user account) [20:07:16] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [20:08:06] /aux0 on hemlock is CRITICAL: DISK CRITICAL - free space: /aux0 317250 MB (5% inode=34%): [20:08:16] DiskSuite on turnera is CRITICAL: CRITICAL - submirror d42 of mirror d40 is Needs and submirror d32 of mirror d30 is Needs and submirror d22 of mirror d20 is Needs and submirror d12 of mirror d10 is Needs [20:10:44] 3(created) [UTRS-105] No way of showing multiple appeals from an account; UTRS: Main Interface; Minor Bug <10https://jira.toolserver.org/browse/UTRS-105> (secretlondon) [20:26:28] re [20:31:57] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [20:49:17] Sun Grid Engine execd on willow is CRITICAL: medium-sol@willow in error state: QERROR as result of job 2020656s failure: longrun-sol@willow in error state: QERROR as result of job 2020656s failure [20:53:36] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [20:56:26] Sun Grid Engine execd on wolfsbane is WARNING: medium-sol@wolfsbane exceedes load threshold: alarm hl:np_load_short=0.243164/1.00, alarm hl:np_load_long=0.270020/1.50, alarm hl:mem_free=560.000000M/600M, alarm hl:available=1/0 [20:57:26] Sun Grid Engine execd on wolfsbane is OK: testqueue@wolfsbane OK: short-sol@wolfsbane OK: medium-sol@wolfsbane OK [21:02:06] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [21:03:16] Load avg. on willow is WARNING: WARNING - load average: 14.89, 15.45, 13.17 [21:04:17] Load avg. on willow is OK: OK - load average: 10.95, 14.26, 12.89 [21:07:25] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [21:08:16] /aux0 on hemlock is CRITICAL: DISK CRITICAL - free space: /aux0 317030 MB (5% inode=34%): [21:08:16] DiskSuite on turnera is CRITICAL: CRITICAL - submirror d42 of mirror d40 is Needs and submirror d32 of mirror d30 is Needs and submirror d22 of mirror d20 is Needs and submirror d12 of mirror d10 is Needs [21:31:56] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [21:48:02] nighty [21:49:26] Sun Grid Engine execd on willow is CRITICAL: medium-sol@willow in error state: QERROR as result of job 2020656s failure: longrun-sol@willow in error state: QERROR as result of job 2020656s failure [21:53:45] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [22:02:06] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [22:03:17] Load avg. on willow is WARNING: WARNING - load average: 16.45, 16.07, 13.85 [22:05:17] Load avg. on willow is OK: OK - load average: 13.66, 14.46, 13.49 [22:07:35] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [22:08:26] DiskSuite on turnera is CRITICAL: CRITICAL - submirror d42 of mirror d40 is Needs and submirror d32 of mirror d30 is Needs and submirror d22 of mirror d20 is Needs and submirror d12 of mirror d10 is Needs [22:09:16] /aux0 on hemlock is CRITICAL: DISK CRITICAL - free space: /aux0 316916 MB (5% inode=34%): [22:13:06] nacht ts [22:31:56] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [22:47:29] [[Special:Log/newusers]] create 10 * DGideas * (New user account) [22:48:46] [[User:DGideas]] !N 10https://wiki.toolserver.org/w/index.php?oldid=7222&rcid=9630 * DGideas * (+73) (create user page) [22:49:36] Sun Grid Engine execd on willow is CRITICAL: medium-sol@willow in error state: QERROR as result of job 2020656s failure: longrun-sol@willow in error state: QERROR as result of job 2020656s failure [22:50:25] Load avg. on willow is WARNING: WARNING - load average: 17.56, 14.82, 13.17 [22:52:24] Load avg. on willow is OK: OK - load average: 14.36, 14.23, 13.13 [22:54:44] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [22:56:24] Load avg. on willow is WARNING: WARNING - load average: 16.51, 15.66, 13.94 [23:02:16] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [23:07:36] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [23:08:35] DiskSuite on turnera is CRITICAL: CRITICAL - submirror d42 of mirror d40 is Needs and submirror d32 of mirror d30 is Needs and submirror d22 of mirror d20 is Needs and submirror d12 of mirror d10 is Needs [23:09:58] /aux0 on hemlock is CRITICAL: DISK CRITICAL - free space: /aux0 315530 MB (5% inode=34%): [23:32:18] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [23:39:57] Sun Grid Engine execd on willow is OK: medium-sol@willow OK: longrun-sol@willow OK [23:42:57] Sun Grid Engine execd on willow is WARNING: medium-sol@willow exceedes load threshold: alarm hl:np_load_short=2.563477/1.95, alarm hl:np_load_avg=1.524414/2.0, alarm hl:mem_free=391.000000M/350M, alarm hl:available=1/0: longrun-sol@willow exceedes load threshold: alarm hl:np_load_short=2.563477/2.3, alarm hl:np_load_long=1.430176/2.5, alarm hl:cpu=83.300000/98, alarm hl:mem_free=391.000000M/200M, alarm hl:available=1/0 [23:43:57] Sun Grid Engine execd on willow is OK: medium-sol@willow OK: longrun-sol@willow OK [23:55:07] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk