[00:04:13] Sun Grid Engine execd on willow is WARNING: medium-sol@willow exceedes load threshold: alarm hl:np_load_short=0.893066/1.8, alarm hl:np_load_avg=0.850098/2.3, alarm hl:mem_free=243.000000M/300M, alarm hl:available=1/0 [00:08:13] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [00:08:44] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default [00:10:13] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [00:11:23] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [00:12:53] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [00:23:14] Sun Grid Engine execd on willow is OK: medium-sol@willow OK: longrun-sol@willow OK [00:27:13] Sun Grid Engine execd on willow is WARNING: medium-sol@willow exceedes load threshold: alarm hl:np_load_short=0.679199/1.8, alarm hl:np_load_avg=0.708008/2.3, alarm hl:mem_free=231.000000M/300M, alarm hl:available=1/0 [00:30:13] Sun Grid Engine execd on willow is OK: medium-sol@willow OK: longrun-sol@willow OK [00:35:31] @replag [00:35:32] matthewrbowker: s1-rr-a: 4d 3h 20m 28s [+1.00 s/s]; s1-user: 4d 3h 20m 28s [+1.00 s/s]; s2-user: 33s [+0.00 s/s] [00:41:46] :'( [00:43:12] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 358085.000000 [00:44:32] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 358158.000000 [01:08:23] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [01:08:54] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default [01:10:22] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [01:11:22] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [01:13:01] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [01:43:22] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 361687.000000 [01:44:32] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 361764.000000 [02:08:23] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [02:09:04] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default [02:10:23] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [02:11:24] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [02:13:13] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [02:13:44] Sun Grid Engine execd on ortelius is WARNING: short-sol@ortelius exceedes load threshold: alarm hl:np_load_short=1.500000/1.10, alarm hl:np_load_long=0.816406/1.55, alarm hl:mem_free=21005.000000M/300M, alarm hl:available=1/0: medium-sol@ortelius exceedes load threshold: alarm hl:np_load_short=1.500000/1.00, alarm hl:np_load_long=0.816406/1.50, alarm hl:mem_free=21005.000000M/300M, alarm hl:available=1/0 [02:14:43] Sun Grid Engine execd on ortelius is OK: short-sol@ortelius OK: medium-sol@ortelius OK [02:43:22] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 365293.000000 [02:43:54] Sun Grid Engine execd on ortelius is WARNING: short-sol@ortelius exceedes load threshold: alarm hl:np_load_short=1.196289/1.10, alarm hl:np_load_long=0.795898/1.55, alarm hl:mem_free=21010.000000M/300M, alarm hl:available=1/0: medium-sol@ortelius exceedes load threshold: alarm hl:np_load_short=1.196289/1.00, alarm hl:np_load_long=0.795898/1.50, alarm hl:mem_free=21010.000000M/300M, alarm hl:available=1/0 [02:44:43] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 365375.000000 [02:44:55] Sun Grid Engine execd on ortelius is OK: short-sol@ortelius OK: medium-sol@ortelius OK [02:56:03] /sql on rosemary is WARNING: DISK WARNING - free space: /sql 163206 MB (16% inode=99%): [03:08:36] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [03:09:22] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default [03:10:35] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [03:11:36] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [03:13:42] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [03:43:43] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 368913.000000 [03:44:54] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 368982.000000 [04:08:44] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [04:09:22] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default [04:10:54] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [04:11:54] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [04:14:03] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [04:26:57] @replag [04:26:57] closedmouth: s1-rr-a: 4d 7h 11m 53s [+1.00 s/s]; s1-user: 4d 7h 11m 53s [+1.00 s/s]; s2-user: 1m 47s [+0.01 s/s]; s3-rr-a: 2m 7s [+0.00 s/s]; s3-user: 2m 7s [+0.00 s/s] [04:44:43] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 372575.000000 [04:44:55] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 372583.000000 [05:08:55] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [05:09:32] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default [05:10:55] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [05:11:54] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [05:14:12] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [05:17:55] Sun Grid Engine execd on willow is WARNING: medium-sol@willow exceedes load threshold: alarm hl:np_load_short=0.853027/1.8, alarm hl:np_load_avg=1.005371/2.3, alarm hl:mem_free=210.000000M/300M, alarm hl:available=1/0 [05:19:56] Sun Grid Engine execd on willow is OK: medium-sol@willow OK: longrun-sol@willow OK [05:25:54] Sun Grid Engine execd on willow is WARNING: medium-sol@willow exceedes load threshold: alarm hl:np_load_short=0.989746/1.8, alarm hl:np_load_avg=0.903809/2.3, alarm hl:mem_free=223.000000M/300M, alarm hl:available=1/0 [05:44:56] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 376179.000000 [05:44:56] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 376184.000000 [05:56:56] Load avg. on willow is WARNING: WARNING - load average: 17.38, 15.35, 11.37 [05:57:55] Load avg. on willow is OK: OK - load average: 11.60, 14.10, 11.18 [06:09:03] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [06:09:34] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default [06:11:02] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [06:12:02] Load avg. on willow is WARNING: WARNING - load average: 14.54, 15.29, 12.98 [06:12:02] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [06:15:12] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [06:45:04] Sun Grid Engine execd on willow is WARNING: medium-sol@willow exceedes load threshold: alarm hl:np_load_short=0.989258/1.8, alarm hl:np_load_avg=1.090332/2.3, alarm hl:mem_free=242.000000M/300M, alarm hl:available=1/0 [06:45:04] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 379792.000000 [06:45:53] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 379842.000000 [06:50:04] Sun Grid Engine execd on willow is OK: medium-sol@willow OK: longrun-sol@willow OK [07:03:33] Sun Grid Engine execd on ortelius is WARNING: short-sol@ortelius exceedes load threshold: alarm hl:np_load_short=1.140625/1.10, alarm hl:np_load_long=0.750977/1.55, alarm hl:mem_free=20916.000000M/300M, alarm hl:available=1/0: medium-sol@ortelius exceedes load threshold: alarm hl:np_load_short=1.140625/1.00, alarm hl:np_load_long=0.750977/1.50, alarm hl:mem_free=20916.000000M/300M, alarm hl:available=1/0 [07:04:32] Sun Grid Engine execd on ortelius is OK: short-sol@ortelius OK: medium-sol@ortelius OK [07:09:12] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [07:09:52] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default [07:11:13] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [07:12:14] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [07:13:02] Sun Grid Engine execd on willow is WARNING: medium-sol@willow exceedes load threshold: alarm hl:np_load_short=1.269531/1.8, alarm hl:np_load_avg=1.126465/2.3, alarm hl:mem_free=223.000000M/300M, alarm hl:available=1/0 [07:15:02] Sun Grid Engine execd on willow is OK: medium-sol@willow OK: longrun-sol@willow OK [07:15:22] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [07:37:12] RAID on adenia is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [07:42:02] RAID on adenia is OK: OK - TOTAL: 2: FAILED: 0: DEGRADED: 0 [07:45:13] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 383401.000000 [07:46:54] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 383506.000000 [07:57:13] RAID on adenia is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [08:08:13] Sun Grid Engine execd on willow is WARNING: medium-sol@willow exceedes load threshold: alarm hl:np_load_short=0.933594/1.8, alarm hl:np_load_avg=1.078613/2.3, alarm hl:mem_free=278.000000M/300M, alarm hl:available=1/0 [08:09:43] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [08:09:53] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default [08:11:43] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [08:12:43] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [08:15:13] Sun Grid Engine execd on willow is OK: medium-sol@willow OK: longrun-sol@willow OK [08:15:54] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [08:45:12] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 387001.000000 [08:47:02] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 387113.000000 [08:49:32] SMTP on z-dat-s3-a is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:50:03] SMTP on z-dat-s6-a is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:50:03] SMTP on z-dat-s4-a is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:50:03] SMTP on hyacinth is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:50:13] SMF on z-dat-s4-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [08:50:13] SSH on hyacinth is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:50:13] SMF on z-dat-s6-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [08:50:13] SMTP on z-dat-s7-a is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:50:22] SMF on z-dat-s7-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [08:50:22] SSH on z-dat-s6-a is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:50:22] SSH on z-dat-s7-a is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:50:22] SSH on z-dat-s4-a is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:50:32] SMF on hyacinth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [08:50:32] RAID on hyacinth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [08:50:42] SMF on z-dat-s4-a is OK: OK - all services online [08:50:43] SMF on z-dat-s6-a is OK: OK - all services online [08:50:54] SMTP on z-dat-s6-a is OK: SMTP OK - 0.032 sec. response time [08:50:54] SMTP on z-dat-s4-a is OK: SMTP OK - 0.041 sec. response time [08:50:54] SMF on z-dat-s7-a is OK: OK - all services online [08:50:54] SMTP on hyacinth is OK: SMTP OK - 0.053 sec. response time [08:51:03] SMF on hyacinth is OK: OK - all services online [08:51:03] SSH on hyacinth is OK: SSH OK - OpenSSH_5.8p2-hpn13v11 (protocol 2.0) [08:51:03] SMTP on z-dat-s7-a is OK: SMTP OK - 0.032 sec. response time [08:51:13] RAID on hyacinth is OK: OK - TOTAL: 2: FAILED: 0: DEGRADED: 0 [08:51:13] SSH on z-dat-s6-a is OK: SSH OK - OpenSSH_5.8p2-hpn13v11 (protocol 2.0) [08:51:13] SSH on z-dat-s4-a is OK: SSH OK - OpenSSH_5.8p2-hpn13v11 (protocol 2.0) [08:51:13] SSH on z-dat-s7-a is OK: SSH OK - OpenSSH_5.8p2-hpn13v11 (protocol 2.0) [08:51:22] SMTP on z-dat-s3-a is OK: SMTP OK - 0.049 sec. response time [09:04:13] Sun Grid Engine execd on willow is WARNING: medium-sol@willow exceedes load threshold: alarm hl:np_load_short=1.052246/1.8, alarm hl:np_load_avg=0.987305/2.3, alarm hl:mem_free=242.000000M/300M, alarm hl:available=1/0 [09:05:14] Sun Grid Engine execd on willow is OK: medium-sol@willow OK: longrun-sol@willow OK [09:08:22] Sun Grid Engine execd on willow is WARNING: medium-sol@willow exceedes load threshold: alarm hl:np_load_short=1.075684/1.8, alarm hl:np_load_avg=1.170899/2.3, alarm hl:mem_free=271.000000M/300M, alarm hl:available=1/0 [09:10:02] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default [09:10:43] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [09:12:43] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [09:12:43] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [09:16:03] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [09:45:22] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 390615.000000 [09:48:02] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 390774.000000 [09:49:23] Sun Grid Engine execd on willow is WARNING: medium-sol@willow exceedes load threshold: alarm hl:np_load_short=0.913086/1.8, alarm hl:np_load_avg=0.901367/2.3, alarm hl:mem_free=159.000000M/300M, alarm hl:available=1/0: longrun-sol@willow exceedes load threshold: alarm hl:np_load_short=0.913086/1.9, alarm hl:np_load_long=0.964844/2.25, alarm hl:mem_free=159.000000M/200M, alarm hl:available=1/0 [09:50:01] [[Special:Log/newusers]] create 10 * Maksat * (New user account) [09:50:23] Sun Grid Engine execd on willow is OK: medium-sol@willow OK: longrun-sol@willow OK [10:10:04] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default [10:10:52] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [10:12:52] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [10:13:03] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [10:13:04] [[List of Wikimedia bots]] ! 10https://wiki.toolserver.org/w/index.php?diff=6932&oldid=6736&rcid=9129 * Maksat * (+52) (/* {{#language:ky}} */ ) [10:14:29] [[User:Maksat]] !N 10https://wiki.toolserver.org/w/index.php?oldid=6933&rcid=9130 * Maksat * (+385) (Created page with "My [[Special:EmailUser/Maksat|e-mail]]
Максат Бекбоевич Матраимов (Maksat Bekboo Matraimov)
FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [10:25:33] [[Башбарак]] !N 10https://wiki.toolserver.org/w/index.php?oldid=6934&rcid=9131 * Maksat * (+2632) (Created page with "{{:Main Page/lang}} {|class="plainlinks" style="font-family:'Lucida Grande', sans-serif;" cellspacing="8" | colspan="2" style="border: solid 2px #990000; padding: 1em;" | {| sty...") [10:26:36] [[Main Page/lang]] ! 10https://wiki.toolserver.org/w/index.php?diff=6935&oldid=6931&rcid=9132 * Maksat * (+0) () [10:45:32] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 394218.000000 [10:48:13] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 394380.000000 [10:58:52] /sql on thyme is CRITICAL: DISK CRITICAL - free space: /sql 16853 MB (1% inode=99%): [11:03:31] [[Special:Log/newusers]] create 10 * An-Min * (New user account) [11:10:13] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default [11:10:53] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [11:12:53] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [11:14:02] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [11:16:22] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [11:26:44] is anything known of nightshade? [11:46:33] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 397879.000000 [11:48:22] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 397989.000000 [12:10:23] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default [12:11:13] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [12:13:13] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [12:14:13] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [12:16:32] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [12:47:03] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 401507.000000 [12:48:23] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 401594.000000 [13:10:33] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default [13:11:20] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [13:13:22] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [13:14:33] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [13:16:40] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [13:48:01] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 405167.000000 [13:48:33] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 405197.000000 [13:50:52] [[Replication lag]] ! 10https://wiki.toolserver.org/w/index.php?diff=6936&oldid=6921&rcid=9134 * 70.160.180.134 * (-4) (fix grammar) [14:10:42] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default [14:11:31] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [14:13:42] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [14:14:51] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [14:16:51] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [14:48:05] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 408772.000000 [14:48:38] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 408803.000000 [14:56:37] /sql on rosemary is WARNING: DISK WARNING - free space: /sql 126306 MB (13% inode=99%): [14:59:03] MZMcBride * [Toolserver-l] nightshade status [15:10:46] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default [15:11:36] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [15:13:57] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [15:14:57] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [15:17:05] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [15:48:15] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 412381.000000 [15:49:37] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 412463.000000 [16:10:56] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default [16:11:45] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [16:14:56] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [16:15:55] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [16:17:06] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [16:36:24] DNS recursor on ha-dns-recursor.esi is OK: DNS OK: 0.101 seconds response time. www.google.com returns 173.194.65.103,173.194.65.104,173.194.65.105,173.194.65.106,173.194.65.147,173.194.65.99 [16:48:15] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 415989.000000 [16:49:46] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 416072.000000 [17:09:47] Sun Grid Engine execd on ortelius is WARNING: short-sol@ortelius exceedes load threshold: alarm hl:np_load_short=1.505859/1.10, alarm hl:np_load_long=0.709961/1.55, alarm hl:mem_free=21802.000000M/300M, alarm hl:available=1/0: medium-sol@ortelius exceedes load threshold: alarm hl:np_load_short=1.505859/1.00, alarm hl:np_load_long=0.709961/1.50, alarm hl:mem_free=21802.000000M/300M, alarm hl:available=1/0 [17:10:45] Sun Grid Engine execd on ortelius is OK: short-sol@ortelius OK: medium-sol@ortelius OK [17:10:56] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default [17:11:46] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [17:15:05] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [17:16:05] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [17:17:15] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [17:40:02] DaB. * Re: [Toolserver-l] nightshade status [17:43:47] Sun Grid Engine execd on ortelius is WARNING: short-sol@ortelius exceedes load threshold: alarm hl:np_load_short=1.386719/1.10, alarm hl:np_load_long=0.740235/1.55, alarm hl:mem_free=21884.000000M/300M, alarm hl:available=1/0: medium-sol@ortelius exceedes load threshold: alarm hl:np_load_short=1.386719/1.00, alarm hl:np_load_long=0.740235/1.50, alarm hl:mem_free=21884.000000M/300M, alarm hl:available=1/0 [17:46:47] Sun Grid Engine execd on ortelius is OK: short-sol@ortelius OK: medium-sol@ortelius OK [17:48:16] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 419589.000000 [17:49:47] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 419672.000000 [18:00:59] does anyone know what db server ACC is running on? [18:11:05] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default [18:11:47] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [18:15:07] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [18:16:06] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [18:17:25] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [18:49:15] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 423248.000000 [18:50:46] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 423337.000000 [18:53:54] 3(resolved) [MAGNUS-311] Catscan broken on plwiki <10https://jira.toolserver.org/browse/MAGNUS-311> (Magnus Manske) [19:10:52] [[Special:Log/newusers]] create 10 * Theaitetos * (New user account) [19:10:59] 3(resolved) [MAGNUS-310] ImageSiblings: Category with apostroph has wrong link <10https://jira.toolserver.org/browse/MAGNUS-310> (Magnus Manske) [19:11:05] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default [19:11:55] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [19:14:24] [[User:Theaitetos]] !N 10https://wiki.toolserver.org/w/index.php?oldid=6937&rcid=9136 * Theaitetos * (+240) (Created page with "Hello, in order for you to reach me quickly, please contact me via my Mediawiki page [[mw:User:Theaitetos|Theaitetos]]. Hallo, wer mich schnell erreichen möchte, kann dies übe...") [19:16:05] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [19:16:15] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [19:17:35] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [19:49:34] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 426859.000000 [19:50:51] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 426937.000000 [20:02:19] RAID on adenia is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [20:11:25] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default [20:12:24] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [20:16:35] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [20:16:35] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [20:18:24] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [20:27:53] 3(created) [TS-1335] I have a trouble with pass and user-config.py in toolserver; Toolserver: Toolserver-DB; Task <10https://jira.toolserver.org/browse/TS-1335> (Abdollah Abdollahi) [20:29:53] 3(updated) [TS-1335] I have a trouble with pass and user-config.py in toolserver <10https://jira.toolserver.org/browse/TS-1335> (Abdollah Abdollahi) [20:31:53] 3(updated) [TS-1335] I have a trouble with pass and user-config.py in toolserver <10https://jira.toolserver.org/browse/TS-1335> (Abdollah Abdollahi) [20:31:54] RAID on adenia is OK: OK - TOTAL: 2: FAILED: 0: DEGRADED: 0 [20:39:56] 3(commented) [TS-1335] I have a trouble with pass and user-config.py in toolserver <10https://jira.toolserver.org/browse/TS-1335> (Merlijn van Deen) [20:42:43] fisheye.toolserver.org on web.amaranth is CRITICAL: CRITICAL - Socket timeout after 21 seconds [20:49:35] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 430465.000000 [20:51:16] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 430565.000000 [21:04:37] fisheye.toolserver.org on web.amaranth is OK: HTTP OK: HTTP/1.1 200 OK - 272 bytes in 9.982 second response time [21:11:46] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default [21:12:46] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [21:19:49] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [21:19:49] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [21:20:41] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [21:49:44] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 434073.000000 [21:52:14] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 434226.000000 [22:12:03] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default [22:12:32] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [22:17:03] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [22:17:03] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [22:19:11] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [22:50:03] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 437691.000000 [22:52:22] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 437828.000000 [22:59:21] /sql on thyme is CRITICAL: DISK CRITICAL - free space: /sql 14350 MB (1% inode=99%): [23:12:03] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default [23:12:41] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [23:12:56] 3(commented) [MNT-1198] nightshade down because of missing disc <10https://jira.toolserver.org/browse/MNT-1198> (MZMcBride) [23:17:02] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [23:17:02] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [23:19:11] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [23:51:02] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 441352.000000 [23:53:21] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 441495.000000