[00:00:54] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [00:00:54] APT on yarrow is CRITICAL: APT CRITICAL: 4 packages available for upgrade (4 critical updates). [00:01:24] Load avg. on willow is WARNING: WARNING - load average: 21.31, 16.81, 14.06 [00:01:54] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [00:03:34] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [00:09:56] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [00:11:54] Sun Grid Engine execd on willow is WARNING: medium-sol@willow exceedes load threshold: alarm hl:np_load_short=2.016113/1.75, alarm hl:np_load_avg=2.039551/2.0, alarm hl:mem_free=140.000000M/350M, alarm hl:available=1/0: longrun-sol@willow exceedes load threshold: alarm hl:np_load_short=2.016113/1.9, alarm hl:np_load_long=1.867676/2.25, alarm hl:mem_free=140.000000M/200M, alarm hl:available=1/0 [00:14:34] Load avg. on willow is OK: OK - load average: 12.77, 14.67, 14.52 [00:16:56] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default [00:27:13] MySQL slave on thyme is WARNING: No slaves defined [00:32:34] Load avg. on willow is WARNING: WARNING - load average: 17.02, 16.87, 15.31 [00:38:23] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 126522 MB (20% inode=99%): [00:38:54] Sun Grid Engine execd on willow is OK: medium-sol@willow OK: longrun-sol@willow OK [00:41:55] Sun Grid Engine execd on willow is WARNING: medium-sol@willow exceedes load threshold: alarm hl:np_load_short=1.850098/1.75, alarm hl:np_load_avg=2.002930/2.0, alarm hl:mem_free=534.000000M/350M, alarm hl:available=1/0 [00:42:55] Sun Grid Engine execd on willow is OK: medium-sol@willow OK: longrun-sol@willow OK [00:43:35] Load avg. on willow is OK: OK - load average: 11.59, 14.41, 14.97 [00:50:35] Load avg. on willow is WARNING: WARNING - load average: 24.54, 17.54, 15.86 [00:54:13] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1136342.000000 [00:56:13] s1 replag on thyme is CRITICAL: QUERY CRITICAL: Unknown database enwiki_p [00:58:43] RAID on adenia is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [01:00:33] Load avg. on willow is CRITICAL: CRITICAL - load average: 35.49, 20.59, 17.35 [01:00:53] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [01:01:54] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [01:01:54] APT on yarrow is CRITICAL: APT CRITICAL: 4 packages available for upgrade (4 critical updates). [01:03:23] RAID on adenia is OK: OK - TOTAL: 2: FAILED: 0: DEGRADED: 0 [01:03:45] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [01:10:04] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [01:17:03] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default [01:20:03] Sun Grid Engine execd on willow is WARNING: medium-sol@willow exceedes load threshold: alarm hl:np_load_short=2.161133/1.75, alarm hl:np_load_avg=2.465332/2.0, alarm hl:mem_free=295.000000M/350M, alarm hl:available=1/0: longrun-sol@willow exceedes load threshold: alarm hl:np_load_short=2.161133/1.9, alarm hl:np_load_long=2.407715/2.25, alarm hl:mem_free=295.000000M/200M, alarm hl:available=1/0 [01:27:13] MySQL slave on thyme is WARNING: No slaves defined [01:38:22] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 125316 MB (20% inode=99%): [01:42:14] Sun Grid Engine execd on willow is OK: medium-sol@willow OK: longrun-sol@willow OK [01:45:23] /sql on ptolemy is OK: DISK OK - free space: /sql 127378 MB (21% inode=99%): [01:48:14] Sun Grid Engine execd on willow is WARNING: medium-sol@willow exceedes load threshold: alarm hl:np_load_short=2.068848/1.75, alarm hl:np_load_avg=1.970215/2.0, alarm hl:mem_free=277.000000M/350M, alarm hl:available=1/0: longrun-sol@willow exceedes load threshold: alarm hl:np_load_short=2.068848/1.9, alarm hl:np_load_long=2.068359/2.25, alarm hl:mem_free=277.000000M/200M, alarm hl:available=1/0 [01:48:23] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 126396 MB (20% inode=99%): [01:50:45] Load avg. on willow is WARNING: WARNING - load average: 24.21, 18.36, 17.37 [01:54:15] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1139945.000000 [01:56:14] s1 replag on thyme is CRITICAL: QUERY CRITICAL: Unknown database enwiki_p [02:00:43] Load avg. on willow is CRITICAL: CRITICAL - load average: 41.09, 22.28, 18.83 [02:01:13] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [02:01:44] Load avg. on willow is WARNING: WARNING - load average: 23.62, 20.69, 18.48 [02:02:14] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [02:02:15] APT on yarrow is CRITICAL: APT CRITICAL: 4 packages available for upgrade (4 critical updates). [02:03:53] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [02:08:54] 3(created) [UTRS-92] Appeal in backlog when closed; UTRS: Main Interface; Bug <10https://jira.toolserver.org/browse/UTRS-92> (Chris Howie) [02:10:15] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [02:17:14] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default [02:27:13] MySQL slave on thyme is WARNING: No slaves defined [02:30:43] Load avg. on willow is CRITICAL: CRITICAL - load average: 30.60, 20.55, 19.27 [02:31:43] Load avg. on willow is WARNING: WARNING - load average: 21.00, 19.59, 19.01 [02:48:24] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 126205 MB (20% inode=99%): [02:49:14] Sun Grid Engine execd on willow is WARNING: medium-sol@willow exceedes load threshold: alarm hl:np_load_short=2.048828/1.75, alarm hl:np_load_avg=2.016113/2.0, alarm hl:mem_free=190.000000M/350M, alarm hl:available=1/0: longrun-sol@willow exceedes load threshold: alarm hl:np_load_short=2.048828/1.9, alarm hl:np_load_long=2.116211/2.25, alarm hl:mem_free=190.000000M/200M, alarm hl:available=1/0 [02:54:23] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1143555.000000 [02:56:23] s1 replag on thyme is CRITICAL: QUERY CRITICAL: Unknown database enwiki_p [03:01:24] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [03:02:16] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [03:02:16] APT on yarrow is CRITICAL: APT CRITICAL: 4 packages available for upgrade (4 critical updates). [03:04:03] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [03:11:13] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [03:14:13] Sun Grid Engine execd on willow is OK: medium-sol@willow OK: longrun-sol@willow OK [03:17:13] Sun Grid Engine execd on willow is WARNING: medium-sol@willow exceedes load threshold: alarm hl:np_load_short=1.939453/1.75, alarm hl:np_load_avg=2.010742/2.0, alarm hl:mem_free=327.000000M/350M, alarm hl:available=1/0: longrun-sol@willow exceedes load threshold: alarm hl:np_load_short=1.939453/1.9, alarm hl:np_load_long=2.057617/2.25, alarm hl:mem_free=327.000000M/200M, alarm hl:available=1/0 [03:18:13] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default [03:22:13] Sun Grid Engine execd on willow is OK: medium-sol@willow OK: longrun-sol@willow OK [03:27:23] MySQL slave on thyme is WARNING: No slaves defined [03:31:55] Load avg. on willow is WARNING: WARNING - load average: 15.12, 16.19, 16.16 [03:36:56] Load avg. on willow is OK: OK - load average: 11.11, 13.10, 14.77 [03:49:24] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 125903 MB (20% inode=99%): [03:54:24] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1147155.000000 [03:56:24] s1 replag on thyme is CRITICAL: QUERY CRITICAL: Unknown database enwiki_p [04:01:24] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [04:03:13] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [04:03:13] APT on yarrow is CRITICAL: APT CRITICAL: 4 packages available for upgrade (4 critical updates). [04:04:13] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [04:05:44] /sql on rosemary is WARNING: DISK WARNING - free space: /sql 120244 MB (12% inode=99%): [04:11:24] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [04:18:24] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default [04:27:23] MySQL slave on thyme is WARNING: No slaves defined [04:42:54] Load avg. on willow is WARNING: WARNING - load average: 17.06, 14.92, 13.92 [04:43:24] Sun Grid Engine execd on willow is WARNING: medium-sol@willow exceedes load threshold: alarm hl:np_load_short=2.132324/1.75, alarm hl:np_load_avg=1.866211/2.0, alarm hl:mem_free=568.000000M/350M, alarm hl:available=1/0: longrun-sol@willow exceedes load threshold: alarm hl:np_load_short=2.132324/1.9, alarm hl:np_load_long=1.740234/2.25, alarm hl:mem_free=568.000000M/200M, alarm hl:available=1/0 [04:48:24] Sun Grid Engine execd on willow is OK: medium-sol@willow OK: longrun-sol@willow OK [04:49:44] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 125683 MB (20% inode=99%): [04:51:24] Sun Grid Engine execd on willow is WARNING: medium-sol@willow exceedes load threshold: alarm hl:np_load_short=2.449707/1.75, alarm hl:np_load_avg=2.166016/2.0, alarm hl:mem_free=543.000000M/350M, alarm hl:available=1/0: longrun-sol@willow exceedes load threshold: alarm hl:np_load_short=2.449707/1.9, alarm hl:np_load_long=1.931641/2.25, alarm hl:mem_free=543.000000M/200M, alarm hl:available=1/0 [04:52:54] Load avg. on willow is OK: OK - load average: 11.65, 14.93, 14.77 [04:54:33] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1150761.000000 [04:57:23] s1 replag on thyme is CRITICAL: QUERY CRITICAL: Unknown database enwiki_p [05:01:23] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [05:01:54] Load avg. on willow is WARNING: WARNING - load average: 20.87, 18.54, 16.29 [05:03:23] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [05:03:24] APT on yarrow is CRITICAL: APT CRITICAL: 4 packages available for upgrade (4 critical updates). [05:04:33] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [05:08:57] 3(updated) [ACCAPP-482] Tools for Wikimedia projects <10https://jira.toolserver.org/browse/ACCAPP-482> (IWorld Wikimedia) [05:10:57] 3(commented) [ACCAPP-482] Tools for Wikimedia projects <10https://jira.toolserver.org/browse/ACCAPP-482> (IWorld Wikimedia) [05:11:24] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [05:14:24] Sun Grid Engine execd on willow is WARNING: medium-sol@willow exceedes load threshold: alarm hl:np_load_short=2.062500/1.75, alarm hl:np_load_avg=2.340820/2.0, alarm hl:mem_free=182.000000M/350M, alarm hl:available=1/0: longrun-sol@willow exceedes load threshold: alarm hl:np_load_short=2.062500/1.9, alarm hl:np_load_long=2.210449/2.25, alarm hl:mem_free=182.000000M/200M, alarm hl:available=1/0 [05:18:24] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default [05:28:25] MySQL slave on thyme is WARNING: No slaves defined [05:49:43] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 125377 MB (20% inode=99%): [05:50:53] Load avg. on willow is CRITICAL: CRITICAL - load average: 26.95, 21.91, 20.18 [05:55:34] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1154422.000000 [05:57:24] s1 replag on thyme is CRITICAL: QUERY CRITICAL: Unknown database enwiki_p [06:02:24] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [06:03:23] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [06:04:24] APT on yarrow is CRITICAL: APT CRITICAL: 4 packages available for upgrade (4 critical updates). [06:04:34] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [06:12:23] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [06:14:55] Load avg. on willow is WARNING: WARNING - load average: 14.80, 17.70, 19.68 [06:15:24] Sun Grid Engine execd on willow is WARNING: medium-sol@willow exceedes load threshold: alarm hl:np_load_short=1.803223/1.75, alarm hl:np_load_avg=2.194336/2.0, alarm hl:mem_free=390.000000M/350M, alarm hl:available=1/0: longrun-sol@willow exceedes load threshold: alarm hl:np_load_short=1.803223/1.9, alarm hl:np_load_long=2.452148/2.25, alarm hl:mem_free=390.000000M/200M, alarm hl:available=1/0 [06:19:23] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default [06:28:23] MySQL slave on thyme is WARNING: No slaves defined [06:49:55] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 125234 MB (20% inode=99%): [06:52:54] /sql on ptolemy is OK: DISK OK - free space: /sql 253932 MB (42% inode=99%): [06:55:35] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1158026.000000 [06:57:34] s1 replag on thyme is CRITICAL: QUERY CRITICAL: Unknown database enwiki_p [07:02:34] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [07:03:34] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [07:04:34] APT on yarrow is CRITICAL: APT CRITICAL: 4 packages available for upgrade (4 critical updates). [07:04:43] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [07:12:33] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [07:15:13] Load avg. on willow is WARNING: WARNING - load average: 17.86, 17.75, 17.50 [07:15:33] Sun Grid Engine execd on willow is WARNING: medium-sol@willow exceedes load threshold: alarm hl:np_load_short=2.263672/1.75, alarm hl:np_load_avg=2.224609/2.0, alarm hl:mem_free=864.000000M/350M, alarm hl:available=1/0: longrun-sol@willow exceedes load threshold: alarm hl:np_load_short=2.263672/1.9, alarm hl:np_load_long=2.189941/2.25, alarm hl:mem_free=864.000000M/200M, alarm hl:available=1/0 [07:19:23] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default [07:28:33] MySQL slave on thyme is WARNING: No slaves defined [07:53:33] Sun Grid Engine execd on willow is OK: medium-sol@willow OK: longrun-sol@willow OK [07:55:44] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1161632.000000 [07:58:03] Load avg. on adenia is WARNING: WARNING - load average: 16.98, 11.03, 6.29 [07:58:34] s1 replag on thyme is CRITICAL: QUERY CRITICAL: Unknown database enwiki_p [08:00:34] Sun Grid Engine execd on willow is WARNING: medium-sol@willow exceedes load threshold: alarm hl:np_load_short=2.614746/1.75, alarm hl:np_load_avg=2.007812/2.0, alarm hl:mem_free=143.000000M/350M, alarm hl:available=1/0: longrun-sol@willow exceedes load threshold: alarm hl:np_load_short=2.614746/1.9, alarm hl:np_load_long=2.102539/2.25, alarm hl:mem_free=143.000000M/200M, alarm hl:available=1/0 [08:02:34] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [08:03:04] Load avg. on adenia is OK: OK - load average: 12.19, 12.96, 8.56 [08:03:43] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [08:04:55] APT on yarrow is CRITICAL: APT CRITICAL: 4 packages available for upgrade (4 critical updates). [08:04:56] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [08:07:42] [[Database access]] ! 10https://wiki.toolserver.org/w/index.php?diff=6982&oldid=6654&rcid=9190 * Tb * (+178) (/* C */ Expanding example slightly) [08:09:24] [[Database access]] ! 10https://wiki.toolserver.org/w/index.php?diff=6983&oldid=6982&rcid=9191 * Tb * (+56) (/* C */ Expand a little more) [08:12:54] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [08:13:43] RAID on adenia is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [08:15:14] Load avg. on willow is WARNING: WARNING - load average: 17.06, 18.02, 17.53 [08:19:55] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default [08:28:56] MySQL slave on thyme is WARNING: No slaves defined [08:32:55] Sun Grid Engine execd on willow is OK: medium-sol@willow OK: longrun-sol@willow OK [08:34:15] Load avg. on willow is OK: OK - load average: 9.43, 13.19, 14.90 [08:42:14] Load avg. on willow is WARNING: WARNING - load average: 15.38, 14.74, 14.73 [08:42:54] Sun Grid Engine execd on willow is WARNING: medium-sol@willow exceedes load threshold: alarm hl:np_load_short=1.916504/1.75, alarm hl:np_load_avg=1.852539/2.0, alarm hl:mem_free=324.000000M/350M, alarm hl:available=1/0: longrun-sol@willow exceedes load threshold: alarm hl:np_load_short=1.916504/1.9, alarm hl:np_load_long=1.845215/2.25, alarm hl:mem_free=324.000000M/200M, alarm hl:available=1/0 [08:46:13] Load avg. on willow is OK: OK - load average: 13.67, 14.85, 14.82 [08:55:54] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1165240.000000 [08:58:42] s1 replag on thyme is CRITICAL: QUERY CRITICAL: Unknown database enwiki_p [08:59:49] [[Special:Log/newusers]] create 10 * RheesDeboef * (New user account) [09:02:55] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [09:03:33] RAID on adenia is OK: OK - TOTAL: 2: FAILED: 0: DEGRADED: 0 [09:03:54] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [09:04:55] APT on yarrow is CRITICAL: APT CRITICAL: 4 packages available for upgrade (4 critical updates). [09:05:03] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [09:09:35] Load avg. on willow is WARNING: WARNING - load average: 14.74, 15.84, 16.10 [09:13:54] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [09:18:54] Sun Grid Engine execd on willow is OK: medium-sol@willow OK: longrun-sol@willow OK [09:19:54] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default [09:22:53] Sun Grid Engine execd on willow is WARNING: medium-sol@willow exceedes load threshold: alarm hl:np_load_short=1.900879/1.75, alarm hl:np_load_avg=2.055664/2.0, alarm hl:mem_free=408.000000M/350M, alarm hl:available=1/0: longrun-sol@willow exceedes load threshold: alarm hl:np_load_short=1.900879/1.9, alarm hl:np_load_long=2.059570/2.25, alarm hl:mem_free=408.000000M/200M, alarm hl:available=1/0 [09:29:54] MySQL slave on thyme is WARNING: No slaves defined [09:30:34] Load avg. on willow is CRITICAL: CRITICAL - load average: 46.39, 24.27, 19.33 [09:32:34] Load avg. on willow is WARNING: WARNING - load average: 26.46, 24.11, 19.89 [09:56:04] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1168853.000000 [09:58:53] s1 replag on thyme is CRITICAL: QUERY CRITICAL: Unknown database enwiki_p [10:03:04] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [10:04:03] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [10:05:15] APT on yarrow is CRITICAL: APT CRITICAL: 4 packages available for upgrade (4 critical updates). [10:05:15] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [10:10:34] Load avg. on willow is CRITICAL: CRITICAL - load average: 33.04, 22.02, 18.69 [10:11:33] Load avg. on willow is WARNING: WARNING - load average: 21.02, 20.75, 18.46 [10:14:14] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [10:20:13] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default [10:20:13] Sun Grid Engine execd on willow is OK: medium-sol@willow OK: longrun-sol@willow OK [10:28:43] RAID on adenia is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [10:29:54] MySQL slave on thyme is WARNING: No slaves defined [10:30:14] Sun Grid Engine execd on willow is WARNING: medium-sol@willow exceedes load threshold: alarm hl:np_load_short=2.104980/1.75, alarm hl:np_load_avg=1.881836/2.0, alarm hl:mem_free=536.000000M/350M, alarm hl:available=1/0: longrun-sol@willow exceedes load threshold: alarm hl:np_load_short=2.104980/1.9, alarm hl:np_load_long=1.968750/2.25, alarm hl:mem_free=536.000000M/200M, alarm hl:available=1/0 [10:30:33] Load avg. on willow is CRITICAL: CRITICAL - load average: 40.76, 20.94, 17.74 [10:31:34] Load avg. on willow is WARNING: WARNING - load average: 23.39, 19.57, 17.46 [10:35:14] Sun Grid Engine execd on willow is OK: medium-sol@willow OK: longrun-sol@willow OK [10:47:45] Load avg. on willow is OK: OK - load average: 11.40, 13.57, 14.91 [10:53:14] RAID on adenia is OK: OK - TOTAL: 2: FAILED: 0: DEGRADED: 0 [10:54:44] Load avg. on willow is WARNING: WARNING - load average: 16.04, 14.85, 14.95 [10:56:03] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1172456.000000 [10:58:54] s1 replag on thyme is CRITICAL: QUERY CRITICAL: Unknown database enwiki_p [11:00:45] Load avg. on willow is CRITICAL: CRITICAL - load average: 37.07, 21.84, 17.73 [11:03:13] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [11:03:54] 3(commented) [ACCAPP-468] Rcsprinter <10https://jira.toolserver.org/browse/ACCAPP-468> (David Moon) [11:04:15] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [11:05:16] APT on yarrow is CRITICAL: APT CRITICAL: 4 packages available for upgrade (4 critical updates). [11:05:26] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [11:10:17] Sun Grid Engine execd on willow is WARNING: medium-sol@willow exceedes load threshold: alarm hl:np_load_short=2.210449/1.75, alarm hl:np_load_avg=2.309570/2.0, alarm hl:mem_free=189.000000M/350M, alarm hl:available=1/0: longrun-sol@willow exceedes load threshold: alarm hl:np_load_short=2.210449/1.9, alarm hl:np_load_long=2.197754/2.25, alarm hl:mem_free=189.000000M/200M, alarm hl:available=1/0 [11:11:42] @replag [11:11:43] closedmouth: s1-rr-a: 1w 6d 13h 56m 39s [+1.00 s/s]; s1-user: 1w 6d 13h 56m 39s [+1.00 s/s] [11:14:18] Sun Grid Engine execd on ortelius is WARNING: short-sol@ortelius exceedes load threshold: alarm hl:np_load_short=1.210938/1.10, alarm hl:np_load_long=0.818360/1.55, alarm hl:mem_free=20639.000000M/300M, alarm hl:available=1/0: medium-sol@ortelius exceedes load threshold: alarm hl:np_load_short=1.210938/1.00, alarm hl:np_load_long=0.818360/1.50, alarm hl:mem_free=20639.000000M/350M, alarm hl:available=1/0 [11:14:27] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [11:15:16] Sun Grid Engine execd on ortelius is OK: short-sol@ortelius OK: medium-sol@ortelius OK [11:15:48] hello all [11:20:17] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default [11:20:36] Load avg. on willow is WARNING: WARNING - load average: 17.53, 17.30, 17.47 [11:24:16] Sun Grid Engine execd on willow is OK: medium-sol@willow OK: longrun-sol@willow OK [11:27:48] hi DaBPunkt [11:28:09] how's the importing progress? [11:30:02] slowly [11:30:06] MySQL slave on thyme is WARNING: No slaves defined [11:30:16] Sun Grid Engine execd on willow is WARNING: medium-sol@willow exceedes load threshold: alarm hl:np_load_short=1.935059/1.75, alarm hl:np_load_avg=1.875000/2.0, alarm hl:mem_free=474.000000M/350M, alarm hl:available=1/0: longrun-sol@willow exceedes load threshold: alarm hl:np_load_short=1.935059/1.9, alarm hl:np_load_long=1.998535/2.25, alarm hl:mem_free=474.000000M/200M, alarm hl:available=1/0 [11:43:17] Sun Grid Engine execd on willow is OK: medium-sol@willow OK: longrun-sol@willow OK [11:56:16] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1176062.000000 [11:59:06] s1 replag on thyme is CRITICAL: QUERY CRITICAL: Unknown database enwiki_p [12:00:36] Load avg. on willow is CRITICAL: CRITICAL - load average: 34.41, 21.34, 18.47 [12:01:37] Load avg. on willow is WARNING: WARNING - load average: 23.83, 20.74, 18.45 [12:03:17] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [12:04:17] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [12:05:16] APT on yarrow is CRITICAL: APT CRITICAL: 4 packages available for upgrade (4 critical updates). [12:05:16] Sun Grid Engine execd on willow is WARNING: medium-sol@willow exceedes load threshold: alarm hl:np_load_short=2.135742/1.75, alarm hl:np_load_avg=2.375977/2.0, alarm hl:mem_free=194.000000M/350M, alarm hl:available=1/0: longrun-sol@willow exceedes load threshold: alarm hl:np_load_short=2.135742/1.9, alarm hl:np_load_long=2.274902/2.25, alarm hl:mem_free=194.000000M/200M, alarm hl:available=1/0 [12:05:25] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [12:10:36] Load avg. on willow is CRITICAL: CRITICAL - load average: 30.38, 20.87, 18.91 [12:15:17] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [12:20:17] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default [12:25:55] [[Cheap memory foam mattress topper is really comfortable]] !N 10https://wiki.toolserver.org/w/index.php?oldid=6984&rcid=9193 * RheesDeboef * (+3826) (Created page with "Chances are which you initial rested on a "Swedish" style mattress, also identified as memory foam mattress, throughout certainly one of your buying sprees in the nearby mall. On...") [12:27:17] Sun Grid Engine execd on willow is OK: medium-sol@willow OK: longrun-sol@willow OK [12:30:06] MySQL slave on thyme is WARNING: No slaves defined [12:30:35] Load avg. on willow is WARNING: WARNING - load average: 19.66, 14.84, 16.76 [12:33:16] Sun Grid Engine execd on willow is WARNING: medium-sol@willow exceedes load threshold: alarm hl:np_load_short=1.571289/1.75, alarm hl:np_load_avg=1.666504/2.0, alarm hl:mem_free=309.000000M/350M, alarm hl:available=1/0 [12:34:16] Sun Grid Engine execd on willow is OK: medium-sol@willow OK: longrun-sol@willow OK [12:37:36] Load avg. on willow is OK: OK - load average: 9.66, 12.65, 15.00 [12:43:47] RAID on adenia is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [12:52:00] [[Special:Log/delete]] delete 10 * Dab * (deleted "[[02Cheap memory foam mattress topper is really comfortable10]]": SPAM) [12:52:29] [[Special:Log/block]] block 10 * Dab * (blocked [[02User:RheesDeboef10]] with an expiry time of infinite (account creation disabled): Spamming) [12:56:17] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1179663.000000 [12:59:06] s1 replag on thyme is CRITICAL: QUERY CRITICAL: Unknown database enwiki_p [13:01:37] Load avg. on willow is WARNING: WARNING - load average: 22.13, 18.00, 15.47 [13:03:17] RAID on adenia is OK: OK - TOTAL: 2: FAILED: 0: DEGRADED: 0 [13:03:28] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [13:04:30] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [13:05:28] APT on yarrow is CRITICAL: APT CRITICAL: 4 packages available for upgrade (4 critical updates). [13:05:47] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [13:09:47] Load avg. on willow is OK: OK - load average: 13.15, 14.87, 14.94 [13:12:47] Load avg. on willow is WARNING: WARNING - load average: 15.75, 15.53, 15.22 [13:15:25] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [13:16:26] Sun Grid Engine execd on ortelius is WARNING: short-sol@ortelius exceedes load threshold: alarm hl:np_load_short=1.315430/1.10, alarm hl:np_load_long=0.750977/1.55, alarm hl:mem_free=19770.000000M/300M, alarm hl:available=1/0: medium-sol@ortelius exceedes load threshold: alarm hl:np_load_short=1.315430/1.00, alarm hl:np_load_long=0.750977/1.50, alarm hl:mem_free=19770.000000M/350M, alarm hl:available=1/0 [13:20:17] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default [13:21:27] Sun Grid Engine execd on ortelius is OK: short-sol@ortelius OK: medium-sol@ortelius OK [13:22:48] Load avg. on willow is OK: OK - load average: 9.11, 13.72, 14.81 [13:24:26] Sun Grid Engine execd on ortelius is WARNING: short-sol@ortelius exceedes load threshold: alarm hl:np_load_short=1.106445/1.10, alarm hl:np_load_long=0.928711/1.55, alarm hl:mem_free=19796.000000M/300M, alarm hl:available=1/0: medium-sol@ortelius exceedes load threshold: alarm hl:np_load_short=1.106445/1.00, alarm hl:np_load_long=0.928711/1.50, alarm hl:mem_free=19796.000000M/350M, alarm hl:available=1/0 [13:30:17] MySQL slave on thyme is WARNING: No slaves defined [13:38:56] 3(commented) [UTRS-92] Appeal in backlog when closed <10https://jira.toolserver.org/browse/UTRS-92> (Chris Howie) [13:41:57] DaBPunkt: there are again enwikt dumps in user store root :-/ [13:43:53] 3(resolved) [DBQ-178] Statistics about abuse filters on all Wikimedia projects <10https://jira.toolserver.org/browse/DBQ-178> (Hoo man) [13:56:17] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1183265.000000 [13:58:47] RAID on adenia is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [13:59:16] s1 replag on thyme is CRITICAL: QUERY CRITICAL: Unknown database enwiki_p [14:00:01] @replag [14:00:01] DaBPunkt: s1-rr-a: 1w 6d 16h 44m 57s [+1.00 s/s]; s1-user: 1w 6d 16h 44m 57s [+1.00 s/s] [14:01:55] 3(commented) [ACCAPP-481] I am active user in http://fa.wiktionary.org and i want this account to run bot on this wiki also updating it's statics. <10https://jira.toolserver.org/browse/ACCAPP-481> (Darafsh Kaviyani) [14:02:48] Load avg. on willow is WARNING: WARNING - load average: 16.71, 17.24, 15.20 [14:03:37] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [14:04:37] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [14:05:36] APT on yarrow is CRITICAL: APT CRITICAL: 4 packages available for upgrade (4 critical updates). [14:05:57] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [14:15:37] Sun Grid Engine execd on willow is WARNING: medium-sol@willow exceedes load threshold: alarm hl:np_load_short=2.087891/1.75, alarm hl:np_load_avg=1.943359/2.0, alarm hl:mem_free=195.000000M/350M, alarm hl:available=1/0: longrun-sol@willow exceedes load threshold: alarm hl:np_load_short=2.087891/1.9, alarm hl:np_load_long=1.930176/2.25, alarm hl:mem_free=195.000000M/200M, alarm hl:available=1/0 [14:15:37] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [14:16:31] Danny_B|backup: I deleted the dumps and disabled the download-script; have left a messsage there too. [14:16:44] thanks [14:18:58] Load avg. on willow is OK: OK - load average: 9.55, 13.61, 14.78 [14:20:27] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default [14:27:36] Sun Grid Engine execd on willow is OK: medium-sol@willow OK: longrun-sol@willow OK [14:28:52] 3(created) [MNT-1228] s6 became correupt, needs re-import; Maintenance; Minor work <10https://jira.toolserver.org/browse/MNT-1228> (DaB.) [14:30:27] MySQL slave on thyme is WARNING: No slaves defined [14:32:40] Sun Grid Engine execd on willow is WARNING: medium-sol@willow exceedes load threshold: alarm hl:np_load_short=1.801758/1.75, alarm hl:np_load_avg=1.873535/2.0, alarm hl:mem_free=313.000000M/350M, alarm hl:available=1/0 [14:38:57] Load avg. on willow is WARNING: WARNING - load average: 15.66, 15.27, 14.82 [14:43:56] Load avg. on willow is OK: OK - load average: 10.68, 14.40, 14.80 [14:44:39] Sun Grid Engine execd on ortelius is WARNING: short-sol@ortelius exceedes load threshold: alarm hl:np_load_short=1.276367/1.10, alarm hl:np_load_long=0.803711/1.55, alarm hl:mem_free=19880.000000M/300M, alarm hl:available=1/0: medium-sol@ortelius exceedes load threshold: alarm hl:np_load_short=1.276367/1.00, alarm hl:np_load_long=0.803711/1.50, alarm hl:mem_free=19880.000000M/350M, alarm hl:available=1/0 [14:46:37] Sun Grid Engine execd on ortelius is OK: short-sol@ortelius OK: medium-sol@ortelius OK [14:47:56] Load avg. on willow is WARNING: WARNING - load average: 20.30, 17.24, 15.86 [14:49:38] @replag [14:49:39] Thehelpfulone: s1-rr-a: 1w 6d 17h 34m 35s [+1.00 s/s]; s1-user: 1w 6d 17h 34m 35s [+1.00 s/s]; s2-user: 9m 52s [+0.01 s/s] [14:56:27] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1186876.000000 [14:59:27] s1 replag on thyme is CRITICAL: QUERY CRITICAL: Unknown database enwiki_p [15:03:38] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [15:04:37] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [15:05:37] APT on yarrow is CRITICAL: APT CRITICAL: 4 packages available for upgrade (4 critical updates). [15:06:16] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [15:11:37] Sun Grid Engine execd on ortelius is WARNING: short-sol@ortelius exceedes load threshold: alarm hl:np_load_short=1.210938/1.10, alarm hl:np_load_long=0.901367/1.55, alarm hl:mem_free=19591.000000M/300M, alarm hl:available=1/0: medium-sol@ortelius exceedes load threshold: alarm hl:np_load_short=1.210938/1.00, alarm hl:np_load_long=0.901367/1.50, alarm hl:mem_free=19591.000000M/350M, alarm hl:available=1/0 [15:15:37] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [15:17:37] Sun Grid Engine execd on ortelius is OK: short-sol@ortelius OK: medium-sol@ortelius OK [15:20:28] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default [15:24:02] Danny B. * [Toolserver-l] Is there an alternative to the tool server ran article assessments? [15:26:37] Sun Grid Engine execd on willow is OK: medium-sol@willow OK: longrun-sol@willow OK [15:29:37] Sun Grid Engine execd on willow is WARNING: medium-sol@willow exceedes load threshold: alarm hl:np_load_short=1.851562/1.75, alarm hl:np_load_avg=1.843262/2.0, alarm hl:mem_free=258.000000M/350M, alarm hl:available=1/0 [15:30:26] MySQL slave on thyme is WARNING: No slaves defined [15:33:37] Sun Grid Engine execd on ortelius is WARNING: short-sol@ortelius exceedes load threshold: alarm hl:np_load_short=1.490234/1.10, alarm hl:np_load_long=1.023438/1.55, alarm hl:mem_free=19825.000000M/300M, alarm hl:available=1/0: medium-sol@ortelius exceedes load threshold: alarm hl:np_load_short=1.490234/1.00, alarm hl:np_load_long=1.023438/1.50, alarm hl:mem_free=19825.000000M/350M, alarm hl:available=1/0 [15:36:37] Sun Grid Engine execd on ortelius is OK: short-sol@ortelius OK: medium-sol@ortelius OK [15:41:56] 3(updated) [MNT-1228] s6 became corrupt, needs re-import <10https://jira.toolserver.org/browse/MNT-1228> (DaB.) [15:48:17] Load avg. on willow is WARNING: WARNING - load average: 13.64, 16.16, 16.32 [15:49:37] Sun Grid Engine execd on willow is OK: medium-sol@willow OK: longrun-sol@willow OK [15:52:37] Sun Grid Engine execd on willow is WARNING: medium-sol@willow exceedes load threshold: alarm hl:np_load_short=1.770996/1.75, alarm hl:np_load_avg=1.942871/2.0, alarm hl:mem_free=344.000000M/350M, alarm hl:available=1/0 [15:56:27] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1190475.000000 [15:59:28] s1 replag on thyme is CRITICAL: QUERY CRITICAL: Unknown database enwiki_p [16:00:02] DaB. * Re: [Toolserver-l] Is there an alternative to the tool server ran article assessments? [16:04:47] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [16:04:48] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [16:05:46] APT on yarrow is CRITICAL: APT CRITICAL: 4 packages available for upgrade (4 critical updates). [16:06:28] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [16:06:37] /sql on rosemary is WARNING: DISK WARNING - free space: /sql 117603 MB (12% inode=99%): [16:08:46] APT on yarrow is OK: APT OK: 0 packages available for upgrade (0 critical updates). [16:08:52] 3(commented) [ACCAPP-468] Rcsprinter <10https://jira.toolserver.org/browse/ACCAPP-468> (DaB.) [16:12:17] s4 replag on cassia is WARNING: QUERY WARNING: SELECT ts_rc_age() returned 1934.000000 [16:15:47] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [16:20:27] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default [16:23:47] Sun Grid Engine execd on ortelius is WARNING: short-sol@ortelius exceedes load threshold: alarm hl:np_load_short=1.985351/1.10, alarm hl:np_load_long=0.911133/1.55, alarm hl:mem_free=19968.000000M/300M, alarm hl:available=1/0: medium-sol@ortelius exceedes load threshold: alarm hl:np_load_short=1.985351/1.00, alarm hl:np_load_long=0.911133/1.50, alarm hl:mem_free=19968.000000M/350M, alarm hl:available=1/0 [16:25:31] [[Special:Log/newusers]] create 10 * Mikaxr27 * (New user account) [16:27:46] Sun Grid Engine execd on ortelius is OK: short-sol@ortelius OK: medium-sol@ortelius OK [16:30:27] MySQL slave on thyme is WARNING: No slaves defined [16:32:46] Sun Grid Engine execd on ortelius is WARNING: medium-sol@ortelius exceedes load threshold: alarm hl:np_load_short=1.013672/1.00, alarm hl:np_load_long=0.966797/1.50, alarm hl:mem_free=19083.000000M/350M, alarm hl:available=1/0 [16:32:46] Sun Grid Engine execd on willow is OK: medium-sol@willow OK: longrun-sol@willow OK [16:34:17] Load avg. on willow is OK: OK - load average: 12.45, 13.95, 14.88 [16:42:47] Sun Grid Engine execd on willow is WARNING: medium-sol@willow exceedes load threshold: alarm hl:np_load_short=1.777832/1.75, alarm hl:np_load_avg=1.765625/2.0, alarm hl:mem_free=731.000000M/350M, alarm hl:available=1/0 [16:46:16] Load avg. on willow is WARNING: WARNING - load average: 18.16, 16.14, 15.14 [16:53:47] Sun Grid Engine execd on willow is OK: medium-sol@willow OK: longrun-sol@willow OK [16:54:17] Load avg. on willow is OK: OK - load average: 13.51, 14.73, 14.92 [16:56:27] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1194076.000000 [17:00:27] s1 replag on thyme is CRITICAL: QUERY CRITICAL: Unknown database enwiki_p [17:00:47] Sun Grid Engine execd on willow is WARNING: medium-sol@willow exceedes load threshold: alarm hl:np_load_short=3.622559/1.75, alarm hl:np_load_avg=2.212402/2.0, alarm hl:mem_free=215.000000M/350M, alarm hl:available=1/0: longrun-sol@willow exceedes load threshold: alarm hl:np_load_short=3.622559/1.9, alarm hl:np_load_long=1.974121/2.25, alarm hl:mem_free=215.000000M/200M, alarm hl:available=1/0 [17:03:16] s4 replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 3607.000000 [17:04:50] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [17:04:50] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [17:06:39] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [17:13:50] Sun Grid Engine execd on willow is OK: medium-sol@willow OK: longrun-sol@willow OK [17:15:51] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [17:17:31] Load avg. on willow is WARNING: WARNING - load average: 12.47, 13.53, 15.02 [17:20:51] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default [17:22:30] Load avg. on willow is OK: OK - load average: 11.25, 13.64, 14.78 [17:27:29] Load avg. on willow is WARNING: WARNING - load average: 15.43, 14.90, 14.98 [17:28:30] Load avg. on willow is OK: OK - load average: 13.07, 14.33, 14.77 [17:30:30] MySQL slave on thyme is WARNING: No slaves defined [17:42:57] [[Comparison of osm2pgsql and osmosis for GeoShape]] ! 10https://wiki.toolserver.org/w/index.php?diff=6985&oldid=6842&rcid=9197 * 84.112.160.35 * (+202) (/* Osm2pgsql tables */ ) [17:49:44] [[Comparison of osm2pgsql and osmosis for GeoShape]] ! 10https://wiki.toolserver.org/w/index.php?diff=6986&oldid=6985&rcid=9198 * 84.112.160.35 * (+13) (/* Osm2pgsql tables */ ) [17:56:49] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1197696.000000 [18:00:29] s1 replag on thyme is CRITICAL: QUERY CRITICAL: Unknown database enwiki_p [18:03:39] s4 replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 5452.000000 [18:04:00] Sun Grid Engine execd on ortelius is WARNING: medium-sol@ortelius exceedes load threshold: alarm hl:np_load_short=1.014649/1.00, alarm hl:np_load_long=0.893555/1.50, alarm hl:mem_free=19546.000000M/350M, alarm hl:available=1/0 [18:05:00] Sun Grid Engine execd on ortelius is OK: short-sol@ortelius OK: medium-sol@ortelius OK [18:05:01] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [18:05:01] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [18:06:59] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [18:16:07] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [18:20:58] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default [18:30:58] MySQL slave on thyme is WARNING: No slaves defined [18:43:07] Sun Grid Engine execd on ortelius is WARNING: short-sol@ortelius exceedes load threshold: alarm hl:np_load_short=1.292969/1.10, alarm hl:np_load_long=1.001953/1.55, alarm hl:mem_free=20000.000000M/300M, alarm hl:available=1/0: medium-sol@ortelius exceedes load threshold: alarm hl:np_load_short=1.292969/1.00, alarm hl:np_load_long=1.001953/1.50, alarm hl:mem_free=20000.000000M/350M, alarm hl:available=1/0 [18:46:08] Sun Grid Engine execd on ortelius is OK: short-sol@ortelius OK: medium-sol@ortelius OK [18:56:58] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1201307.000000 [19:01:00] s1 replag on thyme is CRITICAL: QUERY CRITICAL: Unknown database enwiki_p [19:04:09] s4 replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 4364.000000 [19:05:08] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [19:05:09] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [19:07:17] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [19:16:08] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [19:21:08] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default [19:23:08] Sun Grid Engine execd on ortelius is WARNING: short-sol@ortelius exceedes load threshold: alarm hl:np_load_short=1.122070/1.10, alarm hl:np_load_long=0.829102/1.55, alarm hl:mem_free=19877.000000M/300M, alarm hl:available=1/0: medium-sol@ortelius exceedes load threshold: alarm hl:np_load_short=1.122070/1.00, alarm hl:np_load_long=0.829102/1.50, alarm hl:mem_free=19877.000000M/350M, alarm hl:available=1/0 [19:24:09] Sun Grid Engine execd on ortelius is OK: short-sol@ortelius OK: medium-sol@ortelius OK [19:25:58] Load avg. on willow is WARNING: WARNING - load average: 16.22, 15.38, 15.95 [19:31:57] MySQL slave on thyme is WARNING: No slaves defined [19:45:18] Sun Grid Engine execd on ortelius is WARNING: short-sol@ortelius exceedes load threshold: alarm hl:np_load_short=1.274414/1.10, alarm hl:np_load_long=0.849610/1.55, alarm hl:mem_free=20044.000000M/300M, alarm hl:available=1/0: medium-sol@ortelius exceedes load threshold: alarm hl:np_load_short=1.274414/1.00, alarm hl:np_load_long=0.849610/1.50, alarm hl:mem_free=20044.000000M/350M, alarm hl:available=1/0 [19:46:18] Sun Grid Engine execd on ortelius is OK: short-sol@ortelius OK: medium-sol@ortelius OK [19:47:18] Sun Grid Engine execd on willow is WARNING: medium-sol@willow exceedes load threshold: alarm hl:np_load_short=2.322266/1.75, alarm hl:np_load_avg=2.213867/2.0, alarm hl:mem_free=326.000000M/350M, alarm hl:available=1/0: longrun-sol@willow exceedes load threshold: alarm hl:np_load_short=2.322266/1.9, alarm hl:np_load_long=2.105469/2.25, alarm hl:mem_free=326.000000M/200M, alarm hl:available=1/0 [19:49:53] 3(updated) [ACCAPP-484] Account activation for user celicni for Wikimedia projects <10https://jira.toolserver.org/browse/ACCAPP-484> (Goran Obradovic) [19:54:18] Sun Grid Engine execd on willow is OK: medium-sol@willow OK: longrun-sol@willow OK [19:57:58] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1204971.000000 [19:58:17] Sun Grid Engine execd on willow is WARNING: medium-sol@willow exceedes load threshold: alarm hl:np_load_short=1.946289/1.75, alarm hl:np_load_avg=2.007324/2.0, alarm hl:mem_free=568.000000M/350M, alarm hl:available=1/0: longrun-sol@willow exceedes load threshold: alarm hl:np_load_short=1.946289/1.9, alarm hl:np_load_long=2.054688/2.25, alarm hl:mem_free=568.000000M/200M, alarm hl:available=1/0 [20:01:57] s1 replag on thyme is CRITICAL: QUERY CRITICAL: Unknown database enwiki_p [20:04:18] s4 replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 5318.000000 [20:05:18] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [20:05:18] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [20:07:27] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [20:13:47] RAID on adenia is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [20:16:17] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [20:17:18] Sun Grid Engine execd on willow is OK: medium-sol@willow OK: longrun-sol@willow OK [20:20:17] Sun Grid Engine execd on willow is WARNING: medium-sol@willow exceedes load threshold: alarm hl:np_load_short=1.217285/1.75, alarm hl:np_load_avg=1.604004/2.0, alarm hl:mem_free=252.000000M/350M, alarm hl:available=1/0 [20:21:18] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default [20:22:57] Load avg. on willow is OK: OK - load average: 11.50, 12.82, 14.80 [20:32:57] MySQL slave on thyme is WARNING: No slaves defined [20:33:18] Sun Grid Engine execd on willow is OK: medium-sol@willow OK: longrun-sol@willow OK [20:42:57] 3(assigned) [MNT-1228] s6 became corrupt, needs re-import <10https://jira.toolserver.org/browse/MNT-1228> (Marlen Caemmerer) [20:48:00] 3(commented) [MNT-1228] s6 became corrupt, needs re-import <10https://jira.toolserver.org/browse/MNT-1228> (Marlen Caemmerer) [20:48:37] RAID on adenia is OK: OK - TOTAL: 2: FAILED: 0: DEGRADED: 0 [20:54:17] Sun Grid Engine execd on willow is WARNING: medium-sol@willow exceedes load threshold: alarm hl:np_load_short=1.319336/1.75, alarm hl:np_load_avg=1.402344/2.0, alarm hl:mem_free=307.000000M/350M, alarm hl:available=1/0 [20:58:07] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1208573.000000 [21:01:58] s1 replag on thyme is CRITICAL: QUERY CRITICAL: Unknown database enwiki_p [21:03:47] RAID on adenia is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [21:04:20] s4 replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 7048.000000 [21:05:20] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [21:05:20] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [21:07:47] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [21:10:20] Sun Grid Engine execd on willow is OK: medium-sol@willow OK: longrun-sol@willow OK [21:13:19] Sun Grid Engine execd on willow is WARNING: medium-sol@willow exceedes load threshold: alarm hl:np_load_short=1.400879/1.75, alarm hl:np_load_avg=1.736816/2.0, alarm hl:mem_free=280.000000M/350M, alarm hl:available=1/0 [21:16:27] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [21:21:19] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default [21:23:02] DaB. * [Toolserver-announce] Corruption of s6 and (short) downtime of s6 tomorrow (Tuesday) [21:32:57] MySQL slave on thyme is WARNING: No slaves defined [21:32:58] Load avg. on willow is WARNING: WARNING - load average: 15.02, 15.59, 14.07 [21:33:58] Load avg. on willow is OK: OK - load average: 13.12, 14.93, 13.93 [21:56:49] DaBPunkt: about? [21:56:59] about? [21:57:11] that means are you around :) [21:57:15] can you have a look at https://jira.toolserver.org/browse/ACCAPP-485 please? [21:58:02] DaB. * Re: [Toolserver-announce] Corruption of s6 and (short) downtime of s6 tomorrow (Tuesday) [21:58:19] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1212185.000000 [21:59:22] Thehelpfulone: that's the unblock-MMP, isn't it? [21:59:26] yep [22:01:57] s1 replag on thyme is CRITICAL: QUERY CRITICAL: Unknown database enwiki_p [22:04:29] s4 replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 8198.000000 [22:05:28] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [22:05:29] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [22:07:57] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [22:11:07] Load avg. on willow is WARNING: WARNING - load average: 20.51, 16.79, 14.55 [22:15:07] Load avg. on willow is OK: OK - load average: 13.52, 14.78, 14.20 [22:16:27] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [22:16:28] Sun Grid Engine execd on willow is WARNING: medium-sol@willow exceedes load threshold: alarm hl:np_load_short=2.428223/1.75, alarm hl:np_load_avg=2.090820/2.0, alarm hl:mem_free=896.000000M/350M, alarm hl:available=1/0: longrun-sol@willow exceedes load threshold: alarm hl:np_load_short=2.428223/1.9, alarm hl:np_load_long=1.873047/2.25, alarm hl:mem_free=896.000000M/200M, alarm hl:available=1/0 [22:18:08] Load avg. on willow is WARNING: WARNING - load average: 15.05, 16.05, 14.91 [22:19:27] Sun Grid Engine execd on willow is OK: medium-sol@willow OK: longrun-sol@willow OK [22:21:28] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default [22:22:54] 3(resolved) [UTRS-88] Display IP address in all cases when user does not have an account <10https://jira.toolserver.org/browse/UTRS-88> (TParis) [22:24:56] 3(resolved) [UTRS-85] "void()" is not valid JavaScript <10https://jira.toolserver.org/browse/UTRS-85> (TParis) [22:26:04] nacht ts [22:26:54] 3(resolved) [UTRS-72] Order of log <10https://jira.toolserver.org/browse/UTRS-72> (TParis) [22:26:56] 3(work started) [UTRS-77] Link to a user's appeal history <10https://jira.toolserver.org/browse/UTRS-77> (TParis) [22:26:57] 3(resolved) [UTRS-74] Email template <10https://jira.toolserver.org/browse/UTRS-74> (TParis) [22:30:27] Sun Grid Engine execd on willow is WARNING: medium-sol@willow exceedes load threshold: alarm hl:np_load_short=2.080078/1.75, alarm hl:np_load_avg=1.796875/2.0, alarm hl:mem_free=135.000000M/350M, alarm hl:available=1/0: longrun-sol@willow exceedes load threshold: alarm hl:np_load_short=2.080078/1.9, alarm hl:np_load_long=1.788574/2.25, alarm hl:mem_free=135.000000M/200M, alarm hl:available=1/0 [22:33:07] MySQL slave on thyme is WARNING: No slaves defined [22:43:06] Load avg. on willow is WARNING: WARNING - load average: 15.93, 14.30, 13.75 [22:50:07] Load avg. on willow is OK: OK - load average: 14.04, 14.98, 14.47 [22:52:38] Sun Grid Engine execd on willow is OK: medium-sol@willow OK: longrun-sol@willow OK [22:56:37] Sun Grid Engine execd on willow is WARNING: medium-sol@willow exceedes load threshold: alarm hl:np_load_short=1.307617/1.75, alarm hl:np_load_avg=1.530274/2.0, alarm hl:mem_free=264.000000M/350M, alarm hl:available=1/0 [22:59:19] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1215846.000000 [23:00:52] 3(resolved) [UTRS-77] Link to a user's appeal history <10https://jira.toolserver.org/browse/UTRS-77> (TParis) [23:01:57] s1 replag on thyme is CRITICAL: QUERY CRITICAL: Unknown database enwiki_p [23:03:38] Sun Grid Engine execd on ortelius is WARNING: short-sol@ortelius exceedes load threshold: alarm hl:np_load_short=2.631836/1.10, alarm hl:np_load_long=1.081055/1.55, alarm hl:mem_free=20514.000000M/300M, alarm hl:available=1/0: medium-sol@ortelius exceedes load threshold: alarm hl:np_load_short=2.631836/1.00, alarm hl:np_load_long=1.081055/1.50, alarm hl:mem_free=20514.000000M/350M, alarm hl:available=1/0 [23:04:28] s4 replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 8078.000000 [23:05:37] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [23:05:37] Sun Grid Engine execd on ortelius is OK: short-sol@ortelius OK: medium-sol@ortelius OK [23:05:38] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [23:07:57] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [23:13:06] Load avg. on willow is WARNING: WARNING - load average: 17.96, 15.27, 14.54 [23:16:38] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [23:20:07] Load avg. on willow is OK: OK - load average: 10.64, 14.64, 14.82 [23:22:27] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default [23:28:54] 3(assigned) [UTRS-84] New form field for blockee to fill: "Why were you blocked?" <10https://jira.toolserver.org/browse/UTRS-84> (TParis) [23:31:00] 3(assigned) [UTRS-91] Line breaks in the template view interface aren't shown <10https://jira.toolserver.org/browse/UTRS-91> (TParis) [23:31:02] 3(resolved) [UTRS-91] Line breaks in the template view interface aren't shown <10https://jira.toolserver.org/browse/UTRS-91> (TParis) [23:31:03] 3(assigned) [UTRS-84] New form field for blockee to fill: "Why were you blocked?" <10https://jira.toolserver.org/browse/UTRS-84> (TParis) [23:32:38] Sun Grid Engine execd on willow is OK: medium-sol@willow OK: longrun-sol@willow OK [23:33:07] MySQL slave on thyme is WARNING: No slaves defined [23:35:38] Sun Grid Engine execd on willow is WARNING: medium-sol@willow exceedes load threshold: alarm hl:np_load_short=1.307129/1.75, alarm hl:np_load_avg=1.445312/2.0, alarm hl:mem_free=253.000000M/350M, alarm hl:available=1/0 [23:42:54] 3(resolved) [UTRS-86] The double-quote character is not HTML-encoded in JavaScript HTML attributes <10https://jira.toolserver.org/browse/UTRS-86> (TParis) [23:42:58] 3(assigned) [UTRS-86] The double-quote character is not HTML-encoded in JavaScript HTML attributes <10https://jira.toolserver.org/browse/UTRS-86> (TParis) [23:47:37] Sun Grid Engine execd on willow is OK: medium-sol@willow OK: longrun-sol@willow OK