[00:00:42] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [00:01:41] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default [00:03:42] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [00:03:42] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [00:04:50] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [00:22:43] Sun Grid Engine execd on willow is WARNING: medium-sol@willow exceedes load threshold: alarm hl:np_load_short=1.129883/1.8, alarm hl:np_load_avg=1.262207/2.3, alarm hl:mem_free=189.000000M/300M, alarm hl:available=1/0: longrun-sol@willow exceedes load threshold: alarm hl:np_load_short=1.129883/1.9, alarm hl:np_load_long=1.339844/2.25, alarm hl:mem_free=189.000000M/200M, alarm hl:available=1/0 [00:24:29] fisheye.toolserver.org on web.amaranth is CRITICAL: CRITICAL - Socket timeout after 21 seconds [00:26:41] Sun Grid Engine execd on willow is OK: medium-sol@willow OK: longrun-sol@willow OK [00:29:41] Sun Grid Engine execd on willow is WARNING: medium-sol@willow exceedes load threshold: alarm hl:np_load_short=0.821777/1.8, alarm hl:np_load_avg=0.963379/2.3, alarm hl:mem_free=248.000000M/300M, alarm hl:available=1/0 [00:31:56] RAID on adenia is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [00:35:03] Sun Grid Engine execd on willow is OK: medium-sol@willow OK: longrun-sol@willow OK [00:37:18] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 271322.000000 [00:38:18] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 271384.000000 [00:56:46] RAID on adenia is OK: OK - TOTAL: 2: FAILED: 0: DEGRADED: 0 [01:00:54] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [01:02:34] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default [01:03:54] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [01:04:20] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [01:05:35] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [01:24:54] fisheye.toolserver.org on web.amaranth is CRITICAL: CRITICAL - Socket timeout after 21 seconds [01:38:16] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 274984.000000 [01:39:15] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 275045.000000 [02:00:55] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [02:02:46] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default [02:03:54] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [02:05:16] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [02:05:45] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [02:09:55] Sun Grid Engine execd on willow is WARNING: medium-sol@willow exceedes load threshold: alarm hl:np_load_short=0.941406/1.8, alarm hl:np_load_avg=0.998535/2.3, alarm hl:mem_free=264.000000M/300M, alarm hl:available=1/0 [02:10:54] Sun Grid Engine execd on willow is OK: medium-sol@willow OK: longrun-sol@willow OK [02:12:54] Sun Grid Engine execd on ortelius is WARNING: short-sol@ortelius exceedes load threshold: alarm hl:np_load_short=1.347656/1.10, alarm hl:np_load_long=0.803711/1.55, alarm hl:mem_free=20338.000000M/300M, alarm hl:available=1/0: medium-sol@ortelius exceedes load threshold: alarm hl:np_load_short=1.347656/1.00, alarm hl:np_load_long=0.803711/1.50, alarm hl:mem_free=20338.000000M/300M, alarm hl:available=1/0 [02:13:54] Sun Grid Engine execd on ortelius is OK: short-sol@ortelius OK: medium-sol@ortelius OK [02:13:54] Sun Grid Engine execd on willow is WARNING: medium-sol@willow exceedes load threshold: alarm hl:np_load_short=1.180176/1.8, alarm hl:np_load_avg=1.164062/2.3, alarm hl:mem_free=283.000000M/300M, alarm hl:available=1/0 [02:25:03] fisheye.toolserver.org on web.amaranth is CRITICAL: CRITICAL - Socket timeout after 21 seconds [02:25:55] Sun Grid Engine execd on willow is OK: medium-sol@willow OK: longrun-sol@willow OK [02:34:54] Sun Grid Engine execd on ortelius is WARNING: medium-sol@ortelius exceedes load threshold: alarm hl:np_load_short=1.003906/1.00, alarm hl:np_load_long=0.912110/1.50, alarm hl:mem_free=21250.000000M/300M, alarm hl:available=1/0 [02:36:04] Sun Grid Engine execd on ortelius is OK: short-sol@ortelius OK: medium-sol@ortelius OK [02:38:15] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 278584.000000 [02:39:15] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 278645.000000 [02:45:05] Sun Grid Engine execd on ortelius is WARNING: medium-sol@ortelius exceedes load threshold: alarm hl:np_load_short=1.029297/1.00, alarm hl:np_load_long=0.930664/1.50, alarm hl:mem_free=21781.000000M/300M, alarm hl:available=1/0 [02:54:14] /sql on rosemary is WARNING: DISK WARNING - free space: /sql 166947 MB (17% inode=99%): [03:01:04] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [03:02:46] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default [03:04:04] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [03:05:04] Sun Grid Engine execd on willow is WARNING: medium-sol@willow exceedes load threshold: alarm hl:np_load_short=0.703613/1.8, alarm hl:np_load_avg=0.679688/2.3, alarm hl:mem_free=227.000000M/300M, alarm hl:available=1/0 [03:05:16] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [03:05:55] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [03:08:06] Sun Grid Engine execd on willow is OK: medium-sol@willow OK: longrun-sol@willow OK [03:12:05] Sun Grid Engine execd on ortelius is WARNING: short-sol@ortelius exceedes load threshold: alarm hl:np_load_short=1.119141/1.10, alarm hl:np_load_long=0.911133/1.55, alarm hl:mem_free=21281.000000M/300M, alarm hl:available=1/0: medium-sol@ortelius exceedes load threshold: alarm hl:np_load_short=1.119141/1.00, alarm hl:np_load_long=0.911133/1.50, alarm hl:mem_free=21281.000000M/300M, alarm hl:available=1/0 [03:13:06] Sun Grid Engine execd on ortelius is OK: short-sol@ortelius OK: medium-sol@ortelius OK [03:13:06] Sun Grid Engine execd on willow is WARNING: medium-sol@willow exceedes load threshold: alarm hl:np_load_short=0.874512/1.8, alarm hl:np_load_avg=0.848144/2.3, alarm hl:mem_free=203.000000M/300M, alarm hl:available=1/0 [03:25:24] fisheye.toolserver.org on web.amaranth is CRITICAL: CRITICAL - Socket timeout after 21 seconds [03:34:14] is Dispenser's math on https://jira.toolserver.org/browse/MNT-1225 that replag won't resolve for 48 days possible? [03:35:19] I read microsecond as milliseconds [03:36:01] But we're likely going to lazily insert the SHA1 hashes [03:38:24] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 282192.000000 [03:39:34] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 282261.000000 [03:39:45] If we assume the major bottle neck is disk seeking (~3 ms): 1.8 or 18.1 days if disk seeks every 10 or 1 rows, respectively [03:51:56] However another datapoint, http://enwp.org/WP:Wikipedia_Signpost/2008-01-14/Technology_report John Carter's rename 76,000 in ~10 minute puts us back at the 48 day mark [03:57:18] ugh [03:57:24] Sun Grid Engine execd on ortelius is WARNING: short-sol@ortelius exceedes load threshold: alarm hl:np_load_short=1.423828/1.10, alarm hl:np_load_long=1.002930/1.55, alarm hl:mem_free=20875.000000M/300M, alarm hl:available=1/0: medium-sol@ortelius exceedes load threshold: alarm hl:np_load_short=1.423828/1.00, alarm hl:np_load_long=1.002930/1.50, alarm hl:mem_free=20875.000000M/300M, alarm hl:available=1/0 [04:01:27] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [04:03:15] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default [04:04:25] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [04:05:25] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [04:06:36] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [04:07:25] Sun Grid Engine execd on ortelius is OK: short-sol@ortelius OK: medium-sol@ortelius OK [04:13:24] Sun Grid Engine execd on willow is WARNING: medium-sol@willow exceedes load threshold: alarm hl:np_load_short=0.877930/1.8, alarm hl:np_load_avg=0.831055/2.3, alarm hl:mem_free=185.000000M/300M, alarm hl:available=1/0: longrun-sol@willow exceedes load threshold: alarm hl:np_load_short=0.877930/1.9, alarm hl:np_load_long=0.795898/2.25, alarm hl:mem_free=185.000000M/200M, alarm hl:available=1/0 [04:18:24] Sun Grid Engine execd on willow is OK: medium-sol@willow OK: longrun-sol@willow OK [04:26:04] fisheye.toolserver.org on web.amaranth is CRITICAL: CRITICAL - Socket timeout after 21 seconds [04:28:24] Sun Grid Engine execd on ortelius is WARNING: short-sol@ortelius exceedes load threshold: alarm hl:np_load_short=1.555664/1.10, alarm hl:np_load_long=0.920898/1.55, alarm hl:mem_free=21027.000000M/300M, alarm hl:available=1/0: medium-sol@ortelius exceedes load threshold: alarm hl:np_load_short=1.555664/1.00, alarm hl:np_load_long=0.920898/1.50, alarm hl:mem_free=21027.000000M/300M, alarm hl:available=1/0 [04:30:25] Sun Grid Engine execd on ortelius is OK: short-sol@ortelius OK: medium-sol@ortelius OK [04:38:36] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 285808.000000 [04:39:47] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 285872.000000 [04:58:24] Sun Grid Engine execd on ortelius is WARNING: short-sol@ortelius exceedes load threshold: alarm hl:np_load_short=1.784180/1.10, alarm hl:np_load_long=0.998047/1.55, alarm hl:mem_free=21062.000000M/300M, alarm hl:available=1/0: medium-sol@ortelius exceedes load threshold: alarm hl:np_load_short=1.784180/1.00, alarm hl:np_load_long=0.998047/1.50, alarm hl:mem_free=21062.000000M/300M, alarm hl:available=1/0 [05:00:25] Sun Grid Engine execd on ortelius is OK: short-sol@ortelius OK: medium-sol@ortelius OK [05:02:24] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [05:03:24] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default [05:04:35] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [05:05:45] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [05:06:55] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [05:12:53] 3(commented) [MNT-1225] Growing replag on S1 due to a database migration at WMF <10https://jira.toolserver.org/browse/MNT-1225> (Dispenser) [05:17:47] Sun Grid Engine execd on willow is WARNING: medium-sol@willow exceedes load threshold: alarm hl:np_load_short=0.895996/1.8, alarm hl:np_load_avg=1.083008/2.3, alarm hl:mem_free=259.000000M/300M, alarm hl:available=1/0 [05:21:47] Sun Grid Engine execd on ortelius is WARNING: short-sol@ortelius exceedes load threshold: alarm hl:np_load_short=1.454101/1.10, alarm hl:np_load_long=1.097656/1.55, alarm hl:mem_free=21208.000000M/300M, alarm hl:available=1/0: medium-sol@ortelius exceedes load threshold: alarm hl:np_load_short=1.454101/1.00, alarm hl:np_load_long=1.097656/1.50, alarm hl:mem_free=21208.000000M/300M, alarm hl:available=1/0 [05:26:24] fisheye.toolserver.org on web.amaranth is CRITICAL: CRITICAL - Socket timeout after 21 seconds [05:26:48] Sun Grid Engine execd on willow is OK: medium-sol@willow OK: longrun-sol@willow OK [05:33:47] Sun Grid Engine execd on ortelius is OK: short-sol@ortelius OK: medium-sol@ortelius OK [05:38:46] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 289416.000000 [05:39:57] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 289482.000000 [05:41:50] [[Special:Log/block]] block 10 * Dispenser * (blocked [[02User:Bailey Helton10]] with an expiry time of 1 year (account creation disabled): Spamming links to external sites) [05:42:19] [[User:Dab]] M 10https://wiki.toolserver.org/w/index.php?diff=6926&oldid=6858&rcid=9122 * Dispenser * (-71) (Reverted edits by [[Special:Contributions/Bailey Helton|Bailey Helton]] ([[User talk:Bailey Helton|talk]]) to last revision by [[User:Valhallasw|Valhallasw]]) [05:42:20] [[User talk:Gnuinux]] M 10https://wiki.toolserver.org/w/index.php?diff=6927&oldid=6859&rcid=9123 * Dispenser * (-51) (Reverted edits by [[Special:Contributions/Bailey Helton|Bailey Helton]] ([[User talk:Bailey Helton|talk]]) to last revision by [[User:Gnuinux|Gnuinux]]) [05:42:20] [[~hippietrail/apiproxy.fcgi]] M 10https://wiki.toolserver.org/w/index.php?diff=6928&oldid=6918&rcid=9124 * Dispenser * (-56) (Reverted edits by [[Special:Contributions/Bailey Helton|Bailey Helton]] ([[User talk:Bailey Helton|talk]]) to last revision by [[User:Hippietrail|Hippietrail]]) [05:42:23] [[Ghel]] M 10https://wiki.toolserver.org/w/index.php?diff=6929&oldid=6919&rcid=9125 * Dispenser * (-60) (Reverted edits by [[Special:Contributions/Bailey Helton|Bailey Helton]] ([[User talk:Bailey Helton|talk]]) to last revision by [[User:Dispenser|Dispenser]]) [05:42:23] [[Editcounter]] M 10https://wiki.toolserver.org/w/index.php?diff=6930&oldid=6920&rcid=9126 * Dispenser * (-63) (Reverted edits by [[Special:Contributions/Bailey Helton|Bailey Helton]] ([[User talk:Bailey Helton|talk]]) to last revision by [[User:MZMcBride|MZMcBride]]) [05:51:46] Sun Grid Engine execd on ortelius is WARNING: medium-sol@ortelius exceedes load threshold: alarm hl:np_load_short=1.050781/1.00, alarm hl:np_load_long=0.962890/1.50, alarm hl:mem_free=21237.000000M/300M, alarm hl:available=1/0 [05:52:45] Sun Grid Engine execd on ortelius is OK: short-sol@ortelius OK: medium-sol@ortelius OK [06:02:46] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [06:03:26] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default [06:03:47] Sun Grid Engine execd on ortelius is WARNING: short-sol@ortelius exceedes load threshold: alarm hl:np_load_short=1.282226/1.10, alarm hl:np_load_long=0.986328/1.55, alarm hl:mem_free=20949.000000M/300M, alarm hl:available=1/0: medium-sol@ortelius exceedes load threshold: alarm hl:np_load_short=1.282226/1.00, alarm hl:np_load_long=0.986328/1.50, alarm hl:mem_free=20949.000000M/300M, alarm hl:available=1/0 [06:04:56] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [06:05:57] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [06:07:25] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [06:26:44] fisheye.toolserver.org on web.amaranth is CRITICAL: CRITICAL - Socket timeout after 21 seconds [06:38:55] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 293023.000000 [06:40:06] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 293090.000000 [07:02:05] Sun Grid Engine execd on willow is WARNING: medium-sol@willow exceedes load threshold: alarm hl:np_load_short=1.170899/1.8, alarm hl:np_load_avg=1.051758/2.3, alarm hl:mem_free=173.000000M/300M, alarm hl:available=1/0: longrun-sol@willow exceedes load threshold: alarm hl:np_load_short=1.170899/1.9, alarm hl:np_load_long=1.014160/2.25, alarm hl:mem_free=173.000000M/200M, alarm hl:available=1/0 [07:03:06] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [07:03:34] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default [07:05:16] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [07:05:16] Sun Grid Engine execd on willow is OK: medium-sol@willow OK: longrun-sol@willow OK [07:06:18] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [07:07:55] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [07:11:16] Sun Grid Engine execd on willow is WARNING: medium-sol@willow exceedes load threshold: alarm hl:np_load_short=1.518066/1.8, alarm hl:np_load_avg=1.223145/2.3, alarm hl:mem_free=121.000000M/300M, alarm hl:available=1/0: longrun-sol@willow exceedes load threshold: alarm hl:np_load_short=1.518066/1.9, alarm hl:np_load_long=1.102051/2.25, alarm hl:mem_free=121.000000M/200M, alarm hl:available=1/0 [07:27:04] fisheye.toolserver.org on web.amaranth is CRITICAL: CRITICAL - Socket timeout after 21 seconds [07:32:05] RAID on adenia is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [07:39:02] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 296630.000000 [07:40:11] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 296701.000000 [08:03:12] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [08:04:02] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default [08:06:12] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [08:06:22] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [08:06:51] RAID on adenia is OK: OK - TOTAL: 2: FAILED: 0: DEGRADED: 0 [08:08:12] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [08:27:22] fisheye.toolserver.org on web.amaranth is CRITICAL: CRITICAL - Socket timeout after 21 seconds [08:39:11] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 300239.000000 [08:40:24] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 300311.000000 [08:46:23] Sun Grid Engine execd on willow is WARNING: medium-sol@willow exceedes load threshold: alarm hl:np_load_short=1.227051/1.8, alarm hl:np_load_avg=1.039551/2.3, alarm hl:mem_free=216.000000M/300M, alarm hl:available=1/0 [08:49:23] Sun Grid Engine execd on willow is OK: medium-sol@willow OK: longrun-sol@willow OK [08:57:13] APT on yarrow is CRITICAL: APT CRITICAL: 3 packages available for upgrade (3 critical updates). [09:03:32] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [09:04:11] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default [09:06:56] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [09:06:56] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [09:08:29] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [09:08:29] Sun Grid Engine execd on willow is WARNING: medium-sol@willow exceedes load threshold: alarm hl:np_load_short=1.127930/1.8, alarm hl:np_load_avg=1.220215/2.3, alarm hl:mem_free=172.000000M/300M, alarm hl:available=1/0: longrun-sol@willow exceedes load threshold: alarm hl:np_load_short=1.127930/1.9, alarm hl:np_load_long=1.193848/2.25, alarm hl:mem_free=172.000000M/200M, alarm hl:available=1/0 [09:14:17] Load avg. on willow is WARNING: WARNING - load average: 16.32, 13.55, 11.25 [09:16:17] Load avg. on willow is OK: OK - load average: 14.99, 14.08, 11.73 [09:19:27] Sun Grid Engine execd on willow is OK: medium-sol@willow OK: longrun-sol@willow OK [09:27:36] fisheye.toolserver.org on web.amaranth is CRITICAL: CRITICAL - Socket timeout after 21 seconds [09:39:15] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 303842.000000 [09:40:29] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 303917.000000 [09:57:28] APT on yarrow is CRITICAL: APT CRITICAL: 3 packages available for upgrade (3 critical updates). [10:04:17] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default [10:04:27] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [10:07:36] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [10:07:36] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [10:08:36] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [10:27:46] fisheye.toolserver.org on web.amaranth is CRITICAL: CRITICAL - Socket timeout after 21 seconds [10:39:27] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 307456.000000 [10:41:28] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 307580.000000 [10:42:15] RAID on hyacinth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [10:42:16] SMTP on z-dat-s3-a is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:42:28] SMTP on z-dat-s6-a is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:42:36] SSH on hyacinth is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:42:37] SSH on z-dat-s4-a is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:42:37] SSH on z-dat-s7-a is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:42:37] SSH on z-dat-s6-a is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:42:37] SSH on z-dat-s3-a is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:42:57] RAID on hyacinth is OK: OK - TOTAL: 2: FAILED: 0: DEGRADED: 0 [10:43:07] SMTP on z-dat-s3-a is OK: SMTP OK - 0.005 sec. response time [10:43:16] SMTP on z-dat-s6-a is OK: SMTP OK - 0.004 sec. response time [10:43:26] SSH on hyacinth is OK: SSH OK - OpenSSH_5.8p2-hpn13v11 (protocol 2.0) [10:43:27] SSH on z-dat-s6-a is OK: SSH OK - OpenSSH_5.8p2-hpn13v11 (protocol 2.0) [10:43:27] SSH on z-dat-s4-a is OK: SSH OK - OpenSSH_5.8p2-hpn13v11 (protocol 2.0) [10:43:27] SSH on z-dat-s7-a is OK: SSH OK - OpenSSH_5.8p2-hpn13v11 (protocol 2.0) [10:43:27] SSH on z-dat-s3-a is OK: SSH OK - OpenSSH_5.8p2-hpn13v11 (protocol 2.0) [10:57:36] APT on yarrow is CRITICAL: APT CRITICAL: 3 packages available for upgrade (3 critical updates). [10:58:06] /sql on thyme is CRITICAL: DISK CRITICAL - free space: /sql 49414 MB (5% inode=99%): [11:04:27] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default [11:04:56] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [11:07:57] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [11:07:57] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [11:08:45] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [11:12:58] Sun Grid Engine execd on ortelius is WARNING: short-sol@ortelius exceedes load threshold: alarm hl:np_load_short=1.128906/1.10, alarm hl:np_load_long=0.770508/1.55, alarm hl:mem_free=20880.000000M/300M, alarm hl:available=1/0: medium-sol@ortelius exceedes load threshold: alarm hl:np_load_short=1.128906/1.00, alarm hl:np_load_long=0.770508/1.50, alarm hl:mem_free=20880.000000M/300M, alarm hl:available=1/0 [11:13:56] Sun Grid Engine execd on ortelius is OK: short-sol@ortelius OK: medium-sol@ortelius OK [11:28:15] fisheye.toolserver.org on web.amaranth is CRITICAL: CRITICAL - Socket timeout after 21 seconds [11:39:47] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 311078.000000 [11:42:00] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 311209.000000 [11:55:47] RAID on hyacinth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [11:55:58] SMTP on hyacinth is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:56:17] RAID on hyacinth is OK: OK - TOTAL: 2: FAILED: 0: DEGRADED: 0 [11:56:46] SMTP on hyacinth is OK: SMTP OK - 0.003 sec. response time [11:58:08] APT on yarrow is CRITICAL: APT CRITICAL: 3 packages available for upgrade (3 critical updates). [12:04:58] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default [12:05:20] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [12:08:28] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [12:08:28] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [12:09:37] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [12:28:58] fisheye.toolserver.org on web.amaranth is CRITICAL: CRITICAL - Socket timeout after 21 seconds [12:34:48] fisheye.toolserver.org on web.amaranth is OK: HTTP OK: HTTP/1.1 200 OK - 273 bytes in 11.126 second response time [12:40:13] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 314696.000000 [12:42:11] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 314817.000000 [12:58:31] APT on yarrow is CRITICAL: APT CRITICAL: 3 packages available for upgrade (3 critical updates). [13:05:13] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default [13:05:31] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [13:08:42] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [13:08:43] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [13:10:21] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [13:31:29] fisheye.toolserver.org on web.amaranth is CRITICAL: CRITICAL - Socket timeout after 21 seconds [13:33:20] fisheye.toolserver.org on web.amaranth is OK: HTTP OK: HTTP/1.1 200 OK - 272 bytes in 10.513 second response time [13:40:13] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 318296.000000 [13:42:11] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 318418.000000 [13:50:30] fisheye.toolserver.org on web.amaranth is CRITICAL: HTTP CRITICAL: HTTP/1.1 200 OK - 273 bytes in 20.437 second response time [13:58:53] APT on yarrow is CRITICAL: APT CRITICAL: 3 packages available for upgrade (3 critical updates). [14:05:21] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default [14:05:52] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [14:08:51] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [14:08:51] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [14:10:30] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [14:13:40] fisheye.toolserver.org on web.amaranth is CRITICAL: CRITICAL - Socket timeout after 21 seconds [14:21:30] Sun Grid Engine execd on ortelius is WARNING: short-sol@ortelius exceedes load threshold: alarm hl:np_load_short=1.598633/1.10, alarm hl:np_load_long=0.915039/1.55, alarm hl:mem_free=21343.000000M/300M, alarm hl:available=1/0: medium-sol@ortelius exceedes load threshold: alarm hl:np_load_short=1.598633/1.00, alarm hl:np_load_long=0.915039/1.50, alarm hl:mem_free=21343.000000M/300M, alarm hl:available=1/0 [14:23:30] Sun Grid Engine execd on ortelius is OK: short-sol@ortelius OK: medium-sol@ortelius OK [14:38:41] fisheye.toolserver.org on web.amaranth is OK: HTTP OK: HTTP/1.1 200 OK - 272 bytes in 9.712 second response time [14:40:21] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 321915.000000 [14:42:34] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 322036.000000 [14:55:02] /sql on rosemary is WARNING: DISK WARNING - free space: /sql 164776 MB (17% inode=99%): [14:59:02] APT on yarrow is CRITICAL: APT CRITICAL: 3 packages available for upgrade (3 critical updates). [15:05:43] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default [15:06:02] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [15:09:03] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [15:09:03] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [15:10:51] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [15:15:45] Sun Grid Engine execd on ortelius is WARNING: short-sol@ortelius exceedes load threshold: alarm hl:np_load_short=1.106445/1.10, alarm hl:np_load_long=0.620117/1.55, alarm hl:mem_free=21250.000000M/300M, alarm hl:available=1/0: medium-sol@ortelius exceedes load threshold: alarm hl:np_load_short=1.106445/1.00, alarm hl:np_load_long=0.620117/1.50, alarm hl:mem_free=21250.000000M/300M, alarm hl:available=1/0 [15:19:46] Sun Grid Engine execd on ortelius is OK: short-sol@ortelius OK: medium-sol@ortelius OK [15:22:45] Sun Grid Engine execd on ortelius is WARNING: medium-sol@ortelius exceedes load threshold: alarm hl:np_load_short=1.091797/1.00, alarm hl:np_load_long=0.796875/1.50, alarm hl:mem_free=21385.000000M/300M, alarm hl:available=1/0 [15:40:44] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 325530.000000 [15:40:56] 3(created) [MAGNUS-310] ImageSiblings: Category with apostroph has wrong link; Magnus' tools; Trivial Bug <10https://jira.toolserver.org/browse/MAGNUS-310> (Umherirrender) [15:42:44] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 325652.000000 [15:58:52] Sun Grid Engine execd on willow is WARNING: medium-sol@willow exceedes load threshold: alarm hl:np_load_short=0.713867/1.8, alarm hl:np_load_avg=0.710938/2.3, alarm hl:mem_free=248.000000M/300M, alarm hl:available=1/0 [15:59:04] APT on yarrow is CRITICAL: APT CRITICAL: 3 packages available for upgrade (3 critical updates). [16:05:52] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default [16:06:06] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [16:09:12] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [16:09:13] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [16:11:21] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [16:15:01] Sun Grid Engine execd on willow is OK: medium-sol@willow OK: longrun-sol@willow OK [16:20:01] Sun Grid Engine execd on ortelius is WARNING: short-sol@ortelius exceedes load threshold: alarm hl:np_load_short=3.036133/1.10, alarm hl:np_load_long=0.994140/1.55, alarm hl:mem_free=20876.000000M/300M, alarm hl:available=1/0: medium-sol@ortelius exceedes load threshold: alarm hl:np_load_short=3.036133/1.00, alarm hl:np_load_long=0.994140/1.50, alarm hl:mem_free=20876.000000M/300M, alarm hl:available=1/0 [16:40:02] Sun Grid Engine execd on ortelius is OK: short-sol@ortelius OK: medium-sol@ortelius OK [16:40:43] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 329130.000000 [16:43:43] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 329312.000000 [16:59:14] APT on yarrow is CRITICAL: APT CRITICAL: 3 packages available for upgrade (3 critical updates). [17:06:13] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default [17:06:26] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [17:06:52] fisheye.toolserver.org on web.amaranth is CRITICAL: CRITICAL - Socket timeout after 21 seconds [17:09:22] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [17:09:22] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [17:11:32] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [17:13:02] Sun Grid Engine execd on willow is WARNING: medium-sol@willow exceedes load threshold: alarm hl:np_load_short=1.850098/1.8, alarm hl:np_load_avg=1.404785/2.3, alarm hl:mem_free=416.000000M/300M, alarm hl:available=1/0 [17:14:02] Sun Grid Engine execd on willow is OK: medium-sol@willow OK: longrun-sol@willow OK [17:27:02] Sun Grid Engine execd on ortelius is WARNING: medium-sol@ortelius exceedes load threshold: alarm hl:np_load_short=1.080078/1.00, alarm hl:np_load_long=0.795898/1.50, alarm hl:mem_free=21026.000000M/300M, alarm hl:available=1/0 [17:28:02] Sun Grid Engine execd on ortelius is OK: short-sol@ortelius OK: medium-sol@ortelius OK [17:28:32] fisheye.toolserver.org on web.amaranth is OK: HTTP OK: HTTP/1.1 200 OK - 274 bytes in 10.234 second response time [17:41:42] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 332791.000000 [17:43:54] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 332922.000000 [17:59:22] APT on yarrow is CRITICAL: APT CRITICAL: 3 packages available for upgrade (3 critical updates). [18:06:12] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default [18:06:32] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [18:09:33] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [18:09:43] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [18:11:26] @replag [18:11:27] Danny_B|backup: s1-rr-a: 3d 20h 56m 22s [+1.00 s/s]; s1-user: 3d 20h 56m 22s [+1.00 s/s]; s3-rr-a: 20s [+0.00 s/s]; s3-user: 20s [+0.00 s/s] [18:11:38] @replag all [18:11:39] Danny_B|backup: s1-rr-a: 3d 20h 56m 34s [+1.00 s/s]; s1-rr-a-c: 1s [-0.00 s/s]; s1-user: 3d 20h 56m 34s [+1.00 s/s]; s2-user: 3s [-0.00 s/s]; s2-user-c: 1s [-0.00 s/s]; s3-rr-a: 32s [+1.00 s/s]; s3-user: 32s [+1.00 s/s]; s4-rr-a: 1s [-] [18:11:40] Danny_B|backup: s4-user: 1s [-]; s5-rr-a: 1s [-0.00 s/s]; s5-user: 1s [-0.00 s/s]; s5-user-c: 1s [-0.00 s/s]; s6-rr-a: 1s [-0.00 s/s]; s6-user: 1s [-0.00 s/s]; s7-rr-a: 1s [-0.00 s/s]; s7-user: 1s [-0.00 s/s] [18:11:42] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [18:41:43] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 336391.000000 [18:44:02] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 336529.000000 [18:55:12] Sun Grid Engine execd on ortelius is WARNING: short-sol@ortelius exceedes load threshold: alarm hl:np_load_short=1.125000/1.10, alarm hl:np_load_long=0.823242/1.55, alarm hl:mem_free=21132.000000M/300M, alarm hl:available=1/0: medium-sol@ortelius exceedes load threshold: alarm hl:np_load_short=1.125000/1.00, alarm hl:np_load_long=0.823242/1.50, alarm hl:mem_free=21132.000000M/300M, alarm hl:available=1/0 [18:57:12] Sun Grid Engine execd on ortelius is OK: short-sol@ortelius OK: medium-sol@ortelius OK [18:59:23] APT on yarrow is CRITICAL: APT CRITICAL: 3 packages available for upgrade (3 critical updates). [19:06:13] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default [19:06:43] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [19:09:42] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [19:10:42] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [19:12:03] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [19:21:13] Sun Grid Engine execd on willow is WARNING: medium-sol@willow exceedes load threshold: alarm hl:np_load_short=0.713867/1.8, alarm hl:np_load_avg=0.768555/2.3, alarm hl:mem_free=208.000000M/300M, alarm hl:available=1/0 [19:24:56] 3(created) [MAGNUS-311] Catscan broken on plwiki; Magnus' tools; Bug <10https://jira.toolserver.org/browse/MAGNUS-311> (bulwersator) [19:32:58] 3(updated) [MAGNUS-310] ImageSiblings: Category with apostroph has wrong link <10https://jira.toolserver.org/browse/MAGNUS-310> (Umherirrender) [19:36:23] Sun Grid Engine execd on willow is OK: medium-sol@willow OK: longrun-sol@willow OK [19:37:12] RAID on adenia is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [19:39:22] Sun Grid Engine execd on willow is WARNING: medium-sol@willow exceedes load threshold: alarm hl:np_load_short=0.665527/1.8, alarm hl:np_load_avg=0.703125/2.3, alarm hl:mem_free=286.000000M/300M, alarm hl:available=1/0 [19:41:53] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 339998.000000 [19:44:02] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 340133.000000 [19:59:43] APT on yarrow is CRITICAL: APT CRITICAL: 3 packages available for upgrade (3 critical updates). [20:06:35] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default [20:07:43] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [20:09:43] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [20:09:52] any sql expert? I need someone to check an sql query [20:10:03] Merlissimo: ^ ? [20:10:42] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [20:11:17] Alchimista: depends on the expected skills of an "expert" [20:12:06] hehe.. i need a list of orphan pages, but without *kill* anything.. i have this: [20:12:08] SELECT page_title FROM page where page_title NOT IN (SELECT pl_title FROM Pagelinks WHERE pl_namespace=0) /* SLOW_OK */ >/home/alchimista/orphan.txt [20:12:12] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [20:12:53] Merlissimo: ^ but i'm more used to simple querys, i prefer a second opinion despite mine [20:17:16] without killing anything is a good point [20:17:41] i am also search orphaned pages for dewiki [20:18:01] so you've a script already? [20:18:42] http://kpaste.net/1f9e8503 [20:19:05] for not killing anything i am using recentchanges table, with only included pages changes last 30 days [20:19:39] and disamig pages (Begriffsklärung) and wrong written word (Falschschreibung) should be orphaned on dewiki [20:19:50] but thatway the list is not a complete one [20:21:12] the problem whith your query is that pages linked from e.g. project namespace are not found [20:21:39] yap, i'm just interested on the main namespace ones [20:22:13] RAID on adenia is OK: OK - TOTAL: 2: FAILED: 0: DEGRADED: 0 [20:22:34] if you exclude the recentchanges table from the join then you'll get all, but i don't know the runtime then [20:23:03] my sql query as posted above runs about 40 minutes on dewiki [20:23:54] :O 40 min? [20:26:33] Sun Grid Engine execd on willow is WARNING: medium-sol@willow exceedes load threshold: alarm hl:np_load_short=0.826172/1.8, alarm hl:np_load_avg=0.784668/2.3, alarm hl:mem_free=184.000000M/300M, alarm hl:available=1/0: longrun-sol@willow exceedes load threshold: alarm hl:np_load_short=0.826172/1.9, alarm hl:np_load_long=0.790039/2.25, alarm hl:mem_free=184.000000M/200M, alarm hl:available=1/0 [20:28:19] Alchimista: don't use NOT IN, but rather join with AND .. IS NULL [20:31:33] Sun Grid Engine execd on willow is OK: medium-sol@willow OK: longrun-sol@willow OK [20:41:39] valhallasw: SELECT page_title FROM page LEFT JOIN pagelinks ON page_namespace = pl_namespace AND page_title = tl_title WHERE page_namespace = 0 AND pl_from IS NULL /* SLOW_OK */ >/home/alchimista/orphan.txt [20:42:13] errrr [20:42:17] pagelinks left join page, I think [20:42:22] is it fine, or can be more eficient? [20:42:29] oh, no [20:42:37] you want pages that don't have a pagelink [20:42:42] yap [20:42:43] Sun Grid Engine execd on willow is WARNING: medium-sol@willow exceedes load threshold: alarm hl:np_load_short=0.616699/1.8, alarm hl:np_load_avg=0.604004/2.3, alarm hl:mem_free=209.000000M/300M, alarm hl:available=1/0 [20:42:49] then this is the right join, yes [20:42:51] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 343664.000000 [20:43:22] this should list all pages that have no links to them, if I read the query correctly [20:43:46] you could try an explain, but I think it should be OK [20:44:13] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 343739.000000 [20:44:19] the main problem is eficiency, i'm not just tryng to get the list, but doing it efficiently [20:44:48] that's why you should check the explain [20:45:02] you could also check what mediawiki does [20:45:52] the special page only shows 5 000 pages [20:46:18] yes, and the special page uses a query [20:46:30] I think it's safe to assume that query is reasonably efficient. [20:52:27] valhallasw: the special pages simple makge a join with pagelinks, templatelins and redirects [20:52:57] you'll wont find pages linked from e.g. user namespace but not from article namespace [20:53:36] you need an extra join for that in any case [20:57:44] Sun Grid Engine execd on willow is OK: medium-sol@willow OK: longrun-sol@willow OK [20:59:44] APT on yarrow is CRITICAL: APT CRITICAL: 3 packages available for upgrade (3 critical updates). [21:07:33] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default [21:07:44] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [21:09:52] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [21:10:44] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [21:12:22] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [21:13:44] Sun Grid Engine execd on willow is WARNING: medium-sol@willow exceedes load threshold: alarm hl:np_load_short=0.766602/1.8, alarm hl:np_load_avg=0.779785/2.3, alarm hl:mem_free=279.000000M/300M, alarm hl:available=1/0 [21:17:43] Sun Grid Engine execd on willow is OK: medium-sol@willow OK: longrun-sol@willow OK [21:29:43] Sun Grid Engine execd on willow is WARNING: medium-sol@willow exceedes load threshold: alarm hl:np_load_short=0.644043/1.8, alarm hl:np_load_avg=0.681152/2.3, alarm hl:mem_free=173.000000M/300M, alarm hl:available=1/0: longrun-sol@willow exceedes load threshold: alarm hl:np_load_short=0.644043/1.9, alarm hl:np_load_long=0.695312/2.25, alarm hl:mem_free=173.000000M/200M, alarm hl:available=1/0 [21:35:17] Hello all [21:35:19] @replag [21:35:20] DaBPunkt: s1-rr-a: 4d 20m 15s [+1.00 s/s]; s1-user: 4d 20m 15s [+1.00 s/s] [21:35:30] *seufz* [21:43:01] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 347274.000000 [21:44:12] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 347346.000000 [21:59:36] Alchimista: https://wiki.toolserver.org/view/Queries [21:59:42] That had the query you were looking for already, I think. [21:59:46] Pages with no incoming links? [21:59:50] Not sure about the "kill" bit. [21:59:53] APT on yarrow is CRITICAL: APT CRITICAL: 3 packages available for upgrade (3 critical updates). [22:01:54] APT on yarrow is OK: APT OK: 0 packages available for upgrade (0 critical updates). [22:07:16] nighty~ o/ [22:07:42] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default [22:07:53] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [22:09:53] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [22:10:52] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [22:12:32] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [22:32:46] [[Main Page/lang]] ! 10https://wiki.toolserver.org/w/index.php?diff=6931&oldid=6912&rcid=9127 * 79.39.138.216 * (+40) () [22:43:02] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 350874.000000 [22:44:22] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 350947.000000 [22:58:43] /sql on thyme is CRITICAL: DISK CRITICAL - free space: /sql 31538 MB (3% inode=99%): [23:07:46] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default [23:08:04] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [23:09:02] Sun Grid Engine execd on willow is WARNING: medium-sol@willow exceedes load threshold: alarm hl:np_load_short=0.713867/1.8, alarm hl:np_load_avg=0.745117/2.3, alarm hl:mem_free=265.000000M/300M, alarm hl:available=1/0 [23:10:03] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [23:11:03] RAID on daphne is CRITICAL: ERROR - TOTAL: 2: FAILED: 0: DEGRADED: 1 [23:12:44] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [23:13:48] nacht ts [23:14:03] Sun Grid Engine execd on willow is OK: medium-sol@willow OK: longrun-sol@willow OK [23:43:13] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 354485.000000 [23:44:22] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 354553.000000