[00:03:01] nacht ts [00:11:54] SMF on turnera.esi is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [00:18:34] SMF on damiana.esi is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [00:20:33] SSH on nightshade.mgmt is CRITICAL: Server answer: [00:20:33] /sql on rosemary is CRITICAL: DISK CRITICAL - free space: /sql 56833 MB (5% inode=99%): [00:30:13] / on hemlock is WARNING: DISK WARNING - free space: / 3705 MB (18% inode=89%): [00:33:14] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: (Service Check Timed Out) [01:11:53] SMF on turnera.esi is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [01:18:34] SMF on damiana.esi is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [01:20:33] SSH on nightshade.mgmt is CRITICAL: Server answer: [01:20:33] /sql on rosemary is CRITICAL: DISK CRITICAL - free space: /sql 56711 MB (5% inode=99%): [01:30:13] / on hemlock is WARNING: DISK WARNING - free space: / 3702 MB (18% inode=89%): [01:33:13] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: (Service Check Timed Out) [01:49:13] MySQL slave on thyme is WARNING: SLOW_SLAVE WARNING: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1956 [01:49:34] s1 replag on thyme is WARNING: QUERY WARNING: SELECT ts_rc_age() returned 1979.000000 [02:11:54] SMF on turnera.esi is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [02:17:14] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 3636 [02:17:35] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 3660.000000 [02:18:45] SMF on damiana.esi is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [02:20:33] SSH on nightshade.mgmt is CRITICAL: Server answer: [02:20:34] /sql on rosemary is CRITICAL: DISK CRITICAL - free space: /sql 56585 MB (5% inode=99%): [02:30:13] / on hemlock is WARNING: DISK WARNING - free space: / 3700 MB (18% inode=89%): [02:33:14] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: (Service Check Timed Out) [03:11:54] SMF on turnera.esi is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [03:17:14] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 7236 [03:18:34] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 7320.000000 [03:18:44] SMF on damiana.esi is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [03:18:55] hi everyone! quick question for the room: are the Article Feedback Tool tables available for metawiki_p? I don't see them, but I know that AFT is enabled on some Meta pages (for instance, this one: http://meta.wikimedia.org/wiki/Fundraising_2011/Jimmy_Letter_002/de), so imagine that data is being stored somewhere. Any help appreciated! [03:20:34] SSH on nightshade.mgmt is CRITICAL: Server answer: [03:20:34] /sql on rosemary is CRITICAL: DISK CRITICAL - free space: /sql 56448 MB (5% inode=99%): [03:30:14] / on hemlock is WARNING: DISK WARNING - free space: / 3734 MB (18% inode=89%): [03:33:14] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: (Service Check Timed Out) [03:35:25] if anyone can suggest another editor who I could ping for an answer to the question above, I'd be grateful for that too! :) [04:12:03] SMF on turnera.esi is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [04:17:14] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 10838 [04:18:55] SMF on damiana.esi is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [04:19:34] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 10981.000000 [04:21:33] SSH on nightshade.mgmt is CRITICAL: Server answer: [04:21:34] /sql on rosemary is CRITICAL: DISK CRITICAL - free space: /sql 56318 MB (5% inode=99%): [04:30:02] Dmitry * [Toolserver-l] fatal: relocation error [04:30:14] / on hemlock is WARNING: DISK WARNING - free space: / 3731 MB (18% inode=89%): [05:02:55] Sun Grid Engine execd on nightshade is WARNING: all.q@nightshade exceedes load threshold: alarm hl:np_load_short=1.697266/1.50, alarm hl:mem_free=767.000000M/200M: longrun@nightshade exceedes load threshold: alarm hl:np_load_short=1.697266/1.50, alarm hl:np_load_long=1.345703/2.00, alarm hl:mem_free=767.000000M/250M [05:03:14] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: (Service Check Timed Out) [05:03:55] Sun Grid Engine execd on nightshade is OK: all.q@nightshade OK: longrun@nightshade OK [05:12:03] SMF on turnera.esi is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [05:17:14] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 14069 [05:19:34] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 14210.000000 [05:19:54] SMF on damiana.esi is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [05:21:34] SSH on nightshade.mgmt is CRITICAL: Server answer: [05:21:34] /sql on rosemary is CRITICAL: DISK CRITICAL - free space: /sql 57027 MB (5% inode=99%): [05:30:24] / on hemlock is WARNING: DISK WARNING - free space: / 3729 MB (18% inode=89%): [05:42:55] Sun Grid Engine execd on nightshade is WARNING: all.q@nightshade exceedes load threshold: alarm hl:np_load_short=1.645996/1.50, alarm hl:mem_free=1504.000000M/200M: longrun@nightshade exceedes load threshold: alarm hl:np_load_short=1.645996/1.50, alarm hl:np_load_long=1.325195/2.00, alarm hl:mem_free=1504.000000M/250M [05:49:55] Sun Grid Engine execd on nightshade is OK: all.q@nightshade OK: longrun@nightshade OK [06:02:55] Sun Grid Engine execd on nightshade is WARNING: all.q@nightshade exceedes load threshold: alarm hl:np_load_short=1.531738/1.50, alarm hl:mem_free=1517.000000M/200M: longrun@nightshade exceedes load threshold: alarm hl:np_load_short=1.531738/1.50, alarm hl:np_load_long=1.499024/2.00, alarm hl:mem_free=1517.000000M/250M [06:03:15] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: (Service Check Timed Out) [06:12:05] SMF on turnera.esi is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [06:17:15] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 17554 [06:20:03] SMF on damiana.esi is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [06:20:33] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 17754.000000 [06:22:33] /sql on rosemary is CRITICAL: DISK CRITICAL - free space: /sql 56989 MB (5% inode=99%): [06:22:33] SSH on nightshade.mgmt is CRITICAL: Server answer: [06:31:24] / on hemlock is WARNING: DISK WARNING - free space: / 3726 MB (18% inode=89%): [06:31:54] Sun Grid Engine execd on nightshade is WARNING: all.q@nightshade exceedes load threshold: alarm hl:np_load_short=2.226074/1.50, alarm hl:mem_free=1463.000000M/200M: longrun@nightshade exceedes load threshold: alarm hl:np_load_short=2.226074/1.50, alarm hl:np_load_long=1.389649/2.00, alarm hl:mem_free=1463.000000M/250M [06:32:54] Sun Grid Engine execd on nightshade is OK: all.q@nightshade OK: longrun@nightshade OK [07:12:04] SMF on turnera.esi is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [07:17:24] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 20560 [07:20:04] SMF on damiana.esi is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [07:20:33] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 20751.000000 [07:22:34] /sql on rosemary is CRITICAL: DISK CRITICAL - free space: /sql 56886 MB (5% inode=99%): [07:22:34] SSH on nightshade.mgmt is CRITICAL: Server answer: [07:31:23] / on hemlock is WARNING: DISK WARNING - free space: / 3724 MB (18% inode=89%): [07:33:13] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: (Service Check Timed Out) [07:58:23] / on hemlock is OK: DISK OK - free space: / 8796 MB (44% inode=89%): [08:03:43] /aux0 on daphne is CRITICAL: DISK CRITICAL - free space: /aux0 51899 MB (5% inode=99%): [08:13:04] SMF on turnera.esi is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [08:18:23] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 24220 [08:20:03] SMF on damiana.esi is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [08:20:33] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 24350.000000 [08:22:36] /sql on rosemary is CRITICAL: DISK CRITICAL - free space: /sql 56260 MB (5% inode=99%): [08:22:36] SSH on nightshade.mgmt is CRITICAL: Server answer: [08:33:14] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: (Service Check Timed Out) [08:52:34] RAID on hyacinth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [08:52:44] SMTP on z-dat-s4-a is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:52:44] SSH on z-dat-s6-a is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:52:44] SMTP on hyacinth is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:52:54] SMTP on z-dat-s6-a is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:53:05] /tmp on z-dat-s3-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [08:53:05] SSH on z-dat-s4-a is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:53:05] SSH on z-dat-s3-a is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:53:05] SSH on z-dat-s7-a is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:53:05] /tmp on z-dat-s6-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [08:53:23] /tmp on z-dat-s4-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [08:53:54] MySQL slave on z-dat-s3-a is CRITICAL: (Service Check Timed Out) [08:53:54] MySQL on z-dat-s3-a is CRITICAL: (Service Check Timed Out) [08:54:44] MySQL slave on z-dat-s7-a is CRITICAL: (Service Check Timed Out) [08:54:44] MySQL on z-dat-s7-a is CRITICAL: (Service Check Timed Out) [08:54:44] SMTP on z-dat-s7-a is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:54:44] SMTP on z-dat-s3-a is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:54:44] SSH on hyacinth is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:54:53] MySQL on z-dat-s6-a is CRITICAL: (Service Check Timed Out) [08:54:54] MySQL slave on z-dat-s6-a is CRITICAL: (Service Check Timed Out) [08:55:13] MySQL slave on z-dat-s4-a is CRITICAL: (Service Check Timed Out) [08:55:54] MySQL on z-dat-s4-a is CRITICAL: (Service Check Timed Out) [08:57:54] /tmp on z-dat-s3-a is OK: DISK OK - free space: /tmp 3531 MB (99% inode=99%): [08:57:54] /tmp on z-dat-s6-a is OK: DISK OK - free space: /tmp 3523 MB (99% inode=99%): [08:57:54] /tmp on z-dat-s4-a is OK: DISK OK - free space: /tmp 3474 MB (99% inode=99%): [08:57:54] MySQL on z-dat-s4-a is OK: Uptime: 3928436 Threads: 6 Questions: 165113396 Slow queries: 43073 Opens: 30764 Flush tables: 1 Open tables: 440 Queries per second avg: 42.30 [08:57:54] MySQL on z-dat-s6-a is OK: Uptime: 4011220 Threads: 13 Questions: 747169457 Slow queries: 270437 Opens: 7627262 Flush tables: 2 Open tables: 2925 Queries per second avg: 186.269 [08:57:54] MySQL slave on z-dat-s6-a is OK: Uptime: 4011220 Threads: 13 Questions: 747169458 Slow queries: 270437 Opens: 7627262 Flush tables: 2 Open tables: 2925 Queries per second avg: 186.269 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 465 [08:57:55] SSH on z-dat-s4-a is OK: SSH OK - OpenSSH_5.8p2-hpn13v11 (protocol 2.0) [08:57:55] SSH on z-dat-s3-a is OK: SSH OK - OpenSSH_5.8p2-hpn13v11 (protocol 2.0) [08:57:56] SSH on z-dat-s7-a is OK: SSH OK - OpenSSH_5.8p2-hpn13v11 (protocol 2.0) [08:57:56] MySQL slave on z-dat-s4-a is OK: Uptime: 3928443 Threads: 6 Questions: 165114072 Slow queries: 43074 Opens: 30764 Flush tables: 1 Open tables: 440 Queries per second avg: 42.30 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 322 [08:58:04] MySQL on z-dat-s3-a is OK: Uptime: 2744312 Threads: 25 Questions: 2925218495 Slow queries: 269394 Opens: 37752118 Flush tables: 2 Open tables: 16384 Queries per second avg: 1065.920 [08:58:04] MySQL slave on z-dat-s3-a is OK: Uptime: 2744312 Threads: 25 Questions: 2925218496 Slow queries: 269394 Opens: 37752118 Flush tables: 2 Open tables: 16384 Queries per second avg: 1065.920 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 476 [08:58:13] RAID on hyacinth is OK: OK - TOTAL: 2: FAILED: 0: DEGRADED: 0 [08:58:23] MySQL slave on z-dat-s7-a is OK: Uptime: 1516763 Threads: 5 Questions: 342218765 Slow queries: 65018 Opens: 4093023 Flush tables: 1 Open tables: 3756 Queries per second avg: 225.624 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 200 [08:58:23] MySQL on z-dat-s7-a is OK: Uptime: 1516763 Threads: 5 Questions: 342218782 Slow queries: 65018 Opens: 4093023 Flush tables: 1 Open tables: 3756 Queries per second avg: 225.624 [08:58:34] SMTP on z-dat-s4-a is OK: SMTP OK - 0.028 sec. response time [08:58:35] SMTP on z-dat-s7-a is OK: SMTP OK - 0.128 sec. response time [08:58:35] SSH on z-dat-s6-a is OK: SSH OK - OpenSSH_5.8p2-hpn13v11 (protocol 2.0) [08:58:35] SMTP on z-dat-s3-a is OK: SMTP OK - 0.003 sec. response time [08:58:35] SSH on hyacinth is OK: SSH OK - OpenSSH_5.8p2-hpn13v11 (protocol 2.0) [08:58:35] SMTP on hyacinth is OK: SMTP OK - 0.003 sec. response time [08:58:43] SMTP on z-dat-s6-a is OK: SMTP OK - 0.039 sec. response time [09:13:14] SMF on turnera.esi is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [09:19:14] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 17371 [09:20:35] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 17386.000000 [09:21:04] SMF on damiana.esi is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [09:22:43] SSH on nightshade.mgmt is CRITICAL: Server answer: [09:23:35] /sql on rosemary is CRITICAL: DISK CRITICAL - free space: /sql 56663 MB (5% inode=99%): [09:33:14] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: (Service Check Timed Out) [09:34:28] @replag all [09:34:34] @replag all [09:34:35] nosy: s1-pri: 4h 41m 46s [+0.11 s/s]; s1-sec: 0s [-]; s1-sec-c: 8s [+0.00 s/s]; s2-pri: 3s [+0.00 s/s]; s2/s5-pri-c: 8s [+0.00 s/s]; s3-rr: 12s [+0.00 s/s]; s3-user: 12s [+0.00 s/s]; s4-rr: 8s [+0.00 s/s] [09:34:36] nosy: s4-user: 8s [+0.00 s/s]; s5-rr: 1s [-0.00 s/s]; s5-user: 1s [-0.00 s/s]; s6-rr: 1s [-]; s6-user: 1s [-]; s7-rr: 3s [+0.00 s/s]; s7-user: 3s [+0.00 s/s] [10:14:13] SMF on turnera.esi is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [10:18:14] MySQL slave on thyme is WARNING: SLOW_SLAVE WARNING: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 3435 [10:18:44] s1 replag on thyme is WARNING: QUERY WARNING: SELECT ts_rc_age() returned 3152.000000 [10:22:03] SMF on damiana.esi is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [10:22:45] SSH on nightshade.mgmt is CRITICAL: Server answer: [10:23:34] /sql on rosemary is CRITICAL: DISK CRITICAL - free space: /sql 56532 MB (5% inode=99%): [10:25:14] MySQL slave on thyme is OK: Uptime: 453284 Threads: 16 Questions: 140760083 Slow queries: 58500 Opens: 25659 Flush tables: 1 Open tables: 2329 Queries per second avg: 310.533 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1745 [10:25:44] s1 replag on thyme is OK: QUERY OK: SELECT ts_rc_age() returned 1732.000000 [10:26:01] [[Special:Log/newusers]] create 10 * Dmvstar * (New user account) [10:33:14] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: (Service Check Timed Out) [10:38:33] !seen soxred93 [10:38:45] no this feature here. [10:39:20] does soxred93 attend IRC nowadays? [10:47:44] s1 replag on thyme is WARNING: QUERY WARNING: SELECT ts_rc_age() returned 1919.000000 [10:48:14] MySQL slave on thyme is WARNING: SLOW_SLAVE WARNING: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1942 [10:48:39] [[OpenStreetMap/Priorities 2012]] ! 10https://wiki.toolserver.org/w/index.php?diff=6542&oldid=6541&rcid=8602 * Sebastian Sooth (WMDE) * (+98) () [10:51:13] MySQL slave on thyme is OK: Uptime: 454845 Threads: 22 Questions: 141109240 Slow queries: 58869 Opens: 25673 Flush tables: 1 Open tables: 2334 Queries per second avg: 310.235 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1798 [10:51:44] s1 replag on thyme is OK: QUERY OK: SELECT ts_rc_age() returned 1725.000000 [11:15:10] SMF on turnera.esi is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [11:22:11] SMF on damiana.esi is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [11:23:12] SSH on nightshade.mgmt is CRITICAL: Server answer: [11:23:41] /sql on rosemary is CRITICAL: DISK CRITICAL - free space: /sql 56409 MB (5% inode=99%): [12:03:11] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: (Service Check Timed Out) [12:15:11] SMF on turnera.esi is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [12:23:10] SMF on damiana.esi is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [12:24:10] SSH on nightshade.mgmt is CRITICAL: Server answer: [12:24:41] /sql on rosemary is CRITICAL: DISK CRITICAL - free space: /sql 56147 MB (5% inode=99%): [13:15:20] SMF on turnera.esi is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [13:23:20] SMF on damiana.esi is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [13:24:10] SSH on nightshade.mgmt is CRITICAL: Server answer: [13:24:41] /sql on rosemary is CRITICAL: DISK CRITICAL - free space: /sql 55180 MB (5% inode=99%): [13:33:10] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: (Service Check Timed Out) [13:40:30] [[Special:Log/newusers]] create 10 * Bruce Pate * (New user account) [13:45:30] hello all [14:07:31] Load avg. on daphne is WARNING: WARNING - load average: 16.74, 14.76, 11.26 [14:15:21] SMF on turnera.esi is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [14:20:31] Load avg. on daphne is OK: OK - load average: 10.27, 14.23, 13.53 [14:23:21] SMF on damiana.esi is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [14:24:10] SSH on nightshade.mgmt is CRITICAL: Server answer: [14:25:41] /sql on rosemary is CRITICAL: DISK CRITICAL - free space: /sql 55988 MB (5% inode=99%): [14:31:31] Load avg. on daphne is WARNING: WARNING - load average: 16.72, 14.78, 13.87 [14:34:31] Load avg. on daphne is OK: OK - load average: 14.66, 14.80, 14.05 [14:52:30] Load avg. on daphne is WARNING: WARNING - load average: 16.39, 15.29, 14.44 [15:03:10] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: (Service Check Timed Out) [15:15:21] SMF on turnera.esi is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [15:23:21] SMF on damiana.esi is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [15:24:10] SSH on nightshade.mgmt is CRITICAL: Server answer: [15:26:41] /sql on rosemary is CRITICAL: DISK CRITICAL - free space: /sql 56785 MB (5% inode=99%): [15:37:11] Load avg. on hyacinth is WARNING: WARNING - load average: 17.70, 15.04, 11.94 [15:42:21] Sun Grid Engine execd on ortelius is WARNING: short@ortelius exceedes load threshold: alarm hl:np_load_short=1.470703/1.00, alarm hl:mem_free=12037.000000M/100M: all.q@ortelius exceedes load threshold: alarm hl:np_load_short=1.470703/1.00, alarm hl:mem_free=12037.000000M/100M [15:43:21] Sun Grid Engine execd on ortelius is OK: short@ortelius OK: all.q@ortelius OK [16:03:11] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: (Service Check Timed Out) [16:04:11] Load avg. on hyacinth is OK: OK - load average: 12.50, 14.06, 14.89 [16:15:21] SMF on turnera.esi is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [16:23:21] SMF on damiana.esi is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [16:24:10] SSH on nightshade.mgmt is CRITICAL: Server answer: [16:26:41] /sql on rosemary is CRITICAL: DISK CRITICAL - free space: /sql 56204 MB (5% inode=99%): [16:33:10] Load avg. on hyacinth is WARNING: WARNING - load average: 16.69, 14.29, 12.82 [16:56:33] Sun Grid Engine execd on nightshade is WARNING: all.q@nightshade exceedes load threshold: alarm hl:np_load_short=3.031250/1.50, alarm hl:mem_free=2275.000000M/200M: longrun@nightshade exceedes load threshold: alarm hl:np_load_short=3.031250/1.50, alarm hl:np_load_long=1.230957/2.00, alarm hl:mem_free=2275.000000M/250M [16:56:33] Load avg. on nightshade is WARNING: WARNING - load average: 27.19, 16.93, 10.76 [17:00:33] Sun Grid Engine execd on nightshade is OK: all.q@nightshade OK: longrun@nightshade OK [17:02:33] Load avg. on nightshade is OK: OK - load average: 8.84, 14.71, 12.05 [17:03:12] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: (Service Check Timed Out) [17:12:11] Load avg. on hyacinth is OK: OK - load average: 10.68, 13.28, 14.80 [17:15:31] SMF on turnera.esi is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [17:23:32] SMF on damiana.esi is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [17:24:11] SSH on nightshade.mgmt is CRITICAL: Server answer: [17:26:43] /sql on rosemary is CRITICAL: DISK CRITICAL - free space: /sql 56451 MB (5% inode=99%): [17:42:06] nosy: if spatial is already installed then ignore it. the last time i was asking, it was not, then i forgot about it and since now working on some georelated project, i recalled that i was supposed to file a request [18:03:11] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: (Service Check Timed Out) [18:15:32] SMF on turnera.esi is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [18:23:32] SMF on damiana.esi is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [18:24:22] SSH on nightshade.mgmt is CRITICAL: Server answer: [18:27:41] /sql on rosemary is CRITICAL: DISK CRITICAL - free space: /sql 56310 MB (5% inode=99%): [18:43:47] [[Category:Multilingual tools]] ! 10https://wiki.toolserver.org/w/index.php?diff=6543&oldid=174&rcid=8604 * 85.1.195.167 * (+646) (Dr. Novartis Andreas Gasser) [18:46:45] [[Category:Multilingual tools]] ! 10https://wiki.toolserver.org/w/index.php?diff=6544&oldid=6543&rcid=8605 * 217.254.57.93 * (-646) (Undo revision 6543 by [[Special:Contributions/85.1.195.167|85.1.195.167]] ([[User talk:85.1.195.167|talk]])) [19:03:11] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: (Service Check Timed Out) [19:15:32] SMF on turnera.esi is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [19:23:33] SMF on damiana.esi is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [19:24:22] SSH on nightshade.mgmt is CRITICAL: Server answer: [19:27:42] /sql on rosemary is CRITICAL: DISK CRITICAL - free space: /sql 56147 MB (5% inode=99%): [19:36:22] DaBPunkt: nosy : could the [[Admin:Next maintenance]] be updated if anything took a place? thank you [20:03:11] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: (Service Check Timed Out) [20:04:02] /aux0 on daphne is CRITICAL: DISK CRITICAL - free space: /aux0 51247 MB (5% inode=99%): [20:15:42] SMF on turnera.esi is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [20:16:42] Load avg. on nightshade is CRITICAL: CRITICAL - load average: 51.34, 28.55, 14.70 [20:16:42] Sun Grid Engine execd on nightshade is WARNING: all.q@nightshade exceedes load threshold: alarm hl:np_load_short=7.241211/1.50, alarm hl:mem_free=2565.000000M/200M: longrun@nightshade exceedes load threshold: alarm hl:np_load_short=7.241211/1.50, alarm hl:np_load_long=1.847656/2.00, alarm hl:mem_free=2565.000000M/250M [20:17:42] Load avg. on nightshade is WARNING: WARNING - load average: 21.68, 24.20, 14.04 [20:18:42] Sun Grid Engine execd on nightshade is OK: all.q@nightshade OK: longrun@nightshade OK [20:21:42] Load avg. on nightshade is OK: OK - load average: 7.40, 14.49, 12.23 [20:23:42] SMF on damiana.esi is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [20:24:21] SSH on nightshade.mgmt is CRITICAL: Server answer: [20:24:42] Sun Grid Engine execd on nightshade is WARNING: all.q@nightshade exceedes load threshold: alarm hl:np_load_short=4.939453/1.50, alarm hl:mem_free=2453.000000M/200M: longrun@nightshade exceedes load threshold: alarm hl:np_load_short=4.939453/1.50, alarm hl:np_load_long=2.335938/2.00, alarm hl:mem_free=2453.000000M/250M [20:25:31] Sun Grid Engine execd on ortelius is WARNING: short@ortelius exceedes load threshold: alarm hl:np_load_short=1.533203/1.00, alarm hl:mem_free=11708.000000M/100M: all.q@ortelius exceedes load threshold: alarm hl:np_load_short=1.533203/1.00, alarm hl:mem_free=11708.000000M/100M [20:26:32] Sun Grid Engine execd on ortelius is OK: short@ortelius OK: all.q@ortelius OK [20:26:38] [[Special:Log/newusers]] create 10 * Gasserandreas * (New user account) [20:27:53] /sql on rosemary is CRITICAL: DISK CRITICAL - free space: /sql 55169 MB (5% inode=99%): [20:33:21] 3(reopened) [TS-1226] VIEW - Roger Mbiama <10https://jira.toolserver.org/browse/TS-1226> (Gasserandreas) [20:42:42] Sun Grid Engine execd on nightshade is OK: all.q@nightshade OK: longrun@nightshade OK [21:03:12] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: (Service Check Timed Out) [21:15:42] SMF on turnera.esi is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [21:24:42] SMF on damiana.esi is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [21:25:21] SSH on nightshade.mgmt is CRITICAL: Server answer: [21:27:52] /sql on rosemary is CRITICAL: DISK CRITICAL - free space: /sql 56747 MB (5% inode=99%): [21:46:41] Sun Grid Engine execd on ortelius is WARNING: short@ortelius exceedes load threshold: alarm hl:np_load_short=2.090820/1.00, alarm hl:mem_free=11778.000000M/100M: all.q@ortelius exceedes load threshold: alarm hl:np_load_short=2.090820/1.00, alarm hl:mem_free=11778.000000M/100M [21:49:31] Sun Grid Engine execd on ortelius is OK: short@ortelius OK: all.q@ortelius OK [22:03:12] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: (Service Check Timed Out) [22:15:42] SMF on turnera.esi is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [22:24:41] SMF on damiana.esi is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [22:25:21] SSH on nightshade.mgmt is CRITICAL: Server answer: [22:28:01] /sql on rosemary is CRITICAL: DISK CRITICAL - free space: /sql 56621 MB (5% inode=99%): [22:38:12] SSH on z-dat-s6-a is CRITICAL: CRITICAL - Socket timeout after 10 seconds [22:39:02] SSH on z-dat-s6-a is OK: SSH OK - OpenSSH_5.8p2-hpn13v11 (protocol 2.0) [23:15:42] SMF on turnera.esi is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [23:24:43] SMF on damiana.esi is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [23:25:22] SSH on nightshade.mgmt is CRITICAL: Server answer: [23:28:01] /sql on rosemary is CRITICAL: DISK CRITICAL - free space: /sql 56467 MB (5% inode=99%): [23:33:12] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: (Service Check Timed Out) [23:38:32] RAID on hyacinth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [23:39:12] RAID on hyacinth is OK: OK - TOTAL: 2: FAILED: 0: DEGRADED: 0 [23:45:32] SSH on z-dat-s4-a is CRITICAL: CRITICAL - Socket timeout after 10 seconds [23:45:32] RAID on hyacinth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [23:45:42] /tmp on z-dat-s4-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [23:46:12] SMTP on z-dat-s6-a is CRITICAL: CRITICAL - Socket timeout after 10 seconds [23:46:21] /tmp on z-dat-s3-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [23:46:31] /tmp on z-dat-s4-a is OK: DISK OK - free space: /tmp 3618 MB (99% inode=99%): [23:46:31] SSH on z-dat-s4-a is OK: SSH OK - OpenSSH_5.8p2-hpn13v11 (protocol 2.0) [23:46:51] /tmp on z-dat-s3-a is OK: DISK OK - free space: /tmp 3697 MB (99% inode=99%): [23:47:02] SMTP on z-dat-s6-a is OK: SMTP OK - 0.007 sec. response time