[00:23:04] Platonides * Re: [Toolserver-l] TS and/vs. Labs [00:26:47] 2013/09/17 00:26 WARN cassia wikidata replag QUERY WARNING: 'SELECT ts_rc_age()' returned 3367.000000 [00:33:48] 2013/09/17 00:33 OK cassia wikidata replag QUERY OK: 'SELECT ts_rc_age()' returned 1665.000000 [00:33:48] 2013/09/17 00:33 OK rosemary /sql DISK OK - free space: /sql 34074 MB (11% inode=99%): [01:03:48] 2013/09/17 00:57 WARN rosemary /sql DISK WARNING - free space: /sql 33530 MB (10% inode=99%): [01:45:52] 2013/09/17 01:45 WARN rosemary wikidata replag QUERY WARNING: 'SELECT ts_rc_age()' returned 3517.000000 [01:52:53] 2013/09/17 01:52 OK rosemary wikidata replag QUERY OK: 'SELECT ts_rc_age()' returned 1657.000000 [04:09:00] 2013/09/17 04:08 OK rosemary /sql DISK OK - free space: /sql 34064 MB (11% inode=99%): [04:22:00] 2013/09/17 04:15 WARN rosemary /sql DISK WARNING - free space: /sql 32815 MB (10% inode=99%): [04:31:00] 2013/09/17 04:30 OK rosemary /sql DISK OK - free space: /sql 33593 MB (11% inode=99%): [04:38:01] 2013/09/17 04:31 WARN rosemary /sql DISK WARNING - free space: /sql 32933 MB (10% inode=99%): [11:10:13] 2013/09/17 11:09 CRIT ptolemy /sql Timeout while attempting connection [11:11:14] 2013/09/17 11:10 CRIT ptolemy / Timeout while attempting connection [11:11:14] 2013/09/17 11:10 CRIT ptolemy Environment Timeout while attempting connection [11:11:14] 2013/09/17 11:10 CRIT ptolemy Load avg. Timeout while attempting connection [11:11:14] 2013/09/17 11:10 CRIT ptolemy NTP CRITICAL - Socket timeout after 10 seconds [11:11:14] 2013/09/17 11:10 CRIT ptolemy PostgreSQL CRITICAL - Plugin timed out after 20 seconds [11:11:14] 2013/09/17 11:10 CRIT ptolemy RAID Timeout while attempting connection [11:11:14] 2013/09/17 11:10 CRIT ptolemy SMTP CRITICAL - Socket timeout after 10 seconds [11:12:14] 2013/09/17 11:11 CRIT ptolemy /tmp Timeout while attempting connection [11:12:14] 2013/09/17 11:11 CRIT ptolemy PING PING CRITICAL - Packet loss = 100% [11:12:14] 2013/09/17 11:10 CRIT ptolemy SMF Timeout while attempting connection [11:12:14] 2013/09/17 11:11 CRIT ptolemy SSH CRITICAL - Socket timeout after 10 seconds [11:13:14] 2013/09/17 11:12 OK ptolemy PING PING OK - Packet loss = 0%, RTA = 0.14 ms [11:18:13] 2013/09/17 11:10 CRIT ptolemy / Connection refused by host [11:18:13] 2013/09/17 11:11 CRIT ptolemy /tmp Connection refused by host [11:18:13] 2013/09/17 11:10 CRIT ptolemy Environment Connection refused by host [11:18:13] 2013/09/17 11:10 CRIT ptolemy PostgreSQL CRITICAL - no connection to 'osm_mapnik' (could not connect to server: Connection refused [11:19:13] 2013/09/17 11:10 CRIT ptolemy RAID Connection refused by host [11:19:13] 2013/09/17 11:10 CRIT ptolemy SMF Connection refused by host [11:19:13] 2013/09/17 11:11 CRIT ptolemy SSH Connection refused [11:20:13] 2013/09/17 11:10 CRIT ptolemy Load avg. Connection refused by host [11:20:13] 2013/09/17 11:10 CRIT ptolemy SMTP Connection refused [11:20:38] [[Special:Log/newusers]] create 10 * Horcrux92 * (New user account) [11:23:10] [[Category:Tools]] ! 10https://wiki.toolserver.org/w/index.php?diff=8145&oldid=8144&rcid=22249 * Horcrux92 * (+19) (Undo revision 8144 by [[Special:Contributions/110.90.31.136|110.90.31.136]] ([[User talk:110.90.31.136|talk]])) [13:18:22] 2013/09/17 13:15 CRIT z-dat-s7-a MySQL slave Can't connect to MySQL server on 'z-dat-s7-a' (111) [13:19:22] 2013/09/17 13:15 CRIT z-dat-s7-a MySQL Can't connect to MySQL server on 'z-dat-s7-a' (111) [13:28:23] 2013/09/17 13:24 CRIT z-dat-s4-a MySQL slave (Service Check Timed Out) [13:28:23] 2013/09/17 13:24 CRIT z-dat-s6-a MySQL Can't connect to MySQL server on 'z-dat-s6-a' (110) [13:29:23] 2013/09/17 13:28 OK z-dat-s4-a MySQL slave Uptime: 1135409 Threads: 3 Questions: 59098195 Slow queries: 64 Opens: 263 Flush tables: 1 Open tables: 251 Queries per second avg: 52.50 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 369 [13:30:23] 2013/09/17 13:29 OK z-dat-s6-a MySQL Uptime: 1135475 Threads: 12 Questions: 309119814 Slow queries: 38339 Opens: 254497 Flush tables: 1 Open tables: 3216 Queries per second avg: 272.238 [13:30:23] 2013/09/17 13:29 OK z-dat-s7-a MySQL Uptime: 867 Threads: 4 Questions: 544 Slow queries: 1 Opens: 97 Flush tables: 1 Open tables: 88 Queries per second avg: 0.627 [13:30:23] 2013/09/17 13:29 OK z-dat-s7-a MySQL slave Uptime: 867 Threads: 4 Questions: 543 Slow queries: 1 Opens: 97 Flush tables: 1 Open tables: 88 Queries per second avg: 0.626 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1243 [16:15:36] [[File:Wikimedia Community Logo-Toolserver.png]] ! 10https://wiki.toolserver.org/w/index.php?diff=8146&oldid=8114&rcid=22250 * 108.59.1.220 * (+193) () [16:27:51] [[File:Wikimedia Community Logo-Toolserver.png]] ! 10https://wiki.toolserver.org/w/index.php?diff=8147&oldid=8146&rcid=22251 * 108.59.1.220 * (+193) () [18:18:39] 2013/09/17 18:17 CRIT z-dat-s4-a /sql CHECK_NRPE: Socket timeout after 30 seconds. [18:19:39] 2013/09/17 18:18 WARN z-dat-s4-a /sql DISK WARNING - free space: /sql 60779 MB (9% inode=99%): [18:32:16] [[File:Wikimedia Community Logo-Toolserver.png]] M 10https://wiki.toolserver.org/w/index.php?diff=8148&oldid=8147&rcid=22252 * Betacommand * (-386) (Reverted edits by [[Special:Contributions/108.59.1.220|108.59.1.220]] ([[User talk:108.59.1.220|talk]]) to last revision by [[User:Legoktm|Legoktm]]) [18:32:59] [[Special:Log/block]] block 10 * Betacommand * (blocked [[02User:108.59.1.22010]] with an expiry time of 2 weeks (anonymous users only, account creation disabled): vandalism) [18:50:58] [[Special:Log/newusers]] create 10 * Noriko463 * (New user account) [19:40:42] 2013/09/17 19:40 OK ptolemy Load avg. OK - load average: 0.02, 0.00, 0.00 [19:40:42] 2013/09/17 19:40 OK ptolemy RAID OK - TOTAL: 2: FAILED: 0: DEGRADED: 0 [19:40:42] 2013/09/17 19:40 OK ptolemy SMTP SMTP OK - 1.051 sec. response time [19:41:42] 2013/09/17 19:40 OK ptolemy / DISK OK - free space: / 9534 MB (47% inode=91%): [19:41:42] 2013/09/17 19:40 WARN ptolemy /sql DISK WARNING - free space: /sql 138935 MB (17% inode=99%): [19:41:42] 2013/09/17 19:41 OK ptolemy /tmp DISK OK - free space: /tmp 67132 MB (99% inode=99%): [19:41:42] 2013/09/17 19:40 OK ptolemy Environment ok: temperature ok fan ok voltage ok chassis ok [19:41:42] 2013/09/17 19:40 OK ptolemy SMF OK - all services online [19:41:43] 2013/09/17 19:41 OK ptolemy SSH SSH OK - OpenSSH_5.8p2-hpn13v11 (protocol 2.0) [19:44:42] 2013/09/17 19:43 OK ptolemy PostgreSQL OK - database osm_mapnik (0 sec.) [20:29:22] [[Special:Log/newusers]] create 10 * Carl417 * (New user account) [20:55:47] 2013/09/17 20:55 CRIT hemlock / Connection refused or timed out [20:55:47] 2013/09/17 20:55 CRIT hemlock /home Timeout while attempting connection [20:55:47] 2013/09/17 20:55 CRIT hemlock /tmp Connection refused or timed out [20:55:47] 2013/09/17 20:55 CRIT hemlock Environment IPMI Connection refused or timed out [20:55:47] 2013/09/17 20:55 CRIT hemlock NTP CRITICAL - Socket timeout after 10 seconds [20:55:48] 2013/09/17 20:55 CRIT hemlock SSH CRITICAL - Socket timeout after 10 seconds [20:56:47] 2013/09/17 20:55 CRIT hemlock /aux0 Connection refused or timed out [20:56:47] 2013/09/17 20:56 CRIT hemlock Load avg. Connection refused or timed out [20:56:47] 2013/09/17 20:55 CRIT hemlock PING CRITICAL - Host Unreachable (hemlock) [20:56:47] 2013/09/17 20:55 CRIT hemlock SMTP No route to host [20:59:04] Marlen Caemmerer * Re: [Toolserver-announce] [Toolserver-l] Maintenance: PHP update tomorrow [20:59:47] 2013/09/17 20:58 OK hemlock PING PING OK - Packet loss = 0%, RTA = 0.30 ms [21:02:48] 2013/09/17 21:01 CRIT hemlock PING CRITICAL - Host Unreachable (hemlock) [21:03:48] 2013/09/17 20:56 CRIT hemlock Load avg. Connection refused or timed out [21:04:48] 2013/09/17 20:55 CRIT hemlock /aux0 Connection refused by host [21:04:48] 2013/09/17 20:55 CRIT hemlock /home Connection refused by host [21:04:48] 2013/09/17 20:55 CRIT hemlock Environment IPMI Connection refused by host [21:04:48] 2013/09/17 20:55 CRIT hemlock NTP NTP CRITICAL: No response from NTP server [21:04:48] 2013/09/17 20:55 CRIT hemlock SMTP Connection refused [21:04:48] 2013/09/17 20:55 CRIT hemlock SSH Connection refused [21:05:49] 2013/09/17 21:04 OK hemlock PING PING OK - Packet loss = 0%, RTA = 0.12 ms [21:08:49] 2013/09/17 21:08 OK hemlock NTP NTP OK: Offset 3.4e-05 secs [21:16:49] 2013/09/17 21:16 WARN hemlock / DISK WARNING - free space: / 3849 MB (19% inode=87%): [21:16:49] 2013/09/17 21:16 OK hemlock /home DISK OK - free space: /home 14228 MB (28% inode=81%): [21:16:49] 2013/09/17 21:16 WARN hemlock /tmp DISK WARNING - free space: / 4006 MB (20% inode=87%): [21:16:49] 2013/09/17 21:16 OK hemlock Environment IPMI ok: temperature ok fan ok voltage ok chassis ok [21:16:49] 2013/09/17 21:16 OK hemlock Load avg. OK - load average: 0.49, 0.36, 0.41 [21:16:50] 2013/09/17 21:16 OK hemlock SSH SSH OK - OpenSSH_5.8p2-hpn13v11 (protocol 2.0) [21:17:49] 2013/09/17 21:16 OK hemlock /aux0 DISK OK - free space: / 3697 MB (18% inode=87%): [21:17:49] 2013/09/17 21:16 OK hemlock SMTP SMTP OK - 0.069 sec. response time [21:25:27] [[Special:Log/newusers]] create 10 * Nidia641 * (New user account) [21:35:50] 2013/09/17 21:32 CRIT z-dat-s4-a MySQL slave Slave IO: No Slave SQL: Yes Seconds Behind Master: (null) [21:35:51] 2013/09/17 21:33 CRIT z-dat-s7-a MySQL slave Slave IO: No Slave SQL: Yes Seconds Behind Master: (null) [21:39:51] 2013/09/17 21:33 CRIT cassia MySQL slave Slave IO: No Slave SQL: Yes Seconds Behind Master: (null) [21:39:51] 2013/09/17 21:33 CRIT daphne MySQL slave Slave IO: No Slave SQL: Yes Seconds Behind Master: (null) [21:39:51] 2013/09/17 21:32 CRIT rosemary MySQL slave Slave IO: No Slave SQL: Yes Seconds Behind Master: (null) [21:39:51] 2013/09/17 21:33 CRIT z-dat-s1-b MySQL slave Slave IO: No Slave SQL: Yes Seconds Behind Master: (null) [21:39:51] 2013/09/17 21:33 CRIT z-dat-s2-b MySQL slave Slave IO: No Slave SQL: Yes Seconds Behind Master: (null) [21:39:52] 2013/09/17 21:32 CRIT z-dat-s3-a MySQL slave Slave IO: No Slave SQL: Yes Seconds Behind Master: (null) [21:39:52] 2013/09/17 21:33 CRIT z-dat-s5-b MySQL slave Slave IO: No Slave SQL: Yes Seconds Behind Master: (null) [21:39:53] 2013/09/17 21:32 CRIT z-dat-s6-a MySQL slave Slave IO: No Slave SQL: Yes Seconds Behind Master: (null) [22:09:53] 2013/09/17 22:03 WARN cassia wikidata replag QUERY WARNING: 'SELECT ts_rc_age()' returned 2191.000000 [22:09:53] 2013/09/17 22:03 WARN daphne s4 replag QUERY WARNING: 'SELECT ts_rc_age()' returned 2190.000000 [22:09:53] 2013/09/17 22:03 WARN rosemary s1 replag QUERY WARNING: 'SELECT ts_rc_age()' returned 2195.000000 [22:09:53] 2013/09/17 22:03 WARN rosemary s4 replag QUERY WARNING: 'SELECT ts_rc_age()' returned 2204.000000 [22:09:53] 2013/09/17 22:03 WARN rosemary wikidata replag QUERY WARNING: 'SELECT ts_rc_age()' returned 2213.000000 [22:09:53] 2013/09/17 22:03 WARN z-dat-s2-b wikidata replag QUERY WARNING: 'SELECT ts_rc_age()' returned 2177.000000 [22:09:53] 2013/09/17 22:03 WARN z-dat-s5-b s4 replag QUERY WARNING: 'SELECT ts_rc_age()' returned 2201.000000 [22:09:54] 2013/09/17 22:03 WARN z-dat-s5-b wikidata replag QUERY WARNING: 'SELECT ts_rc_age()' returned 2206.000000 [22:10:53] 2013/09/17 22:03 WARN cassia s4 replag QUERY WARNING: 'SELECT ts_rc_age()' returned 2219.000000 [22:10:53] 2013/09/17 22:03 WARN cassia s5 replag QUERY WARNING: 'SELECT ts_rc_age()' returned 2220.000000 [22:33:53] 2013/09/17 22:33 CRIT cassia wikidata replag QUERY CRITICAL: 'SELECT ts_rc_age()' returned 3631.000000 [22:33:53] 2013/09/17 22:33 CRIT daphne s4 replag QUERY CRITICAL: 'SELECT ts_rc_age()' returned 3631.000000 [22:33:53] 2013/09/17 22:33 CRIT rosemary s1 replag QUERY CRITICAL: 'SELECT ts_rc_age()' returned 3635.000000 [22:33:53] 2013/09/17 22:33 CRIT rosemary s4 replag QUERY CRITICAL: 'SELECT ts_rc_age()' returned 3644.000000 [22:33:53] 2013/09/17 22:33 CRIT rosemary wikidata replag QUERY CRITICAL: 'SELECT ts_rc_age()' returned 3653.000000 [22:33:54] 2013/09/17 22:33 CRIT z-dat-s2-b wikidata replag QUERY CRITICAL: 'SELECT ts_rc_age()' returned 3617.000000 [22:33:54] 2013/09/17 22:33 CRIT z-dat-s5-b s4 replag QUERY CRITICAL: 'SELECT ts_rc_age()' returned 3641.000000 [22:33:55] 2013/09/17 22:33 CRIT z-dat-s5-b wikidata replag QUERY CRITICAL: 'SELECT ts_rc_age()' returned 3646.000000 [22:34:53] 2013/09/17 22:33 CRIT cassia s4 replag QUERY CRITICAL: 'SELECT ts_rc_age()' returned 3659.000000 [22:34:53] 2013/09/17 22:33 CRIT cassia s5 replag QUERY CRITICAL: 'SELECT ts_rc_age()' returned 3660.000000