[01:21:38] 2014/03/01 01:14 WARN willow / DISK WARNING - free space: / 15526 MB (14% inode=97%): [01:21:38] 2014/03/01 01:14 WARN willow /tmp DISK WARNING - free space: / 15526 MB (14% inode=97%): [01:25:38] 2014/03/01 01:24 OK willow / DISK OK - free space: / 29375 MB (28% inode=98%): [01:25:39] 2014/03/01 01:24 OK willow /tmp DISK OK - free space: / 29375 MB (28% inode=98%): [02:14:41] 2014/03/01 02:06 CRIT cassia s4 replag (Service Check Timed Out) [02:15:41] 2014/03/01 02:14 OK cassia s4 replag QUERY OK: 'SELECT ts_rc_age()' returned 0.000000 [03:11:44] 2014/03/01 03:10 OK ortelius / DISK OK - free space: / 6485 MB (21% inode=91%): [06:18:55] 2014/03/01 06:10 CRIT cassia s4 replag (Service Check Timed Out) [06:23:56] 2014/03/01 06:21 OK cassia s4 replag QUERY OK: 'SELECT ts_rc_age()' returned 0.000000 [07:03:58] 2014/03/01 06:56 CRIT cassia s4 replag (Service Check Timed Out) [07:12:59] 2014/03/01 07:11 OK cassia s4 replag QUERY OK: 'SELECT ts_rc_age()' returned 0.000000 [08:09:02] 2014/03/01 08:00 CRIT cassia s4 replag (Service Check Timed Out) [08:13:02] 2014/03/01 08:11 OK cassia s4 replag QUERY OK: 'SELECT ts_rc_age()' returned 0.000000 [09:13:04] Maarten Dammers * Re: [Toolserver-l] Scholarships for Zurich Hackathon [09:54:04] K. Peachey * Re: [Toolserver-l] Scholarships for Zurich Hackathon [10:38:11] 2014/03/01 10:29 CRIT cassia s4 replag (Service Check Timed Out) [10:40:11] 2014/03/01 10:38 OK cassia s4 replag QUERY OK: 'SELECT ts_rc_age()' returned 0.000000 [11:10:13] 2014/03/01 11:02 CRIT cassia s4 replag (Service Check Timed Out) [11:12:13] 2014/03/01 11:11 OK cassia s4 replag QUERY OK: 'SELECT ts_rc_age()' returned 0.000000 [11:29:15] 2014/03/01 11:21 CRIT cassia s4 replag (Service Check Timed Out) [11:30:16] 2014/03/01 11:28 OK cassia s4 replag QUERY OK: 'SELECT ts_rc_age()' returned 0.000000 [11:38:16] 2014/03/01 11:31 WARN z-dat-s3-a MySQL slave SLOW_SLAVE WARNING: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 2121 [11:42:17] 2014/03/01 11:40 CRIT z-dat-s3-a MySQL slave (Service Check Timed Out) [11:46:16] 2014/03/01 11:44 WARN z-dat-s3-a MySQL slave SLOW_SLAVE WARNING: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 2560 [11:49:04] Manuel Schneider * Re: [Toolserver-l] Scholarships for Zurich Hackathon [12:06:17] 2014/03/01 12:04 CRIT z-dat-s3-a MySQL slave SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 3693 [12:19:17] 2014/03/01 12:12 WARN z-dat-s4-a MySQL slave SLOW_SLAVE WARNING: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 2071 [12:22:17] 2014/03/01 12:15 CRIT hyacinth SSH CRITICAL - Socket timeout after 10 seconds [12:23:17] 2014/03/01 12:22 OK hyacinth SSH SSH OK - OpenSSH_5.8p2-hpn13v11 (protocol 2.0) [12:27:17] 2014/03/01 12:20 CRIT yarrow aliasd Connection refused [12:30:17] 2014/03/01 12:23 WARN z-dat-s7-a MySQL slave SLOW_SLAVE WARNING: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 2195 [13:05:19] 2014/03/01 13:04 CRIT z-dat-s7-a MySQL slave SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 3621 [13:31:20] 2014/03/01 13:30 CRIT z-dat-s4-a MySQL slave SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 3617 [13:42:20] 2014/03/01 13:41 WARN z-dat-s4-a MySQL slave SLOW_SLAVE WARNING: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 3551 [14:20:22] 2014/03/01 14:19 OK z-dat-s4-a MySQL slave Uptime: 1643707 Threads: 1 Questions: 197405743 Slow queries: 85 Opens: 295 Flush tables: 1 Open tables: 263 Queries per second avg: 120.97 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1793 [15:34:28] 2014/03/01 15:33 WARN z-dat-s7-a MySQL slave SLOW_SLAVE WARNING: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 3532 [15:52:30] 2014/03/01 15:51 OK z-dat-s7-a MySQL slave Uptime: 1599768 Threads: 5 Questions: 215222354 Slow queries: 104414 Opens: 10499 Flush tables: 1 Open tables: 5067 Queries per second avg: 134.533 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1719 [16:02:31] 2014/03/01 16:01 WARN z-dat-s3-a MySQL slave SLOW_SLAVE WARNING: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 3473 [16:09:31] 2014/03/01 16:08 OK z-dat-s3-a MySQL slave Uptime: 1600759 Threads: 10 Questions: 455522178 Slow queries: 27203 Opens: 1363510 Flush tables: 1 Open tables: 16384 Queries per second avg: 284.566 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1703 [19:36:44] 2014/03/01 19:36 OK yarrow aliasd TCP OK - 0.002 second response time on port 984 [500 Not found.] [23:10:38] I've a /home/phe/public_html/cgi-bin/credits script which was working until a few days ago, now I get a 500 error at http://toolserver.org/~phe/cgi-bin/credits , any idea ? [23:14:47] opened TS-1722 on Jira for that problem [23:21:43] If you replace toolserver.org with wolfsbane.toolserver.org and log into wolfsbane.toolserver.org, you can grep for credits in /var/log/http/errors: [23:21:49] [01/Mar/2014:23:20:57 +0000] WARN:toolserver.org:No content was generated for /~phe/cgi-bin/credits [23:22:12] WARN:toolserver.org:Unknown directive: php_flag [23:22:17] WARN:toolserver.org:Unknown directive: php_value [23:22:29] Is that something in your script? [23:23:35] scfc_de, I don't think so, and the script worked 18 month [23:23:59] the script is python btw, not php [23:24:39] I just noticed :-). [23:26:22] I don't understand the WARN:toolserver.org:No content was generated for /~phe/cgi-bin/credits [23:26:41] does it means than the script failed w/o any output ? [23:26:42] phe: You have those settings in ~phe/public_html/.htaccess (not changed for 2.5 years, so something on the web server must have changed). Try commenting them out? [23:28:42] I don't know if the webserver tries to execute your script at all or stops at the "unknown" directives. [23:29:30] no longer error about php_* but always the WARN:toolserver.org:No content was generated for /~phe/cgi-bin/credits [23:30:26] Hmmm. [23:31:16] What happens when you execute ~phe/public_html/cgi-bin/credits on the command line? [23:32:24] scfc_de, found it, there is an exception for a missing column in the db, the trouble is not on the side of the web server [23:32:42] hmm Table 'frwikisource_p.revision_no_user_index' [23:38:03] scfc_de, thanks for the help, its working now, something changed in the db table [23:38:30] np [23:43:36] I don't know how to close https://jira.toolserver.org/browse/TS-1722 [23:46:18] phe: Click "Assign To Me", then you'll see a button "Resolve" or something like that.