[04:13:00] (03PS1) 10Legoktm: Update mw-conf.json on every run [labs/tools/extdist] - 10https://gerrit.wikimedia.org/r/167426 [04:15:12] (03CR) 10Legoktm: [C: 032] Update mw-conf.json on every run [labs/tools/extdist] - 10https://gerrit.wikimedia.org/r/167426 (owner: 10Legoktm) [04:51:53] Coren / andrewbogott_afk: https://dpaste.de/AJwU - replication / db integrity issue? [05:21:17] Earwig: its lot a lag issue http://tools.wmflabs.org/betacommand-dev/cgi-bin/replag [05:21:23] *not [05:21:37] yeah, I noticed that... [05:22:50] Betacommand: "SELECT COUNT(*) FROM page LEFT JOIN revision ON page_latest = rev_id WHERE rev_id IS NULL;" gave me about 12,000 results [05:23:15] ouch [05:23:33] Earwig: if you file a but cc me on it please [05:23:37] okay [05:39:25] 3Wikimedia Labs / 3tools: Missing page revisions on enwiki - 10https://bugzilla.wikimedia.org/72226 (10Ben Kurtovic) 3NEW p:3Unprio s:3major a:3Marc A. Pelletier I noticed the top revisions for at least several pages on enwiki do not exist in the revision table, after my bot started freaking out. For... [08:20:46] anyone able to help figuring out an issue with submitting a job via `qsub` for a bot on tools? [08:55:52] 3Wikimedia Labs / 3tools: Grid engine "swallows" quotation marks (double and single quotation marks) and does not recognize pages at cs.wiki (more at "Additional Information") - 10https://bugzilla.wikimedia.org/72092#c11 (10Wesalius) (In reply to Marc A. Pelletier from comment #2) > The problem is that gride... [17:14:55] any of you guys involved with the winter theme project? [18:06:16] i have another user where webservice start always results in (network.c.358) can't bind to port: 4153 Address already in use in error.log [18:22:08] YuviPanda: websocket servers on tools works, but it depends on the implementation. socket.io 0.9.x and 1.1.x failed (both for websockets and long-polling) on python's gevent-socketio and node. Connection is established and the server recieves everything, but io.emit() messages send _to_ the client disappear. The ws library on node also failed. [18:22:32] sitic: ah, hmm. which one works? [18:22:35] sock.js with node backend works flawlessly, [18:22:43] aaah, I see [18:22:56] maybe some of the websocket servers also work [18:29:49] coren: ping [18:30:46] gifti: Odd. That should only happen if someone bound to the port manually. [18:30:48] * Coren checks. [18:31:15] gifti: What instance? -tomcat? [18:31:30] no -lighttpd [18:31:37] tools.taxonbot [18:32:08] Coren: log at /data/project/taxonbot/error.log [18:32:16] gifti: the ports are per-instance, so I need to know on which it failed. Do you have a last job number? [18:33:32] * Merlissimo runs qacct -j lighttpd-tools.taxonbot -d 1 [18:33:55] 4931958 [18:33:58] Coren: 4931958 [18:34:25] haha, same idea [18:34:37] Ah, webgrid-01 [18:37:22] gifti, TaxoTiger: should work now. There was indeed something listening on the port that was not properly registered with portgranter for some reason. [18:37:31] btw: webgrid 4 had really high load: load_long=20.230000 load_short=9.460000 [18:37:37] aha [18:38:19] thank you very much indeed Coren [18:38:27] I'll try [18:38:46] change the configs and try again [18:38:51] I will report about [18:41:20] Merlissimo: It looks like "normal" load; that is there are a couple webservices that are currently very busy. The biggest culprid seems to be dewikinews-rss and that does seem odd. [18:42:28] okay, evrything working [18:42:32] thank you very much [20:18:41] PROBLEM - ToolLabs: Low disk space on /var on labmon1001 is CRITICAL: CRITICAL: tools.tools.diskspace._var.byte_avail.value (10.00%) [20:26:27] RECOVERY - ToolLabs: Low disk space on /var on labmon1001 is OK: OK: All targets OK [21:16:33] PROBLEM - ToolLabs: Low disk space on /var on labmon1001 is CRITICAL: CRITICAL: tools.tools.diskspace._var.byte_avail.value (30.00%) [22:15:35] RECOVERY - ToolLabs: Low disk space on /var on labmon1001 is OK: OK: All targets OK [22:29:56] There used to be a tool to help with image mapping on wiki [22:29:56] Where different parts of the image would link to different pages [22:29:57] http://toolserver.org/~dapete/ImageMapEdit/ImageMapEdit.html [22:30:08] Anybody know of a current way to do this? [22:32:39] !fingerprints [22:32:39] ssh keys for bastion hosts: https://wikitech.wikimedia.org/wiki/Help:SSH_Fingerprints [22:34:36] https://wikitech.wikimedia.org/w/index.php?title=Fingerprints&redirect=no [22:37:25] RD: http://meta.wikimedia.org/wiki/User:Dapete/ImageMapEdit#English this? [22:37:59] perhaps [22:38:08] t [22:38:10] ty [22:38:20] np [22:40:09] Very nice [22:40:18] It's way nicer than the old way :D [22:40:43] hehe [22:58:40] !log math Added myself to project members to debug {{bug|72234}} [23:33:46] !log math Fixed duplicate mount of /dev/mapper/vd-second--local--disk on mlp.eqiad.wmflabs [23:37:11] !log math Removed myself from project members [23:44:06] jeremyb, andrewbogott_afk: morebots seems to be missing from this channel.