[00:13:21] [bz] (8RESOLVED - created by: 2Nemo, priority: 4Normal - 6major) [Bug 53987] sulinfo is unusable (takes tens of seconds) - https://bugzilla.wikimedia.org/show_bug.cgi?id=53987 [00:39:00] Ryan_Lane: hey :-) last week you told me our puppet does not have 'gems' as a package provider? Is that a technical limitation on labs or a switch we could enable? [03:19:25] [bz] (8NEW - created by: 2Nemo, priority: 4Normal - 6normal) [Bug 44756] [Errors 301] Many entry URLs to be updated - https://bugzilla.wikimedia.org/show_bug.cgi?id=44756 [04:13:14] [bz] (8NEW - created by: 2Nemo, priority: 4Normal - 6normal) [Bug 44756] wikistats: Update entry URLs for wikis that redirect elsewhere or no longer exist - https://bugzilla.wikimedia.org/show_bug.cgi?id=44756 [05:54:06] [bz] (8REOPENED - created by: 2Nemo, priority: 4Normal - 6major) [Bug 53987] sulinfo is unusable (takes tens of seconds) - https://bugzilla.wikimedia.org/show_bug.cgi?id=53987 [05:54:07] [bz] (8NEW - created by: 2Nemo, priority: 4Normal - 6normal) [Bug 44756] [Errors 301] wikistats: Update entry URLs for wikis that redirect elsewhere or no longer exist - https://bugzilla.wikimedia.org/show_bug.cgi?id=44756 [10:41:08] hi, I applied yesterday for tool labs access and haven't heard anything so far.. should I have gotten a response by now or is that the normal delay? [12:29:49] hi to all. can i access to mysql database via cron? my php script return error: PHP Warning: mysqli::mysqli(): (HY000/2003): Can't connect to MySQL server on 'ukwiki.labsdb' (111) [14:54:18] hello what happened to the service groups? I can't add any new service group [14:54:22] https://wikitech.wikimedia.org/w/index.php?title=Special:NovaProject&action=addservicegroup&projectname=tools [14:55:16] petan: ^ [15:05:46] is there anyone? [15:18:26] Amir1: Special:NovaServiceGroup instead Special:NovaProject [15:18:44] rluts [15:18:49] thank you :) [16:11:34] @seen hashar [16:11:34] chrismcmahon: Last time I saw hashar they were quitting the network with reason: Quit: I am a manual virus, please copy me to your quit message. N/A at 9/18/2013 8:36:12 AM (7h35m21s ago) [16:53:17] [bz] (8NEW - created by: 2Antoine "hashar" Musso, priority: 4Normal - 6enhancement) [Bug 49779] sync articles from production wikis (css/gadgets) - https://bugzilla.wikimedia.org/show_bug.cgi?id=49779 [16:59:50] hey guys [16:59:56] I'm seeing a small problem with labsdb [16:59:59] ERROR 2003 (HY000): Can't connect to MySQL server on 'arwiki.labsdb' (111) [17:00:08] enwiki, dewiki, commonswiki, etc. all work fine [17:00:16] it's just arwiki as far as I can tell [17:01:58] this is happening on the tools box when I do "sql arwiki_p" [18:10:47] milimetric I'm getting the same error for 'sql metawiki'. You have any idea what's causing this? [18:11:05] no idea J-Mo [18:11:23] anyone in here know why arwiki and metawiki are not working on labsdb? [18:11:58] Coren: ^^? Coren will know, he's the man [18:20:26] ping Coren and Ryan_Lane. Some replicas down or blocked? arwiki and metawiki so far. Enwiki works. [19:00:36] milimetric: They /should/ be working. What is the problem you're running into? [19:01:18] thanks Coren for replying [19:01:18] local-wikimetrics@tools-login:~$ sql arwiki_p [19:01:18] ERROR 2003 (HY000): Can't connect to MySQL server on 'arwiki.labsdb' (111) [19:01:27] that's the problem, and J-Mo sees it too [19:01:42] Lemme check. [19:01:42] for contrast, enwiki_p works [19:01:50] (sorry for the delay, was in a meeting) [19:01:53] no prob! [19:02:07] now it's totally possible that I flooded it with bad connection / resource management [19:02:29] but I didn't know I had that power [19:03:30] you apparently don't know your own strenght, Coren :) [19:03:45] metawiki still not letting me in, btw [19:04:21] same error as milimetric [19:07:25] The actual DB seems ill. We're on it. [19:17:29] cool, thanks for the info Coren [19:17:51] yeah, thanks muchly [19:48:22] Coren: wassup [19:55:12] OrenBochman: Hey. [20:30:47] Coren: any eta on getting the http access fixed? [20:36:27] Betacommand: wait, what problem with http access? [20:38:27] Coren: 54052 [20:41:07] I have no idea what workaround petan might have been talking about; the fact of the matter is that thepublic IP simply cannot be reached from within the virtual network; that's a wart of openstack it's not really possible to work around. [20:41:54] Coren: petan did something with the host file [20:42:48] ... eeew. He overrides DNS with the internal IP? That's... eech. [20:45:14] Coren: but it makes things functional [20:46:38] For different values of "functional"; you're relying on some subsystem to lie to you at some point in the chain -- and that's not going to be reliable if you're talking to DNS directly (gethostent() and friends). [20:47:06] I don't even know if getaddrinfo() even checks hosts. [20:47:45] Whereas if you use 'tools-proxy' then you know you are getting exactly the thing you need. [20:52:55] \\ [22:24:21] error: commlib error: access denied (server host resolves rdata host "tools-login" as "tools-login.pmtpa.wmflabs") [22:24:22] Unable to run job: unable to contact qmaster using port 6444 on host "tools-master.pmtpa.wmflabs". [22:24:22] Exiting. [22:24:30] Coren: ^ that appeared in one of my .err files [22:54:21] legoktm: That's odd; just the one occurence? [22:54:36] let me grep my other logs, i only checked one [22:56:38] Coren: so i see it occurring in a few other logs (I grepped for 'qmaster') but unfortunately i dont have timestamps so im not sure how old they are [22:56:59] hm [22:57:05] rfc_report.err:error: commlib error: got select error (No route to host) <-- different message [22:57:50] Almost certainly related. That looks as though the queue master was unresponsive for a period -- I wish you had timestamps because then I'd know if it was during last week's brief outage in which case it would all be as expected. [22:57:57] afk for a few. [23:02:43] hm, it would be nice if timestamps got automatically appended to .err files :) [23:20:31] legoktm: All of the stuff I start on the grid starts with a 'date' command for that reason. [23:20:53] But otherwise, '.err' is just a dump of the standard error fd of the process; it's not massaged in any way. [23:21:05] (And there is no provision to do so)