[00:00:06] !ping [00:00:06] !pong [00:24:52] 3Wikimedia Labs / 3tools: jsub with a number as the value of -N argument fails silently - 10https://bugzilla.wikimedia.org/63369#c1 (10Tim Landscheidt) 5NEW>3RESO/INV jsub doesn't fail silently, it just directs its error messages by default to 1.err; you can override this with -stderr: | scfc@tools-logi... [02:33:12] Hi, anyone can give a hint on the name of the `toolserver` db on labs? I'm quite confused by the comments in bug 48625 [02:33:45] jimmyxu: the db name is "meta_p" [02:34:26] legoktm: erm, I'm looking for the `toolserver.namespacename` table [02:34:45] I'm not sure that table exists. [02:35:12] MariaDB [meta_p]> show tables; [02:35:12] +------------------+ [02:35:13] | Tables_in_meta_p | [02:35:13] +------------------+ [02:35:13] | legacy | [02:35:14] | wiki | [02:35:15] +------------------+ [02:35:25] bug 48625 is FIXED, but I can't find where the table now lies... [02:38:38] jimmyxu: I also think that the bug was marked FIXED prematurely, but I haven't investigated further. [02:40:27] s51892_toolserverdb -- seems like it [02:41:00] scfc_de: hope it'd get merged into meta_p or something without a s** prefix [02:46:00] jimmyxu: Could you reopen the bug for tracking that, please? [02:47:26] 3Wikimedia Labs / 3tools: Provide namespace IDs and names in the databases similar to toolserver.namespace - 10https://bugzilla.wikimedia.org/48625#c40 (10Jimmy Xu) 5RESO/FIX>3REOP Reopening, would this be merged into meta_p or renamed without a s**_ prefix? [03:07:52] 3Wikimedia Labs / 3Infrastructure: Database upgrade MariaDB 10: Key: user_timestamp missing from archive table - 10https://bugzilla.wikimedia.org/68912#c1 (10Sean Pringle) 5UNCO>3RESO/FIX Index restored. [10:42:16] On action=configure, has an encoding error [10:42:37] We get   in the output [14:11:40] New labs user here with a question. [14:13:36] So I'm currently using labs as the platform that I will be coding my extension on but to code that extension with the best base framework for testing, I need to run three simultaneous MW instances. [14:13:47] *Whoops. I mean't tools [14:15:59] Negative24: so install them in seperate directories? [14:16:40] Well. I'm kind of wondering if setting up a project rather than a tool was a better idea. [14:17:16] More flexibility. Better web host. More like real life. [14:21:20] Just more control which I think may be better in actual MW work rather than tool/bot work [14:22:36] How would it be a 'better web host' or 'more like real life'? I'd think you just need a web server with php, which is what TL provides you. [14:23:09] I'm also unsure why you think the 'more control' would be useful for your task, as that control would mostly be on the level of web server/php tuning, which is out of reach for most php users anyway [14:26:15] I was kind of talking about the puppet configs and security groups. Are you suggesting I stay with TL? [14:28:07] How would those help for writing your extension...? [14:28:54] yeah, unless there is a reason to, I'd stay away from managing your own instances - it's more work and you're unlikely to gain anything from it [14:29:45] Sounds good. It just sounded like TL was for 3rd party tools and bots not real MW work. [14:32:10] Thanks for the help. [14:56:09] 3Wikimedia Labs / 3tools: Install package: python-pygments (syntax highlighting) - 10https://bugzilla.wikimedia.org/69050 (10Tim Landscheidt) a:5Marc A. Pelletier>3metatron [15:01:23] 3Wikimedia Labs / 3tools: Install lighttpd binary mod_magnet.so - 10https://bugzilla.wikimedia.org/68614 (10Tim Landscheidt) a:5Marc A. Pelletier>3metatron [15:03:08] 3Wikimedia Labs / 3tools: Install Linux kernel AIO access library: libaio (libaio1) - 10https://bugzilla.wikimedia.org/68615 (10Tim Landscheidt) a:5Marc A. Pelletier>3metatron [15:04:08] 3Wikimedia Labs / 3tools: Install tmux on tools-login and tools-dev - 10https://bugzilla.wikimedia.org/65426 (10Tim Landscheidt) 5PATC>3RESO/FIX [15:12:23] 3Wikimedia Labs / 3tools: Packages to be added to toollabs puppet - 10https://bugzilla.wikimedia.org/53704 (10Tim Landscheidt) [15:12:24] 3Wikimedia Labs / 3tools: install GD perl lib - 10https://bugzilla.wikimedia.org/67199 (10Tim Landscheidt) 5NEW>3ASSI a:5Marc A. Pelletier>3Tim Landscheidt [15:22:53] 3Wikimedia Labs / 3tools: 403 error on PHP script - 10https://bugzilla.wikimedia.org/68499 (10Tim Landscheidt) 5PATC>3RESO/FIX a:5Marc A. Pelletier>3metatron [15:44:08] 3Wikimedia Labs / 3tools: Useful graphite metrics to be tracked for Tool labs (tracking) - 10https://bugzilla.wikimedia.org/67879 (10Tim Landscheidt) [15:44:11] 3Wikimedia Labs / 3tools: Monitor mail system in Graphite - 10https://bugzilla.wikimedia.org/69072 (10Tim Landscheidt) 3NEW p:3Unprio s:3normal a:3Yuvi Panda In Ganglia, we monitored: - "exim messages in", - "exim messages out", - "exim deferred delivery", - "exim failed delivery", - "exim suppresse... [15:45:37] 3Wikimedia Labs / 3tools: Monitor mail system in Graphite - 10https://bugzilla.wikimedia.org/69072#c1 (10Yuvi Panda) Should probably be done with a diamond module. [15:46:37] 3Wikimedia Labs / 3tools: Old version of webservice script on tools-dev - 10https://bugzilla.wikimedia.org/66845 (10Tim Landscheidt) 5PATC>3RESO/FIX [15:47:31] YuviPanda: What's the correct lingo? Diamond = agnostic collector on the hosts? Graphite = one of several receiving ends for that? [15:47:51] scfc_de: yeah, diamond is the collector that runs on each host. graphite is one box that receives and displays them [15:48:00] scfc_de: right now, graphite is the only thing that receives [15:48:07] it's all carbon anyway ;-) [15:48:26] scfc_de: there's also a txstatsd in the middle. so technically, 1. diamond, -> 2. txstatds, -> 3. graphite [15:48:32] valhallasw`cloud: indeed, carbon is actually part of grpahite [15:49:10] scfc_de: eventual hope is to not need ganglia at all anywhere. I'll have to build a dashboard generator thing for graphite at some point [15:49:18] scfc_de: awaiting me getting access to labmon1001 :) [15:49:25] YuviPanda: you were writing something to interface with it, right? Call it buckyball ;-) [15:49:40] Uh, complicated. And they all speak standard protocols between themselves so they can be interchanged? [15:49:46] scfc_de: yup [15:50:02] scfc_de: it's not *that* complicated, though. the protocol is rather super simple [15:50:07] and well used / understood [15:50:30] valhallasw`cloud: heh :D just going to use... giraffe for graphing [15:50:48] but giraffes are not made out of carbon ;-p [15:50:54] well, they are partially [15:50:57] valhallasw`cloud: all life has carbon [15:51:08] valhallasw`cloud: giraffe is made out of rickshaw, actually :D [15:51:08] YuviPanda: Then why can't we just point the Ganglia clients to the Graphite receiver and be happy? :-) [15:51:30] scfc_de: our ganglia instance is not very puppetized :) plus that's just way too heavyweight IMO [16:57:38] \o/\o/\o/\o/\o/\o/\o/\o/ [16:57:51] YuviPanda: in-cre-di-buuul [16:58:25] YuviPanda: see the new fancy+ Optimizer http://tools.wmflabs.org/tools-info/optimizer.py [16:59:21] It's real-time, no snapshots, bare metal [17:01:48] YuviPanda: I'm going to add some lines, ad take over quarry :P [17:06:44] any known trouble with nginx atm ? I needed to do a webservice restart twice in the last few hour, llighttpd no longer received any request from nginx, but lighhttpd received and handled request from the internal internal proxy [18:47:56] 3Tool Labs tools / 3[other]: merl tools (tracking) - 10https://bugzilla.wikimedia.org/67556 (10merl) [18:47:56] 3Wikimedia Labs / 3tools: Database access to spam-blacklist log - 10https://bugzilla.wikimedia.org/69077 (10merl) 3NEW p:3Unprio s:3enhanc a:3Marc A. Pelletier For extending one of my tool (bot), i would like to have access to log entries caused by local and global spam-blacklist blocking. On wikiped... [18:47:56] 3Wikimedia Labs / 3(other): (Tracking) Database replication services - 10https://bugzilla.wikimedia.org/48930 (10merl) [18:50:09] 3Wikimedia Labs / 3tools: Database access to spam-blacklist log - 10https://bugzilla.wikimedia.org/69077#c1 (10Kunal Mehta (Legoktm)) 5NEW>3RESO/WOR eMariaDB [enwiki_p]> select * from logging where log_type="spamblacklist" limit 2; +----------+---------------+------------+----------------+----------+----... [18:51:17] nice hack on wikibugs [18:51:44] greg-g: hmm? [18:55:41] phe: What's the tool's name? [18:56:47] YuviPanda: that long line of ----------------+-------------- [18:56:51] ah [18:56:51] right [18:56:54] mariadb output [18:56:56] yeah [19:36:18] Any chance of having php5-imagick installed on Tool Labs? [19:36:50] your chance is pretty good if you file a bug :) [19:37:09] 3Wikimedia Labs / 3tools: libvips-tools, libtiff etc install - 10https://bugzilla.wikimedia.org/52717 (10Tim Landscheidt) 5ASSI>3RESO/FIX [19:38:38] 3Wikimedia Labs / 3tools: tools-dev's Puppet status is "failed" - 10https://bugzilla.wikimedia.org/63439 (10Tim Landscheidt) 5NEW>3RESO/FIX [19:38:38] 3Wikimedia Labs / 3tools: tools-login's Puppet status is "failed" - 10https://bugzilla.wikimedia.org/63438 (10Tim Landscheidt) 5NEW>3RESO/FIX [19:39:43] cool, I'll do that [19:41:54] 3Wikimedia Labs / 3tools: Please install php5-imagick on Tool Labs - 10https://bugzilla.wikimedia.org/69078 (10Dan Michael Heggø) 3UNCO p:3Unprio s:3normal a:3Marc A. Pelletier It would be very useful for my CropTool. ImageMagick is already installed. [19:48:09] 3Wikimedia Labs / 3tools: Upgrade node and npm on Tool Labs - 10https://bugzilla.wikimedia.org/69079 (10Dan Michael Heggø) 3UNCO p:3Unprio s:3normal a:3Marc A. Pelletier (partly copy-paste from http://comments.gmane.org/gmane.org.wikimedia.labs/2780) The version of npm/node currently installed is no... [19:51:07] 3Wikimedia Labs / 3tools: Upgrade node and npm on Tool Labs - 10https://bugzilla.wikimedia.org/69079#c1 (10Yuvi Panda) Hmm, I suspect we'll have to find a newer package of nodejs for precise and get it on toollabs. Other option is to setup a bunch of nodes that run trusty, and let tool authors specify that... [19:55:01] hedonil: yay :) [19:55:18] YuviPanda: yay, yay, yay ;-) [19:55:21] hedonil: can I do a feature request? is it possible for me to set a query parameter with an SQL query and you can prefil the textbox with it? [19:55:44] hedonil: so I can setup an 'analyze with Hedonil\'s optimizer' link in quarry, and clicking that will prepopulate the query and open another tab and they can click analyze [19:56:10] * hedonil works [19:56:33] hedonil: \o/ [19:56:42] hedonil: I'm flying out in about 6hours, so will add it after [19:56:58] YuviPanda: Wikimania? [19:57:01] hedonil: ya [19:57:13] lucky one :/ [19:57:19] inorite :( [19:57:53] hedonil: btw, there's a research hackathon, and you might be interested as well [19:58:09] hedonil: maybe even hack on Quarry! :D [20:05:08] YuviPanda: shoud work now [20:05:11] http://tools.wmflabs.org/tools-info/optimizer.py?text=Select%20*%0Afrom%20logging_userindex%0Awhere%20log_user_text=%27YuviPanda%27 [20:05:15] wheeee [20:05:17] thanks :) [20:05:39] my pleasure ;-) [20:06:58] hedonil: is the optimizer specifically aimed for labs? Or can it be used for general mediawiki development...? [20:07:39] legoktm: whatever you can/want to do with it [20:08:08] I mean, is it optimizing for labs specific things like _userindex and stuff? [20:09:10] legoktm: no it's just an additional feature to show the current table/view definitions from daily dumps [20:09:19] ok [20:09:20] :D [20:10:07] legoktm: fork it, if you want /data/project/tools-info/public_html/optimizer.py [20:10:15] it's only a few lines of code [20:10:18] I'll take a look when I have some more time [20:12:31] hedonil: btw [20:12:34] Select * from page; [20:12:35] Select * from revision; [20:12:36] fails [20:12:44] since oursql doesn't support that kinda multiple queries :( [20:13:23] multi query doesn't work at all iirc [20:13:35] * hedonil tries UNION [20:14:55] hedonil: also, I think you can use dbexec.thread_id() for the connection id [20:15:01] at least with pymysql, which is what I use [20:15:43] YuviPanda: yeah, I just used small oursql, which doesn't provide much connection info [20:15:52] right [20:15:58] * YuviPanda should get pymysql installed on toollabs [20:16:45] Hmm, UNION works [20:16:46] Select page_id from page [20:16:46] UNION [20:16:46] Select rev_id, '' from revision [20:17:12] ... but you have to add an additional empty column on the second statement [20:17:37] because of the invisible hackz ;-) [20:18:31] hedonil: heh [20:18:36] hedonil: I think not supporting multiple statements is fine [20:19:05] Hello again. [20:19:14] YuviPanda: I think the same way [20:19:32] hedonil: :) right. I'm unsure how to integrate this with Quarry, though, since it supports multi statements [20:20:32] YuviPanda: A job for releases v20ff. hehe [20:20:37] hedonil: :D [20:26:56] I think my webservice has quit on TL. It's giving me: queue instance "task@tools-exec-07.eqiad.wmflabs" dropped because it is temporarily not available [20:29:05] scfc_de: ^ [20:30:49] this sounds normal to me [20:31:38] gifti: Well its serving my index.html (which is blank to test) but isn't serving my MW instance in a subdir [20:31:42] Negative24, it only mean your web server will not run on instance tools-exec-07.eqiad.wmflabs, there is other instance available [20:32:18] phe: How do I switch instances? [20:33:30] it doesn't switch but queue not available doesn't mean the instance is dead [20:34:01] Negative24: it's a kind of automatism, restart until it hits the right queue ... ;-) [20:34:59] grid looks fine $qhost -q [20:35:56] I'm just wondering why it serve my index.html but not my MW instance [20:36:19] Negative24: toolname ? [20:37:21] hedonil: custom-utils MW in public_html/orig-tw [20:41:24] The weird thing is that my MW was showing up when going through the install but wouldn't work after I uploaded the LocalSettings.php [20:43:37] Negative24: well, lighty works, php works - seems to be your MW config :/ [20:43:45] Negative24: IIRC PHP is rather silent unless you enable some debugging. [20:44:44] http://tools.wmflabs.org/custom-utils/orig-tw/ gives me "LocalSettings.php not found." [20:45:12] Yea. I just moved it to a new name to test [20:45:42] Also, keep in mind that wikis on Tools/Labs need to be properly locked up, i. e. no anonymous editing or registration as otherwise spammers will hit very hard. [20:46:20] Just moved it back and suddenly I can't connect. Well it seems to be a problem on my end. scfc_de: Yup. Already locked up. (If I could get the LocalSettings.php working) [20:48:43] Maybe this will help: -rw-r--r-- 1 tools.custom-utils tools.custom-utils 4710 Aug 3 20:47 LocalSettings.php [20:49:05] Oh. Duh +x [20:52:16] I forget. Does LocalSettings.php have to be 775 or 755? I never really had to deal with permissions on MW before. [20:52:53] I don't think it needs to be executable at all. Could it be that MW is complaining because it is world-readable (but contains PWs & Co.)? [20:54:10] Maybe. How would I fix that [20:54:31] I use jlocal from a cron job to be able to submit jobs to sge, I use a user DB and I get: [20:54:36] _mysql_exceptions.OperationalError: (1129, "Host '10.68.17.1' is blocked because of many connection errors; unblock with 'mysqladmin flush-hosts'") [20:55:25] Negative24: "chmod o-r LocalSettings.php" [20:56:40] I just set it to 664 (-rw-rw-r--) [20:56:53] Negative24: That's still world-readable. [20:57:25] Whoops. Didn't see your message there. Now set to 660 [20:58:45] phe: I see the same error (on tools-submit, "mysql -htools-db"). springle, already Monday in AU? :-) [20:59:20] scfc_de, it's not intended, I can expect it'll work ? [20:59:22] 3Wikimedia Labs / 3tools: Set up Icinga monitoring for mail queue - 10https://bugzilla.wikimedia.org/58871 (10Tim Landscheidt) 5PATC>3NEW [21:02:22] 3Wikimedia Labs / 3tools: Monitor mail system in Graphite - 10https://bugzilla.wikimedia.org/69072#c2 (10Tim Landscheidt) (Gerrit change #143111 added a collector for exim, but I don't see it at http://graphite.wmflabs.org/ under tools-mail.) [21:03:03] phe: Hmmm. This could be one of those iptables changes that haven't been applied to that host. Let me check. [21:07:05] phe: On second thought: No, that can't be it because tools-db has a regular IP with no NAT. Could you file a bug for that, please? [21:07:17] *that = no connection from tools-submit to tools-db. [21:07:25] scfc_de: need to make 'get access to labsdb' be a puppet role [21:07:30] * YuviPanda has been meaning to do that forever [21:07:36] ferm, and some way of managing /etc/hosts [21:08:36] scfc_de, ok [21:08:47] YuviPanda: I'd prefer https://bugzilla.wikimedia.org/61897 ("Move LabsDB aliases and NAT to DNS and LabsDB servers"). I think you can find my futile attempts with ferm still in Gerrit :-). [21:09:42] scfc_de: let me see if I can wrangle up the folks at wikimania itself [21:09:44] scfc_de: will you be coming? [21:09:54] YuviPanda: No. [21:10:00] aww [21:11:52] 3Wikimedia Labs / 3tools: Puppet is stuck due to openjdk-7-jre-headless - 10https://bugzilla.wikimedia.org/63823#c5 (10Tim Landscheidt) 5NEW>3RESO/FIX I don't think this got resolved intentionally, but Puppet runs clean at the moment, so closing for now (and hopefully not reopening it any time soon :-)). [21:12:38] 3Wikimedia Labs / 3Infrastructure: Move LabsDB aliases and NAT to DNS and LabsDB servers - 10https://bugzilla.wikimedia.org/61897 (10Tim Landscheidt) [21:12:38] 3Wikimedia Labs / 3tools: Make the iptables initialization occur at boot time - 10https://bugzilla.wikimedia.org/53181 (10Tim Landscheidt) [21:14:29] Interesting. "See also" is reciprocal in Bugzilla. [21:14:42] see all the things? :) [21:15:39] 3Wikimedia Labs / 3tools: Unable to access user database from tools-submit host - 10https://bugzilla.wikimedia.org/69081 (10Philippe Elie) 3NEW p:3Unprio s:3major a:3Marc A. Pelletier jlocal allow to run cron job directly on tools-submit, that's a work-arpund for #54786 , but actually this workaround... [21:21:01] Can someone point me at some documentation describing how MW has to be configured in order for it to work on TL? [21:21:28] Negative24: I think you're better off using labs-vagrant in a separate project. [21:22:23] Are there special configs for it to work? [21:22:37] or just easier because puppet is doing everything? [21:23:44] mainly easier because puppet sets up apache, redis, etc to work specifically with MediaWiki [21:24:04] and toollabs isn't exactly a standard mediawiki setup. no apache, for once. [21:24:11] Does MW need apache or can it work with TL's web service? [21:24:13] so you'll probably keep running into bumps [21:25:23] Should I switch to a project for my extension coding or should I stick with TL? [21:26:41] * YuviPanda suggests asking for a new project [21:26:53] Tools provides a working PHP environment, and other users have set up wikis here. It's hard to tell what the obstacles are. [21:27:38] I think Tools should make installing MW easier for developers instead of suggesting them to take the hard route 'create a new project' [21:27:47] valhallasw`cloud: +1, but right now.... [21:28:08] valhallasw`cloud: also, I'd want that to be a separate project to help setup test mw instances, and not part of tools. [21:28:20] I see. Yes, that could make sense. [21:28:51] valhallasw`cloud: I actually have more expertise with VMs, networking, etc.. So it wouldn't be as hard as you think. [21:29:01] For me at least. [21:29:22] Negative24: hmyes. Well, if you do take that route in the end, please document it :-) [21:29:49] valhallasw`cloud: the TL or project route? [21:29:53] https://wikitech.wikimedia.org/wiki/Labs-vagrant [21:29:54] :D [21:29:56] well, both I guess [21:30:09] YuviPanda: saw that. Looks nice. [21:30:11] oh, well, that's nice [21:30:17] I missed that one [21:31:07] or https://wikitech.wikimedia.org/wiki/Help:Single_Node_MediaWiki [21:31:42] Negative24: don't use that, it's unmaintained atm [21:31:47] * YuviPanda puts a deprecation warning [21:32:10] * Negative24 likes how YuviPanda uses /mes [21:32:27] :) [21:37:15] Looks like I'll put in a new project request and research into getting TL better for MW instances. [21:37:28] or a new project all together. [21:39:03] YuviPanda: the warning would be most useful in the [?] popup of the configuration special page [21:39:16] I suppose it's some bit of code documentation somewhere but I have no idea where [21:39:20] Nemo_bis: yeah, should add [21:39:23] Nemo_bis: heh, me neither [21:40:18] Negative24: What were the problems you were running into? [21:40:50] scfc_de: Wiki not showing up after uploading LocalSettings.php. Setup worked fine. [21:41:12] Negative24: And what was the cause for that? [21:42:36] Idk. We were trying to figure it out before but IRC got side-tracked so I began to pursue further on my own but I reached a dead end. Eventually turning my tool into a project came up. [21:42:54] So here we are. [21:47:20] I just turned in my project request form. [21:56:23] 3Wikimedia Labs / 3tools: Packages to be added to toollabs puppet - 10https://bugzilla.wikimedia.org/53704 (10Tim Landscheidt) [21:56:23] 3Wikimedia Labs / 3tools: Install rake for Tools Labs - 10https://bugzilla.wikimedia.org/68208 (10Tim Landscheidt) [21:56:38] Negative24: w00t. poke andrewbogott_afk when he's aroudn? [21:56:41] usually US EST [21:56:52] 3Wikimedia Labs / 3tools: install gawk libyaml-dev libgdbm-dev libncurses5-dev bison libffi-dev - 10https://bugzilla.wikimedia.org/65974 (10Tim Landscheidt) 5PATC>3RESO/FIX [21:57:37] YuviPanda: What? [21:57:47] Negative24: to approve the project [21:58:02] * YuviPanda doesn't have rights to approve projects yet [21:58:43] That's too bad. [21:59:00] yeah :( [21:59:21] What's really confusing is the categories at the bottom of request forms. They seem to be severely outdated. [21:59:38] Look at this: https://wikitech.wikimedia.org/wiki/Category:New_Project_Requests [21:59:46] I don't think those are all new [22:00:08] In fact I know for sure they aren't all new. [22:00:34] They were at some point :-). But "Labs Project Requests" would suit it better, I think. [22:01:42] I think there is a special page that lists the uncompleted requests. I think the categories should be taken down. They are a little misleading. I was shocked to see so many requests in that category. [22:02:16] * Negative24 is adding too many things to his to do list :( [22:05:31] hedonil: ping [22:05:41] hedonil: can you explain to me a little more about how the optimizer works? [22:06:41] hedonil: are you just running the query in a thread for a second, running 'explain' on that, and then killing it? [22:11:04] YuviPanda: Does MW require Apache? [22:11:24] * Negative24 thinks his stupidity is starting to show. [22:11:24] Negative24: no, it doesn't really. [22:11:31] Negative24: but that's how it's usually deployed. [22:11:48] Ok. Going to go back to tinkering... [22:12:25] :) [22:51:10] YuviPanda: The only thing I can see that would cause MW to not work is a php error. The most likely one being a php.ini config error. Do you have the path to the php.ini on tools? [22:51:19] scfc_de: ^ [22:51:22] I'm unsure :| [22:52:41] I'm guessing it's /etc/php5/cli [22:54:41] Yup. Should have run php --ini before I asked. [23:11:43] Negative24: But the URL I linked above worked; it just failed at locating LocalSettings.php. [23:12:28] scfc_de: The link to my tool? [23:14:51] Negative24: Yes, http://tools.wmflabs.org/custom-utils/orig-tw/. That clearly showed PHP working. [23:15:47] I was specifically looking at a MySql in php being wrong not php being broken. [23:16:16] I'm looking at https://www.mediawiki.org/wiki/Manual:Errors_and_symptoms#You_see_a_Blank_Page [23:58:08] 3Wikimedia Labs / 3tools: Packages to be added to toollabs puppet - 10https://bugzilla.wikimedia.org/53704 (10Tim Landscheidt) [23:58:09] 3Wikimedia Labs / 3tools: Please install php5-imagick on Tool Labs - 10https://bugzilla.wikimedia.org/69078 (10Tim Landscheidt) 5UNCO>3ASSI a:5Marc A. Pelletier>3Tim Landscheidt