[01:07:16] !bugs [01:13:31] features [01:16:55] (03PS1) 10JanZerebecki: Document that via gitblit this repository is publicly accessible: https://git.wikimedia.org/tree/labs%2Fprivate [labs/private] - 10https://gerrit.wikimedia.org/r/111945 [01:18:11] (03PS2) 10JanZerebecki: Document that via gitblit this repository is publicly accessible. [labs/private] - 10https://gerrit.wikimedia.org/r/111945 [01:21:18] :| [02:37:37] is it by design that newly created instances do not have any swap space? [02:38:41] my instance fastcci-worker1 just ran out of mem to the point where a malloc returned 0 [02:39:23] free shows buffers and caches taking up a fair bit [02:40:51] uaahhhh, mayday [02:41:07] now, after reboot, I cannot log in anymore :-( [02:42:19] immediate connection closed [02:42:26] andrewbogott, maybe? [02:43:11] dschwen_: what is your project and instance name? [02:43:16] console output (Special:NovaInstance) shows a login prompt [02:43:25] fastcci-worker1 [02:43:31] fastcci is the project [02:45:01] it is not just login that doesn't work, the websocket server on there is not responding either [02:49:59] try login again? [02:51:43] boom, works! [02:51:48] what happened? [02:52:18] I restarted the gluster home volume. Not sure if that was the problem. [02:52:21] But, glad it's working now! [02:52:32] oh god [02:52:38] where is my data [02:52:49] home is empty [02:53:24] :-( [02:53:43] should I rebuild or is there a chance I get my homedir back? [02:54:06] um... [02:55:48] So, here's what happened (at least in part): [02:56:05] Your project ought to have shared homedirs across instances. Most likely because you requested that when your project was created. [02:56:19] ok [02:56:26] But, something went wrong, and homedirs weren't shared; you had a local homedir instead. [02:56:32] Right now everything is as it should be (shared homedirs) [02:56:33] yay [02:56:42] but I guess you stowed some data in the local homedir earler? [02:56:44] earlier? [02:56:45] yep [02:56:51] a bit [02:56:52] So, it's still there, just masked by the shared homedir. [02:56:57] hm [02:57:08] can we switch off the sharing then? [02:57:17] Any important data should generally be stored in /data/project anyway. [02:57:23] yeah [02:57:32] So we can temporarily unmount the shared homedir, you can move the data, then we can turn it back on. [02:57:36] ok [02:57:36] sound ok? [02:57:38] sounds good [02:57:55] I'm not totally sure I know how to 'temporarily unmount the shared homedir' but I will try :) [02:58:29] :-) [02:58:33] can you cd out of $home? [02:59:02] I'm logged out again [02:59:15] Wait, did you log out on purpose? [02:59:17] Or were you kicked? [02:59:24] purpose [02:59:45] oh… well now I don't know if you can log in again when home isn't shared [02:59:49] but, hang on, we'll see. [02:59:50] back in and cd /data/project [02:59:56] 'k [03:02:53] cool, thats a first step [03:03:00] ok, do you see your old files now? [03:03:00] home is gone completely :) [03:03:08] yep [03:03:11] hang on... [03:04:46] copying [03:04:52] there is quite a bit of data [03:07:47] almost done... [03:08:19] ok, done [03:08:49] ok, let's see if I can put it back :) [03:09:37] dschwen_: should be all set. Let me know if it flakes out again. [03:09:47] thx [03:09:50] big time [06:56:32] addshore: Do you know if https://wikitech.wikimedia.org/wiki/User:WikidataBuilder needs shell access? [07:47:04] fyi, https://doc.wikimedia.org/puppet/classes/__site__/role/labs/vagrant.html -> The page isn't redirecting properly [07:47:32] scfc_de: no [07:49:53] petan: Thanks. [07:50:47] Interesting, looks like the mediawiki/vagrant/Vagrantfile is incompatible with my labs Ruby [07:50:56] how the... [07:51:26] awight: Why should the page redirect? [07:52:18] scfc_de: I think it's stuck in a redirect loop or something... if this isn't a known issue, lemme take a look. [07:52:40] I'm seeing the broken link on https://wikitech.wikimedia.org/w/index.php?title=Special:NovaInstance&action=configure&instanceid=2665250c-e27b-47c2-8b73-0a80f557ce36&project=fundraising-awight®ion=pmtpa [07:52:56] weird. works now ;) [07:53:51] Those help pages are pretty terse [07:53:51] awight: "Your account is not in the project fundraising-awight." :-) I have absolutely no idea what you mean. [07:54:14] Well, nobody has documented the class role::labs::vagrant, so there's no documentation. [07:54:17] scfc_de: Well, luckily it's an unreproducible but anyway ;) [07:54:21] bug [08:24:30] Got this in puppet.log after creating a new instance: [08:24:30] info: Creating a new SSL key for i-00000906.pmtpa.wmflabs [08:24:30] err: Could not request certificate: getaddrinfo: Name or service not known [08:32:10] * awight rubs eyes. apparently the Precise package for vagrant is too old to support mediawiki/vagrant [08:40:47] awight: If you are using a standard instance on Labs, the SSL/cert should resolve after one or two Puppet runs. But what are you using Vagrant for? [08:43:29] scfc_de: I was installing vagrant to do development on stuff which has been puppetized within that environment... [08:43:56] It feels kinda wasteful. But convenient if I can get it working. [08:44:53] awight: I think ori produces the Vagrant images. You might want to query him how he does development. [08:45:46] labs::vagrant doesn't actually use vagrant... [08:46:39] YuviPanda: orly! [08:46:46] it just uses the puppet files [08:46:50] yarly [08:46:52] great to hear [08:46:53] just uses the puppet files [08:47:19] awight: in fact, if you are already on a linux machine locally, you can just use the puppet files from vagrant without having to use a VM [08:47:40] I did try that a few months ago, but it sort of trashed my laptop :/ [08:48:51] Along those lines... the production/dev puppet discussion is exciting. [08:51:35] awight: heh, yeah. nobody has tried it yet [09:09:16] scfc_de: no [09:09:30] ie. no it doesnt [09:22:58] addshore: Thanks. [09:23:30] no problem :) just needed a gerrit account :) [11:42:06] andrewbogott_afk: make a new project for me when you are around? :) [14:16:02] andrewbogott_afk: https://wikitech.wikimedia.org/wiki/New_Project_Request/design when you have the time [14:28:42] (03CR) 10Hashar: [C: 031] Document that via gitblit this repository is publicly accessible. [labs/private] - 10https://gerrit.wikimedia.org/r/111945 (owner: 10JanZerebecki) [15:51:05] Change on 12mediawiki a page Wikimedia Labs/Tool Labs/List of Toolserver Tools was modified, changed by Nemo bis link https://www.mediawiki.org/w/index.php?diff=901056 edit summary: add bugzilla template as apparently that's where stuff goes [16:11:23] Change on 12mediawiki a page Wikimedia Labs/Tool Labs/List of Toolserver Tools was modified, changed by Nemo bis link https://www.mediawiki.org/w/index.php?diff=901063 edit summary: johang and some links [16:40:35] (03CR) 10Chad: [C: 032 V: 032] Document that via gitblit this repository is publicly accessible. [labs/private] - 10https://gerrit.wikimedia.org/r/111945 (owner: 10JanZerebecki) [17:39:22] andrewbogott: around? [17:39:31] YuviPanda: barely [17:39:32] what's up? [17:39:43] andrewbogott: new project. for the *gasp* design team [17:39:53] andrewbogott: https://wikitech.wikimedia.org/wiki/New_Project_Request/design [17:41:05] YuviPanda, don't forget to configure your project defaults before creating instances. [17:41:16] andrewbogott: yup! I'll poke around. [17:41:18] created? [17:41:26] https://wikitech.wikimedia.org/w/index.php?title=Special:NovaProject&action=configureproject&projectname=design [17:41:34] doing now [17:41:35] whee [17:41:38] I guess there are really only two settings there :) [17:41:45] andrewbogott: I am ticking bot of 'em [17:41:57] That's what I would do :) [17:41:59] yeah [17:42:23] andrewbogott: woo, thanks :) [18:01:05] hello there [18:01:34] I have just created a new tool but cannot see the public_html folder in my tools account [18:05:16] hello? [18:08:23] anyone there? [18:13:19] hello? [18:17:22] Superyetkin: What's your tool's name? [18:18:11] superyetkin [18:18:19] my tool's name is superyetkin [18:18:48] by the way, nice to hear from you again, scfc [18:19:15] /data/project/superyetkin/public_html exists? [18:20:03] I have connected to tools-login.wmflabs via WinSCP [18:20:09] am I missing something? [18:20:28] Does /data/project/superyetkin/public_html exist for you? [18:20:43] no data folder there [18:21:45] cache, .bash... etc. [18:23:01] .bash looks like if you are looking at your user's home directory. Is there really no root directory accessible in WinSCP? [18:23:02] can you look at this? [18:23:43] this is what I see there [18:23:52] brr, NFS seems broken again [18:24:09] umm [18:24:16] Superyetkin: Have you looked at https://wikitech.wikimedia.org/wiki/Help:Access_to_ToolLabs_instances_with_PuTTY_and_WinSCP#How_to_set_up_WinSCP_for_direct_access_to_your_Tool_Labs_account? [18:24:30] YuviPanda: How? [18:24:34] yes, I have follwed that to connect [18:24:44] configured winscp [18:25:04] scfc_de: I created a new instance, setup NFS, and now it gets killed after the motd [18:25:06] and created a new tool at http://tools.wmflabs.org/ [18:25:08] I remember this happening before [18:26:02] Superyetkin: "Access the root directory by clicking the root directory icon. (A folder icon with a backwards slash in the right/remote pane of WinSCP) You will now be in /." [18:26:50] YuviPanda: Don't you need to reboot the instance after that or something? [18:26:58] scfc_de: yup. you need to reboot it twice. I did that [19:06:37] Change on 12mediawiki a page OAuth详细了解有关已连接的应用程序 was created, changed by Cklim074 link https://www.mediawiki.org/w/index.php?title=OAuth%e8%af%a6%e7%bb%86%e4%ba%86%e8%a7%a3%e6%9c%89%e5%85%b3%e5%b7%b2%e8%bf%9e%e6%8e%a5%e7%9a%84%e5%ba%94%e7%94%a8%e7%a8%8b%e5%ba%8f edit summary: Created page with ":File:[[Category:{{DEFAULTSORT:#REDIRECT[[[[[[[{{–—“‘«‹„‚…~|° ≈≠≤≥±−..." [19:06:40] data/projects folder is taking too long, times out... [19:06:59] scfc [19:22:10] where am I suppoed to put my PHP files? no matter what I do, I get "internal server error" [19:22:31] is the "public_html" folder the answer? [19:26:37] hello? [19:28:22] Superyetkin: yes [19:28:46] public_html does not work [19:28:59] what could be the issue? [19:29:01] then there's probably an error in your error.log. [19:29:15] where is that? [19:29:18] cannot find it [19:29:30] ~/error.log [19:29:42] does not exist... [19:29:47] Superyetkin: You're using Apache; only with lighttpd do you have an ~/error.log. Type "webservice start". [19:30:08] Err, there should be an error log [19:30:12] where to type it? I am using winscp [19:30:13] maybe under a different name, though [19:30:45] valhallasw: No, webserver errors with Apache are accessible by roots only. [19:30:49] php_error.log [19:31:17] does not exist for me [19:31:26] did you refresh the directory in winscp? [19:31:33] Superyetkin: You need to log into tools-login.wmflabs.org for that, "become superyetkin", "webservice start". [19:31:34] the file "index.html" loads as expected, but a simple PHP file fails [19:32:27] hm, no php_error.log indeed. Strange. [19:33:12] Superyetkin: "[Fri Feb 07 19:32:47 2014] [error] [client 10.4.1.89] File does not exist: /data/project/superyetkin/public_html/libs, referer: http://tools.wmflabs.org/superyetkin/a.php" [19:33:43] scfc, YOU ROCK [19:33:49] http://tools.wmflabs.org/superyetkin/a.php works now :) [19:34:58] scfc_de: that's really weird. Check /data/project/superyetkin/public_html/a.php -- there's just an echo. No .htaccess either. [19:35:06] so I'm not sure why apache would not just work [19:35:37] now will try to make a databae connection [19:36:09] what about the database name? [19:36:19] hostname, sorry [19:36:46] Superyetkin: https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/Help#Database_access [19:37:29] valhallasw: You're right; I don't understand where the error came from either. [19:37:35] basically: projectname.labsdb [19:38:09] trwiki_p.labsdb? [19:38:33] tswiki.labsdb according to the docs I linked. [19:38:43] trwiki.labsdb [21:21:08] Change on 12mediawiki a page OAuth详细了解有关已连接的应用程序 was modified, changed by Wargo link https://www.mediawiki.org/w/index.php?diff=901262 edit summary: Candidate for deletion [21:46:41] NFS having issues again on tool labs? [21:46:57] hm, working again. Maybe just a network hickup [21:49:34] zz_yuvipanda: Where should I file requests for adding stuff to your https proxy? [21:49:44] (e.g. tacking ganglia.wmflabs.org to it) [21:57:21] Krinkle: Isn't that handled by "Manage Web Proxies" on wikitech? [21:58:54] scfc_de: Does it automatically pick up on stuff without needing anything on his end? [21:59:12] Your'e saying the project admin of ganglia can just point it at his project and it'd work? [21:59:42] I only went through this procces once, for cvn.wmflabs.org, and I think there was a step involved that required him to do an action. [21:59:55] And since it takes over non-https http as well, I'd rather not have down time [22:01:01] Krinkle: I haven't done it myself, so I don't know what the status is. [22:01:42] Krinkle: Perhaps try it with ganglia2.wmflabs.org and delete that afterwards? [22:34:24] hi notconfusing! I've been enjoying your blog posts [22:34:36] sumanah, thanks [22:35:35] i have some more in the pipeline too - ipython has really accelerated my flow [22:36:08] :D [22:54:12] * valhallasw shows off http://tools.wmflabs.org/tsreports/?wiki=enwiki and points to the 'A cached version of this report, 4 weeks, 5 days, 7 hours, 53 minutes, 42 seconds old, is available. A new version will be prepared if you view the current report, and will be ready in approximately 15 minutes, 1 second.' line [22:54:26] (not entirely happy with the i18n, but that's a project for another day) [23:19:08] Can I write the results of a query to the filesystem when connected to a replica database? [23:20:10] cff: I think yes, but within a directory you have privileges in, of course [23:20:44] sumanah: I've tried writing to my home or /tmp but it says ERROR 1045 (28000): Access denied for user 'uxxxx'@'%' (using password: YES) [23:21:13] I'm trying to write directly from SQL to a file [23:21:19] cff: ah, I see what you mean .... hmm, I have been able to write a script in Python that uses the mysqldb library to grab data and then write it to a local file [23:21:32] cff: no, that's not allowed, as that would write on the server (not the client) [23:21:45] you can, however, use \T, I think [23:23:25] And if you're using "mysql -e ...", for many rows it's best to add "--quiet" to reduce memory consumption. [23:25:55] scfc_de: mysql doesn't seem to have that option [23:26:08] scfc_de: --quiet, that is [23:27:04] Oh, I meant --quick.