[00:10:19] https://wikitech.wikimedia.org/wiki/Nova_Resource:I-0000095a how did i fill 160G of 175G?? [04:58:17] hah, there's a tool called Mono and a tool called multichill :P [05:55:43] how do i compare environment on a tool labs host that i can't log in to with e.g. tools-login? [05:56:44] jeremyb: exec_environ and dev_environ in operations/puppet.git [05:56:53] huh [05:57:08] jeremyb: those puppet files specify the environments (packages and otherwise0 [05:57:16] or maybe that's not what you were asking [05:57:17] YuviPanda: well i jjust stopped the one on the grid and i'll running it manually on -login and see if it works better [05:57:26] ok [05:57:27] :D [15:05:00] Coren: YuviPanda|away: Any idea why tools.wmflabs.org is taking like ~ 5 seconds to respond for an average http request? [15:05:17] e.g. http://tools.wmflabs.org/intuition/load.php [15:05:18] That depends what you mean by "avergae" [15:05:36] when I do `php public_html/load.php` locally on tools-login it responds instantly, so it isn't php [15:05:56] Coren: When I do `curl 'http://tools-webproxy/intuition/load.php'` from tools-login it is also slow [15:06:09] so it isn't external networking slowness either [15:07:24] I'm not sure; I've seen it before and wondered a bit; I think it's suphp startup time because: https://tools.wmflabs.org/csbot/foo.php is really fast. [15:08:16] (that uses the new webserver scheme) [15:08:25] (which you should use anyways) [15:08:35] (because it's much better) [15:09:39] ((because it supports proper error logging and FCGI for free)) [15:21:12] Coren: I don't see the difference [15:21:27] what is it I could be doing differently you recommend? [15:22:07] You don't have a webservice started. What did you do to try it? [15:22:24] More precisely, /intuition/ doesn't have one. [15:23:08] Coren: tools' webserver handles all requests to /*, including 404. You're saying individual tools can actually have their own webservice? And should do so? [15:23:19] How would I do that, and could that be handled by default for public_html ? [15:23:57] https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/Help/NewWeb [15:24:06] I just created the intuition project and exposed the php endpoints in public_html/ [15:24:44] Thx [15:25:19] In practice, for a simple php thingy in public_html, just 'webservice start' from the tool account is sufficient. [15:25:33] Coren: Do you think a plain "webservice start" from the local-intuition account will be suff^ [15:25:34] Thanks [15:26:05] Coren: webservice uses grid to ensure to keep running if it the server goes down or the tools grid is restarted? [15:26:15] Krinkle: Yep. [15:26:21] cool [15:26:37] Thanks, this is much faster. [15:52:11] Coren, do you know what happened to the idea of the archive tables becoming available? [15:53:26] Krenair: https://bugzilla.wikimedia.org/show_bug.cgi?id=49088 [15:54:31] !petan-build [15:54:31] make -j `getconf _NPROCESSORS_ONLN` deb-pkg LOCALVERSION=-custom [16:21:32] hi, can can anyone tell me if the tool http://toolserver.org/~tparis/pages/index.php is available in the wmflabs? [16:32:41] < giftpflanze> Coren: now that the ts will be shut down do you have any updates on email-addresses reachable from the outside? [16:33:15] giftpflanze: Soonish; most of the details have been worked out. [16:33:47] But it's going to be forward-only via the email address registered on Wikitech. [16:34:29] that's ok, it's no regression [19:37:01] i tried to raise file limits with /etc/security/limits.conf, seems not to work, do i have to reboot? [19:38:34] giftpflanze: you might be limited by this https://wikitech.wikimedia.org/wiki/Help:Nova-manage#Manage_project_quotas [19:40:24] i don't see anything there that prohibits that [19:40:36] Ryan_Lane? ^ [19:42:35] giftpflanze: what are you trying to do with limits.conf? [19:42:41] by default limits.conf isn't used [19:42:45] it needs to be added to the pam config [19:42:46] oh, ok [19:42:56] and you have to reboot after adding it to the pam config [19:43:04] what are you trying to do in limits? [19:43:11] can anything get lost by a reboot? [19:43:20] I don't know why we don't have pam_limits in the default pam config [19:43:32] my script needs lots of files [19:44:12] is this in tools? [19:45:06] no, dwl [19:45:23] couldn't even edit the file in tools i assume [19:45:30] well, puppet may remove pam_limits from the config [19:47:05] I thought I pushed pam_limits into the default... [19:47:36] so, if that is in pam, i can change it with limits.conf? [19:48:15] yes [19:48:34] paravoid: any reason we don't have pam_limits in common-session? [19:50:21] there is session required pam_limits.so [19:50:25] in login [19:51:17] yeah and in cron [19:51:18] and in ssh [19:51:27] maybe that's enough to cover everything necessary? [19:51:53] but it doesn't work for me nonetheless [20:22:04] giftpflanze: for sure a reboot is necessary [20:22:05] hm [20:22:09] wait [20:22:14] no, that's only if adding it to cron [20:22:20] giftpflanze: what do you have in limits.conf? [20:22:43] i tried with x1000 what ulimit says [20:23:31] gifti soft nofile 1024000 [20:23:32] gifti hard nofile 4096000 [20:25:25] yeah, that should work [20:25:30] your user needs to log out and back in [20:25:48] and any script that is running needs to be restarted in the new shell [20:27:02] erm [20:45:01] Ryan_Lane: do i have to logout completely? [20:45:10] yes [20:45:14] ah [21:02:28] Quickie: If you're in the SF office, and have frequent wifi disconnects, can you try hopping on WMF5 (same user creds, but 5Ghz channels only)... [21:03:06] (wrong channel, but stil trye) [21:26:47] Looks like s1 replication on labsdb stopped about 30 minutes ago [22:10:23] :O SEARCH_BASE="" <-- in /etc/default/autofs can take multiple entries and will use them in order [22:10:36] heh. we can have per-project autofs natively [22:14:57] oh wow, sudoers too [22:15:07] so we can have global autofs and sudoers and project specific ones [22:16:50] no need to define any labs specific sudo policies in puppet [22:17:26] Coren: ^^ [22:17:44] that probably means we didn't need hacks for autofs for /home and such :D [22:18:02] That'd be immensely cool. [22:18:05] yes [22:18:16] and if we need to test things project by project we could [22:18:29] I'm writing a presentation and started investigating this :) [22:25:24] I wish gerrit supported multiple bases :( [22:30:47] well, then all our bases would belong to it [23:01:16] Coren: do you do any code review [23:01:43] Betacommand: Depends what with; do you have a changeset you'd like me to take a look at? [23:02:13] Coren: bug 6092 [23:05:27] My familiarity in core is mostly around special pages, but I'll take a look. [23:05:54] Coren: thanks, I could really use that feature on a private wiki [23:06:20] Did you test its functionality on one? [23:07:16] Coren: No, its not my code [23:07:51] I dont know git well enough to apply that change to my local setup [23:11:48] Hi everyone. I'm trying to connect to wmflabs for the first time, but i have some difficulties doing so. [23:17:00] Guest90117: can you be more specific about what you mean by 'connect'? [23:18:46] andrewbogott: My modem cannot dial the server [23:19:19] 　well, I have an account, shell access, and bastion access (obviously), ssh public key in place, but my local pc returns (Permission denied (publickey)) each time I try to connect. [23:21:56] loaded said key into an agent/similar? [23:29:14] Guest90117: you're on windows, using putty and pageant? [23:32:04] andrewbogott : I'm on Mac OS, using Terminal. I can try on Windows, (not right now though) but I would prefer if things work also well on Mac OS. [23:32:41] OK, mac should be easier anyway... [23:33:16] Let's see… did you upload your public key to wikitech as well as to gerrit? [23:34:14] (03PS1) 10Andrew Bogott: Move default datafile to /etc/dynamicproxy-api [labs/invisible-unicorn] - 10https://gerrit.wikimedia.org/r/93619 [23:35:12] andrewbogott : yes, re: wikitech&gerrit [23:35:58] can you run ssh -v bastion1.wmflabs.org and paste the output to dpaste.org? [23:36:08] I guess I'm missing either a step, or a magic command word. [23:39:10] here : https://dpaste.de/CdnH (sorry I chose Python :( [23:39:44] Is wikitech down for anyone else? [23:40:09] It's not bastion1 [23:40:12] bastion.wmflabs.org [23:40:23] oops, apparently there's no such thing as bastion1 :) [23:40:45] ok, that makes more sense :) [23:40:54] Reedy, behold the eternal answer to that question: http://www.downforeveryoneorjustme.com/ [23:40:55] It's not just you! http://wikitech.wikimedia.org looks down from here. [23:40:59] I know [23:41:03] Ah, you beat me to it : [23:41:04] :) [23:41:04] :D [23:41:09] And, hm, yeah, looks down. [23:41:22] My wifi has been flaky for me since I got home so wasn't quite so sure [23:41:25] * andrewbogott curses the distraction [23:42:06] Guest90117: Did you see bastion1.wmflabs.org written down somewhere? [23:42:11] As if so, we should fix that [23:42:59] Reedy : no, bastion1 [23:43:04] Where? [23:43:22] Reedy: It's because I just now said 'bastion1' [23:43:25] andrewbogott : pasted it https://dpaste.de/Q66L#L [23:43:28] aha [23:44:17] Guest90117: Hm, nothing stands out there, looks like your key just isn't there :( [23:45:21] yeah, that's what i understood too ... the problem is that, it's there, and it's the same key i use for many other connections. [23:48:56] andrewbogott : just to clarify, do you mean that my key is not on my pc, or on wikitech? [23:49:12] one or the other :) I'd guess the latter [23:53:02] andrewbogott : one more clarification, is it just not there? or it could be there but it's the wrong one (or wrong match)? [23:53:25] I'm just trying to recall if I did anything wrong. [23:53:41] Guest90117: in theory you could check on wikitech, but wikitech is currently down... [23:53:46] which probably means that ~nothing will work just now [23:54:30] is it? It was fine last time I check about 30 min ago. ... oh well