[00:02:19] <scfc_de>	 giftpflanze: Okay, das max-age habe ich korrigiert und deployed, bei dem Rest, wenn es momentan funktioniert, fehlt mir Wissen und Zeit.
[00:04:09] <Carlos_Danger>	 scfc_de: So, if I use scp where does that file go?
[00:07:19] <scfc_de>	 Carlos_Danger: Well, where are you aiming for? :-)  What are you using as the second parameter to scp?
[02:22:35] <Betacommand>	 how does one pass a output redirect to jsub?
[02:56:49] <scfc_de>	 Betacommand: What do you mean?  "jsub 'somecommand | somecommand"?  That won't work.  In most cases, you will have to use a wrapper script.
[02:58:17] <Betacommand>	 scfc_de: I use > to save the output in a file
[03:23:10] <scfc_de>	 Betacommand: Then you'll have to use a wrapper script (unless you want to capture the whole output of the job because - of course - it's saved to ~/*.out and .err).
[06:59:52] <andrewbogott>	 !log tools merged a lint patch to the gridengine module.  Should be a noop
[07:02:00] <andrewbogott>	 !log tools merged a lint patch to the gridengine module.  Should be a noop
[07:02:20] <andrewbogott>	 labs-morebots, what gives?
[07:02:20] <labs-morebots>	 I am a logbot running on tools-exec-07.
[07:02:20] <labs-morebots>	 Messages are logged to wikitech.wikimedia.org/wiki/Server_Admin_Log.
[07:02:20] <labs-morebots>	 To log a message, type !log <msg>.
[07:02:36] <andrewbogott>	 grrr
[08:27:43] <ilmerovingio>	 Hi guys, sorry for re-posting: someone knows why I can login correctly on http://wikitech.wikimedia.org/ but not anymore on gerrit?
[08:28:49] <andrewbogott>	 When you say 'log in' on gerrit… is that a thing you normally do?  Via ssh?
[08:28:56] <andrewbogott>	 Or are you talking about not being able to push things?
[08:34:28] <andrewbogott>	 ilmerovingio: ?
[08:42:10] <ilmerovingio>	 andrewbogott: login on the web interface
[08:43:59] <ilmerovingio>	 in the last week i did some code review for puppet modules but now i can't login anymore
[08:44:46] <andrewbogott>	 Ah, I see.  Ok, so you aren't even using an ssh key to log in, it's just your username/pass
[08:45:40] <andrewbogott>	 It may be that gerrit is case-sensitive but wikitech is not?
[08:45:48] <andrewbogott>	 What is your username?   I'll take a look.
[08:50:10] <andrewbogott>	 ilmerovingio: ?
[08:50:55] <ilmerovingio>	 guido.iaquinti
[08:50:57] <ilmerovingio>	 sorry :)
[08:54:02] <andrewbogott>	 ilmerovingio, are you loggin in as just 'guido.iaquinti' or as 'guido.iaquinti@gmail.com'?
[08:55:26] <ilmerovingio>	 i tried both
[08:55:30] <ilmerovingio>	 let me check again
[08:56:21] <ilmerovingio>	 yes, it doesn't works. The problem is that I logged in on saturday i think without problem
[09:01:45] <andrewbogott>	 It seems unlikely that you have a '.' in your username.
[09:01:51] <andrewbogott>	 I'm looking at the user db now...
[09:03:32] <andrewbogott>	 Try username with these caps:  Guido.iaquinti
[09:03:57] <ilmerovingio>	 yes, i've already tried
[09:03:59] <ilmerovingio>	 also now
[09:04:03] <andrewbogott>	 Ah, so I see.
[09:04:31] <andrewbogott>	 OK, lemme look at a log from Saturday...
[09:04:37] <andrewbogott>	 You mean 8 days ago, right?
[09:04:42] <andrewbogott>	 Or two days ago?
[09:12:39] <ilmerovingio>	 i think 2 days
[09:17:46] <andrewbogott>	 OK… there were some network issues between our datacenters, and I think that our account databases may be out of sync.  I'm investigating.
[09:19:19] <ilmerovingio>	 andrewbogott: many thanks for your help :)
[09:32:48] <andrewbogott>	 ilmerovingio: I need to run, but will try to keep you updated.
[09:33:06] <ilmerovingio>	 andrewbogott: don't worry, many thanks for your help
[09:42:14] <petan>	 !petan-build
[09:42:14] <wm-bot>	 make -j `getconf _NPROCESSORS_ONLN` deb-pkg LOCALVERSION=-custom
[12:51:50] <Steinsplitter>	 !labs
[12:51:50] <wm-bot>	 https://labsconsole.wikimedia.org/wiki/$1
[12:51:57] <Steinsplitter>	 :/
[12:52:18] <Steinsplitter>	 ther is a doc on wiktech how to use putty with tools?
[12:52:40] <Steinsplitter>	 (i know, putty is evil...)
[12:53:03] <matanya>	 what do you need to do Steinsplitter 
[12:53:28] <Steinsplitter>	 how to config, my configuration dos not work.
[12:54:13] <Steinsplitter>	 "wrong passphrase"
[12:54:23] <Steinsplitter>	 but my passphrase & cert is correct :)
[12:56:42] <matanya>	 I haven't used putty in like 8 years
[12:57:11] <Steinsplitter>	 :-)
[12:57:34] <Steinsplitter>	 but you have pls a link with the acces data at least (host port etc.) ?
[12:57:42] <matanya>	 that i do
[12:58:17] <matanya>	 yourusername@tools-login.wmflabs.org
[13:00:22] <Steinsplitter>	 :D ah, it works. wrong host *g*
[13:00:23] <Steinsplitter>	 thx :)
[13:00:37] <Steinsplitter>	 typo in host  :/ lol
[13:01:52] <matanya>	 good
[13:17:54] <petan>	 !putty
[13:17:55] <wm-bot>	 official site: http://www.chiark.greenend.org.uk/~sgtatham/putty/ | how to tunnel - http://oldsite.precedence.co.uk/nc/putty.html
[13:18:02] <petan>	 !access
[13:18:02] <wm-bot>	 https://wikitech.wikimedia.org/wiki/Access#Accessing_public_and_private_instances
[13:18:06] <petan>	 Steinsplitter ^
[13:18:22] <petan>	 I don't think putty is evil
[13:19:24] <Steinsplitter>	 well... maby it is the encoding. UTF-8 is the problem.    if utf-8 selected i cannot access :P
[13:20:00] <Steinsplitter>	 maby i find som time at home to fix this
[13:55:32] <andrewbogott>	 ilmerovingio: try now?
[14:27:49] <ChrisJ_WMDE>	 hi.  It seems that I cannot sudo on either of my instances.  I also lost admin menus on wikitech.  But, I am still listed as an admin for the project.
[14:29:35] <ChrisJ_WMDE>	 in syslog I am getting errors from nslcd on both instances
[14:37:30] <matanya>	 ChrisJ_WMDE: the ldap was recynced, try now
[14:48:38] <ChrisJ_WMDE>	 matanya: still getting errors.  nslcd[1111]: [14914e] <group=50062> error writing to client: Broken pipe
[14:52:00] <matanya>	 I asked in #wikimedia-operations
[15:23:47] <matanya>	 ChrisJ_WMDE: https://wikitech.wikimedia.org/wiki/LDAP#Client
[15:30:00] <ChrisJ_WMDE>	 matanya: thanks, but I cannot debug it because I lost my credentials to sudo
[15:31:05] <matanya>	 you will need an admin then ChrisJ_WMDE 
[15:33:15] <Coren>	 "Lost credentials?"
[15:35:10] <matanya>	 i should say admin more often if you replay so fast Coren :)
[15:35:36] <matanya>	 ChrisJ_WMDE: coren can help you
[15:36:12] <ChrisJ_WMDE>	 hi coren
[15:36:32] <Coren>	 What instance is this, ChrisJ?
[15:36:53] <ChrisJ_WMDE>	 The project is scrumbugz, the problem is on all three instances, I cannot sudo
[15:38:09] <matanya>	 see you
[15:41:06] <Coren>	 Looking into it.
[15:42:13] <Coren>	 There doesn't seem to be a sudo policy to get to root in your project.
[15:43:27] <ChrisJ_WMDE>	 yes.  It disappeared...
[15:43:51] <Coren>	 You should be able to add it back with the 'Manage Sudo Policies' link in the sidebar.
[15:45:11] <Coren>	 Do you have access to that section allright?
[15:45:47] <ChrisJ_WMDE>	 yes.  actually the default policy still exists there
[15:46:24] <Coren>	 Yeah, but the default allows project member -> project member.  Not root for project admins.  :-)
[15:46:30] <Coren>	 Lemme add it for you.
[15:47:08] <ChrisJ_WMDE>	 ok thanks
[15:48:49] <Coren>	 Hm.  How odd.
[15:49:53] <Coren>	 That should do it.  Try?
[15:50:31] <ChrisJ_WMDE>	 it works! thanks a lot Coren
[15:50:44] <Coren>	 No worries.
[20:16:11] <drdee>	 anybody objects if i (try) to reboot nginx-devunt.pmtpa.wmflabs? it's totally unresponsive
[20:21:43] <drdee>	 coren: nginx-devunt seems to be broken, it cannot create a socket on eth0 (see https://wikitech.wikimedia.org/w/index.php?title=Special:NovaInstance&action=consoleoutput&project=nginx&instanceid=a13c687c-e77d-4f70-8bea-2cef52a8fa3b&region=pmtpa)
[20:21:46] <drdee>	 any magic tricks?
[20:51:43] <Coren>	 drdee: Checking.
[20:51:54] <drdee>	 ty
[20:53:27] <Coren>	 drdee: That's IPv6 (which labs doesn't support).
[20:54:18] <drdee>	 yeah i saw that as well, it's not my instance but don' know what should happen
[20:54:20] <Coren>	 drdee: And it's just npd whining (you can tweak the config so that it doesn't try); it shouldn't harm anything else.
[20:54:27] <drdee>	 i can't ssh into that box
[20:54:39] <drdee>	 i thought it might be related to the eth0 stuff
[20:54:46] <drdee>	 ssh just hangs
[20:54:55] <drdee>	 it doesn't close the connection, it does not timeout, it just hangs
[20:55:11] <Coren>	 Probably gluster being insane again.  Yeay gluster.  Lemme check.
[20:55:42] <Krenair>	 Hi Coren 
[20:56:02] <Coren>	 drdee: Ah, not even.  The instance does seem to be off its rocker.  That's after a reboot, you say?
[20:56:08] <drdee>	 yup
[20:56:36] <drdee>	 nginx-dev1.pmtpa.wmflabs might have the same problem
[20:56:36] <Krenair>	 I'm on my laptop with a  relatively new SSH key which I haven't used with labs before. I added my id_rsa.pub to my openstack preferences on wikitech
[20:56:54] <Coren>	 explodinate, then rebuild.  I can't even get in via root.  You /might/ be able to salvage it if you knew what was wrong and puppet runs on reboot, but it's normally not worth the trouble.
[20:57:01] <Krenair>	 But when I try to ssh to tools-login.wmflabs.org it fails with Permission denied (publickey,hostbased)...
[20:57:26] <Coren>	 Krenair: It may take some time before keys are pushed (minutes though, not hours).
[20:57:30] <drdee>	 Coren: right, but it's not my instance :) my amazing labs-migration-assistant "detected" the problem
[20:57:44] <Coren>	 Oh, ah.
[20:57:50] <Coren>	 Well, clearly it found a problem.  :-)
[20:57:51] <marktraceur>	 !log started orgcharts instance back up
[20:57:51] <labs-morebots>	 started is not a valid project.
[20:57:57] <marktraceur>	 !log orgcharts started orgcharts instance back up
[20:57:58] <Krenair>	 I've been sitting here for a while... not hours though
[20:58:20] <marktraceur>	 matanya, Gloria, andrewbogott_afk ^^
[20:58:41] <marktraceur>	 Apparently it crashed
[20:58:47] <Gloria>	 Oh, nice.
[20:59:10] <Coren>	 Krenair: I'm seeing a key whose comment reads 'ubuntu laptop', I'm guessing that should be it?
[20:59:56] <matanya>	 thanks marktraceur 
[21:00:23] <Krenair>	 Coren, with my email address, yes
[21:00:26] <Coren>	 Krenair: You know, I'm not sure how well ssh deals with a space in the key comment.  Also, there seems to be a stray blank line in your keys (though that I am pretty sure is harmless)
[21:00:35] * Coren  looks at logs.

[21:00:53] <Krenair>	 That key has been working with Gerrit, so...
[21:01:17] <Coren>	 Yeah, likely.  What host are you trying to connect to?
[21:02:11] <Coren>	 Krenair: Also, what is your shell account name?
[21:02:17] <Coren>	 Wait, it's krenair isn't it?
[21:02:20] <Krenair>	 yes
[21:02:32] <Coren>	 I see no attempt from you on tools-login.  At all.
[21:03:07] <Krenair>	 Woops.
[21:03:23] <Krenair>	 I use a different username on my machine. Wasn't specifying krenair@...
[21:03:27] <Krenair>	 Thanks Coren 
[21:03:37] <Coren>	 D'oh.  :-)
[21:04:15] <Krenair>	 Coren, you're a remote contractor for WMF right?
[21:05:08] <Coren>	 Krenair: Well, I'm a permanent staffer now, but I was.  Why?
[21:05:33] <Krenair>	 Coren, oh I'm just sitting in the WMF office at the moment with a few people. was wondering if I might meet you at some point this week
[21:05:53] <Coren>	 Krenair: Aw, sorry no.  I'll be at the office Feb 10 and 11 next.
[21:06:54] <Coren>	 Also, at FOSDEM if you're going.
[21:08:01] <Nemo_bis>	 Coren: speaking of which, how much overlap is there between FT and indef/permanent and at what conditions can one be either from outside USA
[21:09:51] <hedonil>	 Coren: I would need your helping hands again. Could you please move the database  p50380g50769__wvs2ds  on s7 to another (fast) storage as you did once before? So I can free up some space on s7. The database is new and -except one table definition- empty.
[21:10:01] <Coren>	 Nemo_bis: There is no real distinction about being outside the US for status; though non-US staffers get more money rather than employee benefits.
[21:10:30] <Coren>	 hedonil: Sure, give me a couple minutes?
[21:10:47] <hedonil>	 Coren: 'k. super.
[21:11:13] * Gloria  NP: "American Pie" by Don McLean from "American Pie"

[21:11:17] <Coren>	 Nemo_bis: As to the staffer/contractor distinction it's mostly a question of whether you've got a budget earmarked or you're coming out of the general contractor budger.  There are probably other subtleties, but HR would know.
[21:12:40] <Nemo_bis>	 That's the source of the distinction, not the distinction itself
[21:13:03] <Nemo_bis>	 But thanks anyway
[21:13:33] <hedonil>	 Coren: Sorry it's not  s7  it's  on s6
[21:16:27] <Coren>	 hedonil: {{done}}
[21:16:58] <hedonil>	 Coren: thx. great.
[21:25:38] <Coren>	 Nemo_bis: I'm not sure I understand the difference you see, sorry.
[21:46:34] <scfc_de>	 Krenair: It seems to be the most common mistake to leave out the username if it is different between your own machine and Labs; I wanted to add a bigger note to [[Help:Access]], but didn't find the right spot.  If you have a good idea, be bold! :-)
[21:47:34] <valhallasw>	 are usernames public? in that case, it might be an option to get sshd to respond 'hey, we don't know that user here'
[21:55:17] <scfc_de>	 valhallasw: I don't know if they can be queried externally.  (Inside of Labs, you can always look in /public/keys.)
[21:57:04] <scfc_de>	 If someone gives as reason for a Tools access request: "bulk insertion" - why do I find that slightly troubling? :-)
[23:33:27] <Betacommand>	 Coren: are you around?