[00:09:36] RECOVERY Current Load is now: OK on deployment-web deployment-web output: OK - load average: 0.03, 0.17, 4.09 [00:10:36] RECOVERY Current Load is now: OK on deployment-web5 deployment-web5 output: OK - load average: 0.01, 0.21, 4.32 [01:02:23] 03/08/2012 - 01:02:23 - Creating a home directory for catrope at /export/home/testing/catrope [01:03:26] 03/08/2012 - 01:03:26 - Updating keys for catrope [01:07:28] catrope@bastion1:~$ ssh testing-ioerror [01:07:30] Permission denied (publickey). [01:07:33] Ryan_Lane: Is that normal? --^^ [01:10:49] Never mind, I'm in [01:20:14] PROBLEM Disk Space is now: WARNING on testing-ioerror testing-ioerror output: DISK WARNING - free space: / 55 MB (4% inode=35%): [01:35:05] RoanKattouw: :D [01:35:14] PROBLEM Disk Space is now: CRITICAL on testing-ioerror testing-ioerror output: DISK CRITICAL - free space: / 0 MB (0% inode=34%): [01:35:16] how have I somehow been roped into user support? [01:35:24] hehe [01:35:25] I walked willing into this somehow [01:40:14] RECOVERY Disk Space is now: OK on testing-ioerror testing-ioerror output: DISK OK [02:46:44] RECOVERY Disk Space is now: OK on hugglewa-db hugglewa-db output: DISK OK [02:47:24] RECOVERY Free ram is now: OK on hugglewa-db hugglewa-db output: OK: 75% free memory [02:48:14] PROBLEM Disk Space is now: WARNING on testing-ioerror testing-ioerror output: DISK WARNING - free space: / 54 MB (4% inode=22%): [02:48:54] RECOVERY Total Processes is now: OK on hugglewa-db hugglewa-db output: PROCS OK: 88 processes [02:49:34] RECOVERY dpkg-check is now: OK on hugglewa-db hugglewa-db output: All packages OK [02:50:14] RECOVERY Current Load is now: OK on hugglewa-db hugglewa-db output: OK - load average: 0.01, 0.06, 0.03 [02:51:04] RECOVERY Current Users is now: OK on hugglewa-db hugglewa-db output: USERS OK - 0 users currently logged in [03:23:14] PROBLEM Disk Space is now: CRITICAL on testing-ioerror testing-ioerror output: DISK CRITICAL - free space: / 20 MB (1% inode=22%): [03:28:14] PROBLEM dpkg-check is now: CRITICAL on testing-ioerror testing-ioerror output: DPKG CRITICAL dpkg reports broken packages [16:21:12] 03/08/2012 - 16:21:12 - Creating a home directory for addshore at /export/home/bastion/addshore [16:21:23] <3 [16:21:27] 03/08/2012 - 16:21:27 - Creating a home directory for addshore at /export/home/hugglewa/addshore [16:21:32] <3 [16:22:12] 03/08/2012 - 16:22:12 - Updating keys for addshore [16:22:17] =] [16:22:27] 03/08/2012 - 16:22:27 - Updating keys for addshore [16:28:32] !access | addshore [16:28:32] addshore: https://labsconsole.wikimedia.org/wiki/Access#Accessing_public_and_private_instances [16:28:42] ahhaa :P [16:28:51] @regsearch bastion [16:28:51] Results (found 4): sudo, bastion, ryanland, socks-proxy, [16:28:57] !ryanland [16:28:57] in case you want to get to wonderfull land of labs use portal we call bastion, you will see amazing world where vm's runs happily and nfs friends with ntfs, puppets are fresh and gerrit is ugly :O [16:29:39] :P [16:29:43] guide [16:35:13] 03/08/2012 - 16:35:13 - Creating a home directory for addshore at /export/home/huggle/addshore [16:36:14] 03/08/2012 - 16:36:13 - Updating keys for addshore [16:36:36] addshore: try @search [16:36:44] bot knowz [16:36:58] @search ssh [16:36:59] Results (found 3): pageant, ssh, socks-proxy, [16:41:12] 03/08/2012 - 16:41:12 - Updating keys for addshore [16:41:13] 03/08/2012 - 16:41:13 - Updating keys for addshore [16:41:27] 03/08/2012 - 16:41:27 - Updating keys for addshore [16:45:19] hi hexmode [16:45:19] everyting work? [16:45:38] petan|wk: "everything" -- you mean with the docs? [16:45:46] with deployment :D [16:45:50] project [16:45:56] i hate thsi ssh [16:45:59] why is it so difficult [16:46:07] i can't help you document het cuz I don't even know what it is [16:46:21] addshore: it's easdy :P [16:46:24] !ssh [16:46:24] https://labsconsole.wikimedia.org/wiki/Help:SSH [16:46:25] petan|wk: I haven't checked today, was going through email and stuff [16:46:35] ok [16:46:53] np [16:46:58] wait, do i have to do anything here?https://gerrit.wikimedia.org/r/ [16:47:05] meh [16:47:07] petan|wk: Could you move the page to labsconsole like Ryan asked? [16:47:07] who knows [16:47:13] hexmode: which [16:47:20] I can copy paste it [16:47:36] but I need t know what and where [16:48:14] petan|wk: ok, we'll ask when ryan comes on, 'cause I don't know either. [16:48:25] heh [16:48:29] petan|wk: actually just repond to the email and ask [16:48:31] I think main stapce is good for that [16:48:33] okay, in what format does my public key need to be [16:48:37] and where do i need to put it [16:49:16] rsa [16:49:22] in console [16:49:27] ssh-keygen [16:49:41] cat ~/.ssh/*pub [16:49:42] addshore, that's openssh format [16:50:05] rsa in console [16:50:11] .pub [16:50:12] not private [16:50:35] yee i know how to use keys petan|wk just for some reason its not working :P [16:51:03] addshore, does your public key begin ssh-rsa AAAAB3Nza... ? [16:51:04] okay i have put my public rsa in the console [16:51:13] 03/08/2012 - 16:51:12 - Updating keys for addshore [16:51:14] 03/08/2012 - 16:51:13 - Updating keys for addshore [16:51:27] ---- BEGIN SSH2 PUBLIC KEY ---- Comment: "rsa-key-20120308" AAAAB3Nz# e.t.c [16:51:27] 03/08/2012 - 16:51:27 - Updating keys for addshore [16:51:39] or can the console not deal with that little bit infront? :P [16:52:33] huh? [16:52:34] try now [16:52:44] btw did u load it to putty :P [16:52:50] yes [16:52:50] you need to load the key tehre too [16:52:52] i think [16:52:53] ok [16:52:55] xD [16:52:55] you think :D [16:52:59] shhh [16:53:12] did u see "Using key blah" in terminal or not [16:53:20] yep [16:53:21] ok [16:53:21] its all set [16:53:40] server refused our key >.< [16:53:45] :O [16:53:59] i should be logging into bastion.wmfe.t.c right? [16:54:10] username = addshore [16:54:33] i am allowed to use passphrase alongside the key right? [16:54:39] i dont need any other settings in putty? [16:54:44] no [16:54:57] ssh addshore@bastion.wmflabs.org [16:55:01] HAHA [16:55:08] mwahahwha [16:55:10] ya [16:55:11] wait [16:55:17] yes [16:55:17] thats is my user .. seriously? [16:55:23] why [16:55:24] probably [16:55:29] yes [16:55:36] didnt work either [16:55:39] meh [16:55:43] should just be addshore anyway as far as i know :P [16:55:55] noes [16:56:00] that was terminal command :D [16:56:07] when you open bash [16:56:08] so user is just addshore [16:56:11] im using putty [16:56:13] ah [16:56:14] ok [16:56:17] yes [16:56:26] i really dont get why this isnt working :/ [16:56:32] neither me [16:56:35] try in linux [16:56:40] or send me your private key and I try it :D [16:57:04] or I can give you access to my private server :D [16:57:12] you can upload key there and ssh from there [16:57:13] I had thinking in changing the format of the public key myself [16:57:24] but that would be insecure, as I could have been replacing it [16:57:34] heh [16:57:37] providing the private key... humm [16:57:59] :D [16:58:09] 03/08/2012 - 16:58:09 - Updating keys for platonides [16:58:13] 03/08/2012 - 16:58:12 - Updating keys for platonides [16:58:16] 03/08/2012 - 16:58:16 - Updating keys for platonides [16:58:19] Platonides, whats the format of your key? [16:58:39] addshore, it has to be in openssh format [16:59:51] see http://www.mediawiki.org/wiki/User:Platonides/SSH_key [16:59:57] in the lower format [17:00:23] Platonides: can I see your private key [17:00:25] XD [17:00:27] haha [17:00:31] cheers Platonides [17:01:12] 03/08/2012 - 17:01:12 - Updating keys for addshore [17:01:24] * addshore waits for these to update [17:01:25] petan, where do you want me to post it? [17:01:27] 03/08/2012 - 17:01:27 - Updating keys for addshore [17:01:30] pastebin [17:01:33] xD [17:02:06] I just want to check if my key is in similar format [17:02:12] petan, http://pastebin.com/eEfGrgYs [17:02:12] 03/08/2012 - 17:02:12 - Updating keys for addshore [17:02:13] 03/08/2012 - 17:02:13 - Updating keys for addshore [17:02:25] the public key is in nova ;) [17:02:46] wait did you really post your private key tehre? :D [17:02:50] I was joking [17:02:55] okay [17:03:03] it's one I had just created for testing formats xD [17:03:07] ok [17:03:12] i have changed my public key to the one line format [17:03:18] now when trying to login it just doesnt let me [17:03:19] it was a bit spoiled by the line "Comment: rsa-key-20120308" [17:03:26] but it doesnt say anything about the key... [17:03:31] addshore: install linux [17:03:34] addshore, load your key in putty [17:03:42] Platonides, the private? i have [17:03:47] im not barking mad :P [17:03:52] :D [17:04:00] are you sure it's loaded? [17:04:06] it should either accept or reject it [17:04:22] yep it is definalty loaded [17:05:06] maybe try to log to gerrit now :P [17:05:13] ?? [17:05:16] I don't know [17:05:22] maybe it's related to it [17:05:24] !gerrit [17:05:24] https://gerrit.wikimedia.org/ [17:05:36] what even is that for? :P [17:05:42] !ryanlans [17:05:44] !ryanland [17:05:44] in case you want to get to wonderfull land of labs use portal we call bastion, you will see amazing world where vm's runs happily and nfs friends with ntfs, puppets are fresh and gerrit is ugly :O [17:05:47] it's ugly [17:05:51] that's all you need to know [17:06:19] is there any labs admin that can lend me a hand? :) [17:06:31] * petan|wk slaps mutante [17:06:58] !Ryan [17:06:58] man of all answers ever (but there are others :)) [17:07:08] petan, gerrit uses a different key setup [17:07:23] Platonides: I just thought it's connected to ldap as well [17:07:27] i can sign into gerrit [17:07:42] meh [17:07:51] ill add the key there? :P [17:08:02] that's what I did as first [17:08:05] then I tried to ssh [17:08:19] but it may not be connected so dunno [17:10:26] blarral [17:11:59] how can access be so hard :/ [17:14:34] it's well secured hehe [17:14:38] because there is nothing [17:15:09] it simulate real cluster of wikimedia [17:15:17] right now we only simulated security so far [17:15:25] rest is coming :D [17:15:56] but [17:15:57] why me [17:16:22] XD [17:16:32] you aren't using secure OS [17:16:40] im using putty [17:16:43] whats wrong with that [17:16:43] xd [17:17:20] putty != linux [17:17:23] that's it [17:17:36] petan|wk: is it possible to create a global IRC feed for development-prep? [17:17:43] bastion.wmflabs.org:22 SSH Username=addshore privatekey = somewhere\keys\wmflabs_private_key.ppk [17:17:44] !linux is brave men's OS [17:17:44] Key was added! [17:17:46] all the RC feed in one channel I mean :) [17:18:06] Thehelpfulone: ask Platonides [17:18:10] he's irc guy [17:19:05] btw Thehelpfulone lot of spam [17:19:07] there [17:19:08] need to fix [17:19:18] you should use checkuser and block ip [17:19:30] it's easy [17:19:36] yeah is it only on labs.wikimedia [17:19:41] or is it in other place too? [17:19:47] others too [17:20:08] brb 1h [17:20:13] haha [17:20:19] u said 2 hours about 10 mins ago :P [17:20:24] :P [17:20:29] I am going to be fast [17:20:32] I want home!!!!!! [17:20:32] Thehelpfulone, do you have labs access? [17:20:37] don't hold me here [17:20:39] addshore: yes [17:20:45] well onwiki [17:20:51] no ssh? [17:21:01] petan|wk hasn't given it to me yet ;) [17:21:06] haha :p [17:21:16] i have it but am seriously struggling to actually log in >.< [17:21:29] addshore: okay, from bastion [17:21:34] you need to type: [17:21:40] ssh -A deployment-prep [17:21:41] i cant get into bastion! [17:21:44] ooh [17:21:55] addshore: your public SSH key needs to be in the openssh format [17:21:55] :< [17:22:03] okay, and that is? :P [17:22:12] give me an example? :> [17:22:56] Thehelpfulone, he won't have the key tunneled to bastion... [17:23:44] addshore, inside bastion do: cd .ssh && ssh-keygen -t rsa [17:23:57] Platonides i cant loginto bastion.. [17:24:04] Platonides: he can't get into bastion ;) [17:24:16] I thought he was in bastion but had problems going to the vm... [17:24:21] no :p [17:24:40] i have failed at the first hurdle [17:25:52] ok, let's try again [17:25:52] that was me the other day [17:25:56] basic steps: [17:25:59] - Open putty [17:26:07] maybe i should start with a totally new key [17:26:07] - In host name write bastion.wmflabs.org [17:26:11] * addshore deletes everything [17:26:33] - At the left treeview, expand SSH [17:26:41] - Choose Auth [17:27:09] - Where it says Private key file for authentication, press Browse and choose the .ppk file holding your private key [17:27:19] - Click Open button [17:27:33] - A black console opens [17:27:40] - When it asks you for you r name, provide addshore [17:28:41] and my key that i put into the labsconsole needs to be in single line openssh format [17:29:36] yes, but I though you already had it like that? [17:29:42] yes [17:29:43] i.e. [17:29:43] ssh-rsa AAAAB3NzagNPww0 dJ8s6LKVC1yc2EAAAABJQAAAIeq9XrKpzOwit8NlGBNw3PpG1+6htj8shFVg327Jvvz6oefk8lOyQI3+h6YJvn2696i9hoYwiwb6in/RdWJxBi2s4vd734hjDq/fGdHDYUnnGTpYxkRBuuqelNvhP1h6aHktMx3Np0fX4ORDLPzY1V20d d3dsbQ== [17:30:07] do i need to specify ssh2 [17:30:53] ssh2? at which point? [17:31:09] ssh2-rsa keyhere? :P [17:31:16] no [17:31:19] good :P [17:31:22] then why wont this work xD [17:31:27] *updates key again just incase [17:31:35] did you follow the steps Iprovided above? [17:31:53] yep [17:32:04] login as: addshore [17:32:12] 03/08/2012 - 17:32:12 - Updating keys for addshore [17:32:13] 03/08/2012 - 17:32:13 - Updating keys for addshore [17:32:15] login as: addshore [17:32:15] If you are having access problems, please see: https://labsconsole.wikimedia.org/wiki/Access#Accessing_public_and_private_instances [17:32:23] then it says server unexpectidly disconnected [17:32:26] :> [17:32:27] 03/08/2012 - 17:32:27 - Updating keys for addshore [17:32:57] since i put it in single line form it doesnt even say key rejected or anything [17:33:43] right im gonna loginto toolserver and try and loginto wmflabs from there [17:34:37] you can log in to the toolserver? [17:34:42] yes... [17:34:53] it's the same exact process... [17:34:55] this is why i dont understand that I cant loginto wmflabs :P [17:34:58] i know xD [17:35:17] Platonides: is the global recent changes doable? [17:36:42] Thehelpfulone, context? [17:36:52] I can connect fine to wmflabs using putty... [17:39:18] hmm [17:39:22] maybe its just my account? [17:39:28] or i have missed one little thing somewhere [17:39:56] do you have spaces in the public key you provided? [17:40:09] (I'm looking at what you pasted above) [17:41:01] * addshore checks [17:41:13] i think there may be one [17:41:14] 03/08/2012 - 17:41:14 - Creating a home directory for thehelpfulone at /export/home/globaleducation/thehelpfulone [17:41:30] I'm seeing one at "w0 dJ8s6" and another at "0d d3" [17:41:39] if they are indeed there, you should remove them [17:42:14] 03/08/2012 - 17:42:14 - Updating keys for thehelpfulone [17:43:12] 03/08/2012 - 17:43:12 - Updating keys for addshore [17:43:13] 03/08/2012 - 17:43:13 - Updating keys for addshore [17:43:28] 03/08/2012 - 17:43:27 - Updating keys for addshore [17:44:12] 03/08/2012 - 17:44:12 - Updating keys for addshore [17:44:13] 03/08/2012 - 17:44:13 - Updating keys for addshore [17:44:27] 03/08/2012 - 17:44:27 - Updating keys for addshore [17:49:03] Platonides: it's to monitor the spam so things can be deleted accordingly [17:53:06] does anyone know how I sftp into education.wmflabs.org? I can do it for bastion and bots-3 but not education [17:53:38] Thehelpfulone, are you able to add me to the bots project? :P [17:54:13] sorry nope, I'm just a mere mortal for that project - but Damianz can [17:54:28] 03/08/2012 - 17:54:28 - Updating keys for addshore [17:55:12] 03/08/2012 - 17:55:12 - Updating keys for addshore [17:55:13] 03/08/2012 - 17:55:13 - Updating keys for addshore [17:55:29] haha new error for me logging in now [17:55:58] Disconnected: No supported authentication methods availible (server sent: publickey) ... [17:57:59] ;_; [17:58:02] yeah that was the one I got [17:58:09] when my public key wasn't open SSH [17:58:10] error? :) [17:58:14] but [17:58:24] flubbermijuggle :< [17:58:34] did you put your new key in pageant? [18:01:34] i did [18:01:34] but that didnt work either [18:04:48] Thehelpfulone, whjat did you use to generate you keys? [18:05:24] puttygen [18:05:37] okay, thats what i used :P [18:10:14] 03/08/2012 - 18:10:14 - Updating keys for addshore [18:10:15] 03/08/2012 - 18:10:14 - Updating keys for addshore [18:10:29] 03/08/2012 - 18:10:29 - Updating keys for addshore [18:10:47] YESS!!!!!!!!!!! [18:10:48] finally :) [18:11:22] * addshore jumps for joy [18:13:39] heh [18:15:50] Platonides: so any idea how to enable sftp? [18:18:26] ah figured it out [18:18:34] JeroenDeDauw: under https://labsconsole.wikimedia.org/wiki/Special:NovaSecurityGroup [18:18:47] I added 22 22 tcp 0.0.0.0/0 remove rule [18:18:59] and remove the one that just said CIDR ranges 10.4.0.0/24 [18:39:32] !log globaleducation Added new site logo [18:39:33] Logged the message, Master [18:47:05] !log globaleducation moved all files from /var/www to /var/www/w [18:47:06] Logged the message, Master [19:17:08] Thehelpfulone: what's the instance name? [19:17:58] !access | Thehelpfulone [19:17:58] Thehelpfulone: https://labsconsole.wikimedia.org/wiki/Access#Accessing_public_and_private_instances [19:17:59] wep [19:18:09] project is globaleducation [19:18:20] so, looking at that, you can use sftp to systems via "Using ProxyCommand ssh option" [19:18:36] even if they don't have a cidr range of 0.0.0.0/0 [19:18:43] since it uses the bastion as a proxy [19:19:09] okay I'm on windows, so where would that be added? [19:19:17] oh [19:19:24] you're using putty? [19:19:27] yep [19:19:32] heh. that makes things harder [19:19:35] I don't know :) [19:19:42] I haven't used windows in years [19:19:51] heh [19:20:00] !log globaleducation moving /var/www/w to /srv/w [19:20:02] Logged the message, Master [19:20:03] I usually just "ssh -A bots-3" [19:20:17] o.O [19:20:25] the httpd.conf is mostly empty [19:20:48] oh, are you using cygwin? [19:21:21] ah. httpd.conf is empty by default, so that's ok [19:22:00] I'm not sure, I was just trying to follow the MW guide @ http://www.mediawiki.org/wiki/Manual:Short_URL [19:22:13] I guess it's not set up exactly like that [19:23:14] ah, there's a syntax error in localsettings [19:23:35] !log globaleducation added two aliases. one for /w, and another for /wiki [19:23:36] Logged the message, Master [19:23:38] that was probably me, what is it? [19:24:17] was missing a semicolon [19:24:34] yeah sounds like me [19:24:39] script '/var/www/api.php' not found or unable to stat, referer: http://education.wmflabs.org/index.php/Special:NewMessages [19:24:41] what the fuck> [19:24:55] JeroenDeDauw: are you hardcoding the api location somewhere in your extension? [19:25:07] Ryan_Lane: yeah of course, that'd make perfect sense [19:25:18] I'm not saying you are, I'm asking [19:25:44]