[00:05:32] PROBLEM Current Load is now: CRITICAL on deployment-web deployment-web output: CRITICAL - load average: 78.03, 38.12, 15.49 [00:05:32] PROBLEM Current Load is now: CRITICAL on deployment-web2 deployment-web2 output: CRITICAL - load average: 35.49, 23.30, 10.07 [00:05:42] PROBLEM Free ram is now: CRITICAL on deployment-web2 deployment-web2 output: Critical: 5% free memory [00:06:32] PROBLEM Free ram is now: CRITICAL on deployment-web5 deployment-web5 output: CHECK_NRPE: Socket timeout after 10 seconds. [00:06:42] PROBLEM Current Load is now: CRITICAL on deployment-web5 deployment-web5 output: CHECK_NRPE: Socket timeout after 10 seconds. [00:07:02] PROBLEM Current Load is now: WARNING on deployment-web4 deployment-web4 output: WARNING - load average: 19.45, 21.16, 10.48 [00:07:32] PROBLEM Current Load is now: CRITICAL on deployment-web3 deployment-web3 output: CRITICAL - load average: 107.49, 62.69, 27.35 [00:09:02] PROBLEM Free ram is now: CRITICAL on deployment-web3 deployment-web3 output: Critical: 3% free memory [00:10:32] PROBLEM Current Load is now: WARNING on deployment-web deployment-web output: WARNING - load average: 1.70, 21.21, 15.45 [00:10:32] PROBLEM Current Load is now: WARNING on deployment-web2 deployment-web2 output: WARNING - load average: 0.72, 10.81, 8.59 [00:10:42] RECOVERY Free ram is now: OK on deployment-web2 deployment-web2 output: OK: 46% free memory [00:11:32] PROBLEM dpkg-check is now: CRITICAL on deployment-web5 deployment-web5 output: CHECK_NRPE: Socket timeout after 10 seconds. [00:11:42] PROBLEM SSH is now: CRITICAL on deployment-web5 deployment-web5 output: CRITICAL - Socket timeout after 10 seconds [00:12:12] PROBLEM Current Users is now: CRITICAL on deployment-web5 deployment-web5 output: CHECK_NRPE: Socket timeout after 10 seconds. [00:12:12] PROBLEM Disk Space is now: CRITICAL on deployment-web5 deployment-web5 output: CHECK_NRPE: Socket timeout after 10 seconds. [00:12:12] PROBLEM Total Processes is now: CRITICAL on deployment-web5 deployment-web5 output: CHECK_NRPE: Socket timeout after 10 seconds. [00:12:22] PROBLEM Free ram is now: CRITICAL on deployment-web deployment-web output: Critical: 3% free memory [00:12:40] petan you pinged me? :) [00:14:02] RECOVERY Free ram is now: OK on deployment-web3 deployment-web3 output: OK: 71% free memory [00:15:35] addshore: he pinged you about access to hugglewm [00:15:45] I added him, so no worries [00:15:49] :) [00:16:04] Can I ping you about access to the bots wmlabs project? :) [00:16:22] PROBLEM host: driver-dev is DOWN address: driver-dev CRITICAL - Host Unreachable (driver-dev) [00:16:32] petan: ^^ ? [00:16:33] :) [00:16:41] I usually try to avoid giving access to projects [00:16:51] ahhh :P [00:16:58] as it means people are missing from the loop [00:17:26] It would be good if people asked for access requests on the discussion page of the project [00:17:28] !project bots [00:17:28] https://labsconsole.wikimedia.org/wiki/Nova_Resource:bots [00:17:32] PROBLEM Current Load is now: WARNING on deployment-web3 deployment-web3 output: WARNING - load average: 0.05, 11.61, 17.95 [00:18:03] !project-access is To request access to a project, use a project's discussion page; see !project-discuss [00:18:03] Key was added! [00:18:03] willdo :) [00:18:45] !project-discuss https://labsconsole.wikimedia.org/wiki/Nova_Resource:bots [00:18:52] !project-discuss is https://labsconsole.wikimedia.org/wiki/Nova_Resource:bots [00:18:52] Key was added! [00:18:57] !project-discuss bots [00:18:57] https://labsconsole.wikimedia.org/wiki/Nova_Resource:bots [00:19:04] o.O [00:19:22] PROBLEM host: reportcard1 is DOWN address: reportcard1 CRITICAL - Host Unreachable (reportcard1) [00:20:03] !project-discuss [00:20:03] https://labsconsole.wikimedia.org/wiki/Nova_Resource:bots [00:20:05] !project-discuss foo [00:20:05] https://labsconsole.wikimedia.org/wiki/Nova_Resource:bots [00:20:06] !project-discuss is https://labsconsole.wikimedia.org/wiki/Nova_Resource_Talk:$1 [00:20:06] Key exist! [00:20:12] !project-discuss del [00:20:12] Successfully removed project-discuss [00:20:12] !project-discuss del [00:20:14] Unable to find the specified key in db [00:20:15] !project-discuss is https://labsconsole.wikimedia.org/wiki/Nova_Resource_Talk:$1 [00:20:15] Key was added! [00:20:17] :) [00:20:25] !project-discuss foo [00:20:25] https://labsconsole.wikimedia.org/wiki/Nova_Resource_Talk:foo [00:20:32] RECOVERY Current Load is now: OK on deployment-web2 deployment-web2 output: OK - load average: 0.00, 1.47, 4.51 [00:20:32] !project-access del [00:20:33] Successfully removed project-access [00:20:38] !project-access is To request access to a project, use a project's discussion page; see !project-discuss [00:20:38] Key was added! [00:21:22] adium's auto-"correction" and formatting makes me want to: (╯°□°）╯︵ ┻━┻ [00:22:02] RECOVERY Current Load is now: OK on deployment-web4 deployment-web4 output: OK - load average: 0.04, 1.13, 4.04 [00:22:22] PROBLEM Free ram is now: WARNING on deployment-web deployment-web output: Warning: 6% free memory [00:23:17] * werdna waves [00:23:19] how goes Ryan_Lane [00:23:26] poorly [00:23:32] I broke my unicorn's horn [00:23:41] :o [00:23:48] oh right, you're talking about the _base directory on labs [00:23:52] * werdna was confused [00:24:32] PROBLEM host: canonical-bridge is DOWN address: canonical-bridge CRITICAL - Host Unreachable (canonical-bridge) [00:26:42] werdna: how's things in aussie-ville? [00:27:02] they're going [00:27:04] back at uni [00:27:14] I totally need to make a mediawiki extension called aussie-ville. It'll be like farmville, but you'll throw prawns on the barbie, and chase kangaroos [00:27:22] PROBLEM Free ram is now: CRITICAL on deployment-web deployment-web output: Critical: 5% free memory [00:27:30] so, as usual, trying to juggle two jobs, class, appropriate amounts of time at the pub, sleep, et cetera [00:27:35] heh [00:27:36] indeed [00:27:50] fun times [00:30:32] RECOVERY Current Load is now: OK on deployment-web deployment-web output: OK - load average: 0.00, 0.39, 4.25 [00:37:32] RECOVERY Current Load is now: OK on deployment-web3 deployment-web3 output: OK - load average: 0.09, 0.30, 4.99 [00:46:22] PROBLEM host: driver-dev is DOWN address: driver-dev CRITICAL - Host Unreachable (driver-dev) [00:49:22] PROBLEM host: reportcard1 is DOWN address: reportcard1 CRITICAL - Host Unreachable (reportcard1) [00:54:35] PROBLEM host: canonical-bridge is DOWN address: canonical-bridge CRITICAL - Host Unreachable (canonical-bridge) [01:16:25] PROBLEM host: driver-dev is DOWN address: driver-dev CRITICAL - Host Unreachable (driver-dev) [01:19:25] PROBLEM host: reportcard1 is DOWN address: reportcard1 CRITICAL - Host Unreachable (reportcard1) [01:24:35] PROBLEM host: canonical-bridge is DOWN address: canonical-bridge CRITICAL - Host Unreachable (canonical-bridge) [01:43:23] heh. this gluster code is a bitch and a half to write [01:43:42] I'm running all commands via ssh [01:46:25] PROBLEM host: driver-dev is DOWN address: driver-dev CRITICAL - Host Unreachable (driver-dev) [01:49:25] PROBLEM host: reportcard1 is DOWN address: reportcard1 CRITICAL - Host Unreachable (reportcard1) [01:52:25] PROBLEM Free ram is now: WARNING on deployment-web deployment-web output: Warning: 6% free memory [01:54:35] PROBLEM host: canonical-bridge is DOWN address: canonical-bridge CRITICAL - Host Unreachable (canonical-bridge) [01:56:20] hey Ryan_Lane, you htere still? [01:56:23] yep [01:56:24] I can't log into deployment-dbdump [01:56:27] Permission denied (publickey). [01:56:30] yes my agent is forwarded [01:57:01] you *sure*? :) [01:57:18] because I was able to su to you, and you have an authorized_keys there [01:57:32] andrew-macbook:wmf-deployment andrew$ ssh -A bastion.wmflabs.org ssh deployment-dbdump [01:57:36] Permission denied (publickey). [01:57:52] do you have a key in your agent? [01:57:54] ssh-add -l [01:58:18] is it your labs key? [01:58:36] hmm, the wrong key is in my agent [01:58:39] ;) [01:58:40] 2048 6b:fe:97:06:09:4f:e9:33:14:73:7a:af:24:d5:0a:21 /Users/andrew/.ssh/id_rsa-cca (RSA) [01:58:51] now to figure out how to fix that :) [01:59:02] open another window and make a new agent [01:59:06] then add the correct key to it [01:59:25] or this, right? andrew-macbook:wmf-deployment andrew$ ssh-add ~/.ssh/id_rsa-wikimedia [01:59:34] works now :) [02:16:25] PROBLEM host: driver-dev is DOWN address: driver-dev CRITICAL - Host Unreachable (driver-dev) [02:19:25] PROBLEM host: reportcard1 is DOWN address: reportcard1 CRITICAL - Host Unreachable (reportcard1) [02:20:59] addshore: hi. any issues with your new project and access? feel free to bu me about it now [02:21:40] well, instance creation is broken for now [02:21:45] :P [02:22:32] ah ok. yeah. i saw that mail.. re the base image [02:24:35] PROBLEM host: canonical-bridge is DOWN address: canonical-bridge CRITICAL - Host Unreachable (canonical-bridge) [02:29:05] Ryan_Lane: ugh, now I can't ssh to deployment-sql, and my key is definitely in my ssh agent :) [02:29:53] ok. try now [02:30:07] nscd was acting up [02:30:10] <3 [02:30:20] you rock [02:31:17] deployment-prep is all really really slow, but that's my job to figure out :) [02:31:28] likely needs more squid/varnish [02:31:39] also, we need real hardware for databases [02:31:45] shouldn't, even Special:BlankPage is obscenely slow [02:32:02] I can make MediaWiki run pretty damn fast on a single small server [02:32:13] it's taking like minutes to load Special:BlankPage [02:32:29] I'm betting memc is down [02:33:20] nope, I'll see what comes up in profiling [02:34:28] weird, it looks like the connection's being held open or something. All the HTML is through, including the profiling info, my browser is just insisting that it's still loading [02:41:51] some image holding it up :/ [02:41:55] PROBLEM Free ram is now: WARNING on puppet-lucid puppet-lucid output: Warning: 12% free memory [02:46:25] PROBLEM host: driver-dev is DOWN address: driver-dev CRITICAL - Host Unreachable (driver-dev) [02:49:25] PROBLEM host: reportcard1 is DOWN address: reportcard1 CRITICAL - Host Unreachable (reportcard1) [02:54:35] PROBLEM host: canonical-bridge is DOWN address: canonical-bridge CRITICAL - Host Unreachable (canonical-bridge) [02:56:25] PROBLEM host: deployment-web5 is DOWN address: deployment-web5 CRITICAL - Host Unreachable (deployment-web5) [02:57:00] !log deployment-prep rebooting a few hosts, there is something seriously wrong with fetching resources at the moment [02:57:01] Logged the message, junior [03:04:55] PROBLEM host: deployment-nfs-memc is DOWN address: deployment-nfs-memc CRITICAL - Host Unreachable (deployment-nfs-memc) [03:05:40] PROBLEM dpkg-check is now: CRITICAL on deployment-web deployment-web output: Connection refused by host [03:05:40] PROBLEM Current Users is now: CRITICAL on deployment-web2 deployment-web2 output: Connection refused by host [03:05:40] PROBLEM Total Processes is now: CRITICAL on deployment-web2 deployment-web2 output: Connection refused by host [03:05:45] PROBLEM SSH is now: CRITICAL on deployment-web2 deployment-web2 output: Connection refused [03:05:49] * werdna whistles [03:06:05] PROBLEM Total Processes is now: CRITICAL on deployment-web3 deployment-web3 output: Connection refused by host [03:06:15] PROBLEM dpkg-check is now: CRITICAL on deployment-web3 deployment-web3 output: Connection refused by host [03:06:40] PROBLEM Disk Space is now: CRITICAL on deployment-web3 deployment-web3 output: Connection refused by host [03:06:40] PROBLEM Current Users is now: CRITICAL on deployment-web3 deployment-web3 output: Connection refused by host [03:06:45] PROBLEM host: deployment-squid is DOWN address: deployment-squid CRITICAL - Host Unreachable (deployment-squid) [03:06:55] PROBLEM Free ram is now: CRITICAL on puppet-lucid puppet-lucid output: Critical: 3% free memory [03:07:05] PROBLEM Free ram is now: CRITICAL on deployment-web3 deployment-web3 output: Connection refused by host [03:07:25] PROBLEM Current Users is now: CRITICAL on deployment-web deployment-web output: Connection refused by host [03:07:35] PROBLEM Total Processes is now: CRITICAL on deployment-web deployment-web output: Connection refused by host [03:07:55] PROBLEM Disk Space is now: CRITICAL on deployment-web deployment-web output: Connection refused by host [03:07:55] PROBLEM SSH is now: CRITICAL on deployment-web deployment-web output: Connection refused [03:07:55] PROBLEM SSH is now: CRITICAL on deployment-web3 deployment-web3 output: Connection refused [03:07:55] PROBLEM SSH is now: CRITICAL on deployment-web4 deployment-web4 output: Connection refused [03:08:05] PROBLEM dpkg-check is now: CRITICAL on deployment-web2 deployment-web2 output: Connection refused by host [03:08:35] PROBLEM Current Users is now: CRITICAL on deployment-web4 deployment-web4 output: Connection refused by host [03:08:35] PROBLEM Current Load is now: CRITICAL on deployment-web deployment-web output: Connection refused by host [03:08:35] PROBLEM dpkg-check is now: CRITICAL on deployment-web4 deployment-web4 output: Connection refused by host [03:08:35] PROBLEM Current Load is now: CRITICAL on deployment-web2 deployment-web2 output: Connection refused by host [03:08:40] PROBLEM Free ram is now: CRITICAL on deployment-web2 deployment-web2 output: Connection refused by host [03:09:15] PROBLEM Disk Space is now: CRITICAL on deployment-web2 deployment-web2 output: Connection refused by host [03:09:55] PROBLEM Current Load is now: CRITICAL on deployment-web4 deployment-web4 output: Connection refused by host [03:10:25] PROBLEM Free ram is now: CRITICAL on deployment-web deployment-web output: Connection refused by host [03:10:35] PROBLEM Current Load is now: CRITICAL on deployment-web3 deployment-web3 output: Connection refused by host [03:10:35] PROBLEM Free ram is now: CRITICAL on deployment-web4 deployment-web4 output: Connection refused by host [03:10:35] PROBLEM Disk Space is now: CRITICAL on deployment-web4 deployment-web4 output: Connection refused by host [03:10:35] PROBLEM Total Processes is now: CRITICAL on deployment-web4 deployment-web4 output: Connection refused by host [03:11:10] !log deployment-prep facepalm: apparently all reboots are failing, so this will be down until Ryan brings it all back up tomorrow [03:11:11] Logged the message, junior [03:16:25] PROBLEM host: driver-dev is DOWN address: driver-dev CRITICAL - Host Unreachable (driver-dev) [03:17:40] werdna: arr.heh. i was about to warn you of rebooting.. but got distracted by a query :p [03:19:25] PROBLEM host: reportcard1 is DOWN address: reportcard1 CRITICAL - Host Unreachable (reportcard1) [03:24:35] PROBLEM host: canonical-bridge is DOWN address: canonical-bridge CRITICAL - Host Unreachable (canonical-bridge) [03:26:25] PROBLEM host: deployment-web5 is DOWN address: deployment-web5 CRITICAL - Host Unreachable (deployment-web5) [03:26:55] RECOVERY Free ram is now: OK on puppet-lucid puppet-lucid output: OK: 20% free memory [03:35:35] PROBLEM host: deployment-nfs-memc is DOWN address: deployment-nfs-memc CRITICAL - Host Unreachable (deployment-nfs-memc) [03:37:35] PROBLEM host: deployment-squid is DOWN address: deployment-squid CRITICAL - Host Unreachable (deployment-squid) [03:42:45] RECOVERY host: deployment-squid is UP address: deployment-squid PING OK - Packet loss = 0%, RTA = 0.45 ms [03:44:05] RECOVERY host: deployment-nfs-memc is UP address: deployment-nfs-memc PING OK - Packet loss = 0%, RTA = 3.36 ms [03:46:25] PROBLEM host: driver-dev is DOWN address: driver-dev CRITICAL - Host Unreachable (driver-dev) [03:49:25] PROBLEM host: reportcard1 is DOWN address: reportcard1 CRITICAL - Host Unreachable (reportcard1) [03:54:35] PROBLEM host: canonical-bridge is DOWN address: canonical-bridge CRITICAL - Host Unreachable (canonical-bridge) [03:56:25] PROBLEM host: deployment-web5 is DOWN address: deployment-web5 CRITICAL - Host Unreachable (deployment-web5) [04:16:25] PROBLEM host: driver-dev is DOWN address: driver-dev CRITICAL - Host Unreachable (driver-dev) [04:19:25] PROBLEM host: reportcard1 is DOWN address: reportcard1 CRITICAL - Host Unreachable (reportcard1) [04:24:35] PROBLEM host: canonical-bridge is DOWN address: canonical-bridge CRITICAL - Host Unreachable (canonical-bridge) [04:26:25] PROBLEM host: deployment-web5 is DOWN address: deployment-web5 CRITICAL - Host Unreachable (deployment-web5) [04:46:25] PROBLEM host: driver-dev is DOWN address: driver-dev CRITICAL - Host Unreachable (driver-dev) [04:49:25] PROBLEM host: reportcard1 is DOWN address: reportcard1 CRITICAL - Host Unreachable (reportcard1) [04:54:35] PROBLEM host: canonical-bridge is DOWN address: canonical-bridge CRITICAL - Host Unreachable (canonical-bridge) [04:56:25] PROBLEM host: deployment-web5 is DOWN address: deployment-web5 CRITICAL - Host Unreachable (deployment-web5) [05:16:25] PROBLEM host: driver-dev is DOWN address: driver-dev CRITICAL - Host Unreachable (driver-dev) [05:19:25] PROBLEM host: reportcard1 is DOWN address: reportcard1 CRITICAL - Host Unreachable (reportcard1) [05:24:35] PROBLEM host: canonical-bridge is DOWN address: canonical-bridge CRITICAL - Host Unreachable (canonical-bridge) [05:26:25] PROBLEM host: deployment-web5 is DOWN address: deployment-web5 CRITICAL - Host Unreachable (deployment-web5) [05:46:25] PROBLEM host: driver-dev is DOWN address: driver-dev CRITICAL - Host Unreachable (driver-dev) [05:49:25] PROBLEM host: reportcard1 is DOWN address: reportcard1 CRITICAL - Host Unreachable (reportcard1) [05:54:35] PROBLEM host: canonical-bridge is DOWN address: canonical-bridge CRITICAL - Host Unreachable (canonical-bridge) [05:56:25] PROBLEM host: deployment-web5 is DOWN address: deployment-web5 CRITICAL - Host Unreachable (deployment-web5) [06:16:25] PROBLEM host: driver-dev is DOWN address: driver-dev CRITICAL - Host Unreachable (driver-dev) [06:19:25] PROBLEM host: reportcard1 is DOWN address: reportcard1 CRITICAL - Host Unreachable (reportcard1) [06:24:35] PROBLEM host: canonical-bridge is DOWN address: canonical-bridge CRITICAL - Host Unreachable (canonical-bridge) [06:26:25] PROBLEM host: deployment-web5 is DOWN address: deployment-web5 CRITICAL - Host Unreachable (deployment-web5) [06:46:25] PROBLEM host: driver-dev is DOWN address: driver-dev CRITICAL - Host Unreachable (driver-dev) [06:49:25] PROBLEM host: reportcard1 is DOWN address: reportcard1 CRITICAL - Host Unreachable (reportcard1) [06:54:35] PROBLEM host: canonical-bridge is DOWN address: canonical-bridge CRITICAL - Host Unreachable (canonical-bridge) [06:56:25] PROBLEM host: deployment-web5 is DOWN address: deployment-web5 CRITICAL - Host Unreachable (deployment-web5) [07:16:25] PROBLEM host: driver-dev is DOWN address: driver-dev CRITICAL - Host Unreachable (driver-dev) [07:19:25] PROBLEM host: reportcard1 is DOWN address: reportcard1 CRITICAL - Host Unreachable (reportcard1) [07:24:35] PROBLEM host: canonical-bridge is DOWN address: canonical-bridge CRITICAL - Host Unreachable (canonical-bridge) [07:26:25] PROBLEM host: deployment-web5 is DOWN address: deployment-web5 CRITICAL - Host Unreachable (deployment-web5) [07:46:25] PROBLEM host: driver-dev is DOWN address: driver-dev CRITICAL - Host Unreachable (driver-dev) [07:49:25] PROBLEM host: reportcard1 is DOWN address: reportcard1 CRITICAL - Host Unreachable (reportcard1) [07:54:35] PROBLEM host: canonical-bridge is DOWN address: canonical-bridge CRITICAL - Host Unreachable (canonical-bridge) [07:56:25] PROBLEM host: deployment-web5 is DOWN address: deployment-web5 CRITICAL - Host Unreachable (deployment-web5) [08:16:25] PROBLEM host: driver-dev is DOWN address: driver-dev CRITICAL - Host Unreachable (driver-dev) [08:19:25] PROBLEM host: reportcard1 is DOWN address: reportcard1 CRITICAL - Host Unreachable (reportcard1) [08:24:35] PROBLEM host: canonical-bridge is DOWN address: canonical-bridge CRITICAL - Host Unreachable (canonical-bridge) [08:26:25] PROBLEM host: deployment-web5 is DOWN address: deployment-web5 CRITICAL - Host Unreachable (deployment-web5) [08:46:25] PROBLEM host: driver-dev is DOWN address: driver-dev CRITICAL - Host Unreachable (driver-dev) [08:49:25] PROBLEM host: reportcard1 is DOWN address: reportcard1 CRITICAL - Host Unreachable (reportcard1) [08:54:35] PROBLEM host: canonical-bridge is DOWN address: canonical-bridge CRITICAL - Host Unreachable (canonical-bridge) [08:56:25] PROBLEM host: deployment-web5 is DOWN address: deployment-web5 CRITICAL - Host Unreachable (deployment-web5) [09:16:25] PROBLEM host: driver-dev is DOWN address: driver-dev CRITICAL - Host Unreachable (driver-dev) [09:19:25] PROBLEM host: reportcard1 is DOWN address: reportcard1 CRITICAL - Host Unreachable (reportcard1) [09:24:35] PROBLEM host: canonical-bridge is DOWN address: canonical-bridge CRITICAL - Host Unreachable (canonical-bridge) [09:26:25] PROBLEM host: deployment-web5 is DOWN address: deployment-web5 CRITICAL - Host Unreachable (deployment-web5) [09:46:25] PROBLEM host: driver-dev is DOWN address: driver-dev CRITICAL - Host Unreachable (driver-dev) [09:49:25] PROBLEM host: reportcard1 is DOWN address: reportcard1 CRITICAL - Host Unreachable (reportcard1) [09:54:35] PROBLEM host: canonical-bridge is DOWN address: canonical-bridge CRITICAL - Host Unreachable (canonical-bridge) [09:56:25] PROBLEM host: deployment-web5 is DOWN address: deployment-web5 CRITICAL - Host Unreachable (deployment-web5) [09:56:35] !account-questions | IWorld [09:56:35] IWorld : I need the following info from you: 1. Your preferred wiki user name. This will also be your git username, so if you'd prefer this to be your real name, then provide your real name. 2. Your preferred email address. 3. Your SVN account name, or your preferred shell account name, if you do not have SVN access. [09:57:00] ah [10:00:24] Where I can create the account? [10:00:51] just answer the questions and someone do that [10:01:09] someone would be mutante heh [10:01:10] ah [10:02:20] 1. IWorld 2. vgweb@hotmail.de 3. IWorld. If someone need my real name, ask me via query. [10:02:37] 3 needs to be lower case [10:02:39] but ok [10:02:42] iworld [10:02:46] mutante: can you create it pls [10:02:58] he will be working on huggle wa [10:05:27] IWorld: "Real name is optional. If you choose to provide it, this will be used for giving you attribution for your work. " so i am not asking you :) [10:05:40] ah [10:06:32] :) [10:06:36] petan|wk: you know what, the bot could also output the "created new account" line? hm? [10:06:49] indeed [10:06:53] created new account User:IWorld (via petan, will work on hugglewa, password sent by e-mail) [10:07:01] IWorld: check your mail [10:07:05] ok [10:07:21] I think it could be implemented to script you use to create it [10:07:31] if it's in svn [10:08:01] should all members of hugglewa also bet sys and netadmin though? [10:08:07] be [10:08:16] I can sort it out [10:08:23] !log hugglewa inserted IWorld to project [10:08:24] Logged the message, Master [10:08:37] heh, you were faster [10:08:40] ah [10:08:44] he's already there [10:08:50] Successfully added IWorld to hugglewa. [10:08:53] heh [10:09:35] !access [10:09:35] https://labsconsole.wikimedia.org/wiki/Access#Accessing_public_and_private_instances [10:09:44] this can wait [10:09:45] !access | IWorld [10:09:45] IWorld : https://labsconsole.wikimedia.org/wiki/Access#Accessing_public_and_private_instances [10:09:50] labs are down a bit [10:09:54] yea, please explain he current issue :) [10:09:58] the [10:10:06] I already told him :) [10:10:09] kk [10:10:16] once it's fixed we can create few instances there [10:10:31] Thank you! [10:11:21] your welcome. you can already create an upload an ssh key though [10:11:32] ok [10:11:36] https://labsconsole.wikimedia.org/wiki/Special:NovaKey [10:12:05] Do I need Linux for accessing? [10:12:17] no. are you on windows? [10:12:23] yes [10:12:24] then get putty [10:12:33] ok [10:12:36] !putty [10:12:36] how to tunnel - http://oldsite.precedence.co.uk/nc/putty.html [10:12:36] the full install package, includng puttygen and pageant [10:12:55] use puttygen to create your key, use pageant as an agent to load it [10:13:01] use putty to connect:) [10:13:07] !bastion [10:13:07] http://en.wikipedia.org/wiki/Bastion_host; lab's specific bastion host is: bastion.wmflabs.org; see !access [10:13:10] I know [10:13:33] you can search the bot to get answers for anything you want [10:13:37] @seach bot [10:13:43] @search bot [10:13:44] Results (found 7): morebots, bot, labs-morebots, keys, bots, cs, help, [10:13:47] etc [10:14:29] petan|wk: can i add to an eisting definition? [10:14:36] you need to del [10:14:41] then create it again [10:14:47] !key del [10:14:48] Unable to find the specified key in db [10:14:56] !putty del [10:14:57] Successfully removed putty [10:15:17] !putty official site: http://www.chiark.greenend.org.uk/~sgtatham/putty/ | how to tunnel - http://oldsite.precedence.co.uk/nc/putty.html [10:15:24] !putty is [10:15:25] It would be cool to give me also a text of key [10:15:37] !putty is official site: http://www.chiark.greenend.org.uk/~sgtatham/putty/ | how to tunnel - http://oldsite.precedence.co.uk/nc/putty.html [10:15:37] Key was added! [10:15:38] !putty is official site: http://www.chiark.greenend.org.uk/~sgtatham/putty/ | how to tunnel - http://oldsite.precedence.co.uk/nc/putty.html [10:15:38] Key exist! [10:15:40] that [10:15:41] :) [10:15:41] ;) [10:15:55] !:) is /me laughs [10:15:55] Key was added! [10:15:58] !:) [10:15:58] /me laughs [10:16:01] arr;) [10:16:25] PROBLEM host: driver-dev is DOWN address: driver-dev CRITICAL - Host Unreachable (driver-dev) [10:16:49] Can I use "SSH-2 RSA" [10:16:51] ? [10:16:53] yep [10:17:03] anything what ubuntu knows :) [10:17:12] ah [10:17:32] are 4096 bits in key ok? [10:17:38] yes [10:17:42] ok [10:17:47] upload .pub [10:17:51] you need to copy/paste from the "Public key for pasting box" [10:17:53] ah [10:17:57] instead of saving [10:18:21] well, you can also save it, but that is a different format [10:18:30] ah [10:18:56] DO save your private key though.. preferably in a save place .. maybe a USB flash drive or something f you like [10:19:19] okay [10:19:25] PROBLEM host: reportcard1 is DOWN address: reportcard1 CRITICAL - Host Unreachable (reportcard1) [10:20:09] and add a passphrase to your key [10:20:18] ok [10:20:20] hen start pageant.exe, it becomes a little tray icon [10:20:28] ok [10:20:30] select your private key from pageant and load it [10:20:47] that way you dont have to keep typing your passphrase more than once per sesson [10:21:16] after you see it loaded in the tray icon. just start putty and connect.. you dont need to worry about loading the key in putty itself [10:21:32] ah [10:21:49] in putty enable the setting thought to allow "Agent forwarding" [10:22:04] that will allow you to connect to the bastion host and from there to another instance [10:22:08] forwarding the key [10:22:42] ah [10:23:00] Do I need the key fingerprint? [10:23:03] you can change that, enter a username and hostname, and save that whole thing as a "session" in putty.. so next time it should just be a doulble-click [10:24:35] PROBLEM host: canonical-bridge is DOWN address: canonical-bridge CRITICAL - Host Unreachable (canonical-bridge) [10:24:44] Can I upload the file with "---- BEGIN SSH2 PUBLIC KEY ----"? [10:25:49] IWorld: no, copy/paste the one that starts with just ssh-rsa [10:25:57] ok [10:25:58] see that in puttygen on that box? [10:26:00] ok [10:26:25] PROBLEM host: deployment-web5 is DOWN address: deployment-web5 CRITICAL - Host Unreachable (deployment-web5) [10:26:27] 03/06/2012 - 10:26:27 - Creating a home directory for iworld at /export/home/hugglewa/iworld [10:27:25] 03/06/2012 - 10:27:25 - Updating keys for iworld [10:28:21] And now? :) [10:30:16] load the private key, connect to bastion.wmflabs.org [10:30:25] confirm that works.. then thats it for today i think:) [10:30:42] ah [10:31:06] Do I connect via pageant.exe? [10:32:06] no, thats just where you load the key [10:32:10] connect via putty.exe [10:32:38] provide putty.exe with hostname (bastion..) and your username..then hit connect [10:35:10] I have an error. :-( [10:35:52] wait [10:36:12] 03/06/2012 - 10:36:12 - Creating a home directory for iworld at /export/home/bastion/iworld [10:36:12] http://www.uploadscreenshot.com/image/806762/151621 [10:36:26] !log bastion new member IWorld [10:36:27] Logged the message, Master [10:36:35] you weren't in bastion [10:36:46] ah [10:36:55] try it [10:37:11] 03/06/2012 - 10:37:11 - Updating keys for iworld [10:37:40] okay :) [10:37:51] It runs! [10:40:06] what are the infos like "usage of"? [10:40:22] @search ganglia [10:40:22] Results (found 2): load, load-all, [10:40:24] !load [10:40:25] http://ganglia.wikimedia.org/2.2.0/graph_all_periods.php?h=virt2.pmtpa.wmnet&m=load_one&r=hour&s=by%20name&hc=4&mc=2&st=1327006829&g=load_report&z=large&c=Virtualization%20cluster%20pmtpa [10:40:40] what you mean [10:40:58] if it's info in bastion you can ignore [10:41:06] ok [10:41:44] When we can create hugglewa.wmflabs.org? [10:42:07] wait :) [10:42:12] labs are broken [10:42:16]