[01:31:37] Reviewer requested changes to revision D4. [04:16:38] jeremyb: !log in this channel did not update https://labsconsole.wikimedia.org/wiki/Nova_Resource:Deployment-prep [08:49:32] Reedy: yay [08:49:40] did you forget to branch Mobile Frontend? [08:49:50] because it's missing in 1.19 branch [08:50:55] !log deployment-prep removing some extensions from config which are missing in latest branch [08:51:00] eh [08:54:08] !log deployment-prep removing some extensions from config which are missing in latest branch [08:54:15] Logged the message, Master [08:54:21] hi Ryan_Lane [08:54:23] :o [08:54:27] yay [08:54:32] Reedy: around? [08:55:58] Ryan_Lane: logbot is disconnecting for some reason [09:00:48] unable to login currently [09:01:06] !accountreq [09:01:06] in case you want to have an account on labs, please contact someone who is in charge of doing that: Ryan.Lane, m.utante or ssmolle.tt [09:32:19] hi Nikerabbit [09:32:32] what is wrong with login? [09:42:45] try it [09:42:59] Fatal error: require_once() [function.require]: Failed opening required '/usr/local/apache/common/live/extensions/MobileFrontend/MobileFrontend.php' (include_path='/usr/local/apache/common-local/live/extensions/OggHandler/PEAR/File_Ogg:.:/usr/share/php:/usr/share/pear') in /usr/local/apache/common-local/wmf-config/CommonSettings.php on line 2107 [09:44:12] I know [09:44:19] because wmf1 is broken [09:44:27] I switch back to trunk [09:46:15] it's working again [09:46:37] wmf1 is totally broken [09:46:48] it's not just extensions, there is problem with Vector too [09:47:29] Nikerabbit: am I allowed to commit to wmf1 or it must be done by someone from wmf only [09:59:19] petan|wk: if you don't know you probably can't commit to wmf branches [09:59:19] with wmf1 do you mean 1.19 or 1.18? [10:00:51] 1.19 [10:07:25] Ryan_Lane: around?> [10:07:31] there is a problem with memcached in puppet [10:08:29] !log deployment-prep removing the puppetized memcached [10:08:29] Logged the message, Master [11:56:46] surrururur [12:03:43] is labs supposed to support https? [12:03:48] and account creation is still broken [12:04:55] <^demon> s/broken/disabled/ [12:05:56] ^demon: why disabled? why doesn't it say so? [12:06:07] on labs *wiki* [12:06:16] <^demon> Because labs wiki uses ldap. [12:06:49] <^demon> It's not going to be like that forever. [12:06:54] sigh [12:06:59] I'm going to file a bug report about that [12:07:29] <^demon> it is going to use ldap forever...I'm not talking properly yet this morning. [12:07:31] <^demon> Too early. [12:07:39] <^demon> Need caffeine. [12:11:49] ping mutante ssmollett: I'd like to have an ccount for testing translation memory [12:14:45] <^demon> Nikerabbit: Ohhh, I thought you were talking about labsconsole. [12:14:56] <^demon> Not the beta site. [12:15:28] <^demon> w.r.t. account creation. [12:15:34] <^demon> Ignore everything I said about ldap. [12:18:59] ^demon: might want to add a note to https://bugzilla.wikimedia.org/34368 [12:20:40] Nikerabbit: if anything is broken [12:20:43] tell me [12:20:45] on beta [12:21:21] petan|wk: see those two bugs I filed [12:21:30] btw ^demon what if we implemented autocompletion to Special space :P [12:21:43] like Special:Recent would autocomplete to RecentChanges :D [12:21:47] or Special:RC [12:21:49] etc [12:21:51] aliases [12:22:03] <^demon> There was a bug about specials in autocompletion. [12:22:11] aha [12:22:16] I think it would be really nice [12:22:28] <^demon> I don't like shortcuts like Special:RC though. [12:22:39] autocompletion for specials should work already [12:23:35] Nikerabbit: registration work to me, sorry [12:23:39] what is broken? [12:23:48] I mean what you see when you try to register an account [12:24:56] petan|wk: "uknown source, please make sure you accept cookies" [12:25:05] I just registered an account in firefox [12:25:10] using en.wikipedia [12:25:39] http://labs.wikimedia.beta.wmflabs.org/w/index.php?title=Special:UserLogin [12:26:02] it's not so easy to track changes because many people change stuff, but no one track the changes [12:27:26] created test account on labs, with no problems [12:27:32] hmph [12:27:32] which browser you use? [12:27:37] chrome [12:27:38] I will try to replicate it [12:27:40] now it worked [12:27:51] it was probably caused by memcached [12:27:56] ah [12:27:57] it was misconfigured like 2 hours ago [12:28:10] puppet overwrites the local changes [12:28:11] it sucks [12:28:20] I need to do something about it [12:28:28] otherwise puppet version is of absolute no use [12:28:36] absolutely [12:37:17] btw Nikerabbit could you assign all beta bugs to me? benapetr@gmail.com [12:37:29] so I can easily see them [12:37:46] you said there are 2 bugs, but I see only 1 [12:37:52] in bz [12:37:58] petan|wk: ask someone to make you the default cc [12:38:09] * petan|wk seeks someone [12:38:22] there is no bugzilla category for beta site [12:38:29] ^demon perhaps iirc? [12:38:30] [14:07:35] wikibugs_> (NEW) Please support https for http://labs.wikimedia.beta.wmflabs.org/wiki/Main_Page - https://bugzilla.wikimedia.org/34367 normal; Wikimedia Labs: Setup; (niklas.laxstrom) [12:38:34] [14:09:31] wikibugs_> (NEW) Account creation on http://labs.wikimedia.beta.wmflabs.org/ too difficult - https://bugzilla.wikimedia.org/34368 normal; Wikimedia Labs: Setup; (niklas.laxstrom) [12:38:37] and I don't know if I want to be default cc for whole labs [12:39:07] you can do it per component [12:40:11] <^demon> Component name + description + assignee + any other cc list members? [12:41:05] I don't if we call it deployment or beta [12:41:14] both deployment.wmflabs and beta works for that [12:41:24] but current url is beta.wmflabs [12:41:42] <^demon> "Deployment beta" sounds descriptive enough [12:41:46] ok [12:41:55] can you insert it as component of labs [12:42:21] <^demon> Doing that now [12:42:52] <^demon> You want to be the default assignee? [12:43:00] yes, me or hexmode [12:43:16] <^demon> I'll add him to the cc list. [12:43:19] ok [12:44:15] thanks [12:44:51] <^demon> No problem. It's done so you should see it on new bug pages and advanced search now. [12:56:37] Reedy: hi [12:57:03] :o [12:57:17] ^demon: who is working on wmf branches? [12:58:18] <^demon> Reedy [12:58:27] <^demon> He's been doing the branching/merging. [12:58:32] hm [12:58:37] but it's broken [12:58:46] <^demon> Be more specific. [12:58:49] MobileFrontend is missing [12:58:52] ./extensions [12:58:57] it's installed on prod [12:59:15] when I switched most of wikis were not available [12:59:24] <^demon> Hrm, you're right. [13:37:53] Lol [13:38:00] Must've got removed from the list at somepoint [13:39:19] ^demon: we might aswell just branch MF2 [13:40:15] can you fix it?> [13:40:29] it's a blocker to push wmf1 to beta [13:40:48] yeah, i'm just waiting for svn up to run [13:42:35] k [13:42:36] ty [13:42:43] done [13:52:31] Reedy: it works but it looks pretty weird [13:52:46] in firefox I don't see the search button [13:52:55] just floating search text [13:52:56] no idea [13:53:04] somewhere outside of the screen [13:53:13] hm, ok [13:53:43] it should be the same as is running on cluster etc [13:53:59] it's definitely not [13:54:22] on cluster there is an image for that [13:54:42] * Nikerabbit waits [13:54:53] Nikerabbit: ? [13:54:56] does it work to you [13:55:13] it=what? [13:55:24] wondering what you were waiting for :) [13:55:39] it = beta [13:55:41] ah [13:56:11] it's a bit slow [13:56:36] http://en.wikipedia.beta.wmflabs.org/wiki/Main_Page?useformat=mobile [13:56:40] Looks fine for me in chrome [13:57:03] but I'm waiting for account and looking for docs how to use it [13:58:07] Reedy: I meant the regular view [13:58:13] for pc [13:58:22] What? [13:58:29] like no ?useformat [13:58:42] Fine also [13:58:55] in that case it's something here [13:59:02] in browser.. [13:59:04] ok [13:59:25] Nikerabbit: account on labsconsole? [13:59:40] or beta [14:01:22] petan|wk: good question, I don't know the difference, yet [14:04:03] labsconsole is a place to control vm [14:04:05] vm's [14:04:13] beta is a deployment test site [14:04:34] on labsconsole you can create a project and install own software to test [14:04:49] deployment beta is only for testing latest mediawiki before deployment [14:05:09] !labs [14:05:09] https://labsconsole.wikimedia.org/wiki/$1 [14:05:11] <^demon> Nikerabbit: Basically labsconsole is the VM controller. and beta and all the other ones are VMs on that. [14:05:12] meh [14:05:23] !info [14:05:23] https://www.mediawiki.org/wiki/WMF_Projects/Wikimedia_Labs [14:05:30] that's it [14:05:40] !labs Help:Contents [14:05:40] https://labsconsole.wikimedia.org/wiki/Help:Contents [14:05:53] this is a help I started working on [14:05:58] cool [14:06:13] I guess I need labs then [14:06:16] ok [14:06:24] mutante: around? [14:06:35] !account-questions [14:06:35] I need the following info from you: 1. Your preferred wiki user name. This will also be your git username, so if you'd prefer this to be your real name, then provide your real name. 2. Your SVN account name, or your preferred shell account name, if you do not have SVN access. 3. Your preferred email address. [14:06:48] Nikerabbit: that's answers you can prepare for now :D [14:06:51] that are [14:07:26] Ryan or mutante would need to know that in order to create an account [14:07:44] sure [14:07:49] but Ryan or Sara will likely be there after 6pm in eu [14:08:00] dunno where mutante lives [14:08:06] but he's around more often I guess [14:08:12] <^demon> He's got an LDAP account already. [14:08:24] I know but that's not enough I guess [14:08:34] someone still needs to link it to wiki acc [14:08:38] and create an account there [14:08:43] <^demon> There's a command line thing that I can run, but I can't remember it. [14:08:44] that someone needs to be wiki sysop [14:08:45] <^demon> Ryan told me. [14:08:48] <^demon> Shoulda wrote it down [14:08:51] yes there is [14:08:54] I think it's in logs [14:09:00] because he was telling it to many people [14:09:10] but no one yet created a php search engine for logs [14:09:14] so it's going to be hard to find it [14:10:02] oh wait [14:10:05] it's in Help [14:10:31] ok there is how to disable it [14:10:39] maybe if you did it upside down :) [14:10:59] hehe [14:13:55] PROBLEM Disk Space is now: WARNING on nagios 127.0.0.1 output: DISK WARNING - free space: /home/petrb 3403 MB (19% inode=93%): [14:15:16] petan|wk: hi [14:15:19] hi [14:15:25] Nikerabbit needs you :) [14:15:38] yay [14:16:26] ok, reading backlog. needs an account labs ? [14:16:39] yup [14:16:46] and maybe some help too [14:18:55] RECOVERY Disk Space is now: OK on nagios 127.0.0.1 output: DISK OK [14:20:49] Nikerabbit: alright, i dont see you in wiki users list, so what is your preferred wiki user name (which will also be git user name) [14:28:23] arr.. There was either an authentication database error or you are not allowed to update your external account. [14:33:58] PROBLEM Disk Space is now: WARNING on nagios 127.0.0.1 output: DISK WARNING - free space: /home/petrb 2852 MB (16% inode=94%): [14:40:24] !new-labsuser [14:40:24] add-labs-user --wikiname="" --mail="" [14:40:34] <--:) [14:41:00] that's cause there already was an LDAP user, unlike a completely new user..yes [14:41:34] <^demon> mutante: Many thanks [14:43:15] !bastion added nikerabbit as a labs user, using add-labs-user on virt0 [14:43:16] http://en.wikipedia.org/wiki/Bastion_host; lab's specific bastion host is: bastion.wmflabs.org; see !access [14:43:20] !log bastion added nikerabbit as a labs user, using add-labs-user on virt0 [14:43:22] Logged the message, Master [14:43:38] Nikerabbit: try logging in to labsconsole wiki now, using your existing credentials [14:44:21] @search add [14:44:22] Results (found 4): account-questions, new-labsuser, new-ldapuser, domain, [14:44:34] !domain [14:44:34] in case you want to assign a domain to your ip, you can use manage addresses to do that [14:44:44] !new-ldapuser [14:44:44] add-ldap-user [options] [14:44:54] hmm [14:45:08] but if the user is a new user, you can just create it via mediawiki [14:47:27] mutante: existing credentials to where? [14:48:33] Nikerabbit: your LDAP user [14:48:50] mutante: I'm not sure I've ever used it [14:49:18] Nikerabbit: you can just let it reset pw for you [14:49:20] Nikerabbit: your svn user [14:49:40] "If you currently have SVN access, then you have an account," [14:49:50] that's not entirely true [14:49:58] I had it [14:50:13] thought I needed to have it linked to labs [14:50:26] ok, i just linked it though [14:50:35] you can just reset pw in mediawiki that would change it in ldap [14:50:36] so yeah, try reset password via labsconsole mediawiki [14:51:49] petan|wk: yes, the full sentence is ". If you currently have SVN access, then you have an account, but need to have it linked to Labs.", it just did not say HOW to link it, the answer is !add-ldap-user [14:52:23] arg, no, it is: !add-labs-user of course [14:52:48] hm... [14:52:57] got in to the wiki [14:53:18] ok it's time to start reading help ;) [14:53:21] :) [14:53:27] indeed [14:54:42] Nikerabbit: next step is uploading your SSH key via the wiki [14:55:13] we should see how an accounts is created for you on the bastion host [14:55:14] <^demon> mutante: Any clue about gerrit permissions, or is Ryan my only source for that? [14:55:51] ^demon: afraid he is, you mean like "the right to merge" etc? [14:56:09] <^demon> Yeahhhh :\ [14:56:22] <^demon> I'm editing the permissions for my new repo but I'm not 100% sure how I need it. [14:56:23] Nikerabbit: once you got a key up there, try ssh to bastion.wmflabs.org [14:56:52] ^demon: sorry, dont know [14:58:53] mutante: looks like it alrady has my public key (although the interface only shows the beginning of it) [15:00:11] 02/13/2012 - 15:00:11 - Creating a home directory for nikerabbit at /export/home/bastion/nikerabbit [15:00:19] Nikerabbit: you are already in group "sysadmin", but i had to add you to the bastion host project [15:00:31] Nikerabbit: see above, it just created your home after i did that [15:01:09] 02/13/2012 - 15:01:09 - Updating keys for nikerabbit [15:01:56] !log bastion added member nikerabbit [15:01:57] Logged the message, Master [15:02:11] 02/13/2012 - 15:02:10 - Updating keys for nikerabbit [15:03:03] *** System restart required *** [15:03:04] yay [15:03:28] welcome to labs [15:03:50] okay, then, how do I break it? [15:03:53] did you want to join an existing project ? [15:03:57] <^demon> Nikerabbit: rm -fR / [15:04:00] <^demon> :) [15:04:42] mutante: I'd probably start my own [15:05:45] Nikerabbit: as a sysadmin, you should be able to create new instance.. so i'd try that next [15:06:39] Nikerabbit: either just an instance to test, within project "testlabs", or we can create your own separate project right away [15:07:51] I'm not even sure what makes sense :) [15:07:51] suggest a project name? you said "to test translation-memory"?? [15:07:56] yes [15:08:12] the tm is branded as ttmserver [15:08:58] just "translation-memory" ok with you? [15:09:12] whatever it's just a name [15:09:36] that should be clear to everyone what it is about [15:10:08] !log bastion created project "translation-memory" for Nikerabbit [15:10:09] Logged the message, Master [15:10:19] 02/13/2012 - 15:10:18 - Creating a project directory for translation-memory [15:10:19] 02/13/2012 - 15:10:19 - Creating a home directory for nikerabbit at /export/home/translation-memory/nikerabbit [15:11:18] Nikerabbit: you are now a sysadmin and netadmin of that new project, see it in 'Manage Projects' [15:11:20] 02/13/2012 - 15:11:20 - Updating keys for nikerabbit [15:11:46] I see [15:11:51] Nikerabbit: now go to 'Manage Instances' [15:12:09] Nikerabbit: then click 'Add Instance' next to your project name [15:13:00] i suggest you select instance type "m1.small" for now [15:13:35] and leave security groups , DNS domain etc, at defaults [15:14:21] any naming patterns for instances? [15:15:08] not really, i see some ending in -01, some in 1, some just have names without numbers [15:15:37] maybe transmem1 [15:16:26] they are referred to by instance-id internally anyways [15:16:36] aaand it failed [15:16:43] oops? how [15:18:25] mutante: just says failed [15:18:32] "Failed to create instance. [15:19:16] hrmm,then let's try this: go to "Manage projects" and try to add me (Dzahn) as an admin of your project [15:22:41] Nikerabbit: yes there are naming conventions :) [15:22:59] did you try to add the instance to project "translation-memory" and not maybe to "testlabs"? [15:23:26] btw I can't create instances as well [15:23:28] mutante: translation-memory, I didn't see testlabs on that list [15:23:32] I thought I reached a limit [15:23:51] i'll add myself to the project and try [15:23:52] it's maybe a labs problem then [15:24:24] btw naming convention is prefix all hostnames with project [15:24:28] like huggle-blah [15:24:38] oh,ok [15:25:09] unfortunatelly not all people know that [15:25:21] 02/13/2012 - 15:25:20 - Creating a home directory for dzahn at /export/home/translation-memory/dzahn [15:25:29] ah, ther is no 'Add instance link' next to the project name, at least if i am only netadmin [15:25:37] yes [15:25:38] maybe it is a quota [15:25:41] you need to be sysadmin [15:25:55] netadmin is for firewall only [15:26:19] 02/13/2012 - 15:26:19 - Updating keys for dzahn [15:27:23] Created instance i-00000135 with image ami-0000001d and hostname i-00000135.pmtpa.wmflabs. [15:27:35] I can't create instances too [15:27:39] in my projects [15:28:00] !log translation-memory created an m1.small instance translation-memory-1 [15:28:02] Logged the message, Master [15:28:41] :o [15:28:54] why does it ask for the name if there is preferred convention for that? [15:29:15] right you don't have to follow that convention, but it's a good idea [15:29:19] Nikerabbit: do you see that instance now? can you use the "Configure" link next to it? [15:29:27] because otherwise it can conflict with an existing vm [15:29:46] petan|wk: hmm, then there must have been a change in permissions.. [15:30:01] !nagios [15:30:01] http://nagios.wmflabs.org/nagios3 [15:30:21] it's not easy to browse it when you don't follow conventions too [15:30:33] if you do that, all instance are grouped together in nagios [15:31:05] Is nagios still a manual thing or did we decide if we where using puppet or some custom system for it? [15:31:15] of course it's not manual :D [15:31:24] it uses nparser I wrote like months ago [15:31:33] I think I sent a message on wikitech about it [15:31:43] petan|wk: it would be nice if there were Nagios hostgroups and servicegroups per project ... http://nagios.wmflabs.org/cgi-bin/nagios3/status.cgi?hostgroup=all&style=overview [15:31:50] Probably should read wikitech more :P [15:31:56] oh yes, that would be cool [15:32:04] also it would be nice if people could login using ldap [15:32:09] mutante: yes and yes [15:32:10] instead of custom login as now [15:32:38] It would be nice if people could add custom stuff and ack/schedule downtime etc for projects they belong too [15:32:46] Nikerabbit: nice! then try to start it up, without any puppet classes besides default, and login from bastion host [15:32:57] Damianz: you can already do that :P [15:33:01] petan|wk: yes for Nagios LDAP! [15:33:11] see nagios.wmflabs.org/nlogin [15:33:13] petan|wk: I can if I feel you cookies :P [15:33:25] I also sent a message regarding that on labs-l [15:33:26] :P [15:33:37] Yeah not that I have a login to that :P [15:33:53] PROBLEM Current Load is now: CRITICAL on translation-memory-1 translation-memory-1 output: Connection refused by host [15:33:54] I asked many times on many places if someone want a login there :) [15:34:08] so now I pm you one... sec [15:34:29] mutante: I only have reboot, does that mean it is running? [15:34:32] Reminds me I should setup edit monitoring for cbng though as currently I know by people moaning [15:34:33] PROBLEM Current Users is now: CRITICAL on translation-memory-1 translation-memory-1 output: Connection refused by host [15:34:53] PROBLEM Disk Space is now: WARNING on labs-nfs1 labs-nfs1 output: DISK WARNING - free space: /export 917 MB (5% inode=94%): /home/SAVE 917 MB (5% inode=94%): [15:34:54] Nikerabbit: yes, it has state "Running" now [15:34:55] Could do with moving the puppet class to a misc class like Ryan said to do before someone else merged my change [15:35:05] ah I see [15:35:13] PROBLEM Disk Space is now: CRITICAL on translation-memory-1 translation-memory-1 output: Connection refused by host [15:35:47] something we should do to silence the bot? [15:35:53] PROBLEM Free ram is now: CRITICAL on translation-memory-1 translation-memory-1 output: Connection refused by host [15:36:02] Ack the alert if you're going to fix it [15:36:37] Btw is bots-3 better now? It had a few days of getting ram rapped by a bot :( [15:37:03] PROBLEM Total Processes is now: CRITICAL on translation-memory-1 translation-memory-1 output: Connection refused by host [15:37:10] Nikerabbit: because of the way Nagios config is created, it is quicker than the actual instance being up and having the nagios stuff installed.. on creation of new instances [15:37:17] Damianz: you can just use nova to change what services are being monitored [15:37:37] nparser is getting the nova classes and based on that add nagios checks [15:37:43] PROBLEM dpkg-check is now: CRITICAL on translation-memory-1 translation-memory-1 output: Connection refused by host [15:37:49] so if u have a puppetized service you can create a nagios check for that [15:37:50] Nikerabbit: next step after succesful login: sudo puppetd -tv [15:37:55] Ahhh [15:38:01] mutante: didn't get that far yet [15:38:11] I've not quite puppetized cbng as creating debs made me go insane [15:38:18] Permission denied (publickey). [15:38:32] Still on my todo list so we can destory and re-roll the box and loose nothing as mysql is the persistant data :D [15:38:40] Nikerabbit: you need to forward your SSH key, like add it to an agent, and "ssh -A" to the bastion host, then ssh to your instance name, same user [15:38:41] @search access [15:38:41] Results (found 4): access, bastion, account-questions, account, [15:38:46] !access [15:38:46] https://labsconsole.wikimedia.org/wiki/Access#Accessing_public_and_private_instances [15:38:53] mutante: Doesn't he have to wait for the first nagios run to setup the users and stuff? [15:38:57] errr s/nagios/puppet/ [15:39:16] Damianz: last part of puppet is enable ssh [15:39:23] oh, wait it's not [15:39:24] Ah [15:39:35] actually you can see if it's done in console [15:39:41] mutante: yes my key is forwarded [15:39:43] !console [15:39:44] yay [15:39:54] That's true :) [15:39:56] Damianz: hmm, afair i could login right after the homedir created log line appeared [15:40:09] !console is in case you want to see what is happening on terminal of your vm, check console output [15:40:09] Key was added! [15:40:39] Damianz: but then i ran it manually and saw Nagios stuff being added [15:40:46] yes [15:40:48] that's a bug [15:40:51] or something [15:40:55] o.0 [15:40:59] mutante: soo any idea why it doesn't work? [15:41:03] Nikerabbit: yes [15:41:10] @search forward [15:41:10] No results found! :| [15:41:16] @search tunnel [15:41:17] Results (found 1): putty, [15:41:18] Nikerabbit: are you getting Permission Denied? [15:41:20] meh [15:41:26] problem is that your private key is not on bastion [15:41:29] mutante: yes [15:41:36] so that you can't login to any other vm [15:41:53]