[00:41:07] I notice http://www.mediawiki.org/wiki/Wikimedia_Labs/Terms_of_use is marked as "draft"; Is it even theoretically possible to agree to a draft? [00:48:22] 07/23/2012 - 00:48:22 - Creating a home directory for azatoth at /export/keys/azatoth [00:49:21] 07/23/2012 - 00:49:21 - Updating keys for azatoth at /export/keys/azatoth [08:09:58] how do I write and test puppet stuff on my instance? [08:17:32] unfortunately I missed most of the workshop in the hackathon, is there anything written down on this? [08:18:27] Nikerabbit: there is https://labsconsole.wikimedia.org/wiki/Help:Self-hosted_puppetmaster [08:18:43] on an existing instance, apply the puppetmaster::self class [08:18:53] that would git clone our puppet repo in /var/lib/git/operations/puppet [08:18:59] and instruct puppet to check files from there [08:19:07] so you could then edit the puppet manifest from there [08:19:19] and puppetd -tv will happily apply your change :-] [08:19:24] okay [08:19:31] once happy you can send it to gerrit for review [08:19:31] I'll try that, thanks [08:19:47] do note that you will have to manually update your git repo for now [08:19:52] i can't conect by ssh, can anyone check if i'm already member of bastion project? [08:20:02] using: cd /var/lib/git/operations/puppet; sudo GIT_SSH=/var/lib/git/ssh git pull --rebase [08:20:36] Alchimista: what is your loginname? [08:20:44] hashar: alchimista [08:20:55] Alchimista: you are not a member of the bastion project :-/ [08:21:07] have you filled a request somewhere ? [08:21:33] just for the account. [08:21:36] Nikerabbit: let me know if you have any trouble [08:22:04] Alchimista: well I have no idea myself how people are being added to labs but I guess you should receive a notification when being added [08:22:57] hashar: i have the account created, all is missing is that. i'll try poke sumanah [08:23:29] hashar: I'm trying to get new instance running on precise first... for some reason I can't connect to it [08:24:23] what's the difference between nova and pmtpa as availability zone? [08:24:26] Nikerabbit: well you need puppet to run on it and have it install your ssh key [08:24:46] Nikerabbit: I have no idea . I have always used the default availability zone [08:24:58] me too, but it ended up in pmtpa [08:25:16] and from console output I see puppet has run already [08:25:31] channel 0: open failed: administratively prohibited: open failed [08:29:28] Nikerabbit: I have no idea :/ [08:31:55] hmph [08:32:08] I guess I have to wait for someone else [08:35:10] Nikerabbit: What instance is that? [08:35:23] Alchimista: Do you need access to Labs? [08:45:04] Hydriz: translation-memory-3 [08:48:05] hmm, is it online? [08:49:17] hmm, can't see it on labsconsole [08:49:30] what does the console log say? [09:09:44] !log deployment-prep Updated mediawiki-config Updating 96ba09e..66ca8b0 [09:09:47] Logged the message, Master [09:10:51] !log deployment-prep updating core + extensions to their lastest master versions [09:10:52] Logged the message, Master [09:11:45] !log deployment-prep updated mediawiki/core: Updating ef3132f..f8de6a7 [09:11:46] Logged the message, Master [09:13:22] !log deployment-prep updating MediaWiki extensions [09:13:23] Logged the message, Master [09:19:59] !log incubator Imported the full database into devwiki. Lifted the editing restriction on anons and removed the site notice. [09:20:00] Logged the message, Master [09:46:58] Hydriz: something about dhclient [10:02:51] Hydriz: yah, it would be usefull to have access to labs [10:31:32] help [12:06:01] help: cannot access my new instance translation-memory-3 [12:16:32] ^demon: pet an talked about having his C# bot hosted on WMF ( source https://github.com/benapetr/wikimedia-bot ) [12:16:51] <^demon> I've been meaning to ask him a question about getting his repo setup. [12:16:54] ^demon: I am not sure if he really meant to host it in Gerrit [12:19:02] <^demon> petan: ping, when you're around. [12:29:29] ^demon pong [12:29:49] <^demon> Hey. I was about to create your two repos for bot stuff. Where did we want to put them? [12:29:53] <^demon> mediawiki/tools/*? [12:30:08] they are more wikimedia than mediawiki [12:30:16] <^demon> wikimedia/bots/*? [12:30:25] that's ok [12:30:35] <^demon> Ok, will make both of them now. [12:30:41] :) [12:34:05] hashar: I am going to start work on that bot we need for labs to remove all spam [12:34:20] some ideas? [12:34:32] right now it's suppose to delete every page without tag __NOSPAM__ [12:34:37] * supposed [12:34:50] that's a lot of pages to tag [12:34:50] that is dumb [12:34:55] kind of [12:35:08] we want to be able to import pages from production wiki [12:35:11] https://bugzilla.wikimedia.org/show_bug.cgi?id=38391 [12:35:21] and I don't feel like adding __NOSPAM__ to each entries [12:35:29] that was Ryan's idea [12:35:30] :P [12:35:33] to defend me [12:35:39] plus if a spammer just alter an existing article he would definitely let the __NOSPAM__ in :)) [12:35:56] hm... [12:36:08] anyway sorry for using 'dumb' ;-] [12:36:10] ok, what should we do instead than [12:36:13] then * [12:36:21] I keep using that word in another sense than what I mean hehe [12:36:27] is there still that much spam ? [12:36:29] I was thinking it's dumb as well at some point heh [12:36:38] I don't know [12:36:47] but people complains I got some email from Erik [12:37:02] he was like if you won't make that site spamless we will shut it down [12:37:22] I think you were in CC [12:37:32] maybe [12:37:42] somewhere in the thousands of mails I receive per week [12:37:49] hah [12:37:55] though I have a specific rule for Erik :-] [12:38:19] lol [12:38:21] note that I have added sorbs based autoblocking [12:38:23] <^demon> petan: wikimedia/bots/LabsAntiSpamBot and wikimedia/bots/WMIB are both created now. [12:38:28] The wmf devel list is a bit spammy [12:38:32] so anytime a bot is passing through an open proxy/ it should get blocked [12:38:33] nice [12:38:33] <^demon> Made a new "Bot authors" group you're in who has all the right bits set. [12:38:45] also we had an issue with the title blacklister which was not working IIRC [12:39:10] hashar: you replied to that mail, so you probably saw it [12:39:16] ohh [12:39:23] probably already forgot about it :-) [12:39:27] :D [12:39:42] anyway [12:39:45] I like the spam bots [12:39:53] heh [12:39:55] cause they do produce some "real world" traffic on beta [12:39:57] they help to test [12:39:59] yeah [12:39:59] that is great to get some use cases [12:40:01] heheh [12:40:17] I should write a blog about how chinese spammers help us making the world better ;-D [12:40:28] anyway. [12:40:32] I did set up the sorbs blocking [12:40:41] ok, so that mean we don't need bot now? [12:40:41] but I have no idea if it is actually doing anything :-( [12:41:05] oh and Platonides added captcha last week [12:41:18] http://commons.wikimedia.beta.wmflabs.org/w/index.php?title=Special:UserLogin&type=signup&returnto=Special:RecentChanges [12:41:23] (what a smart guy) [12:41:24] ;) [12:41:44] http://simple.wikipedia.beta.wmflabs.org/wiki/Special:RecentChanges [12:41:46] it doesn't work [12:41:51] spammed like hell [12:42:13] I am going to delete it now [12:42:15] maybe already existing accounts ? [12:42:21] I can block them [12:42:25] let's see [12:42:32] I really need to install huggle on beta [12:42:34] :) [12:42:43] that would make it matter of few clicks [12:42:46] yeah some users were created before [12:42:54] what we could do [12:42:58] is trash out all the site content [12:43:02] and reimport it [12:43:05] automatically [12:43:08] say every sunday ;-] [12:43:16] hm... I would rather prefer to find a way to block spammers [12:43:30] that wouldn't let us make custom content [12:43:34] if we were syncing it [12:44:20] but it's one of options of course [12:44:21] looks like the spam accounts on simple were created on July 16th [12:44:26] ok [12:44:27] probably before captcha [12:46:03] blocking now [12:50:01] hashar: we need to make a feed working as well [12:50:08] irc.beta.wmflabs.org [12:50:17] ircd is running but bot doesn't rely RC [12:50:30] it's receiving data though [12:51:40] I guess you are on your own on that side :-]]]]]] [12:51:41] there is no bot atm [12:51:47] I have ZERO knowledge about our IRC setup hehe [12:51:51] nor the bots [12:51:58] but maybe Timo "Krinkle" could help [12:52:05] hm... I don't know much either because that is secret stuff of ops [12:52:23] as long as he has access to production shell, maybe [12:54:09] great, I can't ssh to deployment-feed [12:54:16] mutante-away: ping [12:54:39] someone with novaadmin who can check it? [12:55:16] I am not going to create instance again everytime when it stop working because of puppet [12:58:23] petan: yeah -feed is broken see Ryan email a couple weeks ago [12:58:29] um [12:58:33] -feed got corrupted during the migration [12:58:42] I know it used to host the udp2log system for mediawiki logging [12:58:45] that was the instance with secret configuration Ryan copied to there XD [12:58:48] I am having it migrated to dbdump [12:58:51] which was only there and now is nowhere [12:58:55] cool [12:58:59] drop him an email [12:59:05] ok [12:59:07] maybe he can recover the files from the instance [12:59:11] it's weird that ircd is working though [12:59:17] I can irc there [12:59:22] but bot is down [12:59:32] well maybe the part for ircd did not get corrupted [12:59:39] but the /home/ is more mounted or something [12:59:53] maybe [13:00:04] hm [13:00:12] also I have some changes pending to stop using deployment-nfs-memc to mount the apache, mediawiki files and upload [13:00:32] we will use data-project with some sym links, changes are pending review still [13:00:40] why no scap [13:00:50] scap is different :-D [13:01:00] it is a low priority to me for now [13:01:01] it's what is on prod [13:01:05] ok [13:01:25] the scripts are hardcoded to use production IP [13:01:34] that's bad [13:01:35] so we need to have the scripts converted to templates [13:01:38] what if IP change :P [13:01:42] and do the magic puppet stuff to inject the correct IP [13:01:57] if IP change ops edit the script and ask puppet to redeploy it :-D [13:02:02] everything hardcoded suck [13:02:07] well [13:02:21] we used to have all those scripts in a local directory on zwinger^Wfenari [13:02:39] where any root can alter them without any version tracking I know off [13:02:42] so we improved already :-D [13:02:46] heh [13:02:57] and ops get people outside of their team to help them remove the hardcoded stuff :-D [13:03:06] so it is not perfect, but definitely improved over the last 10 years !! [13:03:13] :) [13:10:31] ahhh [13:10:34] I got role::logging::mediawiki now :-] [13:11:20] 07/23/2012 - 13:11:20 - Updating keys for jhsoby at /export/keys/jhsoby [13:11:56] !log deployment-prep applying role::logging::mediawiki to -dbdump (will bring log2udp) [13:11:57] Logged the message, Master [13:13:23] !log dumps Deleted dumps-incr, was a very buggy instance and had LDAP issues [13:13:24] Logged the message, Master [13:17:08] help: cannot access my new instance translation-memory-3 [13:27:21] 07/23/2012 - 13:27:21 - Updating keys for jhsoby at /export/keys/jhsoby [13:28:21] 07/23/2012 - 13:28:21 - Updating keys for jhsoby at /export/keys/jhsoby [13:32:58] !log incubator Deleted instance incubator-common. No longer in use/needed [13:32:59] Logged the message, Master [13:40:52] !log deployment-prep udp2log restored on beta!!! Still in /home/wikipedia/logs/ and logged by deployment-dbdump [13:40:54] Logged the message, Master [13:41:54] !log deployment-prep rebooting -dbdump to make sure everything works fine :D [13:41:56] Logged the message, Master [15:32:21] Hypothetically, if you were to take 5-10 research databases that donated access to their services to select Wikipedians, and you wanted to locate those sources behind a single (firewalled) access point with only one login, what might be the basic technical specifications to do so? [16:03:05] !log deployment-prep hopefully half fixed the udp2log on deployment-dbdump . Need several changes in the puppet files though cause the udp2log-mw init script seems to conflict with the udp2log one :/ [16:03:07] Logged the message, Master [16:23:50] help: cannot access my new instance translation-memory-3 [16:25:08] Nikerabbit, is it fully booted? [16:26:41] Platonides: dhclient keeps complaining something [16:26:50] but it has been so for many hours, so [16:31:19] did you choose the right OS? [16:31:30] that caused issues in the past [16:32:20] aslo, did you set any security groups? [16:32:28] that can also break instance generation [16:39:33] Platonides: I took precise image [18:00:55] 07/23/2012 - 18:00:55 - Created a home directory for preilly in project(s): echo [18:01:58] 07/23/2012 - 18:01:58 - User preilly may have been modified in LDAP or locally, updating key in project(s): echo [18:16:46] Reedy: can you please add me to the bastion and bots projects? [19:14:16] awjr_lunch: I hear you're coming at the end of this week? [19:27:59] ah the amazing Ryan_Lane is around :-D A shame remember about 3 commits I did to OpenStackManager whenever you are in a code review mood: https://gerrit.wikimedia.org/r/#/q/is:open+project:mediawiki/extensions/OpenStackManager,n,z ;-D [19:32:44] hashar: I merged two [19:32:47] one needs to be fixed [19:33:46] you are fast Ryan_Lane ! [19:34:20] well, two of the changes only moved things around and added docs :) [19:34:27] hehe [19:36:13] werdna: yeah! i'll be in the office on weds [19:36:39] I should start learning object mocking in PHPUnit [19:36:53] that makes writing tests easier [19:37:07] awjr: I suppose beers are in order [19:41:24] werdna yes indeed :) [19:47:13] damn [19:47:16] gerrit is TOO fast now [19:48:03] Ryan_Lane: acton=list is handled as an exception at the beginning of the code https://gerrit.wikimedia.org/r/#/c/15892/ [19:48:16] Ryan_Lane: before checking the membership / sysadmin [19:49:20] I have added a comment in the code to clarify it [19:51:20] oh [19:51:27] I missed that [19:52:01] this seems sane, then [19:53:09] ideally I would have used Mediawiki actions [19:53:16] but I have no idea how to use them :/ [19:53:38] apparently we could make the consoleOutput a formless action [19:54:01] I was also wondering how we could make the submission to go back directly to list and show a nice popup message giving the status (ok/ko) [19:54:14] haven't found a way to do that with mw :/ [19:54:52] Ruby on Rails has a nice way of handling that, you can pass your action a flash parameter [19:54:57] def myaction [19:55:09] flash[:notice] = "myaction completed!!" [19:55:14] redirect_to homepage [19:55:15] ;) [19:55:40] hashar: yeah, console output could be formless [19:55:52] the other ones would need a basic form action [19:55:54] I really want all of this to be ajax'd, yeally [19:56:00] like YesNoForm :-D [19:56:22] then we could make the mediawiki actions to be ajax by themselves! [19:56:31] how so? [19:56:38] it requires an API [19:56:44] plop [19:57:33] Ryan_Lane: I can't access my newly created instance and nobody else has figured out why yet [19:58:21] Ryan_Lane: hoooo we need the API too :/ [19:59:14] Nikerabbit: which instance? [19:59:18] in which project? [19:59:52] Ryan_Lane: translation-memory-3 [20:00:39] it's using precise image but that seems to throw it into pmtpa zone which apparently doesn't work like the rest [20:35:50] Nikerabbit: pmtpa works just like nova. they're the same thing [20:36:30] Ryan_Lane: so what could be the issue then? I'm using the ssh proxy way to connect [20:36:42] channel 0: open failed: administratively prohibited: open failed [20:36:42] ssh_exchange_identification: Connection closed by remote host [20:49:00] petan: ping. Will you be implementing the IRC feed system on beta? [20:49:09] yes I hope [20:49:12] petan: just wondering, that is for the project status update :-] [20:49:14] petan: great! [20:49:24] ok [20:50:01] petan: would it let us plug huggle to it ? [20:50:11] yeah [20:50:18] awesome! [20:50:19] huggle doesn't need irc feed [20:50:26] it work even without that [20:50:27] ohh that is a second entry so [20:52:04] Ryan_Lane I need to get files on -feed, these ircd configs [20:52:13] I can't ssh there because it's broken [20:52:29] should be in /etc/ircd-ratbox [20:52:32] or something [20:52:40] dunno atm [20:52:45] but it should be same as on prod [20:52:59] it's not urgent though [20:53:10] well we could setup a new instance [20:53:18] isn't there a puppet class for the ircd ? [20:53:19] yes but I still need these conf [20:53:22] no [20:53:23] oh the conf [20:53:25] :-/ [20:53:26] it's like puppet [20:53:29] secret :D [20:53:31] eh [20:53:34] * squid [20:53:37] not puppet [20:53:39] :P [21:03:23] ;D [21:03:44] https://bugzilla.wikimedia.org/show_bug.cgi?id=37012 [21:03:49] I am in conf call will be back tomorrow :-D [21:03:58] oh that one [21:04:03] I did poke udp2log this afternoon [21:04:07] will look at it tomorrow [21:04:10] ok [21:04:24] what is wrong with it ? [21:04:38] ohh [21:04:43] instance is down [21:04:45] I moved it to deployment-dbdump this afternoon :-D [21:04:49] see SAL hehe [21:04:55] mutante-away, paravoid https://bugzilla.wikimedia.org/show_bug.cgi?id=38611 [21:05:05] aha [21:05:06] ok [21:05:30] that bug can be closed then? [21:05:39] or problem is still same [21:06:22] renamed :P [21:07:03] most of the time t is better to just open a new bug [21:07:04] :) [21:07:13] I have closed 37012 [21:07:21] we should close bugs too [21:07:22] :D [21:07:25] not just open new [21:07:25] the "new" puppet class is role::logging::mediawiki [21:07:37] had to do some fix to udplog too :/ [21:07:43] ok [21:07:45] anyway, I am out for conf call [21:07:46] ;) [21:07:47] to sources? [21:07:49] hmm [21:07:50] see you tomorrow! [21:07:52] ok [22:32:14] 07/23/2012 - 22:32:13 - Creating a home directory for enemyx at /export/keys/enemyx [22:32:47] we want' no enemies at labs! [22:33:13] 07/23/2012 - 22:33:13 - Updating keys for enemyx at /export/keys/enemyx [22:35:02] I can't either [22:35:11] may be one of those stubborn instances [22:35:27] nevermind [22:35:31] I mistyped the name [22:38:24] $ ssh deployment-video01 uptime [22:38:25] 22:38:12 up 1:18, 0 users, load average: 0.09, 0.09, 0.07 [22:38:36] yeah worked for me [22:38:41] have you tried now, j^ ? [22:38:47] maybe you were trying while still being created [22:39:04] j^: are you in SF still this week ? [22:40:18] I have no idea what might be the cause, maybe the ssh key is not correct in labsconsole [22:40:26] or some local configuration :/ [22:40:38] you could ask one of the ops people on 3rd floor ;-] [22:41:04] j^: the puppetmaster:self should help a bit doing the puppetization [22:41:19] for now I am heading bed, sorry. I am waking up in 6 hours :/ [22:41:31] j^, which is your username? [23:48:48] Ohai. Is something wrong with bastion or is something wrong with me? It don't like me anymore. :-( (But I've been inactive for months, that might be it) [23:50:37] andrewbogott: openstack is so much fucking harder to use thanks to keystone [23:50:44] this is seriously absurdly difficult [23:50:55] :( [23:51:01] you need to create services, then endpoints that reference the services [23:51:50] Really? I haven't done any of that by hand but thought it was implicit somehow. [23:52:00] devstack does it for you [23:52:44] Yeah, I'm looking at stack.sh now. These bits must've been added since I first read through the script. [23:54:30] Ryan_Lane: Login to bastion fail; have I been inactive'd out? [23:54:41] what's your username? [23:54:44] marc [23:55:05] I'm surfacing after a wikiburnout. :-) [23:55:22] well, I have a good feeling that the home directories are full [23:55:31] Being an arb on enwp for three years beat me up, chewed me up, then spat me out. :-) [23:56:23] * Ryan_Lane sighs [23:56:27] * Coren whistles innocently. Not me. My gunk is on bots3. [23:56:28] seems the home directories aren't responding [23:56:41] actually, you're eating nearly 1GB [23:56:43] of 18 [23:56:56] How the? [23:57:06] Oh, shared home? [23:57:11] I need to do some log pruning. [23:57:22] I was away for six months. That does bad things.