[00:05:30] Coren|AFK: Ryan_Lane: Any idea what could be causing socket closing on labs? [00:05:37] It is happening on labs when I try to start an irc bot [00:05:38] ERROR :Closing Link: 208.80.153.192 (Too many user connections (global)) [00:05:46] Warning: There is 1 user waiting for shell: Hkam (waiting 67 minutes) [00:06:00] /data/project/wmfdbbot/dbbot-wm.out [00:06:02] sounds like the IRC is limiting us based on the IP [00:06:03] tools-login [00:06:25] But is it freenode closing us, or labs on itself? [00:06:29] freenode [00:06:42] (Too many user connections (global)) [00:06:49] ERROR :Closing Link: 127.0.0.1 (Connection timed out) [00:07:08] Krinkle: IIRC, the toolserver has an exemption from freenode staff for a higher limit [00:07:25] yep. we probably need to apply for one for labs [00:07:47] and there was an issue after the ts got new IPs recently [00:07:49] I'll contact #freenode, I'm a group contact for some wikimedia projects. I'll create an RT ticket if they need anything from ops. [00:08:14] 208.80.153.192 is the NAT IP [00:08:25] Is that the only IP for labs for now? [00:08:34] yep [00:08:48] it'll change at some point in the future, but likely not for 8 months or so [00:19:16] Warning: There is 1 user waiting for shell: Hkam (waiting 81 minutes) [00:29:49] Coren|AFK: Ryan_Lane: https://rt.wikimedia.org/Ticket/Display.html?id=5055 [00:30:07] Looks like we need to email eyeliner :) [00:31:30] I also have no clue how many [00:32:51] Warning: There is 1 user waiting for shell: Hkam (waiting 94 minutes) [00:33:09] Ryan_Lane: I suppose there is a sense of trust between, us, them and toolserver. So we can probably jus ask for the same without knowing how many. [00:33:20] Or we can ask a ts-admin first. [00:45:09] Krinkle: I asked to have our limit doubled for now, until we've come up with a more accurate number [00:45:25] ok [00:46:17] Warning: There is 1 user waiting for shell: Hkam (waiting 108 minutes) [00:58:45] The wikitech Nagios page said nagios.wikimedia.org "is currently an alias to [[spence]]". Is that still true for its replacement https://icinga.wikimedia.org/ ? [00:59:44] Warning: There is 1 user waiting for shell: Hkam (waiting 121 minutes) [01:05:37] spagewmf: icinga is an alias for "neon" [01:07:12] Ryan_Lane: how about installing http://www.mediawiki.org/wiki/Extension:Interwiki on labs/wikitech [01:07:29] i would like to add an interwiki prefix back that old wikitech had [01:07:32] Thanks mutante, will update [01:07:38] spagewmf: yw [01:07:54] neon is in eqiad, spence is in tampa [01:11:23] mutante: open a bugzilla ticket :) [01:11:43] wikimedia labs product, infrastructure component [01:11:54] ok, i will do, because i'm never sure about the status of the old interwiki table in db, i tried to add it [01:12:10] i used to use that [01:23:46] [bz] (NEW - created by: Daniel Zahn, priority: Unprioritized - normal) [Bug 47906] install Extension:Interwiki on wikitech/labs wiki - https://bugzilla.wikimedia.org/show_bug.cgi?id=47906 [01:27:10] mutante: I added the extension, you can add the interwiki [01:27:52] Ryan_Lane: woohoo, that was quick, thanks!:) [01:27:56] yw [01:28:13] was working on that redis stuff before. didn't know if I'd get to it or forget when you told me :) [01:29:40] "$wgInterwikiMagic", heh [01:30:03] $wgDisableBugs = true; [01:31:24] Ryan_Lane: do you have an edit link or Special:Interwiki though? [01:31:43] do you not? :) [01:32:00] no [01:32:07] hm [01:32:10] I don't either [01:32:46] $wgGroupPermissions['sysop']['interwiki'] = true; [01:32:47] ? [01:33:04] or maybe another group? [01:33:42] it adds a new permission [01:34:27] "The interwiki data is cached. Modifying the cache is not possible." [01:34:28] heh [01:34:51] that's why [01:35:19] does it mean it uses a .cdb ? [01:35:27] yeah. it's using a cdb right now [01:35:41] one generated for production [01:35:55] $wgInterwikiCache = "$wgCacheDirectory/interwiki.cdb"; [01:36:03] hrmm. the extension might not be able to that setup then .. [01:36:08] it can't [01:36:39] ok, then i just want RT in the production one [01:36:41] and of course interwiki.cdb is a hack that only works in producton [01:36:48] yea [01:36:51] which is incredibly annoying [01:36:53] yes [01:37:52] oh well, it was worth a try, thought the extension would have saved us some tickets to change interwiki [01:38:22] heh [01:38:28] well, at least we can see them now! :D [01:39:00] that is true indeed, and while it works via API as well this looks nicer:) [07:29:15] legoktm: your bot is making mistakes. [07:29:18] https://www.wikidata.org/w/index.php?title=Q4212&diff=31763141&oldid=24562400 [07:29:41] yeah >.< [07:29:45] i'm still cleaning up [07:30:32] ok [08:52:18] Warning: There is 1 user waiting for shell: EnDumEn (waiting 0 minutes) [09:05:40] Warning: There is 1 user waiting for shell: EnDumEn (waiting 13 minutes) [09:05:58] hey [09:19:02] Warning: There is 1 user waiting for shell: EnDumEn (waiting 26 minutes) [09:32:23] Warning: There is 1 user waiting for shell: EnDumEn (waiting 40 minutes) [09:45:45] Warning: There is 1 user waiting for shell: EnDumEn (waiting 53 minutes) [09:58:49] Coren ping [09:59:06] Warning: There is 1 user waiting for shell: EnDumEn (waiting 66 minutes) [09:59:16] !sh [09:59:16] http://bit.ly/10eZZoa [10:33:51] Warning: There is 1 user waiting for shell: Kenrick95 (waiting 0 minutes) [12:04:29] Warning: There is 1 user waiting for shell: Suman.bahuguna (waiting 0 minutes) [12:17:54] Warning: There is 1 user waiting for shell: Suman.bahuguna (waiting 13 minutes) [12:28:42] Is there a url that shows all of the wikitech tools? [12:30:50] wikitech tools no [12:30:54] tools project yes [12:31:04] there is nothing like "wikitech tool" [12:31:10] tools is a project of wikitech [12:31:15] :P [12:31:16] Warning: There is 1 user waiting for shell: Suman.bahuguna (waiting 27 minutes) [12:33:28] ok, where is the tools project list? [12:35:15] either root html [12:35:18] or on wikitech [12:35:24] if you click manage projects [12:35:33] you should see list of local- accounts [12:35:39] https://wikitech.wikimedia.org/wiki/Main_Page [12:35:44] each is a 1 tool [12:36:11] not seeing this [12:36:34] I'm just looking for a URL that I can show on my tool so users can get more information [12:36:41] ah [12:36:47] well, Coren would know more [12:36:53] there is a list at tools.wmflabs.org [12:37:11] that will work [12:38:18] www.wmflabs.org should be populated with something [12:43:05] !log deployment-prep updated puppet manifests on -video05 34ad3d6..32fef26 [12:43:08] Logged the message, Master [12:43:25] !log deployment-prep migrating jobruner08 and video05 to the NFS server [12:43:27] Logged the message, Master [12:44:41] Warning: There is 1 user waiting for shell: Suman.bahuguna (waiting 40 minutes) [12:51:23] Coren [12:58:07] Warning: There is 1 user waiting for shell: Suman.bahuguna (waiting 53 minutes) [13:05:03] have you installed the perl modules? [13:11:42] Warning: There is 1 user waiting for shell: Suman.bahuguna (waiting 67 minutes) [13:25:03] Warning: There is 1 user waiting for shell: Suman.bahuguna (waiting 80 minutes) [13:38:26] Warning: There is 1 user waiting for shell: Suman.bahuguna (waiting 94 minutes) [13:45:00] UA31_: Should be. Would you like to try and see if you've got anything still missing? [13:49:02] Coren: https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/Help says "You can create a tool account with the 'Add service group' link in the action column.", yet I get a "You must be a member of the projectadmin role to perform this action." Could you create a tool "dbreps" with me, legoktm and mzmcbride as members? [13:49:24] scfc_de: Known bug, andrew is on it. Sure, I'll create it. [13:50:05] Coren: Thanks. [13:51:28] scfc_de: {{done}}. Also added MZM to tools. :-) [13:51:48] Warning: There is 1 user waiting for shell: Suman.bahuguna (waiting 107 minutes) [13:54:08] (When will I learn that wmbot is something very different than wm-bot?! :-)) [13:55:56] Coren: "Configure project local-[...]" has "Share home directories across instances" unmarked. That's rather surprising. Is this another bug? [13:59:54] scfc_de: o_O I'm not sure I understand what you mean. The project is 'tools'; local-* is just a service group in that project [14:00:35] scfc_de: In other worse, pix^H^H^H URL or it didn't happen. :-) [14:00:39] words* [14:00:56] https://wikitech.wikimedia.org/w/index.php?title=Special:NovaProject&action=configureproject&projectname=local-wikilint [14:01:23] (And the same for dbreps.) [14:02:46] Ah, yeah, terminology fail. :-) "local-wikilint" is a service group in the "tools" project; configureproject is only about the higher-level projects and the service groups inherit. [14:02:46] Admitedly, configureproject should yell at you about the project not existing rather than show you some blank info. [14:02:46] (That part would be a bug) [14:03:07] Yeah, local-* aren't projects at all, they are service groups. [14:03:46] Well, it shows up when I hit any of the "configure" links on https://wikitech.wikimedia.org/w/index.php?title=Special:NovaProject. [14:04:10] scfc_de: Aha! Now /that/ is a bug. [14:05:06] I don't seem to be able to reproduce it on my end, though. [14:05:17] * Coren suspects a permission issue? [14:05:21] Too much karma? :-) [14:05:32] Plz to file a bz? [14:05:54] You don't see "configure" links for tools? [14:06:25] I see /a/ configure link in the Actions column, that leads to the configuration for tools itself. [14:06:40] https://wikitech.wikimedia.org/w/index.php?title=Special:NovaProject&action=configureproject&projectname=tools [14:06:47] Note "projectname=tools" [14:06:48] I have one for every "local-" tool I am a member of. [14:07:27] o_O I don't see those. [14:07:28] Have you done "Show project filter" to show other "projects" apart from "tools"? [14:07:52] I got a couple more.. oh! [14:08:08] There /was/ a bug in show project filter that mistakenly listed service groups for a while. [14:08:25] If you selected some of those then, they'd show as confusingly broken projects. [14:08:49] I don't see em in the filter now, though. Do you still see those? [14:09:10] Warning: There is 1 user waiting for shell: Alvarin32 (waiting 0 minutes) [14:09:21] Ah, okay, so the list as part of the "Tools" section (terminology sucks again) is the one where you're supposed to add/remove members? [14:09:57] "Project filter" shows bots, bastion, webtools, checkwiki, tools, local-wikilint and local-dbreps for me (now). [14:10:01] Yes. You should see an "add user..." and "remove user..." in the entries there. [14:10:12] https://bugzilla.wikimedia.org/show_bug.cgi?id=47101 [14:10:14] Yes, they're there. [14:10:29] Coren:Try if you like [14:11:17] scfc_de: Those are the right links to manage maintainers of specific service groups (aka tool accounts) [14:11:31] Okay, to answer Andre's question, apparently there "is more needed here" to fix the bug :-). [14:11:43] And yes, the terminology is a mess. It's almost as bad as the mediawiki/wikimedia/wikipedia mess. :-) [14:13:34] [bz] (NEW - created by: Peter Bena, priority: Normal - normal) [Bug 47101] Project filter on "Instance list" lists service groups showing up as projects - https://bugzilla.wikimedia.org/show_bug.cgi?id=47101 [14:22:32] Warning: There is 1 user waiting for shell: Alvarin32 (waiting 13 minutes) [14:23:19] Coren: One positive side effect of this bug is that the section titles for the service groups (= tools) are (red-)linked to https://wikitech.wikimedia.org/w/index.php?title=Nova_Resource:Local-wikilint&action=edit&redlink=1 which would be a nice place for documentation. Is this "Nova Resource" for service groups permanent, or do you have another structure for documenting tools in mind? [14:24:20] Probably under subpages of Nova Resource:Tools [14:24:31] scfc_de what? [14:24:43] scfc_de wmbot? never heard of that [14:24:59] petan: /query wmbot :-). [14:25:34] ::moorcock.freenode.net 401 petan wmbot :No such nick/channel [14:26:32] Coren: The nice thing about Nova_Resource:Local-* would be the 1:1 mapping, but I don't have any particular opinion on that. [14:27:01] The problem is that local-* are not globally unique, they are per-project namespace. [14:27:58] How are the URLs then resolved? Or are those service groups not Nova resources (which I'm not sure what exactly the latter are anyway)? [14:28:45] petan: Yeah, but the fun part is that this (at least with ERC) is the "answer" to "@notify petan". [14:29:19] sorry I don't undestand what you mean (what is ERC) [14:29:27] @notify petan [14:29:27] This user is now online in #huggle so I will let you know when they show some activity (talk etc) [14:30:17] petan: http://www.emacswiki.org/ERC: "ERC is a powerful, modular, and extensible Emacs InternetRelayChat client." [14:30:36] aha [14:31:04] so you see wm-bot as wmbot with that? [14:31:25] Nova resources <-> projects, as far as I know. [14:32:57] petan: (This takes way too long to explain a joke, but anyhow ... :-)) No. When I'm "feeling lucky" and don't look up wm-bot's name, but just overconfidently type in "wmbot", the confusion starts. [14:33:13] ah [14:34:24] Coren: Okay, then the "Nova_Resource" links are probably just an artifact of the bug, and putting documentation under Tools/ is a better idea. [14:34:41] They are, as far as I know. [14:35:30] One last question: The descriptions at http://tools.wmflabs.org/home.php were in what files? [14:35:46] scfc_de: The tool's ~/.description if it exists. [14:35:54] Warning: There is 1 user waiting for shell: Alvarin32 (waiting 26 minutes) [14:37:18] Ah, okay, thanks. Would be nice if this could be documented on the web page (which is probably where tool maintainers will look first). [14:38:03] It's in /Help; I should probably point ''there'' from the landing page actually. [14:38:20] In the sidebar [14:39:05] * Coren frowns at IRC clearly not understanding wikimarkup. DWIM, dammit! [14:39:37] With the documentation spread out over mediawiki.org, wikitech and meta, finding "/Help" is hard enough :-). I searched wikitech for ".description" and "~/.description", and it came up empty. [14:39:59] * Coren has no idea if search even works right on Wikitech. :-) [14:40:12] https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/Help [14:41:37] Probably the easiest way to add a link to the landing page if the tool itself isn't at index.* would be some symlink? :-) [14:42:38] petan: do you happen to know how we handle load balancing on the beta cluster? I have a lot of errors that look like "LBFactory_Multi::newExternalLB: Unknown cluster "extension1"" [14:42:50] * addshore returns [14:43:22] chrismcmahon sorry I have no idea :( last time squid was responsible for that [14:43:30] hashar will know [14:44:20] petan: thanks [14:57:45] hello! [14:58:08] Hello, John. [15:01:24] Not sure you saw, but there were TfD tags put on all the library templates last night. I've added some comments. and it looks like at this point, discussion is weighting towards "Keep". [15:01:45] But if you have any advice on handling this, I'd be happy to hear. [15:10:26] scfc_de, if you have the time... can you log out of wikitech, log back in, and then post a screenshot of the project filter to that bug? [15:11:27] andrewbogott: Will do. [15:18:53] scfc_de: thanks! I may have more tests for you in a bit. [15:19:06] andrewbogott: Okay. [15:28:03] scfc_de, can you uncheck the local-* entries in the project filter, submit, and then reload the filter? [15:33:04] andrewbogott: Did that (only leaving "tools" checked), got "Successfully set the project filter." and local-* unchecked, but still there. Reload didn't change that, logged out and in again, still no change: "local-dbreps" and "local-wikilint" still show in the filter list. [15:33:24] scfc_de: OK, cool -- I have an idea of what this might be now. [15:33:25] Thanks. [15:36:27] scfc_de: OK… once more? Just reload the page this time, no need to do anything else. [15:37:07] andrewbogott: Now local-* have disappeared. Well done! :-) [15:37:16] But the other stuff is still there, right [15:37:17] ? [15:37:22] * andrewbogott doesn't want to overcorrect [15:37:42] :-) [15:38:53] Was this a permissions issue or was some code broken? [15:39:10] scfc_de: OK, I'm going to revert my change pending a proper patch getting merged. Don't fret about seeing those options back in the filter for a few days. [15:39:49] I can cope with that. [15:40:03] scfc_de: It was just an oversight… there turned out to be two code paths, one for people who can see all projects and one for people who can only see projects they belong too. I fixed the bug a few weeks back but only in my codepath. [15:40:46] Ah, okay. [15:42:18] Coren [15:43:27] Coren, https://gerrit.wikimedia.org/r/#/c/61783/ [15:50:26] andrewbogott: merged [15:51:18] thanks. There's some scary JS stuff pending merge so this patch will have to wait until someone comes along who's brave enough to deploy those bits too :) [15:51:58] Scary javascript is scary. :-) [15:54:57] UA31_: Success? [15:56:27] segmentation fault [15:56:33] o_O [15:56:46] Can you tell me what command line you are using so I can try to debug it? [15:57:16] perl bot.pl [15:59:21] UA31_: ... it works when I try it. [15:59:43] Can you do the test, and pastebin the problem so I can look at it? [16:00:16] ua31@tools-login:/data/project/elvisor$ perl bot.pl [16:00:16] [16:00:16] [[4: The Remix]] [16:00:16] >> http://www.beyonce.com/music/4-the-remix-ep [16:00:16] 200 OK [16:00:17] ... [16:00:24] Ooops. Sorry. [16:07:51] andrewbogott: the js bits? [16:07:56] deploy away :D [16:08:04] they are reviewed and tested [16:08:56] Coren: Can you setup a new project on tools for me pls? [16:09:11] greenrosetta: Sure thing. What name? [16:09:21] flask-stub [16:09:32] greenrosetta: Maintainer(s)? Just you? [16:09:36] I'm going to create a simple stub project for others to use the workflow [16:09:39] anyone [16:10:03] I spent enough time getting this workflow going, might as well let others use it [16:10:17] o_O? Can't do fully public, I'm afraid, but you can make the files publicly readable though. [16:10:56] as long as anyone can "become" that should be good enough [16:11:02] greenrosetta: Incidentally, that's a nice idea. :-) [16:11:15] gotta hook my bother and sister coders up [16:11:34] greenrosetta: That's the part I can't do, at least not yet. Ryan_Lane: thoughts? Is this something we want a provision for? [16:11:44] Ryan_Lane: OK… here goes. [16:11:56] greenrosetta: (project created, btw) [16:12:00] ty [16:12:21] I'm not sure I know what you mean by opening a workflow [16:12:33] btw, shouldnt people create a page for their tool? eg I created this [16:12:33] https://wikitech.wikimedia.org/wiki/Common-interests [16:12:49] Ryan_Lane: He's making a "skeleton/example" for using CGI with Flow. [16:13:11] this sounds like something that belongs in a gerrit repo [16:13:31] probably, though im an mercural guy at th emoment [16:13:38] greenrosetta: We haven't quite set down the right namespace and titles for tool documentation yet, but we'll point you at it once we figure it out. :-) [16:13:45] I'll have one of you guys gerrit it for me later [16:13:49] Ryan_Lane: I think he wanted it to be a "working example" [16:14:18] this is for use in tools, right? [16:14:26] * Coren nods. [16:14:35] then maybe an open tool? [16:14:59] Yeah, that's the idea. He /can/ add everyone to the service group, but that won't track additions. [16:15:32] just change the sudo policy to allow anyone in the tools project to sudo to it [16:18:59] hahaha [16:19:13] the entirety of the engineering report can't be edited by visual editor :( [16:22:12] how do you use chown to take ownserhip as the logged in user? [16:22:38] you still have to specify your own username, there's no implicit self [16:23:06] whatst he cmd for finding the current username? [16:23:29] greenrosetta: whoami [16:23:58] Ryan_Lane, in several places the OpenStackManager code checks this: if ( !$this->userCanExecute( $this->getUser() ) && !$this->userLDAP->inProject( $projectname ) ) [16:24:03] What does the first half of that check, exactly? [16:24:25] andrewbogott: it checks the right assigned to the special class [16:24:49] for instance: parent::__construct( 'NovaProject', 'manageproject' ); [16:24:59] in that case it would check 'manageproject' [16:25:04] is there an equivilant whoami for owner-group? [16:25:15] greenrosetta: you mean default group? [16:25:19] yes [16:25:30] I copied a directory and want to change the ownership [16:25:31] you can see all the info using id [16:25:50] user and group should be the same thing, though [16:25:55] OK, makes sense. I will copy/paste with confidence :) [16:26:06] heh [16:27:35] Coren, you want the same permissions to delete a group as to create one? [16:27:49] andrewbogott: No, deleting should still need project admin. [16:27:50] nvm... i just created the directory through the term [16:27:55] ok [16:28:13] Since deleting is destructive. :-) [16:33:20] Coren, https://gerrit.wikimedia.org/r/#/c/61788/1 [16:34:07] Coren how can one become a group admin? [16:34:20] there is no management interface for that [16:34:22] andrewbogott: https://gerrit.wikimedia.org/r/#/c/61787/ :P [16:34:22] andrewbogott: did you deploy that change? [16:34:26] I want to test it in production :) [16:34:28] "group admin"? [16:34:37] Coren yes [16:34:41] when you create a tool [16:34:46] you need to create a group for it [16:34:48] service group [16:34:51] * Coren nods. [16:35:03] Ryan_Lane: Yeah, the js is deployed. [16:35:05] cool [16:35:06] some people want to be able to manage that group [16:35:13] Anyone in the service group can add and remove people from it. [16:35:18] aha [16:35:20] didn't know that [16:35:28] hm [16:35:34] someone was asking me before [16:35:43] I'm not seeing it for reboot [16:36:02] Ryan_Lane: is this the instance api JS thingy? [16:36:05] petan: It's done (unintuitively) from the Manage Projects interface [16:36:09] ori-l: yep [16:36:17] * ori-l looks [16:36:21] Coren is creating fully automatic now? [16:36:33] I tested your version on nova-precise2 [16:36:34] or is there still a need to run cripts [16:36:36] scripts [16:36:37] petan: Yes, with the merge just done. [16:36:39] let me check virt0 [16:36:59] andrewbogott: Merginated. [16:37:02] Coren so now when people want to create a new group, they create it themselve, and the databases etc are created? [16:37:09] petan: Right. [16:37:39] did you prevent people from creating dangerous user names? [16:37:41] like * [16:37:42] petan: /usr/local/sbin/toolwatcher [16:37:43] etc [16:37:50] gah, it's throwing an error [16:37:56] i'll diagnose, sec [16:38:06] petan: wikitech only allows [a-z][a-z0-9-]* IIRC [16:38:10] ori-l, do you have +2 on core? Lack of this patch makes testing mwreview_singlenode annoying: https://gerrit.wikimedia.org/r/#/c/61064/ [16:38:14] ok [16:38:24] ori-l: Although, I think the patch needs work before it gets merged. [16:38:48] andrewbogott: I do, added self as reviewer, will look when I get the chance [16:39:04] thanks. Probably I should nag maxsem as well. [16:39:34] * MaxSem got nagged [16:39:44] :) [16:42:13] Coren: Where should crontabs be installed? -login? [16:42:44] scfc_de: Yes. I'm looking into a distributed cron alternative but, in the meantime, -login will do. [16:44:24] I think the default cronie has some cluster functionality (that's also used on Toolserver). I was talking about crontabs just for submitting SGE jobs anyhow. [16:44:50] Yeah, I want a distributed cron for redundancy purposes. [16:46:47] andrewbogott, amended per comments [16:47:30] this month's labs report was pretty large. thanks guys :) [16:47:44] I probably forgot some stuff, too. feel free to update: https://www.mediawiki.org/wiki/Wikimedia_engineering_report/2013/April#Technical_Operations [16:48:21] hi Ryan_Lane, any updates on the root partition size problem? [16:49:30] not yet [16:49:46] BTW, /home on Tools is owned by petrb.root. That doesn't look right. [16:50:30] hm. I'm specifying the root size as: rootsize = 10240 [16:50:39] fucking vmbuilder [16:51:21] scfc_de: Indeed not. Greedy petan. :-) Fix't. :-) [16:51:30] huh [16:51:37] wtf [16:51:42] petan: All our homes are belong to you? :-) [16:51:42] howcome it was owned by me? [16:51:54] I never chowned that or I don't remember that [16:52:12] petan: Might be a burp when I did the rsync to move the homes from gluster to NFS [16:52:21] I usualy log all commands I do with sudo... lemme check my history [16:55:27] ottomata, I'm a bit uneasy about the inbetween state that puppetmaster::self is in right now. Are you mostly done with your dev work there and it's just a question of updating the docs? [16:55:58] The docs say to use puppetmaster::self and don't mention role::puppet::self but I'm pretty sure the former is broken. [16:56:17] um… oops, he isn't here. [16:56:18] oh... it might be me [16:56:28] I did chown .* once, in my home [16:56:37] which took effect probably on .. [16:56:39] as well [16:56:41] andrewbogott: AFAICT, puppetmaster::self is still working. [16:56:51] petan: I would have. :-) [16:56:52] It failed for me yesterday but it could've been a fluke [16:56:58] interesting, didn't know shell does that [16:57:18] * won't match . and .. unless you ask it to. Which you did. :-) [16:57:43] Just be glad you didn't chown -R .* :-) [16:57:44] * won't match any hidden file [16:58:05] I try to avoid -R and -f everytime when I use * in shell ;) [16:58:20] Ryan_Lane: I was naughty [16:58:29] oh? :) [16:58:31] More precisely. * won't match anything that starts with a . but .. isn't special that way. .* matches it [16:58:41] Ryan_Lane: https://gerrit.wikimedia.org/r/#/c/61790/ [16:59:04] !log tools petrb: fixed invalid permissions on /home [16:59:06] Logged the message, Master [16:59:12] hm. weird [16:59:19] I wonder why this worked on nova-precise2 [16:59:49] it's required by other modules so depending on how resourceloader chose to order assets it may or may not crash [16:59:53] ah [17:00:26] heh [17:00:29] anyways, that's entirely my fault, should have noticed that [17:00:34] I see something else was missed, too :) [17:00:50] oh? [17:00:56] reboot is supposed to replace "active" with "rebooting" when success is returned [17:01:08] well, with the response from the api [17:01:24] no worries. I'll add that back in. [17:01:29] thanks [17:01:43] thanks for the help on it :) [17:02:32] how would you feel about making JS a requirement for the management interface, btw? [17:03:43] [bz] (NEW - created by: m.p.roppelt, priority: Unprioritized - enhancement) [Bug 47900] install tcl 8.6 - https://bugzilla.wikimedia.org/show_bug.cgi?id=47900 [17:05:59] Coren: $HOME ("~") for tools is "/data/project/$TOOL/" with a trailing "/". This leads to "echo ~/bin" = "/data/project/dbreps//bin". I don't think that's an error per se, but confusing. [17:07:04] scfc_de: It's ugly. I'll look into tweaking that. [17:11:20] ori-l: well, right now it can fall back for every action [17:11:20] ori-l: I'd kind of prefer that be the case [17:11:21] yeah, that's a defensible choice :) [17:11:22] it's pretty simple writing the htmlform code and the api code, anyway [17:13:20] Coren: Thx. [17:41:42] Coren [17:41:51] UA31_: Yes? [17:44:54] Have you repaired the core dump error [17:46:48] UA31_: Like I told you earlier, I cannot reproduce the error. When I run your bot, it works with no core dump. [17:47:00] [11:59:43] Can you do the test, and pastebin the problem so I can look at it? [17:48:09] http://pastebin.com/Zch6jHuf [17:48:14] we really should start using bugzilla for problems [17:59:52] !ping [17:59:53] pong [18:00:27] !bug is https://bugzilla.wikimedia.org/enter_bug.cgi?product=Wikimedia%20Labs [18:00:27] This key already exist - remove it, if you want to change it [18:00:33] that bot is parsing approx 300 messages from irc per second o.O [18:00:40] UA31_: Found your problem. You're trying to use SSL from threads. IO::Socket::SSL isn't thread-safe. [18:01:05] UA31_: man IO::Socket::SSL (check the BUGS section) [18:01:18] !bug [18:01:18] wm-bot: srsly, start working faster [18:01:18] Hi petan, there is some error, I am a stupid bot and I am not intelligent enough to hold a conversation with you :-) [18:01:19] https://bugzilla.wikimedia.org/$1 [18:01:23] petan: If it was on the bad side of a netsplit, it might still be badly lagged. [18:01:54] well, it is just that it joined 60+ channels, and ircd sends hell a lot of lines to it [18:02:04] I did tcpflow on server where it run [18:02:09] interesting matrix :D [18:03:15] Coren: Didn't you write a script to give ownership of files to a tool? "giveaway"? "takeaway"? [18:03:25] !rb is broken? report a bug: https://bugzilla.wikimedia.org/enter_bug.cgi?product=Wikimedia%20Labs [18:03:25] Key was added [18:03:29] !rb [18:03:30] broken? report a bug: https://bugzilla.wikimedia.org/enter_bug.cgi?product=Wikimedia%20Labs [18:04:16] scfc_de that isn't really simple to write :o [18:04:43] I believe it is possible to let members of a same group, give ownership to another member [18:05:40] petan: Not that I know of (and it doesn't work on Tools anyway: "chown petrb a": "chown: changing ownership of `a': Operation not permitted"). [18:06:26] hackathon plan tickets £101 [18:06:27] scfc_de: I have. Ryan_Lane doesn't like it though. [18:06:50] scfc_de: There is a sudo in place to chown the entire tool directory recursively. [18:07:42] scfc_de: Or you might "accidentally" figure out that it's still in ~marc/bin/take [18:07:43] :-) [18:07:45] addshore won't be cheaper here [18:08:19] i turn up on thursday but a half hour after the registration ends D: [18:08:58] Coren lol that is actually root cause of that weird /home - I was taking some scripts you had in your ~/bin so that addtool actually worked :P that's why I had to do chown petrb .* later [18:09:18] you have .my.cnf there I needed [18:09:31] without addtool produced just a bunch of errors [18:09:54] nice, it just went down to £96 ;p [18:10:20] addshore good you can spend some 5 pounds for more beer [18:10:25] :D [18:10:33] Coren: Hmmm. As local-dbreps: "-bash: /home/marc/bin/take: Permission denied". As scfc works, but that's the wrong way around. Anyway, "cp && mv" works good enough :-). [18:10:55] petan: it just went down to 76.98 O_o [18:11:01] scfc_de: Ah, indeed, my home might be a bit too restricted. :-) [18:11:02] MOAR [18:11:03] :D [18:11:30] addshore are you paying for tickets in gold or what that it changes the price so fast [18:11:41] 95.98 now O_o [18:11:44] or bitcoins? :P [18:11:53] in pounds :P [18:12:31] No hold luggage added :< god dammititt [18:12:55] Coren: Could you install emacs on -login as well, please? [18:13:20] addshore you don't need luggage :P [18:13:31] just laptop [18:13:38] XD [18:13:44] I havn't flowln anywhere in a long time :P I'm not sure how much stuff you can actually take xD [18:13:53] neither I did [18:13:59] that is why I probably will take a train [18:14:06] I don't like airports [18:14:13] chaos and drama :D [18:14:37] petan: train for me will cost so much more :< [18:14:47] I will need to compare the prices [18:14:54] maybe I will have that problem too [18:15:19] flight is about 1h, train is about 10h :P [18:15:22] scfc_de: emacs? Eeew! [18:15:41] petan: Weren't you based in Germany? [18:15:56] Coren: *E*macs. Yeah! [18:16:00] scfc_de no, but I am pretty close [18:16:13] to germany :P [18:16:17] not netherlands [18:16:28] scfc_de: Done. Emacs has been inflicted upon -login. :-) [18:16:45] Coren: Perfect. Thanks! [18:16:48] petan is neighbour to germany ;-) [18:16:57] "One doesn't /install/ emacs, one /perpetrates/ it." [18:17:16] scfc_de if I was located in Germany, I would probably get a reply to my job application as TS sysadmin :P now they didn't even bothered to tell me "sorry" [18:17:30] :x [18:18:14] well, I wasn't matching a lot of requirements though :P being located in berlin was one of them I think [18:21:04] Coren: As local-dbreps, if I "mysql": "ERROR 1045 (28000): Access denied for user 'dbreps'@'tools-login.pmtpa.wmflabs' (using password: YES)". Works for local-wikilint. Forgot to run some script? [18:22:11] Hm. No, as far as I can tell it should work. Lemme check somethings. [18:24:29] scfc_de: Ah. My screwup. Gimme a sec. [18:25:37] scfc_de: Try this? [18:25:51] Coren can I have some rants regarding /usr/local/sbin/toolwatcher [18:25:54] :D [18:26:06] Coren is it in git? [18:26:09] petan: Rant away. [18:26:23] Coren first of all, I don't like relying on "cd" in scripts [18:26:30] like, it beging with cd /data/project [18:26:34] Coren: Works. [18:26:55] if /data/project wasn't mounted or not accessible, it would created a lot of mess in current directory where it starts from [18:27:18] Coren if it's in git I would be glad to update it a bit :P [18:28:01] or I can just update it, but... versioning is useful [18:28:46] petan: Well, first off, note that it deliberately cds into /data/project then cds back to /tmp. This has three very important uses: forces an automount, allows an unmount, and creates the project directory in /tmp if something breaks. [18:28:59] aha, I just noticed that [18:29:13] Although, admitedly, just doing nothing if /data/project isn't there would be a reasonable option. [18:29:30] well, or putting /data/project in a variable and prefix all paths with that [18:29:40] like mkdir $data/$tool [18:29:52] or even mkdir "$data/$tool" [18:30:07] If you did that and the directory wasn't there for any reason, the mysql would create the credentials but have nowhere to save them. [18:30:13] that would be separator proof [18:30:23] true... [18:30:31] it could check the return codes though [18:30:38] and break on error [18:31:17] like mkdir "$data/$tool" || exit 1 [18:31:39] You don't want it to break on error, it has to keep running but fail gracefully. That's why I cd in /data/project but still -d "/data/project/$tool" [18:31:39] the whole part that creates directory could be wrapped into 1 script and mysql into second script [18:32:04] Coren it would not exit, it would just skip the current loo [18:32:06] loop [18:32:27] like it would start script 1 and if successful, it would start script 2 (mysql) otherwise it would continue [18:32:35] well, I don't really care it works as it is :P [18:33:04] Only change I'd make right now is perhaps check that the forst cd worked before doing the rest. :-) [18:33:19] It'd just not create the home instead of creating it in /tmp [18:33:36] But I like it in /tmp because then we can move it back once the filesystem is fixed. [18:33:40] btw I am afraid that now if it wasn't able to create a directory for tool it would create mysql anyway [18:33:51] Well, things seem to be settling down in the TfD discussion. Will watch for a resolution or a new issue kicking up. [18:34:21] JohnMarkOckerblo: Sorry, the wheels of Legal turn slowly. :-) [18:35:03] TfD? [18:37:32] petan: Indirectly related to Labs. John is working on a tool to link to library sources and one of his templates was under fire as "spamming" of some sort on enwp. Cooler heads prevailed. [18:37:37] :-)\ [18:38:00] oh [18:38:13] template for deletion :D aha [18:38:59] Actually, all of them were. Hopefully the tags will come off before long so they stop looking weird :) Thanks for your help. [18:41:11] JohnMarkOckerblo: Sometimes, the enwp community can be... a bit reactionnary. :-) [18:42:04] haha [18:42:06] you tell me [18:44:00] Coren: could you try and see why I'm getting a 500 on http://tools.wmflabs.org/flask-stub/cgi.py [18:44:12] im not even getting a python.err message [18:44:30] check apache error log [18:44:42] dunno how [18:44:44] show me? [18:45:05] ori-l Not available currently on tools. [18:46:13] greenrosetta: You have a syntax error that prevents the cgi from getting far enough to redirect errors. Line 7. [18:46:22] Are you allowed to have a - in a bare module name? [18:46:25] Coren why not let people enable error displaying in browser? [18:46:32] which file? [18:46:46] In /data/project/flask-stub/public_html/cgi.py [18:47:15] petan: It's difficult to split and anonymise the error log on apache 2.2; that's why I have an upgrade to 2.4 in the pipeline [18:48:27] Coren: I've no idea why it works on my common-interests app [18:48:40] Pretty much the same file [18:49:33] greenrosetta: I think you're not allowed to have a '-' in a module name, at least not without quoting it somehow. I'm no python expert though [18:54:01] yeah, that's correct [18:57:36] module = __import__('thing-with-a-dash') [18:59:04] Probably not something suitable for a sample CGI targeted at novice users. [19:02:44] ERROR 1045 (28000): Access denied for user 'flaskstub'@'tools-login.pmtpa.wmflabs' (using password: YES) [19:02:59] I thought "mysql" would just work for a "become" user [19:26:59] greenrosetta: It would have, were it not for a silly error of mine. [19:27:07] greenrosetta: Lemme fix that for you. [19:28:37] greenrosetta: fix't [19:36:20] addshore well I gave up on my plans [19:36:23] taking plane... [19:36:28] it is cheaper as well [19:49:24] hehe petan :P [19:49:45] I have to catch a 3 hour train from the west to east of the UK to then catch a 1 hour plane xD [19:51:52] Warning: There is 1 user waiting for shell: Intelimal (waiting 0 minutes) [19:56:54] addshore I thought ur in London? [19:57:00] nope [19:57:03] oh [19:57:29] is Danny _ B Dab of TS? [19:57:33] for some reason I think that every englishman is from London [19:57:46] no [19:57:48] haha petan silly you ;p [19:57:55] hmm dab sint on irc :/ [19:57:56] poah [19:58:01] he is Danny_B of Danny :D [19:58:15] Sometimes I think lots of Londoners think every Englishman is from London. [19:58:29] addshore: he's not on right now [19:58:39] Krenair: Aren't all the /real/ ones? :-) [19:58:41] @seenrx Dab [19:58:41] petan: Last time I saw Dab1001 they were leaving the channel #wikimedia-wikidata at 3/31/2013 6:10:51 PM (31.01:47:50.3951890 ago) [19:59:05] @seenrx Da.*b [19:59:05] petan: Last time I saw Danny_B|backup they were quitting the network with reason: Quit: Page closed at 2/11/2013 12:34:22 AM (79.19:24:42.8598860 ago) (multiple results were found: Danny_B|webchat, Dalba, Danny_B|webgate, Danielinblue, DarTar-bedtime and 2 more results) [19:59:12] lol [19:59:15] not a best regex heh [19:59:21] addshore: lookup DaBPunkt [19:59:30] @seenrx dabpunkt [19:59:30] petan: I have never seen dabpunkt [19:59:44] meh doesnt matter, i went ahead and changed what I was going to change :P [20:00:03] addshore rm -rf /usr ? [20:00:11] was that what you were changing? :D [20:00:26] nah, just rm -rf * [20:00:32] mv /home /usr # makes more sense [20:00:54] in windows it's called users [20:00:58] so /usr is closer [20:00:59] :P [20:01:11] btw it's funny to read history of unix FS [20:01:22] with explanations why these folders are called so weird [20:01:38] basically, UNIX people are weird [20:01:40] just as petan [20:02:28] :P [20:02:36] petan: hows huggle coming along/ [20:02:37] ? [20:02:43] !lawl is http://en.wikipedia.org/wiki/Filesystem_Hierarchy_Standard [20:02:44] Key was added [20:02:47] addshore you ask me :D [20:02:48] andrewbogott: had you already deployed this change that's in /w on nova-precise2? [20:02:49] lol [20:02:49] I was just considering fetching the latest versiona nd playing :P [20:03:05] or are you still working on that in there? [20:03:14] I was waiting for a day when huggle developers will ask me "how is the development going on?" :D [20:03:33] addshore it goes slowly, because you are unhelpful :D [20:03:45] Ryan_Lane: You're free to reset whatever's running on nova-precise2, I don't ever code directly there. [20:03:50] ah [20:03:50] I'm not sure what's running atm [20:03:50] cool [20:04:00] api stuff is [20:05:19] Warning: There is 1 user waiting for shell: Intelimal (waiting 13 minutes) [20:05:26] addshore latest version suck but I will work more on that soon [20:05:35] addshore it's just I spend a lot of time with my irc client :P [20:05:45] hah! [20:05:48] far more fun :D [20:05:52] i need to get back on huggle [20:06:03] got exams until hackathon now :P [20:06:16] mhm [20:06:24] exams... that's why I don't like school [20:07:07] seriously... most of the stuff I didn't like in school I already forgot... what these exams are for :D [20:07:31] just put you in a load of stress [20:07:52] nah, work is for a load of stress [20:08:00] In early versions of the UNIX Implementation Document from Bell labs, /etc is referred to as the etcetera directory,[23] as this directory historically held everything that did not belong elsewhere [20:08:01] :D :D [20:08:28] so now I have justification for putting random crap in there [20:18:56] Warning: There is 1 user waiting for shell: Intelimal (waiting 27 minutes) [20:32:28] Warning: There is 1 user waiting for shell: Intelimal (waiting 40 minutes) [20:34:11] * addshore tells petan NO ;p [20:46:02] Warning: There are 2 users waiting for shell, displaying last 2: Intelimal (waiting 54 minutes) JamesR (waiting 9 minutes) [20:59:33] Warning: There are 2 users waiting for shell, displaying last 2: Intelimal (waiting 67 minutes) JamesR (waiting 22 minutes) [21:28:41] what are the different methods by which we can transcode .wav files to .ogg at the wikimedia labs server? [21:32:40] can anyone help me out? [21:33:23] ggmpeg [21:33:30] ffmpeg* [21:34:12] Damianz: could you elaborate, thanks for replying [21:35:19] apt-get install ffmpeg; ffmpeg -i file.wav -acodec libvorbis file.ogg [21:36:07] Damianz: Will i need a virtual machine for that ? [21:36:28] yeah, what are you actually doing? [21:37:12] This is regarding a project for recording pronunciations using a type of wizard. [21:37:35] https://bugzilla.wikimedia.org/show_bug.cgi?id=46610 [21:37:43] Damianz: http://www.mediawiki.org/wiki/User:Rahul21/Gsoc [21:38:02] It's for GSOC. I'm mentoring Rahul if it gets accepted (along with Michael Dale). [21:38:15] The idea is that if we can't upload WAV to Commons, we can transcode it elsewhere then do so. [21:38:51] At least as a temporary measure [21:38:52] Damianz: since browser's record voice using webRTC in .wav format, we need to transcode it to .ogg then upload it to commons [21:39:22] yeah an instance is probably a good idea - you can write a simple extension to upload the files then use a scheduled job to transcode them using ffmpeg then publish... I think there's something like this already but not for this specific use case [21:41:59] Actually the code I'm thinking of generates a static image for the thumbnail on videos [21:42:03] But the principle is the same [21:44:27] Damianz: so it basically is, upload the files to the labs server, using a scheduled job transcode them [21:44:51] Damianz: could you provide me with some resources that might be handy [21:45:05] Depending on how you'd design the workflow/what feedback you want to give the users (ie fake real time vs don't care) then yeah [21:45:29] * Ryan_Lane twitches [21:45:39] this is going to be as a proof of concept that we'll use in production, right? :) [21:45:42] * Damianz gives Ryan_Lane his pills [21:46:00] Damianz: it is real time [21:46:24] then you'll have to use a nice queue system and fudge real time, scheduled tasks won't do [21:46:45] ah. I missed some of the scrollback [21:46:48] look at redis/celery or such (dunno php equiv) and make a nice ajaxy 'wait while we transcode it' thing [21:47:00] Ryan_Lane, it's really only a fallback in case we can't upload WAV directly to Commons. [21:47:09] If we can, they we can used TimedMediaHandler instead. [21:47:21] Which can convert to OGG for playback. [21:47:38] mhhm [21:49:09] Damianz: is it complicated and time consuming? [21:49:43] complicated depends on how much you can fudge time and at what scale/volume you require processing... time consuming, not massivly [21:51:13] Basically you make a FIFO queue, throw up some workers to process jobs and throw jobs into it (at a very high level) [21:51:33] Or try and do real, real time and you'll hurt really badly very quickly [21:52:11] so the queue is important ? [21:55:50] Damianz: so the queue is important? and how much time does it take for it to transcode ?(an estimate) [21:58:25] transcoding time depends on a bunch of things (It's not massivly my area) but quality, length, cpu avaible, as well as the normal disk read/write speeds etc all make a different IIRC [21:59:32] Normally for stuff like that you'd use a queue with a number of workers (number of workers depend on capacity required), you'd hang the use with some ajax checking status thing... run the job in the bg then once done throw the gate open for the use and boot them forward to the next stop or w/e... but that depends on design of user workflow and how real time you need it [22:00:26] If you don't use some sort of queue and try to run each request in real time, hundreds of requests together and you kill the servers [22:01:18] Damianz: if you have time just look at the UI mockups that I have made, you might get a good idea [22:01:49] I'll read your link when I sit down to eat - just making some routing changes at work right now [22:02:20] sure :) can you get back to me via mail ? [22:02:30] after you read it that is [22:06:13] I prefer irc tbh - more collaborate as I'm only an ass with a lot of opinions, not with all the answers.. can reply to your talkpage or email I guess if you want [22:06:38] * Damianz loves the 'I'm just the guy at the front of the room, not the guy with all the answers' line in talks at conferences... such a sucker [22:07:39] I dont mind, as per your convenience. But do get back to me after you read it cause the proposal submission deadline is May 3 [22:13:57] Damianz: ^ [22:14:06] sure [23:27:34] Change on 12mediawiki a page Wikimedia Labs/Tool Labs was modified, changed by APPER link https://www.mediawiki.org/w/index.php?diff=682969 edit summary: [+51] /* See also */