[00:18:53] RECOVERY HTTP is now: OK on deployment-test deployment-test output: HTTP OK: HTTP/1.1 200 OK - 1427 bytes in 0.105 second response time [00:44:13] * johnduhart grinds teeth [00:44:27] ugh [00:46:20] petan: Thank you for making logical and consistent database names :/ [00:55:06] http://hi.wikipedia.deployment.wmflabs.org/wiki/index.php/Main_Page [00:55:07] me [00:55:09] meh [00:55:15] we're on our way [01:05:22] it's a blank page for me [01:05:40] petan and logical don't go in the same story. [01:05:45] I know, just broken [01:06:02] we should name the databases the same as in production [01:06:10] That's what I want [01:06:29] otherwise we can't as easily use the same configs for labs and production [01:06:47] Okay so copy pasting InitialiseSettings.php via nano isn't working [01:07:25] Ryan_Lane: Ideas? [01:07:35] what's apache say? [01:07:43] the error logs, that is [01:07:48] No my session hangs when I try that [01:08:00] As in, I can't even copy paste the thing [01:08:05] o.O [01:08:10] use wget [01:08:18] Ryan_Lane: It's highlighted [01:08:27] there's a way to get the raw, right? [01:08:36] * johnduhart shurgs [01:08:47] http://noc.wikimedia.org/conf/InitialiseSettings.php.txt [01:09:01] oooh [01:09:06] there's a (raw text) link next to the highlighted link [01:09:19] * johnduhart facepalms [01:09:47] heh [01:24:46] !log deployment-prep Installed mysql-client on deployment-test [01:24:47] Logged the message, Master [01:35:36] pfffff [01:36:08] Just spent 15+ minutes on an issue caused by a comma being a period [01:37:42] :D [01:41:08] Okay that looks like a wiki, almost http://hi.wikipedia.deployment.wmflabs.org/wiki/Main_Page [01:41:24] yeah, a little wiki-like :D [01:41:38] Hmm, why doesn't it have a logo [01:42:16] oh! [01:42:24] missed the most important part of wgConf [01:42:31] extract( $globals ); [01:43:04] aw now that breaks stuff [01:45:05] what would be ideal is to make modifications to the config, that allow the realm to be set [01:45:19] so that we can then move those to production, and override settings in labs [01:45:41] ideally, we'd have a labs-specific file that we can override [01:45:42] That's what I'm doing [01:45:46] :) [01:45:53] awesome [01:46:05] InitialiseSettingsDeploy.php, which overrides stuff in InitialiseSettings.pph [01:46:12] cool [01:46:24] if we do that, we can keep the labs files in sync with production [01:46:41] by simply re-pulling the production files from noc occasionally [01:46:43] or even via cron [01:51:24] yup [01:59:23] Ryan_Lane: :D http://hi.wikipedia.deployment.wmflabs.org/wiki/%E0%A4%AE%E0%A5%81%E0%A4%96%E0%A5%8D%E0%A4%AF_%E0%A4%AA%E0%A5%83%E0%A4%B7%E0%A5%8D%E0%A4%A0 [02:15:11] 09 00:30:22 < oren> I mean can I use $wgMainCacheType = CACHE_ACCEL; with eaccelerator [02:15:16] 09 00:54:00 < Ryan_Lane> why are you using eaccelerator? < Ryan_Lane> use apc [02:15:23] 09 01:54:49 < OrenBochman> it's hard to find a built version for windows [02:15:48] OrenBochman: are you doing much work offline/mobile? i.e. why not just use labs? or the local ubuntu install you said you made? [02:16:05] OrenBochman: i know you said the internet was quite flaky in israel but it's better now in .hu? [02:16:38] I've not installed it on my local ubuntu - I've lost a couple of HD as well [02:17:08] lost as in don't know where they are? [02:17:31] no as in they don't work any longer [02:17:42] ahh [02:18:19] anyhow I need a windows MW to check porting works on windows as well [02:18:52] I've upgraded to latest XAMPP + MW from svn [02:18:56] but it is slow [02:19:14] Import works and statistics works now too [02:19:43] OrenBochman: so, how slow? can you pastebin your LocalSettings.php? [02:19:52] running memcached? [02:19:57] no [02:20:27] I've just found a apc build for win [02:21:37] ok, well other questions still stand :) (how slow is slow and pastebin LocalSettings.php) [02:22:14] I working on 3 machines so it kind of slow [02:22:41] i.e. paste don't work to well :-) [02:24:54] huh? [02:25:07] i have no idea what paste don't work so well means [02:25:32] are you familiar with pastebin? try dpaste.com [02:25:35] the localsettings is on a machine far away [02:25:40] copy your LocalSettings.php to there [02:25:51] so what? you don't have remote access to the machine? [02:26:04] I do it's real slow [02:26:25] where is that machine? [02:26:34] is your .hu internet better than .il? [02:26:34] down stairs [02:26:56] * jeremyb is confused. you have it on your local LAN and it's still slow?!!! [02:26:59] it is [02:27:16] its not on a lan [02:45:04] I don't get why you are using windows for this [02:45:15] it's going to make things about 20 billion times harder [02:45:28] it's also not anything like what we are using in production [02:45:39] agreed [02:45:52] far and away the first priority should be linux [02:45:58] yes. [02:46:01] windows parity should be a side project [02:46:05] if anything [02:46:17] if you want to ensure it works in windows, that's fine, but you should start with linux. preferably ubuntu [02:46:50] unless you simply want to work on search for mediawiki, and not necessarily for wikimedia [02:47:08] in which case go nuts [02:47:22] but we can't reasonably support you if you are using windows [02:47:25] ^^ oren [02:48:58] / Testing internally [02:48:58] include "$wmfConfigDir/secret-projects.php"; [02:48:59] :O [02:49:06] heh [02:49:38] * johnduhart wonders what's in that file [02:50:42] basically nothing [02:51:17] one thins is a password, and another is an extension being tested internally [02:51:20] *thing [02:51:38] I think whoever named that file as being "cute" [02:51:42] *was [02:52:28] heh [03:39:37] I've fixed it [03:40:43] I hope to make more progress on labs/ubuntu tommorow [03:42:28] I've written 2/3 of an important new component for search but it would need access to most (or all of the dumps). [04:02:05] http://nope.wikipedia.deployment.wmflabs.org/wiki/Main_Page [04:02:33] !log deployment-prep [04:02:33] Message missing. Nothing logged. [04:03:12] !log deployment-prep Lot of configuration done, much tuning to come. Missing.php now works http://nope.wikipedia.deployment.wmflabs.org/wiki/Main_Page [04:03:13] Logged the message, Master [04:07:34] !log deployment-prep Adding metawiki apache config to /usr/local/apache/conf/remnant.conf [04:07:35] Logged the message, Master [04:08:12] !log deployment-prep Adding remnant.conf to httpd.conf [04:08:13] Logged the message, Master [04:09:46] !log deployment-prep Created meta docroot and added favicons to meta and wp [04:09:46] johnduhart: <3 the not-found page [04:09:46] Logged the message, Master [04:09:52] Ryan_Lane: thanks :) [04:12:04] Ryan_Lane: You don't have a bigger labs logo do you? [04:12:35] umm [04:12:37] lemme see [04:13:06] nope [04:13:13] brandon would [04:13:22] I'll ask him tomorrow [04:14:28] heh. an invalid project doesn't show the page, though, just an error [04:14:38] http://nope.deployment.wmflabs.org [04:14:45] * johnduhart nods [04:18:00] !log Created metawiki http://meta.wikimedia.deployment.wmflabs.org/ [04:18:00] Created is not a valid project. [04:18:09] !log deployment-prep http://meta.wikimedia.deployment.wmflabs.org/ [04:18:10] Logged the message, Master [04:18:12] ugh [04:18:25] !log deployment-prep [04:18:25] Message missing. Nothing logged. [04:18:27] !log deployment-prep Created metawiki http://meta.wikimedia.deployment.wmflabs.org/ [04:18:28] Logged the message, Master [04:18:58] Hmm, I can just run update.php on this but something tells me that something else will blow up [04:22:42] oooh it worked [04:25:57] !log deployment-prep Created centralauth database centralauth [04:25:58] Logged the message, Master [04:28:35] !log deployment-prep Imported db schema to centralauth [04:28:36] Logged the message, Master [04:41:27] YES! [04:41:40] !log deployment-prep Centralauth is working :) [04:41:41] Logged the message, Master [04:43:09] Hmm kinda tired, I'll just go setup openstack :D [04:51:47] -labs [04:51:51] jeremyb: * [04:52:25] johnduhart: i has a script to grab all the pages titles for an arbitrary wiki (api) [04:52:49] johnduhart: petan said [[special:export]] could take an unlimited # of titles at once [04:53:43] Would be a good idea [05:12:07] !log deployment-prep [05:12:07] Message missing. Nothing logged. [05:14:43] !log deployment-prep Importing prefstats table to hiwiki [05:14:44] Logged the message, Master [05:15:07] !log deployment-prep Running update.php on hiwiki [05:15:07] Logged the message, Master [05:36:06] !log deployment-prep Recreated hwiki, had a bad JohnTest account. Central auth now works fully [05:36:07] Logged the message, Master [05:36:16] woot [05:44:17] heh, http://ganglia3.wikimedia.org/graph_all_periods.php?c=Virtualization%20cluster%20pmtpa&m=load_one&r=hour&s=by%20name&hc=4&mc=2&st=1326087834&g=network_report&z=large&c=Virtualization%20cluster%20pmtpa [05:48:04] grrr [05:48:14] kjournald [05:49:27] what did that? [05:49:37] jeremyb: I downloaded the internet [05:50:16] ahh [05:50:17] !log deployment-prep Downloaded metawiki dump ont dbdump, extracting now. poor labs. [05:50:18] Logged the message, Master [05:59:34] oops [05:59:39] ran out of disk space... [06:00:47] Ryan_Lane: You're not still around are you? [06:02:54] johnduhart: for everyone? [06:03:05] jeremyb: No just my instance [06:03:17] johnduhart: something i can do? [06:03:31] re disk space [06:04:08] Nah, you're not able to make me a new instance or allocate me a volume [06:04:20] you can't make yourself a new instance? [06:04:27] not sysadmin [06:05:18] you are correct. and hexmode is presumably asleep [06:05:32] * Damianz gets the pointy stick and passes it to jeremyb [06:05:37] petan can fix your perms i think and should be up soon? [06:05:52] i.e. it's 7:06am for him [06:07:36] johnduhart: you're totally out? can't just delete something? [06:07:56] No, I need a large amount of space for extracting a dumb [06:07:59] dump* [06:08:12] what are the commands? [06:08:17] maybe i can save you some space [06:08:25] e.g. compress a step [06:08:31] You can't [06:08:48] johnduhart@deployment-dbdump:/tmp/metawiki$ 7z x metawiki-20120103-pages-meta-history.xml.7z [06:08:57] That fills up the 10G partition [06:09:16] does the thing that eats the resulting file take xml on stdin? [06:09:34] hmmm [06:09:46] -so Write data to StdOut (eg: % echo foo | 7z a dummy -tgzip -si -so > /dev/null) [06:09:55] err [06:10:08] I'm using importDump [06:10:19] never used it... [06:10:26] does it have a --help? [06:10:53] Arguments: [06:10:53] [file]: Dump file to import [else use stdin] [06:10:57] hmmm [06:12:34] these 7zip docs are lacking [06:13:07] What's wrong with gzip? [06:15:20] johnduhart: bingo, http://sevenzip.sourceforge.jp/chm/cmdline/switches/stdout.htm [06:15:31] Damianz: it comes in 7zip [06:15:46] Still a valid question :P 7zip is horrid [06:16:47] not really that bad. just bad syntax and docs [06:17:20] Damianz: Better compression from what I see [06:18:21] questionable. [06:18:38] jeremyb: Extracting metawiki-20120103-pages-meta-history.xml-bash: xrealloc: ../bash/subst.c:4952: cannot allocate 536870912 bytes (1075728384 bytes allocated) [06:18:40] nope [06:18:56] Damianz: I really don't care [06:18:57] Damianz: really is better ratio [06:19:06] Damianz: anyway, again we don't have a choice [06:19:29] * johnduhart ponders what else he can do [06:19:31] johnduhart: where is this? [06:19:56] deployment-test i guess [06:20:17] deployment-dbdump [06:23:02] !log deployment-prep [06:23:03] Message missing. Nothing logged. [06:23:17] !log deployment-prep Created simplewiki http://simple.wikipedia.deployment.wmflabs.org/wiki/Main_Page [06:23:18] Logged the message, Master [06:31:13] !log deployment-prep Installing git on deployment-test [06:31:14] Logged the message, Master [06:34:53] johnduhart: `7z x archive.7z filename.xml -so 2>/dev/null | importdump...` ? [06:44:22] you guys have any idea how much data you're going to be using total? :) [06:44:36] hah [06:45:28] johnduhart: added you as a sysadmin [06:45:55] try not to go too crazy on space :) [06:46:01] heh [06:46:09] 1.2T 437G 650G 41% /var/lib/nova/instances [06:46:19] ^^ if that gets too high we're in trouble [06:46:25] ... [06:46:35] bah [06:46:41] net split [06:46:54] Ryan_Lane: where's the best place to measure that? and is it going to send nagios to this channel if we get close? [06:47:02] umm [06:47:06] agreed, netsplit [06:47:08] not sure if it's monitored or not [06:48:29] if i want a package from pypi that's in wheezy (testing), sid (unstable), oneiric, and precise how should i get it into lucid? [06:48:40] package it [06:48:44] as a debian package [06:48:53] if it's already packaged, backport it [06:49:08] (note this doesn't need to ever get to prod) [06:49:18] what's it for? [06:49:22] i was thinking about apt-pinning [06:49:45] you could, but it may not work [06:49:50] Ryan_Lane: deployment-web:~jeremyb/getalltitlesNS8.py [06:49:59] or just running pip [06:51:04] well, you could install it via pip in a virtualenv [06:51:24] precise will thankfully be out soon [06:51:28] i was going to put in in /usr/local [06:51:33] why? [06:51:40] does anything except your app need it? [06:51:41] well i made it for peter to use [06:51:49] it's a self contained script [06:52:03] well except it has deps. but i mean it's all one file [06:52:20] what dependency does it have that's not available in lucid? [06:52:35] I'd say either backport it, or use a virtualenv till precise comes out [06:52:39] python-requests.org [06:52:54] package is python-requests [06:54:30] * Ryan_Lane nods [07:09:02] oooh! [07:09:06] Ryan_Lane! [07:09:13] !log deployment-prep Adding wikibooks configuration [07:09:14] Logged the message, Master [07:09:16] !log deployment-prep Created simple wikibooks http://simple.wikibooks.deployment.wmflabs.org/ [07:09:17] Logged the message, Master [07:10:00] !log deployment-prep [07:10:00] Message missing. Nothing logged. [07:10:08] !log deployment-prep SiteMatrix is now working http://meta.wikimedia.deployment.wmflabs.org/wiki/Special:SiteMatrix [07:10:09] Logged the message, Master [07:15:26] !log deployment-prep Importing simplewikibooks [07:15:27] Logged the message, Master [07:18:34] god import dump is slow [07:32:26] New user [[b:simple:User:Johnduhart]] created. Block: http://simple.wikibooks.org/wiki/Special:Blockip/Johnduhart [07:32:28] what the fuck [07:33:46] New user [[b:simple:User:OHGODWHYISTHISHAPPENING]] created. Block: http://simple.wikibooks.org/wiki/Special:Blockip/OHGODWHYISTHISHAPPENING [07:33:52] hahahah oh man what is going wrong [07:36:59] !log deployment-prep WARNING: some how new users are showing up on some feed outside of labs, and was picked up on a monitoring robot. wtf. [07:36:59] Logged the message, Master [07:37:51] !log deployment-prep This only affects my new configuration though [07:37:52] Logged the message, Master [07:42:30] ah. I've seen this before [07:42:40] on prototype [07:42:40] he's alive! [07:42:48] these is some udp stuff that sends to some feed [07:42:55] it needs to be disabled [07:43:00] I have all the feeds commented out though [07:43:09] you sure? :) [07:43:15] hmmm [07:44:23] Ryan_Lane: OAI? [07:44:23] Okay, now I think I do [07:44:34] Ryan_Lane: shouldn't that be firewalled...? [07:44:58] Ryan_Lane: i can't even get ICMP to prod! [07:45:16] New user [[b:simple:User:AHHHHHHH]] created. Block: http://simple.wikibooks.org/wiki/Special:Blockip/AHHHHHHH [07:45:17] nope [07:46:12] Ryan_Lane: btw, is it possible to get more spce on deployment-dbdump [07:53:49] johnduhart: not at this time, no [07:54:09] when the gluster volume storage cluster comes in, yes [07:54:17] you can create another instance... [07:54:24] that has more space. [07:54:32] ah [08:12:36] !log deployment-prep Starting import of metawiki [08:12:37] Logged the message, Master [08:13:06] oh shit [08:13:14] I wonder how much disk space -sql has left [08:13:42] /dev/vda 9.9G 942M 8.5G 10% / [08:13:45] Interesting [08:16:17] it should be /mnt [08:16:19] johnduhart: wgRC2UDPAddress must be the culprit [08:22:04] Ryan_Lane: prod is file per table or no? [08:23:07] bye [08:27:21] no [11:27:47] petan bhere? [12:32:34] !log deployment-prep Created enwikibooks http://en.wikibooks.deployment.wmflabs.org/wiki/Main_Page [12:32:35] Logged the message, Master [12:44:02] !log deployment-prep Ran update.php on metawiki [12:44:02] Logged the message, Master [13:08:32] johnduhart: yes [13:08:45] did you read my mail? [13:09:41] hexmode: around? [13:19:17] !log deployment-prep updated svn [13:19:18] Logged the message, Master [13:19:31] what is testwiki? [13:21:00] New review: Rich Smith; "(no comment)" [operations/puppet] (test) C: 1; - https://gerrit.wikimedia.org/r/1712 [13:29:53] New patchset: Dzahn; "Adding generic check for user's last edit time + adding 2 checks for the bots-cb server along with some package requirements. The bots-cb manifest will be expanded upon once the core components are packaged up and we can properly roll/configure a cb serve" [operations/puppet] (test) - https://gerrit.wikimedia.org/r/1712 [13:33:35] New review: Dzahn; "let me rebase that for you." [operations/puppet] (test); V: 1 C: 2; - https://gerrit.wikimedia.org/r/1712 [13:34:02] !log created backup of central auth and replace the testing SUL with current data, merged with current SUL so that we can use same logins for both [13:34:02] created is not a valid project. [13:43:11] petan|work: Fail [13:43:39] !log deployment-prep created backup of central auth and replace the testing SUL with current data, merged with current SUL so that we can use same logins on all sites [13:43:40] Logged the message, Master [13:43:45] :oi [13:43:55] done [13:52:04] !log deployment-test test is done, restored test SUL to previous state [13:52:04] deployment-test is not a valid project. [13:52:17] !log deployment-prep test is done, restored test SUL to previous state [13:52:18] Logged the message, Master [13:55:45] New review: Rich Smith; "(no comment)" [operations/puppet] (test) C: 1; - https://gerrit.wikimedia.org/r/1712 [13:56:05] New review: Mark Bergsma; "Please fix the indentation and tabs/spaces issues in these files..." [operations/puppet] (test) - https://gerrit.wikimedia.org/r/1656 [14:09:45] !log deployment-prep created backup of broken db of meta and replaced it with auth db [14:09:46] Logged the message, Master [14:20:50] New review: Mark Bergsma; "Why are you following some style guide that we haven't instated? :) These things seem rather arbitra..." [operations/puppet] (test) - https://gerrit.wikimedia.org/r/1709 [14:26:38] New patchset: Dzahn; "Adding generic check for user's last edit time + adding 2 checks for the bots-cb server along with some package requirements." [operations/puppet] (test) - https://gerrit.wikimedia.org/r/1712 [14:29:48] New review: Dzahn; "oh my.. this was/is a tricky one to rebase..?!" [operations/puppet] (test); V: 1 C: 2; - https://gerrit.wikimedia.org/r/1712 [14:30:19] New review: Mark Bergsma; "If this is explicitly for labs only, can you add an IF check on $realm (should be 'labs'), so it act..." [operations/puppet] (test) - https://gerrit.wikimedia.org/r/1711 [14:31:34] New review: Dzahn; "try rebasing this and see..hrmm.." [operations/puppet] (test); V: 1 C: 1; - https://gerrit.wikimedia.org/r/1712 [14:32:09] petan|work: ... [14:32:15] why did you touch centralauth [14:32:22] We're not ready to switch [14:33:13] PROBLEM Disk Space is now: CRITICAL on puppet-lucid puppet-lucid output: DISK CRITICAL - free space: / 33 MB (2% inode=35%): [14:33:35] johnduhart: I am just testing somewhing, I will revert it in 2 mins [14:33:36] where did metawiki just go [14:33:39] okay [14:33:43] I am restoring your version [14:33:45] * johnduhart waits paientely [14:36:08] ok I am loading meta now [14:36:14] New review: Rich Smith; "(no comment)" [operations/puppet] (test) C: 1; - https://gerrit.wikimedia.org/r/1712 [14:36:19] meanwhile, did you know that meta db was broken? [14:36:26] No? [14:36:32] New review: Dzahn; "the style guide is from puppetlabs (http://docs.puppetlabs.com/guides/style_guide.html) but of cours..." [operations/puppet] (test) - https://gerrit.wikimedia.org/r/1709 [14:36:38] yes it was, when I clicked show random page it thrown error [14:36:51] you imported page info but no data [14:37:06] it tried to open page but it didn't have content in db [14:37:16] db will be back in a minute so I will show you [14:37:23] I created full backup so it will be same as it was [14:37:33] Well the import is (was) still in progress so [14:37:42] regarding SUL, it's possible to convert current one there [14:37:43] Though since you dropped the db that's probably broken [14:37:49] ok do we need to have full meta clone? what for [14:37:59] where is dump running? [14:38:10] I didn't notice in log that you started dump [14:38:13] PROBLEM Disk Space is now: WARNING on puppet-lucid puppet-lucid output: DISK WARNING - free space: / 50 MB (3% inode=35%): [14:38:20] petan|work: Can you allow me access to approve stuff on gerrit? [14:38:20] No forget it, we don't need it [14:38:31] methecooldude: I can't... :o [14:38:39] petan|work, johnduhart: morning! [14:38:43] petan|work: Ryan can? [14:38:44] !log deployment-prep Forget the metawiki dump [14:38:45] Logged the message, Master [14:38:56] johnduhart: I think we should create meta wiki but as entry wiki [14:39:01] something like auth is now [14:39:08] johnduhart: http://ar.wikipedia.deployment.wmflabs.org/wiki/Main_Page create it please? [14:39:10] so that you will see info about test cluster there etc. [14:39:28] Why can't we just make a meta like in production? [14:39:30] hexmode: One sec [14:39:35] oh yes we can [14:39:46] but I don't think we need real content there, apart of MW space [14:40:00] because if it was main wiki, when someone open the website they get confused [14:40:09] because they would see clone of meta with no explanation [14:40:18] Well instead of having this whacky auth wiki and entry wiki just make it meta [14:40:19] I think we should use meta config as in production, MW space of meta [14:40:20] More logical [14:40:23] but no content pages of meta [14:40:26] Sure [14:40:34] I won't import meta content [14:40:36] yes [14:40:37] I agree [14:40:40] Oh [14:40:40] That's a good point though [14:40:43] Okay [14:40:55] So I'll make a landing page for the labs [14:41:15] I tried to convert auth to metawiki but it failed, because of 2 things [14:41:35] Lets open an etherpad so we can organize this... [14:41:48] I think best would be to drop current meta db and create new, then I will import pages from auth there ok? [14:41:51] ok [14:41:53] http://etherpad.wikimedia.org/DeploymentPrep [14:41:55] link me :) [14:42:27] hexmode: could you join us? I think we should discuss what we want and then start working on that together [14:42:34] but we have to know what we want to do :D [14:42:55] first question how should entry wiki look like? [14:43:04] my idea is to use meta config but no content pages [14:43:10] import pages from auth instead [14:43:24] what do you think? [14:43:27] petan|work: See etherpad [14:43:50] New review: Mark Bergsma; "This probably doesn't work. It's refreshonly, but is not notified by anything (afaics). Why not use ..." [operations/puppet] (test) - https://gerrit.wikimedia.org/r/1760 [14:44:26] * johnduhart waves to RoanKattouw [14:44:42] Morning [14:45:59] * johnduhart is in math class [14:46:01] heh [14:46:55] petan|work: I vote 3 [14:47:06] But we'll keep the simplewiki data [14:47:12] pagedata, that is [14:47:13] I like that idea too, 3 or 4 [14:47:17] and empty the users table [14:47:27] hm... hexmode what do you think? [14:47:38] hexmode: Can you get in that etherpad? [14:47:43] I don't like idea that people who registered will need to do it again [14:47:54] I don't know how hard it is to import users there [14:48:04] only thing which complicate it is Hash [14:48:07] for password [14:48:08] Ooooh they can handle 5 seconds of registering [14:48:12] :P [14:48:17] hm, probably [14:48:45] petan|work: What's simple_data? [14:48:49] ok so let's start from scratch but do it asap, so no waiting for next days and let's switch current deployment to new one today [14:48:57] so that new users get registered properly [14:49:04] Okay [14:49:19] simple_data was first database, it's full db clone of simple wikipedia [14:49:28] we can use everything excepting user table [14:49:46] but pages etc are correct it contains sha1 and all we need for .19 [14:49:51] full history [14:50:03] just populate script was running 10 hours [14:50:08] ah [14:50:19] it's possible to rename it [14:50:22] to simplewiki [14:50:42] ok I will disable current deployment and put a site notice there [14:50:45] that we do maintenance [14:50:53] Sure [14:50:56] and we can start moving wikis to new one [14:51:08] I'm going to nuke current wikis that are in the new system, okay? [14:51:11] I think we should start with meta and labs [14:51:14] ok [14:51:26] create a new sul, meta and labs [14:51:27] petan|work: Communicate before making changes, alright :) [14:51:32] sure [14:51:39] I didn't actually change anything [14:51:43] I made backup of everything [14:51:52] was just testing if it works or not [14:52:10] !log deployment-prep DROPing new configuration tables, will recreate [14:52:11] Logged the message, Master [14:54:36] Okay tables dropped. [14:54:39] RoanKattouw: wanna try and rebase 1712 ?;P i failed so far [14:54:59] Going to create the centralauth database now [14:55:08] !log deployment-prep Creating centralauth db [14:55:09] Logged the message, Master [14:55:21] !g 1712 [14:55:21] https://gerrit.wikimedia.org/r/1712 [14:55:43] RoanKattouw: it's a tricky one, with conflicts "modify/delete" and stuff, and i went all the way through it manually, appeared fine,, but still not yet..arg [14:55:48] !log deployment-prep disabled current site [14:55:49] Logged the message, Master [14:56:07] Let's see [14:56:24] Wait a damn minute [14:56:32] Centralauth tables created [14:56:40] mutante: It's based on production, but submitted to test [14:57:32] Stashed the CentralNotice settings, will get back to that later [14:57:48] ok [14:58:14] is it possible to simple deploy extension to certain wiki or only at global level? [14:58:15] petan|work: johnduhart: just got back from dropping something off at the neighbor's .. on to the etherpad! [14:58:17] simply [14:58:42] petan|work: It's just like on production [14:58:51] In fact, we take configuration directly form production [14:58:56] And then we override it [14:59:04] I don't know how it works on prod [14:59:18] but I know my old config allowed me to change variable to true and extension was deployed :D [14:59:30] petan|work: I'll explain more when we get closer [14:59:37] Let's just focus on getting this rolling [14:59:57] !log deployment-prep Creating metawiki [14:59:58] Logged the message, Master [15:02:17] !log deployment-prep Ran update.php on metawiki [15:02:18] Logged the message, Master [15:02:21] New review: Catrope; "This revision is based off production, but was submitted to test. I've resubmitted it to production ..." [operations/puppet] (test); V: 0 C: -2; - https://gerrit.wikimedia.org/r/1712 [15:02:30] petan|work: Okay: http://meta.wikimedia.deployment.wmflabs.org/wiki/Main_Page [15:03:19] Cannot create account: the requested username is already taken in the unified login system [15:03:23] how is that possible? [15:03:24] huh [15:03:29] didn't you purged SUL [15:03:33] yeah I did [15:03:35] hold on [15:03:38] heh [15:04:09] maybe we should restart memcached [15:04:19] that's holding session data [15:04:31] good point [15:04:48] !log deployment-prep restarted memcached [15:04:49] Logged the message, Master [15:05:23] Hi, can I have administrative rights for the commons-clone? [15:05:38] rillke: hi, sure you can, but please wait a moment [15:05:45] rillke: We're in the middle of reworking the whole system :x [15:05:49] rillke: we are now moving all stuff a bit :) [15:05:56] it's in site notice I think [15:06:28] yes it is. [15:06:28] rillke: actually I can enable site and give you all you want until we move it, but you will have to create account again then, is it ok? [15:06:43] because current SUL will be droped [15:06:58] rillke: I guess it tak whole day to move all [15:07:05] I'm switching classes, will be back in a moment [15:07:07] so if you wanted to start testing right now... [15:07:13] ok [15:07:18] New patchset: Catrope; "Adding generic check for user's last edit time + adding 2 checks for the bots-cb server along with some package requirements." [operations/puppet] (test) - https://gerrit.wikimedia.org/r/1712 [15:07:29] So see you tomorrow? [15:07:51] rillke: wait [15:08:09] if you need to test something, I can enable old site but keep in mind we are going to drop it... [15:08:38] rillke: done [15:09:15] http://deployment.wmflabs.org/commons_wiki/wiki/Main_Page [15:09:18] rillke: ^ [15:09:24] New review: Catrope; "Daniel tells me this shouldn't go into production after all, so I've rebased it onto test:" [operations/puppet] (test); V: 0 C: 0; - https://gerrit.wikimedia.org/r/1712 [15:09:29] * rillke is loading [15:09:40] why commons_wiki? [15:09:53] and not commons.deployment.wmflabs.org/wiki? [15:09:53] Ryan_Lane: it's temporary [15:09:57] ah. ok [15:10:02] that's the old site [15:10:05] we are moving it now [15:10:24] btw hi Ryan [15:10:33] Ryan_Lane: http://etherpad.wikimedia.org/DeploymentPrep [15:10:43] :o [15:10:47] New review: Dzahn; "thanks Roan, for fixing the path conflict" [operations/puppet] (test); V: 1 C: 2; - https://gerrit.wikimedia.org/r/1712 [15:10:47] Change merged: Dzahn; [operations/puppet] (test) - https://gerrit.wikimedia.org/r/1712 [15:12:35] Okay I'm back [15:12:38] the func continues [15:12:39] fun* [15:12:42] Uh [15:12:51] So for some reason centrauth has my username in it [15:12:56] so I'm going to drop and reimport [15:13:20] !change 1712 | Damianz [15:13:20] Damianz: https://gerrit.wikimedia.org/r/1712 [15:13:27] Damianz: merged now:) [15:13:35] rillke: you got it [15:13:57] rillke: let me know after we move it, you will have to create account again so I will set it back to you [15:14:32] johnduhart: let me know when it's ready to register heh I am going to move simple db [15:14:34] mutante: Handy alias for !change : !g (for Gerrit) [15:14:42] !g [15:14:42] https://gerrit.wikimedia.org/r/$1 [15:14:45] :o [15:14:50] Ah, thanks. [15:14:58] petan|work: You're moving simpledb? [15:15:03] I want to [15:15:05] to simplewiki [15:15:13] Okay, sure! [15:15:14] it's going to take at least 10 min [15:16:04] actually maybe it would be better if we create simple again and I only move the page data tables [15:16:07] johnduhart: ^ [15:16:10] rebuildall fix the rest [15:16:11] Sure [15:16:15] let me do that [15:17:22] !log deployment-prep Created simplewiki [15:17:23] Logged the message, Master [15:18:01] petan|work: Go to town [15:18:09] New patchset: Dzahn; "mariadb - add a check if realm is labs, dont setup repo otherwise" [operations/puppet] (test) - https://gerrit.wikimedia.org/r/1812 [15:19:12] New patchset: Dzahn; "mariadb - add a check if realm is labs, dont setup repo otherwise" [operations/puppet] (test) - https://gerrit.wikimedia.org/r/1812 [15:19:29] ah, is SUL working? [15:19:35] johnduhart? [15:19:36] Nope, still playing with it [15:19:41] hm... [15:20:08] !log deployment-prep Restarted memcached [15:20:09] Logged the message, Master [15:20:32] New review: Dzahn; "(no comment)" [operations/puppet] (test); V: 1 C: 2; - https://gerrit.wikimedia.org/r/1812 [15:20:32] Change merged: Dzahn; [operations/puppet] (test) - https://gerrit.wikimedia.org/r/1812 [15:21:13] New review: Dzahn; "fixed.(1812)" [operations/puppet] (test) - https://gerrit.wikimedia.org/r/1711 [15:23:20] petan|work: Going to create blank enwiki and enwikibooks to test SUL [15:24:41] !log deployment-prep Created enwiki and enwikibooks [15:24:41] Logged the message, Master [15:24:45] !nova-resource is https://labsconsole.wikimedia.org/wiki/Nova_Resource:$1 [15:24:45] Key was added! [15:24:47] johnduhart: ok [15:24:53] johnduhart: can I register now? :P [15:24:58] !project alias nova-resource [15:24:58] Successfully created [15:25:41] petan|work: Yes! SUL works :D [15:26:23] still can't use my name [15:26:36] Ryan_Lane: Can you get me a copy of the images in in /usr/local/apache/common/images/sul/* [15:26:47] petan|work: I had that issue too :/ [15:26:53] JohnTest worked. hm [15:27:25] I'm in a junos course today [15:27:33] Ah [15:27:48] johnduhart: nevermind I will fix it [15:27:53] RoanKattouw: Got a minute? [15:28:00] we should change the "simple english" word in the logo to be the comic sans font [15:28:06] Ryan_Lane: hehehe [15:28:09] Sure [15:28:36] hahaha, yeah comic sans is a great idea [15:29:22] RoanKattouw: Got a minute to grab those files off of an apache? [15:29:43] johnduhart: i got the files, but where do you want me to put them? [15:30:09] should they be in git? [15:30:21] mutante: Meh, not in git [15:30:43] mutante: If you could zip them up and put them somewhere that I can wget I'd appreicate it [15:32:03] johnduhart: can you list all wikis you set up, so I can drop all databases we don't use? [15:32:19] I believe my username is on some local wiki which is in SUL [15:32:45] petan|work: /usr/local/apache/common/all.dblist [15:32:52] + centralauth [15:32:58] these are all working wiki's we are using now? [15:33:01] Yes [15:33:04] ok [15:36:53] johnduhart: wget http://stats.wikimedia.org/sul_images.tar.gz [15:37:09] mutante: Thanks, really appreicate it [15:37:36] yw [15:40:11] petan|work: I'm going to enable some debug output so we can pinpoint the problem [15:41:40] johnduhart, what's the problem? [15:42:00] Platonides: SUL is claiming to have johnduhart and petan in SUL [15:42:29] and? [15:42:54] It doesn't (shouldn't) [15:43:03] So we can't create petan or johnduhart accounts [15:43:34] I create another name :D [15:43:49] but I am afraid all people who already registered will have same issue [15:44:09] did you install centralauth before of after creating the account ? [15:44:22] before [15:44:42] you could have created your sul account when you created the normal account [15:45:06] There is no global account for "Petan" [15:45:35] johnduhart registered 10 minutes ago [15:45:42] Where is that? [15:45:50] http://deployment.wmflabs.org/auth/w/index.php?title=Special%3ACentralAuth&target=johnduhart [15:45:56] No [15:46:00] That's the wrong wiki [15:46:14] wait [15:46:18] what [15:46:42] you expected centralauth to be less central? [15:46:44] petan|work: Uh? ^ [15:46:52] Platonides: No, that is an old system [15:46:58] johnduhart: I enabled it for that guy who wanted commons [15:47:12] so which one is the modern one? [15:47:16] petan|work: Can you turn it off quickly? [15:47:23] Platonides: http://meta.wikimedia.deployment.wmflabs.org/wiki/Special:RecentChanges [15:47:34] johnduhart: yes I can turn it off but he is using it now? [15:47:43] rillke: You using commonswiki? [15:47:48] I am ready, thanks [15:47:56] :o [15:48:00] what does it mean? [15:48:12] rillke: can we turn it off? [15:48:17] johnduhart, there it's the same registration time [15:48:17] Yes. [15:48:25] http://en.wikipedia.deployment.wmflabs.org/w/index.php?title=Special%3ACentralAuth&target=Johnduhart [15:48:39] done [15:48:55] are you sharing memcahe between old and new? [15:49:20] Platonides: yes [15:49:32] there's probably something shared there [15:49:36] probably [15:49:44] ughh [15:50:18] petan|work: Reboot memcached please? [15:50:54] * johnduhart wonders if he should just drop everything and redo it [15:52:10] Looks like it [15:52:25] ok [15:53:34] !log deployment-prep restarted memcached [15:53:34] Logged the message, Master [15:53:52] petan|work: Can I drop the users table on simplewiki for right now while you import? [15:54:16] truncate not drop [15:54:23] I don't want to import user table [15:54:23] ok [15:54:25] suer [15:54:26] sure [15:54:29] because it wouldn't match key [15:55:04] truncated [15:55:47] !log deployment-prep [15:55:47] Logged the message, Master [15:55:55] !log deployment-prep Dropped all wikis except simplewiki [15:55:56] Logged the message, Master [15:56:10] how'd it log a message without the message? [15:56:13] that's a bug :D [15:56:34] did you take down the whole server? [15:56:42] johnduhart: did you drop SUL? [15:56:44] Platonides: Yes, redoing everything [15:56:46] Yeah [15:56:56] ah [15:56:58] that's why [15:56:59] lol [15:57:00] :D [15:57:02] nvm [15:57:13] !log deployment-prep Imported centralauth [15:57:14] Logged the message, Master [15:57:42] ok I will try to register [15:58:02] Table 'metawiki.revtag' doesn't exist [15:58:06] maintenance/update.php ? [15:58:15] Platonides: Yeah yeah [15:58:21] yay [15:58:23] works [15:58:34] !log deployment-prep Recreated metawiki enwiki enwikibooks [15:58:35] Logged the message, Master [15:58:55] New review: Dzahn; "notify => Service["apache2"], and "service { apache2" should be included from generic::webserver:php..." [operations/puppet] (test) - https://gerrit.wikimedia.org/r/1760 [15:59:00] !log deployment-prep Ran update on metawiki [15:59:01] Logged the message, Master [15:59:35] Yup, seems to be working [15:59:39] I'm not sure the alt text of the sul icons is right [16:00:39] petan: had you cleared the SAL for deployment-prep the other day? [16:00:39] Platonides: No that should be right [16:02:11] hmm. I think there's a bug in OSM that is blanking the SALs [16:02:15] that sucks [16:02:16] howdy ryan! [16:02:23] diederik: hi. I'm in a class [16:02:42] * Andre_Engels waves. [16:02:48] ryan: ok, when would you have time? [16:03:12] New patchset: Dzahn; "fix tabs / spaces in wikistats template" [operations/puppet] (test) - https://gerrit.wikimedia.org/r/1813 [16:03:26] New patchset: Dzahn; "wikistats - remove unneeded exec and fix some tabs" [operations/puppet] (test) - https://gerrit.wikimedia.org/r/1814 [16:03:41] diederik: wednesday, or when I get a long enough break [16:04:18] ryan: okay, ttyl! [16:04:27] New review: Dzahn; "(no comment)" [operations/puppet] (test); V: 1 C: 2; - https://gerrit.wikimedia.org/r/1813 [16:04:28] Change merged: Dzahn; [operations/puppet] (test) - https://gerrit.wikimedia.org/r/1813 [16:05:14] New review: Dzahn; "(no comment)" [operations/puppet] (test); V: 1 C: 2; - https://gerrit.wikimedia.org/r/1814 [16:05:15] Change merged: Dzahn; [operations/puppet] (test) - https://gerrit.wikimedia.org/r/1814 [16:05:46] New review: Dzahn; "removed (1814)" [operations/puppet] (test) - https://gerrit.wikimedia.org/r/1760 [16:06:50] petan|work: How do you change global rights? [16:07:19] petan|work: Also that's causing a shitton of errors, can you wait a second while I fix that [16:07:48] oh [16:07:50] really? [16:07:55] which errors... [16:08:02] I am trying to do it in a proper way :o [16:08:32] petan|work: I'm getting a load of errors in error.log [16:08:33] one sec [16:10:00] ah [16:10:04] that shouldn't happen [16:10:06] where is the log [16:10:22] /var/log/apache2/error.log [16:11:17] also johnduhart I am think of remounting /usr/apache [16:11:26] there is a 20 gb unused vd [16:11:40] previously mounted at /mnt [16:12:04] but I don't really care unless you need more space [16:12:10] Not at this time [16:13:14] sure [16:14:23] johnduhart: that notice you got in log is a bug of central notice [16:14:30] *central auth [16:14:34] yup [16:14:38] just committed a fix [16:14:41] ok [16:14:52] !log deployment-prep [16:14:53] is there update script? [16:14:53] Message missing. Nothing logged. [16:14:58] :o [16:15:07] meh [16:15:14] !log deployment-prep svn up /usr/local/apache/common/live [16:15:15] Logged the message, Master [16:15:22] ;) [16:15:32] extensions are where> [16:15:38] btw how this update all db's? [16:16:42] I guess there is no script to update dbs [16:16:46] should I make one [16:17:07] petan|work: Extensions are in common/live/extensions [16:17:15] And yes a script to update all dbs would be nice [16:17:16] I see [16:17:22] petan|work: to update a db: [16:17:47] for enwiki [16:17:47] php live/maintenance/update.php enwiki --quick [16:17:57] So get the db names from all.ablist in common [16:19:39] ./usr/local/apache/common/maintenance [16:19:41] :P [16:19:42] done [16:23:30] johnduhart: how do you create new wiki [16:23:40] also how does mw recognize which db to use [16:23:44] from path? [16:23:48] From the URL [16:23:52] ah [16:23:55] is it safe? [16:24:03] Uh, yes? [16:24:06] Why wouldn't it be? [16:24:20] I don't know... maybe someone could create exploitable url [16:24:26] It also relies on docroot [16:24:30] ok [16:24:40] petan|work: So, what wiki sould you like to create [16:24:50] So I can walk you though thisd [16:24:51] I don't know just wondering how to do that [16:24:58] ok, let's say en_wikinews [16:25:05] enwikinews* [16:25:07] ;) [16:25:08] yep [16:25:44] I need to create a folder? [16:25:46] hm [16:25:53] First of all wikinews doesn't have a docroot or an apache config, you'd have to pull the config from production, tweak it, and create a docroot with a favicon and a symlink for w [16:26:03] You'd also have to add it to the CentralAuth config [16:26:06] I see that it doesn't have a docroot :) [16:26:17] where is central auth config [16:26:33] Then you create the wiki with bin/addWiki.php en wikinews enwikinews [16:26:38] petan|work: In CommonSettings.php [16:26:45] ah, ok [16:27:12] there is wikinews in common [16:27:28] btw we have to create a script so that people can see config [16:27:37] ok let's create labs wiki now [16:27:46] it's important I want to redirect fp [16:28:01] petan|work: Gotta add a docroot for that [16:28:05] ok [16:28:47] petan|work: Also,important, you need to run addWiki as root since it writes to some caches in /tmp [16:29:14] I will fix permissions working on that right now [16:29:25] keep in mind we move it to nfs [16:29:35] so that all maintenance scripts will run on dump instance [16:29:42] I don't want to run maint script on web server [16:30:04] ok [16:30:04] also once we get a squid there we will need memory for other stuff [16:30:32] I can remount /usr/local/apache to nfs [16:30:41] and move current infrastructure [16:30:51] then I could move the ip to -web [16:30:55] sure. [16:31:15] ok so let's create labs wiki now and after that I will configure nfs [16:31:57] petan|work: So tell me what you're going to do to create the labs wiki [16:32:09] I thought you make it :D [16:32:15] right, I would create doc root [16:32:16] labs [16:32:22] then symlink to live [16:32:26] w -> live [16:32:34] then reconfigured httpd.conf [16:32:36] reloaded apache [16:32:46] updated that parser for url [16:32:49] created db [16:32:51] installed mw [16:32:53] :o [16:33:10] easy :D [16:33:48] Sure, let's see you do it :) [16:33:56] dude I am in work [16:33:59] oh [16:34:03] but right [16:34:05] I will try to :D [16:34:16] it's gonna be a bit slow [16:34:31] it's not hard for me to enter command to move infrastructure to nfs and let it run [16:34:44] but making a lot of commands is a bit complicated right now :D [16:36:34] petan|work: In that case I can do it if you want [16:37:16] I am changing apache now [16:37:31] Sure [16:37:38] petan|work: What filer are you editing [16:37:59] "/usr/local/apache/conf/remnant.conf [16:38:04] good :D [16:40:12] !log deployment-prep reconfigured apache on test [16:40:13] Logged the message, Master [16:41:29] yay [16:41:33] it doesn't work [16:41:39] oksy [16:41:44] what did you do? [16:43:13] check it [16:43:31] hold on [16:44:42] petan|work: WhatURL are you trying to use? [16:45:13] http://labs.wikimedia.deployment.wmflabs.org/ [16:45:21] Seems to sort of work [16:46:07] petan|work: What were you expecting? [16:47:08] it offers me a file to download [16:47:25] huh [16:47:33] works for me [16:47:46] http://lolo.wikipedia.deployment.wmflabs.org/ [16:47:56] Doies that do the same thing? [16:50:21] hexmode: http://labs.wikimedia.deployment.wmflabs.org/ does that work? [16:51:07] johnduhart: doesn't exist ... is that what you want? [16:51:16] Yes [16:51:16] Yes [16:51:25] petan|work says he gets a download file prompt [16:51:33] in firefox I see a page [16:51:39] in ie it offers a file to download [16:51:44] fuck ie [16:51:52] hrm... Lemme check IE [16:51:55] heh, we should support all browsers [16:52:02] * hexmode toddles off to find IE [16:52:03] heh [16:52:30] petan|work: Try now? [16:53:12] ie? [16:53:29] works [16:53:35] ok now we need to update parser heh [16:53:35] ie8 WFM [16:54:38] Well hold on [16:55:34] petan|work: You shouldn't need to touch the sitedetection code [16:55:42] hm, right [16:55:45] so how I install mw [16:56:05] so run the addWiki script, that'll create the db and import stuff you you [16:56:25] labswiki? [16:56:26] db [16:56:32] ah ok [16:56:46] what parameters I use [16:57:18] en wikimedia labswiki [16:57:23] That should do it [16:57:23] where is script [16:57:33] in bin [16:57:39] I don't see it [16:57:42] ./bin [16:57:46] or ./usr/bin [16:57:54] /usr/local/apache/common/bin [16:59:14] ok done [16:59:17] what now? [16:59:32] one sec [16:59:56] petan|work: well done http://labs.wikipedia.deployment.wmflabs.org/wiki/Main_Page [17:00:13] ok, let me check it [17:00:25] wait [17:00:56] Okay we need to fix the URLs [17:01:03] can;t login [17:01:06] heh [17:01:18] btw how do I configure extensions [17:01:48] petan|work: When fixing stuff that's wrong in InitialiseSettings you need to do it InitialiseSettingsDeploy [17:02:13] petan|work: Configure extensions how? [17:02:21] for a single wiki [17:02:22] !gi [17:02:24] !git [17:02:24] for more information about git on labs see https://labsconsole.wikimedia.org/wiki/Git [17:02:36] let's say wiki labs should have extension xx [17:02:40] but others not [17:03:00] I think it would be cool if each site could load also certain local file [17:03:20] huge switch in Common settings doesn't sound well [17:03:31] That's not how it works [17:03:45] ok so is it possible to install one extensions to one wiki [17:03:54] Yes [17:03:58] how? [17:04:20] hold on [17:04:59] petan|work: You need to add it near the bottom CommonSettings.php, wrapped in an if ( $wmgUseMyExtension ) [17:05:23] yes I know that, but that sort of suck :D [17:05:26] Then in InitialiseSettingsDeploy add an entry for wmgUseMyExtension, with default => 'false' and labswiki => true [17:05:27] but ok... [17:05:33] if it's used in prod... IDC [17:06:09] petan|work: Having a file for each and every wiki is better? [17:06:27] if it insert only one line with true or false, then probably yes [17:06:40] * contain [17:07:27] So when we get to 30 or 80 wikis in this system, you're willing to maintain 80 files when you need to add or disable an extension in all of them? [17:07:40] like the previous config had an array where was specified which extensions are enabled or not and local.php could override it [17:07:59] there was a central extensions file with config related to each extension [17:08:16] no, you don't need to maintain anything [17:08:21] by defaul the file is empty [17:08:28] it overrides the config only [17:08:39] local.php overrides global config [17:08:55] so if in global is Extension['blah'] = false; local could have true; [17:09:43] You also can't copy the InitialiseSettings.php over from production, which is the point of this setup [17:09:53] johnduhart: petan|work: what are the plans for search? [17:09:58] But anyway [17:10:03] hexmode: hm? [17:10:16] hm... good question, I think we could replicate production search if we had small db [17:10:28] daemon would run on separate instance [17:10:58] johnduhart: yes I know but it would be cool if had config where both is possible [17:11:02] your config is better [17:11:12] but having even that would be cool [17:11:30] petan|work: sure... I was just looking at http://bugzilla.wikimedia.org/30323 and wanted to see if they could test it on our test deployment [17:12:04] I mean the LocalSettings.php could contain a line like if file exist blah include local/$db.php [17:12:16] after it include Global [17:12:24] so that local could override it if it existed [17:13:38] I don't know how to do that in php [17:13:43] but I can find that [17:14:27] Why don't you guys just get InitialiseSettings & CommonSettings to work on the labs wikis? [17:14:33] RoanKattouw: I did [17:14:40] we have it [17:14:42] I like it [17:14:51] So why are you trying to redesign the "which extensions are enabled on which wikis" thing? [17:14:52] I was just think of tweaking the code on background [17:14:56] I have no idea [17:15:02] petan|work: johnduhart: is there an instance that someone could use to set up search? [17:15:15] RoanKattouw: because the code in prod is somehow complicated, but I don't really care [17:15:28] hexmode: Oren already did it [17:15:33] hexmode: project search [17:15:38] ah [17:15:38] hexmode: I have no idea about search [17:16:02] petan|work: is it hooked up to deployment? [17:16:09] no [17:16:18] but we can set it up [17:16:27] anyway I need to go now [17:16:31] brb in 1 hour [17:16:36] petan|work: wait 1s [17:16:40] ok [17:16:47] when did you last see oren [17:16:49] ? [17:16:54] I'll finish setting up labswiki then [17:16:55] OrenBochman: around? [17:17:20] johnduhart: ok, let me know how did you configure it, note it somewher [17:17:30] wmf-config/InitialiseSettingsDeploy.php [17:17:35] if I can talk to him, we're fine. tyvm petan|work. see you in 1hr [17:17:37] ah ok [17:17:44] bb [17:17:45] brb [17:22:14] Class switch, won't be back for some time [17:22:25] email me if you need help [18:08:31] hey [18:08:33] back [18:18:27] !log deployment-prep moving configuration of apache to web [18:18:28] Logged the message, Master [18:20:34] johnduhart|poof: don't change anything now, ok? [18:20:38] on fs [18:43:42] johnduhart|poof: around? [18:47:22] !log moved all stuff -web reconfiguring IP [18:47:22] moved is not a valid project. [18:47:29] !log deployment-prep moved all stuff -web reconfiguring IP [18:47:30] Logged the message, Master [18:50:12] !log deployment-prep turned off -test definitely and reconfiguring ip [18:50:13] Logged the message, Master [18:51:49] Ryan_Lane: what is reasociate and disasociate? [18:52:10] !address [18:52:14] !addresses [18:52:23] @search address [18:52:23] No results found! :| [18:52:30] @search nova [18:52:30] No results found! :| [18:52:30] it attaches a floating IP to an instance [18:52:42] ok I need to move floating ip from one instance [18:52:44] to another [18:52:54] @search ht [18:52:54] Results (found 45): puppet, instance, morebots, git, nagios, bot, labs-home-wm, labs-nagios-wm, labs-morebots, gerrit-wm, wiki, labs, extension, wm-bot, projects, putty, gerrit, change, wikitech, revision, monitor, alert, unicorn, bz, os-change, instancelist, instance-json, amend, queue, socks-proxy, sal, info, security, access, keys, bug, blueprint-dns, bots, rt, pxe, group, pathconflict, terminology, etherpad, nova-resource, [18:52:57] disassociate it [18:52:59] ok [18:53:02] then associate it to another [18:53:10] don't use reassociate, I think it's broken [18:53:20] !log deployment-prep disasociated 208.80.153.219 [18:53:21] Logged the message, Master [18:54:07] is it possible to asociate deployment.wmflabs and *.deployment.wmflabs both to one ip? [18:54:09] Ryan_Lane: ^ [18:54:19] because not it's separate [18:54:29] yes [18:54:32] how [18:54:35] delete the hostname from one, and add it to the other [18:54:40] ok [18:54:50] you can't delete * entries [18:54:52] it's broken :( [18:54:53] PROBLEM HTTP is now: CRITICAL on deployment-test deployment-test output: Connection refused [18:54:53] heh [18:56:36] Ryan_Lane: you can remove ip .215 [18:56:41] ok [18:57:30] !log deployment prep configured ip back to -web and removed temporary ip [18:57:31] deployment is not a valid project. [18:57:36] !log deployment-prep configured ip back to -web and removed temporary ip [18:57:37] Logged the message, Master [19:00:30] Ryan_Lane: I can't connect to deployment.wmflabs.org [19:00:33] is it dns cache? [19:00:48] hmm [19:00:50] lemme see [19:00:59] other works [19:01:12] likely dns cache [19:01:13] only deployment doesn't [19:01:14] ok [19:01:15] gimme a sec [19:01:16] I will wait [19:01:49] hexmode: around? [19:01:57] yep [19:01:59] ??? [19:02:03] can you create an account :D [19:02:05] on new SUL [19:02:09] I hope it's final one [19:02:26] I am now going to import back data from wikis [19:02:29] http://deployment.wmflabs.org/ -- "Can't determine language" [19:02:33] which url? [19:02:38] http://meta.wikimedia.deployment.wmflabs.org/wiki/ [19:02:44] for instance [19:02:56] oh [19:02:58] I see it too now [19:03:04] Invalid host name (meta.wikimedia.deployment.wmflabs.org), can't determine language. [19:03:06] heh [19:03:11] heh [19:03:19] oh. I didn't even need to clear the cache, then :) [19:03:26] http://en.wikipedia.deployment.wmflabs.org/wiki/Main_Page [19:03:28] this works [19:03:35] XD [19:04:02] still waiting.... [19:04:11] there it is... [19:04:30] petan: can we redir to meta ... when meta is working, of course [19:04:39] I want to redir to labs [19:04:46] labs.wikimedia.dep... [19:04:52] meta is also for testing [19:04:57] labs is stable [19:05:15] k [19:05:32] still no icons after logging in [19:06:02] http://labs.wikimedia.deployment.wmflabs.org/ -- "Invalid host name (labs.wikimedia.deployment.wmflabs.org), can't determine language. " [19:06:06] not too stable [19:06:37] I will fix it [19:06:40] I just moved instance [19:12:45] bah... no idea what's wrong [19:12:54] I just moved all files as they were [19:13:30] johnduhart-phone: around? [19:13:37] I just moved the instance to -web [19:13:43] but for some reason only wikipedia domain works [19:13:48] Yes [19:13:50] Ugh [19:13:59] I moved everything excepting icons [19:14:06] I don't know where they are [19:14:36] What do you mean yo dont know where they are? [19:14:41] SUL [19:14:42] icons [19:14:45] where are they stored [19:14:47] on fs [19:14:55] it's somewhere in confs... [19:15:11] ... [19:15:30] got it [19:15:33] ok nvm [19:15:41] ./usr/local/apache/common/images/sul [19:15:41] that's moved too [19:15:43] K [19:15:48] whole apache was moved [19:16:00] Why didnt you just copy paste everything? [19:16:03] Oh ok [19:16:07] huh? [19:16:12] I moved it to nfs [19:16:17] remounted [19:16:38] actually it's still on -test [19:16:41] it's shared [19:17:00] Ah ok [19:17:31] Throw me a non working url to test on my phone [19:17:32] UI get [19:17:32] Invalid host name (meta.wikimedia.deployment.wmflabs.org), can't determine language. [19:17:40] http://meta.wikimedia.deployment.wmflabs.org/wiki [19:17:54] I think it's caused by wrong htdocs root [19:17:56] this.is.invalid [19:19:09] petan are ALL the vhosts configured? [19:19:18] I copied only two lines in httpd [19:19:23] include [19:19:46] In ports change namevirtual host to * [19:19:49] No port [19:20:20] [Mon Jan 09 19:20:12 2012] [error] VirtualHost *:80 -- mixing * ports and non-* ports with a NameVirtualHost address is not supported, proceeding with undefi [19:20:46] Disable the default site [19:20:57] where is that [19:21:14] got it [19:21:47] done [19:22:02] Heh [19:22:18] yay [19:22:21] hexmode: work [19:22:23] Thats was pretty good for only having ircc on a phone [19:22:30] hehe [19:23:41] http://labs.wikimedia.deployment.wmflabs.org/wiki/Main_Page -- works! [19:24:01] http://meta.wikimedia.deployment.wmflabs.org/wiki/Main_Page -- works [19:24:17] http://deployment.wmflabs.org/ -- need redir [19:24:27] what is the host you guys are using? [19:24:32] sure [19:24:34] sec [19:24:43] it's labs.wikimedia [19:25:02] petan: I meant the wmflabs ssh host [19:25:11] bastion [19:25:55] Deployment-web [19:26:00] :o [19:26:07] yup [19:26:14] deployment-web -sql -dbdump [19:26:21] when you guys are ready, I'll spam the village pump pages with https://meta.wikimedia.org/wiki/Global_message_delivery [19:26:55] Not yet [19:26:58] also, I'm writing up a blog post mentioning you guys and thanking you if thats ok [19:27:04] Sure [19:28:29] ok [19:28:35] o.0 woot, there is a wikipedia spam service. [19:30:03] http://deployment.wmflabs.org/ [19:30:05] done [19:30:06] An an un-related note, who killed my bots [19:30:11] * Damianz eyes Ryan [19:30:38] it's possible, but unlikely this time [19:30:54] the instances are configured to patch themselves, and reboot, right now [19:30:56] for security updates [19:31:03] so, that's likely what did it [19:31:23] :O [19:31:28] can we turn it off? [19:31:45] petan: johnduhart-phone: should we get search working first or just note that it doesn't work yet? [19:31:46] I dunno. I think I kind of prefer it this way. heh [19:31:58] at least then I know for sure the patches are being applied [19:32:08] hm... I don't know... you mean what kind of search [19:32:17] hm... right [19:32:25] but it makes it pretty unstable [19:32:34] we really just need to ensure that when things reboot, they restart properly [19:32:44] Im fine with MySQL search [19:33:01] I guess that's kind of bad for the mysql servers, though [19:33:24] until we get a good process for ensuring security patches are getting applied, I'm going to keep it on [19:33:31] ok and maybe ensure that all bots etc start where they stopped heh [19:33:35] :D [19:33:36] petan: I was thinking lucene but we don't really have a good person other than OrenBochman that I know of [19:33:38] which is impossible [19:33:44] why? [19:33:49] if they have init scripts.... [19:34:01] I'd really like to have a meta-init script [19:34:05] an upstart one [19:34:06] Ryan_Lane: it's not so easy to determine where bot stopped also wikipedia is changing faster than ubuntu load [19:34:31] so it make inconsistent edit, likely [19:34:34] then we can have the bots put their "init" info into a file [19:34:42] hm... [19:34:51] a scheduler could tell which system which bots to run [19:34:53] it does happen though because bots crashes so I think it's ok [19:35:14] then the meta-init script could launch the bots as the user who wrote them [19:35:28] hexmode: you want to create account now and write some inital info on wikis we have [19:35:31] :D [19:35:36] the bots could live on NFS/gluster [19:35:40] hexmode: I start importing stuff ok [19:35:47] then all boxes could run them [19:36:14] hell, we wouldn't even need a scheduler. we could have another file, managed by root, that says which bots run where [19:36:26] then we can manually change it around, based on load [19:36:39] root would be needed to enable new bots [19:37:00] petan: will do. I need to make sure I can get my gadget working for "Problem reports" [19:37:03] :) [19:37:11] ok [19:37:14] I will import all [19:38:33] petan: import from where? my gadget was only on auth AFAIK [19:38:54] ok I will import it from there [19:38:57] auth still exist [19:39:02] just it isn't available to users [19:39:07] k [19:39:30] it was just a script, though, easy to reproduce if it gives you too much trouble [19:40:06] We really should have a nice way to handle patches so for clustered servers they don't all reboot at once. [19:40:26] Damianz: tell that to ubuntu [19:40:43] there's no patch management software available [19:40:51] except landscape, which isn't open source [19:40:54] * Damianz eys the python apt bindings [19:41:27] yeah, I wouldn't imagine writing one would be amazingly hard [19:41:55] could likely do it easily enough with marionette collective, too [19:42:13] though it would need to be in ruby then [19:42:16] * Ryan_Lane shudders [19:42:18] I'm tempted to write something simple for RHEL based systems, spacewalk is a beast. [19:42:28] spacewalk works, though [19:42:36] True but 378packages! [19:42:41] heh [19:42:44] And java *shudders* [19:42:53] no. no [19:42:58] java, and python, and perl [19:43:02] Yeah [19:43:05] petan: the only page from auth that I really want is "Problem reports" ... if you get that imported I can manage the rest easily [19:43:12] ok [19:44:09] done [19:44:19] Actually I think I un-installed it as the setup script wouldn't register the server :( Oh well it's under cfengine on the todo list for the testing env for me *sigh* [19:44:57] hexmode: did you create an account? [19:47:13] petan: sorry, will do [19:47:16] np [19:47:20] I don't really care :D [19:47:27] but it's usefull [19:47:38] also I wanted to know if it works [19:48:00] petan: I did and got the images this time [19:48:04] w00! [19:48:07] heh [20:00:23] !log deployment-prep creating commons, de wiki, en_wiktionary etc. etc... [20:00:24] Logged the message, Master [20:21:45] Damianz: cfengine? [20:21:52] Damianz: what's under cfengine? [20:26:33] hey [20:26:38] Hi [20:26:52] I forgot, what's the next part after I upload wiki [20:26:56] eg create db [20:27:18] http://commons.wikimedia.deployment.wmflabs.org/wiki [20:27:36] That needs a new docroot [20:27:42] I created it [20:27:46] even config in apache [20:28:21] What's tje db name? [20:28:27] commonswiki [20:28:49] Is it in all.dblist [20:28:53] en wikimedia commons [20:28:56] oh [20:28:58] that's it [20:29:37] LOL [20:29:41] it redirects me to real commons [20:29:51] Ill be home soon to adsist [20:29:54] Heh [20:29:56] Is the deployment site for MW 1.19 testing up yet? [20:30:05] sort of [20:30:15] Sid-G: seehttp://labs.wikimedia.deployment.wmflabs.org/wiki/Main_Page [20:30:18] no cloning done yet, right? [20:30:23] You need to fix tje wgaerve [20:30:25] seen that [20:30:31] The wgServer [20:30:38] nothing in the recent changes except the main page [20:30:47] did you check site matrix [20:30:54] no [20:30:59] * Sid-G is looking [20:31:20] ah [20:31:22] ok [20:31:25] johnduhart where [20:31:29] See wmf-config/InitialiseSettimgsDeploy [20:31:31] Php [20:31:32] ok [20:31:57] how many pages will this testing involve? [20:32:08] per project I mean [20:32:24] Sid-G: 5000 wikipedia other 2000 + anything people import] [20:32:31] so you will be able to import anything you want [20:32:36] ok [20:32:46] and test extesions too, right? [20:32:53] Sid-G: if you created account I can give you permissions to import [20:33:00] 5 mimutes from helping [20:33:05] Sid-G: any extensions you request will be deployed [20:33:06] Brb [20:33:06] its different from sul? [20:33:11] yes it is [20:33:18] for security reasons... [20:33:23] this site is unstable [20:33:31] because it runs unreviewed code [20:33:39] you should use different password than on wiki [20:33:43] but its got internal sul of its own right? [20:33:46] ye [20:33:50] ok [20:34:32] maybe I should check back in a day or two? (Hopefully the pages would've been imported by then?) [20:34:42] Or do users import pages? [20:35:03] yes [20:35:11] I said I give you permissions if you register :D [20:35:18] ok :D [20:35:24] just tell me if for all wikis or some certain [20:35:34] I've never imported before, so its gonna be fun :) [20:35:37] sure [20:35:51] be carefull import less than 100 pages in one import otherwise it's gona stuck [20:35:57] ok [20:35:58] if you wanted to import more let me know and I will do it [20:36:15] any general idea of what all should be tested? [20:36:25] everything :) [20:36:41] extensions, js, css, template structures, gadgets [20:36:49] yes [20:36:58] special pages too? [20:37:00] Sid-G: which wiki you want? [20:37:01] sure [20:37:04] hi-wp [20:37:06] ok [20:37:10] will set it up [20:37:14] :) [20:38:00] !log deployment-prep created hi wiki + de wiki [20:38:01] Logged the message, Master [20:38:42] petan: do I need a secure password? Or will anything do? I mean, do u expect anyone to try to hack into this? [20:38:53] I don't know [20:38:55] it's up to you [20:39:00] ok [20:39:17] so u're not sending a dev to try to hack it atleast :P [20:40:24] Sid-G: done [20:40:37] ? [20:40:44] * johnduhart|poof is home [20:40:47] wiki is up [20:40:53] :) [20:40:57] hi.wikipedia.deployment.wmflabs.org [20:41:48] uh, its main page is using an older url type [20:41:57] it will change [20:42:04] huh? [20:42:05] that wont change on the real wp with deployment wud it? [20:42:08] it's in MW space [20:42:14] no it won't [20:42:23] I didn't import configuration yet [20:42:34] Sid-G: did you login there? [20:42:44] petan:logging in now [20:43:23] yup [20:43:36] gave you admin and crat [20:43:52] :) didnt have those at hi-wp; so YAY [20:43:59] heh [20:44:04] no deal [20:44:05] here [20:44:16] yeah, still its gonna be fun! [20:44:22] I hope [20:44:33] petan: THe apache config should match the configratuion at noc [20:44:40] ah [20:44:43] ok [20:44:44] http://noc.wikimedia.org/conf/ [20:44:52] I created a separate config files because I was lazy [20:44:55] I will copy it [20:45:21] btw it can't match it [20:45:27] there will be always some difference [20:45:35] you think we can't keep it separated? [20:45:37] Of course [20:45:47] because it's easier to read [20:45:52] than one big file [20:46:30] Fair enough, fix it so that each is it's own file, and it includes on main configuration in httpd.conf which includes the rest [20:46:45] ok [20:47:01] I'm going to work on getting some of the extensions working [20:47:13] right can we disable new user message? [20:47:22] On meta? [20:47:27] on enwiki meta and labs [20:47:38] is it used there? [20:47:43] on prod [20:47:47] There shouldn't be a new user message opn enwiki [20:47:53] ah right [20:47:56] there is on all other wikis [20:48:23] IF that's how they're set up then I'd leave it like that, again we're trying to match real conditions [20:48:40] ok I just don't believe that [20:48:44] and labs doesn't exist on prod [20:48:50] I can disable it on labs [20:48:52] de wiki doesn't have welcome message afaik [20:50:32] * johnduhart|poof pokes at configuration [20:51:41] petan: did i miss anything? http://hi.wikipedia.deployment.wmflabs.org/wiki/%E0%A4%B8%E0%A4%A6%E0%A4%B8%E0%A5%8D%E0%A4%AF:Siddhartha_Ghai [20:52:53] petan: Can you please commit when you change settings? [20:53:09] I am still changing it [20:53:12] right now [20:53:16] I write file and commit [20:53:53] Okay, got just saying since you have a bunch of files in sitting in your working directory [20:56:56] petan: I don't get an autogreeting on de.wp.d [20:57:11] ah, right I think I got it [20:57:17] maybe it was commons [20:57:29] commons has that on [20:58:10] commited [20:58:26] petan: You still have a bunch of untracked things [20:58:52] uh really? [20:58:56] where [20:59:13] All the new docroots and configurations [20:59:17] git status [21:00:13] done [21:00:19] Great [21:05:06] petan: Can you please fix the permissions for apache/conf, I can't right anything [21:05:16] write* [21:05:20] you are in depops group? [21:05:24] check it [21:05:33] in which instance you work? [21:05:36] I hope not -test [21:05:39] -web [21:05:47] And all the files are in the svn group [21:05:55] wait [21:06:11] fixing [21:07:28] petan: I'm getting no article feedback form on the test main page for hi-wp [21:07:51] will fix it [21:08:14] and special:Import says there are no sources to import from [21:08:20] AF 0.2.0 :/ [21:08:54] Sid-G: Probably a configuration problem, will poke at it right after I'm done setting up testwiki [21:09:07] johnduhart:ok, thanks :) [21:09:08] Sid-G: fixing [21:09:57] oh, just for knowledge; when is deployment expected in feb? [21:10:14] Sid-G: When it's ready [21:10:15] I guess it depends on results of testing... [21:10:17] No set date [21:10:24] ok [21:10:33] petan: I still can't right to those files since theyre not g+w [21:10:47] I am working on that [21:10:58] root@i-000000d7:/mnt/export# chgrp depops -R . [21:11:08] that didn't work o.O [21:11:13] that's weird [21:11:27] ah [21:11:29] +w [21:11:34] ding ding ding [21:12:04] you're winner! [21:12:08] done [21:12:20] nope still not g+w [21:12:26] wait [21:12:48] still can't write [21:13:00] interwikis not functional? [21:13:14] Sid-G: Probably not! [21:13:43] http://etherpad.wikimedia.org/DeploymentPrep [21:13:44] johnduhart: thats intentional? Or not fixed yet? [21:13:50] Not setup yet [21:14:43] okay I can write [21:15:08] cool [21:15:36] Sid-G: you can import [21:15:40] try it [21:15:46] you should see option to import file now [21:15:55] ok [21:16:10] you probably need to relog [21:16:44] relogin? not just a cache clear? [21:17:49] relogin [21:17:54] ok [21:19:06] No transwiki import sources found ? [21:20:05] not defined [21:20:12] petan: ? [21:20:25] no transwiki [21:20:27] use import xml [21:20:39] on source use Special:Export [21:20:42] on target Import [21:20:44] ;) [21:20:49] how? I haven't done this before? [21:21:03] hm... [21:21:04] i have no source and target fields [21:21:12] en.wikipedia.org/wiki/Special:Export [21:21:17] there you can export pages to xml [21:21:23] then use Special:Import to import them [21:21:38] ok [21:22:10] so there's some kind of internal buffer or something for this which is empty till I export the page from a source? [21:22:27] huh? [21:22:37] No [21:24:25] ok, now i get some of it. I'm downloading the xml [21:24:30] nice [21:24:45] but where are the import options? [21:24:55] open Special:Import [21:25:00] on target wiki [21:25:06] ok [21:25:16] you may need to relog again [21:25:22] right [21:25:29] !log deployment-prep reconfigured global permissions [21:25:30] Logged the message, Master [21:25:38] that's the thing that was probably confusing me [21:28:23] ok, 1 page imported :) [21:29:16] !log deployment-prep Created test.wikimedia [21:29:17] Logged the message, Master [21:29:23] !log deployment-prep Updated databases [21:29:24] Logged the message, Master [21:29:27] so to import pages, I always have to download-upload? [21:30:19] yes, or send me a list [21:30:23] and I will import them [21:30:28] or is there a less bandwidth intensive way? [21:30:41] sending me a list is [21:30:48] just copy it to paste bin [21:32:12] right, a less bandwidth intensive way for imports? [21:33:13] um [21:33:20] I said send me a list [21:33:21] isnt it possible directly? Its on the same servers I mean; cant it just copy from one part to the other without me having to download the entire thing and uploading it again? [21:33:26] yes it is [21:33:27] soory [21:33:36] my connection cut me off :( [21:33:39] ah ok [21:33:40] *sorry [21:33:55] list, category names would do? [21:34:00] yes [21:34:15] ok, now or if u're busy, later? [21:34:20] sure [21:34:20] now [21:34:26] ok hold on [21:34:34] paste it on pastebin [21:34:50] what wiki it is? [21:35:04] hi-wp [21:35:16] pastebin? [21:35:23] yep [21:35:36] can't i just link here? [21:35:39] yes [21:36:00] for starters: http://hi.wikipedia.org/wiki/%E0%A4%B6%E0%A5%8D%E0%A4%B0%E0%A5%87%E0%A4%A3%E0%A5%80:Templates_used_by_Twinkle [21:36:26] ok, that's all? [21:36:46] no, hold on [21:36:55] anything in mediawiki namespace? [21:37:09] I will import whole MW [21:37:13] ok [21:37:17] that will be done for all wikis [21:37:26] ok [21:37:38] petan: Can't commit, permissions problems. [21:37:42] yay [21:37:44] sec [21:38:05] working on that [21:38:12] root@i-000000d7:/mnt/export# chmod -R g+w * [21:38:18] that's gonna take a while [21:38:32] done XD [21:38:40] k [21:38:53] And my default group is svn for some reason [21:39:00] hm... that's ldap [21:39:05] can't change it ask Ryan [21:39:12] * johnduhart slaps Ryan_Lane [21:39:20] mine too, when I think of that we should use svn as group :D [21:39:20] http://hi.wikipedia.org/wiki/%E0%A4%B6%E0%A5%8D%E0%A4%B0%E0%A5%87%E0%A4%A3%E0%A5%80:%E0%A4%A6%E0%A5%87%E0%A4%B6_%E0%A4%86%E0%A4%81%E0%A4%95%E0%A4%A1%E0%A4%BC%E0%A5%87_%E0%A4%B8%E0%A4%BE%E0%A4%81%E0%A4%9A%E0%A5%87 [21:39:52] probably done [21:39:57] petan: all subcats and their pages too plz :) [21:40:02] uh [21:40:03] blame svn, not me [21:40:12] can you list it? [21:40:16] to pastebin [21:40:20] also, I don't plan on modifying people's default group [21:40:28] define:pastebin :D [21:40:49] !pastebin is http://pastebin.org [21:40:49] Key was added! [21:41:04] ok [21:41:06] wait [21:41:07] petan: use newgrp [21:41:11] !pastebin del [21:41:11] Successfully removed pastebin [21:41:15] !pastebin is http://pastebin.com [21:41:15] Key was added! [21:41:16] :D [21:41:17] johnduhart: use newgrp [21:41:18] fixed [21:41:23] ok [21:42:32] johnduhartis it ok? [21:43:02] !log newgrp newgrp can be used to change your current group ID for a login session. [21:43:02] newgrp is not a valid project. [21:43:14] doh [21:43:19] !newgrp newgrp can be used to change your current group ID for a login session. [21:43:20] heh [21:43:25] !newgrp is newgrp can be used to change your current group ID for a login session. [21:43:25] Key was added! [21:43:26] !newgrp is newgrp can be used to change your current group ID for a login session. [21:43:26] Key exist! [21:43:28] heh [21:43:29] heh [21:43:31] heh [21:43:31] :D [21:43:41] !group [21:43:41] https://labsconsole.wikimedia.org/wiki/Special:NovaPuppetGroup [21:43:46] !groups [21:43:49] meh [21:43:53] petan: Will know in a bit [21:43:57] * johnduhart is working on interwiki [21:44:11] petan: do i need to list subcats or will the cats be flattened before import? [21:44:18] * petan is working on 4 imports at once [21:44:29] sbcats [21:44:32] * sub [21:44:34] ok [21:44:47] if it got flattened you would export whole wiki :D [21:45:02] if it's categorized well [21:45:03] :P [21:45:24] it isnt :P [21:46:07] oh, abusefilters come under? [21:50:24] huh? [21:51:10] uh, they need to be imported? [21:51:21] what? [21:51:23] or created by hand here for testing? [21:51:25] lol [21:51:28] I don't know what you mean [21:51:37] abuse filter defs? [21:51:45] hey, I told you I aint an admin [21:51:46] or MW pages? [21:51:56] I dont know half the admin stuff! [21:51:59] defs won't be probably imported unless someone do that [21:52:02] abusefilter defs [21:52:04] some defs are private [21:52:08] so not [21:52:33] http://pastebin.com/FCGV01Nm [21:53:16] :) [21:53:35] uh [21:53:36] ok, so how can the abusefilter be tested? [21:53:44] I hoped you can send me a list like Category:fsg [21:53:46] not url's [21:53:54] petan:uh [21:53:59] hold on then [21:54:13] also not encoded please :o [21:54:35] sure [21:54:38] thanks [21:55:39] johnduhart-phone: don't forget to run maintenance scripts on test [21:55:48] because of load [21:55:52] no need to run it on apache [21:55:56] ok [21:56:09] apache is already on high load [21:56:14] too high [21:57:31] Well you're the one running an dump import on it [21:57:45] yes I know... 1 is running there [21:57:50] but other 2 are running on tset [21:58:00] I forgot test can do that :D [21:58:05] when I started first [21:59:10] Reedy: what is api to list all mw pages? [21:59:18] allpages [21:59:19] is it even possible? [21:59:23] without limit [21:59:27] nope [21:59:30] damn [21:59:35] action=query&list=allpages&allimit=max [21:59:36] I think [21:59:48] just make x requests until you have them all... [21:59:52] yup but that's almost same for me as opening Special page [21:59:52] Having limitless stuff is just asking for trouble [22:00:32] I will create app for that [22:02:11] petan: http://pastebin.com/V7UdW5KY [22:02:21] all but the last two are categories [22:02:38] hexmode: http://en.wiktionary.deployment.wmflabs.org/wiki/Wiktionary:Main_Page [22:03:48] btw, did you guys start 4-5 hrs ago? [22:04:16] like that [22:04:17] heh [22:04:20] 10 hours :D [22:04:41] :D [22:05:13] right its around 3pm on 9th in the US right? [22:05:24] The us has many timezones ;) [22:05:25] I am from EU [22:05:33] no wonder. I miscalculated... [22:05:38] 23:00 [22:05:43] US has 3 if i remember correctly [22:05:52] do I reedy? [22:05:57] Do you what? [22:06:12] do i remember correctly that US has 3 timezones? [22:06:43] west/east/central ? [22:06:44] 5 or 6 if you include canada [22:06:59] thats a lot of timezones [22:07:43] anyways, Good Night to all (whenever you decide to sleep) :) [22:12:01] hi people [22:12:05] hey [22:12:12] I am back [22:12:34] I've been revising shell scripting [22:14:09] do you know what hexmode wanted ? [22:14:41] yay 2gb of ram isn't enough [22:15:30] not enough or what [22:17:40] * methecooldude pokes Ryan_Lane [22:18:05] eh? [22:18:07] sup? [22:18:10] yay load on test :D [22:18:34] poor labs [22:18:59] methecooldude: ? [22:19:21] I'm in a class, if you are gonna poke me, you gotta be responsive ;) [22:19:31] Ryan_Lane: Can I get access to approve patches on Gerrit... it seems I can review them, but Approving never works [22:19:51] no. only ops has that right currently [22:19:57] you can +1 [22:20:01] only ops can +2/merge [22:20:07] Ryan_Lane: Ah, ok [22:20:24] Ryan_Lane: For prod, sure, but would it make sense to widen that a bit for test? [22:20:40] no. because if we do that, then people can take over other people's projects [22:20:44] Oh, right [22:20:54] when each project has its own repo, it's less of a problem [22:20:57] err [22:20:58] branch [22:22:21] I've been thinking about it more, I think we can do it fairly easily [22:22:39] ma rk's suggestion is good. it'll take a little effort, but it should work [22:22:41] Yeah, we definitely need to have that at some point [22:22:45] What suggestion is that? [22:22:52] we'll switch away from having a central server [22:23:04] and each instance will have a copy of the repo locally [22:23:15] it'll be configured to use ldap for node info [22:23:36] people will be able to make changes locally, to test, then can push the changes to test [22:23:48] or can make a topic branch, and push that to test when it is good [22:24:08] a topic branch would be useful for multiple instances that need to be configured together [22:25:03] the thing I worry about is projects switching branches, then forgetting to ever switch back [22:25:25] we should likely put nagios checks in place to warn about very outdated projects [22:25:26] IMO, everything would start in its own topic branch ideally, linked to a project [22:26:57] that would be nice, but I again worry that the branch would become very out of date [22:27:07] so the systems wouldn't receive updates via puppet [22:27:22] Right [22:28:07] Hmm, I have an idea for a feature, but it's kind of magical [22:28:41] ...and possibly impractical or confusing [22:29:03] oh? [22:29:07] Basically, in addition to specifying a branch, a project should be able to specify a commit ID, which may correspond to a commit that's pending review [22:29:25] yeah. someone in gerrit mentioned that too [22:29:28] So you'd say "normally my project runs off test, but I'd also like it to have 9c54ab..." [22:29:36] The confusing magical behavior is this [22:29:39] that's easy, if the repo is local [22:29:58] Once 9c54ab is merged into test, the project automatically goes back to tracking the tip of test rather than staying at that commit [22:30:11] it would be *really* awesome if everyone could use mcollective, to modify all their project instances at once [22:31:15] mcollective i9c54ab [22:31:29] mcollective run-puppet [22:31:42] or something like that, anyway [22:33:42] Hmm, right [22:34:03] Well isn't there some config thing somewhere where you tell a project which branch to track? [22:34:29] Can't we "just" have change-merged hooks that update all projects automatically, unless they opt out? [22:36:21] oren: ping? [22:36:54] oren: I wanted to see if you could set up lucene for deployment [22:37:41] * hexmode wonders if he missed his chance to ask OrenBochman  [22:38:03] PROBLEM Free ram is now: WARNING on deployment-test deployment-test output: Warning: 12% free memory [22:38:06] re [22:38:24] OrenBochman: I wanted to see if you could set up lucene for deployment [22:38:46] not sure what you mean [22:39:09] deployment to where [22:39:46] OrenBochman: http://deployment.wmflabs.org/ -- I'm working with johnduhart and petan to set up an test deployment of 1.19 [22:40:13] OrenBochman: and I'd like to get Lucene there to be complete [22:40:18] can you help? [22:40:30] what is the time frame ? [22:40:32] maybe we can just point to your labs instance? [22:40:55] tomorrow? ... if that is too soon maybe we can add lucene later [22:40:57] my labsinstance is not fully set up [22:41:24] it looks like the demon is not deployed [22:41:36] I wanted to write a script to do it [22:41:57] sorry for the lack of notice... but I didn't know you were doing anything on labs or that you were lucense-capable :) [22:42:17] should we push and add lucene later, then? [22:42:47] I'd like to cooperate [22:43:03] PROBLEM Free ram is now: CRITICAL on deployment-test deployment-test output: Critical: 4% free memory [22:43:07] how soon could you do it? [22:43:17] just that linux comand line is lagging [22:43:29] the command line is lagging? [22:43:32] labs-nagios-wm: seriously. I just browsed a few pages! [22:43:37] hehehe [22:44:09] just that my comand of the linux comandline is awful [22:44:23] heh [22:44:25] I think we can wrap it up in about an hour [22:44:44] + time for indexing [22:44:58] it's only going to index what is loaded, right/ [22:45:05] we don't have a massive amount of space [22:45:10] but that would be only a small stand alone installation [22:45:17] and you guys have used at least a quarter of available space :) [22:45:19] petan: around? [22:45:23] yes [22:45:30] yes [22:45:40] petan: can you work with OrenBochman on this? [22:45:41] Ryan_Lane: we only used 140 gb [22:45:51] probably yes [22:45:53] its only got simple-english wikipedia [22:45:55] oh? [22:46:08] I wonder what is eating up the rest of the space [22:46:09] Ryan_Lane: want me to bring you hdd? [22:46:10] :P [22:46:20] I'll be adding more space soon [22:46:27] and a *lot* more soon after [22:46:29] I could use some of mine hdds :D [22:46:33] petan we use 140 GB [22:46:40] >> [22:46:42] ?? [22:46:45] OrenBochman: yes [22:46:49] what's wrong [22:46:49] petan: OrenBochman: ping me if I can help, but I think you all are on it [22:46:53] only 80 sql [22:47:15] hexmode, petan, oren: get notpeter to help you guys with this [22:47:22] he helped set it up in production [22:47:50] OrenBochman: if you tell me what is needed to do, because I don't know much [22:47:54] related to search... [22:48:03] RECOVERY Free ram is now: OK on deployment-test deployment-test output: OK: 87% free memory [22:48:13] I've not got it running yet [22:48:23] but we can get started [22:48:28] we want to set it up like it is set up in production [22:48:35] so, it should ideally use the puppet config [22:48:52] minus the lvs stuff [22:49:27] that's complicated - the lab-test is nothing like the production - it is supposed to be a standalone installation [22:49:40] hexmode: enwiki wiktionary should be ready for testing [22:49:43] ah [22:49:46] interwiki links [22:49:52] yay [22:49:53] also I've never logging into the prodoction servers - I don't think I have access [22:50:01] OrenBochman: except that deployment is supposed to look like production [22:50:15] I agree [22:50:21] that's why I suggested notpeter :) [22:50:25] who happens to not be in this channel [22:50:31] and may not be around right now [22:50:34] but it would take more than an hour [22:50:43] likely, yes [22:50:57] I looked over the docs today and yesterday [22:51:11] the production setup is four machines [22:51:44] they may or maynot have media wiki - but no content on them. [22:51:57] so that would be fast to setup [22:52:14] using puppet [22:52:48] yeah, they have mediawiki installed [22:53:09] with no content. just the software [22:53:19] btw what's notpeter's mediawiki user [22:53:22] yes [22:53:24] ummm [22:53:37] Pyoungmeister [22:55:06] they will need java 5 ant 1.6 and rsync [22:55:08] hey I go sleep ok? [22:55:19] anyone need something [22:55:50] I was hoping for some help on search-test but we can do it tommorow [22:56:01] since I got to sleep soon [22:56:05] depends on what kind of help [22:56:09] I can spare 30 min [22:56:40] could you write for me a script to do the following [22:57:14] 1. get the Lucene-search2 from subversion [22:58:25] to /usr/local/search/ls2 [22:59:06] sure [22:59:12] which instance [22:59:21] 2.download mwdumper to /use/local/search/ls2/lib [22:59:27] yes [22:59:27] search-test [22:59:34] svn co http://svn.wikimedia.org/svnroot/mediawiki/trunk/lucene-search-2/ /usr/local/search/ls2 [23:00:08] !log search installed java [23:00:09] Logged the message, Master [23:02:31] I really need to fix this OSM bug for the SAL [23:02:53] it's overwriting the SAL when project members are added/removed [23:03:36] Orendone [23:03:39] Oren done [23:03:47] it's all installed there [23:04:06] ok now we need to modify a couple of files [23:04:11] right [23:04:12] !new-bug is https://bugzilla.wikimedia.org/enter_bug.cgi?assigned_to=rlane32%40gmail.com&blocked=&bug_file_loc=http%3A%2F%2F&bug_severity=enhancement&bug_status=NEW&comment=&component=OpenStackManager&contenttypeentry=&contenttypemethod=autodetect&contenttypeselection=text%2Fplain&data=&dependson=&description=&form_name=enter_bug&keywords=&maketemplate=Remember%20values%20as%20bookmarkable%20template&op_sys=All&product=MediaWiki%20extensio [23:04:12] Key was added! [23:04:16] heh [23:04:26] :O [23:04:28] too long [23:04:37] iki%20extensio [23:04:41] not all [23:05:54] PROBLEM host: puppet2 is DOWN address: puppet2 PING CRITICAL - Packet loss = 100% [23:06:09] OrenBochman: what can I do [23:06:13] We need to create a Global Configuration file [23:06:19] !new-bug del [23:06:19] Successfully removed new-bug [23:06:23] where and for what [23:06:29] !osm-bug is https://bugzilla.wikimedia.org/enter_bug.cgi?assigned_to=rlane32@gmail.com&bug_severity=enhancement&bug_status=NEW&component=OpenStackManager&contenttypemethod=autodetect&contenttypeselection=text/plain&form_name=enter_bug&op_sys=All&product=MediaWiki extensions&rep_platform=All&version=any [23:06:30] Key was added! [23:06:40] um [23:06:45] that doesn't work like that [23:06:58] !osm-bug del [23:06:58] Successfully removed osm-bug [23:07:03] !osm-bug is https://bugzilla.wikimedia.org/enter_bug.cgi?assigned_to=rlane32@gmail.com&bug_severity=enhancement&bug_status=NEW&component=OpenStackManager&contenttypemethod=autodetect&contenttypeselection=text/plain&form_name=enter_bug&op_sys=All&product=MediaWiki%20extensions&rep_platform=All&version=any [23:07:03] Key was added! [23:07:16] !osm-bug | petan_petan [23:07:16] petan_petan: https://bugzilla.wikimedia.org/enter_bug.cgi?assigned_to=rlane32@gmail.com&bug_severity=enhancement&bug_status=NEW&component=OpenStackManager&contenttypemethod=autodetect&contenttypeselection=text/plain&form_name=enter_bug&op_sys=All&product=MediaWiki%20extensions&rep_platform=All&version=any [23:07:20] :D [23:07:28] better :) [23:07:58] before that we need to create a directory for the indexesss at /usr/local/search/indexes [23:08:10] chmod? [23:08:21] is it going to be big? [23:08:27] don't know [23:08:36] I could link to mnt [23:08:39] that has 20gb [23:08:45] ./usr only 10 [23:08:50] about 75% of the dbase [23:09:02] which db? [23:09:08] ok I will use /mnt [23:09:15] ok [23:09:38] the important thing is that lsearch.conf needs to point at it [23:09:56] the important thing is that lsearch.conf needs to point and at the MWConfig.global [23:10:03] that's ok [23:10:06] at the lib directory [23:10:36] at the localization as well [23:11:11] done [23:11:13] and it needs at a log4j configuration [23:11:14] it's there [23:11:22] great [23:11:37] I have no idea how to set up lsearch though [23:11:41] where - I can't see it [23:11:48] when you guys get a chance, you should look through how search is done in puppt [23:11:50] *puppet [23:11:51] ./usr/local/search/indexes [23:12:02] you can manage puppet groups, and add variables and classes as necessary [23:12:06] in your project [23:12:14] we need to set up the global config and ant should take care of the rest [23:12:47] hm. I think some of this is managed via scripts on fenari... [23:13:08] petan: docroot/labs/images/sul/? [23:13:10] wat [23:13:10] OrenBochman: I will go now, let's do this tommoro ok? [23:13:19] johnduhart huh [23:13:21] where is the conf [23:13:22] what? [23:13:30] I can't find it [23:13:30] OrenBochman: which conf [23:13:31] Where did that come from? [23:13:35] I created only the folder [23:13:49] the lsearch.conf [23:13:57] lrwxrwxrwx 1 mah svn [23:14:00] * johnduhart loooks at hexmode [23:14:01] from hex [23:14:06] no [23:14:10] bad hexmode [23:14:13] heh [23:15:09] OrenBochman: I didn;t create it [23:15:12] I don't know how [23:15:24] ok I'll give it a shot [23:15:29] ewwww [23:15:33] right, send me a mail if you needed help [23:15:35] a 777 directory? [23:15:39] there are samples in the test-data [23:15:43] Ryan_Lane: lol it's a link [23:15:44] o [23:15:46] oh [23:15:48] :D [23:15:48] a link. heh [23:15:51] directory for global and local [23:16:12] also it may be possible to generate automaticaly [23:16:19] ok [23:16:28] send me all this in a mail and I will do it asap [23:16:34] tommorow [23:16:35] :) [23:16:36] ok [23:16:36] I'll try and we can take it up tommotro [23:17:02] I'll also send notpeter an email [23:17:44] put me in a copy ok so I see the reply [23:18:05] or maybe even jeremy he works on that too? [23:18:22] ps can you install ant 1.8 [23:18:32] it's possible the lsearchd config is on fenari, and is pushed to the systems [23:18:41] s/possible/likely/ [23:19:09] OrenBochman: yup [23:19:10] is that like a ferari [23:19:18] heh [23:19:18] no [23:19:24] it's the bastion host for production [23:19:41] done [23:19:52] what is the matrix ? [23:19:59] where [23:20:03] deployment? [23:20:06] s/bastion/matrix/ [23:20:09] ah [23:20:14] that's login server [23:20:24] just the gateway [23:20:29] yes [23:20:30] for ssh [23:20:34] probably [23:20:38] Ryan knows more [23:20:49] !Ryan is man of the all answers ever [23:20:49] Key was added! [23:21:02] ok [23:21:08] !Ryan [23:21:08] man of the all answers ever [23:21:09] matrix? [23:21:12] gateway? [23:21:15] !terms [23:21:15] https://labsconsole.wikimedia.org/wiki/Terminology [23:21:18] ok maybe not [23:21:20] ant can build things [23:21:47] please use the term bastion, rather than matrix or gateway [23:21:54] great doc [23:21:57] matrix means nothing, and gateway refers to a network device [23:22:43] yes [23:23:10] but it also refers to an entry point in plain english [23:23:23] petan: wha? how did that link get my user? [23:23:28] I no link that file [23:23:31] because you made it [23:23:32] :D [23:23:33] but it's a bad term to use, since it means something in the computing world [23:23:39] LIES [23:23:57] <^demon> Ryan_Lane: We could call it a Portal :) [23:24:04] hehe [23:24:15] no. we should call it a bastion, because that's what this is, in computing terms [23:24:20] !bastion is portal to RyanLand [23:24:21] Key exist! [23:24:23] damn [23:24:34] !bastion [23:24:34] ssh user@bastion.wmflabs.org [23:24:38] !bastion is http://en.wikipedia.org/wiki/Bastion_host [23:24:38] Key exist! [23:24:44] !bastion del [23:24:44] Successfully removed bastion [23:24:46] !bastion is http://en.wikipedia.org/wiki/Bastion_host [23:24:46] Key was added! [23:24:50] !bastion del [23:24:50] Successfully removed bastion [23:24:52] add to the terminology nova [23:24:54] :o [23:24:59] benchmarking wm-bot? [23:25:15] !bastion is http://en.wikipedia.org/wiki/Bastion_host; lab's specific bastion host is: bastion.wmflabs.org; see !access [23:25:15] Key was added! [23:25:28] !access [23:25:29] https://labsconsole.wikimedia.org/wiki/Access#Accessing_public_and_private_instances [23:25:33] !terms [23:25:33] https://labsconsole.wikimedia.org/wiki/Terminology [23:25:40] @regsearch [[[/.[]].]^5%$^#$^] [23:25:40] No results found! :| [23:25:43] yay [23:25:45] @regsearch [[[ [23:25:45] This is pretty bad regex [23:25:47] :D [23:25:55] hahaha [23:26:12] best message is when you excess timeout for search [23:26:53] @help regex [23:26:53] Unknown command type @commands for a list of all commands I know [23:27:00] @help search [23:27:00] Unknown command type @commands for a list of all commands I know [23:27:03] yay [23:27:06] that's wrong [23:27:08] heh [23:27:11] I forgot to insert help for that [23:27:49] ok I need to go now [23:27:51] !Ryan [23:27:51] man of the all answers ever [23:27:57] :D [23:31:39] !ryanland in case you want to get to wonderfull land of labs use portal we call bastion, you will see amazing world where vm's runs happily and nfs friends with ntfs, puppets are fresh and gerrit is ugly :O [23:31:43] !ryanland is in case you want to get to wonderfull land of labs use portal we call bastion, you will see amazing world where vm's runs happily and nfs friends with ntfs, puppets are fresh and gerrit is ugly :O [23:31:43] Key was added! [23:32:14] right it's time to go [23:32:22] or I do something more mad :D [23:34:27] btw hexmode some wikis are imported yet [23:34:37] wiktionary at least [23:35:52] petan: k, is it ok if I wait till Oren does the search before we do the big announcment? [23:35:58] sure [23:35:59] it is [23:36:01] or should we start now? [23:36:04] PROBLEM host: puppet2 is DOWN address: puppet2 PING CRITICAL - Packet loss = 100% [23:36:08] :) [23:36:50] petan I got a small problem [23:36:54] yes? [23:37:29] ant fails [23:37:33] yay [23:37:39] maybe we could fix it tommorow? [23:37:41] it cannot find tools.jar [23:37:42] um [23:37:44] aha [23:37:48] wait [23:37:50] to fix [23:38:07] I think we need to [23:38:26] apt-get install openjdk-6-jdk [23:38:28] apt-get install openjdk-6-jre-headless [23:38:29] apt-get install openjdk-6-jre-lib [23:38:43] in other words instal a jdk [23:39:02] you know… the puppet classes will do most or all of this stuff for you, right? [23:39:43] Rayan_Lane: how does this happen? [23:40:03] installed [23:40:10] is there an option to install JDK+ ANT [23:40:20] I have to go now [23:40:50] ok we'll continue tommorow [23:41:08] too bad I'm useless [23:41:31] basically, you select the classes, and when puppet runs, it installs and configures everything [23:41:40] Directory /usr/local/search/ls2/bin creation was not successful for an unknown reason [23:41:43] the classes may need to be slightly modified for labs [23:41:55] that's not a helful error [23:41:58] but thats why I suggested working with notpeter on this [23:42:01] but I guess it rights [23:42:15] but I guess it's a rights issue [23:43:04] are the classes accessible to wikilabs users or to developers (what's the differnce anyhow) [23:43:45] they are available to everyone [23:43:50] !git [23:43:50] for more information about git on labs see https://labsconsole.wikimedia.org/wiki/Git [23:44:03] our puppet configuration is in a git repo [23:44:38] it's also possible to modify our puppet configuration, and push merge requests [23:45:02] in the "configure instance" dialog in "Manage instances", you can select puppet classes and variables [23:45:29] if some are missing there, you can either ask me to add what's missing, or you can add them to your own project via "Manage puppet groups" [23:46:18] I've done manage instance [23:46:47] in that interface is a "configure" link for each instance [23:48:11] basically, right now you need to look through the puppet configuration, and see what classes and variables you need [23:48:24] which is something notpeter can likely do fairly easily [23:48:47] I see [23:48:49] then he'd select the right classes and variables on the instance, and force-run puppet [23:49:04] it would reconfigure itself based on the puppet configuration [23:49:35] the puppet classess and names are rather cryptic [23:49:40] yes [23:49:52] at some point I'm going to make "meta-instances" [23:50:18] I guess one would need to go though the GIT and get to know them [23:50:39] unless you could add a gloss(ary) field [23:50:45] which will give you a list of meta-instances, based on a type. when you ask to create that, it'll only show you options that correspond with that type of instance [23:51:08] I was planning on adding a description field for all variables and classes [23:51:10] that actually make sense [23:51:11] and groups [23:51:19] but you should call it a protoype [23:51:33] one meta-instance type will be the generic type [23:51:35] like a search prototype [23:51:48] which will be the exact interface you see now [23:51:54] it'll have everything available [23:52:12] hmm.. [23:52:24] have you used maven ? [23:52:30] nope [23:52:39] I know it's a build system, but it's for software [23:52:41] specifically java [23:52:51] yes it is [23:52:51] and I do basically no java dev anymore [23:53:03] but at its core it is a dependency managment system [23:53:29] yeah. it's heavily java-centric, though [23:53:36] it is [23:53:46] you couldn't use it [23:54:17] why do you ask? [23:54:31] but the one of it's features is that it has a central project definition in xml called a POM [23:55:15] and it also allows you to define project "archtypes" [23:55:27] like your metainstance I guess [23:55:32] * Ryan_Lane nods [23:56:22] if you add an archtype it get all the dependencies from cource reositories, builds the libs and makes for you a "hello world kind of app" [23:56:33] i.e. a working instance [23:57:11] yeah. that's the basic idea here [23:59:11] any how I'm glad you are improving documentation - it makes a big difference for early adopters [23:59:27] * Ryan_Lane nods [23:59:29] documentation is hard [23:59:33] any idea why ant can't make a dir in mt instance [23:59:41] permissions? [23:59:45] out of disk space? [23:59:56] where's the directory? [23:59:57] I doubt it disk space