[00:00:41] petan: I hope I'm getting these right... there wasn't any info on the PoolCounter one [00:00:56] there could be more such [00:01:05] because it wasn't included [00:02:40] !log deployment-prep [auth] added bugzilla to interwiki.sql and ran it, doesn't seem to be working [00:02:41] Logged the message, Master [00:02:54] !log deployment-prep booting memcache in case that fixes interwiki [00:02:55] Logged the message, Master [00:03:52] don't forget memcached breaks sessions [00:04:09] http://deployment.wmflabs.org/commons_wiki/wiki/Special:RecentChanges [00:04:12] same as on enwiki [00:04:17] !log deployment-prep booting memcached fixed it [00:04:18] Logged the message, Master [00:04:24] petan: you sure? i'm still logged in [00:04:33] it logged me off [00:04:50] i'm very surely logged in... [00:04:54] and broken my import [00:05:02] :( [00:05:06] :( [00:06:19] http://deployment.wmflabs.org/commons_wiki/wiki/Special:Preferences#mw-prefsection-gadgets [00:06:20] yay [00:06:21] so many [00:08:20] petan: could you create an images/timeline dir when creating wikis in the future (asking in case you're scripting it, I'm creating it now) [00:08:33] ok [00:08:35] I will [00:11:02] !log deployment-prep "apt-get install ploticus ttf-freefont" for timeline [00:11:03] Logged the message, Master [00:11:23] !log deployment-prep set config for timeline [00:11:24] Logged the message, Master [00:15:35] petan: have you set up hiwiki yet? [00:15:52] hm... probably not [00:15:58] I will do that tommorow ok? [00:16:01] it's 1 am [00:16:11] :o [00:16:18] sure, go to bed... unless you want to point me to how [00:16:29] or if you import data I can set it up it's not so hard [00:17:01] I will make a guide on auth [00:17:04] I was mostly trying to figure out how you did db set up for now [00:17:13] it's very simple [00:17:22] there is one user mw who has access to all db's [00:17:28] k, go to bed for now unless this is gonna take you 5min ;) [00:17:38] I always create a new db and set up permissions for it [00:17:47] then I copy preconfigured mw to new folder and start installation [00:17:59] then I copy LocalSettings and check extensions I need [00:18:05] you were creating some scripts for set up? where? [00:18:11] I am going to do that [00:18:17] for now I just do cp and cp [00:18:18] :D [00:18:24] k thought you had already [00:18:25] it's about 2 copies [00:18:40] I made a script for extensions deployment from svn [00:18:45] but I need to improve it [00:19:18] oh [00:19:22] hi_wikipedia exist [00:20:51] k, just didn't see dbname for ti [00:21:03] hi_wikipedia [00:21:04] and got lots of errors frm the cli [00:21:14] trying again [00:21:18] http://deployment.wmflabs.org/hi_wikipedia/wiki/Main_Page [00:21:56] ah [00:22:07] was missing a symlink for extensions [00:23:26] yes [00:23:28] running update [00:24:38] hrm... [00:24:41] works [00:24:45] back to interwiki [00:26:42] works [00:26:49] ty jeremyb [08:28:57] PROBLEM Current Users is now: CRITICAL on nova-dev2 nova-dev2 output: CHECK_NRPE: Socket timeout after 10 seconds. [08:33:47] RECOVERY Current Users is now: OK on nova-dev2 nova-dev2 output: USERS OK - 0 users currently logged in [12:17:55] !log deployment-prep restarted apache to fix some problem with config [12:17:55] Logged the message, Master [12:45:50] yay [12:45:55] jeremyb: check out new scripts [14:04:50] !log deployment-prep created temporary memcached instance for data [14:04:51] Logged the message, Master [14:13:54] PROBLEM Current Load is now: CRITICAL on deployment-nfs-memc deployment-nfs-memc output: Connection refused by host [14:14:39] PROBLEM Current Users is now: CRITICAL on deployment-nfs-memc deployment-nfs-memc output: Connection refused or timed out [14:18:54] PROBLEM host: deployment-nfs-memc is DOWN address: deployment-nfs-memc CRITICAL - Host Unreachable (deployment-nfs-memc) [14:49:02] PROBLEM host: deployment-nfs-memc is DOWN address: deployment-nfs-memc CRITICAL - Host Unreachable (deployment-nfs-memc) [15:09:02] RECOVERY host: deployment-nfs-memc is UP address: deployment-nfs-memc PING OK - Packet loss = 0%, RTA = 0.84 ms [15:13:22] PROBLEM dpkg-check is now: CRITICAL on deployment-nfs-memc deployment-nfs-memc output: CHECK_NRPE: Socket timeout after 10 seconds. [15:13:32] PROBLEM Disk Space is now: CRITICAL on deployment-nfs-memc deployment-nfs-memc output: CHECK_NRPE: Socket timeout after 10 seconds. [15:13:42] PROBLEM Total Processes is now: CRITICAL on deployment-nfs-memc deployment-nfs-memc output: CHECK_NRPE: Socket timeout after 10 seconds. [15:14:02] PROBLEM Free ram is now: CRITICAL on deployment-nfs-memc deployment-nfs-memc output: CHECK_NRPE: Socket timeout after 10 seconds. [15:18:52] PROBLEM host: deployment-nfs-memc is DOWN address: deployment-nfs-memc CRITICAL - Host Unreachable (deployment-nfs-memc) [15:23:53] RECOVERY host: deployment-nfs-memc is UP address: deployment-nfs-memc PING OK - Packet loss = 0%, RTA = 1.67 ms [16:07:53] RECOVERY Current Load is now: OK on deployment-nfs-memc deployment-nfs-memc output: OK - load average: 1.20, 1.10, 0.74 [16:08:13] RECOVERY dpkg-check is now: OK on deployment-nfs-memc deployment-nfs-memc output: All packages OK [16:08:23] RECOVERY Disk Space is now: OK on deployment-nfs-memc deployment-nfs-memc output: DISK OK [16:08:33] RECOVERY Total Processes is now: OK on deployment-nfs-memc deployment-nfs-memc output: PROCS OK: 95 processes [16:08:53] RECOVERY Current Users is now: OK on deployment-nfs-memc deployment-nfs-memc output: USERS OK - 1 users currently logged in [16:08:53] RECOVERY Free ram is now: OK on deployment-nfs-memc deployment-nfs-memc output: OK: 84% free memory [16:28:03] * Damianz gives labs-morebots a muffin [16:45:14] !log deployment-prep moved memcached to deployment-nfs-memc and update global [16:45:15] Logged the message, Master [18:47:12] ok [18:47:26] relative paths can't be used for command line [18:47:35] because you would need to start maint scripts from the given path [18:47:43] hexmode: ^ [18:47:45] :o [18:47:46] !log deployment-prep set up relative paths for config files [18:47:47] Logged the message, Master [18:47:51] I will fix that [18:48:02] petan: ok, so which full path? [18:48:10] yes [18:48:12] full path [18:49:29] petan: yeah, I just meant "which one" since /var and /mnt work [18:49:47] I don't think it matters, I started /mnt [18:50:04] k [18:56:29] done [18:59:14] hexmode: I don't know if this is a good solution we now have to also update all paths in LocalSettings [18:59:26] because it's now in another folder [18:59:46] no... why would you have to do that? [19:00:02] it's looking for "local.php" [19:00:12] but there is no local.php in /mnt/www/global/LocalSettings/ [19:00:28] but it shouldn't be looking in /mnt/www/global [19:00:29] it would either have to be relative path from /mnt/www/global/LocalSettings/ or absolute path [19:00:34] where is it doing that? [19:00:37] it does because it's cli [19:00:46] all maintenance scripts fail [19:00:46] I ran update.php and it worked, though [19:00:52] it didn't to me [19:00:58] where did you start it from [19:01:04] what command are you using? [19:01:23] petrb@deployment-dbdump:/mnt/www$ global/maintenance/updatesites [19:01:37] PHP Warning: include(local.php): failed to open stream: No such file or directory in /mnt/www/global/LocalSettings/auth.php [19:01:43] let me try that to see what you see [19:01:56] just start the same cmd [19:02:29] cli is following symlinks so it's making relative path from target path of symlink [19:02:40] it shouldn't be... 1s [19:03:53] does it work to you? [19:04:38] k, something is wrong here... it works when I run update.php in the directory [19:04:59] try to run update.php from a different [19:05:43] I think it makes a lot of sense... [19:06:02] you start update.php and it open LocalSettings.php and start looking for config.php from current path [19:06:17] if there was absolute path it would work [19:07:09] try now [19:07:27] what did you change? [19:07:47] script changes dir before running maint [19:07:53] hm... [19:07:56] worked like a charm ;) [19:08:06] it probably will work, but it's a bit... unstable [19:08:07] :D [19:08:16] I suggest to remove local symlink [19:08:21] and put absolute path to LS [19:08:35] I think it's same complicated [19:08:51] either having a symlink with absolute path or absolute path in include is same [19:08:56] relative symlink shouldn't have caused it [19:09:07] but relative symlink didn't work at all [19:09:09] for cli [19:09:19] try it, change one wiki to relative [19:09:23] you will see [19:09:32] :| [19:09:36] it does now... 1s I have an idea [19:10:33] enwiki still has relative symlinks [19:10:49] and this solution seems to be working [19:15:00] http://deployment.wmflabs.org/en_wiktionary/wiki/Main_Page [19:15:04] why there is no skin? [19:17:13] hrm... [19:17:19] wth [19:19:37] all newly installed wiki's don't have skin [19:20:04] wonder if it is related to some jquery stuff that stopped working [19:20:25] it's really weird because I didn't change anything related to this [19:21:03] http://deployment.wmflabs.org/auth/wiki/Problem_reports -- bug was being updated via jsonp yesterday [19:21:28] petan: you're still using the same createsite script, right? [19:21:33] yes [19:21:44] but I created some other sites using that today [19:21:51] k [19:22:04] just going to look at that to see how you are creating them [19:23:19] OH [19:23:19] yes [19:25:34] yeah... I'm beginning to wonder about the latest revs in svn [19:25:52] I forgot to update global [19:29:23] how do you initialize the db? [19:29:41] installer [19:29:46] I do it manually for now [19:29:55] you know we have a cli installer now? [19:30:00] I don't know [19:30:02] * hexmode adds it [19:30:07] ah [19:30:18] had to let you know ... I did a lot of the work ;) [19:30:54] heh [19:30:57] not sure how much it is going to help us here, but maybe a little [19:31:33] but what in the worls is causing this [19:32:58] not sure, but I'm looking [19:33:06] let me know if you see something [19:33:14] !log deployment-prep clearing cache [19:33:15] Logged the message, Master [19:33:25] was going to test setting up a wiki and see if that did it. [19:34:07] I think it's a problem with global I did [19:34:18] I forgot to update some settings and it remained cached somehow [19:43:28] k, my testwiki doesn't have a /wiki [19:43:37] that's weird... [19:43:43] how do I get /wiki and /w ? [19:43:49] ./* No modules requested. Max made me put this here */ [19:43:54] that;s what I get from resource loader [19:44:02] same command doesn't work on that wiki [19:44:06] but on other wiki it does [19:44:21] hexmode: /etc/apache/htt* [19:44:21] URL? [19:44:23] see it [19:44:26] http://deployment.wmflabs.org/auth/w/load.php?debug=true&lang=en&modules=sit&only=styles&skin=vector&* [19:44:26] k [19:44:44] just thought you might have that set up :) [19:45:25] oh yes [19:45:27] it works... [19:45:30] that's really weird [19:46:30] k, now I see how you're setting them up [19:47:47] nvm [19:47:54] I found it [19:48:25] https://en.wikipedia.org/w/load.php?debug=true&lang=en&modules=sit&skin=vector&* [19:49:32] http://deployment.wmflabs.org/auth/w/load.php?debug=true&lang=en&modules=sit&skin=vector&* [19:49:34] same [19:50:27] is it b/c you have the aliases set up wrong? [19:50:49] I fixed it [19:50:49] yeah, they're fixed now [19:50:51] k [19:51:00] weird [19:51:28] nah scriptpath was set in localsettings [19:51:40] and the new ones didn't have /wiki [19:51:53] ? [19:51:57] that was a manual part of the setup, right? [19:52:03] setting up the aliases [19:52:05] I don't know, probably yes [19:52:06] yes [19:54:04] there is some problem with load.php [19:54:09] it doesn't work [19:55:13] that's weird [19:55:20] http://deployment.wmflabs.org/de_wikipedia/w/load.php?debug=false&lang=en&modules=mediawiki.legacy.commonPrint%2Cshared|skins.vector&only=styles&skin=vector&* [19:55:28] this is displaying the index.php [19:55:30] o.O [19:55:33] hexmode [19:56:01] nowit works [20:05:12] 01/08/2012 - 20:05:11 - Creating a home directory for johnduhart at /export/home/deployment-prep/johnduhart [20:06:12] 01/08/2012 - 20:06:12 - Updating keys for johnduhart [20:39:10] hm [20:39:26] hm [20:39:26] !log deployment-prep created new group for /mnt/www [20:39:27] Logged the message, Master [20:41:08] petan: Group name [20:41:13] ? [20:41:19] depops [20:41:22] ops is taken [20:41:32] by real ops [20:41:47] ah [20:42:09] Do I just use usermod on the server or is this special LDAP magic? [20:42:34] hm... probably yes [20:42:59] That wasn't really a yes or no question ;) [20:44:52] I added you [20:45:11] Just for reference, how? [20:45:26] by hand [20:45:29] ./etc/group [20:45:30] :P [20:45:36] that's only working way afaik [20:45:38] ah [20:47:23] Still dont' have permissions [20:47:25] permissions set [20:48:21] that's weird [20:48:46] Do permissions not carry over NFS? [20:49:09] that's also fixed but it doesn't seem to work on you [20:49:24] all people are in that group excepting you try to log off and back [20:49:29] I couldn't put you even to git [20:49:37] that's weird [20:50:20] were you trying any other commands before? [20:50:46] Like? [20:51:07] johnduhart@deployment-web:/var/www$ ls -l [20:51:07] ls: cannot open directory .: Permission denied [20:51:17] see, dunno who did it [20:51:18] have you relogged in? [20:51:21] fixed [20:51:25] Platonides: yes [20:51:58] Still can't write though [20:52:02] johnduhart: no idea, let's set it a+w [20:52:06] and ask Ryan [20:52:10] hold on [20:52:16] it's a cosmetic issue and it doesn't matter at all [20:52:30] because no one else than people who are supposed to write there will have shell access [20:53:01] Fine, just a+w it for now [20:53:20] done [20:53:36] let's concentrate on something what really matters [20:53:49] you wanted to change the configs? [20:53:51] * johnduhart grumbles about permissions really mattering to him [20:53:54] Yeah [20:54:12] all people who will ever have access there will be either root or will not have accesss [20:55:07] So first we need a wildcard on *.deployment.wmflabs.org [20:55:43] Ryan is offline now [20:55:50] so I guess it will need to wait [20:56:14] * johnduhart checks for other ops [20:58:35] ok [20:58:41] None at the moment [20:58:48] actually it would be cool [20:58:53] to have that [20:59:03] I gave you some global flags on SUL [20:59:30] ooof, looks like I need to go somewhere. I'll be back soon, if you see ryan ask him [20:59:33] and thanks [21:04:46] Reedy: what is svn path [21:04:54] to 1.19 ex [21:04:54] ...? [21:05:11] /truk/extensions [21:05:18] /trunk/extensions [21:05:20] so head? [21:05:23] Yup [21:05:25] not branched yet [21:05:32] right... [21:19:57] hexmode: done [21:19:58] it's 1.19 [21:20:33] :) [21:21:13] do you know api to get MW space pages? [21:21:14] all [21:21:24] it would really speed imports up [21:22:13] petan: did you look at api.php? [21:22:22] sure but... I am lazy :d [21:22:27] I hoped someone know it [21:22:38] could ask in #mediawiki [21:22:41] ;) [21:22:51] heh [21:25:14] hexmode: I will need to go, try to explain to john that we wanted to have the site working tommorow so maybe it's not best to perform some hard core changes today [21:25:43] actually I like his ideas, but I don't believe we can set it up today [21:26:11] if we start moving domain... :\ [21:33:04] OrenBochman: hi [21:33:11] check https://en.wikipedia.org/wiki/User_talk:Petrb#Two_ideas_for_developers [21:33:21] there is an idea to improve search [21:35:32] petan: johnduhart I think has a good idea but I'll let him know what we're aiming for [21:35:44] yes it's good idea [21:35:46] I like it [21:35:57] but problem is we don't have a time to set it up today :) [21:36:05] Ryan is not here [21:36:06] it's sunday [21:36:18] I doubt he want to mess up with labs config today [21:36:25] sure [21:36:59] johnduhart: are you getting this? we want to make let people know they can test tomorrow [21:37:08] s/make// [21:37:11] I think tommorow is a good day to perform some first bigger tests on simple clone and english clone, then we could place a central notice that we want to perform maintenace on, lets say tuesday and do it that day [21:37:15] there is central notice :) [21:37:17] on all wikis [21:37:34] oh [21:37:42] I need to point to the test plans [21:37:46] ok [21:37:55] in case anyone wants to try them [21:37:55] I don't know what tests plan is [21:38:03] or improve them [21:38:18] https://www.mediawiki.org/wiki/Category:MediaWiki_test_plans [21:38:19] hm... [21:38:41] there are no plans for this [21:38:42] version [21:38:52] going to put that on the problem reports page and the fp [21:38:52] 1.19 [21:38:56] ok [21:39:07] no... could use the 1.18 ones [21:39:09] aha [21:39:20] https://www.mediawiki.org/wiki/User:Sumanah/1.18_test_cases [21:40:05] ? [21:40:23] * johnduhart is back from driving [21:41:22] :o [21:41:24] johnduhart: bottom line is: we want to have deployment working tomorrow [21:41:29] that is all [21:41:42] so don't screw it up ;) [21:41:49] johnduhart: if you believe you can move domain today go ahead :) [21:41:54] petan: Can you just spin me up a new web instance so I can work on the new configuration the next few days? It'll be outside of NFS and it won't affect the current webs [21:41:57] I support it [21:42:00] only do things that make it better [21:42:07] sure [21:42:18] * jeremyb is kinda here a little [21:42:48] Thanks, that way I can be more radical in configration changes [21:42:55] johnduhart: it won't be accessible from outside [21:43:09] Radical as in not worrying about breaking the current setup [21:43:16] petan: Sure [21:43:18] feel free to use db... but I suggest not to use simple wiki [21:43:27] I'll stay away from that [21:43:30] ok [21:43:39] but you should definitely use that central sql server [21:43:46] otherwise Ryan will get angry [21:43:46] petan:ypu [21:43:47] :D [21:43:48] yup * [21:44:07] Do you think we should use shorter subdomains instead of the full name? eh. en.wp. isntead of en.wikipedia? [21:44:15] no [21:44:17] full [21:44:20] Sure [21:44:23] maybe make a redirect from short [21:44:38] Until Ryan gets us DNS I'll just play with my hosts file [21:44:40] jeremyb: is there anything you can do that would help? [21:44:48] maybe stand in for ryan? [21:45:04] jeremyb: create my api :D [21:45:13] petan: Deployment-test? [21:45:15] jeremyb: I need to make a list of all MW pages on de wiki [21:45:17] johnduhart: yes [21:45:28] yay [21:46:32] * jeremyb reads [21:47:25] hexmode: how so? [21:47:33] jeremyb: make a list :D [21:47:42] that is very helpfull heh [21:47:55] I need to import mw space of de and en wikinews and wikitionary [21:48:06] so I need to make a list of all pages there [21:48:34] also if you could make all wikis more cute [21:48:35] :) [21:48:43] * Damianz applys kittens [21:48:46] like create some better main page [21:48:47] :D [21:48:51] jeremyb: we're setting up deployment.wmflabs.org for some (hopefully) widespread testing tomorrow [21:48:53] Damianz: that's good idea [21:48:53] * johnduhart waits for deployment-test to respond [21:49:04] johnduhart: labs are really broken today [21:49:09] hexmode: i got that much. what does stand in for ryan mean? [21:49:12] I needed to poke apergos to fix brewster [21:49:19] he didn't even know that's a puppet repo [21:49:32] Poke ryan with a stick! [21:49:33] apergos has root everywhere but doesn't know what is running there :D [21:49:43] jeremyb: petan was saying ryan wasn't around and I thought maybe you could help... I don't know what petan needs, though [21:49:44]