[00:22:29] Aw, custom CSS is turned off on labsconsole [00:48:55] oh? [00:49:02] lemme turn that on [00:49:04] Cookies [00:50:19] johnduhart: I just turned it on [00:50:22] same with custom jhs [00:50:23] *js [00:51:12] ah, much better [00:51:13] https://labsconsole.wikimedia.org/wiki/User:Johnduhart/vector.css [00:51:40] hahaha [00:51:52] you turned off powered-by-SMW? [00:51:57] yes :) [00:52:02] sad ;) [00:53:40] but it's doing AWESOME things [00:53:45] I swear the CentOS repo is smaller now, only like 300gb =/ [00:53:55] I made a dsh that pulls instance lists from SMW, even [00:54:10] and actually used it, for real-like the other day [00:54:10] * johnduhart sticks fingers in ears [00:54:11] Ryan_Lane: LALALA CAN'T HEAR YOU [00:54:13] it was incredibly useful [00:54:30] But yeah it's useful sometimes [00:54:44] in fact, I may make some scripts that let people force-run puppet on all instances in their project using that [00:54:51] Its code base is scary though [00:54:55] yes [00:54:56] yes it is [00:55:07] So is Ryan_Lane's os extension :P [00:55:19] my extension's code isn't *that* scary [00:55:29] it needs to be cleaned up, for sure [00:55:41] but it's all classed, and the classes represent discrete things [00:55:57] lol [00:55:59] I mostly use the objects, rather than using static functions as a crutch [00:56:03] and I hardly use globals at all [00:56:08] Damianz: His code acutally makes an attempt at following MW standards [00:56:18] MW standards are insane. [00:56:23] that's true [00:56:25] but I can't help that [00:56:31] I wish HTML form was a little better [00:56:46] Ryan_Lane: Hi, I take care of HTMLForm [00:56:47] I'd *really* love a paged-table form [00:56:53] Hm [00:56:58] it lacks documentation [00:57:06] True [00:57:07] which makes it hard to use [00:57:20] don't get me wrong, I love HTMLForm [00:57:48] so, take for instance the list views in OSM [00:58:20] I'd love to turn that into a form [00:58:43] where a set of actions can be standardized, and the creation of the table is handled for me [00:59:12] but a non-shitty version of what I have [00:59:27] that's the part of my code I hate the most [00:59:45] well, the DNS code sucks too, but that's moving to openstack nova :) [01:00:36] ok. I'm off to the hackathon [01:00:38] * Ryan_Lane waves [01:00:58] Have fun! [01:01:02] * Damianz goes back to reading about openstack and figuring out how to not tie vlans to projects and using iscsi + gluster for storage [01:28:02] Who do I have to ask to request en.wikisource on beta.wmflabs ? [01:28:25] johnduhart: petan [01:29:11] Krinkle: petan [01:29:13] they have a fairly unique javascript collection on their wikis, I think we should really test that properly on 1.19 [01:29:49] pretty guaranteed to have at least a few things that need migration. [02:07:06] PROBLEM Total Processes is now: CRITICAL on bots-2 bots-2 output: CHECK_NRPE: Socket timeout after 10 seconds. [02:07:13] diederik: http://wikitech.wikimedia.org/view/Media_server/Distributed_File_Storage_choices [02:07:26] PROBLEM Current Users is now: CRITICAL on bots-2 bots-2 output: CHECK_NRPE: Socket timeout after 10 seconds. [02:07:36] PROBLEM Current Load is now: CRITICAL on bots-2 bots-2 output: CHECK_NRPE: Socket timeout after 10 seconds. [02:09:06] PROBLEM Disk Space is now: CRITICAL on bots-2 bots-2 output: CHECK_NRPE: Socket timeout after 10 seconds. [02:09:26] PROBLEM dpkg-check is now: CRITICAL on bots-2 bots-2 output: CHECK_NRPE: Socket timeout after 10 seconds. [02:09:26] PROBLEM SSH is now: CRITICAL on bots-2 bots-2 output: CRITICAL - Socket timeout after 10 seconds [02:13:56] RECOVERY Disk Space is now: OK on bots-2 bots-2 output: DISK OK [02:14:16] RECOVERY SSH is now: OK on bots-2 bots-2 output: SSH OK - OpenSSH_5.3p1 Debian-3ubuntu7 (protocol 2.0) [02:14:16] RECOVERY dpkg-check is now: OK on bots-2 bots-2 output: All packages OK [02:16:56] RECOVERY Total Processes is now: OK on bots-2 bots-2 output: PROCS OK: 110 processes [02:17:16] RECOVERY Current Users is now: OK on bots-2 bots-2 output: USERS OK - 0 users currently logged in [02:17:26] RECOVERY Current Load is now: OK on bots-2 bots-2 output: OK - load average: 1.41, 2.81, 2.81 [02:17:53] check [02:18:02] ping [02:18:33] http://mirror.fem-net.de/CCC/28C3/mp4-h264-HQ/28c3-4800-en-how_governments_have_tried_to_block_tor_h264.mp4 [02:18:36] cool [03:08:11] PROBLEM Disk Space is now: CRITICAL on bots-2 bots-2 output: CHECK_NRPE: Socket timeout after 10 seconds. [03:08:26] PROBLEM dpkg-check is now: CRITICAL on bots-2 bots-2 output: CHECK_NRPE: Socket timeout after 10 seconds. [03:08:26] PROBLEM SSH is now: CRITICAL on bots-2 bots-2 output: CRITICAL - Socket timeout after 10 seconds [04:27:46] !log testwiki test log [04:27:46] testwiki is not a valid project. [04:27:54] !log testlabs test log [04:27:55] Logged the message, Master [05:13:36] PROBLEM Free ram is now: WARNING on bots-2 bots-2 output: Warning: 12% free memory [05:18:36] RECOVERY Free ram is now: OK on bots-2 bots-2 output: OK: 24% free memory [13:53:13] Change on 12mediawiki a page Wikimedia Labs/Toolserver features wanted was modified, changed by Krinkle link https://www.mediawiki.org/w/index.php?diff=488428 edit summary: not sure which are redundant or done already, listing here anyway. [13:53:35] Change on 12mediawiki a page Wikimedia Labs/Toolserver features wanted was modified, changed by Krinkle link https://www.mediawiki.org/w/index.php?diff=488429 edit summary: whatever it's called [13:57:16] petan: johnduhart hexmode When I'm logged out on http on http://labs.wikimedia.beta.wmflabs.org/wiki/Headings_with_images I see a Create tab [13:57:18] and text "There is currently no text in this page. You can search for this page title in other pages, search the related logs, or edit this page." [13:57:29] but when pressing "Create", I see the page exists and has wikitext [13:57:31] bug ? [13:57:58] at all: do not purge or save the page in the mean time [13:58:28] wgArticleId:0 [13:59:41] ok [14:00:01] btw I created wkik you needed [14:00:58] petan: Do you create the different beta wikis on labs? [14:01:08] yes [14:01:21] you want some? [14:01:30] if possible, are you able to provide the all.dblist? [14:01:36] sure [14:01:42] like, make it publically available so that we can see the log for new wikis created [14:02:18] like recently I saw the number change from 455 wikis to 456, so I am interested in what wiki has been created [14:02:22] Thanks for creating en-Wikisource on beta.wmflabs! [14:02:51] :D [14:02:58] http://config.beta.wmflabs.org/all.dblist [14:03:05] ok lol [14:03:10] thanks petan and Krinkle :) [14:03:25] yw [14:03:31] Krinkle: didn't import stuff there [14:03:37] Krinkle: you have steward or not? [14:03:52] petan: minor thing: enWikisource seems to a feature a wikibooks favicon [14:04:08] petan: On labs, yes. [14:04:19] ok [14:04:21] want me to SpecialExport/Import ? [14:04:27] that's up to you [14:04:37] I will create a queue where people could request import of pages [14:04:51] Would be nice if NS_MEDIAWIKI could be imported from live [14:04:53] if you want to import MW space on any wiki list it on global request and I will try to do that [14:05:01] that's what I do [14:05:07] cool [14:05:12] some wikis already have it [14:05:32] if I had access to prod I could make it for all in hours [14:05:36] * hour [14:05:42] but now I need to use Special:Export [14:05:46] that's slow [14:11:45] please update http://labs.wikimedia.beta.wmflabs.org/wiki/Global_Requests#Data [14:11:51] Hydriz: ^ [14:12:06] eh wut [14:12:18] that's a list of wikis you want to have mw space copied [14:12:25] nah [14:12:26] I will process them one by one [14:12:34] I am not really in development of wmf wikis [14:12:46] ok [14:13:01] although it is interesting to see only one person working on the entire virtualization cluster [14:13:21] no it was made by johnduhart [14:13:24] I did just a minor stuff [14:13:34] + mark [14:13:38] it wasn't just me [18:20:17] howdy ryan! [18:54:57] diederik: analytics/reportcard? [19:00:57] robla: http://en.wikisource.beta.wmflabs.org/wiki/Main_Page [19:03:50] thanks! [19:03:54] hexmode: you there? [19:05:47] * robla scans the landscape for someone who is currently active in the deployment-prep project on labs [19:08:55] yw [19:08:57] hm [19:09:00] petan: around? [19:09:07] might be a little early for him [19:12:11] early? isn't he in europe? [19:13:02] maybe he's a vampire [19:14:06] PROBLEM Disk Space is now: WARNING on nagios 127.0.0.1 output: DISK WARNING - free space: /home/petrb 3216 MB (18% inode=94%): [19:19:06] RECOVERY Disk Space is now: OK on nagios 127.0.0.1 output: DISK OK [19:19:31] ryan: let's do it? [19:19:43] already setting it up ;) [19:19:52] Reedy: early, late, whatever :) [19:27:02] gicode: https://labsconsole.wikimedia.org/wiki/Access [19:27:13] diederik: ok. it's set up [19:27:29] it's an empty repo, but it at least has an empty commit, so it can be cloned [19:33:37] thx! [19:34:06] PROBLEM Disk Space is now: WARNING on nagios 127.0.0.1 output: DISK WARNING - free space: /home/petrb 2512 MB (14% inode=94%): [19:36:45] yw [19:44:20] diederik: so, your repo requires change-ids, which means you'll need a setup script for your users [19:44:32] we have one in the puppet repo [19:44:53] but, you'll need to modify it some [19:45:10] we really need a better, more generic version of the script we are using [20:01:12] so, thanks to petan, we have a bot that will ask people questions for us :) [20:01:19] @search account- [20:01:19] No results found! :| [20:01:22] bah [20:01:29] !account-questions [20:01:29] I need the following info from you: 1. Your preferred wiki user name. This will also be your git username, so if you'd prefer this to be your real name, then provide your real name. 2. Your SVN account name, or your preferred shell account name, if you do not have SVN access. 3. Your preferred email address. [20:01:41] !account-questions | PugMajere [20:01:41] PugMajere: I need the following info from you: 1. Your preferred wiki user name. This will also be your git username, so if you'd prefer this to be your real name, then provide your real name. 2. Your SVN account name, or your preferred shell account name, if you do not have SVN access. 3. Your preferred email address. [20:01:54] nice :) [20:02:12] it saves a lot on typing :) [20:02:18] I can see that. [20:03:08] LeslieCarr: labs account creation is either a one step or two step process, depending on if the user already has an SVN account [20:03:18] !search add- [20:03:19] he does not [20:03:23] @search add [20:03:24] Results (found 2): account-questions, new-labsuser, [20:03:31] !new-labsuer [20:03:37] !new-labsuser [20:03:37] add-labs-user --wikiname="" --mail="" [20:03:37] I'll go with tradition, and uniqueness: pugmajere pugmajere ryan@michonline.com [20:03:43] that's the second step ;) [20:03:50] !new-svnuser [20:04:14] pugmajere is already taken [20:04:20] cool, so where is the adds-lab-user run ? [20:04:23] ah [20:04:30] on formey [20:04:31] as root [20:04:32] but... [20:04:41] you need to make an ldap account first [20:04:46] !new-ldapuser [20:04:49] bah [20:05:17] !new-ldapuser is add-ldap-user [options] [20:05:17] Key was added! [20:05:29] !new-ldapuser [20:05:29] add-ldap-user [options] [20:05:29] so, the key in this case should be empty [20:05:53] a blank file for this works. [20:05:55] a blank file for this works. [20:06:20] doh accidentally closed this window ;) [20:06:20] so, add-ldap-user pugmajere /root/test [20:06:34] /root/test is a file I touched, and is empty [20:07:15] then, add-labs-user —wikiname="Pugmajere" —mail="ryan@michonline.com" pugmajere [20:07:24] which links his labs account with his svn account [20:07:48] we'll have a new, easier, way of doing this in the future, but this is it for now [20:08:06] cool [20:08:12] so i think it worked? :) [20:08:22] after you create the account, you need to tell them how to do an initial login [20:08:29] !initial-login | PugMajere [20:08:29] PugMajere: https://labsconsole.wikimedia.org/wiki/Access#Initial_log_in [20:08:35] that's it [20:08:45] LeslieCarr: if the script doesn't error out, it worked [20:09:19] wait, pugmajere is someone else [20:09:29] Lance Hedstrom [20:10:23] i started laughing and he figured it out… damn my laughter! [20:10:26] :D [20:10:56] * PugMajere glares at LeslieCarr  [20:11:11] they see me trollin, they be hatin [20:12:36] PROBLEM Free ram is now: WARNING on bots-2 bots-2 output: Warning: 19% free memory [20:14:46] hrm, monday i should see if petan can extend the bot to include warnings for trolling :) [20:15:11] so, every time domas types something? [20:15:27] oh snap [20:19:10] 01/21/2012 - 20:19:10 - Creating a home directory for gicode at /export/home/bastion/gicode [20:20:11] 01/21/2012 - 20:20:11 - Updating keys for gicode [20:21:14] 01/21/2012 - 20:21:14 - Creating a home directory for robla at /export/home/deployment-prep/robla [20:21:44] Can we get it to do http://www.youtube.com/watch?v=trC1Ig_ouTc to domas? [20:22:04] robla: sup? [20:22:17] 01/21/2012 - 20:22:17 - Updating keys for robla [20:23:56] PROBLEM Disk Space is now: WARNING on labs-nfs1 labs-nfs1 output: DISK WARNING - free space: /export 751 MB (4% inode=94%): /home/SAVE 751 MB (4% inode=94%): [20:24:25] gicode: when you do any sysadmin related actions on your instances, please log them [20:24:28] !logging [20:24:28] To log a message, use the following format: !log [20:24:52] also, you should add documentation for your project on its project page, when things are ready to be documented [20:24:56] as an example.... [20:25:01] !project bots [20:25:01] https://labsconsole.wikimedia.org/wiki/Nova_Resource:bots [20:25:27] the description shows up in the project list. [20:25:29] !projects [20:25:29] https://labsconsole.wikimedia.org/wiki/Special:Ask/-5B-5BResource-20Type::project-5D-5D/-3FMember [20:25:45] have I mentioned I truly <3 this bot? [20:25:53] bah. that search is wrong [20:26:05] !projects del [20:26:06] Successfully removed projects [20:26:08] !projects is https://labsconsole.wikimedia.org/wiki/Special:Ask/-5B-5BResource-20Type::project-5D-5D/-3F/-3FMember/-3FDescription/mainlabel%3D-2D [20:26:08] Key was added! [20:26:14] that's better [20:26:19] hexmode: we have a hackathon project this weekend involving deployment-prep [20:26:44] robla: k, what should I do? [20:27:16] I just wanted to make sure you were fine with us futzing in there [20:27:23] being labs noobs and all [20:27:23] sure [20:27:34] oh. one warning [20:27:35] it's what its for ;) [20:27:51] when importing from wikisource, don't import *too* much :) [20:28:06] we're still low on storage until the glusterfs cluster comes in [20:28:11] Zaran is getting set up as someone to help maintain Proofread Page, and one thing we want to do is get the extension up and running on one of the wikisource instances [20:28:18] Ryan_Lane: Thanks for the labs info :-) [20:28:29] awww ryan's first ferrit :) [20:28:32] Ryan_Lane: noted (and Zaran should probably note that as well) :) [20:28:47] gicode: you're welcome. just let me know if you have any questions regarding process [20:28:50] yeah :) [20:29:04] in general we try to follow op's procedures for everything [20:29:20] if you don't log and document, we'll badger you till you do ;) [20:30:02] logging is the more important of the two, I don't expect much documentation being written during the hackathon [20:30:07] hexmode: another question you might know the answer to: gicode is thinking about setting up a patch test sandbox on labs. do you know if something like that already exists? [20:32:12] robla: not really, but deployment would be close [20:32:22] gicode: how is it going? [20:33:56] PROBLEM Disk Space is now: CRITICAL on labs-nfs1 labs-nfs1 output: DISK CRITICAL - free space: /export 419 MB (2% inode=94%): /home/SAVE 419 MB (2% inode=94%): [20:49:08] hexmode: Hopping between a bunch of taks right now. ;-) [20:49:13] s/taks/tasks/ [20:53:16] diederik: http://svn.wikimedia.org/viewvc/mediawiki/trunk/debs/nginx/modules/nginx-udplog/ [20:57:16] 01/21/2012 - 20:57:16 - Creating a project directory for nginx [20:57:16] 01/21/2012 - 20:57:16 - Creating a home directory for diederik at /export/home/nginx/diederik [20:57:16] 01/21/2012 - 20:57:16 - Creating a home directory for laner at /export/home/nginx/laner [20:58:17] 01/21/2012 - 20:58:17 - Updating keys for diederik [20:58:17] 01/21/2012 - 20:58:17 - Updating keys for laner [21:04:47] anyone want to change out bots to read and write from a rabbitmq queue? :) [21:04:57] (ircbots, that is) [21:13:15] 01/21/2012 - 21:13:15 - Creating a project directory for patchtest [21:13:16] 01/21/2012 - 21:13:15 - Creating a home directory for robla at /export/home/patchtest/robla [21:13:55] PROBLEM Total Processes is now: CRITICAL on nginx-dev1 nginx-dev1 output: CHECK_NRPE: Error - Could not complete SSL handshake. [21:14:16] 01/21/2012 - 21:14:16 - Updating keys for robla [21:14:16] 01/21/2012 - 21:14:16 - Creating a home directory for laner at /export/home/patchtest/laner [21:14:35] PROBLEM dpkg-check is now: CRITICAL on nginx-dev1 nginx-dev1 output: CHECK_NRPE: Error - Could not complete SSL handshake. [21:15:16] 01/21/2012 - 21:15:16 - Updating keys for laner [21:15:35] PROBLEM Current Load is now: CRITICAL on nginx-dev1 nginx-dev1 output: CHECK_NRPE: Error - Could not complete SSL handshake. [21:16:05] PROBLEM Current Users is now: CRITICAL on nginx-dev1 nginx-dev1 output: CHECK_NRPE: Error - Could not complete SSL handshake. [21:16:45] PROBLEM Disk Space is now: CRITICAL on nginx-dev1 nginx-dev1 output: CHECK_NRPE: Error - Could not complete SSL handshake. [21:16:48] !log nginx installing dpkg-dev pbuilder [21:16:49] Logged the message, Master [21:16:58] !log nginx that was on nginx-dev1 [21:16:59] Logged the message, Master [21:17:25] PROBLEM Free ram is now: CRITICAL on nginx-dev1 nginx-dev1 output: CHECK_NRPE: Error - Could not complete SSL handshake. [21:17:48] labs-nagios-wm: bah. shut up, I'll restart nrpe in a sec [21:18:37] !log nginx installing source package for nginx under /mnt [21:18:37] Logged the message, Master [21:20:51] !log nginx added pbuilder distro for lucid on nginx-dev1 [21:20:52] Logged the message, Master [21:21:49] !log nginx installing debhelper on nginx-dev1 [21:21:50] Logged the message, Master [21:22:21] !project nginx [21:22:21] https://labsconsole.wikimedia.org/wiki/Nova_Resource:nginx [21:29:48] diederik: have you ever dealt with quilt? [21:30:07] !quilt is http://wiki.debian.org/UsingQuilt [21:30:07] Key was added! [21:30:48] when creating and modifying debian packages, you need to use quilt [21:30:59] it'll apply a bunch of patches in an order [21:31:32] and leaves the original source alone [21:51:16] http://svn.wikimedia.org/viewvc/mediawiki/trunk/debs/nginx/modules/nginx-udplog/ [21:57:15] 01/21/2012 - 21:57:15 - Creating a home directory for gicode at /export/home/patchtest/gicode [21:57:50] gicode: read the docs on instances and security groups [21:57:56] !instances | gicode [21:57:56] gicode: https://labsconsole.wikimedia.org/wiki/Instances [21:58:03] !security-groups [21:58:08] @search security [21:58:08] Results (found 1): security, [21:58:11] !security [21:58:11] https://labsconsole.wikimedia.org/wiki/Security_Groups [21:58:17] 01/21/2012 - 21:58:17 - Updating keys for gicode [21:58:25] !alias security-groups security [21:58:45] hm. how the hell does alias work? [21:58:54] !alias security security-groups [21:59:01] -_- [21:59:15] !alias security is security-groups [21:59:21] fuck it [22:00:04] !security alias security-groups [22:00:04] Successfully created [22:00:09] !security-groups [22:00:13] hah [22:00:15] !security [22:00:16] https://labsconsole.wikimedia.org/wiki/Security_Groups [22:00:23] !security-groups alias security [22:00:23] Successfully created [22:00:29] !security-groups [22:00:29] https://labsconsole.wikimedia.org/wiki/Security_Groups [22:00:32] \o/ [22:01:10] so, the important thing to note about instances and security groups, is that you can't change security groups for an instance, once it is created [22:01:17] but you can change rules in a security group at any time [22:01:27] this is a limitation with openstack [22:07:35] RECOVERY Free ram is now: OK on bots-2 bots-2 output: OK: 20% free memory [22:12:15] 01/21/2012 - 22:12:15 - Updating keys for robla [22:12:17] 01/21/2012 - 22:12:17 - Updating keys for robla [22:15:35] PROBLEM Free ram is now: WARNING on bots-2 bots-2 output: Warning: 19% free memory [22:17:11] 01/21/2012 - 22:17:11 - Creating a home directory for robla at /export/home/bastion/robla [22:18:11] 01/21/2012 - 22:18:11 - Updating keys for robla [22:20:34] RECOVERY Free ram is now: OK on bots-2 bots-2 output: OK: 21% free memory [22:27:24] PROBLEM host: patchtest is DOWN address: patchtest PING CRITICAL - Packet loss = 100% [22:34:47] New patchset: Lcarr; "trying to create a firewall auto exporter (v1!!)" [operations/puppet] (test) - https://gerrit.wikimedia.org/r/2001 [22:35:10] New review: gerrit2; "Lint check passed." [operations/puppet] (test); V: 1 - https://gerrit.wikimedia.org/r/2001 [22:35:36] New review: Lcarr; "(no comment)" [operations/puppet] (test); V: 0 C: 2; - https://gerrit.wikimedia.org/r/2001 [22:35:36] Change merged: Lcarr; [operations/puppet] (test) - https://gerrit.wikimedia.org/r/2001 [22:43:53] PROBLEM Current Load is now: CRITICAL on client1-lcarr client1-lcarr output: CHECK_NRPE: Error - Could not complete SSL handshake. [22:43:53] PROBLEM Current Load is now: CRITICAL on client2-lcarr client2-lcarr output: Connection refused by host [22:43:53] PROBLEM dpkg-check is now: CRITICAL on fwserver1 fwserver1 output: Connection refused by host [22:44:43] PROBLEM Current Users is now: CRITICAL on client1-lcarr client1-lcarr output: CHECK_NRPE: Error - Could not complete SSL handshake. [22:44:53] PROBLEM Current Load is now: CRITICAL on fwserver1 fwserver1 output: CHECK_NRPE: Error - Could not complete SSL handshake. [22:45:03] PROBLEM Current Users is now: CRITICAL on client2-lcarr client2-lcarr output: CHECK_NRPE: Error - Could not complete SSL handshake. [22:45:23] PROBLEM Disk Space is now: CRITICAL on client1-lcarr client1-lcarr output: CHECK_NRPE: Error - Could not complete SSL handshake. [22:45:23] PROBLEM Disk Space is now: CRITICAL on client2-lcarr client2-lcarr output: CHECK_NRPE: Error - Could not complete SSL handshake. [22:45:23] PROBLEM Current Users is now: CRITICAL on fwserver1 fwserver1 output: CHECK_NRPE: Error - Could not complete SSL handshake. [22:46:03] PROBLEM Free ram is now: CRITICAL on client1-lcarr client1-lcarr output: CHECK_NRPE: Error - Could not complete SSL handshake. [22:46:03] PROBLEM Free ram is now: CRITICAL on client2-lcarr client2-lcarr output: CHECK_NRPE: Error - Could not complete SSL handshake. [22:46:43] PROBLEM Disk Space is now: CRITICAL on fwserver1 fwserver1 output: CHECK_NRPE: Error - Could not complete SSL handshake. [22:47:03] PROBLEM Free ram is now: CRITICAL on fwserver1 fwserver1 output: CHECK_NRPE: Error - Could not complete SSL handshake. [22:47:33] PROBLEM Total Processes is now: CRITICAL on client2-lcarr client2-lcarr output: CHECK_NRPE: Error - Could not complete SSL handshake. [22:47:38] PROBLEM Total Processes is now: CRITICAL on client1-lcarr client1-lcarr output: CHECK_NRPE: Error - Could not complete SSL handshake. [22:48:13] PROBLEM dpkg-check is now: CRITICAL on client1-lcarr client1-lcarr output: CHECK_NRPE: Error - Could not complete SSL handshake. [22:48:13] PROBLEM dpkg-check is now: CRITICAL on client2-lcarr client2-lcarr output: CHECK_NRPE: Error - Could not complete SSL handshake. [22:48:13] PROBLEM Total Processes is now: CRITICAL on fwserver1 fwserver1 output: CHECK_NRPE: Error - Could not complete SSL handshake. [22:57:43] PROBLEM host: patchtest is DOWN address: patchtest PING CRITICAL - Packet loss = 100% [23:08:09] bah [23:08:19] stupid command-q being next to command-w [23:08:21] !log patchtest Completed upgrade and dist-upgrade [23:08:23] Logged the message, Master [23:08:27] !account-questions | mdale [23:08:27] mdale: I need the following info from you: 1. Your preferred wiki user name. This will also be your git username, so if you'd prefer this to be your real name, then provide your real name. 2. Your SVN account name, or your preferred shell account name, if you do not have SVN access. 3. Your preferred email address. [23:10:05] !labs [23:10:05] https://labsconsole.wikimedia.org/wiki/$1 [23:10:09] bah [23:10:30] !labs-project is http://www.mediawiki.org/wiki/Wikimedia_Labs [23:10:30] Key was added! [23:10:49] !openstack-manager is http://www.mediawiki.org/wiki/Extension:OpenStackManager [23:10:49] Key was added! [23:11:28] !wikitech is http://wikitech.wikimedia.org/view/$1 [23:11:28] Key exist! [23:11:28] wm-bot: -_- [23:11:33] !wikitech [23:11:33] https://wikitech.wikimedia.org/view/$1 [23:11:35] heh [23:11:42] https? [23:11:46] !wikitech del [23:11:46] Successfully removed wikitech [23:11:50] !wikitech is http://wikitech.wikimedia.org/view/$1 [23:11:50] Key was added! [23:12:28] paulmaki: howdy [23:12:33] RECOVERY Total Processes is now: OK on client1-lcarr client1-lcarr output: PROCS OK: 77 processes [23:12:39] so, what kind of project documentation were you looking for? [23:12:50] !labs-project | paulmaki [23:12:50] paulmaki: http://www.mediawiki.org/wiki/Wikimedia_Labs [23:13:03] !wikitech OpenStack | paulmaki [23:13:03] paulmaki: http://wikitech.wikimedia.org/view/OpenStack [23:13:09] !openstack-manager | paulmaki [23:13:09] paulmaki: http://www.mediawiki.org/wiki/Extension:OpenStackManager [23:13:13] RECOVERY dpkg-check is now: OK on client1-lcarr client1-lcarr output: All packages OK [23:13:18] !log patchtest Installed acpid build-essential imagemagick libapache2-mod-php5 memcached mlocate mysql-client mysql-server php5 php5-cli php5-intl php5-memcache php5-mysql php5-sqlite php5-sqlite php-apc php-pear [23:13:19] Logged the message, Master [23:13:43] !labs Main_Page | paulmaki [23:13:43] paulmaki: https://labsconsole.wikimedia.org/wiki/Main_Page [23:13:53] RECOVERY Current Load is now: OK on client1-lcarr client1-lcarr output: OK - load average: 0.04, 0.02, 0.05 [23:14:33] RECOVERY Current Users is now: OK on client1-lcarr client1-lcarr output: USERS OK - 0 users currently logged in [23:15:23] RECOVERY Disk Space is now: OK on client1-lcarr client1-lcarr output: DISK OK [23:16:03] RECOVERY Free ram is now: OK on client1-lcarr client1-lcarr output: OK: 72% free memory [23:24:14] PROBLEM Free ram is now: WARNING on bots-2 bots-2 output: Warning: 19% free memory [23:24:18] yo. bots people... [23:24:24] PROBLEM Total Processes is now: CRITICAL on new new output: Connection refused by host [23:24:54] PROBLEM Current Load is now: WARNING on bots-cb bots-cb output: WARNING - load average: 11.17, 18.59, 9.28 [23:25:24] PROBLEM dpkg-check is now: CRITICAL on new new output: CHECK_NRPE: Error - Could not complete SSL handshake. [23:25:44] PROBLEM Current Load is now: CRITICAL on new new output: CHECK_NRPE: Error - Could not complete SSL handshake. [23:26:39] !account-questions | abemusic [23:26:39] abemusic: I need the following info from you: 1. Your preferred wiki user name. This will also be your git username, so if you'd prefer this to be your real name, then provide your real name. 2. Your SVN account name, or your preferred shell account name, if you do not have SVN access. 3. Your preferred email address. [23:27:04] PROBLEM Current Users is now: CRITICAL on new new output: CHECK_NRPE: Error - Could not complete SSL handshake. [23:27:34] PROBLEM Disk Space is now: CRITICAL on new new output: CHECK_NRPE: Error - Could not complete SSL handshake. [23:27:44] PROBLEM host: patchtest is DOWN address: patchtest CRITICAL - Plugin timed out after 10 seconds [23:27:54] PROBLEM Free ram is now: CRITICAL on new new output: CHECK_NRPE: Error - Could not complete SSL handshake. [23:28:01] !log patchtest Installed httpd config /etc/apache2/sites-available/mw [23:28:02] Logged the message, Master [23:29:04] RECOVERY Disk Space is now: OK on labs-nfs1 labs-nfs1 output: DISK OK [23:29:30] !log patchtest Switched config: a2dissite default && a2ensite mw && service apache2 reload [23:29:31] Logged the message, Master [23:31:46] Ryan_Lane: hey, i forget (once again) how to add classes to the nova interface in labs ? [23:32:02] LeslieCarr: it's changed [23:32:06] and is way easier ;) [23:32:19] yay [23:32:21] you can either add to the global groups, or add just for your project [23:32:58] okay, i just put these machines in testlabs, so global methinks :) [23:33:33] oh manage puppet groups [23:33:34] look at that [23:34:54] RECOVERY Current Load is now: OK on bots-cb bots-cb output: OK - load average: 0.22, 2.75, 4.98 [23:35:18] I recommend doing it in the per-project groups first [23:35:31] then, when you have it stable, move it to the global, if it's something other people would use [23:37:56] !log patchtest Added system account: adduser --system --home=/var/lib/mw mw [23:37:57] Logged the message, Master [23:38:27] Ryal_Lane: Hi, just asking about a testlab machine for extension testing [23:38:42] *Ryan_Lane: [23:38:47] !initial-login | abemusic [23:38:47] abemusic: https://labsconsole.wikimedia.org/wiki/Access#Initial_log_in [23:38:57] jeremyb: cool. we'll need to make you an account first [23:39:19] !log patchtest Pointed httpd config at new home directory [23:39:20] Logged the message, Master [23:39:20] * jeremyb has been copied? [23:39:39] ahh, you're all in SF [23:39:50] whoops [23:39:57] jesse__: cool. we'll need to make you an account [23:40:27] !initial-login | jesse__ [23:40:27] jesse__: https://labsconsole.wikimedia.org/wiki/Access#Initial_log_in [23:40:30] crap [23:40:33] I mean.... [23:40:40] !account-questions | jesse__ [23:40:40] jesse__: I need the following info from you: 1. Your preferred wiki user name. This will also be your git username, so if you'd prefer this to be your real name, then provide your real name. 2. Your SVN account name, or your preferred shell account name, if you do not have SVN access. 3. Your preferred email address. [23:40:56] Ryan_Lane: need a key to tell you which keys to use? :) [23:41:02] nope [23:41:08] jeremyb: don't you already have an account? [23:41:10] 01/21/2012 - 23:41:10 - Creating a home directory for abemusic at /export/home/bastion/abemusic [23:41:12] i does [23:41:14] heh [23:41:15] 01/21/2012 - 23:41:14 - Creating a home directory for abemusic at /export/home/nginx/abemusic [23:41:21] in fact i was going to make my first git commit [23:41:27] cool [23:41:29] wm-bot: 1. Jdz 2. jdz 3. embeddedlinuxguy@gmail.com [23:41:37] !log patchtest Added pear channels pear.phpunit.de, pear.symfony-project.com and components.ez.no [23:41:38] Logged the message, Master [23:41:44] oh, dinner's here. bbiab [23:42:00] !initial-login | mdale [23:42:00] mdale: https://labsconsole.wikimedia.org/wiki/Access#Initial_log_in [23:42:11] 01/21/2012 - 23:42:11 - Updating keys for abemusic [23:42:16] 01/21/2012 - 23:42:15 - Updating keys for abemusic [23:42:21] !log patchtest Installed phpunit/PHPUnit via pear [23:42:22] Logged the message, Master [23:42:53] !initial-login | jesse__ [23:42:53] jesse__: https://labsconsole.wikimedia.org/wiki/Access#Initial_log_in [23:43:06] !log patchtest Bah, scratch that, only precise has a new enough pear package. [23:43:07] Logged the message, Master [23:44:10] 01/21/2012 - 23:44:09 - Creating a home directory for dale at /export/home/bastion/dale [23:44:15] so, for those with new accounts, there's some things to know [23:44:19] !access [23:44:19] https://labsconsole.wikimedia.org/wiki/Access#Accessing_public_and_private_instances [23:44:34] !logging [23:44:34] To log a message, use the following format: !log [23:45:01] when you are added to a project, when you do anything in the project, you should log it ^^ [23:45:11] 01/21/2012 - 23:45:11 - Updating keys for dale [23:45:18] this lets other people know what you are doing, and makes it easier for people to work with you on a project [23:45:33] you can see a project's log by checking out its project page [23:45:37] !project bots [23:45:37] https://labsconsole.wikimedia.org/wiki/Nova_Resource:bots [23:45:40] ^^ for instance [23:45:54] you should also eventually document how things work in your project on those pages [23:46:27] Ryan_Lane: hi [23:46:33] :) [23:46:42] LeslieCarr: hey [23:46:52] you both pinged me client shows ^^ [23:47:12] anything to me before I go :D [23:47:15] 1 am [23:47:57] hehehe [23:48:08] oh we said you should make an update to the bot that detects trolling :) [23:48:39] robla: hello [23:48:54] LeslieCarr: I did, when you spam too much :) [23:49:04] hahaha [23:49:19] robla: I do stuff on deployment prep, can I help? [23:50:01] New patchset: Lcarr; "adding firewall testing" [operations/puppet] (test) - https://gerrit.wikimedia.org/r/2002 [23:50:11] 01/21/2012 - 23:50:11 - Creating a home directory for jdz at /export/home/bastion/jdz [23:50:14] New review: gerrit2; "Change did not pass lint check. You will need to send an amended patchset for this (see: https://lab..." [operations/puppet] (test); V: -1 - https://gerrit.wikimedia.org/r/2002 [23:50:24] hi petan...there's a handful of us working on the Proofread Page extension, and we'd like to get it enabled on the wikisource instance on deployment-prep [23:50:40] New review: Lcarr; "(no comment)" [operations/puppet] (test); V: 0 C: 2; - https://gerrit.wikimedia.org/r/2002 [23:51:11] 01/21/2012 - 23:51:11 - Updating keys for jdz [23:51:37] oh, yes thats no problem [23:51:51] should I install trunk version? [23:51:52] !project nginx | diederik [23:51:52] diederik: https://labsconsole.wikimedia.org/wiki/Nova_Resource:nginx [23:51:59] !project nginx | abemusic [23:51:59] abemusic: https://labsconsole.wikimedia.org/wiki/Nova_Resource:nginx [23:52:03] Ryan_Lane: Hi [23:52:34] hey hey ey [23:52:49] !account-questions | pgehres [23:52:49] pgehres: I need the following info from you: 1. Your preferred wiki user name. This will also be your git username, so if you'd prefer this to be your real name, then provide your real name. 2. Your SVN account name, or your preferred shell account name, if you do not have SVN access. 3. Your preferred email address. [23:53:32] New patchset: Lcarr; "adding firewall testing" [operations/puppet] (test) - https://gerrit.wikimedia.org/r/2002 [23:53:38] wm-bot: Ryan_Lane: pgehres, pgehres, pgehres@wikimedia.org [23:53:46] New review: gerrit2; "Change did not pass lint check. You will need to send an amended patchset for this (see: https://lab..." [operations/puppet] (test); V: -1 - https://gerrit.wikimedia.org/r/2002 [23:54:19] !initial-login | pgehres [23:54:19] pgehres: https://labsconsole.wikimedia.org/wiki/Access#Initial_log_in [23:54:23] Ryan_Lane: can I get a new project :) deployment-prepbackup as I requested [23:54:31] yep [23:54:34] I would only make a one temporary instance [23:54:43] untill we get sql server working with backups [23:54:45] * until [23:54:48] yeah. that's cool [23:54:51] gimme a min [23:54:53] sure [23:54:54] thanks [23:55:53] Ryan_Lane: three more people to add to bastion: Tim Starling, Zaran, and TheDJ [23:56:08] robla: you can add them in, if you'd like [23:56:12] 01/21/2012 - 23:56:11 - Creating a home directory for pgehres at /export/home/bastion/pgehres [23:56:16] New patchset: Lcarr; "adding firewall testing" [operations/puppet] (test) - https://gerrit.wikimedia.org/r/2002 [23:56:27] I can do so too, if you'd prefer [23:56:29] New review: gerrit2; "Change did not pass lint check. You will need to send an amended patchset for this (see: https://lab..." [operations/puppet] (test); V: -1 - https://gerrit.wikimedia.org/r/2002 [23:56:46] just wanted to let you know you can if I'm not around [23:56:49] can I? I was assuming I needed to be a sysadmin [23:56:54] nope [23:56:55] in that project [23:56:59] ok....I'll do it now [23:57:03] cool [23:57:11] 01/21/2012 - 23:57:11 - Updating keys for pgehres [23:57:11] 01/21/2012 - 23:57:11 - Creating a home directory for tstarling at /export/home/bastion/tstarling [23:57:17] if someone goes crazy and starts removing people, I'll just disable their account [23:57:27] and add those people back in [23:57:33] the recent-changes log will tell me this [23:58:09] robla: I am installing trunk head, ok? [23:58:12] 01/21/2012 - 23:58:12 - Updating keys for tstarling [23:58:12] 01/21/2012 - 23:58:12 - Creating a home directory for zaran at /export/home/bastion/zaran [23:58:12] 01/21/2012 - 23:58:12 - Creating a home directory for hartman at /export/home/bastion/hartman [23:58:14] PROBLEM host: patchtest is DOWN address: patchtest PING CRITICAL - Packet loss = 100% [23:58:17] 01/21/2012 - 23:58:17 - Creating a project directory for selenium [23:58:18] 01/21/2012 - 23:58:17 - Creating a home directory for pgehres at /export/home/selenium/pgehres [23:58:31] petan: great! [23:58:33] Hi Ryan_Lane [23:58:45] jpostlethwaite: howdy [23:58:52] you said something about questions appearing? [23:59:11] 01/21/2012 - 23:59:11 - Updating keys for hartman [23:59:11] 01/21/2012 - 23:59:11 - Updating keys for zaran [23:59:11] 01/21/2012 - 23:59:11 - Creating a home directory for dale at /export/home/mediahandler/dale [23:59:16] 01/21/2012 - 23:59:15 - Updating keys for pgehres [23:59:29] New patchset: Lcarr; "adding firewall testing" [operations/puppet] (test) - https://gerrit.wikimedia.org/r/2002 [23:59:43] New review: gerrit2; "Lint check passed." [operations/puppet] (test); V: 1 - https://gerrit.wikimedia.org/r/2002 [23:59:48] robla: http://en.wikisource.beta.wmflabs.org/w/index.php?title=Special:Version installed