[00:07:03] PROBLEM Free ram is now: CRITICAL on incubator-bots2 i-00000119 output: Critical: 5% free memory [02:40:35] RECOVERY Free ram is now: OK on deployment-squid i-000000dc output: OK: 22% free memory [03:23:35] PROBLEM Free ram is now: WARNING on deployment-squid i-000000dc output: Warning: 19% free memory [03:35:14] PROBLEM Free ram is now: WARNING on nova-daas-1 i-000000e7 output: Warning: 14% free memory [03:44:14] PROBLEM Free ram is now: WARNING on test-oneiric i-00000187 output: Warning: 14% free memory [03:55:18] PROBLEM Free ram is now: CRITICAL on nova-daas-1 i-000000e7 output: Critical: 5% free memory [03:59:13] PROBLEM Free ram is now: WARNING on orgcharts-dev i-0000018f output: Warning: 14% free memory [03:59:13] PROBLEM Free ram is now: CRITICAL on test-oneiric i-00000187 output: Critical: 5% free memory [04:04:15] PROBLEM Free ram is now: WARNING on utils-abogott i-00000131 output: Warning: 15% free memory [04:05:15] RECOVERY Free ram is now: OK on nova-daas-1 i-000000e7 output: OK: 92% free memory [04:09:15] RECOVERY Free ram is now: OK on test-oneiric i-00000187 output: OK: 97% free memory [04:14:15] PROBLEM Free ram is now: CRITICAL on orgcharts-dev i-0000018f output: Critical: 5% free memory [04:16:15] PROBLEM Free ram is now: WARNING on test3 i-00000093 output: Warning: 6% free memory [04:19:15] PROBLEM Free ram is now: CRITICAL on utils-abogott i-00000131 output: Critical: 5% free memory [04:21:15] RECOVERY Free ram is now: OK on test3 i-00000093 output: OK: 96% free memory [04:24:15] RECOVERY Free ram is now: OK on orgcharts-dev i-0000018f output: OK: 96% free memory [04:29:15] RECOVERY Free ram is now: OK on utils-abogott i-00000131 output: OK: 96% free memory [05:16:24] Can someone give me an account on bots-sql3 (I have one on bots-sql2 .. but need to move) [08:16:41] hello there :-) [08:16:42] ping pong [08:39:05] PROBLEM Puppet freshness is now: CRITICAL on jenkins2 i-00000102 output: Puppet has not run in last 20 hours [08:52:05] PROBLEM Puppet freshness is now: CRITICAL on nova-production1 i-0000007b output: Puppet has not run in last 20 hours [08:56:05] PROBLEM Puppet freshness is now: CRITICAL on nova-gsoc1 i-000001de output: Puppet has not run in last 20 hours [10:16:34] 04/17/2012 - 10:16:34 - Creating a home directory for johlig at /export/home/wikidata-dev/johlig [10:16:35] 04/17/2012 - 10:16:34 - Creating a home directory for reedy at /export/home/wikidata-dev/reedy [10:17:33] 04/17/2012 - 10:17:33 - Updating keys for johlig [10:17:34] 04/17/2012 - 10:17:33 - Updating keys for reedy [10:29:17] PROBLEM Free ram is now: WARNING on bots-3 i-000000e5 output: Warning: 9% free memory [10:32:17] RECOVERY Free ram is now: OK on incubator-bots2 i-00000119 output: OK: 55% free memory [10:34:17] RECOVERY Free ram is now: OK on bots-3 i-000000e5 output: OK: 51% free memory [10:37:15] mutante: are you about? Do you know if there are any free public ips on labs? [10:44:24] PROBLEM Current Load is now: CRITICAL on wikidata-dev-1 i-00000209 output: Connection refused by host [10:45:04] PROBLEM Current Users is now: CRITICAL on wikidata-dev-1 i-00000209 output: Connection refused by host [10:45:44] PROBLEM Disk Space is now: CRITICAL on wikidata-dev-1 i-00000209 output: CHECK_NRPE: Error - Could not complete SSL handshake. [10:46:14] PROBLEM Free ram is now: CRITICAL on wikidata-dev-1 i-00000209 output: CHECK_NRPE: Error - Could not complete SSL handshake. [10:47:34] PROBLEM Total Processes is now: CRITICAL on wikidata-dev-1 i-00000209 output: CHECK_NRPE: Error - Could not complete SSL handshake. [10:48:14] PROBLEM dpkg-check is now: CRITICAL on wikidata-dev-1 i-00000209 output: CHECK_NRPE: Error - Could not complete SSL handshake. [11:23:54] PROBLEM HTTP is now: CRITICAL on wikidata-dev-1 i-00000209 output: CRITICAL - Socket timeout after 10 seconds [11:30:43] RECOVERY Disk Space is now: OK on wikidata-dev-1 i-00000209 output: DISK OK [11:30:43] RECOVERY Current Users is now: OK on wikidata-dev-1 i-00000209 output: USERS OK - 4 users currently logged in [11:31:13] RECOVERY Free ram is now: OK on wikidata-dev-1 i-00000209 output: OK: 91% free memory [11:32:33] RECOVERY Total Processes is now: OK on wikidata-dev-1 i-00000209 output: PROCS OK: 102 processes [11:33:13] RECOVERY dpkg-check is now: OK on wikidata-dev-1 i-00000209 output: All packages OK [11:34:13] 04/17/2012 - 11:34:12 - Updating keys for suhasmonk [11:34:23] RECOVERY Current Load is now: OK on wikidata-dev-1 i-00000209 output: OK - load average: 0.13, 0.39, 0.27 [11:35:06] 04/17/2012 - 11:35:06 - Updating keys for suhasmonk [12:16:54] * Beetstra tries again: [12:16:57] Can someone give me an account on bots-sql3 (I have one on bots-sql2 .. but need to move) [12:33:15] Beetstra: I thought we didn't do per instance configuration, it's per project? [12:33:57] No clue, but I am filling up bots-sql3 fast, so I was suggested to move to sql2 (I see I mixed them up above) [12:34:12] But I can't login on bots-sql2 [12:34:53] Yeah, I am on bots-sql3 [12:39:48] What error message? [12:40:11] I've not enough rights on the project anyway [12:40:27] phpmyadmin: #1045 Cannot log in to the MySQL server [12:40:40] (when I log into bots-sql2 [12:42:44] lo [12:42:45] l [12:43:15] If someone was about I'd ask for more rights on it [12:43:40] Well, yeah [12:43:55] I asked this morning, and ask now .. but noone seems about [12:43:58] I mean, sysadmin/netadmin for the project [12:44:46] There's only likely to be petan about due to timezones [12:45:21] * Beetstra tickles petan ;-) [12:46:02] Petan, can I haz account on bots-sql3, or generally more rightz? [12:47:20] * DamianZ throws shit at Beetstra [12:47:42] * Beetstra cries a little [12:48:17] DamianZ: that's bad idea [12:49:01] I'd try but as I have 3 fingers today I can't type my password very well to see if I can actually log into the server [12:49:10] vvv: She only bites certain people [12:49:12] * DamianZ gets his gun [12:51:04] * DamianZ gives Beetstra a cookie [12:51:05] * Beetstra feels pretty save, I don't expect that you will be able to get close enough to actually kill me with a gun .. nor throw shit that far that it actually will hit me (or a nearby fan) [12:51:27] If any shit gets thrown in here it hits Ryans fan :D [12:51:38] heh [12:52:24] I mean, I am in a 40 sq. kilometer compound surrounded by a barb-wired wall in a country that is not exactly the most accessible in the world. It must be local shit if it will hit my fan [12:53:06] Beetstra: are you at prison in North Korea? [12:53:22] No, Saudi Arabia [12:53:27] And not a prison [12:53:48] Golden cage is probably a better description [12:54:05] You've got all the money [12:54:07] and all the oil! [12:54:16] Also sunburn. [12:54:20] Putin has moar oil [12:54:33] But less money [12:55:47] I have airco, I can see the red sea from my office window, and a 1 Gbps network connection on my desktop. Does Putin has that as well? [12:56:06] (and I get paid, also for the moments that I look from my right-eye corner at the Red Sea [12:56:36] Beetstra: well, Putin may see whatever he wants from his window [12:57:15] :-) [12:57:26] The Siberian outback? [12:57:56] It's not like there are few Russians with a view on Red Sea [12:58:48] Putin's first vice has one, IIRC [13:02:50] Anyways .. [13:03:03] do your 7 fingers operate correctly, DamianZ ? [13:03:47] My 8 fingers do, just have 2 taped together until later when it will get abused. [13:13:43] PROBLEM Current Load is now: CRITICAL on wikidata-dev-2 i-0000020a output: Connection refused by host [13:14:23] PROBLEM Current Users is now: CRITICAL on wikidata-dev-2 i-0000020a output: Connection refused by host [13:15:04] PROBLEM Disk Space is now: CRITICAL on wikidata-dev-2 i-0000020a output: Connection refused by host [13:15:43] PROBLEM Free ram is now: CRITICAL on wikidata-dev-2 i-0000020a output: Connection refused by host [13:16:53] PROBLEM Total Processes is now: CRITICAL on wikidata-dev-2 i-0000020a output: Connection refused by host [13:17:33] PROBLEM dpkg-check is now: CRITICAL on wikidata-dev-2 i-0000020a output: Connection refused by host [13:31:05] hellooo [13:31:46] PROBLEM dpkg-check is now: CRITICAL on wikidata-dev-1 i-00000209 output: DPKG CRITICAL dpkg reports broken packages [13:32:16] PROBLEM Current Load is now: WARNING on bots-cb i-0000009e output: WARNING - load average: 7.70, 14.32, 7.07 [13:34:46] PROBLEM Current Load is now: WARNING on bots-3 i-000000e5 output: WARNING - load average: 4.26, 6.89, 6.00 [13:42:24] RECOVERY Current Load is now: OK on bots-cb i-0000009e output: OK - load average: 0.34, 2.21, 3.84 [13:44:34] PROBLEM HTTP is now: CRITICAL on wikidata-dev-2 i-0000020a output: CRITICAL - Socket timeout after 10 seconds [13:44:57] hmm .. still no access to -bots-sql2 :-( [13:46:44] RECOVERY dpkg-check is now: OK on wikidata-dev-1 i-00000209 output: All packages OK [13:49:44] RECOVERY Current Load is now: OK on bots-3 i-000000e5 output: OK - load average: 4.80, 4.22, 4.78 [13:52:33] It's not going to fix itself [13:53:00] And by the looks of it, you just need an account creating on the mysql server instance [13:53:16] which if you can ssh into the box, you can maybe do it yourself [13:53:47] I can ssh into the box [13:54:08] what would be the command for creating a sql-account? [13:54:27] * Beetstra is far from fluent in command-line sql [13:54:37] https://dev.mysql.com/doc/refman/5.1/en/create-user.html [13:54:51] Can you sudo on the box? [13:55:16] Seems to work [13:55:52] sudo mysql [13:56:12] no, that I can't [13:56:21] I can 'sudo su' .. [13:56:31] sudo su [13:56:32] enter [13:56:33] mysql [13:57:10] "ERROR 1045 (28000): Access denied for user 'root'@'localhost' (using password: NO)" [13:57:25] Works for me on bots-sql2 [13:57:27] not on 1 [13:58:08] try puppet [13:58:20] does not work on bots3 (where I have an account) [13:58:30] Does it matter? [13:58:42] You're not trying to create an account on bots-sql3 [13:58:57] Ah, bingo, I am in mysql on bots-sql2 [13:59:11] * DamianZ sits drumming on Beetstra [13:59:52] CREATE USER 'username'@'%' IDENTIFIED BY 'mypass'; [14:00:39] GRANT ALL ON mydb.* TO myuser@'%' IDENTIFIED BY 'mypass'; [14:01:00] I am in! [14:03:11] gj [14:03:16] except for the problem that I am not allowed to make a db ... [14:04:01] Are you allowed to create any called whatever you want on the other servers? [14:04:40] yes, I can make one on bots-sql3 [14:04:44] PROBLEM dpkg-check is now: CRITICAL on wikidata-dev-1 i-00000209 output: DPKG CRITICAL dpkg reports broken packages [14:05:03] GRANT ALL ON *.* TO 'username'@'%'; [14:06:09] ERROR 1064 (42000): You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near 'to *.* to 'beetstra'@'%'' at line 1 [14:07:30] first to should be on [14:07:44] PROBLEM Current Load is now: WARNING on bots-3 i-000000e5 output: WARNING - load average: 5.93, 5.63, 5.14 [14:08:06] GRANT ALL ON *.* TO 'beetstra'@'%'; [14:08:07] done [14:08:34] Grant stroke on boobies.* to Reedy@localhost; [14:08:49] DamianZ, /0.o\ [14:08:52] I don't think there any boobies on bots-sql2 [14:09:01] sql needs more boobies [14:09:07] lol [14:09:56] GRANT ALL ON *.* TO 'beetstra'@'%' identified by ''; still does not do the trick [14:10:12] you don't need the identified by [14:10:14] it's osrted [14:10:18] just try it [14:10:26] I did, does not help [14:10:26] (creating a db) [14:10:40] flush priveleges maybe [14:11:02] mm [14:11:23] Now? [14:12:08] I logged out and in .. now it works [14:13:52] Good [14:14:17] I will see if I manage to transfer the tables tomorrow. Now it's time to go home [14:14:26] Thanks all! [14:27:46] PROBLEM Current Load is now: WARNING on bots-cb i-0000009e output: WARNING - load average: 1.15, 10.13, 6.96 [15:28:49] ping petan [15:44:03] mutante: I have a question for you [15:44:21] andrewbogott: you might be able to answer it as well [15:44:34] given that a MediaWiki wiki username will always start with a capital letter (if it's a letter) [15:44:59] when I create a labs user via the command line, on formey, if the user requests a Git username that starts with a capital letter [15:45:23] does it matter whether I create it (as a Labs user, using add-labs-user) as the user requested it, or with a capital first letter? [15:54:18] I think it might need to be lowercase, for *nix apps expecting it lower [15:54:26] mediawiki wouldn't care [15:56:00] Platonides: ok, lowercase it is, thanks Platonides [16:12:56] PROBLEM dpkg-check is now: CRITICAL on wikidata-dev-1 i-00000209 output: DPKG CRITICAL dpkg reports broken packages [17:45:11] PROBLEM dpkg-check is now: CRITICAL on bots-3 i-000000e5 output: CHECK_NRPE: Socket timeout after 10 seconds. [17:47:51] PROBLEM Current Load is now: WARNING on bots-3 i-000000e5 output: WARNING - load average: 5.16, 6.29, 5.56 [17:48:01] PROBLEM Free ram is now: WARNING on bots-3 i-000000e5 output: Warning: 12% free memory [17:50:01] RECOVERY dpkg-check is now: OK on bots-3 i-000000e5 output: All packages OK [17:53:01] RECOVERY Free ram is now: OK on bots-3 i-000000e5 output: OK: 51% free memory [17:58:01] I have a feeling someone called me [17:58:11] hi petan [17:58:16] hey [18:00:14] DamianZ: we need to puppetize mysql :P [18:00:22] so that it's not so hard to manage users [18:00:36] or at least it should look same every where [18:00:49] mysql etc [18:02:51] RECOVERY Current Load is now: OK on bots-3 i-000000e5 output: OK - load average: 4.98, 4.61, 4.84 [18:40:01] PROBLEM Puppet freshness is now: CRITICAL on jenkins2 i-00000102 output: Puppet has not run in last 20 hours [18:53:01] PROBLEM Puppet freshness is now: CRITICAL on nova-production1 i-0000007b output: Puppet has not run in last 20 hours [18:57:01] PROBLEM Puppet freshness is now: CRITICAL on nova-gsoc1 i-000001de output: Puppet has not run in last 20 hours [19:10:49] Platonides: replied to pm [19:19:25] petan, replied to your reply [19:29:43] petan: hey :-] Will you be around this week during the day ? [19:30:55] yes [19:31:12] every day 10 - 6pm [19:31:15] gmt [19:31:31] petan: wonderful . I am in Europe as well with similar hours [19:31:56] petan: it looks like I am going to help you enhance the MediaWiki test cluster [19:37:15] gmt + 1 I meant [19:37:31] that would be cool [19:37:36] it really needs a lot of fixes [19:37:48] did u read all bugzilla tickets we have? [19:37:56] there is a lot of stuff to work on [19:48:46] petan: I haven't looked at anything for now :D [19:48:52] petan: guess I will discover that tomorrow! [19:49:09] for now I am heading to bed. Have a good night ;) [19:58:22] Hey all [19:58:40] How do I find where an extension is being tested via labs? [19:59:47] petan? ^ [20:00:43] Never mind. Found it. [20:14:57] can someone recover the old version of topic [20:15:10] the one w link to logs and information channel is logged [20:15:35] I don't remember the url [20:15:40] I mean the short one [20:41:08] this was the topic we had a month ago [21:46:07] 04/17/2012 - 21:46:07 - Updating keys for faidon [21:46:13] 04/17/2012 - 21:46:13 - Updating keys for faidon [21:53:43] PROBLEM Current Load is now: CRITICAL on localpuppet1 i-0000020b output: CHECK_NRPE: Error - Could not complete SSL handshake. [21:54:23] PROBLEM Current Users is now: CRITICAL on localpuppet1 i-0000020b output: CHECK_NRPE: Error - Could not complete SSL handshake. [21:55:03] PROBLEM Disk Space is now: CRITICAL on localpuppet1 i-0000020b output: CHECK_NRPE: Error - Could not complete SSL handshake. [21:55:43] PROBLEM Free ram is now: CRITICAL on localpuppet1 i-0000020b output: CHECK_NRPE: Error - Could not complete SSL handshake. [21:56:53] PROBLEM Total Processes is now: CRITICAL on localpuppet1 i-0000020b output: CHECK_NRPE: Error - Could not complete SSL handshake. [21:57:33] PROBLEM dpkg-check is now: CRITICAL on localpuppet1 i-0000020b output: CHECK_NRPE: Error - Could not complete SSL handshake. [23:12:07] 04/17/2012 - 23:12:07 - Updating keys for faidon [23:12:14] 04/17/2012 - 23:12:13 - Updating keys for faidon [23:20:54] Hi. [23:21:01] I want to be a member of the bastion. [23:21:11] The bastion? [23:21:15] yes [23:21:26] I'm a svn and git user [23:21:55] and added to git/gerrit/labconsole at yesterday