[00:02:53] PROBLEM Free ram is now: WARNING on aggregator2.pmtpa.wmflabs 10.4.0.193 output: Warning: 9% free memory [00:28:34] PROBLEM Free ram is now: WARNING on bots-2.pmtpa.wmflabs 10.4.0.42 output: Warning: 19% free memory [00:38:33] RECOVERY Free ram is now: OK on bots-2.pmtpa.wmflabs 10.4.0.42 output: OK: 21% free memory [00:39:33] RECOVERY Free ram is now: OK on stackfarm-sql2.pmtpa.wmflabs 10.4.1.23 output: OK: 22% free memory [00:57:32] PROBLEM Free ram is now: WARNING on stackfarm-sql2.pmtpa.wmflabs 10.4.1.23 output: Warning: 18% free memory [01:11:33] PROBLEM Free ram is now: WARNING on bots-2.pmtpa.wmflabs 10.4.0.42 output: Warning: 18% free memory [01:18:02] PROBLEM Free ram is now: UNKNOWN on aggregator2.pmtpa.wmflabs 10.4.0.193 output: NRPE: Call to fork() failed [01:33:02] PROBLEM Free ram is now: WARNING on aggregator2.pmtpa.wmflabs 10.4.0.193 output: Warning: 9% free memory [03:57:53] PROBLEM Free ram is now: UNKNOWN on aggregator2.pmtpa.wmflabs 10.4.0.193 output: NRPE: Unable to read output [04:02:53] PROBLEM Free ram is now: WARNING on aggregator2.pmtpa.wmflabs 10.4.0.193 output: Warning: 9% free memory [04:37:32] RECOVERY Free ram is now: OK on stackfarm-sql2.pmtpa.wmflabs 10.4.1.23 output: OK: 22% free memory [04:41:52] RECOVERY Free ram is now: OK on sube.pmtpa.wmflabs 10.4.0.245 output: OK: 22% free memory [04:45:32] PROBLEM Free ram is now: WARNING on stackfarm-sql2.pmtpa.wmflabs 10.4.1.23 output: Warning: 18% free memory [04:48:02] PROBLEM Free ram is now: CRITICAL on aggregator2.pmtpa.wmflabs 10.4.0.193 output: NRPE: Unable to read output [04:48:52] PROBLEM dpkg-check is now: CRITICAL on aggregator2.pmtpa.wmflabs 10.4.0.193 output: CHECK_NRPE: Error - Could not complete SSL handshake. [04:49:22] PROBLEM Current Load is now: CRITICAL on aggregator2.pmtpa.wmflabs 10.4.0.193 output: CHECK_NRPE: Error - Could not complete SSL handshake. [04:49:52] PROBLEM Free ram is now: WARNING on sube.pmtpa.wmflabs 10.4.0.245 output: Warning: 14% free memory [04:53:53] RECOVERY dpkg-check is now: OK on aggregator2.pmtpa.wmflabs 10.4.0.193 output: All packages OK [04:54:13] RECOVERY Current Load is now: OK on aggregator2.pmtpa.wmflabs 10.4.0.193 output: OK - load average: 0.02, 0.13, 0.19 [05:00:52] PROBLEM Free ram is now: WARNING on message-remailer.pmtpa.wmflabs 10.4.0.251 output: Warning: 14% free memory [05:23:02] PROBLEM Free ram is now: WARNING on aggregator2.pmtpa.wmflabs 10.4.0.193 output: Warning: 9% free memory [06:28:46] PROBLEM Total processes is now: WARNING on parsoid-roundtrip4-8core.pmtpa.wmflabs 10.4.0.39 output: PROCS WARNING: 152 processes [06:32:44] PROBLEM Total processes is now: WARNING on wikidata-dev-9.pmtpa.wmflabs 10.4.1.41 output: PROCS WARNING: 155 processes [06:33:44] RECOVERY Total processes is now: OK on parsoid-roundtrip4-8core.pmtpa.wmflabs 10.4.0.39 output: PROCS OK: 147 processes [06:47:53] PROBLEM Total processes is now: CRITICAL on wikidata-dev-9.pmtpa.wmflabs 10.4.1.41 output: CHECK_NRPE: Socket timeout after 10 seconds. [06:50:35] PROBLEM Free ram is now: CRITICAL on stackfarm-sql2.pmtpa.wmflabs 10.4.1.23 output: CHECK_NRPE: Error - Could not complete SSL handshake. [06:50:55] PROBLEM Total processes is now: WARNING on parsoid-spof.pmtpa.wmflabs 10.4.0.33 output: PROCS WARNING: 156 processes [06:50:55] PROBLEM Current Load is now: CRITICAL on bots-liwa.pmtpa.wmflabs 10.4.1.65 output: CRITICAL - load average: 36.42, 18.70, 7.85 [06:51:05] PROBLEM Free ram is now: CRITICAL on message-remailer.pmtpa.wmflabs 10.4.0.251 output: CHECK_NRPE: Socket timeout after 10 seconds. [06:51:35] PROBLEM Disk Space is now: CRITICAL on stackfarm-sql2.pmtpa.wmflabs 10.4.1.23 output: CHECK_NRPE: Socket timeout after 10 seconds. [06:52:05] PROBLEM Total processes is now: CRITICAL on stackfarm-sql2.pmtpa.wmflabs 10.4.1.23 output: CHECK_NRPE: Socket timeout after 10 seconds. [06:52:05] PROBLEM Free ram is now: WARNING on stackfarm-sql1.pmtpa.wmflabs 10.4.1.8 output: Warning: 18% free memory [06:52:45] PROBLEM Total processes is now: WARNING on wikidata-dev-9.pmtpa.wmflabs 10.4.1.41 output: PROCS WARNING: 167 processes [06:54:25] PROBLEM Total processes is now: WARNING on bots-liwa.pmtpa.wmflabs 10.4.1.65 output: PROCS WARNING: 151 processes [06:54:35] PROBLEM Free ram is now: WARNING on bots-liwa.pmtpa.wmflabs 10.4.1.65 output: Warning: 10% free memory [06:55:12] PROBLEM dpkg-check is now: CRITICAL on incubator-sql.pmtpa.wmflabs 10.4.0.31 output: CHECK_NRPE: Socket timeout after 10 seconds. [06:55:52] RECOVERY dpkg-check is now: OK on incubator-sql.pmtpa.wmflabs 10.4.0.31 output: All packages OK [06:55:52] PROBLEM Current Load is now: WARNING on bots-liwa.pmtpa.wmflabs 10.4.1.65 output: WARNING - load average: 4.50, 11.83, 8.21 [06:55:52] RECOVERY Free ram is now: OK on message-remailer.pmtpa.wmflabs 10.4.0.251 output: OK: 28% free memory [06:56:32] RECOVERY Disk Space is now: OK on stackfarm-sql2.pmtpa.wmflabs 10.4.1.23 output: DISK OK [06:57:02] RECOVERY Free ram is now: OK on stackfarm-sql1.pmtpa.wmflabs 10.4.1.8 output: OK: 42% free memory [06:57:12] PROBLEM SSH is now: CRITICAL on integration-jobbuilder.pmtpa.wmflabs 10.4.0.21 output: CRITICAL - Socket timeout after 10 seconds [06:59:22] RECOVERY Total processes is now: OK on bots-liwa.pmtpa.wmflabs 10.4.1.65 output: PROCS OK: 140 processes [06:59:42] RECOVERY Free ram is now: OK on bots-liwa.pmtpa.wmflabs 10.4.1.65 output: OK: 22% free memory [07:00:42] PROBLEM Free ram is now: WARNING on stackfarm-sql2.pmtpa.wmflabs 10.4.1.23 output: Warning: 13% free memory [07:00:52] RECOVERY Total processes is now: OK on parsoid-spof.pmtpa.wmflabs 10.4.0.33 output: PROCS OK: 144 processes [07:01:52] RECOVERY Total processes is now: OK on stackfarm-sql2.pmtpa.wmflabs 10.4.1.23 output: PROCS OK: 105 processes [07:02:02] RECOVERY SSH is now: OK on integration-jobbuilder.pmtpa.wmflabs 10.4.0.21 output: SSH OK - OpenSSH_5.9p1 Debian-5ubuntu1 (protocol 2.0) [07:05:52] RECOVERY Current Load is now: OK on bots-liwa.pmtpa.wmflabs 10.4.1.65 output: OK - load average: 0.65, 2.23, 4.67 [07:08:52] PROBLEM Free ram is now: WARNING on mediawiki-bugfix-kozuch.pmtpa.wmflabs 10.4.0.26 output: Warning: 16% free memory [07:13:53] RECOVERY Free ram is now: OK on mediawiki-bugfix-kozuch.pmtpa.wmflabs 10.4.0.26 output: OK: 25% free memory [08:01:53] PROBLEM dpkg-check is now: UNKNOWN on aggregator2.pmtpa.wmflabs 10.4.0.193 output: NRPE: Call to fork() failed [08:02:33] PROBLEM Disk Space is now: CRITICAL on aggregator2.pmtpa.wmflabs 10.4.0.193 output: CHECK_NRPE: Error - Could not complete SSL handshake. [08:02:53] PROBLEM Free ram is now: CRITICAL on aggregator2.pmtpa.wmflabs 10.4.0.193 output: CHECK_NRPE: Error - Could not complete SSL handshake. [08:06:53] RECOVERY dpkg-check is now: OK on aggregator2.pmtpa.wmflabs 10.4.0.193 output: All packages OK [08:07:33] RECOVERY Disk Space is now: OK on aggregator2.pmtpa.wmflabs 10.4.0.193 output: DISK OK [08:07:53] PROBLEM Free ram is now: WARNING on aggregator2.pmtpa.wmflabs 10.4.0.193 output: Warning: 9% free memory [08:39:53] RECOVERY Free ram is now: OK on sube.pmtpa.wmflabs 10.4.0.245 output: OK: 22% free memory [08:40:34] RECOVERY Free ram is now: OK on stackfarm-sql2.pmtpa.wmflabs 10.4.1.23 output: OK: 22% free memory [08:52:53] PROBLEM Free ram is now: WARNING on sube.pmtpa.wmflabs 10.4.0.245 output: Warning: 14% free memory [08:58:32] PROBLEM Free ram is now: WARNING on stackfarm-sql2.pmtpa.wmflabs 10.4.1.23 output: Warning: 18% free memory [09:02:58] can't get onto bots-3 right now [09:03:04] and bots-2 can't access /data/project [09:47:53] PROBLEM Free ram is now: CRITICAL on aggregator2.pmtpa.wmflabs 10.4.0.193 output: CHECK_NRPE: Error - Could not complete SSL handshake. [09:53:02] PROBLEM Free ram is now: WARNING on aggregator2.pmtpa.wmflabs 10.4.0.193 output: Warning: 9% free memory [11:29:14] PROBLEM Free ram is now: CRITICAL on bots-4.pmtpa.wmflabs 10.4.0.64 output: Critical: 5% free memory [11:29:44] PROBLEM Free ram is now: WARNING on bots-liwa.pmtpa.wmflabs 10.4.1.65 output: Warning: 19% free memory [11:37:53] PROBLEM Free ram is now: CRITICAL on aggregator2.pmtpa.wmflabs 10.4.0.193 output: NRPE: Call to popen() failed [11:39:13] PROBLEM Current Load is now: CRITICAL on aggregator2.pmtpa.wmflabs 10.4.0.193 output: CHECK_NRPE: Error - Could not complete SSL handshake. [11:43:02] PROBLEM Free ram is now: WARNING on aggregator2.pmtpa.wmflabs 10.4.0.193 output: Warning: 9% free memory [11:44:12] PROBLEM Free ram is now: WARNING on bots-4.pmtpa.wmflabs 10.4.0.64 output: Warning: 7% free memory [11:44:22] RECOVERY Current Load is now: OK on aggregator2.pmtpa.wmflabs 10.4.0.193 output: OK - load average: 0.00, 0.10, 0.21 [11:59:42] RECOVERY Free ram is now: OK on bots-liwa.pmtpa.wmflabs 10.4.1.65 output: OK: 20% free memory [12:03:42] PROBLEM Free ram is now: CRITICAL on stackfarm-sql2.pmtpa.wmflabs 10.4.1.23 output: CHECK_NRPE: Socket timeout after 10 seconds. [12:08:33] PROBLEM Free ram is now: WARNING on stackfarm-sql2.pmtpa.wmflabs 10.4.1.23 output: Warning: 17% free memory [12:09:13] PROBLEM Free ram is now: CRITICAL on bots-4.pmtpa.wmflabs 10.4.0.64 output: Critical: 5% free memory [12:37:52] RECOVERY Free ram is now: OK on sube.pmtpa.wmflabs 10.4.0.245 output: OK: 22% free memory [12:38:32] RECOVERY Free ram is now: OK on stackfarm-sql2.pmtpa.wmflabs 10.4.1.23 output: OK: 22% free memory [12:45:53] PROBLEM Free ram is now: WARNING on sube.pmtpa.wmflabs 10.4.0.245 output: Warning: 14% free memory [12:54:12] PROBLEM Free ram is now: WARNING on bots-4.pmtpa.wmflabs 10.4.0.64 output: Warning: 7% free memory [13:07:34] PROBLEM Free ram is now: WARNING on bots-nr1.pmtpa.wmflabs 10.4.1.2 output: Warning: 19% free memory [13:19:13] PROBLEM Free ram is now: CRITICAL on bots-4.pmtpa.wmflabs 10.4.0.64 output: Critical: 5% free memory [13:26:33] PROBLEM Free ram is now: WARNING on stackfarm-sql2.pmtpa.wmflabs 10.4.1.23 output: Warning: 17% free memory [13:27:53] PROBLEM Free ram is now: UNKNOWN on aggregator2.pmtpa.wmflabs 10.4.0.193 output: Unknown [13:32:32] PROBLEM Total processes is now: CRITICAL on aggregator2.pmtpa.wmflabs 10.4.0.193 output: CHECK_NRPE: Error - Could not complete SSL handshake. [13:33:02] PROBLEM Free ram is now: CRITICAL on aggregator2.pmtpa.wmflabs 10.4.0.193 output: CHECK_NRPE: Error - Could not complete SSL handshake. [13:37:33] RECOVERY Total processes is now: OK on aggregator2.pmtpa.wmflabs 10.4.0.193 output: PROCS OK: 215 processes [13:37:53] PROBLEM Free ram is now: WARNING on aggregator2.pmtpa.wmflabs 10.4.0.193 output: Warning: 9% free memory [14:19:36] Change on 12mediawiki a page Wikimedia Labs/Toolserver features needed in Tool Labs was modified, changed by Kolossos link https://www.mediawiki.org/w/index.php?diff=640090 edit summary: [+2] /* OSM */ typo [14:40:54] PROBLEM Free ram is now: CRITICAL on sube.pmtpa.wmflabs 10.4.0.245 output: Critical: 5% free memory [14:45:52] PROBLEM Free ram is now: WARNING on sube.pmtpa.wmflabs 10.4.0.245 output: Warning: 14% free memory [15:13:02] PROBLEM Free ram is now: WARNING on aggregator2.pmtpa.wmflabs 10.4.0.193 output: Warning: 9% free memory [15:32:54] PROBLEM Free ram is now: CRITICAL on aggregator2.pmtpa.wmflabs 10.4.0.193 output: NRPE: Unable to read output [16:02:55] PROBLEM Free ram is now: WARNING on aggregator2.pmtpa.wmflabs 10.4.0.193 output: Warning: 9% free memory [16:39:12] PROBLEM Free ram is now: WARNING on bots-4.pmtpa.wmflabs 10.4.0.64 output: Warning: 8% free memory [16:40:53] RECOVERY Free ram is now: OK on sube.pmtpa.wmflabs 10.4.0.245 output: OK: 22% free memory [16:41:33] RECOVERY Free ram is now: OK on stackfarm-sql2.pmtpa.wmflabs 10.4.1.23 output: OK: 21% free memory [17:03:53] PROBLEM Free ram is now: WARNING on sube.pmtpa.wmflabs 10.4.0.245 output: Warning: 14% free memory [17:14:33] PROBLEM Free ram is now: WARNING on stackfarm-sql2.pmtpa.wmflabs 10.4.1.23 output: Warning: 17% free memory [17:33:02] PROBLEM Free ram is now: CRITICAL on aggregator2.pmtpa.wmflabs 10.4.0.193 output: NRPE: Unable to read output [17:38:02] PROBLEM Free ram is now: WARNING on aggregator2.pmtpa.wmflabs 10.4.0.193 output: Warning: 9% free memory [18:19:13] PROBLEM Free ram is now: CRITICAL on bots-4.pmtpa.wmflabs 10.4.0.64 output: Critical: 5% free memory [18:24:12] PROBLEM Free ram is now: WARNING on bots-4.pmtpa.wmflabs 10.4.0.64 output: Warning: 6% free memory [18:29:56] urgh, overcrowded bots4 [18:44:14] PROBLEM Free ram is now: CRITICAL on bots-4.pmtpa.wmflabs 10.4.0.64 output: Critical: 5% free memory [19:57:32] PROBLEM Free ram is now: CRITICAL on bots-nr1.pmtpa.wmflabs 10.4.1.2 output: Critical: 5% free memory [20:07:33] PROBLEM Free ram is now: WARNING on bots-nr1.pmtpa.wmflabs 10.4.1.2 output: Warning: 6% free memory [20:12:32] PROBLEM Free ram is now: CRITICAL on bots-nr1.pmtpa.wmflabs 10.4.1.2 output: Critical: 5% free memory [20:38:53] RECOVERY Free ram is now: OK on sube.pmtpa.wmflabs 10.4.0.245 output: OK: 22% free memory [20:39:13] PROBLEM Free ram is now: WARNING on bots-4.pmtpa.wmflabs 10.4.0.64 output: Warning: 7% free memory [20:39:33] RECOVERY Free ram is now: OK on stackfarm-sql2.pmtpa.wmflabs 10.4.1.23 output: OK: 21% free memory [20:43:02] PROBLEM Free ram is now: UNKNOWN on aggregator2.pmtpa.wmflabs 10.4.0.193 output: Unknown [20:47:52] PROBLEM dpkg-check is now: CRITICAL on aggregator2.pmtpa.wmflabs 10.4.0.193 output: CHECK_NRPE: Error - Could not complete SSL handshake. [20:48:02] PROBLEM Free ram is now: CRITICAL on aggregator2.pmtpa.wmflabs 10.4.0.193 output: CHECK_NRPE: Error - Could not complete SSL handshake. [20:49:12] PROBLEM Free ram is now: CRITICAL on bots-4.pmtpa.wmflabs 10.4.0.64 output: Critical: 5% free memory [20:52:54] RECOVERY dpkg-check is now: OK on aggregator2.pmtpa.wmflabs 10.4.0.193 output: All packages OK [20:52:54] PROBLEM Free ram is now: WARNING on aggregator2.pmtpa.wmflabs 10.4.0.193 output: Warning: 9% free memory [21:01:54] PROBLEM Free ram is now: WARNING on sube.pmtpa.wmflabs 10.4.0.245 output: Warning: 14% free memory [21:04:14] PROBLEM Free ram is now: WARNING on bots-4.pmtpa.wmflabs 10.4.0.64 output: Warning: 6% free memory [21:07:33] PROBLEM Free ram is now: WARNING on stackfarm-sql2.pmtpa.wmflabs 10.4.1.23 output: Warning: 17% free memory [21:13:20] addshore: i can't get my bot running anywhere [21:13:48] bots-3 is hosed, bots-4, has no memory, and bots-2 can't connect to where the bot is stored anymore [21:17:08] is Gluster still dead? [21:19:54] bots-3 is hosed? [21:21:03] bots-nr1 ? [21:21:05] i can't ssh in from bastion [21:21:11] bots-nr2? [21:21:35] i don't know, i'm just getting increasingly frustrated [21:21:45] i can't keep the bot running for more than 48 hours, it seems like [21:22:08] bots 4 is the most stable *goes and sees what is using all the memory* [21:23:40] bots-3 dosn't like me, bots-4 has 62% of its memory in use by a gluster process "1218 root 20 0 1402m 1.2g 1056 S 0.0 62.3 64:58.15 glusterfs" [21:24:10] bots-3 doesnt like me either [21:24:19] could just klill it >.< [21:24:26] id just reboot it at this point [21:24:33] yee [21:25:08] wait, addshore can you make projects? [21:25:27] im guessing you mean instances and no [21:25:42] I think we need a larger bots instance [21:25:50] and get rid of some of the older messy instances :/ [21:26:42] well, currently fyi, continuitybot isnt running on labs cause i need to do a re-write of part of its framework to work properly, so nr2 is free [21:28:08] !log bots addshore: rebooted bots-4 [21:28:10] Logged the message, Master [21:32:28] grrr [21:37:33] bots-1 has lots of free ram, bots-2 doesnt, bots-3 is dead, bots-4 is rebooting and having gluster issues [21:38:00] rschen7754, i forgot about this one, use bots-bnr1 [21:38:24] is 3 dead for just an unknown reason or cause of gluster issues? [21:39:00] JasonDC, we will find out when someone who can fixes it :) [21:39:29] ok [21:39:38] rschen7754, it has 4cpus and 8gb ram ;p [21:40:04] i'm having trouble pushing changes to gerrit [21:40:22] i run 'git push', enter my password, then get an error message containing: [21:40:30] Total 10 (delta 7), reused 0 (delta 0) [21:40:31] error: RPC failed; result=22, HTTP code = 500 [21:40:33] fatal: The remote end hung up unexpectedly [21:40:47] how do i begin debugging this? [21:41:03] rschen7754 is not allowed to run sudo on bots-nr1. This incident will be reported. [21:42:05] nr stands for no root :/ [21:42:09] yeah... [21:42:10] what do you need to do? :p [21:42:17] i need python-twisted installed [21:42:24] youll have to wait for someone ;p [21:42:35] mmm gluster [21:42:42] Emw: Annoy chad tomorrow when he's in the office [21:43:03] *sigh* [21:43:05] Damianz: bummer, alright [21:43:07] * addshore sighs [21:43:24] (also feel free to spam bz/mailing lists about how this sucks) [21:43:41] which mailing list would be best? [21:43:43] yeah, i'm just getting more and more frustrated… i expected labs to be a set it up and leave it sort of thing [21:43:59] labs-l@lists.wikimedia.org [21:44:07] thanks [21:44:55] Damianz: is there a way to reset one's HTTP password on gerrit to something other than a random string? [21:45:02] Nothing is ever set up and leave, labs does seem to be a bit more broken than usual recently though [21:45:18] Emw: Login to https://labsconsole.wikimedia.org/ and do it like a normal wiki [21:45:31] will try, thanks [21:45:32] Don't think you can via gerrit's interface atm [21:45:46] Damianz: well yeah, but i shouldn't have to log in every day and restart because something crashed [21:46:09] and right now i can't run my bot anywhere [21:48:02] `god` [21:49:08] i think thats one of the up sides of puppet [21:49:48] Damianz: another question -- my labs and gerrit username/password are the same (user: Emw), but i have to use a slightly different username (user: emw) and password to push commits to gerrit. is there a way i could make my gerrit "push credentials" (repostory credentials?) the same as my labs/gerrit credentials? [21:51:16] gerrit uses ssh which is always lowercase, so in this case wouldn't matter if I'm reading right [21:51:24] Puppet is for state enforcement not process control [21:51:25] we need a grid framework for our processes :/ [21:52:01] depends on what the processes are doing [21:52:27] well, we just need the same system as toolserver for our user processes [21:53:02] one instance where all crons sit, nothing runs there and nothing is installed there so nothing can go wrong [21:53:02] PROBLEM Free ram is now: CRITICAL on aggregator2.pmtpa.wmflabs 10.4.0.193 output: NRPE: Call to popen() failed [21:53:11] all other instances have everything needed installed [21:53:15] and no root access [21:53:18] bingo [21:54:55] Damianz: ok, so it sounds like it's not possible to change my username. how about being able to change my password used for gerrit pushes? it's not the same as my labs/gerrit UI password. that password can be reset on gerrit via Settings -> HTTP Password -> Generate password, but i'd like to be able to set it to a non-random password. is that possible? [21:55:52] PROBLEM dpkg-check is now: CRITICAL on aggregator2.pmtpa.wmflabs 10.4.0.193 output: CHECK_NRPE: Error - Could not complete SSL handshake. [21:55:54] hmm, if you use ssh to push the password should be the same - not sure if it's forced to key auth or not though [21:58:28] from what i can tell i'm pushing over https. for me 'git config -l' includes 'remote.origin.url=https://emw@gerrit.wikimedia.org/r/p/mediawiki/extensions/PDBHandler.git', and that's the URL i see giving an HTTP 403 (unauthorized) error when i try 'git push' and enter a wrong password [21:59:47] If you change https://emw@gerrit.wikimedia.org/r/p/ to ssh://emw@gerrit.wikimedia.org:29418/ it might work, or might want you to add your key [22:00:07] will try [22:00:52] Why are you using git over https? :/ [22:01:26] because gerrit is stoopid and defaults to that for copying? [22:06:03] Krenair: i'm using git over https because that's how the mediawiki documentation's example indicates it should be used; see remote.origin.url in the screenshot at http://www.mediawiki.org/wiki/Git/Tutorial#Configure_Git [22:07:11] * Damianz shoots preilly [22:13:06] having an example git config for gerrit that can be copied, pasted then modified would be awesome [22:13:30] needing to manually transcribe what's in a screenshot seems unnecessarily slow [22:14:26] well normally you'd just go like git remote add origin or such to set it up and not write the file out manually [22:14:59] oh that'd be nice [22:15:33] i think i'll try that [22:28:02] PROBLEM Free ram is now: WARNING on aggregator2.pmtpa.wmflabs 10.4.0.193 output: Warning: 9% free memory [22:58:02] PROBLEM Free ram is now: CRITICAL on aggregator2.pmtpa.wmflabs 10.4.0.193 output: NRPE: Call to popen() failed [23:23:02] PROBLEM Free ram is now: WARNING on aggregator2.pmtpa.wmflabs 10.4.0.193 output: Warning: 9% free memory [23:51:02] RECOVERY dpkg-check is now: OK on bots-labs.pmtpa.wmflabs 10.4.0.75 output: All packages OK