[00:40:32] <labs-nagios-wm>	 RECOVERY Free ram is now: OK on nova-precise2.pmtpa.wmflabs 10.4.1.57 output: OK: 23% free memory
[00:40:52] <labs-nagios-wm>	 RECOVERY Free ram is now: OK on sube.pmtpa.wmflabs 10.4.0.245 output: OK: 21% free memory
[00:53:33] <labs-nagios-wm>	 PROBLEM Free ram is now: WARNING on nova-precise2.pmtpa.wmflabs 10.4.1.57 output: Warning: 16% free memory
[01:03:54] <labs-nagios-wm>	 PROBLEM Free ram is now: WARNING on sube.pmtpa.wmflabs 10.4.0.245 output: Warning: 13% free memory
[01:08:43] <labs-nagios-wm>	 PROBLEM Total processes is now: WARNING on bots-salebot.pmtpa.wmflabs 10.4.0.163 output: PROCS WARNING: 173 processes
[01:12:22] <labs-nagios-wm>	 RECOVERY Current Load is now: OK on parsoid-roundtrip7-8core.pmtpa.wmflabs 10.4.1.26 output: OK - load average: 4.66, 4.78, 4.96
[01:13:42] <labs-nagios-wm>	 RECOVERY Total processes is now: OK on bots-salebot.pmtpa.wmflabs 10.4.0.163 output: PROCS OK: 95 processes
[01:26:13] <labs-nagios-wm>	 PROBLEM Disk Space is now: CRITICAL on scribunto.pmtpa.wmflabs 10.4.0.144 output: DISK CRITICAL - free space: / 286 MB (2% inode=74%):
[01:31:12] <labs-nagios-wm>	 PROBLEM Disk Space is now: WARNING on scribunto.pmtpa.wmflabs 10.4.0.144 output: DISK WARNING - free space: / 297 MB (3% inode=74%):
[01:50:22] <labs-nagios-wm>	 PROBLEM Current Load is now: WARNING on parsoid-roundtrip7-8core.pmtpa.wmflabs 10.4.1.26 output: WARNING - load average: 5.70, 5.65, 5.28
[02:08:43] <labs-nagios-wm>	 PROBLEM Disk Space is now: WARNING on nova-precise2.pmtpa.wmflabs 10.4.1.57 output: DISK WARNING - free space: / 531 MB (5% inode=80%):
[04:01:47] <devunt>	 !log
[04:02:47] <devunt>	 !log nginx build new instance: devunt-nginx
[04:33:22] <labs-nagios-wm>	 PROBLEM Current Load is now: WARNING on parsoid-roundtrip7-8core.pmtpa.wmflabs 10.4.1.26 output: WARNING - load average: 5.35, 5.33, 5.12
[04:38:23] <labs-nagios-wm>	 RECOVERY Current Load is now: OK on parsoid-roundtrip7-8core.pmtpa.wmflabs 10.4.1.26 output: OK - load average: 4.37, 4.77, 4.93
[04:38:33] <labs-nagios-wm>	 RECOVERY Free ram is now: OK on nova-precise2.pmtpa.wmflabs 10.4.1.57 output: OK: 20% free memory
[04:38:53] <labs-nagios-wm>	 RECOVERY Free ram is now: OK on sube.pmtpa.wmflabs 10.4.0.245 output: OK: 21% free memory
[04:46:53] <labs-nagios-wm>	 PROBLEM Free ram is now: WARNING on sube.pmtpa.wmflabs 10.4.0.245 output: Warning: 13% free memory
[05:06:33] <labs-nagios-wm>	 PROBLEM Free ram is now: WARNING on nova-precise2.pmtpa.wmflabs 10.4.1.57 output: Warning: 13% free memory
[05:58:43] <labs-nagios-wm>	 RECOVERY Disk Space is now: OK on nova-precise2.pmtpa.wmflabs 10.4.1.57 output: DISK OK
[06:28:25] <labs-nagios-wm>	 PROBLEM Total processes is now: WARNING on parsoid-roundtrip4-8core.pmtpa.wmflabs 10.4.0.39 output: PROCS WARNING: 152 processes
[06:53:22] <labs-nagios-wm>	 RECOVERY Total processes is now: OK on parsoid-roundtrip4-8core.pmtpa.wmflabs 10.4.0.39 output: PROCS OK: 148 processes
[07:30:53] <labs-nagios-wm>	 PROBLEM Free ram is now: CRITICAL on aggregator2.pmtpa.wmflabs 10.4.0.193 output: NRPE: Unable to read output
[07:36:32] <labs-nagios-wm>	 PROBLEM Current Load is now: UNKNOWN on aggregator2.pmtpa.wmflabs 10.4.0.193 output: NRPE: Call to fork() failed
[07:38:32] <labs-nagios-wm>	 PROBLEM dpkg-check is now: CRITICAL on aggregator2.pmtpa.wmflabs 10.4.0.193 output: CHECK_NRPE: Error - Could not complete SSL handshake.
[07:38:52] <labs-nagios-wm>	 PROBLEM Total processes is now: CRITICAL on aggregator2.pmtpa.wmflabs 10.4.0.193 output: CHECK_NRPE: Error - Could not complete SSL handshake.
[07:41:32] <labs-nagios-wm>	 PROBLEM Current Load is now: CRITICAL on aggregator2.pmtpa.wmflabs 10.4.0.193 output: CHECK_NRPE: Error - Could not complete SSL handshake.
[07:43:32] <labs-nagios-wm>	 RECOVERY dpkg-check is now: OK on aggregator2.pmtpa.wmflabs 10.4.0.193 output: All packages OK
[07:43:52] <labs-nagios-wm>	 RECOVERY Total processes is now: OK on aggregator2.pmtpa.wmflabs 10.4.0.193 output: PROCS OK: 155 processes
[07:45:53] <labs-nagios-wm>	 PROBLEM Free ram is now: WARNING on aggregator2.pmtpa.wmflabs 10.4.0.193 output: Warning: 10% free memory
[07:46:33] <labs-nagios-wm>	 RECOVERY Current Load is now: OK on aggregator2.pmtpa.wmflabs 10.4.0.193 output: OK - load average: 0.01, 0.17, 0.27
[08:41:33] <labs-nagios-wm>	 RECOVERY Free ram is now: OK on nova-precise2.pmtpa.wmflabs 10.4.1.57 output: OK: 20% free memory
[08:41:53] <labs-nagios-wm>	 RECOVERY Free ram is now: OK on sube.pmtpa.wmflabs 10.4.0.245 output: OK: 21% free memory
[08:49:32] <labs-nagios-wm>	 PROBLEM Free ram is now: WARNING on nova-precise2.pmtpa.wmflabs 10.4.1.57 output: Warning: 13% free memory
[08:59:53] <labs-nagios-wm>	 PROBLEM Free ram is now: WARNING on sube.pmtpa.wmflabs 10.4.0.245 output: Warning: 13% free memory
[09:54:32] <labs-nagios-wm>	 RECOVERY Disk Space is now: OK on wikidata-dev-9.pmtpa.wmflabs 10.4.1.41 output: DISK OK
[12:39:33] <labs-nagios-wm>	 RECOVERY Free ram is now: OK on nova-precise2.pmtpa.wmflabs 10.4.1.57 output: OK: 20% free memory
[12:39:53] <labs-nagios-wm>	 RECOVERY Free ram is now: OK on sube.pmtpa.wmflabs 10.4.0.245 output: OK: 21% free memory
[12:47:32] <labs-nagios-wm>	 PROBLEM Free ram is now: WARNING on nova-precise2.pmtpa.wmflabs 10.4.1.57 output: Warning: 19% free memory
[12:47:52] <labs-nagios-wm>	 PROBLEM Free ram is now: WARNING on sube.pmtpa.wmflabs 10.4.0.245 output: Warning: 13% free memory
[13:32:37] <hashar>	 !log integration Upgrading Gerrit on integration-jenkins2 to https://integration.mediawiki.org/nightly/gerrit/wmf/gerrit-2.5.1-1225-gd52acbc.war
[15:51:17] <wm-bot>	 [bz] (8ASSIGNED - created by: 2Antoine "hashar" Musso, priority: 4Normal - 6enhancement) [Bug 44041] Adapt varnish mobile puppet class on beta - https://bugzilla.wikimedia.org/show_bug.cgi?id=44041
[16:31:37] <wm-bot>	 [bz] (8ASSIGNED - created by: 2Antoine "hashar" Musso, priority: 4Normal - 6normal) [Bug 44424] wikiversions.cdb does not vary by realm - https://bugzilla.wikimedia.org/show_bug.cgi?id=44424
[16:32:37] <saper>	 ouch
[16:32:43] <saper>	 too colorful
[16:38:53] <hashar>	 :-D
[16:39:02] <hashar>	 I got yet another wikibugs bot laying somewhere
[16:39:09] <hashar>	 written in python and parsing the mail stream
[16:39:19] <hashar>	 but I guess that still not solve the root issue: having a hack on the mail servers
[16:39:33] <hashar>	 if only bugzilla produced a non-email stream we could consumem
[16:41:41] <saper>	 what's wrong with email?
[16:43:32] <Krenair>	 You have to parse emails.
[16:44:00] <^demon>	 Why don't we just use wm-bot.
[16:44:03] <^demon>	 It supports bugzilla.
[16:44:18] <^demon>	 I found this out yesterday and suggested it to Andre.
[16:44:22] <^demon>	 He seemed to like the idea.
[16:44:56] <^demon>	 How does wm-bot consume data?
[16:47:31] <Krenair>	 I thought it was using RSS or atom or something...? Could be wrong though.
[16:48:17] <^demon>	 Well as long as it's pretty much got feature parity with wikibugs, I'd say use that.
[16:48:29] <^demon>	 The hacks in place to support the current wikibugs are annoying.
[16:49:10] <^demon>	 How do we turn on bugzilla notifs from wm-bot in #mediawiki?
[16:49:18] <Krenair>	 petan, ^ ?
[17:16:29] <hashar>	 yeah the RSS thing is not ideal but is probably better than the mail hack :-]
[17:16:32] <hashar>	 that we please everyone
[17:16:34] <hashar>	 anyway
[17:16:35] <hashar>	 I am off
[17:16:38] <hashar>	 good weekend everyone
[17:35:39] <petan>	 ^demon to which bugs?
[17:36:02] <^demon>	 Everything in mediawiki and extensions?
[17:36:41] <^demon>	 We possibly need to talk about it on-list though before swapping.
[17:37:08] <petan>	 it already does that in #mediawiki-feed
[17:37:35] <petan>	 it parses bugs from RSS and that contains far less information than emails
[17:38:05] <petan>	 we should install some plugin to bugzilla so that it produces better feed
[17:38:26] <^demon>	 I wanna move the bot out of #mediawiki. I've been using #-feed but nobody else does.
[17:38:57] <petan>	 maybe people don't like bots at all :D so they all parted -feed
[17:39:01] <petan>	 there used to be some people in past
[17:39:03] <petan>	 like 2 :D
[17:39:21] <^demon>	 Well, if we silence bots in #mediawiki, people would have to use #-feed :p
[17:39:32] <petan>	 ok but we should make sure it really works
[17:39:37] <petan>	 it's kind of experimental now
[17:39:44] <petan>	 I gtg now
[17:39:56] <^demon>	 k, there's no rush.
[18:04:08] <petan>	 back
[18:04:53] <petan>	 ^demon first of all we should decide on how the output should look, it's very customizable now, but RSS feed doesn't produce so much
[18:05:29] <petan>	 in case some stuff that people really need to see wasn't available we need to find out a workaround for that
[18:15:56] <devunt>	 !log nginx new instance: nginx-devunt
[22:09:49] <dschoon>	 labs etherpad lite is down?
[22:22:53] <hashar>	 dschoon: http://etherpad.wmflabs.org/pad/p/works_for_me
[22:23:09] <hashar>	 dschoon: I am a few minutes late, but that works for me
[22:24:03] <dschoon>	 magic!
[22:24:14] <dschoon>	 i guess it fixed itself. woo.
[22:25:44] <hashar>	 maybe
[22:35:56] <Damianz>	 Wtf python, you can do greater than comparisons betwean an int and None