[01:05:59] <wikibugs>	 10Traffic, 10Operations, 10Performance-Team (Radar): Support brotli compression - https://phabricator.wikimedia.org/T137979 (10Krinkle) >>! In T137979#4118215, @BBlack wrote: > Re-reading above: probably the better blend of options would be to swap gzip for brotli in Varnish one-for-one (without the whole st...
[01:06:10] <wikibugs>	 10Traffic, 10Operations, 10Performance-Team (Radar): Support brotli compression - https://phabricator.wikimedia.org/T137979 (10Krinkle) p:05Low→03Normal
[17:41:34] <cdanis>	 does anyone else think that the non-paging (IRC-only) alerts for traffic availability are perhaps too sensitive?  alerting #wikimedia-operations for 20rps of 500s over four minutes is a bit much
[20:18:46] <bblack>	 yeah they're arguably too noisy in the sense that they're often not emergencies, but then that's why they're not paging too
[20:19:21] <bblack>	 but it's also arguable that they all represent some kind of "real" problem that should be troubleshot/eliminated before it gets worse
[20:19:48] <bblack>	 it's tough call subjectively on where you draw the line an alerting
[20:20:36] <bblack>	 20rps is "nothing" out of our grand total average of ~100k, but it's also not just some unavoidable singular transient either
[20:20:55] <bblack>	 it does mean that 20 times per second, something went wrong for some user somewhere in the world
[20:21:49] <bblack>	 In an ideal world we'd be so perfectly-built that individual 5xx's would be alerts, but we're nowhere near that (nor is anyone else I imagine)
[20:22:31] <bblack>	 making them less-visible means they'll probably get even less attention