[06:22:09] <jynus>	 handling T404940
[06:22:09] <stashbot>	 T404940: es2027 database unhealthy - https://phabricator.wikimedia.org/T404940
[07:54:40] <arnaudb>	 heads-up: we're switching gerrit's httpd mod_qos from log-only to enforcing (with max 25 connection per client IP) for non identified clients, our internal ranges are excluded from those limits, following nftables throttling pattern. I'll rollout from spare to primary, let me know if you see anything odd!
[07:55:12] <jelto>	 👀
[08:05:13] <fabfur>	 👍
[08:09:33] <jynus>	 thanks
[15:55:47] <jasmine_>	 hi folks, just a reminder that we'll be starting the dc switchover livetest shortly
[15:57:17] <swfrench-wmf>	 cdanis: (and me I guess, heh) FYI ^
[15:57:24] <cdanis>	 :D
[15:59:28] <rzl>	 hoping it's exactly as lively as planned
[16:48:11] <jasmine_>	 alrighty we're in the clear :)
[16:48:41] <Krinkle>	 brett: Today's rollout (fawiki and metawiki): https://gerrit.wikimedia.org/r/1189510  I'll be around next 4 hours or so. Let me know when works best.
[16:49:23] <brett>	 Good to go now
[16:51:48] <swfrench-wmf>	 nicely done, jasmine_!
[16:53:59] <brett>	 I'm going to roll out in 30 when k comes back from afk
[16:58:20] <jasmine_>	 swfrench-wmf: ty! 
[16:59:26] <jasmine_>	 h.nowlan, swfrecnh-wmf: and thanks to you two for reverse shadowing! much much appreciated~
[17:12:54] <hnowlan>	 jasmine_: good job o> 
[17:26:44] <Krinkle>	 brett: back :)
[17:48:00] <andrewbogott>	 godog, elukey, Amir1, jayme, there are several debian Buster VMs in the 'pki' cloud-vps project (created by jbond I think).  Is it OK if I delete them? We're trying to clean up Buster remnants there.
[17:51:32] <brett>	 Krinkle: Gonna roll out now
[17:51:36] <Krinkle>	 ack
[17:52:31] <andrewbogott>	 https://phabricator.wikimedia.org/T405017
[18:00:53] <brett>	 Krinkle: fully rolled
[18:02:09] <Krinkle>	 thanks
[19:15:19] <inflatador>	 Does anyone know if there is a way to exempt specific systemd units from alerts, ideally based on a path/regex?
[19:18:10] <mutante>	 inflatador: the systemd::service define has a parameter $monitoring_enabled  
[19:18:50] <mutante>	 and others to change the contact_group and whether it's considered CRIT or not
[19:19:26] <inflatador>	 mutante thanks, will take a look at that
[19:20:41] <mutante>	 :) now that you ask, I should have used this myself today before enabling a new service which then alerted, heh
[19:23:46] <inflatador>	 ~_^