[10:17:48] <jinxer-wm>	 FIRING: PuppetFailure: Puppet has failed on ms-fe2009:9100 - https://puppetboard.wikimedia.org/nodes?status=failed - https://grafana.wikimedia.org/d/yOxVDGvWk/puppet - https://alerts.wikimedia.org/?q=alertname%3DPuppetFailure
[10:19:07] <Emperor>	 The last Puppet run was at Tue May 12 08:45:00 UTC 2026 (93 minutes ago). Puppet is disabled. jayme - jayme
[10:19:21] <jayme>	 o/
[10:19:27] <jayme>	 that's firing quick
[10:19:30] <jayme>	 I'm about to clean up
[10:19:47] <jayme>	 sorry for the noise
[10:19:53] <Emperor>	 jayme: OK, cool, just wanted to check it was expected, was a bit concerning :)
[10:20:37] <jayme>	 I'm testing the media ratelimit implementation there. Could have said so in advance, sorry
[10:20:54] <jayme>	 ofc. I did not think it would take that long
[10:21:22] <Emperor>	 No worries, but yeah, I'd have said please pick another frontend to mess with (that's one of the stat reporter hosts and the ring manager). 
[10:23:06] <jayme>	 oh, I wasn't aware it's special. Will switch to a different one then. Which one is special in eqiad?
[10:24:32] <Emperor>	 ms-fe1009
[10:26:15] <jayme>	 okidoke, will avoid that one as well then
[10:26:36] <Emperor>	 thanks :)
[10:28:48] <jayme>	 I've completed two consecutive successful puppet runs on ms-fe2009, recovery should come in soon I suppose
[10:32:48] <jinxer-wm>	 RESOLVED: PuppetFailure: Puppet has failed on ms-fe2009:9100 - https://puppetboard.wikimedia.org/nodes?status=failed - https://grafana.wikimedia.org/d/yOxVDGvWk/puppet - https://alerts.wikimedia.org/?q=alertname%3DPuppetFailure
[12:07:04] <jayme>	 Emperor: is there a way to test requests against a particular ms-fe?
[12:07:48] <jayme>	 like WikimediaDebug but for upload
[12:12:44] <Emperor>	 err, something simple you can use curl internally, but not more generally than that
[12:21:44] <jayme>	 ok