[09:52:43] tappof: prometheus3004 is created, all your's! [09:55:30] thx moritzm, I’ll take care of migrating this afternoon. [09:55:47] excellent, thanks [10:43:40] and feel free to add me to any patches as reviewer if that helps [13:50:22] hello! I've added a new thing to help us shed some abuse away on Gerrit with httpd while we work on moving it behind the CDN, I've worked on mod-qos (which we use to drop some abusers) observability and I ended up having to use alloy which I don't think we're using anywhere.is there a better way for me to create metrics from httpd logs? (My current [13:50:22] prototype uses this config: https://w.wiki/FEx5) [14:25:34] Hi Arnaud! For generating metrics from logs (not forwarded to logstash), we have mtail provisioned several places in the fleet. [14:35:50] thanks cwhite, I'll dig into it :) [15:55:12] FIRING: ThanosQueryHttpRequestQueryRangeErrorRateHigh: Thanos Query is failing to handle requests. - https://wikitech.wikimedia.org/wiki/Thanos#Alerts - https://grafana.wikimedia.org/d/af36c91291a603f1d9fbdabdd127ac4a/thanos-query - https://alerts.wikimedia.org/?q=alertname%3DThanosQueryHttpRequestQueryRangeErrorRateHigh [16:00:12] RESOLVED: ThanosQueryHttpRequestQueryRangeErrorRateHigh: Thanos Query is failing to handle requests. - https://wikitech.wikimedia.org/wiki/Thanos#Alerts - https://grafana.wikimedia.org/d/af36c91291a603f1d9fbdabdd127ac4a/thanos-query - https://alerts.wikimedia.org/?q=alertname%3DThanosQueryHttpRequestQueryRangeErrorRateHigh