[13:51:05] Hi all, I'm looking for someone who I can chat about observability. On my mission to improve o11y in our company (I'm also in SRE), I stumbled upon Wikimedia's Grafana and I thought someone here might be willing to help. I'm looking to answer questions around standardisation, metrics, SLOs and doing observability education for engineers. [13:56:43] FIRING: BenthosKafkaConsumerLag: Too many messages in logging-eqiad for group benthos-mw-accesslog-metrics - TODO - https://grafana.wikimedia.org/d/000000484/kafka-consumer-lag?var-cluster=logging-eqiad&var-datasource=eqiad%20prometheus/ops&var-consumer_group=benthos-mw-accesslog-metrics - https://alerts.wikimedia.org/?q=alertname%3DBenthosKafkaConsumerLag [13:58:29] that'll clear shortly, temporary backlog due to centrallog host reboot [14:11:43] RESOLVED: BenthosKafkaConsumerLag: Too many messages in logging-eqiad for group benthos-mw-accesslog-metrics - TODO - https://grafana.wikimedia.org/d/000000484/kafka-consumer-lag?var-cluster=logging-eqiad&var-datasource=eqiad%20prometheus/ops&var-consumer_group=benthos-mw-accesslog-metrics - https://alerts.wikimedia.org/?q=alertname%3DBenthosKafkaConsumerLag [14:12:11] and codfw should do the same here soon [21:18:37] Thanks herron !