[03:42:09] 06Traffic, 06SRE, 13Patch-For-Review, 07User-notice: Block traffic from user-agents not honoring our policy - https://phabricator.wikimedia.org/T400119#11133550 (10tfmorris) >>! In T400119#11133180, @Tgr wrote: >>>! In T400119#11133146, @tfmorris wrote: >> Note that returning a plain text error message to... [05:21:15] 06Traffic, 06Commons, 06DBA, 06SRE: Unable to save edits or delete pages on Commons – database lag - https://phabricator.wikimedia.org/T402749#11133565 (10Zache) >>! In T402749#11123303, @Ladsgroup wrote: > I suggest something even more radical: Move CAL (and HotCat) to core I am not against this per... [12:46:43] FIRING: [12x] HaproxyKafkaSocketDroppedMessages: Unexpected rate of dropped messages from HaproxyKafka - https://wikitech.wikimedia.org/wiki/HAProxyKafka#HaproxyKafkaSocketDroppedMessages - https://alerts.wikimedia.org/?q=alertname%3DHaproxyKafkaSocketDroppedMessages [12:51:43] RESOLVED: [26x] HaproxyKafkaSocketDroppedMessages: Unexpected rate of dropped messages from HaproxyKafka - https://wikitech.wikimedia.org/wiki/HAProxyKafka#HaproxyKafkaSocketDroppedMessages - https://alerts.wikimedia.org/?q=alertname%3DHaproxyKafkaSocketDroppedMessages [17:42:34] 06Traffic, 06SRE, 13Patch-For-Review, 07User-notice: Block traffic from user-agents not honoring our policy - https://phabricator.wikimedia.org/T400119#11134002 (10DavidBrooks) Re-upping a question I had earlier - will the servers' "Retry-After" header use seconds, or http-date, or potentially either? Of c... [18:01:11] 06Traffic, 06SRE, 13Patch-For-Review, 07User-notice: Block traffic from user-agents not honoring our policy - https://phabricator.wikimedia.org/T400119#11134004 (10Vgutierrez) >>! In T400119#11134002, @DavidBrooks wrote: > Re-upping a question I had earlier - will the servers' "Retry-After" header use seco... [18:31:00] FIRING: PurgedHighEventLag: High event process lag with purged on cp5031:2112 - https://wikitech.wikimedia.org/wiki/Purged#Alerts - https://grafana.wikimedia.org/d/RvscY1CZk/purged?var-datasource=eqsin%20prometheus/ops&var-instance=cp5031 - https://alerts.wikimedia.org/?q=alertname%3DPurgedHighEventLag [18:36:00] RESOLVED: [2x] PurgedHighEventLag: High event process lag with purged on cp5031:2112 - https://wikitech.wikimedia.org/wiki/Purged#Alerts - https://grafana.wikimedia.org/d/RvscY1CZk/purged?var-datasource=eqsin%20prometheus/ops&var-instance=cp5031 - https://alerts.wikimedia.org/?q=alertname%3DPurgedHighEventLag