[00:27:40] FIRING: [8x] VarnishHighThreadCount: Varnish's thread count on cp5017:0 is high - https://wikitech.wikimedia.org/wiki/Varnish - https://alerts.wikimedia.org/?q=alertname%3DVarnishHighThreadCount [00:37:40] FIRING: [9x] VarnishHighThreadCount: Varnish's thread count on cp5017:0 is high - https://wikitech.wikimedia.org/wiki/Varnish - https://alerts.wikimedia.org/?q=alertname%3DVarnishHighThreadCount [00:42:40] FIRING: [16x] VarnishHighThreadCount: Varnish's thread count on cp5017:0 is high - https://wikitech.wikimedia.org/wiki/Varnish - https://alerts.wikimedia.org/?q=alertname%3DVarnishHighThreadCount [00:57:40] FIRING: [8x] VarnishHighThreadCount: Varnish's thread count on cp5017:0 is high - https://wikitech.wikimedia.org/wiki/Varnish - https://alerts.wikimedia.org/?q=alertname%3DVarnishHighThreadCount [01:02:40] RESOLVED: [8x] VarnishHighThreadCount: Varnish's thread count on cp5017:0 is high - https://wikitech.wikimedia.org/wiki/Varnish - https://alerts.wikimedia.org/?q=alertname%3DVarnishHighThreadCount [15:12:22] 06Traffic, 10conftool, 10Sustainability (Incident Followup): Research allowing read-only access to the superset api from requestctl's web UI - https://phabricator.wikimedia.org/T379718#10406370 (10Joe) I would frankly go with option 1 so we are more flexible - I want to authenticate on this second superset i... [15:20:14] 06Traffic, 10conftool, 10HIDDENPARMA, 07Epic: [EPIC] FY 24/25 WE 4.3.7 Roll out a user-friendly web application that enables assisted editing and creation of requestctl rules - https://phabricator.wikimedia.org/T377699#10406393 (10Joe) [16:09:48] FIRING: PuppetZeroResources: Puppet has failed generate resources on cp7005:9100 - https://puppetboard.wikimedia.org/nodes?status=failed - https://grafana.wikimedia.org/d/yOxVDGvWk/puppet - https://alerts.wikimedia.org/?q=alertname%3DPuppetZeroResources [16:10:48] FIRING: [2x] PuppetZeroResources: Puppet has failed generate resources on cp5028:9100 - https://puppetboard.wikimedia.org/nodes?status=failed - https://grafana.wikimedia.org/d/yOxVDGvWk/puppet - https://alerts.wikimedia.org/?q=alertname%3DPuppetZeroResources [16:54:48] RESOLVED: PuppetZeroResources: Puppet has failed generate resources on cp7005:9100 - https://puppetboard.wikimedia.org/nodes?status=failed - https://grafana.wikimedia.org/d/yOxVDGvWk/puppet - https://alerts.wikimedia.org/?q=alertname%3DPuppetZeroResources [16:56:02] RESOLVED: [2x] PuppetZeroResources: Puppet has failed generate resources on cp5028:9100 - https://puppetboard.wikimedia.org/nodes?status=failed - https://grafana.wikimedia.org/d/yOxVDGvWk/puppet - https://alerts.wikimedia.org/?q=alertname%3DPuppetZeroResources [17:06:32] 10netops, 10HIDDENPARMA, 06Infrastructure-Foundations: Reduce the steps needed to deploy hiddenparma - https://phabricator.wikimedia.org/T382268 (10Joe) 03NEW [17:12:16] 10netops, 10HIDDENPARMA, 06Infrastructure-Foundations, 10Prod-Kubernetes, 07Kubernetes: Allow reaching services on the aux k8s cluster bypassing the CDN - https://phabricator.wikimedia.org/T382269 (10Joe) 03NEW [18:11:04] 06Traffic, 10Sustainability (Incident Followup): Pass Wikimedia Enterprise HEAD requests to ATS - https://phabricator.wikimedia.org/T382274#10407058 (10BCornwall) [18:13:10] 06Traffic, 10Sustainability (Incident Followup): Pass Wikimedia Enterprise HEAD requests to ATS - https://phabricator.wikimedia.org/T382274#10407064 (10BCornwall) @bblack proposes something like P71676, which, while untested, hooks vcl_miss() so that we only trigger this behavior when we don't already have the... [18:18:28] 06Traffic: Add Wikimedia Enterprise IPs as an ipblock in requestctl - https://phabricator.wikimedia.org/T382275 (10BCornwall) 03NEW [18:18:33] 06Traffic: Add Wikimedia Enterprise IPs as an ipblock in requestctl - https://phabricator.wikimedia.org/T382275#10407083 (10BCornwall) p:05Triage→03Low [18:23:34] 06Traffic, 10Sustainability (Incident Followup): Implement HEAD→GET caching logic implemented against WME globally - https://phabricator.wikimedia.org/T382276 (10BCornwall) 03NEW [18:23:43] 06Traffic, 10Sustainability (Incident Followup): Implement HEAD→GET caching logic implemented against WME globally - https://phabricator.wikimedia.org/T382276#10407102 (10BCornwall) p:05Triage→03Low [18:25:13] 06Traffic, 10Sustainability (Incident Followup): Add Wikimedia Enterprise IPs as an ipblock in requestctl - https://phabricator.wikimedia.org/T382275#10407114 (10BCornwall) [22:06:07] hello traffic friends, would anyone be interested in reviewing a small unit-test-only ATS Lua patch? (adds a test case to the suite for a not-yet-deployed script) [22:09:59] I think the traffic team is mostly sick/pto/ooo, but if you want to send I'll have a look tomorrow morning! [22:14:53] this is not urgent at all, so it can definitely wait (also sorry to hear folks are sick!) [22:17:44] https://gerrit.wikimedia.org/r/1101104 is the patch in question, but to emphasize, not at all urgent :)