[09:37:00] 06Traffic, 10requestctl, 06serviceops, 07Sustainability (Incident Followup): requestctl clearing all fields on error is not user-friendly when combined with stricter checking - https://phabricator.wikimedia.org/T406309 (10MatthewVernon) 03NEW [09:37:31] 06Traffic, 10requestctl, 06serviceops, 07Sustainability (Incident Followup): requestctl clearing all fields on error is not user-friendly when combined with stricter checking - https://phabricator.wikimedia.org/T406309#11239961 (10MatthewVernon) [10:27:11] 10netops, 06Infrastructure-Foundations, 06SRE: Eqiad: row C/D switch refresh configuration task - https://phabricator.wikimedia.org/T402588#11240440 (10ops-monitoring-bot) Icinga downtime and Alertmanager silence (ID=da4ec6fc-e51f-4967-b0f1-8ef51813239b) set by cmooney@cumin1003 for 0:10:00 on 5 host(s) and... [11:49:10] 06Traffic, 10requestctl, 06serviceops, 07Sustainability (Incident Followup): requestctl clearing all fields on error is not user-friendly when combined with stricter checking - https://phabricator.wikimedia.org/T406309#11240694 (10Aklapper) [12:31:17] 10netops, 06DC-Ops, 06Infrastructure-Foundations, 10ops-eqiad, 06SRE: Eqiad C/D refresh: 2 x test hosts for config validation - https://phabricator.wikimedia.org/T405560#11240827 (10Jclark-ctr) I have pulled 2 Servers from decom i have wiped all configs from them and racked and cabled sretest1005 Rack... [13:30:47] 10netops, 06DC-Ops, 06Infrastructure-Foundations, 10ops-eqiad, and 2 others: Eqiad C/D refresh: 2 x test hosts for config validation - https://phabricator.wikimedia.org/T405560#11241087 (10cmooney) >>! In T405560#11240827, @Jclark-ctr wrote: > I have pulled 2 Servers from decom i have wiped all configs fro... [14:19:29] 06Traffic, 10observability, 06SRE: HAProxy metrics go down on config reload - https://phabricator.wikimedia.org/T343000#11241282 (10ssingh) Can someone help me double-check if this is still a problem? I don't see it in the dashboards above, selecting a more recent time interval. [14:20:53] 06Traffic, 10Maps, 06SRE: Allow Wikimedia Maps usage on Wikidata for Firefox (Browser extension) - https://phabricator.wikimedia.org/T398588#11241295 (10ssingh) @Shisma: Hi, this still needs a Wikimedia affiliate approval as per https://lists.wikimedia.org/pipermail/maps-l/2020-August/001729.html. Can you pr... [14:22:25] 06Traffic, 10Hiddenparma, 10requestctl, 06serviceops, 07Sustainability (Incident Followup): requestctl clearing all fields on error is not user-friendly when combined with stricter checking - https://phabricator.wikimedia.org/T406309#11241318 (10Scott_French) It's certainly the intention of the code to [... [14:28:18] 06Traffic, 10observability, 06SRE: HAProxy metrics go down on config reload - https://phabricator.wikimedia.org/T343000#11241334 (10Vgutierrez) yes, it's still hapenning https://grafana.wikimedia.org/goto/SHdP6s3HR?orgId=1: {F66723380} I believe this will be fixed when we upgrade to HAProxy 3.0 given it pro... [14:29:31] 06Traffic, 10observability, 06SRE: HAProxy metrics go down on config reload - https://phabricator.wikimedia.org/T343000#11241339 (10ssingh) >>! In T343000#11241334, @Vgutierrez wrote: > yes, it's still hapenning https://grafana.wikimedia.org/goto/SHdP6s3HR?orgId=1: {F66723380} > > I believe this will be fix... [14:44:09] 06Traffic: Consider using the alternate chain of Google Trust Services certificates - https://phabricator.wikimedia.org/T398596#11241379 (10ssingh) 05Open→03Stalled We will be resuming work on this in Q3 2025-2026. [15:28:46] 06Traffic, 06Data-Engineering, 06Data-Engineering-Radar, 13Patch-For-Review: improved x-analytics data on Edge Uniques status - https://phabricator.wikimedia.org/T405783#11241706 (10CDanis) Will deploy Puppet patches on Monday. [15:44:05] 06Traffic, 10Hiddenparma, 10requestctl, 06serviceops, 07Sustainability (Incident Followup): requestctl clearing all fields on error is not user-friendly when combined with stricter checking - https://phabricator.wikimedia.org/T406309#11241796 (10Scott_French) 05Open→03Resolved a:03Scott_French... [16:20:16] 06Traffic, 06DC-Ops, 10ops-codfw, 06SRE, 13Patch-For-Review: Q4:rack/setup/install cp20[43-58] codfw - https://phabricator.wikimedia.org/T392851#11242196 (10elukey) Status update: I was able to upgrade idrac+bios of most of the cp hosts, I'll review the remaining ones on Monday and I'll give a precise li... [16:21:18] 06Traffic, 10Phabricator, 06Release-Engineering-Team (Radar): Phabricator videos fail in Firefox ("Range" request gets 503 from Varnish) - https://phabricator.wikimedia.org/T397661#11242201 (10Aklapper) I have not managed yet to reproduce either. Is this still an issue that folks experience? [16:21:28] 06Traffic, 06DC-Ops, 10ops-codfw, 06SRE, 13Patch-For-Review: Q4:rack/setup/install cp20[43-58] codfw - https://phabricator.wikimedia.org/T392851#11242202 (10ssingh) >>! In T392851#11242196, @elukey wrote: > Status update: I was able to upgrade idrac+bios of most of the cp hosts, I'll review the remaining... [17:26:15] 06Traffic, 10Phabricator, 06Release-Engineering-Team (Radar): Phabricator videos fail in Firefox ("Range" request gets 503 from Varnish) - https://phabricator.wikimedia.org/T397661#11242382 (10A_smart_kitten) Yeah, I can still repro on a couple of devices: for me in Firefox on Windows I experience what's des...