[01:04:34] <wikibugs>	 10Wikimedia-Apache-configuration, 10SRE, 10serviceops: Investigate and restore K.A.Z httpbb test - https://phabricator.wikimedia.org/T289022 (10RLazarus)
[05:07:28] <wikibugs>	 10Traffic, 10Anti-Harassment, 10SRE: Enable automatic redirection to the mobile version of votewiki - https://phabricator.wikimedia.org/T288938 (10phuedx) Many thanks to @ssingh and #traffic for the very quick turnaround.  >>! In T288938#7284430, @phuedx wrote: > @dom_walden noted that after he'd jumped from...
[06:23:58] <wikibugs>	 10netops, 10Infrastructure-Foundations: cr2-eqdfw: PEM 1 Not Powered - https://phabricator.wikimedia.org/T289028 (10ayounsi) p:05Triage→03High
[06:24:16] <wikibugs>	 10netops, 10Infrastructure-Foundations, 10ops-eqdfw: cr2-eqdfw: PEM 1 Not Powered - https://phabricator.wikimedia.org/T289028 (10ayounsi)
[08:04:29] <wikibugs>	 10Traffic, 10SRE Observability: Use Grizzly for Varnish SLO Grafana dashboard - https://phabricator.wikimedia.org/T289036 (10ema)
[08:04:44] <wikibugs>	 10Traffic, 10SRE Observability: Use Grizzly for Varnish SLO Grafana dashboard - https://phabricator.wikimedia.org/T289036 (10ema) p:05Triage→03Medium
[09:37:56] <wikibugs>	 10netops, 10DC-Ops, 10Infrastructure-Foundations, 10SRE: (Need By: TBD) rack/setup/install atlas-codfw.wikimedia.org - https://phabricator.wikimedia.org/T273114 (10cmooney) @robh no problem I will document the process there once it is fully clear to me.  Update for now is that RIPE have gotten back to me a...
[10:03:11] <godog>	 vgutierrez: hi, I'm running nginx (swift) in Bullseye and the ssl ecdhe variable isn't available, safe to say I can disable it altogether for swift hosts ?
[10:03:53] <vgutierrez>	 godog: I guess you suffered the same issue with buster as well
[10:04:21] <vgutierrez>	 and yes, it's safe to disable it
[10:04:43] <godog>	 ok thanks ! yeah no idea re: buster because we're skipping it for swift
[10:05:00] <vgutierrez>	 gotcha :)
[10:05:52] <godog>	 also I guess an arguably better but more invasive solution would be to switch to envoy to terminate ssl heh
[10:06:01] <godog>	 disabling ecdhe for now will do
[10:34:25] <wikibugs>	 10netops, 10Infrastructure-Foundations, 10SRE, 10ops-eqdfw: cr2-eqdfw: PEM 1 Not Powered - https://phabricator.wikimedia.org/T289028 (10ayounsi) 05Open→03Resolved Nevermind. It was an Equinix maintenance, it's now back to normal.
[12:21:11] <question_mark>	 I created a pad for the traffic meeting today: https://etherpad.wikimedia.org/p/Traffic-2021-08-17
[12:21:43] <question_mark>	 please add your topics or roundtable items :)
[12:25:08] <wikibugs>	 10netops, 10DC-Ops, 10Infrastructure-Foundations, 10SRE: (Need By: TBD) rack/setup/install atlas-codfw.wikimedia.org - https://phabricator.wikimedia.org/T273114 (10cmooney) RIPE have emailed back to confirm registration and provided image download `  From: RIPE Atlas (no reply) [mailto:no-reply@ripe.net] S...
[12:25:30] <wikibugs>	 10netops, 10DC-Ops, 10Infrastructure-Foundations, 10SRE: (Need By: TBD) rack/setup/install atlas-codfw.wikimedia.org - https://phabricator.wikimedia.org/T273114 (10cmooney)
[15:03:29] <vgutierrez>	 it looks like our own VCL was tricking me: https://gerrit.wikimedia.org/r/c/operations/puppet/+/713482, that should fix it
[15:05:25] <vgutierrez>	 maybe I should submit a few tests with that CR
[15:05:37] <ema>	 <3
[15:05:41] <vgutierrez>	 bblack: re XCPS, right now on envoy https://gerrit.wikimedia.org/r/c/operations/puppet/+/713272/2/modules/profile/files/cache/envoy.lua#7 I'm setting SSR to 2 to flag it as unknown, should I mark all of them as new (0) or modify the VCL to allow the new value?
[15:26:12] <vgutierrez>	 hmmm ema do you know if I can mock client.ip with varnishtest?
[15:29:51] <ema>	 vgutierrez: good question, I don't think so! Take a look at `man 7 vtc` though
[15:30:40] <ema>	 and look for client.ip in the varnish repo (under bin/varnishtest/tests/)
[15:31:58] <vgutierrez>	 so -proxy1 on the client allows to inject PROXYv1 traffic
[15:32:13] <vgutierrez>	 so that effectively lets me control client.ip and server.ip
[15:32:38] <vgutierrez>	 but I don't know if it's going to allow me to set it as 0.0.0.0
[15:34:52] <vgutierrez>	 hmmm
[15:34:56] <vgutierrez>	 even better
[15:35:05] <vgutierrez>	 it looks like I can mock a client that connects to a server using UDS
[15:35:23] <vgutierrez>	 server s2 -repeat 2 -listen "${tmpdir}/s2.sock"
[15:35:30] <vgutierrez>	 that should do it
[15:50:03] <vgutierrez>	 and same for varnish of course
[16:02:39] <wikibugs>	 10netops, 10Infrastructure-Foundations, 10SRE, 10decommission-hardware, 10ops-eqiad: Decommission asw-c-eqiad - https://phabricator.wikimedia.org/T208734 (10Cmjohnson) 05Open→03Resolved Removed the serial console port (port 9) for old asw-c1.resolving
[16:05:15] <ema>	 vgutierrez: nice! I'm off for the day, tty tomorrow o/
[16:11:03] <wikibugs>	 10netops, 10Infrastructure-Foundations, 10SRE, 10ops-eqiad: Switch failure: asw2-a8-eqiad Aug 13th 2021 - https://phabricator.wikimedia.org/T288834 (10Cmjohnson) @ayounsi Did the fiber swap fix the issue or do we need to change optics?
[17:04:32] <wikibugs>	 10netops, 10Infrastructure-Foundations, 10SRE, 10ops-eqiad: Switch failure: asw2-a8-eqiad Aug 13th 2021 - https://phabricator.wikimedia.org/T288834 (10cmooney) Hey @Cmjohnson.  Link has been clean since, but it often goes a few weeks without issues, so we probably want to wait just to be sure.  So far so g...