[08:39:16] 06Traffic, 06collaboration-services, 06Release-Engineering-Team, 06SRE, 05WMF-NDA: Move GitLab behind the CDN - https://phabricator.wikimedia.org/T366882 (10Jelto) 03NEW [09:00:10] 06Traffic, 06collaboration-services, 06Release-Engineering-Team, 06SRE, and 2 others: Move GitLab behind the CDN - https://phabricator.wikimedia.org/T366882#9870324 (10Jelto) [09:37:55] 06Traffic, 06collaboration-services, 06Release-Engineering-Team, 06SRE, 13Patch-For-Review: Move GitLab behind the CDN - https://phabricator.wikimedia.org/T366882#9870408 (10Peachey88) [10:17:32] 06Traffic: Upgrade HAProxy to version 3 on cp hosts - https://phabricator.wikimedia.org/T366885 (10Fabfur) 03NEW [10:18:44] 06Traffic: Backport HAProxy 3.0 to Bullseye - https://phabricator.wikimedia.org/T366887 (10Fabfur) 03NEW [10:20:13] 06Traffic: Check production configuration compatibility with HAProxy 3.0 - https://phabricator.wikimedia.org/T366888 (10Fabfur) 03NEW [10:21:48] 06Traffic: Create new haproxy30 component and import bullseye package - https://phabricator.wikimedia.org/T366890 (10Fabfur) 03NEW [10:22:32] 06Traffic: HAProxy 3.0 production rollout - https://phabricator.wikimedia.org/T366891 (10Fabfur) 03NEW [17:12:36] 10netops, 06DC-Ops, 06Infrastructure-Foundations, 10ops-codfw, 06SRE: Codfw row C/D switch installation & configuration - https://phabricator.wikimedia.org/T364095#9871635 (10ops-monitoring-bot) Icinga downtime and Alertmanager silence (ID=4f6d5735-139a-4c58-be67-6179e7c2ab71) set by cmooney@cumin1002 fo... [17:15:30] 10netops, 06DC-Ops, 06Infrastructure-Foundations, 10ops-codfw, 06SRE: Codfw row C/D switch installation & configuration - https://phabricator.wikimedia.org/T364095#9871642 (10cmooney) @Jhancock.wm can you make sure to set the links to status "connected" in Netbox as they are added? And add the circuit I... [17:28:54] 10netops, 06DC-Ops, 06Infrastructure-Foundations, 10ops-codfw, 06SRE: Codfw row C/D switch installation & configuration - https://phabricator.wikimedia.org/T364095#9871683 (10ops-monitoring-bot) Icinga downtime and Alertmanager silence (ID=ef0faea2-9357-469a-a5c3-aa5b1c50c748) set by cmooney@cumin1002 fo... [17:40:09] 10netops, 06DC-Ops, 06Infrastructure-Foundations, 10ops-codfw, 06SRE: codfw row C/D upgrade racking task - https://phabricator.wikimedia.org/T360789#9871721 (10cmooney) I tried to bring the //ssw1-d8-codfw// link to //cr2-codfw// up, but it doesn't look ready? Ticked above, but checking on cr2-codfw the... [19:09:11] 06Traffic, 06DC-Ops, 10ops-ulsfo, 06SRE: Q4: install PCIe NVMe SSDs into ulsfo text cp40(3[789]|4[01234] - https://phabricator.wikimedia.org/T364891#9871917 (10BCornwall) A problem that we may potentially run into is predictable device naming being different than in previous deployments. We have different... [19:49:52] 10netops, 06Infrastructure-Foundations, 06SRE: Move asw-c-codfw and asw-d-codfw CR uplinks to Spine switches - https://phabricator.wikimedia.org/T366941 (10cmooney) 03NEW p:05Triage→03Medium [19:50:26] 10netops, 06DC-Ops, 06Infrastructure-Foundations, 10ops-codfw, 06SRE: Codfw row C/D switch installation & configuration - https://phabricator.wikimedia.org/T364095#9872013 (10cmooney) [19:50:27] 10netops, 06Infrastructure-Foundations, 06SRE: Move asw-c-codfw and asw-d-codfw CR uplinks to Spine switches - https://phabricator.wikimedia.org/T366941#9872014 (10cmooney) [19:52:32] 10netops, 06Infrastructure-Foundations, 06SRE: Switch BGP (EVPN) topology between rows/spines at core sites - https://phabricator.wikimedia.org/T365169#9872018 (10cmooney) 05Open→03Resolved Folk seem happy enough with this approach so I'll close this, automation has been added and working. [19:53:04] 10netops, 06Infrastructure-Foundations, 06SRE: Move asw-c-codfw and asw-d-codfw CR uplinks to Spine switches - https://phabricator.wikimedia.org/T366941#9872015 (10cmooney) [19:59:11] 10netops, 06Infrastructure-Foundations, 06SRE: Move asw-c-codfw and asw-d-codfw CR uplinks to Spine switches - https://phabricator.wikimedia.org/T366941#9872044 (10cmooney)