[07:23:03] 10netops, 06collaboration-services, 06DC-Ops, 06Infrastructure-Foundations, and 2 others: Migrate servers in codfw racks D5 & D6 from asw to lsw - https://phabricator.wikimedia.org/T373104#10147444 (10ABran-WMF) [] db2129: cm s6 T374806→switchback [] db2140: m s4 T374804 [] db2218: m s7 T374807 [07:23:57] 10netops, 06DC-Ops, 06Infrastructure-Foundations, 10ops-codfw, 06SRE: Migrate servers in codfw racks D3 & D4 from asw to lsw - https://phabricator.wikimedia.org/T373103#10147440 (10ABran-WMF) [] db2213: m s5 T374805 [] db2214: m s6 T374806 [07:24:11] 10netops, 06collaboration-services, 06DC-Ops, 06Infrastructure-Foundations, and 3 others: Migrate servers in codfw racks D7 & D8 from asw to lsw - https://phabricator.wikimedia.org/T373105#10147456 (10ABran-WMF) [] db2220: cm s7 T374807→switchback [08:19:45] 10netops, 10fundraising-tech-ops, 06Infrastructure-Foundations: Test prototype fundraising pybal replacement based on haproxy + anycast-healthchecker. - https://phabricator.wikimedia.org/T373942#10147625 (10ayounsi) Catching up on backlog, I think {T374803} is related. [08:57:29] 10netops, 06Infrastructure-Foundations, 06SRE: Enable BFD on 'core' EBGP peerings from L3 switches to CRs - https://phabricator.wikimedia.org/T374452#10147824 (10ayounsi) Not sure it's worth it for direct (short) links. The tradeoff is to rely on an extra protocol, extra config, and adding load on the device... [09:02:34] 10netops, 06Infrastructure-Foundations, 06SRE: ToR server-move Netbox script adding ".0" to end of interface names - https://phabricator.wikimedia.org/T374024#10147850 (10ayounsi) @cmooney thanks for your patch ! is there something left to do on this ? [09:26:48] 10netops, 06Infrastructure-Foundations, 06SRE: Cloud IPv6 subnets - https://phabricator.wikimedia.org/T187929#10147916 (10ayounsi) Awesome, great to see progress here ! [09:31:18] 10netops, 06Infrastructure-Foundations, 06SRE: Cloud IPv6 subnets - https://phabricator.wikimedia.org/T187929#10147929 (10aborrero) 05Open→03Resolved a:03aborrero it seems there is agreement in the addressing plan. Marking as resolved, will work on {T374712} next. [09:42:01] 10netops, 06Infrastructure-Foundations, 06SRE: Create alerting for saturation on sub-rated interfaces - https://phabricator.wikimedia.org/T374614#10147994 (10ayounsi) Short term I think if you add `[4Gbps]` to the interface description, LibreNMS will [[ https://docs.librenms.org/Extensions/Interface-Descript... [10:48:09] 10netops, 06Traffic, 06Infrastructure-Foundations, 06SRE: Alert when anycast-healthchecker withdraws BGP route - https://phabricator.wikimedia.org/T374619#10148385 (10ayounsi) Note that the Bird exporter is already up and running: https://grafana.wikimedia.org/d/dxbfeGDZk/anycast We could in theory correl... [11:23:44] 10netops, 06Infrastructure-Foundations, 06SRE: netbox: create IPv6 entries for Cloud VPS - https://phabricator.wikimedia.org/T374712#10148509 (10aborrero) p:05Triage→03Medium [11:32:42] 10netops, 06DC-Ops, 06Infrastructure-Foundations, 10ops-codfw, 06SRE: Migrate servers in codfw racks D3 & D4 from asw to lsw - https://phabricator.wikimedia.org/T373103#10148524 (10ABran-WMF) all hosts are depoolable for this task [13:20:35] 10netops, 10fundraising-tech-ops, 06Infrastructure-Foundations, 13Patch-For-Review: Test prototype fundraising pybal replacement based on haproxy + anycast-healthchecker. - https://phabricator.wikimedia.org/T373942#10148844 (10Jgreen) [14:23:02] 10netops, 06DC-Ops, 10fundraising-tech-ops, 06Infrastructure-Foundations, and 2 others: codfw:frack:rack/install/configuration new switches - https://phabricator.wikimedia.org/T374587#10149067 (10ayounsi) Those won't be in a VC, especially as we didn't pay for the extra VC license :) This means a bit more... [20:28:53] 10netops, 06DC-Ops, 10fundraising-tech-ops, 06Infrastructure-Foundations, and 2 others: codfw:frack:rack/install/configuration new switches - https://phabricator.wikimedia.org/T374587#10150834 (10Papaul) [21:09:17] 06Traffic: Write a cookbook that performs a rolling restart of the pdns-recursor service on the DNS hosts - https://phabricator.wikimedia.org/T374891 (10CDobbins) 03NEW