[07:29:33] 10netops, 06DC-Ops, 06Infrastructure-Foundations, 10ops-codfw, and 2 others: Migrate servers in codfw racks C6 & C7 from asw to lsw - https://phabricator.wikimedia.org/T373101#10136469 (10ABran-WMF) T374512 done. all remaining hosts are either non prod critical or depoolable [08:27:41] topranks: thanks for taking the time and checking gobgpd neighbor options <3 [09:46:55] 06Traffic, 06Data Products, 06Data-Engineering, 13Patch-For-Review: Prepare puppet configuration to send haproxy logs to haproxykafka socket - https://phabricator.wikimedia.org/T374473#10136693 (10gmodena) Hi, Are you planning to start shipping to Kafka anytime soon? It would be great to touch base and ir... [10:33:14] 10netops, 06DC-Ops, 06Infrastructure-Foundations, 10ops-codfw, 06SRE: Move db2209 uplink from asw-c5-codfw to lsw1-c5-codfw - https://phabricator.wikimedia.org/T374523 (10cmooney) 03NEW p:05Triage→03Medium [10:46:32] 10netops, 06Infrastructure-Foundations, 06SRE, 13Patch-For-Review: Routed Ganeti: Add support for VM QoS marking - https://phabricator.wikimedia.org/T374392#10136850 (10cmooney) 05Open→03Resolved Patch merged, working as expected: ` cmooney@ganeti2033:~$ cat /etc/nftables/postrouting/05_trust-vm-ds... [10:47:30] 10netops, 06DBA, 06DC-Ops, 06Infrastructure-Foundations, and 2 others: Move db2209 uplink from asw-c5-codfw to lsw1-c5-codfw - https://phabricator.wikimedia.org/T374523#10136856 (10ABran-WMF) I'll get to T374425 to get to T374421 and unblock this T374523 [10:48:18] 10netops, 06DBA, 06DC-Ops, 06Infrastructure-Foundations, and 2 others: Move db2209 uplink from asw-c5-codfw to lsw1-c5-codfw - https://phabricator.wikimedia.org/T374523#10136865 (10cmooney) >>! In T374523#10136856, @ABran-WMF wrote: > I'll get to T374425 to get to T374421 and unblock this T374523 Thanks! [10:48:31] 10netops, 06DBA, 06DC-Ops, 06Infrastructure-Foundations, and 2 others: Move db2209 uplink from asw-c5-codfw to lsw1-c5-codfw - https://phabricator.wikimedia.org/T374523#10136866 (10cmooney) [10:48:33] 10netops, 06DC-Ops, 06Infrastructure-Foundations, 10ops-codfw, 06SRE: Migrate codfw servers in rows C & D from legacy ASW to LSW - https://phabricator.wikimedia.org/T370630#10136867 (10cmooney) [12:26:43] 10netops, 06collaboration-services, 06DC-Ops, 06Infrastructure-Foundations, and 3 others: Migrate servers in codfw racks D1 & D2 from asw to lsw - https://phabricator.wikimedia.org/T373102#10137107 (10jcrespo) I will want to stop ms backups at codfw for backup2011 before it happens. No big deal if I don't... [12:26:47] 10netops, 06collaboration-services, 06DC-Ops, 06Infrastructure-Foundations, and 3 others: Migrate servers in codfw racks D7 & D8 from asw to lsw - https://phabricator.wikimedia.org/T373105#10137114 (10jcrespo) I will want to stop ms backups at codfw for backup2007 before it happens. No big deal if I don't... [13:22:29] 10netops, 10fundraising-tech-ops, 06Infrastructure-Foundations: Test prototype fundraising pybal replacement based on haproxy + anycast-healthchecker. - https://phabricator.wikimedia.org/T373942#10137275 (10cmooney) >>! In T373942#10134407, @Jgreen wrote: > Hey @cmooney, we have two servers online in frack-c... [13:49:24] 10netops, 06collaboration-services, 06DC-Ops, 06Infrastructure-Foundations, and 3 others: Migrate servers in codfw racks C4 & C5 from asw to lsw - https://phabricator.wikimedia.org/T373097#10137421 (10ops-monitoring-bot) Icinga downtime and Alertmanager silence (ID=5ff7d01a-40d8-4196-9008-7bf9b79ea4e8)... [14:06:29] 10netops, 06DC-Ops, 06Infrastructure-Foundations, 10ops-eqiad, and 2 others: (2) new singlemode fiber patches from dmarc to routers for IX ports - https://phabricator.wikimedia.org/T373376#10137512 (10cmooney) Still chasing Equinix to get this sorted, back-and-forth now with them for almost 2 weeks without... [14:30:33] hey folks [14:30:36] cp2037 and cp2038 are due to be moved to new top-of-rack switch later today [14:30:47] is someone available to depool these before we do the work? [14:31:19] yes please :) [14:31:27] will do so 30 mins before [14:33:09] sukhe: thanks!! [15:28:44] topranks: done. gl for today :) [15:31:00] sukhe: thank you! [15:45:55] 10netops, 06DC-Ops, 06Infrastructure-Foundations, 10ops-codfw, and 2 others: Migrate servers in codfw racks C6 & C7 from asw to lsw - https://phabricator.wikimedia.org/T373101#10137884 (10ABran-WMF) depoolable hosts have been depooled https://phabricator.wikimedia.org/P68929 [16:07:44] 10netops, 06DC-Ops, 06Infrastructure-Foundations, 10ops-codfw, and 2 others: Migrate servers in codfw racks C6 & C7 from asw to lsw - https://phabricator.wikimedia.org/T373101#10137966 (10ops-monitoring-bot) Icinga downtime and Alertmanager silence (ID=6257a49b-1ea6-4675-9944-c5d85eb38288) set by cmooney@c... [16:21:08] 10netops, 06DC-Ops, 06Infrastructure-Foundations, 10ops-codfw, and 2 others: Migrate servers in codfw racks C6 & C7 from asw to lsw - https://phabricator.wikimedia.org/T373101#10138029 (10ops-monitoring-bot) Icinga downtime and Alertmanager silence (ID=6458a64c-9bf9-4b09-a6e1-82f1e6f72fc3) set by cmooney@c... [16:28:46] 10netops, 06DC-Ops, 06Infrastructure-Foundations, 10ops-codfw, and 2 others: Migrate servers in codfw racks C6 & C7 from asw to lsw - https://phabricator.wikimedia.org/T373101#10138056 (10cmooney) All hosts successfully moved and responding to ping again. [16:36:16] 10netops, 06DC-Ops, 06Infrastructure-Foundations, 10ops-codfw, and 2 others: Migrate servers in codfw racks C6 & C7 from asw to lsw - https://phabricator.wikimedia.org/T373101#10138100 (10ABran-WMF) hosts are repooling [21:36:06] 06Traffic, 06Data-Persistence, 06SRE, 10SRE-swift-storage, and 6 others: Change default image thumbnail size - https://phabricator.wikimedia.org/T355914#10139152 (10Jdlrobson)