[07:40:26] 10netops, 10Operations: cr3-eqsin disk 1 failure - https://phabricator.wikimedia.org/T257154 (10ayounsi) ` root@cr3-eqsin> request vmhost snapshot recovery warning: Existing data on the target may be lost Proceed ? [yes,no] (no) yes warning: Proceeding with vmhost snapshot Current root details, De... [08:58:40] 10netops, 10Operations: Investigate Junos vmhost snapshot - https://phabricator.wikimedia.org/T257153 (10ayounsi) Works as expected at least on single RE devices: ` cr3-ulsfo> show vmhost snapshot UEFI Version: CBEP_P_SUM1_00.13.01 Secondary Disk, Snapshot Time: Wed Sep 19 23:22:47 UTC 2018 Version: set p... [09:06:35] 10netops, 10Operations: Investigate Junos vmhost snapshot - https://phabricator.wikimedia.org/T257153 (10ayounsi) and dual RE: ` cr1-codfw> show vmhost snapshot invoke-on all-routing-engines re0: -------------------------------------------------------------------------- UEFI Version: NGRE_v00.53.00.01 Secon... [15:09:22] 10netops, 10Operations, 10ops-eqiad: (Need by: 2019-09-30) upgrade msw1-eqiad from EX4200 to EX4300 - https://phabricator.wikimedia.org/T225121 (10ayounsi) The switch has been replaced successfully, next steps: * Update Netbox * Wipe/decom old switch [15:11:24] 10netops, 10Operations, 10Wikimedia-Incident: Investigate Juniper storm control - https://phabricator.wikimedia.org/T245192 (10ayounsi) > msw1-eqiad is replaced with T225121 This is done, and is running the same storm-control config as codfw. [19:38:33] 10netops, 10Operations: cr3-eqsin disk 1 failure - https://phabricator.wikimedia.org/T257154 (10ayounsi) JTAC says that we need to RMA the whole chassis. I added @RobH to the email thread to take care of shipping. [20:02:57] 10netops, 10Operations: cr3-eqsin disk 1 failure - https://phabricator.wikimedia.org/T257154 (10RobH) [20:03:23] 10netops, 10Operations, 10ops-eqsin: cr3-eqsin disk 1 failure - https://phabricator.wikimedia.org/T257154 (10RobH)