[10:18:14] <wikibugs>	 10DBA, 10ContentTranslation, 10Data-Services: Consider adding ContentTranslation (CX) tables to wiki replicas - https://phabricator.wikimedia.org/T196020 (10Arrbee) p:05Triage>03Normal
[11:37:28] <marostegui>	 https://gerrit.wikimedia.org/r/#/c/450542/
[13:46:42] <wikibugs_>	 10DBA, 10Operations, 10ops-codfw: Degraded RAID on db2054 - https://phabricator.wikimedia.org/T201245 (10Papaul) p:05Triage>03Normal
[13:59:33] <marostegui>	 I have merged that - I guess we have to reload the proxies
[14:50:42] <wikibugs_>	 10DBA, 10Operations, 10ops-codfw: Degraded RAID on db2054 - https://phabricator.wikimedia.org/T201245 (10Papaul) a:05Papaul>03Marostegui @Marostegui  Disk replaced
[14:51:56] <wikibugs_>	 10DBA, 10Operations, 10ops-codfw: Degraded RAID on db2054 - https://phabricator.wikimedia.org/T201245 (10Marostegui) Thanks! ```       physicaldrive 1I:1:7 (port 1I:box 1:bay 7, SAS, 600 GB, Rebuilding) ```
[15:14:59] <wikibugs_>	 10DBA, 10Operations, 10ops-codfw: pc2006 rebooted itself - https://phabricator.wikimedia.org/T200641 (10Papaul) This server has pro support as mentioned in T139283   Hi Papaul,  This server (7D3H282) has pro support so technically I cannot help you with it but if you will update the bios to 2.1.7:  http://ww...
[15:18:03] <wikibugs_>	 10DBA, 10Operations, 10ops-codfw: pc2006 rebooted itself - https://phabricator.wikimedia.org/T200641 (10Marostegui) Thanks @Papaul - let's upgrade the BIOS then.
[15:36:22] <wikibugs_>	 10DBA, 10Operations, 10ops-codfw: pc2006 rebooted itself - https://phabricator.wikimedia.org/T200641 (10Papaul) a:05Papaul>03Marostegui @Marostegui Bios update to 2.8.0 .  It is all yours  {F24596942}
[15:37:27] <wikibugs_>	 10DBA, 10Operations, 10ops-codfw: Degraded RAID on db2054 - https://phabricator.wikimedia.org/T201245 (10Marostegui) a:05Marostegui>03Papaul This disk failed: ```       physicaldrive 1I:1:7 (port 1I:box 1:bay 7, SAS, 600 GB, Failed) ```  If it was a new disk, can we try to pull it out and pull it back ag...
[15:38:32] <wikibugs_>	 10DBA, 10Operations, 10ops-codfw: Degraded RAID on db2054 - https://phabricator.wikimedia.org/T201245 (10Papaul) Done
[15:39:54] <wikibugs_>	 10DBA, 10Operations, 10ops-codfw: pc2006 rebooted itself - https://phabricator.wikimedia.org/T200641 (10Marostegui) Thanks - I have started MySQL and will leave it running during the night. There is not much we can do with this host as per T200641#4481566 - and we will at some point replace these hosts with...
[15:40:35] <wikibugs_>	 10DBA, 10Operations, 10ops-codfw: Degraded RAID on db2054 - https://phabricator.wikimedia.org/T201245 (10Marostegui) Thanks, let's see how it goes this time! ```       physicaldrive 1I:1:7 (port 1I:box 1:bay 7, SAS, 600 GB, Rebuilding) ```
[15:57:18] <wikibugs_>	 10DBA, 10Operations, 10ops-codfw: Degraded RAID on db2054 - https://phabricator.wikimedia.org/T201245 (10Papaul) Moved all disks in one of the decom server (db2013). Disk wipe in progress
[15:58:37] <wikibugs_>	 10DBA, 10Operations, 10ops-codfw: Degraded RAID on db2054 - https://phabricator.wikimedia.org/T201245 (10Marostegui) >>! In T201245#4481644, @Papaul wrote: > Moved all disks in one of the decom server (db2013). Disk wipe in progress   I guess this is for: T195228 ?
[15:59:52] <wikibugs_>	 10DBA, 10Operations, 10ops-codfw: Degraded RAID on db2054 - https://phabricator.wikimedia.org/T201245 (10Papaul) yes thanks
[16:00:05] <wikibugs_>	 10DBA, 10Operations, 10decommission, 10ops-codfw: db2064 crashed and totally broken - decommission it - https://phabricator.wikimedia.org/T195228 (10Papaul) Moved all disks in one of the decom server (db2013). Disk wipe in progress
[16:01:02] <wikibugs_>	 10DBA, 10Operations, 10decommission, 10ops-codfw: db2064 crashed and totally broken - decommission it - https://phabricator.wikimedia.org/T195228 (10Papaul) switch port information   ge-6/0/12
[17:54:15] <wikibugs_>	 10DBA, 10Operations, 10ops-codfw: Degraded RAID on db2054 - https://phabricator.wikimedia.org/T201245 (10Marostegui) 05Open>03Resolved All good this time! ``` root@db2054:~# hpssacli controller all show config  Smart Array P420i in Slot 0 (Embedded)    (sn: 0014380337FE1C0)      Port Name: 1I     Port Na...