[07:27:37] marostegui: okay if I restart the parsercache clean up in eqiad? [07:28:17] Amir1: yeah [07:28:22] awesome [08:38:21] db2189 is acked but not resolved; is that something someone's working on? [08:41:13] Ah, yes, T384202 [08:41:13] T384202: db2189 replication broken - https://phabricator.wikimedia.org/T384202 [08:41:59] marostegui: do you think that'll be done before the p.age fires again, should I resolve the VO incident, ...? [08:47:25] Emperor: it may take a bit longer than usual as I'll teach federico3 how to deal with it [08:47:45] Emperor: please resolve it if you don't mind [08:55:38] {{done}} [09:08:00] thank you [13:48:23] ms-fe1014 seems unhappy (and I get EIO trying to log in) [13:52:27] oh, great, the reboot cookbook barfs too [13:52:36] ValueError: invalid literal for int() with base 10: 'bash: /etc/bash.bashrc: Input/output error\nxargs: echo: Input/output error\nxargs: echo: Input/output error\nxargs: echo: Input/output error\n0' [13:53:14] it probably needs a hard reboot via ipmi/redfish/mgmt console/iDRAC UI [13:53:27] gah, I wish everything would stop all breaking at once :( [13:58:37] Wow, that's a "the RAID controller is doomed, all is doomed" console message [13:59:02] I'll open a ticket for dc-ops with a screenshot [14:03:39] T384317 [14:03:39] T384317: ms-fe1014 hardware fault (may need new disk controller?) - https://phabricator.wikimedia.org/T384317 [15:22:42] * Emperor alarmed by Dell saying we've the wrong drives in ms-be2075, given Dell sold it to us :( [15:22:55] context: T382707 [15:22:55] T382707: Frequent disk resets on ms-be2075 - https://phabricator.wikimedia.org/T382707 [17:56:13] greetings data-persistence friends - following up here about switching pc sections over to the parsercache flavor, what I'd propose is fairly simple [0]. [17:56:14] given the desire to coordinate potentially conflicting changes, perhaps we could aim for some time Wednesday (tomorrow)? I'm happy to start my day on the early side :) [17:56:14] [0] https://phabricator.wikimedia.org/T383324#10480877 [17:57:50] just do it when the team is asleep, to avoid any conflict :-P [17:57:54] * volans hides [18:04:16] lol [18:13:19] swfrench-wmf: we can do it tomorrow yeah [18:37:39] marostegui: sounds good - I'll aim to be here by 15:00 UTC tomorrow to check in and find a time. I can also do a bit earlier if that works better. thanks!