[09:40:42] 10DBA, 10Analytics, 10Analytics-Kanban, 10User-Elukey: Review dbstore1002's non-wiki databases and decide which ones needs to be migrated to the new multi instance setup - https://phabricator.wikimedia.org/T212487 (10elukey) >>! In T212487#4891493, @Marostegui wrote: > > So the only pending one to close t... [14:56:53] 10DBA: BBU issues on codfw - https://phabricator.wikimedia.org/T214264 (10Marostegui) [14:57:40] 10DBA: BBU issues on codfw - https://phabricator.wikimedia.org/T214264 (10Marostegui) [14:57:42] 10DBA, 10User-Banyek: BBU problems dbstore2002 - https://phabricator.wikimedia.org/T205257 (10Marostegui) [14:57:57] 10DBA: Failover m3 codfw master - https://phabricator.wikimedia.org/T209261 (10Marostegui) [14:57:59] 10DBA: BBU issues on codfw - https://phabricator.wikimedia.org/T214264 (10Marostegui) [14:58:21] 10DBA: BBU issues on codfw - https://phabricator.wikimedia.org/T214264 (10Marostegui) p:05Triage→03Normal [15:08:48] 10DBA: BBU issues on codfw - https://phabricator.wikimedia.org/T214264 (10Marostegui) [15:14:03] 10DBA: BBU issues on codfw - https://phabricator.wikimedia.org/T214264 (10Marostegui) db2040 was really delayed, and I checked that the actor migration script finished yesterday, so it is probably not because of that but because of the failed BBU and the policy being back to WriteThru. I have forced WriteBack th... [20:09:04] 10DBA: BBU issues on codfw - https://phabricator.wikimedia.org/T214264 (10Marostegui) db2040 caught up, and I switched back to WriteThru and it wasn't able to keep up with replication. So I have forced WB again, let's promote db2047 to master and make db2040 a replica.