[01:09:40] <wikibugs>	 10DBA, 10Operations, 10ops-eqiad: db1114 crashed due to memory issues (server under warranty) - https://phabricator.wikimedia.org/T229452 (10wiki_willy) @Cmjohnson - just following up on this one, since you were out on vacation last week when the task came in.  Thanks, Willy
[05:39:57] <wikibugs>	 10DBA, 10Schema-change: Remove globalblocks tables from wikis - https://phabricator.wikimedia.org/T230055 (10Marostegui)
[05:40:02] <wikibugs>	 10DBA, 10Epic, 10Tracking-Neverending: Database tables to be dropped on Wikimedia wikis and other WMF databases (tracking) - https://phabricator.wikimedia.org/T54921 (10Marostegui)
[05:52:17] <wikibugs>	 10DBA, 10DC-Ops, 10Operations, 10decommission, and 2 others: Decommission db2035 - https://phabricator.wikimedia.org/T229784 (10Marostegui)
[05:56:43] <wikibugs>	 10DBA, 10DC-Ops, 10Operations, 10decommission, and 2 others: Decommission db2035 - https://phabricator.wikimedia.org/T229784 (10Marostegui)
[05:57:27] <wikibugs>	 10DBA: Decommission old coredb machines (<=db2042) - https://phabricator.wikimedia.org/T221533 (10Marostegui)
[05:58:04] <wikibugs>	 10DBA: Decommission old coredb machines (<=db2042) - https://phabricator.wikimedia.org/T221533 (10Marostegui) 05Open→03Resolved All these hosts have been sent to #dc-ops for the last steps of their decommissioning process, so resolving this.
[05:58:06] <wikibugs>	 10DBA, 10Goal: Address Database infrastructure blockers on datacenter switchover & multi-dc deployment - https://phabricator.wikimedia.org/T220170 (10Marostegui)
[05:59:14] <wikibugs>	 10DBA, 10Schema-change: Remove globalblocks tables from wikis - https://phabricator.wikimedia.org/T230055 (10Marostegui) p:05Triage→03Normal
[06:04:01] <wikibugs>	 10DBA, 10Schema-change: Remove globalblocks tables from wikis - https://phabricator.wikimedia.org/T230055 (10Marostegui)
[06:09:02] <wikibugs>	 10DBA, 10Schema-change: Remove globalblocks tables from wikis - https://phabricator.wikimedia.org/T230055 (10Marostegui) I have confirmed that all the tables are empty on all those s3 wikis: `  # for i in `mysql.py -hdb1075 information_schema -e "select table_schema from tables where table_name='globalblocks'"...
[07:49:07] <wikibugs>	 10DBA, 10Operations, 10Patch-For-Review: Decommission db2043-db2069 - https://phabricator.wikimedia.org/T228258 (10Marostegui)
[08:42:59] <wikibugs>	 10DBA, 10Goal: Switchover codfw masters to new hosts - https://phabricator.wikimedia.org/T230106 (10Marostegui)
[08:46:08] <wikibugs>	 10DBA, 10Goal: Switchover codfw masters to new hosts - https://phabricator.wikimedia.org/T230106 (10Marostegui)
[08:46:37] <wikibugs>	 10DBA, 10Goal: Switchover codfw masters to new hosts - https://phabricator.wikimedia.org/T230106 (10Marostegui) p:05Triage→03Normal
[08:46:46] <wikibugs>	 10DBA, 10Goal: Switchover codfw primary database masters to new hosts - https://phabricator.wikimedia.org/T230106 (10Marostegui)
[08:51:34] <wikibugs>	 10DBA, 10Math, 10Patch-For-Review: Remove table `math` from the database - https://phabricator.wikimedia.org/T196055 (10Marostegui)
[08:59:35] <wikibugs>	 10DBA, 10Operations, 10decommission, 10ops-eqiad: Decommission db2069 - https://phabricator.wikimedia.org/T230107 (10Marostegui)
[08:59:49] <wikibugs>	 10DBA, 10Operations, 10decommission, 10ops-eqiad: Decommission db2069 - https://phabricator.wikimedia.org/T230107 (10Marostegui) p:05Triage→03Normal
[09:05:50] <wikibugs>	 10DBA, 10Operations, 10decommission, 10ops-eqiad, 10Patch-For-Review: Decommission db2069 - https://phabricator.wikimedia.org/T230107 (10Marostegui)
[09:19:18] <wikibugs>	 10DBA, 10Operations, 10decommission, 10ops-eqiad, 10Patch-For-Review: Decommission db2069 - https://phabricator.wikimedia.org/T230107 (10Marostegui)
[09:27:18] <wikibugs>	 10DBA, 10Math, 10Patch-For-Review: Remove table `math` from the database - https://phabricator.wikimedia.org/T196055 (10Marostegui)
[13:09:33] <wikibugs>	 10DBA, 10Math, 10Patch-For-Review: Remove table `math` from the database - https://phabricator.wikimedia.org/T196055 (10Marostegui)
[13:33:44] <wikibugs>	 10DBA, 10Math, 10Patch-For-Review: Remove table `math` from the database - https://phabricator.wikimedia.org/T196055 (10Marostegui)
[14:01:02] <wikibugs>	 10DBA, 10Operations: Decommission db2043-db2069 - https://phabricator.wikimedia.org/T228258 (10Marostegui)
[14:04:57] <wikibugs>	 10DBA, 10Operations, 10decommission, 10ops-codfw: Decommission db2069 - https://phabricator.wikimedia.org/T230107 (10Cmjohnson)
[14:30:49] <wikibugs>	 10DBA, 10Operations, 10wikitech.wikimedia.org, 10cloud-services-team (Kanban): Switchover m5 primary master: db1073 to db1133 - https://phabricator.wikimedia.org/T229657 (10Marostegui)
[14:32:45] <wikibugs>	 10DBA, 10Operations, 10wikitech.wikimedia.org, 10cloud-services-team (Kanban): Switchover m5 primary master: db1073 to db1133 - https://phabricator.wikimedia.org/T229657 (10Marostegui)
[22:18:00] <wikibugs>	 10DBA, 10conftool: #dbctl: add 'comment'/'description' metadata to instances - https://phabricator.wikimedia.org/T229677 (10CDanis) OK, for now I'm planning on changing the instance schema in the following way:  * Add a `candidate_master` field, type boolean, default false.  No extra code or feature support, a...