[07:53:10] 10DBA, 10MW-1.31-release-notes (WMF-deploy-2018-04-03 (1.31.0-wmf.28)), 10Patch-For-Review, 10Wikimedia-log-errors: 1.31.0-wmf.27 rolled back due to increase in fatals: "Replication wait failed: lost connection to MySQL server during query" - https://phabricator.wikimedia.org/T190960#4089198 (10hashar) > `... [08:27:40] 10DBA, 10MW-1.31-release-notes (WMF-deploy-2018-04-03 (1.31.0-wmf.28)), 10Patch-For-Review, 10Wikimedia-log-errors: 1.31.0-wmf.27 rolled back due to increase in fatals: "Replication wait failed: lost connection to MySQL server during query" - https://phabricator.wikimedia.org/T190960#4093767 (10Volans) For... [10:28:20] 10DBA, 10Contributors-Analysis: Query runs extremely slow on analytics-store - https://phabricator.wikimedia.org/T120119#4094109 (10Neil_P._Quinn_WMF) p:05Lowest>03Triage [10:31:38] 10DBA, 10Collaboration-Team-Triage, 10Contributors-Analysis: Replicate Echo tables to analytics-store - https://phabricator.wikimedia.org/T115275#4094162 (10Neil_P._Quinn_WMF) p:05Normal>03Triage [10:35:06] 10DBA, 10Analytics-EventLogging, 10Analytics-Kanban, 10Contributors-Analysis, and 4 others: Drop tables with bad data: mediawiki_page_create_1 mediawiki_revision_create_1 - https://phabricator.wikimedia.org/T169781#4094201 (10Neil_P._Quinn_WMF) p:05Normal>03Triage [16:15:36] 10DBA, 10MediaWiki-General-or-Unknown: Wikimedia\Rdbms\Database::tableName: use of subqueries is not supported this way. - https://phabricator.wikimedia.org/T191116#4094572 (10Volans) [17:37:57] 10DBA, 10MediaWiki-Database, 10MediaWiki-General-or-Unknown: Wikimedia\Rdbms\Database::tableName: use of subqueries is not supported this way. - https://phabricator.wikimedia.org/T191116#4094661 (10Marostegui) [22:25:18] 10DBA, 10DC-Ops, 10Operations, 10media-storage, 10ops-codfw: msw-c6-codfw offline - https://phabricator.wikimedia.org/T191129#4094875 (10RobH) p:05Triage>03High [22:47:32] 10DBA, 10DC-Ops, 10Operations, 10media-storage, 10ops-codfw: msw-c6-codfw offline - https://phabricator.wikimedia.org/T191129#4094901 (10Volans) I've agreed with @RobH on IRC that this is not UBN for now for the #dba part. Although assessing the situation I discovered that the rack distribution is far f...