[06:24:58] 10DBA, 10Operations, 10ops-codfw: Degraded RAID on db2047 - https://phabricator.wikimedia.org/T221481 (10Marostegui) a:03Papaul Let's replace the failed disk first only, disk #12 [06:32:21] 10DBA, 10Goal, 10Patch-For-Review: Decommission database hosts <= db2031 (tracking) - https://phabricator.wikimedia.org/T176243 (10Marostegui) [09:41:14] 10DBA, 10MediaWiki-Database, 10MediaWiki-Logging, 10Operations, 10Wikimedia-production-error: Special:Log on commons -- entire web request took longer than 60 seconds and timed out - https://phabricator.wikimedia.org/T221458 (10Framawiki) p:05High→03Unbreak! [15:49:42] 10DBA, 10MediaWiki-Database, 10MediaWiki-Logging, 10Operations, 10Wikimedia-production-error: Special:Log on commons -- entire web request took longer than 60 seconds and timed out - https://phabricator.wikimedia.org/T221458 (10Marostegui) This is the query I believe - looks like the optimizer is being d... [16:50:38] 10DBA, 10Core Platform Team, 10MediaWiki-Database, 10MediaWiki-Logging, and 2 others: Special:Log on commons -- entire web request took longer than 60 seconds and timed out - https://phabricator.wikimedia.org/T221458 (10Marostegui) [17:34:14] 10DBA, 10Core Platform Team, 10MediaWiki-Database, 10MediaWiki-Logging, and 3 others: Special:Log on commons -- entire web request took longer than 60 seconds and timed out - https://phabricator.wikimedia.org/T221458 (10Aklapper) [17:55:05] 10DBA, 10Operations, 10ops-eqiad: db1099 memory issues - https://phabricator.wikimedia.org/T221502 (10Marostegui) [17:55:15] 10DBA, 10Operations, 10ops-eqiad: db1099 memory issues - https://phabricator.wikimedia.org/T221502 (10Marostegui) p:05Triage→03Normal [18:20:38] 10DBA, 10Core Platform Team, 10MediaWiki-Database, 10MediaWiki-Logging, and 3 others: Special:Log on commons -- entire web request took longer than 60 seconds and timed out - https://phabricator.wikimedia.org/T221458 (10Jc86035) @Framawiki It //sounds// like the same issue but I'm not totally sure.