[04:52:26] 10DBA, 10Operations, 10ops-eqiad: Degraded RAID on db1063 - https://phabricator.wikimedia.org/T230682 (10Marostegui) 05Open→03Resolved Thank you Chris! This looks good now ` root@db1063:~# megacli -LDPDInfo -aAll Adapter #0 Number of Virtual Disks: 1 Virtual Drive: 0 (Target Id: 0) Name... [07:53:40] 10DBA, 10CirrusSearch, 10Discovery-Search, 10MediaWiki-Categories: Special:RandomInCategory does not return all pages with equal probability - https://phabricator.wikimedia.org/T200703 (10Marostegui) Thanks for providing the examples! I have tested your examples on the worst possible scenario: Old hardware... [07:53:49] 10DBA, 10Operations: Decommission db2052.codfw.wmnet - https://phabricator.wikimedia.org/T230883 (10Marostegui) [07:53:51] 10DBA, 10Operations: Decommission db2059.codfw.wmnet - https://phabricator.wikimedia.org/T230884 (10Marostegui) [07:53:56] 10DBA, 10Operations: Decommission db2066.codfw.wmnet - https://phabricator.wikimedia.org/T230885 (10Marostegui) [07:54:11] 10DBA, 10Operations: Decommission db2052.codfw.wmnet - https://phabricator.wikimedia.org/T230883 (10Marostegui) p:05Triage→03Normal [07:54:23] 10DBA, 10Operations: Decommission db2059.codfw.wmnet - https://phabricator.wikimedia.org/T230884 (10Marostegui) p:05Triage→03Normal [07:54:28] 10DBA, 10Operations: Decommission db2066.codfw.wmnet - https://phabricator.wikimedia.org/T230885 (10Marostegui) p:05Triage→03Normal [07:55:15] 10DBA, 10Operations: Decommission db2043-db2069 - https://phabricator.wikimedia.org/T228258 (10Marostegui) [07:58:41] 10DBA, 10Operations: Switchover s2 primary database master db1066 -> db1122 - 17th Sept @05:00 UTC - https://phabricator.wikimedia.org/T230785 (10Marostegui) Binary log format changed on db1122, host upgraded and rebooted. [08:09:28] 10DBA, 10Operations, 10Patch-For-Review: Decommission db2052.codfw.wmnet - https://phabricator.wikimedia.org/T230883 (10Marostegui) [08:13:08] 10DBA, 10Operations: Decommission db2043-db2069 - https://phabricator.wikimedia.org/T228258 (10Marostegui) [08:19:09] 10DBA, 10MediaWiki-File-management, 10MW-1.34-notes (1.34.0-wmf.20; 2019-08-27), 10Performance-Team (Radar): Drop filejournal table from WMF - https://phabricator.wikimedia.org/T51195 (10Marostegui) Thanks for getting that merged @Reedy - this can now proceed then! [08:31:09] 10DBA, 10MediaWiki-extensions-Renameuser: Fix use of DB schema so RenameUser is trivial - https://phabricator.wikimedia.org/T33863 (10Marostegui) 05Open→03Resolved I am going to close this. If someone feels it should remain open, please re-open it. Thanks! [09:08:24] 10DBA, 10CirrusSearch, 10Discovery-Search, 10MediaWiki-Categories: Special:RandomInCategory does not return all pages with equal probability - https://phabricator.wikimedia.org/T200703 (10Bawolff) Thank you! A limit of 1000 should work fine for this usecase. [09:09:36] I'll start with the reboot of db2102 (to revert to a clean stretch kernel) in a bit [09:13:55] sounds god [10:09:27] 10DBA, 10Operations: Predictive failures on disk S.M.A.R.T. status - https://phabricator.wikimedia.org/T208323 (10Marostegui) [10:54:05] 10DBA, 10MediaWiki-Configuration, 10Operations, 10discovery-system: Allow use of EtcdConfig to configure slave databases - https://phabricator.wikimedia.org/T185084 (10Marostegui) @Joe can this be considered done already with `dbctl`? [10:55:18] 10DBA, 10MediaWiki-Configuration, 10Operations, 10discovery-system: Allow use of EtcdConfig to configure slave databases - https://phabricator.wikimedia.org/T185084 (10Joe) 05Open→03Resolved a:03Joe Indeed! we're doing more than this! [17:51:38] 10DBA, 10Operations, 10StructuredDiscussions, 10Growth-Team (Current Sprint), 10WorkType-Maintenance: Setup separate logical External Store for Flow in production - https://phabricator.wikimedia.org/T107610 (10JTannerWMF) a:03Tgr