[07:00:55] 10DBA, 10Operations, 10ops-eqiad: db1051 database host BBU issues - https://phabricator.wikimedia.org/T186049#3936240 (10Marostegui) This server definitely needs a BBU replacement. @Cmjohnson can you let us know a day that works for you to get it replaced? Thanks! [07:14:06] 10DBA: Failover DB masters in row D - https://phabricator.wikimedia.org/T186188#3936392 (10Marostegui) p:05Triage>03Normal [07:14:15] 10DBA: Failover DB masters in row D - https://phabricator.wikimedia.org/T186188#3936392 (10Marostegui) a:05ayounsi>03None [08:45:26] 10DBA, 10MediaWiki-extensions-Linter, 10Patch-For-Review: Display count of remaining content space errors - https://phabricator.wikimedia.org/T173943#3545017 (10jcrespo) This was bad and is still bad for the reasons mentioned here: T184280 [10:15:49] https://mariadb.com/resources/blog/mariadb-server-10034-now-available [10:23:59] are you planning any stretch reimages this or next week? I just merged a fix for the problem we'd been seeing a few weeks ago (that a new stretch install didn't install the latest kernel from security.debian.org). when you do the next stretch reimage, can you ping me so that I can quickly doublecheck that this fixes it properly? [10:51:21] I am about to reimage a server [10:58:04] if you use the reimage script please ping me, it should work fine but I would like to check the logs that everyting is still logged fine [12:25:19] FYI, I'm restarting apache on dbmonitor for the libxml sec update in a bit [12:26:06] done [13:06:53] I will restart the whole servers [13:44:00] apparently, now on new installs, the latest kernel is installed [14:00:08] "Master server does not support semi-sync, fallback to asynchronous replication" [14:00:13] this is from es2019 [14:31:52] jynus: great [15:33:43] 10DBA, 10Operations, 10hardware-requests, 10ops-codfw, 10Patch-For-Review: Decommission db2016, db2017, db2018, db2019, db2023, db2028, db2029 - https://phabricator.wikimedia.org/T184090#3937784 (10Dzahn) a:05Papaul>03RobH [16:04:29] 10DBA, 10Operations, 10ops-codfw, 10Patch-For-Review: rack/setup/install tendril2001 - https://phabricator.wikimedia.org/T186123#3937880 (10Papaul) @Marostegui is okay for me to use raid1-gpt.cfg for the partman on this system ? [16:17:07] 10DBA, 10Operations, 10ops-codfw, 10Patch-For-Review: rack/setup/install tendril2001 - https://phabricator.wikimedia.org/T186123#3937914 (10Papaul) [16:32:36] 10DBA, 10Operations, 10ops-codfw, 10Patch-For-Review: rack/setup/install tendril2001 - https://phabricator.wikimedia.org/T186123#3937990 (10jcrespo) raid1-gpt.cfg seems about right [21:46:33] 10DBA, 10Operations, 10ops-eqiad, 10Patch-For-Review: Rack and setup db1115 (tendril replacement database) - https://phabricator.wikimedia.org/T185788#3939366 (10RobH) [22:19:24] 10DBA, 10Wikimedia-General-or-Unknown, 10Performance: Clean up skin properties - https://phabricator.wikimedia.org/T171643#3939415 (10demon) {P6653} [22:30:47] 10DBA, 10Wikimedia-General-or-Unknown, 10Performance: Clean up skin properties - https://phabricator.wikimedia.org/T171643#3939472 (10matmarex) @demon Just to remind, that query is wrong, especially if you plan to use the same condition for deleting: >>! In T171643#3472259, @matmarex wrote: >> The **only**... [22:32:08] 10DBA, 10Wikimedia-General-or-Unknown, 10Performance: Clean up skin properties - https://phabricator.wikimedia.org/T171643#3939473 (10matmarex) [23:33:26] 10DBA, 10Operations, 10ops-eqiad: db1051 database host BBU issues - https://phabricator.wikimedia.org/T186049#3939620 (10Dzahn) p:05Triage>03Normal [23:33:41] 10DBA, 10Operations, 10ops-eqiad: db1051 database host BBU issues - https://phabricator.wikimedia.org/T186049#3932086 (10Dzahn) a:03Cmjohnson