[06:20:49] 10DBA, 10MediaWiki-Configuration, 10Operations, 10Patch-For-Review, and 2 others: Create tool to handle the state of database configuration in MediaWiki in etcd - https://phabricator.wikimedia.org/T197126 (10Joe) EtcdConfig in MediaWiki has been extensively tested against failures before it was introduced,... [08:07:21] how is deployment going? [08:07:31] good [08:07:45] I am deploying the change in batches [08:07:54] https://grafana.wikimedia.org/d/000000106/parser-cache?orgId=1&from=now-12h&to=now&refresh=30s [08:37:36] if is ok for me to deploy the dns change for the proxy? [08:37:44] go for it! [09:46:01] the plan is to deploy https://gerrit.wikimedia.org/r/c/operations/puppet/+/505407 today [09:46:19] I will have a look at labsdbs after proxies finish [09:47:01] labsdb1012 is still compressing s6 [09:47:15] I think we should go ahead and compress slots table across all the wikis to start gaining some quick space back [09:48:32] 10DBA, 10MediaWiki-Cache, 10Patch-For-Review, 10Performance-Team (Radar), 10User-Marostegui: Replace parsercache keys to something more meaningful on db-XXXX.php - https://phabricator.wikimedia.org/T210725 (10Marostegui) The second key has been replaced everywhere. It will take a few days to get the hit... [10:02:25] 10DBA, 10Patch-For-Review: Prepare to decommission 2 codfw x1 hosts db2033 and db2034 - https://phabricator.wikimedia.org/T219493 (10Marostegui) [10:04:52] 10DBA, 10Patch-For-Review: Prepare to decommission 2 codfw x1 hosts db2033 and db2034 - https://phabricator.wikimedia.org/T219493 (10Marostegui) [10:05:22] 10DBA: Decommission old coredb machines (<=db2042) - https://phabricator.wikimedia.org/T221533 (10Marostegui) [10:05:27] 10DBA, 10Patch-For-Review: Prepare to decommission 2 codfw x1 hosts db2033 and db2034 - https://phabricator.wikimedia.org/T219493 (10Marostegui) 05Open→03Resolved Both hosts handed over to DCOPs for decommissioning {T220070} {T223216} [10:05:53] 10DBA: Decommission old coredb machines (<=db2042) - https://phabricator.wikimedia.org/T221533 (10Marostegui) 05Stalled→03Open [10:08:01] 10DBA: Decommission db1064 - https://phabricator.wikimedia.org/T223217 (10Marostegui) [10:08:21] 10DBA: Decommission db1064 - https://phabricator.wikimedia.org/T223217 (10Marostegui) Only tagging #dba for now until our steps are done. [10:08:31] 10DBA: Decommission db1064 - https://phabricator.wikimedia.org/T223217 (10Marostegui) p:05Triage→03Normal [11:15:51] 10DBA, 10Operations, 10Patch-For-Review: correctable memory errors db1068 (commons primary master database) - https://phabricator.wikimedia.org/T213664 (10jcrespo) It now says: `CRITICAL: Devices (12) not equal to PDs (2)` [11:23:38] 10DBA, 10Operations, 10Patch-For-Review: correctable memory errors db1068 (commons primary master database) - https://phabricator.wikimedia.org/T213664 (10jcrespo) Ignore the above, that is unrelated. [14:19:00] jynus: I am going to log off. labsdb1012 is still compressing s6 (it won't finish before thursday). I am not touching any other labsdb hosts, so if you want to start compressing slots table there, be my guest! :) [14:30:22] ok bye! [14:30:42] o/