[09:42:27] 10DBA, 10MediaWiki-Page-derived-data, 10Platform Engineering, 10TechCom-RFC, and 2 others: RFC: Normalize MediaWiki link tables - https://phabricator.wikimedia.org/T222224 (10ArielGlenn) Is there an overarching task or a place folks can be kept in the loop as tables get close to being "too large" so that s... [10:37:24] 10Data-Persistence-Backup, 10SRE, 10SRE-swift-storage, 10Traffic, 10netops: Depool codfw swift cluster - https://phabricator.wikimedia.org/T267338 (10jcrespo) [10:38:07] 10Data-Persistence-Backup, 10SRE, 10SRE-swift-storage, 10Traffic, 10netops: Depool codfw swift cluster - https://phabricator.wikimedia.org/T267338 (10jcrespo) Clarifying expected duration and method of depooling for next week. [10:38:46] 10Data-Persistence-Backup, 10SRE, 10SRE-swift-storage, 10Traffic, 10netops: Depool codfw swift cluster - https://phabricator.wikimedia.org/T267338 (10jcrespo) [10:51:04] 10Data-Persistence-Backup, 10SRE, 10SRE-swift-storage, 10Traffic, 10netops: Depool codfw swift cluster - https://phabricator.wikimedia.org/T267338 (10ayounsi) Note that one of the eqiad/codfw links is still down due to Texas weather issues. I hope it will be back up by the 22nd, but if it's not, we shoul... [12:27:23] I am taking db1133 for some backup tests [12:27:34] db1133 is test-s1 [13:20:37] 10Data-Persistence-Backup, 10SRE, 10SRE-swift-storage, 10Traffic, 10netops: Depool codfw swift cluster - https://phabricator.wikimedia.org/T267338 (10fgiunchedi) Reassessing the situation early next week sounds good to me -- we're not terribly in a rush to do this and might as well avoid unnecessary risks [14:59:14] leaving now db1133 and using db2102 (the test-s1 host on codfw) [15:41:17] testwiki image names are a good battery testing that your application is not vulnerable to string injection [15:42:12] I think there is some special hell to however call their photos ("'.jpeg) without parenthesis [15:42:17] *whoever [16:07:40] lovely :) [16:09:05] BTW, both backups app and mysql was working well with it, but I just thought I had a bug on logs- but no, the file really was named like that [18:10:04] 10Data-Persistence-Backup, 10SRE, 10SRE-swift-storage, 10Epic, 10Goal: WMF media storage must be adequately backed up in a remote location - https://phabricator.wikimedia.org/T262668 (10jcrespo) This is an example of an ongoing backup (testwiki): ` db2102.codfw.wmnet[mediabackups]> select backup_status_n... [18:36:37] 10DBA, 10SRE, 10ops-eqiad, 10Patch-For-Review: Investigate and repool db1134 - https://phabricator.wikimedia.org/T274472 (10Jclark-ctr) memory swap completed @Marostegui [19:50:42] 10DBA, 10SRE, 10ops-eqiad: eqiad: move db1111 to rack A8 - https://phabricator.wikimedia.org/T273982 (10RobH) [20:37:15] 10DBA: iwl_prefix has inconsistent length on MySQL - https://phabricator.wikimedia.org/T275242 (10Lahwaacz)