[00:02:15] Amir1: ok I did a final check if categorylinks is fully migrated and found something: https://gerrit.wikimedia.org/g/mediawiki/core/+/a1ce584ed0d37a387e606c3201ebac2a97732366/includes/cache/BacklinkCache.php#321 [00:02:47] loooovely [00:03:07] I can review ASAP and you backport? since the column is being dropped as we speak [00:03:39] yep [00:03:42] thats the point [00:03:51] zabe: it's quite simple, just move it up to templatelinks [00:04:04] already done https://gerrit.wikimedia.org/r/c/mediawiki/core/+/1182243 [00:04:31] wanna backport or should I? [00:04:53] can do [00:05:32] Thanks [00:35:30] Sorry for the mess [10:24:52] federico3: I am sure this is not done on s2: https://phabricator.wikimedia.org/T401906 [10:24:52] https://wikitech.wikimedia.org/wiki/Map_of_database_maintenance [10:27:53] I'm aware, there's something in the check I'm going to review after s5 is done [10:30:11] actually I just reran check now as it's safe [10:31:35] Amir1: when you have a sec https://gerrit.wikimedia.org/r/c/operations/puppet/+/1182507 [11:55:36] federico3: would it be okay to split it to one host per patch. Doing it in serial. Provision one host, get it merged, apply changes and then move on to the next? [11:55:59] that way we can be sure if all steps are done correctly [11:58:21] Amir1: I can split it but I'm not sure how it would change the rollout process [13:42:35] FIRING: DiskSpace: Disk space ms-be1066:9100:/srv/swift-storage/sda3 3.873% free - https://wikitech.wikimedia.org/wiki/Monitoring/Disk_space - https://grafana.wikimedia.org/d/000000377/host-overview?orgId=1&viewPanel=12&var-server=ms-be1066 - https://alerts.wikimedia.org/?q=alertname%3DDiskSpace [13:45:13] huh [13:45:41] time for some vacuuming I guess [14:07:18] I'm not quite sure why that didn't appear in alerts.wm.org when I checked this morning [14:23:17] is that not the first firing? [14:25:05] they used to show up as warning before the alert fired (which meant we had a smidge more headroom) [14:26:23] (as it was there wasn't enough disk space free to do a VACUUM at all, which is making things a bit more faffsome) [14:27:55] oh. [14:28:08] happy thoughts! [15:16:01] zabe: yay for incorrect index hint [15:16:06] I merge it now [15:16:16] thanks [16:05:24] Team, as discussed in the team meeting please take some time to fill this sheet so that we can go over it during our meeting next week - https://docs.google.com/spreadsheets/d/1v7G0VWxmUSLHia_9_yoXh-tn6YiU5O0qkrO16VnzqF4/edit?gid=2043227103#gid=2043227103