[09:10:10] I'd like to reboot cumin2001 some time next week, there are some mariadb-snapshot/backup_mariadb.py processes running, can we sync up a time next week where a reboot would fit in? [09:16:27] next week? [09:16:52] probably tuesday morning [09:17:17] you can see the schedule of snapshots at: [09:17:46] # Puppet Name: regular_snapshot [09:17:47] 0 19 * * 0,2,4 /usr/bin/systemd-cat -t mariadb-snapshots /usr/bin/python3 /usr/local/bin/remote_backup_mariadb.py 2>&1 [09:19:19] they run at night and take around 17 hours [09:20:51] although for what I see, they finished yesterday one already [09:20:55] if you want to do it now [09:21:14] ^moritz [09:21:23] ^moritzm [09:22:47] I'm currently in the middle of something else and I'm off in a bit, but Tuesday morning sounds good, I'll recheck with you, then ok? [09:22:57] ok [11:45:10] 10DBA, 10MediaWiki-extensions-OATHAuth, 10Schema-change: Drop old oathauth_users columns - https://phabricator.wikimedia.org/T226826 (10Reedy) [13:50:31] marostegui and jynus, do either of you have a moment to help me understand the load on labsdb1011 (which currently has all the replication lag as well)? It doesn't seem like it's all that much busier than usual, unless all that load is just trying to catch up replication. [18:55:21] 10Blocked-on-schema-change, 10DBA: Drop abuse_filter_log.afl_log_id in production - https://phabricator.wikimedia.org/T226851 (10Daimona) [18:55:42] 10Blocked-on-schema-change, 10DBA: Drop abuse_filter_log.afl_log_id in production - https://phabricator.wikimedia.org/T226851 (10Daimona) [19:26:50] 10Blocked-on-schema-change, 10DBA: Drop abuse_filter_log.afl_log_id in production - https://phabricator.wikimedia.org/T226851 (10Huji) [19:26:58] 10Blocked-on-schema-change, 10DBA: Drop abuse_filter_log.afl_log_id in production - https://phabricator.wikimedia.org/T226851 (10Huji) [19:27:32] 10Blocked-on-schema-change, 10DBA: Drop abuse_filter_log.afl_log_id in production - https://phabricator.wikimedia.org/T226851 (10Huji)