[10:37:29] <jynus>	 Yesterday I had to rerun an s3 dump due to an interaction with an ongoing schema change (detected thanks to backup monitoring)
[13:38:57] <Amir1>	 marostegui: for binlog rotation of x1. When does that happen? midnight UTC?‌ or it's hourly? I can't find it 😅
[13:39:23] <Amir1>	 deleting the old ones, I‌ know the split is based on 1GB file size 
[13:42:56] <marostegui>	 Amir1: based on time of the oldest at the time
[14:46:25] <jinxer-wm>	 FIRING: SystemdUnitFailed: swift_dispersion_stats_lowlatency.service on ms-fe1009:9100 - https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state - https://grafana.wikimedia.org/d/g-AaZRFWk/systemd-status - https://alerts.wikimedia.org/?q=alertname%3DSystemdUnitFailed
[14:50:46] <Amir1>	 thanks
[15:01:25] <jinxer-wm>	 RESOLVED: SystemdUnitFailed: swift_dispersion_stats_lowlatency.service on ms-fe1009:9100 - https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state - https://grafana.wikimedia.org/d/g-AaZRFWk/systemd-status - https://alerts.wikimedia.org/?q=alertname%3DSystemdUnitFailed
[17:03:48] <bjensen>	 hey folks, does anyone happen to know if there was maintenance on the s2 primary in codfw at 2026-02-04 T06:16:25?
[17:13:33] <bjensen>	 ah, disregard, sorry, found the error message indicating that there was indeed
[17:15:04] <elukey>	 folks as FYI I am dropping old Tegola buckets on Thanos swift via s3cmd for https://phabricator.wikimedia.org/T396584. If you see anything weird, I have a tmux session running on stat1010, feel free to kill it.
[17:48:43] <marostegui>	 bjensen: that timing..probably me doing a switch over
[17:49:22] <bjensen>	 marostegui: i think so, thanks! logs eventually pointed me to T416300
[17:49:22] <stashbot>	 T416300: Switchover s2 master (db2204 -> db2207) - https://phabricator.wikimedia.org/T416300
[20:32:27] <Amir1>	 Random note, db2200 instances all are marked in misc cluster instead of mysql. See https://grafana.wikimedia.org/goto/VRnCCsNvR?orgId=1
[20:33:10] <Amir1>	 I was wondering why "misc" in power consumption is so high
[20:33:10] <Amir1>	 https://grafana-rw.wikimedia.org/d/f64mmDzMz/power-dashboard?orgId=1&from=now-2d&to=now&timezone=utc&var-datasource=PA7DE9A562EF40E24&var-site=codfw&var-instance=$__all&var-row=$__all&viewPanel=panel-110
[20:33:30] <Amir1>	 db2200 onwards (db2201, db2202, db2203, ...) 
[20:39:21] <federico3>	 TIL the power dashboard