[07:35:06] <icinga-wm>	 RECOVERY - MariaDB sustained replica lag on db1083 is OK: (C)2 ge (W)1 ge 0 https://wikitech.wikimedia.org/wiki/MariaDB/troubleshooting%23Replication_lag https://grafana.wikimedia.org/d/000000273/mysql?orgId=1&var-server=db1083&var-port=9104
[12:56:54] <wikibugs>	 10DBA, 10Data-Services, 10Quarry: SQL requests to DB replicas became work much slower, both from Quarry and from process on Toolforge - https://phabricator.wikimedia.org/T262757 (10MBH)
[13:25:43] <wikibugs>	 10DBA, 10Data-Services, 10cloud-services-team (Kanban): enwiki database replicas (Toolforge and Cloud VPS) are more than 24h+ lagged - https://phabricator.wikimedia.org/T262239 (10Majavah) 05Open→03Resolved It looks like the replication has catched up:  ` MariaDB [enwiki_p]> select max(rev_timestamp), re...
[17:35:30] <icinga-wm>	 PROBLEM - MariaDB sustained replica lag on db1081 is CRITICAL: 21.2 ge 2 https://wikitech.wikimedia.org/wiki/MariaDB/troubleshooting%23Replication_lag https://grafana.wikimedia.org/d/000000273/mysql?orgId=1&var-server=db1081&var-port=9104
[17:45:12] <icinga-wm>	 RECOVERY - MariaDB sustained replica lag on db1081 is OK: (C)2 ge (W)1 ge 0.2 https://wikitech.wikimedia.org/wiki/MariaDB/troubleshooting%23Replication_lag https://grafana.wikimedia.org/d/000000273/mysql?orgId=1&var-server=db1081&var-port=9104
[18:12:24] <icinga-wm>	 PROBLEM - MariaDB sustained replica lag on db1081 is CRITICAL: 22 ge 2 https://wikitech.wikimedia.org/wiki/MariaDB/troubleshooting%23Replication_lag https://grafana.wikimedia.org/d/000000273/mysql?orgId=1&var-server=db1081&var-port=9104
[18:15:46] <icinga-wm>	 PROBLEM - MariaDB sustained replica lag on db1138 is CRITICAL: 4.6 ge 2 https://wikitech.wikimedia.org/wiki/MariaDB/troubleshooting%23Replication_lag https://grafana.wikimedia.org/d/000000273/mysql?orgId=1&var-server=db1138&var-port=9104
[18:23:34] <icinga-wm>	 RECOVERY - MariaDB sustained replica lag on db1138 is OK: (C)2 ge (W)1 ge 0 https://wikitech.wikimedia.org/wiki/MariaDB/troubleshooting%23Replication_lag https://grafana.wikimedia.org/d/000000273/mysql?orgId=1&var-server=db1138&var-port=9104
[18:28:04] <icinga-wm>	 RECOVERY - MariaDB sustained replica lag on db1081 is OK: (C)2 ge (W)1 ge 0 https://wikitech.wikimedia.org/wiki/MariaDB/troubleshooting%23Replication_lag https://grafana.wikimedia.org/d/000000273/mysql?orgId=1&var-server=db1081&var-port=9104
[20:12:26] <wikibugs>	 10DBA, 10Data-Services, 10Quarry: SQL requests to DB replicas became work much slower, both from Quarry and from process on Toolforge - https://phabricator.wikimedia.org/T262757 (10Peachey88)