[07:45:59] Emperor: thank you, yeah not super urgent (i.e. today's fine) [08:15:09] godog: you have two CRs to look at when you've a moment :) [08:27:11] ack, {{done}} [08:35:37] puppetboard looking happier [08:36:53] Q. describe your job. A. I make unhappy dashboard happierâ„¢ :-P [08:37:11] *dashboards [08:43:52] A. I mostly get insulted on IRC (and by automated puppet linters) :-p [08:44:00] :) [08:53:14] (my usual answer is "I'm still trying to automate myself out of a job") [08:54:56] eheheh [09:58:49] PROBLEM - MariaDB sustained replica lag on m1 on db1117 is CRITICAL: 125.6 ge 2 https://wikitech.wikimedia.org/wiki/MariaDB/troubleshooting%23Replication_lag https://grafana.wikimedia.org/d/000000273/mysql?orgId=1&var-server=db1117&var-port=13321 [10:00:44] checking [10:03:09] etherpad, maybe? [10:04:25] I belive someone must be doing an exam there [10:06:21] RECOVERY - MariaDB sustained replica lag on m1 on db1117 is OK: (C)2 ge (W)1 ge 0 https://wikitech.wikimedia.org/wiki/MariaDB/troubleshooting%23Replication_lag https://grafana.wikimedia.org/d/000000273/mysql?orgId=1&var-server=db1117&var-port=13321 [11:42:58] Amir1: FlaggedRevs/maintenance/pruneRevData.php will refresh the config? [11:43:37] marostegui: nope, let me kill it [11:43:42] ah ok! [11:43:47] which wiki? I have two running [11:43:53] ruwiki [11:44:46] done [11:45:01] thanks! [13:21:32] marostegui: the flaggedtemplates schema change dropped 40 GB from ruwiki alone https://grafana.wikimedia.org/d/000000377/host-overview?viewPanel=28&orgId=1&var-server=db1168&var-datasource=thanos&var-cluster=wmcs&from=now-1d&to=now [15:09:38] swift ring management code deployed other than the final change (which will allow the resulting new rings to actually get deployed); I'll deploy that last bit in the morning [17:59:51] https://www.percona.com/blog/mariadb-10-9-quick-peek/