[09:12:59] (CR) jenkins-bot: Localisation updates from https://translatewiki.net. [extensions/CentralNotice] - https://gerrit.wikimedia.org/r/481372 (owner: L10n-bot) [10:39:20] Fundraising-Backlog: Investigate Fetch CiviMail Bounces failed with code 1 - https://phabricator.wikimedia.org/T212643 (jgleeson) [10:47:21] PROBLEM - check_puppetrun on frdb1001 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 5 minutes ago with 1 failures. Failed resources (up to 3 shown): Package[mariadb-client] [10:52:21] PROBLEM - check_puppetrun on frdb1001 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 10 minutes ago with 1 failures. Failed resources (up to 3 shown): Package[mariadb-client] [10:57:25] PROBLEM - check_puppetrun on frdb1001 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 15 minutes ago with 1 failures. Failed resources (up to 3 shown): Package[mariadb-client] [11:02:25] RECOVERY - check_puppetrun on frdb1001 is OK: OK: Puppet is currently enabled, last run 4 minutes ago with 0 failures [16:03:35] PROBLEM - Host frdb1001 is DOWN: PING CRITICAL - Packet loss = 100% [16:07:11] PROBLEM - check_mysql on frdb2001 is CRITICAL: Slave IO: Connecting Slave SQL: Yes Seconds Behind Master: (null) [16:07:13] PROBLEM - check_mysql on frdev1001 is CRITICAL: Slave IO: Connecting Slave SQL: Yes Seconds Behind Master: (null) [16:09:30] ACKNOWLEDGEMENT - check_mysql on frdb1002 is CRITICAL: Slave IO: Connecting Slave SQL: Yes Seconds Behind Master: (null) Casey Dentinger replacing master raid battery [16:09:30] ACKNOWLEDGEMENT - check_mysql on frdb2001 is CRITICAL: Slave IO: Connecting Slave SQL: Yes Seconds Behind Master: (null) Casey Dentinger replacing master raid battery [16:09:30] ACKNOWLEDGEMENT - check_mysql on frdev1001 is CRITICAL: Slave IO: Connecting Slave SQL: Yes Seconds Behind Master: (null) Casey Dentinger replacing master raid battery [16:20:58] Seddon: someone has modified the communityv2 banner template [16:21:01] directly [16:21:08] I shall revert it [16:22:37] RECOVERY - Host frdb1001 is UP: PING OK - Packet loss = 0%, RTA = 0.33 ms [18:02:11] RECOVERY - check_mysql on frdb2001 is OK: Uptime: 261120 Threads: 1 Questions: 2065051 Slow queries: 132521 Opens: 633 Flush tables: 1 Open tables: 663 Queries per second avg: 7.908 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 0 [18:02:15] RECOVERY - check_mysql on frdev1001 is OK: Uptime: 2680655 Threads: 1 Questions: 376883866 Slow queries: 350755 Opens: 1964 Flush tables: 1 Open tables: 1332 Queries per second avg: 140.593 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 0