[00:00:25] <icinga-wikitide>	 PROBLEM - cp1 HTTP 4xx/5xx ERROR Rate on cp1 is UNKNOWN: UNKNOWN - NGINX Error Rate is UNKNOWN
[00:01:20] <WikiTideLSBot>	 !log [@test1] starting deploy of {'config': True, 'versions': ['']} to [test1]
[00:01:21] <WikiTideLSBot>	 !log [@test1] finished deploy of {'config': True, 'versions': ['']} to [test1] - SUCCESS in 0s
[00:01:26] <WikiTideLogbot>	 Logged the message at https://meta.wikitide.org/wiki/Tech:Server_admin_log
[00:01:33] <WikiTideLogbot>	 Logged the message at https://meta.wikitide.org/wiki/Tech:Server_admin_log
[00:02:25] <icinga-wikitide>	 PROBLEM - cp1 HTTP 4xx/5xx ERROR Rate on cp1 is CRITICAL: CRITICAL - NGINX Error Rate is 100%
[02:15:10] <icinga-wikitide>	 PROBLEM - newcascadia.net - reverse DNS on sslhost is WARNING: LifetimeTimeout: The resolution lifetime expired after 5.402 seconds: Server 1.1.1.1 UDP port 53 answered The DNS operation timed out.; Server 1.1.1.1 UDP port 53 answered The DNS operation timed out.; Server 1.1.1.1 UDP port 53 answered The DNS operation timed out.
[02:45:15] <icinga-wikitide>	 PROBLEM - cp1 PowerDNS Recursor on cp1 is CRITICAL: Domain 'wikitide.org' was not found by the server
[02:49:24] <icinga-wikitide>	 RECOVERY - cp1 PowerDNS Recursor on cp1 is OK: DNS OK: 6.842 seconds response time. wikitide.org returns 2001:41d0:801:2000::4089,51.75.170.66
[03:45:09] <icinga-wikitide>	 PROBLEM - newcascadia.net - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - newcascadia.net All nameservers failed to answer the query.
[15:56:03] <icinga-wikitide>	 PROBLEM - cp6 SSH on cp6 is CRITICAL: CRITICAL - Socket timeout after 10 seconds
[15:56:29] <icinga-wikitide>	 PROBLEM - cp6 HTTPS on cp6 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Connection timed out after 10004 milliseconds
[15:57:15] <icinga-wikitide>	 PROBLEM - Host cp6 is DOWN: PING CRITICAL - Packet loss = 100%
[16:01:39] <icinga-wikitide>	 RECOVERY - Host cp6 is UP: PING OK - Packet loss = 0%, RTA = 546.45 ms
[16:02:14] <icinga-wikitide>	 RECOVERY - cp6 SSH on cp6 is OK: SSH OK - OpenSSH_9.2p1 Debian-2+deb12u2 (protocol 2.0)
[16:02:40] <icinga-wikitide>	 RECOVERY - cp6 HTTPS on cp6 is OK: HTTP OK: HTTP/2 200 - 2973 bytes in 1.847 second response time
[18:40:22] <botifico>	 [02WikiTideOrg/dns] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/WikiTideOrg/dns/compare/049ef5cc61e7...527d975b39ae
[18:40:24] <botifico>	 [02WikiTideOrg/dns] 07paladox 03527d975 - Add cloud18 to dns
[18:49:20] <botifico>	 [02WikiTideOrg/dns] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/WikiTideOrg/dns/compare/527d975b39ae...58d48c8d6d0d
[18:49:22] <botifico>	 [02WikiTideOrg/dns] 07paladox 0358d48c8 - Add puppet181 to dns
[22:45:10] <icinga-wikitide>	 PROBLEM - newcascadia.net - reverse DNS on sslhost is WARNING: LifetimeTimeout: The resolution lifetime expired after 5.404 seconds: Server 1.1.1.1 UDP port 53 answered The DNS operation timed out.; Server 1.1.1.1 UDP port 53 answered The DNS operation timed out.; Server 1.1.1.1 UDP port 53 answered The DNS operation timed out.
[23:15:09] <icinga-wikitide>	 PROBLEM - newcascadia.net - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - newcascadia.net All nameservers failed to answer the query.
[23:32:51] <icinga-wikitide>	 PROBLEM - swiftproxy1 SSH on swiftproxy1 is CRITICAL: CRITICAL - Socket timeout after 10 seconds
[23:34:06] <icinga-wikitide>	 PROBLEM - swiftproxy1 Current Load on swiftproxy1 is CRITICAL: LOAD CRITICAL - total load average: 60.23, 34.06, 14.60
[23:34:46] <icinga-wikitide>	 RECOVERY - swiftproxy1 SSH on swiftproxy1 is OK: SSH OK - OpenSSH_9.2p1 Debian-2+deb12u2 (protocol 2.0)
[23:45:28] <icinga-wikitide>	 PROBLEM - swiftproxy1 Current Load on swiftproxy1 is WARNING: LOAD WARNING - total load average: 0.16, 3.73, 7.16
[23:47:21] <icinga-wikitide>	 RECOVERY - swiftproxy1 Current Load on swiftproxy1 is OK: LOAD OK - total load average: 0.17, 2.58, 6.33