[00:00:25] <icinga-wikitide> PROBLEM - cp1 HTTP 4xx/5xx ERROR Rate on cp1 is UNKNOWN: UNKNOWN - NGINX Error Rate is UNKNOWN [00:02:25] <icinga-wikitide> PROBLEM - cp1 HTTP 4xx/5xx ERROR Rate on cp1 is CRITICAL: CRITICAL - NGINX Error Rate is 100% [01:15:10] <icinga-wikitide> PROBLEM - newcascadia.net - reverse DNS on sslhost is WARNING: LifetimeTimeout: The resolution lifetime expired after 5.405 seconds: Server 1.1.1.1 UDP port 53 answered The DNS operation timed out.; Server 1.1.1.1 UDP port 53 answered The DNS operation timed out.; Server 1.1.1.1 UDP port 53 answered The DNS operation timed out. [01:45:09] <icinga-wikitide> PROBLEM - newcascadia.net - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - newcascadia.net All nameservers failed to answer the query. [03:00:57] <icinga-wikitide> RECOVERY - db1 Backups SQL on db1 is OK: FILE_AGE OK: /var/log/backup-logs/sql-backup.log is 55 seconds old and 275 bytes [06:45:10] <icinga-wikitide> PROBLEM - newcascadia.net - reverse DNS on sslhost is WARNING: LifetimeTimeout: The resolution lifetime expired after 5.405 seconds: Server 1.1.1.1 UDP port 53 answered The DNS operation timed out.; Server 1.1.1.1 UDP port 53 answered The DNS operation timed out.; Server 1.1.1.1 UDP port 53 answered The DNS operation timed out. [07:02:51] <icinga-wikitide> PROBLEM - swiftproxy1 SSH on swiftproxy1 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:04:37] <icinga-wikitide> PROBLEM - swiftproxy1 Puppet on swiftproxy1 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [07:04:37] <icinga-wikitide> PROBLEM - swiftproxy1 NTP time on swiftproxy1 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [07:05:39] <icinga-wikitide> PROBLEM - swiftproxy1 Current Load on swiftproxy1 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [07:06:11] <icinga-wikitide> PROBLEM - swiftproxy1 PowerDNS Recursor on swiftproxy1 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [07:12:27] <icinga-wikitide> RECOVERY - swiftproxy1 PowerDNS Recursor on swiftproxy1 is OK: DNS OK: 8.525 seconds response time. wikitide.org returns 2001:41d0:801:2000::4089,51.75.170.66 [07:13:01] <icinga-wikitide> RECOVERY - swiftproxy1 Puppet on swiftproxy1 is OK: OK: Puppet is currently enabled, last run 9 seconds ago with 0 failures [07:13:05] <icinga-wikitide> RECOVERY - swiftproxy1 SSH on swiftproxy1 is OK: SSH OK - OpenSSH_9.2p1 Debian-2+deb12u2 (protocol 2.0) [07:14:24] <icinga-wikitide> RECOVERY - swiftproxy1 NTP time on swiftproxy1 is OK: NTP OK: Offset -0.002862513065 secs [07:15:09] <icinga-wikitide> PROBLEM - newcascadia.net - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - newcascadia.net All nameservers failed to answer the query. [07:34:12] <icinga-wikitide> PROBLEM - swiftproxy1 Current Load on swiftproxy1 is WARNING: LOAD WARNING - total load average: 0.13, 0.78, 7.49 [07:36:12] <icinga-wikitide> RECOVERY - swiftproxy1 Current Load on swiftproxy1 is OK: LOAD OK - total load average: 0.06, 0.55, 6.59 [14:42:44] <botifico> [02WikiTideOrg/dns] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/卤1] 13https://github.com/WikiTideOrg/dns/commit/59cac69d39c4 [14:42:45] <botifico> [02WikiTideOrg/dns] 07paladox 0359cac69 - Add some ips for hosts for cloud18 [14:42:46] <botifico> [02dns] 07paladox created branch 03paladox-patch-1 - 13https://github.com/WikiTideOrg/dns [14:42:47] <botifico> [02dns] 07paladox opened pull request 03#3: Add some ips for hosts for cloud18 - 13https://github.com/WikiTideOrg/dns/pull/3 [14:46:24] <botifico> [02dns] 07AgentIsai closed pull request 03#3: Add some ips for hosts for cloud18 - 13https://github.com/WikiTideOrg/dns/pull/3 [14:46:27] <botifico> [02WikiTideOrg/dns] 07AgentIsai deleted branch 03paladox-patch-1 [14:46:29] <botifico> [02WikiTideOrg/dns] 07AgentIsai pushed 031 commit to 03master [+0/-0/卤1] 13https://github.com/WikiTideOrg/dns/compare/58d48c8d6d0d...b15d27f8d5a4 [14:46:31] <botifico> [02WikiTideOrg/dns] 07paladox 03b15d27f - Add some ips for hosts for cloud18 (#3) [14:46:32] <botifico> [02dns] 07AgentIsai deleted branch 03paladox-patch-1 - 13https://github.com/WikiTideOrg/dns [14:47:55] <botifico> [02WikiTideOrg/dns] 07paladox pushed 031 commit to 03master [+0/-0/卤1] 13https://github.com/WikiTideOrg/dns/compare/b15d27f8d5a4...09b7e07d6420 [14:47:56] <botifico> [02WikiTideOrg/dns] 07paladox 0309b7e07 - Add mon181