[00:06:49] <icinga-miraheze>	 RECOVERY - cp191 Disk Space on cp191 is OK: DISK OK - free space: / 57802MiB (12% inode=99%);
[00:07:07] <icinga-miraheze>	 RECOVERY - cp201 Disk Space on cp201 is OK: DISK OK - free space: / 56909MiB (12% inode=99%);
[00:08:07] <icinga-miraheze>	 RECOVERY - cp171 Disk Space on cp171 is OK: DISK OK - free space: / 57042MiB (12% inode=99%);
[01:08:56] <icinga-miraheze>	 PROBLEM - puppet181 Check unit status of listdomains_github_push on puppet181 is CRITICAL: CRITICAL: Status of the systemd unit listdomains_github_push
[01:16:56] <icinga-miraheze>	 RECOVERY - puppet181 Check unit status of listdomains_github_push on puppet181 is OK: OK: Status of the systemd unit listdomains_github_push
[02:05:23] <icinga-miraheze>	 PROBLEM - ldap171 PowerDNS Recursor on ldap171 is CRITICAL: No response from DNS ::1
[02:05:25] <icinga-miraheze>	 PROBLEM - mw151 PowerDNS Recursor on mw151 is CRITICAL: Domain 'mw151.fsslc.wtnet' was not found by the server
[02:05:26] <icinga-miraheze>	 PROBLEM - cp191 PowerDNS Recursor on cp191 is CRITICAL: No response from DNS ::1
[02:05:28] <icinga-miraheze>	 PROBLEM - kafka181 PowerDNS Recursor on kafka181 is CRITICAL: Domain 'kafka181.fsslc.wtnet' was not found by the server
[02:05:28] <icinga-miraheze>	 PROBLEM - reports171 NTP time on reports171 is CRITICAL: NTP CRITICAL: No response from NTP server
[02:05:32] <icinga-miraheze>	 PROBLEM - mwtask151 PowerDNS Recursor on mwtask151 is CRITICAL: Domain 'mwtask151.fsslc.wtnet' was not found by the server
[02:05:33] <icinga-miraheze>	 PROBLEM - mwtask171 PowerDNS Recursor on mwtask171 is CRITICAL: Domain 'mwtask171.fsslc.wtnet' was not found by the server
[02:05:41] <icinga-miraheze>	 PROBLEM - os201 NTP time on os201 is CRITICAL: NTP CRITICAL: No response from NTP server
[02:05:43] <icinga-miraheze>	 PROBLEM - cp161 PowerDNS Recursor on cp161 is CRITICAL: Domain 'cp161.wikitide.net' was not found by the server
[02:05:43] <icinga-miraheze>	 PROBLEM - mem161 NTP time on mem161 is UNKNOWN: check_ntp_time: Invalid hostname/address - time.cloudflare.comUsage: check_ntp_time -H <host> [-4|-6] [-w <warn>] [-c <crit>] [-v verbose] [-o <time offset>]
[02:05:46] <icinga-miraheze>	 PROBLEM - mw193 NTP time on mw193 is CRITICAL: NTP CRITICAL: No response from NTP server
[02:05:53] <icinga-miraheze>	 PROBLEM - ns1 GDNSD Datacenters on ns1 is CRITICAL: CRITICAL - 1 datacenter is down: 2602:294:0:b13::110/cpweb
[02:05:56] <icinga-miraheze>	 PROBLEM - graylog161 PowerDNS Recursor on graylog161 is CRITICAL: Domain 'graylog161.fsslc.wtnet' was not found by the server
[02:05:56] <icinga-miraheze>	 PROBLEM - matomo151 PowerDNS Recursor on matomo151 is CRITICAL: Domain 'matomo151.fsslc.wtnet' was not found by the server
[02:06:00] <icinga-miraheze>	 PROBLEM - mw192 NTP time on mw192 is UNKNOWN: check_ntp_time: Invalid hostname/address - time.cloudflare.comUsage: check_ntp_time -H <host> [-4|-6] [-w <warn>] [-c <crit>] [-v verbose] [-o <time offset>]
[02:06:03] <icinga-miraheze>	 PROBLEM - os161 NTP time on os161 is CRITICAL: NTP CRITICAL: No response from NTP server
[02:06:03] <icinga-miraheze>	 PROBLEM - mw191 NTP time on mw191 is UNKNOWN: check_ntp_time: Invalid hostname/address - time.cloudflare.comUsage: check_ntp_time -H <host> [-4|-6] [-w <warn>] [-c <crit>] [-v verbose] [-o <time offset>]
[02:06:03] <icinga-miraheze>	 PROBLEM - db151 NTP time on db151 is UNKNOWN: check_ntp_time: Invalid hostname/address - time.cloudflare.comUsage: check_ntp_time -H <host> [-4|-6] [-w <warn>] [-c <crit>] [-v verbose] [-o <time offset>]
[02:06:10] <icinga-miraheze>	 PROBLEM - swiftobject171 PowerDNS Recursor on swiftobject171 is CRITICAL: No response from DNS ::1
[02:06:12] <icinga-miraheze>	 PROBLEM - mw153 PowerDNS Recursor on mw153 is CRITICAL: Domain 'mw153.fsslc.wtnet' was not found by the server
[02:06:12] <icinga-miraheze>	 PROBLEM - os151 PowerDNS Recursor on os151 is CRITICAL: Domain 'os151.fsslc.wtnet' was not found by the server
[02:06:12] <icinga-miraheze>	 PROBLEM - mw162 PowerDNS Recursor on mw162 is CRITICAL: Domain 'mw162.fsslc.wtnet' was not found by the server
[02:06:13] <icinga-miraheze>	 PROBLEM - db182 PowerDNS Recursor on db182 is CRITICAL: Domain 'db182.fsslc.wtnet' was not found by the server
[02:06:14] <icinga-miraheze>	 PROBLEM - os191 NTP time on os191 is CRITICAL: NTP CRITICAL: No response from NTP server
[02:06:16] <icinga-miraheze>	 PROBLEM - changeprop201 PowerDNS Recursor on changeprop201 is CRITICAL: Domain 'changeprop201.fsslc.wtnet' was not found by the server
[02:06:17] <icinga-miraheze>	 PROBLEM - test151 NTP time on test151 is UNKNOWN: check_ntp_time: Invalid hostname/address - time.cloudflare.comUsage: check_ntp_time -H <host> [-4|-6] [-w <warn>] [-c <crit>] [-v verbose] [-o <time offset>]
[02:06:17] <icinga-miraheze>	 PROBLEM - mw203 NTP time on mw203 is UNKNOWN: check_ntp_time: Invalid hostname/address - time.cloudflare.comUsage: check_ntp_time -H <host> [-4|-6] [-w <warn>] [-c <crit>] [-v verbose] [-o <time offset>]
[02:06:18] <icinga-miraheze>	 PROBLEM - swiftobject201 PowerDNS Recursor on swiftobject201 is CRITICAL: Domain 'swiftobject201.fsslc.wtnet' was not found by the server
[02:06:18] <icinga-miraheze>	 PROBLEM - mw152 NTP time on mw152 is UNKNOWN: check_ntp_time: Invalid hostname/address - time.cloudflare.comUsage: check_ntp_time -H <host> [-4|-6] [-w <warn>] [-c <crit>] [-v verbose] [-o <time offset>]
[02:06:19] <icinga-miraheze>	 PROBLEM - swiftproxy171 HTTP on swiftproxy171 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host: HTTP/1.1 401 Unauthorized
[02:06:19] <icinga-miraheze>	 PROBLEM - swiftobject161 PowerDNS Recursor on swiftobject161 is CRITICAL: Domain 'swiftobject161.fsslc.wtnet' was not found by the server
[02:06:20] <icinga-miraheze>	 PROBLEM - rdb151 PowerDNS Recursor on rdb151 is CRITICAL: Domain 'rdb151.fsslc.wtnet' was not found by the server
[02:06:20] <icinga-miraheze>	 PROBLEM - mw202 PowerDNS Recursor on mw202 is CRITICAL: Domain 'mw202.fsslc.wtnet' was not found by the server
[02:06:23] <icinga-miraheze>	 PROBLEM - mem161 PowerDNS Recursor on mem161 is CRITICAL: Domain 'mem161.fsslc.wtnet' was not found by the server
[02:06:23] <icinga-miraheze>	 PROBLEM - mwtask151 NTP time on mwtask151 is UNKNOWN: check_ntp_time: Invalid hostname/address - time.cloudflare.comUsage: check_ntp_time -H <host> [-4|-6] [-w <warn>] [-c <crit>] [-v verbose] [-o <time offset>]
[02:06:23] <icinga-miraheze>	 PROBLEM - test151 PowerDNS Recursor on test151 is CRITICAL: Domain 'test151.fsslc.wtnet' was not found by the server
[02:06:24] <icinga-miraheze>	 PROBLEM - mw201 NTP time on mw201 is CRITICAL: NTP CRITICAL: No response from NTP server
[02:06:24] <icinga-miraheze>	 PROBLEM - reports171 PowerDNS Recursor on reports171 is CRITICAL: Domain 'reports171.fsslc.wtnet' was not found by the server
[02:06:25] <icinga-miraheze>	 PROBLEM - mw183 PowerDNS Recursor on mw183 is CRITICAL: Domain 'mw183.fsslc.wtnet' was not found by the server
[02:06:25] <icinga-miraheze>	 PROBLEM - mem191 PowerDNS Recursor on mem191 is CRITICAL: Domain 'mem191.fsslc.wtnet' was not found by the server
[02:06:25] <icinga-miraheze>	 PROBLEM - mem191 NTP time on mem191 is CRITICAL: NTP CRITICAL: No response from NTP server
[02:06:27] <icinga-miraheze>	 PROBLEM - mw191 PowerDNS Recursor on mw191 is CRITICAL: Domain 'mw191.fsslc.wtnet' was not found by the server
[02:06:30] <icinga-miraheze>	 PROBLEM - db181 PowerDNS Recursor on db181 is CRITICAL: Domain 'db181.fsslc.wtnet' was not found by the server
[02:06:32] <icinga-miraheze>	 PROBLEM - mw163 PowerDNS Recursor on mw163 is CRITICAL: Domain 'mw163.fsslc.wtnet' was not found by the server
[02:06:32] <icinga-miraheze>	 PROBLEM - db161 PowerDNS Recursor on db161 is CRITICAL: No response from DNS ::1
[02:06:33] <icinga-miraheze>	 PROBLEM - os151 NTP time on os151 is UNKNOWN: check_ntp_time: Invalid hostname/address - time.cloudflare.comUsage: check_ntp_time -H <host> [-4|-6] [-w <warn>] [-c <crit>] [-v verbose] [-o <time offset>]
[02:06:34] <icinga-miraheze>	 PROBLEM - db172 PowerDNS Recursor on db172 is CRITICAL: Domain 'db172.fsslc.wtnet' was not found by the server
[02:06:35] <icinga-miraheze>	 PROBLEM - os201 PowerDNS Recursor on os201 is CRITICAL: No response from DNS ::1
[02:06:36] <icinga-miraheze>	 PROBLEM - db161 NTP time on db161 is UNKNOWN: check_ntp_time: Invalid hostname/address - time.cloudflare.comUsage: check_ntp_time -H <host> [-4|-6] [-w <warn>] [-c <crit>] [-v verbose] [-o <time offset>]
[02:06:38] <icinga-miraheze>	 PROBLEM - mem151 PowerDNS Recursor on mem151 is CRITICAL: No response from DNS ::1
[02:06:38] <icinga-miraheze>	 PROBLEM - rdb151 NTP time on rdb151 is UNKNOWN: check_ntp_time: Invalid hostname/address - time.cloudflare.comUsage: check_ntp_time -H <host> [-4|-6] [-w <warn>] [-c <crit>] [-v verbose] [-o <time offset>]
[02:06:38] <icinga-miraheze>	 PROBLEM - swiftproxy171 Check unit status of swift-account-stats_mw:media on swiftproxy171 is CRITICAL: CRITICAL: Status of the systemd unit swift-account-stats_mw:media
[02:06:39] <icinga-miraheze>	 PROBLEM - mw162 NTP time on mw162 is UNKNOWN: check_ntp_time: Invalid hostname/address - time.cloudflare.comUsage: check_ntp_time -H <host> [-4|-6] [-w <warn>] [-c <crit>] [-v verbose] [-o <time offset>]
[02:06:43] <icinga-miraheze>	 PROBLEM - os161 PowerDNS Recursor on os161 is CRITICAL: Domain 'os161.fsslc.wtnet' was not found by the server
[02:06:44] <icinga-miraheze>	 PROBLEM - os162 NTP time on os162 is UNKNOWN: check_ntp_time: Invalid hostname/address - time.cloudflare.comUsage: check_ntp_time -H <host> [-4|-6] [-w <warn>] [-c <crit>] [-v verbose] [-o <time offset>]
[02:06:47] <icinga-miraheze>	 PROBLEM - mw153 NTP time on mw153 is UNKNOWN: check_ntp_time: Invalid hostname/address - time.cloudflare.comUsage: check_ntp_time -H <host> [-4|-6] [-w <warn>] [-c <crit>] [-v verbose] [-o <time offset>]
[02:06:47] <icinga-miraheze>	 PROBLEM - mem201 NTP time on mem201 is UNKNOWN: check_ntp_time: Invalid hostname/address - time.cloudflare.comUsage: check_ntp_time -H <host> [-4|-6] [-w <warn>] [-c <crit>] [-v verbose] [-o <time offset>]
[02:06:48] <icinga-miraheze>	 PROBLEM - db172 NTP time on db172 is UNKNOWN: check_ntp_time: Invalid hostname/address - time.cloudflare.comUsage: check_ntp_time -H <host> [-4|-6] [-w <warn>] [-c <crit>] [-v verbose] [-o <time offset>]
[02:06:52] <icinga-miraheze>	 PROBLEM - graylog161 NTP time on graylog161 is UNKNOWN: check_ntp_time: Invalid hostname/address - time.cloudflare.comUsage: check_ntp_time -H <host> [-4|-6] [-w <warn>] [-c <crit>] [-v verbose] [-o <time offset>]
[02:06:55] <icinga-miraheze>	 PROBLEM - swiftobject171 NTP time on swiftobject171 is UNKNOWN: check_ntp_time: Invalid hostname/address - time.cloudflare.comUsage: check_ntp_time -H <host> [-4|-6] [-w <warn>] [-c <crit>] [-v verbose] [-o <time offset>]
[02:06:56] <icinga-miraheze>	 PROBLEM - mw203 PowerDNS Recursor on mw203 is CRITICAL: Domain 'mw203.fsslc.wtnet' was not found by the server
[02:07:01] <icinga-miraheze>	 PROBLEM - os191 PowerDNS Recursor on os191 is CRITICAL: No response from DNS ::1
[02:07:02] <icinga-miraheze>	 PROBLEM - swiftproxy171 HTTPS on swiftproxy171 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: HTTP/1.1 503 Service Unavailable
[02:07:04] <icinga-miraheze>	 PROBLEM - mw193 PowerDNS Recursor on mw193 is CRITICAL: Domain 'mw193.fsslc.wtnet' was not found by the server
[02:07:05] <icinga-miraheze>	 PROBLEM - eventgate181 PowerDNS Recursor on eventgate181 is CRITICAL: Domain 'eventgate181.fsslc.wtnet' was not found by the server
[02:07:07] <icinga-miraheze>	 PROBLEM - mw152 PowerDNS Recursor on mw152 is CRITICAL: Domain 'mw152.fsslc.wtnet' was not found by the server
[02:07:07] <icinga-miraheze>	 PROBLEM - db151 PowerDNS Recursor on db151 is CRITICAL: No response from DNS ::1
[02:07:09] <icinga-miraheze>	 PROBLEM - eventgate181 NTP time on eventgate181 is CRITICAL: NTP CRITICAL: No response from NTP server
[02:07:09] <icinga-miraheze>	 PROBLEM - changeprop201 NTP time on changeprop201 is UNKNOWN: check_ntp_time: Invalid hostname/address - time.cloudflare.comUsage: check_ntp_time -H <host> [-4|-6] [-w <warn>] [-c <crit>] [-v verbose] [-o <time offset>]
[02:07:10] <icinga-miraheze>	 PROBLEM - mw201 PowerDNS Recursor on mw201 is CRITICAL: Domain 'mw201.fsslc.wtnet' was not found by the server
[02:07:11] <icinga-miraheze>	 PROBLEM - os162 PowerDNS Recursor on os162 is CRITICAL: No response from DNS ::1
[02:07:11] <icinga-miraheze>	 PROBLEM - mwtask161 NTP time on mwtask161 is UNKNOWN: check_ntp_time: Invalid hostname/address - time.cloudflare.comUsage: check_ntp_time -H <host> [-4|-6] [-w <warn>] [-c <crit>] [-v verbose] [-o <time offset>]
[02:07:11] <icinga-miraheze>	 PROBLEM - swiftproxy171 NTP time on swiftproxy171 is UNKNOWN: check_ntp_time: Invalid hostname/address - time.cloudflare.comUsage: check_ntp_time -H <host> [-4|-6] [-w <warn>] [-c <crit>] [-v verbose] [-o <time offset>]
[02:07:11] <icinga-miraheze>	 PROBLEM - bots171 PowerDNS Recursor on bots171 is CRITICAL: Domain 'bots171.fsslc.wtnet' was not found by the server
[02:07:11] <icinga-miraheze>	 PROBLEM - mem201 PowerDNS Recursor on mem201 is CRITICAL: Domain 'mem201.fsslc.wtnet' was not found by the server
[02:07:13] <icinga-miraheze>	 PROBLEM - mw192 PowerDNS Recursor on mw192 is CRITICAL: Domain 'mw192.fsslc.wtnet' was not found by the server
[02:07:13] <icinga-miraheze>	 PROBLEM - swiftproxy171 PowerDNS Recursor on swiftproxy171 is CRITICAL: Domain 'swiftproxy171.fsslc.wtnet' was not found by the server
[02:07:15] <icinga-miraheze>	 PROBLEM - ldap171 NTP time on ldap171 is UNKNOWN: check_ntp_time: Invalid hostname/address - time.cloudflare.comUsage: check_ntp_time -H <host> [-4|-6] [-w <warn>] [-c <crit>] [-v verbose] [-o <time offset>]
[02:07:16] <icinga-miraheze>	 PROBLEM - mwtask161 PowerDNS Recursor on mwtask161 is CRITICAL: No response from DNS ::1
[02:07:18] <icinga-miraheze>	 PROBLEM - db181 NTP time on db181 is CRITICAL: NTP CRITICAL: No response from NTP server
[02:07:19] <icinga-miraheze>	 PROBLEM - swiftobject201 NTP time on swiftobject201 is UNKNOWN: check_ntp_time: Invalid hostname/address - time.cloudflare.comUsage: check_ntp_time -H <host> [-4|-6] [-w <warn>] [-c <crit>] [-v verbose] [-o <time offset>]
[02:07:21] <icinga-miraheze>	 PROBLEM - mw151 NTP time on mw151 is CRITICAL: NTP CRITICAL: No response from NTP server
[02:07:24] <icinga-miraheze>	 PROBLEM - mw202 NTP time on mw202 is CRITICAL: NTP CRITICAL: No response from NTP server
[02:07:25] <icinga-miraheze>	 PROBLEM - bots171 NTP time on bots171 is CRITICAL: NTP CRITICAL: No response from NTP server
[02:07:26] <icinga-miraheze>	 PROBLEM - mem151 NTP time on mem151 is CRITICAL: NTP CRITICAL: No response from NTP server
[02:07:26] <icinga-miraheze>	 PROBLEM - db182 NTP time on db182 is CRITICAL: NTP CRITICAL: No response from NTP server
[02:07:27] <icinga-miraheze>	 RECOVERY - cp191 PowerDNS Recursor on cp191 is OK: DNS OK: 2.158 seconds response time. cp191.wikitide.net returns 2602:294:0:b33::102
[02:07:31] <icinga-miraheze>	 RECOVERY - mwtask171 PowerDNS Recursor on mwtask171 is OK: DNS OK: 0.031 seconds response time. mwtask171.fsslc.wtnet returns 10.0.17.144
[02:07:33] <icinga-miraheze>	 PROBLEM - mw183 NTP time on mw183 is UNKNOWN: check_ntp_time: Invalid hostname/address - time.cloudflare.comUsage: check_ntp_time -H <host> [-4|-6] [-w <warn>] [-c <crit>] [-v verbose] [-o <time offset>]
[02:07:35] <icinga-miraheze>	 PROBLEM - mw163 NTP time on mw163 is UNKNOWN: check_ntp_time: Invalid hostname/address - time.cloudflare.comUsage: check_ntp_time -H <host> [-4|-6] [-w <warn>] [-c <crit>] [-v verbose] [-o <time offset>]
[02:07:36] <icinga-miraheze>	 PROBLEM - kafka181 NTP time on kafka181 is UNKNOWN: check_ntp_time: Invalid hostname/address - time.cloudflare.comUsage: check_ntp_time -H <host> [-4|-6] [-w <warn>] [-c <crit>] [-v verbose] [-o <time offset>]
[02:07:39] <icinga-miraheze>	 PROBLEM - reports171 NTP time on reports171 is UNKNOWN: check_ntp_time: Invalid hostname/address - time.cloudflare.comUsage: check_ntp_time -H <host> [-4|-6] [-w <warn>] [-c <crit>] [-v verbose] [-o <time offset>]
[02:07:40] <icinga-miraheze>	 RECOVERY - cp161 PowerDNS Recursor on cp161 is OK: DNS OK: 2.165 seconds response time. cp161.wikitide.net returns 2602:294:0:b13::110,38.46.223.205
[02:07:46] <icinga-miraheze>	 PROBLEM - swiftobject161 NTP time on swiftobject161 is UNKNOWN: check_ntp_time: Invalid hostname/address - time.cloudflare.comUsage: check_ntp_time -H <host> [-4|-6] [-w <warn>] [-c <crit>] [-v verbose] [-o <time offset>]
[02:07:51] <icinga-miraheze>	 PROBLEM - ns1 NTP time on ns1 is UNKNOWN: check_ntp_time: Invalid hostname/address - time.cloudflare.comUsage: check_ntp_time -H <host> [-4|-6] [-w <warn>] [-c <crit>] [-v verbose] [-o <time offset>]
[02:07:52] <icinga-miraheze>	 PROBLEM - os201 NTP time on os201 is UNKNOWN: check_ntp_time: Invalid hostname/address - time.cloudflare.comUsage: check_ntp_time -H <host> [-4|-6] [-w <warn>] [-c <crit>] [-v verbose] [-o <time offset>]
[02:07:55] <icinga-miraheze>	 RECOVERY - matomo151 PowerDNS Recursor on matomo151 is OK: DNS OK: 2.152 seconds response time. matomo151.fsslc.wtnet returns 10.0.15.112
[02:07:56] <icinga-miraheze>	 PROBLEM - mw193 NTP time on mw193 is UNKNOWN: check_ntp_time: Invalid hostname/address - time.cloudflare.comUsage: check_ntp_time -H <host> [-4|-6] [-w <warn>] [-c <crit>] [-v verbose] [-o <time offset>]
[02:08:13] <icinga-miraheze>	 PROBLEM - os161 NTP time on os161 is UNKNOWN: check_ntp_time: Invalid hostname/address - time.cloudflare.comUsage: check_ntp_time -H <host> [-4|-6] [-w <warn>] [-c <crit>] [-v verbose] [-o <time offset>]
[02:08:19] <icinga-miraheze>	 RECOVERY - os191 NTP time on os191 is OK: NTP OK: Offset -0.0003280043602 secs
[02:08:31] <icinga-miraheze>	 PROBLEM - mw201 NTP time on mw201 is UNKNOWN: check_ntp_time: Invalid hostname/address - time.cloudflare.comUsage: check_ntp_time -H <host> [-4|-6] [-w <warn>] [-c <crit>] [-v verbose] [-o <time offset>]
[02:08:33] <icinga-miraheze>	 PROBLEM - mem191 NTP time on mem191 is UNKNOWN: check_ntp_time: Invalid hostname/address - time.cloudflare.comUsage: check_ntp_time -H <host> [-4|-6] [-w <warn>] [-c <crit>] [-v verbose] [-o <time offset>]
[02:08:34] <icinga-miraheze>	 RECOVERY - swiftproxy171 Check unit status of swift-account-stats_mw:media on swiftproxy171 is OK: OK: Status of the systemd unit swift-account-stats_mw:media
[02:08:55] <icinga-miraheze>	 RECOVERY - swiftobject171 NTP time on swiftobject171 is OK: NTP OK: Offset -0.0001696646214 secs
[02:08:58] <icinga-miraheze>	 RECOVERY - os191 PowerDNS Recursor on os191 is OK: DNS OK: 0.392 seconds response time. os191.fsslc.wtnet returns 10.0.19.152
[02:09:02] <icinga-miraheze>	 PROBLEM - os162 NTP time on os162 is CRITICAL: NTP CRITICAL: No response from NTP server
[02:09:06] <icinga-miraheze>	 RECOVERY - os162 PowerDNS Recursor on os162 is OK: DNS OK: 0.425 seconds response time. os162.fsslc.wtnet returns 10.0.16.141
[02:09:12] <icinga-miraheze>	 RECOVERY - swiftproxy171 PowerDNS Recursor on swiftproxy171 is OK: DNS OK: 0.036 seconds response time. swiftproxy171.fsslc.wtnet returns 10.0.17.108
[02:09:13] <icinga-miraheze>	 RECOVERY - swiftproxy171 NTP time on swiftproxy171 is OK: NTP OK: Offset -0.0002530813217 secs
[02:09:13] <icinga-miraheze>	 PROBLEM - mw183 Puppet on mw183 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle.
[02:09:14] <icinga-miraheze>	 PROBLEM - matomo151 Puppet on matomo151 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle.
[02:09:21] <icinga-miraheze>	 PROBLEM - eventgate181 NTP time on eventgate181 is UNKNOWN: check_ntp_time: Invalid hostname/address - time.cloudflare.comUsage: check_ntp_time -H <host> [-4|-6] [-w <warn>] [-c <crit>] [-v verbose] [-o <time offset>]
[02:09:25] <icinga-miraheze>	 PROBLEM - db181 NTP time on db181 is UNKNOWN: check_ntp_time: Invalid hostname/address - time.cloudflare.comUsage: check_ntp_time -H <host> [-4|-6] [-w <warn>] [-c <crit>] [-v verbose] [-o <time offset>]
[02:09:29] <icinga-miraheze>	 RECOVERY - mw202 NTP time on mw202 is OK: NTP OK: Offset -0.0005392432213 secs
[02:09:31] <icinga-miraheze>	 PROBLEM - mw151 NTP time on mw151 is UNKNOWN: check_ntp_time: Invalid hostname/address - time.cloudflare.comUsage: check_ntp_time -H <host> [-4|-6] [-w <warn>] [-c <crit>] [-v verbose] [-o <time offset>]
[02:09:31] <icinga-miraheze>	 RECOVERY - swiftobject201 NTP time on swiftobject201 is OK: NTP OK: Offset -0.0004725456238 secs
[02:09:34] <icinga-miraheze>	 PROBLEM - bots171 NTP time on bots171 is UNKNOWN: check_ntp_time: Invalid hostname/address - time.cloudflare.comUsage: check_ntp_time -H <host> [-4|-6] [-w <warn>] [-c <crit>] [-v verbose] [-o <time offset>]
[02:09:34] <icinga-miraheze>	 PROBLEM - db182 NTP time on db182 is UNKNOWN: check_ntp_time: Invalid hostname/address - time.cloudflare.comUsage: check_ntp_time -H <host> [-4|-6] [-w <warn>] [-c <crit>] [-v verbose] [-o <time offset>]
[02:09:38] <icinga-miraheze>	 PROBLEM - mem151 NTP time on mem151 is UNKNOWN: check_ntp_time: Invalid hostname/address - time.cloudflare.comUsage: check_ntp_time -H <host> [-4|-6] [-w <warn>] [-c <crit>] [-v verbose] [-o <time offset>]
[02:10:06] <icinga-miraheze>	 RECOVERY - swiftobject171 PowerDNS Recursor on swiftobject171 is OK: DNS OK: 0.396 seconds response time. swiftobject171.fsslc.wtnet returns 10.0.17.126
[02:10:12] <icinga-miraheze>	 RECOVERY - mw202 PowerDNS Recursor on mw202 is OK: DNS OK: 0.284 seconds response time. mw202.fsslc.wtnet returns 10.0.20.163
[02:10:20] <icinga-miraheze>	 RECOVERY - swiftobject201 PowerDNS Recursor on swiftobject201 is OK: DNS OK: 0.275 seconds response time. swiftobject201.fsslc.wtnet returns 10.0.20.145
[02:10:40] <icinga-miraheze>	 PROBLEM - mw202 Puppet on mw202 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle.
[02:10:50] <icinga-miraheze>	 PROBLEM - db172 Puppet on db172 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle.
[02:11:06] <icinga-miraheze>	 RECOVERY - bots171 PowerDNS Recursor on bots171 is OK: DNS OK: 0.415 seconds response time. bots171.fsslc.wtnet returns 10.0.17.143
[02:11:06] <icinga-miraheze>	 RECOVERY - os162 NTP time on os162 is OK: NTP OK: Offset -0.0003300905228 secs
[02:11:09] <icinga-miraheze>	 RECOVERY - db172 NTP time on db172 is OK: NTP OK: Offset -0.0003048479557 secs
[02:11:23] <icinga-miraheze>	 RECOVERY - mwtask161 NTP time on mwtask161 is OK: NTP OK: Offset -0.0002809464931 secs
[02:11:36] <icinga-miraheze>	 RECOVERY - bots171 NTP time on bots171 is OK: NTP OK: Offset -0.0002889931202 secs
[02:11:51] <icinga-miraheze>	 RECOVERY - ns1 GDNSD Datacenters on ns1 is OK: OK - all datacenters are online
[02:11:51] <icinga-miraheze>	 RECOVERY - mw163 NTP time on mw163 is OK: NTP OK: Offset -0.0003280639648 secs
[02:11:59] <icinga-miraheze>	 PROBLEM - mem201 Puppet on mem201 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle.
[02:12:00] <icinga-miraheze>	 RECOVERY - swiftobject161 NTP time on swiftobject161 is OK: NTP OK: Offset -0.0002867281437 secs
[02:12:03] <icinga-miraheze>	 RECOVERY - ns1 NTP time on ns1 is OK: NTP OK: Offset -0.000164270401 secs
[02:12:09] <icinga-miraheze>	 RECOVERY - mem161 NTP time on mem161 is OK: NTP OK: Offset -0.0002214312553 secs
[02:12:11] <icinga-miraheze>	 RECOVERY - mw193 NTP time on mw193 is OK: NTP OK: Offset -0.0003532171249 secs
[02:12:14] <icinga-miraheze>	 RECOVERY - swiftobject161 PowerDNS Recursor on swiftobject161 is OK: DNS OK: 0.034 seconds response time. swiftobject161.fsslc.wtnet returns 10.0.16.134
[02:12:16] <icinga-miraheze>	 RECOVERY - mem161 PowerDNS Recursor on mem161 is OK: DNS OK: 0.274 seconds response time. mem161.fsslc.wtnet returns 10.0.16.131
[02:12:25] <icinga-miraheze>	 RECOVERY - db172 PowerDNS Recursor on db172 is OK: DNS OK: 0.036 seconds response time. db172.fsslc.wtnet returns 10.0.17.158
[02:12:30] <icinga-miraheze>	 RECOVERY - mw163 PowerDNS Recursor on mw163 is OK: DNS OK: 0.035 seconds response time. mw163.fsslc.wtnet returns 10.0.16.151
[02:12:38] <icinga-miraheze>	 RECOVERY - mwtask151 NTP time on mwtask151 is OK: NTP OK: Offset -0.0006358027458 secs
[02:12:48] <icinga-miraheze>	 RECOVERY - swiftproxy171 HTTPS on swiftproxy171 is OK: HTTP OK: Status line output matched "HTTP/1.1 404" - 352 bytes in 0.023 second response time
[02:12:55] <icinga-miraheze>	 RECOVERY - os151 NTP time on os151 is OK: NTP OK: Offset -0.0004840195179 secs
[02:12:59] <icinga-miraheze>	 RECOVERY - mwtask161 PowerDNS Recursor on mwtask161 is OK: DNS OK: 0.147 seconds response time. mwtask161.fsslc.wtnet returns 10.0.16.157
[02:13:01] <icinga-miraheze>	 RECOVERY - mw193 PowerDNS Recursor on mw193 is OK: DNS OK: 0.277 seconds response time. mw193.fsslc.wtnet returns 10.0.19.164
[02:13:16] <icinga-miraheze>	 RECOVERY - graylog161 NTP time on graylog161 is OK: NTP OK: Offset -0.0003079771996 secs
[02:13:16] <icinga-miraheze>	 RECOVERY - mwtask151 PowerDNS Recursor on mwtask151 is OK: DNS OK: 0.274 seconds response time. mwtask151.fsslc.wtnet returns 10.0.15.150
[02:13:25] <icinga-miraheze>	 PROBLEM - mw162 Puppet on mw162 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle.
[02:13:31] <icinga-miraheze>	 RECOVERY - changeprop201 NTP time on changeprop201 is OK: NTP OK: Offset -0.000509083271 secs
[02:13:44] <icinga-miraheze>	 RECOVERY - graylog161 PowerDNS Recursor on graylog161 is OK: DNS OK: 0.285 seconds response time. graylog161.fsslc.wtnet returns 10.0.16.130
[02:13:46] <icinga-miraheze>	 RECOVERY - mw183 NTP time on mw183 is OK: NTP OK: Offset -0.0007054209709 secs
[02:14:02] <icinga-miraheze>	 RECOVERY - swiftproxy171 HTTP on swiftproxy171 is OK: HTTP OK: Status line output matched "HTTP/1.1 404" - 352 bytes in 0.019 second response time
[02:14:02] <icinga-miraheze>	 RECOVERY - os151 PowerDNS Recursor on os151 is OK: DNS OK: 0.406 seconds response time. os151.fsslc.wtnet returns 10.0.15.111
[02:14:03] <icinga-miraheze>	 RECOVERY - changeprop201 PowerDNS Recursor on changeprop201 is OK: DNS OK: 0.033 seconds response time. changeprop201.fsslc.wtnet returns 10.0.20.149
[02:14:12] <MirahezeRelay>	 <cosmicalpha> Im lost why this keeps happening.... I have a theory but its confusing...
[02:14:16] <icinga-miraheze>	 RECOVERY - mw183 PowerDNS Recursor on mw183 is OK: DNS OK: 0.396 seconds response time. mw183.fsslc.wtnet returns 10.0.18.155
[02:14:43] <icinga-miraheze>	 RECOVERY - mw203 NTP time on mw203 is OK: NTP OK: Offset -0.0004305541515 secs
[02:14:43] <icinga-miraheze>	 RECOVERY - mw203 PowerDNS Recursor on mw203 is OK: DNS OK: 0.276 seconds response time. mw203.fsslc.wtnet returns 10.0.20.165
[02:14:47] <icinga-miraheze>	 PROBLEM - mwtask151 Puppet on mwtask151 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle.
[02:14:53] <icinga-miraheze>	 PROBLEM - mwtask161 Puppet on mwtask161 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle.
[02:15:02] <icinga-miraheze>	 PROBLEM - mw203 Puppet on mw203 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle.
[02:15:07] <icinga-miraheze>	 RECOVERY - ldap171 PowerDNS Recursor on ldap171 is OK: DNS OK: 2.153 seconds response time. ldap171.fsslc.wtnet returns 10.0.17.121
[02:15:13] <icinga-miraheze>	 PROBLEM - eventgate181 Puppet on eventgate181 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle.
[02:15:18] <icinga-miraheze>	 RECOVERY - mw153 NTP time on mw153 is OK: NTP OK: Offset -0.0004788339138 secs
[02:15:45] <icinga-miraheze>	 RECOVERY - ldap171 NTP time on ldap171 is OK: NTP OK: Offset -0.0002130270004 secs
[02:16:41] <icinga-miraheze>	 RECOVERY - mw192 NTP time on mw192 is OK: NTP OK: Offset -0.0005312263966 secs
[02:17:02] <icinga-miraheze>	 RECOVERY - mw192 PowerDNS Recursor on mw192 is OK: DNS OK: 0.285 seconds response time. mw192.fsslc.wtnet returns 10.0.19.161
[02:17:15] <icinga-miraheze>	 PROBLEM - db161 Puppet on db161 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle.
[02:17:45] <icinga-miraheze>	 RECOVERY - mw153 PowerDNS Recursor on mw153 is OK: DNS OK: 0.038 seconds response time. mw153.fsslc.wtnet returns 10.0.15.140
[02:18:32] <icinga-miraheze>	 RECOVERY - db181 PowerDNS Recursor on db181 is OK: DNS OK: 1.039 second response time. db181.fsslc.wtnet returns 10.0.18.102
[02:18:34] <icinga-miraheze>	 RECOVERY - reports171 NTP time on reports171 is OK: NTP OK: Offset -0.0004204511642 secs
[02:18:49] <icinga-miraheze>	 RECOVERY - mw201 PowerDNS Recursor on mw201 is OK: DNS OK: 0.040 seconds response time. mw201.fsslc.wtnet returns 10.0.20.162
[02:18:55] <icinga-miraheze>	 RECOVERY - mw191 NTP time on mw191 is OK: NTP OK: Offset -0.0005960464478 secs
[02:18:59] <icinga-miraheze>	 RECOVERY - mem201 PowerDNS Recursor on mem201 is OK: DNS OK: 0.035 seconds response time. mem201.fsslc.wtnet returns 10.0.20.148
[02:19:06] <icinga-miraheze>	 RECOVERY - mw201 NTP time on mw201 is OK: NTP OK: Offset -0.0005752146244 secs
[02:19:10] <icinga-miraheze>	 RECOVERY - db151 PowerDNS Recursor on db151 is OK: DNS OK: 0.396 seconds response time. db151.fsslc.wtnet returns 10.0.15.110
[02:19:10] <icinga-miraheze>	 RECOVERY - db151 NTP time on db151 is OK: NTP OK: Offset -0.0003605484962 secs
[02:19:11] <icinga-miraheze>	 RECOVERY - test151 NTP time on test151 is OK: NTP OK: Offset -0.0005218982697 secs
[02:19:51] <icinga-miraheze>	 RECOVERY - mem201 NTP time on mem201 is OK: NTP OK: Offset -0.0007266998291 secs
[02:19:55] <icinga-miraheze>	 RECOVERY - db181 NTP time on db181 is OK: NTP OK: Offset -0.0003709495068 secs
[02:20:08] <icinga-miraheze>	 RECOVERY - test151 PowerDNS Recursor on test151 is OK: DNS OK: 0.280 seconds response time. test151.fsslc.wtnet returns 10.0.15.118
[02:20:09] <icinga-miraheze>	 RECOVERY - reports171 PowerDNS Recursor on reports171 is OK: DNS OK: 0.399 seconds response time. reports171.fsslc.wtnet returns 10.0.17.139
[02:20:13] <icinga-miraheze>	 RECOVERY - mw191 PowerDNS Recursor on mw191 is OK: DNS OK: 0.022 seconds response time. mw191.fsslc.wtnet returns 10.0.19.160
[02:20:37] <icinga-miraheze>	 PROBLEM - os201 Puppet on os201 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle.
[02:20:38] <icinga-miraheze>	 RECOVERY - kafka181 NTP time on kafka181 is OK: NTP OK: Offset -0.0004161298275 secs
[02:20:56] <icinga-miraheze>	 PROBLEM - mem151 Puppet on mem151 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle.
[02:21:22] <icinga-miraheze>	 RECOVERY - kafka181 PowerDNS Recursor on kafka181 is OK: DNS OK: 0.161 seconds response time. kafka181.fsslc.wtnet returns 10.0.18.159
[02:21:52] <icinga-miraheze>	 PROBLEM - mw191 Puppet on mw191 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle.
[02:22:51] <icinga-miraheze>	 PROBLEM - kafka181 Puppet on kafka181 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle.
[02:24:08] <icinga-miraheze>	 PROBLEM - db182 Puppet on db182 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle.
[02:24:38] <icinga-miraheze>	 RECOVERY - db182 NTP time on db182 is OK: NTP OK: Offset -0.0007120668888 secs
[02:25:31] <icinga-miraheze>	 RECOVERY - mem191 NTP time on mem191 is OK: NTP OK: Offset -0.0006006360054 secs
[02:25:38] <icinga-miraheze>	 RECOVERY - os161 NTP time on os161 is OK: NTP OK: Offset -0.0004169344902 secs
[02:26:06] <icinga-miraheze>	 RECOVERY - mem191 PowerDNS Recursor on mem191 is OK: DNS OK: 0.037 seconds response time. mem191.fsslc.wtnet returns 10.0.19.154
[02:26:10] <icinga-miraheze>	 RECOVERY - db182 PowerDNS Recursor on db182 is OK: DNS OK: 0.405 seconds response time. db182.fsslc.wtnet returns 10.0.18.103
[02:26:24] <icinga-miraheze>	 RECOVERY - os161 PowerDNS Recursor on os161 is OK: DNS OK: 0.035 seconds response time. os161.fsslc.wtnet returns 10.0.16.129
[02:26:51] <icinga-miraheze>	 RECOVERY - mw151 NTP time on mw151 is OK: NTP OK: Offset -0.0005764365196 secs
[02:29:07] <icinga-miraheze>	 RECOVERY - mw151 PowerDNS Recursor on mw151 is OK: DNS OK: 0.038 seconds response time. mw151.fsslc.wtnet returns 10.0.15.114
[02:29:38] <icinga-miraheze>	 PROBLEM - mw151 Puppet on mw151 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle.
[02:30:10] <icinga-miraheze>	 PROBLEM - rdb151 Puppet on rdb151 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle.
[02:32:03] <icinga-miraheze>	 RECOVERY - rdb151 PowerDNS Recursor on rdb151 is OK: DNS OK: 0.034 seconds response time. rdb151.fsslc.wtnet returns 10.0.15.142
[02:32:31] <icinga-miraheze>	 RECOVERY - mem151 PowerDNS Recursor on mem151 is OK: DNS OK: 2.158 seconds response time. mem151.fsslc.wtnet returns 10.0.15.113
[02:32:56] <icinga-miraheze>	 RECOVERY - mem151 NTP time on mem151 is OK: NTP OK: Offset -0.0007322132587 secs
[02:32:56] <icinga-miraheze>	 RECOVERY - rdb151 NTP time on rdb151 is OK: NTP OK: Offset -0.0005278587341 secs
[02:33:34] <icinga-miraheze>	 RECOVERY - mw152 NTP time on mw152 is OK: NTP OK: Offset -0.000796765089 secs
[02:33:57] <icinga-miraheze>	 RECOVERY - mw162 NTP time on mw162 is OK: NTP OK: Offset -0.000245064497 secs
[02:34:37] <icinga-miraheze>	 RECOVERY - mw152 PowerDNS Recursor on mw152 is OK: DNS OK: 0.024 seconds response time. mw152.fsslc.wtnet returns 10.0.15.115
[02:35:01] <icinga-miraheze>	 PROBLEM - mw152 Puppet on mw152 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle.
[02:35:45] <icinga-miraheze>	 RECOVERY - mw162 PowerDNS Recursor on mw162 is OK: DNS OK: 0.035 seconds response time. mw162.fsslc.wtnet returns 10.0.16.133
[02:37:04] <icinga-miraheze>	 RECOVERY - matomo151 Puppet on matomo151 is OK: OK: Puppet is currently enabled, last run 32 seconds ago with 0 failures
[02:37:08] <icinga-miraheze>	 RECOVERY - mw183 Puppet on mw183 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures
[02:37:58] <icinga-miraheze>	 RECOVERY - mem201 Puppet on mem201 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures
[02:38:28] <icinga-miraheze>	 RECOVERY - db172 Puppet on db172 is OK: OK: Puppet is currently enabled, last run 2 seconds ago with 0 failures
[02:39:28] <icinga-miraheze>	 RECOVERY - mw162 Puppet on mw162 is OK: OK: Puppet is currently enabled, last run 24 seconds ago with 0 failures
[02:39:58] <icinga-miraheze>	 RECOVERY - eventgate181 NTP time on eventgate181 is OK: NTP OK: Offset -0.0004470348358 secs
[02:40:22] <icinga-miraheze>	 RECOVERY - mw202 Puppet on mw202 is OK: OK: Puppet is currently enabled, last run 55 seconds ago with 0 failures
[02:40:56] <icinga-miraheze>	 RECOVERY - eventgate181 PowerDNS Recursor on eventgate181 is OK: DNS OK: 0.041 seconds response time. eventgate181.fsslc.wtnet returns 10.0.18.147
[02:42:35] <icinga-miraheze>	 RECOVERY - mwtask161 Puppet on mwtask161 is OK: OK: Puppet is currently enabled, last run 13 seconds ago with 0 failures
[02:43:02] <icinga-miraheze>	 RECOVERY - mw203 Puppet on mw203 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures
[02:43:07] <icinga-miraheze>	 PROBLEM - matomo151 Check unit status of matomo-archiver-1 on matomo151 is CRITICAL: CRITICAL: Status of the systemd unit matomo-archiver-1
[02:43:33] <icinga-miraheze>	 PROBLEM - matomo151 Check unit status of matomo-archiver-2 on matomo151 is CRITICAL: CRITICAL: Status of the systemd unit matomo-archiver-2
[02:43:34] <icinga-miraheze>	 PROBLEM - matomo151 Check unit status of matomo-archiver-3 on matomo151 is CRITICAL: CRITICAL: Status of the systemd unit matomo-archiver-3
[02:44:33] <icinga-miraheze>	 RECOVERY - mwtask151 Puppet on mwtask151 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures
[02:46:56] <icinga-miraheze>	 RECOVERY - mem151 Puppet on mem151 is OK: OK: Puppet is currently enabled, last run 46 seconds ago with 0 failures
[02:47:03] <icinga-miraheze>	 RECOVERY - os201 NTP time on os201 is OK: NTP OK: Offset -0.001001060009 secs
[02:48:45] <icinga-miraheze>	 RECOVERY - kafka181 Puppet on kafka181 is OK: OK: Puppet is currently enabled, last run 24 seconds ago with 0 failures
[02:49:00] <icinga-miraheze>	 RECOVERY - os201 PowerDNS Recursor on os201 is OK: DNS OK: 0.164 seconds response time. os201.fsslc.wtnet returns 10.0.20.156
[02:51:51] <icinga-miraheze>	 RECOVERY - mw191 Puppet on mw191 is OK: OK: Puppet is currently enabled, last run 31 seconds ago with 0 failures
[02:52:08] <icinga-miraheze>	 RECOVERY - db182 Puppet on db182 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures
[02:56:10] <icinga-miraheze>	 RECOVERY - rdb151 Puppet on rdb151 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures
[02:59:38] <icinga-miraheze>	 RECOVERY - mw151 Puppet on mw151 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures
[03:02:49] <icinga-miraheze>	 PROBLEM - puppet181 Disk Space on puppet181 is WARNING: DISK WARNING - free space: / 2383MiB (7% inode=81%);
[03:04:58] <icinga-miraheze>	 RECOVERY - mw152 Puppet on mw152 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures
[03:06:48] <icinga-miraheze>	 RECOVERY - puppet181 Disk Space on puppet181 is OK: DISK OK - free space: / 4434MiB (14% inode=81%);
[03:11:02] <icinga-miraheze>	 RECOVERY - eventgate181 Puppet on eventgate181 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures
[03:16:30] <icinga-miraheze>	 RECOVERY - os201 Puppet on os201 is OK: OK: Puppet is currently enabled, last run 57 seconds ago with 0 failures
[03:41:26] <icinga-miraheze>	 RECOVERY - db161 NTP time on db161 is OK: NTP OK: Offset -0.0007945895195 secs
[03:42:44] <icinga-miraheze>	 RECOVERY - db161 PowerDNS Recursor on db161 is OK: DNS OK: 0.404 seconds response time. db161.fsslc.wtnet returns 10.0.16.128
[03:45:11] <icinga-miraheze>	 RECOVERY - db161 Puppet on db161 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures
[05:22:39] <icinga-miraheze>	 RECOVERY - mw162 NTP time on mw162 is OK: NTP OK: Offset -0.000530153513 secs
[05:22:52] <icinga-miraheze>	 RECOVERY - mw162 PowerDNS Recursor on mw162 is OK: DNS OK: 0.040 seconds response time. mw162.fsslc.wtnet returns 10.0.16.133
[05:23:19] <icinga-miraheze>	 RECOVERY - os162 NTP time on os162 is OK: NTP OK: Offset -0.0002414286137 secs
[05:24:07] <icinga-miraheze>	 RECOVERY - os162 PowerDNS Recursor on os162 is OK: DNS OK: 0.290 seconds response time. os162.fsslc.wtnet returns 10.0.16.141
[05:26:18] <icinga-miraheze>	 RECOVERY - mem191 NTP time on mem191 is OK: NTP OK: Offset -0.0007286965847 secs
[05:27:04] <icinga-miraheze>	 RECOVERY - mem191 PowerDNS Recursor on mem191 is OK: DNS OK: 0.400 seconds response time. mem191.fsslc.wtnet returns 10.0.19.154
[05:27:43] <icinga-miraheze>	 RECOVERY - mw172 PowerDNS Recursor on mw172 is OK: DNS OK: 0.402 seconds response time. mw172.fsslc.wtnet returns 10.0.17.123
[05:28:34] <icinga-miraheze>	 RECOVERY - graylog161 PowerDNS Recursor on graylog161 is OK: DNS OK: 0.039 seconds response time. graylog161.fsslc.wtnet returns 10.0.16.130
[05:28:36] <icinga-miraheze>	 PROBLEM - mem191 Puppet on mem191 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle.
[05:28:46] <icinga-miraheze>	 RECOVERY - mw172 NTP time on mw172 is OK: NTP OK: Offset -0.0005093514919 secs
[05:29:10] <icinga-miraheze>	 RECOVERY - graylog161 NTP time on graylog161 is OK: NTP OK: Offset -0.0006104409695 secs
[05:29:52] <icinga-miraheze>	 PROBLEM - db181 Puppet on db181 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle.
[05:31:13] <icinga-miraheze>	 PROBLEM - graylog161 Puppet on graylog161 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle.
[05:33:07] <icinga-miraheze>	 RECOVERY - test151 PowerDNS Recursor on test151 is OK: DNS OK: 0.033 seconds response time. test151.fsslc.wtnet returns 10.0.15.118
[05:33:16] <icinga-miraheze>	 PROBLEM - db151 Puppet on db151 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle.
[05:33:35] <icinga-miraheze>	 RECOVERY - test151 NTP time on test151 is OK: NTP OK: Offset -0.0004940032959 secs
[05:33:43] <icinga-miraheze>	 RECOVERY - mw193 NTP time on mw193 is OK: NTP OK: Offset -0.0008399784565 secs
[05:33:51] <icinga-miraheze>	 RECOVERY - bast181 Puppet on bast181 is OK: OK: Puppet is currently enabled, last run 52 seconds ago with 0 failures
[05:34:00] <icinga-miraheze>	 RECOVERY - mw193 PowerDNS Recursor on mw193 is OK: DNS OK: 0.033 seconds response time. mw193.fsslc.wtnet returns 10.0.19.164
[05:34:57] <icinga-miraheze>	 PROBLEM - os191 Puppet on os191 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle.
[05:35:18] <icinga-miraheze>	 RECOVERY - mw182 Puppet on mw182 is OK: OK: Puppet is currently enabled, last run 26 seconds ago with 0 failures
[05:35:56] <icinga-miraheze>	 RECOVERY - mw152 Puppet on mw152 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures
[05:36:03] <icinga-miraheze>	 RECOVERY - mw183 Puppet on mw183 is OK: OK: Puppet is currently enabled, last run 18 seconds ago with 0 failures
[05:37:16] <icinga-miraheze>	 RECOVERY - mon181 Puppet on mon181 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures
[05:39:02] <icinga-miraheze>	 RECOVERY - mw162 Puppet on mw162 is OK: OK: Puppet is currently enabled, last run 22 seconds ago with 0 failures
[05:39:38] <icinga-miraheze>	 RECOVERY - db181 NTP time on db181 is OK: NTP OK: Offset -0.001325696707 secs
[05:39:58] <icinga-miraheze>	 RECOVERY - mw161 Puppet on mw161 is OK: OK: Puppet is currently enabled, last run 3 seconds ago with 0 failures
[05:40:32] <icinga-miraheze>	 RECOVERY - swiftproxy171 Puppet on swiftproxy171 is OK: OK: Puppet is currently enabled, last run 38 seconds ago with 0 failures
[05:40:51] <icinga-miraheze>	 RECOVERY - mw172 Puppet on mw172 is OK: OK: Puppet is currently enabled, last run 36 seconds ago with 0 failures
[05:40:51] <icinga-miraheze>	 RECOVERY - mw202 Puppet on mw202 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures
[05:41:02] <icinga-miraheze>	 RECOVERY - mw203 Puppet on mw203 is OK: OK: Puppet is currently enabled, last run 12 seconds ago with 0 failures
[05:41:09] <icinga-miraheze>	 RECOVERY - db181 PowerDNS Recursor on db181 is OK: DNS OK: 0.035 seconds response time. db181.fsslc.wtnet returns 10.0.18.102
[05:42:18] <icinga-miraheze>	 RECOVERY - mem151 NTP time on mem151 is OK: NTP OK: Offset -0.0002843141556 secs
[05:42:55] <icinga-miraheze>	 RECOVERY - mem161 PowerDNS Recursor on mem161 is OK: DNS OK: 0.396 seconds response time. mem161.fsslc.wtnet returns 10.0.16.131
[05:43:09] <icinga-miraheze>	 RECOVERY - mem161 NTP time on mem161 is OK: NTP OK: Offset -0.0005965530872 secs
[05:43:13] <icinga-miraheze>	 RECOVERY - mwtask161 Puppet on mwtask161 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures
[05:43:42] <icinga-miraheze>	 RECOVERY - mem151 PowerDNS Recursor on mem151 is OK: DNS OK: 0.402 seconds response time. mem151.fsslc.wtnet returns 10.0.15.113
[05:46:56] <icinga-miraheze>	 RECOVERY - mem151 Puppet on mem151 is OK: OK: Puppet is currently enabled, last run 57 seconds ago with 0 failures
[05:47:13] <icinga-miraheze>	 RECOVERY - db151 NTP time on db151 is OK: NTP OK: Offset -0.001155048609 secs
[05:47:16] <icinga-miraheze>	 RECOVERY - mw193 Puppet on mw193 is OK: OK: Puppet is currently enabled, last run 32 seconds ago with 0 failures
[05:47:58] <icinga-miraheze>	 RECOVERY - db171 Puppet on db171 is OK: OK: Puppet is currently enabled, last run 8 seconds ago with 0 failures
[05:48:37] <icinga-miraheze>	 RECOVERY - db151 PowerDNS Recursor on db151 is OK: DNS OK: 0.391 seconds response time. db151.fsslc.wtnet returns 10.0.15.110
[05:50:16] <icinga-miraheze>	 RECOVERY - mem201 NTP time on mem201 is OK: NTP OK: Offset -0.0009875893593 secs
[05:50:50] <icinga-miraheze>	 RECOVERY - os191 NTP time on os191 is OK: NTP OK: Offset -0.0008552670479 secs
[05:51:33] <icinga-miraheze>	 RECOVERY - mem201 PowerDNS Recursor on mem201 is OK: DNS OK: 0.406 seconds response time. mem201.fsslc.wtnet returns 10.0.20.148
[05:51:58] <icinga-miraheze>	 RECOVERY - os191 PowerDNS Recursor on os191 is OK: DNS OK: 0.407 seconds response time. os191.fsslc.wtnet returns 10.0.19.152
[05:53:20] <icinga-miraheze>	 RECOVERY - os151 NTP time on os151 is OK: NTP OK: Offset -0.0008068680763 secs
[05:54:07] <icinga-miraheze>	 RECOVERY - os151 PowerDNS Recursor on os151 is OK: DNS OK: 0.428 seconds response time. os151.fsslc.wtnet returns 10.0.15.111
[05:56:16] <icinga-miraheze>	 RECOVERY - mem191 Puppet on mem191 is OK: OK: Puppet is currently enabled, last run 46 seconds ago with 0 failures
[05:57:16] <icinga-miraheze>	 RECOVERY - graylog161 Puppet on graylog161 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures
[05:59:44] <icinga-miraheze>	 RECOVERY - db181 Puppet on db181 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures
[06:00:54] <icinga-miraheze>	 RECOVERY - db151 Puppet on db151 is OK: OK: Puppet is currently enabled, last run 32 seconds ago with 0 failures
[06:01:14] <icinga-miraheze>	 RECOVERY - os191 Puppet on os191 is OK: OK: Puppet is currently enabled, last run 51 seconds ago with 0 failures
[06:04:46] <icinga-miraheze>	 RECOVERY - eventgate181 NTP time on eventgate181 is OK: NTP OK: Offset -0.002111166716 secs
[06:06:01] <icinga-miraheze>	 RECOVERY - eventgate181 PowerDNS Recursor on eventgate181 is OK: DNS OK: 0.041 seconds response time. eventgate181.fsslc.wtnet returns 10.0.18.147
[06:07:58] <icinga-miraheze>	 RECOVERY - mem201 Puppet on mem201 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures
[06:09:55] <icinga-miraheze>	 RECOVERY - eventgate181 Puppet on eventgate181 is OK: OK: Puppet is currently enabled, last run 13 seconds ago with 0 failures
[06:12:39] <icinga-miraheze>	 RECOVERY - mem161 Puppet on mem161 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures
[06:16:44] <icinga-miraheze>	 RECOVERY - os151 Puppet on os151 is OK: OK: Puppet is currently enabled, last run 0 seconds ago with 0 failures
[06:45:03] <MirahezeRelay>	 <posix_memalign, replying to picholasstripes2000> [1/2] Not a good channel for your question btw. 
[06:45:03] <MirahezeRelay>	 <posix_memalign, replying to picholasstripes2000> [2/2] The image is fine on my side. Have you tried visiting the wiki using a different browser/incognito mode?
[08:01:07] <icinga-miraheze>	 RECOVERY - matomo151 Check unit status of matomo-archiver-1 on matomo151 is OK: OK: Status of the systemd unit matomo-archiver-1
[08:01:33] <icinga-miraheze>	 RECOVERY - matomo151 Check unit status of matomo-archiver-2 on matomo151 is OK: OK: Status of the systemd unit matomo-archiver-2
[08:03:34] <icinga-miraheze>	 RECOVERY - matomo151 Check unit status of matomo-archiver-3 on matomo151 is OK: OK: Status of the systemd unit matomo-archiver-3
[08:22:07] <icinga-miraheze>	 PROBLEM - cp171 Disk Space on cp171 is WARNING: DISK WARNING - free space: / 49877MiB (10% inode=99%);
[09:59:06] <icinga-miraheze>	 PROBLEM - cp201 Disk Space on cp201 is WARNING: DISK WARNING - free space: / 49846MiB (10% inode=99%);
[11:18:49] <icinga-miraheze>	 PROBLEM - cp191 Disk Space on cp191 is WARNING: DISK WARNING - free space: / 49938MiB (10% inode=99%);
[16:42:56] <icinga-miraheze>	 [Grafana] FIRING: The mediawiki JobQueue backlog is increasing by more than 100 jobs a minute over an extended time period https://grafana.wikitide.net/d/GtxbP1Xnk?from=1754840540000&orgId=1&to=1754844176679
[17:06:20] <MacFanBot>	 [02mediawiki-repos] 07Universal-Omega created 03RequestCustomDomain (+1 new commit) 13https://github.com/miraheze/mediawiki-repos/commit/71eac013423d
[17:06:20] <MacFanBot>	 02mediawiki-repos/03RequestCustomDomain 07CosmicAlpha 0371eac01 Replace RequestSSL with RequestCustomDomain
[17:06:24] <MacFanBot>	 [02mediawiki-repos] 07Universal-Omega opened pull request #86: Replace RequestSSL with RequestCustomDomain (03main...03RequestCustomDomain) 13https://github.com/miraheze/mediawiki-repos/pull/86
[17:06:31] <MacFanBot>	 [02mediawiki-repos] 07coderabbitai[bot] commented on pull request #86: <details> […] 13https://github.com/miraheze/mediawiki-repos/pull/86#issuecomment-3172771544
[17:07:27] <MacFanBot>	 [02RequestSSL] 07Universal-Omega merged pull request #88: Finalize extension rename (03main...03rename-final) 13https://github.com/miraheze/RequestSSL/pull/88
[17:07:27] <MacFanBot>	 [02RequestSSL] 07Universal-Omega pushed 1 new commit to 03main 13https://github.com/miraheze/RequestSSL/commit/5bc22fac8790e8e85a0019310d69b5d96b042ca7
[17:07:27] <MacFanBot>	 02RequestSSL/03main 07CosmicAlpha 035bc22fa Finalize extension rename…
[17:07:28] <MacFanBot>	 [02RequestSSL] 07Universal-Omega 04deleted 03rename-final at 030c640d9 13https://api.github.com/repos/miraheze/RequestSSL/commit/0c640d9
[17:08:04] <MacFanBot>	 [02mediawiki-repos] 07Universal-Omega merged pull request #86: Replace RequestSSL with RequestCustomDomain (03main...03RequestCustomDomain) 13https://github.com/miraheze/mediawiki-repos/pull/86
[17:08:05] <MacFanBot>	 [02mediawiki-repos] 07Universal-Omega pushed 1 new commit to 03main 13https://github.com/miraheze/mediawiki-repos/commit/42d6c00686619be8ef74d0c5f963a01c09d4dd69
[17:08:05] <MacFanBot>	 02mediawiki-repos/03main 07CosmicAlpha 0342d6c00 Replace RequestSSL with RequestCustomDomain
[17:08:05] <MacFanBot>	 [02mediawiki-repos] 07Universal-Omega 04deleted 03RequestCustomDomain at 0371eac01 13https://api.github.com/repos/miraheze/mediawiki-repos/commit/71eac01
[17:13:54] <MacFanBot>	 [02MirahezeMagic] 07Universal-Omega pushed 1 new commit to 03main 13https://github.com/miraheze/MirahezeMagic/commit/fd8f9998beaf30dd370bc9c23d70d8f5e70e23af
[17:13:54] <MacFanBot>	 02MirahezeMagic/03main 07CosmicAlpha 03fd8f999 Rename the requestssl-help-target-subdomain message
[17:26:10] <miraheze-github>	 miraheze/RequestSSL - Universal-Omega the build passed.
[17:26:28] <miraheze-github>	 miraheze/MirahezeMagic - Universal-Omega the build passed.
[17:52:56] <icinga-miraheze>	 [Grafana] RESOLVED: MediaWiki Jobs are rapidly increasing https://grafana.wikitide.net/d/GtxbP1Xnk?from=1754844500000&orgId=1&to=1754848100000
[18:43:05] <MacFanBot>	 [02MirahezeMagic] 07Universal-Omega pushed 1 new commit to 03rw-ui 13https://github.com/miraheze/MirahezeMagic/commit/499703f1323de8f8c18e33d0eb2e4c729e99a0bb
[18:43:05] <MacFanBot>	 02MirahezeMagic/03rw-ui 07CosmicAlpha 03499703f Merge branch 'main' into rw-ui
[18:46:56] <MacFanBot>	 [02mw-config] 07Universal-Omega pushed 1 new commit to 03main 13https://github.com/miraheze/mw-config/commit/8bad74f3d88eaecf87bde0278b9b6cbd7ad4f8a5
[18:46:56] <MacFanBot>	 02mw-config/03main 07CosmicAlpha 038bad74f Remove RequestSSL from metawikibeta…
[18:47:48] <miraheze-github>	 miraheze/mw-config - Universal-Omega the build passed.
[18:48:27] <MacFanBot>	 [02mw-config] 07Universal-Omega pushed 1 new commit to 03main 13https://github.com/miraheze/mw-config/commit/3742e2fd12872ca2419216087f89f494a00e5bd1
[18:48:27] <MacFanBot>	 02mw-config/03main 07CosmicAlpha 033742e2f Enable RequestCustomDomain on metawikibeta
[18:49:17] <miraheze-github>	 miraheze/mw-config - Universal-Omega the build passed.
[18:49:21] <MirahezeLSBot>	 !log [universalomega@test151] rm -rf /srv/*/*/extensions/RequestSSL
[18:51:04] <MirahezeLSBot>	 !log [universalomega@mwtask181] starting deploy of {'force_upgrade': True, 'versions': ['1.43', '1.44'], 'upgrade_extensions': ['MirahezeMagic', 'RequestCustomDomain']} to all
[18:53:08] <MirahezeLSBot>	 !log [universalomega@mwtask181] finished deploy of {'force_upgrade': True, 'versions': ['1.43', '1.44'], 'upgrade_extensions': ['MirahezeMagic', 'RequestCustomDomain']} to all - SUCCESS in 124s
[18:54:16] <MacFanBot>	 [02mw-config] 07Universal-Omega pushed 1 new commit to 03main 13https://github.com/miraheze/mw-config/commit/20f3711650e74284315757ab0db99beafea2890a
[18:54:17] <MacFanBot>	 02mw-config/03main 07CosmicAlpha 0320f3711 Remove RequestSSL from metawiki…
[18:54:26] <MirahezeLSBot>	 !log [universalomega@mwtask181] starting deploy of {'pull': 'config', 'config': True} to all
[18:54:57] <MirahezeLSBot>	 !log [universalomega@mwtask181] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 31s
[18:55:01] <miraheze-github>	 miraheze/MirahezeMagic - Universal-Omega the build passed.
[18:55:13] <miraheze-github>	 miraheze/mw-config - Universal-Omega the build passed.
[18:56:27] <MirahezeLSBot>	 !log [universalomega@puppet181] rm -rf /srv/*/*/extensions/RequestSSL on mw*
[18:58:51] <MacFanBot>	 [02mw-config] 07Universal-Omega pushed 1 new commit to 03main 13https://github.com/miraheze/mw-config/commit/279fa7be6a52bf5afc681da72f323a0af81cc791
[18:58:51] <MacFanBot>	 02mw-config/03main 07CosmicAlpha 03279fa7b Enable RequestCustomDomain on metawiki
[18:58:57] <MirahezeLSBot>	 !log [universalomega@mwtask181] starting deploy of {'pull': 'config', 'config': True} to all
[18:59:27] <MirahezeLSBot>	 !log [universalomega@mwtask181] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 30s
[18:59:43] <miraheze-github>	 miraheze/mw-config - Universal-Omega the build passed.
[19:08:19] <MacFanBot>	 [02.github] 07Universal-Omega pushed 1 new commit to 03main 13https://github.com/miraheze/.github/commit/d42906e82b2427983160e71374c78988ce09906f
[19:08:19] <MacFanBot>	 02.github/03main 07CosmicAlpha 03d42906e Replace RequestSSL with RequestCustomDomain
[19:10:44] <MacFanBot>	 [02puppet] 07Universal-Omega pushed 1 new commit to 03main 13https://github.com/miraheze/puppet/commit/d36d797b32b665e6020044ad33b08da58c516050
[19:10:44] <MacFanBot>	 02puppet/03main 07CosmicAlpha 03d36d797 Replace RequestSSL with RequestCustomDomain and remove YouTube
[19:11:59] <miraheze-github>	 miraheze/puppet - Universal-Omega the build has errored.
[19:21:42] <MacFanBot>	 [02python-functions] 07Universal-Omega pushed 1 new commit to 03main 13https://github.com/miraheze/python-functions/commit/0a0f8702c0a3ef778986b5401697c22598c36f16
[19:21:42] <MacFanBot>	 02python-functions/03main 07CosmicAlpha 030a0f870 Replace RequestSSL with RequestCustomDomain and remove YouTube and SpriteSheet
[19:22:56] <icinga-miraheze>	 PROBLEM - cp161 HTTP 4xx/5xx ERROR Rate on cp161 is CRITICAL: CRITICAL - NGINX Error Rate is 65%
[19:24:18] <MacFanBot>	 [02RequestCustomDomain] 07Universal-Omega pushed 1 new commit to 03main 13https://github.com/miraheze/RequestCustomDomain/commit/841012d849978a2c8a3cc2982a70de7021df9e51
[19:24:18] <MacFanBot>	 02RequestCustomDomain/03main 07CosmicAlpha 03841012d Update message
[19:25:51] <MacFanBot>	 [02RequestCustomDomain] 07Universal-Omega pushed 1 new commit to 03main 13https://github.com/miraheze/RequestCustomDomain/commit/f6bfbbca863d3c3874605b47d487b6a729fd7415
[19:25:51] <MacFanBot>	 02RequestCustomDomain/03main 07CosmicAlpha 03f6bfbbc Remove unused message
[19:26:56] <icinga-miraheze>	 PROBLEM - cp161 HTTP 4xx/5xx ERROR Rate on cp161 is WARNING: WARNING - NGINX Error Rate is 58%
[19:28:31] <MirahezeRelay>	 <cosmicalpha> Finally the RequestSSL -> RequestCustomDomain rename is fully completed...
[19:28:33] <miraheze-github>	 miraheze/python-functions - Universal-Omega the build passed.
[19:28:56] <icinga-miraheze>	 PROBLEM - cp161 HTTP 4xx/5xx ERROR Rate on cp161 is CRITICAL: CRITICAL - NGINX Error Rate is 68%
[19:38:56] <icinga-miraheze>	 PROBLEM - cp161 HTTP 4xx/5xx ERROR Rate on cp161 is WARNING: WARNING - NGINX Error Rate is 58%
[19:40:56] <icinga-miraheze>	 PROBLEM - cp161 HTTP 4xx/5xx ERROR Rate on cp161 is CRITICAL: CRITICAL - NGINX Error Rate is 60%
[19:44:47] <miraheze-github>	 miraheze/RequestCustomDomain - Universal-Omega the build passed.
[19:44:56] <icinga-miraheze>	 PROBLEM - cp161 HTTP 4xx/5xx ERROR Rate on cp161 is WARNING: WARNING - NGINX Error Rate is 56%
[19:46:56] <icinga-miraheze>	 PROBLEM - cp161 HTTP 4xx/5xx ERROR Rate on cp161 is CRITICAL: CRITICAL - NGINX Error Rate is 74%
[19:48:56] <icinga-miraheze>	 RECOVERY - cp161 HTTP 4xx/5xx ERROR Rate on cp161 is OK: OK - NGINX Error Rate is 14%
[22:45:42] <MacFanBot>	 [02ManageWiki] 07Universal-Omega created 03cache (+1 new commit) 13https://github.com/miraheze/ManageWiki/commit/6ce4cdbda6bb
[22:45:42] <MacFanBot>	 02ManageWiki/03cache 07CosmicAlpha 036ce4cdb Move wiki cache handling from CreateWiki to ManageWiki
[22:45:47] <MacFanBot>	 [02ManageWiki] 07Universal-Omega opened pull request #722: Move wiki cache handling from CreateWiki to ManageWiki (03main...03cache) 13https://github.com/miraheze/ManageWiki/pull/722
[22:45:53] <MacFanBot>	 [02ManageWiki] 07coderabbitai[bot] commented on pull request #722: <details> […] 13https://github.com/miraheze/ManageWiki/pull/722#issuecomment-3172943346
[22:48:00] <MacFanBot>	 [02ManageWiki] 07Universal-Omega pushed 1 new commit to 03cache 13https://github.com/miraheze/ManageWiki/commit/38873ef29bb463c58685eb4ab4ea1b2cffce730b
[22:48:00] <MacFanBot>	 02ManageWiki/03cache 07CosmicAlpha 0338873ef Add
[22:51:38] <miraheze-github>	 miraheze/ManageWiki - Universal-Omega the build has errored.
[22:59:07] <MacFanBot>	 [02ManageWiki] 07Universal-Omega pushed 1 new commit to 03cache 13https://github.com/miraheze/ManageWiki/commit/4563f5c72f3710f26106c0dcf1bfbcf242f8ba55
[22:59:07] <MacFanBot>	 02ManageWiki/03cache 07CosmicAlpha 034563f5c Add
[23:00:59] <MacFanBot>	 [02ManageWiki] 07Universal-Omega pushed 1 new commit to 03cache 13https://github.com/miraheze/ManageWiki/commit/2da4de1d3397cb290f50b9a6871ca33e5d18996d
[23:00:59] <MacFanBot>	 02ManageWiki/03cache 07CosmicAlpha 032da4de1 Update
[23:03:07] <MacFanBot>	 [02ManageWiki] 07Universal-Omega pushed 1 new commit to 03cache 13https://github.com/miraheze/ManageWiki/commit/c1304eb88585b15e0d8beb85bf5a8c5042ca5f8b
[23:03:07] <MacFanBot>	 02ManageWiki/03cache 07CosmicAlpha 03c1304eb Add
[23:05:07] <MacFanBot>	 [02ManageWiki] 07Universal-Omega pushed 1 new commit to 03cache 13https://github.com/miraheze/ManageWiki/commit/8a0a99d2fce0d64bfbf18cbfd824e12d1e90d1c2
[23:05:07] <MacFanBot>	 02ManageWiki/03cache 07CosmicAlpha 038a0a99d Update
[23:06:34] <MacFanBot>	 [02ManageWiki] 07Universal-Omega pushed 1 new commit to 03cache 13https://github.com/miraheze/ManageWiki/commit/b5283cb9986afb985a08a6d24b45cdda9ec0b953
[23:06:34] <MacFanBot>	 02ManageWiki/03cache 07CosmicAlpha 03b5283cb Update
[23:07:22] <MacFanBot>	 [02ManageWiki] 07Universal-Omega pushed 1 new commit to 03cache 13https://github.com/miraheze/ManageWiki/commit/3844d68a64897d3269ea4eb530e91b43831beaa1
[23:07:22] <MacFanBot>	 02ManageWiki/03cache 07CosmicAlpha 033844d68 Update
[23:07:59] <MacFanBot>	 [02ManageWiki] 07Universal-Omega pushed 1 new commit to 03cache 13https://github.com/miraheze/ManageWiki/commit/0b194932917cda8a4acc15cf46f4db5348c588a1
[23:07:59] <MacFanBot>	 02ManageWiki/03cache 07CosmicAlpha 030b19493 Update
[23:08:34] <MacFanBot>	 [02ManageWiki] 07Universal-Omega pushed 1 new commit to 03cache 13https://github.com/miraheze/ManageWiki/commit/8b7210914bdb67e2abae325db5e86b81b60ceced
[23:08:34] <MacFanBot>	 02ManageWiki/03cache 07CosmicAlpha 038b72109 Update
[23:09:06] <MacFanBot>	 [02ManageWiki] 07Universal-Omega pushed 1 new commit to 03cache 13https://github.com/miraheze/ManageWiki/commit/9670b4fd44bbf304cd38c3bddc204842baf63d3b
[23:09:06] <MacFanBot>	 02ManageWiki/03cache 07CosmicAlpha 039670b4f Update
[23:10:45] <MacFanBot>	 [02ManageWiki] 07Universal-Omega pushed 1 new commit to 03cache 13https://github.com/miraheze/ManageWiki/commit/3d4aa9a6248619f2326798886c57569fae01b23c
[23:10:45] <MacFanBot>	 02ManageWiki/03cache 07CosmicAlpha 033d4aa9a Update
[23:11:33] <MacFanBot>	 [02ManageWiki] 07Universal-Omega pushed 1 new commit to 03cache 13https://github.com/miraheze/ManageWiki/commit/5679d3866eef8d57dd96f82b72e8b830048d2fb5
[23:11:33] <MacFanBot>	 02ManageWiki/03cache 07CosmicAlpha 035679d38 Update
[23:12:10] <MacFanBot>	 [02ManageWiki] 07Universal-Omega pushed 1 new commit to 03cache 13https://github.com/miraheze/ManageWiki/commit/bda71be9b7a4d34d1d098383cf6f50a849c360bb
[23:12:10] <MacFanBot>	 02ManageWiki/03cache 07CosmicAlpha 03bda71be Update
[23:12:49] <MacFanBot>	 [02ManageWiki] 07Universal-Omega pushed 1 new commit to 03cache 13https://github.com/miraheze/ManageWiki/commit/0b8136c5910924156b167cda0b8b86f565e45c55
[23:12:50] <MacFanBot>	 02ManageWiki/03cache 07CosmicAlpha 030b8136c Update
[23:14:55] <MacFanBot>	 [02ManageWiki] 07Universal-Omega pushed 1 new commit to 03cache 13https://github.com/miraheze/ManageWiki/commit/f1bb04a67c02ccf7af208dab1e5b68d4208f535b
[23:14:55] <MacFanBot>	 02ManageWiki/03cache 07CosmicAlpha 03f1bb04a Add
[23:16:22] <MacFanBot>	 [02ManageWiki] 07Universal-Omega pushed 1 new commit to 03cache 13https://github.com/miraheze/ManageWiki/commit/24c0c2478a46d9414ad67f32f9564a879a4fc749
[23:16:22] <MacFanBot>	 02ManageWiki/03cache 07CosmicAlpha 0324c0c24 Add
[23:19:53] <miraheze-github>	 miraheze/ManageWiki - Universal-Omega the build has errored.
[23:20:46] <MacFanBot>	 [02ManageWiki] 07Universal-Omega pushed 1 new commit to 03cache 13https://github.com/miraheze/ManageWiki/commit/952225bebc192f02bcc79c8b820f23d7ff6f4969
[23:20:46] <MacFanBot>	 02ManageWiki/03cache 07CosmicAlpha 03952225b Fix
[23:21:00] <MacFanBot>	 [02ManageWiki] 07Universal-Omega un-readied pull request #722: Move wiki cache handling from CreateWiki to ManageWiki (03main...03cache) 13https://github.com/miraheze/ManageWiki/pull/722
[23:22:19] <MacFanBot>	 [02ManageWiki] 07Universal-Omega pushed 1 new commit to 03cache 13https://github.com/miraheze/ManageWiki/commit/276ac22313bf3473e927ba785b56a4164f01f318
[23:22:20] <MacFanBot>	 02ManageWiki/03cache 07CosmicAlpha 03276ac22 Fix
[23:28:08] <miraheze-github>	 miraheze/ManageWiki - Universal-Omega the build passed.
[23:28:56] <icinga-miraheze>	 PROBLEM - puppet181 Check unit status of listdomains_github_push on puppet181 is CRITICAL: CRITICAL: Status of the systemd unit listdomains_github_push
[23:31:50] <MacFanBot>	 [02ManageWiki] 07Universal-Omega pushed 1 new commit to 03cache 13https://github.com/miraheze/ManageWiki/commit/a2090d109d7bf3840ec33e2d51042e1e2e6386f3
[23:31:50] <MacFanBot>	 02ManageWiki/03cache 07CosmicAlpha 03a2090d1 Use const
[23:36:56] <icinga-miraheze>	 RECOVERY - puppet181 Check unit status of listdomains_github_push on puppet181 is OK: OK: Status of the systemd unit listdomains_github_push
[23:37:30] <miraheze-github>	 miraheze/ManageWiki - Universal-Omega the build passed.
[23:38:24] <MacFanBot>	 [02RequestCustomDomain] 07Universal-Omega pushed 1 new commit to 03main 13https://github.com/miraheze/RequestCustomDomain/commit/71b8624fc4e19a9f7ea4f3cd0c7c331fa102249d
[23:38:24] <MacFanBot>	 02RequestCustomDomain/03main 07CosmicAlpha 0371b8624 Rename messages across all languages
[23:57:16] <miraheze-github>	 miraheze/RequestCustomDomain - Universal-Omega the build passed.