[00:00:34] miraheze/CreateWiki - Universal-Omega the build has errored. [00:07:29] PROBLEM - mwtask181 Current Load on mwtask181 is CRITICAL: LOAD CRITICAL - total load average: 28.21, 16.24, 7.73 [00:09:29] RECOVERY - mwtask181 Current Load on mwtask181 is OK: LOAD OK - total load average: 10.35, 14.82, 8.35 [00:13:13] RECOVERY - cp37 Disk Space on cp37 is OK: DISK OK - free space: / 51802MiB (11% inode=99%); [00:21:01] PROBLEM - ecole.science - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'ecole.science' expires in 14 day(s) (Sat 08 Mar 2025 12:02:35 AM GMT +0000). [00:26:00] RECOVERY - civwiki.org - LetsEncrypt on sslhost is OK: OK - Certificate 'civwiki.org' will expire on Wed 21 May 2025 10:57:37 PM GMT +0000. [00:34:32] miraheze/CreateWiki - Universal-Omega the build passed. [00:45:16] PROBLEM - guia.esporo.net - Cloudflare on sslhost is CRITICAL: Temporary failure in name resolutionHTTP CRITICAL - Unable to open TCP socket [00:50:31] RECOVERY - ecole.science - LetsEncrypt on sslhost is OK: OK - Certificate 'ecole.science' will expire on Wed 21 May 2025 11:22:36 PM GMT +0000. [00:52:05] miraheze/CreateWiki - Universal-Omega the build passed. [01:21:13] PROBLEM - cp37 Disk Space on cp37 is WARNING: DISK WARNING - free space: / 49828MiB (10% inode=99%); [02:03:32] miraheze/CreateWiki - Universal-Omega the build has errored. [02:13:25] RECOVERY - guia.esporo.net - Cloudflare on sslhost is OK: OK - Certificate 'guia.esporo.net' will expire on Wed 26 Mar 2025 02:54:55 PM GMT +0000. [02:14:26] miraheze/CreateWiki - Universal-Omega the build has errored. [03:11:42] PROBLEM - wikimoma.art - LetsEncrypt on sslhost is CRITICAL: connect to address wikimoma.art and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [03:11:50] PROBLEM - metroidpedia.com - LetsEncrypt on sslhost is CRITICAL: connect to address metroidpedia.com and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [03:12:01] PROBLEM - cp36 HTTP 4xx/5xx ERROR Rate on cp36 is CRITICAL: CRITICAL - NGINX Error Rate is 83% [03:12:04] PROBLEM - cp36 HTTPS on cp36 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 7 - Failed to connect to cp36.wikitide.net port 443 after 0 ms: Couldn't connect to server [03:12:07] PROBLEM - buildabearwiki.info - LetsEncrypt on sslhost is CRITICAL: connect to address buildabearwiki.info and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [03:12:12] PROBLEM - hardcore.wiki - LetsEncrypt on sslhost is CRITICAL: connect to address hardcore.wiki and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [03:12:15] PROBLEM - burnout.wiki - LetsEncrypt on sslhost is CRITICAL: connect to address burnout.wiki and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [03:12:15] PROBLEM - cp36 Nginx Backend for mw171 on cp36 is CRITICAL: connect to address localhost and port 8117: Connection refused [03:12:15] PROBLEM - mwtask151 Current Load on mwtask151 is WARNING: LOAD WARNING - total load average: 23.34, 16.10, 7.86 [03:12:18] PROBLEM - cp36 Nginx Backend for matomo151 on cp36 is CRITICAL: connect to address localhost and port 8203: Connection refused [03:12:18] PROBLEM - cp36 Nginx Backend for test151 on cp36 is CRITICAL: connect to address localhost and port 8181: Connection refused [03:12:21] PROBLEM - cp36 Nginx Backend for mw154 on cp36 is CRITICAL: connect to address localhost and port 8122: Connection refused [03:12:22] PROBLEM - cp36 Nginx Backend for mw172 on cp36 is CRITICAL: connect to address localhost and port 8118: Connection refused [03:12:23] PROBLEM - ns1 GDNSD Datacenters on ns1 is CRITICAL: CRITICAL - 2 datacenters are down: 38.46.223.205/cpweb, 2602:294:0:b13::110/cpweb [03:12:25] PROBLEM - cp36 Nginx Backend for mw181 on cp36 is CRITICAL: connect to address localhost and port 8119: Connection refused [03:12:33] PROBLEM - cp36 Nginx Backend for mon181 on cp36 is CRITICAL: connect to address localhost and port 8201: Connection refused [03:12:40] PROBLEM - baharna.org - LetsEncrypt on sslhost is CRITICAL: connect to address baharna.org and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [03:12:43] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 2 datacenters are down: 38.46.223.205/cpweb, 2602:294:0:b13::110/cpweb [03:12:44] PROBLEM - fashiondreamer.wiki - LetsEncrypt on sslhost is CRITICAL: connect to address fashiondreamer.wiki and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [03:12:49] PROBLEM - cp36 Nginx Backend for puppet181 on cp36 is CRITICAL: connect to address localhost and port 8204: Connection refused [03:12:50] PROBLEM - vilexia.com - LetsEncrypt on sslhost is CRITICAL: connect to address vilexia.com and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [03:12:50] PROBLEM - cp36 Nginx Backend for mw182 on cp36 is CRITICAL: connect to address localhost and port 8120: Connection refused [03:12:55] PROBLEM - iceria.org - LetsEncrypt on sslhost is CRITICAL: connect to address iceria.org and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [03:12:57] PROBLEM - cp36 Nginx Backend for mw163 on cp36 is CRITICAL: connect to address localhost and port 8123: Connection refused [03:12:58] PROBLEM - cp36 Nginx Backend for phorge171 on cp36 is CRITICAL: connect to address localhost and port 8202: Connection refused [03:13:03] PROBLEM - cp36 Nginx Backend for swiftproxy161 on cp36 is CRITICAL: connect to address localhost and port 8206: Connection refused [03:13:03] PROBLEM - osdev.wiki - LetsEncrypt on sslhost is CRITICAL: connect to address osdev.wiki and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [03:13:04] PROBLEM - cp36 Nginx Backend for mw161 on cp36 is CRITICAL: connect to address localhost and port 8115: Connection refused [03:13:06] PROBLEM - cp36 Nginx Backend for mw173 on cp36 is CRITICAL: connect to address localhost and port 8125: Connection refused [03:13:10] PROBLEM - cp36 Nginx Backend for mw151 on cp36 is CRITICAL: connect to address localhost and port 8113: Connection refused [03:13:20] PROBLEM - cp36 Nginx Backend for reports171 on cp36 is CRITICAL: connect to address localhost and port 8205: Connection refused [03:13:29] PROBLEM - cp36 Nginx Backend for mw183 on cp36 is CRITICAL: connect to address localhost and port 8127: Connection refused [03:13:32] PROBLEM - cpmusicwiki.com - LetsEncrypt on sslhost is CRITICAL: connect to address cpmusicwiki.com and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [03:13:32] PROBLEM - podpedia.org - LetsEncrypt on sslhost is CRITICAL: connect to address podpedia.org and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [03:13:33] PROBLEM - cp36 Nginx Backend for mw184 on cp36 is CRITICAL: connect to address localhost and port 8128: Connection refused [03:13:34] PROBLEM - farthestfrontier.wiki - LetsEncrypt on sslhost is CRITICAL: connect to address farthestfrontier.wiki and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [03:13:42] PROBLEM - cp36 Nginx Backend for mwtask171 on cp36 is CRITICAL: connect to address localhost and port 8161: Connection refused [03:13:42] PROBLEM - cp36 Varnish Backends on cp36 is CRITICAL: 17 backends are down. mw151 mw152 mw161 mw162 mw171 mw172 mw181 mw182 mw153 mw154 mw163 mw164 mw173 mw174 mw183 mw184 mediawiki [03:13:46] PROBLEM - cp36 Nginx Backend for mwtask151 on cp36 is CRITICAL: connect to address localhost and port 8162: Connection refused [03:13:46] PROBLEM - cp36 Nginx Backend for mwtask181 on cp36 is CRITICAL: connect to address localhost and port 8160: Connection refused [03:13:47] PROBLEM - cp36 Nginx Backend for mw153 on cp36 is CRITICAL: connect to address localhost and port 8121: Connection refused [03:13:57] PROBLEM - cp36 Nginx Backend for mw164 on cp36 is CRITICAL: connect to address localhost and port 8124: Connection refused [03:13:57] PROBLEM - mh142.com - LetsEncrypt on sslhost is CRITICAL: connect to address mh142.com and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [03:13:59] PROBLEM - cp36 Nginx Backend for mw174 on cp36 is CRITICAL: connect to address localhost and port 8126: Connection refused [03:14:00] PROBLEM - cp36 Nginx Backend for swiftproxy171 on cp36 is CRITICAL: connect to address localhost and port 8207: Connection refused [03:14:02] PROBLEM - cp36 Nginx Backend for mwtask161 on cp36 is CRITICAL: connect to address localhost and port 8163: Connection refused [03:14:03] PROBLEM - cp36 Nginx Backend for mw152 on cp36 is CRITICAL: connect to address localhost and port 8114: Connection refused [03:14:10] PROBLEM - cp36 Nginx Backend for mw162 on cp36 is CRITICAL: connect to address localhost and port 8116: Connection refused [03:14:22] PROBLEM - worldtriggerwiki.com - LetsEncrypt on sslhost is CRITICAL: connect to address worldtriggerwiki.com and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [03:14:30] PROBLEM - rippaverse.wikitide.org - LetsEncrypt on sslhost is CRITICAL: connect to address rippaverse.wikitide.org and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [03:14:31] PROBLEM - kunwok.org - LetsEncrypt on sslhost is CRITICAL: connect to address kunwok.org and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [03:14:36] PROBLEM - androidwiki.info - LetsEncrypt on sslhost is CRITICAL: connect to address androidwiki.info and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [03:14:42] PROBLEM - vesc.wiki - LetsEncrypt on sslhost is CRITICAL: connect to address vesc.wiki and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [03:14:47] PROBLEM - dragonquestwiki.com - LetsEncrypt on sslhost is CRITICAL: connect to address dragonquestwiki.com and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [03:14:47] PROBLEM - terraforming.wiki - LetsEncrypt on sslhost is CRITICAL: connect to address terraforming.wiki and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [03:14:48] PROBLEM - darkwaterswiki.com - LetsEncrypt on sslhost is CRITICAL: connect to address darkwaterswiki.com and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [03:14:51] PROBLEM - dkwiki.org - LetsEncrypt on sslhost is CRITICAL: connect to address dkwiki.org and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [03:15:17] PROBLEM - familiacorsi.com - LetsEncrypt on sslhost is CRITICAL: connect to address familiacorsi.com and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [03:15:20] PROBLEM - webkinzguide.com - LetsEncrypt on sslhost is CRITICAL: connect to address webkinzguide.com and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [03:15:35] PROBLEM - ncuwiki.com - LetsEncrypt on sslhost is CRITICAL: connect to address ncuwiki.com and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [03:15:45] PROBLEM - grayravens.com - LetsEncrypt on sslhost is CRITICAL: connect to address grayravens.com and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [03:15:53] PROBLEM - runzeppelin.ru - LetsEncrypt on sslhost is CRITICAL: connect to address runzeppelin.ru and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [03:16:06] PROBLEM - mockgovernments.com - LetsEncrypt on sslhost is CRITICAL: connect to address mockgovernments.com and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [03:16:12] PROBLEM - comprehensibleinputwiki.org - LetsEncrypt on sslhost is CRITICAL: connect to address comprehensibleinputwiki.org and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [03:16:27] PROBLEM - ourlifewiki.org - LetsEncrypt on sslhost is CRITICAL: connect to address ourlifewiki.org and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [03:16:28] PROBLEM - oxboxtra.wiki - LetsEncrypt on sslhost is CRITICAL: connect to address oxboxtra.wiki and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [03:16:30] PROBLEM - clubpenguinfanon.wiki - LetsEncrypt on sslhost is CRITICAL: connect to address clubpenguinfanon.wiki and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [03:17:07] PROBLEM - baligawiki.org - LetsEncrypt on sslhost is CRITICAL: connect to address baligawiki.org and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [03:17:33] PROBLEM - monarchists.wiki - LetsEncrypt on sslhost is CRITICAL: connect to address monarchists.wiki and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [03:17:57] PROBLEM - bobobay.wiki - LetsEncrypt on sslhost is CRITICAL: connect to address bobobay.wiki and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [03:18:00] PROBLEM - worldsanskrit.net - LetsEncrypt on sslhost is CRITICAL: connect to address worldsanskrit.net and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [03:18:02] PROBLEM - edapedia.net - LetsEncrypt on sslhost is CRITICAL: connect to address edapedia.net and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [03:18:31] PROBLEM - encyclopediaofastrobiology.org - LetsEncrypt on sslhost is CRITICAL: connect to address encyclopediaofastrobiology.org and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [03:18:34] PROBLEM - poupedia.com - LetsEncrypt on sslhost is CRITICAL: connect to address poupedia.com and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [03:18:49] RECOVERY - cp36 Nginx Backend for puppet181 on cp36 is OK: TCP OK - 0.000 second response time on localhost port 8204 [03:18:50] RECOVERY - cp36 Nginx Backend for mw182 on cp36 is OK: TCP OK - 0.000 second response time on localhost port 8120 [03:18:57] RECOVERY - cp36 Nginx Backend for mw163 on cp36 is OK: TCP OK - 0.000 second response time on localhost port 8123 [03:18:58] RECOVERY - cp36 Nginx Backend for phorge171 on cp36 is OK: TCP OK - 0.000 second response time on localhost port 8202 [03:19:03] RECOVERY - cp36 Nginx Backend for swiftproxy161 on cp36 is OK: TCP OK - 0.000 second response time on localhost port 8206 [03:19:04] RECOVERY - cp36 Nginx Backend for mw161 on cp36 is OK: TCP OK - 0.000 second response time on localhost port 8115 [03:19:06] RECOVERY - cp36 Nginx Backend for mw173 on cp36 is OK: TCP OK - 0.000 second response time on localhost port 8125 [03:19:10] RECOVERY - cp36 Nginx Backend for mw151 on cp36 is OK: TCP OK - 0.001 second response time on localhost port 8113 [03:19:20] RECOVERY - cp36 Nginx Backend for reports171 on cp36 is OK: TCP OK - 0.000 second response time on localhost port 8205 [03:19:29] RECOVERY - cp36 Nginx Backend for mw183 on cp36 is OK: TCP OK - 0.000 second response time on localhost port 8127 [03:19:33] RECOVERY - cp36 Nginx Backend for mw184 on cp36 is OK: TCP OK - 0.000 second response time on localhost port 8128 [03:19:42] RECOVERY - cp36 Nginx Backend for mwtask171 on cp36 is OK: TCP OK - 0.000 second response time on localhost port 8161 [03:19:42] RECOVERY - cp36 Varnish Backends on cp36 is OK: All 29 backends are healthy [03:19:46] RECOVERY - cp36 Nginx Backend for mwtask151 on cp36 is OK: TCP OK - 0.000 second response time on localhost port 8162 [03:19:46] RECOVERY - cp36 Nginx Backend for mwtask181 on cp36 is OK: TCP OK - 0.000 second response time on localhost port 8160 [03:19:47] RECOVERY - cp36 Nginx Backend for mw153 on cp36 is OK: TCP OK - 0.000 second response time on localhost port 8121 [03:19:56] RECOVERY - cp36 HTTPS on cp36 is OK: HTTP OK: HTTP/2 404 - Status line output matched "HTTP/2 404" - 4114 bytes in 0.065 second response time [03:19:57] RECOVERY - cp36 Nginx Backend for mw164 on cp36 is OK: TCP OK - 0.000 second response time on localhost port 8124 [03:19:59] RECOVERY - cp36 Nginx Backend for mw174 on cp36 is OK: TCP OK - 0.000 second response time on localhost port 8126 [03:20:00] RECOVERY - cp36 Nginx Backend for swiftproxy171 on cp36 is OK: TCP OK - 0.000 second response time on localhost port 8207 [03:20:01] RECOVERY - cp36 HTTP 4xx/5xx ERROR Rate on cp36 is OK: OK - NGINX Error Rate is 6% [03:20:02] RECOVERY - cp36 Nginx Backend for mwtask161 on cp36 is OK: TCP OK - 0.000 second response time on localhost port 8163 [03:20:03] RECOVERY - cp36 Nginx Backend for mw152 on cp36 is OK: TCP OK - 0.000 second response time on localhost port 8114 [03:20:10] RECOVERY - cp36 Nginx Backend for mw162 on cp36 is OK: TCP OK - 0.000 second response time on localhost port 8116 [03:20:15] RECOVERY - cp36 Nginx Backend for mw171 on cp36 is OK: TCP OK - 0.000 second response time on localhost port 8117 [03:20:18] RECOVERY - cp36 Nginx Backend for matomo151 on cp36 is OK: TCP OK - 0.000 second response time on localhost port 8203 [03:20:18] RECOVERY - cp36 Nginx Backend for test151 on cp36 is OK: TCP OK - 0.000 second response time on localhost port 8181 [03:20:21] RECOVERY - cp36 Nginx Backend for mw154 on cp36 is OK: TCP OK - 0.000 second response time on localhost port 8122 [03:20:22] RECOVERY - cp36 Nginx Backend for mw172 on cp36 is OK: TCP OK - 0.000 second response time on localhost port 8118 [03:20:23] RECOVERY - ns1 GDNSD Datacenters on ns1 is OK: OK - all datacenters are online [03:20:25] RECOVERY - cp36 Nginx Backend for mw181 on cp36 is OK: TCP OK - 0.000 second response time on localhost port 8119 [03:20:33] RECOVERY - cp36 Nginx Backend for mon181 on cp36 is OK: TCP OK - 0.000 second response time on localhost port 8201 [03:20:44] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [03:22:15] PROBLEM - mwtask151 Current Load on mwtask151 is CRITICAL: LOAD CRITICAL - total load average: 24.18, 22.12, 14.99 [03:26:15] PROBLEM - mwtask151 Current Load on mwtask151 is WARNING: LOAD WARNING - total load average: 23.46, 23.37, 17.18 [03:28:15] RECOVERY - mwtask151 Current Load on mwtask151 is OK: LOAD OK - total load average: 4.91, 16.89, 15.61 [03:40:49] RECOVERY - wikimoma.art - LetsEncrypt on sslhost is OK: OK - Certificate 'wikimoma.art' will expire on Fri 14 Mar 2025 02:42:04 PM GMT +0000. [03:41:04] RECOVERY - metroidpedia.com - LetsEncrypt on sslhost is OK: OK - Certificate 'metroidpedia.com' will expire on Sun 09 Mar 2025 03:37:37 PM GMT +0000. [03:41:34] RECOVERY - baharna.org - LetsEncrypt on sslhost is OK: OK - Certificate 'baharna.org' will expire on Tue 08 Apr 2025 10:22:34 PM GMT +0000. [03:41:39] RECOVERY - vilexia.com - LetsEncrypt on sslhost is OK: OK - Certificate 'vilexia.com' will expire on Thu 01 May 2025 05:08:25 PM GMT +0000. [03:41:50] RECOVERY - iceria.org - LetsEncrypt on sslhost is OK: OK - Certificate 'iceria.org' will expire on Tue 08 Apr 2025 10:22:50 PM GMT +0000. [03:41:50] RECOVERY - buildabearwiki.info - LetsEncrypt on sslhost is OK: OK - Certificate 'buildabearwiki.info' will expire on Sat 08 Mar 2025 11:49:05 PM GMT +0000. [03:41:58] RECOVERY - burnout.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'burnout.wiki' will expire on Tue 18 Mar 2025 03:16:41 PM GMT +0000. [03:42:09] RECOVERY - hardcore.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'hardcore.wiki' will expire on Fri 09 May 2025 07:38:37 PM GMT +0000. [03:42:10] RECOVERY - fashiondreamer.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'fashiondreamer.wiki' will expire on Fri 14 Mar 2025 01:50:18 PM GMT +0000. [03:42:57] RECOVERY - osdev.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'osdev.wiki' will expire on Wed 23 Apr 2025 09:23:35 PM GMT +0000. [03:43:05] RECOVERY - podpedia.org - LetsEncrypt on sslhost is OK: OK - Certificate 'podpedia.org' will expire on Wed 21 May 2025 06:59:07 PM GMT +0000. [03:43:05] RECOVERY - cpmusicwiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'cpmusicwiki.com' will expire on Tue 15 Apr 2025 11:09:46 AM GMT +0000. [03:43:13] RECOVERY - worldtriggerwiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'worldtriggerwiki.com' will expire on Sun 16 Mar 2025 12:03:12 AM GMT +0000. [03:43:22] RECOVERY - rippaverse.wikitide.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wikitide.org' will expire on Sat 12 Apr 2025 07:36:30 PM GMT +0000. [03:43:23] RECOVERY - farthestfrontier.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'farthestfrontier.wiki' will expire on Mon 28 Apr 2025 07:20:21 PM GMT +0000. [03:43:33] RECOVERY - kunwok.org - LetsEncrypt on sslhost is OK: OK - Certificate 'kunwok.org' will expire on Wed 21 May 2025 07:22:29 AM GMT +0000. [03:43:39] RECOVERY - vesc.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'vesc.wiki' will expire on Tue 11 Mar 2025 01:54:22 PM GMT +0000. [03:43:41] RECOVERY - androidwiki.info - LetsEncrypt on sslhost is OK: OK - Certificate 'androidwiki.info' will expire on Sat 12 Apr 2025 03:18:53 PM GMT +0000. [03:43:51] RECOVERY - mh142.com - LetsEncrypt on sslhost is OK: OK - Certificate 'mh142.com' will expire on Wed 21 May 2025 06:53:08 AM GMT +0000. [03:43:57] RECOVERY - dragonquestwiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'dragonquestwiki.com' will expire on Fri 14 Mar 2025 02:26:07 PM GMT +0000. [03:44:04] RECOVERY - terraforming.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'terraforming.wiki' will expire on Wed 07 May 2025 06:27:23 PM GMT +0000. [03:44:07] RECOVERY - darkwaterswiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'darkwaterswiki.com' will expire on Mon 24 Mar 2025 03:09:45 PM GMT +0000. [03:44:12] RECOVERY - dkwiki.org - LetsEncrypt on sslhost is OK: OK - Certificate 'dkwiki.org' will expire on Sat 08 Mar 2025 03:26:18 PM GMT +0000. [03:44:31] RECOVERY - grayravens.com - LetsEncrypt on sslhost is OK: OK - Certificate 'grayravens.com' will expire on Sat 08 Mar 2025 03:35:29 PM GMT +0000. [03:44:47] RECOVERY - runzeppelin.ru - LetsEncrypt on sslhost is OK: OK - Certificate 'runzeppelin.ru' will expire on Wed 21 May 2025 06:04:35 AM GMT +0000. [03:45:05] RECOVERY - familiacorsi.com - LetsEncrypt on sslhost is OK: OK - Certificate 'familiacorsi.com' will expire on Thu 20 Mar 2025 03:46:41 PM GMT +0000. [03:45:12] RECOVERY - mockgovernments.com - LetsEncrypt on sslhost is OK: OK - Certificate 'mockgovernments.com' will expire on Tue 01 Apr 2025 05:55:36 PM GMT +0000. [03:45:15] RECOVERY - webkinzguide.com - LetsEncrypt on sslhost is OK: OK - Certificate 'webkinzguide.com' will expire on Sun 09 Mar 2025 11:01:02 AM GMT +0000. [03:45:25] RECOVERY - comprehensibleinputwiki.org - LetsEncrypt on sslhost is OK: OK - Certificate 'comprehensibleinputwiki.org' will expire on Sun 27 Apr 2025 01:44:26 PM GMT +0000. [03:45:29] RECOVERY - ncuwiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'ncuwiki.com' will expire on Sun 09 Mar 2025 05:24:06 PM GMT +0000. [03:46:12] RECOVERY - ourlifewiki.org - LetsEncrypt on sslhost is OK: OK - Certificate 'ourlifewiki.org' will expire on Fri 11 Apr 2025 05:41:16 PM GMT +0000. [03:46:13] RECOVERY - oxboxtra.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'oxboxtra.wiki' will expire on Mon 14 Apr 2025 06:14:39 AM GMT +0000. [03:46:29] RECOVERY - clubpenguinfanon.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'clubpenguinfanon.wiki' will expire on Tue 25 Mar 2025 11:01:22 PM GMT +0000. [03:46:32] RECOVERY - bobobay.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'bobobay.wiki' will expire on Mon 28 Apr 2025 01:38:22 PM GMT +0000. [03:46:52] RECOVERY - baligawiki.org - LetsEncrypt on sslhost is OK: OK - Certificate 'baligawiki.org' will expire on Fri 04 Apr 2025 06:57:58 PM GMT +0000. [03:46:54] RECOVERY - edapedia.net - LetsEncrypt on sslhost is OK: OK - Certificate 'edapedia.net' will expire on Mon 07 Apr 2025 01:52:00 AM GMT +0000. [03:46:58] RECOVERY - worldsanskrit.net - LetsEncrypt on sslhost is OK: OK - Certificate 'worldsanskrit.net' will expire on Fri 14 Mar 2025 02:35:17 PM GMT +0000. [03:47:01] RECOVERY - monarchists.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'monarchists.wiki' will expire on Wed 21 May 2025 08:10:32 AM GMT +0000. [03:47:07] RECOVERY - poupedia.com - LetsEncrypt on sslhost is OK: OK - Certificate 'poupedia.com' will expire on Mon 28 Apr 2025 01:12:42 PM GMT +0000. [03:48:21] RECOVERY - encyclopediaofastrobiology.org - LetsEncrypt on sslhost is OK: OK - Certificate 'encyclopediaofastrobiology.org' will expire on Wed 21 May 2025 07:52:29 AM GMT +0000. [04:03:29] PROBLEM - mwtask181 Current Load on mwtask181 is CRITICAL: LOAD CRITICAL - total load average: 25.14, 17.25, 9.29 [04:05:29] PROBLEM - mwtask181 Current Load on mwtask181 is WARNING: LOAD WARNING - total load average: 21.69, 18.45, 10.69 [04:39:29] RECOVERY - mwtask181 Current Load on mwtask181 is OK: LOAD OK - total load average: 4.44, 14.58, 17.81 [08:19:29] PROBLEM - mwtask181 Current Load on mwtask181 is CRITICAL: LOAD CRITICAL - total load average: 32.87, 19.86, 10.45 [08:21:29] RECOVERY - mwtask181 Current Load on mwtask181 is OK: LOAD OK - total load average: 8.24, 15.01, 9.83 [09:34:13] PROBLEM - inourownwords.online - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'inourownwords.online' expires in 14 day(s) (Sat 08 Mar 2025 09:05:57 AM GMT +0000). [09:36:24] PROBLEM - mwtask171 Current Load on mwtask171 is WARNING: LOAD WARNING - total load average: 20.94, 17.35, 14.02 [09:42:24] RECOVERY - mwtask171 Current Load on mwtask171 is OK: LOAD OK - total load average: 18.64, 18.83, 15.96 [09:59:35] PROBLEM - wikimas.kr - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wikimas.kr' expires in 14 day(s) (Sat 08 Mar 2025 09:56:22 AM GMT +0000). [09:59:47] PROBLEM - rct.wiki - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'rct.wiki' expires in 14 day(s) (Sat 08 Mar 2025 09:57:02 AM GMT +0000). [10:03:26] RECOVERY - inourownwords.online - LetsEncrypt on sslhost is OK: OK - Certificate 'inourownwords.online' will expire on Thu 22 May 2025 08:35:49 AM GMT +0000. [10:08:24] PROBLEM - mwtask171 Current Load on mwtask171 is CRITICAL: LOAD CRITICAL - total load average: 28.02, 18.76, 11.86 [10:12:24] RECOVERY - mwtask171 Current Load on mwtask171 is OK: LOAD OK - total load average: 5.90, 16.42, 12.90 [10:29:03] RECOVERY - rct.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'rct.wiki' will expire on Thu 22 May 2025 09:01:22 AM GMT +0000. [10:29:26] RECOVERY - wikimas.kr - LetsEncrypt on sslhost is OK: OK - Certificate 'wikimas.kr' will expire on Thu 22 May 2025 09:01:10 AM GMT +0000. [11:37:10] PROBLEM - thestarsareright.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'thestarsareright.org' expires in 14 day(s) (Sat 08 Mar 2025 11:10:21 AM GMT +0000). [12:06:20] RECOVERY - thestarsareright.org - LetsEncrypt on sslhost is OK: OK - Certificate 'thestarsareright.org' will expire on Thu 22 May 2025 10:38:46 AM GMT +0000. [12:10:06] PROBLEM - mw184 Current Load on mw184 is WARNING: LOAD WARNING - total load average: 22.48, 15.39, 8.42 [12:12:06] RECOVERY - mw184 Current Load on mw184 is OK: LOAD OK - total load average: 15.14, 15.15, 9.19 [12:14:11] PROBLEM - db171 Current Load on db171 is CRITICAL: LOAD CRITICAL - total load average: 15.72, 10.47, 5.31 [12:22:04] PROBLEM - db171 Current Load on db171 is WARNING: LOAD WARNING - total load average: 9.57, 11.59, 8.22 [12:24:02] PROBLEM - db171 Current Load on db171 is CRITICAL: LOAD CRITICAL - total load average: 14.11, 11.59, 8.56 [12:26:00] PROBLEM - db171 Current Load on db171 is WARNING: LOAD WARNING - total load average: 9.19, 11.34, 8.88 [12:26:06] PROBLEM - mw184 Current Load on mw184 is WARNING: LOAD WARNING - total load average: 23.05, 20.84, 16.06 [12:27:08] PROBLEM - mw174 Current Load on mw174 is WARNING: LOAD WARNING - total load average: 21.56, 20.55, 15.89 [12:27:45] PROBLEM - mw182 Current Load on mw182 is WARNING: LOAD WARNING - total load average: 22.86, 20.00, 14.74 [12:29:57] RECOVERY - db171 Current Load on db171 is OK: LOAD OK - total load average: 7.59, 9.01, 8.53 [12:31:45] RECOVERY - mw182 Current Load on mw182 is OK: LOAD OK - total load average: 17.17, 20.05, 16.08 [12:32:06] RECOVERY - mw184 Current Load on mw184 is OK: LOAD OK - total load average: 19.10, 20.25, 17.45 [12:35:50] PROBLEM - db171 Current Load on db171 is CRITICAL: LOAD CRITICAL - total load average: 14.14, 11.92, 9.88 [12:36:06] PROBLEM - mw184 Current Load on mw184 is WARNING: LOAD WARNING - total load average: 18.63, 20.57, 18.30 [12:37:00] [Grafana] FIRING: Some MediaWiki Appservers are running out of PHP-FPM workers. https://grafana.wikitide.net/d/GtxbP1Xnk?orgId=1 [12:37:08] RECOVERY - mw174 Current Load on mw174 is OK: LOAD OK - total load average: 16.09, 19.31, 17.89 [12:38:06] RECOVERY - mw184 Current Load on mw184 is OK: LOAD OK - total load average: 18.72, 19.82, 18.29 [12:42:29] PROBLEM - mw151 Current Load on mw151 is WARNING: LOAD WARNING - total load average: 22.22, 19.26, 16.11 [12:43:08] PROBLEM - mw174 Current Load on mw174 is WARNING: LOAD WARNING - total load average: 22.87, 20.53, 18.64 [12:43:37] PROBLEM - mw172 Current Load on mw172 is WARNING: LOAD WARNING - total load average: 23.03, 20.83, 17.88 [12:44:29] RECOVERY - mw151 Current Load on mw151 is OK: LOAD OK - total load average: 15.23, 17.88, 16.01 [12:45:08] RECOVERY - mw174 Current Load on mw174 is OK: LOAD OK - total load average: 15.31, 18.44, 18.11 [12:46:06] PROBLEM - mw184 Current Load on mw184 is WARNING: LOAD WARNING - total load average: 21.00, 20.45, 19.06 [12:47:31] RECOVERY - mw172 Current Load on mw172 is OK: LOAD OK - total load average: 15.25, 19.56, 18.17 [12:48:06] RECOVERY - mw184 Current Load on mw184 is OK: LOAD OK - total load average: 16.39, 18.86, 18.64 [12:49:37] PROBLEM - db171 Current Load on db171 is WARNING: LOAD WARNING - total load average: 2.57, 9.44, 11.18 [12:51:35] RECOVERY - db171 Current Load on db171 is OK: LOAD OK - total load average: 1.05, 6.60, 9.93 [12:52:00] [Grafana] RESOLVED: PHP-FPM Worker Usage High https://grafana.wikitide.net/d/GtxbP1Xnk?orgId=1 [13:24:05] PROBLEM - hoseki.wiki - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'hoseki.wiki' expires in 14 day(s) (Sat 08 Mar 2025 01:09:01 PM GMT +0000). [13:49:46] PROBLEM - smashbroswiki.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'smashbroswiki.com' expires in 14 day(s) (Sat 08 Mar 2025 01:33:58 PM GMT +0000). [13:53:41] RECOVERY - hoseki.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'hoseki.wiki' will expire on Thu 22 May 2025 12:25:41 PM GMT +0000. [14:02:24] PROBLEM - mwtask171 Current Load on mwtask171 is CRITICAL: LOAD CRITICAL - total load average: 26.85, 14.60, 6.26 [14:06:24] RECOVERY - mwtask171 Current Load on mwtask171 is OK: LOAD OK - total load average: 11.88, 17.30, 9.58 [14:19:32] RECOVERY - smashbroswiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'smashbroswiki.com' will expire on Thu 22 May 2025 12:51:22 PM GMT +0000. [14:41:13] PROBLEM - cp37 Disk Space on cp37 is CRITICAL: DISK CRITICAL - free space: / 27154MiB (5% inode=99%); [14:43:29] PROBLEM - mwtask181 Current Load on mwtask181 is CRITICAL: LOAD CRITICAL - total load average: 27.95, 16.57, 8.18 [14:47:29] RECOVERY - mwtask181 Current Load on mwtask181 is OK: LOAD OK - total load average: 16.54, 20.12, 11.80 [15:20:29] PROBLEM - crocwiki.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'crocwiki.com' expires in 14 day(s) (Sat 08 Mar 2025 03:13:41 PM GMT +0000). [15:44:51] PROBLEM - dkwiki.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'dkwiki.org' expires in 14 day(s) (Sat 08 Mar 2025 03:26:18 PM GMT +0000). [15:45:46] PROBLEM - grayravens.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'grayravens.com' expires in 14 day(s) (Sat 08 Mar 2025 03:35:29 PM GMT +0000). [15:50:29] RECOVERY - crocwiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'crocwiki.com' will expire on Thu 22 May 2025 02:22:05 PM GMT +0000. [16:14:12] RECOVERY - dkwiki.org - LetsEncrypt on sslhost is OK: OK - Certificate 'dkwiki.org' will expire on Thu 22 May 2025 02:46:27 PM GMT +0000. [16:14:31] RECOVERY - grayravens.com - LetsEncrypt on sslhost is OK: OK - Certificate 'grayravens.com' will expire on Thu 22 May 2025 02:47:21 PM GMT +0000. [16:16:34] PROBLEM - matomo151 HTTPS on matomo151 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 7 - Failed to connect to matomo151.wikitide.net port 443 after 0 ms: Couldn't connect to server [16:26:29] RECOVERY - matomo151 HTTPS on matomo151 is OK: HTTP OK: HTTP/2 200 - 553 bytes in 0.216 second response time [16:28:24] PROBLEM - mwtask171 Current Load on mwtask171 is WARNING: LOAD WARNING - total load average: 20.48, 16.71, 8.01 [16:30:24] RECOVERY - mwtask171 Current Load on mwtask171 is OK: LOAD OK - total load average: 3.21, 11.35, 7.10 [16:39:39] PROBLEM - mwtask181 Current Load on mwtask181 is CRITICAL: LOAD CRITICAL - total load average: 31.87, 22.26, 10.91 [16:41:38] RECOVERY - mwtask181 Current Load on mwtask181 is OK: LOAD OK - total load average: 5.53, 15.37, 9.76 [17:47:29] PROBLEM - mwtask181 Current Load on mwtask181 is WARNING: LOAD WARNING - total load average: 21.12, 13.90, 7.21 [17:49:29] RECOVERY - mwtask181 Current Load on mwtask181 is OK: LOAD OK - total load average: 12.54, 13.30, 7.83 [18:04:23] PROBLEM - mwtask181 Current Load on mwtask181 is CRITICAL: LOAD CRITICAL - total load average: 29.81, 22.45, 15.18 [18:08:21] RECOVERY - mwtask181 Current Load on mwtask181 is OK: LOAD OK - total load average: 8.06, 18.57, 15.64 [18:22:26] PROBLEM - antiguabarbudacalypso.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'antiguabarbudacalypso.com' expires in 14 day(s) (Sat 08 Mar 2025 06:18:35 PM GMT +0000). [18:52:01] PROBLEM - mwtask181 Current Load on mwtask181 is CRITICAL: LOAD CRITICAL - total load average: 34.04, 18.86, 9.97 [18:52:23] RECOVERY - antiguabarbudacalypso.com - LetsEncrypt on sslhost is OK: OK - Certificate 'antiguabarbudacalypso.com' will expire on Thu 22 May 2025 05:24:05 PM GMT +0000. [18:55:59] RECOVERY - mwtask181 Current Load on mwtask181 is OK: LOAD OK - total load average: 6.87, 16.84, 11.65 [20:39:11] miraheze/mw-config - MacFan4000 the build passed. [20:43:25] !log [macfan@mwtask181] starting deploy of {'pull': 'config', 'config': True} to all [20:43:27] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:43:46] !log [macfan@mwtask181] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 20s [20:43:47] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:21:04] RECOVERY - anawawiki.com - Cloudflare on sslhost is OK: OK - Certificate 'anawawiki.com' will expire on Mon 19 May 2025 04:19:50 PM GMT +0000. [22:47:27] PROBLEM - mariopedia.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'mariopedia.org' expires in 14 day(s) (Sat 08 Mar 2025 10:39:11 PM GMT +0000). [23:30:04] PROBLEM - persist.wiki - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'persist.wiki' expires in 14 day(s) (Sat 08 Mar 2025 10:58:16 PM GMT +0000). [23:30:15] [02ssl] 07WikiTideSSLBot pushed 1 new commit to 03master 13https://github.com/miraheze/ssl/commit/4b218153cb9b16d4270c0f681efb805b00a60bb9 [23:30:16] 02ssl/03master 07WikiTideSSLBot 034b21815 Bot: Update SSL cert for persist.wiki [23:46:49] RECOVERY - mariopedia.org - LetsEncrypt on sslhost is OK: OK - Certificate 'mariopedia.org' will expire on Thu 22 May 2025 09:56:46 PM GMT +0000. [23:52:50] PROBLEM - knifepointhorror.wiki - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'knifepointhorror.wiki' expires in 14 day(s) (Sat 08 Mar 2025 11:30:15 PM GMT +0000). [23:53:01] [02ssl] 07WikiTideSSLBot pushed 1 new commit to 03master 13https://github.com/miraheze/ssl/commit/6d029c1d268974536c3eb15dc2fe4da5c472fc7b [23:53:01] 02ssl/03master 07WikiTideSSLBot 036d029c1 Bot: Update SSL cert for knifepointhorror.wiki [23:59:33] RECOVERY - persist.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'persist.wiki' will expire on Thu 22 May 2025 10:31:40 PM GMT +0000.