[00:02:02] [02puppet] 07Universal-Omega synchronize pull request 03#39: Add raid status checks - 13https://github.com/WikiTideOrg/puppet/pull/39 [00:02:03] [02WikiTideOrg/puppet] 07Universal-Omega pushed 031 commit to 03raid [+0/-0/±1] 13https://github.com/WikiTideOrg/puppet/compare/7d78238d868f...5cd25d44fb83 [00:02:06] [02WikiTideOrg/puppet] 07Universal-Omega 035cd25d4 - Fix [00:03:18] WikiTideOrg/puppet - Universal-Omega the build has errored. [00:05:19] [02puppet] 07Universal-Omega synchronize pull request 03#39: Add raid status checks - 13https://github.com/WikiTideOrg/puppet/pull/39 [00:05:21] [02WikiTideOrg/puppet] 07Universal-Omega pushed 031 commit to 03raid [+0/-0/±1] 13https://github.com/WikiTideOrg/puppet/compare/5cd25d44fb83...06a0a0d665b6 [00:05:23] [02WikiTideOrg/puppet] 07Universal-Omega 0306a0a0d - Fix [00:05:53] [02WikiTideOrg/puppet] 07github-actions[bot] pushed 031 commit to 03raid [+0/-0/±1] 13https://github.com/WikiTideOrg/puppet/compare/06a0a0d665b6...7c2166dcffa1 [00:05:56] [02WikiTideOrg/puppet] 07github-actions 037c2166d - CI: lint puppet code to standards Check commit and GitHub actions for more details [00:05:57] [02puppet] 07github-actions[bot] synchronize pull request 03#39: Add raid status checks - 13https://github.com/WikiTideOrg/puppet/pull/39 [00:06:30] WikiTideOrg/puppet - Universal-Omega the build has errored. [00:09:12] PROBLEM - cloud3 MegaRAID on cloud3 is UNKNOWN: NRPE: Unable to read output [00:09:43] PROBLEM - rosettacode.org - reverse DNS on sslhost is WARNING: LifetimeTimeout: The resolution lifetime expired after 5.401 seconds: Server 1.1.1.1 UDP port 53 answered The DNS operation timed out.; Server 1.1.1.1 UDP port 53 answered The DNS operation timed out.; Server 1.1.1.1 UDP port 53 answered The DNS operation timed out. [00:10:24] RECOVERY - mon21 Check correctness of the icinga configuration on mon21 is OK: Icinga configuration is correct [00:13:53] PROBLEM - cloud3 Puppet on cloud3 is WARNING: WARNING: Puppet is currently disabled, message: Networking issues, last run 8 minutes ago with 0 failures [00:38:10] PROBLEM - valorantjp.wiki - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - valorantjp.wiki reverse DNS resolves to vps-6006c2ae.vps.ovh.ca [00:38:12] PROBLEM - newcascadia.net - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - newcascadia.net reverse DNS resolves to vps-6006c2ae.vps.ovh.ca [00:39:00] PROBLEM - rosettacode.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - rosettacode.org reverse DNS resolves to vps-6006c2ae.vps.ovh.ca [01:07:07] PROBLEM - newcascadia.net - reverse DNS on sslhost is WARNING: LifetimeTimeout: The resolution lifetime expired after 5.405 seconds: Server 1.1.1.1 UDP port 53 answered The DNS operation timed out.; Server 1.1.1.1 UDP port 53 answered The DNS operation timed out.; Server 1.1.1.1 UDP port 53 answered The DNS operation timed out. [01:08:18] PROBLEM - rosettacode.org - reverse DNS on sslhost is WARNING: LifetimeTimeout: The resolution lifetime expired after 5.404 seconds: Server 1.1.1.1 UDP port 53 answered The DNS operation timed out.; Server 1.1.1.1 UDP port 53 answered The DNS operation timed out.; Server 1.1.1.1 UDP port 53 answered The DNS operation timed out. [01:27:05] [02puppet] 07Universal-Omega synchronize pull request 03#32: mediawiki: use mcrouter instead of nutcracker - 13https://github.com/WikiTideOrg/puppet/pull/32 [01:27:07] [02WikiTideOrg/puppet] 07Universal-Omega pushed 031 commit to 03mcrouter [+1/-1/±0] 13https://github.com/WikiTideOrg/puppet/compare/ed8b463c8b44...bb0419015f53 [01:27:10] [02WikiTideOrg/puppet] 07Universal-Omega 03bb04190 - Fix [01:27:57] [02WikiTideOrg/puppet] 07Universal-Omega pushed 0329 commits to 03mcrouter [+46/-42/±129] 13https://github.com/WikiTideOrg/puppet/compare/bb0419015f53...3b8a692d2019 [01:28:00] [02WikiTideOrg/puppet] 07Universal-Omega 033b8a692 - Merge branch 'master' into mcrouter [01:28:01] [02puppet] 07Universal-Omega synchronize pull request 03#32: mediawiki: use mcrouter instead of nutcracker - 13https://github.com/WikiTideOrg/puppet/pull/32 [01:31:47] [02puppet] 07Universal-Omega synchronize pull request 03#32: mediawiki: use mcrouter instead of nutcracker - 13https://github.com/WikiTideOrg/puppet/pull/32 [01:31:50] [02WikiTideOrg/puppet] 07Universal-Omega pushed 031 commit to 03mcrouter [+0/-0/±1] 13https://github.com/WikiTideOrg/puppet/compare/3b8a692d2019...04c13f0a3c4e [01:31:53] [02WikiTideOrg/puppet] 07Universal-Omega 0304c13f0 - Update [01:35:03] [02puppet] 07Universal-Omega synchronize pull request 03#32: mediawiki: use mcrouter instead of nutcracker - 13https://github.com/WikiTideOrg/puppet/pull/32 [01:35:05] [02WikiTideOrg/puppet] 07Universal-Omega pushed 031 commit to 03mcrouter [+0/-0/±1] 13https://github.com/WikiTideOrg/puppet/compare/04c13f0a3c4e...c14ab5fd055d [01:35:07] [02WikiTideOrg/puppet] 07Universal-Omega 03c14ab5f - Update [01:37:53] PROBLEM - rosettacode.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - rosettacode.org reverse DNS resolves to vps-d267e842.vps.ovh.ca [01:38:49] PROBLEM - nexttide.org - reverse DNS on sslhost is WARNING: LifetimeTimeout: The resolution lifetime expired after 5.403 seconds: Server 1.1.1.1 UDP port 53 answered The DNS operation timed out.; Server 1.1.1.1 UDP port 53 answered The DNS operation timed out.; Server 1.1.1.1 UDP port 53 answered The DNS operation timed out. [01:39:28] PROBLEM - www.rosettacode.org - reverse DNS on sslhost is WARNING: LifetimeTimeout: The resolution lifetime expired after 5.404 seconds: Server 1.1.1.1 UDP port 53 answered The DNS operation timed out.; Server 1.1.1.1 UDP port 53 answered The DNS operation timed out.; Server 1.1.1.1 UDP port 53 answered The DNS operation timed out. [01:43:50] [02puppet] 07Universal-Omega synchronize pull request 03#32: mediawiki: use mcrouter instead of nutcracker - 13https://github.com/WikiTideOrg/puppet/pull/32 [01:43:53] [02WikiTideOrg/puppet] 07Universal-Omega pushed 031 commit to 03mcrouter [+0/-0/±1] 13https://github.com/WikiTideOrg/puppet/compare/c14ab5fd055d...60b9f984751f [01:43:55] [02WikiTideOrg/puppet] 07Universal-Omega 0360b9f98 - Fix [01:45:50] [02WikiTideOrg/puppet] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/WikiTideOrg/puppet/compare/937ce071fca2...62f951982623 [01:45:51] [02WikiTideOrg/puppet] 07Universal-Omega 0362f9519 - Fix deprecated to_json_pretty [01:48:49] [02WikiTideOrg/puppet] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/WikiTideOrg/puppet/compare/62f951982623...b1ef369051bf [01:48:50] [02WikiTideOrg/puppet] 07Universal-Omega 03b1ef369 - Fix server in tests [01:49:08] [02WikiTideOrg/puppet] 07Universal-Omega pushed 033 commits to 03raid [+0/-0/±4] 13https://github.com/WikiTideOrg/puppet/compare/7c2166dcffa1...f3e65fdae015 [01:49:09] [02WikiTideOrg/puppet] 07Universal-Omega 03f3e65fd - Merge branch 'master' into raid [01:49:11] [02puppet] 07Universal-Omega synchronize pull request 03#39: Add raid status checks - 13https://github.com/WikiTideOrg/puppet/pull/39 [01:49:20] [02WikiTideOrg/puppet] 07Universal-Omega pushed 033 commits to 03mcrouter [+0/-0/±4] 13https://github.com/WikiTideOrg/puppet/compare/60b9f984751f...e8aa45a533ca [01:49:21] [02WikiTideOrg/puppet] 07Universal-Omega 03e8aa45a - Merge branch 'master' into mcrouter [01:49:23] [02puppet] 07Universal-Omega synchronize pull request 03#32: mediawiki: use mcrouter instead of nutcracker - 13https://github.com/WikiTideOrg/puppet/pull/32 [01:50:02] WikiTideOrg/puppet - Universal-Omega the build passed. [01:50:09] [02puppet] 07Universal-Omega synchronize pull request 03#23: Add thumbor and haproxy support - 13https://github.com/WikiTideOrg/puppet/pull/23 [01:50:11] [02WikiTideOrg/puppet] 07Universal-Omega pushed 031 commit to 03thumbor [+1/-1/±0] 13https://github.com/WikiTideOrg/puppet/compare/56c20948d04a...79ee112b9b7a [01:50:12] [02WikiTideOrg/puppet] 07Universal-Omega 0379ee112 - Fix [01:50:32] WikiTideOrg/puppet - Universal-Omega the build passed. [01:51:44] [02WikiTideOrg/puppet] 07Universal-Omega pushed 03108 commits to 03thumbor [+67/-59/±295] 13https://github.com/WikiTideOrg/puppet/compare/79ee112b9b7a...305bac0bbc97 [01:51:47] [02WikiTideOrg/puppet] 07Universal-Omega 03305bac0 - Merge branch 'master' into thumbor [01:51:50] [02puppet] 07Universal-Omega synchronize pull request 03#23: Add thumbor and haproxy support - 13https://github.com/WikiTideOrg/puppet/pull/23 [01:52:15] [02puppet] 07Universal-Omega synchronize pull request 03#23: Add thumbor and haproxy support - 13https://github.com/WikiTideOrg/puppet/pull/23 [01:52:18] [02WikiTideOrg/puppet] 07Universal-Omega pushed 031 commit to 03thumbor [+0/-0/±1] 13https://github.com/WikiTideOrg/puppet/compare/305bac0bbc97...9cdf7ff11203 [01:52:20] [02WikiTideOrg/puppet] 07Universal-Omega 039cdf7ff - Update [01:52:48] [02puppet] 07Universal-Omega synchronize pull request 03#23: Add thumbor and haproxy support - 13https://github.com/WikiTideOrg/puppet/pull/23 [01:52:50] [02WikiTideOrg/puppet] 07Universal-Omega pushed 031 commit to 03thumbor [+0/-0/±1] 13https://github.com/WikiTideOrg/puppet/compare/9cdf7ff11203...78ef31e96f82 [01:52:51] [02WikiTideOrg/puppet] 07Universal-Omega 0378ef31e - Update [01:53:13] WikiTideOrg/puppet - Universal-Omega the build passed. [01:53:34] [02WikiTideOrg/puppet] 07Universal-Omega pushed 032 commits to 03cloud-monitoring [+0/-0/±2] 13https://github.com/WikiTideOrg/puppet/compare/f29c8459b158...ed4e3d67d504 [01:53:36] [02WikiTideOrg/puppet] 07Universal-Omega 0394adcad - cloud: add monitoring [01:53:37] WikiTideOrg/puppet - Universal-Omega the build passed. [01:53:39] [02WikiTideOrg/puppet] 07Universal-Omega 03ed4e3d6 - Use lookup [01:53:42] [02puppet] 07Universal-Omega synchronize pull request 03#21: cloud: add monitoring - 13https://github.com/WikiTideOrg/puppet/pull/21 [01:54:58] [02WikiTideOrg/puppet] 07Universal-Omega pushed 0337 commits to 03reports [+51/-43/±142] 13https://github.com/WikiTideOrg/puppet/compare/b904a34d2a2a...56f317e68fca [01:54:59] [02WikiTideOrg/puppet] 07Universal-Omega 0356f317e - Merge branch 'master' into reports [01:55:02] [02puppet] 07Universal-Omega synchronize pull request 03#18: Add reports module - 13https://github.com/WikiTideOrg/puppet/pull/18 [01:55:21] [02puppet] 07Universal-Omega synchronize pull request 03#18: Add reports module - 13https://github.com/WikiTideOrg/puppet/pull/18 [01:55:24] [02WikiTideOrg/puppet] 07Universal-Omega pushed 031 commit to 03reports [+1/-1/±0] 13https://github.com/WikiTideOrg/puppet/compare/56f317e68fca...b674d2e706a1 [01:55:25] [02WikiTideOrg/puppet] 07Universal-Omega 03b674d2e - Update [01:56:07] [02WikiTideOrg/puppet] 07Universal-Omega pushed 032 commits to 03phpldapadmin [+22/-0/±1] 13https://github.com/WikiTideOrg/puppet/compare/e8754f627cc0...a3480cf632db [01:56:08] [02WikiTideOrg/puppet] 07Universal-Omega 031a40aea - Add phpldapadmin module [01:56:11] [02WikiTideOrg/puppet] 07github-actions 03a3480cf - CI: lint puppet code to standards Check commit and GitHub actions for more details [01:56:14] [02puppet] 07Universal-Omega synchronize pull request 03#15: Add phpldapadmin module - 13https://github.com/WikiTideOrg/puppet/pull/15 [01:59:02] [02puppet] 07Universal-Omega synchronize pull request 03#32: mediawiki: use mcrouter instead of nutcracker - 13https://github.com/WikiTideOrg/puppet/pull/32 [01:59:03] [02WikiTideOrg/puppet] 07Universal-Omega pushed 031 commit to 03mcrouter [+0/-0/±1] 13https://github.com/WikiTideOrg/puppet/compare/e8aa45a533ca...55213bb2eb1a [01:59:04] [02WikiTideOrg/puppet] 07Universal-Omega 0355213bb - Update [02:05:24] PROBLEM - newcascadia.net - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - newcascadia.net reverse DNS resolves to vps-6006c2ae.vps.ovh.ca [02:08:13] PROBLEM - nexttide.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - nexttide.org reverse DNS resolves to vps-d267e842.vps.ovh.ca [02:09:10] PROBLEM - www.rosettacode.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - www.rosettacode.org reverse DNS resolves to vps-6006c2ae.vps.ovh.ca [02:26:32] [02WikiTideOrg/mw-config] 07Universal-Omega pushed 031 commit to 03mcrouter [+0/-0/±1] 13https://github.com/WikiTideOrg/mw-config/commit/f6d6c847e586 [02:26:34] [02WikiTideOrg/mw-config] 07Universal-Omega 03f6d6c84 - Use mcrouter [02:26:36] [02mw-config] 07Universal-Omega created branch 03mcrouter - 13https://github.com/WikiTideOrg/mw-config [02:26:37] [02mw-config] 07Universal-Omega opened pull request 03#26: Use mcrouter - 13https://github.com/WikiTideOrg/mw-config/pull/26 [02:27:29] [02WikiTideOrg/mw-config] 07Universal-Omega pushed 031 commit to 03mcrouter [+0/-0/±1] 13https://github.com/WikiTideOrg/mw-config/compare/f6d6c847e586...440b6d4dcab8 [02:27:31] [02WikiTideOrg/mw-config] 07Universal-Omega 03440b6d4 - Use mcrouter [02:27:32] [02mw-config] 07Universal-Omega synchronize pull request 03#26: Use mcrouter - 13https://github.com/WikiTideOrg/mw-config/pull/26 [02:27:32] WikiTideOrg/mw-config - Universal-Omega the build passed. [02:28:19] WikiTideOrg/mw-config - Universal-Omega the build passed. [02:34:33] PROBLEM - newcascadia.net - reverse DNS on sslhost is WARNING: LifetimeTimeout: The resolution lifetime expired after 5.405 seconds: Server 1.1.1.1 UDP port 53 answered The DNS operation timed out.; Server 1.1.1.1 UDP port 53 answered The DNS operation timed out.; Server 1.1.1.1 UDP port 53 answered The DNS operation timed out. [02:41:50] [02WikiTideOrg/mw-config] 07Universal-Omega pushed 031 commit to 03main [+0/-0/±1] 13https://github.com/WikiTideOrg/mw-config/compare/44e5134d4585...6e80bc7a1cf2 [02:41:53] [02WikiTideOrg/mw-config] 07Universal-Omega 036e80bc7 - Use bots21 for RC feed [02:42:22] !log [universalomega@jobrunner21] starting deploy of {'pull': 'config', 'config': True, 'versions': ['1.40']} to [mw21, mw22, jobrunner21] [02:42:24] !log [universalomega@jobrunner21] DEPLOY ABORTED: Canary check failed for meta.wikitide.org@mw21.wikitide.net [02:42:24] Logged the message at https://meta.wikitide.org/wiki/Tech:Server_admin_log [02:42:26] Logged the message at https://meta.wikitide.org/wiki/Tech:Server_admin_log [02:42:32] !log [universalomega@jobrunner21] starting deploy of {'pull': 'config', 'config': True, 'force': True, 'versions': ['1.40']} to [mw21, mw22, jobrunner21] [02:42:34] Logged the message at https://meta.wikitide.org/wiki/Tech:Server_admin_log [02:42:34] !log [universalomega@jobrunner21] finished deploy of {'pull': 'config', 'config': True, 'force': True, 'versions': ['1.40']} to [mw21, mw22, jobrunner21] - SUCCESS in 2s [02:42:36] Logged the message at https://meta.wikitide.org/wiki/Tech:Server_admin_log [02:42:49] WikiTideOrg/mw-config - Universal-Omega the build passed. [02:50:52] RECOVERY - bots21 Puppet on bots21 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [02:53:11] RECOVERY - bots21 CVT Bot on bots21 is OK: PROCS OK: 2 processes with args 'cvtbot' [02:57:06] PROBLEM - bots21 CVT Bot on bots21 is CRITICAL: PROCS CRITICAL: 1 process with args 'cvtbot' [03:02:01] RECOVERY - puppet21 Backups Private on puppet21 is OK: FILE_AGE OK: /var/log/private-backup.log is 119 seconds old and 0 bytes [03:02:30] !log stopped bots on bots1 and fixed them on bots21 [03:02:32] Logged the message at https://meta.wikitide.org/wiki/Tech:Server_admin_log [03:03:01] RECOVERY - bots21 CVT Bot on bots21 is OK: PROCS OK: 2 processes with args 'cvtbot' [04:16:24] PROBLEM - cp3 HTTP 4xx/5xx ERROR Rate on cp3 is WARNING: WARNING - NGINX Error Rate is 46% [04:18:24] RECOVERY - cp3 HTTP 4xx/5xx ERROR Rate on cp3 is OK: OK - NGINX Error Rate is 18% [04:31:08] PROBLEM - newcascadia.net - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - newcascadia.net reverse DNS resolves to vps-6006c2ae.vps.ovh.ca [05:00:07] RECOVERY - db21 Backups SQL wtglobal on db21 is OK: FILE_AGE OK: /var/log/backup-logs/sql-wtglobal-backup-weekly.log is 6 seconds old and 0 bytes [05:00:17] PROBLEM - newcascadia.net - reverse DNS on sslhost is WARNING: LifetimeTimeout: The resolution lifetime expired after 5.404 seconds: Server 1.1.1.1 UDP port 53 answered The DNS operation timed out.; Server 1.1.1.1 UDP port 53 answered The DNS operation timed out.; Server 1.1.1.1 UDP port 53 answered The DNS operation timed out. [05:29:23] PROBLEM - newcascadia.net - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - newcascadia.net reverse DNS resolves to vps-6006c2ae.vps.ovh.ca [05:36:24] PROBLEM - mlrpgspeedruns.com - reverse DNS on sslhost is WARNING: LifetimeTimeout: The resolution lifetime expired after 5.404 seconds: Server 1.1.1.1 UDP port 53 answered The DNS operation timed out.; Server 1.1.1.1 UDP port 53 answered The DNS operation timed out.; Server 1.1.1.1 UDP port 53 answered The DNS operation timed out. [05:58:32] PROBLEM - newcascadia.net - reverse DNS on sslhost is WARNING: LifetimeTimeout: The resolution lifetime expired after 5.404 seconds: Server 1.1.1.1 UDP port 53 answered The DNS operation timed out.; Server 1.1.1.1 UDP port 53 answered The DNS operation timed out.; Server 1.1.1.1 UDP port 53 answered The DNS operation timed out. [06:00:08] RECOVERY - puppet21 Backups SSLKeys on puppet21 is OK: FILE_AGE OK: /var/log/sslkeys-backup.log is 2 seconds old and 92 bytes [06:06:05] PROBLEM - mlrpgspeedruns.com - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - mlrpgspeedruns.com reverse DNS resolves to vps-d267e842.vps.ovh.ca [06:06:43] PROBLEM - www.rosettacode.org - reverse DNS on sslhost is WARNING: LifetimeTimeout: The resolution lifetime expired after 5.404 seconds: Server 1.1.1.1 UDP port 53 answered The DNS operation timed out.; Server 1.1.1.1 UDP port 53 answered The DNS operation timed out.; Server 1.1.1.1 UDP port 53 answered The DNS operation timed out. [06:36:23] PROBLEM - www.rosettacode.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - www.rosettacode.org reverse DNS resolves to vps-d267e842.vps.ovh.ca [07:02:20] PROBLEM - nexttide.org - reverse DNS on sslhost is WARNING: LifetimeTimeout: The resolution lifetime expired after 5.405 seconds: Server 1.1.1.1 UDP port 53 answered The DNS operation timed out.; Server 1.1.1.1 UDP port 53 answered The DNS operation timed out.; Server 1.1.1.1 UDP port 53 answered The DNS operation timed out. [07:06:09] PROBLEM - mem21 Current Load on mem21 is WARNING: LOAD WARNING - total load average: 2.52, 3.50, 3.87 [07:12:09] PROBLEM - mem21 Current Load on mem21 is CRITICAL: LOAD CRITICAL - total load average: 4.12, 3.95, 3.94 [07:14:10] PROBLEM - mem21 Current Load on mem21 is WARNING: LOAD WARNING - total load average: 3.99, 3.95, 3.94 [07:16:09] PROBLEM - mem21 Current Load on mem21 is CRITICAL: LOAD CRITICAL - total load average: 5.42, 4.37, 4.09 [07:20:09] PROBLEM - mem21 Current Load on mem21 is WARNING: LOAD WARNING - total load average: 2.84, 3.91, 4.00 [07:22:09] PROBLEM - mem21 Current Load on mem21 is CRITICAL: LOAD CRITICAL - total load average: 4.75, 4.08, 4.04 [07:25:58] PROBLEM - newcascadia.net - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - newcascadia.net reverse DNS resolves to vps-6006c2ae.vps.ovh.ca [07:31:44] PROBLEM - nexttide.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - nexttide.org reverse DNS resolves to vps-6006c2ae.vps.ovh.ca [07:32:09] PROBLEM - mem21 Current Load on mem21 is WARNING: LOAD WARNING - total load average: 3.41, 3.82, 3.97 [07:32:46] PROBLEM - rosettacode.org - reverse DNS on sslhost is WARNING: LifetimeTimeout: The resolution lifetime expired after 5.405 seconds: Server 1.1.1.1 UDP port 53 answered The DNS operation timed out.; Server 1.1.1.1 UDP port 53 answered The DNS operation timed out.; Server 1.1.1.1 UDP port 53 answered The DNS operation timed out. [07:36:09] PROBLEM - mem21 Current Load on mem21 is CRITICAL: LOAD CRITICAL - total load average: 4.47, 4.17, 4.08 [07:55:07] PROBLEM - newcascadia.net - reverse DNS on sslhost is WARNING: LifetimeTimeout: The resolution lifetime expired after 5.404 seconds: Server 1.1.1.1 UDP port 53 answered The DNS operation timed out.; Server 1.1.1.1 UDP port 53 answered The DNS operation timed out.; Server 1.1.1.1 UDP port 53 answered The DNS operation timed out. [08:00:09] PROBLEM - mem21 Current Load on mem21 is WARNING: LOAD WARNING - total load average: 3.35, 3.76, 3.99 [08:00:51] PROBLEM - valorantjp.wiki - reverse DNS on sslhost is WARNING: LifetimeTimeout: The resolution lifetime expired after 5.405 seconds: Server 1.1.1.1 UDP port 53 answered The DNS operation timed out.; Server 1.1.1.1 UDP port 53 answered The DNS operation timed out.; Server 1.1.1.1 UDP port 53 answered The DNS operation timed out. [08:02:10] PROBLEM - mem21 Current Load on mem21 is CRITICAL: LOAD CRITICAL - total load average: 3.93, 3.97, 4.05 [08:02:18] PROBLEM - rosettacode.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - rosettacode.org reverse DNS resolves to vps-6006c2ae.vps.ovh.ca [08:30:28] PROBLEM - valorantjp.wiki - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - valorantjp.wiki reverse DNS resolves to vps-6006c2ae.vps.ovh.ca [08:38:09] PROBLEM - mem21 Current Load on mem21 is WARNING: LOAD WARNING - total load average: 3.24, 3.56, 3.90 [08:40:09] PROBLEM - mem21 Current Load on mem21 is CRITICAL: LOAD CRITICAL - total load average: 4.10, 3.81, 3.95 [08:46:10] PROBLEM - mem21 Current Load on mem21 is WARNING: LOAD WARNING - total load average: 3.52, 3.93, 4.00 [08:48:10] PROBLEM - mem21 Current Load on mem21 is CRITICAL: LOAD CRITICAL - total load average: 4.18, 4.19, 4.09 [08:50:09] PROBLEM - mem21 Current Load on mem21 is WARNING: LOAD WARNING - total load average: 2.84, 3.80, 3.97 [08:56:09] PROBLEM - mem21 Current Load on mem21 is CRITICAL: LOAD CRITICAL - total load average: 4.39, 3.89, 3.91 [08:58:10] PROBLEM - mem21 Current Load on mem21 is WARNING: LOAD WARNING - total load average: 3.17, 3.54, 3.77 [09:00:10] PROBLEM - mem21 Current Load on mem21 is CRITICAL: LOAD CRITICAL - total load average: 4.13, 3.85, 3.86 [09:02:10] PROBLEM - mem21 Current Load on mem21 is WARNING: LOAD WARNING - total load average: 3.97, 3.88, 3.87 [09:04:20] PROBLEM - mlrpgspeedruns.com - reverse DNS on sslhost is WARNING: LifetimeTimeout: The resolution lifetime expired after 5.404 seconds: Server 1.1.1.1 UDP port 53 answered The DNS operation timed out.; Server 1.1.1.1 UDP port 53 answered The DNS operation timed out.; Server 1.1.1.1 UDP port 53 answered The DNS operation timed out. [09:06:09] PROBLEM - mem21 Current Load on mem21 is CRITICAL: LOAD CRITICAL - total load average: 5.06, 4.01, 3.89 [09:12:09] PROBLEM - mem21 Current Load on mem21 is WARNING: LOAD WARNING - total load average: 3.37, 3.86, 3.92 [09:14:10] PROBLEM - mem21 Current Load on mem21 is CRITICAL: LOAD CRITICAL - total load average: 5.35, 4.45, 4.13 [09:56:10] PROBLEM - mem21 Current Load on mem21 is WARNING: LOAD WARNING - total load average: 3.20, 3.49, 3.97 [10:03:43] PROBLEM - mlrpgspeedruns.com - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - mlrpgspeedruns.com reverse DNS resolves to vps-6006c2ae.vps.ovh.ca [10:06:09] PROBLEM - mem21 Current Load on mem21 is CRITICAL: LOAD CRITICAL - total load average: 4.33, 3.67, 3.77 [10:08:09] PROBLEM - mem21 Current Load on mem21 is WARNING: LOAD WARNING - total load average: 3.25, 3.61, 3.75 [10:10:10] PROBLEM - mem21 Current Load on mem21 is CRITICAL: LOAD CRITICAL - total load average: 4.71, 3.82, 3.80 [10:16:10] PROBLEM - mem21 Current Load on mem21 is WARNING: LOAD WARNING - total load average: 3.66, 3.79, 3.82 [10:18:10] PROBLEM - mem21 Current Load on mem21 is CRITICAL: LOAD CRITICAL - total load average: 4.79, 4.35, 4.04 [10:24:10] PROBLEM - mem21 Current Load on mem21 is WARNING: LOAD WARNING - total load average: 3.90, 3.98, 3.99 [10:26:09] PROBLEM - mem21 Current Load on mem21 is CRITICAL: LOAD CRITICAL - total load average: 4.39, 4.07, 4.02 [10:38:09] PROBLEM - mem21 Current Load on mem21 is WARNING: LOAD WARNING - total load average: 3.61, 3.78, 3.99 [10:40:09] PROBLEM - mem21 Current Load on mem21 is CRITICAL: LOAD CRITICAL - total load average: 4.13, 3.84, 3.97 [10:42:09] PROBLEM - mem21 Current Load on mem21 is WARNING: LOAD WARNING - total load average: 3.70, 3.84, 3.96 [10:46:09] PROBLEM - mem21 Current Load on mem21 is CRITICAL: LOAD CRITICAL - total load average: 4.34, 4.07, 4.01 [10:52:09] PROBLEM - mem21 Current Load on mem21 is WARNING: LOAD WARNING - total load average: 3.69, 3.89, 3.96 [10:54:09] PROBLEM - mem21 Current Load on mem21 is CRITICAL: LOAD CRITICAL - total load average: 4.81, 4.25, 4.09 [10:58:09] PROBLEM - mem21 Current Load on mem21 is WARNING: LOAD WARNING - total load average: 2.94, 3.61, 3.87 [11:00:09] PROBLEM - mem21 Current Load on mem21 is CRITICAL: LOAD CRITICAL - total load average: 4.72, 3.97, 3.97 [11:02:09] PROBLEM - mem21 Current Load on mem21 is WARNING: LOAD WARNING - total load average: 3.76, 3.80, 3.90 [11:06:09] PROBLEM - mem21 Current Load on mem21 is CRITICAL: LOAD CRITICAL - total load average: 4.20, 3.81, 3.87 [11:27:07] PROBLEM - nexttide.org - reverse DNS on sslhost is WARNING: LifetimeTimeout: The resolution lifetime expired after 5.405 seconds: Server 1.1.1.1 UDP port 53 answered The DNS operation timed out.; Server 1.1.1.1 UDP port 53 answered The DNS operation timed out.; Server 1.1.1.1 UDP port 53 answered The DNS operation timed out. [11:32:09] PROBLEM - mem21 Current Load on mem21 is WARNING: LOAD WARNING - total load average: 2.85, 3.66, 3.91 [11:36:09] PROBLEM - mem21 Current Load on mem21 is CRITICAL: LOAD CRITICAL - total load average: 4.29, 3.86, 3.92 [11:48:19] PROBLEM - newcascadia.net - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - newcascadia.net reverse DNS resolves to vps-6006c2ae.vps.ovh.ca [11:52:10] PROBLEM - mem21 Current Load on mem21 is WARNING: LOAD WARNING - total load average: 3.33, 3.72, 3.91 [11:56:10] PROBLEM - mem21 Current Load on mem21 is CRITICAL: LOAD CRITICAL - total load average: 4.45, 3.94, 3.95 [11:56:30] PROBLEM - nexttide.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - nexttide.org reverse DNS resolves to vps-6006c2ae.vps.ovh.ca [11:58:10] PROBLEM - mem21 Current Load on mem21 is WARNING: LOAD WARNING - total load average: 3.70, 3.82, 3.90 [12:00:09] PROBLEM - mem21 Current Load on mem21 is CRITICAL: LOAD CRITICAL - total load average: 4.31, 3.92, 3.93 [12:04:09] PROBLEM - mem21 Current Load on mem21 is WARNING: LOAD WARNING - total load average: 3.30, 3.84, 3.91 [12:08:09] PROBLEM - mem21 Current Load on mem21 is CRITICAL: LOAD CRITICAL - total load average: 4.72, 4.19, 4.03 [12:17:29] PROBLEM - newcascadia.net - reverse DNS on sslhost is WARNING: LifetimeTimeout: The resolution lifetime expired after 5.402 seconds: Server 1.1.1.1 UDP port 53 answered The DNS operation timed out.; Server 1.1.1.1 UDP port 53 answered The DNS operation timed out.; Server 1.1.1.1 UDP port 53 answered The DNS operation timed out. [12:29:38] PROBLEM - valorantjp.wiki - reverse DNS on sslhost is WARNING: LifetimeTimeout: The resolution lifetime expired after 5.404 seconds: Server 1.1.1.1 UDP port 53 answered The DNS operation timed out.; Server 1.1.1.1 UDP port 53 answered The DNS operation timed out.; Server 1.1.1.1 UDP port 53 answered The DNS operation timed out. [12:42:09] PROBLEM - mem21 Current Load on mem21 is WARNING: LOAD WARNING - total load average: 3.63, 3.93, 4.00 [12:44:10] PROBLEM - mem21 Current Load on mem21 is CRITICAL: LOAD CRITICAL - total load average: 4.99, 4.31, 4.13 [12:46:34] PROBLEM - newcascadia.net - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - newcascadia.net reverse DNS resolves to vps-6006c2ae.vps.ovh.ca [12:59:35] PROBLEM - valorantjp.wiki - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - valorantjp.wiki reverse DNS resolves to vps-6006c2ae.vps.ovh.ca [13:15:44] PROBLEM - newcascadia.net - reverse DNS on sslhost is WARNING: LifetimeTimeout: The resolution lifetime expired after 5.404 seconds: Server 1.1.1.1 UDP port 53 answered The DNS operation timed out.; Server 1.1.1.1 UDP port 53 answered The DNS operation timed out.; Server 1.1.1.1 UDP port 53 answered The DNS operation timed out. [13:24:58] PROBLEM - nexttide.org - reverse DNS on sslhost is WARNING: LifetimeTimeout: The resolution lifetime expired after 5.404 seconds: Server 1.1.1.1 UDP port 53 answered The DNS operation timed out.; Server 1.1.1.1 UDP port 53 answered The DNS operation timed out.; Server 1.1.1.1 UDP port 53 answered The DNS operation timed out. [13:54:54] PROBLEM - nexttide.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - nexttide.org reverse DNS resolves to vps-6006c2ae.vps.ovh.ca [14:29:38] PROBLEM - rosettacode.org - reverse DNS on sslhost is WARNING: LifetimeTimeout: The resolution lifetime expired after 5.405 seconds: Server 1.1.1.1 UDP port 53 answered The DNS operation timed out.; Server 1.1.1.1 UDP port 53 answered The DNS operation timed out.; Server 1.1.1.1 UDP port 53 answered The DNS operation timed out. [14:59:37] PROBLEM - rosettacode.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - rosettacode.org reverse DNS resolves to vps-6006c2ae.vps.ovh.ca [15:12:17] PROBLEM - newcascadia.net - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - newcascadia.net reverse DNS resolves to vps-6006c2ae.vps.ovh.ca [15:30:18] PROBLEM - mlrpgspeedruns.com - reverse DNS on sslhost is WARNING: LifetimeTimeout: The resolution lifetime expired after 5.401 seconds: Server 1.1.1.1 UDP port 53 answered The DNS operation timed out.; Server 1.1.1.1 UDP port 53 answered The DNS operation timed out.; Server 1.1.1.1 UDP port 53 answered The DNS operation timed out. [15:41:26] PROBLEM - newcascadia.net - reverse DNS on sslhost is WARNING: LifetimeTimeout: The resolution lifetime expired after 5.405 seconds: Server 1.1.1.1 UDP port 53 answered The DNS operation timed out.; Server 1.1.1.1 UDP port 53 answered The DNS operation timed out.; Server 1.1.1.1 UDP port 53 answered The DNS operation timed out. [15:59:57] PROBLEM - mlrpgspeedruns.com - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - mlrpgspeedruns.com reverse DNS resolves to vps-6006c2ae.vps.ovh.ca [16:59:23] PROBLEM - mlrpgspeedruns.com - reverse DNS on sslhost is WARNING: LifetimeTimeout: The resolution lifetime expired after 5.404 seconds: Server 1.1.1.1 UDP port 53 answered The DNS operation timed out.; Server 1.1.1.1 UDP port 53 answered The DNS operation timed out.; Server 1.1.1.1 UDP port 53 answered The DNS operation timed out. [17:09:38] PROBLEM - newcascadia.net - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - newcascadia.net reverse DNS resolves to vps-6006c2ae.vps.ovh.ca [17:39:39] PROBLEM - newcascadia.net - reverse DNS on sslhost is WARNING: LifetimeTimeout: The resolution lifetime expired after 5.404 seconds: Server 1.1.1.1 UDP port 53 answered The DNS operation timed out.; Server 1.1.1.1 UDP port 53 answered The DNS operation timed out.; Server 1.1.1.1 UDP port 53 answered The DNS operation timed out. [18:22:32] [02WikiTideOrg/landing] 07Reception123 pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/WikiTideOrg/landing/compare/5386915011e7...c819560e517e [18:22:33] [02WikiTideOrg/landing] 07Reception123 03c819560 - 100% not 100 [18:24:58] PROBLEM - nexttide.org - reverse DNS on sslhost is WARNING: LifetimeTimeout: The resolution lifetime expired after 5.404 seconds: Server 1.1.1.1 UDP port 53 answered The DNS operation timed out.; Server 1.1.1.1 UDP port 53 answered The DNS operation timed out.; Server 1.1.1.1 UDP port 53 answered The DNS operation timed out. [18:28:20] PROBLEM - www.rosettacode.org - reverse DNS on sslhost is WARNING: LifetimeTimeout: The resolution lifetime expired after 5.403 seconds: Server 1.1.1.1 UDP port 53 answered The DNS operation timed out.; Server 1.1.1.1 UDP port 53 answered The DNS operation timed out.; Server 1.1.1.1 UDP port 53 answered The DNS operation timed out. [18:28:32] PROBLEM - mlrpgspeedruns.com - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - mlrpgspeedruns.com reverse DNS resolves to vps-d267e842.vps.ovh.ca [18:54:54] PROBLEM - nexttide.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - nexttide.org reverse DNS resolves to vps-d267e842.vps.ovh.ca [18:58:03] PROBLEM - www.rosettacode.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - www.rosettacode.org reverse DNS resolves to vps-d267e842.vps.ovh.ca [19:54:58] PROBLEM - nexttide.org - reverse DNS on sslhost is WARNING: LifetimeTimeout: The resolution lifetime expired after 5.408 seconds: Server 1.1.1.1 UDP port 53 answered The DNS operation timed out.; Server 1.1.1.1 UDP port 53 answered The DNS operation timed out.; Server 1.1.1.1 UDP port 53 answered The DNS operation timed out. [20:24:53] PROBLEM - nexttide.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - nexttide.org reverse DNS resolves to vps-6006c2ae.vps.ovh.ca [20:59:38] PROBLEM - valorantjp.wiki - reverse DNS on sslhost is WARNING: LifetimeTimeout: The resolution lifetime expired after 5.404 seconds: Server 1.1.1.1 UDP port 53 answered The DNS operation timed out.; Server 1.1.1.1 UDP port 53 answered The DNS operation timed out.; Server 1.1.1.1 UDP port 53 answered The DNS operation timed out. [20:59:38] PROBLEM - rosettacode.org - reverse DNS on sslhost is WARNING: LifetimeTimeout: The resolution lifetime expired after 5.404 seconds: Server 1.1.1.1 UDP port 53 answered The DNS operation timed out.; Server 1.1.1.1 UDP port 53 answered The DNS operation timed out.; Server 1.1.1.1 UDP port 53 answered The DNS operation timed out. [21:29:34] PROBLEM - rosettacode.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - rosettacode.org reverse DNS resolves to vps-d267e842.vps.ovh.ca [21:29:35] PROBLEM - valorantjp.wiki - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - valorantjp.wiki reverse DNS resolves to vps-6006c2ae.vps.ovh.ca [21:40:37] PROBLEM - puppet21 Current Load on puppet21 is WARNING: LOAD WARNING - total load average: 6.82, 6.45, 5.69 [21:44:37] PROBLEM - puppet21 Current Load on puppet21 is CRITICAL: LOAD CRITICAL - total load average: 9.46, 7.90, 6.45 [21:46:37] PROBLEM - puppet21 Current Load on puppet21 is WARNING: LOAD WARNING - total load average: 5.67, 7.21, 6.39 [21:48:37] RECOVERY - puppet21 Current Load on puppet21 is OK: LOAD OK - total load average: 4.14, 6.12, 6.09 [21:55:07] [02WikiTideOrg/puppet] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/WikiTideOrg/puppet/compare/b1ef369051bf...8aa89bc83a3c [21:55:10] [02WikiTideOrg/puppet] 07Universal-Omega 038aa89bc - Use 'wiki' suffix [21:56:23] WikiTideOrg/puppet - Universal-Omega the build passed. [21:56:44] PROBLEM - mlrpgspeedruns.com - reverse DNS on sslhost is WARNING: LifetimeTimeout: The resolution lifetime expired after 5.404 seconds: Server 1.1.1.1 UDP port 53 answered The DNS operation timed out.; Server 1.1.1.1 UDP port 53 answered The DNS operation timed out.; Server 1.1.1.1 UDP port 53 answered The DNS operation timed out. [22:09:38] PROBLEM - newcascadia.net - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - newcascadia.net reverse DNS resolves to vps-6006c2ae.vps.ovh.ca [22:56:41] PROBLEM - mlrpgspeedruns.com - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - mlrpgspeedruns.com reverse DNS resolves to vps-6006c2ae.vps.ovh.ca [23:09:39] PROBLEM - newcascadia.net - reverse DNS on sslhost is WARNING: LifetimeTimeout: The resolution lifetime expired after 5.405 seconds: Server 1.1.1.1 UDP port 53 answered The DNS operation timed out.; Server 1.1.1.1 UDP port 53 answered The DNS operation timed out.; Server 1.1.1.1 UDP port 53 answered The DNS operation timed out. [23:39:36] PROBLEM - newcascadia.net - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - newcascadia.net reverse DNS resolves to vps-6006c2ae.vps.ovh.ca