[00:04:49] [02WikiTideOrg/puppet] 07Universal-Omega pushed 031 commit to 03thumbor [+0/-0/±1] 13https://github.com/WikiTideOrg/puppet/compare/e55baa93a650...c1588ed64074 [00:04:51] [02WikiTideOrg/puppet] 07Universal-Omega 03c1588ed - Use base::memory_cgroup [00:04:54] [02puppet] 07Universal-Omega synchronize pull request 03#23: Add thumbor and haproxy support - 13https://github.com/WikiTideOrg/puppet/pull/23 [00:06:45] WikiTideOrg/puppet - Universal-Omega the build passed. [00:31:28] [02WikiTideOrg/puppet] 07Universal-Omega pushed 031 commit to 03jobrunner [+0/-0/±1] 13https://github.com/WikiTideOrg/puppet/compare/d8521f9631c3...798f3438df00 [00:31:30] [02WikiTideOrg/puppet] 07Universal-Omega 03798f343 - Increase memory_limit [00:31:31] [02puppet] 07Universal-Omega synchronize pull request 03#44: mediawiki: tune jobrunner config - 13https://github.com/WikiTideOrg/puppet/pull/44 [00:35:35] [02puppet] 07Universal-Omega closed pull request 03#44: mediawiki: tune jobrunner config - 13https://github.com/WikiTideOrg/puppet/pull/44 [00:35:38] [02WikiTideOrg/puppet] 07Universal-Omega pushed 031 commit to 03master [+1/-0/±5] 13https://github.com/WikiTideOrg/puppet/compare/574f318f9dec...94320e62db15 [00:35:39] [02WikiTideOrg/puppet] 07Universal-Omega 0394320e6 - mediawiki: tune jobrunner config [00:35:41] [02WikiTideOrg/puppet] 07Universal-Omega deleted branch 03jobrunner [00:35:42] [02puppet] 07Universal-Omega deleted branch 03jobrunner - 13https://github.com/WikiTideOrg/puppet [00:42:10] PROBLEM - puppet21 Current Load on puppet21 is WARNING: LOAD WARNING - total load average: 7.99, 6.77, 5.84 [00:46:00] PROBLEM - puppet21 Current Load on puppet21 is CRITICAL: LOAD CRITICAL - total load average: 8.57, 7.41, 6.29 [00:47:54] PROBLEM - puppet21 Current Load on puppet21 is WARNING: LOAD WARNING - total load average: 6.95, 7.09, 6.30 [00:57:31] RECOVERY - puppet21 Current Load on puppet21 is OK: LOAD OK - total load average: 6.12, 6.72, 6.53 [01:04:21] PROBLEM - puppet21 Current Load on puppet21 is WARNING: LOAD WARNING - total load average: 6.73, 6.88, 6.69 [01:06:16] RECOVERY - puppet21 Current Load on puppet21 is OK: LOAD OK - total load average: 6.08, 6.51, 6.57 [01:11:09] [02WikiTideOrg/puppet] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/WikiTideOrg/puppet/compare/94320e62db15...55386be5ddbb [01:11:12] [02WikiTideOrg/puppet] 07Universal-Omega 0355386be - Add femiwiki [01:14:20] [02WikiTideOrg/puppet] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/WikiTideOrg/puppet/compare/55386be5ddbb...10574361afc0 [01:14:21] [02WikiTideOrg/puppet] 07Universal-Omega 031057436 - Use REL1_40 [01:15:57] !log [universalomega@jobrunner21] starting deploy of {'versions': ['1.40', '1.41'], 'upgrade_skins': ['Femiwiki']} to [mw21, mw22, jobrunner21] [01:15:58] !log [universalomega@jobrunner21] finished deploy of {'versions': ['1.40', '1.41'], 'upgrade_skins': ['Femiwiki']} to [mw21, mw22, jobrunner21] - SUCCESS in 0s [01:15:59] !log [universalomega@jobrunner21] starting deploy of {'versions': ['1.40', '1.41'], 'upgrade_skins': ['Femiwiki']} to [mw21, mw22, jobrunner21] [01:16:00] Logged the message at https://meta.wikitide.org/wiki/Tech:Server_admin_log [01:16:01] !log [universalomega@jobrunner21] finished deploy of {'versions': ['1.40', '1.41'], 'upgrade_skins': ['Femiwiki']} to [mw21, mw22, jobrunner21] - SUCCESS in 0s [01:16:01] Logged the message at https://meta.wikitide.org/wiki/Tech:Server_admin_log [01:16:02] !log [universalomega@jobrunner21] starting deploy of {'versions': ['1.40', '1.41'], 'upgrade_skins': ['Femiwiki']} to [mw21, mw22, jobrunner21] [01:16:03] Logged the message at https://meta.wikitide.org/wiki/Tech:Server_admin_log [01:16:03] !log [universalomega@jobrunner21] finished deploy of {'versions': ['1.40', '1.41'], 'upgrade_skins': ['Femiwiki']} to [mw21, mw22, jobrunner21] - SUCCESS in 1s [01:16:05] Logged the message at https://meta.wikitide.org/wiki/Tech:Server_admin_log [01:16:07] Logged the message at https://meta.wikitide.org/wiki/Tech:Server_admin_log [01:16:09] Logged the message at https://meta.wikitide.org/wiki/Tech:Server_admin_log [01:16:51] !log [universalomega@jobrunner21] starting deploy of {'force': True, 'versions': ['1.40', '1.41'], 'upgrade_skins': ['Femiwiki']} to [mw21, mw22, jobrunner21] [01:16:52] !log [universalomega@jobrunner21] finished deploy of {'force': True, 'versions': ['1.40', '1.41'], 'upgrade_skins': ['Femiwiki']} to [mw21, mw22, jobrunner21] - SUCCESS in 0s [01:16:53] Logged the message at https://meta.wikitide.org/wiki/Tech:Server_admin_log [01:16:53] !log [universalomega@jobrunner21] starting deploy of {'force': True, 'versions': ['1.40', '1.41'], 'upgrade_skins': ['Femiwiki']} to [mw21, mw22, jobrunner21] [01:16:54] Logged the message at https://meta.wikitide.org/wiki/Tech:Server_admin_log [01:16:56] Logged the message at https://meta.wikitide.org/wiki/Tech:Server_admin_log [01:18:57] !log [universalomega@jobrunner21] finished deploy of {'force': True, 'versions': ['1.40', '1.41'], 'upgrade_skins': ['Femiwiki']} to [mw21, mw22, jobrunner21] - SUCCESS in 126s [01:18:58] !log [universalomega@jobrunner21] starting deploy of {'force': True, 'versions': ['1.40', '1.41'], 'upgrade_skins': ['Femiwiki']} to [mw21, mw22, jobrunner21] [01:18:59] Logged the message at https://meta.wikitide.org/wiki/Tech:Server_admin_log [01:19:01] Logged the message at https://meta.wikitide.org/wiki/Tech:Server_admin_log [01:19:09] !log [universalomega@jobrunner21] finished deploy of {'force': True, 'versions': ['1.40', '1.41'], 'upgrade_skins': ['Femiwiki']} to [mw21, mw22, jobrunner21] - SUCCESS in 137s [01:19:10] Logged the message at https://meta.wikitide.org/wiki/Tech:Server_admin_log [01:20:40] !log [universalomega@jobrunner21] starting deploy of {'folders': '1.40/skins/Femiwiki,1.41/skins/Femiwiki', 'versions': ['1.40']} to [mw21, mw22, jobrunner21] [01:20:42] Logged the message at https://meta.wikitide.org/wiki/Tech:Server_admin_log [01:21:20] !log [universalomega@jobrunner21] finished deploy of {'folders': '1.40/skins/Femiwiki,1.41/skins/Femiwiki', 'versions': ['1.40']} to [mw21, mw22, jobrunner21] - SUCCESS in 40s [01:21:22] Logged the message at https://meta.wikitide.org/wiki/Tech:Server_admin_log [01:22:16] !log [universalomega@jobrunner21] starting deploy of {'folders': '1.40/skins/Femiwiki,1.41/skins/Femiwiki', 'versions': ['1.40']} to [jobrunner21] [01:22:17] !log [universalomega@jobrunner21] finished deploy of {'folders': '1.40/skins/Femiwiki,1.41/skins/Femiwiki', 'versions': ['1.40']} to [jobrunner21] - SUCCESS in 0s [01:22:18] Logged the message at https://meta.wikitide.org/wiki/Tech:Server_admin_log [01:22:19] Logged the message at https://meta.wikitide.org/wiki/Tech:Server_admin_log [01:23:38] !log [universalomega@jobrunner21] finished deploy of {'folders': '1.40/skins/Femiwiki,1.41/skins/Femiwiki', 'versions': ['1.40'], 'servers': ['mw21']} to [mw21] - FAIL: [2, 2] in 71s [01:23:40] Logged the message at https://meta.wikitide.org/wiki/Tech:Server_admin_log [01:24:28] !log [universalomega@jobrunner21] starting deploy of {'config': True, 'versions': ['1.40']} to [mw21, mw22, jobrunner21] [01:24:33] Logged the message at https://meta.wikitide.org/wiki/Tech:Server_admin_log [01:24:37] !log [universalomega@jobrunner21] finished deploy of {'config': True, 'versions': ['1.40']} to [mw21, mw22, jobrunner21] - SUCCESS in 8s [01:24:43] Logged the message at https://meta.wikitide.org/wiki/Tech:Server_admin_log [01:25:22] !log [universalomega@jobrunner21] starting deploy of {'config': True, 'versions': ['1.40']} to [mw21, mw22, jobrunner21] [01:25:26] Logged the message at https://meta.wikitide.org/wiki/Tech:Server_admin_log [01:25:31] PROBLEM - puppet21 Current Load on puppet21 is CRITICAL: LOAD CRITICAL - total load average: 8.66, 7.46, 6.95 [01:26:41] !log [universalomega@jobrunner21] finished deploy of {'config': True, 'versions': ['1.40']} to [mw21, mw22, jobrunner21] - SUCCESS in 79s [01:26:44] Logged the message at https://meta.wikitide.org/wiki/Tech:Server_admin_log [01:27:31] PROBLEM - puppet21 Current Load on puppet21 is WARNING: LOAD WARNING - total load average: 7.83, 7.46, 7.02 [01:32:00] !log [universalomega@jobrunner21] starting deploy of {'pull': 'config', 'config': True, 'versions': ['1.40']} to [mw21, mw22, jobrunner21] [01:32:02] Logged the message at https://meta.wikitide.org/wiki/Tech:Server_admin_log [01:33:22] RECOVERY - jobrunner21 Puppet on jobrunner21 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [01:33:30] !log [universalomega@jobrunner21] starting deploy of {'pull': 'config', 'config': True, 'versions': ['1.40']} to [mw21, mw22, jobrunner21] [01:33:33] Logged the message at https://meta.wikitide.org/wiki/Tech:Server_admin_log [01:33:40] !log [universalomega@jobrunner21] finished deploy of {'pull': 'config', 'config': True, 'versions': ['1.40']} to [mw21, mw22, jobrunner21] - SUCCESS in 9s [01:33:42] Logged the message at https://meta.wikitide.org/wiki/Tech:Server_admin_log [01:33:43] !log [universalomega@jobrunner21] starting deploy of {'pull': 'config', 'config': True, 'versions': ['1.40']} to [mw21, mw22, jobrunner21] [01:33:48] Logged the message at https://meta.wikitide.org/wiki/Tech:Server_admin_log [01:33:52] !log [universalomega@jobrunner21] finished deploy of {'pull': 'config', 'config': True, 'versions': ['1.40']} to [mw21, mw22, jobrunner21] - SUCCESS in 8s [01:33:54] Logged the message at https://meta.wikitide.org/wiki/Tech:Server_admin_log [01:35:43] [02puppet] 07Universal-Omega closed pull request 03#18: Add reports module - 13https://github.com/WikiTideOrg/puppet/pull/18 [01:35:44] [02WikiTideOrg/puppet] 07Universal-Omega pushed 031 commit to 03master [+5/-0/±2] 13https://github.com/WikiTideOrg/puppet/compare/10574361afc0...6fd91f01c4fd [01:35:45] [02WikiTideOrg/puppet] 07Universal-Omega 036fd91f0 - Add reports module Signed-off-by: CosmicAlpha [01:35:47] [02WikiTideOrg/puppet] 07Universal-Omega deleted branch 03reports [01:35:49] [02puppet] 07Universal-Omega deleted branch 03reports - 13https://github.com/WikiTideOrg/puppet [01:36:09] whoops I did not mean to merge that [01:36:46] [02WikiTideOrg/puppet] 07Universal-Omega pushed 036 commits to 03thumbor [+12/-0/±19] 13https://github.com/WikiTideOrg/puppet/compare/c1588ed64074...cceec865a309 [01:36:47] [02WikiTideOrg/puppet] 07Universal-Omega 03cceec86 - Merge branch 'master' into thumbor [01:36:50] [02puppet] 07Universal-Omega synchronize pull request 03#23: Add thumbor and haproxy support - 13https://github.com/WikiTideOrg/puppet/pull/23 [01:37:31] RECOVERY - puppet21 Current Load on puppet21 is OK: LOAD OK - total load average: 5.15, 6.26, 6.69 [01:38:28] WikiTideOrg/puppet - Universal-Omega the build passed. [01:43:31] PROBLEM - puppet21 Current Load on puppet21 is CRITICAL: LOAD CRITICAL - total load average: 9.33, 7.16, 6.87 [01:44:55] RECOVERY - mw21 Puppet on mw21 is OK: OK: Puppet is currently enabled, last run 41 seconds ago with 0 failures [01:46:20] RECOVERY - mw22 Puppet on mw22 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [01:47:31] PROBLEM - puppet21 Current Load on puppet21 is WARNING: LOAD WARNING - total load average: 6.13, 7.29, 7.07 [01:59:31] RECOVERY - puppet21 Current Load on puppet21 is OK: LOAD OK - total load average: 6.05, 6.53, 6.78 [02:09:31] PROBLEM - puppet21 Current Load on puppet21 is WARNING: LOAD WARNING - total load average: 7.57, 7.08, 6.84 [02:11:31] RECOVERY - puppet21 Current Load on puppet21 is OK: LOAD OK - total load average: 6.01, 6.71, 6.74 [02:15:31] PROBLEM - puppet21 Current Load on puppet21 is WARNING: LOAD WARNING - total load average: 7.27, 7.21, 6.95 [02:25:31] PROBLEM - puppet21 Current Load on puppet21 is CRITICAL: LOAD CRITICAL - total load average: 8.67, 8.02, 7.43 [02:41:31] PROBLEM - puppet21 Current Load on puppet21 is WARNING: LOAD WARNING - total load average: 7.18, 7.95, 7.98 [02:43:31] PROBLEM - puppet21 Current Load on puppet21 is CRITICAL: LOAD CRITICAL - total load average: 8.00, 8.04, 8.01 [02:54:05] RECOVERY - newcascadia.net - reverse DNS on sslhost is OK: SSL OK - newcascadia.net reverse DNS resolves to cp5.wikitide.net - NS RECORDS OK [02:57:31] PROBLEM - puppet21 Current Load on puppet21 is WARNING: LOAD WARNING - total load average: 6.76, 7.45, 7.96 [03:11:31] PROBLEM - puppet21 Current Load on puppet21 is CRITICAL: LOAD CRITICAL - total load average: 8.09, 7.28, 7.53 [03:15:31] PROBLEM - puppet21 Current Load on puppet21 is WARNING: LOAD WARNING - total load average: 7.19, 7.55, 7.61 [03:17:31] PROBLEM - puppet21 Current Load on puppet21 is CRITICAL: LOAD CRITICAL - total load average: 8.05, 7.78, 7.69 [03:33:31] PROBLEM - puppet21 Current Load on puppet21 is WARNING: LOAD WARNING - total load average: 7.13, 7.85, 7.98 [03:35:31] PROBLEM - puppet21 Current Load on puppet21 is CRITICAL: LOAD CRITICAL - total load average: 8.26, 7.84, 7.94 [03:37:31] PROBLEM - puppet21 Current Load on puppet21 is WARNING: LOAD WARNING - total load average: 7.45, 7.64, 7.85 [03:47:31] PROBLEM - puppet21 Current Load on puppet21 is CRITICAL: LOAD CRITICAL - total load average: 8.38, 7.61, 7.61 [03:53:31] PROBLEM - puppet21 Current Load on puppet21 is WARNING: LOAD WARNING - total load average: 7.60, 7.75, 7.67 [03:59:31] PROBLEM - puppet21 Current Load on puppet21 is CRITICAL: LOAD CRITICAL - total load average: 9.30, 7.55, 7.50 [04:13:49] PROBLEM - www.rosettacode.org - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query rosettacode.org. IN NS: Server 1.1.1.1 UDP port 53 answered The DNS operation timed out.; Server 1.1.1.1 UDP port 53 answered SERVFAIL [04:27:26] PROBLEM - newcascadia.net - reverse DNS on sslhost is WARNING: LifetimeTimeout: The resolution lifetime expired after 5.404 seconds: Server 1.1.1.1 UDP port 53 answered The DNS operation timed out.; Server 1.1.1.1 UDP port 53 answered The DNS operation timed out.; Server 1.1.1.1 UDP port 53 answered The DNS operation timed out. [04:55:31] PROBLEM - puppet21 Current Load on puppet21 is WARNING: LOAD WARNING - total load average: 6.90, 7.35, 8.00 [05:01:31] PROBLEM - puppet21 Current Load on puppet21 is CRITICAL: LOAD CRITICAL - total load average: 8.82, 7.50, 7.78 [05:03:31] PROBLEM - puppet21 Current Load on puppet21 is WARNING: LOAD WARNING - total load average: 6.97, 7.30, 7.68 [05:07:31] PROBLEM - puppet21 Current Load on puppet21 is CRITICAL: LOAD CRITICAL - total load average: 8.63, 7.66, 7.71 [05:11:31] PROBLEM - puppet21 Current Load on puppet21 is WARNING: LOAD WARNING - total load average: 7.57, 7.89, 7.81 [05:25:31] PROBLEM - puppet21 Current Load on puppet21 is CRITICAL: LOAD CRITICAL - total load average: 9.56, 8.01, 7.68 [05:43:44] RECOVERY - www.rosettacode.org - reverse DNS on sslhost is OK: SSL OK - www.rosettacode.org reverse DNS resolves to cp5.wikitide.net - NS RECORDS OK [06:01:31] PROBLEM - puppet21 Current Load on puppet21 is WARNING: LOAD WARNING - total load average: 6.45, 7.47, 7.96 [06:05:31] PROBLEM - puppet21 Current Load on puppet21 is CRITICAL: LOAD CRITICAL - total load average: 8.18, 7.64, 7.91 [06:23:31] PROBLEM - puppet21 Current Load on puppet21 is WARNING: LOAD WARNING - total load average: 6.49, 7.59, 8.00 [06:25:31] PROBLEM - puppet21 Current Load on puppet21 is CRITICAL: LOAD CRITICAL - total load average: 8.39, 7.93, 8.08 [06:59:31] PROBLEM - puppet21 Current Load on puppet21 is WARNING: LOAD WARNING - total load average: 6.82, 7.62, 7.89 [07:11:31] PROBLEM - puppet21 Current Load on puppet21 is CRITICAL: LOAD CRITICAL - total load average: 8.93, 7.70, 7.57 [07:21:31] PROBLEM - puppet21 Current Load on puppet21 is WARNING: LOAD WARNING - total load average: 6.91, 7.75, 7.84 [07:31:31] PROBLEM - puppet21 Current Load on puppet21 is CRITICAL: LOAD CRITICAL - total load average: 8.59, 7.56, 7.56 [07:43:31] PROBLEM - puppet21 Current Load on puppet21 is WARNING: LOAD WARNING - total load average: 7.63, 7.84, 7.86 [07:45:31] PROBLEM - puppet21 Current Load on puppet21 is CRITICAL: LOAD CRITICAL - total load average: 8.75, 8.23, 8.00 [07:47:31] PROBLEM - puppet21 Current Load on puppet21 is WARNING: LOAD WARNING - total load average: 7.23, 7.74, 7.84 [07:51:31] PROBLEM - puppet21 Current Load on puppet21 is CRITICAL: LOAD CRITICAL - total load average: 8.78, 8.17, 7.98 [07:55:31] PROBLEM - puppet21 Current Load on puppet21 is WARNING: LOAD WARNING - total load average: 7.34, 7.89, 7.91 [08:01:31] PROBLEM - puppet21 Current Load on puppet21 is CRITICAL: LOAD CRITICAL - total load average: 8.06, 7.90, 7.90 [08:03:31] PROBLEM - puppet21 Current Load on puppet21 is WARNING: LOAD WARNING - total load average: 6.97, 7.67, 7.83 [08:13:31] PROBLEM - puppet21 Current Load on puppet21 is CRITICAL: LOAD CRITICAL - total load average: 9.54, 7.50, 7.43 [08:21:31] PROBLEM - puppet21 Current Load on puppet21 is WARNING: LOAD WARNING - total load average: 6.33, 7.69, 7.69 [08:33:31] PROBLEM - puppet21 Current Load on puppet21 is CRITICAL: LOAD CRITICAL - total load average: 9.54, 7.74, 7.47 [08:39:31] PROBLEM - puppet21 Current Load on puppet21 is WARNING: LOAD WARNING - total load average: 6.88, 7.62, 7.55 [08:47:31] PROBLEM - puppet21 Current Load on puppet21 is CRITICAL: LOAD CRITICAL - total load average: 8.64, 7.65, 7.49 [08:49:31] PROBLEM - puppet21 Current Load on puppet21 is WARNING: LOAD WARNING - total load average: 6.89, 7.30, 7.38 [08:51:31] PROBLEM - puppet21 Current Load on puppet21 is CRITICAL: LOAD CRITICAL - total load average: 8.11, 7.51, 7.44 [08:59:31] PROBLEM - puppet21 Current Load on puppet21 is WARNING: LOAD WARNING - total load average: 6.55, 7.71, 7.69 [09:05:31] PROBLEM - puppet21 Current Load on puppet21 is CRITICAL: LOAD CRITICAL - total load average: 8.02, 7.53, 7.58 [09:07:31] PROBLEM - puppet21 Current Load on puppet21 is WARNING: LOAD WARNING - total load average: 6.32, 7.09, 7.41 [09:15:31] PROBLEM - puppet21 Current Load on puppet21 is CRITICAL: LOAD CRITICAL - total load average: 9.52, 7.97, 7.56 [09:25:31] PROBLEM - puppet21 Current Load on puppet21 is WARNING: LOAD WARNING - total load average: 6.95, 7.85, 7.86 [09:27:31] PROBLEM - puppet21 Current Load on puppet21 is CRITICAL: LOAD CRITICAL - total load average: 9.83, 8.51, 8.09 [11:57:31] PROBLEM - puppet21 Current Load on puppet21 is WARNING: LOAD WARNING - total load average: 6.52, 7.28, 8.00 [11:59:31] PROBLEM - puppet21 Current Load on puppet21 is CRITICAL: LOAD CRITICAL - total load average: 8.80, 7.92, 8.15 [12:03:31] PROBLEM - puppet21 Current Load on puppet21 is WARNING: LOAD WARNING - total load average: 7.39, 7.54, 7.94 [12:05:31] PROBLEM - puppet21 Current Load on puppet21 is CRITICAL: LOAD CRITICAL - total load average: 8.61, 7.77, 7.96 [13:20:19] RECOVERY - newcascadia.net - reverse DNS on sslhost is OK: SSL OK - newcascadia.net reverse DNS resolves to cp5.wikitide.net - NS RECORDS OK [13:59:31] PROBLEM - puppet21 Current Load on puppet21 is WARNING: LOAD WARNING - total load average: 6.63, 7.39, 7.94 [14:07:31] PROBLEM - puppet21 Current Load on puppet21 is CRITICAL: LOAD CRITICAL - total load average: 8.52, 7.52, 7.68 [14:13:31] PROBLEM - puppet21 Current Load on puppet21 is WARNING: LOAD WARNING - total load average: 6.81, 7.82, 7.88 [14:15:31] PROBLEM - puppet21 Current Load on puppet21 is CRITICAL: LOAD CRITICAL - total load average: 8.68, 8.19, 8.01 [14:33:31] PROBLEM - puppet21 Current Load on puppet21 is WARNING: LOAD WARNING - total load average: 7.89, 7.75, 7.92 [14:35:31] PROBLEM - puppet21 Current Load on puppet21 is CRITICAL: LOAD CRITICAL - total load average: 8.46, 8.13, 8.04 [14:41:31] PROBLEM - puppet21 Current Load on puppet21 is WARNING: LOAD WARNING - total load average: 6.32, 7.37, 7.79 [14:45:31] PROBLEM - puppet21 Current Load on puppet21 is CRITICAL: LOAD CRITICAL - total load average: 8.03, 7.43, 7.69 [15:37:31] PROBLEM - puppet21 Current Load on puppet21 is WARNING: LOAD WARNING - total load average: 6.63, 7.61, 7.95 [15:39:31] PROBLEM - puppet21 Current Load on puppet21 is CRITICAL: LOAD CRITICAL - total load average: 8.45, 7.96, 8.03 [16:53:31] PROBLEM - puppet21 Current Load on puppet21 is WARNING: LOAD WARNING - total load average: 6.27, 7.40, 7.94 [17:01:31] PROBLEM - puppet21 Current Load on puppet21 is CRITICAL: LOAD CRITICAL - total load average: 8.66, 7.55, 7.69 [17:09:31] PROBLEM - puppet21 Current Load on puppet21 is WARNING: LOAD WARNING - total load average: 7.09, 7.90, 7.90 [17:11:31] PROBLEM - puppet21 Current Load on puppet21 is CRITICAL: LOAD CRITICAL - total load average: 8.60, 7.78, 7.83 [17:13:31] PROBLEM - puppet21 Current Load on puppet21 is WARNING: LOAD WARNING - total load average: 7.67, 7.59, 7.75 [17:15:31] PROBLEM - puppet21 Current Load on puppet21 is CRITICAL: LOAD CRITICAL - total load average: 8.57, 7.98, 7.88 [17:17:31] PROBLEM - puppet21 Current Load on puppet21 is WARNING: LOAD WARNING - total load average: 7.54, 7.82, 7.83 [17:23:31] PROBLEM - puppet21 Current Load on puppet21 is CRITICAL: LOAD CRITICAL - total load average: 9.53, 8.30, 7.95 [17:23:50] [02WikiTideOrg/puppet] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/WikiTideOrg/puppet/compare/6fd91f01c4fd...fd4f89fb7b68 [17:23:53] [02WikiTideOrg/puppet] 07Universal-Omega 03fd4f89f - prometheus-jobqueue-stats: add RottenLinksJob [18:26:24] PROBLEM - newcascadia.net - reverse DNS on sslhost is WARNING: LifetimeTimeout: The resolution lifetime expired after 5.404 seconds: Server 1.1.1.1 UDP port 53 answered The DNS operation timed out.; Server 1.1.1.1 UDP port 53 answered The DNS operation timed out.; Server 1.1.1.1 UDP port 53 answered The DNS operation timed out. [18:41:31] PROBLEM - puppet21 Current Load on puppet21 is WARNING: LOAD WARNING - total load average: 7.72, 7.50, 7.94 [18:45:31] PROBLEM - puppet21 Current Load on puppet21 is CRITICAL: LOAD CRITICAL - total load average: 10.24, 8.50, 8.19 [19:19:31] PROBLEM - puppet21 Current Load on puppet21 is WARNING: LOAD WARNING - total load average: 6.45, 7.38, 7.97 [19:27:31] PROBLEM - puppet21 Current Load on puppet21 is CRITICAL: LOAD CRITICAL - total load average: 8.18, 7.83, 7.92 [20:00:25] [02WikiTideOrg/puppet] 07AgentIsai pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/WikiTideOrg/puppet/compare/fd4f89fb7b68...a00e2aed5960 [20:00:26] [02WikiTideOrg/puppet] 07AgentIsai 03a00e2ae - Replace mail21 with mail1 [21:37:31] PROBLEM - puppet21 Current Load on puppet21 is WARNING: LOAD WARNING - total load average: 6.88, 7.24, 7.91 [21:39:31] PROBLEM - puppet21 Current Load on puppet21 is CRITICAL: LOAD CRITICAL - total load average: 8.09, 7.36, 7.87 [21:51:47] RECOVERY - newcascadia.net - reverse DNS on sslhost is OK: SSL OK - newcascadia.net reverse DNS resolves to cp5.wikitide.net - NS RECORDS OK [22:07:31] PROBLEM - puppet21 Current Load on puppet21 is WARNING: LOAD WARNING - total load average: 6.78, 7.12, 7.89 [22:19:31] PROBLEM - puppet21 Current Load on puppet21 is CRITICAL: LOAD CRITICAL - total load average: 9.16, 8.26, 8.02 [22:21:31] PROBLEM - puppet21 Current Load on puppet21 is WARNING: LOAD WARNING - total load average: 6.48, 7.64, 7.83 [22:33:14] !log [agent@jobrunner21] sudo -u www-data php /srv/mediawiki/1.40/maintenance/run.php /srv/mediawiki/1.40/maintenance/runJobs.php --wiki=metawiki --procs 24 (START) [22:33:15] !log [agent@jobrunner21] sudo -u www-data php /srv/mediawiki/1.40/maintenance/run.php /srv/mediawiki/1.40/maintenance/runJobs.php --wiki=metawiki --procs 24 (END - exit=0) [22:33:16] Logged the message at https://meta.wikitide.org/wiki/Tech:Server_admin_log [22:33:18] Logged the message at https://meta.wikitide.org/wiki/Tech:Server_admin_log [22:33:31] PROBLEM - puppet21 Current Load on puppet21 is CRITICAL: LOAD CRITICAL - total load average: 8.21, 7.40, 7.43 [22:35:31] PROBLEM - puppet21 Current Load on puppet21 is WARNING: LOAD WARNING - total load average: 7.43, 7.47, 7.46 [22:39:31] PROBLEM - puppet21 Current Load on puppet21 is CRITICAL: LOAD CRITICAL - total load average: 8.28, 8.20, 7.78 [22:47:31] PROBLEM - puppet21 Current Load on puppet21 is WARNING: LOAD WARNING - total load average: 7.82, 7.82, 7.75 [22:49:31] PROBLEM - puppet21 Current Load on puppet21 is CRITICAL: LOAD CRITICAL - total load average: 8.42, 8.09, 7.86 [22:51:31] PROBLEM - puppet21 Current Load on puppet21 is WARNING: LOAD WARNING - total load average: 7.03, 7.95, 7.86 [22:59:31] PROBLEM - puppet21 Current Load on puppet21 is CRITICAL: LOAD CRITICAL - total load average: 9.63, 7.72, 7.68 [23:01:31] PROBLEM - puppet21 Current Load on puppet21 is WARNING: LOAD WARNING - total load average: 7.15, 7.54, 7.63 [23:07:31] PROBLEM - puppet21 Current Load on puppet21 is CRITICAL: LOAD CRITICAL - total load average: 8.94, 7.92, 7.76