[00:26:17] [02WikiTideOrg/mw-config] 07Universal-Omega pushed 031 commit to 03main [+0/-0/±1] 13https://github.com/WikiTideOrg/mw-config/compare/8948ebc184fb...756c28bafc41 [00:26:19] [02WikiTideOrg/mw-config] 07Universal-Omega 03756c28b - Set $wgExtensionInfoMTime [00:27:12] WikiTideOrg/mw-config - Universal-Omega the build passed. [00:31:44] [02WikiTideOrg/mw-config] 07Universal-Omega pushed 031 commit to 03main [+0/-0/±1] 13https://github.com/WikiTideOrg/mw-config/compare/756c28bafc41...14b4e9068785 [00:31:46] [02WikiTideOrg/mw-config] 07Universal-Omega 0314b4e90 - Add comment [00:32:46] WikiTideOrg/mw-config - Universal-Omega the build passed. [00:44:50] [02WikiTideOrg/mw-config] 07Universal-Omega pushed 031 commit to 03main [+0/-0/±1] 13https://github.com/WikiTideOrg/mw-config/compare/14b4e9068785...1cf575cc414a [00:44:51] [02WikiTideOrg/mw-config] 07Universal-Omega 031cf575c - Increase $wgRevisionCacheExpiry to 7 days [00:45:48] WikiTideOrg/mw-config - Universal-Omega the build passed. [00:46:55] !log [@jobrunner21] starting deploy of {'config': True, 'versions': ['']} to [mw21, mw22, jobrunner21] [00:46:57] !log [@jobrunner21] finished deploy of {'config': True, 'versions': ['']} to [mw21, mw22, jobrunner21] - SUCCESS in 1s [00:46:57] Logged the message at https://meta.wikitide.org/wiki/Tech:Server_admin_log [00:46:59] Logged the message at https://meta.wikitide.org/wiki/Tech:Server_admin_log [01:03:02] RECOVERY - newcascadia.net - reverse DNS on sslhost is OK: SSL OK - newcascadia.net reverse DNS resolves to cp5.wikitide.net - NS RECORDS OK [01:29:27] [02WikiTideOrg/puppet] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/WikiTideOrg/puppet/compare/9d1743f8ca07...fedea028d2e6 [01:29:30] [02WikiTideOrg/puppet] 07Universal-Omega 03fedea02 - varnish: use querysort to improve cache efficiency [01:30:12] [02WikiTideOrg/mw-config] 07Universal-Omega pushed 031 commit to 03main [+0/-0/±1] 13https://github.com/WikiTideOrg/mw-config/compare/1cf575cc414a...83f5f23179d2 [01:30:13] [02WikiTideOrg/mw-config] 07Universal-Omega 0383f5f23 - Set $wgCdnMatchParameterOrder to false [01:31:04] WikiTideOrg/mw-config - Universal-Omega the build passed. [01:46:50] !log [@jobrunner21] starting deploy of {'config': True, 'versions': ['']} to [mw21, mw22, jobrunner21] [01:46:52] !log [@jobrunner21] finished deploy of {'config': True, 'versions': ['']} to [mw21, mw22, jobrunner21] - SUCCESS in 1s [01:46:52] Logged the message at https://meta.wikitide.org/wiki/Tech:Server_admin_log [01:46:54] Logged the message at https://meta.wikitide.org/wiki/Tech:Server_admin_log [01:56:37] [02WikiTideOrg/mw-config] 07Universal-Omega pushed 031 commit to 03main [+0/-0/±1] 13https://github.com/WikiTideOrg/mw-config/compare/83f5f23179d2...830b3217d8c2 [01:56:39] [02WikiTideOrg/mw-config] 07Universal-Omega 03830b321 - Enable file cache on metawiki [01:56:56] !log [universalomega@jobrunner21] starting deploy of {'pull': 'config', 'config': True, 'versions': ['1.40']} to [mw21, mw22, jobrunner21] [01:56:58] Logged the message at https://meta.wikitide.org/wiki/Tech:Server_admin_log [01:56:59] !log [universalomega@jobrunner21] finished deploy of {'pull': 'config', 'config': True, 'versions': ['1.40']} to [mw21, mw22, jobrunner21] - SUCCESS in 3s [01:57:00] Logged the message at https://meta.wikitide.org/wiki/Tech:Server_admin_log [01:57:38] WikiTideOrg/mw-config - Universal-Omega the build passed. [02:08:45] [02WikiTideOrg/mw-config] 07Universal-Omega pushed 037 commits to 03mcrouter [+0/-0/±8] 13https://github.com/WikiTideOrg/mw-config/compare/5be71e707fa2...4f2ba7de7d64 [02:08:46] [02WikiTideOrg/mw-config] 07Universal-Omega 034f2ba7d - Merge branch 'main' into mcrouter [02:08:49] [02mw-config] 07Universal-Omega synchronize pull request 03#26: Use mcrouter - 13https://github.com/WikiTideOrg/mw-config/pull/26 [02:09:37] WikiTideOrg/mw-config - Universal-Omega the build passed. [02:09:37] [02puppet] 07Universal-Omega edited pull request 03#32: mediawiki: use mcrouter instead of nutcracker (T102) - 13https://github.com/WikiTideOrg/puppet/pull/32 [02:10:04] [02puppet] 07Universal-Omega closed pull request 03#32: mediawiki: use mcrouter instead of nutcracker (T102) - 13https://github.com/WikiTideOrg/puppet/pull/32 [02:10:07] [02WikiTideOrg/puppet] 07Universal-Omega pushed 031 commit to 03master [+10/-1/±5] 13https://github.com/WikiTideOrg/puppet/compare/fedea028d2e6...199ebaffae98 [02:10:09] [02WikiTideOrg/puppet] 07Universal-Omega 03199ebaf - mediawiki: use mcrouter instead of nutcracker (T102) [02:10:10] [02WikiTideOrg/puppet] 07Universal-Omega deleted branch 03mcrouter [02:10:13] [02puppet] 07Universal-Omega deleted branch 03mcrouter - 13https://github.com/WikiTideOrg/puppet [02:14:28] PROBLEM - mw22 Puppet on mw22 is WARNING: WARNING: Puppet is currently disabled, message: reason not specified, last run 25 minutes ago with 2 failures [02:17:42] [02WikiTideOrg/puppet] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/WikiTideOrg/puppet/compare/199ebaffae98...82295df1a2c5 [02:17:44] [02WikiTideOrg/puppet] 07Universal-Omega 0382295df - Ensure daemon is installed [02:20:55] PROBLEM - jobrunner21 APT on jobrunner21 is WARNING: APT WARNING: 0 packages available for upgrade (0 critical updates). warnings detected, errors detected. [02:25:42] [02WikiTideOrg/puppet] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/WikiTideOrg/puppet/compare/82295df1a2c5...a82607642e57 [02:25:43] [02WikiTideOrg/puppet] 07Universal-Omega 03a826076 - Use libboost-regex1.74.0 [02:26:55] RECOVERY - jobrunner21 APT on jobrunner21 is OK: APT OK: 57 packages available for upgrade (0 critical updates). [02:56:48] [02WikiTideOrg/puppet] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/WikiTideOrg/puppet/compare/a82607642e57...b9c28203600a [02:56:49] [02WikiTideOrg/puppet] 07Universal-Omega 03b9c2820 - Use nutcracker again (for now) [03:32:52] [02WikiTideOrg/mw-config] 07Universal-Omega pushed 031 commit to 03main [+0/-0/±1] 13https://github.com/WikiTideOrg/mw-config/compare/830b3217d8c2...0383eb6ccc6f [03:32:53] [02WikiTideOrg/mw-config] 07Universal-Omega 030383eb6 - Database: set load to 0 [03:33:32] !log [universalomega@jobrunner21] starting deploy of {'pull': 'config', 'config': True, 'versions': ['1.40']} to [mw21, mw22, jobrunner21] [03:33:34] Logged the message at https://meta.wikitide.org/wiki/Tech:Server_admin_log [03:33:35] !log [universalomega@jobrunner21] finished deploy of {'pull': 'config', 'config': True, 'versions': ['1.40']} to [mw21, mw22, jobrunner21] - SUCCESS in 2s [03:33:37] Logged the message at https://meta.wikitide.org/wiki/Tech:Server_admin_log [03:33:45] WikiTideOrg/mw-config - Universal-Omega the build passed. [03:38:22] PROBLEM - newcascadia.net - reverse DNS on sslhost is WARNING: LifetimeTimeout: The resolution lifetime expired after 5.404 seconds: Server 1.1.1.1 UDP port 53 answered The DNS operation timed out.; Server 1.1.1.1 UDP port 53 answered The DNS operation timed out.; Server 1.1.1.1 UDP port 53 answered The DNS operation timed out. [03:42:33] [02WikiTideOrg/puppet] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/WikiTideOrg/puppet/compare/b9c28203600a...33a9e678b8d2 [03:42:34] [02WikiTideOrg/puppet] 07Universal-Omega 0333a9e67 - Add updateSpecialPages.php cron [03:43:52] [02WikiTideOrg/mw-config] 07Universal-Omega pushed 031 commit to 03main [+0/-0/±1] 13https://github.com/WikiTideOrg/mw-config/compare/0383eb6ccc6f...0d838fca125e [03:43:54] [02WikiTideOrg/mw-config] 07Universal-Omega 030d838fc - Enable wgMiserMode [03:44:44] WikiTideOrg/mw-config - Universal-Omega the build passed. [03:47:24] !log [@jobrunner21] starting deploy of {'config': True, 'versions': ['']} to [mw21, mw22, jobrunner21] [03:47:26] Logged the message at https://meta.wikitide.org/wiki/Tech:Server_admin_log [03:47:26] !log [@jobrunner21] finished deploy of {'config': True, 'versions': ['']} to [mw21, mw22, jobrunner21] - SUCCESS in 2s [03:47:28] Logged the message at https://meta.wikitide.org/wiki/Tech:Server_admin_log [03:53:47] [02WikiTideOrg/mw-config] 07Universal-Omega pushed 031 commit to 03main [+0/-0/±1] 13https://github.com/WikiTideOrg/mw-config/compare/0d838fca125e...1595c7d11754 [03:53:49] [02WikiTideOrg/mw-config] 07Universal-Omega 031595c7d - Update query page settings [03:54:45] WikiTideOrg/mw-config - Universal-Omega the build passed. [03:55:19] !log [universalomega@jobrunner21] starting deploy of {'pull': 'config', 'config': True, 'versions': ['1.40']} to [mw21, mw22, jobrunner21] [03:55:21] Logged the message at https://meta.wikitide.org/wiki/Tech:Server_admin_log [03:55:21] !log [universalomega@jobrunner21] finished deploy of {'pull': 'config', 'config': True, 'versions': ['1.40']} to [mw21, mw22, jobrunner21] - SUCCESS in 2s [03:55:24] Logged the message at https://meta.wikitide.org/wiki/Tech:Server_admin_log [04:00:26] [02WikiTideOrg/WikiTideMagic] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/WikiTideOrg/WikiTideMagic/compare/0e56d66f216d...62420edfd3ff [04:00:29] [02WikiTideOrg/WikiTideMagic] 07Universal-Omega 0362420ed - Add querypage-updates-half-monthly message [04:01:25] !log [@jobrunner21] starting deploy of {'folders': '1.40/extensions/WikiTideMagic', 'versions': ['1.40']} to [mw21, mw22, jobrunner21] [04:01:27] !log [@jobrunner21] finished deploy of {'folders': '1.40/extensions/WikiTideMagic', 'versions': ['1.40']} to [mw21, mw22, jobrunner21] - SUCCESS in 2s [04:01:28] Logged the message at https://meta.wikitide.org/wiki/Tech:Server_admin_log [04:01:29] Logged the message at https://meta.wikitide.org/wiki/Tech:Server_admin_log [04:01:34] !log [@jobrunner21] starting deploy of {'folders': '1.41/extensions/WikiTideMagic', 'versions': ['1.40']} to [mw21, mw22, jobrunner21] [04:01:36] !log [@jobrunner21] finished deploy of {'folders': '1.41/extensions/WikiTideMagic', 'versions': ['1.40']} to [mw21, mw22, jobrunner21] - SUCCESS in 1s [04:01:36] Logged the message at https://meta.wikitide.org/wiki/Tech:Server_admin_log [04:01:38] Logged the message at https://meta.wikitide.org/wiki/Tech:Server_admin_log [04:02:26] !log [universalomega@jobrunner21] starting deploy of {'l10n': True, 'lang': 'en', 'versions': ['1.40', '1.41']} to [mw21, mw22, jobrunner21] [04:02:27] !log [universalomega@jobrunner21] finished deploy of {'l10n': True, 'lang': 'en', 'versions': ['1.40', '1.41']} to [mw21, mw22, jobrunner21] - SUCCESS in 0s [04:02:28] !log [universalomega@jobrunner21] starting deploy of {'l10n': True, 'lang': 'en', 'versions': ['1.40', '1.41']} to [mw21, mw22, jobrunner21] [04:02:28] Logged the message at https://meta.wikitide.org/wiki/Tech:Server_admin_log [04:02:30] Logged the message at https://meta.wikitide.org/wiki/Tech:Server_admin_log [04:02:30] !log [universalomega@jobrunner21] finished deploy of {'l10n': True, 'lang': 'en', 'versions': ['1.40', '1.41']} to [mw21, mw22, jobrunner21] - SUCCESS in 4s [04:02:31] !log [universalomega@jobrunner21] starting deploy of {'l10n': True, 'lang': 'en', 'versions': ['1.40', '1.41']} to [mw21, mw22, jobrunner21] [04:02:32] Logged the message at https://meta.wikitide.org/wiki/Tech:Server_admin_log [04:02:34] Logged the message at https://meta.wikitide.org/wiki/Tech:Server_admin_log [04:02:34] !log [universalomega@jobrunner21] finished deploy of {'l10n': True, 'lang': 'en', 'versions': ['1.40', '1.41']} to [mw21, mw22, jobrunner21] - SUCCESS in 8s [04:02:36] Logged the message at https://meta.wikitide.org/wiki/Tech:Server_admin_log [04:02:37] Logged the message at https://meta.wikitide.org/wiki/Tech:Server_admin_log [04:07:42] [02WikiTideOrg/mw-config] 07Universal-Omega pushed 031 commit to 03main [+0/-0/±1] 13https://github.com/WikiTideOrg/mw-config/compare/1595c7d11754...a32b22c39503 [04:07:44] [02WikiTideOrg/mw-config] 07Universal-Omega 03a32b22c - Disable for now [04:08:07] !log [universalomega@jobrunner21] starting deploy of {'pull': 'config', 'config': True, 'versions': ['1.40']} to [mw21, mw22, jobrunner21] [04:08:09] Logged the message at https://meta.wikitide.org/wiki/Tech:Server_admin_log [04:08:10] !log [universalomega@jobrunner21] finished deploy of {'pull': 'config', 'config': True, 'versions': ['1.40']} to [mw21, mw22, jobrunner21] - SUCCESS in 3s [04:08:12] Logged the message at https://meta.wikitide.org/wiki/Tech:Server_admin_log [04:08:36] WikiTideOrg/WikiTideMagic - Universal-Omega the build passed. [04:08:39] WikiTideOrg/mw-config - Universal-Omega the build passed. [04:15:41] [02WikiTideOrg/puppet] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/WikiTideOrg/puppet/compare/33a9e678b8d2...b41f3dc7e9aa [04:15:44] [02WikiTideOrg/puppet] 07Universal-Omega 03b41f3dc - Fix thumb_handler [04:16:31] [02WikiTideOrg/puppet] 07Universal-Omega pushed 0313 commits to 03thumbor [+20/-2/±25] 13https://github.com/WikiTideOrg/puppet/compare/b6aadea1c1ca...e55baa93a650 [04:16:32] [02WikiTideOrg/puppet] 07Universal-Omega 03e55baa9 - Merge branch 'master' into thumbor [04:16:34] [02puppet] 07Universal-Omega synchronize pull request 03#23: Add thumbor and haproxy support - 13https://github.com/WikiTideOrg/puppet/pull/23 [04:17:36] WikiTideOrg/puppet - Universal-Omega the build passed. [04:17:52] WikiTideOrg/puppet - Universal-Omega the build passed. [06:23:34] [02WikiTideOrg/landing] 07AgentIsai pushed 031 commit to 03master [+1/-0/±2] 13https://github.com/WikiTideOrg/landing/compare/c819560e517e...9e87f3df9b6b [06:23:37] [02WikiTideOrg/landing] 07AgentIsai 039e87f3d - Update landing page [06:24:01] !log [agent@jobrunner21] starting deploy of {'pull': 'landing', 'landing': True, 'versions': ['1.40']} to [mw21, mw22, jobrunner21] [06:24:03] Logged the message at https://meta.wikitide.org/wiki/Tech:Server_admin_log [06:24:04] !log [agent@jobrunner21] finished deploy of {'pull': 'landing', 'landing': True, 'versions': ['1.40']} to [mw21, mw22, jobrunner21] - SUCCESS in 3s [06:24:06] Logged the message at https://meta.wikitide.org/wiki/Tech:Server_admin_log [06:25:07] [02WikiTideOrg/landing] 07AgentIsai pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/WikiTideOrg/landing/compare/9e87f3df9b6b...00a6cf4bc258 [06:25:08] [02WikiTideOrg/landing] 07AgentIsai 0300a6cf4 - Fix percentage [06:25:08] !log [agent@jobrunner21] starting deploy of {'pull': 'landing', 'landing': True, 'versions': ['1.40']} to [mw21, mw22, jobrunner21] [06:25:10] Logged the message at https://meta.wikitide.org/wiki/Tech:Server_admin_log [06:25:11] !log [agent@jobrunner21] finished deploy of {'pull': 'landing', 'landing': True, 'versions': ['1.40']} to [mw21, mw22, jobrunner21] - SUCCESS in 2s [06:25:13] Logged the message at https://meta.wikitide.org/wiki/Tech:Server_admin_log [06:29:29] [02WikiTideOrg/landing] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/WikiTideOrg/landing/compare/00a6cf4bc258...1bc76f5f3e69 [06:29:31] [02WikiTideOrg/landing] 07Universal-Omega 031bc76f5 - Fix percentage display [06:29:49] !log [universalomega@jobrunner21] starting deploy of {'pull': 'landing', 'landing': True, 'versions': ['1.40']} to [mw21, mw22, jobrunner21] [06:29:51] Logged the message at https://meta.wikitide.org/wiki/Tech:Server_admin_log [06:29:52] !log [universalomega@jobrunner21] finished deploy of {'pull': 'landing', 'landing': True, 'versions': ['1.40']} to [mw21, mw22, jobrunner21] - SUCCESS in 3s [06:29:54] Logged the message at https://meta.wikitide.org/wiki/Tech:Server_admin_log [06:33:36] [02WikiTideOrg/landing] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/WikiTideOrg/landing/compare/1bc76f5f3e69...5ef021481705 [06:33:38] [02WikiTideOrg/landing] 07Universal-Omega 035ef0214 - Update [06:33:41] !log [universalomega@jobrunner21] starting deploy of {'pull': 'landing', 'landing': True, 'versions': ['1.40']} to [mw21, mw22, jobrunner21] [06:33:44] Logged the message at https://meta.wikitide.org/wiki/Tech:Server_admin_log [06:33:44] !log [universalomega@jobrunner21] finished deploy of {'pull': 'landing', 'landing': True, 'versions': ['1.40']} to [mw21, mw22, jobrunner21] - SUCCESS in 2s [06:33:46] Logged the message at https://meta.wikitide.org/wiki/Tech:Server_admin_log [06:37:33] [02WikiTideOrg/landing] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/WikiTideOrg/landing/compare/5ef021481705...d367bd55ab1e [06:37:36] [02WikiTideOrg/landing] 07Universal-Omega 03d367bd5 - Use Issue tracker for name [06:37:39] !log [universalomega@jobrunner21] starting deploy of {'pull': 'landing', 'landing': True, 'versions': ['1.40']} to [mw21, mw22, jobrunner21] [06:37:41] Logged the message at https://meta.wikitide.org/wiki/Tech:Server_admin_log [06:37:42] !log [universalomega@jobrunner21] finished deploy of {'pull': 'landing', 'landing': True, 'versions': ['1.40']} to [mw21, mw22, jobrunner21] - SUCCESS in 3s [06:37:44] Logged the message at https://meta.wikitide.org/wiki/Tech:Server_admin_log [07:03:46] RECOVERY - newcascadia.net - reverse DNS on sslhost is OK: SSL OK - newcascadia.net reverse DNS resolves to cp5.wikitide.net - NS RECORDS OK [08:14:20] [02WikiTideOrg/ssl] 07WikiTideSSL pushed 031 commit to 03master [+1/-0/±1] 13https://github.com/WikiTideOrg/ssl/compare/e7a490145f87...1491bd65da1c [08:14:22] [02WikiTideOrg/ssl] 07WikiTideSSL 031491bd6 - Bot: Adding SSL cert for wiki.myehs.eu Certificate committed by reception [08:32:41] PROBLEM - mw22 Puppet on mw22 is UNKNOWN: NRPE: Unable to read output [08:37:11] PROBLEM - newcascadia.net - reverse DNS on sslhost is WARNING: LifetimeTimeout: The resolution lifetime expired after 5.404 seconds: Server 1.1.1.1 UDP port 53 answered The DNS operation timed out.; Server 1.1.1.1 UDP port 53 answered The DNS operation timed out.; Server 1.1.1.1 UDP port 53 answered The DNS operation timed out. [09:35:58] [02WikiTideOrg/mw-config] 07Universal-Omega pushed 031 commit to 03main [+0/-0/±1] 13https://github.com/WikiTideOrg/mw-config/compare/a32b22c39503...a9e9deb06f2a [09:35:59] [02WikiTideOrg/mw-config] 07Universal-Omega 03a9e9deb - Disable file cache on metawiki [09:36:16] !log [universalomega@jobrunner21] starting deploy of {'pull': 'config', 'config': True, 'versions': ['1.40']} to [mw21, mw22, jobrunner21] [09:36:18] Logged the message at https://meta.wikitide.org/wiki/Tech:Server_admin_log [09:36:19] !log [universalomega@jobrunner21] finished deploy of {'pull': 'config', 'config': True, 'versions': ['1.40']} to [mw21, mw22, jobrunner21] - SUCCESS in 3s [09:36:21] Logged the message at https://meta.wikitide.org/wiki/Tech:Server_admin_log [09:36:51] WikiTideOrg/mw-config - Universal-Omega the build passed. [10:34:31] RECOVERY - newcascadia.net - reverse DNS on sslhost is OK: SSL OK - newcascadia.net reverse DNS resolves to cp2.wikitide.net - NS RECORDS OK [12:08:59] PROBLEM - newcascadia.net - reverse DNS on sslhost is WARNING: LifetimeTimeout: The resolution lifetime expired after 5.404 seconds: Server 1.1.1.1 UDP port 53 answered The DNS operation timed out.; Server 1.1.1.1 UDP port 53 answered The DNS operation timed out.; Server 1.1.1.1 UDP port 53 answered The DNS operation timed out. [13:07:40] RECOVERY - newcascadia.net - reverse DNS on sslhost is OK: SSL OK - newcascadia.net reverse DNS resolves to cp5.wikitide.net - NS RECORDS OK [15:43:05] PROBLEM - newcascadia.net - reverse DNS on sslhost is WARNING: LifetimeTimeout: The resolution lifetime expired after 5.404 seconds: Server 1.1.1.1 UDP port 53 answered The DNS operation timed out.; Server 1.1.1.1 UDP port 53 answered The DNS operation timed out.; Server 1.1.1.1 UDP port 53 answered The DNS operation timed out. [16:00:17] !log [agent@jobrunner21] sudo -u www-data php /srv/mediawiki/1.40/maintenance/run.php /srv/mediawiki/1.40/extensions/SemanticMediaWiki/maintenance/setupStore.php --wiki=rushpediawiki (END - exit=0) [16:00:19] Logged the message at https://meta.wikitide.org/wiki/Tech:Server_admin_log [16:00:25] !log [agent@jobrunner21] starting deploy of {'files': '../mediawiki/1.40/extensions/SemanticMediaWiki/.smw.json', 'versions': ['1.40']} to [mw21, mw22, jobrunner21] [16:00:27] !log [agent@jobrunner21] finished deploy of {'files': '../mediawiki/1.40/extensions/SemanticMediaWiki/.smw.json', 'versions': ['1.40']} to [mw21, mw22, jobrunner21] - SUCCESS in 1s [16:00:27] Logged the message at https://meta.wikitide.org/wiki/Tech:Server_admin_log [16:00:29] Logged the message at https://meta.wikitide.org/wiki/Tech:Server_admin_log [16:22:23] !log [agent@jobrunner21] sudo -u www-data php /srv/mediawiki/1.40/maintenance/run.php /srv/mediawiki/1.40/maintenance/runJobs.php --wiki=rosettacodewiki --procs 999 (START) [16:23:42] !log [agent@jobrunner21] sudo -u www-data php /srv/mediawiki/1.40/maintenance/run.php /srv/mediawiki/1.40/maintenance/runJobs.php --wiki=rosettacodewiki --procs 999 (END - exit=0) [16:23:44] Logged the message at https://meta.wikitide.org/wiki/Tech:Server_admin_log [16:25:31] PROBLEM - puppet21 Current Load on puppet21 is WARNING: LOAD WARNING - total load average: 6.47, 6.92, 6.01 [16:27:31] RECOVERY - puppet21 Current Load on puppet21 is OK: LOAD OK - total load average: 4.58, 6.07, 5.81 [18:51:31] PROBLEM - puppet21 Current Load on puppet21 is WARNING: LOAD WARNING - total load average: 6.64, 6.91, 6.15 [18:53:31] PROBLEM - puppet21 Current Load on puppet21 is CRITICAL: LOAD CRITICAL - total load average: 8.77, 7.72, 6.55 [18:55:31] PROBLEM - puppet21 Current Load on puppet21 is WARNING: LOAD WARNING - total load average: 6.96, 7.59, 6.66 [18:59:31] RECOVERY - puppet21 Current Load on puppet21 is OK: LOAD OK - total load average: 4.82, 6.25, 6.35 [20:07:25] RECOVERY - newcascadia.net - reverse DNS on sslhost is OK: SSL OK - newcascadia.net reverse DNS resolves to cp2.wikitide.net - NS RECORDS OK [20:19:31] PROBLEM - puppet21 Current Load on puppet21 is CRITICAL: LOAD CRITICAL - total load average: 8.43, 6.96, 5.68 [20:21:31] PROBLEM - puppet21 Current Load on puppet21 is WARNING: LOAD WARNING - total load average: 7.43, 6.97, 5.83 [20:25:31] RECOVERY - puppet21 Current Load on puppet21 is OK: LOAD OK - total load average: 6.11, 6.74, 6.01 [20:31:31] PROBLEM - puppet21 Current Load on puppet21 is CRITICAL: LOAD CRITICAL - total load average: 8.63, 7.39, 6.46 [20:35:31] PROBLEM - puppet21 Current Load on puppet21 is WARNING: LOAD WARNING - total load average: 7.32, 7.51, 6.73 [20:39:31] PROBLEM - puppet21 Current Load on puppet21 is CRITICAL: LOAD CRITICAL - total load average: 8.20, 7.54, 6.90 [20:45:31] PROBLEM - puppet21 Current Load on puppet21 is WARNING: LOAD WARNING - total load average: 7.17, 7.83, 7.29 [20:47:31] PROBLEM - puppet21 Current Load on puppet21 is CRITICAL: LOAD CRITICAL - total load average: 8.47, 7.95, 7.39 [20:51:31] PROBLEM - puppet21 Current Load on puppet21 is WARNING: LOAD WARNING - total load average: 6.83, 7.63, 7.42 [21:08:20] PROBLEM - newcascadia.net - reverse DNS on sslhost is WARNING: LifetimeTimeout: The resolution lifetime expired after 5.404 seconds: Server 1.1.1.1 UDP port 53 answered The DNS operation timed out.; Server 1.1.1.1 UDP port 53 answered The DNS operation timed out.; Server 1.1.1.1 UDP port 53 answered The DNS operation timed out. [21:10:17] [02WikiTideOrg/dns] 07AgentIsai pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/WikiTideOrg/dns/compare/23013e42b823...06132ea24696 [21:10:20] [02WikiTideOrg/dns] 07AgentIsai 0306132ea - Add swift-lb2 [21:15:31] PROBLEM - puppet21 Current Load on puppet21 is CRITICAL: LOAD CRITICAL - total load average: 8.52, 7.42, 7.14 [21:21:31] PROBLEM - puppet21 Current Load on puppet21 is WARNING: LOAD WARNING - total load average: 7.62, 7.83, 7.47 [21:39:31] PROBLEM - puppet21 Current Load on puppet21 is CRITICAL: LOAD CRITICAL - total load average: 8.75, 7.33, 7.10 [21:41:31] PROBLEM - puppet21 Current Load on puppet21 is WARNING: LOAD WARNING - total load average: 6.83, 7.25, 7.11 [21:53:31] RECOVERY - puppet21 Current Load on puppet21 is OK: LOAD OK - total load average: 6.11, 6.43, 6.74 [22:02:21] PROBLEM - puppet21 Current Load on puppet21 is WARNING: LOAD WARNING - total load average: 7.10, 7.27, 7.02 [22:17:38] PROBLEM - puppet21 Current Load on puppet21 is CRITICAL: LOAD CRITICAL - total load average: 10.10, 7.94, 7.37 [22:27:31] PROBLEM - puppet21 Current Load on puppet21 is WARNING: LOAD WARNING - total load average: 6.06, 7.73, 7.75 [22:53:31] RECOVERY - puppet21 Current Load on puppet21 is OK: LOAD OK - total load average: 4.87, 5.84, 6.56