[00:01:18] PROBLEM - cp1 HTTP 4xx/5xx ERROR Rate on cp1 is UNKNOWN: UNKNOWN - NGINX Error Rate is UNKNOWN [00:03:18] PROBLEM - cp1 HTTP 4xx/5xx ERROR Rate on cp1 is CRITICAL: CRITICAL - NGINX Error Rate is 100% [04:11:27] [02WikiTideOrg/puppet] 07AgentIsai pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/WikiTideOrg/puppet/compare/73b37eda3287...0486342bcb30 [04:11:28] [02WikiTideOrg/puppet] 07AgentIsai 030486342 - Redirect wikitide.org to miraheze.org Sorry wikitide.org! [12:19:40] RECOVERY - puppet1 Puppet on puppet1 is OK: OK: Puppet is currently enabled, last run 17 seconds ago with 0 failures [12:21:13] RECOVERY - matomo1 Puppet on matomo1 is OK: OK: Puppet is currently enabled, last run 50 seconds ago with 0 failures [12:22:14] RECOVERY - cp2 Puppet on cp2 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [12:23:41] RECOVERY - cp5 Puppet on cp5 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [12:24:45] RECOVERY - mw1 Puppet on mw1 is OK: OK: Puppet is currently enabled, last run 54 seconds ago with 0 failures [12:25:52] RECOVERY - db1 Puppet on db1 is OK: OK: Puppet is currently enabled, last run 34 seconds ago with 0 failures [12:26:08] RECOVERY - cp1 Puppet on cp1 is OK: OK: Puppet is currently enabled, last run 30 seconds ago with 0 failures [12:26:27] RECOVERY - bast1 Puppet on bast1 is OK: OK: Puppet is currently enabled, last run 2 seconds ago with 0 failures [12:26:28] RECOVERY - mw2 Puppet on mw2 is OK: OK: Puppet is currently enabled, last run 53 seconds ago with 0 failures [12:29:54] RECOVERY - swiftproxy1 Puppet on swiftproxy1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [12:30:15] PROBLEM - mw2 MediaWiki Rendering on mw2 is CRITICAL: connect to address 10.0.0.102 and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [12:31:28] !log [@test1] starting deploy of {'config': True, 'versions': ['']} to [test1] [12:31:29] !log [@test1] finished deploy of {'config': True, 'versions': ['']} to [test1] - SUCCESS in 0s [12:32:15] PROBLEM - mw2 MediaWiki Rendering on mw2 is WARNING: HTTP WARNING: HTTP/1.1 404 Not Found - 8191 bytes in 0.149 second response time [12:33:07] RECOVERY - swiftac1 Puppet on swiftac1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [12:35:58] RECOVERY - services1 Puppet on services1 is OK: OK: Puppet is currently enabled, last run 45 seconds ago with 0 failures [12:35:59] RECOVERY - graylog1 Puppet on graylog1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [12:36:45] RECOVERY - mem1 Puppet on mem1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [12:40:23] RECOVERY - cp4 Puppet on cp4 is OK: OK: Puppet is currently enabled, last run 46 seconds ago with 0 failures [12:41:57] RECOVERY - phorge1 Puppet on phorge1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [12:42:03] RECOVERY - prometheus1 Puppet on prometheus1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [12:42:29] RECOVERY - mon1 Puppet on mon1 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [12:42:43] RECOVERY - ldap1 Puppet on ldap1 is OK: OK: Puppet is currently enabled, last run 23 seconds ago with 0 failures [12:44:28] PROBLEM - mw2 Puppet on mw2 is WARNING: WARNING: Puppet is currently disabled, message: reason not specified, last run 12 minutes ago with 0 failures [12:44:31] RECOVERY - swiftobject1 Puppet on swiftobject1 is OK: OK: Puppet is currently enabled, last run 23 seconds ago with 0 failures [12:47:13] RECOVERY - jobchron1 Puppet on jobchron1 is OK: OK: Puppet is currently enabled, last run 12 seconds ago with 0 failures [12:47:52] !log [@jobrunner1] starting deploy of {'config': True, 'versions': ['']} to [mw1, mw2, jobrunner1] [12:47:55] !log [@jobrunner1] finished deploy of {'config': True, 'versions': ['']} to [mw1, mw2, jobrunner1] - SUCCESS in 3s [12:48:44] RECOVERY - cp6 Puppet on cp6 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [12:49:51] RECOVERY - jobrunner1 Puppet on jobrunner1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [12:50:30] RECOVERY - bots1 Puppet on bots1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [12:52:42] [02WikiTideOrg/puppet] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/WikiTideOrg/puppet/compare/0486342bcb30...c93b964f86ec [12:52:45] [02WikiTideOrg/puppet] 07Universal-Omega 03c93b964 - Fix redirecting wikitide.org to miraheze.org [12:54:28] RECOVERY - mw2 Puppet on mw2 is OK: OK: Puppet is currently enabled, last run 8 seconds ago with 0 failures [12:56:03] [02landing] 07Universal-Omega closed pull request 03#2: make landing page translatable per T71 - 13https://github.com/WikiTideOrg/landing/pull/2 [12:56:04] [02landing] 07Universal-Omega commented on pull request 03#2: make landing page translatable per T71 - 13https://github.com/WikiTideOrg/landing/pull/2#issuecomment-1921267323 [12:56:07] [02WikiTideOrg/landing] 07Universal-Omega deleted branch 03Reception123-patch-1 [12:56:10] [02landing] 07Universal-Omega deleted branch 03Reception123-patch-1 - 13https://github.com/WikiTideOrg/landing [12:58:18] [02WikiTideOrg/landing] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/WikiTideOrg/landing/compare/d367bd55ab1e...903380df812a [12:58:19] [02WikiTideOrg/landing] 07Universal-Omega 03903380d - ARCHIVED [13:00:48] [02WikiTideOrg/puppet] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/WikiTideOrg/puppet/compare/c93b964f86ec...4b5d7516f131 [13:00:51] [02WikiTideOrg/puppet] 07Universal-Omega 034b5d751 - Remove landing [13:03:14] [02WikiTideOrg/puppet] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/WikiTideOrg/puppet/compare/4b5d7516f131...3e562b8ab646 [13:03:17] [02WikiTideOrg/puppet] 07Universal-Omega 033e562b8 - Remove landing [13:03:54] [02WikiTideOrg/puppet] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/WikiTideOrg/puppet/compare/3e562b8ab646...1f36ce479069 [13:03:56] [02WikiTideOrg/puppet] 07Universal-Omega 031f36ce4 - Remove landing [13:04:37] WikiTideOrg/puppet - Universal-Omega the build passed. [13:20:16] [02mw-config] 07Universal-Omega closed pull request 03#26: Use mcrouter - 13https://github.com/WikiTideOrg/mw-config/pull/26 [13:20:19] [02WikiTideOrg/mw-config] 07Universal-Omega deleted branch 03mcrouter [13:20:20] [02mw-config] 07Universal-Omega deleted branch 03mcrouter - 13https://github.com/WikiTideOrg/mw-config [13:20:30] [02mw-config] 07Universal-Omega closed pull request 03#17: Add thumbor config - 13https://github.com/WikiTideOrg/mw-config/pull/17 [13:20:33] [02WikiTideOrg/mw-config] 07Universal-Omega deleted branch 03thumbor [13:20:35] [02mw-config] 07Universal-Omega deleted branch 03thumbor - 13https://github.com/WikiTideOrg/mw-config [13:20:49] [02mw-config] 07Universal-Omega closed pull request 03#30: Bump styfle/cancel-workflow-action from 0.12.0 to 0.12.1 - 13https://github.com/WikiTideOrg/mw-config/pull/30 [13:20:51] [02WikiTideOrg/mw-config] 07Universal-Omega pushed 031 commit to 03main [+0/-0/±1] 13https://github.com/WikiTideOrg/mw-config/compare/0c63e9e7a6bd...d15aa4512b83 [13:20:52] [02WikiTideOrg/mw-config] 07dependabot[bot] 03d15aa45 - Bump styfle/cancel-workflow-action from 0.12.0 to 0.12.1 (#30) Bumps [styfle/cancel-workflow-action](https://github.com/styfle/cancel-workflow-action) from 0.12.0 to 0.12.1. - [Release notes](https://github.com/styfle/cancel-workflow-action/releases) - [Commits](https://github.com/styfle/cancel-workflow-action/compare/0.12.0...0.12.1) --- updated-dependencies: - dependency-name: styfl [13:20:55] [02WikiTideOrg/mw-config] 07Universal-Omega deleted branch 03dependabot/github_actions/styfle/cancel-workflow-action-0.12.1 [13:20:57] [02mw-config] 07Universal-Omega deleted branch 03dependabot/github_actions/styfle/cancel-workflow-action-0.12.1 - 13https://github.com/WikiTideOrg/mw-config [13:21:02] [02mw-config] 07Universal-Omega closed pull request 03#31: Update mediawiki/mediawiki-codesniffer requirement from 42.0.0 to 43.0.0 - 13https://github.com/WikiTideOrg/mw-config/pull/31 [13:21:04] [02mw-config] 07dependabot[bot] commented on pull request 03#31: Update mediawiki/mediawiki-codesniffer requirement from 42.0.0 to 43.0.0 - 13https://github.com/WikiTideOrg/mw-config/pull/31#issuecomment-1921311721 [13:21:05] [02WikiTideOrg/mw-config] 07Universal-Omega deleted branch 03dependabot/composer/mediawiki/mediawiki-codesniffer-43.0.0 [13:21:06] [02mw-config] 07Universal-Omega deleted branch 03dependabot/composer/mediawiki/mediawiki-codesniffer-43.0.0 - 13https://github.com/WikiTideOrg/mw-config [13:21:46] WikiTideOrg/mw-config - Universal-Omega the build passed. [13:30:52] !log [@test1] starting deploy of {'config': True, 'versions': ['']} to [test1] [13:30:53] !log [@test1] finished deploy of {'config': True, 'versions': ['']} to [test1] - SUCCESS in 0s [13:48:22] !log [@jobrunner1] starting deploy of {'config': True, 'versions': ['']} to [mw1, mw2, jobrunner1] [13:48:25] !log [@jobrunner1] finished deploy of {'config': True, 'versions': ['']} to [mw1, mw2, jobrunner1] - SUCCESS in 3s [17:40:39] [02WikiTideOrg/ssl] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/WikiTideOrg/ssl/compare/195584db5f35...05c052a8878a [17:40:42] [02WikiTideOrg/ssl] 07Universal-Omega 0305c052a - Remove wwwwikitideredirect [17:51:41] PROBLEM - puppet1 Puppet on puppet1 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_ssl] [18:19:31] RECOVERY - puppet1 Puppet on puppet1 is OK: OK: Puppet is currently enabled, last run 59 seconds ago with 0 failures [18:21:06] RECOVERY - realitylongterms.studio - LetsEncrypt on sslhost is OK: OK - Certificate 'realitylongterms.studio' will expire on Fri 26 Apr 2024 11:11:13 PM GMT +0000. [22:53:35] PROBLEM - jobrunner1 MediaWiki Rendering on jobrunner1 is CRITICAL: HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - 933 bytes in 0.093 second response time [22:55:36] PROBLEM - jobrunner1 MediaWiki Rendering on jobrunner1 is WARNING: HTTP WARNING: HTTP/1.1 404 Not Found - 8191 bytes in 0.178 second response time