[01:02:22] PROBLEM - ping6 on mattermost1 is CRITICAL: PING CRITICAL - Packet loss = 100% [01:04:23] RECOVERY - ping6 on mattermost1 is OK: PING OK - Packet loss = 0%, RTA = 31.68 ms [02:02:19] !log [@mwtask181] starting deploy of {'config': True} to all [02:03:37] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [02:04:45] PROBLEM - ping6 on mattermost1 is CRITICAL: PING CRITICAL - Packet loss = 80%, RTA = 63.15 ms [02:06:32] PROBLEM - mwtask181 Puppet on mwtask181 is CRITICAL: CRITICAL: Puppet has 3 failures. Last run 3 minutes ago with 3 failures. Failed resources (up to 3 shown): Exec[MediaWiki Config Sync],Exec[git_pull_landing],Exec[git_pull_MediaWiki-REL1_42 MirahezeMagic] [02:06:47] RECOVERY - ping6 on mattermost1 is OK: PING OK - Packet loss = 0%, RTA = 65.02 ms [02:33:27] PROBLEM - ping6 on mattermost1 is CRITICAL: PING CRITICAL - Packet loss = 80%, RTA = 31.94 ms [02:34:32] PROBLEM - mwtask181 Puppet on mwtask181 is WARNING: WARNING: Puppet is currently disabled, message: Testing no http on rpc --Agent, last run 1 minute ago with 0 failures [02:37:37] RECOVERY - ping6 on mattermost1 is OK: PING OK - Packet loss = 0%, RTA = 31.69 ms [02:45:23] [02puppet] 07AgentIsai pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/24ca425352a3...7aa09ee3b65a [02:45:26] [02puppet] 07AgentIsai 037aa09ee - Temporarily disable SSL on jobrunner rpc endpoints [02:48:32] RECOVERY - mwtask181 Puppet on mwtask181 is OK: OK: Puppet is currently enabled, last run 13 seconds ago with 0 failures [02:58:11] [02puppet] 07AgentIsai pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/7aa09ee3b65a...e18fc52d5803 [02:58:14] [02puppet] 07AgentIsai 03e18fc52 - kafka: increase partitions to 12 [04:13:44] PROBLEM - ping6 on mattermost1 is CRITICAL: PING CRITICAL - Packet loss = 70%, RTA = 31.80 ms [04:15:46] RECOVERY - ping6 on mattermost1 is OK: PING OK - Packet loss = 0%, RTA = 31.67 ms [04:35:55] PROBLEM - mw154 Puppet on mw154 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [04:36:32] PROBLEM - mwtask181 Puppet on mwtask181 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): File[/usr/local/bin/iaupload] [05:01:06] PROBLEM - db161 Puppet on db161 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [05:01:23] PROBLEM - swiftobject181 Puppet on swiftobject181 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): File[/etc/logrotate.d/puppet] [05:02:32] RECOVERY - mwtask181 Puppet on mwtask181 is OK: OK: Puppet is currently enabled, last run 3 seconds ago with 0 failures [05:03:55] RECOVERY - mw154 Puppet on mw154 is OK: OK: Puppet is currently enabled, last run 50 seconds ago with 0 failures [05:04:04] PROBLEM - db171 Puppet on db171 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [05:08:17] PROBLEM - ping6 on mattermost1 is CRITICAL: PING CRITICAL - Packet loss = 80%, RTA = 32.08 ms [05:10:19] RECOVERY - ping6 on mattermost1 is OK: PING OK - Packet loss = 0%, RTA = 31.70 ms [05:27:07] RECOVERY - db161 Puppet on db161 is OK: OK: Puppet is currently enabled, last run 29 seconds ago with 0 failures [05:27:22] RECOVERY - swiftobject181 Puppet on swiftobject181 is OK: OK: Puppet is currently enabled, last run 30 seconds ago with 0 failures [05:28:19] RECOVERY - db171 Puppet on db171 is OK: OK: Puppet is currently enabled, last run 58 seconds ago with 0 failures [05:41:35] [Grafana] FIRING: A MediaWiki pool is sick according to CloudFlare [06:00:20] Why is that missing a tag [06:02:44] Also liar [06:04:18] PROBLEM - matomo151 Puppet on matomo151 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [06:21:35] [Grafana] RESOLVED: DatasourceNoData [06:26:27] RECOVERY - matomo151 Puppet on matomo151 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [06:40:54] PROBLEM - test151 PowerDNS Recursor on test151 is CRITICAL: Domain 'wikitide.net' was not found by the server [06:42:34] PROBLEM - os162 Puppet on os162 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [06:42:54] RECOVERY - test151 PowerDNS Recursor on test151 is OK: DNS OK: 0.030 seconds response time. wikitide.net returns 2602:294:0:b13::110,2602:294:0:b23::112,38.46.223.205,38.46.223.206 [07:10:34] RECOVERY - os162 Puppet on os162 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [08:31:02] PROBLEM - ping6 on mattermost1 is CRITICAL: PING CRITICAL - Packet loss = 100% [08:33:04] RECOVERY - ping6 on mattermost1 is OK: PING OK - Packet loss = 0%, RTA = 31.69 ms [11:32:04] PROBLEM - ping6 on mattermost1 is CRITICAL: PING CRITICAL - Packet loss = 100% [11:34:06] RECOVERY - ping6 on mattermost1 is OK: PING OK - Packet loss = 0%, RTA = 31.84 ms [12:19:03] PROBLEM - ping6 on ns2 is CRITICAL: PING CRITICAL - Packet loss = 70%, RTA = 140.49 ms [12:29:12] RECOVERY - ping6 on ns2 is OK: PING OK - Packet loss = 0%, RTA = 140.46 ms [12:40:47] PROBLEM - mem151 PowerDNS Recursor on mem151 is CRITICAL: CRITICAL - Plugin timed out while executing system call [12:41:51] PROBLEM - mem151 Current Load on mem151 is CRITICAL: LOAD CRITICAL - total load average: 5.96, 3.74, 1.82 [12:42:43] RECOVERY - mem151 PowerDNS Recursor on mem151 is OK: DNS OK: 1.796 second response time. wikitide.net returns 2602:294:0:b13::110,2602:294:0:b23::112,38.46.223.205,38.46.223.206 [12:43:50] PROBLEM - mem151 Current Load on mem151 is WARNING: LOAD WARNING - total load average: 2.53, 3.56, 2.01 [12:45:50] RECOVERY - mem151 Current Load on mem151 is OK: LOAD OK - total load average: 0.47, 2.44, 1.79 [12:55:29] PROBLEM - ping6 on ns2 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 140.44 ms [13:00:47] PROBLEM - mem151 PowerDNS Recursor on mem151 is CRITICAL: CRITICAL - Plugin timed out while executing system call [13:01:50] PROBLEM - mem151 Current Load on mem151 is CRITICAL: LOAD CRITICAL - total load average: 7.76, 4.56, 2.53 [13:03:42] PROBLEM - mem161 Current Load on mem161 is CRITICAL: LOAD CRITICAL - total load average: 6.56, 4.26, 1.94 [13:04:08] PROBLEM - mem161 Puppet on mem161 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [13:04:12] PROBLEM - mem151 Puppet on mem151 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [13:04:17] PROBLEM - mem151 APT on mem151 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [13:04:35] PROBLEM - mem161 APT on mem161 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [13:06:09] RECOVERY - mem161 Puppet on mem161 is OK: OK: Puppet is currently enabled, last run 7 minutes ago with 0 failures [13:06:34] RECOVERY - mem161 APT on mem161 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [13:06:49] RECOVERY - mem151 PowerDNS Recursor on mem151 is OK: DNS OK: 0.462 seconds response time. wikitide.net returns 2602:294:0:b13::110,2602:294:0:b23::112,38.46.223.205,38.46.223.206 [13:09:13] RECOVERY - mem151 Puppet on mem151 is OK: OK: Puppet is currently enabled, last run 25 seconds ago with 0 failures [13:09:16] RECOVERY - mem151 APT on mem151 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [13:09:42] RECOVERY - mem161 Current Load on mem161 is OK: LOAD OK - total load average: 0.55, 2.91, 2.29 [13:09:44] RECOVERY - ping6 on ns2 is OK: PING OK - Packet loss = 0%, RTA = 140.50 ms [13:11:50] PROBLEM - mem151 Current Load on mem151 is WARNING: LOAD WARNING - total load average: 0.63, 3.67, 3.52 [13:13:42] PROBLEM - mem161 Current Load on mem161 is CRITICAL: LOAD CRITICAL - total load average: 7.30, 4.61, 3.05 [13:13:50] RECOVERY - mem151 Current Load on mem151 is OK: LOAD OK - total load average: 0.40, 2.57, 3.13 [13:17:42] PROBLEM - mem161 Current Load on mem161 is WARNING: LOAD WARNING - total load average: 0.88, 3.49, 3.04 [13:18:08] PROBLEM - mem161 memcached on mem161 is CRITICAL: connect to address 10.0.16.131 and port 11211: Connection refused [13:19:42] RECOVERY - mem161 Current Load on mem161 is OK: LOAD OK - total load average: 0.19, 2.35, 2.67 [13:28:08] RECOVERY - mem161 memcached on mem161 is OK: TCP OK - 0.000 second response time on 10.0.16.131 port 11211 [13:54:09] PROBLEM - ping6 on ns2 is CRITICAL: PING CRITICAL - Packet loss = 70%, RTA = 140.45 ms [13:58:18] RECOVERY - ping6 on ns2 is OK: PING OK - Packet loss = 0%, RTA = 140.40 ms [14:39:05] PROBLEM - ping6 on ns2 is CRITICAL: PING CRITICAL - Packet loss = 50%, RTA = 140.41 ms [14:45:14] RECOVERY - ping6 on ns2 is OK: PING OK - Packet loss = 0%, RTA = 140.45 ms [14:49:33] PROBLEM - ping6 on ns2 is CRITICAL: PING CRITICAL - Packet loss = 70%, RTA = 140.43 ms [14:51:33] RECOVERY - ping6 on ns2 is OK: PING OK - Packet loss = 0%, RTA = 140.95 ms [15:08:29] !log [paladox@mwtask181] starting deploy of {'world': True, 'l10n': True, 'versions': '1.42'} to all [15:08:34] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:09:35] !log [paladox@mwtask181] starting deploy of {'world': True, 'l10n': True, 'versions': '1.42'} to all [15:09:39] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:10:24] !log [paladox@mwtask181] starting deploy of {'world': True, 'l10n': True, 'versions': '1.42'} to all [15:10:30] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:11:25] !log [paladox@mwtask181] starting deploy of {'world': True, 'l10n': True, 'versions': '1.42'} to all [15:11:30] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:12:12] !log [paladox@mwtask181] starting deploy of {'world': True, 'l10n': True, 'versions': '1.42'} to all [15:12:16] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:17:07] !log [paladox@test151] starting deploy of {'world': True, 'l10n': True, 'versions': '1.43'} to test151 [15:17:12] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:17:12] !log [paladox@mwtask181] DEPLOY ABORTED: Canary check failed for publictestwiki.com@mw151.wikitide.net [15:17:17] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:17:47] !log [paladox@mwtask181] starting deploy of {'world': True, 'l10n': True, 'versions': '1.42'} to all [15:17:51] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:19:28] PROBLEM - test151 MediaWiki Rendering on test151 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 8191 bytes in 0.229 second response time [15:21:28] RECOVERY - test151 MediaWiki Rendering on test151 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 0.354 second response time [15:21:40] !log [paladox@mwtask181] DEPLOY ABORTED: Canary check failed for publictestwiki.com@mwtask151.wikitide.net [15:21:43] !log [paladox@test151] finished deploy of {'world': True, 'l10n': True, 'versions': '1.43'} to test151 - SUCCESS in 276s [15:22:17] PROBLEM - mw153 MediaWiki Rendering on mw153 is CRITICAL: HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - 3900 bytes in 0.091 second response time [15:22:56] PROBLEM - mw164 MediaWiki Rendering on mw164 is CRITICAL: HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - 3900 bytes in 0.059 second response time [15:23:29] !log [paladox@mwtask181] starting deploy of {'world': True, 'l10n': True, 'force': True, 'versions': '1.42'} to all [15:23:32] PROBLEM - mw173 MediaWiki Rendering on mw173 is CRITICAL: HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - 3900 bytes in 0.057 second response time [15:23:34] PROBLEM - mw152 MediaWiki Rendering on mw152 is CRITICAL: HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - 3900 bytes in 0.057 second response time [15:23:48] PROBLEM - mwtask151 MediaWiki Rendering on mwtask151 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 8191 bytes in 0.329 second response time [15:23:53] PROBLEM - mw183 MediaWiki Rendering on mw183 is CRITICAL: HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - 3900 bytes in 0.059 second response time [15:23:53] PROBLEM - mw161 MediaWiki Rendering on mw161 is CRITICAL: HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - 3900 bytes in 0.062 second response time [15:23:55] !log [paladox@mwtask181] DEPLOY ABORTED: Non-Zero Exit Code in prep, see output. [15:23:56] PROBLEM - mw174 MediaWiki Rendering on mw174 is CRITICAL: HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - 3900 bytes in 0.055 second response time [15:23:56] PROBLEM - mw162 MediaWiki Rendering on mw162 is CRITICAL: HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - 3900 bytes in 0.074 second response time [15:24:08] PROBLEM - mw171 MediaWiki Rendering on mw171 is CRITICAL: HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - 3900 bytes in 0.058 second response time [15:24:23] PROBLEM - mw163 MediaWiki Rendering on mw163 is CRITICAL: HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - 3900 bytes in 0.061 second response time [15:24:25] !log [paladox@mwtask181] starting deploy of {'world': True, 'l10n': True, 'force': True, 'versions': '1.42'} to all [15:25:07] PROBLEM - mw182 MediaWiki Rendering on mw182 is CRITICAL: HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - 3900 bytes in 0.073 second response time [15:25:09] PROBLEM - mw181 MediaWiki Rendering on mw181 is CRITICAL: HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - 3900 bytes in 0.060 second response time [15:25:31] PROBLEM - mw184 MediaWiki Rendering on mw184 is CRITICAL: HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - 3900 bytes in 0.071 second response time [15:25:35] RECOVERY - mw152 MediaWiki Rendering on mw152 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 0.250 second response time [15:30:49] PROBLEM - mwtask161 MediaWiki Rendering on mwtask161 is CRITICAL: HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - 3904 bytes in 0.076 second response time [15:31:58] Is there any server issue at the moment? I can't reach any miraheze-wiki. :( [15:32:18] Yes [15:32:25] !log [paladox@mwtask181] starting deploy of {'world': True, 'l10n': True, 'force': True, 'versions': '1.42'} to all [15:36:32] PROBLEM - mwtask181 Puppet on mwtask181 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 4 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_clone_MediaWiki-REL1_42 vendor] [15:39:23] PROBLEM - mwtask181 MediaWiki Rendering on mwtask181 is CRITICAL: HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - 3904 bytes in 0.089 second response time [15:41:08] PROBLEM - cp37 HTTP 4xx/5xx ERROR Rate on cp37 is WARNING: WARNING - NGINX Error Rate is 44% [15:43:24] PROBLEM - mw151 MediaWiki Rendering on mw151 is CRITICAL: HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - 3900 bytes in 0.064 second response time [15:44:08] PROBLEM - mw172 MediaWiki Rendering on mw172 is CRITICAL: HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - 3900 bytes in 0.060 second response time [15:44:25] PROBLEM - cp36 HTTP 4xx/5xx ERROR Rate on cp36 is WARNING: WARNING - NGINX Error Rate is 49% [15:44:35] PROBLEM - mwtask171 MediaWiki Rendering on mwtask171 is CRITICAL: HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - 3904 bytes in 0.059 second response time [15:45:48] RECOVERY - mwtask151 MediaWiki Rendering on mwtask151 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 0.512 second response time [15:48:15] !log [paladox@mwtask181] starting deploy of {'world': True, 'l10n': True, 'versions': '1.42'} to all [15:48:16] !log [paladox@mwtask181] DEPLOY ABORTED: Canary check failed for publictestwiki.com@localhost [15:48:31] !log [paladox@mwtask181] starting deploy of {'world': True, 'l10n': True, 'versions': '1.42'} to all [15:48:32] !log [paladox@mwtask181] DEPLOY ABORTED: Canary check failed for publictestwiki.com@localhost [15:49:29] !log [paladox@mwtask181] starting deploy of {'world': True, 'l10n': True, 'force': True, 'versions': '1.42'} to mwtask151 [15:49:39] !log [paladox@mwtask181] finished deploy of {'world': True, 'l10n': True, 'force': True, 'versions': '1.42'} to mwtask151 - SUCCESS in 10s [15:50:06] !log [paladox@mwtask181] starting deploy of {'world': True, 'l10n': True, 'force': True, 'versions': '1.42'} to mwtask151 [15:50:10] !log [paladox@mwtask181] finished deploy of {'world': True, 'l10n': True, 'force': True, 'versions': '1.42'} to mwtask151 - SUCCESS in 3s [15:52:56] !log [paladox@mwtask181] starting deploy of {'world': True, 'versions': '1.42'} to mwtask151 [15:52:59] !log [paladox@mwtask181] DEPLOY ABORTED: Canary check failed for publictestwiki.com@mwtask151.wikitide.net [15:57:08] RECOVERY - cp37 HTTP 4xx/5xx ERROR Rate on cp37 is OK: OK - NGINX Error Rate is 24% [16:00:46] !log [@mwtask181] starting deploy of {'folders': '1.42/extensions/MirahezeMagic'} to all [16:00:47] !log [@mwtask181] DEPLOY ABORTED: Canary check failed for publictestwiki.com@localhost [16:01:08] PROBLEM - cp37 HTTP 4xx/5xx ERROR Rate on cp37 is WARNING: WARNING - NGINX Error Rate is 43% [16:03:08] RECOVERY - cp37 HTTP 4xx/5xx ERROR Rate on cp37 is OK: OK - NGINX Error Rate is 33% [16:05:07] RECOVERY - mw182 MediaWiki Rendering on mw182 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 0.197 second response time [16:13:53] RECOVERY - mw183 MediaWiki Rendering on mw183 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 0.185 second response time [16:13:54] PROBLEM - cp37 HTTP 4xx/5xx ERROR Rate on cp37 is WARNING: WARNING - NGINX Error Rate is 46% [16:13:56] RECOVERY - mw174 MediaWiki Rendering on mw174 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 0.178 second response time [16:14:01] RECOVERY - cp36 HTTP 4xx/5xx ERROR Rate on cp36 is OK: OK - NGINX Error Rate is 31% [16:15:50] RECOVERY - cp37 HTTP 4xx/5xx ERROR Rate on cp37 is OK: OK - NGINX Error Rate is 30% [16:15:53] RECOVERY - mw161 MediaWiki Rendering on mw161 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 0.150 second response time [16:16:11] !log [paladox@mwtask181] starting deploy of {'upgrade_world': True, 'versions': '1.42', 'upgrade_extensions': 'all', 'upgrade_skins': 'all'} to mwtask151 [16:16:32] RECOVERY - mwtask181 Puppet on mwtask181 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [16:16:40] !log [paladox@mwtask181] finished deploy of {'upgrade_world': True, 'versions': '1.42', 'upgrade_extensions': 'all', 'upgrade_skins': 'all'} to mwtask151 - SUCCESS in 28s [16:17:14] !log [paladox@mwtask181] starting deploy of {'upgrade_world': True, 'l10n': True, 'versions': '1.42', 'upgrade_extensions': 'all', 'upgrade_skins': 'all'} to all [16:17:15] !log [paladox@mwtask181] DEPLOY ABORTED: Canary check failed for publictestwiki.com@localhost [16:17:24] !log [paladox@mwtask181] starting deploy of {'upgrade_world': True, 'l10n': True, 'versions': '1.42', 'upgrade_extensions': 'all', 'upgrade_skins': 'all'} to all [16:17:25] !log [paladox@mwtask181] DEPLOY ABORTED: Canary check failed for publictestwiki.com@localhost [16:17:27] !log [paladox@mwtask181] starting deploy of {'upgrade_world': True, 'l10n': True, 'force': True, 'versions': '1.42', 'upgrade_extensions': 'all', 'upgrade_skins': 'all'} to all [16:23:25] RECOVERY - mwtask181 MediaWiki Rendering on mwtask181 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 1.866 second response time [16:26:24] !log [agent@mwtask181] starting deploy of {'upgrade_vendor': True, 'versions': '1.42'} to all [16:26:43] !log [agent@mwtask181] DEPLOY ABORTED: Canary check failed for publictestwiki.com@mw151.wikitide.net [16:26:48] !log [agent@mwtask181] starting deploy of {'upgrade_vendor': True, 'force': True, 'versions': '1.42'} to all [16:27:24] RECOVERY - mw151 MediaWiki Rendering on mw151 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 0.176 second response time [16:27:53] !log [agent@mwtask181] finished deploy of {'upgrade_vendor': True, 'force': True, 'versions': '1.42'} to all - SUCCESS in 65s [16:28:17] RECOVERY - mw153 MediaWiki Rendering on mw153 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 0.197 second response time [16:29:30] RECOVERY - mw171 MediaWiki Rendering on mw171 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 1.392 second response time [16:29:30] RECOVERY - mw163 MediaWiki Rendering on mw163 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 0.180 second response time [16:30:18] RECOVERY - mw164 MediaWiki Rendering on mw164 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 0.167 second response time [16:30:20] RECOVERY - mw173 MediaWiki Rendering on mw173 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 0.224 second response time [16:30:32] RECOVERY - mw172 MediaWiki Rendering on mw172 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 0.162 second response time [16:30:35] PROBLEM - mw182 MediaWiki Rendering on mw182 is CRITICAL: HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - 3900 bytes in 0.070 second response time [16:32:24] RECOVERY - mw181 MediaWiki Rendering on mw181 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 0.225 second response time [16:32:24] RECOVERY - mw184 MediaWiki Rendering on mw184 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 0.227 second response time [16:32:26] RECOVERY - mwtask161 MediaWiki Rendering on mwtask161 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 0.926 second response time [16:32:30] RECOVERY - mw182 MediaWiki Rendering on mw182 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 0.191 second response time [16:32:32] RECOVERY - mwtask171 MediaWiki Rendering on mwtask171 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 1.020 second response time [16:34:22] RECOVERY - mw162 MediaWiki Rendering on mw162 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 0.165 second response time [16:38:39] !log [paladox@mwtask181] finished deploy of {'upgrade_world': True, 'l10n': True, 'force': True, 'versions': '1.42', 'upgrade_extensions': 'all', 'upgrade_skins': 'all'} to all - SUCCESS in 1272s [16:38:44] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:01:35] [Grafana] FIRING: A MediaWiki pool is sick according to CloudFlare [17:05:16] [02dns] 07MacFan4000 opened pull request 03#625: add 48plus.org zone - 13https://github.com/miraheze/dns/pull/625 [17:07:05] [02ssl] 07MacFan4000 pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/773eb3374bf2...31d77369cf44 [17:07:06] [02ssl] 07MacFan4000 0331d7736 - add mcwiki.abovelime.org [17:31:45] [02CreateWiki] 07Universal-Omega pushed 031 commit to 03MissingWikiError [+1/-0/±0] 13https://github.com/miraheze/CreateWiki/commit/3a97ee6ab913 [17:31:46] [02CreateWiki] 07Universal-Omega 033a97ee6 - Add MissingWikiError exception [17:31:49] [02CreateWiki] 07Universal-Omega created branch 03MissingWikiError - 13https://github.com/miraheze/CreateWiki [17:31:50] [02CreateWiki] 07Universal-Omega opened pull request 03#569: Add MissingWikiError exception - 13https://github.com/miraheze/CreateWiki/pull/569 [17:33:45] [02CreateWiki] 07github-actions[bot] pushed 031 commit to 03MissingWikiError [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/compare/3a97ee6ab913...1f24766cfccd [17:33:47] [02CreateWiki] 07github-actions 031f24766 - CI: lint code to MediaWiki standards [17:33:48] [02CreateWiki] 07github-actions[bot] synchronize pull request 03#569: Add MissingWikiError exception - 13https://github.com/miraheze/CreateWiki/pull/569 [17:36:24] miraheze/CreateWiki - Universal-Omega the build has errored. [17:37:30] [02CreateWiki] 07Universal-Omega pushed 031 commit to 03MissingWikiError [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/compare/1f24766cfccd...21dd3cf246d9 [17:37:33] [02CreateWiki] 07Universal-Omega 0321dd3cf - Use [17:37:36] [02CreateWiki] 07Universal-Omega synchronize pull request 03#569: Add MissingWikiError exception - 13https://github.com/miraheze/CreateWiki/pull/569 [17:41:31] [02CreateWiki] 07github-actions[bot] pushed 031 commit to 03MissingWikiError [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/compare/21dd3cf246d9...6be3080949e9 [17:41:34] [02CreateWiki] 07github-actions 036be3080 - CI: lint code to MediaWiki standards [17:41:35] [Grafana] RESOLVED: DatasourceNoData [17:41:36] [02CreateWiki] 07github-actions[bot] synchronize pull request 03#569: Add MissingWikiError exception - 13https://github.com/miraheze/CreateWiki/pull/569 [17:44:18] miraheze/CreateWiki - Universal-Omega the build has errored. [17:45:57] [02ErrorPages] 07MacFan4000 opened pull request 03#51: correct static doc links - 13https://github.com/miraheze/ErrorPages/pull/51 [17:46:46] miraheze/ErrorPages - MacFan4000 the build passed. [17:47:13] [02CreateWiki] 07Universal-Omega pushed 031 commit to 03MissingWikiError [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/compare/6be3080949e9...7e09ac118dce [17:47:16] [02CreateWiki] 07Universal-Omega 037e09ac1 - Add message [17:47:19] [02CreateWiki] 07Universal-Omega synchronize pull request 03#569: Add MissingWikiError exception - 13https://github.com/miraheze/CreateWiki/pull/569 [17:50:33] [02CreateWiki] 07Universal-Omega pushed 031 commit to 03MissingWikiError [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/compare/7e09ac118dce...62b8421375e8 [17:50:36] [02CreateWiki] 07Universal-Omega 0362b8421 - Add [17:50:38] [02CreateWiki] 07Universal-Omega synchronize pull request 03#569: Add MissingWikiError exception - 13https://github.com/miraheze/CreateWiki/pull/569 [17:55:02] miraheze/CreateWiki - Universal-Omega the build has errored. [18:00:16] [02ci-scripts] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ci-scripts/compare/126f47573d58...0734733e7be6 [18:00:17] [02ci-scripts] 07Universal-Omega 030734733 - Test temporarily forcing DiscussionTools to REL1_42 [18:00:37] [02puppet] 07MacFan4000 opened pull request 03#4002: mediawiki: nginx: allow passing of php-fpm error responses to nginx for handling via custom ErrorPages - 13https://github.com/miraheze/puppet/pull/4002 [18:05:03] ^ my first time ever doing anything with nginx config [18:06:36] [02ci-scripts] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ci-scripts/compare/0734733e7be6...cb114467c944 [18:06:38] [02ci-scripts] 07Universal-Omega 03cb11446 - Just skip DiscussionTools for now [18:06:43] miraheze/CreateWiki - Universal-Omega the build has errored. [18:15:15] [02ManageWiki] 07Universal-Omega created branch 03no-wm - 13https://github.com/miraheze/ManageWiki [18:15:18] [02ManageWiki] 07Universal-Omega pushed 031 commit to 03no-wm [+0/-0/±1] 13https://github.com/miraheze/ManageWiki/commit/b8340fa89320 [18:15:21] [02ManageWiki] 07Universal-Omega 03b8340fa - Remove use of WikiManager [18:15:22] [02ManageWiki] 07Universal-Omega opened pull request 03#490: Remove use of WikiManager - 13https://github.com/miraheze/ManageWiki/pull/490 [18:16:12] [02ManageWiki] 07Universal-Omega edited pull request 03#490: Remove use of WikiManager (T12716) - 13https://github.com/miraheze/ManageWiki/pull/490 [18:16:24] miraheze/CreateWiki - Universal-Omega the build passed. [18:18:07] miraheze/ManageWiki - Universal-Omega the build has errored. [18:24:58] [02CreateWiki] 07Universal-Omega synchronize pull request 03#569: Add MissingWikiError exception - 13https://github.com/miraheze/CreateWiki/pull/569 [18:24:59] [02CreateWiki] 07Universal-Omega pushed 031 commit to 03MissingWikiError [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/compare/62b8421375e8...1f19c0a83964 [18:25:01] [02CreateWiki] 07Universal-Omega 031f19c0a - Use RuntimeException if command line mode [18:26:42] [02CreateWiki] 07github-actions[bot] pushed 031 commit to 03MissingWikiError [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/compare/1f19c0a83964...72e8e80389c4 [18:26:43] [02CreateWiki] 07github-actions 0372e8e80 - CI: lint code to MediaWiki standards [18:26:46] [02CreateWiki] 07github-actions[bot] synchronize pull request 03#569: Add MissingWikiError exception - 13https://github.com/miraheze/CreateWiki/pull/569 [18:29:07] [02CreateWiki] 07Universal-Omega synchronize pull request 03#569: Add MissingWikiError exception - 13https://github.com/miraheze/CreateWiki/pull/569 [18:29:09] [02CreateWiki] 07Universal-Omega pushed 031 commit to 03MissingWikiError [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/compare/72e8e80389c4...0edf9dcaad2c [18:29:12] [02CreateWiki] 07Universal-Omega 030edf9dc - . [18:30:03] [02CreateWiki] 07Universal-Omega pushed 031 commit to 03MissingWikiError [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/compare/0edf9dcaad2c...b813122ff088 [18:30:05] [02CreateWiki] 07Universal-Omega 03b813122 - . [18:30:08] [02CreateWiki] 07Universal-Omega synchronize pull request 03#569: Add MissingWikiError exception - 13https://github.com/miraheze/CreateWiki/pull/569 [18:30:42] [02CreateWiki] 07Universal-Omega synchronize pull request 03#569: Add MissingWikiError exception - 13https://github.com/miraheze/CreateWiki/pull/569 [18:30:45] [02CreateWiki] 07Universal-Omega pushed 031 commit to 03MissingWikiError [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/compare/b813122ff088...e1545a9cacd4 [18:30:47] [02CreateWiki] 07Universal-Omega 03e1545a9 - Use ->inContentLanguage() [18:31:39] [02CreateWiki] 07Universal-Omega synchronize pull request 03#569: Add MissingWikiError exception - 13https://github.com/miraheze/CreateWiki/pull/569 [18:31:41] [02CreateWiki] 07Universal-Omega pushed 031 commit to 03MissingWikiError [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/compare/e1545a9cacd4...6f0b84123819 [18:31:43] [02CreateWiki] 07Universal-Omega 036f0b841 - Fix [18:41:11] miraheze/CreateWiki - Universal-Omega the build passed. [18:47:01] [02CreateWiki] 07Universal-Omega edited pull request 03#569: Add MissingWikiError exception - 13https://github.com/miraheze/CreateWiki/pull/569 [18:48:51] [02CreateWiki] 07Universal-Omega pushed 031 commit to 03master [+1/-0/±3] 13https://github.com/miraheze/CreateWiki/compare/a2aed0656b1c...13264769c7f3 [18:48:53] [02CreateWiki] 07Universal-Omega 031326476 - Add MissingWikiError exception (#569) [18:48:56] [02CreateWiki] 07Universal-Omega closed pull request 03#569: Add MissingWikiError exception - 13https://github.com/miraheze/CreateWiki/pull/569 [18:48:58] [02CreateWiki] 07Universal-Omega deleted branch 03MissingWikiError [18:49:01] [02CreateWiki] 07Universal-Omega deleted branch 03MissingWikiError - 13https://github.com/miraheze/CreateWiki [18:52:03] !log [universalomega@mwtask181] starting deploy of {'versions': '1.42', 'upgrade_extensions': 'CreateWiki'} to all [18:52:08] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:52:30] !log [universalomega@mwtask181] finished deploy of {'versions': '1.42', 'upgrade_extensions': 'CreateWiki'} to all - SUCCESS in 26s [18:52:34] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:52:48] !log [universalomega@mwtask181] starting deploy of {'l10n': True, 'versions': '1.42'} to all [18:52:52] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:54:21] [02ManageWiki] 07Universal-Omega pushed 031 commit to 03no-wm [+0/-0/±1] 13https://github.com/miraheze/ManageWiki/compare/b8340fa89320...156311e507f7 [18:54:24] [02ManageWiki] 07Universal-Omega 03156311e - Remove managewiki-missing [18:54:27] [02ManageWiki] 07Universal-Omega synchronize pull request 03#490: Remove use of WikiManager (T12716) - 13https://github.com/miraheze/ManageWiki/pull/490 [18:54:46] [02ManageWiki] 07Universal-Omega pushed 031 commit to 03no-wm [+0/-0/±1] 13https://github.com/miraheze/ManageWiki/compare/156311e507f7...615fd3c4a84d [18:54:49] [02ManageWiki] 07Universal-Omega 03615fd3c - Remove managewiki-missing [18:54:50] [02ManageWiki] 07Universal-Omega synchronize pull request 03#490: Remove use of WikiManager (T12716) - 13https://github.com/miraheze/ManageWiki/pull/490 [18:54:54] !log [paladox@test151] starting deploy of {'upgrade_world': True, 'l10n': True, 'versions': '1.43', 'upgrade_extensions': 'all', 'upgrade_skins': 'all'} to test151 [18:54:59] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:56:44] [02MirahezeMagic] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/MirahezeMagic/compare/cc5667b94b53...ff1f34e3a3b8 [18:56:45] [02MirahezeMagic] 07Universal-Omega 03ff1f34e - Remove CreateWikiJson [18:57:21] [02mediawiki-repos] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://github.com/miraheze/mediawiki-repos/commit/794440f5e626 [18:57:24] [02mediawiki-repos] 07paladox 03794440f - CSS: Run composer install [18:57:27] [02mediawiki-repos] 07paladox created branch 03paladox-patch-1 - 13https://github.com/miraheze/mediawiki-repos [18:57:30] [02mediawiki-repos] 07paladox opened pull request 03#38: CSS: Run composer install - 13https://github.com/miraheze/mediawiki-repos/pull/38 [18:57:31] [02mediawiki-repos] 07paladox closed pull request 03#38: CSS: Run composer install - 13https://github.com/miraheze/mediawiki-repos/pull/38 [18:57:32] [02mediawiki-repos] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mediawiki-repos/compare/11e5c222027c...f9efd18dd2d8 [18:57:33] miraheze/ManageWiki - Universal-Omega the build has errored. [18:57:35] [02mediawiki-repos] 07paladox 03f9efd18 - CSS: Run composer install (#38) [18:57:36] [02mediawiki-repos] 07paladox deleted branch 03paladox-patch-1 - 13https://github.com/miraheze/mediawiki-repos [18:57:38] [02mediawiki-repos] 07paladox deleted branch 03paladox-patch-1 [18:58:04] [02MirahezeMagic] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/MirahezeMagic/compare/ff1f34e3a3b8...ae7fe243afc5 [18:58:07] [02MirahezeMagic] 07Universal-Omega 03ae7fe24 - Remove CreateWikiJson [18:58:47] !log [@mwtask181] starting deploy of {'folders': '1.42/extensions/MirahezeMagic'} to all [18:58:52] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:58:54] miraheze/CreateWiki - Universal-Omega the build passed. [18:59:09] !log [@mwtask181] finished deploy of {'folders': '1.42/extensions/MirahezeMagic'} to all - SUCCESS in 22s [18:59:14] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:59:28] !log [universalomega@mwtask181] finished deploy of {'l10n': True, 'versions': '1.42'} to all - SUCCESS in 400s [18:59:32] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:02:32] !log [paladox@mwtask181] starting deploy of {'upgrade_world': True, 'l10n': True, 'versions': '1.42', 'upgrade_extensions': 'all', 'upgrade_skins': 'all'} to all [19:02:37] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:03:30] [02ManageWiki] 07Universal-Omega pushed 031 commit to 03datafactory [+0/-0/±1] 13https://github.com/miraheze/ManageWiki/commit/c61f90e3c916 [19:03:31] [02ManageWiki] 07Universal-Omega 03c61f90e - Use CreateWikiDataFactory [19:03:33] [02ManageWiki] 07Universal-Omega created branch 03datafactory - 13https://github.com/miraheze/ManageWiki [19:03:35] [02ManageWiki] 07Universal-Omega opened pull request 03#491: Use CreateWikiDataFactory - 13https://github.com/miraheze/ManageWiki/pull/491 [19:04:45] [02ManageWiki] 07Universal-Omega edited pull request 03#491: Use CreateWikiDataFactory (T12718) - 13https://github.com/miraheze/ManageWiki/pull/491 [19:05:13] miraheze/MirahezeMagic - Universal-Omega the build has errored. [19:06:19] miraheze/ManageWiki - Universal-Omega the build has errored. [19:06:41] [02ManageWiki] 07Universal-Omega pushed 031 commit to 03datafactory [+0/-0/±1] 13https://github.com/miraheze/ManageWiki/compare/c61f90e3c916...437471e47f30 [19:06:43] [02ManageWiki] 07Universal-Omega 03437471e - Use CreateWikiDataFactory [19:06:44] [02ManageWiki] 07Universal-Omega synchronize pull request 03#491: Use CreateWikiDataFactory (T12718) - 13https://github.com/miraheze/ManageWiki/pull/491 [19:07:01] [02ManageWiki] 07Universal-Omega pushed 031 commit to 03datafactory [+0/-0/±1] 13https://github.com/miraheze/ManageWiki/compare/437471e47f30...702b84bbc62a [19:07:02] [02ManageWiki] 07Universal-Omega 03702b84b - Fix [19:07:05] [02ManageWiki] 07Universal-Omega synchronize pull request 03#491: Use CreateWikiDataFactory (T12718) - 13https://github.com/miraheze/ManageWiki/pull/491 [19:08:56] [02.github] 07dependabot[bot] created branch 03dependabot/github_actions/actions/cache-4.1.1 - 13https://github.com/miraheze/.github [19:08:59] [02.github] 07dependabot[bot] pushed 031 commit to 03dependabot/github_actions/actions/cache-4.1.1 [+0/-0/±1] 13https://github.com/miraheze/.github/commit/d2ebe363d394 [19:09:01] [02.github] 07dependabot[bot] 03d2ebe36 - Bump actions/cache from 4.1.0 to 4.1.1 [19:09:04] [02.github] 07dependabot[bot] labeled pull request 03#51: Bump actions/cache from 4.1.0 to 4.1.1 - 13https://github.com/miraheze/.github/pull/51 [19:09:06] [02.github] 07dependabot[bot] opened pull request 03#51: Bump actions/cache from 4.1.0 to 4.1.1 - 13https://github.com/miraheze/.github/pull/51 [19:09:39] [02ManageWiki] 07Universal-Omega pushed 031 commit to 03datafactory [+0/-0/±1] 13https://github.com/miraheze/ManageWiki/compare/702b84bbc62a...bade088d60e2 [19:09:41] [02ManageWiki] 07Universal-Omega 03bade088 - Use CreateWikiDataFactory [19:09:44] [02ManageWiki] 07Universal-Omega synchronize pull request 03#491: Use CreateWikiDataFactory (T12718) - 13https://github.com/miraheze/ManageWiki/pull/491 [19:10:09] miraheze/ManageWiki - Universal-Omega the build has errored. [19:10:34] !log [paladox@mwtask181] DEPLOY ABORTED: Canary check failed for publictestwiki.com@mw152.wikitide.net [19:10:39] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:10:56] !log [paladox@mwtask181] starting deploy of {'upgrade_world': True, 'l10n': True, 'force': True, 'versions': '1.42', 'upgrade_extensions': 'all', 'upgrade_skins': 'all'} to mw152 [19:11:01] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:11:38] [02ManageWiki] 07Universal-Omega pushed 031 commit to 03datafactory [+0/-0/±1] 13https://github.com/miraheze/ManageWiki/compare/bade088d60e2...460b506a8166 [19:11:39] !log [paladox@mwtask181] finished deploy of {'upgrade_world': True, 'l10n': True, 'force': True, 'versions': '1.42', 'upgrade_extensions': 'all', 'upgrade_skins': 'all'} to mw152 - SUCCESS in 43s [19:11:40] [02ManageWiki] 07Universal-Omega 03460b506 - Use CreateWikiDataFactory [19:11:43] [02ManageWiki] 07Universal-Omega synchronize pull request 03#491: Use CreateWikiDataFactory (T12718) - 13https://github.com/miraheze/ManageWiki/pull/491 [19:11:44] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:11:50] !log [paladox@mwtask181] starting deploy of {'upgrade_world': True, 'l10n': True, 'force': True, 'versions': '1.42', 'upgrade_extensions': 'all', 'upgrade_skins': 'all'} to mw152 [19:11:54] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:12:06] !log [paladox@mwtask181] finished deploy of {'upgrade_world': True, 'l10n': True, 'force': True, 'versions': '1.42', 'upgrade_extensions': 'all', 'upgrade_skins': 'all'} to mw152 - SUCCESS in 16s [19:12:08] !log [paladox@mwtask181] starting deploy of {'upgrade_world': True, 'l10n': True, 'versions': '1.42', 'upgrade_extensions': 'all', 'upgrade_skins': 'all'} to all [19:12:10] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:12:15] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:13:12] [02ManageWiki] 07Universal-Omega pushed 031 commit to 03datafactory [+0/-0/±1] 13https://github.com/miraheze/ManageWiki/compare/460b506a8166...169521375131 [19:13:15] [02ManageWiki] 07Universal-Omega 031695213 - Use CreateWikiDataFactory [19:13:18] [02ManageWiki] 07Universal-Omega synchronize pull request 03#491: Use CreateWikiDataFactory (T12718) - 13https://github.com/miraheze/ManageWiki/pull/491 [19:14:34] [02ManageWiki] 07Universal-Omega pushed 031 commit to 03datafactory [+0/-0/±1] 13https://github.com/miraheze/ManageWiki/compare/169521375131...ab86f1857cb4 [19:14:36] [02ManageWiki] 07Universal-Omega 03ab86f18 - Use CreateWikiDataFactory [19:14:39] [02ManageWiki] 07Universal-Omega synchronize pull request 03#491: Use CreateWikiDataFactory (T12718) - 13https://github.com/miraheze/ManageWiki/pull/491 [19:16:11] [02ManageWiki] 07github-actions[bot] pushed 031 commit to 03datafactory [+0/-0/±1] 13https://github.com/miraheze/ManageWiki/compare/ab86f1857cb4...cfda50ce5104 [19:16:13] [02ManageWiki] 07github-actions 03cfda50c - CI: lint code to MediaWiki standards [19:16:15] [02ManageWiki] 07github-actions[bot] synchronize pull request 03#491: Use CreateWikiDataFactory (T12718) - 13https://github.com/miraheze/ManageWiki/pull/491 [19:17:40] miraheze/ManageWiki - Universal-Omega the build has errored. [19:19:37] [02ManageWiki] 07Universal-Omega pushed 031 commit to 03datafactory [+0/-0/±1] 13https://github.com/miraheze/ManageWiki/compare/cfda50ce5104...a5c9d99b00a4 [19:19:38] [02ManageWiki] 07Universal-Omega 03a5c9d99 - Use CreateWikiDataFactory [19:19:39] [02ManageWiki] 07Universal-Omega synchronize pull request 03#491: Use CreateWikiDataFactory (T12718) - 13https://github.com/miraheze/ManageWiki/pull/491 [19:22:14] !log [paladox@mwtask181] DEPLOY ABORTED: Canary check failed for publictestwiki.com@mw153.wikitide.net [19:22:20] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:22:29] [02ManageWiki] 07Universal-Omega pushed 031 commit to 03datafactory [+0/-0/±1] 13https://github.com/miraheze/ManageWiki/compare/a5c9d99b00a4...97e56118d73f [19:22:30] miraheze/ManageWiki - Universal-Omega the build has errored. [19:22:31] [02ManageWiki] 07Universal-Omega 0397e5611 - Update [19:22:32] [02ManageWiki] 07Universal-Omega synchronize pull request 03#491: Use CreateWikiDataFactory (T12718) - 13https://github.com/miraheze/ManageWiki/pull/491 [19:23:50] !log [@test151] starting deploy of {'folders': '1.42/extensions/MirahezeMagic'} to test151 [19:23:51] !log [@test151] finished deploy of {'folders': '1.42/extensions/MirahezeMagic'} to test151 - SUCCESS in 0s [19:23:55] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:24:00] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:24:05] !log [@test151] starting deploy of {'folders': '1.43/extensions/MirahezeMagic'} to test151 [19:24:06] !log [@test151] finished deploy of {'folders': '1.43/extensions/MirahezeMagic'} to test151 - SUCCESS in 0s [19:24:10] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:24:14] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:24:56] [02ManageWiki] 07Universal-Omega pushed 031 commit to 03datafactory [+0/-0/±1] 13https://github.com/miraheze/ManageWiki/compare/97e56118d73f...b2de0c3b6c42 [19:24:58] [02ManageWiki] 07Universal-Omega 03b2de0c3 - Use CreateWikiDataFactory [19:24:59] [02ManageWiki] 07Universal-Omega synchronize pull request 03#491: Use CreateWikiDataFactory (T12718) - 13https://github.com/miraheze/ManageWiki/pull/491 [19:25:05] miraheze/ManageWiki - Universal-Omega the build has errored. [19:26:35] !log [paladox@mwtask181] starting deploy of {'upgrade_world': True, 'l10n': True, 'force': True, 'versions': '1.42', 'upgrade_extensions': 'all', 'upgrade_skins': 'all'} to mw153 [19:26:40] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:27:17] !log [paladox@mwtask181] finished deploy of {'upgrade_world': True, 'l10n': True, 'force': True, 'versions': '1.42', 'upgrade_extensions': 'all', 'upgrade_skins': 'all'} to mw153 - SUCCESS in 41s [19:27:21] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:27:23] !log [paladox@mwtask181] starting deploy of {'upgrade_world': True, 'l10n': True, 'force': True, 'versions': '1.42', 'upgrade_extensions': 'all', 'upgrade_skins': 'all'} to mw154 [19:27:28] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:28:13] !log [paladox@mwtask181] finished deploy of {'upgrade_world': True, 'l10n': True, 'force': True, 'versions': '1.42', 'upgrade_extensions': 'all', 'upgrade_skins': 'all'} to mw154 - SUCCESS in 50s [19:28:18] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:28:42] miraheze/ManageWiki - Universal-Omega the build has errored. [19:30:32] !log [paladox@mwtask181] starting deploy of {'upgrade_world': True, 'l10n': True, 'force': True, 'versions': '1.42', 'upgrade_extensions': 'all', 'upgrade_skins': 'all'} to mw161 [19:30:37] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:31:22] !log [paladox@mwtask181] finished deploy of {'upgrade_world': True, 'l10n': True, 'force': True, 'versions': '1.42', 'upgrade_extensions': 'all', 'upgrade_skins': 'all'} to mw161 - SUCCESS in 49s [19:31:27] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:33:40] [02ManageWiki] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±8] 13https://github.com/miraheze/ManageWiki/compare/1340cd3c632d...2cec896a294b [19:33:42] [02ManageWiki] 07Universal-Omega 032cec896 - Use CreateWikiDataFactory (T12718) (#491) [19:33:44] [02ManageWiki] 07Universal-Omega closed pull request 03#491: Use CreateWikiDataFactory (T12718) - 13https://github.com/miraheze/ManageWiki/pull/491 [19:33:46] [02ManageWiki] 07Universal-Omega deleted branch 03datafactory [19:33:48] [02ManageWiki] 07Universal-Omega deleted branch 03datafactory - 13https://github.com/miraheze/ManageWiki [19:35:37] !log [paladox@mwtask181] starting deploy of {'upgrade_world': True, 'l10n': True, 'force': True, 'versions': '1.42', 'upgrade_extensions': 'all', 'upgrade_skins': 'all'} to all [19:35:41] !log [paladox@mwtask181] starting deploy of {'upgrade_world': True, 'l10n': True, 'versions': '1.42', 'upgrade_extensions': 'all', 'upgrade_skins': 'all'} to all [19:35:42] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:35:47] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:37:22] !log [universalomega@mwtask181] starting deploy of {'versions': '1.42', 'upgrade_extensions': 'ManageWiki'} to all [19:37:23] !log [universalomega@mwtask181] finished deploy of {'versions': '1.42', 'upgrade_extensions': 'ManageWiki'} to all - SUCCESS in 1s [19:37:25] miraheze/ManageWiki - Universal-Omega the build has errored. [19:37:27] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:37:31] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:41:42] [02mw-config] 07Universal-Omega pushed 031 commit to 03remove-hooks [+0/-0/±1] 13https://github.com/miraheze/mw-config/commit/cc22713ebf3e [19:41:44] [02mw-config] 07Universal-Omega 03cc22713 - Remove old hooks [19:41:46] [02mw-config] 07Universal-Omega created branch 03remove-hooks - 13https://github.com/miraheze/mw-config [19:41:48] [02mw-config] 07Universal-Omega opened pull request 03#5706: Remove old hooks - 13https://github.com/miraheze/mw-config/pull/5706 [19:42:21] [02mw-config] 07github-actions[bot] pushed 031 commit to 03remove-hooks [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/cc22713ebf3e...f1234eed01e2 [19:42:23] [02mw-config] 07github-actions 03f1234ee - CI: lint code to MediaWiki standards [19:42:24] [02mw-config] 07github-actions[bot] synchronize pull request 03#5706: Remove old hooks - 13https://github.com/miraheze/mw-config/pull/5706 [19:42:52] miraheze/mw-config - Universal-Omega the build passed. [19:44:47] [02mw-config] 07Universal-Omega pushed 031 commit to 03remove-hooks [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/f1234eed01e2...f5fd5e370d82 [19:44:50] [02mw-config] 07Universal-Omega 03f5fd5e3 - Rename [19:44:52] [02mw-config] 07Universal-Omega synchronize pull request 03#5706: Remove old hooks - 13https://github.com/miraheze/mw-config/pull/5706 [19:45:43] miraheze/mw-config - Universal-Omega the build passed. [19:46:37] !log [paladox@mwtask181] DEPLOY ABORTED: Canary check failed for publictestwiki.com@mw164.wikitide.net [19:46:42] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:47:03] !log [paladox@mwtask181] starting deploy of {'upgrade_world': True, 'l10n': True, 'force': True, 'versions': '1.42', 'upgrade_extensions': 'all', 'upgrade_skins': 'all'} to mw164 [19:47:08] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:47:48] [02MirahezeMagic] 07Universal-Omega created branch 03datafactory - 13https://github.com/miraheze/MirahezeMagic [19:47:49] [02MirahezeMagic] 07Universal-Omega pushed 031 commit to 03datafactory [+0/-0/±1] 13https://github.com/miraheze/MirahezeMagic/commit/fa370787cb28 [19:47:51] [02MirahezeMagic] 07Universal-Omega 03fa37078 - Use CreateWikiDataFactory [19:47:52] !log [paladox@mwtask181] finished deploy of {'upgrade_world': True, 'l10n': True, 'force': True, 'versions': '1.42', 'upgrade_extensions': 'all', 'upgrade_skins': 'all'} to mw164 - SUCCESS in 48s [19:47:54]