[00:10:45] RECOVERY - cp38 Disk Space on cp38 is OK: DISK OK - free space: / 53228MiB (11% inode=99%); [00:11:07] RECOVERY - cp37 Disk Space on cp37 is OK: DISK OK - free space: / 53640MiB (11% inode=99%); [00:28:11] RECOVERY - cp38 Puppet on cp38 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [00:32:10] PROBLEM - cp38 Puppet on cp38 is WARNING: WARNING: Puppet is currently disabled, message: reason not specified, last run 4 hours ago with 0 failures [00:40:19] [02puppet] 07Universal-Omega merged pull request #4366: haproxy: adjust balancing (03main...03haproxy-balance) 13https://github.com/miraheze/puppet/pull/4366 [00:40:19] [02puppet] 07Universal-Omega pushed 1 new commit to 03main 13https://github.com/miraheze/puppet/commit/556329c27856c891a1d75983c0baffc2b030d35c [00:40:19] 02puppet/03main 07CosmicAlpha 03556329c haproxy: adjust balancing (#4366) [00:40:20] [02puppet] 07Universal-Omega 04deleted 03haproxy-balance at 03d6fe237 13https://api.github.com/repos/miraheze/puppet/commit/d6fe237 [00:40:33] !log [blankeclair@mwtask181] Starting import for openkorebrasilwikiwiki (XML: None; Images: openkorebrasilwikiwiki/) (START) [00:40:34] !log [blankeclair@mwtask181] sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php importImages --wiki=openkorebrasilwikiwiki '--comment=Importing images ([[phorge:T13796|T13796]])' --search-recursively -- openkorebrasilwikiwiki/ (START) [00:40:36] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:40:38] !log [blankeclair@mwtask181] sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php importImages --wiki=openkorebrasilwikiwiki '--comment=Importing images ([[phorge:T13796|T13796]])' --search-recursively -- openkorebrasilwikiwiki/ (END - exit=0) [00:40:39] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:40:39] !log [blankeclair@mwtask181] sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php initSiteStats --wiki=openkorebrasilwikiwiki --update (START) [00:40:40] !log [blankeclair@mwtask181] sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php initSiteStats --wiki=openkorebrasilwikiwiki --update (END - exit=0) [00:40:41] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:40:41] !log [blankeclair@mwtask181] Finished import for openkorebrasilwikiwiki (XML: None; Images: openkorebrasilwikiwiki/) (END - exit=0) [00:40:44] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:40:46] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:40:48] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:45:50] [02puppet] 07Universal-Omega closed pull request #4365: haproxy: use safe http reuse for backends (03main...03safe-http-reuse) 13https://github.com/miraheze/puppet/pull/4365 [00:45:52] [02puppet] 07Universal-Omega 04deleted 03safe-http-reuse at 036ff9137 13https://api.github.com/repos/miraheze/puppet/commit/6ff9137 [00:50:10] RECOVERY - cp38 Puppet on cp38 is OK: OK: Puppet is currently enabled, last run 24 seconds ago with 0 failures [01:37:17] [02MediaWikiDebugJS] 07Universal-Omega pushed 1 new commit to 03main 13https://github.com/miraheze/MediaWikiDebugJS/commit/21228a12c103ab8a5cff6f7acb6c6ce9573bccce [01:37:17] 02MediaWikiDebugJS/03main 07CosmicAlpha 0321228a1 Add support for x-cache [02:50:45] PROBLEM - cp38 Disk Space on cp38 is WARNING: DISK WARNING - free space: / 49919MiB (10% inode=99%); [03:01:22] RECOVERY - db171 Backups SQL on db171 is OK: FILE_AGE OK: /var/log/db-backups/db-backups/db-backups.log is 20 seconds old and 4106107 bytes [03:15:07] PROBLEM - cp37 Disk Space on cp37 is WARNING: DISK WARNING - free space: / 49834MiB (10% inode=99%); [06:51:19] PROBLEM - history.estill.org - Cloudflare on sslhost is CRITICAL: Temporary failure in name resolutionHTTP CRITICAL - Unable to open TCP socket [06:53:21] PROBLEM - wiki.jinghe.in - Cloudflare on sslhost is CRITICAL: Temporary failure in name resolutionHTTP CRITICAL - Unable to open TCP socket [06:54:01] PROBLEM - www.isocasg.org - Cloudflare on sslhost is CRITICAL: Temporary failure in name resolutionHTTP CRITICAL - Unable to open TCP socket [06:54:02] PROBLEM - wikisauce.rank1.com - Cloudflare on sslhost is CRITICAL: Temporary failure in name resolutionHTTP CRITICAL - Unable to open TCP socket [06:54:05] PROBLEM - wiki.candelabrem.com - Cloudflare on sslhost is CRITICAL: Temporary failure in name resolutionHTTP CRITICAL - Unable to open TCP socket [06:56:27] PROBLEM - wiki.bluevertigo.org - Cloudflare on sslhost is CRITICAL: Temporary failure in name resolutionHTTP CRITICAL - Unable to open TCP socket [06:56:30] PROBLEM - beta.sagan4.org - Cloudflare on sslhost is CRITICAL: Temporary failure in name resolutionHTTP CRITICAL - Unable to open TCP socket [06:56:47] PROBLEM - wiki.rlab.org.uk - Cloudflare on sslhost is CRITICAL: Temporary failure in name resolutionHTTP CRITICAL - Unable to open TCP socket [06:57:58] PROBLEM - wiki.whentheycry.org - Cloudflare on sslhost is CRITICAL: Temporary failure in name resolutionHTTP CRITICAL - Unable to open TCP socket [06:58:04] PROBLEM - mason.sagan4.org - Cloudflare on sslhost is CRITICAL: Temporary failure in name resolutionHTTP CRITICAL - Unable to open TCP socket [06:58:09] PROBLEM - wiki.cdntennis.ca - Cloudflare on sslhost is CRITICAL: Temporary failure in name resolutionHTTP CRITICAL - Unable to open TCP socket [06:59:05] PROBLEM - wiki.paneidoverse.com - Cloudflare on sslhost is CRITICAL: Temporary failure in name resolutionHTTP CRITICAL - Unable to open TCP socket [07:00:07] PROBLEM - meta.sagan4.org - Cloudflare on sslhost is CRITICAL: Temporary failure in name resolutionHTTP CRITICAL - Unable to open TCP socket [07:00:26] da faq are they doin [07:01:17] [02puppet] 07dependabot[bot] created 03dependabot/github_actions/scottbrenner/puppet-lint-action-1.0.9 (+1 new commit) 13https://github.com/miraheze/puppet/commit/0ed7897408ea [07:01:17] 02puppet/03dependabot/github_actions/scottbrenner/puppet-lint-action-1.0.9 07dependabot[bot] 030ed7897 build(deps): bump scottbrenner/puppet-lint-action from 1.0.8 to 1.0.9… [07:01:19] [02puppet] 07dependabot[bot] opened pull request #4367: build(deps): bump scottbrenner/puppet-lint-action from 1.0.8 to 1.0.9 (03main...03dependabot/github_actions/scottbrenner/puppet-lint-action-1.0.9) 13https://github.com/miraheze/puppet/pull/4367 [07:01:19] [02puppet] 07dependabot[bot] added the label 'github_actions' to pull request #4367 (build(deps): bump scottbrenner/puppet-lint-action from 1.0.8 to 1.0.9) 13https://github.com/miraheze/puppet/pull/4367 [07:01:21] [02puppet] 07dependabot[bot] added the label 'dependencies' to pull request #4367 (build(deps): bump scottbrenner/puppet-lint-action from 1.0.8 to 1.0.9) 13https://github.com/miraheze/puppet/pull/4367 [07:01:23] [02puppet] 07dependabot[bot] added the label 'github_actions' to pull request #4367 (build(deps): bump scottbrenner/puppet-lint-action from 1.0.8 to 1.0.9) 13https://github.com/miraheze/puppet/pull/4367 [07:01:25] [02puppet] 07dependabot[bot] added the label 'dependencies' to pull request #4367 (build(deps): bump scottbrenner/puppet-lint-action from 1.0.8 to 1.0.9) 13https://github.com/miraheze/puppet/pull/4367 [07:01:27] [02puppet] 07coderabbitai[bot] commented on pull request #4367: --- […] 13https://github.com/miraheze/puppet/pull/4367#issuecomment-2938850326 [07:02:26] miraheze/puppet - dependabot[bot] the build passed. [07:08:13] PROBLEM - upscwiki.mridulpm.in - Cloudflare on sslhost is CRITICAL: Temporary failure in name resolutionHTTP CRITICAL - Unable to open TCP socket [07:08:44] PROBLEM - wiki.apico.buzz - Cloudflare on sslhost is CRITICAL: Temporary failure in name resolutionHTTP CRITICAL - Unable to open TCP socket [07:11:29] PROBLEM - iewiki.auroville.org - Cloudflare on sslhost is CRITICAL: Temporary failure in name resolutionHTTP CRITICAL - Unable to open TCP socket [07:12:46] PROBLEM - wiki.seamly.io - Cloudflare on sslhost is CRITICAL: Temporary failure in name resolutionHTTP CRITICAL - Unable to open TCP socket [07:13:28] PROBLEM - alpha.sagan4.org - Cloudflare on sslhost is CRITICAL: Temporary failure in name resolutionHTTP CRITICAL - Unable to open TCP socket [07:16:09] PROBLEM - wiki.ourbluemarble.net - Cloudflare on sslhost is CRITICAL: Temporary failure in name resolutionHTTP CRITICAL - Unable to open TCP socket [07:16:45] PROBLEM - wiki.knowledgerevolution.eu - Cloudflare on sslhost is CRITICAL: Temporary failure in name resolutionHTTP CRITICAL - Unable to open TCP socket [07:17:15] PROBLEM - en.omniversalis.org - Cloudflare on sslhost is CRITICAL: Temporary failure in name resolutionHTTP CRITICAL - Unable to open TCP socket [07:18:02] PROBLEM - wiki.hexearth.xyz - Cloudflare on sslhost is CRITICAL: Temporary failure in name resolutionHTTP CRITICAL - Unable to open TCP socket [07:20:30] PROBLEM - iewiki.purnamcommunity.in - Cloudflare on sslhost is CRITICAL: Temporary failure in name resolutionHTTP CRITICAL - Unable to open TCP socket [08:41:35] [02puppet] 07Universal-Omega merged 07dependabot[bot]'s pull request #4367: build(deps): bump scottbrenner/puppet-lint-action from 1.0.8 to 1.0.9 (03main...03dependabot/github_actions/scottbrenner/puppet-lint-action-1.0.9) 13https://github.com/miraheze/puppet/pull/4367 [08:41:35] [02puppet] 07Universal-Omega pushed 1 new commit to 03main 13https://github.com/miraheze/puppet/commit/50ebb4ec216a6c30b28f7d228b0fd9dbc6e5d53b [08:41:35] 02puppet/03main 07dependabot[bot] 0350ebb4e build(deps): bump scottbrenner/puppet-lint-action from 1.0.8 to 1.0.9 (#4367)… [08:41:36] [02puppet] 07Universal-Omega 04deleted 03dependabot/github_actions/scottbrenner/puppet-lint-action-1.0.9 at 030ed7897 13https://api.github.com/repos/miraheze/puppet/commit/0ed7897 [08:42:58] miraheze/puppet - Universal-Omega the build passed. [12:08:11] PROBLEM - db171 Current Load on db171 is WARNING: LOAD WARNING - total load average: 10.53, 9.93, 6.81 [12:10:09] RECOVERY - db171 Current Load on db171 is OK: LOAD OK - total load average: 7.58, 9.45, 7.03 [13:46:14] PROBLEM - mwtask181 Current Load on mwtask181 is CRITICAL: LOAD CRITICAL - total load average: 24.12, 17.98, 11.56 [13:46:39] PROBLEM - mwtask151 Current Load on mwtask151 is WARNING: LOAD WARNING - total load average: 22.24, 17.26, 10.33 [13:48:14] RECOVERY - mwtask181 Current Load on mwtask181 is OK: LOAD OK - total load average: 15.24, 16.77, 11.91 [13:48:39] RECOVERY - mwtask151 Current Load on mwtask151 is OK: LOAD OK - total load average: 19.94, 17.92, 11.40 [13:54:14] PROBLEM - mwtask181 Current Load on mwtask181 is WARNING: LOAD WARNING - total load average: 22.49, 19.65, 14.61 [14:12:14] PROBLEM - mwtask181 Current Load on mwtask181 is CRITICAL: LOAD CRITICAL - total load average: 24.39, 23.66, 20.82 [14:13:12] PROBLEM - db181 Backups SQL on db181 is WARNING: FILE_AGE WARNING: /var/log/db-backups/db-backups/db-backups.log is 1382567 seconds old and 4275475 bytes [14:14:14] PROBLEM - mwtask181 Current Load on mwtask181 is WARNING: LOAD WARNING - total load average: 19.37, 22.26, 20.67 [14:22:14] RECOVERY - mwtask181 Current Load on mwtask181 is OK: LOAD OK - total load average: 11.55, 17.02, 19.09 [14:52:17] [02mw-config] 07SomeMWDev opened pull request #5980: T13789: Add wgPhonosInlineAudioPlayerMode (07miraheze:03main...07SomeMWDev:03T13789) 13https://github.com/miraheze/mw-config/pull/5980 [14:53:23] miraheze/mw-config - SomeMWDev the build passed. [14:57:59] [02mw-config] 07dependabot[bot] created 03dependabot/composer/justinrainbow/json-schema-6.4.2 (+1 new commit) 13https://github.com/miraheze/mw-config/commit/e02164a4e299 [14:57:59] 02mw-config/03dependabot/composer/justinrainbow/json-schema-6.4.2 07dependabot[bot] 03e02164a Update justinrainbow/json-schema requirement from 6.0.0 to 6.4.2… [14:58:01] [02mw-config] 07dependabot[bot] opened pull request #5981: Update justinrainbow/json-schema requirement from 6.0.0 to 6.4.2 (03main...03dependabot/composer/justinrainbow/json-schema-6.4.2) 13https://github.com/miraheze/mw-config/pull/5981 [14:58:03] [02mw-config] 07dependabot[bot] added the label 'dependencies' to pull request #5981 (Update justinrainbow/json-schema requirement from 6.0.0 to 6.4.2) 13https://github.com/miraheze/mw-config/pull/5981 [14:58:05] [02mw-config] 07dependabot[bot] added the label 'dependencies' to pull request #5981 (Update justinrainbow/json-schema requirement from 6.0.0 to 6.4.2) 13https://github.com/miraheze/mw-config/pull/5981 [14:58:07] [02mw-config] 07dependabot[bot] added the label 'php' to pull request #5981 (Update justinrainbow/json-schema requirement from 6.0.0 to 6.4.2) 13https://github.com/miraheze/mw-config/pull/5981 [14:58:09] [02mw-config] 07dependabot[bot] added the label 'php' to pull request #5981 (Update justinrainbow/json-schema requirement from 6.0.0 to 6.4.2) 13https://github.com/miraheze/mw-config/pull/5981 [14:58:11] [02mw-config] 07dependabot[bot] closed pull request #5896: Update justinrainbow/json-schema requirement from 6.0.0 to 6.4.1 (03main...03dependabot/composer/justinrainbow/json-schema-6.4.1) 13https://github.com/miraheze/mw-config/pull/5896 [14:58:13] [02mw-config] 07dependabot[bot] commented on pull request #5896: Superseded by #5981. 13https://github.com/miraheze/mw-config/pull/5896#issuecomment-2940369631 [14:58:15] [02mw-config] 07dependabot[bot] 04deleted 03dependabot/composer/justinrainbow/json-schema-6.4.1 at 03fe5272a 13https://api.github.com/repos/miraheze/mw-config/commit/fe5272a [14:58:57] miraheze/mw-config - dependabot[bot] the build has errored. [15:43:29] PROBLEM - db161 Backups SQL on db161 is WARNING: FILE_AGE WARNING: /var/log/db-backups/db-backups/db-backups.log is 1382610 seconds old and 4617419 bytes [18:02:14] PROBLEM - mwtask181 Current Load on mwtask181 is WARNING: LOAD WARNING - total load average: 23.04, 17.42, 12.08 [18:04:14] RECOVERY - mwtask181 Current Load on mwtask181 is OK: LOAD OK - total load average: 16.66, 17.14, 12.64 [18:26:45] PROBLEM - cp38 Disk Space on cp38 is CRITICAL: DISK CRITICAL - free space: / 27219MiB (5% inode=99%); [18:37:07] PROBLEM - cp37 Disk Space on cp37 is CRITICAL: DISK CRITICAL - free space: / 27176MiB (5% inode=99%); [19:48:26] RECOVERY - wiki.hexearth.xyz - Cloudflare on sslhost is OK: OK - Certificate 'wiki.hexearth.xyz' will expire on Thu 28 Aug 2025 10:43:12 PM GMT +0000. [19:48:39] RECOVERY - iewiki.purnamcommunity.in - Cloudflare on sslhost is OK: OK - Certificate 'iewiki.purnamcommunity.in' will expire on Wed 23 Jul 2025 04:12:16 AM GMT +0000. [19:48:50] RECOVERY - en.omniversalis.org - Cloudflare on sslhost is OK: OK - Certificate 'en.omniversalis.org' will expire on Tue 22 Jul 2025 09:29:23 PM GMT +0000. [19:49:16] RECOVERY - history.estill.org - Cloudflare on sslhost is OK: OK - Certificate 'history.estill.org' will expire on Tue 22 Jul 2025 11:15:51 PM GMT +0000. [19:56:43] [02dns] 07Universal-Omega created 03cf-lb (+1 new commit) 13https://github.com/miraheze/dns/commit/92c68778baae [19:56:44] 02dns/03cf-lb 07CosmicAlpha 0392c6877 wikitide.net: update some to cf-lb [19:56:49] [02dns] 07Universal-Omega opened pull request #672: wikitide.net: update some to cf-lb (03main...03cf-lb) 13https://github.com/miraheze/dns/pull/672 [19:58:48] miraheze/dns - Universal-Omega the build has errored. [19:59:36] [02dns] 07Universal-Omega pushed 1 new commit to 03cf-lb 13https://github.com/miraheze/dns/commit/88fdd47af098a0039f1fcbde17740393bc7f4117 [19:59:37] 02dns/03cf-lb 07CosmicAlpha 0388fdd47 Fix [20:01:21] [02dns] 07Universal-Omega pushed 1 new commit to 03main 13https://github.com/miraheze/dns/commit/d6aaaedde199709df478d106d61d69a74b08cea3 [20:01:21] 02dns/03main 07CosmicAlpha 03d6aaaed wikitide.net: update some to cf-lb [20:01:21] [02dns] 07Universal-Omega merged pull request #672: wikitide.net: update some to cf-lb (03main...03cf-lb) 13https://github.com/miraheze/dns/pull/672 [20:01:22] [02dns] 07Universal-Omega 04deleted 03cf-lb at 0388fdd47 13https://api.github.com/repos/miraheze/dns/commit/88fdd47 [20:01:35] miraheze/dns - Universal-Omega the build passed. [20:02:16] miraheze/dns - Universal-Omega the build passed. [20:06:01] RECOVERY - upscwiki.mridulpm.in - Cloudflare on sslhost is OK: OK - Certificate 'upscwiki.mridulpm.in' will expire on Tue 29 Jul 2025 05:17:54 AM GMT +0000. [20:06:34] RECOVERY - wiki.apico.buzz - Cloudflare on sslhost is OK: OK - Certificate 'wiki.apico.buzz' will expire on Tue 22 Jul 2025 04:56:24 PM GMT +0000. [20:07:05] RECOVERY - wiki.ourbluemarble.net - Cloudflare on sslhost is OK: OK - Certificate 'wiki.ourbluemarble.net' will expire on Sun 06 Jul 2025 11:29:38 PM GMT +0000. [20:12:17] RECOVERY - wiki.knowledgerevolution.eu - Cloudflare on sslhost is OK: OK - Certificate 'wiki.knowledgerevolution.eu' will expire on Tue 22 Jul 2025 03:14:21 PM GMT +0000. [20:12:46] RECOVERY - alpha.sagan4.org - Cloudflare on sslhost is OK: OK - Certificate 'alpha.sagan4.org' will expire on Tue 22 Jul 2025 11:43:53 PM GMT +0000. [20:12:52] RECOVERY - wiki.seamly.io - Cloudflare on sslhost is OK: OK - Certificate 'wiki.seamly.io' will expire on Tue 22 Jul 2025 10:57:40 PM GMT +0000. [20:12:57] RECOVERY - iewiki.auroville.org - Cloudflare on sslhost is OK: OK - Certificate 'iewiki.auroville.org' will expire on Thu 24 Jul 2025 03:03:27 AM GMT +0000. [20:13:02] RECOVERY - meta.sagan4.org - Cloudflare on sslhost is OK: OK - Certificate 'meta.sagan4.org' will expire on Wed 23 Jul 2025 03:34:39 AM GMT +0000. [20:13:06] RECOVERY - wiki.paneidoverse.com - Cloudflare on sslhost is OK: OK - Certificate 'wiki.paneidoverse.com' will expire on Fri 11 Jul 2025 02:24:50 PM GMT +0000. [20:13:11] RECOVERY - wiki.cdntennis.ca - Cloudflare on sslhost is OK: OK - Certificate 'wiki.cdntennis.ca' will expire on Tue 22 Jul 2025 05:26:07 PM GMT +0000. [20:13:17] RECOVERY - mason.sagan4.org - Cloudflare on sslhost is OK: OK - Certificate 'mason.sagan4.org' will expire on Tue 22 Jul 2025 03:42:56 PM GMT +0000. [20:13:21] RECOVERY - wiki.rlab.org.uk - Cloudflare on sslhost is OK: OK - Certificate 'wiki.rlab.org.uk' will expire on Tue 22 Jul 2025 04:59:56 PM GMT +0000. [20:13:25] RECOVERY - wiki.whentheycry.org - Cloudflare on sslhost is OK: OK - Certificate 'wiki.whentheycry.org' will expire on Tue 22 Jul 2025 04:16:55 PM GMT +0000. [20:13:31] RECOVERY - beta.sagan4.org - Cloudflare on sslhost is OK: OK - Certificate 'beta.sagan4.org' will expire on Tue 22 Jul 2025 09:18:15 PM GMT +0000. [20:13:36] RECOVERY - wiki.bluevertigo.org - Cloudflare on sslhost is OK: OK - Certificate 'wiki.bluevertigo.org' will expire on Wed 23 Jul 2025 10:05:54 PM GMT +0000. [20:13:41] RECOVERY - wiki.candelabrem.com - Cloudflare on sslhost is OK: OK - Certificate 'wiki.candelabrem.com' will expire on Wed 23 Jul 2025 07:16:20 AM GMT +0000. [20:13:51] RECOVERY - www.isocasg.org - Cloudflare on sslhost is OK: OK - Certificate 'www.isocasg.org' will expire on Fri 11 Jul 2025 08:00:32 PM GMT +0000. [20:13:56] RECOVERY - wikisauce.rank1.com - Cloudflare on sslhost is OK: OK - Certificate 'wikisauce.rank1.com' will expire on Mon 01 Sep 2025 12:47:47 PM GMT +0000. [20:14:02] RECOVERY - wiki.jinghe.in - Cloudflare on sslhost is OK: OK - Certificate 'wiki.jinghe.in' will expire on Fri 29 Aug 2025 08:40:09 PM GMT +0000. [20:27:02] [02puppet] 07Universal-Omega created 03resolver-dns (+1 new commit) 13https://github.com/miraheze/puppet/commit/c4b58ecdf1ea [20:27:02] 02puppet/03resolver-dns 07CosmicAlpha 03c4b58ec resolver: use dns.wikitide.net [20:27:07] [02puppet] 07Universal-Omega opened pull request #4368: resolver: use dns.wikitide.net (03main...03resolver-dns) 13https://github.com/miraheze/puppet/pull/4368 [20:27:13] [02puppet] 07coderabbitai[bot] commented on pull request #4368: --- […] 13https://github.com/miraheze/puppet/pull/4368#issuecomment-2941366654 [20:34:16] !log [void@cloud15] clear ipmi sel [20:34:19] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:35:04] RECOVERY - cloud15 IPMI Sensors on cloud15 is OK: IPMI Status: OK [20:35:22] !log [void@cloud20.wikitide.net] clear ipmi sel [20:35:25] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:35:34] RECOVERY - cloud20 IPMI Sensors on cloud20 is OK: IPMI Status: OK [21:36:16] @orduin why does cloud20 have its full domain as hostname? [21:36:45] check 21 as well if you've got time to fix it [21:37:00] I wonder if the newer ones were setup inconsistently [21:37:47] good question, I'll adjust [21:38:01] Ty [21:38:07] I'm off to sleep now [21:38:31] !log [void@cloud20] set hostname to cloud20 (was cloud20.wikitide.net) [21:38:34] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:39:35] !log [void@cloud19] set hostname to cloud19 (was cloud19.wikitide.net) [21:39:38] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:50:11] [02ssl] 07MacFan4000 pushed 1 new commit to 03main 13https://github.com/miraheze/ssl/commit/5ec256577f0093a7e34af72e02a0d28735abe611 [21:50:11] 02ssl/03main 07MacFan4000 035ec2565 add incubator.songngu.xyz [21:56:53] [02dns] 07Universal-Omega created 03internal-dns (+1 new commit) 13https://github.com/miraheze/dns/commit/f635a703cce1 [21:56:53] 02dns/03internal-dns 07CosmicAlpha 03f635a70 Add fully internal DNS zone [21:56:59] [02dns] 07Universal-Omega opened pull request #673: Add fully internal DNS zone (03main...03internal-dns) 13https://github.com/miraheze/dns/pull/673 [21:58:37] miraheze/dns - Universal-Omega the build has errored. [22:02:19] [02dns] 07Universal-Omega pushed 1 new commit to 03internal-dns 13https://github.com/miraheze/dns/commit/986234eea4f1d0434f4fe238486aca9080379a92 [22:02:19] 02dns/03internal-dns 07CosmicAlpha 03986234e Add ns2 [22:03:17] miraheze/dns - Universal-Omega the build passed. [22:08:19] [02dns] 07Universal-Omega merged pull request #673: Add fully internal DNS zone (03main...03internal-dns) 13https://github.com/miraheze/dns/pull/673 [22:08:21] [02dns] 07Universal-Omega pushed 1 new commit to 03main 13https://github.com/miraheze/dns/commit/4e950424b52e481e755d298607430b00198643dd [22:08:22] 02dns/03main 07CosmicAlpha 034e95042 Add fully internal DNS zone [22:08:24] [02dns] 07Universal-Omega 04deleted 03internal-dns at 03986234e 13https://api.github.com/repos/miraheze/dns/commit/986234e [22:09:24] miraheze/dns - Universal-Omega the build passed. [22:30:24] [02puppet] 07Universal-Omega created 03recursor (+1 new commit) 13https://github.com/miraheze/puppet/commit/28a0146203bd [22:30:24] 02puppet/03recursor 07CosmicAlpha 0328a0146 Update recursor for internal network [22:30:28] [02puppet] 07Universal-Omega opened pull request #4369: Update recursor for internal network (03main...03recursor) 13https://github.com/miraheze/puppet/pull/4369 [22:30:34] [02puppet] 07coderabbitai[bot] commented on pull request #4369: --- […] 13https://github.com/miraheze/puppet/pull/4369#issuecomment-2941775613 [22:47:35] [02dns] 07Universal-Omega created 03wtnet (+1 new commit) 13https://github.com/miraheze/dns/commit/513f07eff9ae [22:47:35] 02dns/03wtnet 07CosmicAlpha 03513f07e Use wtnet for simplicity in recursor [22:47:39] [02dns] 07Universal-Omega opened pull request #674: Use wtnet for simplicity in recursor (03main...03wtnet) 13https://github.com/miraheze/dns/pull/674 [22:48:36] miraheze/dns - Universal-Omega the build passed. [22:52:52] [02dns] 07Universal-Omega pushed 1 new commit to 03wtnet 13https://github.com/miraheze/dns/commit/c821c6444504148a41b03e97957e8ed280bf2022 [22:52:52] 02dns/03wtnet 07CosmicAlpha 03c821c64 Update TTL [22:53:53] miraheze/dns - Universal-Omega the build has errored. [22:58:32] [02dns] 07Universal-Omega pushed 1 new commit to 03wtnet 13https://github.com/miraheze/dns/commit/e3872189d045a3a1136a55d746358b026b775f0e [22:58:32] 02dns/03wtnet 07CosmicAlpha 03e387218 Update [22:59:35] miraheze/dns - Universal-Omega the build passed. [23:04:56] [02dns] 07Universal-Omega pushed 1 new commit to 03wtnet 13https://github.com/miraheze/dns/commit/d03f93e725075392700b125dfc1463857ae0b11d [23:04:56] 02dns/03wtnet 07CosmicAlpha 03d03f93e Use 5M [23:05:53] miraheze/dns - Universal-Omega the build passed. [23:09:39] [02dns] 07Universal-Omega merged pull request #674: Use wtnet for simplicity in recursor (03main...03wtnet) 13https://github.com/miraheze/dns/pull/674 [23:09:39] [02dns] 07Universal-Omega pushed 1 new commit to 03main 13https://github.com/miraheze/dns/commit/0411f07b8d1abf2d85c3f131689899097a0b4757 [23:09:39] 02dns/03main 07CosmicAlpha 030411f07 Use wtnet for simplicity in recursor [23:09:40] [02dns] 07Universal-Omega 04deleted 03wtnet at 03d03f93e 13https://api.github.com/repos/miraheze/dns/commit/d03f93e [23:10:44] miraheze/dns - Universal-Omega the build passed. [23:18:12] [02dns] 07Universal-Omega pushed 1 new commit to 03main 13https://github.com/miraheze/dns/commit/3e4a590ee841a7443868dccc3e621ac7a76376ce [23:18:12] 02dns/03main 07CosmicAlpha 033e4a590 Remove phorge alias [23:19:14] miraheze/dns - Universal-Omega the build passed. [23:19:34] [02dns] 07Universal-Omega pushed 1 new commit to 03main 13https://github.com/miraheze/dns/commit/f225e6e87148ffca35abbb30840da07cc16aeeb5 [23:19:34] 02dns/03main 07CosmicAlpha 03f225e6e Remove ldap and logging aliases (at least for now) [23:20:34] miraheze/dns - Universal-Omega the build passed. [23:24:37] [02puppet] 07Universal-Omega pushed 1 new commit to 03main 13https://github.com/miraheze/puppet/commit/db080936e7e936b071d26de6e08bb8e70d6de7f6 [23:24:37] 02puppet/03main 07CosmicAlpha 03db08093 prometheus-pushgateway: use fsslc.wtnet [23:26:23] [02dns] 07Universal-Omega pushed 1 new commit to 03main 13https://github.com/miraheze/dns/commit/177069d31241ff0fa0cbb13fb06cc20a4eca1dc5 [23:26:24] 02dns/03main 07CosmicAlpha 03177069d Remove prometheus-pushgateway… [23:27:19] miraheze/dns - Universal-Omega the build passed. [23:31:40] PROBLEM - mattermost1 Puppet on mattermost1 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [23:37:45] [02puppet] 07Universal-Omega pushed 1 new commit to 03recursor 13https://github.com/miraheze/puppet/commit/5e853eb71e8fba4fbfbe2a6ed7937acd656e480f [23:37:45] 02puppet/03recursor 07CosmicAlpha 035e853eb Update [23:38:43] [02puppet] 07Universal-Omega merged pull request #4369: Update recursor for internal network (03main...03recursor) 13https://github.com/miraheze/puppet/pull/4369 [23:38:43] [02puppet] 07Universal-Omega pushed 1 new commit to 03main 13https://github.com/miraheze/puppet/commit/c39450ac573365a55b3d12aa5627f7efddbb9c31 [23:38:44] 02puppet/03main 07CosmicAlpha 03c39450a Update recursor for internal network (#4369) [23:38:46] [02puppet] 07Universal-Omega 04deleted 03recursor at 035e853eb 13https://api.github.com/repos/miraheze/puppet/commit/5e853eb [23:41:33] PROBLEM - os162 PowerDNS Recursor on os162 is CRITICAL: No response from DNS ::1 [23:41:56] PROBLEM - mw192 PowerDNS Recursor on mw192 is CRITICAL: No response from DNS ::1 [23:42:00] PROBLEM - cloud18 PowerDNS Recursor on cloud18 is CRITICAL: No response from DNS ::1 [23:42:08] PROBLEM - swiftobject191 PowerDNS Recursor on swiftobject191 is CRITICAL: No response from DNS ::1 [23:42:12] uhh [23:42:13] PROBLEM - mw203 PowerDNS Recursor on mw203 is CRITICAL: No response from DNS ::1 [23:42:14] that a problem? [23:42:28] [02puppet] 07Universal-Omega pushed 1 new commit to 03main 13https://github.com/miraheze/puppet/commit/afd5e69649ddd873b7b7e7ba1402e6291909267a [23:42:28] 02puppet/03main 07CosmicAlpha 03afd5e69 Fix [23:42:29] PROBLEM - mw192 Puppet on mw192 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[pdns-recursor] [23:43:02] PROBLEM - os162 Puppet on os162 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[pdns-recursor] [23:43:03] PROBLEM - swiftobject191 Puppet on swiftobject191 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[pdns-recursor] [23:43:08] PROBLEM - cloud18 Puppet on cloud18 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[pdns-recursor] [23:43:20] PROBLEM - puppet181 Puppet on puppet181 is WARNING: WARNING: Puppet is currently disabled, message: Universal Omega, last run 14 minutes ago with 0 failures [23:43:31] PROBLEM - mw173 PowerDNS Recursor on mw173 is CRITICAL: No response from DNS ::1 [23:43:32] PROBLEM - mw203 Puppet on mw203 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[pdns-recursor] [23:43:35] PROBLEM - mw173 Puppet on mw173 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[pdns-recursor] [23:43:53] PROBLEM - test151 PowerDNS Recursor on test151 is CRITICAL: No response from DNS ::1 [23:44:29] PROBLEM - kafka181 Puppet on kafka181 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[pdns-recursor] [23:45:10] PROBLEM - kafka181 PowerDNS Recursor on kafka181 is CRITICAL: No response from DNS ::1 [23:45:17] PROBLEM - mattermost1 PowerDNS Recursor on mattermost1 is CRITICAL: No response from DNS ::1 [23:45:43] PROBLEM - swiftobject171 Puppet on swiftobject171 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[pdns-recursor] [23:45:44] PROBLEM - swiftobject171 PowerDNS Recursor on swiftobject171 is CRITICAL: No response from DNS ::1 [23:45:53] RECOVERY - test151 PowerDNS Recursor on test151 is OK: DNS OK: 0.032 seconds response time. wikitide.net returns 2602:294:0:b13::110,38.46.223.205