[00:01:13] [02statichelp] 07WikiTideBot pushed 1 new commit to 03main 13https://github.com/miraheze/statichelp/commit/0c4335c9d160b6b69f0364e108b2b3e3aed5c103 [00:01:13] 02statichelp/03main 07WikiTideBot 030c4335c Bot: Auto-update Tech namespace pages 2025-08-04 00:01:10 [00:05:22] RECOVERY - cp171 Disk Space on cp171 is OK: DISK OK - free space: / 57467MiB (12% inode=99%); [00:06:04] RECOVERY - cp191 Disk Space on cp191 is OK: DISK OK - free space: / 57921MiB (12% inode=99%); [00:07:01] RECOVERY - cp201 Disk Space on cp201 is OK: DISK OK - free space: / 57174MiB (12% inode=99%); [00:26:23] PROBLEM - db182 Puppet on db182 is WARNING: WARNING: Puppet is currently disabled, message: Universal Omega, last run 6 minutes ago with 0 failures [00:32:46] PROBLEM - matomo151 Check unit status of matomo-archiver-3 on matomo151 is CRITICAL: CRITICAL: Status of the systemd unit matomo-archiver-3 [00:33:01] matonooooooo [00:33:14] PROBLEM - matomo151 Check unit status of matomo-archiver-1 on matomo151 is CRITICAL: CRITICAL: Status of the systemd unit matomo-archiver-1 [00:34:00] PROBLEM - matomo151 Check unit status of matomo-archiver-2 on matomo151 is CRITICAL: CRITICAL: Status of the systemd unit matomo-archiver-2 [00:40:24] matodead [00:40:31] mato mato [00:42:22] RECOVERY - db182 Puppet on db182 is OK: OK: Puppet is currently enabled, last run 12 seconds ago with 0 failures [00:52:08] !log [skye@test151] starting deploy of {'l10n': True, 'versions': '1.44'} to test151 [00:52:12] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:53:50] nice [00:53:54] that fixed the tracking category message [00:54:51] cc @posix_memalign ^ [00:57:05] !log [skye@test151] finished deploy of {'l10n': True, 'versions': '1.44'} to test151 - SUCCESS in 297s [00:57:09] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:00:56] cccccbtgtdbgtfclgbekbglntggjjdtjhihilgdkejen [01:03:10] keysmasher [01:05:23] no i short tapped my yubikey LMAO [01:05:30] dont give me things to press [01:05:39] (dw i already regenerated it) [01:06:17] for my discord citizens i deleted the message cause heck y'all in particular [01:06:27] > [04/08/2025 11:05] (dw i already regenerated it) [01:06:31] i had to manually verify it :p [01:06:42] h o w [01:06:44] also, you can move the yuriotp to the second slot [01:06:47] https://demo.yubico.com/otp/verify [01:06:52] this is how to verify lol [01:08:28] i keep an hmac challenge on slot 1, and yuriotp on slot 2 [01:08:35] slower to use the yuri, yes, but i don't do it that often anyway :p [01:08:40] plus, i like to fidget with my keys [01:12:32] i told my dumbass key to not press enter right after lmao [01:12:42] problem solved [01:13:06] oh lol [01:13:26] you have to upload the new yuriotp to the yuricloud servers btw [01:13:34] ya :3 [01:23:40] RECOVERY - puppet181 Puppet on puppet181 is OK: OK: Puppet is currently enabled, last run 6 seconds ago with 0 failures [01:26:38] RECOVERY - mw172 Puppet on mw172 is OK: OK: Puppet is currently enabled, last run 7 seconds ago with 0 failures [01:26:38] RECOVERY - mw182 Puppet on mw182 is OK: OK: Puppet is currently enabled, last run 7 seconds ago with 0 failures [01:26:40] RECOVERY - mw203 Puppet on mw203 is OK: OK: Puppet is currently enabled, last run 10 seconds ago with 0 failures [01:26:50] RECOVERY - mw153 Puppet on mw153 is OK: OK: Puppet is currently enabled, last run 21 seconds ago with 0 failures [01:26:50] RECOVERY - mwtask161 Puppet on mwtask161 is OK: OK: Puppet is currently enabled, last run 20 seconds ago with 0 failures [01:26:58] RECOVERY - mw152 Puppet on mw152 is OK: OK: Puppet is currently enabled, last run 26 seconds ago with 0 failures [01:27:14] RECOVERY - mw193 Puppet on mw193 is OK: OK: Puppet is currently enabled, last run 41 seconds ago with 0 failures [01:27:20] RECOVERY - mw162 Puppet on mw162 is OK: OK: Puppet is currently enabled, last run 50 seconds ago with 0 failures [01:27:21] RECOVERY - mwtask171 Puppet on mwtask171 is OK: OK: Puppet is currently enabled, last run 50 seconds ago with 0 failures [01:27:27] RECOVERY - mw171 Puppet on mw171 is OK: OK: Puppet is currently enabled, last run 57 seconds ago with 0 failures [01:27:28] RECOVERY - mw191 Puppet on mw191 is OK: OK: Puppet is currently enabled, last run 57 seconds ago with 0 failures [01:27:30] woa [01:27:33] RECOVERY - mw151 Puppet on mw151 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [01:27:39] RECOVERY - mw201 Puppet on mw201 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [01:27:39] RECOVERY - mw161 Puppet on mw161 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [01:27:40] RECOVERY - mw202 Puppet on mw202 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [01:27:45] RECOVERY - mw192 Puppet on mw192 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [01:27:45] RECOVERY - mw173 Puppet on mw173 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [01:28:04] RECOVERY - mw181 Puppet on mw181 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [01:28:05] RECOVERY - test151 Puppet on test151 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [01:28:06] RECOVERY - mwtask151 Puppet on mwtask151 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [01:28:15] RECOVERY - mw183 Puppet on mw183 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [01:28:29] RECOVERY - mw163 Puppet on mw163 is OK: OK: Puppet is currently enabled, last run 15 seconds ago with 0 failures [01:28:40] RECOVERY - mwtask181 Puppet on mwtask181 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [01:28:52] !log regenerated & readded cloudflare tokens that got purged from private puppet then run puppet on mw* with salt-ssh [01:28:55] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:29:23] !log upgraded kernal and all packages on matomo151 and reboot (a couple hours ago) [01:29:26] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:31:00] !log added hack (https://issue-tracker.miraheze.org/T14092#282388) to Matomo and restarted php8.2-fpm (about an hour ago) [01:31:03] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:32:59] Productive day lol. But I think im calling it a day and going off for now [01:56:22] !log [macfan@mwtask181] sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php /srv/mediawiki/1.43/maintenance/importDump.php --wiki=totallyhenchwomenwiki dump.xml --no-updates (START) [01:56:26] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [02:03:11] !log [macfan@mwtask181] sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php /srv/mediawiki/1.43/maintenance/importDump.php --wiki=totallyhenchwomenwiki dump.xml --no-updates (END - exit=0) [02:03:12] !log [macfan@mwtask181] sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php /srv/mediawiki/1.43/maintenance/rebuildall.php --wiki=totallyhenchwomenwiki (START) [02:03:14] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [02:03:17] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [02:05:55] !log [macfan@mwtask181] sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php /srv/mediawiki/1.43/maintenance/rebuildall.php --wiki=totallyhenchwomenwiki (END - exit=0) [02:05:56] !log [macfan@mwtask181] sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php /srv/mediawiki/1.43/maintenance/initSiteStats.php --wiki=totallyhenchwomenwiki --update (END - exit=0) [02:05:59] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [02:06:03] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [04:43:33] PROBLEM - cp161 HTTP 4xx/5xx ERROR Rate on cp161 is WARNING: WARNING - NGINX Error Rate is 55% [04:55:33] RECOVERY - cp161 HTTP 4xx/5xx ERROR Rate on cp161 is OK: OK - NGINX Error Rate is 7% [05:29:02] PROBLEM - phorge171 Puppet on phorge171 is WARNING: WARNING: Puppet is currently disabled, message: Universal Omega, last run 15 minutes ago with 0 failures [05:30:11] !log upgraded arcanist and phorge on phorge171 [05:30:15] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:31:03] RECOVERY - phorge171 Puppet on phorge171 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [05:32:10] !log upgraded kernel and all packages and rebooted phorge171 [05:32:13] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [08:01:14] RECOVERY - matomo151 Check unit status of matomo-archiver-1 on matomo151 is OK: OK: Status of the systemd unit matomo-archiver-1 [08:02:00] RECOVERY - matomo151 Check unit status of matomo-archiver-2 on matomo151 is OK: OK: Status of the systemd unit matomo-archiver-2 [08:02:46] RECOVERY - matomo151 Check unit status of matomo-archiver-3 on matomo151 is OK: OK: Status of the systemd unit matomo-archiver-3 [09:56:46] PROBLEM - matomo151 Check unit status of matomo-archiver-3 on matomo151 is CRITICAL: CRITICAL: Status of the systemd unit matomo-archiver-3 [10:19:01] PROBLEM - cp201 Disk Space on cp201 is WARNING: DISK WARNING - free space: / 49830MiB (10% inode=99%); [10:41:22] PROBLEM - cp171 Disk Space on cp171 is WARNING: DISK WARNING - free space: / 49863MiB (10% inode=99%); [11:18:04] PROBLEM - cp191 Disk Space on cp191 is WARNING: DISK WARNING - free space: / 49945MiB (10% inode=99%); [11:23:23] [02mediawiki-repos] 07SomeMWDev created 03lakeus-branch (+1 new commit) 13https://github.com/miraheze/mediawiki-repos/commit/657f70a2ae80 [11:23:23] 02mediawiki-repos/03lakeus-branch 07SomeRandomDeveloper 03657f70a Use REL_ branches for Lakeus [11:23:46] [02mediawiki-repos] 07SomeMWDev opened pull request #84: Use REL_ branches for Lakeus (03main...03lakeus-branch) 13https://github.com/miraheze/mediawiki-repos/pull/84 [11:27:30] [02mediawiki-repos] 07coderabbitai[bot] commented on pull request #84:

[…] 13https://github.com/miraheze/mediawiki-repos/pull/84#issuecomment-3150223723 [11:28:28] [02mediawiki-repos] 07SomeMWDev merged pull request #84: Use REL_ branches for Lakeus (03main...03lakeus-branch) 13https://github.com/miraheze/mediawiki-repos/pull/84 [11:28:29] [02mediawiki-repos] 07SomeMWDev pushed 1 new commit to 03main 13https://github.com/miraheze/mediawiki-repos/commit/5732e0d80a675f1cebadd022c1b20db1a5d345f1 [11:28:29] 02mediawiki-repos/03main 07SomeRandomDeveloper 035732e0d Use REL_ branches for Lakeus (#84) [11:28:30] [02mediawiki-repos] 07SomeMWDev 04deleted 03lakeus-branch at 03657f70a 13https://api.github.com/repos/miraheze/mediawiki-repos/commit/657f70a [11:45:48] !log ran "sudo -u www-data rm -rf /srv/mediawiki-staging/{1.43,1.44}/skins/Lakeus" on test151 and ran puppet afterwards [11:45:51] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [11:47:37] !log ran "sudo -u www-data rm -rf /srv/mediawiki-staging/{1.43,1.44}/skins/Lakeus" on mwtask181 and ran puppet afterwards [11:47:40] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [11:58:00] !log [somerandomdeveloper@test151] starting deploy of {'versions': '1.44', 'upgrade_extensions': ['OreDict', 'Tilesheets']} to test151 [11:58:02] !log [somerandomdeveloper@test151] finished deploy of {'versions': '1.44', 'upgrade_extensions': ['OreDict', 'Tilesheets']} to test151 - SUCCESS in 1s [11:58:03] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [11:58:06] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [11:58:27] !log [somerandomdeveloper@mwtask181] starting deploy of {'versions': '1.44', 'upgrade_extensions': ['OreDict', 'Tilesheets']} to all [11:58:30] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [11:59:15] !log [somerandomdeveloper@mwtask181] finished deploy of {'versions': '1.44', 'upgrade_extensions': ['OreDict', 'Tilesheets']} to all - SUCCESS in 49s [11:59:19] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:13:05] [02DiscordNotifications] 07translatewiki pushed 1 new commit to 03main 13https://github.com/miraheze/DiscordNotifications/commit/b1c47125b22874628f3459e069561ad267bbc112 [12:13:05] 02DiscordNotifications/03main 07translatewiki.net 03b1c4712 Localisation updates from https://translatewiki.net. [12:13:06] [02GlobalNewFiles] 07translatewiki pushed 1 new commit to 03main 13https://github.com/miraheze/GlobalNewFiles/commit/3a2df8ae1831f575b988eeb67fac05d967691b54 [12:13:07] 02GlobalNewFiles/03main 07translatewiki.net 033a2df8a Localisation updates from https://translatewiki.net. [12:13:08] [02ErrorPages] 07translatewiki pushed 1 new commit to 03main 13https://github.com/miraheze/ErrorPages/commit/04c3719b2249275b16805097e6508e4ee9b14a80 [12:13:10] [02ImportDump] 07translatewiki pushed 1 new commit to 03main 13https://github.com/miraheze/ImportDump/commit/3700d32036f4d3aa40ca0fe6c1555abe01b8bab7 [12:13:13] [02DataDump] 07translatewiki pushed 1 new commit to 03main 13https://github.com/miraheze/DataDump/commit/a08324aa40b6776d3befaa88e8acd48ac374da13 [12:13:15] [02landing] 07translatewiki pushed 1 new commit to 03main 13https://github.com/miraheze/landing/commit/cb7c4874c2c41dcd86b6edcb27e6e92bef43664a [12:13:16] 02ErrorPages/03main 07translatewiki.net 0304c3719 Localisation updates from https://translatewiki.net. [12:13:18] [02RequestSSL] 07translatewiki pushed 1 new commit to 03main 13https://github.com/miraheze/RequestSSL/commit/679b43f649898eddb11ce287787c3d4f4206924c [12:13:20] 02ImportDump/03main 07translatewiki.net 033700d32 Localisation updates from https://translatewiki.net. [12:13:22] [02ManageWiki] 07translatewiki pushed 1 new commit to 03main 13https://github.com/miraheze/ManageWiki/commit/3d8443e0bd628d8ecab0a78ed315aafc74b7111b [12:13:24] [02MirahezeMagic] 07translatewiki pushed 1 new commit to 03main 13https://github.com/miraheze/MirahezeMagic/commit/4c1521f2abd2c459e9a0ea474e7a656558af028e [12:13:26] [02WikiDiscover] 07translatewiki pushed 1 new commit to 03main 13https://github.com/miraheze/WikiDiscover/commit/bb8de956b5857ebffd79bc2a2c38569e3f56daa2 [12:13:27] 02DataDump/03main 07translatewiki.net 03a08324a Localisation updates from https://translatewiki.net. [12:13:29] 02landing/03main 07translatewiki.net 03cb7c487 Localisation updates from https://translatewiki.net. [12:13:30] 02RequestSSL/03main 07translatewiki.net 03679b43f Localisation updates from https://translatewiki.net. [12:13:32] 02ManageWiki/03main 07translatewiki.net 033d8443e Localisation updates from https://translatewiki.net. [12:13:33] 02MirahezeMagic/03main 07translatewiki.net 034c1521f Localisation updates from https://translatewiki.net. [12:13:35] 02WikiDiscover/03main 07translatewiki.net 03bb8de95 Localisation updates from https://translatewiki.net. [12:17:20] miraheze/landing - translatewiki the build passed. [12:17:27] miraheze/ErrorPages - translatewiki the build passed. [12:17:56] miraheze/DataDump - translatewiki the build passed. [12:18:03] miraheze/GlobalNewFiles - translatewiki the build passed. [12:18:41] miraheze/ManageWiki - translatewiki the build passed. [12:21:23] miraheze/WikiDiscover - translatewiki the build passed. [12:25:30] miraheze/MirahezeMagic - translatewiki the build passed. [12:31:16] miraheze/ImportDump - translatewiki the build passed. [12:31:42] miraheze/RequestSSL - translatewiki the build passed. [12:50:50] miraheze/DiscordNotifications - translatewiki the build passed. [13:33:22] PROBLEM - infectowiki.com - Cloudflare on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:45:32] [02ssl] 07WikiTideBot pushed 1 new commit to 03main 13https://github.com/miraheze/ssl/commit/ad1edd20a1a1220a400f3e6dba5a312095eb1d28 [15:45:32] 02ssl/03main 07WikiTideBot 03ad1edd2 Automatic: Updating domain lists in Cloudflare and WikiDiscover (listdomains.py) [16:02:46] RECOVERY - matomo151 Check unit status of matomo-archiver-3 on matomo151 is OK: OK: Status of the systemd unit matomo-archiver-3 [16:16:56] [02ssl] 07MacFan4000 pushed 1 new commit to 03main 13https://github.com/miraheze/ssl/commit/7a4db8c70471420d8fdb21ee0b6e6bdf36a6a4d4 [16:16:56] 02ssl/03main 07MacFan4000 037a4db8c Update certs.yaml [17:30:38] RECOVERY - infectowiki.com - Cloudflare on sslhost is OK: OK - Certificate 'infectowiki.com' will expire on Sat 06 Sep 2025 02:44:07 PM GMT +0000. [18:07:11] [02puppet] 07Universal-Omega created 03matomo-collation (+1 new commit) 13https://github.com/miraheze/puppet/commit/80118cdca76e [18:07:11] 02puppet/03matomo-collation 07CosmicAlpha 0380118cd matomo: set collation [18:08:14] [02puppet] 07Universal-Omega opened pull request #4464: matomo: set collation (03main...03matomo-collation) 13https://github.com/miraheze/puppet/pull/4464 [18:08:20] [02puppet] 07coderabbitai[bot] commented on pull request #4464:

[…] 13https://github.com/miraheze/puppet/pull/4464#issuecomment-3151859652 [18:18:15] [02puppet] 07Universal-Omega merged pull request #4464: matomo: set collation (03main...03matomo-collation) 13https://github.com/miraheze/puppet/pull/4464 [18:18:16] [02puppet] 07Universal-Omega pushed 1 new commit to 03main 13https://github.com/miraheze/puppet/commit/c00766ad6c4c693d69ada96c1349dac0ae98953f [18:18:16] 02puppet/03main 07CosmicAlpha 03c00766a matomo: set collation… [18:18:16] [02puppet] 07Universal-Omega 04deleted 03matomo-collation at 0380118cd 13https://api.github.com/repos/miraheze/puppet/commit/80118cd [18:23:02] !log remove local hack from matomo after applying https://github.com/miraheze/puppet/pull/4464 and restart php8.2-fpm [18:23:02] [GitHub] [miraheze/puppet #4464] merged PR by Universal-Omega, created 14 minutes, 51 seconds ago: matomo: set collation | * [T14092](https://issue-tracker.miraheze.org/T14092) […] [18:23:06] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:23:46] @abaddriverlol ^ hopefully it works lol [18:25:39] [02ssl] 07WikiTideBot pushed 1 new commit to 03main 13https://github.com/miraheze/ssl/commit/0f0b30d57b2580139e1cecc43094a78d22f3d621 [18:25:40] 02ssl/03main 07WikiTideBot 030f0b30d Automatic: Updating domain lists in Cloudflare and WikiDiscover (listdomains.py) [18:50:14] [02puppet] 07MacFan4000 opened pull request #4465: add SSL checks based on the cloudflare_domains file (07miraheze:03main...07MacFan4000:03patch-62) 13https://github.com/miraheze/puppet/pull/4465 [18:54:32] [02puppet] 07coderabbitai[bot] commented on pull request #4465:

[…] 13https://github.com/miraheze/puppet/pull/4465#issuecomment-3151982433 [18:55:40] PROBLEM - cp171 Puppet on cp171 is WARNING: WARNING: Puppet is currently disabled, message: Universal Omega, last run 15 minutes ago with 0 failures [18:55:42] PROBLEM - db161 Puppet on db161 is WARNING: WARNING: Puppet is currently disabled, message: Universal Omega, last run 11 minutes ago with 0 failures [18:55:44] PROBLEM - mem201 Puppet on mem201 is WARNING: WARNING: Puppet is currently disabled, message: Universal Omega, last run 19 minutes ago with 0 failures [18:55:44] PROBLEM - cloud20 Puppet on cloud20 is WARNING: WARNING: Puppet is currently disabled, message: Universal Omega, last run 23 minutes ago with 0 failures [18:55:45] PROBLEM - changeprop201 Puppet on changeprop201 is WARNING: WARNING: Puppet is currently disabled, message: Universal Omega, last run 29 minutes ago with 0 failures [18:55:49] PROBLEM - cloud18 Puppet on cloud18 is WARNING: WARNING: Puppet is currently disabled, message: Universal Omega, last run 3 minutes ago with 0 failures [18:55:50] PROBLEM - mwtask151 Puppet on mwtask151 is WARNING: WARNING: Puppet is currently disabled, message: Universal Omega, last run 12 minutes ago with 0 failures [18:55:51] PROBLEM - mw182 Puppet on mw182 is WARNING: WARNING: Puppet is currently disabled, message: Universal Omega, last run 20 minutes ago with 0 failures [18:55:54] PROBLEM - mwtask161 Puppet on mwtask161 is WARNING: WARNING: Puppet is currently disabled, message: Universal Omega, last run 14 minutes ago with 0 failures [18:55:55] PROBLEM - swiftobject151 Puppet on swiftobject151 is WARNING: WARNING: Puppet is currently disabled, message: Universal Omega, last run 24 minutes ago with 0 failures [18:55:56] PROBLEM - os201 Puppet on os201 is WARNING: WARNING: Puppet is currently disabled, message: Universal Omega, last run 11 minutes ago with 0 failures [18:55:58] PROBLEM - swiftac171 Puppet on swiftac171 is WARNING: WARNING: Puppet is currently disabled, message: Universal Omega, last run 12 minutes ago with 0 failures [18:55:59] PROBLEM - mw202 Puppet on mw202 is WARNING: WARNING: Puppet is currently disabled, message: Universal Omega, last run 17 minutes ago with 0 failures [18:56:00] PROBLEM - mw173 Puppet on mw173 is WARNING: WARNING: Puppet is currently disabled, message: Universal Omega, last run 12 minutes ago with 0 failures [18:56:00] PROBLEM - swiftproxy171 Puppet on swiftproxy171 is WARNING: WARNING: Puppet is currently disabled, message: Universal Omega, last run 16 minutes ago with 0 failures [18:56:01] [02puppet] 07Universal-Omega merged pull request #4413: Cleanup and normalize backups (03main...03backups-cleanup) 13https://github.com/miraheze/puppet/pull/4413 [18:56:01] [02puppet] 07Universal-Omega pushed 1 new commit to 03main 13https://github.com/miraheze/puppet/commit/26bee56b6369fdd90141314d72843e54747314ba [18:56:01] 02puppet/03main 07CosmicAlpha 0326bee56 Cleanup and normalize backups [18:56:03] [02puppet] 07Universal-Omega 04deleted 03backups-cleanup at 03689541f 13https://api.github.com/repos/miraheze/puppet/commit/689541f [18:56:05] PROBLEM - bots171 Puppet on bots171 is WARNING: WARNING: Puppet is currently disabled, message: Universal Omega, last run 2 minutes ago with 0 failures [18:56:07] PROBLEM - mw151 Puppet on mw151 is WARNING: WARNING: Puppet is currently disabled, message: Universal Omega, last run 28 minutes ago with 0 failures [18:56:08] PROBLEM - mwtask171 Puppet on mwtask171 is WARNING: WARNING: Puppet is currently disabled, message: Universal Omega, last run 14 minutes ago with 0 failures [18:56:09] PROBLEM - mwtask181 Puppet on mwtask181 is WARNING: WARNING: Puppet is currently disabled, message: Universal Omega, last run 22 minutes ago with 0 failures [18:56:09] PROBLEM - ns1 Puppet on ns1 is WARNING: WARNING: Puppet is currently disabled, message: Universal Omega, last run 9 minutes ago with 0 failures [18:56:11] [02ssl] 07MacFan4000 created 03MacFan4000-patch-1 (+1 new commit) 13https://github.com/miraheze/ssl/commit/b4b06872ac5d [18:56:11] 02ssl/03MacFan4000-patch-1 07MacFan4000 03b4b0687 remove most from certs.yaml [18:56:17] [02ssl] 07MacFan4000 opened pull request #880: remove most from certs.yaml (03main...03MacFan4000-patch-1) 13https://github.com/miraheze/ssl/pull/880 [18:56:21] PROBLEM - mw192 Puppet on mw192 is WARNING: WARNING: Puppet is currently disabled, message: Universal Omega, last run 30 minutes ago with 0 failures [18:56:26] PROBLEM - prometheus151 Puppet on prometheus151 is WARNING: WARNING: Puppet is currently disabled, message: Universal Omega, last run 20 minutes ago with 0 failures [18:56:26] PROBLEM - mw172 Puppet on mw172 is WARNING: WARNING: Puppet is currently disabled, message: Universal Omega, last run 16 minutes ago with 0 failures [18:56:28] PROBLEM - mattermost1 Puppet on mattermost1 is WARNING: WARNING: Puppet is currently disabled, message: Universal Omega, last run 27 minutes ago with 0 failures [18:56:29] PROBLEM - db181 Puppet on db181 is WARNING: WARNING: Puppet is currently disabled, message: Universal Omega, last run 28 minutes ago with 0 failures [18:56:29] PROBLEM - graylog161 Puppet on graylog161 is WARNING: WARNING: Puppet is currently disabled, message: Universal Omega, last run 29 minutes ago with 0 failures [18:56:32] PROBLEM - matomo151 Puppet on matomo151 is WARNING: WARNING: Puppet is currently disabled, message: Universal Omega, last run 20 minutes ago with 0 failures [18:56:32] PROBLEM - mw171 Puppet on mw171 is WARNING: WARNING: Puppet is currently disabled, message: Universal Omega, last run 5 minutes ago with 0 failures [18:56:34] PROBLEM - swiftproxy161 Puppet on swiftproxy161 is WARNING: WARNING: Puppet is currently disabled, message: Universal Omega, last run 19 minutes ago with 0 failures [18:56:35] PROBLEM - eventgate181 Puppet on eventgate181 is WARNING: WARNING: Puppet is currently disabled, message: Universal Omega, last run 17 minutes ago with 0 failures [18:56:37] PROBLEM - mw152 Puppet on mw152 is WARNING: WARNING: Puppet is currently disabled, message: Universal Omega, last run 22 minutes ago with 0 failures [18:56:38] PROBLEM - mw203 Puppet on mw203 is WARNING: WARNING: Puppet is currently disabled, message: Universal Omega, last run 15 minutes ago with 0 failures [18:56:39] PROBLEM - ldap171 Puppet on ldap171 is WARNING: WARNING: Puppet is currently disabled, message: Universal Omega, last run 22 minutes ago with 0 failures [18:56:40] PROBLEM - db171 Puppet on db171 is WARNING: WARNING: Puppet is currently disabled, message: Universal Omega, last run 8 minutes ago with 0 failures [18:56:42] PROBLEM - bast161 Puppet on bast161 is WARNING: WARNING: Puppet is currently disabled, message: Universal Omega, last run 17 minutes ago with 0 failures [18:56:45] PROBLEM - swiftobject201 Puppet on swiftobject201 is WARNING: WARNING: Puppet is currently disabled, message: Universal Omega, last run 15 minutes ago with 0 failures [18:56:47] PROBLEM - swiftobject191 Puppet on swiftobject191 is WARNING: WARNING: Puppet is currently disabled, message: Universal Omega, last run 15 minutes ago with 0 failures [18:56:49] PROBLEM - swiftobject171 Puppet on swiftobject171 is WARNING: WARNING: Puppet is currently disabled, message: Universal Omega, last run 31 minutes ago with 0 failures [18:56:52] PROBLEM - swiftobject161 Puppet on swiftobject161 is WARNING: WARNING: Puppet is currently disabled, message: Universal Omega, last run 25 minutes ago with 0 failures [18:56:53] PROBLEM - cp161 Puppet on cp161 is WARNING: WARNING: Puppet is currently disabled, message: Universal Omega, last run 31 minutes ago with 0 failures [18:56:53] PROBLEM - bast181 Puppet on bast181 is WARNING: WARNING: Puppet is currently disabled, message: Universal Omega, last run 23 minutes ago with 0 failures [18:56:53] PROBLEM - mw183 Puppet on mw183 is WARNING: WARNING: Puppet is currently disabled, message: Universal Omega, last run 21 minutes ago with 0 failures [18:56:53] PROBLEM - mw191 Puppet on mw191 is WARNING: WARNING: Puppet is currently disabled, message: Universal Omega, last run 5 minutes ago with 0 failures [18:56:54] PROBLEM - db182 Puppet on db182 is WARNING: WARNING: Puppet is currently disabled, message: Universal Omega, last run 7 minutes ago with 0 failures [18:56:55] PROBLEM - cloud19 Puppet on cloud19 is WARNING: WARNING: Puppet is currently disabled, message: Universal Omega, last run 6 minutes ago with 0 failures [18:57:01] PROBLEM - mw201 Puppet on mw201 is WARNING: WARNING: Puppet is currently disabled, message: Universal Omega, last run 23 minutes ago with 0 failures [18:57:02] PROBLEM - os151 Puppet on os151 is WARNING: WARNING: Puppet is currently disabled, message: Universal Omega, last run 10 minutes ago with 0 failures [18:57:06] PROBLEM - mem161 Puppet on mem161 is WARNING: WARNING: Puppet is currently disabled, message: Universal Omega, last run 16 minutes ago with 0 failures [18:57:06] PROBLEM - db151 Puppet on db151 is WARNING: WARNING: Puppet is currently disabled, message: Universal Omega, last run 26 minutes ago with 0 failures [18:57:11] PROBLEM - cloud16 Puppet on cloud16 is WARNING: WARNING: Puppet is currently disabled, message: Universal Omega, last run 11 minutes ago with 0 failures [18:57:11] PROBLEM - os191 Puppet on os191 is WARNING: WARNING: Puppet is currently disabled, message: Universal Omega, last run 27 minutes ago with 0 failures [18:57:12] PROBLEM - mw163 Puppet on mw163 is WARNING: WARNING: Puppet is currently disabled, message: Universal Omega, last run 29 minutes ago with 0 failures [18:57:12] PROBLEM - cloud17 Puppet on cloud17 is WARNING: WARNING: Puppet is currently disabled, message: Universal Omega, last run 6 minutes ago with 0 failures [18:57:13] PROBLEM - cp201 Puppet on cp201 is WARNING: WARNING: Puppet is currently disabled, message: Universal Omega, last run 19 minutes ago with 0 failures [18:57:13] PROBLEM - puppet181 Puppet on puppet181 is WARNING: WARNING: Puppet is currently disabled, message: Universal Omega, last run 14 minutes ago with 0 failures [18:57:13] PROBLEM - swiftobject181 Puppet on swiftobject181 is WARNING: WARNING: Puppet is currently disabled, message: Universal Omega, last run 13 minutes ago with 0 failures [18:57:15] PROBLEM - cloud15 Puppet on cloud15 is WARNING: WARNING: Puppet is currently disabled, message: Universal Omega, last run 12 minutes ago with 0 failures [18:57:15] PROBLEM - os162 Puppet on os162 is WARNING: WARNING: Puppet is currently disabled, message: Universal Omega, last run 30 minutes ago with 0 failures [18:57:17] PROBLEM - mw153 Puppet on mw153 is WARNING: WARNING: Puppet is currently disabled, message: Universal Omega, last run 6 minutes ago with 0 failures [18:57:17] PROBLEM - mw181 Puppet on mw181 is WARNING: WARNING: Puppet is currently disabled, message: Universal Omega, last run 25 minutes ago with 0 failures [18:57:17] PROBLEM - test151 Puppet on test151 is WARNING: WARNING: Puppet is currently disabled, message: Universal Omega, last run 24 minutes ago with 0 failures [18:57:18] PROBLEM - mw161 Puppet on mw161 is WARNING: WARNING: Puppet is currently disabled, message: Universal Omega, last run 17 minutes ago with 0 failures [18:57:19] PROBLEM - mw193 Puppet on mw193 is WARNING: WARNING: Puppet is currently disabled, message: Universal Omega, last run 9 minutes ago with 0 failures [18:57:22] PROBLEM - kafka181 Puppet on kafka181 is WARNING: WARNING: Puppet is currently disabled, message: Universal Omega, last run 9 minutes ago with 0 failures [18:57:22] PROBLEM - rdb151 Puppet on rdb151 is WARNING: WARNING: Puppet is currently disabled, message: Universal Omega, last run 3 minutes ago with 0 failures [18:57:26] PROBLEM - mw162 Puppet on mw162 is WARNING: WARNING: Puppet is currently disabled, message: Universal Omega, last run 18 minutes ago with 0 failures [18:57:30] PROBLEM - db172 Puppet on db172 is WARNING: WARNING: Puppet is currently disabled, message: Universal Omega, last run 19 minutes ago with 0 failures [18:57:34] PROBLEM - mon181 Puppet on mon181 is WARNING: WARNING: Puppet is currently disabled, message: Universal Omega, last run 22 minutes ago with 0 failures [18:57:34] PROBLEM - cp191 Puppet on cp191 is WARNING: WARNING: Puppet is currently disabled, message: Universal Omega, last run 3 minutes ago with 0 failures [18:57:34] PROBLEM - os161 Puppet on os161 is WARNING: WARNING: Puppet is currently disabled, message: Universal Omega, last run 26 minutes ago with 0 failures [18:57:36] PROBLEM - mem191 Puppet on mem191 is WARNING: WARNING: Puppet is currently disabled, message: Universal Omega, last run 32 minutes ago with 0 failures [18:57:36] PROBLEM - reports171 Puppet on reports171 is WARNING: WARNING: Puppet is currently disabled, message: Universal Omega, last run 26 minutes ago with 0 failures [18:57:41] PROBLEM - phorge171 Puppet on phorge171 is WARNING: WARNING: Puppet is currently disabled, message: Universal Omega, last run 14 minutes ago with 0 failures [18:57:43] PROBLEM - mem151 Puppet on mem151 is WARNING: WARNING: Puppet is currently disabled, message: Universal Omega, last run 11 minutes ago with 0 failures [18:57:49] PROBLEM - ns2 Puppet on ns2 is WARNING: WARNING: Puppet is currently disabled, message: Universal Omega, last run 28 minutes ago with 0 failures [18:59:27] [02puppet] 07Universal-Omega pushed 1 new commit to 03main 13https://github.com/miraheze/puppet/commit/70656cb7386bd142c33a58eadbc73b01fb525253 [18:59:27] 02puppet/03main 07CosmicAlpha 0370656cb Fix [18:59:41] PROBLEM - phorge171 Puppet on phorge171 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [19:00:41] [02ssl] 07MacFan4000 merged pull request #880: remove most from certs.yaml (03main...03MacFan4000-patch-1) 13https://github.com/miraheze/ssl/pull/880 [19:00:42] [02ssl] 07MacFan4000 pushed 1 new commit to 03main 13https://github.com/miraheze/ssl/commit/18dd5e7f34e6b5492f249bbb8996814ace39faf4 [19:00:42] 02ssl/03main 07MacFan4000 0318dd5e7 remove most from certs.yaml (#880) [19:00:42] [02ssl] 07MacFan4000 04deleted 03MacFan4000-patch-1 at 03b4b0687 13https://api.github.com/repos/miraheze/ssl/commit/b4b0687 [19:01:41] RECOVERY - phorge171 Puppet on phorge171 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [19:04:28] RECOVERY - mattermost1 Puppet on mattermost1 is OK: OK: Puppet is currently enabled, last run 50 seconds ago with 0 failures [19:08:32] RECOVERY - matomo151 Puppet on matomo151 is OK: OK: Puppet is currently enabled, last run 32 seconds ago with 0 failures [19:09:58] RECOVERY - swiftac171 Puppet on swiftac171 is OK: OK: Puppet is currently enabled, last run 13 seconds ago with 0 failures [19:13:44] !log swiftac171: sudo systemctl disable --now backups-swift-account-container.timer && sudo rm -f /etc/systemd/system/backups-swift-account-container.timer /lib/systemd/system/backups-swift-account-container.timer /usr/lib/systemd/system/backups-swift-account-container.timer [19:13:46] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:15:10] RECOVERY - puppet181 Puppet on puppet181 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [19:19:36] !log puppet181: sudo systemctl disable --now backups-private.timer && sudo rm -f /etc/systemd/system/backups-private.{timer,service} /lib/systemd/system/backups-private.{timer,service} /usr/lib/systemd/system/backups-private.{timer,service} && sudo systemctl daemon-reload [19:19:39] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:20:05] !log puppet181: sudo systemctl disable --now backups-sslkeys.timer && sudo rm -f /etc/systemd/system/backups-sslkeys.{timer,service} /lib/systemd/system/backups-sslkeys.{timer,service} /usr/lib/systemd/system/backups-sslkeys.{timer,service} && sudo systemctl daemon-reload [19:20:08] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:21:32] PROBLEM - matomo151 Check unit status of matomo-archiver-2 on matomo151 is CRITICAL: CRITICAL: Status of the systemd unit matomo-archiver-2 [19:23:29] PROBLEM - db172 Puppet on db172 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 1 minute ago with 1 failures. Failed resources (up to 3 shown): File[/var/log/sql-backups/sql-backup] [19:25:44] !log db172: sudo systemctl disable --now db-backups.timer && sudo rm -f /etc/systemd/system/db-backups.{timer,service} /lib/systemd/system/db-backups.{timer,service} /usr/lib/systemd/system/db-backups.{timer,service} && sudo systemctl daemon-reload [19:25:47] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:30:43] [02puppet] 07Universal-Omega pushed 1 new commit to 03main 13https://github.com/miraheze/puppet/commit/09ff06066a023e6baf3717f83ac04933975c6c08 [19:30:43] 02puppet/03main 07CosmicAlpha 0309ff060 syslog: set recurse for log directories [19:36:58] [02puppet] 07Universal-Omega pushed 1 new commit to 03main 13https://github.com/miraheze/puppet/commit/b1017424785c5cd12a3d72a77f412769331c16b3 [19:36:58] 02puppet/03main 07CosmicAlpha 03b101742 syslog: ensure base_dir [19:39:29] RECOVERY - db172 Puppet on db172 is OK: OK: Puppet is currently enabled, last run 56 seconds ago with 0 failures [19:40:52] RECOVERY - db182 Puppet on db182 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [19:41:41] !log db182: sudo systemctl disable --now reports-db-backups-weekly.timer && sudo rm -f /etc/systemd/system/reports-db-backups-weekly.{timer,service} /lib/systemd/system/reports-db-backups-weekly.{timer,service} /usr/lib/systemd/system/reports-db-backups-weekly.{timer,service} && sudo systemctl daemon-reload [19:41:45] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:42:52] !log db182: sudo systemctl disable --now icinga-db-backups-fortnightly.timer && sudo rm -f /etc/systemd/system/icinga-db-backups-fortnightly.{timer,service} /lib/systemd/system/icinga-db-backups-fortnightly.{timer,service} /usr/lib/systemd/system/icinga-db-backups-fortnightly.{timer,service} && sudo systemctl daemon-reload [19:42:55] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:44:14] !log db182: sudo systemctl disable --now icingaweb2-db-backups-fortnightly.timer && sudo rm -f /etc/systemd/system/icingaweb2-db-backups-fortnightly.{timer,service} /lib/systemd/system/icingaweb2-db-backups-fortnightly.{timer,service} /usr/lib/systemd/system/icingaweb2-db-backups-fortnightly.{timer,service} && sudo systemctl daemon-reload [19:44:17] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:47:01] RECOVERY - db151 Puppet on db151 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [19:47:06] !log db151: sudo systemctl disable --now db-backups.timer && sudo rm -f /etc/systemd/system/db-backups.{timer,service} /lib/systemd/system/db-backups.{timer,service} /usr/lib/systemd/system/db-backups.{timer,service} && sudo systemctl daemon-reload [19:47:10] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:47:40] RECOVERY - db161 Puppet on db161 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [19:48:47] !log db161: sudo systemctl disable --now db-backups.timer && sudo rm -f /etc/systemd/system/db-backups.{timer,service} /lib/systemd/system/db-backups.{timer,service} /usr/lib/systemd/system/db-backups.{timer,service} && sudo systemctl daemon-reload [19:48:50] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:50:46] RECOVERY - db171 Puppet on db171 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [19:50:49] !log db171: sudo systemctl disable --now db-backups.timer && sudo rm -f /etc/systemd/system/db-backups.{timer,service} /lib/systemd/system/db-backups.{timer,service} /usr/lib/systemd/system/db-backups.{timer,service} && sudo systemctl daemon-reload [19:50:52] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:52:15] !log db171: sudo systemctl disable --now mhglobal-db-backups-weekly.timer && sudo rm -f /etc/systemd/system/mhglobal-db-backups-weekly.{timer,service} /lib/systemd/system/mhglobal-db-backups-weekly.{timer,service} /usr/lib/systemd/system/mhglobal-db-backups-weekly.{timer,service} && sudo systemctl daemon-reload [19:52:18] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:52:29] RECOVERY - db181 Puppet on db181 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [19:53:04] !log db181: sudo systemctl disable --now db-backups.timer && sudo rm -f /etc/systemd/system/db-backups.{timer,service} /lib/systemd/system/db-backups.{timer,service} /usr/lib/systemd/system/db-backups.{timer,service} && sudo systemctl daemon-reload [19:53:07] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:53:33] RECOVERY - cp191 Puppet on cp191 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [19:53:39] RECOVERY - cp171 Puppet on cp171 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [19:53:44] RECOVERY - changeprop201 Puppet on changeprop201 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [19:53:55] RECOVERY - cloud20 Puppet on cloud20 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [19:53:59] RECOVERY - cloud18 Puppet on cloud18 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [19:54:04] RECOVERY - bots171 Puppet on bots171 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [19:54:29] RECOVERY - graylog161 Puppet on graylog161 is OK: OK: Puppet is currently enabled, last run 8 seconds ago with 0 failures [19:54:32] RECOVERY - mw171 Puppet on mw171 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [19:54:34] RECOVERY - mw152 Puppet on mw152 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [19:54:35] RECOVERY - eventgate181 Puppet on eventgate181 is OK: OK: Puppet is currently enabled, last run 14 seconds ago with 0 failures [19:54:38] RECOVERY - mw203 Puppet on mw203 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [19:54:39] RECOVERY - ldap171 Puppet on ldap171 is OK: OK: Puppet is currently enabled, last run 19 seconds ago with 0 failures [19:54:47] RECOVERY - cloud15 Puppet on cloud15 is OK: OK: Puppet is currently enabled, last run 29 seconds ago with 0 failures [19:54:53] RECOVERY - cp161 Puppet on cp161 is OK: OK: Puppet is currently enabled, last run 29 seconds ago with 0 failures [19:54:53] RECOVERY - bast181 Puppet on bast181 is OK: OK: Puppet is currently enabled, last run 32 seconds ago with 0 failures [19:54:53] RECOVERY - mw183 Puppet on mw183 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [19:54:53] RECOVERY - mw191 Puppet on mw191 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [19:54:55] RECOVERY - cloud19 Puppet on cloud19 is OK: OK: Puppet is currently enabled, last run 37 seconds ago with 0 failures [19:54:58] RECOVERY - mw201 Puppet on mw201 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [19:55:04] RECOVERY - mem161 Puppet on mem161 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [19:55:10] RECOVERY - cloud16 Puppet on cloud16 is OK: OK: Puppet is currently enabled, last run 52 seconds ago with 0 failures [19:55:10] RECOVERY - cloud17 Puppet on cloud17 is OK: OK: Puppet is currently enabled, last run 51 seconds ago with 0 failures [19:55:10] RECOVERY - mw163 Puppet on mw163 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [19:55:10] RECOVERY - cp201 Puppet on cp201 is OK: OK: Puppet is currently enabled, last run 48 seconds ago with 0 failures [19:55:12] RECOVERY - bast161 Puppet on bast161 is OK: OK: Puppet is currently enabled, last run 51 seconds ago with 0 failures [19:55:16] RECOVERY - mw161 Puppet on mw161 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [19:55:17] RECOVERY - mw153 Puppet on mw153 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [19:55:22] RECOVERY - kafka181 Puppet on kafka181 is OK: OK: Puppet is currently enabled, last run 59 seconds ago with 0 failures [19:55:26] RECOVERY - mw162 Puppet on mw162 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [19:55:28] RECOVERY - mw193 Puppet on mw193 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [19:55:33] RECOVERY - mon181 Puppet on mon181 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [19:55:36] RECOVERY - mem191 Puppet on mem191 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [19:55:44] RECOVERY - mem201 Puppet on mem201 is OK: OK: Puppet is currently enabled, last run 6 seconds ago with 0 failures [19:55:44] RECOVERY - mem151 Puppet on mem151 is OK: OK: Puppet is currently enabled, last run 5 seconds ago with 0 failures [19:55:47] RECOVERY - mw182 Puppet on mw182 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [19:55:47] RECOVERY - mw181 Puppet on mw181 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [19:55:50] RECOVERY - mwtask151 Puppet on mwtask151 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [19:55:52] RECOVERY - mwtask161 Puppet on mwtask161 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [19:55:58] RECOVERY - mw173 Puppet on mw173 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [19:55:59] RECOVERY - mw202 Puppet on mw202 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [19:56:04] RECOVERY - mw151 Puppet on mw151 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [19:56:08] RECOVERY - mwtask171 Puppet on mwtask171 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [19:56:21] RECOVERY - mw192 Puppet on mw192 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [19:56:26] RECOVERY - mw172 Puppet on mw172 is OK: OK: Puppet is currently enabled, last run 12 seconds ago with 0 failures [19:56:35] RECOVERY - ns1 Puppet on ns1 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [19:56:35] RECOVERY - mwtask181 Puppet on mwtask181 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [19:57:18] RECOVERY - ns2 Puppet on ns2 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [19:57:40] [02puppet] 07Universal-Omega pushed 1 new commit to 03main 13https://github.com/miraheze/puppet/commit/27ced2b50939acc0ff78fdfc690f1eef798a5dbd [19:57:40] 02puppet/03main 07CosmicAlpha 0327ced2b pywikibot: set logfile_group [19:59:02] RECOVERY - os151 Puppet on os151 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [19:59:18] RECOVERY - os191 Puppet on os191 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [19:59:22] [02puppet] 07Universal-Omega pushed 1 new commit to 03main 13https://github.com/miraheze/puppet/commit/d826391818aff1f111ccec2e97dc4348f40aa4dc [19:59:22] 02puppet/03main 07CosmicAlpha 03d826391 matomo: set logfile_group [19:59:23] RECOVERY - os161 Puppet on os161 is OK: OK: Puppet is currently enabled, last run 53 seconds ago with 0 failures [19:59:56] PROBLEM - puppet181 Current Load on puppet181 is CRITICAL: LOAD CRITICAL - total load average: 24.67, 14.71, 6.44 [20:00:00] RECOVERY - os162 Puppet on os162 is OK: OK: Puppet is currently enabled, last run 52 seconds ago with 0 failures [20:00:01] RECOVERY - os201 Puppet on os201 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [20:01:27] !log [skye@mwtask181] sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php MirahezeMagic:ResetWiki --wiki=loginwiki --dbname=despairacademywiki --requester=C4yd3nnn (END - exit=0) [20:01:31] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:01:46] RECOVERY - rdb151 Puppet on rdb151 is OK: OK: Puppet is currently enabled, last run 24 seconds ago with 0 failures [20:02:18] RECOVERY - prometheus151 Puppet on prometheus151 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [20:02:50] RECOVERY - swiftobject171 Puppet on swiftobject171 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [20:03:08] RECOVERY - swiftobject151 Puppet on swiftobject151 is OK: OK: Puppet is currently enabled, last run 34 seconds ago with 0 failures [20:03:26] RECOVERY - reports171 Puppet on reports171 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [20:03:49] RECOVERY - swiftobject161 Puppet on swiftobject161 is OK: OK: Puppet is currently enabled, last run 52 seconds ago with 0 failures [20:03:53] RECOVERY - swiftproxy171 Puppet on swiftproxy171 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [20:04:35] RECOVERY - swiftproxy161 Puppet on swiftproxy161 is OK: OK: Puppet is currently enabled, last run 19 seconds ago with 0 failures [20:04:44] RECOVERY - swiftobject181 Puppet on swiftobject181 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [20:04:46]