[00:07:10] RECOVERY - cp171 Disk Space on cp171 is OK: DISK OK - free space: / 56998MiB (12% inode=99%); [00:07:22] RECOVERY - cp191 Disk Space on cp191 is OK: DISK OK - free space: / 57448MiB (12% inode=99%); [00:07:24] RECOVERY - cp201 Disk Space on cp201 is OK: DISK OK - free space: / 56706MiB (12% inode=99%); [02:23:35] miraheze/RequestSSL - dependabot[bot] the build has errored. [03:10:34] PROBLEM - matomo151 Check unit status of matomo-archiver-2 on matomo151 is CRITICAL: CRITICAL: Status of the systemd unit matomo-archiver-2 [03:23:41] miraheze/RequestSSL - Universal-Omega the build has errored. [05:09:10] PROBLEM - db182 Disk Space on db182 is WARNING: DISK WARNING - free space: / 42875MiB (9% inode=99%); [05:43:10] PROBLEM - db182 Disk Space on db182 is CRITICAL: DISK CRITICAL - free space: / 26657MiB (5% inode=99%); [05:45:10] PROBLEM - db182 Disk Space on db182 is WARNING: DISK WARNING - free space: / 38859MiB (8% inode=99%); [06:31:10] PROBLEM - db182 Disk Space on db182 is CRITICAL: DISK CRITICAL - free space: / 23408MiB (5% inode=99%); [06:35:10] RECOVERY - db182 Disk Space on db182 is OK: DISK OK - free space: / 170744MiB (37% inode=99%); [07:39:27] "the build has errored" thats ominous [07:58:45] It will be fixed when we move to 1.44 I broke CreateWiki's CI until then so all the dependents of it fail right now. [08:02:34] RECOVERY - matomo151 Check unit status of matomo-archiver-2 on matomo151 is OK: OK: Status of the systemd unit matomo-archiver-2 [08:15:24] PROBLEM - cp201 Disk Space on cp201 is WARNING: DISK WARNING - free space: / 49825MiB (10% inode=99%); [08:23:00] ight [08:41:10] PROBLEM - cp171 Disk Space on cp171 is WARNING: DISK WARNING - free space: / 49859MiB (10% inode=99%); [09:03:22] PROBLEM - cp191 Disk Space on cp191 is WARNING: DISK WARNING - free space: / 49923MiB (10% inode=99%); [10:21:11] [02mw-config] 07snowfleaf opened pull request #6038: Fixes my mistake on T14052 (07miraheze:03main...07snowfleaf:03patch-1) 13https://github.com/miraheze/mw-config/pull/6038 [10:24:58] [02mw-config] 07Universal-Omega merged 07snowfleaf's pull request #6038: Fixes my mistake on T14052 (07miraheze:03main...07snowfleaf:03patch-1) 13https://github.com/miraheze/mw-config/pull/6038 [10:24:58] [02mw-config] 07Universal-Omega pushed 1 new commit to 03main 13https://github.com/miraheze/mw-config/commit/9b4ef2575a7d06dd08d6382b94287ff54c7b1a3f [10:24:58] 02mw-config/03main 07stackd 039b4ef25 Fixes my mistake on T14052 (#6038)… [10:25:33] !log [universalomega@mwtask181] starting deploy of {'pull': 'config', 'config': True} to all [10:25:36] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [10:25:42] miraheze/mw-config - snowfleaf the build passed. [10:25:54] miraheze/mw-config - Universal-Omega the build passed. [10:25:58] !log [universalomega@mwtask181] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 25s [10:26:01] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [10:30:34] PROBLEM - matomo151 Check unit status of matomo-archiver-2 on matomo151 is CRITICAL: CRITICAL: Status of the systemd unit matomo-archiver-2 [12:11:55] [02CreateWiki] 07translatewiki pushed 1 new commit to 03main 13https://github.com/miraheze/CreateWiki/commit/e62190aecbb9f5dfb2e1d383699b1b28786af974 [12:11:55] 02CreateWiki/03main 07translatewiki.net 03e62190a Localisation updates from https://translatewiki.net. [12:11:56] [02MirahezeMagic] 07translatewiki pushed 1 new commit to 03main 13https://github.com/miraheze/MirahezeMagic/commit/03100973dae22a6aefce912287c9e85813de30a5 [12:11:57] 02MirahezeMagic/03main 07translatewiki.net 030310097 Localisation updates from https://translatewiki.net. [12:11:58] [02ManageWiki] 07translatewiki pushed 1 new commit to 03main 13https://github.com/miraheze/ManageWiki/commit/5f4c1bcf4aca3bde2646cdbf9f98692609936c98 [12:12:00] 02ManageWiki/03main 07translatewiki.net 035f4c1bc Localisation updates from https://translatewiki.net. [12:16:22] miraheze/CreateWiki - translatewiki the build has errored. [12:16:38] miraheze/ManageWiki - translatewiki the build has errored. [12:17:35] miraheze/MirahezeMagic - translatewiki the build has errored. [15:39:34] [02puppet] 07RhinosF1 created 03revert-4453-RhinosF1-patch-3 (+1 new commit) 13https://github.com/miraheze/puppet/commit/4c51fda71565 [15:39:34] 02puppet/03revert-4453-RhinosF1-patch-3 07RhinosF1 034c51fda Revert "[users] rhinos: pause my ssh keys (#4453)"… [15:39:39] [02puppet] 07RhinosF1 opened pull request #4455: Revert "[users] rhinos: pause my ssh keys" (03main...03revert-4453-RhinosF1-patch-3) 13https://github.com/miraheze/puppet/pull/4455 [15:39:50] [02puppet] 07coderabbitai[bot] commented on pull request #4455:
[…] 13https://github.com/miraheze/puppet/pull/4455#issuecomment-3127822944 [16:02:34] RECOVERY - matomo151 Check unit status of matomo-archiver-2 on matomo151 is OK: OK: Status of the systemd unit matomo-archiver-2 [17:19:52] [02ssl] 07Universal-Omega created 03dpl4wiki-redirect (+1 new commit) 13https://github.com/miraheze/ssl/commit/33b355e158b6 [17:19:52] 02ssl/03dpl4wiki-redirect 07CosmicAlpha 0333b355e Redirect dpl4.wikitide.org to dpl3.wikitide.org… [17:20:05] [02ssl] 07Universal-Omega opened pull request #877: Redirect dpl4.wikitide.org to dpl3.wikitide.org (03main...03dpl4wiki-redirect) 13https://github.com/miraheze/ssl/pull/877 [17:20:30] [02ssl] 07Universal-Omega pushed 1 new commit to 03dpl4wiki-redirect 13https://github.com/miraheze/ssl/commit/63c6a1c789a0547419158020e3a1ee61b1b8c581 [17:20:31] 02ssl/03dpl4wiki-redirect 07CosmicAlpha 0363c6a1c Fix [17:21:44] [02ssl] 07coderabbitai[bot] commented on pull request #877:
[…] 13https://github.com/miraheze/ssl/pull/877#issuecomment-3128240327 [17:29:30] PROBLEM - michiscammed.us - Cloudflare on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:28:39] [02puppet] 07RhinosF1 pushed 1 new commit to 03main 13https://github.com/miraheze/puppet/commit/781545b51aba9908eec84d012ed7c5c51960deef [18:28:39] 02puppet/03main 07RhinosF1 03781545b Revert "[users] rhinos: pause my ssh keys" (#4455)… [18:28:39] [02puppet] 07RhinosF1 merged pull request #4455: Revert "[users] rhinos: pause my ssh keys" (03main...03revert-4453-RhinosF1-patch-3) 13https://github.com/miraheze/puppet/pull/4455 [18:28:40] [02puppet] 07RhinosF1 04deleted 03revert-4453-RhinosF1-patch-3 at 034c51fda 13https://api.github.com/repos/miraheze/puppet/commit/4c51fda [18:28:52] [02puppet] 07RhinosF1 pushed 1 new commit to 03concurrency 13https://github.com/miraheze/puppet/commit/d1b41950ad597c4e5f9633b0d1ca69181447f431 [18:28:52] 02puppet/03concurrency 07RhinosF1 03d1b4195 Merge branch 'main' into concurrency [18:29:02] [02puppet] 07RhinosF1 approved pull request #4452 13https://github.com/miraheze/puppet/pull/4452#pullrequestreview-3064143461 [18:30:46] PROBLEM - cp201 Varnish Backends on cp201 is CRITICAL: 1 backends are down. mw162 [18:32:46] RECOVERY - cp201 Varnish Backends on cp201 is OK: All 31 backends are healthy [19:08:09] [02puppet] 07Universal-Omega merged pull request #4452: Increase concurrency to 100 for LocalGlobalUserPageCacheUpdateJob (03main...03concurrency) 13https://github.com/miraheze/puppet/pull/4452 [19:08:11] [02puppet] 07Universal-Omega pushed 1 new commit to 03main 13https://github.com/miraheze/puppet/commit/7e00f491ef14d0c51f209657de8aad602c8c59ee [19:08:13] [02puppet] 07Universal-Omega 04deleted 03concurrency at 03d1b4195 13https://api.github.com/repos/miraheze/puppet/commit/d1b4195 [19:08:15] 02puppet/03main 07CosmicAlpha 037e00f49 Increase concurrency to 100 for LocalGlobalUserPageCacheUpdateJob (#4452) [19:29:25] PROBLEM - www.backroomszh.wiki - Cloudflare on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:51:34] PROBLEM - mw191 APT on mw191 is CRITICAL: APT CRITICAL: 84 packages available for upgrade (17 critical updates). [19:51:35] PROBLEM - mw153 APT on mw153 is CRITICAL: APT CRITICAL: 84 packages available for upgrade (17 critical updates). [19:51:57] PROBLEM - mw171 APT on mw171 is CRITICAL: APT CRITICAL: 84 packages available for upgrade (17 critical updates). [19:55:43] 17?? sheesh [19:58:40] PROBLEM - mw163 APT on mw163 is CRITICAL: APT CRITICAL: 84 packages available for upgrade (17 critical updates). [19:58:47] PROBLEM - mw192 APT on mw192 is CRITICAL: APT CRITICAL: 84 packages available for upgrade (17 critical updates). [19:58:55] RECOVERY - www.backroomszh.wiki - Cloudflare on sslhost is OK: OK - Certificate 'a248.e.akamai.net' will expire on Wed 18 Mar 2026 11:59:59 PM GMT +0000. [20:00:13] PROBLEM - mw151 APT on mw151 is CRITICAL: APT CRITICAL: 84 packages available for upgrade (17 critical updates). [20:02:45] PROBLEM - reports171 APT on reports171 is CRITICAL: APT CRITICAL: 60 packages available for upgrade (13 critical updates). [20:02:49] PROBLEM - mwtask181 APT on mwtask181 is CRITICAL: APT CRITICAL: 84 packages available for upgrade (17 critical updates). [20:03:22] PROBLEM - mw181 APT on mw181 is CRITICAL: APT CRITICAL: 84 packages available for upgrade (17 critical updates). [20:04:00] PROBLEM - test151 APT on test151 is CRITICAL: APT CRITICAL: 69 packages available for upgrade (18 critical updates). [20:04:09] PROBLEM - mw201 APT on mw201 is CRITICAL: APT CRITICAL: 84 packages available for upgrade (17 critical updates). [20:05:05] PROBLEM - mon181 APT on mon181 is CRITICAL: APT CRITICAL: 23 packages available for upgrade (16 critical updates). [20:05:51] PROBLEM - mw152 APT on mw152 is CRITICAL: APT CRITICAL: 84 packages available for upgrade (17 critical updates). [20:06:34] PROBLEM - mw183 APT on mw183 is CRITICAL: APT CRITICAL: 84 packages available for upgrade (17 critical updates). [20:07:32] PROBLEM - mw182 APT on mw182 is CRITICAL: APT CRITICAL: 84 packages available for upgrade (17 critical updates). [20:08:53] PROBLEM - matomo151 APT on matomo151 is CRITICAL: APT CRITICAL: 62 packages available for upgrade (13 critical updates). [20:09:55] PROBLEM - mw202 APT on mw202 is CRITICAL: APT CRITICAL: 84 packages available for upgrade (17 critical updates). [20:11:02] PROBLEM - mw162 APT on mw162 is CRITICAL: APT CRITICAL: 84 packages available for upgrade (17 critical updates). [20:11:34] PROBLEM - mw161 APT on mw161 is CRITICAL: APT CRITICAL: 84 packages available for upgrade (17 critical updates). [20:12:09] PROBLEM - mw172 APT on mw172 is CRITICAL: APT CRITICAL: 84 packages available for upgrade (17 critical updates). [20:12:54] PROBLEM - mwtask161 APT on mwtask161 is CRITICAL: APT CRITICAL: 84 packages available for upgrade (17 critical updates). [20:13:20] PROBLEM - mwtask171 APT on mwtask171 is CRITICAL: APT CRITICAL: 84 packages available for upgrade (17 critical updates). [20:13:42] PROBLEM - mw203 APT on mw203 is CRITICAL: APT CRITICAL: 84 packages available for upgrade (17 critical updates). [20:14:29] PROBLEM - mw173 APT on mw173 is CRITICAL: APT CRITICAL: 84 packages available for upgrade (17 critical updates). [20:14:54] PROBLEM - mwtask151 APT on mwtask151 is CRITICAL: APT CRITICAL: 84 packages available for upgrade (17 critical updates). [20:15:45] PROBLEM - phorge171 APT on phorge171 is CRITICAL: APT CRITICAL: 61 packages available for upgrade (14 critical updates). [20:18:21] PROBLEM - mw193 APT on mw193 is CRITICAL: APT CRITICAL: 84 packages available for upgrade (17 critical updates). [21:17:44] !log [somerandomdeveloper@test151] starting deploy of {'versions': '1.44', 'upgrade_extensions': 'DPLForum'} to test151 [21:17:45] !log [somerandomdeveloper@test151] finished deploy of {'versions': '1.44', 'upgrade_extensions': 'DPLForum'} to test151 - SUCCESS in 1s [21:17:46] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:17:50] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:18:12] !log [somerandomdeveloper@mwtask181] starting deploy of {'versions': '1.44', 'upgrade_extensions': 'DPLForum'} to all [21:18:16] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:18:37] !log [somerandomdeveloper@mwtask181] finished deploy of {'versions': '1.44', 'upgrade_extensions': 'DPLForum'} to all - SUCCESS in 24s [21:18:41] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:19:32] !log [somerandomdeveloper@test151] starting deploy of {'versions': '1.44', 'upgrade_extensions': 'EditSubpages'} to test151 [21:19:33] !log [somerandomdeveloper@test151] finished deploy of {'versions': '1.44', 'upgrade_extensions': 'EditSubpages'} to test151 - SUCCESS in 1s [21:19:35] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:19:39] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:19:39] !log [somerandomdeveloper@mwtask181] starting deploy of {'versions': '1.44', 'upgrade_extensions': 'EditSubpages'} to all [21:19:42] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:20:01] !log [somerandomdeveloper@mwtask181] finished deploy of {'versions': '1.44', 'upgrade_extensions': 'EditSubpages'} to all - SUCCESS in 22s [21:20:04] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:21:57] !log [somerandomdeveloper@test151] starting deploy of {'versions': '1.44', 'upgrade_extensions': 'PWA'} to test151 [21:21:58] !log [somerandomdeveloper@test151] finished deploy of {'versions': '1.44', 'upgrade_extensions': 'PWA'} to test151 - SUCCESS in 1s [21:22:00] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:22:04] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:22:20] !log [somerandomdeveloper@mwtask181] starting deploy of {'versions': '1.44', 'upgrade_extensions': 'PWA'} to all [21:22:23] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:22:43] !log [somerandomdeveloper@mwtask181] finished deploy of {'versions': '1.44', 'upgrade_extensions': 'PWA'} to all - SUCCESS in 22s [21:22:46] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:12:32] !log [paladox@mwtask181] sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php /srv/mediawiki/1.43/maintenance/rebuildImages.php --wiki aceistanwiki [22:12:36] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:18:25] !log [macfan@mwtask181] sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php /srv/mediawiki/1.43/maintenance/importDump.php --wiki=supercubecavernwiki dump.xml --no-updates (START) [22:18:28] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:53:20] miraheze/mw-config - Universal-Omega the build passed. [22:55:34] !log [universalomega@mwtask181] starting deploy of {'pull': 'config', 'config': True} to all [22:55:38] miraheze/mw-config - Universal-Omega the build passed. [22:55:38] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:56:00] !log [universalomega@mwtask181] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 25s [22:56:03] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:11:03] !log [void@test151] Upgraded packages php8.2-zip [23:11:04] php8.2-xml [23:11:05] php8.2-readline [23:11:06] php8.2-opcache [23:11:06] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:11:07] php8.2-mysql [23:11:08] php8.2-mbstring [23:11:09] php8.2-ldap [23:11:10] php8.2-intl [23:11:11] php8.2-gmp [23:11:12] php8.2-gd [23:11:13] php8.2-cli [23:11:14] php8.2-fpm [23:11:15] php8.2-dev [23:11:16] php8.2-dba [23:11:17] php8.2-curl [23:11:18] php8.2-bz2 [23:11:19] php8.2-bcmath [23:11:20] php8.2-common [23:11:21] !log [void@test151] restart php8.2-fpm.service [23:11:24] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:11:52] oops [23:12:32] RECOVERY - test151 APT on test151 is OK: APT OK: 51 packages available for upgrade (0 critical updates). [23:15:45] pfft lol [23:16:27] i mean it still logged it right [23:17:19] no, I had to edit it [23:21:30] whar happened lol [23:21:59] I dropped an array directly into the logsalmsg command [23:22:04] RECOVERY - mw151 APT on mw151 is OK: APT OK: 67 packages available for upgrade (0 critical updates). [23:22:09] !log [void@mw151] Upgraded packages php8.2-zip php8.2-xml php8.2-readline php8.2-opcache php8.2-mysql php8.2-mbstring php8.2-ldap php8.2-intl php8.2-gmp php8.2-gd php8.2-cli php8.2-fpm php8.2-dba php8.2-curl php8.2-bz2 php8.2-bcmath php8.2-common [23:22:10] !log [void@mw151] restart php8.2-fpm.service [23:22:13] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:22:17] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:25:06] !log [void@mw152] Upgraded packages php8.2-zip php8.2-xml php8.2-readline php8.2-opcache php8.2-mysql php8.2-mbstring php8.2-ldap php8.2-intl php8.2-gmp php8.2-gd php8.2-cli php8.2-fpm php8.2-dba php8.2-curl php8.2-bz2 php8.2-bcmath php8.2-common [23:25:07] !log [void@mw152] restart php8.2-fpm.service [23:25:09] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:25:12] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:26:12] RECOVERY - mw153 APT on mw153 is OK: APT OK: 67 packages available for upgrade (0 critical updates). [23:26:14] RECOVERY - mw152 APT on mw152 is OK: APT OK: 67 packages available for upgrade (0 critical updates). [23:26:20] !log [void@mw153] Upgraded packages php8.2-zip php8.2-xml php8.2-readline php8.2-opcache php8.2-mysql php8.2-mbstring php8.2-ldap php8.2-intl php8.2-gmp php8.2-gd php8.2-cli php8.2-fpm php8.2-dba php8.2-curl php8.2-bz2 php8.2-bcmath php8.2-common [23:26:21] !log [void@mw153] restart php8.2-fpm.service [23:26:25] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:26:28] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:26:59] oof [23:27:28] !log [void@mw161] Upgraded packages php8.2-zip php8.2-xml php8.2-readline php8.2-opcache php8.2-mysql php8.2-mbstring php8.2-ldap php8.2-intl php8.2-gmp php8.2-gd php8.2-cli php8.2-fpm php8.2-dba php8.2-curl php8.2-bz2 php8.2-bcmath php8.2-common [23:27:29] !log [void@mw161] restart php8.2-fpm.service [23:27:31] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:27:34] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:28:42] RECOVERY - mw161 APT on mw161 is OK: APT OK: 67 packages available for upgrade (0 critical updates). [23:28:45] !log [void@mw162] Upgraded packages php8.2-zip php8.2-xml php8.2-readline php8.2-opcache php8.2-mysql php8.2-mbstring php8.2-ldap php8.2-intl php8.2-gmp php8.2-gd php8.2-cli php8.2-fpm php8.2-dba php8.2-curl php8.2-bz2 php8.2-bcmath php8.2-common [23:28:46] !log [void@mw162] restart php8.2-fpm.service [23:28:49] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:28:53] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:29:35] RECOVERY - mw162 APT on mw162 is OK: APT OK: 67 packages available for upgrade (0 critical updates). [23:30:04] !log [void@mw163] Upgraded packages php8.2-zip php8.2-xml php8.2-readline php8.2-opcache php8.2-mysql php8.2-mbstring php8.2-ldap php8.2-intl php8.2-gmp php8.2-gd php8.2-cli php8.2-fpm php8.2-dba php8.2-curl php8.2-bz2 php8.2-bcmath php8.2-common [23:30:06] !log [void@mw163] restart php8.2-fpm.service [23:30:16] RECOVERY - mw163 APT on mw163 is OK: APT OK: 67 packages available for upgrade (0 critical updates). [23:30:20] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:30:23] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:30:38] !log [void@mw171] Upgraded packages php8.2-zip php8.2-xml php8.2-readline php8.2-opcache php8.2-mysql php8.2-mbstring php8.2-ldap php8.2-intl php8.2-gmp php8.2-gd php8.2-cli php8.2-fpm php8.2-dba php8.2-curl php8.2-bz2 php8.2-bcmath php8.2-common [23:30:38] RECOVERY - mw171 APT on mw171 is OK: APT OK: 67 packages available for upgrade (0 critical updates). [23:30:39] !log [void@mw171] restart php8.2-fpm.service [23:30:41] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:30:45] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:31:14] !log [void@mw172] Upgraded packages php8.2-zip php8.2-xml php8.2-readline php8.2-opcache php8.2-mysql php8.2-mbstring php8.2-ldap php8.2-intl php8.2-gmp php8.2-gd php8.2-cli php8.2-fpm php8.2-dba php8.2-curl php8.2-bz2 php8.2-bcmath php8.2-common [23:31:15] !log [void@mw172] restart php8.2-fpm.service [23:31:17] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:31:20] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:32:14] RECOVERY - mw173 APT on mw173 is OK: APT OK: 67 packages available for upgrade (0 critical updates). [23:32:21] !log [void@mw173] Upgraded packages php8.2-zip php8.2-xml php8.2-readline php8.2-opcache php8.2-mysql php8.2-mbstring php8.2-ldap php8.2-intl php8.2-gmp php8.2-gd php8.2-cli php8.2-fpm php8.2-dba php8.2-curl php8.2-bz2 php8.2-bcmath php8.2-common [23:32:22] !log [void@mw173] restart php8.2-fpm.service [23:32:25] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:32:26] RECOVERY - mw172 APT on mw172 is OK: APT OK: 67 packages available for upgrade (0 critical updates). [23:32:27] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:32:38] !log [void@mw181] Upgraded packages php8.2-zip php8.2-xml php8.2-readline php8.2-opcache php8.2-mysql php8.2-mbstring php8.2-ldap php8.2-intl php8.2-gmp php8.2-gd php8.2-cli php8.2-fpm php8.2-dba php8.2-curl php8.2-bz2 php8.2-bcmath php8.2-common [23:32:39] !log [void@mw181] restart php8.2-fpm.service [23:32:40] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:32:43] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:32:45] RECOVERY - mw181 APT on mw181 is OK: APT OK: 67 packages available for upgrade (0 critical updates). [23:32:57] !log [void@mw182] Upgraded packages php8.2-zip php8.2-xml php8.2-readline php8.2-opcache php8.2-mysql php8.2-mbstring php8.2-ldap php8.2-intl php8.2-gmp php8.2-gd php8.2-cli php8.2-fpm php8.2-dba php8.2-curl php8.2-bz2 php8.2-bcmath php8.2-common [23:32:58] !log [void@mw182] restart php8.2-fpm.service [23:33:00] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:33:03] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:33:31] RECOVERY - mw182 APT on mw182 is OK: APT OK: 67 packages available for upgrade (0 critical updates). [23:33:41] RECOVERY - mw183 APT on mw183 is OK: APT OK: 67 packages available for upgrade (0 critical updates). [23:33:49] RECOVERY - mw191 APT on mw191 is OK: APT OK: 67 packages available for upgrade (0 critical updates). [23:33:50] !log [void@mw183] Upgraded packages php8.2-zip php8.2-xml php8.2-readline php8.2-opcache php8.2-mysql php8.2-mbstring php8.2-ldap php8.2-intl php8.2-gmp php8.2-gd php8.2-cli php8.2-fpm php8.2-dba php8.2-curl php8.2-bz2 php8.2-bcmath php8.2-common [23:33:51] !log [void@mw183] restart php8.2-fpm.service [23:33:53] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:33:57] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:34:00] !log [void@mw191] Upgraded packages php8.2-zip php8.2-xml php8.2-readline php8.2-opcache php8.2-mysql php8.2-mbstring php8.2-ldap php8.2-intl php8.2-gmp php8.2-gd php8.2-cli php8.2-fpm php8.2-dba php8.2-curl php8.2-bz2 php8.2-bcmath php8.2-common [23:34:01] !log [void@mw191] restart php8.2-fpm.service [23:34:03] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:34:06] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:34:56] !log [void@mw192] Upgraded packages php8.2-zip php8.2-xml php8.2-readline php8.2-opcache php8.2-mysql php8.2-mbstring php8.2-ldap php8.2-intl php8.2-gmp php8.2-gd php8.2-cli php8.2-fpm php8.2-dba php8.2-curl php8.2-bz2 php8.2-bcmath php8.2-common [23:34:57] RECOVERY - mw193 APT on mw193 is OK: APT OK: 67 packages available for upgrade (0 critical updates). [23:34:57] !log [void@mw192] restart php8.2-fpm.service [23:34:59] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:35:02] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:35:14] !log [void@mw193] Upgraded packages php8.2-zip php8.2-xml php8.2-readline php8.2-opcache php8.2-mysql php8.2-mbstring php8.2-ldap php8.2-intl php8.2-gmp php8.2-gd php8.2-cli php8.2-fpm php8.2-dba php8.2-curl php8.2-bz2 php8.2-bcmath php8.2-common [23:35:15] !log [void@mw193] restart php8.2-fpm.service [23:35:17] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:35:20] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:35:20] RECOVERY - mwtask151 APT on mwtask151 is OK: APT OK: 67 packages available for upgrade (0 critical updates). [23:35:26] RECOVERY - mw192 APT on mw192 is OK: APT OK: 67 packages available for upgrade (0 critical updates). [23:35:30] !log [void@mwtask151] Upgraded packages php8.2-zip php8.2-xml php8.2-readline php8.2-opcache php8.2-mysql php8.2-mbstring php8.2-ldap php8.2-intl php8.2-gmp php8.2-gd php8.2-cli php8.2-fpm php8.2-dba php8.2-curl php8.2-bz2 php8.2-bcmath php8.2-common [23:35:31] !log [void@mwtask151] restart php8.2-fpm.service [23:35:34] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:35:36] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:37:56] RECOVERY - mwtask171 APT on mwtask171 is OK: APT OK: 67 packages available for upgrade (0 critical updates). [23:38:09] RECOVERY - mwtask181 APT on mwtask181 is OK: APT OK: 67 packages available for upgrade (0 critical updates). [23:39:43] PROBLEM - wiki.townsmp.xyz - Cloudflare on sslhost is CRITICAL: CRITICAL - Certificate 'wiki.townsmp.xyz' expires in 7 day(s) (Tue 05 Aug 2025 11:37:30 PM GMT +0000). [23:39:50] !log [void@mw201] Upgraded packages php8.2-zip php8.2-xml php8.2-readline php8.2-opcache php8.2-mysql php8.2-mbstring php8.2-ldap php8.2-intl php8.2-gmp php8.2-gd php8.2-cli php8.2-fpm php8.2-dba php8.2-curl php8.2-bz2 php8.2-bcmath php8.2-common [23:39:51] !log [void@mw201] restart php8.2-fpm.service [23:39:53] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:39:56] RECOVERY - mw201 APT on mw201 is OK: APT OK: 67 packages available for upgrade (0 critical updates). [23:39:56] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:40:11] !log [void@mw202] Upgraded packages php8.2-zip php8.2-xml php8.2-readline php8.2-opcache php8.2-mysql php8.2-mbstring php8.2-ldap php8.2-intl php8.2-gmp php8.2-gd php8.2-cli php8.2-fpm php8.2-dba php8.2-curl php8.2-bz2 php8.2-bcmath php8.2-common [23:40:12] !log [void@mw202] restart php8.2-fpm.service [23:40:14] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:40:17] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:40:30] !log same for mwtask171 and mwtask181 (didn't log somehow because my terminal closed?) [23:40:31] !log [void@mw203] Upgraded packages php8.2-zip php8.2-xml php8.2-readline php8.2-opcache php8.2-mysql php8.2-mbstring php8.2-ldap php8.2-intl php8.2-gmp php8.2-gd php8.2-cli php8.2-fpm php8.2-dba php8.2-curl php8.2-bz2 php8.2-bcmath php8.2-common [23:40:32] !log [void@mw203] restart php8.2-fpm.service [23:40:33] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:40:37] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:40:40] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:41:30] RECOVERY - mw202 APT on mw202 is OK: APT OK: 67 packages available for upgrade (0 critical updates). [23:41:58] RECOVERY - mw203 APT on mw203 is OK: APT OK: 67 packages available for upgrade (0 critical updates). [23:42:02] !log [void@mwtask161] Upgraded packages php8.2-zip php8.2-xml php8.2-readline php8.2-opcache php8.2-mysql php8.2-mbstring php8.2-ldap php8.2-intl php8.2-gmp php8.2-gd php8.2-cli php8.2-fpm php8.2-dba php8.2-curl php8.2-bz2 php8.2-bcmath php8.2-common [23:42:03] !log [void@mwtask161] restart php8.2-fpm.service [23:42:05] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:42:08] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:42:35] RECOVERY - mwtask161 APT on mwtask161 is OK: APT OK: 67 packages available for upgrade (0 critical updates). [23:42:51] !log [void@phorge171] Upgraded packages php8.2-zip php8.2-xml php8.2-readline php8.2-opcache php8.2-mysql php8.2-mbstring php8.2-ldap php8.2-intl php8.2-gmp php8.2-gd php8.2-fpm php8.2-curl php8.2-cli php8.2-common [23:42:52] !log [void@phorge171] restart php8.2-fpm.service [23:42:54] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:42:57] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:43:13] !log [void@reports171] Upgraded packages php8.2-xml php8.2-readline php8.2-opcache php8.2-mysql php8.2-mbstring php8.2-ldap php8.2-intl php8.2-gmp php8.2-gd php8.2-fpm php8.2-curl php8.2-cli php8.2-common [23:43:14] !log [void@reports171] restart php8.2-fpm.service [23:43:15] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:43:18] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:43:55] !log [void@matomo151] Upgraded packages php8.2-xml php8.2-readline php8.2-opcache php8.2-mysql php8.2-mbstring php8.2-ldap php8.2-intl php8.2-gmp php8.2-gd php8.2-fpm php8.2-curl php8.2-cli php8.2-common [23:43:56] !log [void@matomo151] restart php8.2-fpm.service [23:43:58] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:44:01] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:44:15] !log [void@mon181] Upgraded packages php8.2-xml php8.2-soap php8.2-readline php8.2-pgsql php8.2-opcache php8.2-mysql php8.2-mbstring php8.2-ldap php8.2-gmp php8.2-gd php8.2-cli php8.2-fpm php8.2-curl php8.2-intl php8.2-common php8.2 [23:44:16] !log [void@mon181] restart php8.2-fpm.service [23:44:18] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:44:19] RECOVERY - phorge171 APT on phorge171 is OK: APT OK: 47 packages available for upgrade (0 critical updates). [23:44:21] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:44:23] RECOVERY - mon181 APT on mon181 is OK: APT OK: 7 packages available for upgrade (0 critical updates). [23:44:35] RECOVERY - reports171 APT on reports171 is OK: APT OK: 47 packages available for upgrade (0 critical updates). [23:45:07] RECOVERY - matomo151 APT on matomo151 is OK: APT OK: 49 packages available for upgrade (0 critical updates). [23:46:22] And that's security updates done [23:53:10] !log [blankeclair@mwtask181] curl -X DELETE https://opensearch-mw.wikitide.net/babelreduxwiki_content https://opensearch-mw.wikitide.net/babelreduxwiki_general [23:53:13] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:53:30] !log [blankeclair@mwtask181] sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php CirrusSearch:UpdateSearchIndexConfig --wiki=babelreduxwiki --startOver (END - exit=0) [23:53:34] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:53:39] !log [blankeclair@mwtask181] sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php CirrusSearch:ForceSearchIndex --wiki=babelreduxwiki (END - exit=0) [23:53:43] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log