[00:07:15] RECOVERY - cp171 Disk Space on cp171 is OK: DISK OK - free space: / 57007MiB (12% inode=99%); [00:07:24] RECOVERY - cp201 Disk Space on cp201 is OK: DISK OK - free space: / 56747MiB (12% inode=99%); [00:07:37] RECOVERY - cp191 Disk Space on cp191 is OK: DISK OK - free space: / 57484MiB (12% inode=99%); [00:45:55] PROBLEM - mwtask181 Check unit status of mediawiki_job_generate-sitemap-index on mwtask181 is CRITICAL: CRITICAL: Status of the systemd unit mediawiki_job_generate-sitemap-index [01:28:30] Jul 25 00:43:22 mwtask181 mediawiki_job_generate-sitemap-index[2801672]: requests.exceptions.ConnectionError: ('Connection aborted.', RemoteDisconnected('Remote end closed connection without response')) [03:01:40] PROBLEM - wiki.thunderscientific.solutions - Cloudflare on sslhost is WARNING: WARNING - Certificate 'wiki.thunderscientific.solutions' expires in 28 day(s) (Sat 23 Aug 2025 02:47:02 AM GMT +0000). [04:55:03] PROBLEM - mw191 Puppet on mw191 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_3d2png] [05:23:23] RECOVERY - mw191 Puppet on mw191 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [07:49:45] BlankEclair: reset it [07:50:50] RhinosF1: no access to systemctl restart * [07:51:04] only service {apache2,mcrouter,nginx,php8.2-fpm} * [07:52:38] BlankEclair: maybe we should add mediawiki_job_* [07:52:49] If you can't find a vulnerability in that [07:53:01] maybe, unsure if sudo's syntax is complex enough to support that [07:53:10] `service` is a wrapper to `systemctl` anyway [07:53:20] last time i checked, i couldn't find anything severe with the second argument [07:53:24] first argument would be interesting though [07:53:32] maybe mediawiki_job_/../system/sshd [07:53:53] > systemctl status meow/../system/sshd [07:53:55] Invalid unit name "meow/../system/sshd" escaped as "meow-..-system-sshd" (maybe you should use systemd-escape?). [07:53:56] huh [07:54:12] have to check that script to make sure tho, and i'm not in the mood for it ^^; [09:13:24] PROBLEM - cp201 Disk Space on cp201 is WARNING: DISK WARNING - free space: / 49826MiB (10% inode=99%); [09:31:10] PROBLEM - cp171 Disk Space on cp171 is WARNING: DISK WARNING - free space: / 49873MiB (10% inode=99%); [10:07:22] PROBLEM - cp191 Disk Space on cp191 is WARNING: DISK WARNING - free space: / 49944MiB (10% inode=99%); [13:32:04] [02ImportDump] 07dependabot[bot] created 03dependabot/npm_and_yarn/eslint-config-wikimedia-0.31.0 (+1 new commit) 13https://github.com/miraheze/ImportDump/commit/f0dc7636e1b2 [13:32:05] 02ImportDump/03dependabot/npm_and_yarn/eslint-config-wikimedia-0.31.0 07dependabot[bot] 03f0dc763 Bump eslint-config-wikimedia from 0.30.0 to 0.31.0… [13:32:05] [02ImportDump] 07dependabot[bot] added the label 'dependencies' to pull request #143 (Bump eslint-config-wikimedia from 0.30.0 to 0.31.0) 13https://github.com/miraheze/ImportDump/pull/143 [13:32:05] [02ImportDump] 07dependabot[bot] added the label 'javascript' to pull request #143 (Bump eslint-config-wikimedia from 0.30.0 to 0.31.0) 13https://github.com/miraheze/ImportDump/pull/143 [13:32:07] [02ImportDump] 07dependabot[bot] opened pull request #143: Bump eslint-config-wikimedia from 0.30.0 to 0.31.0 (03main...03dependabot/npm_and_yarn/eslint-config-wikimedia-0.31.0) 13https://github.com/miraheze/ImportDump/pull/143 [13:32:09] [02ImportDump] 07dependabot[bot] added the label 'dependencies' to pull request #143 (Bump eslint-config-wikimedia from 0.30.0 to 0.31.0) 13https://github.com/miraheze/ImportDump/pull/143 [13:32:11] [02ImportDump] 07dependabot[bot] added the label 'javascript' to pull request #143 (Bump eslint-config-wikimedia from 0.30.0 to 0.31.0) 13https://github.com/miraheze/ImportDump/pull/143 [13:32:13] [02ImportDump] 07coderabbitai[bot] commented on pull request #143: --- […] 13https://github.com/miraheze/ImportDump/pull/143#issuecomment-3117838616 [13:37:19] miraheze/ImportDump - dependabot[bot] the build has errored. [16:54:22] RECOVERY - 9b9t.wiki - Cloudflare on sslhost is OK: OK - Certificate '9b9t.wiki' will expire on Thu 11 Sep 2025 06:04:08 PM GMT +0000. [16:54:27] [02DiscordNotifications] 07SomeMWDev merged pull request #107: Support ptb webhook URLs (03main...03discord-ptb-urls) 13https://github.com/miraheze/DiscordNotifications/pull/107 [16:54:27] [02DiscordNotifications] 07SomeMWDev pushed 1 new commit to 03main 13https://github.com/miraheze/DiscordNotifications/commit/f876213142dd811ebb2b4f4fdb63bd9c8d186971 [16:54:27] 02DiscordNotifications/03main 07SomeRandomDeveloper 03f876213 Support ptb webhook URLs (#107)… [16:54:28] [02DiscordNotifications] 07SomeMWDev 04deleted 03discord-ptb-urls at 036bc0e96 13https://api.github.com/repos/miraheze/DiscordNotifications/commit/6bc0e96 [16:54:47] !log [somerandomdeveloper@test151] starting deploy of {'versions': ['1.43', '1.44'], 'upgrade_extensions': 'DiscordNotifications'} to test151 [16:54:49] !log [somerandomdeveloper@test151] finished deploy of {'versions': ['1.43', '1.44'], 'upgrade_extensions': 'DiscordNotifications'} to test151 - SUCCESS in 1s [16:54:50] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:54:53] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:55:59] !log [somerandomdeveloper@mwtask181] starting deploy of {'versions': ['1.43', '1.44'], 'upgrade_extensions': 'DiscordNotifications'} to all [16:56:02] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:56:50] !log [somerandomdeveloper@mwtask181] finished deploy of {'versions': ['1.43', '1.44'], 'upgrade_extensions': 'DiscordNotifications'} to all - SUCCESS in 50s [16:56:53] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:58:34] [02mw-config] 07Universal-Omega created 03remove-mediawikichat from 03main (+0 new commit) 13https://github.com/miraheze/mw-config/compare/remove-mediawikichat [16:59:27] [02mw-config] 07Universal-Omega pushed 1 new commit to 03remove-mediawikichat 13https://github.com/miraheze/mw-config/commit/1c79eaac749a6f6a8909640dc5711caf415e2b20 [16:59:27] 02mw-config/03remove-mediawikichat 07CosmicAlpha 031c79eaa Remove MediaWikiChat [16:59:45] [02mw-config] 07Universal-Omega opened pull request #6033: Remove MediaWikiChat (03main...03remove-mediawikichat) 13https://github.com/miraheze/mw-config/pull/6033 [17:00:36] miraheze/mw-config - Universal-Omega the build passed. [17:00:39] [02MatomoAnalytics] 07dependabot[bot] created 03dependabot/npm_and_yarn/eslint-config-wikimedia-0.31.0 (+1 new commit) 13https://github.com/miraheze/MatomoAnalytics/commit/b2b16a56e254 [17:00:39] 02MatomoAnalytics/03dependabot/npm_and_yarn/eslint-config-wikimedia-0.31.0 07dependabot[bot] 03b2b16a5 Bump eslint-config-wikimedia from 0.30.0 to 0.31.0… [17:00:40] [02MatomoAnalytics] 07dependabot[bot] added the label 'dependencies' to pull request #168 (Bump eslint-config-wikimedia from 0.30.0 to 0.31.0) 13https://github.com/miraheze/MatomoAnalytics/pull/168 [17:00:40] [02MatomoAnalytics] 07dependabot[bot] opened pull request #168: Bump eslint-config-wikimedia from 0.30.0 to 0.31.0 (03main...03dependabot/npm_and_yarn/eslint-config-wikimedia-0.31.0) 13https://github.com/miraheze/MatomoAnalytics/pull/168 [17:00:42] [02MatomoAnalytics] 07dependabot[bot] added the label 'javascript' to pull request #168 (Bump eslint-config-wikimedia from 0.30.0 to 0.31.0) 13https://github.com/miraheze/MatomoAnalytics/pull/168 [17:00:44] [02MatomoAnalytics] 07dependabot[bot] added the label 'dependencies' to pull request #168 (Bump eslint-config-wikimedia from 0.30.0 to 0.31.0) 13https://github.com/miraheze/MatomoAnalytics/pull/168 [17:00:46] [02MatomoAnalytics] 07dependabot[bot] added the label 'javascript' to pull request #168 (Bump eslint-config-wikimedia from 0.30.0 to 0.31.0) 13https://github.com/miraheze/MatomoAnalytics/pull/168 [17:00:48] [02MatomoAnalytics] 07coderabbitai[bot] commented on pull request #168: --- […] 13https://github.com/miraheze/MatomoAnalytics/pull/168#issuecomment-3119497949 [17:05:04] miraheze/MatomoAnalytics - dependabot[bot] the build passed. [17:13:45] [02mediawiki-repos] 07pskyechology opened pull request #82: Remove MediaWikiChat (07miraheze:03main...07pskyechology:03remove-mediawikichat) 13https://github.com/miraheze/mediawiki-repos/pull/82 [17:13:53] [02mediawiki-repos] 07coderabbitai[bot] commented on pull request #82:
[…] 13https://github.com/miraheze/mediawiki-repos/pull/82#issuecomment-3119569164 [17:18:30] miraheze/DiscordNotifications - SomeMWDev the build passed. [17:34:57] [02ManageWiki] 07dependabot[bot] created 03dependabot/npm_and_yarn/eslint-config-wikimedia-0.31.0 (+1 new commit) 13https://github.com/miraheze/ManageWiki/commit/0ba4e058f34c [17:34:57] 02ManageWiki/03dependabot/npm_and_yarn/eslint-config-wikimedia-0.31.0 07dependabot[bot] 030ba4e05 Bump eslint-config-wikimedia from 0.30.0 to 0.31.0… [17:34:58] [02ManageWiki] 07dependabot[bot] added the label 'dependencies' to pull request #716 (Bump eslint-config-wikimedia from 0.30.0 to 0.31.0) 13https://github.com/miraheze/ManageWiki/pull/716 [17:35:00] [02ManageWiki] 07dependabot[bot] added the label 'javascript' to pull request #716 (Bump eslint-config-wikimedia from 0.30.0 to 0.31.0) 13https://github.com/miraheze/ManageWiki/pull/716 [17:35:02] [02ManageWiki] 07dependabot[bot] opened pull request #716: Bump eslint-config-wikimedia from 0.30.0 to 0.31.0 (03main...03dependabot/npm_and_yarn/eslint-config-wikimedia-0.31.0) 13https://github.com/miraheze/ManageWiki/pull/716 [17:35:04] [02ManageWiki] 07dependabot[bot] added the label 'dependencies' to pull request #716 (Bump eslint-config-wikimedia from 0.30.0 to 0.31.0) 13https://github.com/miraheze/ManageWiki/pull/716 [17:35:06] [02ManageWiki] 07dependabot[bot] added the label 'javascript' to pull request #716 (Bump eslint-config-wikimedia from 0.30.0 to 0.31.0) 13https://github.com/miraheze/ManageWiki/pull/716 [17:35:08] [02ManageWiki] 07coderabbitai[bot] commented on pull request #716: --- […] 13https://github.com/miraheze/ManageWiki/pull/716#issuecomment-3119660576 [17:39:19] miraheze/ManageWiki - dependabot[bot] the build has errored. [18:32:45] [02ssl] 07pskyechology opened pull request #876: T14042: Redirect fashiondreamer.miraheze.org to fashiondreamerwiki.miraheze.org (07miraheze:03main...07pskyechology:03T14042) 13https://github.com/miraheze/ssl/pull/876 [18:34:28] [02ssl] 07coderabbitai[bot] commented on pull request #876: A new redirect entry was added to the `redirects.yaml` configuration file. This entry defines a redirect from `fashiondreamer.miraheze.org` to `fashiondreamerwiki.miraheze.org`, specifying SSL certificate details, certificate authority, and enforcing […] 13https://github.com/miraheze/ssl/pull/876#issuecomment-3119932272 [19:28:07] miraheze/DiscordNotifications - pskyechology the build has errored. [20:02:49] im going to explode [22:30:44] [02IncidentReporting] 07dependabot[bot] created 03dependabot/npm_and_yarn/eslint-config-wikimedia-0.31.0 (+1 new commit) 13https://github.com/miraheze/IncidentReporting/commit/a20641f87111 [22:30:44] 02IncidentReporting/03dependabot/npm_and_yarn/eslint-config-wikimedia-0.31.0 07dependabot[bot] 03a20641f Bump eslint-config-wikimedia from 0.30.0 to 0.31.0… [22:30:46] [02IncidentReporting] 07dependabot[bot] added the label 'dependencies' to pull request #105 (Bump eslint-config-wikimedia from 0.30.0 to 0.31.0) 13https://github.com/miraheze/IncidentReporting/pull/105 [22:30:48] [02IncidentReporting] 07dependabot[bot] opened pull request #105: Bump eslint-config-wikimedia from 0.30.0 to 0.31.0 (03main...03dependabot/npm_and_yarn/eslint-config-wikimedia-0.31.0) 13https://github.com/miraheze/IncidentReporting/pull/105 [22:30:50] [02IncidentReporting] 07dependabot[bot] added the label 'javascript' to pull request #105 (Bump eslint-config-wikimedia from 0.30.0 to 0.31.0) 13https://github.com/miraheze/IncidentReporting/pull/105 [22:30:52] [02IncidentReporting] 07dependabot[bot] added the label 'dependencies' to pull request #105 (Bump eslint-config-wikimedia from 0.30.0 to 0.31.0) 13https://github.com/miraheze/IncidentReporting/pull/105 [22:30:54] [02IncidentReporting] 07dependabot[bot] added the label 'javascript' to pull request #105 (Bump eslint-config-wikimedia from 0.30.0 to 0.31.0) 13https://github.com/miraheze/IncidentReporting/pull/105 [22:30:56] [02IncidentReporting] 07coderabbitai[bot] commented on pull request #105: --- […] 13https://github.com/miraheze/IncidentReporting/pull/105#issuecomment-3120567588 [22:35:18] miraheze/IncidentReporting - dependabot[bot] the build passed. [22:43:16] [02CreateWiki] 07dependabot[bot] created 03dependabot/npm_and_yarn/eslint-config-wikimedia-0.31.0 (+1 new commit) 13https://github.com/miraheze/CreateWiki/commit/c8c6a7edc3df [22:43:16] 02CreateWiki/03dependabot/npm_and_yarn/eslint-config-wikimedia-0.31.0 07dependabot[bot] 03c8c6a7e Bump eslint-config-wikimedia from 0.30.0 to 0.31.0… [22:43:17] [02CreateWiki] 07dependabot[bot] added the label 'dependencies' to pull request #756 (Bump eslint-config-wikimedia from 0.30.0 to 0.31.0) 13https://github.com/miraheze/CreateWiki/pull/756 [22:43:17] [02CreateWiki] 07dependabot[bot] added the label 'javascript' to pull request #756 (Bump eslint-config-wikimedia from 0.30.0 to 0.31.0) 13https://github.com/miraheze/CreateWiki/pull/756 [22:43:19] [02CreateWiki] 07dependabot[bot] opened pull request #756: Bump eslint-config-wikimedia from 0.30.0 to 0.31.0 (03main...03dependabot/npm_and_yarn/eslint-config-wikimedia-0.31.0) 13https://github.com/miraheze/CreateWiki/pull/756 [22:43:21] [02CreateWiki] 07dependabot[bot] added the label 'dependencies' to pull request #756 (Bump eslint-config-wikimedia from 0.30.0 to 0.31.0) 13https://github.com/miraheze/CreateWiki/pull/756 [22:43:23] [02CreateWiki] 07dependabot[bot] added the label 'javascript' to pull request #756 (Bump eslint-config-wikimedia from 0.30.0 to 0.31.0) 13https://github.com/miraheze/CreateWiki/pull/756 [22:43:25] [02CreateWiki] 07coderabbitai[bot] commented on pull request #756: --- […] 13https://github.com/miraheze/CreateWiki/pull/756#issuecomment-3120590383 [22:47:55] miraheze/CreateWiki - dependabot[bot] the build has errored. [23:14:07] @pskyechology if you could test whether DarkMode is fixed with your patch now I can also upgrade it on prod [23:23:41] !log [skye@test151] starting deploy of {'versions': '1.44', 'upgrade_extensions': 'DarkMode'} to test151 [23:23:42] !log [skye@test151] finished deploy of {'versions': '1.44', 'upgrade_extensions': 'DarkMode'} to test151 - SUCCESS in 1s [23:23:44] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:23:46] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:26:36] yup, link in footer doesn't crash anymore [23:42:08] nice [23:42:14] !log [somerandomdeveloper@mwtask181] starting deploy of {'versions': '1.44', 'upgrade_extensions': 'DarkMode'} to all [23:42:17] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:42:42] !log [somerandomdeveloper@mwtask181] finished deploy of {'versions': '1.44', 'upgrade_extensions': 'DarkMode'} to all - SUCCESS in 28s [23:42:45] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log