[00:01:06] [02statichelp] 07WikiTideBot pushed 1 new commit to 03main 13https://github.com/miraheze/statichelp/commit/9f829a1d7da38ca7c34b44e1e48890cc3da53588 [00:01:06] 02statichelp/03main 07WikiTideBot 039f829a1 Bot: Auto-update Tech namespace pages 2026-04-06 00:01:04 [00:12:21] miraheze/mw-config - SomeMWDev the build passed. [00:22:03] [02mw-config] 07SomeMWDev created 03T15194 (+1 new commit) 13https://github.com/miraheze/mw-config/commit/07104d4044ab [00:22:05] [02mw-config] 07SomeMWDev drafted pull request #6363: T15194: Undeploy LinkTitles (03main...03T15194) 13https://github.com/miraheze/mw-config/pull/6363 [00:22:41] [02mediawiki-repos] 07SomeMWDev created 03T15194 (+1 new commit) 13https://github.com/miraheze/mediawiki-repos/commit/a1a5b79de80b [00:22:45] lol the bot is lagging 12 mins behind [00:22:45] [02mediawiki-repos] 07SomeMWDev drafted pull request #139: T15194: Undeploy LinkTitles (03main...03T15194) 13https://github.com/miraheze/mediawiki-repos/pull/139 [00:24:06] 02mw-config/03T15194 07SomeRandomDeveloper 0307104d4 T15194: Undeploy LinkTitles [00:24:06] 02mediawiki-repos/03T15194 07SomeRandomDeveloper 03a1a5b79 T15194: Undeploy LinkTitles [00:35:57] hold on let me download handbrake for a funny [00:59:22] https://cdn.discordapp.com/attachments/808001911868489748/1490516231189696624/speed.gif?ex=69d456e9&is=69d30569&hm=9ee8da003280a010598441bb9443dd9df162acaa39b6442b496fb8bce4fb4d05& [00:59:39] lol [02:32:37] PROBLEM - db161 Current Load on db161 is CRITICAL: LOAD CRITICAL - total load average: 53.85, 28.23, 11.83 [02:38:37] PROBLEM - db161 Current Load on db161 is WARNING: LOAD WARNING - total load average: 1.31, 10.79, 9.43 [02:40:37] RECOVERY - db161 Current Load on db161 is OK: LOAD OK - total load average: 0.69, 7.44, 8.36 [05:03:47] A new one if you haven't done this yet. [05:53:02] PROBLEM - mw163 Current Load on mw163 is CRITICAL: LOAD CRITICAL - total load average: 44.99, 21.80, 10.52 [05:53:14] PROBLEM - cp161 Varnish Backends on cp161 is CRITICAL: 1 backends are down. mw163 [05:53:53] PROBLEM - mw163 PowerDNS Recursor on mw163 is CRITICAL: CRITICAL - Plugin timed out while executing system call [05:53:55] PROBLEM - mw163 SSH on mw163 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [05:54:17] PROBLEM - mw163 php-fpm on mw163 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [05:54:30] PROBLEM - mw163 MediaWiki Rendering on mw163 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [05:54:31] PROBLEM - mw163 HTTPS on mw163 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10004 milliseconds with 0 bytes received [05:54:34] PROBLEM - cp201 Varnish Backends on cp201 is CRITICAL: 1 backends are down. mw163 [05:54:38] PROBLEM - cp171 Varnish Backends on cp171 is CRITICAL: 1 backends are down. mw163 [05:54:45] PROBLEM - cp191 Varnish Backends on cp191 is CRITICAL: 1 backends are down. mw163 [05:55:38] PROBLEM - mw163 APT on mw163 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [05:55:42] PROBLEM - mw163 Check unit status of php8.4-fpm_check_restart on mw163 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [05:56:01] PROBLEM - mw163 ferm_active on mw163 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [05:56:04] PROBLEM - mw163 conntrack_table_size on mw163 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [05:56:09] PROBLEM - mw163 Puppet on mw163 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [05:56:14] RECOVERY - mw163 php-fpm on mw163 is OK: PROCS OK: 25 processes with command name 'php-fpm8.4' [05:56:28] RECOVERY - mw163 HTTPS on mw163 is OK: HTTP OK: HTTP/2 410 - Status line output matched "HTTP/2 410" - 340 bytes in 0.074 second response time [05:56:30] RECOVERY - mw163 MediaWiki Rendering on mw163 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 0.213 second response time [05:57:12] RECOVERY - cp161 Varnish Backends on cp161 is OK: All 31 backends are healthy [05:57:39] RECOVERY - mw163 APT on mw163 is OK: APT OK: 69 packages available for upgrade (0 critical updates). [05:57:41] RECOVERY - mw163 Check unit status of php8.4-fpm_check_restart on mw163 is OK: OK: Status of the systemd unit php8.4-fpm_check_restart [05:57:55] RECOVERY - mw163 ferm_active on mw163 is OK: OK ferm input default policy is set [05:57:58] RECOVERY - mw163 SSH on mw163 is OK: SSH OK - OpenSSH_10.0p2 (protocol 2.0) [05:58:01] RECOVERY - mw163 PowerDNS Recursor on mw163 is OK: DNS OK: 0.045 seconds response time. mw163.fsslc.wtnet returns 10.0.16.151 [05:58:03] RECOVERY - mw163 conntrack_table_size on mw163 is OK: OK: nf_conntrack is 1 % full [05:58:07] RECOVERY - mw163 Puppet on mw163 is OK: OK: Puppet is currently enabled, last run 30 minutes ago with 0 failures [05:58:34] RECOVERY - cp201 Varnish Backends on cp201 is OK: All 31 backends are healthy [05:58:38] Might be good to use `private-tmp` unless the service needs to communicate with other programs via /tmp. [05:58:38] RECOVERY - cp171 Varnish Backends on cp171 is OK: All 31 backends are healthy [05:58:45] RECOVERY - cp191 Varnish Backends on cp191 is OK: All 31 backends are healthy [06:01:02] RECOVERY - mw163 Current Load on mw163 is OK: LOAD OK - total load average: 4.05, 17.77, 15.64 [06:54:43] !log [petramagna@mwtask171] sudo -u www-data php /srv/mediawiki/1.45/maintenance/run.php importDump --wiki=floppapediawiki --no-updates --username-prefix=wikia:floppapedia-revamped -- floppapediarevamped_pages_full.xml (START) [06:54:45] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:00:31] [02ssl] 07WikiTideBot pushed 1 new commit to 03main 13https://github.com/miraheze/ssl/commit/5435c721659740b66f4661de2a6b2be82558f6e3 [07:00:31] 02ssl/03main 07WikiTideBot 035435c72 Bot: Auto-update domain lists [07:17:19] !log [petramagna@mwtask171] sudo -u www-data php /srv/mediawiki/1.45/maintenance/run.php importDump --wiki=floppapediawiki --no-updates --username-prefix=wikia:floppapedia-revamped -- floppapediarevamped_pages_full.xml (END - exit=0) [07:17:21] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:18:33] !log [petramagna@mwtask171] sudo -u www-data php /srv/mediawiki/1.45/maintenance/run.php rebuildall --wiki=floppapediawiki (START) [07:18:35] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:28:22] !log [petramagna@mwtask171] sudo -u www-data php /srv/mediawiki/1.45/maintenance/run.php rebuildall --wiki=floppapediawiki (END - exit=0) [07:28:24] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:28:57] !log [petramagna@mwtask171] sudo -u www-data php /srv/mediawiki/1.45/maintenance/run.php initEditCount --wiki=floppapediawiki (END - exit=0) [07:28:59] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:29:06] !log [petramagna@mwtask171] sudo -u www-data php /srv/mediawiki/1.45/maintenance/run.php initSiteStats --wiki=floppapediawiki (END - exit=0) [07:29:08] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:29:22] !log [petramagna@mwtask171] sudo -u www-data php /srv/mediawiki/1.45/maintenance/run.php initSiteStats --wiki=floppapediawiki --update (END - exit=0) [07:29:24] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:36:30] !log [petramagna@mwtask171] sudo -u www-data php /srv/mediawiki/1.45/maintenance/run.php importImages --wiki=warlordswiki --sleep=1 --comment='Importing images for [[phorge:T15177|T15177]]' ./files (START) [07:36:32] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:37:32] !log [petramagna@mwtask171] sudo -u www-data php /srv/mediawiki/1.45/maintenance/run.php importImages --wiki=warlordswiki --sleep=1 --comment='Importing images for [[phorge:T15177|T15177]]' ./files (END - exit=0) [07:37:34] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:02:25] PROBLEM - puppet181 Check unit status of listdomains_github_push on puppet181 is CRITICAL: CRITICAL: Status of the systemd unit listdomains_github_push [12:12:06] [02GlobalNewFiles] 07translatewiki pushed 1 new commit to 03main 13https://github.com/miraheze/GlobalNewFiles/commit/fb21de2263944864cc7f23b23fd8f65985dea8b4 [12:12:06] 02GlobalNewFiles/03main 07translatewiki.net 03fb21de2 Localisation updates from https://translatewiki.net. [12:12:07] [02CreateWiki] 07translatewiki pushed 1 new commit to 03main 13https://github.com/miraheze/CreateWiki/commit/7cc717da2d8e3c674a3c053e78d0376fcdfbcc30 [12:12:07] 02CreateWiki/03main 07translatewiki.net 037cc717d Localisation updates from https://translatewiki.net. [12:12:09] [02landing] 07translatewiki pushed 1 new commit to 03main 13https://github.com/miraheze/landing/commit/8a3140f4d9c14b61b20d66dc5ec363769f9f94fa [12:12:10] 02landing/03main 07translatewiki.net 038a3140f Localisation updates from https://translatewiki.net. [12:12:12] [02WikiDiscover] 07translatewiki pushed 1 new commit to 03main 13https://github.com/miraheze/WikiDiscover/commit/d0f33ea45f7d963465a4b318d3f5a45bfbb9e683 [12:12:14] [02MirahezeMagic] 07translatewiki pushed 1 new commit to 03main 13https://github.com/miraheze/MirahezeMagic/commit/53a6c28664c42c782c95307fe089e0d77851dd23 [12:12:16] 02WikiDiscover/03main 07translatewiki.net 03d0f33ea Localisation updates from https://translatewiki.net. [12:12:18] 02MirahezeMagic/03main 07translatewiki.net 0353a6c28 Localisation updates from https://translatewiki.net. [12:13:01] miraheze/landing - translatewiki the build passed. [12:16:49] miraheze/GlobalNewFiles - translatewiki the build passed. [12:17:12] miraheze/WikiDiscover - translatewiki the build passed. [12:20:08] miraheze/MirahezeMagic - translatewiki the build passed. [12:20:53] miraheze/CreateWiki - translatewiki the build passed. [13:00:25] RECOVERY - puppet181 Check unit status of listdomains_github_push on puppet181 is OK: OK: Status of the systemd unit listdomains_github_push [13:22:41] !log [wwr@test151] sudo -u www-data php /srv/mediawiki/1.45/maintenance/run.php CreateWiki:DeleteWiki --wiki=loginwiki --delete --deletewiki blocktaleswiki (END - exit=512) [13:22:43] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [13:25:11] !log [wwr@mwtask171] sudo -u www-data php /srv/mediawiki/1.45/maintenance/run.php CreateWiki:DeleteWiki --wiki=loginwiki --delete --deletewiki blocktaleswiki (END - exit=33280) [13:25:13] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [13:25:26] !log [wwr@mwtask171] sudo -u www-data php /srv/mediawiki/1.45/maintenance/run.php CreateWiki:DeleteWiki --wiki=loginwiki --delete --deletewiki blocktaleswiki (END - exit=256) [13:25:28] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [13:37:36] !log [wwr@mwtask171] sudo -u www-data php /srv/mediawiki/1.45/maintenance/run.php MirahezeMagic:RenameDatabase --wiki=loginwiki --rename --old=robloxblocktaleswiki --new=blocktaleswiki --user=TheWWRNerdGuy (END - exit=0) [13:37:38] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:00:37] [02ssl] 07WikiTideBot pushed 1 new commit to 03main 13https://github.com/miraheze/ssl/commit/7cc75ade80b602b18d5643deb8ec00db20e70a2e [14:00:37] 02ssl/03main 07WikiTideBot 037cc75ad Bot: Auto-update domain lists [15:29:10] !log [petramagna@test151] starting deploy of {'versions': '1.45', 'upgrade_extensions': 'Bucket'} to test151 [15:29:11] !log [petramagna@test151] DEPLOY ABORTED: Non-Zero Exit Code in prep, see output. [15:29:13] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:29:15] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:30:22] !log [wwr@mwtask171] sudo -u www-data php /srv/mediawiki/1.45/maintenance/run.php CreateWiki:SetContainersAccess --wiki=blocktaleswiki (END - exit=0) [15:30:24] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:30:40] [1/13] ``` [15:30:40] [2/13] petramagna@test151 /s/m/1/e/Bucket> sudo -u www-data git status [15:30:41] [3/13] On branch REL1_45 [15:30:41] [4/13] Your branch is behind 'origin/REL1_45' by 12 commits, and can be fast-forwarded. [15:30:41] [5/13] (use "git pull" to update your local branch) [15:30:41] [6/13] Changes to be committed: [15:30:42] [7/13] (use "git restore --staged ..." to unstage) [15:30:42] [8/13] modified: extension.json [15:30:42] [9/13] modified: includes/BucketDatabase.php [15:30:43] [10/13] modified: includes/Hooks/Handlers/SchemaHandler.php [15:30:43] [11/13] new file: maintenance/CreateInitialSchemaForBucketIssues.php [15:30:44] [12/13] ``` [15:30:44] [13/13] Safe to restore these changes on test151 I assume? [16:07:36] aye [17:10:15] !log restarting memcache on mem* [17:10:17] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:08:46] !log Move tables from robloxblocktaleswikicargo to blocktaleswikicargo via RENAME TABLE [18:08:48] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:18:10] e [20:38:52] !log [somerandomdeveloper@test151] sudo -u www-data php /srv/mediawiki/1.45/maintenance/run.php ManageWiki:ToggleExtension --wiki=loginwikibeta --name=linktitles --disable --all-wikis --execute (END - exit=0) [20:38:54] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:39:20] !log [somerandomdeveloper@mwtask181] sudo -u www-data php /srv/mediawiki/1.45/maintenance/run.php ManageWiki:ToggleExtension --wiki=loginwiki --name=linktitles --disable --all-wikis --execute (END - exit=0) [20:39:23] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:50:37] !log [somerandomdeveloper@mwtask181] sudo -u www-data /usr/local/bin/foreachwikiindblist /home/somerandomdeveloper/linktitles-perms.json /srv/mediawiki/1.45/maintenance/run ManageWiki:ModifyGroupPermission --all --removeperms=linktitles-batch [20:50:40] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:53:36] @cosmicalpha could we easily support removing multiple settings via PopulateWikiSettings? I need to remove 15 settings and the first one is already taking a while lol [20:53:55] I can add that now probably. [20:54:00] thanks [20:54:12] i think $setting could probably just be turned into an array? [20:54:41] Yes. Give me one moment. Shouldn't take more than a couple minutes. [20:54:43] miraheze/ManageWiki - Universal-Omega the build passed. [20:55:30] miraheze/ManageWiki - Universal-Omega the build passed. [20:57:19] @abaddriverlol do you think I should do it using multiOccurrence support in option or parse from comma separated or a txt file? [20:57:22] !log [somerandomdeveloper@mwtask181] sudo -u www-data php /srv/mediawiki/1.45/maintenance/run.php ManageWiki:PopulateWikiSettings --wiki=loginwiki --remove --all-wikis --execute --setting=wgLinkTitlesCheckRedirect (END - exit=0) [20:57:24] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:58:01] i think allowing to specify the option multiple times should be fine [20:58:25] realistically we probably won't need to remove large numbers of settings [20:58:31] 15 are already a lot [21:12:16] https://github.com/miraheze/ManageWiki/pull/782 fully untested. [21:12:16] [GitHub] [miraheze/ManageWiki #782] open PR by Universal-Omega, created 1 minute, 19 seconds ago: PopulateWikiSettings: support removing multiple settings at once | (empty comment) [21:14:09] thanks, looks fine to me [21:19:15] miraheze/ManageWiki - Universal-Omega the build passed. [21:32:37] !log [somerandomdeveloper@test151] starting deploy of {'folders': '1.45/extensions/ManageWiki'} to test151 [21:32:38] !log [somerandomdeveloper@test151] finished deploy of {'folders': '1.45/extensions/ManageWiki'} to test151 - SUCCESS in 0s [21:32:39] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:32:42] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:34:08] !log [somerandomdeveloper@test151] sudo -u www-data php /srv/mediawiki/1.45/maintenance/run.php ManageWiki:PopulateWikiSettings --wiki=loginwikibeta --remove --all-wikis --execute --setting=wgLinkTitlesCheckRedirect --setting=wgLinkTitlesEnableNoTargetMagicWord --setting=wgLinkTitlesFirstOnly --setting=wgLinkTitlesMinimumTitleLength [21:34:09] --setting=wgLinkTitlesParseHeadings --setting=wgLinkTitlesParseOnEdit --setting=wgLinkTitlesParseOnRender --setting=wgLinkTitlesPreferShortTitles --setting=wgLinkTitlesSmartMode --setting=wgLinkTitlesSameNamespace --setting=wgLinkTitlesSkipTemplates --setting=wgLinkTitlesSpecialPageReloadAfter --setting=wgLinkTitlesWordStartOnly [21:34:10] --setting=wgLinkTitlesWordEndOnly (END - exit=0) [21:34:10] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:38:56] !log [somerandomdeveloper@mwtask181] starting deploy of {'folders': '1.45/extensions/ManageWiki'} to all [21:38:58] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:39:12] (using --folders as we still use a separate branch with debug logging) [21:39:22] !log [somerandomdeveloper@mwtask181] finished deploy of {'folders': '1.45/extensions/ManageWiki'} to all - SUCCESS in 26s [21:39:24] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:41:22] miraheze/ManageWiki - SomeMWDev the build passed. [21:45:21] !log [somerandomdeveloper@mwtask181] sudo -u www-data php /srv/mediawiki/1.45/maintenance/run.php ManageWiki:PopulateWikiSettings --wiki=loginwiki --remove --all-wikis --execute --setting=wgLinkTitlesEnableNoTargetMagicWord --setting=wgLinkTitlesFirstOnly --setting=wgLinkTitlesMinimumTitleLength --setting=wgLinkTitlesParseHeadings [21:45:22] --setting=wgLinkTitlesParseOnEdit --setting=wgLinkTitlesParseOnRender --setting=wgLinkTitlesPreferShortTitles --setting=wgLinkTitlesSmartMode --setting=wgLinkTitlesSameNamespace --setting=wgLinkTitlesSkipTemplates --setting=wgLinkTitlesSpecialPageReloadAfter --setting=wgLinkTitlesWordStartOnly --setting=wgLinkTitlesWordEndOnly (END - exit=0) [21:45:23] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:45:38] !log --setting=wgLinkTitlesParseOnEdit --setting=wgLinkTitlesParseOnRender --setting=wgLinkTitlesPreferShortTitles --setting=wgLinkTitlesSmartMode --setting=wgLinkTitlesSameNamespace --setting=wgLinkTitlesSkipTemplates --setting=wgLinkTitlesSpecialPageReloadAfter --setting=wgLinkTitlesWordStartOnly --setting=wgLinkTitlesWordEndOnly (END - exit=0) [21:45:40] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:47:40] !log [somerandomdeveloper@mwtask181] starting deploy of {'pull': 'config', 'config': True} to all [21:47:42] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:47:54] !log [somerandomdeveloper@test151] starting deploy of {'pull': 'config', 'config': True} to test151 [21:47:55] !log [somerandomdeveloper@test151] finished deploy of {'pull': 'config', 'config': True} to test151 - SUCCESS in 1s [21:47:56] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:47:59] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:48:04] !log [somerandomdeveloper@mwtask181] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 24s [21:48:06] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:48:45] miraheze/mw-config - SomeMWDev the build passed. [21:53:32] !log [somerandomdeveloper@test151] starting deploy of {'extension_list': True, 'versions': '1.45'} to test151 [21:53:33] !log [somerandomdeveloper@test151] finished deploy of {'extension_list': True, 'versions': '1.45'} to test151 - SUCCESS in 0s [21:53:34] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:53:36] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:54:22] !log [somerandomdeveloper@test151] starting deploy of {'extension_list': True, 'versions': '1.45'} to test151 [21:54:23] !log [somerandomdeveloper@test151] finished deploy of {'extension_list': True, 'versions': '1.45'} to test151 - SUCCESS in 0s [21:54:24] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:54:27] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:54:48] !log ran "sudo -u www-data rm -rf /srv/mediawiki/1.45/extensions/LinkTitles/" and "sudo -u www-data rm -rf /srv/mediawiki-staging/1.45/extensions/LinkTitles/" on test151 [21:54:50] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:55:38] !log [somerandomdeveloper@mwtask181] sudo -u www-data rm -rf /srv/mediawiki-staging/1.45/extensions/LinkTitles/ [21:55:41] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:56:44] !log [somerandomdeveloper@puppet181] sudo salt-ssh -E mw.* cmd.run sudo -u www-data rm -rf /srv/mediawiki/1.45/extensions/LinkTitles/ [21:56:46] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:57:10] !log [somerandomdeveloper@mwtask181] starting deploy of {'extension_list': True, 'versions': '1.45'} to all [21:57:13] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:57:34] !log [somerandomdeveloper@mwtask181] finished deploy of {'extension_list': True, 'versions': '1.45'} to all - SUCCESS in 23s [21:57:37] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:42:39] PROBLEM - llm191 Puppet on llm191 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[openwebui] [22:46:01] !log [petramagna@test151] starting deploy of {'versions': '1.45', 'upgrade_extensions': 'Bucket'} to test151 [22:46:02] !log [petramagna@test151] finished deploy of {'versions': '1.45', 'upgrade_extensions': 'Bucket'} to test151 - SUCCESS in 0s [22:46:04] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:46:06] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:46:50] !log [petramagna@mwtask181] starting deploy of {'versions': '1.45', 'upgrade_extensions': 'Bucket'} to all [22:46:51] !log [petramagna@mwtask181] DEPLOY ABORTED: Non-Zero Exit Code in prep, see output. [22:46:52] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:46:54] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:47:56] !log [petramagna@mwtask181] starting deploy of {'versions': '1.45', 'upgrade_extensions': 'Bucket'} to all [22:47:58] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:48:22] !log [petramagna@mwtask181] finished deploy of {'versions': '1.45', 'upgrade_extensions': 'Bucket'} to all - SUCCESS in 25s [22:48:24] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:10:54] RECOVERY - llm191 Puppet on llm191 is OK: OK: Puppet is currently enabled, last run 24 seconds ago with 0 failures [23:59:22] PROBLEM - db151 Current Load on db151 is CRITICAL: LOAD CRITICAL - total load average: 37.02, 20.40, 8.53