[00:01:17] [02MirahezeMagic] 07pskyechology left a file comment in pull request #640 03c625485: ```suggestion […] 13https://github.com/miraheze/MirahezeMagic/pull/640#discussion_r2835543697 [00:01:26] [02statichelp] 07WikiTideBot pushed 1 new commit to 03main 13https://github.com/miraheze/statichelp/commit/6b377b61328f49f1be894e9931546f147d2d28aa [00:01:28] 02statichelp/03main 07WikiTideBot 036b377b6 Bot: Auto-update Tech namespace pages 2026-02-21 00:01:24 [00:02:40] PROBLEM - mwtask181 Current Load on mwtask181 is CRITICAL: LOAD CRITICAL - total load average: 25.85, 22.86, 20.16 [00:03:32] [02MirahezeMagic] 07BlankEclair pushed 1 new commit to 03T14033 13https://github.com/miraheze/MirahezeMagic/commit/0ef5136a567ff65473790428c597572b34bddb99 [00:03:32] 02MirahezeMagic/03T14033 07Claire Elaina 030ef5136 Fix hook name in extension.json… [00:06:39] PROBLEM - mwtask181 Current Load on mwtask181 is WARNING: LOAD WARNING - total load average: 22.21, 23.07, 20.93 [00:07:48] miraheze/MirahezeMagic - BlankEclair the build has errored. [00:08:39] PROBLEM - mwtask181 Current Load on mwtask181 is CRITICAL: LOAD CRITICAL - total load average: 24.25, 23.50, 21.34 [00:16:37] miraheze/MirahezeMagic - BlankEclair the build has errored. [00:32:11] RECOVERY - cp171 Disk Space on cp171 is OK: DISK OK - free space: / 73391MiB (16.2% inode=100%); [00:36:25] [02MirahezeMagic] 07BlankEclair pushed 1 new commit to 03T14033 13https://github.com/miraheze/MirahezeMagic/commit/8e89c76f4164415f50f5bd5bf9beb7f62e8db4b1 [00:36:25] 02MirahezeMagic/03T14033 07Claire Elaina 038e89c76 Move SpecialPageBeforeExecute hook to a separate file [00:40:29] miraheze/MirahezeMagic - BlankEclair the build has errored. [00:41:05] [02MirahezeMagic] 07BlankEclair pushed 1 new commit to 03T14033 13https://github.com/miraheze/MirahezeMagic/commit/c22187ca88c167b504ada69c92ebaf5af8d82442 [00:41:05] 02MirahezeMagic/03T14033 07Claire Elaina 03c22187c Fix extension.json syntax error [00:42:23] RECOVERY - cp201 Disk Space on cp201 is OK: DISK OK - free space: / 73122MiB (16.1% inode=100%); [00:44:11] [02MirahezeMagic] 07BlankEclair pushed 1 new commit to 03T14033 13https://github.com/miraheze/MirahezeMagic/commit/6776922f802000285a60183beeec712d63e136e1 [00:44:11] 02MirahezeMagic/03T14033 07Claire Elaina 036776922 Add comma [00:48:39] PROBLEM - mwtask181 Current Load on mwtask181 is WARNING: LOAD WARNING - total load average: 20.44, 21.91, 23.89 [00:50:18] [02mediawiki-repos] 07SomeMWDev created 03gup-job-fix (+1 new commit) 13https://github.com/miraheze/mediawiki-repos/commit/69deb6ee40a8 [00:50:18] 02mediawiki-repos/03gup-job-fix 07SomeRandomDeveloper 0369deb6e Add patch for GUP to limit the amount of jobs [00:50:27] [02mediawiki-repos] 07SomeMWDev opened pull request #120: Add patch for GUP to limit the amount of jobs (03main...03gup-job-fix) 13https://github.com/miraheze/mediawiki-repos/pull/120 [00:51:23] [02MirahezeMagic] 07pskyechology commented on pull request #640: can't believe my absolutely cracked suggestion of putting it in another handler worked 13https://github.com/miraheze/MirahezeMagic/pull/640#issuecomment-3937809765 [00:51:31] !log [somerandomdeveloper@test151] starting deploy of {'folders': '1.45/extensions/GlobalUserPage'} to test151 [00:51:32] !log [somerandomdeveloper@test151] finished deploy of {'folders': '1.45/extensions/GlobalUserPage'} to test151 - SUCCESS in 0s [00:51:34] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:51:35] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:51:57] miraheze/MirahezeMagic - BlankEclair the build passed. [00:52:22] [02MirahezeMagic] 07BlankEclair commented on pull request #640: it made sense when i thought about it lol […] 13https://github.com/miraheze/MirahezeMagic/pull/640#issuecomment-3937811641 [00:56:39] PROBLEM - mwtask181 Current Load on mwtask181 is CRITICAL: LOAD CRITICAL - total load average: 32.10, 24.90, 24.03 [01:00:31] [02mediawiki-repos] 07SomeMWDev merged pull request #120: Add patch for GUP to limit the amount of jobs (03main...03gup-job-fix) 13https://github.com/miraheze/mediawiki-repos/pull/120 [01:00:31] [02mediawiki-repos] 07SomeMWDev pushed 1 new commit to 03main 13https://github.com/miraheze/mediawiki-repos/commit/6be17aec7bbfc60adf2185684f4813d4d85cad9e [01:00:31] 02mediawiki-repos/03main 07SomeRandomDeveloper 036be17ae Add patch for GUP to limit the amount of jobs (#120) [01:00:33] [02mediawiki-repos] 07SomeMWDev 04deleted 03gup-job-fix at 0369deb6e 13https://api.github.com/repos/miraheze/mediawiki-repos/commit/69deb6e [01:00:42] RECOVERY - cp191 Disk Space on cp191 is OK: DISK OK - free space: / 73884MiB (16.3% inode=100%); [01:04:23] !log [somerandomdeveloper@mwtask181] starting deploy of {'versions': '1.45', 'upgrade_extensions': 'GlobalUserPage'} to all [01:04:25] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:04:26] !log [somerandomdeveloper@mwtask181] finished deploy of {'versions': '1.45', 'upgrade_extensions': 'GlobalUserPage'} to all - SUCCESS in 2s [01:04:28] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:04:31] !log [somerandomdeveloper@mwtask181] starting deploy of {'force_upgrade': True, 'versions': '1.45', 'upgrade_extensions': 'GlobalUserPage'} to all [01:04:33] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:04:51] mwdeploy did not apply the patch lol [01:05:04] !log [somerandomdeveloper@mwtask181] finished deploy of {'force_upgrade': True, 'versions': '1.45', 'upgrade_extensions': 'GlobalUserPage'} to all - SUCCESS in 33s [01:05:06] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:06:02] oh apparently it did but it didn't log it? [01:06:36] [1/7] ``` [01:06:36] [2/7] [somerandomdeveloper@mwtask181:~]$ cat /srv/mediawiki/1.45/extensions/GlobalUserPage/includes/LocalJobSubmitJob.php | grep "CentralAuth" [01:06:36] [3/7] use MediaWiki\Extension\CentralAuth\User\CentralAuthUser; [01:06:37] [4/7] if ( $services->getExtensionRegistry()->isLoaded( 'CentralAuth' ) ) { [01:06:37] [5/7] $localAccounts = CentralAuthUser::getInstance( $user )->queryAttachedBasic(); [01:06:37] [6/7] ``` [01:06:37] [7/7] ig it's there now [01:06:53] ok nvm I'm blind, it did log it [01:12:13] [02mw-config] 07pskyechology approved pull request #6323: Thank you! 13https://github.com/miraheze/mw-config/pull/6323#pullrequestreview-3834758751 [01:12:25] [02mw-config] 07pskyechology merged 07YTFGolf's pull request #6323: T15003: Set 'vector-theme' preference to 'os' on lazerpigeonwiki (07miraheze:03main...07YTFGolf:03patch-T15003) 13https://github.com/miraheze/mw-config/pull/6323 [01:12:25] [02mw-config] 07pskyechology pushed 1 new commit to 03main 13https://github.com/miraheze/mw-config/commit/34526177d320812227247ae2dc8f76c641a427e7 [01:12:25] 02mw-config/03main 07YTFGolf 033452617 T15003: Set 'vector-theme' preference to 'os' on lazerpigeonwiki (#6323)… [01:12:49] !log [skye@mwtask181] starting deploy of {'pull': 'config', 'config': True} to all [01:12:51] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:13:18] !log [skye@mwtask181] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 29s [01:13:20] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:13:32] miraheze/mw-config - pskyechology the build passed. [01:27:54] [02mediawiki-repos] 07Universal-Omega commented on pull request #120: Can't you use https://github.com/wikimedia/mediawiki/blob/b186cc3/includes/User/CentralId/CentralIdLookup.php#L96 which by using CentralIdLookup should also support CentralAuth? I am not 100% sure though and havent looked into it *much* yet. 13https://github.com/miraheze/mediawiki-repos/pull/120#issuecomment-3937867707 [01:30:55] [02mediawiki-repos] 07SomeMWDev commented on pull request #120: Hm I guess that would work as well, I'm gonna look into that tomorrow probably 13https://github.com/miraheze/mediawiki-repos/pull/120#issuecomment-3937872004 [01:36:53] [02MirahezeMagic] 07Universal-Omega left a file comment in pull request #640 036776922: We dont geo block it, its global to prevent us having to do that. So this wording may get a bit confusing. 13https://github.com/miraheze/MirahezeMagic/pull/640#discussion_r2835665663 [01:38:18] [02MirahezeMagic] 07BlankEclair left a file comment in pull request #640 036776922: I stole that message from the task; do you have any better phrasing? ^^; 13https://github.com/miraheze/MirahezeMagic/pull/640#discussion_r2835667185 [01:40:41] [02MirahezeMagic] 07Universal-Omega left a file comment in pull request #640 036776922: "Due to local laws and regulations in some jurisdictions, EmailUser has been disabled. If you need to contact another user, please try using their talk page." I think? 13https://github.com/miraheze/MirahezeMagic/pull/640#discussion_r2835669641 [01:43:21] [02MirahezeMagic] 07BlankEclair pushed 1 new commit to 03T14033 13https://github.com/miraheze/MirahezeMagic/commit/fa6db2d7994af1724959122743fd3242ea94e2d2 [01:43:21] 02MirahezeMagic/03T14033 07Claire Elaina 03fa6db2d Use suggested phrasing from CA [01:47:02] [02MirahezeMagic] 07Universal-Omega approved pull request #640 13https://github.com/miraheze/MirahezeMagic/pull/640#pullrequestreview-3834792238 [01:49:11] [02MirahezeMagic] 07Universal-Omega left a file comment in pull request #640 03fa6db2d: I think $special->getAuthority()->isAllowed( 'sendemail' ) could work to prevent needing the service at all, but nkt to concerned about it so if you dont want to this works for me. 13https://github.com/miraheze/MirahezeMagic/pull/640#discussion_r2835678417 [01:50:06] [02MirahezeMagic] 07BlankEclair left a file comment in pull request #640 03fa6db2d: That checks for blocks and rate limits :p 13https://github.com/miraheze/MirahezeMagic/pull/640#discussion_r2835679301 [01:50:26] [02MirahezeMagic] 07BlankEclair left a file comment in pull request #640 03fa6db2d: Wait no, I was thinking of isDefinitelyAllowed... 13https://github.com/miraheze/MirahezeMagic/pull/640#discussion_r2835679551 [01:51:37] [02MirahezeMagic] 07Universal-Omega left a file comment in pull request #640 03fa6db2d: All groups that would affect which have sendemail are not affected by rate limits, and if they needed to could use metawiki to send email where they would never be blocked. 13https://github.com/miraheze/MirahezeMagic/pull/640#discussion_r2835680766 [01:51:50] miraheze/MirahezeMagic - BlankEclair the build passed. [01:53:01] [02MirahezeMagic] 07BlankEclair pushed 1 new commit to 03T14033 13https://github.com/miraheze/MirahezeMagic/commit/a0039be13e245d1113b0fa2371be40fdede73cec [01:53:01] 02MirahezeMagic/03T14033 07Claire Elaina 03a0039be Avoid PermissionManager [02:00:55] miraheze/MirahezeMagic - BlankEclair the build passed. [02:03:37] !log badorkbeewiki: https://issue-tracker.miraheze.org/P586 [02:03:40] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [02:06:39] PROBLEM - mwtask181 Current Load on mwtask181 is WARNING: LOAD WARNING - total load average: 17.75, 21.44, 23.85 [02:26:00] !log [blankeclair@test151] sudo -u www-data php /srv/mediawiki/1.45/maintenance/run.php OATHAuth:disableOATHAuthForUser --wiki=metawikibeta blankEclair (END - exit=65280) [02:26:02] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [02:26:26] !log [blankeclair@test151] sudo -u www-data php /srv/mediawiki/1.45/maintenance/run.php OATHAuth:DisableOATHAuthForUser --wiki=metawikibeta blankEclair (END - exit=256) [02:26:28] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [02:28:39] RECOVERY - mwtask181 Current Load on mwtask181 is OK: LOAD OK - total load average: 18.99, 18.74, 20.28 [02:29:28] !log test151: manually remove 2fa for blankEclair [02:29:30] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [02:30:23] [02ssl] 07WikiTideBot pushed 1 new commit to 03main 13https://github.com/miraheze/ssl/commit/9369200f0b73dcb4efac67c1bb277a9e93f925b9 [02:30:23] 02ssl/03main 07WikiTideBot 039369200 Bot: Auto-update domain lists [02:32:39] PROBLEM - mwtask181 Current Load on mwtask181 is CRITICAL: LOAD CRITICAL - total load average: 26.48, 22.68, 21.49 [02:34:39] PROBLEM - mwtask181 Current Load on mwtask181 is WARNING: LOAD WARNING - total load average: 22.32, 22.26, 21.48 [02:36:39] PROBLEM - mwtask181 Current Load on mwtask181 is CRITICAL: LOAD CRITICAL - total load average: 27.86, 25.45, 22.80 [02:38:39] PROBLEM - mwtask181 Current Load on mwtask181 is WARNING: LOAD WARNING - total load average: 20.25, 23.43, 22.38 [02:46:40] RECOVERY - mwtask181 Current Load on mwtask181 is OK: LOAD OK - total load average: 16.05, 18.32, 20.35 [02:54:17] !log [blankeclair@mwtask181] Starting import for shintowiki (XML: shintowiki-20251218.xml.gz; Images: tmp/shintowiki/) (START) [02:54:18] !log [blankeclair@mwtask181] sudo -u www-data php /srv/mediawiki/1.45/maintenance/run.php importDump --wiki=shintowiki --no-updates -- shintowiki-20251218.xml.gz (START) [02:54:19] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [02:54:21] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [02:57:32] PROBLEM - mwtask181 Current Load on mwtask181 is CRITICAL: LOAD CRITICAL - total load average: 26.84, 23.57, 21.58 [02:57:41] whoops [02:58:48] girl get the fuck off mwtask181 with that bomb [02:59:53] ping for attention :3 ^ [02:59:59] !log [blankeclair@mwtask181] sudo -u www-data php /srv/mediawiki/1.45/maintenance/run.php importDump --wiki=shintowiki --no-updates -- shintowiki-20251218.xml.gz (END - exit=-2) [03:00:00] !log [blankeclair@mwtask181] Finished import for shintowiki (XML: shintowiki-20251218.xml.gz; Images: tmp/shintowiki/) (END - exit=-2) [03:00:01] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:00:02] yes ma'am [03:00:03] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:00:10] should i do it on mwtask171 instead? [03:00:18] yeah any other should be fine [03:00:21] oki~ [03:00:27] thank youuuuu <3 [03:01:52] !log [blankeclair@mwtask171] Starting import for shintowiki (XML: shintowiki-20251218.xml.gz; Images: tmp/shintowiki/) (START) [03:01:53] !log [blankeclair@mwtask171] sudo -u www-data php /srv/mediawiki/1.45/maintenance/run.php importDump --wiki=shintowiki --no-updates -- shintowiki-20251218.xml.gz (START) [03:01:54] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:01:55] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:05:21] PROBLEM - mwtask181 Current Load on mwtask181 is WARNING: LOAD WARNING - total load average: 19.92, 23.46, 22.56 [03:05:38] idk why but i swear mwtask181 is always keen on exploding even if we aren't all using it at the same time [03:08:21] because everything (not everyone) else is using it all at the same time [03:17:20] [Grafana] RESOLVED: High Job Queue Backlog https://grafana.wikitide.net/d/GtxbP1Xnk?from=1771626410000&orgId=1&to=1771643810000 [03:24:55] RECOVERY - mwtask181 Current Load on mwtask181 is OK: LOAD OK - total load average: 20.03, 19.20, 20.36 [03:28:47] PROBLEM - mwtask181 Current Load on mwtask181 is WARNING: LOAD WARNING - total load average: 23.43, 21.19, 20.88 [03:30:44] PROBLEM - mwtask181 Current Load on mwtask181 is CRITICAL: LOAD CRITICAL - total load average: 25.55, 22.86, 21.54 [03:32:50] me before my parents [03:32:53] me after my parents [03:34:39] PROBLEM - mwtask181 Current Load on mwtask181 is WARNING: LOAD WARNING - total load average: 21.95, 23.22, 22.05 [03:40:39] RECOVERY - mwtask181 Current Load on mwtask181 is OK: LOAD OK - total load average: 5.64, 14.82, 19.06 [04:00:22] [02ssl] 07WikiTideBot pushed 1 new commit to 03main 13https://github.com/miraheze/ssl/commit/de3420d489e53dac8fbc302a85b0827bcc8fc768 [04:00:22] 02ssl/03main 07WikiTideBot 03de3420d Bot: Auto-update domain lists [04:25:36] !log [blankeclair@mwtask161] sudo -u www-data php /srv/mediawiki/1.45/maintenance/run.php nukeNS --wiki=hispanowiki --ns 0 --all --delete (START) [04:25:38] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [04:25:57] !log [blankeclair@mwtask161] sudo -u www-data php /srv/mediawiki/1.45/maintenance/run.php nukeNS --wiki=hispanowiki --ns 0 --all --delete (END - exit=0) [04:25:59] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [04:30:20] [02ssl] 07WikiTideBot pushed 1 new commit to 03main 13https://github.com/miraheze/ssl/commit/2964166d093154f746b78a377de094b589fa869f [04:30:21] 02ssl/03main 07WikiTideBot 032964166 Bot: Auto-update domain lists [04:37:14] !log [universalomega@bots171] Restart ircrcbot-MirahezeRC2 [04:37:16] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:00:19] [02ssl] 07WikiTideBot pushed 1 new commit to 03main 13https://github.com/miraheze/ssl/commit/4119084380bdf4f3f9e68c939ea2bf173166cc05 [05:00:19] 02ssl/03main 07WikiTideBot 034119084 Bot: Auto-update domain lists [05:10:51] !log [skye@mwtask181] sudo -u www-data php /srv/mediawiki/1.45/maintenance/run.php createAndPromote --wiki=loginwiki 'Skye (Miraheze)' --sysop --force (END - exit=0) [05:10:53] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:30:19] [02ssl] 07WikiTideBot pushed 1 new commit to 03main 13https://github.com/miraheze/ssl/commit/0c5bf087aa00a03c4ee4881e5126cdea92bee25a [05:30:19] 02ssl/03main 07WikiTideBot 030c5bf08 Bot: Auto-update domain lists [06:49:33] [02DataMaps] 07lihaohong6 opened pull request #1: Update README.md (07miraheze:03main...07lihaohong6:03main) 13https://github.com/miraheze/DataMaps/pull/1 [07:30:22] [02ssl] 07WikiTideBot pushed 1 new commit to 03main 13https://github.com/miraheze/ssl/commit/209558b29d7ebc63a55b9a0fa63896c67be4bfe4 [07:30:22] 02ssl/03main 07WikiTideBot 03209558b Bot: Auto-update domain lists [11:00:20] [02ssl] 07WikiTideBot pushed 1 new commit to 03main 13https://github.com/miraheze/ssl/commit/75ef40d9560f86a0a1a9d325498175a72b37f981 [11:00:20] 02ssl/03main 07WikiTideBot 0375ef40d Bot: Auto-update domain lists [11:33:45] PROBLEM - puppet181 Check unit status of listdomains_github_push on puppet181 is CRITICAL: CRITICAL: Status of the systemd unit listdomains_github_push [12:01:45] RECOVERY - puppet181 Check unit status of listdomains_github_push on puppet181 is OK: OK: Status of the systemd unit listdomains_github_push [12:30:20] [02ssl] 07WikiTideBot pushed 1 new commit to 03main 13https://github.com/miraheze/ssl/commit/1f8cc0cc63378c20d8c3e1c33b5362a27ef41ea8 [12:30:20] 02ssl/03main 07WikiTideBot 031f8cc0c Bot: Auto-update domain lists [12:44:12] [02mw-config] 07lihaohong6 merged pull request #6311: T14581: Add help messages for problematic extensions (07miraheze:03main...07lihaohong6:03T14581) 13https://github.com/miraheze/mw-config/pull/6311 [12:44:12] [02mw-config] 07lihaohong6 pushed 1 new commit to 03main 13https://github.com/miraheze/mw-config/commit/cdc6f7ba2278d122aaf40c133bec637f4bf4de3f [12:44:13] 02mw-config/03main 07Peter Li 03cdc6f7b T14581: Add help messages for problematic extensions (#6311) [12:45:23] miraheze/mw-config - lihaohong6 the build passed. [12:45:58] !log [petramagna@mwtask181] starting deploy of {'pull': 'config', 'config': True} to all [12:46:00] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:46:27] !log [petramagna@mwtask181] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 29s [12:46:30] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:47:44] [02puppet] 07paladox created 03paladox-patch-1 (+1 new commit) 13https://github.com/miraheze/puppet/commit/c97f2ba77a2e [12:47:45] 02puppet/03paladox-patch-1 07paladox 03c97f2ba changeprop: Lower concurrency for some jobs [12:47:48] [02puppet] 07paladox opened pull request #4774: changeprop: Lower concurrency for some jobs (03main...03paladox-patch-1) 13https://github.com/miraheze/puppet/pull/4774 [12:48:58] [02puppet] 07paladox merged pull request #4774: changeprop: Lower concurrency for some jobs (03main...03paladox-patch-1) 13https://github.com/miraheze/puppet/pull/4774 [12:49:00] [02puppet] 07paladox pushed 1 new commit to 03main 13https://github.com/miraheze/puppet/commit/117cd815de18171d59a8fbd1e80e7f74eac37c25 [12:49:01] [02puppet] 07paladox 04deleted 03paladox-patch-1 at 03c97f2ba 13https://api.github.com/repos/miraheze/puppet/commit/c97f2ba [12:49:03] 02puppet/03main 07paladox 03117cd81 changeprop: Lower concurrency for some jobs (#4774) [12:49:22] !log [petramagna@test151] starting deploy of {'config': True} to test151 [12:49:23] !log [petramagna@test151] finished deploy of {'config': True} to test151 - SUCCESS in 0s [12:49:24] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:49:26] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:52:37] [02mw-config] 07lihaohong6 readied pull request #6312: T14964: Add MultimediaViewer as a default extension (07miraheze:03main...07lihaohong6:03T14964) 13https://github.com/miraheze/mw-config/pull/6312 [13:01:44] !log [petramagna@test151] sudo -u www-data php /srv/mediawiki/1.45/maintenance/run.php CreateWiki:DeleteWiki --wiki=loginwiki --delete --deletewiki defaultextwikibeta (END - exit=512) [13:01:45] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [13:02:17] !log [petramagna@test151] sudo -u www-data php /srv/mediawiki/1.45/maintenance/run.php CreateWiki:DeleteWiki --wiki=loginwikibeta --delete --deletewiki defaultextwikibeta (END - exit=0) [13:02:19] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [13:25:41] !log [petramagna@mwtask171] sudo -u www-data php /srv/mediawiki/1.45/maintenance/run.php CreateWiki:DeleteWiki --wiki=loginwiki --delete --deletewiki flowtestwiki (END - exit=0) [13:25:44] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:56:26] [02puppet] 07paladox created 03paladox-patch-1 (+1 new commit) 13https://github.com/miraheze/puppet/commit/4e2ea7aae507 [14:56:26] 02puppet/03paladox-patch-1 07paladox 034e2ea7a Update health check endpoints in lb.cfg.erb [14:56:30] [02puppet] 07paladox opened pull request #4775: Update health check endpoints in lb.cfg.erb (03main...03paladox-patch-1) 13https://github.com/miraheze/puppet/pull/4775 [14:57:15] [02puppet] 07paladox merged pull request #4775: Update health check endpoints in lb.cfg.erb (03main...03paladox-patch-1) 13https://github.com/miraheze/puppet/pull/4775 [14:57:15] [02puppet] 07paladox pushed 1 new commit to 03main 13https://github.com/miraheze/puppet/commit/92bcba412e44b876e9951ec36b6c653fa0f01c25 [14:57:15] 02puppet/03main 07paladox 0392bcba4 Update health check endpoints in lb.cfg.erb (#4775) [14:57:17] [02puppet] 07paladox 04deleted 03paladox-patch-1 at 034e2ea7a 13https://api.github.com/repos/miraheze/puppet/commit/4e2ea7a [15:25:54] [02puppet] 07Copilot assigned pull request #4776 to 07paladox ([WIP] Update HAProxy TLS terminator template for Cloudflare compatibility) 13https://github.com/miraheze/puppet/pull/4776 [15:25:54] [02puppet] 07Copilot self-assigned pull request #4776 ([WIP] Update HAProxy TLS terminator template for Cloudflare compatibility) 13https://github.com/miraheze/puppet/pull/4776 [15:25:54] [02puppet] 07Copilot drafted pull request #4776: [WIP] Update HAProxy TLS terminator template for Cloudflare compatibility (03main...03copilot/update-haproxy-tls-template) 13https://github.com/miraheze/puppet/pull/4776 [15:28:08] [02puppet] 07Copilot pushed 1 new commit to 03copilot/update-haproxy-tls-template 13https://github.com/miraheze/puppet/commit/32580b6190a10578ed26e9d2d3da4e3ee66e1b52 [15:28:10] 02puppet/03copilot/update-haproxy-tls-template 07copilot-swe-agent[bot] 0332580b6 cache/haproxy: disable backend connection reuse in varnish backend listeners… [15:28:41] [02puppet] 07Copilot retitled PR #4776: "[WIP] Update HAProxy TLS terminator template for Cloudflare compatibility" ➜ "cache/haproxy: disable backend connection reuse in varnish backend listeners" 13https://github.com/miraheze/puppet/pull/4776 [15:33:34] [02puppet] 07paladox closed pull request #4776: cache/haproxy: disable backend connection reuse in varnish backend listeners (03main...03copilot/update-haproxy-tls-template) 13https://github.com/miraheze/puppet/pull/4776 [15:33:51] [02puppet] 07paladox 04deleted 03copilot/update-haproxy-tls-template at 0332580b6 13https://api.github.com/repos/miraheze/puppet/commit/32580b6 [15:56:35] !log [blankeclair@mwtask171] sudo -u www-data php /srv/mediawiki/1.45/maintenance/run.php importDump --wiki=shintowiki --no-updates -- shintowiki-20251218.xml.gz (END - exit=1) [15:56:36] !log [blankeclair@mwtask171] Finished import for shintowiki (XML: shintowiki-20251218.xml.gz; Images: tmp/shintowiki/) (END - exit=1) [15:56:37] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:56:39] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:18:27] [02puppet] 07paladox created 03paladox-patch-1 (+1 new commit) 13https://github.com/miraheze/puppet/commit/4a779f5fd567 [16:18:29] 02puppet/03paladox-patch-1 07paladox 034a779f5 Reduce concurrency values for parsoidCachePrewarm and htmlCacheUpdate [16:18:30] [02puppet] 07paladox opened pull request #4777: Reduce concurrency values for parsoidCachePrewarm and htmlCacheUpdate (03main...03paladox-patch-1) 13https://github.com/miraheze/puppet/pull/4777 [16:18:37] [02puppet] 07paladox merged pull request #4777: Reduce concurrency values for parsoidCachePrewarm and htmlCacheUpdate (03main...03paladox-patch-1) 13https://github.com/miraheze/puppet/pull/4777 [16:18:37] [02puppet] 07paladox pushed 1 new commit to 03main 13https://github.com/miraheze/puppet/commit/6683ef6f3c4183aff7c64ade49bb389e1fbeac80 [16:18:37] 02puppet/03main 07paladox 036683ef6 Reduce concurrency values for parsoidCachePrewarm and htmlCacheUpdate (#4777) [16:18:38] [02puppet] 07paladox 04deleted 03paladox-patch-1 at 034a779f5 13https://api.github.com/repos/miraheze/puppet/commit/4a779f5 [16:20:45] [02puppet] 07paladox pushed 1 new commit to 03main 13https://github.com/miraheze/puppet/commit/c9ce1bcf9e69630588f25d3a427607f05f014a38 [16:20:45] 02puppet/03main 07paladox 03c9ce1bc Reduce concurrency for LocalGlobalUserPageCacheUpdateJob [16:38:11] PROBLEM - cp171 Disk Space on cp171 is WARNING: DISK WARNING - free space: / 45291MiB (10.0% inode=100%); [16:40:23] PROBLEM - cp201 Disk Space on cp201 is WARNING: DISK WARNING - free space: / 45208MiB (10.0% inode=100%); [16:58:32] PROBLEM - matomo151 Current Load on matomo151 is CRITICAL: LOAD CRITICAL - total load average: 17.48, 13.09, 9.83 [17:00:32] RECOVERY - matomo151 Current Load on matomo151 is OK: LOAD OK - total load average: 13.37, 13.07, 10.22 [17:12:42] PROBLEM - cp191 Disk Space on cp191 is WARNING: DISK WARNING - free space: / 45272MiB (10.0% inode=100%); [18:14:10] PROBLEM - db151 Current Load on db151 is CRITICAL: LOAD CRITICAL - total load average: 20.05, 13.82, 9.01 [18:18:10] RECOVERY - db151 Current Load on db151 is OK: LOAD OK - total load average: 3.23, 9.00, 8.22 [18:33:45] PROBLEM - puppet181 Check unit status of listdomains_github_push on puppet181 is CRITICAL: CRITICAL: Status of the systemd unit listdomains_github_push [18:58:10] [02mw-config] 07Universal-Omega pushed 1 new commit to 03main 13https://github.com/miraheze/mw-config/commit/1feba5ce8617bdebc095241f5ea8516e2e9d5418 [18:58:10] 02mw-config/03main 07CosmicAlpha 031feba5c RunJobs: set $wgRequestTimeLimit [18:59:10] [02mw-config] 07Universal-Omega pushed 1 new commit to 03main 13https://github.com/miraheze/mw-config/commit/23d587d7d190a48d7d21592e53b46a0b597dcfa2 [18:59:10] 02mw-config/03main 07CosmicAlpha 0323d587d Move below WebStart [18:59:19] miraheze/mw-config - Universal-Omega the build passed. [19:00:31] miraheze/mw-config - Universal-Omega the build passed. [19:01:45] RECOVERY - puppet181 Check unit status of listdomains_github_push on puppet181 is OK: OK: Status of the systemd unit listdomains_github_push [19:03:20] [02mw-config] 07Universal-Omega pushed 1 new commit to 03main 13https://github.com/miraheze/mw-config/commit/a042f4b8c639683e3385bde66306666ce673c7a1 [19:03:20] 02mw-config/03main 07CosmicAlpha 03a042f4b Remove since doesnt do anything here [19:04:34] miraheze/mw-config - Universal-Omega the build passed. [19:05:43] [02mw-config] 07Universal-Omega created 03beta-timeout-fix (+1 new commit) 13https://github.com/miraheze/mw-config/commit/9ccae7cda480 [19:05:44] 02mw-config/03beta-timeout-fix 07CosmicAlpha 039ccae7c Fix jobs timeout on beta [19:05:52] [02mw-config] 07Universal-Omega opened pull request #6324: Fix jobs timeout on beta (03main...03beta-timeout-fix) 13https://github.com/miraheze/mw-config/pull/6324 [19:07:08] miraheze/mw-config - Universal-Omega the build passed. [19:09:11] [02mw-config] 07paladox merged 07Universal-Omega's pull request #6324: Fix jobs timeout on beta (03main...03beta-timeout-fix) 13https://github.com/miraheze/mw-config/pull/6324 [19:09:12] [02mw-config] 07paladox pushed 1 new commit to 03main 13https://github.com/miraheze/mw-config/commit/43bdbb8af5143f898e920cd35e025206ae53c338 [19:09:14] [02mw-config] 07paladox 04deleted 03beta-timeout-fix at 039ccae7c 13https://api.github.com/repos/miraheze/mw-config/commit/9ccae7c [19:09:16] 02mw-config/03main 07CosmicAlpha 0343bdbb8 Fix jobs timeout on beta (#6324) [19:10:07] !log [universalomega@test151] starting deploy of {'pull': 'config', 'config': True} to test151 [19:10:08] !log [universalomega@test151] finished deploy of {'pull': 'config', 'config': True} to test151 - SUCCESS in 0s [19:10:09] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:10:11] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:12:45] miraheze/mw-config - paladox the build passed. [20:00:20] [02ssl] 07WikiTideBot pushed 1 new commit to 03main 13https://github.com/miraheze/ssl/commit/241c632a3638c9c7a705cc97e84b5ce95022436e [20:00:21] 02ssl/03main 07WikiTideBot 03241c632 Bot: Auto-update domain lists [20:33:45] PROBLEM - puppet181 Check unit status of listdomains_github_push on puppet181 is CRITICAL: CRITICAL: Status of the systemd unit listdomains_github_push [21:00:26] [02ssl] 07WikiTideBot pushed 1 new commit to 03main 13https://github.com/miraheze/ssl/commit/5bdb2e91176ca8cc004802aee17a695b0908cc14 [21:00:26] 02ssl/03main 07WikiTideBot 035bdb2e9 Bot: Auto-update domain lists [21:01:45] RECOVERY - puppet181 Check unit status of listdomains_github_push on puppet181 is OK: OK: Status of the systemd unit listdomains_github_push [21:02:44] PROBLEM - mw201 Current Load on mw201 is CRITICAL: LOAD CRITICAL - total load average: 27.15, 20.91, 14.45 [21:04:44] RECOVERY - mw201 Current Load on mw201 is OK: LOAD OK - total load average: 16.02, 18.98, 14.55 [22:20:11] RECOVERY - cp171 Disk Space on cp171 is OK: DISK OK - free space: / 72509MiB (16.0% inode=100%); [22:25:23] !log reboot bots171, reports of connection issues persisting a service restart [22:25:25] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:26:33] Seems like some aren’t starting automatically and need a manual kick [22:27:12] I'm seeing if puppet auto starts things [22:27:26] It should in theory ensure=running [22:27:35] No [22:27:38] Sigh [22:28:02] LSBot cvtbot and rc bots [22:30:37] https://github.com/miraheze/puppet/blob/main/modules/irc/manifests/ircrcbot.pp#L21 [22:30:38] [GitHub] [miraheze/puppet] modules/irc/manifests/ircrcbot.pp @ main | L21:  ensure => present, [22:31:01] RhinosF1: ^ we ensure=present not ensure=running [22:31:14] I'm aware [22:31:22] And about to send a PR [22:31:26] I started them all [22:32:03] I started them all but RC doesn't look to be up [22:32:15] LSBot too [22:32:30] PROBLEM - test151 APT on test151 is WARNING: APT WARNING: 0 packages available for upgrade (0 critical updates). warnings detected, errors detected. [22:32:34] I'm not sure why [22:32:41] The services are running [22:33:35] [02puppet] 07RhinosF1 created 03RhinosF1-patch-2 (+1 new commit) 13https://github.com/miraheze/puppet/commit/2d4be8e4d116 [22:33:35] 02puppet/03RhinosF1-patch-2 07RhinosF1 032d4be8e irc: set some services to running over present [22:33:40] [02puppet] 07RhinosF1 opened pull request #4778: irc: set some services to running over present (03main...03RhinosF1-patch-2) 13https://github.com/miraheze/puppet/pull/4778 [22:33:50] Anything in the logs RhinosF1 [22:34:23] [02puppet] 07RhinosF1 pushed 1 new commit to 03RhinosF1-patch-2 13https://github.com/miraheze/puppet/commit/45381cb6d006629cd9611a5fdbf4ceca01dc421e [22:34:23] 02puppet/03RhinosF1-patch-2 07RhinosF1 0345381cb Change cvtbot service ensure state to running [22:34:52] PROBLEM - test151 Puppet on test151 is CRITICAL: CRITICAL: Puppet has 147 failures. Last run 2 minutes ago with 147 failures. Failed resources (up to 3 shown): Package[gnupg],Package[acct],Package[apt-transport-https],Package[coreutils] [22:35:00] [02puppet] 07RhinosF1 pushed 1 new commit to 03RhinosF1-patch-2 13https://github.com/miraheze/puppet/commit/6eac06e31896d5759ebdaddd36b28309ce5cfb4f [22:35:00] 02puppet/03RhinosF1-patch-2 07RhinosF1 036eac06e Change irclogserverbot service status to running [22:35:26] MacFan4000: no [22:35:35] @paladox: any idea [22:39:10] Really strange especially since lsbot and rc1 were working prior to this [22:40:40] PROBLEM - test151 APT on test151 is CRITICAL: connect to address 10.0.15.118 port 5666: Connection refusedconnect to host 10.0.15.118 port 5666: Connection refused [22:42:41] RECOVERY - test151 APT on test151 is OK: APT OK: 1 packages available for upgrade (0 critical updates). [22:42:49] RECOVERY - test151 Puppet on test151 is OK: OK: Puppet is currently enabled, last run 38 seconds ago with 0 failures [22:43:16] Or @cosmicalpha [22:43:34] bots is playing up and I need to sleep [22:43:44] I will look at that in a bit. [22:45:48] [02puppet] 07paladox commented on pull request #4778: I'm not sure this fixes anything apart from if the service crashed or booted up. If it disconnects from irc I don't think it crashes? 13https://github.com/miraheze/puppet/pull/4778#issuecomment-3939632168 [22:45:59] [02puppet] 07paladox merged 07RhinosF1's pull request #4778: irc: set some services to running over present (03main...03RhinosF1-patch-2) 13https://github.com/miraheze/puppet/pull/4778 [22:46:00] [02puppet] 07paladox pushed 1 new commit to 03main 13https://github.com/miraheze/puppet/commit/a757a151c63e6486b72a1903d154338df20caf4f [22:46:00] 02puppet/03main 07RhinosF1 03a757a15 irc: set some services to running over present (#4778) [22:46:01] [02puppet] 07paladox 04deleted 03RhinosF1-patch-2 at 036eac06e 13https://api.github.com/repos/miraheze/puppet/commit/6eac06e [22:48:55] Thanks @paladox [22:50:42] RECOVERY - cp191 Disk Space on cp191 is OK: DISK OK - free space: / 72947MiB (16.1% inode=100%); [22:53:31] PROBLEM - bots171 IRC RC Bot MirahezeRC on bots171 is CRITICAL: PROCS CRITICAL: 0 processes with args 'ircrcbot-MirahezeRC.py' [22:55:12] PROBLEM - bots171 Puppet on bots171 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [22:56:08] PROBLEM - bots171 IRC Log Server Bot on bots171 is CRITICAL: PROCS CRITICAL: 0 processes with args 'irclogserverbot.py' [23:10:08] RECOVERY - bots171 IRC Log Server Bot on bots171 is OK: PROCS OK: 1 process with args 'irclogserverbot.py' [23:12:08] [02puppet] 07Universal-Omega created 03revert-4778-RhinosF1-patch-2 (+1 new commit) 13https://github.com/miraheze/puppet/commit/7f1c8785a438 [23:12:09] 02puppet/03revert-4778-RhinosF1-patch-2 07CosmicAlpha 037f1c878 Revert "irc: set some services to running over present (#4778)"… [23:13:28] [02puppet] 07Universal-Omega opened pull request #4779: Revert "irc: set some services to running over present" (03main...03revert-4778-RhinosF1-patch-2) 13https://github.com/miraheze/puppet/pull/4779 [23:13:48] [02puppet] 07Universal-Omega merged pull request #4779: Revert "irc: set some services to running over present" (03main...03revert-4778-RhinosF1-patch-2) 13https://github.com/miraheze/puppet/pull/4779 [23:13:50] [02puppet] 07Universal-Omega pushed 1 new commit to 03main 13https://github.com/miraheze/puppet/commit/240d31692e507c24ac5ac2b53e0cef683325b506 [23:13:52] [02puppet] 07Universal-Omega 04deleted 03revert-4778-RhinosF1-patch-2 at 037f1c878 13https://api.github.com/repos/miraheze/puppet/commit/7f1c878 [23:13:53] 02puppet/03main 07CosmicAlpha 03240d316 Revert "irc: set some services to running over present" (#4779)… [23:24:08] PROBLEM - bots171 IRC Log Server Bot on bots171 is CRITICAL: PROCS CRITICAL: 3 processes with args 'irclogserverbot.py' [23:31:12] PROBLEM - bots171 Puppet on bots171 is WARNING: WARNING: Puppet is currently disabled, message: Universal Omega, last run 1 minute ago with 0 failures [23:31:31] RECOVERY - bots171 IRC RC Bot MirahezeRC on bots171 is OK: PROCS OK: 1 process with args 'ircrcbot-MirahezeRC.py' [23:48:27] [02puppet] 07Universal-Omega pushed 1 new commit to 03main 13https://github.com/miraheze/puppet/commit/7479a1cf53a9bf408a8373bb402fa64c9d1220a4 [23:48:27] 02puppet/03main 07CosmicAlpha 037479a1c ircrcbot: disable sasl [23:49:12] RECOVERY - bots171 Puppet on bots171 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [23:49:52] miraheze/puppet - Universal-Omega the build passed. [23:50:08] RECOVERY - bots171 IRC Log Server Bot on bots171 is OK: PROCS OK: 1 process with args 'irclogserverbot.py' [23:50:13] MacFan4000, RhinosF1: fixed bots [23:50:37] SASL problem? [23:50:50] Yeah seems so