[00:01:19] [02statichelp] 07WikiTideBot pushed 1 new commit to 03main 13https://github.com/miraheze/statichelp/commit/6e74aaffa97a497fafdf2f37f54058319628157c [00:01:21] 02statichelp/03main 07WikiTideBot 036e74aaf Bot: Auto-update Tech namespace pages 2025-08-13 00:01:17 [00:06:07] RECOVERY - cp171 Disk Space on cp171 is OK: DISK OK - free space: / 57106MiB (12% inode=99%); [00:06:49] RECOVERY - cp191 Disk Space on cp191 is OK: DISK OK - free space: / 57854MiB (12% inode=99%); [00:07:06] RECOVERY - cp201 Disk Space on cp201 is OK: DISK OK - free space: / 57115MiB (12% inode=99%); [00:08:00] miraheze/CreateWiki - Universal-Omega the build passed. [00:29:04] [02ManageWiki] 07Universal-Omega pushed 1 new commit to 03resetwikidata 13https://github.com/miraheze/ManageWiki/commit/e5ed130a446c30705f741e865266f0ac593d5686 [00:29:04] 02ManageWiki/03resetwikidata 07CosmicAlpha 03e5ed130 Update [00:31:58] [02CreateWiki] 07Universal-Omega pushed 1 new commit to 03main 13https://github.com/miraheze/CreateWiki/commit/e06a9c3faa924008311f637afeac2a1492d93b27 [00:31:58] 02CreateWiki/03main 07CosmicAlpha 03e06a9c3 Add virtual-managewiki [00:34:14] miraheze/ManageWiki - Universal-Omega the build has errored. [00:37:54] miraheze/ManageWiki - Universal-Omega the build has errored. [00:39:16] !log [universalomega@mwtask181] starting deploy of {'force': True, 'versions': ['1.43', '1.44'], 'upgrade_extensions': 'ManageWiki'} to all [00:39:20] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:40:09] !log [universalomega@mwtask181] finished deploy of {'force': True, 'versions': ['1.43', '1.44'], 'upgrade_extensions': 'ManageWiki'} to all - SUCCESS in 53s [00:40:13] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:41:55] [02MirahezeMagic] 07Universal-Omega pushed 1 new commit to 03main 13https://github.com/miraheze/MirahezeMagic/commit/09d35ff417ac6a1e25392ddf99c83eaa638046e1 [00:41:55] 02MirahezeMagic/03main 07CosmicAlpha 0309d35ff ResetWiki: use ManageWikiDataStoreFactory [00:42:37] !log [universalomega@mwtask181] starting deploy of {'versions': ['1.43', '1.44'], 'upgrade_extensions': 'MirahezeMagic'} to all [00:42:41] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:43:28] !log [universalomega@mwtask181] finished deploy of {'versions': ['1.43', '1.44'], 'upgrade_extensions': 'MirahezeMagic'} to all - SUCCESS in 50s [00:43:31] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:44:51] [02MirahezeMagic] 07Universal-Omega pushed 1 new commit to 03main 13https://github.com/miraheze/MirahezeMagic/commit/d45fbe5d8a0ff8d1fdb40ac549374c76f7e1605f [00:44:52] 02MirahezeMagic/03main 07CosmicAlpha 03d45fbe5 Remove ResetWikiCaches… [00:45:01] !log [universalomega@mwtask181] starting deploy of {'versions': ['1.43', '1.44'], 'upgrade_extensions': 'MirahezeMagic'} to all [00:45:05] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:45:50] !log [universalomega@mwtask181] finished deploy of {'versions': ['1.43', '1.44'], 'upgrade_extensions': 'MirahezeMagic'} to all - SUCCESS in 48s [00:45:53] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:46:14] [02CreateWiki] 07Universal-Omega pushed 1 new commit to 03main 13https://github.com/miraheze/CreateWiki/commit/490adda94fb91b00a24bc431c53259cc189b2df1 [00:46:14] 02CreateWiki/03main 07CosmicAlpha 03490adda Remove ManageWiki cache handling [00:46:14] [02CreateWiki] 07Universal-Omega merged pull request #761: Remove ManageWiki cache handling (03main...03cache) 13https://github.com/miraheze/CreateWiki/pull/761 [00:46:15] [02CreateWiki] 07Universal-Omega 04deleted 03cache at 030b73726 13https://api.github.com/repos/miraheze/CreateWiki/commit/0b73726 [00:46:29] !log [universalomega@mwtask181] starting deploy of {'versions': ['1.43', '1.44'], 'upgrade_extensions': 'CreateWiki'} to all [00:46:32] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:46:57] !log [universalomega@mwtask181] DEPLOY ABORTED: Canary check failed for publictestwiki.com@mw151 [00:47:01] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:47:16] !log [universalomega@mwtask181] starting deploy of {'force': True, 'versions': ['1.43', '1.44'], 'upgrade_extensions': 'CreateWiki'} to all [00:47:19] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:47:20] !log [universalomega@mwtask181] finished deploy of {'force': True, 'versions': ['1.43', '1.44'], 'upgrade_extensions': 'CreateWiki'} to all - SUCCESS in 3s [00:47:23] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:48:08] !log [universalomega@mwtask181] starting deploy of {'force': True, 'force_upgrade': True, 'versions': ['1.43', '1.44'], 'upgrade_extensions': 'CreateWiki'} to all [00:48:11] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:48:57] !log [universalomega@mwtask181] finished deploy of {'force': True, 'force_upgrade': True, 'versions': ['1.43', '1.44'], 'upgrade_extensions': 'CreateWiki'} to all - SUCCESS in 48s [00:49:00] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:54:11] [02mw-config] 07Universal-Omega merged pull request #6045: Major modernization (03main...03modern) 13https://github.com/miraheze/mw-config/pull/6045 [00:54:12] [02mw-config] 07Universal-Omega pushed 1 new commit to 03main 13https://github.com/miraheze/mw-config/commit/86d4dd9ab236eecedb7ac64ecfb4adb31c459661 [00:54:12] 02mw-config/03main 07CosmicAlpha 0386d4dd9 Major modernization… [00:54:12] [02mw-config] 07Universal-Omega 04deleted 03modern at 034d97e3e 13https://api.github.com/repos/miraheze/mw-config/commit/4d97e3e [00:54:19] !log [universalomega@mwtask181] starting deploy of {'pull': 'config', 'config': True} to all [00:54:22] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:54:44] !log [universalomega@mwtask181] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 24s [00:55:02] miraheze/mw-config - Universal-Omega the build passed. [00:56:48] miraheze/MirahezeMagic - Universal-Omega the build passed. [01:04:09] !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php ManageWiki:ResetWikiCaches --wiki=tuscriaturaswiki (END - exit=0) [01:04:27] did it work? [01:04:43] oh right, log bot doesn't work anymore because the tech namespace fucked off xD [01:06:42] [02mw-config] 07Universal-Omega created 03managewiki-servers (+1 new commit) 13https://github.com/miraheze/mw-config/commit/e7c4a8c697f3 [01:06:42] 02mw-config/03managewiki-servers 07CosmicAlpha 03e7c4a8c Set $wgManageWikiServers [01:06:48] [02mw-config] 07Universal-Omega opened pull request #6057: Set $wgManageWikiServers (03main...03managewiki-servers) 13https://github.com/miraheze/mw-config/pull/6057 [01:07:24] [02mw-config] 07Universal-Omega merged pull request #6057: Set $wgManageWikiServers (03main...03managewiki-servers) 13https://github.com/miraheze/mw-config/pull/6057 [01:07:26] [02mw-config] 07Universal-Omega pushed 1 new commit to 03main 13https://github.com/miraheze/mw-config/commit/3e2060d02f7d426b24c879b104e0a0bc9c68405a [01:07:28] [02mw-config] 07Universal-Omega 04deleted 03managewiki-servers at 03e7c4a8c 13https://api.github.com/repos/miraheze/mw-config/commit/e7c4a8c [01:07:29] 02mw-config/03main 07CosmicAlpha 033e2060d Set $wgManageWikiServers [01:07:33] !log [universalomega@mwtask181] starting deploy of {'pull': 'config', 'config': True} to all [01:07:43] miraheze/mw-config - Universal-Omega the build passed. [01:07:44] miraheze/CreateWiki - Universal-Omega the build passed. [01:07:57] !log [universalomega@mwtask181] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 24s [01:08:06] !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php ManageWiki:ResetWikiCaches --wiki=tuscriaturaswiki (END - exit=0) [01:08:28] miraheze/mw-config - Universal-Omega the build passed. [01:21:12] [02mw-config] 07Universal-Omega pushed 1 new commit to 03main 13https://github.com/miraheze/mw-config/commit/0111023e68630e6c7fb680004eb4b633ba4d9694 [01:21:12] 02mw-config/03main 07CosmicAlpha 030111023 Fix [01:21:19] !log [universalomega@mwtask181] starting deploy of {'pull': 'config', 'config': True} to all [01:21:43] !log [universalomega@mwtask181] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 24s [01:22:05] miraheze/mw-config - Universal-Omega the build passed. [01:22:05] !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php ManageWiki:ResetWikiCaches --wiki=tuscriaturaswiki (END - exit=0) [01:28:12] [02mw-config] 07Universal-Omega pushed 1 new commit to 03main 13https://github.com/miraheze/mw-config/commit/3c923026bf7a2e050cb01f10864e8520cedc5746 [01:28:12] 02mw-config/03main 07CosmicAlpha 033c92302 Fix [01:28:32] !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php ManageWiki:ResetWikiCaches --wiki=metawiki --all-wikis (END - exit=2) [01:29:02] !log [universalomega@mwtask181] starting deploy of {'pull': 'config', 'config': True} to all [01:29:08] miraheze/mw-config - Universal-Omega the build passed. [01:29:26] !log [universalomega@mwtask181] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 24s [01:32:41] !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php ManageWiki:ResetWikiCaches --wiki=metawiki --all-wikis (END - exit=2) [01:33:08] !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php ManageWiki:ResetWikiCaches --wiki=rainversewiki (END - exit=0) [01:46:37] PROBLEM - puppet181 Current Load on puppet181 is CRITICAL: LOAD CRITICAL - total load average: 22.17, 13.04, 6.26 [01:47:58] !log [universalomega@mwtask181] sudo -u www-data /usr/local/bin/foreachwikiindblist /srv/mediawiki/cache/databases.php /srv/mediawiki/1.43/maintenance/run.php ManageWiki:ResetWikiCache (START) [01:48:03] !log [universalomega@mwtask181] sudo -u www-data /usr/local/bin/foreachwikiindblist /srv/mediawiki/cache/databases.php /srv/mediawiki/1.43/maintenance/run.php ManageWiki:ResetWikiCache (END - exit=2) [01:48:22] how da faq are we having problems on puppet181 [01:48:32] !log [universalomega@mwtask181] sudo -u www-data /usr/local/bin/foreachwikiindblist /srv/mediawiki/cache/databases.php /srv/mediawiki/1.43/maintenance/run.php ManageWiki:ResetWikiCaches (START) [01:48:37] PROBLEM - puppet181 Current Load on puppet181 is WARNING: LOAD WARNING - total load average: 7.13, 11.53, 6.61 [01:50:37] RECOVERY - puppet181 Current Load on puppet181 is OK: LOAD OK - total load average: 1.52, 7.88, 5.87 [01:55:36] !log increase puppet181 ram to 12gb [01:56:01] because I killed it [01:56:14] Trying to run rm on all cache files using salt. [01:57:53] !log [universalomega@mwtask181] sudo -u www-data /usr/local/bin/foreachwikiindblist /srv/mediawiki/cache/databases.php /srv/mediawiki/1.43/maintenance/run.php ManageWiki:ResetWikiCaches (END - exit=2) [01:58:08] !log [universalomega@mwtask181] sudo -u www-data /usr/local/bin/foreachwikiindblist /srv/mediawiki/cache/databases.php /srv/mediawiki/1.43/maintenance/run.php ManageWiki:ResetWikiCaches (START) [01:58:14] PROBLEM - mw192 Puppet on mw192 is CRITICAL: CRITICAL: Puppet has 14 failures. Last run 2 minutes ago with 14 failures. Failed resources (up to 3 shown): File[/var/www],File[/etc/sysctl.d],File[/home/agent],File[/home/paladox] [01:58:30] ^ moved to a screen [01:58:44] PROBLEM - os162 Puppet on os162 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [01:58:52] it was only on wikis starting in `4` lol [01:59:24] PROBLEM - graylog161 Puppet on graylog161 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [01:59:34] PROBLEM - changeprop201 Puppet on changeprop201 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [02:01:23] !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php ManageWiki:ResetWikiCaches --wiki=kanrikyarawiki (END - exit=0) [02:02:37] !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php ManageWiki:ResetWikiCache --wiki=constantnoblewiki (END - exit=256) [02:02:47] !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php ManageWiki:ResetWikiCaches --wiki=constantnoblewiki (END - exit=0) [02:06:47] [02puppet] 07paladox created 03paladox-patch-1 (+1 new commit) 13https://github.com/miraheze/puppet/commit/8b5de7cffd95 [02:06:47] 02puppet/03paladox-patch-1 07paladox 038b5de7c puppet181: increase puppetdb heap to 2G [02:06:50] [02puppet] 07paladox opened pull request #4473: puppet181: increase puppetdb heap to 2G (03main...03paladox-patch-1) 13https://github.com/miraheze/puppet/pull/4473 [02:06:56] [02puppet] 07coderabbitai[bot] commented on pull request #4473:

[…] 13https://github.com/miraheze/puppet/pull/4473#issuecomment-3181946703 [02:07:38] [02puppet] 07paladox pushed 1 new commit to 03paladox-patch-1 13https://github.com/miraheze/puppet/commit/2b30a90460abd9160982e7c3cb286034c3188460 [02:07:38] 02puppet/03paladox-patch-1 07paladox 032b30a90 Update puppet181.yaml [02:07:56] [02puppet] 07paladox merged pull request #4473: puppet181: increase puppetdb heap to 2G (03main...03paladox-patch-1) 13https://github.com/miraheze/puppet/pull/4473 [02:07:56] [02puppet] 07paladox pushed 1 new commit to 03main 13https://github.com/miraheze/puppet/commit/4f80df12bed479196bda45b479b4f242e72f9e78 [02:07:57] 02puppet/03main 07paladox 034f80df1 puppet181: increase puppetdb heap to 2G (#4473) [02:07:59] [02puppet] 07paladox 04deleted 03paladox-patch-1 at 032b30a90 13https://api.github.com/repos/miraheze/puppet/commit/2b30a90 [02:09:11] !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php ManageWiki:ResetWikiCaches --wiki=indianajoneswiki (END - exit=0) [02:12:18] PROBLEM - bast161 Puppet on bast161 is CRITICAL: CRITICAL: Puppet has 26 failures. Last run 2 minutes ago with 26 failures. Failed resources (up to 3 shown): File[/etc/ferm/functions.conf],File[/etc/default/ferm],File[/usr/lib/nagios/plugins/check_conntrack],File[/usr/lib/nagios/plugins/check_ferm] [02:12:23] [02puppet] 07paladox pushed 1 new commit to 03main 13https://github.com/miraheze/puppet/commit/25a15dc96d1c17fdba808ae8c0b9806a85b32732 [02:12:23] 02puppet/03main 07paladox 0325a15dc Fix typo [02:12:24] PROBLEM - mw202 Puppet on mw202 is CRITICAL: CRITICAL: Puppet has 8 failures. Last run 2 minutes ago with 8 failures. Failed resources (up to 3 shown): File[/home/universalomega],File[/home/void],File[/home/blankeclair],File[/home/macfan] [02:12:32] PROBLEM - swiftproxy171 Puppet on swiftproxy171 is CRITICAL: CRITICAL: Puppet has 46 failures. Last run 2 minutes ago with 46 failures. Failed resources (up to 3 shown): File[/etc/rsyslog.d],File[/etc/rsyslog.conf],File[authority certificates],File[/etc/apt/apt.conf.d/50unattended-upgrades] [02:12:46] PROBLEM - mw162 Puppet on mw162 is CRITICAL: CRITICAL: Puppet has 21 failures. Last run 2 minutes ago with 21 failures. Failed resources (up to 3 shown): File[/srv/mediawiki/robots.php],File[/srv/mediawiki/favicon.php],File[/srv/mediawiki/touch.php],File[/srv/mediawiki/healthcheck.php] [02:12:53] PROBLEM - cp171 Puppet on cp171 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [02:12:54] PROBLEM - eventgate181 Puppet on eventgate181 is CRITICAL: CRITICAL: Puppet has 33 failures. Last run 3 minutes ago with 33 failures. Failed resources (up to 3 shown): File[/etc/apt/trusted.gpg.d/openvox-keyring.gpg],File[/usr/local/bin/puppet-enabled],File[/etc/rsyslog.d],File[/etc/rsyslog.conf] [02:13:02] PROBLEM - mw203 Puppet on mw203 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [02:13:31] PROBLEM - mw172 Puppet on mw172 is CRITICAL: CRITICAL: Puppet has 41 failures. Last run 2 minutes ago with 41 failures. Failed resources (up to 3 shown): File[/etc/vim/vimrc.local],File[/etc/bash.bashrc],File[/etc/skel/.bashrc],File[/opt/mcrouter_2023.07.17.00-1_amd64.deb] [02:13:45] PROBLEM - mw161 Puppet on mw161 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [02:14:15] [02puppet] 07paladox created 03paladox-patch-1 (+1 new commit) 13https://github.com/miraheze/puppet/commit/0a9a5952cf25 [02:14:16] 02puppet/03paladox-patch-1 07paladox 030a9a595 puppet181: increase heap to 3g [02:14:20] [02puppet] 07paladox opened pull request #4474: puppet181: increase heap to 3g (03main...03paladox-patch-1) 13https://github.com/miraheze/puppet/pull/4474 [02:14:26] [02puppet] 07paladox retitled PR #4474: "puppet181: increase heap to 3g" ➜ "puppet181: increase heap to 3g for puppetserver" 13https://github.com/miraheze/puppet/pull/4474 [02:14:27] [02puppet] 07coderabbitai[bot] commented on pull request #4474:

[…] 13https://github.com/miraheze/puppet/pull/4474#issuecomment-3181957163 [02:14:31] [02puppet] 07paladox merged pull request #4474: puppet181: increase heap to 3g for puppetserver (03main...03paladox-patch-1) 13https://github.com/miraheze/puppet/pull/4474 [02:14:33] [02puppet] 07paladox pushed 1 new commit to 03main 13https://github.com/miraheze/puppet/commit/8bb36f6973bb46e82809a703a5fe7c82ad0b7fd9 [02:14:35] [02puppet] 07paladox 04deleted 03paladox-patch-1 at 030a9a595 13https://api.github.com/repos/miraheze/puppet/commit/0a9a595 [02:14:36] 02puppet/03main 07paladox 038bb36f6 puppet181: increase heap to 3g for puppetserver (#4474) [02:17:29] PROBLEM - cloud16 Puppet on cloud16 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [02:17:42] PROBLEM - os201 Puppet on os201 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [02:18:35] PROBLEM - ns1 Puppet on ns1 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [02:18:56] PROBLEM - mem151 Puppet on mem151 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [02:20:29] PROBLEM - mw193 Puppet on mw193 is CRITICAL: CRITICAL: Puppet has 34 failures. Last run 3 minutes ago with 34 failures. Failed resources (up to 3 shown): File[/etc/apt/trusted.gpg.d/openvox-keyring.gpg],File[/usr/local/bin/puppet-enabled],File[/etc/rsyslog.d],File[/etc/rsyslog.conf] [02:22:11] !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php ManageWiki:ResetWikiCaches --wiki=criticalrolewiki (END - exit=0) [02:24:19] !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php ManageWiki:ResetWikiCaches --wiki=levelsharesquarewiki (END - exit=0) [02:26:44] !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php ManageWiki:ResetWikiCaches --wiki=avidwiki (END - exit=0) [02:26:44] RECOVERY - os162 Puppet on os162 is OK: OK: Puppet is currently enabled, last run 3 seconds ago with 0 failures [02:27:26] RECOVERY - graylog161 Puppet on graylog161 is OK: OK: Puppet is currently enabled, last run 40 seconds ago with 0 failures [02:27:34] RECOVERY - changeprop201 Puppet on changeprop201 is OK: OK: Puppet is currently enabled, last run 57 seconds ago with 0 failures [02:28:14] RECOVERY - mw192 Puppet on mw192 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [02:40:16] RECOVERY - bast161 Puppet on bast161 is OK: OK: Puppet is currently enabled, last run 35 seconds ago with 0 failures [02:40:22] RECOVERY - mw202 Puppet on mw202 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [02:40:32] RECOVERY - swiftproxy171 Puppet on swiftproxy171 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [02:40:51] RECOVERY - mw162 Puppet on mw162 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [02:40:53] RECOVERY - cp171 Puppet on cp171 is OK: OK: Puppet is currently enabled, last run 32 seconds ago with 0 failures [02:40:54] RECOVERY - eventgate181 Puppet on eventgate181 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [02:41:35] RECOVERY - mw172 Puppet on mw172 is OK: OK: Puppet is currently enabled, last run 59 seconds ago with 0 failures [02:41:45] RECOVERY - mw161 Puppet on mw161 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [02:43:02] RECOVERY - mw203 Puppet on mw203 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [02:45:42] RECOVERY - os201 Puppet on os201 is OK: OK: Puppet is currently enabled, last run 30 seconds ago with 0 failures [02:46:35] RECOVERY - ns1 Puppet on ns1 is OK: OK: Puppet is currently enabled, last run 29 seconds ago with 0 failures [02:46:56] RECOVERY - mem151 Puppet on mem151 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [02:47:29] RECOVERY - cloud16 Puppet on cloud16 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [02:48:29] RECOVERY - mw193 Puppet on mw193 is OK: OK: Puppet is currently enabled, last run 58 seconds ago with 0 failures [03:03:37] !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php ManageWiki:ResetWikiCaches --wiki=ftlmultiversewiki (END - exit=0) [03:06:39] [02ManageWiki] 07Universal-Omega pushed 1 new commit to 03main 13https://github.com/miraheze/ManageWiki/commit/6f7ffcb756a88964fe04a64a4df162af33c099f5 [03:06:39] 02ManageWiki/03main 07CosmicAlpha 036f7ffcb Add output [03:06:49] !log [universalomega@mwtask181] starting deploy of {'versions': ['1.43', '1.44'], 'upgrade_extensions': 'ManageWiki'} to all [03:07:37] !log [universalomega@mwtask181] finished deploy of {'versions': ['1.43', '1.44'], 'upgrade_extensions': 'ManageWiki'} to all - SUCCESS in 48s [03:11:55] miraheze/ManageWiki - Universal-Omega the build has errored. [04:38:52] !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php ManageWiki:ResetWikiCaches --wiki=metawiki --all-wikis (END - exit=0) [04:38:56] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:45:06] PROBLEM - cp201 Disk Space on cp201 is WARNING: DISK WARNING - free space: / 49829MiB (10% inode=99%); [07:18:07] PROBLEM - cp171 Disk Space on cp171 is WARNING: DISK WARNING - free space: / 49854MiB (10% inode=99%); [08:17:04] !log [blankeclair@mwtask181] sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php ManageWiki:ResetWikiCaches --wiki=mariaworldwiki (END - exit=0) [08:17:07] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [08:18:49] PROBLEM - cp191 Disk Space on cp191 is WARNING: DISK WARNING - free space: / 49929MiB (10% inode=99%); [08:48:07] !log [salt-user@mwtask171] starting deploy of {'extension_list': True, 'versions': []} to all [08:48:08] !log [salt-user@mwtask171] finished deploy of {'extension_list': True, 'versions': []} to all - SUCCESS in 0s [08:48:09] !log [salt-user@mwtask181] starting deploy of {'extension_list': True, 'versions': ['1.43', '1.44']} to all [08:48:10] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [08:48:13] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [08:48:16] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [08:48:42] !log [salt-user@mwtask181] starting deploy of {'extension_list': True, 'versions': ['1.43', '1.44']} to all [08:48:44] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [08:48:51] !log [salt-user@mwtask181] finished deploy of {'extension_list': True, 'versions': ['1.43', '1.44']} to all - SUCCESS in 43s [08:48:54] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [08:49:24] !log [salt-user@mwtask181] finished deploy of {'extension_list': True, 'versions': ['1.43', '1.44']} to all - SUCCESS in 42s [08:49:27] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [08:49:31] whoops I ran with salt user lol [08:49:38] !log salt-user was me [08:49:41] Did the namespace issue make tagged bot edits clog it up? [08:49:41] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [08:50:15] Because it looks like bot edits are getting into global changes [08:52:19] It shouldn't [08:54:13] Well on my watchlist I have not seen a human edit in the past 500 edits, but a lot of them appear to be entering the global feed [08:55:06] Unless there is a large delay [08:55:48] There is a large delay on the IRC feed. [08:58:01] I don't think there actually is much of a delay [08:58:07] It does not appear to be the case [08:58:42] It was about an hour delay last I looked. [08:59:08] Oh. Maybe there was a time zone error or something [08:59:35] If its an issue I'll look into it tomorrow. [08:59:45] its 3AM right now. So I guess today lol [09:00:29] but yeah I was more concerned with getting the other issues with cache resolved today. Other things I'll look at when I sleep some. [09:06:29] Okay. The feed looks like it is acting a bit weird, but I'll just let this run, since it doesn't appear to be causing as much issues as with yesterday. [09:29:46] !log [universalomega@mwtask181] sudo -u www-data /usr/local/bin/foreachwikiindblist /srv/mediawiki/cache/databases.php /srv/mediawiki/1.43/maintenance/run.php ManageWiki:ResetWikiCaches (END - exit=0) [09:29:49] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [09:30:41] girl what [10:59:07] PROBLEM - matomo151 Check unit status of matomo-archiver-1 on matomo151 is CRITICAL: CRITICAL: Status of the systemd unit matomo-archiver-1 [11:15:56] [Grafana] FIRING: The mediawiki JobQueue backlog is increasing by more than 100 jobs a minute over an extended time period https://grafana.wikitide.net/d/GtxbP1Xnk?from=1755080120000&orgId=1&to=1755083756678 [11:20:56] [Grafana] RESOLVED: MediaWiki Jobs are rapidly increasing https://grafana.wikitide.net/d/GtxbP1Xnk?from=1755080300000&orgId=1&to=1755083900000 [11:25:57] [Grafana] FIRING: The mediawiki job queue has more than 100000 unclaimed jobs https://grafana.wikitide.net/d/GtxbP1Xnk?from=1755080510000&orgId=1&to=1755084357511[Grafana] RESOLVED: MediaWiki Jobs are rapidly increasing https://grafana.wikitide.net/d/GtxbP1Xnk?from=1755080300000&orgId=1&to=1755083900000 [12:50:57] [Grafana] RESOLVED: High Job Queue Backlog https://grafana.wikitide.net/d/GtxbP1Xnk?from=1755080510000&orgId=1&to=1755089210000 [14:42:20] [Grafana] FIRING: The mediawiki job queue has more than 100000 unclaimed jobs https://grafana.wikitide.net/d/GtxbP1Xnk?from=1755092510000&orgId=1&to=1755096140013 [14:47:20] [Grafana] RESOLVED: High Job Queue Backlog https://grafana.wikitide.net/d/GtxbP1Xnk?from=1755092510000&orgId=1&to=1755096410000 [16:01:07] RECOVERY - matomo151 Check unit status of matomo-archiver-1 on matomo151 is OK: OK: Status of the systemd unit matomo-archiver-1 [16:15:53] !log set cpunits to 4096 for db and mem/rdb [16:15:57] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:19:00] !log set cpuunits to 4096 for mw [16:19:03] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:20:28] !log set cpuunits to 2048 for cp [16:20:31] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:22:29] !log set cpuunits to 3072 for cp [16:22:33] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:29:27] [02ManageWiki] 07Universal-Omega created 03match (+1 new commit) 13https://github.com/miraheze/ManageWiki/commit/98a786fdde9b [16:29:27] 02ManageWiki/03match 07CosmicAlpha 0398a786f Use match [16:29:31] [02ManageWiki] 07Universal-Omega opened pull request #727: Use match (03main...03match) 13https://github.com/miraheze/ManageWiki/pull/727 [16:29:38] [02ManageWiki] 07coderabbitai[bot] commented on pull request #727:

[…] 13https://github.com/miraheze/ManageWiki/pull/727#issuecomment-3184611426 [16:31:36] [02ManageWiki] 07Universal-Omega pushed 1 new commit to 03match 13https://github.com/miraheze/ManageWiki/commit/2cd9c99f69fff6dd341bb491ec87c3688b68e479 [16:31:36] 02ManageWiki/03match 07CosmicAlpha 032cd9c99 Update [16:36:14] [02ci-scripts] 07Universal-Omega pushed 1 new commit to 03main 13https://github.com/miraheze/ci-scripts/commit/7b560ccf2a01d856778957d3d81d629b55379247 [16:36:14] 02ci-scripts/03main 07CosmicAlpha 037b560cc Set $wgManageWikiCacheDirectory [16:36:58] miraheze/ManageWiki - Universal-Omega the build has errored. [16:43:45] miraheze/ManageWiki - Universal-Omega the build has errored. [16:43:54] miraheze/ManageWiki - Universal-Omega the build has errored. [16:58:32] [02CreateWiki] 07Universal-Omega created 03wiki-commit (+1 new commit) 13https://github.com/miraheze/CreateWiki/commit/d97cb9715b86 [16:58:32] 02CreateWiki/03wiki-commit 07CosmicAlpha 03d97cb97 Add commit after adding new wiki to cw_wikis [16:58:37] [02CreateWiki] 07Universal-Omega opened pull request #763: Add commit after adding new wiki to cw_wikis (03main...03wiki-commit) 13https://github.com/miraheze/CreateWiki/pull/763 [16:58:43] [02CreateWiki] 07coderabbitai[bot] commented on pull request #763:

[…] 13https://github.com/miraheze/CreateWiki/pull/763#issuecomment-3184715122 [17:00:07] PROBLEM - cp171 Disk Space on cp171 is CRITICAL: connect to address 10.0.17.138 port 5666: Network is unreachableconnect to host 10.0.17.138 port 5666: Network is unreachable [17:01:06] !log set network queue to 4 on mem, rdb, db, mw, swift, mon, prometheus and cp [17:01:10] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:02:07] PROBLEM - cp171 Disk Space on cp171 is WARNING: DISK WARNING - free space: / 42078MiB (9% inode=99%); [17:02:52] miraheze/CreateWiki - Universal-Omega the build has errored. [17:03:56] [02CreateWiki] 07Universal-Omega pushed 1 new commit to 03wiki-commit 13https://github.com/miraheze/CreateWiki/commit/5cab1b47c46704c38d6e3d75dc8c08763b58b6d0 [17:03:56] 02CreateWiki/03wiki-commit 07CosmicAlpha 035cab1b4 Update [17:04:58] [02ManageWiki] 07Universal-Omega pushed 1 new commit to 03resetwikidata 13https://github.com/miraheze/ManageWiki/commit/230be469e883201a18acb67f4cf93776b096b0c1 [17:04:58] 02ManageWiki/03resetwikidata 07CosmicAlpha 03230be46 Update [17:06:45] !log change network queue for rdb to 2 [17:06:48] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:08:54] [02CreateWiki] 07codecov[bot] commented on pull request #763: :white_check_mark: All modified and coverable lines are covered by tests. […] 13https://github.com/miraheze/CreateWiki/pull/763#issuecomment-3184758729 [17:10:23] miraheze/ManageWiki - Universal-Omega the build has errored. [17:14:12] [02CreateWiki] 07Universal-Omega created 03test-1 (+1 new commit) 13https://github.com/miraheze/CreateWiki/commit/9e6d2c543253 [17:14:12] 02CreateWiki/03test-1 07CosmicAlpha 039e6d2c5 Test [17:14:22] [02CreateWiki] 07Universal-Omega opened pull request #764: Test (03main...03test-1) 13https://github.com/miraheze/CreateWiki/pull/764 [17:14:31] [02CreateWiki] 07coderabbitai[bot] commented on pull request #764:

[…] 13https://github.com/miraheze/CreateWiki/pull/764#issuecomment-3184782594 [17:14:54] [02ManageWiki] 07Universal-Omega pushed 1 new commit to 03resetwikidata 13https://github.com/miraheze/ManageWiki/commit/1f5708f05ce3f41fb5bfbd5fc7a1c47a883af494 [17:14:54] 02ManageWiki/03resetwikidata 07CosmicAlpha 031f5708f Update [17:16:11] [02CreateWiki] 07github-actions[bot] pushed 1 new commit to 03test-1 13https://github.com/miraheze/CreateWiki/commit/3c1835964838a823ee87ffe508fd7bc62bc1b607 [17:16:12] 02CreateWiki/03test-1 07github-actions 033c18359 CI: lint code to MediaWiki standards… [17:18:30] miraheze/CreateWiki - Universal-Omega the build has errored. [17:20:13] miraheze/ManageWiki - Universal-Omega the build has errored. [17:23:39] miraheze/mw-config - pskyechology the build has errored. [17:24:53] :3 [17:24:57] miraheze/CreateWiki - Universal-Omega the build passed. [17:25:22] [02CreateWiki] 07Universal-Omega pushed 1 new commit to 03test-1 13https://github.com/miraheze/CreateWiki/commit/ee464031695208242740c7df8fa0fdb9652d43d9 [17:25:22] 02CreateWiki/03test-1 07CosmicAlpha 03ee46403 Add output [17:26:52] miraheze/mw-config - pskyechology the build passed. [17:28:57] !log [skye@test151] starting deploy of {'config': True} to test151 [17:28:58] !log [skye@test151] finished deploy of {'config': True} to test151 - SUCCESS in 0s [17:29:01] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:29:04] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:30:54] miraheze/ManageWiki - Universal-Omega the build has errored. [17:31:14] [02CreateWiki] 07codecov[bot] commented on pull request #764: :white_check_mark: All modified and coverable lines are covered by tests. […] 13https://github.com/miraheze/CreateWiki/pull/764#issuecomment-3184832312 [17:32:17] !log increase puppet181 ram to 16gb [17:32:20] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:33:32] [02puppet] 07paladox created 03paladox-patch-1 (+1 new commit) 13https://github.com/miraheze/puppet/commit/857ba97eb691 [17:33:33] 02puppet/03paladox-patch-1 07paladox 03857ba97 puppet181: increase heap to 4g for puppetserver [17:33:36] [02puppet] 07paladox opened pull request #4475: puppet181: increase heap to 4g for puppetserver (03main...03paladox-patch-1) 13https://github.com/miraheze/puppet/pull/4475 [17:33:42] [02puppet] 07paladox merged pull request #4475: puppet181: increase heap to 4g for puppetserver (03main...03paladox-patch-1) 13https://github.com/miraheze/puppet/pull/4475 [17:33:44] [02puppet] 07paladox pushed 1 new commit to 03main 13https://github.com/miraheze/puppet/commit/f14122bc0843be2bb583ec972b57e061d7d5d79e [17:33:45] [02puppet] 07coderabbitai[bot] commented on pull request #4475:

[…] 13https://github.com/miraheze/puppet/pull/4475#issuecomment-3184839067 [17:33:48] [02puppet] 07paladox 04deleted 03paladox-patch-1 at 03857ba97 13https://api.github.com/repos/miraheze/puppet/commit/857ba97 [17:33:49] 02puppet/03main 07paladox 03f14122b puppet181: increase heap to 4g for puppetserver (#4475) [17:35:01] PROBLEM - mw152 Puppet on mw152 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [17:35:02] PROBLEM - ldap171 Puppet on ldap171 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [17:35:44] PROBLEM - bast181 Puppet on bast181 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [17:35:55] [02CreateWiki] 07Universal-Omega pushed 1 new commit to 03test-1 13https://github.com/miraheze/CreateWiki/commit/93d8c6d38f0333ae8af800ca9ca24f80aca635d9 [17:35:55] 02CreateWiki/03test-1 07CosmicAlpha 0393d8c6d - [17:36:12] PROBLEM - test151 Puppet on test151 is CRITICAL: CRITICAL: Puppet has 51 failures. Last run 2 minutes ago with 51 failures. Failed resources (up to 3 shown): File[/etc/firejail/mediawiki.local],File[/etc/firejail/mediawiki-converters.profile],File[/usr/local/bin/mediawiki-firejail-ghostscript],File[/usr/local/bin/rsvg-convert] [17:36:56] PROBLEM - mon181 Puppet on mon181 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [17:37:17] PROBLEM - mwtask181 Puppet on mwtask181 is CRITICAL: CRITICAL: Puppet has 32 failures. Last run 3 minutes ago with 32 failures. Failed resources (up to 3 shown): File[/etc/sudoers],File[/home/salt-user],File[/etc/logrotate.d/mcrouter],File[/etc/logrotate.d/mediawiki_debug_logs] [17:37:38] PROBLEM - mw201 Puppet on mw201 is CRITICAL: CRITICAL: Puppet has 27 failures. Last run 3 minutes ago with 27 failures. Failed resources (up to 3 shown): File[/etc/skel/.bashrc],File[/opt/mcrouter_2023.07.17.00-1_amd64.deb],File[/usr/local/bin/cgroup-mediawiki-clean],File[/usr/local/bin/php8adm] [17:37:59] PROBLEM - mem201 Puppet on mem201 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [17:38:05] PROBLEM - prometheus151 Puppet on prometheus151 is CRITICAL: CRITICAL: Puppet has 32 failures. Last run 2 minutes ago with 32 failures. Failed resources (up to 3 shown): File[/etc/rsyslog.conf],File[authority certificates],File[/etc/apt/apt.conf.d/50unattended-upgrades],File[/etc/apt/apt.conf.d/20auto-upgrades] [17:38:30] PROBLEM - mw182 Puppet on mw182 is CRITICAL: CRITICAL: Puppet has 42 failures. Last run 2 minutes ago with 42 failures. Failed resources (up to 3 shown): File[/usr/local/bin/mwscript],File[/usr/local/bin/disable-puppet],File[/usr/local/bin/enable-puppet],File[/usr/local/bin/cycle-puppet] [17:38:48] PROBLEM - mw183 Puppet on mw183 is CRITICAL: CRITICAL: Puppet has 13 failures. Last run 3 minutes ago with 13 failures. Failed resources (up to 3 shown): File[/etc/sysctl.d],File[/home/agent],File[/home/paladox],File[/home/reception] [17:39:04] PROBLEM - matomo151 Puppet on matomo151 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [17:40:17] miraheze/CreateWiki - Universal-Omega the build has errored. [17:40:38] [02CreateWiki] 07Universal-Omega created 03category-required (+1 new commit) 13https://github.com/miraheze/CreateWiki/commit/7a681411db62 [17:40:38] 02CreateWiki/03category-required 07CosmicAlpha 037a68141 Make category required [17:40:43] [02CreateWiki] 07Universal-Omega opened pull request #765: Make category required (03main...03category-required) 13https://github.com/miraheze/CreateWiki/pull/765 [17:40:51] [02CreateWiki] 07coderabbitai[bot] commented on pull request #765:

[…] 13https://github.com/miraheze/CreateWiki/pull/765#issuecomment-3184861466 [17:41:31] miraheze/ManageWiki - Universal-Omega the build has errored. [17:42:32] [02puppet] 07paladox created 03paladox-patch-1 (+1 new commit) 13https://github.com/miraheze/puppet/commit/f2882f7100f5 [17:42:32] 02puppet/03paladox-patch-1 07paladox 03f2882f7 puppet181: set puppetdb::command_processing_threads to 16 [17:42:35] [02puppet] 07paladox opened pull request #4476: puppet181: set puppetdb::command_processing_threads to 16 (03main...03paladox-patch-1) 13https://github.com/miraheze/puppet/pull/4476 [17:42:41] [02puppet] 07coderabbitai[bot] commented on pull request #4476:

[…] 13https://github.com/miraheze/puppet/pull/4476#issuecomment-3184866487 [17:42:42] [02puppet] 07paladox merged pull request #4476: puppet181: set puppetdb::command_processing_threads to 16 (03main...03paladox-patch-1) 13https://github.com/miraheze/puppet/pull/4476 [17:42:44] [02puppet] 07paladox pushed 1 new commit to 03main 13https://github.com/miraheze/puppet/commit/4a8ee5b9930557e6efe67cd8f41b559789f1213c [17:42:46] 02puppet/03main 07paladox 034a8ee5b puppet181: set puppetdb::command_processing_threads to 16 (#4476) [17:42:48] [02puppet] 07paladox 04deleted 03paladox-patch-1 at 03f2882f7 13https://api.github.com/repos/miraheze/puppet/commit/f2882f7 [17:44:36] [02ManageWiki] 07Universal-Omega pushed 1 new commit to 03resetwikidata 13https://github.com/miraheze/ManageWiki/commit/e7221e94478afd99ec2fe51c7cca0f8553b0211c [17:44:36] 02ManageWiki/03resetwikidata 07CosmicAlpha 03e7221e9 - [17:45:57] [02CreateWiki] 07codecov[bot] commented on pull request #765: :white_check_mark: All modified and coverable lines are covered by tests. […] 13https://github.com/miraheze/CreateWiki/pull/765#issuecomment-3184875077 [17:46:52] [02CreateWiki] 07Universal-Omega pushed 1 new commit to 03category-required 13https://github.com/miraheze/CreateWiki/commit/501071fe6a36248bbe46b612228bd74f48b3814c [17:46:53] 02CreateWiki/03category-required 07CosmicAlpha 03501071f Update [17:47:11] PROBLEM - db161 Puppet on db161 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [17:47:41] [02CreateWiki] 07Universal-Omega pushed 1 new commit to 03category-required 13https://github.com/miraheze/CreateWiki/commit/d2356a589a0527d99af5474b5f401397a65f18c0 [17:47:41] 02CreateWiki/03category-required 07CosmicAlpha 03d2356a5 Update [17:48:24] [02CreateWiki] 07Universal-Omega pushed 1 new commit to 03category-required 13https://github.com/miraheze/CreateWiki/commit/993b6e23ebe0dc58052070a19bd7ba317ff30c54 [17:48:24] 02CreateWiki/03category-required 07CosmicAlpha 03993b6e2 Update [17:50:06] miraheze/ManageWiki - Universal-Omega the build has errored. [17:54:36] [02ManageWiki] 07Universal-Omega pushed 1 new commit to 03resetwikidata 13https://github.com/miraheze/ManageWiki/commit/f500aa00b9366736c14bb30565341b21ceff0058 [17:54:36] 02ManageWiki/03resetwikidata 07CosmicAlpha 03f500aa0 Try [18:00:12] miraheze/ManageWiki - Universal-Omega the build has errored. [18:02:54] [02CreateWiki] 07Universal-Omega pushed 1 new commit to 03test-1 13https://github.com/miraheze/CreateWiki/commit/7c51ca50538dbf15c1dc476c713e5ef5e020a0a0 [18:02:54] 02CreateWiki/03test-1 07CosmicAlpha 037c51ca5 - [18:04:33] RECOVERY - test151 Puppet on test151 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [18:04:58] RECOVERY - mw152 Puppet on mw152 is OK: OK: Puppet is currently enabled, last run 56 seconds ago with 0 failures [18:05:20] RECOVERY - ldap171 Puppet on ldap171 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [18:05:35] RECOVERY - mw201 Puppet on mw201 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [18:05:42] RECOVERY - mwtask181 Puppet on mwtask181 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [18:05:44] RECOVERY - bast181 Puppet on bast181 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [18:06:05] RECOVERY - prometheus151 Puppet on prometheus151 is OK: OK: Puppet is currently enabled, last run 47 seconds ago with 0 failures [18:06:16] [02CreateWiki] 07Universal-Omega pushed 1 new commit to 03test-1 13https://github.com/miraheze/CreateWiki/commit/a0e864fb886930f16a5c3ad252b3526ec0d5470a [18:06:16] 02CreateWiki/03test-1 07CosmicAlpha 03a0e864f - [18:06:28] RECOVERY - mw182 Puppet on mw182 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [18:06:48] RECOVERY - mw183 Puppet on mw183 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [18:06:56] RECOVERY - mon181 Puppet on mon181 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [18:07:04] RECOVERY - matomo151 Puppet on matomo151 is OK: OK: Puppet is currently enabled, last run 23 seconds ago with 0 failures [18:07:58] RECOVERY - mem201 Puppet on mem201 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [18:10:19] miraheze/CreateWiki - Universal-Omega the build passed. [18:12:45] miraheze/ManageWiki - Universal-Omega the build passed. [18:15:11] RECOVERY - db161 Puppet on db161 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [18:16:52] !log set network queue to 2 on puppet [18:16:55] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:18:35] PROBLEM - ns1 Puppet on ns1 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [18:19:28] !log set network queue to 2 on eventgate [18:19:32] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:20:00] !log set network queue to 2 on kafka [18:20:03] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:20:42] [02CreateWiki] 07Universal-Omega created 03phpunit-nopopulatemainpage (+1 new commit) 13https://github.com/miraheze/CreateWiki/commit/707c6597355a [18:20:42] 02CreateWiki/03phpunit-nopopulatemainpage 07CosmicAlpha 03707c659 Don't run PopulateMainPage in PHPUnit [18:20:46] [02CreateWiki] 07Universal-Omega opened pull request #766: Don't run PopulateMainPage in PHPUnit (03main...03phpunit-nopopulatemainpage) 13https://github.com/miraheze/CreateWiki/pull/766 [18:20:52] [02CreateWiki] 07coderabbitai[bot] commented on pull request #766:

[…] 13https://github.com/miraheze/CreateWiki/pull/766#issuecomment-3185010488 [18:21:02] !log set network queue to 4 on matomo [18:21:05] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:21:57] !log set network queue to 2 on graylog [18:22:00]