[00:01:14] [02statichelp] 07WikiTideBot pushed 1 new commit to 03main 13https://github.com/miraheze/statichelp/commit/b94eccd28a33a647eb4e7565cc66899dd5986372 [00:01:15] 02statichelp/03main 07WikiTideBot 03b94eccd Bot: Auto-update Tech namespace pages 2026-02-09 00:01:12 [00:03:16] !log [universalomega@mwtask181] starting deploy of {'versions': ['1.44', '1.45'], 'upgrade_extensions': 'MirahezeMagic'} to all [00:03:17] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:04:11] !log [universalomega@mwtask181] finished deploy of {'versions': ['1.44', '1.45'], 'upgrade_extensions': 'MirahezeMagic'} to all - SUCCESS in 56s [00:04:13] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:04:31] !log [somerandomdeveloper@mwtask181] starting deploy of {'pull': 'config', 'config': True} to all [00:04:33] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:04:58] !log [somerandomdeveloper@mwtask181] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 27s [00:05:00] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:05:34] miraheze/mw-config - SomeMWDev the build passed. [00:06:07] [02mw-config] 07SomeMWDev approved pull request #6266 13https://github.com/miraheze/mw-config/pull/6266#pullrequestreview-3770641675 [00:06:51] [02mw-config] 07SomeMWDev merged 07YTFGolf's pull request #6266: T14894: set vector-theme to night on versesanddimensionswiki (07miraheze:03main...07YTFGolf:03main) 13https://github.com/miraheze/mw-config/pull/6266 [00:06:51] [02mw-config] 07SomeMWDev pushed 1 new commit to 03main 13https://github.com/miraheze/mw-config/commit/9a0d2d94ff2b2e2737df74aecacc7d049df7248d [00:10:21] miraheze/mw-config - lihaohong6 the build passed. [00:12:05] miraheze/mw-config - lihaohong6 the build passed. [00:12:48] !log [universalomega@mwtask181] sudo -u www-data /usr/local/bin/foreachwikiindblist /srv/mediawiki/cache/databases.php /srv/mediawiki/1.44/maintenance/run.php ManageWiki:ResetWikiCaches (END - exit=2) [00:12:49] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:13:10] 02mw-config/03main 07YTFGolf 039a0d2d9 T14894: set vector-theme to night on versesanddimensionswiki (#6266)… [00:13:12] [02mw-config] 07SomeMWDev left a review on pull request #6278: Why are we undeploying 3D? It's WMF-deployed and I think it might be useful for a lot of wikis if it would work. I'm sure we can fix it instead of undeploying it 13https://github.com/miraheze/mw-config/pull/6278#pullrequestreview-3770646586 [00:13:32] !log [universalomega@mwtask181] starting deploy of {'versions': ['1.44', '1.45'], 'upgrade_extensions': 'ManageWiki'} to all [00:13:33] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:13:33] !log [universalomega@mwtask181] finished deploy of {'versions': ['1.44', '1.45'], 'upgrade_extensions': 'ManageWiki'} to all - SUCCESS in 1s [00:13:35] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:14:07] [02mw-config] 07SomeMWDev left a file comment in pull request #6274 0393f454f: This was done in d030a17 13https://github.com/miraheze/mw-config/pull/6274#discussion_r2780095258 [00:14:58] [02mw-config] 07paladox created 03paladox-patch-6 (+1 new commit) 13https://github.com/miraheze/mw-config/commit/04011831e389 [00:14:58] 02mw-config/03paladox-patch-6 07paladox 030401183 Add SwiftFileBackend configuration for commonswiki (miraheze own) [00:15:01] [02mw-config] 07paladox opened pull request #6286: Add SwiftFileBackend configuration for commonswiki (miraheze own) (03main...03paladox-patch-6) 13https://github.com/miraheze/mw-config/pull/6286 [00:15:03] RECOVERY - cp201 Disk Space on cp201 is OK: DISK OK - free space: / 73452MiB (16.2% inode=100%); [00:15:10] miraheze/mw-config - lihaohong6 the build passed. [00:16:17] miraheze/mw-config - paladox the build passed. [00:17:51] RECOVERY - cp171 Disk Space on cp171 is OK: DISK OK - free space: / 73696MiB (16.2% inode=100%); [00:18:26] [02mw-config] 07paladox pushed 1 new commit to 03paladox-patch-6 13https://github.com/miraheze/mw-config/commit/dd18787d354cbf82efe67195006eb6d5af2d78a7 [00:18:27] 02mw-config/03paladox-patch-6 07paladox 03dd18787 Update backend for mirahezecommons repository [00:19:10] [02mw-config] 07paladox pushed 1 new commit to 03paladox-patch-6 13https://github.com/miraheze/mw-config/commit/0651e756cd3fe2ea4529e8d43e5f7c3fc9135278 [00:19:10] 02mw-config/03paladox-patch-6 07paladox 030651e75 Add miraheze-swift backends configuration… [00:19:37] miraheze/mw-config - paladox the build passed. [00:20:26] miraheze/mw-config - paladox the build passed. [00:20:33] [02mw-config] 07paladox merged pull request #6286: Add SwiftFileBackend configuration for commonswiki (miraheze own) (03main...03paladox-patch-6) 13https://github.com/miraheze/mw-config/pull/6286 [00:20:33] [02mw-config] 07paladox pushed 1 new commit to 03main 13https://github.com/miraheze/mw-config/commit/eba97c0c7d67f1509202d524e90354f6451f24f4 [00:20:35] 02mw-config/03main 07paladox 03eba97c0 Add SwiftFileBackend configuration for commonswiki (miraheze own) (#6286) [00:20:37] [02mw-config] 07paladox 04deleted 03paladox-patch-6 at 030651e75 13https://api.github.com/repos/miraheze/mw-config/commit/0651e75 [00:21:16] !log [paladox@mwtask181] starting deploy of {'pull': 'config', 'config': True} to all [00:21:18] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:21:44] !log [paladox@mwtask181] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 28s [00:21:46] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:21:48] miraheze/mw-config - paladox the build passed. [00:24:01] !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.44/maintenance/run.php ManageWiki:ResetWikiCaches --wiki=metawiki --all-wikis (END - exit=0) [00:24:03] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:24:21] !log [universalomega@mwtask181] starting deploy of {'versions': ['1.44', '1.45'], 'upgrade_extensions': 'CreateWiki'} to all [00:24:23] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:25:18] !log [universalomega@mwtask181] finished deploy of {'versions': ['1.44', '1.45'], 'upgrade_extensions': 'CreateWiki'} to all - SUCCESS in 57s [00:25:20] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:27:29] !log [petramagna@test151] starting deploy of {'config': True} to test151 [00:27:30] !log [petramagna@test151] finished deploy of {'config': True} to test151 - SUCCESS in 0s [00:27:31] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:27:32] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:32:18] miraheze/mw-config - lihaohong6 the build passed. [00:32:59] [02mw-config] 07Universal-Omega commented on pull request #6278: If its broken since before 1.44 and no one reports it its probably not realistically being used so not worth keeping in that case, but if we can make it work I guess I have no issues with keeping it. 13https://github.com/miraheze/mw-config/pull/6278#issuecomment-3868686988 [00:33:15] RECOVERY - cp191 Disk Space on cp191 is OK: DISK OK - free space: / 74083MiB (16.3% inode=100%); [02:06:47] !log [petramagna@test151] sudo -u www-data php /srv/mediawiki/1.45/maintenance/run.php updateSpecialPages --wiki=exttestwikibeta --only=OrphanedTalkPages (END - exit=0) [02:06:49] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:50:08] [02python-functions] 07renovate[bot] pushed 1 new commit to 03main 13https://github.com/miraheze/python-functions/commit/c2b9d9a7e49fb7a24c93ac3f7dee7552aea8d769 [03:50:08] 02python-functions/03main 07renovate[bot] 03c2b9d9a chore(deps): update dependency flake8-noqa to v1.5.0 [03:50:08] [02python-functions] 07renovate[bot] 04deleted 03renovate/all-deps at 03c2b9d9a 13https://api.github.com/repos/miraheze/python-functions/commit/c2b9d9a [03:53:21] miraheze/python-functions - renovate[bot] the build passed. [07:53:15] PROBLEM - mw172 HTTPS on mw172 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: HTTP/2 502 [07:54:04] PROBLEM - cp191 Varnish Backends on cp191 is CRITICAL: 1 backends are down. mw172 [07:54:05] PROBLEM - cp171 Varnish Backends on cp171 is CRITICAL: 1 backends are down. mw172 [07:54:19] PROBLEM - cp161 Varnish Backends on cp161 is CRITICAL: 1 backends are down. mw172 [07:54:27] PROBLEM - mw172 MediaWiki Rendering on mw172 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 8191 bytes in 0.011 second response time [07:54:38] PROBLEM - cp201 Varnish Backends on cp201 is CRITICAL: 1 backends are down. mw172 [07:57:23] PROBLEM - mw172 php-fpm on mw172 is CRITICAL: connect to address 10.0.17.123 port 5666: Connection refusedconnect to host 10.0.17.123 port 5666: Connection refused [07:57:39] PROBLEM - mw172 Current Load on mw172 is CRITICAL: connect to address 10.0.17.123 port 5666: Connection refusedconnect to host 10.0.17.123 port 5666: Connection refused [07:57:44] PROBLEM - mw172 PowerDNS Recursor on mw172 is CRITICAL: connect to address 10.0.17.123 port 5666: Connection refusedconnect to host 10.0.17.123 port 5666: Connection refused [07:59:29] PROBLEM - mw172 Check unit status of php8.2-fpm_check_restart on mw172 is CRITICAL: connect to address 10.0.17.123 port 5666: Connection refusedconnect to host 10.0.17.123 port 5666: Connection refused [07:59:32] RECOVERY - mw172 php-fpm on mw172 is OK: PROCS OK: 25 processes with command name 'php-fpm8.2' [07:59:33] RECOVERY - mw172 PowerDNS Recursor on mw172 is OK: DNS OK: 0.048 seconds response time. mw172.fsslc.wtnet returns 10.0.17.123 [07:59:37] RECOVERY - mw172 Current Load on mw172 is OK: LOAD OK - total load average: 0.22, 0.05, 0.02 [08:00:19] RECOVERY - cp161 Varnish Backends on cp161 is OK: All 31 backends are healthy [08:00:27] RECOVERY - mw172 MediaWiki Rendering on mw172 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 0.197 second response time [08:00:33] RECOVERY - cp201 Varnish Backends on cp201 is OK: All 31 backends are healthy [08:00:39] !log reboot mw172 from proxmox (was totally dead) [08:00:41] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [08:01:15] RECOVERY - cp171 Varnish Backends on cp171 is OK: All 31 backends are healthy [08:01:18] RECOVERY - cp191 Varnish Backends on cp191 is OK: All 31 backends are healthy [08:01:21] RECOVERY - mw172 HTTPS on mw172 is OK: HTTP OK: HTTP/2 410 - Status line output matched "HTTP/2 410" - 4288 bytes in 0.061 second response time [08:01:24] RECOVERY - mw172 Check unit status of php8.2-fpm_check_restart on mw172 is OK: OK: Status of the systemd unit php8.2-fpm_check_restart [10:02:18] !log [rhinos@mwtask181] sudo -u www-data php /srv/mediawiki/1.44/maintenance/run.php CreateWiki:DeleteWiki --wiki=loginwiki --delete --deletewiki wardencasserolewiki (END - exit=0) [10:02:19] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [10:03:36] !log deleted and dropped wardencasserolewiki (db171) [10:03:38] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [11:30:49] RECOVERY - db182 APT on db182 is OK: APT OK: 11 packages available for upgrade (0 critical updates). [11:30:51] !log [universalomega@puppet181] Upgraded packages on db182: libwireshark-data, libwsutil16, libwiretap15, libwireshark18, tshark, and wireshark-common [11:30:53] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [11:31:08] RECOVERY - mon181 APT on mon181 is OK: APT OK: 12 packages available for upgrade (0 critical updates). [11:31:09] !log [universalomega@puppet181] Upgraded packages on mon181: libwireshark-data, libwsutil16, libwiretap15, libwireshark18, tshark, and wireshark-common [11:31:11] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:12:12] [02ErrorPages] 07translatewiki pushed 1 new commit to 03main 13https://github.com/miraheze/ErrorPages/commit/fd224f8230999259a5b4ec850129c40fe1dddeda [12:12:12] 02ErrorPages/03main 07translatewiki.net 03fd224f8 Localisation updates from https://translatewiki.net. [12:12:14] [02MirahezeMagic] 07translatewiki pushed 1 new commit to 03main 13https://github.com/miraheze/MirahezeMagic/commit/8a61229de89a0711f533be216c34be9a9aa6e69f [12:12:14] 02MirahezeMagic/03main 07translatewiki.net 038a61229 Localisation updates from https://translatewiki.net. [12:12:16] [02ManageWiki] 07translatewiki pushed 1 new commit to 03main 13https://github.com/miraheze/ManageWiki/commit/7670e9e2ce4737cf6cd5756948b7a5d4c57d354b [12:12:17] 02ManageWiki/03main 07translatewiki.net 037670e9e Localisation updates from https://translatewiki.net. [12:12:57] miraheze/ErrorPages - translatewiki the build passed. [12:17:58] miraheze/MirahezeMagic - translatewiki the build has errored. [12:18:13] miraheze/ManageWiki - translatewiki the build passed. [13:04:36] !log upgrade openvox on puppet181 [13:04:38] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [13:08:20] PROBLEM - prometheus151 Puppet on prometheus151 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [13:08:24] PROBLEM - mon181 Puppet on mon181 is CRITICAL: CRITICAL: Puppet has 36 failures. Last run 3 minutes ago with 36 failures. Failed resources (up to 3 shown): File[/etc/nagios/nrpe.cfg],File[/usr/lib/nagios/plugins/check_smart],File[/usr/lib/nagios/plugins/check_ipmi_sensors],File[/usr/local/bin/gen_fingerprints] [13:08:40] PROBLEM - mw182 Puppet on mw182 is CRITICAL: CRITICAL: Puppet has 37 failures. Last run 3 minutes ago with 37 failures. Failed resources (up to 3 shown): File[/usr/local/sbin/check-and-restart-php],File[/usr/local/bin/safe-service-restart],File[/etc/logrotate.d/puppet],File[/etc/update-motd.d/97-last-puppet-run] [13:08:56] PROBLEM - mw183 Puppet on mw183 is CRITICAL: CRITICAL: Puppet has 45 failures. Last run 3 minutes ago with 45 failures. Failed resources (up to 3 shown): File[/opt/prometheus-statsd-exporter_0.26.1-1_amd64.deb],File[/usr/local/bin/fileLockScript.sh],File[/usr/local/bin/foreachwikiindblist],File[/usr/local/bin/getMWVersion] [13:12:48] will resolve ^ [13:19:35] !log [paladox@test151] starting deploy of {'versions': ['1.44', '1.45'], 'upgrade_extensions': 'MirahezeMagic'} to test151 [13:19:36] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [13:19:37] !log [paladox@test151] finished deploy of {'versions': ['1.44', '1.45'], 'upgrade_extensions': 'MirahezeMagic'} to test151 - SUCCESS in 1s [13:19:38] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [13:36:20] RECOVERY - prometheus151 Puppet on prometheus151 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [13:36:23] RECOVERY - mon181 Puppet on mon181 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [13:36:39] RECOVERY - mw182 Puppet on mw182 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [13:36:53] RECOVERY - mw183 Puppet on mw183 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [15:18:29] !log upgrade phorge on phorge171 [15:18:31] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:05:47] [02mediawiki-repos] 07paladox created 03paladox-patch-1 (+1 new commit) 13https://github.com/miraheze/mediawiki-repos/commit/3b7f3a82c267 [16:05:47] 02mediawiki-repos/03paladox-patch-1 07paladox 033b7f3a8 Use master branch for ImageRating [16:05:52] [02mediawiki-repos] 07paladox opened pull request #107: Use master branch for ImageRating (03main...03paladox-patch-1) 13https://github.com/miraheze/mediawiki-repos/pull/107 [16:06:05] [02mediawiki-repos] 07coderabbitai[bot] commented on pull request #107:

[…] 13https://github.com/miraheze/mediawiki-repos/pull/107#issuecomment-3872641366 [16:08:30] [02mw-config] 07dependabot[bot] created 03dependabot/composer/phpunit/phpunit-13.0.1 (+1 new commit) 13https://github.com/miraheze/mw-config/commit/0057f8f196bb [16:08:30] 02mw-config/03dependabot/composer/phpunit/phpunit-13.0.1 07dependabot[bot] 030057f8f Update phpunit/phpunit requirement from 13.0.0 to 13.0.1… [16:08:31] [02mw-config] 07dependabot[bot] opened pull request #6287: Update phpunit/phpunit requirement from 13.0.0 to 13.0.1 (03main...03dependabot/composer/phpunit/phpunit-13.0.1) 13https://github.com/miraheze/mw-config/pull/6287 [16:09:45] miraheze/mw-config - dependabot[bot] the build passed. [16:11:09] !log [paladox@mwtask181] starting deploy of {'l10n': True, 'versions': ['1.44', '1.45'], 'upgrade_extensions': 'ImageRating'} to all [16:11:11] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:11:25] !log [paladox@test151] starting deploy of {'l10n': True, 'versions': ['1.44', '1.45'], 'upgrade_extensions': 'ImageRating'} to test151 [16:11:27] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:21:54] !log [paladox@test151] finished deploy of {'l10n': True, 'versions': ['1.44', '1.45'], 'upgrade_extensions': 'ImageRating'} to test151 - SUCCESS in 628s [16:21:56] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:29:12] !log [paladox@mwtask181] finished deploy of {'l10n': True, 'versions': ['1.44', '1.45'], 'upgrade_extensions': 'ImageRating'} to all - SUCCESS in 1082s [16:29:14] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:38:39] PROBLEM - mw182 Puppet on mw182 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_femiwiki-deploy-1.44] [16:41:26] PROBLEM - test151 Puppet on test151 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_mathoid] [16:42:20] PROBLEM - puppet181 Check unit status of git_pull_ssl on puppet181 is CRITICAL: CRITICAL: Status of the systemd unit git_pull_ssl [16:42:23] PROBLEM - puppet181 Check unit status of git_pull_puppet on puppet181 is CRITICAL: CRITICAL: Status of the systemd unit git_pull_puppet [16:45:20] PROBLEM - mw162 Puppet on mw162 is CRITICAL: CRITICAL: Puppet has 3 failures. Last run 3 minutes ago with 3 failures. Failed resources (up to 3 shown): Exec[git_pull_femiwiki-deploy-1.44],Exec[git_pull_femiwiki-deploy-1.45],Exec[git_pull_3d2png] [16:45:54] PROBLEM - mw202 Puppet on mw202 is CRITICAL: CRITICAL: Puppet has 3 failures. Last run 3 minutes ago with 3 failures. Failed resources (up to 3 shown): Exec[git_pull_femiwiki-deploy-1.44],Exec[git_pull_femiwiki-deploy-1.45],Exec[git_pull_3d2png] [16:46:35] PROBLEM - mw161 Puppet on mw161 is CRITICAL: CRITICAL: Puppet has 3 failures. Last run 3 minutes ago with 3 failures. Failed resources (up to 3 shown): Exec[git_pull_femiwiki-deploy-1.44],Exec[git_pull_femiwiki-deploy-1.45],Exec[git_pull_3d2png] [16:46:45] PROBLEM - mw172 Puppet on mw172 is CRITICAL: CRITICAL: Puppet has 3 failures. Last run 3 minutes ago with 3 failures. Failed resources (up to 3 shown): Exec[git_pull_femiwiki-deploy-1.44],Exec[git_pull_femiwiki-deploy-1.45],Exec[git_pull_3d2png] [16:46:46] PROBLEM - mw203 Puppet on mw203 is CRITICAL: CRITICAL: Puppet has 3 failures. Last run 3 minutes ago with 3 failures. Failed resources (up to 3 shown): Exec[git_pull_femiwiki-deploy-1.44],Exec[git_pull_femiwiki-deploy-1.45],Exec[git_pull_3d2png] [16:47:17] PROBLEM - phorge171 Puppet on phorge171 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_phorge-extensions] [16:47:27] PROBLEM - mwtask171 Puppet on mwtask171 is CRITICAL: CRITICAL: Puppet has 4 failures. Last run 3 minutes ago with 4 failures. Failed resources (up to 3 shown): Exec[git_pull_mathoid],Exec[git_pull_femiwiki-deploy-1.44],Exec[git_pull_femiwiki-deploy-1.45],Exec[git_pull_3d2png] [16:48:30] PROBLEM - mw173 Puppet on mw173 is CRITICAL: CRITICAL: Puppet has 3 failures. Last run 2 minutes ago with 3 failures. Failed resources (up to 3 shown): Exec[git_pull_femiwiki-deploy-1.44],Exec[git_pull_femiwiki-deploy-1.45],Exec[git_pull_3d2png] [16:48:54] PROBLEM - puppet181 Puppet on puppet181 is CRITICAL: CRITICAL: Puppet has 4 failures. Last run 2 minutes ago with 4 failures. Failed resources (up to 3 shown): Exec[git_pull_puppet],Exec[git_pull_ssl],Exec[git_pull_mediawiki-repos],Exec[git_pull_pywikibot-config] [16:49:38] PROBLEM - mwtask161 Puppet on mwtask161 is CRITICAL: CRITICAL: Puppet has 4 failures. Last run 3 minutes ago with 4 failures. Failed resources (up to 3 shown): Exec[git_pull_mathoid],Exec[git_pull_femiwiki-deploy-1.44],Exec[git_pull_femiwiki-deploy-1.45],Exec[git_pull_3d2png] [16:51:10] PROBLEM - mwtask151 Puppet on mwtask151 is CRITICAL: CRITICAL: Puppet has 4 failures. Last run 3 minutes ago with 4 failures. Failed resources (up to 3 shown): Exec[git_pull_mathoid],Exec[git_pull_femiwiki-deploy-1.44],Exec[git_pull_femiwiki-deploy-1.45],Exec[git_pull_3d2png] [16:53:11] PROBLEM - ns1 Puppet on ns1 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_dns] [16:53:47] PROBLEM - mw193 Puppet on mw193 is CRITICAL: CRITICAL: Puppet has 3 failures. Last run 3 minutes ago with 3 failures. Failed resources (up to 3 shown): Exec[git_pull_femiwiki-deploy-1.44],Exec[git_pull_femiwiki-deploy-1.45],Exec[git_pull_3d2png] [16:56:42] PROBLEM - mw171 Puppet on mw171 is CRITICAL: CRITICAL: Puppet has 3 failures. Last run 3 minutes ago with 3 failures. Failed resources (up to 3 shown): Exec[git_pull_femiwiki-deploy-1.44],Exec[git_pull_femiwiki-deploy-1.45],Exec[git_pull_3d2png] [16:57:27] PROBLEM - mw191 Puppet on mw191 is CRITICAL: CRITICAL: Puppet has 3 failures. Last run 2 minutes ago with 3 failures. Failed resources (up to 3 shown): Exec[git_pull_femiwiki-deploy-1.44],Exec[git_pull_femiwiki-deploy-1.45],Exec[git_pull_3d2png] [16:57:47] PROBLEM - mw153 Puppet on mw153 is CRITICAL: CRITICAL: Puppet has 3 failures. Last run 3 minutes ago with 3 failures. Failed resources (up to 3 shown): Exec[git_pull_femiwiki-deploy-1.44],Exec[git_pull_femiwiki-deploy-1.45],Exec[git_pull_3d2png] [16:57:51] PROBLEM - bots171 Puppet on bots171 is CRITICAL: CRITICAL: Puppet has 2 failures. Last run 2 minutes ago with 2 failures. Failed resources (up to 3 shown): Exec[git_pull_Pywikibot-stable],Exec[git_pull_IRC-Discord-Relay-relaybot] [17:01:17] PROBLEM - mw192 Puppet on mw192 is CRITICAL: CRITICAL: Puppet has 3 failures. Last run 2 minutes ago with 3 failures. Failed resources (up to 3 shown): Exec[git_pull_femiwiki-deploy-1.44],Exec[git_pull_femiwiki-deploy-1.45],Exec[git_pull_3d2png] [17:04:15] PROBLEM - mw151 Puppet on mw151 is CRITICAL: CRITICAL: Puppet has 3 failures. Last run 3 minutes ago with 3 failures. Failed resources (up to 3 shown): Exec[git_pull_femiwiki-deploy-1.44],Exec[git_pull_femiwiki-deploy-1.45],Exec[git_pull_3d2png] [17:04:21] PROBLEM - mw163 Puppet on mw163 is CRITICAL: CRITICAL: Puppet has 3 failures. Last run 2 minutes ago with 3 failures. Failed resources (up to 3 shown): Exec[git_pull_femiwiki-deploy-1.44],Exec[git_pull_femiwiki-deploy-1.45],Exec[git_pull_3d2png] [17:07:28] PROBLEM - mw181 Puppet on mw181 is CRITICAL: CRITICAL: Puppet has 3 failures. Last run 3 minutes ago with 3 failures. Failed resources (up to 3 shown): Exec[git_pull_femiwiki-deploy-1.44],Exec[git_pull_femiwiki-deploy-1.45],Exec[git_pull_3d2png] [17:09:15] PROBLEM - mw152 Puppet on mw152 is CRITICAL: CRITICAL: Puppet has 3 failures. Last run 2 minutes ago with 3 failures. Failed resources (up to 3 shown): Exec[git_pull_femiwiki-deploy-1.44],Exec[git_pull_femiwiki-deploy-1.45],Exec[git_pull_3d2png] [17:09:32] PROBLEM - mw201 Puppet on mw201 is CRITICAL: CRITICAL: Puppet has 3 failures. Last run 3 minutes ago with 3 failures. Failed resources (up to 3 shown): Exec[git_pull_femiwiki-deploy-1.44],Exec[git_pull_femiwiki-deploy-1.45],Exec[git_pull_3d2png] [17:10:33] PROBLEM - mwtask181 Puppet on mwtask181 is CRITICAL: CRITICAL: Puppet has 4 failures. Last run 3 minutes ago with 4 failures. Failed resources (up to 3 shown): Exec[git_pull_mathoid],Exec[git_pull_femiwiki-deploy-1.44],Exec[git_pull_femiwiki-deploy-1.45],Exec[git_pull_3d2png] [17:10:55] PROBLEM - mw183 Puppet on mw183 is CRITICAL: CRITICAL: Puppet has 3 failures. Last run 2 minutes ago with 3 failures. Failed resources (up to 3 shown): Exec[git_pull_femiwiki-deploy-1.44],Exec[git_pull_femiwiki-deploy-1.45],Exec[git_pull_3d2png] [17:13:38] RECOVERY - mwtask161 Puppet on mwtask161 is OK: OK: Puppet is currently enabled, last run 41 seconds ago with 0 failures [17:14:30] RECOVERY - mw173 Puppet on mw173 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [17:14:54] RECOVERY - puppet181 Puppet on puppet181 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [17:15:10] RECOVERY - mwtask151 Puppet on mwtask151 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [17:15:17] RECOVERY - phorge171 Puppet on phorge171 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [17:17:10] RECOVERY - ns1 Puppet on ns1 is OK: OK: Puppet is currently enabled, last run 21 seconds ago with 0 failures [17:20:42] RECOVERY - mw171 Puppet on mw171 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [17:21:46] RECOVERY - mw153 Puppet on mw153 is OK: OK: Puppet is currently enabled, last run 15 seconds ago with 0 failures [17:23:27] RECOVERY - mw191 Puppet on mw191 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [17:23:55] RECOVERY - bots171 Puppet on bots171 is OK: OK: Puppet is currently enabled, last run 6 seconds ago with 0 failures [17:27:27] RECOVERY - mw192 Puppet on mw192 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [17:28:15] RECOVERY - mw151 Puppet on mw151 is OK: OK: Puppet is currently enabled, last run 17 seconds ago with 0 failures [17:28:21] RECOVERY - mw163 Puppet on mw163 is OK: OK: Puppet is currently enabled, last run 15 seconds ago with 0 failures [17:30:20] RECOVERY - puppet181 Check unit status of git_pull_ssl on puppet181 is OK: OK: Status of the systemd unit git_pull_ssl [17:30:23] RECOVERY - puppet181 Check unit status of git_pull_puppet on puppet181 is OK: OK: Status of the systemd unit git_pull_puppet [17:31:27] RECOVERY - mw181 Puppet on mw181 is OK: OK: Puppet is currently enabled, last run 4 seconds ago with 0 failures [17:34:33] RECOVERY - mwtask181 Puppet on mwtask181 is OK: OK: Puppet is currently enabled, last run 29 seconds ago with 0 failures [17:35:14] RECOVERY - mw152 Puppet on mw152 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [17:35:26] RECOVERY - test151 Puppet on test151 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [17:35:32] RECOVERY - mw201 Puppet on mw201 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [17:36:39] RECOVERY - mw182 Puppet on mw182 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [17:36:53] RECOVERY - mw183 Puppet on mw183 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [17:39:54] RECOVERY - mw202 Puppet on mw202 is OK: OK: Puppet is currently enabled, last run 17 seconds ago with 0 failures [17:39:54] RECOVERY - mw162 Puppet on mw162 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [17:40:35] RECOVERY - mw161 Puppet on mw161 is OK: OK: Puppet is currently enabled, last run 1 second ago with 0 failures [17:40:57] RECOVERY - mw172 Puppet on mw172 is OK: OK: Puppet is currently enabled, last run 51 seconds ago with 0 failures [17:42:45] RECOVERY - mw203 Puppet on mw203 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [17:43:27] RECOVERY - mwtask171 Puppet on mwtask171 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [17:47:38] [02mediawiki-repos] 07Universal-Omega pushed 1 new commit to 03main 13https://github.com/miraheze/mediawiki-repos/commit/397a0e9c07070ec672556ebdc3242d8bf9e09b56 [17:47:39] 02mediawiki-repos/03main 07paladox 03397a0e9 Use master branch for ImageRating [17:47:41] [02mediawiki-repos] 07Universal-Omega merged 07paladox's pull request #107: Use master branch for ImageRating (03main...03paladox-patch-1) 13https://github.com/miraheze/mediawiki-repos/pull/107 [17:47:43] [02mediawiki-repos] 07Universal-Omega 04deleted 03paladox-patch-1 at 033b7f3a8 13https://api.github.com/repos/miraheze/mediawiki-repos/commit/3b7f3a8 [17:47:47] RECOVERY - mw193 Puppet on mw193 is OK: OK: Puppet is currently enabled, last run 32 seconds ago with 0 failures [17:49:28] [02mediawiki-repos] 07Universal-Omega closed pull request #64: Add patch from https://gerrit.wikimedia.org/r/1121572 (07miraheze:03main...07BlankEclair:03pagenotice-global-notices) 13https://github.com/miraheze/mediawiki-repos/pull/64 [17:49:29] [02mediawiki-repos] 07Universal-Omega commented on pull request #64: This won't be needed anymore in 1.45 for sure but may also be in 1.44. 13https://github.com/miraheze/mediawiki-repos/pull/64#issuecomment-3873072128 [17:51:25] [02puppet] 07Universal-Omega created 031.45-default (+1 new commit) 13https://github.com/miraheze/puppet/commit/9081819aab45 [17:51:25] 02puppet/031.45-default 07CosmicAlpha 039081819 Make 1.45 the default version [17:51:31] [02puppet] 07Universal-Omega opened pull request #4750: Make 1.45 the default version (03main...031.45-default) 13https://github.com/miraheze/puppet/pull/4750 [17:51:39] [02puppet] 07coderabbitai[bot] commented on pull request #4750:

[…] 13https://github.com/miraheze/puppet/pull/4750#issuecomment-3873081947 [18:07:16] [02mw-config] 07Universal-Omega merged 07dependabot[bot]'s pull request #6287: Update phpunit/phpunit requirement from 13.0.0 to 13.0.1 (03main...03dependabot/composer/phpunit/phpunit-13.0.1) 13https://github.com/miraheze/mw-config/pull/6287 [18:07:16] [02mw-config] 07Universal-Omega pushed 1 new commit to 03main 13https://github.com/miraheze/mw-config/commit/d5147dc66237fcb1c8d786bb73b52a793322e361 [18:07:18] 02mw-config/03main 07dependabot[bot] 03d5147dc Update phpunit/phpunit requirement from 13.0.0 to 13.0.1 (#6287)… [18:07:20] [02mw-config] 07Universal-Omega 04deleted 03dependabot/composer/phpunit/phpunit-13.0.1 at 030057f8f 13https://api.github.com/repos/miraheze/mw-config/commit/0057f8f [18:08:36] miraheze/mw-config - Universal-Omega the build passed. [18:10:54] !log [universalomega@test151] starting deploy of {'versions': '1.45', 'upgrade_extensions': 'TemplateStylesExtender'} to test151 [18:10:55] !log [universalomega@test151] DEPLOY ABORTED: Non-Zero Exit Code in prep, see output. [18:10:56] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:10:57] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:11:44] !log [universalomega@test151] starting deploy of {'force_upgrade': True, 'versions': '1.45', 'upgrade_extensions': 'TemplateStylesExtender'} to test151 [18:11:45] !log [universalomega@test151] finished deploy of {'force_upgrade': True, 'versions': '1.45', 'upgrade_extensions': 'TemplateStylesExtender'} to test151 - SUCCESS in 0s [18:11:47] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:11:48] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:13:06] !log [universalomega@mwtask181] starting deploy of {'versions': '1.45', 'upgrade_extensions': 'TemplateStylesExtender'} to all [18:13:08] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:13:36] !log [universalomega@mwtask181] finished deploy of {'versions': '1.45', 'upgrade_extensions': 'TemplateStylesExtender'} to all - SUCCESS in 29s [18:13:38] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:26:59] PROBLEM - cp161 APT on cp161 is CRITICAL: APT CRITICAL: 1 packages available for upgrade (1 critical updates). [18:27:23] PROBLEM - cp191 APT on cp191 is CRITICAL: APT CRITICAL: 1 packages available for upgrade (1 critical updates). [18:27:36] PROBLEM - mem191 APT on mem191 is CRITICAL: APT CRITICAL: 1 packages available for upgrade (1 critical updates). [18:27:47] PROBLEM - swiftobject171 APT on swiftobject171 is CRITICAL: APT CRITICAL: 1 packages available for upgrade (1 critical updates). [18:28:36] PROBLEM - graylog161 APT on graylog161 is CRITICAL: APT CRITICAL: 1 packages available for upgrade (1 critical updates). [18:29:33] PROBLEM - os202 APT on os202 is CRITICAL: APT CRITICAL: 1 packages available for upgrade (1 critical updates). [18:29:35] PROBLEM - db181 APT on db181 is CRITICAL: APT CRITICAL: 12 packages available for upgrade (1 critical updates). [18:29:56] PROBLEM - os162 APT on os162 is CRITICAL: APT CRITICAL: 1 packages available for upgrade (1 critical updates). [18:32:22] PROBLEM - ns2 APT on ns2 is CRITICAL: APT CRITICAL: 39 packages available for upgrade (1 critical updates). [18:33:23] PROBLEM - reports171 APT on reports171 is CRITICAL: APT CRITICAL: 1 packages available for upgrade (1 critical updates). [18:33:38] PROBLEM - swiftobject151 APT on swiftobject151 is CRITICAL: APT CRITICAL: 1 packages available for upgrade (1 critical updates). [18:33:42] PROBLEM - db151 APT on db151 is CRITICAL: APT CRITICAL: 12 packages available for upgrade (1 critical updates). [18:33:57] PROBLEM - os191 APT on os191 is CRITICAL: APT CRITICAL: 1 packages available for upgrade (1 critical updates). [18:33:57] PROBLEM - eventgate182 APT on eventgate182 is CRITICAL: APT CRITICAL: 1 packages available for upgrade (1 critical updates). [18:34:15] PROBLEM - os161 APT on os161 is CRITICAL: APT CRITICAL: 1 packages available for upgrade (1 critical updates). [18:34:19] PROBLEM - swiftobject161 APT on swiftobject161 is CRITICAL: APT CRITICAL: 1 packages available for upgrade (1 critical updates). [18:34:56] PROBLEM - db192 APT on db192 is CRITICAL: APT CRITICAL: 54 packages available for upgrade (1 critical updates). [18:34:57] PROBLEM - mon181 APT on mon181 is CRITICAL: APT CRITICAL: 13 packages available for upgrade (1 critical updates). [18:36:33] PROBLEM - bast181 APT on bast181 is CRITICAL: APT CRITICAL: 44 packages available for upgrade (1 critical updates). [18:36:49] PROBLEM - ldap171 APT on ldap171 is CRITICAL: APT CRITICAL: 1 packages available for upgrade (1 critical updates). [18:36:59] PROBLEM - prometheus151 APT on prometheus151 is CRITICAL: APT CRITICAL: 1 packages available for upgrade (1 critical updates). [18:38:12] PROBLEM - mattermost2 APT on mattermost2 is CRITICAL: APT CRITICAL: 1 packages available for upgrade (1 critical updates). [18:38:12] PROBLEM - mem201 APT on mem201 is CRITICAL: APT CRITICAL: 1 packages available for upgrade (1 critical updates). [18:38:17] PROBLEM - swiftproxy161 APT on swiftproxy161 is CRITICAL: APT CRITICAL: 1 packages available for upgrade (1 critical updates). [18:38:31] PROBLEM - matomo151 APT on matomo151 is CRITICAL: APT CRITICAL: 1 packages available for upgrade (1 critical updates). [18:39:06] PROBLEM - changeprop202 APT on changeprop202 is CRITICAL: APT CRITICAL: 1 packages available for upgrade (1 critical updates). [18:39:23] PROBLEM - cp201 APT on cp201 is CRITICAL: APT CRITICAL: 1 packages available for upgrade (1 critical updates). [18:41:02] PROBLEM - db172 APT on db172 is CRITICAL: APT CRITICAL: 12 packages available for upgrade (1 critical updates). [18:42:06] PROBLEM - swiftproxy171 APT on swiftproxy171 is CRITICAL: APT CRITICAL: 1 packages available for upgrade (1 critical updates). [18:42:26] PROBLEM - rdb191 APT on rdb191 is CRITICAL: APT CRITICAL: 1 packages available for upgrade (1 critical updates). [18:42:31] PROBLEM - puppet181 APT on puppet181 is CRITICAL: APT CRITICAL: 1 packages available for upgrade (1 critical updates). [18:42:33] PROBLEM - swiftobject201 APT on swiftobject201 is CRITICAL: APT CRITICAL: 1 packages available for upgrade (1 critical updates). [18:42:56] PROBLEM - llm191 APT on llm191 is CRITICAL: APT CRITICAL: 1 packages available for upgrade (1 critical updates). [18:43:08] PROBLEM - bast161 APT on bast161 is CRITICAL: APT CRITICAL: 43 packages available for upgrade (1 critical updates). [18:43:34] PROBLEM - cp171 APT on cp171 is CRITICAL: APT CRITICAL: 2 packages available for upgrade (1 critical updates). [18:44:02] PROBLEM - swiftobject191 APT on swiftobject191 is CRITICAL: APT CRITICAL: 1 packages available for upgrade (1 critical updates). [18:44:02] PROBLEM - mem161 APT on mem161 is CRITICAL: APT CRITICAL: 1 packages available for upgrade (1 critical updates). [18:44:31] PROBLEM - swiftobject181 APT on swiftobject181 is CRITICAL: APT CRITICAL: 1 packages available for upgrade (1 critical updates). [18:45:08] PROBLEM - phorge171 APT on phorge171 is CRITICAL: APT CRITICAL: 1 packages available for upgrade (1 critical updates). [18:45:52] PROBLEM - swiftac171 APT on swiftac171 is CRITICAL: APT CRITICAL: 1 packages available for upgrade (1 critical updates). [18:47:02] PROBLEM - db161 APT on db161 is CRITICAL: APT CRITICAL: 12 packages available for upgrade (1 critical updates). [18:48:08] PROBLEM - os201 APT on os201 is CRITICAL: APT CRITICAL: 1 packages available for upgrade (1 critical updates). [18:48:14] PROBLEM - ns1 APT on ns1 is CRITICAL: APT CRITICAL: 1 packages available for upgrade (1 critical updates). [18:48:26] PROBLEM - os151 APT on os151 is CRITICAL: APT CRITICAL: 1 packages available for upgrade (1 critical updates). [18:49:20] PROBLEM - mem151 APT on mem151 is CRITICAL: APT CRITICAL: 1 packages available for upgrade (1 critical updates). [18:51:09] PROBLEM - db171 APT on db171 is CRITICAL: APT CRITICAL: 12 packages available for upgrade (1 critical updates). [18:51:30] PROBLEM - db182 APT on db182 is CRITICAL: APT CRITICAL: 12 packages available for upgrade (1 critical updates). [18:51:57] PROBLEM - db201 APT on db201 is CRITICAL: APT CRITICAL: 53 packages available for upgrade (1 critical updates). [18:52:25] PROBLEM - kafka182 APT on kafka182 is CRITICAL: APT CRITICAL: 1 packages available for upgrade (1 critical updates). [18:54:33] !log [universalomega@puppet181] Upgraded packages on bast161: linux-libc-dev [18:54:35] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:55:05] RECOVERY - bast161 APT on bast161 is OK: APT OK: 42 packages available for upgrade (0 critical updates). [18:56:08] !log [universalomega@puppet181] Upgraded packages on bots171: linux-libc-dev [18:56:11] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:56:28] !log [universalomega@puppet181] Upgraded packages on changeprop202: linux-libc-dev [18:56:29] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:56:41] !log [universalomega@puppet181] Upgraded packages on bast181: linux-libc-dev [18:56:42] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:57:01] !log [universalomega@puppet181] Upgraded packages on db172: linux-libc-dev [18:57:03] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:57:05] RECOVERY - changeprop202 APT on changeprop202 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [18:57:09] RECOVERY - db172 APT on db172 is OK: APT OK: 11 packages available for upgrade (0 critical updates). [18:57:13] !log [universalomega@puppet181] Upgraded packages on db161: linux-libc-dev [18:57:15] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:57:25] !log [universalomega@puppet181] Upgraded packages on cp161: linux-libc-dev [18:57:27] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:57:37] !log [universalomega@puppet181] Upgraded packages on cp191: linux-libc-dev [18:57:39] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:57:50] !log [universalomega@puppet181] Upgraded packages on db151: linux-libc-dev [18:57:52] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:58:02] !log [universalomega@puppet181] Upgraded packages on db171: linux-libc-dev [18:58:04] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:58:08] PROBLEM - bots171 Puppet on bots171 is CRITICAL: CRITICAL: Puppet has 2 failures. Last run 2 minutes ago with 2 failures. Failed resources (up to 3 shown): Exec[git_pull_Pywikibot-stable],Exec[git_pull_IRC-Discord-Relay-relaybot] [18:58:16] !log [universalomega@puppet181] Upgraded packages on cp171: linux-libc-dev [18:58:17] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:58:33] RECOVERY - bast181 APT on bast181 is OK: APT OK: 43 packages available for upgrade (0 critical updates). [18:58:37] !log [universalomega@puppet181] Upgraded packages on db182: linux-libc-dev [18:58:39] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:58:50] !log [universalomega@puppet181] Upgraded packages on db181: linux-libc-dev [18:58:52] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:58:58] RECOVERY - cp161 APT on cp161 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [18:59:06] RECOVERY - db161 APT on db161 is OK: APT OK: 11 packages available for upgrade (0 critical updates). [18:59:07] !log [universalomega@puppet181] Upgraded packages on db201: linux-libc-dev [18:59:09] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:59:09] RECOVERY - db171 APT on db171 is OK: APT OK: 11 packages available for upgrade (0 critical updates). [18:59:20] !log [universalomega@puppet181] Upgraded packages on cp201: linux-libc-dev [18:59:21] RECOVERY - cp191 APT on cp191 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [18:59:21] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:59:23] RECOVERY - cp201 APT on cp201 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [18:59:32] !log [universalomega@puppet181] Upgraded packages on eventgate182: linux-libc-dev [18:59:34] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:59:35] RECOVERY - db182 APT on db182 is OK: APT OK: 11 packages available for upgrade (0 critical updates). [18:59:35] RECOVERY - db181 APT on db181 is OK: APT OK: 11 packages available for upgrade (0 critical updates). [18:59:40] RECOVERY - db151 APT on db151 is OK: APT OK: 11 packages available for upgrade (0 critical updates). [18:59:42] RECOVERY - cp171 APT on cp171 is OK: APT OK: 1 packages available for upgrade (0 critical updates). [18:59:54] RECOVERY - db201 APT on db201 is OK: APT OK: 52 packages available for upgrade (0 critical updates). [18:59:58] !log [universalomega@puppet181] Upgraded packages on kafka182: linux-libc-dev [18:59:59] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:00:08] RECOVERY - eventgate182 APT on eventgate182 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [19:00:21] RECOVERY - kafka182 APT on kafka182 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [19:00:22] !log [universalomega@puppet181] Upgraded packages on db192: linux-libc-dev [19:00:24] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:00:53] RECOVERY - db192 APT on db192 is OK: APT OK: 53 packages available for upgrade (0 critical updates). [19:00:54] !log [universalomega@puppet181] Upgraded packages on graylog161: linux-libc-dev [19:00:56] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:01:06] !log [universalomega@puppet181] Upgraded packages on ldap171: linux-libc-dev [19:01:08] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:01:16] !log [universalomega@puppet181] Upgraded packages on mattermost2: linux-libc-dev [19:01:18] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:01:29] !log [universalomega@puppet181] Upgraded packages on matomo151: linux-libc-dev [19:01:30] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:01:41] !log [universalomega@puppet181] Upgraded packages on mem151: linux-libc-dev [19:01:43] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:01:53] !log [universalomega@puppet181] Upgraded packages on mem161: linux-libc-dev [19:01:55] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:02:02] RECOVERY - mem161 APT on mem161 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [19:02:06] !log [universalomega@puppet181] Upgraded packages on llm191: linux-libc-dev [19:02:08] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:02:11] RECOVERY - mattermost2 APT on mattermost2 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [19:02:19] !log [universalomega@puppet181] Upgraded packages on mem201: linux-libc-dev [19:02:21] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:02:25] RECOVERY - mem201 APT on mem201 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [19:02:30] RECOVERY - matomo151 APT on matomo151 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [19:02:32] !log [universalomega@puppet181] Upgraded packages on mon181: linux-libc-dev [19:02:34] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:02:35] RECOVERY - graylog161 APT on graylog161 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [19:02:45] !log [universalomega@puppet181] Upgraded packages on mem191: linux-libc-dev [19:02:47] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:02:50] RECOVERY - ldap171 APT on ldap171 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [19:02:57] RECOVERY - mon181 APT on mon181 is OK: APT OK: 12 packages available for upgrade (0 critical updates). [19:03:10] RECOVERY - llm191 APT on llm191 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [19:03:26] RECOVERY - mem151 APT on mem151 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [19:03:35] RECOVERY - mem191 APT on mem191 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [19:05:49] !log [universalomega@puppet181] Upgraded packages on ns1: linux-libc-dev [19:05:51] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:06:13] RECOVERY - ns1 APT on ns1 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [19:06:21] !log [universalomega@puppet181] Upgraded packages on os161: linux-libc-dev [19:06:23] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:06:43] !log [universalomega@puppet181] Upgraded packages on os151: linux-libc-dev [19:06:45] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:06:55] !log [universalomega@puppet181] Upgraded packages on phorge171: linux-libc-dev [19:06:57] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:07:07] !log [universalomega@puppet181] Upgraded packages on prometheus151: linux-libc-dev [19:07:08] RECOVERY - phorge171 APT on phorge171 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [19:07:09] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:07:20] !log [universalomega@puppet181] Upgraded packages on os162: linux-libc-dev [19:07:22] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:07:26] PROBLEM - test151 Puppet on test151 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_mathoid] [19:07:28] PROBLEM - mw181 Puppet on mw181 is CRITICAL: CRITICAL: Puppet has 3 failures. Last run 3 minutes ago with 3 failures. Failed resources (up to 3 shown): Exec[git_pull_femiwiki-deploy-1.44],Exec[git_pull_femiwiki-deploy-1.45],Exec[git_pull_3d2png] [19:07:33] !log [universalomega@puppet181] Upgraded packages on reports171: linux-libc-dev [19:07:35] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:07:47] !log [universalomega@puppet181] Upgraded packages on os191: linux-libc-dev [19:07:49] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:08:00] !log [universalomega@puppet181] Upgraded packages on puppet181: linux-libc-dev [19:08:02] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:08:07] RECOVERY - os162 APT on os162 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [19:08:14] RECOVERY - os161 APT on os161 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [19:08:15] !log [universalomega@puppet181] Upgraded packages on rdb191: linux-libc-dev [19:08:17] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:08:19] RECOVERY - os191 APT on os191 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [19:08:21] RECOVERY - os151 APT on os151 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [19:08:29] RECOVERY - puppet181 APT on puppet181 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [19:08:30] !log [universalomega@puppet181] Upgraded packages on os201: linux-libc-dev [19:08:31] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:08:33] PROBLEM - mwtask181 Puppet on mwtask181 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_mathoid] [19:08:33] RECOVERY - rdb191 APT on rdb191 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [19:08:49] !log [universalomega@puppet181] Upgraded packages on os202: linux-libc-dev [19:08:51] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:08:59]