[00:00:00] !log [www-data@mwtask181] Began automatic backing up [00:00:05] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:01:10] [02statichelp] 07WikiTideBot pushed 1 new commit to 03main 13https://github.com/miraheze/statichelp/commit/5c6c50476a7c1934eba24985723b25c9721ca4f0 [00:01:11] 02statichelp/03main 07WikiTideBot 035c6c504 Bot: Auto-update Tech namespace pages 2025-10-01 00:01:07 [00:09:09] RECOVERY - cp171 Disk Space on cp171 is OK: DISK OK - free space: / 54739MiB (12% inode=99%); [00:11:42] RECOVERY - cp191 Disk Space on cp191 is OK: DISK OK - free space: / 55134MiB (12% inode=99%); [00:12:12] RECOVERY - cp201 Disk Space on cp201 is OK: DISK OK - free space: / 54233MiB (11% inode=99%); [01:59:29] PROBLEM - db171 Current Load on db171 is WARNING: LOAD WARNING - total load average: 8.92, 11.43, 7.12 [02:01:29] RECOVERY - db171 Current Load on db171 is OK: LOAD OK - total load average: 1.84, 7.97, 6.37 [03:40:12] PROBLEM - cp201 Disk Space on cp201 is WARNING: DISK WARNING - free space: / 49814MiB (10% inode=99%); [04:01:09] PROBLEM - cp171 Disk Space on cp171 is WARNING: DISK WARNING - free space: / 49861MiB (10% inode=99%); [04:21:42] PROBLEM - cp191 Disk Space on cp191 is WARNING: DISK WARNING - free space: / 49918MiB (10% inode=99%); [07:25:38] RECOVERY - puppet181 Check unit status of listdomains_github_push on puppet181 is OK: OK: Status of the systemd unit listdomains_github_push [07:29:38] PROBLEM - puppet181 Check unit status of listdomains_github_push on puppet181 is CRITICAL: CRITICAL: Status of the systemd unit listdomains_github_push [12:58:24] [02ssl] 07paladox created 03paladox-patch-1 (+1 new commit) 13https://github.com/miraheze/ssl/commit/04c0aac1f35c [12:58:24] 02ssl/03paladox-patch-1 07paladox 0304c0aac Fix inconsistencies in redirects.yaml [12:58:30] [02ssl] 07paladox opened pull request #887: Fix inconsistencies in redirects.yaml (03main...03paladox-patch-1) 13https://github.com/miraheze/ssl/pull/887 [12:58:51] [02ssl] 07paladox pushed 1 new commit to 03main 13https://github.com/miraheze/ssl/commit/b89dfb84a44ed24023a032ec15502b7c1312ea15 [12:58:53] 02ssl/03main 07paladox 03b89dfb8 Fix inconsistencies in redirects.yaml (#887) [12:58:55] [02ssl] 07paladox merged pull request #887: Fix inconsistencies in redirects.yaml (03main...03paladox-patch-1) 13https://github.com/miraheze/ssl/pull/887 [12:58:56] [02ssl] 07paladox 04deleted 03paladox-patch-1 at 0304c0aac 13https://api.github.com/repos/miraheze/ssl/commit/04c0aac [13:00:29] [02ssl] 07coderabbitai[bot] commented on pull request #887: Updates redirects.yaml to standardize quoting of sslname values, correct CA capitalization to “Cloudflare,” and add missing sslname fields to certain entries. No logic or redirect behavior changes. […] 13https://github.com/miraheze/ssl/pull/887#issuecomment-3356187616 [13:07:37] PROBLEM - mem201 APT on mem201 is CRITICAL: APT CRITICAL: 119 packages available for upgrade (2 critical updates). [13:08:09] PROBLEM - matomo151 APT on matomo151 is CRITICAL: APT CRITICAL: 74 packages available for upgrade (2 critical updates). [13:09:40] PROBLEM - swiftproxy161 APT on swiftproxy161 is CRITICAL: APT CRITICAL: 128 packages available for upgrade (2 critical updates). [13:09:44] PROBLEM - mw202 APT on mw202 is CRITICAL: APT CRITICAL: 131 packages available for upgrade (2 critical updates). [13:09:46] PROBLEM - mw162 APT on mw162 is CRITICAL: APT CRITICAL: 131 packages available for upgrade (2 critical updates). [13:09:53] [02ssl] 07WikiTideBot pushed 1 new commit to 03main 13https://github.com/miraheze/ssl/commit/3ab24581e798667a91ec47fc0bcfa1392b9a6410 [13:09:54] 02ssl/03main 07WikiTideBot 033ab2458 Bot: Auto-update domain lists [13:11:03] PROBLEM - cp201 APT on cp201 is CRITICAL: APT CRITICAL: 82 packages available for upgrade (2 critical updates). [13:11:15] PROBLEM - eventgate181 APT on eventgate181 is CRITICAL: APT CRITICAL: 3 packages available for upgrade (3 critical updates). [13:11:31] PROBLEM - db172 APT on db172 is CRITICAL: APT CRITICAL: 94 packages available for upgrade (2 critical updates). [13:11:32] PROBLEM - os191 APT on os191 is CRITICAL: APT CRITICAL: 111 packages available for upgrade (2 critical updates). [13:11:38] PROBLEM - bast161 APT on bast161 is CRITICAL: APT CRITICAL: 111 packages available for upgrade (2 critical updates). [13:11:45] PROBLEM - llm191 APT on llm191 is CRITICAL: APT CRITICAL: 48 packages available for upgrade (2 critical updates). [13:11:59] PROBLEM - mw161 APT on mw161 is CRITICAL: APT CRITICAL: 131 packages available for upgrade (2 critical updates). [13:12:14] PROBLEM - swiftproxy171 APT on swiftproxy171 is CRITICAL: APT CRITICAL: 128 packages available for upgrade (2 critical updates). [13:12:20] PROBLEM - mwtask171 APT on mwtask171 is CRITICAL: APT CRITICAL: 135 packages available for upgrade (2 critical updates). [13:12:25] PROBLEM - mw203 APT on mw203 is CRITICAL: APT CRITICAL: 131 packages available for upgrade (2 critical updates). [13:12:25] PROBLEM - mw172 APT on mw172 is CRITICAL: APT CRITICAL: 131 packages available for upgrade (2 critical updates). [13:13:05] PROBLEM - cp171 APT on cp171 is CRITICAL: APT CRITICAL: 112 packages available for upgrade (2 critical updates). [13:13:13] PROBLEM - swiftobject201 APT on swiftobject201 is CRITICAL: APT CRITICAL: 75 packages available for upgrade (2 critical updates). [13:13:49] PROBLEM - mwtask151 APT on mwtask151 is CRITICAL: APT CRITICAL: 135 packages available for upgrade (2 critical updates). [13:13:54] PROBLEM - swiftobject191 APT on swiftobject191 is CRITICAL: APT CRITICAL: 75 packages available for upgrade (2 critical updates). [13:13:56] PROBLEM - mem161 APT on mem161 is CRITICAL: APT CRITICAL: 119 packages available for upgrade (2 critical updates). [13:14:03] PROBLEM - mwtask161 APT on mwtask161 is CRITICAL: APT CRITICAL: 135 packages available for upgrade (2 critical updates). [13:14:07] PROBLEM - puppet181 APT on puppet181 is CRITICAL: APT CRITICAL: 78 packages available for upgrade (2 critical updates). [13:15:10] PROBLEM - phorge171 APT on phorge171 is CRITICAL: APT CRITICAL: 76 packages available for upgrade (2 critical updates). [13:15:28] PROBLEM - swiftobject181 APT on swiftobject181 is CRITICAL: APT CRITICAL: 75 packages available for upgrade (2 critical updates). [13:15:29] PROBLEM - mw173 APT on mw173 is CRITICAL: APT CRITICAL: 131 packages available for upgrade (2 critical updates). [13:15:37] PROBLEM - swiftac171 APT on swiftac171 is CRITICAL: APT CRITICAL: 126 packages available for upgrade (2 critical updates). [13:15:54] RECOVERY - puppet181 Check unit status of listdomains_github_push on puppet181 is OK: OK: Status of the systemd unit listdomains_github_push [13:16:24] PROBLEM - db161 APT on db161 is CRITICAL: APT CRITICAL: 129 packages available for upgrade (2 critical updates). [13:16:58] PROBLEM - cloud15 APT on cloud15 is CRITICAL: APT CRITICAL: 189 packages available for upgrade (2 critical updates). [13:17:05] PROBLEM - os201 APT on os201 is CRITICAL: APT CRITICAL: 83 packages available for upgrade (2 critical updates). [13:17:58] PROBLEM - ns1 APT on ns1 is CRITICAL: APT CRITICAL: 117 packages available for upgrade (2 critical updates). [13:18:26] PROBLEM - os151 APT on os151 is CRITICAL: APT CRITICAL: 113 packages available for upgrade (2 critical updates). [13:18:31] PROBLEM - cloud16 APT on cloud16 is CRITICAL: APT CRITICAL: 186 packages available for upgrade (2 critical updates). [13:18:33] PROBLEM - mem151 APT on mem151 is CRITICAL: APT CRITICAL: 119 packages available for upgrade (2 critical updates). [13:19:08] PROBLEM - mw193 APT on mw193 is CRITICAL: APT CRITICAL: 131 packages available for upgrade (2 critical updates). [13:20:42] PROBLEM - db171 APT on db171 is CRITICAL: APT CRITICAL: 121 packages available for upgrade (2 critical updates). [13:20:55] PROBLEM - kafka181 APT on kafka181 is CRITICAL: APT CRITICAL: 2 packages available for upgrade (2 critical updates). [13:21:52] PROBLEM - mw171 APT on mw171 is CRITICAL: APT CRITICAL: 131 packages available for upgrade (2 critical updates). [13:22:00] PROBLEM - mw191 APT on mw191 is CRITICAL: APT CRITICAL: 131 packages available for upgrade (2 critical updates). [13:22:05] PROBLEM - db182 APT on db182 is CRITICAL: APT CRITICAL: 84 packages available for upgrade (2 critical updates). [13:22:19] PROBLEM - cloud17 APT on cloud17 is CRITICAL: APT CRITICAL: 186 packages available for upgrade (2 critical updates). [13:22:19] PROBLEM - mw153 APT on mw153 is CRITICAL: APT CRITICAL: 131 packages available for upgrade (2 critical updates). [13:22:48] PROBLEM - cloud19 APT on cloud19 is CRITICAL: APT CRITICAL: 2 packages available for upgrade (2 critical updates). [13:23:47] PROBLEM - cloud18 APT on cloud18 is CRITICAL: APT CRITICAL: 186 packages available for upgrade (2 critical updates). [13:25:52] PROBLEM - cp191 APT on cp191 is CRITICAL: APT CRITICAL: 112 packages available for upgrade (2 critical updates). [13:25:56] PROBLEM - bots171 APT on bots171 is CRITICAL: APT CRITICAL: 117 packages available for upgrade (2 critical updates). [13:26:41] PROBLEM - rdb151 APT on rdb151 is CRITICAL: APT CRITICAL: 119 packages available for upgrade (2 critical updates). [13:26:54] PROBLEM - swiftobject171 APT on swiftobject171 is CRITICAL: APT CRITICAL: 75 packages available for upgrade (2 critical updates). [13:27:10] PROBLEM - mw192 APT on mw192 is CRITICAL: APT CRITICAL: 131 packages available for upgrade (2 critical updates). [13:28:00] PROBLEM - mem191 APT on mem191 is CRITICAL: APT CRITICAL: 111 packages available for upgrade (2 critical updates). [13:28:06] PROBLEM - os162 APT on os162 is CRITICAL: APT CRITICAL: 113 packages available for upgrade (2 critical updates). [13:28:38] PROBLEM - mw151 APT on mw151 is CRITICAL: APT CRITICAL: 133 packages available for upgrade (2 critical updates). [13:28:44] PROBLEM - cp161 APT on cp161 is CRITICAL: APT CRITICAL: 121 packages available for upgrade (2 critical updates). [13:28:47] PROBLEM - changeprop201 APT on changeprop201 is CRITICAL: APT CRITICAL: 3 packages available for upgrade (3 critical updates). [13:29:01] PROBLEM - graylog161 APT on graylog161 is CRITICAL: APT CRITICAL: 117 packages available for upgrade (2 critical updates). [13:29:24] PROBLEM - mw163 APT on mw163 is CRITICAL: APT CRITICAL: 131 packages available for upgrade (2 critical updates). [13:29:56] PROBLEM - os202 APT on os202 is CRITICAL: APT CRITICAL: 74 packages available for upgrade (2 critical updates). [13:30:50] PROBLEM - db181 APT on db181 is CRITICAL: APT CRITICAL: 121 packages available for upgrade (2 critical updates). [13:30:58] PROBLEM - ns2 APT on ns2 is CRITICAL: APT CRITICAL: 116 packages available for upgrade (2 critical updates). [13:31:31] PROBLEM - mattermost1 APT on mattermost1 is CRITICAL: APT CRITICAL: 114 packages available for upgrade (2 critical updates). [13:32:45] PROBLEM - reports171 APT on reports171 is CRITICAL: APT CRITICAL: 115 packages available for upgrade (2 critical updates). [13:32:45] PROBLEM - db151 APT on db151 is CRITICAL: APT CRITICAL: 129 packages available for upgrade (2 critical updates). [13:32:58] PROBLEM - mwtask181 APT on mwtask181 is CRITICAL: APT CRITICAL: 135 packages available for upgrade (2 critical updates). [13:33:15] PROBLEM - os161 APT on os161 is CRITICAL: APT CRITICAL: 111 packages available for upgrade (2 critical updates). [13:33:30] PROBLEM - mw181 APT on mw181 is CRITICAL: APT CRITICAL: 131 packages available for upgrade (2 critical updates). [13:33:49] PROBLEM - swiftobject161 APT on swiftobject161 is CRITICAL: APT CRITICAL: 75 packages available for upgrade (2 critical updates). [13:33:55] PROBLEM - swiftobject151 APT on swiftobject151 is CRITICAL: APT CRITICAL: 75 packages available for upgrade (2 critical updates). [13:34:07] PROBLEM - cloud20 APT on cloud20 is CRITICAL: APT CRITICAL: 190 packages available for upgrade (2 critical updates). [13:34:55] PROBLEM - test151 APT on test151 is CRITICAL: APT CRITICAL: 120 packages available for upgrade (3 critical updates). [13:34:55] PROBLEM - ldap171 APT on ldap171 is CRITICAL: APT CRITICAL: 111 packages available for upgrade (2 critical updates). [13:35:15] PROBLEM - bast181 APT on bast181 is CRITICAL: APT CRITICAL: 111 packages available for upgrade (2 critical updates). [13:35:31] PROBLEM - mw201 APT on mw201 is CRITICAL: APT CRITICAL: 131 packages available for upgrade (2 critical updates). [13:35:32] PROBLEM - mon181 APT on mon181 is CRITICAL: APT CRITICAL: 2 packages available for upgrade (2 critical updates). [13:36:22] PROBLEM - mw183 APT on mw183 is CRITICAL: APT CRITICAL: 131 packages available for upgrade (2 critical updates). [13:36:40] PROBLEM - mw182 APT on mw182 is CRITICAL: APT CRITICAL: 131 packages available for upgrade (2 critical updates). [13:36:57] PROBLEM - mw152 APT on mw152 is CRITICAL: APT CRITICAL: 131 packages available for upgrade (2 critical updates). [13:38:03] PROBLEM - prometheus151 APT on prometheus151 is CRITICAL: APT CRITICAL: 119 packages available for upgrade (2 critical updates). [14:55:34] [02ssl] 07WikiTideBot pushed 1 new commit to 03main 13https://github.com/miraheze/ssl/commit/125923cc1c86f1633ba8b6abb829479787155adc [14:55:35] 02ssl/03main 07WikiTideBot 03125923c Bot: Auto-update domain lists [15:19:56] [Grafana] FIRING: The mediawiki JobQueue backlog is increasing by more than 100 jobs a minute over an extended time period https://grafana.wikitide.net/d/GtxbP1Xnk?from=1759328360000&orgId=1&to=1759331996682 [15:39:41] [02puppet] 07paladox pushed 1 new commit to 03main 13https://github.com/miraheze/puppet/commit/e5aea79975cc04de695899a36f65a5156e718dbe [15:39:41] 02puppet/03main 07paladox 03e5aea79 changeprop201: increase LocalGlobalUserPageCacheUpdateJob concurrency to 35 [15:45:30] [02ssl] 07WikiTideBot pushed 1 new commit to 03main 13https://github.com/miraheze/ssl/commit/caac81ef72d95d3a35c03dcaf75a4ff13acf1e21 [15:45:31] 02ssl/03main 07WikiTideBot 03caac81e Bot: Auto-update domain lists [15:48:52] [02puppet] 07MacFan4000 opened pull request #4553: listdomains: pull before reading redirects (07miraheze:03main...07MacFan4000:03patch-67) 13https://github.com/miraheze/puppet/pull/4553 [15:48:59] [02puppet] 07coderabbitai[bot] commented on pull request #4553:
[…] 13https://github.com/miraheze/puppet/pull/4553#issuecomment-3357048598 [15:50:22] miraheze/puppet - MacFan4000 the build passed. [15:50:40] [02puppet] 07RhinosF1 approved pull request #4553 13https://github.com/miraheze/puppet/pull/4553#pullrequestreview-3289909048 [15:51:16] [02puppet] 07paladox merged 07MacFan4000's pull request #4553: listdomains: pull before reading redirects (07miraheze:03main...07MacFan4000:03patch-67) 13https://github.com/miraheze/puppet/pull/4553 [15:51:18] [02puppet] 07paladox pushed 1 new commit to 03main 13https://github.com/miraheze/puppet/commit/b47132419172739351c754451fad2a3017cd375e [15:51:19] 02puppet/03main 07MacFan4000 03b471324 listdomains: pull before reading redirects (#4553) [15:52:50] miraheze/puppet - paladox the build passed. [15:54:56] [Grafana] RESOLVED: MediaWiki Jobs are rapidly increasing https://grafana.wikitide.net/d/GtxbP1Xnk?from=1759330340000&orgId=1&to=1759333940000 [15:59:56] [Grafana] FIRING: The mediawiki job queue has more than 500,000 unclaimed jobs https://grafana.wikitide.net/d/GtxbP1Xnk?from=1759330610000&orgId=1&to=1759334396688[Grafana] RESOLVED: MediaWiki Jobs are rapidly increasing https://grafana.wikitide.net/d/GtxbP1Xnk?from=1759330340000&orgId=1&to=1759333940000 [16:17:54] PROBLEM - puppet181 Check unit status of listdomains_github_push on puppet181 is CRITICAL: CRITICAL: Status of the systemd unit listdomains_github_push [16:26:34] [02puppet] 07paladox created 03paladox-patch-6 (+1 new commit) 13https://github.com/miraheze/puppet/commit/03f87601db88 [16:26:34] 02puppet/03paladox-patch-6 07paladox 0303f8760 listdomains: Fix workdir variable not existing [16:26:39] [02puppet] 07paladox opened pull request #4554: listdomains: Fix workdir variable not existing (03main...03paladox-patch-6) 13https://github.com/miraheze/puppet/pull/4554 [16:26:46] [02puppet] 07coderabbitai[bot] commented on pull request #4554:
[…] 13https://github.com/miraheze/puppet/pull/4554#issuecomment-3357187298 [16:26:48] [02puppet] 07paladox merged pull request #4554: listdomains: Fix workdir variable not existing (03main...03paladox-patch-6) 13https://github.com/miraheze/puppet/pull/4554 [16:26:50] [02puppet] 07paladox pushed 1 new commit to 03main 13https://github.com/miraheze/puppet/commit/75cef7087c98033c1540b2a41f589532fb1e2cef [16:26:52] [02puppet] 07paladox 04deleted 03paladox-patch-6 at 0303f8760 13https://api.github.com/repos/miraheze/puppet/commit/03f8760 [16:26:53] 02puppet/03main 07paladox 0375cef70 listdomains: Fix workdir variable not existing (#4554) [16:28:20] miraheze/puppet - paladox the build passed. [16:28:22] miraheze/puppet - paladox the build passed. [16:35:54] RECOVERY - puppet181 Check unit status of listdomains_github_push on puppet181 is OK: OK: Status of the systemd unit listdomains_github_push [17:02:52] PROBLEM - mwtask181 Current Load on mwtask181 is WARNING: LOAD WARNING - total load average: 23.07, 18.28, 14.31 [17:04:52] RECOVERY - mwtask181 Current Load on mwtask181 is OK: LOAD OK - total load average: 16.96, 17.90, 14.68 [18:09:56] [Grafana] RESOLVED: High Job Queue Backlog https://grafana.wikitide.net/d/GtxbP1Xnk?from=1759330610000&orgId=1&to=1759342010000 [20:48:23] !log [void@puppet181] Upgraded packages on bots171: libssl3 and openssl [20:48:27] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:48:38] !log [void@puppet181] Upgraded packages on db151: libssl3 and openssl [20:48:39] RECOVERY - db151 APT on db151 is OK: APT OK: 127 packages available for upgrade (0 critical updates). [20:48:41] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:48:53] !log [void@puppet181] Upgraded packages on cloud16: libssl3 and openssl [20:48:57] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:48:59] RECOVERY - cloud16 APT on cloud16 is OK: APT OK: 184 packages available for upgrade (0 critical updates). [20:49:08] !log [void@puppet181] Upgraded packages on cloud15: libssl3 and openssl [20:49:12] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:49:22] !log [void@puppet181] Upgraded packages on db172: libssl3 and openssl [20:49:26] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:49:29] RECOVERY - bots171 APT on bots171 is OK: APT OK: 115 packages available for upgrade (0 critical updates). [20:49:37] !log [void@puppet181] Upgraded packages on cloud20: libssl3 and openssl [20:49:40] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:49:41] RECOVERY - db172 APT on db172 is OK: APT OK: 92 packages available for upgrade (0 critical updates). [20:49:52] !log [void@puppet181] Upgraded packages on db161: libssl3 and openssl [20:49:56] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:50:05] RECOVERY - cloud20 APT on cloud20 is OK: APT OK: 188 packages available for upgrade (0 critical updates). [20:50:05] RECOVERY - cloud15 APT on cloud15 is OK: APT OK: 187 packages available for upgrade (0 critical updates). [20:50:05] !log [void@puppet181] Upgraded packages on cloud19: libssl3 and openssl [20:50:09] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:50:20] !log [void@puppet181] Upgraded packages on graylog161: libssl3 and openssl [20:50:24] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:50:28] RECOVERY - cloud19 APT on cloud19 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [20:50:36] !log [void@puppet181] Upgraded packages on db171: libssl3 and openssl [20:50:37] RECOVERY - db161 APT on db161 is OK: APT OK: 127 packages available for upgrade (0 critical updates). [20:50:40] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:50:44] RECOVERY - db171 APT on db171 is OK: APT OK: 119 packages available for upgrade (0 critical updates). [20:50:50] !log [void@puppet181] Upgraded packages on cp161: libssl3 and openssl [20:50:54] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:51:04] !log [void@puppet181] Upgraded packages on cp191: libssl3 and openssl [20:51:08] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:51:18] !log [void@puppet181] Upgraded packages on changeprop201: libssl-dev, libssl3, and openssl [20:51:23] RECOVERY - graylog161 APT on graylog161 is OK: APT OK: 115 packages available for upgrade (0 critical updates). [20:51:29] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:51:33] !log [void@puppet181] Upgraded packages on eventgate181: libssl-dev, libssl3, and openssl [20:51:38] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:51:48] !log [void@puppet181] Upgraded packages on cp201: libssl3 and openssl [20:51:52] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:52:03] !log [void@puppet181] Upgraded packages on cloud17: libssl3 and openssl [20:52:08] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:52:10] RECOVERY - eventgate181 APT on eventgate181 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [20:52:17] !log [void@puppet181] Upgraded packages on kafka181: libssl3 and openssl [20:52:21] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:52:27] RECOVERY - cp201 APT on cp201 is OK: APT OK: 80 packages available for upgrade (0 critical updates). [20:52:33] !log [void@puppet181] Upgraded packages on cp171: libssl3 and openssl [20:52:35] RECOVERY - changeprop201 APT on changeprop201 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [20:52:37] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:52:50] !log [void@puppet181] Upgraded packages on db181: libssl3 and openssl [20:52:50] RECOVERY - cp161 APT on cp161 is OK: APT OK: 119 packages available for upgrade (0 critical updates). [20:52:54] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:52:54] RECOVERY - cp191 APT on cp191 is OK: APT OK: 110 packages available for upgrade (0 critical updates). [20:53:05] !log [void@puppet181] Upgraded packages on db182: libssl3 and openssl [20:53:10] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:53:22] !log [void@puppet181] Upgraded packages on cloud18: libssl3 and openssl [20:53:23] RECOVERY - cloud17 APT on cloud17 is OK: APT OK: 184 packages available for upgrade (0 critical updates). [20:53:27] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:53:37] RECOVERY - kafka181 APT on kafka181 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [20:53:41] !log [void@puppet181] Upgraded packages on bast161: libssl3 and openssl [20:53:44] RECOVERY - db181 APT on db181 is OK: APT OK: 119 packages available for upgrade (0 critical updates). [20:53:45] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:53:56] !log [void@puppet181] Upgraded packages on llm191: libssl3 and openssl [20:53:59] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:54:05] RECOVERY - cloud18 APT on cloud18 is OK: APT OK: 184 packages available for upgrade (0 critical updates). [20:54:11] RECOVERY - llm191 APT on llm191 is OK: APT OK: 46 packages available for upgrade (0 critical updates). [20:54:13] !log [void@puppet181] Upgraded packages on ldap171: libssl3 and openssl [20:54:16] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:54:17] RECOVERY - cp171 APT on cp171 is OK: APT OK: 110 packages available for upgrade (0 critical updates). [20:54:24] RECOVERY - ldap171 APT on ldap171 is OK: APT OK: 109 packages available for upgrade (0 critical updates). [20:54:29] !log [void@puppet181] Upgraded packages on bast181: libssl3 and openssl [20:54:29] RECOVERY - db182 APT on db182 is OK: APT OK: 82 packages available for upgrade (0 critical updates). [20:54:33] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:54:42] !log [void@puppet181] Upgraded packages on matomo151: libssl3 and openssl [20:54:46] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:54:55] !log [void@puppet181] Upgraded packages on mattermost1: libssl3 and openssl [20:54:58] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:55:09] !log [void@puppet181] Upgraded packages on mem151: libssl3 and openssl [20:55:11] RECOVERY - mattermost1 APT on mattermost1 is OK: APT OK: 112 packages available for upgrade (0 critical updates). [20:55:13] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:55:15] RECOVERY - bast181 APT on bast181 is OK: APT OK: 109 packages available for upgrade (0 critical updates). [20:55:23] !log [void@puppet181] Upgraded packages on mem201: libssl3 and openssl [20:55:27] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:55:35] RECOVERY - bast161 APT on bast161 is OK: APT OK: 109 packages available for upgrade (0 critical updates). [20:55:38] !log [void@puppet181] Upgraded packages on mem161: libssl3 and openssl [20:55:42] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:55:54] !log [void@puppet181] Upgraded packages on mem191: libssl3 and openssl [20:55:58] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:55:59] RECOVERY - mem201 APT on mem201 is OK: APT OK: 117 packages available for upgrade (0 critical updates). [20:56:10] PROBLEM - cp201 Disk Space on cp201 is CRITICAL: DISK CRITICAL - free space: / 27189MiB (5% inode=99%); [20:56:10] !log [void@puppet181] Upgraded packages on mw152: libssl3 and openssl [20:56:21] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:56:28] !log [void@puppet181] Upgraded packages on mw151: libssl3 and openssl [20:56:28] RECOVERY - mem191 APT on mem191 is OK: APT OK: 109 packages available for upgrade (0 critical updates). [20:56:32] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:56:33] RECOVERY - mem151 APT on mem151 is OK: APT OK: 117 packages available for upgrade (0 critical updates). [20:56:38] RECOVERY - matomo151 APT on matomo151 is OK: APT OK: 72 packages available for upgrade (0 critical updates). [20:56:41] RECOVERY - mem161 APT on mem161 is OK: APT OK: 117 packages available for upgrade (0 critical updates). [20:56:42] !log [void@puppet181] Upgraded packages on mon181: libssl3 and openssl [20:56:46] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:57:00] !log [void@puppet181] Upgraded packages on mw171: libssl3 and openssl [20:57:04] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:57:06] RECOVERY - mw171 APT on mw171 is OK: APT OK: 129 packages available for upgrade (0 critical updates). [20:57:16] RECOVERY - mw151 APT on mw151 is OK: APT OK: 131 packages available for upgrade (0 critical updates). [20:57:17] !log [void@puppet181] Upgraded packages on mw162: libssl3 and openssl [20:57:21] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:57:31] RECOVERY - mon181 APT on mon181 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [20:57:33] !log [void@puppet181] Upgraded packages on mw153: libssl3 and openssl [20:57:37] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:57:51] !log [void@puppet181] Upgraded packages on mw161: libssl3 and openssl [20:57:51] RECOVERY - mw162 APT on mw162 is OK: APT OK: 129 packages available for upgrade (0 critical updates). [20:57:55] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:58:08] !log [void@puppet181] Upgraded packages on mw172: libssl3 and openssl [20:58:09] RECOVERY - mw152 APT on mw152 is OK: APT OK: 129 packages available for upgrade (0 critical updates). [20:58:12] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:58:24] !log [void@puppet181] Upgraded packages on mw192: libssl3 and openssl [20:58:29] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:58:38] RECOVERY - mw153 APT on mw153 is OK: APT OK: 129 packages available for upgrade (0 critical updates). [20:58:42] !log [void@puppet181] Upgraded packages on mw173: libssl3 and openssl [20:58:47] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:58:51] RECOVERY - mw161 APT on mw161 is OK: APT OK: 129 packages available for upgrade (0 critical updates). [20:59:00] !log [void@puppet181] Upgraded packages on mw163: libssl3 and openssl [20:59:04] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:59:10] RECOVERY - mw192 APT on mw192 is OK: APT OK: 129 packages available for upgrade (0 critical updates). [20:59:16] !log [void@puppet181] Upgraded packages on mw191: libssl3 and openssl [20:59:20] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:59:22] RECOVERY - mw163 APT on mw163 is OK: APT OK: 129 packages available for upgrade (0 critical updates). [20:59:34] !log [void@puppet181] Upgraded packages on mw201: libssl3 and openssl [20:59:38] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:59:50] RECOVERY - mw172 APT on mw172 is OK: APT OK: 129 packages available for upgrade (0 critical updates). [20:59:52] !log [void@puppet181] Upgraded packages on mw193: libssl3 and openssl [20:59:55] RECOVERY - mw173 APT on mw173 is OK: APT OK: 129 packages available for upgrade (0 critical updates). [20:59:55] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:00:09] !log [void@puppet181] Upgraded packages on mw183: libssl3 and openssl [21:00:13] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:00:27] !log [void@puppet181] Upgraded packages on mw202: libssl3 and openssl [21:00:30] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:00:32] RECOVERY - mw183 APT on mw183 is OK: APT OK: 129 packages available for upgrade (0 critical updates). [21:00:45] !log [void@puppet181] Upgraded packages on mw181: libssl3 and openssl [21:00:46] RECOVERY - mw191 APT on mw191 is OK: APT OK: 129 packages available for upgrade (0 critical updates). [21:00:49] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:01:03] !log [void@puppet181] Upgraded packages on mw203: libssl3 and openssl [21:01:05] RECOVERY - mw203 APT on mw203 is OK: APT OK: 129 packages available for upgrade (0 critical updates). [21:01:08] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:01:22] !log [void@puppet181] Upgraded packages on mw182: libssl3 and openssl [21:01:25] RECOVERY - mw182 APT on mw182 is OK: APT OK: 129 packages available for upgrade (0 critical updates). [21:01:26] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:01:28] RECOVERY - mw201 APT on mw201 is OK: APT OK: 129 packages available for upgrade (0 critical updates). [21:01:39] !log [void@puppet181] Upgraded packages on mwtask151: libssl3 and openssl [21:01:40] RECOVERY - mw193 APT on mw193 is OK: APT OK: 129 packages available for upgrade (0 critical updates). [21:01:44] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:01:44] RECOVERY - mw202 APT on mw202 is OK: APT OK: 129 packages available for upgrade (0 critical updates). [21:01:53] RECOVERY - mw181 APT on mw181 is OK: APT OK: 129 packages available for upgrade (0 critical updates). [21:01:57] !log [void@puppet181] Upgraded packages on mwtask161: libssl3 and openssl [21:02:01] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:02:11] !log [void@puppet181] Upgraded packages on os161: libssl3 and openssl [21:02:15] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:02:27] !log [void@puppet181] Upgraded packages on os151: libssl3 and openssl [21:02:31] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:02:41] !log [void@puppet181] Upgraded packages on prometheus151: libssl3 and openssl [21:02:45] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:02:55] !log [void@puppet181] Upgraded packages on phorge171: libssl3 and openssl [21:02:57] RECOVERY - phorge171 APT on phorge171 is OK: APT OK: 74 packages available for upgrade (0 critical updates). [21:02:58] RECOVERY - os161 APT on os161 is OK: APT OK: 109 packages available for upgrade (0 critical updates). [21:02:59] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:03:13] RECOVERY - os151 APT on os151 is OK: APT OK: 111 packages available for upgrade (0 critical updates). [21:03:13] !log [void@puppet181] Upgraded packages on mwtask171: libssl3 and openssl [21:03:17] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:03:23] RECOVERY - mwtask171 APT on mwtask171 is OK: APT OK: 133 packages available for upgrade (0 critical updates). [21:03:29] !log [void@puppet181] Upgraded packages on os162: libssl3 and openssl [21:03:30] RECOVERY - mwtask151 APT on mwtask151 is OK: APT OK: 133 packages available for upgrade (0 critical updates). [21:03:33] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:03:43] !log [void@puppet181] Upgraded packages on rdb151: libssl3 and openssl [21:03:48] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:03:57] RECOVERY - mwtask161 APT on mwtask161 is OK: APT OK: 133 packages available for upgrade (0 critical updates). [21:03:59] !log [void@puppet181] Upgraded packages on os191: libssl3 and openssl [21:04:02] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:04:03] RECOVERY - prometheus151 APT on prometheus151 is OK: APT OK: 117 packages available for upgrade (0 critical updates). [21:04:05] RECOVERY - os162 APT on os162 is OK: APT OK: 111 packages available for upgrade (0 critical updates). [21:04:17] !log [void@puppet181] Upgraded packages on mwtask181: libssl3 and openssl [21:04:21] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:04:32] !log [void@puppet181] Upgraded packages on reports171: libssl3 and openssl [21:04:35] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:04:52] !log [void@puppet181] Upgraded packages on os202: libssl3 and openssl [21:04:56] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:05:08] !log [void@puppet181] Upgraded packages on puppet181: libssl3 and openssl [21:05:12] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:05:24] !log [void@puppet181] Upgraded packages on os201: libssl3 and openssl [21:05:28] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:05:29] RECOVERY - rdb151 APT on rdb151 is OK: APT OK: 117 packages available for upgrade (0 critical updates). [21:05:32] RECOVERY - os191 APT on os191 is OK: APT OK: 109 packages available for upgrade (0 critical updates). [21:05:34] RECOVERY - mwtask181 APT on mwtask181 is OK: APT OK: 133 packages available for upgrade (0 critical updates). [21:05:40] !log [void@puppet181] Upgraded packages on ns1: libssl3 and openssl [21:05:41] RECOVERY - puppet181 APT on puppet181 is OK: APT OK: 76 packages available for upgrade (0 critical updates). [21:05:44] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:05:48] RECOVERY - os202 APT on os202 is OK: APT OK: 72 packages available for upgrade (0 critical updates). [21:05:55] !log [void@puppet181] Upgraded packages on swiftobject151: libssl3 and openssl [21:05:59] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:06:06] RECOVERY - reports171 APT on reports171 is OK: APT OK: 113 packages available for upgrade (0 critical updates). [21:06:13] !log [void@puppet181] Upgraded packages on swiftac171: libssl3 and openssl [21:06:16] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:06:22] RECOVERY - os201 APT on os201 is OK: APT OK: 81 packages available for upgrade (0 critical updates). [21:06:29] !log [void@puppet181] Upgraded packages on swiftobject171: libssl3 and openssl [21:06:33] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:06:45] !log [void@puppet181] Upgraded packages on swiftobject181: libssl3 and openssl [21:06:46] RECOVERY - swiftobject171 APT on swiftobject171 is OK: APT OK: 73 packages available for upgrade (0 critical updates). [21:06:46] RECOVERY - swiftac171 APT on swiftac171 is OK: APT OK: 124 packages available for upgrade (0 critical updates). [21:06:50] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:07:03] !log [void@puppet181] Upgraded packages on swiftobject161: libssl3 and openssl [21:07:06] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:07:09] RECOVERY - swiftobject151 APT on swiftobject151 is OK: APT OK: 73 packages available for upgrade (0 critical updates). [21:07:15] RECOVERY - ns1 APT on ns1 is OK: APT OK: 115 packages available for upgrade (0 critical updates). [21:07:19] !log [void@puppet181] Upgraded packages on swiftobject191: libssl3 and openssl [21:07:23] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:07:37] RECOVERY - swiftobject161 APT on swiftobject161 is OK: APT OK: 73 packages available for upgrade (0 critical updates). [21:07:37] RECOVERY - swiftobject181 APT on swiftobject181 is OK: APT OK: 73 packages available for upgrade (0 critical updates). [21:07:37] !log [void@puppet181] Upgraded packages on swiftproxy161: libssl3 and openssl [21:07:40] RECOVERY - swiftobject191 APT on swiftobject191 is OK: APT OK: 73 packages available for upgrade (0 critical updates). [21:07:41] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:07:55] !log [void@puppet181] Upgraded packages on swiftobject201: libssl3 and openssl [21:07:57] RECOVERY - swiftobject201 APT on swiftobject201 is OK: APT OK: 73 packages available for upgrade (0 critical updates). [21:07:59] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:08:12] !log [void@puppet181] Upgraded packages on test151: libssl-dev, libssl3, and openssl [21:08:16] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:08:21] RECOVERY - swiftproxy161 APT on swiftproxy161 is OK: APT OK: 126 packages available for upgrade (0 critical updates). [21:08:30] !log [void@puppet181] Upgraded packages on swiftproxy171: libssl3 and openssl [21:08:34] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:08:54] !log [void@puppet181] Upgraded packages on ns2: libssl3 and openssl [21:08:58] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:09:13] RECOVERY - test151 APT on test151 is OK: APT OK: 117 packages available for upgrade (0 critical updates). [21:09:15] RECOVERY - swiftproxy171 APT on swiftproxy171 is OK: APT OK: 126 packages available for upgrade (0 critical updates). [21:10:23] RECOVERY - ns2 APT on ns2 is OK: APT OK: 114 packages available for upgrade (0 critical updates). [22:02:09] PROBLEM - cp171 Disk Space on cp171 is CRITICAL: DISK CRITICAL - free space: / 27218MiB (5% inode=99%); [22:10:50] PROBLEM - cp191 Disk Space on cp191 is CRITICAL: DISK CRITICAL - free space: / 27218MiB (5% inode=99%);