[00:01:07] [02statichelp] 07WikiTideBot pushed 1 new commit to 03main 13https://github.com/miraheze/statichelp/commit/f7afdd2bcfeb03096455113fb8d4872256b894fd [00:01:07] 02statichelp/03main 07WikiTideBot 03f7afdd2 Bot: Auto-update Tech namespace pages 2026-04-28 00:01:04 [01:10:52] [02ssl] 07WikiTideBot pushed 1 new commit to 03main 13https://github.com/miraheze/ssl/commit/17bd923b6a01b1d80a8a8a2b60981b2ecb7776c1 [01:10:52] 02ssl/03main 07WikiTideBot 0317bd923 Bot: Auto-update domain lists [01:11:07] !log [somerandomdeveloper@puppet181] sudo systemctl restart listdomains_github_push [01:11:10] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:30:18] [02ssl] 07WikiTideBot pushed 1 new commit to 03main 13https://github.com/miraheze/ssl/commit/3022ce8bf13a3075011ef834469f7f8101762a24 [01:30:18] 02ssl/03main 07WikiTideBot 033022ce8 Bot: Auto-update domain lists [06:39:35] you’re welcome :) [07:20:05] [02mw-config] 07lihaohong6 merged 07Conscience93's pull request #6386: T15281: Add custom language code for anduranwiki (07miraheze:03main...07Conscience93:03language-code-anduranwiki) 13https://github.com/miraheze/mw-config/pull/6386 [07:20:05] [02mw-config] 07lihaohong6 pushed 1 new commit to 03main 13https://github.com/miraheze/mw-config/commit/c9ccdfd30dd9ccfb0f3d12b4bd425808b62f4df8 [07:20:07] 02mw-config/03main 07Conscience93 03c9ccdfd T15281: Add custom language code for anduranwiki (#6386)… [07:20:26] !log [petramagna@test151] starting deploy of {'pull': 'config', 'config': True} to test151 [07:20:27] !log [petramagna@test151] finished deploy of {'pull': 'config', 'config': True} to test151 - SUCCESS in 1s [07:20:28] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:20:31] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:20:58] !log [petramagna@mwtask181] starting deploy of {'pull': 'config', 'config': True} to all [07:21:01] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:21:23] miraheze/mw-config - lihaohong6 the build passed. [07:21:24] !log [petramagna@mwtask181] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 25s [07:21:27] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [09:10:10] [02mediawiki-repos] 07Aeywoo closed pull request #108: install RefreshSpecial per T12835 (again) (07miraheze:03main...07Aeywoo:03Aeywoo-patch-1) 13https://github.com/miraheze/mediawiki-repos/pull/108 [09:19:53] [02mw-config] 07lihaohong6 commented on pull request #6385: There's an extra `+` in `+wgAdvancedSearchNamespacePresets`. It should be removed in a follow-up commit. 13https://github.com/miraheze/mw-config/pull/6385#issuecomment-4333933245 [11:55:05] PROBLEM - cp171 Varnish Backends on cp171 is CRITICAL: 2 backends are down. mw193 mw201 [11:55:23] PROBLEM - cp201 HTTPS on cp201 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10006 milliseconds with 0 bytes received [11:56:15] PROBLEM - cp201 Varnish Backends on cp201 is CRITICAL: 2 backends are down. mw173 mw201 [11:57:19] RECOVERY - cp201 HTTPS on cp201 is OK: HTTP OK: HTTP/2 410 - Status line output matched "HTTP/2 410" - 1463 bytes in 0.064 second response time [11:58:15] RECOVERY - cp201 Varnish Backends on cp201 is OK: All 31 backends are healthy [11:59:05] RECOVERY - cp171 Varnish Backends on cp171 is OK: All 31 backends are healthy [13:49:25] PROBLEM - db171 Current Load on db171 is CRITICAL: LOAD CRITICAL - total load average: 14.62, 12.74, 5.82 [13:51:25] RECOVERY - db171 Current Load on db171 is OK: LOAD OK - total load average: 3.80, 9.71, 5.58 [14:34:48] [02puppet] 07MacFan4000 commented on pull request #4838: Branching has now been completed. 13https://github.com/miraheze/puppet/pull/4838#issuecomment-4336062407 [14:48:04] [02TSPortal] 07renovate[bot] 04force-pushed 03renovate/prod-deps from 0315a4a98 to 03282717f 13https://api.github.com/repos/miraheze/TSPortal/commits/renovate/prod-deps [14:48:06] 02TSPortal/03renovate/prod-deps 07renovate[bot] 03282717f Update prod dependencies [17:09:20] PROBLEM - db151 Current Load on db151 is CRITICAL: LOAD CRITICAL - total load average: 10.97, 14.02, 7.04 [17:11:20] RECOVERY - db151 Current Load on db151 is OK: LOAD OK - total load average: 1.86, 9.61, 6.28 [18:04:50] !log [somerandomdeveloper@test151] enabled puppet [18:04:53] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:05:22] RECOVERY - test151 Puppet on test151 is OK: OK: Puppet is currently enabled, last run 33 seconds ago with 0 failures [18:06:16] !log [somerandomdeveloper@test151] starting deploy of {'versions': '1.45', 'upgrade_extensions': 'Cargo'} to test151 [18:06:17] !log [somerandomdeveloper@test151] finished deploy of {'versions': '1.45', 'upgrade_extensions': 'Cargo'} to test151 - SUCCESS in 1s [18:06:19] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:06:22] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:06:28] !log [somerandomdeveloper@mwtask181] starting deploy of {'versions': '1.45', 'upgrade_extensions': 'Cargo'} to all [18:06:31] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:06:59] !log [somerandomdeveloper@mwtask181] finished deploy of {'versions': '1.45', 'upgrade_extensions': 'Cargo'} to all - SUCCESS in 31s [18:07:02] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:19:22] !log [void@puppet181] Upgraded packages on puppet181: openjdk-21-jdk, openjdk-21-jdk-headless, openjdk-21-jre, and openjdk-21-jre-headless [18:19:25] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:20:12] RECOVERY - puppet181 APT on puppet181 is OK: APT OK: 67 packages available for upgrade (0 critical updates). [18:22:23] PROBLEM - db201 Puppet on db201 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [18:22:32] !log [void@puppet181] Upgraded packages on os161: openjdk-21-jdk, openjdk-21-jdk-headless, openjdk-21-jre, and openjdk-21-jre-headless [18:22:35] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:22:51] RECOVERY - os161 APT on os161 is OK: APT OK: 61 packages available for upgrade (0 critical updates). [18:22:51] !log [void@puppet181] Upgraded packages on os201: openjdk-21-jdk, openjdk-21-jdk-headless, openjdk-21-jre, and openjdk-21-jre-headless [18:22:54] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:23:09] !log [void@puppet181] Upgraded packages on os162: openjdk-21-jdk, openjdk-21-jdk-headless, openjdk-21-jre, and openjdk-21-jre-headless [18:23:12] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:23:31] !log [void@puppet181] Upgraded packages on os191: openjdk-21-jdk, openjdk-21-jdk-headless, openjdk-21-jre, and openjdk-21-jre-headless [18:23:34] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:23:42] PROBLEM - db182 Puppet on db182 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [18:23:45] RECOVERY - os201 APT on os201 is OK: APT OK: 61 packages available for upgrade (0 critical updates). [18:23:52] !log [void@puppet181] Upgraded packages on os151: openjdk-21-jdk, openjdk-21-jdk-headless, openjdk-21-jre, and openjdk-21-jre-headless [18:23:53] PROBLEM - mw171 Puppet on mw171 is CRITICAL: CRITICAL: Puppet has 20 failures. Last run 4 minutes ago with 20 failures. Failed resources (up to 3 shown): File[/srv/mediawiki/sitemap.php],File[/srv/mediawiki/config/OAuth2.key],File[/srv/mediawiki/stopforumspam/listed_ip_90_ipv46_all.txt],File[/var/www] [18:23:55] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:24:11] !log [void@puppet181] Upgraded packages on os202: openjdk-21-jdk, openjdk-21-jdk-headless, openjdk-21-jre, and openjdk-21-jre-headless [18:24:14] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:24:30] RECOVERY - os162 APT on os162 is OK: APT OK: 61 packages available for upgrade (0 critical updates). [18:24:45] RECOVERY - os191 APT on os191 is OK: APT OK: 61 packages available for upgrade (0 critical updates). [18:25:28] RECOVERY - os151 APT on os151 is OK: APT OK: 61 packages available for upgrade (0 critical updates). [18:25:52] RECOVERY - os202 APT on os202 is OK: APT OK: 63 packages available for upgrade (0 critical updates). [18:27:42] RECOVERY - db182 Puppet on db182 is OK: OK: Puppet is currently enabled, last run 6 seconds ago with 0 failures [18:27:54] RECOVERY - mw171 Puppet on mw171 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [18:28:23] RECOVERY - db201 Puppet on db201 is OK: OK: Puppet is currently enabled, last run 40 seconds ago with 0 failures [18:29:49] !log [void@puppet181] Upgraded packages on kafka182: openjdk-21-jre and openjdk-21-jre-headless [18:29:52] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:30:04] RECOVERY - kafka182 APT on kafka182 is OK: APT OK: 64 packages available for upgrade (0 critical updates). [18:30:42] !log [void@puppet181] Upgraded packages on graylog161: openjdk-21-jdk, openjdk-21-jdk-headless, openjdk-21-jre, and openjdk-21-jre-headless [18:30:45] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:31:34] RECOVERY - graylog161 APT on graylog161 is OK: APT OK: 65 packages available for upgrade (0 critical updates). [18:37:26] RECOVERY - db182 Check unit status of sql-weekly-reports-backup on db182 is OK: OK: Status of the systemd unit sql-weekly-reports-backup [18:59:47] PROBLEM - mw163 APT on mw163 is CRITICAL: APT CRITICAL: 68 packages available for upgrade (1 critical updates). [18:59:54] PROBLEM - os202 APT on os202 is CRITICAL: APT CRITICAL: 64 packages available for upgrade (1 critical updates). [19:00:55] PROBLEM - db181 APT on db181 is CRITICAL: APT CRITICAL: 72 packages available for upgrade (1 critical updates). [19:01:54] PROBLEM - cloud18 APT on cloud18 is CRITICAL: APT CRITICAL: 102 packages available for upgrade (1 critical updates). [19:02:45] PROBLEM - swiftobject151 APT on swiftobject151 is CRITICAL: APT CRITICAL: 65 packages available for upgrade (1 critical updates). [19:02:51] PROBLEM - os161 APT on os161 is CRITICAL: APT CRITICAL: 62 packages available for upgrade (1 critical updates). [19:02:55] PROBLEM - mw181 APT on mw181 is CRITICAL: APT CRITICAL: 68 packages available for upgrade (1 critical updates). [19:03:00] PROBLEM - os191 APT on os191 is CRITICAL: APT CRITICAL: 62 packages available for upgrade (1 critical updates). [19:03:15] PROBLEM - eventgate182 APT on eventgate182 is CRITICAL: APT CRITICAL: 62 packages available for upgrade (1 critical updates). [19:03:20] PROBLEM - mwtask181 APT on mwtask181 is CRITICAL: APT CRITICAL: 72 packages available for upgrade (1 critical updates). [19:03:41] PROBLEM - reports171 APT on reports171 is CRITICAL: APT CRITICAL: 64 packages available for upgrade (1 critical updates). [19:03:48] PROBLEM - db151 APT on db151 is CRITICAL: APT CRITICAL: 72 packages available for upgrade (1 critical updates). [19:03:58] PROBLEM - swiftobject161 APT on swiftobject161 is CRITICAL: APT CRITICAL: 65 packages available for upgrade (1 critical updates). [19:04:10] PROBLEM - cloud20 APT on cloud20 is CRITICAL: APT CRITICAL: 102 packages available for upgrade (1 critical updates). [19:04:20] PROBLEM - db192 APT on db192 is CRITICAL: APT CRITICAL: 85 packages available for upgrade (1 critical updates). [19:04:24] PROBLEM - test151 APT on test151 is CRITICAL: APT CRITICAL: 73 packages available for upgrade (1 critical updates). [19:04:37] PROBLEM - mw201 APT on mw201 is CRITICAL: APT CRITICAL: 68 packages available for upgrade (1 critical updates). [19:04:43] PROBLEM - bast181 APT on bast181 is CRITICAL: APT CRITICAL: 75 packages available for upgrade (1 critical updates). [19:04:48] Void only just did updates [19:04:51] Damn stupid servers [19:05:28] PROBLEM - cloud16 APT on cloud16 is CRITICAL: APT CRITICAL: 102 packages available for upgrade (1 critical updates). [19:05:34] PROBLEM - mw182 APT on mw182 is CRITICAL: APT CRITICAL: 68 packages available for upgrade (1 critical updates). [19:05:37] PROBLEM - mon181 APT on mon181 is CRITICAL: APT CRITICAL: 75 packages available for upgrade (1 critical updates). [19:06:12] PROBLEM - prometheus151 APT on prometheus151 is CRITICAL: APT CRITICAL: 66 packages available for upgrade (1 critical updates). [19:06:20] PROBLEM - mw183 APT on mw183 is CRITICAL: APT CRITICAL: 68 packages available for upgrade (1 critical updates). [19:06:29] PROBLEM - ldap171 APT on ldap171 is CRITICAL: APT CRITICAL: 62 packages available for upgrade (1 critical updates). [19:06:33] PROBLEM - mw152 APT on mw152 is CRITICAL: APT CRITICAL: 68 packages available for upgrade (1 critical updates). [19:06:37] PROBLEM - swiftobject211 APT on swiftobject211 is CRITICAL: APT CRITICAL: 63 packages available for upgrade (1 critical updates). [19:07:27] PROBLEM - cloud17 APT on cloud17 is CRITICAL: APT CRITICAL: 102 packages available for upgrade (1 critical updates). [19:08:54] PROBLEM - cp201 APT on cp201 is CRITICAL: APT CRITICAL: 63 packages available for upgrade (1 critical updates). [19:09:07] PROBLEM - swiftproxy161 APT on swiftproxy161 is CRITICAL: APT CRITICAL: 63 packages available for upgrade (1 critical updates). [19:09:15] PROBLEM - matomo151 APT on matomo151 is CRITICAL: APT CRITICAL: 62 packages available for upgrade (1 critical updates). [19:09:17] PROBLEM - mattermost2 APT on mattermost2 is CRITICAL: APT CRITICAL: 63 packages available for upgrade (1 critical updates). [19:09:26] PROBLEM - mw162 APT on mw162 is CRITICAL: APT CRITICAL: 68 packages available for upgrade (1 critical updates). [19:09:28] PROBLEM - mem201 APT on mem201 is CRITICAL: APT CRITICAL: 62 packages available for upgrade (1 critical updates). [19:10:01] PROBLEM - mw202 APT on mw202 is CRITICAL: APT CRITICAL: 68 packages available for upgrade (1 critical updates). [19:10:39] PROBLEM - mw161 APT on mw161 is CRITICAL: APT CRITICAL: 68 packages available for upgrade (1 critical updates). [19:10:42] PROBLEM - changeprop202 APT on changeprop202 is CRITICAL: APT CRITICAL: 62 packages available for upgrade (1 critical updates). [19:10:48] PROBLEM - mw172 APT on mw172 is CRITICAL: APT CRITICAL: 68 packages available for upgrade (1 critical updates). [19:11:14] PROBLEM - bast161 APT on bast161 is CRITICAL: APT CRITICAL: 74 packages available for upgrade (1 critical updates). [19:11:26] PROBLEM - rdb191 APT on rdb191 is CRITICAL: APT CRITICAL: 62 packages available for upgrade (1 critical updates). [19:11:50] PROBLEM - swiftproxy171 APT on swiftproxy171 is CRITICAL: APT CRITICAL: 63 packages available for upgrade (1 critical updates). [19:12:12] I just did updates D: [19:12:12] PROBLEM - db172 APT on db172 is CRITICAL: APT CRITICAL: 72 packages available for upgrade (1 critical updates). [19:12:17] PROBLEM - mwtask171 APT on mwtask171 is CRITICAL: APT CRITICAL: 72 packages available for upgrade (1 critical updates). [19:12:36] PROBLEM - cp171 APT on cp171 is CRITICAL: APT CRITICAL: 63 packages available for upgrade (1 critical updates). [19:13:10] PROBLEM - mw203 APT on mw203 is CRITICAL: APT CRITICAL: 68 packages available for upgrade (1 critical updates). [19:13:23] PROBLEM - puppet181 APT on puppet181 is CRITICAL: APT CRITICAL: 68 packages available for upgrade (1 critical updates). [19:13:29] PROBLEM - mwtask161 APT on mwtask161 is CRITICAL: APT CRITICAL: 72 packages available for upgrade (1 critical updates). [19:13:33] PROBLEM - mem161 APT on mem161 is CRITICAL: APT CRITICAL: 62 packages available for upgrade (1 critical updates). [19:13:40] PROBLEM - llm191 APT on llm191 is CRITICAL: APT CRITICAL: 65 packages available for upgrade (1 critical updates). [19:13:42] PROBLEM - swiftobject191 APT on swiftobject191 is CRITICAL: APT CRITICAL: 66 packages available for upgrade (1 critical updates). [19:13:48] PROBLEM - swiftobject201 APT on swiftobject201 is CRITICAL: APT CRITICAL: 66 packages available for upgrade (1 critical updates). [19:14:04] [02TSPortal] 07renovate[bot] 04force-pushed 03renovate/prod-deps from 03282717f to 037781040 13https://api.github.com/repos/miraheze/TSPortal/commits/renovate/prod-deps [19:14:04] 02TSPortal/03renovate/prod-deps 07renovate[bot] 037781040 Update prod dependencies [19:14:28] PROBLEM - swiftac171 APT on swiftac171 is CRITICAL: APT CRITICAL: 63 packages available for upgrade (1 critical updates). [19:14:38] PROBLEM - swiftobject181 APT on swiftobject181 is CRITICAL: APT CRITICAL: 66 packages available for upgrade (1 critical updates). [19:14:49] PROBLEM - mw173 APT on mw173 is CRITICAL: APT CRITICAL: 68 packages available for upgrade (1 critical updates). [19:14:53] PROBLEM - mwtask151 APT on mwtask151 is CRITICAL: APT CRITICAL: 72 packages available for upgrade (1 critical updates). [19:16:26] PROBLEM - phorge171 APT on phorge171 is CRITICAL: APT CRITICAL: 64 packages available for upgrade (1 critical updates). [19:16:48] PROBLEM - db161 APT on db161 is CRITICAL: APT CRITICAL: 72 packages available for upgrade (1 critical updates). [19:17:29] PROBLEM - os151 APT on os151 is CRITICAL: APT CRITICAL: 62 packages available for upgrade (1 critical updates). [19:17:42] PROBLEM - os201 APT on os201 is CRITICAL: APT CRITICAL: 62 packages available for upgrade (1 critical updates). [19:17:56] PROBLEM - mem151 APT on mem151 is CRITICAL: APT CRITICAL: 62 packages available for upgrade (1 critical updates). [19:18:55] PROBLEM - cloud15 APT on cloud15 is CRITICAL: APT CRITICAL: 102 packages available for upgrade (1 critical updates). [19:19:45] PROBLEM - cloud21 APT on cloud21 is CRITICAL: APT CRITICAL: 99 packages available for upgrade (1 critical updates). [19:20:04] PROBLEM - mw193 APT on mw193 is CRITICAL: APT CRITICAL: 68 packages available for upgrade (1 critical updates). [19:20:38] !log [somerandomdeveloper@db182] sudo systemctl restart sql-weekly-reports-backup [19:20:41] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:21:13] PROBLEM - db171 APT on db171 is CRITICAL: APT CRITICAL: 72 packages available for upgrade (1 critical updates). [19:21:46] PROBLEM - mw171 APT on mw171 is CRITICAL: APT CRITICAL: 68 packages available for upgrade (1 critical updates). [19:22:18] PROBLEM - mw153 APT on mw153 is CRITICAL: APT CRITICAL: 68 packages available for upgrade (1 critical updates). [19:22:36] PROBLEM - mw191 APT on mw191 is CRITICAL: APT CRITICAL: 68 packages available for upgrade (1 critical updates). [19:22:38] PROBLEM - db201 APT on db201 is CRITICAL: APT CRITICAL: 85 packages available for upgrade (1 critical updates). [19:22:50] PROBLEM - kafka182 APT on kafka182 is CRITICAL: APT CRITICAL: 65 packages available for upgrade (1 critical updates). [19:23:15] PROBLEM - db182 APT on db182 is CRITICAL: APT CRITICAL: 78 packages available for upgrade (1 critical updates). [19:26:11] PROBLEM - bots171 APT on bots171 is CRITICAL: APT CRITICAL: 72 packages available for upgrade (1 critical updates). [19:26:39] PROBLEM - cloud19 APT on cloud19 is CRITICAL: APT CRITICAL: 102 packages available for upgrade (1 critical updates). [19:26:43] PROBLEM - swiftobject171 APT on swiftobject171 is CRITICAL: APT CRITICAL: 65 packages available for upgrade (1 critical updates). [19:27:43] PROBLEM - cp191 APT on cp191 is CRITICAL: APT CRITICAL: 63 packages available for upgrade (1 critical updates). [19:28:02] PROBLEM - cp161 APT on cp161 is CRITICAL: APT CRITICAL: 63 packages available for upgrade (1 critical updates). [19:28:14] PROBLEM - mem191 APT on mem191 is CRITICAL: APT CRITICAL: 62 packages available for upgrade (1 critical updates). [19:28:17] PROBLEM - mw192 APT on mw192 is CRITICAL: APT CRITICAL: 68 packages available for upgrade (1 critical updates). [19:28:46] PROBLEM - mw151 APT on mw151 is CRITICAL: APT CRITICAL: 68 packages available for upgrade (1 critical updates). [19:29:38] PROBLEM - os162 APT on os162 is CRITICAL: APT CRITICAL: 62 packages available for upgrade (1 critical updates). [19:29:49] PROBLEM - graylog161 APT on graylog161 is CRITICAL: APT CRITICAL: 66 packages available for upgrade (1 critical updates). [19:30:25] [02ssl] 07WikiTideBot pushed 1 new commit to 03main 13https://github.com/miraheze/ssl/commit/4115298e374cd013f9cde316815b6aefd71ca4a6 [19:30:25] 02ssl/03main 07WikiTideBot 034115298 Bot: Auto-update domain lists [19:58:48] !log [void@puppet181] Upgraded packages on bots171: pdns-recursor [19:58:51] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:59:05] !log [void@puppet181] Upgraded packages on bast161: pdns-recursor [19:59:08] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:59:11] RECOVERY - bast161 APT on bast161 is OK: APT OK: 73 packages available for upgrade (0 critical updates). [19:59:19] !log [void@puppet181] Upgraded packages on cp161: pdns-recursor [19:59:22] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:59:35] !log [void@puppet181] Upgraded packages on db151: pdns-recursor [19:59:38] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:59:46] RECOVERY - db151 APT on db151 is OK: APT OK: 71 packages available for upgrade (0 critical updates). [19:59:49] !log [void@puppet181] Upgraded packages on db172: pdns-recursor [19:59:52] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:00:04] !log [void@puppet181] Upgraded packages on db171: pdns-recursor [20:00:07] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:00:15] RECOVERY - db172 APT on db172 is OK: APT OK: 71 packages available for upgrade (0 critical updates). [20:00:19] RECOVERY - cp161 APT on cp161 is OK: APT OK: 62 packages available for upgrade (0 critical updates). [20:00:19] !log [void@puppet181] Upgraded packages on db161: pdns-recursor [20:00:22] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:00:35] !log [void@puppet181] Upgraded packages on bast181: pdns-recursor [20:00:38] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:00:41] RECOVERY - bast181 APT on bast181 is OK: APT OK: 74 packages available for upgrade (0 critical updates). [20:00:41] RECOVERY - bots171 APT on bots171 is OK: APT OK: 71 packages available for upgrade (0 critical updates). [20:00:48] !log [void@puppet181] Upgraded packages on cloud21: pdns-recursor [20:00:51] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:00:57] RECOVERY - db161 APT on db161 is OK: APT OK: 71 packages available for upgrade (0 critical updates). [20:01:04] !log [void@puppet181] Upgraded packages on db182: pdns-recursor [20:01:07] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:01:20] !log [void@puppet181] Upgraded packages on cp191: pdns-recursor [20:01:23] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:01:25] RECOVERY - db182 APT on db182 is OK: APT OK: 77 packages available for upgrade (0 critical updates). [20:01:32] RECOVERY - db171 APT on db171 is OK: APT OK: 71 packages available for upgrade (0 critical updates). [20:01:36] !log [void@puppet181] Upgraded packages on eventgate182: pdns-recursor [20:01:39] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:01:40] RECOVERY - cp191 APT on cp191 is OK: APT OK: 62 packages available for upgrade (0 critical updates). [20:01:45] RECOVERY - cloud21 APT on cloud21 is OK: APT OK: 98 packages available for upgrade (0 critical updates). [20:01:52] !log [void@puppet181] Upgraded packages on db181: pdns-recursor [20:01:55] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:02:07] !log [void@puppet181] Upgraded packages on graylog161: pdns-recursor [20:02:10] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:02:23] !log [void@puppet181] Upgraded packages on cloud15: pdns-recursor [20:02:26] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:02:40] !log [void@puppet181] Upgraded packages on cp171: pdns-recursor [20:02:43] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:02:53] RECOVERY - db181 APT on db181 is OK: APT OK: 71 packages available for upgrade (0 critical updates). [20:02:57] !log [void@puppet181] Upgraded packages on cloud16: pdns-recursor [20:02:59] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:03:14] !log [void@puppet181] Upgraded packages on cloud18: pdns-recursor [20:03:15] RECOVERY - eventgate182 APT on eventgate182 is OK: APT OK: 61 packages available for upgrade (0 critical updates). [20:03:17] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:03:24] RECOVERY - cloud16 APT on cloud16 is OK: APT OK: 101 packages available for upgrade (0 critical updates). [20:03:25] PROBLEM - puppet181 Check unit status of listdomains_github_push on puppet181 is CRITICAL: CRITICAL: Status of the systemd unit listdomains_github_push [20:03:27] RECOVERY - cloud15 APT on cloud15 is OK: APT OK: 101 packages available for upgrade (0 critical updates). [20:03:30] !log [void@puppet181] Upgraded packages on cloud19: pdns-recursor [20:03:33] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:03:48] !log [void@puppet181] Upgraded packages on cloud20: pdns-recursor [20:03:51] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:03:52] RECOVERY - cloud18 APT on cloud18 is OK: APT OK: 101 packages available for upgrade (0 critical updates). [20:03:59] RECOVERY - graylog161 APT on graylog161 is OK: APT OK: 65 packages available for upgrade (0 critical updates). [20:04:05] !log [void@puppet181] Upgraded packages on cp201: pdns-recursor [20:04:06] RECOVERY - cloud20 APT on cloud20 is OK: APT OK: 101 packages available for upgrade (0 critical updates). [20:04:08] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:04:21] !log [void@puppet181] Upgraded packages on cloud17: pdns-recursor [20:04:24] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:04:33] !log [void@puppet181] Upgraded packages on mattermost2: pdns-recursor [20:04:34] RECOVERY - cp171 APT on cp171 is OK: APT OK: 62 packages available for upgrade (0 critical updates). [20:04:35] RECOVERY - cloud19 APT on cloud19 is OK: APT OK: 101 packages available for upgrade (0 critical updates). [20:04:36] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:04:49] !log [void@puppet181] Upgraded packages on ldap171: pdns-recursor [20:04:52] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:05:04] !log [void@puppet181] Upgraded packages on matomo151: pdns-recursor [20:05:06] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:05:11] RECOVERY - matomo151 APT on matomo151 is OK: APT OK: 61 packages available for upgrade (0 critical updates). [20:05:17] RECOVERY - mattermost2 APT on mattermost2 is OK: APT OK: 62 packages available for upgrade (0 critical updates). [20:05:19] !log [void@puppet181] Upgraded packages on mem151: pdns-recursor [20:05:22] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:05:34] !log [void@puppet181] Upgraded packages on mem161: pdns-recursor [20:05:37] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:05:40] RECOVERY - cp201 APT on cp201 is OK: APT OK: 62 packages available for upgrade (0 critical updates). [20:05:51] !log [void@puppet181] Upgraded packages on llm191: pdns-recursor [20:05:53] RECOVERY - mem151 APT on mem151 is OK: APT OK: 61 packages available for upgrade (0 critical updates). [20:05:54] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:06:05] RECOVERY - cloud17 APT on cloud17 is OK: APT OK: 101 packages available for upgrade (0 critical updates). [20:06:06] !log [void@puppet181] Upgraded packages on mem201: pdns-recursor [20:06:09] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:06:16] RECOVERY - mem201 APT on mem201 is OK: APT OK: 61 packages available for upgrade (0 critical updates). [20:06:25] !log [void@puppet181] Upgraded packages on changeprop202: pdns-recursor [20:06:27] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:06:29] RECOVERY - ldap171 APT on ldap171 is OK: APT OK: 61 packages available for upgrade (0 critical updates). [20:06:44] !log [void@puppet181] Upgraded packages on db201: pdns-recursor [20:06:47] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:07:05] !log [void@puppet181] Upgraded packages on db192: pdns-recursor [20:07:07] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:07:29] !log [void@puppet181] Upgraded packages on mw151: pdns-recursor [20:07:32] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:07:33] RECOVERY - mem161 APT on mem161 is OK: APT OK: 61 packages available for upgrade (0 critical updates). [20:07:33] RECOVERY - changeprop202 APT on changeprop202 is OK: APT OK: 61 packages available for upgrade (0 critical updates). [20:07:35] RECOVERY - llm191 APT on llm191 is OK: APT OK: 64 packages available for upgrade (0 critical updates). [20:07:45] !log [void@puppet181] Upgraded packages on mon181: pdns-recursor [20:07:48] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:08:08] !log [void@puppet181] Upgraded packages on mw152: pdns-recursor [20:08:11] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:08:17] RECOVERY - db192 APT on db192 is OK: APT OK: 84 packages available for upgrade (0 critical updates). [20:08:24] !log [void@puppet181] Upgraded packages on mem191: pdns-recursor [20:08:27] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:08:33] RECOVERY - mw152 APT on mw152 is OK: APT OK: 67 packages available for upgrade (0 critical updates). [20:08:35] RECOVERY - db201 APT on db201 is OK: APT OK: 84 packages available for upgrade (0 critical updates). [20:08:42] RECOVERY - mw151 APT on mw151 is OK: APT OK: 67 packages available for upgrade (0 critical updates). [20:08:46] !log [void@puppet181] Upgraded packages on mw171: pdns-recursor [20:08:49] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:09:08] !log [void@puppet181] Upgraded packages on mw163: pdns-recursor [20:09:10] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:09:30] !log [void@puppet181] Upgraded packages on mw153: pdns-recursor [20:09:33] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:09:35] RECOVERY - mon181 APT on mon181 is OK: APT OK: 74 packages available for upgrade (0 critical updates). [20:09:47] RECOVERY - mw163 APT on mw163 is OK: APT OK: 67 packages available for upgrade (0 critical updates). [20:09:56] !log [void@puppet181] Upgraded packages on mw161: pdns-recursor [20:09:58] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:10:12] RECOVERY - mem191 APT on mem191 is OK: APT OK: 61 packages available for upgrade (0 critical updates). [20:10:21] !log [void@puppet181] Upgraded packages on mw162: pdns-recursor [20:10:23] RECOVERY - mw153 APT on mw153 is OK: APT OK: 67 packages available for upgrade (0 critical updates). [20:10:24] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:10:27] RECOVERY - mw171 APT on mw171 is OK: APT OK: 67 packages available for upgrade (0 critical updates). [20:10:39] RECOVERY - mw161 APT on mw161 is OK: APT OK: 67 packages available for upgrade (0 critical updates). [20:10:43] !log [void@puppet181] Upgraded packages on mw182: pdns-recursor [20:10:46] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:11:09] !log [void@puppet181] Upgraded packages on mw181: pdns-recursor [20:11:12] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:11:24] RECOVERY - mw162 APT on mw162 is OK: APT OK: 67 packages available for upgrade (0 critical updates). [20:11:29] RECOVERY - mw182 APT on mw182 is OK: APT OK: 67 packages available for upgrade (0 critical updates). [20:11:30] !log [void@puppet181] Upgraded packages on mw173: pdns-recursor [20:11:33] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:11:53] RECOVERY - mw173 APT on mw173 is OK: APT OK: 67 packages available for upgrade (0 critical updates). [20:11:54] !log [void@puppet181] Upgraded packages on mw172: pdns-recursor [20:11:58] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:12:16] !log [void@puppet181] Upgraded packages on mw183: pdns-recursor [20:12:17] RECOVERY - mw183 APT on mw183 is OK: APT OK: 67 packages available for upgrade (0 critical updates). [20:12:19] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:12:34] RECOVERY - mw191 APT on mw191 is OK: APT OK: 67 packages available for upgrade (0 critical updates). [20:12:41] !log [void@puppet181] Upgraded packages on mw191: pdns-recursor [20:12:44] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:12:47] RECOVERY - mw172 APT on mw172 is OK: APT OK: 67 packages available for upgrade (0 critical updates). [20:12:52] RECOVERY - mw181 APT on mw181 is OK: APT OK: 67 packages available for upgrade (0 critical updates). [20:13:01] !log [void@puppet181] Upgraded packages on kafka182: pdns-recursor [20:13:03] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:13:27] !log [void@puppet181] Upgraded packages on mw201: pdns-recursor [20:13:30] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:13:34] RECOVERY - kafka182 APT on kafka182 is OK: APT OK: 64 packages available for upgrade (0 critical updates). [20:13:50] !log [void@puppet181] Upgraded packages on mw192: pdns-recursor [20:13:53] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:14:12] RECOVERY - mw192 APT on mw192 is OK: APT OK: 67 packages available for upgrade (0 critical updates). [20:14:14] !log [void@puppet181] Upgraded packages on mw193: pdns-recursor [20:14:16] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:14:34] RECOVERY - mw201 APT on mw201 is OK: APT OK: 67 packages available for upgrade (0 critical updates). [20:14:38] !log [void@puppet181] Upgraded packages on mw202: pdns-recursor [20:14:41] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:14:56] RECOVERY - mw202 APT on mw202 is OK: APT OK: 67 packages available for upgrade (0 critical updates). [20:15:03] !log [void@puppet181] Upgraded packages on mwtask171: pdns-recursor [20:15:06] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:15:19] RECOVERY - mwtask171 APT on mwtask171 is OK: APT OK: 71 packages available for upgrade (0 critical updates). [20:15:21] !log [void@puppet181] Upgraded packages on mwtask151: pdns-recursor [20:15:22] RECOVERY - mw193 APT on mw193 is OK: APT OK: 67 packages available for upgrade (0 critical updates). [20:15:24] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:15:36] !log [void@puppet181] Upgraded packages on os151: pdns-recursor [20:15:40] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:15:52] !log [void@puppet181] Upgraded packages on os161: pdns-recursor [20:15:55] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:16:20] !log [void@puppet181] Upgraded packages on mw203: pdns-recursor [20:16:23] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:16:24] RECOVERY - mw203 APT on mw203 is OK: APT OK: 67 packages available for upgrade (0 critical updates). [20:16:38] !log [void@puppet181] Upgraded packages on mwtask161: pdns-recursor [20:16:41] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:16:51] RECOVERY - os161 APT on os161 is OK: APT OK: 61 packages available for upgrade (0 critical updates). [20:16:52] RECOVERY - mwtask151 APT on mwtask151 is OK: APT OK: 71 packages available for upgrade (0 critical updates). [20:16:53] !log [void@puppet181] Upgraded packages on prometheus151: pdns-recursor [20:16:56] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:17:13] !log [void@puppet181] Upgraded packages on mwtask181: pdns-recursor [20:17:16] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:17:17] RECOVERY - mwtask181 APT on mwtask181 is OK: APT OK: 71 packages available for upgrade (0 critical updates). [20:17:27] RECOVERY - os151 APT on os151 is OK: APT OK: 61 packages available for upgrade (0 critical updates). [20:17:28] RECOVERY - mwtask161 APT on mwtask161 is OK: APT OK: 71 packages available for upgrade (0 critical updates). [20:17:28] !log [void@puppet181] Upgraded packages on phorge171: pdns-recursor [20:17:31] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:17:44] !log [void@puppet181] Upgraded packages on reports171: pdns-recursor [20:17:44] RECOVERY - reports171 APT on reports171 is OK: APT OK: 63 packages available for upgrade (0 critical updates). [20:17:47] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:18:00] !log [void@puppet181] Upgraded packages on puppet181: pdns-recursor [20:18:03] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:18:09] Thanks @void [20:18:12] RECOVERY - prometheus151 APT on prometheus151 is OK: APT OK: 65 packages available for upgrade (0 critical updates). [20:18:16] !log [void@puppet181] Upgraded packages on os162: pdns-recursor [20:18:19] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:18:26] RECOVERY - os162 APT on os162 is OK: APT OK: 61 packages available for upgrade (0 critical updates). [20:18:32] !log [void@puppet181] Upgraded packages on os191: pdns-recursor [20:18:35] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:18:36] RECOVERY - phorge171 APT on phorge171 is OK: APT OK: 63 packages available for upgrade (0 critical updates). [20:18:50] !log [void@puppet181] Upgraded packages on os201: pdns-recursor [20:18:51] RECOVERY - puppet181 APT on puppet181 is OK: APT OK: 67 packages available for upgrade (0 critical updates). [20:18:53] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:19:07] !log [void@puppet181] Upgraded packages on swiftac171: pdns-recursor [20:19:09] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:19:22] !log [void@puppet181] Upgraded packages on swiftobject151: pdns-recursor [20:19:25] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:19:37] RECOVERY - os201 APT on os201 is OK: APT OK: 61 packages available for upgrade (0 critical updates). [20:19:37] RECOVERY - os191 APT on os191 is OK: APT OK: 61 packages available for upgrade (0 critical updates). [20:19:40] !log [void@puppet181] Upgraded packages on swiftobject161: pdns-recursor [20:19:43] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:19:57] RECOVERY - swiftobject161 APT on swiftobject161 is OK: APT OK: 64 packages available for upgrade (0 critical updates). [20:19:58] !log [void@puppet181] Upgraded packages on swiftobject171: pdns-recursor [20:20:00] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:20:13] !log [void@puppet181] Upgraded packages on swiftobject211: pdns-recursor [20:20:16] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:20:23] RECOVERY - swiftac171 APT on swiftac171 is OK: APT OK: 62 packages available for upgrade (0 critical updates). [20:20:30] !log [void@puppet181] Upgraded packages on test151: pdns-recursor [20:20:33] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:20:46] RECOVERY - swiftobject151 APT on swiftobject151 is OK: APT OK: 64 packages available for upgrade (0 critical updates). [20:20:48] !log [void@puppet181] Upgraded packages on swiftobject191: pdns-recursor [20:20:52] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:21:06] !log [void@puppet181] Upgraded packages on swiftobject181: pdns-recursor [20:21:09] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:21:16] RECOVERY - swiftobject171 APT on swiftobject171 is OK: APT OK: 64 packages available for upgrade (0 critical updates). [20:21:18] RECOVERY - swiftobject211 APT on swiftobject211 is OK: APT OK: 62 packages available for upgrade (0 critical updates). [20:21:26] !log [void@puppet181] Upgraded packages on rdb191: pdns-recursor [20:21:29] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:21:40] RECOVERY - swiftobject191 APT on swiftobject191 is OK: APT OK: 65 packages available for upgrade (0 critical updates). [20:21:40] RECOVERY - test151 APT on test151 is OK: APT OK: 72 packages available for upgrade (0 critical updates). [20:21:44] !log [void@puppet181] Upgraded packages on swiftobject201: pdns-recursor [20:21:47] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:22:00] !log [void@puppet181] Upgraded packages on swiftproxy171: pdns-recursor [20:22:02] RECOVERY - rdb191 APT on rdb191 is OK: APT OK: 61 packages available for upgrade (0 critical updates). [20:22:03]