[00:02:36] PROBLEM - mwtask181 Check unit status of update-static-tech-docs on mwtask181 is CRITICAL: CRITICAL: Status of the systemd unit update-static-tech-docs [00:07:27] RECOVERY - cp171 Disk Space on cp171 is OK: DISK OK - free space: / 55956MiB (12% inode=99%); [00:07:33] RECOVERY - cp191 Disk Space on cp191 is OK: DISK OK - free space: / 54845MiB (12% inode=99%); [00:08:13] RECOVERY - cp201 Disk Space on cp201 is OK: DISK OK - free space: / 54450MiB (12% inode=99%); [00:09:40] PROBLEM - puppet181 Check unit status of listdomains_github_push on puppet181 is CRITICAL: CRITICAL: Status of the systemd unit listdomains_github_push [00:13:34] PROBLEM - swiftproxy171 Check unit status of swift-container-stats_mw-media on swiftproxy171 is CRITICAL: CRITICAL: Status of the systemd unit swift-container-stats_mw-media [00:21:34] RECOVERY - swiftproxy171 Check unit status of swift-container-stats_mw-media on swiftproxy171 is OK: OK: Status of the systemd unit swift-container-stats_mw-media [00:23:33] PROBLEM - mwtask181 Check unit status of mediawiki_job_generate-sitemap-index on mwtask181 is CRITICAL: CRITICAL: Status of the systemd unit mediawiki_job_generate-sitemap-index [00:25:40] RECOVERY - puppet181 Check unit status of listdomains_github_push on puppet181 is OK: OK: Status of the systemd unit listdomains_github_push [00:57:40] PROBLEM - puppet181 Check unit status of listdomains_github_push on puppet181 is CRITICAL: CRITICAL: Status of the systemd unit listdomains_github_push [01:05:40] RECOVERY - puppet181 Check unit status of listdomains_github_push on puppet181 is OK: OK: Status of the systemd unit listdomains_github_push [01:28:36] RECOVERY - mwtask181 Check unit status of update-static-tech-docs on mwtask181 is OK: OK: Status of the systemd unit update-static-tech-docs [01:28:57] [02statichelp] 07WikiTideBot pushed 1 new commit to 03main 13https://github.com/miraheze/statichelp/commit/ed8e0c3e769f90d0063bf6406ed1a74213bdba4e [01:28:57] 02statichelp/03main 07WikiTideBot 03ed8e0c3 Bot: Auto-update Tech namespace pages 2025-08-29 01:28:55 [01:39:40] PROBLEM - puppet181 Check unit status of listdomains_github_push on puppet181 is CRITICAL: CRITICAL: Status of the systemd unit listdomains_github_push [01:41:33] RECOVERY - mwtask181 Check unit status of mediawiki_job_generate-sitemap-index on mwtask181 is OK: OK: Status of the systemd unit mediawiki_job_generate-sitemap-index [01:43:25] [1/2] These units seem to be failing due to dns problems [01:43:25] [2/2] > Failed to establish a new connection: [Errno -2] Name or service not known [01:45:40] RECOVERY - puppet181 Check unit status of listdomains_github_push on puppet181 is OK: OK: Status of the systemd unit listdomains_github_push [01:49:40] PROBLEM - puppet181 Check unit status of listdomains_github_push on puppet181 is CRITICAL: CRITICAL: Status of the systemd unit listdomains_github_push [01:53:33] PROBLEM - mwtask181 Check unit status of mediawiki_job_generate-sitemap-index on mwtask181 is CRITICAL: CRITICAL: Status of the systemd unit mediawiki_job_generate-sitemap-index [01:55:40] RECOVERY - puppet181 Check unit status of listdomains_github_push on puppet181 is OK: OK: Status of the systemd unit listdomains_github_push [02:49:40] PROBLEM - puppet181 Check unit status of listdomains_github_push on puppet181 is CRITICAL: CRITICAL: Status of the systemd unit listdomains_github_push [02:55:40] RECOVERY - puppet181 Check unit status of listdomains_github_push on puppet181 is OK: OK: Status of the systemd unit listdomains_github_push [03:08:27] PROBLEM - matomo151 Check unit status of matomo-archiver-1 on matomo151 is CRITICAL: CRITICAL: Status of the systemd unit matomo-archiver-1 [03:49:40] PROBLEM - puppet181 Check unit status of listdomains_github_push on puppet181 is CRITICAL: CRITICAL: Status of the systemd unit listdomains_github_push [03:55:40] RECOVERY - puppet181 Check unit status of listdomains_github_push on puppet181 is OK: OK: Status of the systemd unit listdomains_github_push [04:19:40] PROBLEM - puppet181 Check unit status of listdomains_github_push on puppet181 is CRITICAL: CRITICAL: Status of the systemd unit listdomains_github_push [04:25:40] RECOVERY - puppet181 Check unit status of listdomains_github_push on puppet181 is OK: OK: Status of the systemd unit listdomains_github_push [04:36:08] PROBLEM - ping6 on mattermost1 is WARNING: PING WARNING - Packet loss = 0%, RTA = 150.18 ms [05:14:13] PROBLEM - cp201 Disk Space on cp201 is WARNING: DISK WARNING - free space: / 49845MiB (10% inode=99%); [05:45:33] PROBLEM - cp191 Disk Space on cp191 is WARNING: DISK WARNING - free space: / 49937MiB (10% inode=99%); [06:05:24] !log [reception@mwtask181] sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php /srv/mediawiki/1.43/maintenance/importImages.php --wiki=falcomwiki /home/reception/falcom --search-recursively --summary=Imported from https://isu.fandom.com/, https://gagharv.fandom.com/ and https://tokyoxanadu.fandom.com/ (START) [06:05:24] !log [reception@mwtask181] sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php /srv/mediawiki/1.43/maintenance/importImages.php --wiki=falcomwiki /home/reception/falcom --search-recursively --summary=Imported from https://isu.fandom.com/, https://gagharv.fandom.com/ and https://tokyoxanadu.fandom.com/ (END - exit=256) [06:05:28] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:05:31] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:06:43] !log [reception@mwtask181] sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php /srv/mediawiki/1.43/maintenance/importImages.php --wiki=falcomwiki /home/reception/falcom --search-recursively --summary=Imported from https://isu.fandom.com/, https://gagharv.fandom.com/ and https://tokyoxanadu.fandom.com/ (START) [06:06:46] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:07:31] !log [reception@mwtask181] sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php /srv/mediawiki/1.43/maintenance/importDump.php --wiki=falcomwiki /home/reception/falcom/20250824-kiseki_pages_full.xml --username-prefix=wikia:kiseki (START) [06:07:32] !log [reception@mwtask181] sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php /srv/mediawiki/1.43/maintenance/importDump.php --wiki=falcomwiki /home/reception/falcom/20250824-kiseki_pages_full.xml --username-prefix=wikia:kiseki (END - exit=256) [06:07:34] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:07:38] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:07:49] !log [reception@mwtask181] sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php /srv/mediawiki/1.43/maintenance/importDump.php --wiki=falcomwiki /home/reception/falcom/kiseki_pages_full.xml --username-prefix=wikia:kiseki (START) [06:07:52] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:41:33] PROBLEM - farthestfrontier.wiki - Cloudflare on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:55:10] !log [reception@mwtask181] sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php /srv/mediawiki/1.43/maintenance/importImages.php --wiki=falcomwiki /home/reception/falcom --search-recursively --summary=Imported from https://isu.fandom.com/, https://gagharv.fandom.com/ and https://tokyoxanadu.fandom.com/ (END - exit=0) [06:55:13] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:57:05] !log [reception@mwtask181] sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php /srv/mediawiki/1.43/maintenance/importDump.php --wiki=falcomwiki /home/reception/falcom/kiseki_pages_full.xml --username-prefix=wikia:kiseki (START) [06:57:11] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:11:24] PROBLEM - farthestfrontier.wiki - Cloudflare on sslhost is WARNING: WARNING - Certificate 'farthestfrontier.wiki' expires in 25 day(s) (Tue 23 Sep 2025 04:23:30 PM GMT +0000). [07:26:29] PROBLEM - cp161 APT on cp161 is CRITICAL: APT CRITICAL: 80 packages available for upgrade (1 critical updates). [07:27:58] PROBLEM - mw192 APT on mw192 is CRITICAL: APT CRITICAL: 80 packages available for upgrade (1 critical updates). [07:28:11] PROBLEM - mem191 APT on mem191 is CRITICAL: APT CRITICAL: 57 packages available for upgrade (1 critical updates). [07:28:41] PROBLEM - swiftobject171 APT on swiftobject171 is CRITICAL: APT CRITICAL: 4 packages available for upgrade (1 critical updates). [07:28:57] PROBLEM - changeprop201 APT on changeprop201 is CRITICAL: APT CRITICAL: 80 packages available for upgrade (1 critical updates). [07:29:06] PROBLEM - graylog161 APT on graylog161 is CRITICAL: APT CRITICAL: 63 packages available for upgrade (1 critical updates). [07:29:12] PROBLEM - mw163 APT on mw163 is CRITICAL: APT CRITICAL: 80 packages available for upgrade (1 critical updates). [07:29:20] PROBLEM - mw151 APT on mw151 is CRITICAL: APT CRITICAL: 80 packages available for upgrade (1 critical updates). [07:29:38] PROBLEM - os162 APT on os162 is CRITICAL: APT CRITICAL: 61 packages available for upgrade (1 critical updates). [07:29:45] PROBLEM - os202 APT on os202 is CRITICAL: APT CRITICAL: 5 packages available for upgrade (1 critical updates). [07:30:15] PROBLEM - db181 APT on db181 is CRITICAL: APT CRITICAL: 66 packages available for upgrade (1 critical updates). [07:32:05] PROBLEM - mw181 APT on mw181 is CRITICAL: APT CRITICAL: 80 packages available for upgrade (1 critical updates). [07:32:23] PROBLEM - ns2 APT on ns2 is CRITICAL: APT CRITICAL: 76 packages available for upgrade (1 critical updates). [07:32:30] PROBLEM - mattermost1 APT on mattermost1 is CRITICAL: APT CRITICAL: 59 packages available for upgrade (1 critical updates). [07:33:12] PROBLEM - cloud20 APT on cloud20 is CRITICAL: APT CRITICAL: 141 packages available for upgrade (1 critical updates). [07:33:23] PROBLEM - reports171 APT on reports171 is CRITICAL: APT CRITICAL: 60 packages available for upgrade (1 critical updates). [07:33:43] PROBLEM - swiftobject161 APT on swiftobject161 is CRITICAL: APT CRITICAL: 4 packages available for upgrade (1 critical updates). [07:33:57] PROBLEM - db151 APT on db151 is CRITICAL: APT CRITICAL: 86 packages available for upgrade (1 critical updates). [07:33:57] PROBLEM - mw201 APT on mw201 is CRITICAL: APT CRITICAL: 80 packages available for upgrade (1 critical updates). [07:34:02] PROBLEM - os191 APT on os191 is CRITICAL: APT CRITICAL: 58 packages available for upgrade (1 critical updates). [07:34:28] PROBLEM - mwtask181 APT on mwtask181 is CRITICAL: APT CRITICAL: 80 packages available for upgrade (1 critical updates). [07:34:29] PROBLEM - test151 APT on test151 is CRITICAL: APT CRITICAL: 64 packages available for upgrade (2 critical updates). [07:34:56] PROBLEM - os161 APT on os161 is CRITICAL: APT CRITICAL: 59 packages available for upgrade (1 critical updates). [07:35:02] PROBLEM - swiftobject151 APT on swiftobject151 is CRITICAL: APT CRITICAL: 4 packages available for upgrade (1 critical updates). [07:35:34] PROBLEM - bast181 APT on bast181 is CRITICAL: APT CRITICAL: 58 packages available for upgrade (1 critical updates). [07:35:50] PROBLEM - ldap171 APT on ldap171 is CRITICAL: APT CRITICAL: 58 packages available for upgrade (1 critical updates). [07:36:06] PROBLEM - mw152 APT on mw152 is CRITICAL: APT CRITICAL: 80 packages available for upgrade (1 critical updates). [07:36:16] PROBLEM - mw183 APT on mw183 is CRITICAL: APT CRITICAL: 80 packages available for upgrade (1 critical updates). [07:36:34] PROBLEM - mon181 APT on mon181 is CRITICAL: APT CRITICAL: 11 packages available for upgrade (1 critical updates). [07:36:45] PROBLEM - prometheus151 APT on prometheus151 is CRITICAL: APT CRITICAL: 62 packages available for upgrade (1 critical updates). [07:37:03] PROBLEM - mw182 APT on mw182 is CRITICAL: APT CRITICAL: 80 packages available for upgrade (1 critical updates). [07:38:28] PROBLEM - mem201 APT on mem201 is CRITICAL: APT CRITICAL: 78 packages available for upgrade (1 critical updates). [07:38:41] PROBLEM - cp201 APT on cp201 is CRITICAL: APT CRITICAL: 14 packages available for upgrade (1 critical updates). [07:38:56] PROBLEM - matomo151 APT on matomo151 is CRITICAL: APT CRITICAL: 4 packages available for upgrade (1 critical updates). [07:40:27] PROBLEM - mw202 APT on mw202 is CRITICAL: APT CRITICAL: 80 packages available for upgrade (1 critical updates). [07:40:51] PROBLEM - swiftproxy161 APT on swiftproxy161 is CRITICAL: APT CRITICAL: 83 packages available for upgrade (1 critical updates). [07:40:57] PROBLEM - mw161 APT on mw161 is CRITICAL: APT CRITICAL: 80 packages available for upgrade (1 critical updates). [07:41:02] PROBLEM - db172 APT on db172 is CRITICAL: APT CRITICAL: 25 packages available for upgrade (1 critical updates). [07:41:30] PROBLEM - bast161 APT on bast161 is CRITICAL: APT CRITICAL: 58 packages available for upgrade (1 critical updates). [07:42:04] PROBLEM - swiftproxy171 APT on swiftproxy171 is CRITICAL: APT CRITICAL: 83 packages available for upgrade (1 critical updates). [07:42:09] PROBLEM - mw162 APT on mw162 is CRITICAL: APT CRITICAL: 80 packages available for upgrade (1 critical updates). [07:42:10] PROBLEM - mwtask171 APT on mwtask171 is CRITICAL: APT CRITICAL: 80 packages available for upgrade (1 critical updates). [07:42:21] PROBLEM - eventgate181 APT on eventgate181 is CRITICAL: APT CRITICAL: 80 packages available for upgrade (1 critical updates). [07:42:47] PROBLEM - cp171 APT on cp171 is CRITICAL: APT CRITICAL: 59 packages available for upgrade (1 critical updates). [07:43:10] PROBLEM - swiftobject201 APT on swiftobject201 is CRITICAL: APT CRITICAL: 4 packages available for upgrade (1 critical updates). [07:43:50] PROBLEM - swiftobject191 APT on swiftobject191 is CRITICAL: APT CRITICAL: 4 packages available for upgrade (1 critical updates). [07:43:53] PROBLEM - puppet181 APT on puppet181 is CRITICAL: APT CRITICAL: 9 packages available for upgrade (1 critical updates). [07:43:53] PROBLEM - mw203 APT on mw203 is CRITICAL: APT CRITICAL: 80 packages available for upgrade (1 critical updates). [07:44:24] PROBLEM - mwtask161 APT on mwtask161 is CRITICAL: APT CRITICAL: 80 packages available for upgrade (1 critical updates). [07:44:56] PROBLEM - swiftac171 APT on swiftac171 is CRITICAL: APT CRITICAL: 81 packages available for upgrade (1 critical updates). [07:45:10] PROBLEM - mem161 APT on mem161 is CRITICAL: APT CRITICAL: 78 packages available for upgrade (1 critical updates). [07:45:12] PROBLEM - mwtask151 APT on mwtask151 is CRITICAL: APT CRITICAL: 80 packages available for upgrade (1 critical updates). [07:45:12] PROBLEM - mw173 APT on mw173 is CRITICAL: APT CRITICAL: 80 packages available for upgrade (1 critical updates). [07:45:50] PROBLEM - swiftobject181 APT on swiftobject181 is CRITICAL: APT CRITICAL: 4 packages available for upgrade (1 critical updates). [07:46:21] PROBLEM - phorge171 APT on phorge171 is CRITICAL: APT CRITICAL: 4 packages available for upgrade (1 critical updates). [07:46:51] PROBLEM - db161 APT on db161 is CRITICAL: APT CRITICAL: 86 packages available for upgrade (1 critical updates). [07:47:15] PROBLEM - cloud16 APT on cloud16 is CRITICAL: APT CRITICAL: 139 packages available for upgrade (1 critical updates). [07:47:21] PROBLEM - cloud15 APT on cloud15 is CRITICAL: APT CRITICAL: 140 packages available for upgrade (1 critical updates). [07:48:04] PROBLEM - os201 APT on os201 is CRITICAL: APT CRITICAL: 16 packages available for upgrade (1 critical updates). [07:48:22] PROBLEM - ns1 APT on ns1 is CRITICAL: APT CRITICAL: 71 packages available for upgrade (1 critical updates). [07:48:28] PROBLEM - mem151 APT on mem151 is CRITICAL: APT CRITICAL: 78 packages available for upgrade (1 critical updates). [07:49:05] PROBLEM - mw193 APT on mw193 is CRITICAL: APT CRITICAL: 80 packages available for upgrade (1 critical updates). [07:49:27] PROBLEM - db171 APT on db171 is CRITICAL: APT CRITICAL: 67 packages available for upgrade (1 critical updates). [07:51:11] PROBLEM - kafka181 APT on kafka181 is CRITICAL: APT CRITICAL: 78 packages available for upgrade (1 critical updates). [07:51:48] PROBLEM - mw171 APT on mw171 is CRITICAL: APT CRITICAL: 80 packages available for upgrade (1 critical updates). [07:52:39] PROBLEM - mw153 APT on mw153 is CRITICAL: APT CRITICAL: 80 packages available for upgrade (1 critical updates). [07:53:06] PROBLEM - db182 APT on db182 is CRITICAL: APT CRITICAL: 15 packages available for upgrade (1 critical updates). [07:53:46] PROBLEM - cloud19 APT on cloud19 is CRITICAL: APT CRITICAL: 141 packages available for upgrade (1 critical updates). [07:53:59] PROBLEM - cloud17 APT on cloud17 is CRITICAL: APT CRITICAL: 139 packages available for upgrade (1 critical updates). [07:54:49] PROBLEM - cloud18 APT on cloud18 is CRITICAL: APT CRITICAL: 139 packages available for upgrade (1 critical updates). [07:55:42] PROBLEM - bots171 APT on bots171 is CRITICAL: APT CRITICAL: 61 packages available for upgrade (1 critical updates). [07:57:51] PROBLEM - rdb151 APT on rdb151 is CRITICAL: APT CRITICAL: 78 packages available for upgrade (1 critical updates). [08:00:27] RECOVERY - matomo151 Check unit status of matomo-archiver-1 on matomo151 is OK: OK: Status of the systemd unit matomo-archiver-1 [08:12:03] PROBLEM - mw172 APT on mw172 is CRITICAL: APT CRITICAL: 80 packages available for upgrade (1 critical updates). [08:15:32] [02ssl] 07WikiTideBot pushed 1 new commit to 03main 13https://github.com/miraheze/ssl/commit/24c7e780824266d5f211e97c870d38923ae9fb21 [08:15:32] 02ssl/03main 07WikiTideBot 0324c7e78 Bot: Auto-update domain lists [08:16:08] PROBLEM - mw191 APT on mw191 is CRITICAL: APT CRITICAL: 80 packages available for upgrade (1 critical updates). [08:19:41] PROBLEM - os151 APT on os151 is CRITICAL: APT CRITICAL: 61 packages available for upgrade (1 critical updates). [08:26:50] PROBLEM - cp191 APT on cp191 is CRITICAL: APT CRITICAL: 59 packages available for upgrade (1 critical updates). [08:31:11] PROBLEM - mwtask181 Current Load on mwtask181 is WARNING: LOAD WARNING - total load average: 21.66, 20.30, 15.54 [08:38:58] PROBLEM - ping6 on mattermost1 is CRITICAL: PING CRITICAL - Packet loss = 80%, RTA = 150.11 ms [08:40:59] PROBLEM - ping6 on mattermost1 is WARNING: PING WARNING - Packet loss = 0%, RTA = 150.14 ms [08:41:06] RECOVERY - mwtask181 Current Load on mwtask181 is OK: LOAD OK - total load average: 19.30, 20.07, 17.86 [08:45:03] PROBLEM - mwtask181 Current Load on mwtask181 is WARNING: LOAD WARNING - total load average: 21.98, 20.99, 18.74 [08:47:27] PROBLEM - cp171 Disk Space on cp171 is WARNING: DISK WARNING - free space: / 49870MiB (10% inode=99%); [08:49:05] RECOVERY - ping6 on mattermost1 is OK: PING OK - Packet loss = 0%, RTA = 149.73 ms [08:51:01] RECOVERY - mwtask181 Current Load on mwtask181 is OK: LOAD OK - total load average: 18.56, 20.07, 19.07 [08:54:58] PROBLEM - mwtask181 Current Load on mwtask181 is WARNING: LOAD WARNING - total load average: 20.34, 20.45, 19.45 [08:56:57] RECOVERY - mwtask181 Current Load on mwtask181 is OK: LOAD OK - total load average: 12.90, 17.54, 18.50 [10:51:08] PROBLEM - ping6 on mattermost1 is WARNING: PING WARNING - Packet loss = 0%, RTA = 150.41 ms [11:24:45] PROBLEM - cp191 Varnish Backends on cp191 is CRITICAL: 1 backends are down. mw182 [11:25:48] PROBLEM - cp161 Varnish Backends on cp161 is CRITICAL: 1 backends are down. mw182 [11:25:52] PROBLEM - cp171 Varnish Backends on cp171 is CRITICAL: 1 backends are down. mw182 [11:27:48] RECOVERY - cp161 Varnish Backends on cp161 is OK: All 31 backends are healthy [11:27:52] RECOVERY - cp171 Varnish Backends on cp171 is OK: All 31 backends are healthy [11:28:43] RECOVERY - cp191 Varnish Backends on cp191 is OK: All 31 backends are healthy [12:46:31] PROBLEM - ping6 on mattermost1 is CRITICAL: PING CRITICAL - Packet loss = 50%, RTA = 150.11 ms [12:48:33] PROBLEM - ping6 on mattermost1 is WARNING: PING WARNING - Packet loss = 0%, RTA = 150.12 ms [13:18:56] [Grafana] FIRING: The mediawiki JobQueue backlog is increasing by more than 100 jobs a minute over an extended time period https://grafana.wikitide.net/d/GtxbP1Xnk?from=1756469900000&orgId=1&to=1756473536683 [13:33:56] [Grafana] RESOLVED: MediaWiki Jobs are rapidly increasing https://grafana.wikitide.net/d/GtxbP1Xnk?from=1756470560000&orgId=1&to=1756474160000 [14:03:12] miraheze/mw-config - dependabot[bot] the build passed. [14:07:20] [Grafana] FIRING: The mediawiki job queue has more than 100000 unclaimed jobs https://grafana.wikitide.net/d/GtxbP1Xnk?from=1756472810000&orgId=1&to=1756476440012 [14:12:20] [Grafana] RESOLVED: High Job Queue Backlog https://grafana.wikitide.net/d/GtxbP1Xnk?from=1756472810000&orgId=1&to=1756476710000 [14:18:59] !log reception@mwtask181:/srv/mediawiki/1.43/extensions/CentralAuth/maintenance$ sudo -u www-data php migrateAccount.php --wiki metawiki --username="リムーブグリッチボール" --auto [14:19:02] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:19:04] !log reception@mwtask181:/srv/mediawiki/1.43/extensions/CentralAuth/maintenance$ sudo -u www-data php attachAccount.php --wiki metawiki --userlist /home/reception/attachuser.txt [14:19:07] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:19:39] PROBLEM - ping6 on mattermost1 is CRITICAL: PING CRITICAL - Packet loss = 50%, RTA = 150.06 ms [14:21:40] PROBLEM - ping6 on mattermost1 is WARNING: PING WARNING - Packet loss = 0%, RTA = 150.16 ms [14:22:38] miraheze/mw-config - Reception123 the build passed. [15:26:31] PROBLEM - ping6 on mattermost1 is CRITICAL: PING CRITICAL - Packet loss = 100% [15:28:32] RECOVERY - ping6 on mattermost1 is OK: PING OK - Packet loss = 0%, RTA = 148.01 ms [15:58:27] PROBLEM - db171 Current Load on db171 is WARNING: LOAD WARNING - total load average: 11.83, 8.32, 4.08 [16:00:27] RECOVERY - db171 Current Load on db171 is OK: LOAD OK - total load average: 2.21, 5.82, 3.67 [20:07:09] !log [void@puppet181] Upgraded packages on bots171: libxml2 [20:07:21] !log [void@puppet181] Upgraded packages on cp161: libxml2 [20:07:31] !log [void@puppet181] Upgraded packages on db172: libxml2 [20:07:41] RECOVERY - bots171 APT on bots171 is OK: APT OK: 60 packages available for upgrade (0 critical updates). [20:07:44] !log [void@puppet181] Upgraded packages on cloud19: libxml2 [20:07:57] !log [void@puppet181] Upgraded packages on cloud15: libxml2 [20:08:10] !log [void@puppet181] Upgraded packages on cloud16: libxml2 [20:08:15] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:08:18] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:08:22] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:08:22] !log [void@puppet181] Upgraded packages on bast161: libxml2 [20:08:25] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:08:29] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:08:29] RECOVERY - cp161 APT on cp161 is OK: APT OK: 79 packages available for upgrade (0 critical updates). [20:08:33] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:08:35] !log [void@puppet181] Upgraded packages on cloud17: libxml2 [20:08:38] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:08:47] !log [void@puppet181] Upgraded packages on cp171: libxml2 [20:08:50] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:09:00] !log [void@puppet181] Upgraded packages on cloud20: libxml2 [20:09:02] RECOVERY - db172 APT on db172 is OK: APT OK: 24 packages available for upgrade (0 critical updates). [20:09:03] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:09:13] !log [void@puppet181] Upgraded packages on cloud18: libxml2 [20:09:17] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:09:18] RECOVERY - cloud15 APT on cloud15 is OK: APT OK: 139 packages available for upgrade (0 critical updates). [20:09:25] !log [void@puppet181] Upgraded packages on db182: libxml2 [20:09:29] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:09:38] RECOVERY - cloud16 APT on cloud16 is OK: APT OK: 138 packages available for upgrade (0 critical updates). [20:09:39] !log [void@puppet181] Upgraded packages on bast181: libxml2 [20:09:43] RECOVERY - cloud20 APT on cloud20 is OK: APT OK: 140 packages available for upgrade (0 critical updates). [20:09:43] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:09:45] RECOVERY - cloud19 APT on cloud19 is OK: APT OK: 140 packages available for upgrade (0 critical updates). [20:09:50] !log [void@puppet181] Upgraded packages on db161: libxml2 [20:09:54] RECOVERY - cloud17 APT on cloud17 is OK: APT OK: 138 packages available for upgrade (0 critical updates). [20:09:54] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:10:05] !log [void@puppet181] Upgraded packages on graylog161: libxml2 [20:10:05] RECOVERY - bast161 APT on bast161 is OK: APT OK: 57 packages available for upgrade (0 critical updates). [20:10:09] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:10:17] !log [void@puppet181] Upgraded packages on db171: libxml2 [20:10:21] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:10:32] !log [void@puppet181] Upgraded packages on mem201: libxml2 [20:10:36] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:10:46] RECOVERY - cp171 APT on cp171 is OK: APT OK: 58 packages available for upgrade (0 critical updates). [20:10:47] RECOVERY - cloud18 APT on cloud18 is OK: APT OK: 138 packages available for upgrade (0 critical updates). [20:10:48] !log [void@puppet181] Upgraded packages on mem191: libxml2 [20:10:52] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:11:00] !log [void@puppet181] Upgraded packages on db151: libxml2 [20:11:04] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:11:05] RECOVERY - graylog161 APT on graylog161 is OK: APT OK: 62 packages available for upgrade (0 critical updates). [20:11:06] RECOVERY - db161 APT on db161 is OK: APT OK: 85 packages available for upgrade (0 critical updates). [20:11:06] RECOVERY - db182 APT on db182 is OK: APT OK: 14 packages available for upgrade (0 critical updates). [20:11:16] !log [void@puppet181] Upgraded packages on changeprop201: nodejs, libnode108, libxml2, and nodejs-doc [20:11:19] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:11:28] RECOVERY - db171 APT on db171 is OK: APT OK: 66 packages available for upgrade (0 critical updates). [20:11:34] RECOVERY - bast181 APT on bast181 is OK: APT OK: 57 packages available for upgrade (0 critical updates). [20:11:53] RECOVERY - db151 APT on db151 is OK: APT OK: 85 packages available for upgrade (0 critical updates). [20:11:54] !log [void@puppet181] Upgraded packages on cp191: libxml2 [20:11:58] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:12:11] RECOVERY - mem191 APT on mem191 is OK: APT OK: 56 packages available for upgrade (0 critical updates). [20:12:24] RECOVERY - mem201 APT on mem201 is OK: APT OK: 77 packages available for upgrade (0 critical updates). [20:12:33] !log [void@puppet181] Upgraded packages on cp201: libxml2 [20:12:37] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:12:51] !log [void@puppet181] Upgraded packages on eventgate181: nodejs, libnode-dev, libnode108, libxml2, and nodejs-doc [20:12:55] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:12:56] RECOVERY - changeprop201 APT on changeprop201 is OK: APT OK: 79 packages available for upgrade (0 critical updates). [20:13:04] !log [void@puppet181] Upgraded packages on db181: libxml2 [20:13:08] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:13:19] !log [void@puppet181] Upgraded packages on matomo151: libxml2 [20:13:22] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:13:31] !log [void@puppet181] Upgraded packages on mon181: libxml2 [20:13:35] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:14:11] RECOVERY - db181 APT on db181 is OK: APT OK: 65 packages available for upgrade (0 critical updates). [20:14:12] RECOVERY - mon181 APT on mon181 is OK: APT OK: 10 packages available for upgrade (0 critical updates). [20:14:25] !log [void@puppet181] Upgraded packages on ldap171: libxml2 [20:14:28] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:14:30] RECOVERY - eventgate181 APT on eventgate181 is OK: APT OK: 79 packages available for upgrade (0 critical updates). [20:14:56] RECOVERY - matomo151 APT on matomo151 is OK: APT OK: 3 packages available for upgrade (0 critical updates). [20:15:18] !log [void@puppet181] Upgraded packages on kafka181: libxml2 [20:15:22] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:15:39] !log [void@puppet181] Upgraded packages on mw152: libxml2, nodejs, libnode108, and nodejs-doc [20:15:43] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:15:51] !log [void@puppet181] Upgraded packages on mattermost1: libxml2 [20:15:55] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:16:03] RECOVERY - mattermost1 APT on mattermost1 is OK: APT OK: 58 packages available for upgrade (0 critical updates). [20:16:07] !log [void@puppet181] Upgraded packages on mem151: libxml2 [20:16:08] RECOVERY - ldap171 APT on ldap171 is OK: APT OK: 57 packages available for upgrade (0 critical updates). [20:16:10] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:16:29] !log [void@puppet181] Upgraded packages on mw172: libxml2, nodejs, libnode108, and nodejs-doc [20:16:32] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:16:46] !log [void@puppet181] Upgraded packages on mem161: libxml2 [20:16:50] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:17:00] RECOVERY - mem151 APT on mem151 is OK: APT OK: 77 packages available for upgrade (0 critical updates). [20:17:00] RECOVERY - mw152 APT on mw152 is OK: APT OK: 79 packages available for upgrade (0 critical updates). [20:17:02] RECOVERY - kafka181 APT on kafka181 is OK: APT OK: 77 packages available for upgrade (0 critical updates). [20:17:38] RECOVERY - mem161 APT on mem161 is OK: APT OK: 77 packages available for upgrade (0 critical updates). [20:18:03] RECOVERY - mw172 APT on mw172 is OK: APT OK: 79 packages available for upgrade (0 critical updates). [20:18:16] !log [void@puppet181] Upgraded packages on mw163: libxml2, nodejs, libnode108, and nodejs-doc [20:18:24] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:18:38] !log [void@puppet181] Upgraded packages on mw151: libxml2, nodejs, libnode108, and nodejs-doc [20:18:58] !log [void@puppet181] Upgraded packages on mw153: libxml2, nodejs, libnode108, and nodejs-doc [20:19:14] RECOVERY - mw151 APT on mw151 is OK: APT OK: 79 packages available for upgrade (0 critical updates). [20:19:43] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:20:07] RECOVERY - mw153 APT on mw153 is OK: APT OK: 79 packages available for upgrade (0 critical updates). [20:20:27] !log [void@puppet181] Upgraded packages on mw183: libxml2, nodejs, libnode108, and nodejs-doc [20:20:30] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:20:46] !log [void@puppet181] Upgraded packages on mw171: libxml2, nodejs, libnode108, and nodejs-doc [20:20:49] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:20:59] !log [void@puppet181] Upgraded packages on ns1: libxml2 [20:21:02] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:21:21] !log [void@puppet181] Upgraded packages on mw161: libxml2, nodejs, libnode108, and nodejs-doc [20:21:25] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:21:38] !log [void@puppet181] Upgraded packages on mwtask161: libxml2, nodejs, libnode108, and nodejs-doc [20:21:42] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:21:47] RECOVERY - mw171 APT on mw171 is OK: APT OK: 79 packages available for upgrade (0 critical updates). [20:22:11] RECOVERY - ns1 APT on ns1 is OK: APT OK: 70 packages available for upgrade (0 critical updates). [20:22:22] RECOVERY - mwtask161 APT on mwtask161 is OK: APT OK: 79 packages available for upgrade (0 critical updates). [20:22:57] RECOVERY - mw161 APT on mw161 is OK: APT OK: 79 packages available for upgrade (0 critical updates). [20:23:12] !log [void@puppet181] Upgraded packages on mw162: libxml2, nodejs, libnode108, and nodejs-doc [20:23:15] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:23:33] !log [void@puppet181] Upgraded packages on mw203: libxml2, nodejs, libnode108, and nodejs-doc [20:23:36] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:23:54] !log [void@puppet181] Upgraded packages on mw173: libxml2, nodejs, libnode108, and nodejs-doc [20:23:57] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:24:34] RECOVERY - mw173 APT on mw173 is OK: APT OK: 79 packages available for upgrade (0 critical updates). [20:24:49] !log [void@puppet181] Upgraded packages on mw201: libxml2, nodejs, libnode108, and nodejs-doc [20:24:53] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:25:07] !log [void@puppet181] Upgraded packages on os161: libxml2 [20:25:10] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:25:30] !log [void@puppet181] Upgraded packages on mwtask171: libxml2, nodejs, libnode108, and nodejs-doc [20:25:30] RECOVERY - mw203 APT on mw203 is OK: APT OK: 79 packages available for upgrade (0 critical updates). [20:25:33] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:25:39] RECOVERY - mw201 APT on mw201 is OK: APT OK: 79 packages available for upgrade (0 critical updates). [20:25:50] !log [void@puppet181] Upgraded packages on mw182: libxml2, nodejs, libnode108, and nodejs-doc [20:25:53] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:26:09] RECOVERY - mwtask171 APT on mwtask171 is OK: APT OK: 79 packages available for upgrade (0 critical updates). [20:26:12] !log [void@puppet181] Upgraded packages on mw181: libxml2, nodejs, libnode108, and nodejs-doc [20:26:16] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:26:35] !log [void@puppet181] Upgraded packages on ns2: libxml2 [20:26:38] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:26:54] !log [void@puppet181] Upgraded packages on mw192: libxml2, nodejs, libnode108, and nodejs-doc [20:26:56] RECOVERY - os161 APT on os161 is OK: APT OK: 58 packages available for upgrade (0 critical updates). [20:26:58] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:27:11] !log [void@puppet181] Upgraded packages on rdb151: libxml2 [20:27:14] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:27:16] RECOVERY - mw181 APT on mw181 is OK: APT OK: 79 packages available for upgrade (0 critical updates). [20:28:14] !log [void@puppet181] Upgraded packages on mw193: libxml2, nodejs, libnode108, and nodejs-doc [20:28:17] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:28:20] RECOVERY - mw192 APT on mw192 is OK: APT OK: 79 packages available for upgrade (0 critical updates). [20:28:28] RECOVERY - ns2 APT on ns2 is OK: APT OK: 75 packages available for upgrade (0 critical updates). [20:28:33] !log [void@puppet181] Upgraded packages on mw191: libxml2, nodejs, libnode108, and nodejs-doc [20:28:36] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:29:32] RECOVERY - mw191 APT on mw191 is OK: APT OK: 79 packages available for upgrade (0 critical updates). [20:30:02] !log [void@puppet181] Upgraded packages on mwtask151: libxml2, nodejs, libnode108, and nodejs-doc [20:30:06] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:30:47] !log [void@puppet181] Upgraded packages on puppet181: libxml2 [20:30:50] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:31:11] !log [void@puppet181] Upgraded packages on mw202: libxml2, nodejs, libnode108, and nodejs-doc [20:31:15] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:31:32] !log [void@puppet181] Upgraded packages on mwtask181: libxml2, nodejs, libnode108, and nodejs-doc [20:31:35] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:31:48] !log [void@puppet181] Upgraded packages on os191: libxml2 [20:31:51] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:31:53] RECOVERY - puppet181 APT on puppet181 is OK: APT OK: 8 packages available for upgrade (0 critical updates). [20:32:02] RECOVERY - os191 APT on os191 is OK: APT OK: 57 packages available for upgrade (0 critical updates). [20:32:05] !log [void@puppet181] Upgraded packages on os162: libxml2 [20:32:09] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:32:22] !log [void@puppet181] Upgraded packages on os151: libxml2 [20:32:24] RECOVERY - mwtask181 APT on mwtask181 is OK: APT OK: 79 packages available for upgrade (0 critical updates). [20:32:24] RECOVERY - mw202 APT on mw202 is OK: APT OK: 79 packages available for upgrade (0 critical updates). [20:32:26] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:32:36] !log [void@puppet181] Upgraded packages on reports171: libxml2 [20:32:40] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:32:55] !log [void@puppet181] Upgraded packages on os201: libxml2 [20:32:58] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:33:11] !log [void@puppet181] Upgraded packages on phorge171: libxml2 [20:33:14] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:33:29] !log [void@puppet181] Upgraded packages on prometheus151: libxml2 [20:33:33] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:33:34] RECOVERY - os162 APT on os162 is OK: APT OK: 60 packages available for upgrade (0 critical updates). [20:33:40] RECOVERY - os151 APT on os151 is OK: APT OK: 60 packages available for upgrade (0 critical updates). [20:33:47] !log [void@puppet181] Upgraded packages on swiftobject191: libxml2 [20:33:51] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:34:04] RECOVERY - os201 APT on os201 is OK: APT OK: 15 packages available for upgrade (0 critical updates). [20:34:07] !log [void@puppet181] Upgraded packages on swiftac171: libxml2 [20:34:11] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:34:21] RECOVERY - phorge171 APT on phorge171 is OK: APT OK: 3 packages available for upgrade (0 critical updates). [20:34:46] !log [void@puppet181] Upgraded packages on swiftproxy161: libxml2 [20:34:49] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:34:52] RECOVERY - prometheus151 APT on prometheus151 is OK: APT OK: 61 packages available for upgrade (0 critical updates). [20:34:57] RECOVERY - swiftac171 APT on swiftac171 is OK: APT OK: 80 packages available for upgrade (0 critical updates). [20:35:03] !log [void@puppet181] Upgraded packages on swiftobject151: libxml2 [20:35:07] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:35:22] !log [void@puppet181] Upgraded packages on swiftobject161: libxml2 [20:35:25] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:35:39] !log [void@puppet181] Upgraded packages on swiftobject201: libxml2 [20:35:43] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:35:43] RECOVERY - swiftobject161 APT on swiftobject161 is OK: APT OK: 3 packages available for upgrade (0 critical updates). [20:35:58] !log [void@puppet181] Upgraded packages on swiftobject171: libxml2 [20:36:02] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:36:17] !log [void@puppet181] Upgraded packages on test151: libxml2-dev, libxml2, nodejs, libnode108, and nodejs-doc [20:36:20] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:36:27] RECOVERY - test151 APT on test151 is OK: APT OK: 62 packages available for upgrade (0 critical updates). [20:36:34] !log [void@puppet181] Upgraded packages on os202: libxml2 [20:36:37] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:36:41] RECOVERY - swiftobject171 APT on swiftobject171 is OK: APT OK: 3 packages available for upgrade (0 critical updates). [20:37:01] RECOVERY - swiftobject151 APT on swiftobject151 is OK: APT OK: 3 packages available for upgrade (0 critical updates). [20:37:07] !log [void@puppet181] Upgraded packages on swiftproxy171: libxml2 [20:37:09] RECOVERY - swiftobject201 APT on swiftobject201 is OK: APT OK: 3 packages available for upgrade (0 critical updates). [20:37:11] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:37:28] !log [void@puppet181] Upgraded packages on swiftobject181: libxml2 [20:37:31] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:37:45] RECOVERY - os202 APT on os202 is OK: APT OK: 4 packages available for upgrade (0 critical updates). [20:37:50] RECOVERY - swiftobject181 APT on swiftobject181 is OK: APT OK: 3 packages available for upgrade (0 critical updates). [20:45:51] !log [void@puppet181] Upgraded packages on mw163: libxml2, nodejs, libnode108, and nodejs-doc [20:46:09] !log [void@puppet181] Upgraded packages on mw182: libxml2, nodejs, libnode108, and nodejs-doc [20:46:23] !log [void@puppet181] Upgraded packages on swiftproxy171: libxml2 [20:46:48] !log [void@puppet181] Upgraded packages on swiftproxy161: libxml2 [20:46:51] RECOVERY - swiftproxy161 APT on swiftproxy161 is OK: APT OK: 82 packages available for upgrade (0 critical updates). [20:46:57] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:47:00] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:47:03] !log [void@puppet181] Upgraded packages on cp191: libxml2 [20:47:03] RECOVERY - mw182 APT on mw182 is OK: APT OK: 79 packages available for upgrade (0 critical updates). [20:47:03] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:47:06] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:47:18] !log [void@puppet181] Upgraded packages on swiftobject191: libxml2 [20:47:22] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:47:32] !log [void@puppet181] Upgraded packages on cp201: libxml2 [20:47:36] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:47:50] RECOVERY - swiftobject191 APT on swiftobject191 is OK: APT OK: 3 packages available for upgrade (0 critical updates). [20:47:51] !log [void@puppet181] Upgraded packages on mwtask151: libxml2, nodejs, libnode108, and nodejs-doc [20:47:54] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:48:04] RECOVERY - swiftproxy171 APT on swiftproxy171 is OK: APT OK: 82 packages available for upgrade (0 critical updates). [20:48:11] !log [void@puppet181] Upgraded packages on mw193: libxml2, nodejs, libnode108, and nodejs-doc [20:48:14] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:48:25] !log [void@puppet181] Upgraded packages on rdb151: libxml2 [20:48:29] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:48:41] RECOVERY - cp201 APT on cp201 is OK: APT OK: 13 packages available for upgrade (0 critical updates). [20:48:42] !log [void@puppet181] Upgraded packages on reports171: libxml2 [20:48:45] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:48:50] RECOVERY - cp191 APT on cp191 is OK: APT OK: 58 packages available for upgrade (0 critical updates). [20:49:02] !log [void@puppet181] Upgraded packages on mw183: libxml2, nodejs, libnode108, and nodejs-doc [20:49:05] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:49:06] RECOVERY - mw193 APT on mw193 is OK: APT OK: 79 packages available for upgrade (0 critical updates). [20:49:10] RECOVERY - mwtask151 APT on mwtask151 is OK: APT OK: 79 packages available for upgrade (0 critical updates). [20:49:20] RECOVERY - rdb151 APT on rdb151 is OK: APT OK: 77 packages available for upgrade (0 critical updates). [20:49:20] !log [void@puppet181] Upgraded packages on mw162: libxml2, nodejs, libnode108, and nodejs-doc [20:49:23] RECOVERY - reports171 APT on reports171 is OK: APT OK: 59 packages available for upgrade (0 critical updates). [20:49:23] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:49:37] RECOVERY - mw162 APT on mw162 is OK: APT OK: 79 packages available for upgrade (0 critical updates). [20:50:12] RECOVERY - mw183 APT on mw183 is OK: APT OK: 79 packages available for upgrade (0 critical updates). [20:51:05] !log [void@puppet181] Upgraded packages on mw163: libxml2, nodejs, libnode108, and nodejs-doc [20:51:08] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:51:12] RECOVERY - mw163 APT on mw163 is OK: APT OK: 79 packages available for upgrade (0 critical updates). [20:59:33] RECOVERY - mwtask181 Check unit status of mediawiki_job_generate-sitemap-index on mwtask181 is OK: OK: Status of the systemd unit mediawiki_job_generate-sitemap-index [21:05:33] PROBLEM - mwtask181 Check unit status of mediawiki_job_generate-sitemap-index on mwtask181 is CRITICAL: CRITICAL: Status of the systemd unit mediawiki_job_generate-sitemap-index [21:09:33] RECOVERY - mwtask181 Check unit status of mediawiki_job_generate-sitemap-index on mwtask181 is OK: OK: Status of the systemd unit mediawiki_job_generate-sitemap-index [21:24:52] !log sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php ResetUserEmail --wiki=loginwiki EngyneMac (user's email) [21:24:56] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:49:33] PROBLEM - mwtask181 Check unit status of mediawiki_job_generate-sitemap-index on mwtask181 is CRITICAL: CRITICAL: Status of the systemd unit mediawiki_job_generate-sitemap-index [23:13:48] miraheze/python-functions - dependabot[bot] the build passed. [23:23:50] miraheze/python-functions - github-merge-queue[bot] the build passed. [23:34:17] PROBLEM - mwtask181 Current Load on mwtask181 is WARNING: LOAD WARNING - total load average: 22.93, 17.45, 11.39 [23:36:17] RECOVERY - mwtask181 Current Load on mwtask181 is OK: LOAD OK - total load average: 14.04, 16.60, 11.86