[00:00:49] [02landing] 07Universal-Omega created 03footer (+1 new commit) 13https://github.com/miraheze/landing/commit/30980fff8028 [00:00:50] 02landing/03footer 07CosmicAlpha 0330980ff Some improvements to footer [00:00:53] [02landing] 07Universal-Omega opened pull request #174: Some improvements to footer (03main...03footer) 13https://github.com/miraheze/landing/pull/174 [00:01:00] [02landing] 07coderabbitai[bot] commented on pull request #174:
[…] 13https://github.com/miraheze/landing/pull/174#issuecomment-3304896173 [00:01:15] [02statichelp] 07WikiTideBot pushed 1 new commit to 03main 13https://github.com/miraheze/statichelp/commit/33204b51efc312ddc3e55eca94523e9ed72f49cb [00:01:16] 02statichelp/03main 07WikiTideBot 0333204b5 Bot: Auto-update Tech namespace pages 2025-09-18 00:01:12 [00:01:48] miraheze/landing - Universal-Omega the build passed. [00:02:18] [02landing] 07Universal-Omega pushed 1 new commit to 03footer 13https://github.com/miraheze/landing/commit/00f0ef7bc287ea684cb4402c1b0aa249b6c0fa53 [00:02:18] 02landing/03footer 07CosmicAlpha 0300f0ef7 Update [00:02:53] [02landing] 07Universal-Omega pushed 1 new commit to 03footer 13https://github.com/miraheze/landing/commit/5d4d4d0bbd6d2d55c5ca74ffb7211a529ac37636 [00:02:53] 02landing/03footer 07CosmicAlpha 035d4d4d0 Remove [00:03:20] [02landing] 07Universal-Omega pushed 1 new commit to 03footer 13https://github.com/miraheze/landing/commit/f252f284bf0ad6ea6164eaa6e05344538856e48a [00:03:20] 02landing/03footer 07CosmicAlpha 03f252f28 Remove [00:03:45] miraheze/landing - Universal-Omega the build passed. [00:04:14] miraheze/landing - Universal-Omega the build passed. [00:08:04] RECOVERY - cp171 Disk Space on cp171 is OK: DISK OK - free space: / 56014MiB (12% inode=99%); [00:08:20] [02landing] 07Universal-Omega merged pull request #174: Some improvements to footer (03main...03footer) 13https://github.com/miraheze/landing/pull/174 [00:08:20] [02landing] 07Universal-Omega pushed 1 new commit to 03main 13https://github.com/miraheze/landing/commit/5181924c0f6fcf5cf199a18f9ce9af6f8b515920 [00:08:21] 02landing/03main 07CosmicAlpha 035181924 Some improvements to footer [00:08:23] [02landing] 07Universal-Omega 04deleted 03footer at 03f252f28 13https://api.github.com/repos/miraheze/landing/commit/f252f28 [00:08:57] RECOVERY - cp201 Disk Space on cp201 is OK: DISK OK - free space: / 55753MiB (12% inode=99%); [00:09:11] miraheze/landing - Universal-Omega the build passed. [00:09:13] RECOVERY - cp191 Disk Space on cp191 is OK: DISK OK - free space: / 56432MiB (12% inode=99%); [00:18:07] !log [universalomega@mwtask181] starting deploy of {'pull': 'landing', 'landing': True} to all [00:18:11] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:18:32] !log [universalomega@mwtask181] finished deploy of {'pull': 'landing', 'landing': True} to all - SUCCESS in 24s [00:18:36] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [02:53:16] PROBLEM - matomo151 Check unit status of matomo-archiver-1 on matomo151 is CRITICAL: CRITICAL: Status of the systemd unit matomo-archiver-1 [03:45:30] [02ssl] 07WikiTideBot pushed 1 new commit to 03main 13https://github.com/miraheze/ssl/commit/196792a0c5f9cc11728951248a0eba42bfff7d56 [03:45:30] 02ssl/03main 07WikiTideBot 03196792a Bot: Auto-update domain lists [05:31:46] PROBLEM - mwtask181 Current Load on mwtask181 is CRITICAL: LOAD CRITICAL - total load average: 24.64, 16.66, 8.97 [05:37:46] PROBLEM - mwtask181 Current Load on mwtask181 is WARNING: LOAD WARNING - total load average: 20.08, 21.06, 13.59 [05:39:46] RECOVERY - mwtask181 Current Load on mwtask181 is OK: LOAD OK - total load average: 12.58, 17.90, 13.30 [05:43:46] PROBLEM - mwtask181 Current Load on mwtask181 is CRITICAL: LOAD CRITICAL - total load average: 24.28, 20.90, 15.50 [05:49:46] PROBLEM - mwtask181 Current Load on mwtask181 is WARNING: LOAD WARNING - total load average: 23.70, 23.25, 18.37 [05:55:46] PROBLEM - mwtask181 Current Load on mwtask181 is CRITICAL: LOAD CRITICAL - total load average: 24.47, 23.84, 20.20 [06:00:57] PROBLEM - cp201 Disk Space on cp201 is WARNING: DISK WARNING - free space: / 49811MiB (10% inode=99%); [06:14:04] PROBLEM - cp171 Disk Space on cp171 is WARNING: DISK WARNING - free space: / 49857MiB (10% inode=99%); [06:19:46] PROBLEM - mwtask181 Current Load on mwtask181 is WARNING: LOAD WARNING - total load average: 11.75, 21.77, 23.13 [06:23:46] RECOVERY - mwtask181 Current Load on mwtask181 is OK: LOAD OK - total load average: 4.65, 12.83, 19.15 [06:37:13] PROBLEM - cp191 Disk Space on cp191 is WARNING: DISK WARNING - free space: / 49937MiB (10% inode=99%); [08:01:16] RECOVERY - matomo151 Check unit status of matomo-archiver-1 on matomo151 is OK: OK: Status of the systemd unit matomo-archiver-1 [09:26:02] PROBLEM - mwtask171 Current Load on mwtask171 is WARNING: LOAD WARNING - total load average: 23.20, 15.33, 7.96 [09:53:56] [Grafana] FIRING: The mediawiki JobQueue backlog is increasing by more than 100 jobs a minute over an extended time period https://grafana.wikitide.net/d/GtxbP1Xnk?from=1758185600000&orgId=1&to=1758189236679 [09:58:56] [Grafana] RESOLVED: MediaWiki Jobs are rapidly increasing https://grafana.wikitide.net/d/GtxbP1Xnk?from=1758185660000&orgId=1&to=1758189260000 [10:07:45] PROBLEM - os201 PowerDNS Recursor on os201 is CRITICAL: Domain 'os201.fsslc.wtnet' was not found by the server [10:07:54] PROBLEM - cp201 PowerDNS Recursor on cp201 is CRITICAL: Domain 'cp201.wikitide.net' was not found by the server [10:09:40] RECOVERY - os201 PowerDNS Recursor on os201 is OK: DNS OK: 0.039 seconds response time. os201.fsslc.wtnet returns 10.0.20.156 [10:09:49] RECOVERY - cp201 PowerDNS Recursor on cp201 is OK: DNS OK: 0.035 seconds response time. cp201.wikitide.net returns 2602:294:0:b39::166 [10:15:48] PROBLEM - graylog161 PowerDNS Recursor on graylog161 is CRITICAL: Domain 'graylog161.fsslc.wtnet' was not found by the server [10:15:52] PROBLEM - swiftobject151 PowerDNS Recursor on swiftobject151 is CRITICAL: Domain 'swiftobject151.fsslc.wtnet' was not found by the server [10:15:52] PROBLEM - eventgate181 PowerDNS Recursor on eventgate181 is CRITICAL: Domain 'eventgate181.fsslc.wtnet' was not found by the server [10:15:52] PROBLEM - mw192 PowerDNS Recursor on mw192 is CRITICAL: Domain 'mw192.fsslc.wtnet' was not found by the server [10:15:56] PROBLEM - mem161 PowerDNS Recursor on mem161 is CRITICAL: Domain 'mem161.fsslc.wtnet' was not found by the server [10:16:04] PROBLEM - db181 PowerDNS Recursor on db181 is CRITICAL: Domain 'db181.fsslc.wtnet' was not found by the server [10:16:11] PROBLEM - reports171 PowerDNS Recursor on reports171 is CRITICAL: Domain 'reports171.fsslc.wtnet' was not found by the server [10:16:14] PROBLEM - os151 PowerDNS Recursor on os151 is CRITICAL: Domain 'os151.fsslc.wtnet' was not found by the server [10:17:42] PROBLEM - mw173 Puppet on mw173 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_3d2png] [10:17:44] RECOVERY - graylog161 PowerDNS Recursor on graylog161 is OK: DNS OK: 0.031 seconds response time. graylog161.fsslc.wtnet returns 10.0.16.130 [10:17:47] RECOVERY - swiftobject151 PowerDNS Recursor on swiftobject151 is OK: DNS OK: 0.035 seconds response time. swiftobject151.fsslc.wtnet returns 10.0.15.117 [10:17:47] RECOVERY - eventgate181 PowerDNS Recursor on eventgate181 is OK: DNS OK: 0.041 seconds response time. eventgate181.fsslc.wtnet returns 10.0.18.147 [10:17:47] RECOVERY - mw192 PowerDNS Recursor on mw192 is OK: DNS OK: 0.031 seconds response time. mw192.fsslc.wtnet returns 10.0.19.161 [10:17:50] RECOVERY - mem161 PowerDNS Recursor on mem161 is OK: DNS OK: 0.025 seconds response time. mem161.fsslc.wtnet returns 10.0.16.131 [10:18:03] RECOVERY - db181 PowerDNS Recursor on db181 is OK: DNS OK: 0.041 seconds response time. db181.fsslc.wtnet returns 10.0.18.102 [10:18:08] RECOVERY - reports171 PowerDNS Recursor on reports171 is OK: DNS OK: 0.033 seconds response time. reports171.fsslc.wtnet returns 10.0.17.139 [10:18:13] RECOVERY - os151 PowerDNS Recursor on os151 is OK: DNS OK: 0.181 seconds response time. os151.fsslc.wtnet returns 10.0.15.111 [10:18:51] PROBLEM - puppet181 Check unit status of listdomains_github_push on puppet181 is CRITICAL: CRITICAL: Status of the systemd unit listdomains_github_push [10:21:34] PROBLEM - phorge171 Puppet on phorge171 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_phorge-extensions] [10:26:31] RECOVERY - puppet181 Check unit status of listdomains_github_push on puppet181 is OK: OK: Status of the systemd unit listdomains_github_push [10:26:36] minor nap [10:30:09] PROBLEM - mwtask181 Current Load on mwtask181 is CRITICAL: LOAD CRITICAL - total load average: 24.46, 15.23, 8.93 [10:30:28] RECOVERY - mwtask171 Current Load on mwtask171 is OK: LOAD OK - total load average: 11.08, 15.97, 19.61 [10:34:03] PROBLEM - mwtask181 Current Load on mwtask181 is WARNING: LOAD WARNING - total load average: 23.86, 20.50, 12.55 [10:37:58] RECOVERY - mwtask181 Current Load on mwtask181 is OK: LOAD OK - total load average: 16.42, 19.37, 14.00 [10:43:43] RECOVERY - mw173 Puppet on mw173 is OK: OK: Puppet is currently enabled, last run 16 seconds ago with 0 failures [10:45:09] RECOVERY - phorge171 Puppet on phorge171 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [10:49:46] PROBLEM - mwtask181 Current Load on mwtask181 is CRITICAL: LOAD CRITICAL - total load average: 24.89, 21.01, 16.94 [10:51:46] RECOVERY - mwtask181 Current Load on mwtask181 is OK: LOAD OK - total load average: 17.99, 20.05, 17.09 [10:55:46] PROBLEM - mwtask181 Current Load on mwtask181 is WARNING: LOAD WARNING - total load average: 22.89, 21.57, 18.37 [11:01:46] PROBLEM - mwtask181 Current Load on mwtask181 is CRITICAL: LOAD CRITICAL - total load average: 24.85, 23.15, 20.08 [11:05:46] PROBLEM - mwtask181 Current Load on mwtask181 is WARNING: LOAD WARNING - total load average: 23.68, 23.87, 21.13 [11:11:46] PROBLEM - mwtask181 Current Load on mwtask181 is CRITICAL: LOAD CRITICAL - total load average: 24.08, 23.46, 21.80 [11:13:46] PROBLEM - mwtask181 Current Load on mwtask181 is WARNING: LOAD WARNING - total load average: 16.96, 20.98, 21.10 [11:15:46] RECOVERY - mwtask181 Current Load on mwtask181 is OK: LOAD OK - total load average: 14.95, 18.72, 20.24 [11:35:46] PROBLEM - mwtask181 Current Load on mwtask181 is WARNING: LOAD WARNING - total load average: 21.22, 19.61, 18.57 [11:41:46] RECOVERY - mwtask181 Current Load on mwtask181 is OK: LOAD OK - total load average: 18.22, 20.14, 19.29 [11:58:25] PROBLEM - mwtask181 Current Load on mwtask181 is CRITICAL: LOAD CRITICAL - total load average: 26.04, 22.27, 20.24 [12:04:17] PROBLEM - mwtask181 Current Load on mwtask181 is WARNING: LOAD WARNING - total load average: 20.06, 22.63, 21.22 [12:15:01] [02DiscordNotifications] 07translatewiki pushed 1 new commit to 03main 13https://github.com/miraheze/DiscordNotifications/commit/7199af197dcbd376597dd583ef8f5ace2290ba0a [12:15:01] 02DiscordNotifications/03main 07translatewiki.net 037199af1 Localisation updates from https://translatewiki.net. [12:15:03] [02ErrorPages] 07translatewiki pushed 1 new commit to 03main 13https://github.com/miraheze/ErrorPages/commit/60a4d28b9370156411de7bf6f4a4eb01405f1c12 [12:15:04] 02ErrorPages/03main 07translatewiki.net 0360a4d28 Localisation updates from https://translatewiki.net. [12:15:05] [02MatomoAnalytics] 07translatewiki pushed 1 new commit to 03main 13https://github.com/miraheze/MatomoAnalytics/commit/a50677c4d213584c2ebb22dc9625cb4a8580f740 [12:15:07] 02MatomoAnalytics/03main 07translatewiki.net 03a50677c Localisation updates from https://translatewiki.net. [12:15:09] [02PDFEmbed] 07translatewiki pushed 1 new commit to 03main 13https://github.com/miraheze/PDFEmbed/commit/faa7e1c48574a9e09d559cfb1b6e4367a3318b7f [12:15:11] [02MirahezeMagic] 07translatewiki pushed 1 new commit to 03main 13https://github.com/miraheze/MirahezeMagic/commit/1acf75a1b5618d48f9d0dee10eb37bdde087edcb [12:15:12] 02PDFEmbed/03main 07translatewiki.net 03faa7e1c Localisation updates from https://translatewiki.net. [12:15:14] 02MirahezeMagic/03main 07translatewiki.net 031acf75a Localisation updates from https://translatewiki.net. [12:15:16] [02ManageWiki] 07translatewiki pushed 1 new commit to 03main 13https://github.com/miraheze/ManageWiki/commit/8c5d774ec03e03c73a9223e55b21c66a53b2c32a [12:15:18] 02ManageWiki/03main 07translatewiki.net 038c5d774 Localisation updates from https://translatewiki.net. [12:16:02] RECOVERY - mwtask181 Current Load on mwtask181 is OK: LOAD OK - total load average: 17.67, 19.23, 20.25 [12:19:41] miraheze/ErrorPages - translatewiki the build passed. [12:19:54] PROBLEM - mwtask181 Current Load on mwtask181 is CRITICAL: LOAD CRITICAL - total load average: 24.05, 21.91, 21.14 [12:19:57] miraheze/MatomoAnalytics - translatewiki the build passed. [12:20:05] miraheze/PDFEmbed - translatewiki the build passed. [12:21:19] miraheze/ManageWiki - translatewiki the build passed. [12:23:49] PROBLEM - mwtask181 Current Load on mwtask181 is WARNING: LOAD WARNING - total load average: 22.73, 22.96, 21.79 [12:26:54] miraheze/MirahezeMagic - translatewiki the build passed. [12:29:46] PROBLEM - mwtask181 Current Load on mwtask181 is CRITICAL: LOAD CRITICAL - total load average: 24.32, 23.71, 22.51 [12:35:46] PROBLEM - mwtask181 Current Load on mwtask181 is WARNING: LOAD WARNING - total load average: 20.09, 22.87, 22.70 [12:40:37] miraheze/DiscordNotifications - translatewiki the build passed. [13:01:46] RECOVERY - mwtask181 Current Load on mwtask181 is OK: LOAD OK - total load average: 18.48, 17.91, 20.14 [13:45:36] [02ssl] 07WikiTideBot pushed 1 new commit to 03main 13https://github.com/miraheze/ssl/commit/b4890796e6b0cfcc44551e5a5d2165c9be8b7390 [13:45:36] 02ssl/03main 07WikiTideBot 03b489079 Bot: Auto-update domain lists [14:03:46] PROBLEM - mwtask181 Current Load on mwtask181 is WARNING: LOAD WARNING - total load average: 22.99, 18.95, 17.46 [14:07:46] RECOVERY - mwtask181 Current Load on mwtask181 is OK: LOAD OK - total load average: 18.86, 19.64, 18.13 [14:28:01] PROBLEM - puppet181 Check unit status of listdomains_github_push on puppet181 is CRITICAL: CRITICAL: Status of the systemd unit listdomains_github_push [14:28:38] PROBLEM - mwtask181 Current Load on mwtask181 is WARNING: LOAD WARNING - total load average: 22.05, 20.18, 18.75 [14:30:35] RECOVERY - mwtask181 Current Load on mwtask181 is OK: LOAD OK - total load average: 20.19, 20.40, 19.03 [14:34:27] PROBLEM - mwtask181 Current Load on mwtask181 is CRITICAL: LOAD CRITICAL - total load average: 25.40, 22.90, 20.36 [14:36:01] RECOVERY - puppet181 Check unit status of listdomains_github_push on puppet181 is OK: OK: Status of the systemd unit listdomains_github_push [14:36:25] PROBLEM - mwtask181 Current Load on mwtask181 is WARNING: LOAD WARNING - total load average: 23.75, 23.15, 20.75 [14:40:20] RECOVERY - mwtask181 Current Load on mwtask181 is OK: LOAD OK - total load average: 15.51, 19.06, 19.65 [15:38:01] PROBLEM - puppet181 Check unit status of listdomains_github_push on puppet181 is CRITICAL: CRITICAL: Status of the systemd unit listdomains_github_push [15:46:01] RECOVERY - puppet181 Check unit status of listdomains_github_push on puppet181 is OK: OK: Status of the systemd unit listdomains_github_push [16:03:46] PROBLEM - mwtask181 Current Load on mwtask181 is WARNING: LOAD WARNING - total load average: 21.71, 19.61, 17.60 [16:07:46] RECOVERY - mwtask181 Current Load on mwtask181 is OK: LOAD OK - total load average: 20.35, 20.26, 18.36 [17:06:06] [02puppet] 07Universal-Omega pushed 1 new commit to 03main 13https://github.com/miraheze/puppet/commit/d12a86381e5de15e2f8e4218fb0ed2798fca4a48 [17:06:06] 02puppet/03main 07CosmicAlpha 03d12a863 Order change… [17:14:49] [02puppet] 07Universal-Omega pushed 1 new commit to 03main 13https://github.com/miraheze/puppet/commit/c365614f161656a311282e37d434ac817dbdcbbe [17:14:50] 02puppet/03main 07CosmicAlpha 03c365614 Add deny for foundation.wikitide.org… [17:22:54] [02puppet] 07Universal-Omega pushed 1 new commit to 03main 13https://github.com/miraheze/puppet/commit/1d169319ebdc44940fb0a7a39fc3266c93514200 [17:22:54] 02puppet/03main 07CosmicAlpha 031d16931 Remove /donate redirect on landing… [17:30:37] [02puppet] 07Universal-Omega created 03landing-css-cache (+1 new commit) 13https://github.com/miraheze/puppet/commit/42ff3ee05ed1 [17:30:37] 02puppet/03landing-css-cache 07CosmicAlpha 0342ff3ee Use long, immutable cache for css files on landing… [17:30:47] [02puppet] 07Universal-Omega opened pull request #4528: Use long, immutable cache for css files on landing (03main...03landing-css-cache) 13https://github.com/miraheze/puppet/pull/4528 [17:30:54] [02puppet] 07coderabbitai[bot] commented on pull request #4528:
[…] 13https://github.com/miraheze/puppet/pull/4528#issuecomment-3308711825 [18:18:08] [02mw-config] 07Universal-Omega created 03metrics (+1 new commit) 13https://github.com/miraheze/mw-config/commit/3abd25c97457 [18:18:08] 02mw-config/03metrics 07CosmicAlpha 033abd25c Send MediaWiki metrics to prometheus [18:18:14] [02mw-config] 07Universal-Omega opened pull request #6114: Send MediaWiki metrics to prometheus (03main...03metrics) 13https://github.com/miraheze/mw-config/pull/6114 [18:19:10] miraheze/mw-config - Universal-Omega the build passed. [18:27:34] PROBLEM - matomo151 Check unit status of matomo-archiver-2 on matomo151 is CRITICAL: CRITICAL: Status of the systemd unit matomo-archiver-2 [18:31:59] [02mw-config] 07SomeMWDev created 03T14248 (+1 new commit) 13https://github.com/miraheze/mw-config/commit/8417b58e91a8 [18:32:01] 02mw-config/03T14248 07SomeRandomDeveloper 038417b58 T14248: Set `$wgDplSettings['allowUnlimitedCategories'] = true;` for bluearchivewiki [18:32:43] [02mw-config] 07github-actions[bot] pushed 1 new commit to 03T14248 13https://github.com/miraheze/mw-config/commit/a74eeb8b77d8cd6e4e206011d0ef27b02e57ff4c [18:32:44] 02mw-config/03T14248 07github-actions 03a74eeb8 CI: lint code to MediaWiki standards… [18:32:55] [02mw-config] 07SomeMWDev opened pull request #6115: T14248: Set `$wgDplSettings['allowUnlimitedCategories'] = true;` for … (03main...03T14248) 13https://github.com/miraheze/mw-config/pull/6115 [18:33:15] miraheze/mw-config - SomeMWDev the build passed. [18:33:42] [02mw-config] 07SomeMWDev merged pull request #6115: T14248: Set `$wgDplSettings['allowUnlimitedCategories'] = true;` for … (03main...03T14248) 13https://github.com/miraheze/mw-config/pull/6115 [18:33:44] [02mw-config] 07SomeMWDev pushed 1 new commit to 03main 13https://github.com/miraheze/mw-config/commit/fe0252ea3ab9aedc651e7c761f3d910638f11f59 [18:33:46] [02mw-config] 07SomeMWDev 04deleted 03T14248 at 03a74eeb8 13https://api.github.com/repos/miraheze/mw-config/commit/a74eeb8 [18:33:48] 02mw-config/03main 07SomeRandomDeveloper 03fe0252e T14248: Set `$wgDplSettings['allowUnlimitedCategories'] = true;` for bluearchivewiki (#6115)… [18:33:49] !log [somerandomdeveloper@mwtask181] starting deploy of {'pull': 'config', 'config': True} to all [18:34:15] !log [somerandomdeveloper@mwtask181] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 26s [18:34:38] miraheze/mw-config - SomeMWDev the build passed. [18:37:37] [02mw-config] 07Universal-Omega pushed 1 new commit to 03metrics 13https://github.com/miraheze/mw-config/commit/adeb9b0d18cedc47631b319885b25a981ca396f3 [18:37:37] 02mw-config/03metrics 07CosmicAlpha 03adeb9b0 - [18:38:31] miraheze/mw-config - Universal-Omega the build passed. [18:43:29] !log [macfan@mwtask181] sudo -u www-data php /srv/mediawiki/1.44/maintenance/run.php /srv/mediawiki/1.44/maintenance/importDump.php --wiki=railannouncementswiki dump.xml --no-updates (START) [18:44:09] !log [macfan@mwtask181] sudo -u www-data php /srv/mediawiki/1.44/maintenance/run.php /srv/mediawiki/1.44/maintenance/importDump.php --wiki=railannouncementswiki dump.xml --no-updates (END - exit=0) [18:44:10] !log [macfan@mwtask181] sudo -u www-data php /srv/mediawiki/1.44/maintenance/run.php /srv/mediawiki/1.44/maintenance/rebuildall.php --wiki=railannouncementswiki (START) [18:47:15] !log [macfan@mwtask181] sudo -u www-data php /srv/mediawiki/1.44/maintenance/run.php /srv/mediawiki/1.44/maintenance/rebuildall.php --wiki=railannouncementswiki (END - exit=0) [18:47:17] !log [macfan@mwtask181] sudo -u www-data php /srv/mediawiki/1.44/maintenance/run.php /srv/mediawiki/1.44/maintenance/initSiteStats.php --wiki=railannouncementswiki --update (END - exit=0) [19:06:36] PROBLEM - cp171 Varnish Backends on cp171 is CRITICAL: 1 backends are down. mw193 [19:06:37] PROBLEM - cp191 Varnish Backends on cp191 is CRITICAL: 1 backends are down. mw193 [19:06:42] PROBLEM - mw193 HTTPS on mw193 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10003 milliseconds with 0 bytes received [19:06:43] PROBLEM - db171 Current Load on db171 is CRITICAL: LOAD CRITICAL - total load average: 79.44, 33.88, 13.93 [19:06:51] PROBLEM - cp201 Varnish Backends on cp201 is CRITICAL: 3 backends are down. mw163 mw183 mw193 [19:08:36] RECOVERY - cp171 Varnish Backends on cp171 is OK: All 31 backends are healthy [19:08:37] RECOVERY - cp191 Varnish Backends on cp191 is OK: All 31 backends are healthy [19:08:41] RECOVERY - mw193 HTTPS on mw193 is OK: HTTP OK: HTTP/2 410 - Status line output matched "HTTP/2 410" - 4112 bytes in 0.081 second response time [19:08:51] RECOVERY - cp201 Varnish Backends on cp201 is OK: All 31 backends are healthy [19:13:40] [02mw-config] 07Universal-Omega merged pull request #6114: Send MediaWiki metrics to prometheus (03main...03metrics) 13https://github.com/miraheze/mw-config/pull/6114 [19:13:40] [02mw-config] 07Universal-Omega pushed 1 new commit to 03main 13https://github.com/miraheze/mw-config/commit/ce0e6d27bf4d8bea95e4c07dc394a94e78482bdf [19:13:41] 02mw-config/03main 07CosmicAlpha 03ce0e6d2 Send MediaWiki metrics to prometheus [19:13:43] [02mw-config] 07Universal-Omega 04deleted 03metrics at 03adeb9b0 13https://api.github.com/repos/miraheze/mw-config/commit/adeb9b0 [19:14:00] !log [universalomega@mwtask181] starting deploy of {'pull': 'config', 'config': True} to all [19:14:27] !log [universalomega@mwtask181] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 26s [19:14:34] miraheze/mw-config - Universal-Omega the build passed. [19:14:37] PROBLEM - db171 Current Load on db171 is WARNING: LOAD WARNING - total load average: 1.37, 10.43, 10.77 [19:16:35] RECOVERY - db171 Current Load on db171 is OK: LOAD OK - total load average: 1.06, 7.29, 9.57 [19:16:52] [02mw-config] 07pskyechology pushed 1 new commit to 03main 13https://github.com/miraheze/mw-config/commit/b8279edea3051a2f756aa0fd7b456efed901417f [19:16:52] 02mw-config/03main 07Skye 03b8279ed Set wgVectorNightMode for hullrotwiki… [19:17:44] miraheze/mw-config - pskyechology the build passed. [19:17:55] !log [skye@mwtask181] starting deploy of {'pull': 'config', 'config': True} to all [19:18:19] !log [skye@mwtask181] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 24s [19:24:49] PROBLEM - matomo151 Disk Space on matomo151 is WARNING: DISK WARNING - free space: / 1962MiB (10% inode=89%); [20:02:18] !log [skye@mwtask181] sudo -u www-data php /srv/mediawiki/1.44/maintenance/run.php MirahezeMagic:ResetWiki --wiki=loginwiki --dbname=thechurchofthestatuewiki --requester='Unit Mango' (END - exit=0) [21:02:02] PROBLEM - mwtask171 Current Load on mwtask171 is WARNING: LOAD WARNING - total load average: 23.09, 17.22, 9.91 [21:02:49] RECOVERY - matomo151 Disk Space on matomo151 is OK: DISK OK - free space: / 6517MiB (36% inode=89%); [21:04:02] RECOVERY - mwtask171 Current Load on mwtask171 is OK: LOAD OK - total load average: 5.45, 12.61, 9.12 [21:06:56] PROBLEM - mwtask161 Current Load on mwtask161 is WARNING: LOAD WARNING - total load average: 21.28, 17.68, 10.79 [21:08:56] RECOVERY - mwtask161 Current Load on mwtask161 is OK: LOAD OK - total load average: 10.56, 14.83, 10.59 [21:27:13] [02ManageWiki] 07Universal-Omega created 03CacheUpdateJob (+1 new commit) 13https://github.com/miraheze/ManageWiki/commit/4e5b52668ce7 [21:27:13] 02ManageWiki/03CacheUpdateJob 07CosmicAlpha 034e5b526 Convert CacheUpdate to a job [21:27:18] [02ManageWiki] 07Universal-Omega opened pull request #746: Convert CacheUpdate to a job (03main...03CacheUpdateJob) 13https://github.com/miraheze/ManageWiki/pull/746 [21:27:25] [02ManageWiki] 07coderabbitai[bot] commented on pull request #746:
[…] 13https://github.com/miraheze/ManageWiki/pull/746#issuecomment-3309777646 [21:30:59] miraheze/ManageWiki - Universal-Omega the build has errored. [21:40:46] [02ManageWiki] 07Universal-Omega pushed 1 new commit to 03CacheUpdateJob 13https://github.com/miraheze/ManageWiki/commit/20835a0ffb1d26706c70da45fa2e85f1589b4b30 [21:40:47] 02ManageWiki/03CacheUpdateJob 07CosmicAlpha 0320835a0 - [21:44:24] [02ManageWiki] 07Universal-Omega pushed 1 new commit to 03CacheUpdateJob 13https://github.com/miraheze/ManageWiki/commit/6d6e49f7892775541cea916738593f2e3194f2a9 [21:44:24] 02ManageWiki/03CacheUpdateJob 07CosmicAlpha 036d6e49f Update [21:44:26] miraheze/ManageWiki - Universal-Omega the build has errored. [21:48:14] miraheze/ManageWiki - Universal-Omega the build has errored. [21:54:40] [02ManageWiki] 07Universal-Omega pushed 1 new commit to 03CacheUpdateJob 13https://github.com/miraheze/ManageWiki/commit/34b9864a0d28d78a8ee97dc40751a012e3e95a83 [21:54:40] 02ManageWiki/03CacheUpdateJob 07CosmicAlpha 0334b9864 Keep service [21:57:43] [02ManageWiki] 07Universal-Omega pushed 1 new commit to 03CacheUpdateJob 13https://github.com/miraheze/ManageWiki/commit/f2d2a76bfd8f1911fca354eb87ef58c9d6e254fa [21:57:43] 02ManageWiki/03CacheUpdateJob 07CosmicAlpha 03f2d2a76 Update [21:57:59] [02ManageWiki] 07Universal-Omega pushed 1 new commit to 03CacheUpdateJob 13https://github.com/miraheze/ManageWiki/commit/59ba7bab3fbc38706546cf6a5ff7e23ad740a36d [21:57:59] 02ManageWiki/03CacheUpdateJob 07CosmicAlpha 0359ba7ba - [21:58:26] miraheze/ManageWiki - Universal-Omega the build has errored. [22:00:53] [02ManageWiki] 07Universal-Omega pushed 1 new commit to 03CacheUpdateJob 13https://github.com/miraheze/ManageWiki/commit/31c751125a4053b7ff1272b5d4a3f091ad1ce5fe [22:00:53] 02ManageWiki/03CacheUpdateJob 07CosmicAlpha 0331c7511 Update [22:01:32] miraheze/ManageWiki - Universal-Omega the build has errored. [22:02:24] [02ManageWiki] 07Universal-Omega pushed 1 new commit to 03CacheUpdateJob 13https://github.com/miraheze/ManageWiki/commit/176f6744d5a9aedd0c3eec44011e2ed7dc1adab2 [22:02:24] 02ManageWiki/03CacheUpdateJob 07CosmicAlpha 03176f674 Update [22:03:44] [02ManageWiki] 07Universal-Omega pushed 1 new commit to 03CacheUpdateJob 13https://github.com/miraheze/ManageWiki/commit/f8363d3e757a3018e4ab557deba66fc05622722f [22:03:44] 02ManageWiki/03CacheUpdateJob 07CosmicAlpha 03f8363d3 Update [22:04:11] [02ManageWiki] 07Universal-Omega pushed 1 new commit to 03CacheUpdateJob 13https://github.com/miraheze/ManageWiki/commit/9d4a61d126c017cfb953c9d9cb0f9a7f773b1336 [22:04:11] 02ManageWiki/03CacheUpdateJob 07CosmicAlpha 039d4a61d Remove [22:06:17] [02mediawiki-repos] 07SomeMWDev created 03add-floatingui (+1 new commit) 13https://github.com/miraheze/mediawiki-repos/commit/facc130c55f6 [22:06:17] 02mediawiki-repos/03add-floatingui 07SomeRandomDeveloper 03facc130 T13843: Install FloatingUI [22:06:31] [02mediawiki-repos] 07SomeMWDev opened pull request #92: T13843: Install FloatingUI (03main...03add-floatingui) 13https://github.com/miraheze/mediawiki-repos/pull/92 [22:06:39] [02mediawiki-repos] 07coderabbitai[bot] commented on pull request #92:
[…] 13https://github.com/miraheze/mediawiki-repos/pull/92#issuecomment-3309859652 [22:08:33] [02mediawiki-repos] 07SomeMWDev merged pull request #92: T13843: Install FloatingUI (03main...03add-floatingui) 13https://github.com/miraheze/mediawiki-repos/pull/92 [22:08:33] [02mediawiki-repos] 07SomeMWDev pushed 1 new commit to 03main 13https://github.com/miraheze/mediawiki-repos/commit/1674da0d9115431820658de85abc4f639bd14656 [22:08:33] 02mediawiki-repos/03main 07SomeRandomDeveloper 031674da0 T13843: Install FloatingUI (#92) [22:08:35] [02mediawiki-repos] 07SomeMWDev 04deleted 03add-floatingui at 03facc130 13https://api.github.com/repos/miraheze/mediawiki-repos/commit/facc130 [22:09:58] [02ManageWiki] 07Universal-Omega pushed 1 new commit to 03CacheUpdateJob 13https://github.com/miraheze/ManageWiki/commit/326b719e356583b84d4b8249edd1a61090c2c9d4 [22:09:58] 02ManageWiki/03CacheUpdateJob 07CosmicAlpha 03326b719 Update JOB_NAME [22:10:04] miraheze/ManageWiki - Universal-Omega the build passed. [22:15:56] miraheze/ManageWiki - Universal-Omega the build passed. [22:19:23] [02mw-config] 07SomeMWDev created 03T13843 (+1 new commit) 13https://github.com/miraheze/mw-config/commit/6f52ee72b9ba [22:19:23] 02mw-config/03T13843 07SomeRandomDeveloper 036f52ee7 T13843: Add FloatingUI extension to ManageWiki [22:19:55] !log [somerandomdeveloper@test151] starting deploy of {'config': True} to test151 [22:19:56] !log [somerandomdeveloper@test151] finished deploy of {'config': True} to test151 - SUCCESS in 0s [22:21:24] !log [somerandomdeveloper@test151] starting deploy of {'l10n': True, 'extension_list': True, 'versions': ['1.44', '1.45']} to test151 [22:23:41] !log [somerandomdeveloper@test151] finished deploy of {'l10n': True, 'extension_list': True, 'versions': ['1.44', '1.45']} to test151 - SUCCESS in 137s [22:24:45] !log [somerandomdeveloper@test151] starting deploy of {'world': True, 'versions': ['1.44', '1.45']} to test151 [22:25:31] !log [somerandomdeveloper@test151] finished deploy of {'world': True, 'versions': ['1.44', '1.45']} to test151 - SUCCESS in 46s [22:32:22] !log [somerandomdeveloper@mwtask181] sudo -u www-data php /srv/mediawiki/1.44/maintenance/run.php cleanupBlocks --wiki=tjgvideoswiki --dry-run (END - exit=0) [22:39:07] [02mw-config] 07SomeMWDev opened pull request #6116: T13843: Add FloatingUI extension to ManageWiki (03main...03T13843) 13https://github.com/miraheze/mw-config/pull/6116 [22:40:00] miraheze/mw-config - SomeMWDev the build passed. [22:45:00] [02mw-config] 07SomeMWDev pushed 1 new commit to 03main 13https://github.com/miraheze/mw-config/commit/32a660177456993064af764ff1e4a3b9ebab582f [22:45:00] 02mw-config/03main 07SomeRandomDeveloper 0332a6601 T13843: Add FloatingUI extension to ManageWiki (#6116) [22:45:00] [02mw-config] 07SomeMWDev merged pull request #6116: T13843: Add FloatingUI extension to ManageWiki (03main...03T13843) 13https://github.com/miraheze/mw-config/pull/6116 [22:45:02] [02mw-config] 07SomeMWDev 04deleted 03T13843 at 036f52ee7 13https://api.github.com/repos/miraheze/mw-config/commit/6f52ee7 [22:45:36] !log [somerandomdeveloper@test151] starting deploy of {'pull': 'config', 'config': True} to test151 [22:45:37] !log [somerandomdeveloper@test151] finished deploy of {'pull': 'config', 'config': True} to test151 - SUCCESS in 0s [22:45:56] miraheze/mw-config - SomeMWDev the build passed. [22:46:34] !log [somerandomdeveloper@mwtask181] starting deploy of {'pull': 'config', 'config': True, 'l10n': True, 'extension_list': True, 'folders': '1.44/extensions/FloatingUI', 'versions': '1.44'} to all [22:55:23] !log [somerandomdeveloper@mwtask181] finished deploy of {'pull': 'config', 'config': True, 'l10n': True, 'extension_list': True, 'folders': '1.44/extensions/FloatingUI', 'versions': '1.44'} to all - SUCCESS in 529s [23:03:09] [02ManageWiki] 07Universal-Omega created 03fix-cache (+1 new commit) 13https://github.com/miraheze/ManageWiki/commit/42958bece27e [23:03:09] 02ManageWiki/03fix-cache 07CosmicAlpha 0342958be Fix CacheUpdate [23:03:14] [02ManageWiki] 07Universal-Omega opened pull request #747: Fix CacheUpdate (03main...03fix-cache) 13https://github.com/miraheze/ManageWiki/pull/747 [23:03:20] [02ManageWiki] 07coderabbitai[bot] commented on pull request #747:
[…] 13https://github.com/miraheze/ManageWiki/pull/747#issuecomment-3309956532 [23:08:59] miraheze/ManageWiki - Universal-Omega the build passed. [23:44:15] [02ManageWiki] 07Universal-Omega created 03rest (+1 new commit) 13https://github.com/miraheze/ManageWiki/commit/d96f8e940d68 [23:44:15] 02ManageWiki/03rest 07CosmicAlpha 03d96f8e9 Add Rest API to reset cache [23:44:19] [02ManageWiki] 07Universal-Omega opened pull request #748: Add Rest API to reset cache (03main...03rest) 13https://github.com/miraheze/ManageWiki/pull/748 [23:44:27] [02ManageWiki] 07coderabbitai[bot] commented on pull request #748:
[…] 13https://github.com/miraheze/ManageWiki/pull/748#issuecomment-3310023221 [23:45:08] [02ManageWiki] 07Universal-Omega pushed 1 new commit to 03rest 13https://github.com/miraheze/ManageWiki/commit/bcb25bfc5ed3ce3042f9658e574ae81b47cc281c [23:45:08] 02ManageWiki/03rest 07CosmicAlpha 03bcb25bf Add [23:46:44] [02ManageWiki] 07github-actions[bot] pushed 1 new commit to 03rest 13https://github.com/miraheze/ManageWiki/commit/d2c2ba82f5c03f8b48746349c5bc071371e4ebe2 [23:46:44] 02ManageWiki/03rest 07github-actions 03d2c2ba8 CI: lint code to MediaWiki standards… [23:47:34] [02ManageWiki] 07Universal-Omega pushed 1 new commit to 03rest 13https://github.com/miraheze/ManageWiki/commit/bbbc2d3cf1b32249bd2922de217d2e7aef9d6c3b [23:47:35] 02ManageWiki/03rest 07CosmicAlpha 03bbbc2d3 Update [23:51:12] miraheze/ManageWiki - Universal-Omega the build has errored.