[00:01:01] [02statichelp] 07WikiTideBot pushed 1 new commit to 03main 13https://github.com/miraheze/statichelp/commit/e0f3628588cf81d80731e93bf3b96669a3bdfb5e [00:01:01] 02statichelp/03main 07WikiTideBot 03e0f3628 Bot: Auto-update Tech namespace pages 2026-07-28 00:00:58 [01:32:53] [02RequestCustomDomain] 07dependabot[bot] created 03dependabot/npm_and_yarn/eslint-config-wikimedia-0.32.5 (+1 new commit) 13https://github.com/miraheze/RequestCustomDomain/commit/d1ca68bf9caa [01:32:53] 02RequestCustomDomain/03dependabot/npm_and_yarn/eslint-config-wikimedia-0.32.5 07dependabot[bot] 03d1ca68b Bump eslint-config-wikimedia from 0.32.4 to 0.32.5… [01:32:55] [02RequestCustomDomain] 07dependabot[bot] opened pull request #116: Bump eslint-config-wikimedia from 0.32.4 to 0.32.5 (03main...03dependabot/npm_and_yarn/eslint-config-wikimedia-0.32.5) 13https://github.com/miraheze/RequestCustomDomain/pull/116 [01:32:57] [02RequestCustomDomain] 07dependabot[bot] added the label 'javascript' to pull request #116 (Bump eslint-config-wikimedia from 0.32.4 to 0.32.5) 13https://github.com/miraheze/RequestCustomDomain/pull/116 [01:32:59] [02RequestCustomDomain] 07dependabot[bot] added the label 'dependencies' to pull request #116 (Bump eslint-config-wikimedia from 0.32.4 to 0.32.5) 13https://github.com/miraheze/RequestCustomDomain/pull/116 [01:33:01] [02RequestCustomDomain] 07dependabot[bot] added the label 'dependencies' to pull request #116 (Bump eslint-config-wikimedia from 0.32.4 to 0.32.5) 13https://github.com/miraheze/RequestCustomDomain/pull/116 [01:33:03] [02RequestCustomDomain] 07dependabot[bot] added the label 'javascript' to pull request #116 (Bump eslint-config-wikimedia from 0.32.4 to 0.32.5) 13https://github.com/miraheze/RequestCustomDomain/pull/116 [01:37:39] miraheze/RequestCustomDomain - dependabot[bot] the build passed. [04:43:43] PROBLEM - cp161 HTTP 4xx/5xx ERROR Rate on cp161 is CRITICAL: CRITICAL - NGINX Error Rate is 63% [04:53:43] PROBLEM - cp161 HTTP 4xx/5xx ERROR Rate on cp161 is WARNING: WARNING - NGINX Error Rate is 49% [04:57:43] RECOVERY - cp161 HTTP 4xx/5xx ERROR Rate on cp161 is OK: OK - NGINX Error Rate is 32% [06:53:43] PROBLEM - cp161 HTTP 4xx/5xx ERROR Rate on cp161 is CRITICAL: CRITICAL - NGINX Error Rate is 66% [07:00:23] [02ssl] 07WikiTideBot pushed 1 new commit to 03main 13https://github.com/miraheze/ssl/commit/d1dea84584f604f6445b08c6e353c6690bc8238d [07:00:23] 02ssl/03main 07WikiTideBot 03d1dea84 Bot: Auto-update domain lists [07:01:43] PROBLEM - cp161 HTTP 4xx/5xx ERROR Rate on cp161 is WARNING: WARNING - NGINX Error Rate is 54% [07:09:43] RECOVERY - cp161 HTTP 4xx/5xx ERROR Rate on cp161 is OK: OK - NGINX Error Rate is 38% [08:36:03] PROBLEM - cp161 HTTP 4xx/5xx ERROR Rate on cp161 is CRITICAL: CRITICAL - NGINX Error Rate is 66% [08:38:00] PROBLEM - cp161 HTTP 4xx/5xx ERROR Rate on cp161 is WARNING: WARNING - NGINX Error Rate is 45% [08:41:57] PROBLEM - cp161 HTTP 4xx/5xx ERROR Rate on cp161 is CRITICAL: CRITICAL - NGINX Error Rate is 62% [08:45:57] PROBLEM - cp161 HTTP 4xx/5xx ERROR Rate on cp161 is WARNING: WARNING - NGINX Error Rate is 48% [08:47:57] RECOVERY - cp161 HTTP 4xx/5xx ERROR Rate on cp161 is OK: OK - NGINX Error Rate is 33% [10:21:23] [02mw-config] 07Reception123 created 03Reception123-patch-2 (+1 new commit) 13https://github.com/miraheze/mw-config/commit/516a4508521b [10:21:23] 02mw-config/03Reception123-patch-2 07Reception123 03516a450 add 4 domains to the CSP… [10:21:28] [02mw-config] 07Reception123 opened pull request #6474: add 4 domains to the CSP (03main...03Reception123-patch-2) 13https://github.com/miraheze/mw-config/pull/6474 [10:21:52] [02mw-config] 07Reception123 pushed 1 new commit to 03Reception123-patch-2 13https://github.com/miraheze/mw-config/commit/db52f7700c407108f379f2d54ae8f22b0b0b0210 [10:21:54] 02mw-config/03Reception123-patch-2 07Reception123 03db52f77 Update ContentSecurityPolicy.php [10:21:57] PROBLEM - cp161 HTTP 4xx/5xx ERROR Rate on cp161 is WARNING: WARNING - NGINX Error Rate is 41% [10:22:28] miraheze/mw-config - Reception123 the build has errored. [10:22:49] miraheze/mw-config - Reception123 the build has errored. [10:22:50] [02CreateWiki] 07Reception123 merged pull request #828: add option to record closure reasons (T15629) (03main...03Reception123-patch-5) 13https://github.com/miraheze/CreateWiki/pull/828 [10:22:50] [02CreateWiki] 07Reception123 pushed 1 new commit to 03main 13https://github.com/miraheze/CreateWiki/commit/76d61ba463e8553ea107326d81f292b975cc81fb [10:22:50] 02CreateWiki/03main 07Reception123 0376d61ba add option to record closure reasons (T15629) (#828)… [10:22:51] [02CreateWiki] 07Reception123 04deleted 03Reception123-patch-5 at 0378c9d47 13https://api.github.com/repos/miraheze/CreateWiki/commit/78c9d47 [10:23:57] RECOVERY - cp161 HTTP 4xx/5xx ERROR Rate on cp161 is OK: OK - NGINX Error Rate is 38% [10:25:55] [02mw-config] 07Reception123 commented on pull request #6471: Thanks for the suggestion, probably best to indeed rename to Trust and Safety action rather than mentioning the ToU. As for a request for Stewards, what situation would you have in mind where Stewards would close a wiki that's not the result of a […] 13https://github.com/miraheze/mw-config/pull/6471#issuecomment-5102940006 [10:30:32] miraheze/CreateWiki - Reception123 the build passed. [10:35:43] [02ManageWiki] 07Reception123 pushed 1 new commit to 03Reception123-patch-5 13https://github.com/miraheze/ManageWiki/commit/cdcb757bab817f3549555793e3b065bd0c437dc9 [10:35:43] 02ManageWiki/03Reception123-patch-5 07Reception123 03cdcb757 Update en.json [10:37:38] PROBLEM - test151 Check unit status of mediawiki_job_mediamoderation-scan on test151 is CRITICAL: CRITICAL: Status of the systemd unit mediawiki_job_mediamoderation-scan [10:41:40] miraheze/ManageWiki - Reception123 the build passed. [10:43:38] !log [reception@test151] sudo -u www-data php /srv/mediawiki/1.46/maintenance/run.php /srv/mediawiki/1.46/maintenance/sql.php --wiki=metawikibeta (END - exit=33280) [10:43:41] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [10:58:02] @reception123 why use `mwscript` here? [11:06:19] Forgot to use no-log. It was part of a test that I reverted [11:08:09] if you use `sql` you don't need no-log [11:20:13] Oh I know but it's easier to type mwscript than the whole path [11:35:21] What path [11:35:27] sql metawikibeta [11:35:32] that's all you need to type [11:35:38] RECOVERY - test151 Check unit status of mediawiki_job_mediamoderation-scan on test151 is OK: OK: Status of the systemd unit mediawiki_job_mediamoderation-scan [11:36:35] We created that like 15 months ago as an alias to make it easier [11:36:54] There's sql, mweval and shell [11:37:23] which are the equivalent of doing mwscript sql/eval/shell --no-log --config [11:37:31] oh, I had no idea that existed [11:37:33] will use from now on [11:37:50] Would make your life a lot easier [11:39:22] Btw if there's anything that's annoyingly long to type out, do ask for shorter versions of it @reception123 [11:39:31] Not like every single maint script [11:39:39] But if there's common things that can be made simpler [11:41:00] I'll let you know if I think of anything [11:41:13] Overall things are quite fast to type out I think [11:42:43] That means our SRE tooling is doing well [12:07:39] The import incantations are kind of annoying since they require several mwscript commands one after another. IIRC Claire has a script for this? [12:15:09] @blankeclair wanna make it an official piece of our tooling? [12:42:00] `mwimport`? [12:42:10] [[user:theWWRNerdGuy/imports]] [12:42:16] [12:49:41] please help i have an 8 am class on friday [13:31:16] !log [petramagna@test151] starting deploy of {'versions': ['1.45', '1.46'], 'upgrade_extensions': 'TableProgressTracking'} to test151 [13:31:18] !log [petramagna@test151] finished deploy of {'versions': ['1.45', '1.46'], 'upgrade_extensions': 'TableProgressTracking'} to test151 - SUCCESS in 1s [13:31:19] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [13:31:22] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [13:33:47] !log [petramagna@mwtask181] starting deploy of {'versions': '1.45', 'upgrade_extensions': 'TableProgressTracking'} to all [13:33:50] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [13:34:12] !log [petramagna@mwtask181] finished deploy of {'versions': '1.45', 'upgrade_extensions': 'TableProgressTracking'} to all - SUCCESS in 25s [13:34:15] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [13:37:35] You'd have to be Skye and do an internship with us so I can set your schedule [13:37:41] I can't change your class schedule [13:40:04] Oh this is really nice. The only thing in tech namespace we have right now is https://meta.miraheze.org/wiki/Tech:Import_guideline and this will be a great addition. [13:40:45] It's kind of a shame that python-functions is in limbo. Would be nice to sync it with puppet and add aliases, if that's not already done. [13:43:15] [02WikiTideDebug] 07dependabot[bot] created 03dependabot/npm_and_yarn/eslint-config-wikimedia-0.32.5 (+1 new commit) 13https://github.com/miraheze/WikiTideDebug/commit/4cb2187a6f41 [13:43:17] 02WikiTideDebug/03dependabot/npm_and_yarn/eslint-config-wikimedia-0.32.5 07dependabot[bot] 034cb2187 Bump eslint-config-wikimedia from 0.32.4 to 0.32.5… [13:43:19] [02WikiTideDebug] 07dependabot[bot] added the label 'dependencies' to pull request #36 (Bump eslint-config-wikimedia from 0.32.4 to 0.32.5) 13https://github.com/miraheze/WikiTideDebug/pull/36 [13:43:21] [02WikiTideDebug] 07dependabot[bot] added the label 'javascript' to pull request #36 (Bump eslint-config-wikimedia from 0.32.4 to 0.32.5) 13https://github.com/miraheze/WikiTideDebug/pull/36 [13:43:23] [02WikiTideDebug] 07dependabot[bot] opened pull request #36: Bump eslint-config-wikimedia from 0.32.4 to 0.32.5 (03main...03dependabot/npm_and_yarn/eslint-config-wikimedia-0.32.5) 13https://github.com/miraheze/WikiTideDebug/pull/36 [13:43:25] [02WikiTideDebug] 07dependabot[bot] added the label 'dependencies' to pull request #36 (Bump eslint-config-wikimedia from 0.32.4 to 0.32.5) 13https://github.com/miraheze/WikiTideDebug/pull/36 [13:43:27] [02WikiTideDebug] 07dependabot[bot] added the label 'javascript' to pull request #36 (Bump eslint-config-wikimedia from 0.32.4 to 0.32.5) 13https://github.com/miraheze/WikiTideDebug/pull/36 [13:52:51] [02ImportDump] 07dependabot[bot] created 03dependabot/npm_and_yarn/eslint-config-wikimedia-0.32.5 (+1 new commit) 13https://github.com/miraheze/ImportDump/commit/be756d1c489f [13:52:51] 02ImportDump/03dependabot/npm_and_yarn/eslint-config-wikimedia-0.32.5 07dependabot[bot] 03be756d1 Bump eslint-config-wikimedia from 0.32.4 to 0.32.5… [13:52:55] [02ImportDump] 07dependabot[bot] added the label 'dependencies' to pull request #176 (Bump eslint-config-wikimedia from 0.32.4 to 0.32.5) 13https://github.com/miraheze/ImportDump/pull/176 [13:52:55] [02ImportDump] 07dependabot[bot] opened pull request #176: Bump eslint-config-wikimedia from 0.32.4 to 0.32.5 (03main...03dependabot/npm_and_yarn/eslint-config-wikimedia-0.32.5) 13https://github.com/miraheze/ImportDump/pull/176 [13:52:57] [02ImportDump] 07dependabot[bot] added the label 'javascript' to pull request #176 (Bump eslint-config-wikimedia from 0.32.4 to 0.32.5) 13https://github.com/miraheze/ImportDump/pull/176 [13:52:59] [02ImportDump] 07dependabot[bot] added the label 'dependencies' to pull request #176 (Bump eslint-config-wikimedia from 0.32.4 to 0.32.5) 13https://github.com/miraheze/ImportDump/pull/176 [13:53:01] [02ImportDump] 07dependabot[bot] added the label 'javascript' to pull request #176 (Bump eslint-config-wikimedia from 0.32.4 to 0.32.5) 13https://github.com/miraheze/ImportDump/pull/176 [13:58:01] miraheze/ImportDump - dependabot[bot] the build passed. [14:29:18] I really need to force myself to find some time to finish that off [14:46:51] you'll be fine :3 [14:47:09] if it makes you feel any better I often straight up didn't show up to 9am lectures for most of uni [15:00:24] [02ssl] 07WikiTideBot pushed 1 new commit to 03main 13https://github.com/miraheze/ssl/commit/7cf1bc75a5c181e7fd148b6d04ee764848512b75 [15:00:24] 02ssl/03main 07WikiTideBot 037cf1bc7 Bot: Auto-update domain lists [15:13:10] PROBLEM - swiftobject191 APT on swiftobject191 is CRITICAL: APT CRITICAL: 116 packages available for upgrade (15 critical updates). [15:13:31] PROBLEM - mem161 APT on mem161 is CRITICAL: APT CRITICAL: 98 packages available for upgrade (15 critical updates). [15:14:01] PROBLEM - puppet181 APT on puppet181 is CRITICAL: APT CRITICAL: 56 packages available for upgrade (15 critical updates). [15:14:19] PROBLEM - mwtask161 APT on mwtask161 is CRITICAL: APT CRITICAL: 163 packages available for upgrade (15 critical updates). [15:14:22] PROBLEM - swiftobject201 APT on swiftobject201 is CRITICAL: APT CRITICAL: 116 packages available for upgrade (15 critical updates). [15:14:36] PROBLEM - mwtask151 APT on mwtask151 is CRITICAL: APT CRITICAL: 163 packages available for upgrade (15 critical updates). [15:15:15] PROBLEM - mw173 APT on mw173 is CRITICAL: APT CRITICAL: 158 packages available for upgrade (15 critical updates). [15:15:36] PROBLEM - swiftac171 APT on swiftac171 is CRITICAL: APT CRITICAL: 111 packages available for upgrade (15 critical updates). [15:16:17] [02ManageWiki] 07Reception123 merged pull request #794: add option to record closure reasons (T15629) (03main...03Reception123-patch-5) 13https://github.com/miraheze/ManageWiki/pull/794 [15:16:17] [02ManageWiki] 07Reception123 pushed 1 new commit to 03main 13https://github.com/miraheze/ManageWiki/commit/3cfcc348376f1914d8a2299779445281f068460d [15:16:18] 02ManageWiki/03main 07Reception123 033cfcc34 add option to record closure reasons (T15629) (#794)… [15:16:19] PROBLEM - swiftobject181 APT on swiftobject181 is CRITICAL: APT CRITICAL: 116 packages available for upgrade (15 critical updates). [15:16:20] [02ManageWiki] 07Reception123 04deleted 03Reception123-patch-5 at 03cdcb757 13https://api.github.com/repos/miraheze/ManageWiki/commit/cdcb757 [15:16:31] PROBLEM - phorge171 APT on phorge171 is CRITICAL: APT CRITICAL: 101 packages available for upgrade (15 critical updates). [15:17:17] PROBLEM - db161 APT on db161 is CRITICAL: APT CRITICAL: 108 packages available for upgrade (15 critical updates). [15:17:18] !log [reception@mwtask181] starting deploy of {'l10n': True, 'versions': '1.45', 'upgrade_extensions': 'CreateWiki'} to all [15:17:22] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:18:01] PROBLEM - cloud15 APT on cloud15 is CRITICAL: APT CRITICAL: 164 packages available for upgrade (9 critical updates). [15:18:44] PROBLEM - mw193 APT on mw193 is CRITICAL: APT CRITICAL: 158 packages available for upgrade (15 critical updates). [15:18:46] PROBLEM - os151 APT on os151 is CRITICAL: APT CRITICAL: 106 packages available for upgrade (15 critical updates). [15:18:54] PROBLEM - os201 APT on os201 is CRITICAL: APT CRITICAL: 105 packages available for upgrade (15 critical updates). [15:18:57] PROBLEM - ns1 APT on ns1 is CRITICAL: APT CRITICAL: 100 packages available for upgrade (15 critical updates). [15:18:59] PROBLEM - mem151 APT on mem151 is CRITICAL: APT CRITICAL: 98 packages available for upgrade (15 critical updates). [15:21:00] PROBLEM - mw171 APT on mw171 is CRITICAL: APT CRITICAL: 158 packages available for upgrade (15 critical updates). [15:21:07] PROBLEM - db171 APT on db171 is CRITICAL: APT CRITICAL: 109 packages available for upgrade (15 critical updates). [15:21:19] PROBLEM - cloud21 APT on cloud21 is CRITICAL: APT CRITICAL: 156 packages available for upgrade (9 critical updates). [15:21:39] miraheze/ManageWiki - Reception123 the build passed. [15:21:59] PROBLEM - db201 APT on db201 is CRITICAL: APT CRITICAL: 120 packages available for upgrade (15 critical updates). [15:22:29] PROBLEM - db182 APT on db182 is CRITICAL: APT CRITICAL: 115 packages available for upgrade (15 critical updates). [15:23:13] PROBLEM - kafka182 APT on kafka182 is CRITICAL: APT CRITICAL: 111 packages available for upgrade (15 critical updates). [15:23:36] [02MediaWikiDebugJS] 07dependabot[bot] created 03dependabot/npm_and_yarn/eslint-config-wikimedia-0.32.5 (+1 new commit) 13https://github.com/miraheze/MediaWikiDebugJS/commit/572ba2443969 [15:23:36] 02MediaWikiDebugJS/03dependabot/npm_and_yarn/eslint-config-wikimedia-0.32.5 07dependabot[bot] 03572ba24 Bump eslint-config-wikimedia from 0.32.4 to 0.32.5… [15:23:37] [02MediaWikiDebugJS] 07dependabot[bot] added the label 'dependencies' to pull request #37 (Bump eslint-config-wikimedia from 0.32.4 to 0.32.5) 13https://github.com/miraheze/MediaWikiDebugJS/pull/37 [15:23:37] [02MediaWikiDebugJS] 07dependabot[bot] added the label 'javascript' to pull request #37 (Bump eslint-config-wikimedia from 0.32.4 to 0.32.5) 13https://github.com/miraheze/MediaWikiDebugJS/pull/37 [15:23:39] [02MediaWikiDebugJS] 07dependabot[bot] opened pull request #37: Bump eslint-config-wikimedia from 0.32.4 to 0.32.5 (03main...03dependabot/npm_and_yarn/eslint-config-wikimedia-0.32.5) 13https://github.com/miraheze/MediaWikiDebugJS/pull/37 [15:23:41] [02MediaWikiDebugJS] 07dependabot[bot] added the label 'dependencies' to pull request #37 (Bump eslint-config-wikimedia from 0.32.4 to 0.32.5) 13https://github.com/miraheze/MediaWikiDebugJS/pull/37 [15:23:43] [02MediaWikiDebugJS] 07dependabot[bot] added the label 'javascript' to pull request #37 (Bump eslint-config-wikimedia from 0.32.4 to 0.32.5) 13https://github.com/miraheze/MediaWikiDebugJS/pull/37 [15:23:55] PROBLEM - mw191 APT on mw191 is CRITICAL: APT CRITICAL: 158 packages available for upgrade (15 critical updates). [15:24:00] PROBLEM - mw153 APT on mw153 is CRITICAL: APT CRITICAL: 158 packages available for upgrade (15 critical updates). [15:25:28] PROBLEM - cloud19 APT on cloud19 is CRITICAL: APT CRITICAL: 164 packages available for upgrade (9 critical updates). [15:26:07] !log [reception@mwtask181] finished deploy of {'l10n': True, 'versions': '1.45', 'upgrade_extensions': 'CreateWiki'} to all - SUCCESS in 529s [15:26:08] !log [reception@mwtask181] starting deploy of {'l10n': True, 'versions': '1.45', 'upgrade_extensions': 'ManageWiki'} to all [15:26:11] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:26:13] PROBLEM - bots171 APT on bots171 is CRITICAL: APT CRITICAL: 113 packages available for upgrade (15 critical updates). [15:26:14] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:26:16] PROBLEM - swiftobject151 APT on swiftobject151 is CRITICAL: APT CRITICAL: 115 packages available for upgrade (15 critical updates). [15:26:37] PROBLEM - mem191 APT on mem191 is CRITICAL: APT CRITICAL: 97 packages available for upgrade (15 critical updates). [15:26:50] PROBLEM - cp161 APT on cp161 is CRITICAL: APT CRITICAL: 100 packages available for upgrade (15 critical updates). [15:27:14] PROBLEM - cp191 APT on cp191 is CRITICAL: APT CRITICAL: 100 packages available for upgrade (15 critical updates). [15:27:23] PROBLEM - swiftobject171 APT on swiftobject171 is CRITICAL: APT CRITICAL: 115 packages available for upgrade (15 critical updates). [15:27:29] PROBLEM - mw192 APT on mw192 is CRITICAL: APT CRITICAL: 158 packages available for upgrade (15 critical updates). [15:28:53] PROBLEM - mw151 APT on mw151 is CRITICAL: APT CRITICAL: 158 packages available for upgrade (15 critical updates). [15:29:25] PROBLEM - os202 APT on os202 is CRITICAL: APT CRITICAL: 111 packages available for upgrade (15 critical updates). [15:29:41] PROBLEM - mw163 APT on mw163 is CRITICAL: APT CRITICAL: 158 packages available for upgrade (15 critical updates). [15:29:54] PROBLEM - os162 APT on os162 is CRITICAL: APT CRITICAL: 106 packages available for upgrade (15 critical updates). [15:29:59] PROBLEM - graylog161 APT on graylog161 is CRITICAL: APT CRITICAL: 109 packages available for upgrade (15 critical updates). [15:30:05] PROBLEM - db181 APT on db181 is CRITICAL: APT CRITICAL: 109 packages available for upgrade (15 critical updates). [15:30:46] PROBLEM - mw202 HTTPS on mw202 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: HTTP/2 502 [15:31:38] PROBLEM - cloud18 APT on cloud18 is CRITICAL: APT CRITICAL: 158 packages available for upgrade (9 critical updates). [15:31:48] PROBLEM - cp171 Varnish Backends on cp171 is CRITICAL: 13 backends are down. mw151 mw152 mw161 mw172 mw181 mw182 mw153 mw163 mw183 mw191 mw193 mw201 mw203 [15:31:56] PROBLEM - mw192 MediaWiki Rendering on mw192 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 5857 bytes in 0.010 second response time [15:31:57] PROBLEM - mw171 MediaWiki Rendering on mw171 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 5857 bytes in 0.011 second response time [15:32:13] PROBLEM - os191 APT on os191 is CRITICAL: APT CRITICAL: 105 packages available for upgrade (15 critical updates). [15:32:17] PROBLEM - cp171 Current Load on cp171 is CRITICAL: LOAD CRITICAL - total load average: 74.75, 35.37, 15.00 [15:32:23] PROBLEM - cp191 Varnish Backends on cp191 is CRITICAL: 11 backends are down. mw151 mw152 mw161 mw172 mw181 mw163 mw183 mw191 mw193 mw201 mw203 [15:32:24] PROBLEM - db151 APT on db151 is CRITICAL: APT CRITICAL: 109 packages available for upgrade (15 critical updates). [15:32:37] !log [reception@mwtask181] DEPLOY ABORTED: Canary check failed for publictestwiki.com@mw162 [15:32:49] RECOVERY - mw202 HTTPS on mw202 is OK: HTTP OK: HTTP/2 410 - Status line output matched "HTTP/2 410" - 340 bytes in 2.617 second response time [15:33:28] PROBLEM - mw192 Current Load on mw192 is WARNING: LOAD WARNING - total load average: 23.98, 15.80, 9.66 [15:34:57] !log [reception@mwtask181] starting deploy of {'l10n': True, 'versions': '1.45', 'upgrade_extensions': 'CreateWiki'} to all [15:34:57] PROBLEM - reports171 APT on reports171 is CRITICAL: APT CRITICAL: 102 packages available for upgrade (15 critical updates). [15:34:57] PROBLEM - puppet181 Check unit status of listdomains_github_push on puppet181 is CRITICAL: CRITICAL: Status of the systemd unit listdomains_github_push [15:34:57] PROBLEM - mwtask181 APT on mwtask181 is CRITICAL: APT CRITICAL: 165 packages available for upgrade (15 critical updates). [15:34:57] PROBLEM - cp201 Current Load on cp201 is CRITICAL: LOAD CRITICAL - total load average: 42.28, 34.41, 15.95 [15:34:57] PROBLEM - mw181 APT on mw181 is CRITICAL: APT CRITICAL: 158 packages available for upgrade (15 critical updates). [15:34:58] PROBLEM - ns2 APT on ns2 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [15:34:58] PROBLEM - eventgate182 APT on eventgate182 is CRITICAL: APT CRITICAL: 108 packages available for upgrade (15 critical updates). [15:34:59] RECOVERY - cp171 Varnish Backends on cp171 is OK: All 31 backends are healthy [15:34:59] PROBLEM - swiftobject161 APT on swiftobject161 is CRITICAL: APT CRITICAL: 115 packages available for upgrade (15 critical updates). [15:35:00] PROBLEM - test151 APT on test151 is CRITICAL: APT CRITICAL: 165 packages available for upgrade (15 critical updates). [15:35:00] PROBLEM - os161 APT on os161 is CRITICAL: APT CRITICAL: 106 packages available for upgrade (15 critical updates). [15:35:01] PROBLEM - cp191 Current Load on cp191 is CRITICAL: LOAD CRITICAL - total load average: 24.67, 29.18, 14.42 [15:35:01] PROBLEM - cp161 HTTP 4xx/5xx ERROR Rate on cp161 is CRITICAL: CRITICAL - NGINX Error Rate is 69% [15:35:02] RECOVERY - mw192 MediaWiki Rendering on mw192 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 2.853 second response time [15:35:13] PROBLEM - cp161 HTTPS on cp161 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: HTTP/2 502 [15:35:15] PROBLEM - mon181 APT on mon181 is CRITICAL: APT CRITICAL: 67 packages available for upgrade (15 critical updates). [15:35:15] Hey, that's bad. [15:35:15] Issue Trackeri s down. [15:35:16] @Infrastructure Specialists Servers are inaccessible through ssh. [15:35:16] PROBLEM - mw152 APT on mw152 is CRITICAL: APT CRITICAL: 158 packages available for upgrade (15 critical updates). [15:35:18] [1/2] Fiberstate problem. [15:35:18] [2/2] https://cdn.discordapp.com/attachments/808001911868489748/1531686370722975846/image.png?ex=6a6a1d98&is=6a68cc18&hm=4c13f9924efe2c071ffcd5cd69835c812b93dbc465747a3f020e2b207c454d90& [15:35:18] PROBLEM - matomo151 PowerDNS Recursor on matomo151 is CRITICAL: Domain 'matomo151.fsslc.wtnet' was not found by the server [15:35:18] PROBLEM - puppet181 PowerDNS Recursor on puppet181 is CRITICAL: Domain 'puppet181.wikitide.net' was not found by the server [15:35:20] PROBLEM - os191 PowerDNS Recursor on os191 is CRITICAL: Domain 'os191.fsslc.wtnet' was not found by the server [15:35:22] PROBLEM - db161 PowerDNS Recursor on db161 is CRITICAL: Domain 'db161.fsslc.wtnet' was not found by the server [15:35:23] PROBLEM - mw203 PowerDNS Recursor on mw203 is CRITICAL: Domain 'mw203.fsslc.wtnet' was not found by the server [15:35:26] PROBLEM - mw201 APT on mw201 is CRITICAL: APT CRITICAL: 158 packages available for upgrade (15 critical updates). [15:35:28] PROBLEM - mw171 PowerDNS Recursor on mw171 is CRITICAL: Domain 'mw171.fsslc.wtnet' was not found by the server [15:35:29] PROBLEM - mwtask161 PowerDNS Recursor on mwtask161 is CRITICAL: Domain 'mwtask161.fsslc.wtnet' was not found by the server [15:35:32] PROBLEM - swiftproxy171 HTTP on swiftproxy171 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:35:33] I thought they were supposed to be better than OVH, but I suppose this is only the second time this year this has happened? [15:35:34] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:35:49] And it's back up again. [15:36:02] Issue Tracker is alive. [15:36:03] PROBLEM - cloud17 APT on cloud17 is CRITICAL: APT CRITICAL: 158 packages available for upgrade (9 critical updates). [15:36:13] RECOVERY - cp161 HTTP 4xx/5xx ERROR Rate on cp161 is OK: OK - NGINX Error Rate is 21% [15:36:13] RECOVERY - mw171 MediaWiki Rendering on mw171 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 0.382 second response time [15:36:22] [1/2] One-minute outage. [15:36:22] [2/2] https://cdn.discordapp.com/attachments/808001911868489748/1531686764018667671/image.png?ex=6a6a1df5&is=6a68cc75&hm=dbfcc2a612239adec0b0db96df24572827c359c40bb051dea80083653bacf444& [15:36:26] RECOVERY - cp191 Varnish Backends on cp191 is OK: All 31 backends are healthy [15:36:32] PROBLEM - swiftproxy161 HTTP on swiftproxy161 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:36:36] PROBLEM - bast181 APT on bast181 is CRITICAL: APT CRITICAL: 107 packages available for upgrade (15 critical updates). [15:36:40] PROBLEM - swiftproxy161 HTTPS on swiftproxy161 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:36:45] PROBLEM - swiftproxy171 HTTPS on swiftproxy171 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:36:57] PROBLEM - mem161 PowerDNS Recursor on mem161 is CRITICAL: No response from DNS 127.0.0.1 [15:37:07] RECOVERY - cp161 HTTPS on cp161 is OK: HTTP OK: HTTP/2 410 - Status line output matched "HTTP/2 410" - 1518 bytes in 0.061 second response time [15:37:12] RECOVERY - mw173 MediaWiki Rendering on mw173 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 2.748 second response time [15:37:13] RECOVERY - puppet181 PowerDNS Recursor on puppet181 is OK: DNS OK: 0.041 seconds response time. puppet181.wikitide.net returns 10.0.18.100 [15:37:15] RECOVERY - matomo151 PowerDNS Recursor on matomo151 is OK: DNS OK: 0.173 seconds response time. matomo151.fsslc.wtnet returns 10.0.15.112 [15:37:16] Surely they would have backup servers or processes to handle their DNS? So, I guess maybe one of them went down or something. [15:37:18] RECOVERY - os191 PowerDNS Recursor on os191 is OK: DNS OK: 2.450 seconds response time. os191.fsslc.wtnet returns 10.0.19.152 [15:37:20] RECOVERY - db161 PowerDNS Recursor on db161 is OK: DNS OK: 0.906 seconds response time. db161.fsslc.wtnet returns 10.0.16.128 [15:37:22] RECOVERY - mw203 PowerDNS Recursor on mw203 is OK: DNS OK: 0.033 seconds response time. mw203.fsslc.wtnet returns 10.0.20.165 [15:37:25] RECOVERY - mwtask161 PowerDNS Recursor on mwtask161 is OK: DNS OK: 0.034 seconds response time. mwtask161.fsslc.wtnet returns 10.0.16.157 [15:37:27] RECOVERY - mw171 PowerDNS Recursor on mw171 is OK: DNS OK: 0.188 seconds response time. mw171.fsslc.wtnet returns 10.0.17.122 [15:38:03] PROBLEM - swiftproxy161 Current Load on swiftproxy161 is CRITICAL: LOAD CRITICAL - total load average: 13.61, 7.92, 4.46 [15:38:11] PROBLEM - swiftproxy171 Current Load on swiftproxy171 is CRITICAL: LOAD CRITICAL - total load average: 13.13, 7.90, 4.36 [15:38:14] PROBLEM - mattermost2 APT on mattermost2 is CRITICAL: APT CRITICAL: 100 packages available for upgrade (15 critical updates). [15:38:25] PROBLEM - cloud16 APT on cloud16 is CRITICAL: APT CRITICAL: 158 packages available for upgrade (9 critical updates). [15:38:27] PROBLEM - mw152 Puppet on mw152 is CRITICAL: CRITICAL: Puppet has 2 failures. Last run 3 minutes ago with 2 failures. Failed resources (up to 3 shown): Exec[git_pull_femiwiki-deploy-1.45],Exec[git_pull_3d2png] [15:38:27] PROBLEM - prometheus151 APT on prometheus151 is CRITICAL: APT CRITICAL: 102 packages available for upgrade (15 critical updates). [15:38:34] PROBLEM - mem201 APT on mem201 is CRITICAL: APT CRITICAL: 97 packages available for upgrade (15 critical updates). [15:38:35] PROBLEM - mw182 APT on mw182 is CRITICAL: APT CRITICAL: 158 packages available for upgrade (15 critical updates). [15:38:48] PROBLEM - mw201 Puppet on mw201 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_femiwiki-deploy-1.45] [15:38:54] RECOVERY - mem161 PowerDNS Recursor on mem161 is OK: DNS OK: 0.034 seconds response time. mem161.fsslc.wtnet returns 10.0.16.131 [15:39:02] Tsk tsk, outdated packages, heaven forbid. [15:39:19] PROBLEM - matomo151 APT on matomo151 is CRITICAL: APT CRITICAL: 100 packages available for upgrade (15 critical updates). [15:39:33] !log [reception@mwtask181] finished deploy of {'l10n': True, 'versions': '1.45', 'upgrade_extensions': 'CreateWiki'} to all - SUCCESS in 276s [15:39:33] RECOVERY - cp201 Current Load on cp201 is OK: LOAD OK - total load average: 2.13, 12.86, 12.07 [15:39:34] !log [reception@mwtask181] starting deploy of {'l10n': True, 'versions': '1.45', 'upgrade_extensions': 'ManageWiki'} to all [15:39:37] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:39:40] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:39:53] PROBLEM - swiftproxy171 Check unit status of swift_dispersion_stats on swiftproxy171 is CRITICAL: CRITICAL: Status of the systemd unit swift_dispersion_stats [15:40:04] PROBLEM - cp191 Current Load on cp191 is WARNING: LOAD WARNING - total load average: 2.27, 13.62, 12.57 [15:40:05] PROBLEM - mw202 APT on mw202 is CRITICAL: APT CRITICAL: 158 packages available for upgrade (15 critical updates). [15:40:23] PROBLEM - swiftproxy161 APT on swiftproxy161 is CRITICAL: APT CRITICAL: 111 packages available for upgrade (15 critical updates). [15:40:26] PROBLEM - cp201 APT on cp201 is CRITICAL: APT CRITICAL: 100 packages available for upgrade (15 critical updates). [15:40:36] PROBLEM - changeprop202 APT on changeprop202 is CRITICAL: APT CRITICAL: 108 packages available for upgrade (15 critical updates). [15:40:36] PROBLEM - db172 APT on db172 is CRITICAL: APT CRITICAL: 109 packages available for upgrade (15 critical updates). [15:40:42] RECOVERY - swiftproxy161 HTTP on swiftproxy161 is OK: HTTP OK: Status line output matched "HTTP/1.1 404" - 352 bytes in 2.585 second response time [15:40:43] PROBLEM - mw162 APT on mw162 is CRITICAL: APT CRITICAL: 158 packages available for upgrade (15 critical updates). [15:40:47] RECOVERY - swiftproxy161 HTTPS on swiftproxy161 is OK: HTTP OK: Status line output matched "HTTP/1.1 404" - 352 bytes in 0.054 second response time [15:40:54] RECOVERY - swiftproxy171 HTTPS on swiftproxy171 is OK: HTTP OK: Status line output matched "HTTP/1.1 404" - 352 bytes in 0.054 second response time [15:41:00] !log [reception@mwtask181] finished deploy of {'l10n': True, 'versions': '1.45', 'upgrade_extensions': 'ManageWiki'} to all - SUCCESS in 86s [15:41:04] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:41:15] PROBLEM - mw172 APT on mw172 is CRITICAL: APT CRITICAL: 158 packages available for upgrade (15 critical updates). [15:41:30] PROBLEM - swiftproxy171 APT on swiftproxy171 is CRITICAL: APT CRITICAL: 111 packages available for upgrade (15 critical updates). [15:41:35] RECOVERY - swiftproxy171 HTTP on swiftproxy171 is OK: HTTP OK: Status line output matched "HTTP/1.1 404" - 352 bytes in 0.014 second response time [15:41:36] PROBLEM - mwtask171 APT on mwtask171 is CRITICAL: APT CRITICAL: 164 packages available for upgrade (15 critical updates). [15:41:43] PROBLEM - mw161 APT on mw161 is CRITICAL: APT CRITICAL: 158 packages available for upgrade (15 critical updates). [15:42:00] RECOVERY - cp191 Current Load on cp191 is OK: LOAD OK - total load average: 1.80, 9.82, 11.31 [15:42:04] PROBLEM - swiftproxy171 Current Load on swiftproxy171 is WARNING: LOAD WARNING - total load average: 5.41, 7.87, 5.26 [15:42:18] PROBLEM - bast161 APT on bast161 is CRITICAL: APT CRITICAL: 106 packages available for upgrade (15 critical updates). [15:42:21] PROBLEM - cp171 Current Load on cp171 is WARNING: LOAD WARNING - total load average: 2.63, 13.30, 15.14 [15:42:23] PROBLEM - rdb191 APT on rdb191 is CRITICAL: APT CRITICAL: 100 packages available for upgrade (15 critical updates). [15:42:32] PROBLEM - llm191 APT on llm191 is CRITICAL: APT CRITICAL: 112 packages available for upgrade (15 critical updates). [15:42:32] PROBLEM - mw203 APT on mw203 is CRITICAL: APT CRITICAL: 158 packages available for upgrade (15 critical updates). [15:42:48] PROBLEM - cp171 APT on cp171 is CRITICAL: APT CRITICAL: 101 packages available for upgrade (15 critical updates). [15:43:20] PROBLEM - swiftproxy171 Check unit status of swift-container-stats_mw-media on swiftproxy171 is CRITICAL: CRITICAL: Status of the systemd unit swift-container-stats_mw-media [15:43:55] PROBLEM - swiftproxy161 Current Load on swiftproxy161 is WARNING: LOAD WARNING - total load average: 4.96, 7.06, 5.40 [15:44:01] RECOVERY - swiftproxy171 Current Load on swiftproxy171 is OK: LOAD OK - total load average: 4.50, 6.75, 5.15 [15:45:55] RECOVERY - swiftproxy161 Current Load on swiftproxy161 is OK: LOAD OK - total load average: 3.46, 5.78, 5.13 [15:46:19] RECOVERY - cp171 Current Load on cp171 is OK: LOAD OK - total load average: 1.94, 7.16, 12.19 [15:51:20] RECOVERY - swiftproxy171 Check unit status of swift-container-stats_mw-media on swiftproxy171 is OK: OK: Status of the systemd unit swift-container-stats_mw-media [15:53:48] RECOVERY - swiftproxy171 Check unit status of swift_dispersion_stats on swiftproxy171 is OK: OK: Status of the systemd unit swift_dispersion_stats [15:56:20] [02TSPortal] 07renovate[bot] created 03renovate/dev-deps (+1 new commit) 13https://github.com/miraheze/TSPortal/commit/a53fd956f901 [15:56:20] 02TSPortal/03renovate/dev-deps 07renovate[bot] 03a53fd95 Update dependency phpunit/phpunit to v13.2.6 [16:01:17] RECOVERY - puppet181 Check unit status of listdomains_github_push on puppet181 is OK: OK: Status of the systemd unit listdomains_github_push [16:04:46] RECOVERY - mw201 Puppet on mw201 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [16:06:24] RECOVERY - mw152 Puppet on mw152 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [16:06:47] PROBLEM - ldap171 APT on ldap171 is CRITICAL: APT CRITICAL: 98 packages available for upgrade (15 critical updates). [16:06:51] PROBLEM - swiftobject211 APT on swiftobject211 is CRITICAL: APT CRITICAL: 105 packages available for upgrade (15 critical updates). [16:07:29] PROBLEM - mw183 APT on mw183 is CRITICAL: APT CRITICAL: 158 packages available for upgrade (15 critical updates). [16:17:22] [02mw-config] 07dmehus commented on pull request #6471: Sounds good re: simply renaming ToU as Trust and Safety. No need for two different reasons for them, I think you're right there. […] 13https://github.com/miraheze/mw-config/pull/6471#issuecomment-5106772591 [16:19:56] PROBLEM - cp201 Varnish Backends on cp201 is CRITICAL: 2 backends are down. mw173 mw183 [16:20:11] [02mw-config] 07dmehus commented on pull request #6471: Just realized there's no reason for a Technology Team-closure/deletion as per Terms of Use section 8. Perhaps it _may_ still be useful to have a ToU reason? 13https://github.com/miraheze/mw-config/pull/6471#issuecomment-5106807331 [16:20:31] PROBLEM - mw152 Current Load on mw152 is WARNING: LOAD WARNING - total load average: 23.55, 15.49, 9.74 [16:20:52] PROBLEM - mw192 Current Load on mw192 is WARNING: LOAD WARNING - total load average: 22.50, 15.63, 10.22 [16:20:56] PROBLEM - mw171 Current Load on mw171 is CRITICAL: LOAD CRITICAL - total load average: 24.41, 16.65, 10.54 [16:20:57] PROBLEM - mw162 Current Load on mw162 is WARNING: LOAD WARNING - total load average: 23.86, 16.32, 10.57 [16:21:06] PROBLEM - kafka182 APT on kafka182 is WARNING: APT WARNING: 0 packages available for upgrade (0 critical updates). warnings detected, errors detected. [16:21:26] PROBLEM - mw182 Current Load on mw182 is WARNING: LOAD WARNING - total load average: 23.30, 16.30, 10.49 [16:21:34] PROBLEM - mw203 Current Load on mw203 is WARNING: LOAD WARNING - total load average: 22.82, 16.92, 10.81 [16:21:40] PROBLEM - mw173 Current Load on mw173 is WARNING: LOAD WARNING - total load average: 23.20, 17.11, 11.04 [16:21:40] PROBLEM - mw201 Current Load on mw201 is WARNING: LOAD WARNING - total load average: 23.14, 17.06, 10.86 [16:21:47] PROBLEM - mw161 Current Load on mw161 is WARNING: LOAD WARNING - total load average: 23.53, 17.27, 10.75 [16:21:58] PROBLEM - mw153 Current Load on mw153 is CRITICAL: LOAD CRITICAL - total load average: 24.47, 17.67, 10.88 [16:22:06] PROBLEM - mw181 Current Load on mw181 is WARNING: LOAD WARNING - total load average: 23.23, 17.23, 10.84 [16:22:22] PROBLEM - mw202 Current Load on mw202 is WARNING: LOAD WARNING - total load average: 23.42, 18.02, 11.77 [16:22:22] PROBLEM - mw172 Current Load on mw172 is WARNING: LOAD WARNING - total load average: 23.65, 18.06, 11.32 [16:22:27] PROBLEM - mw183 Current Load on mw183 is WARNING: LOAD WARNING - total load average: 21.35, 16.77, 11.08 [16:22:27] PROBLEM - mw193 Current Load on mw193 is WARNING: LOAD WARNING - total load average: 23.60, 17.82, 11.33 [16:22:41] PROBLEM - mw191 Current Load on mw191 is WARNING: LOAD WARNING - total load average: 23.74, 17.96, 11.26 [16:22:49] PROBLEM - mw163 Current Load on mw163 is WARNING: LOAD WARNING - total load average: 23.69, 17.28, 11.07 [16:22:56] PROBLEM - mw171 Current Load on mw171 is WARNING: LOAD WARNING - total load average: 23.81, 19.02, 12.15 [16:23:11] PROBLEM - kafka182 APT on kafka182 is CRITICAL: APT CRITICAL: 111 packages available for upgrade (15 critical updates). [16:23:43] everything is fine 👍 [16:23:58] PROBLEM - mw153 Current Load on mw153 is WARNING: LOAD WARNING - total load average: 23.48, 19.62, 12.42 [16:24:22] PROBLEM - mw172 Current Load on mw172 is CRITICAL: LOAD CRITICAL - total load average: 24.28, 20.15, 12.90 [16:25:48] PROBLEM - mw151 Current Load on mw151 is WARNING: LOAD WARNING - total load average: 23.05, 19.67, 12.91 [16:25:55] RECOVERY - cp201 Varnish Backends on cp201 is OK: All 31 backends are healthy [16:26:22] PROBLEM - mw172 Current Load on mw172 is WARNING: LOAD WARNING - total load average: 23.61, 21.20, 14.17 [16:26:25] PROBLEM - mw151 APT on mw151 is WARNING: APT WARNING: 0 packages available for upgrade (0 critical updates). warnings detected, errors detected. [16:27:16] [02mw-config] 07dmehus opened pull request #6475: Update LocalSettings.php (07miraheze:03Reception123-patch-1...07dmehus:03patch-17) 13https://github.com/miraheze/mw-config/pull/6475 [16:28:00] Wikis are very slow atm. [16:28:30] PROBLEM - mw151 APT on mw151 is CRITICAL: APT CRITICAL: 158 packages available for upgrade (15 critical updates). [16:28:49] PROBLEM - mw163 Current Load on mw163 is CRITICAL: LOAD CRITICAL - total load average: 24.13, 21.83, 15.14 [16:28:51] RECOVERY - mw162 Current Load on mw162 is OK: LOAD OK - total load average: 18.09, 20.11, 15.03 [16:29:30] [02WikiTideDebug] 07Universal-Omega merged 07dependabot[bot]'s pull request #36: Bump eslint-config-wikimedia from 0.32.4 to 0.32.5 (03main...03dependabot/npm_and_yarn/eslint-config-wikimedia-0.32.5) 13https://github.com/miraheze/WikiTideDebug/pull/36 [16:29:31] [02WikiTideDebug] 07Universal-Omega pushed 1 new commit to 03main 13https://github.com/miraheze/WikiTideDebug/commit/bb6f3d67ea116e6eac9efee706bc68c93ce43417 [16:29:31] 02WikiTideDebug/03main 07dependabot[bot] 03bb6f3d6 Bump eslint-config-wikimedia from 0.32.4 to 0.32.5 (#36)… [16:29:32] [02WikiTideDebug] 07Universal-Omega 04deleted 03dependabot/npm_and_yarn/eslint-config-wikimedia-0.32.5 at 034cb2187 13https://api.github.com/repos/miraheze/WikiTideDebug/commit/4cb2187 [16:29:44] [02ImportDump] 07Universal-Omega merged 07dependabot[bot]'s pull request #176: Bump eslint-config-wikimedia from 0.32.4 to 0.32.5 (03main...03dependabot/npm_and_yarn/eslint-config-wikimedia-0.32.5) 13https://github.com/miraheze/ImportDump/pull/176 [16:29:44] [02ImportDump] 07Universal-Omega pushed 1 new commit to 03main 13https://github.com/miraheze/ImportDump/commit/66ef95bf721bf3dd097f1509de08d827e29c4f70 [16:29:44] 02ImportDump/03main 07dependabot[bot] 0366ef95b Bump eslint-config-wikimedia from 0.32.4 to 0.32.5 (#176)… [16:29:45] [02ImportDump] 07Universal-Omega 04deleted 03dependabot/npm_and_yarn/eslint-config-wikimedia-0.32.5 at 03be756d1 13https://api.github.com/repos/miraheze/ImportDump/commit/be756d1 [16:29:56] [02MediaWikiDebugJS] 07Universal-Omega merged 07dependabot[bot]'s pull request #37: Bump eslint-config-wikimedia from 0.32.4 to 0.32.5 (03main...03dependabot/npm_and_yarn/eslint-config-wikimedia-0.32.5) 13https://github.com/miraheze/MediaWikiDebugJS/pull/37 [16:29:57] [02MediaWikiDebugJS] 07Universal-Omega pushed 1 new commit to 03main 13https://github.com/miraheze/MediaWikiDebugJS/commit/d5586c7cff0fb8425c3875fe2f5635ce491b39e4 [16:29:57] 02MediaWikiDebugJS/03main 07dependabot[bot] 03d5586c7 Bump eslint-config-wikimedia from 0.32.4 to 0.32.5 (#37)… [16:29:58] [02MediaWikiDebugJS] 07Universal-Omega 04deleted 03dependabot/npm_and_yarn/eslint-config-wikimedia-0.32.5 at 03572ba24 13https://api.github.com/repos/miraheze/MediaWikiDebugJS/commit/572ba24 [16:30:49] PROBLEM - mw163 Current Load on mw163 is WARNING: LOAD WARNING - total load average: 22.69, 21.90, 15.98 [16:31:26] PROBLEM - mw182 Current Load on mw182 is CRITICAL: LOAD CRITICAL - total load average: 24.18, 22.53, 16.62 [16:31:44] RECOVERY - mw151 Current Load on mw151 is OK: LOAD OK - total load average: 19.83, 20.35, 15.41 [16:31:47] RECOVERY - mw161 Current Load on mw161 is OK: LOAD OK - total load average: 17.87, 20.09, 15.80 [16:32:06] PROBLEM - mw181 Current Load on mw181 is CRITICAL: LOAD CRITICAL - total load average: 24.24, 23.10, 17.07 [16:33:26] PROBLEM - mw182 Current Load on mw182 is WARNING: LOAD WARNING - total load average: 23.63, 22.90, 17.48 [16:34:06] PROBLEM - mw181 Current Load on mw181 is WARNING: LOAD WARNING - total load average: 23.80, 23.28, 17.87 [16:34:27] PROBLEM - mw183 Current Load on mw183 is CRITICAL: LOAD CRITICAL - total load average: 24.50, 23.10, 17.83 [16:34:31] PROBLEM - mw152 Current Load on mw152 is CRITICAL: LOAD CRITICAL - total load average: 24.16, 22.78, 17.67 [16:35:04] miraheze/ImportDump - Universal-Omega the build passed. [16:36:22] RECOVERY - mw172 Current Load on mw172 is OK: LOAD OK - total load average: 14.02, 19.47, 17.16 [16:36:27] PROBLEM - mw183 Current Load on mw183 is WARNING: LOAD WARNING - total load average: 17.01, 21.59, 17.98 [16:36:31] PROBLEM - mw152 Current Load on mw152 is WARNING: LOAD WARNING - total load average: 19.53, 21.62, 17.88 [16:36:41] RECOVERY - mw191 Current Load on mw191 is OK: LOAD OK - total load average: 9.33, 16.26, 15.61 [16:37:26] RECOVERY - mw182 Current Load on mw182 is OK: LOAD OK - total load average: 14.43, 20.05, 17.72 [16:37:34] RECOVERY - mw203 Current Load on mw203 is OK: LOAD OK - total load average: 12.62, 17.95, 16.81 [16:38:27] RECOVERY - mw183 Current Load on mw183 is OK: LOAD OK - total load average: 15.30, 19.90, 17.82 [16:38:27] RECOVERY - mw193 Current Load on mw193 is OK: LOAD OK - total load average: 11.95, 18.17, 17.20 [16:39:47] PROBLEM - mw161 Current Load on mw161 is WARNING: LOAD WARNING - total load average: 23.95, 22.06, 18.25 [16:39:58] RECOVERY - mw153 Current Load on mw153 is OK: LOAD OK - total load average: 11.81, 17.76, 17.05 [16:40:22] RECOVERY - mw202 Current Load on mw202 is OK: LOAD OK - total load average: 13.64, 18.22, 17.66 [16:40:31] RECOVERY - mw152 Current Load on mw152 is OK: LOAD OK - total load average: 14.03, 19.13, 17.86 [16:40:49] RECOVERY - mw163 Current Load on mw163 is OK: LOAD OK - total load average: 14.42, 20.29, 18.46 [16:40:56] RECOVERY - mw171 Current Load on mw171 is OK: LOAD OK - total load average: 9.65, 17.96, 17.86 [16:41:40] RECOVERY - mw173 Current Load on mw173 is OK: LOAD OK - total load average: 8.83, 17.72, 17.88 [16:41:40] RECOVERY - mw201 Current Load on mw201 is OK: LOAD OK - total load average: 7.84, 16.90, 17.43 [16:41:47] RECOVERY - mw161 Current Load on mw161 is OK: LOAD OK - total load average: 9.65, 18.11, 17.33 [16:42:06] RECOVERY - mw181 Current Load on mw181 is OK: LOAD OK - total load average: 7.42, 16.39, 17.36 [16:42:52] RECOVERY - mw192 Current Load on mw192 is OK: LOAD OK - total load average: 7.07, 16.41, 17.62 [17:28:02] !log [reception@mwtask181] starting deploy of {'world': True, 'versions': '1.45'} to all [17:28:06] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:31:32] !log [reception@mwtask181] finished deploy of {'world': True, 'versions': '1.45'} to all - SUCCESS in 210s [17:31:35] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:32:06] !log [reception@mwtask181] starting deploy of {'versions': '1.45', 'upgrade_extensions': 'CreateWiki'} to all [17:32:07] !log [reception@mwtask181] finished deploy of {'versions': '1.45', 'upgrade_extensions': 'CreateWiki'} to all - SUCCESS in 0s [17:32:09] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:32:12] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:38:15] !log [reception@mwtask181] sudo -u www-data php /srv/mediawiki/1.45/maintenance/run.php /srv/mediawiki/1.45/maintenance/sql.php --wiki=metawiki --wikidb mhglobal /srv/mediawiki-staging/1.45/extensions/CreateWiki/sql/patches/patch-cw_wikis-add-wiki_closed_reason.sql (END - exit=0) [17:38:19] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:45:08] [02mw-config] 07Reception123 pushed 1 new commit to 03Reception123-patch-1 13https://github.com/miraheze/mw-config/commit/8e53efe13dab880b565247e295969e46f7512cab [17:45:08] 02mw-config/03Reception123-patch-1 07Reception123 038e53efe Update LocalSettings.php [17:46:23] miraheze/mw-config - Reception123 the build passed. [17:49:57] PROBLEM - cp161 HTTP 4xx/5xx ERROR Rate on cp161 is WARNING: WARNING - NGINX Error Rate is 51% [17:51:57] RECOVERY - cp161 HTTP 4xx/5xx ERROR Rate on cp161 is OK: OK - NGINX Error Rate is 39% [17:55:37] [02CreateWiki] 07Reception123 created 03revert-828-Reception123-patch-5 (+1 new commit) 13https://github.com/miraheze/CreateWiki/commit/2fc3c4bb204c [17:55:37] 02CreateWiki/03revert-828-Reception123-patch-5 07Reception123 032fc3c4b Revert "add option to record closure reasons (T15629) (#828)"… [17:55:41] [02CreateWiki] 07Reception123 opened pull request #837: Revert "add option to record closure reasons (T15629)" (03main...03revert-828-Reception123-patch-5) 13https://github.com/miraheze/CreateWiki/pull/837 [17:55:48] [02ManageWiki] 07Reception123 created 03revert-794-Reception123-patch-5 (+1 new commit) 13https://github.com/miraheze/ManageWiki/commit/220d66f99647 [17:55:48] 02ManageWiki/03revert-794-Reception123-patch-5 07Reception123 03220d66f Revert "add option to record closure reasons (T15629) (#794)"… [17:55:53] [02ManageWiki] 07Reception123 opened pull request #800: Revert "add option to record closure reasons (T15629)" (03main...03revert-794-Reception123-patch-5) 13https://github.com/miraheze/ManageWiki/pull/800 [17:55:57] PROBLEM - cp161 HTTP 4xx/5xx ERROR Rate on cp161 is WARNING: WARNING - NGINX Error Rate is 52% [17:55:57] [02CreateWiki] 07Reception123 merged pull request #837: Revert "add option to record closure reasons (T15629)" (03main...03revert-828-Reception123-patch-5) 13https://github.com/miraheze/CreateWiki/pull/837 [17:55:57] [02CreateWiki] 07Reception123 pushed 1 new commit to 03main 13https://github.com/miraheze/CreateWiki/commit/d196b9811303d57b2cb2264708d35a8ba0b6c4e7 [17:55:57] 02CreateWiki/03main 07Reception123 03d196b98 Revert "add option to record closure reasons (T15629)" (#837)… [17:55:58] [02CreateWiki] 07Reception123 04deleted 03revert-828-Reception123-patch-5 at 032fc3c4b 13https://api.github.com/repos/miraheze/CreateWiki/commit/2fc3c4b [17:56:01] [02ManageWiki] 07Reception123 merged pull request #800: Revert "add option to record closure reasons (T15629)" (03main...03revert-794-Reception123-patch-5) 13https://github.com/miraheze/ManageWiki/pull/800 [17:56:01] [02ManageWiki] 07Reception123 pushed 1 new commit to 03main 13https://github.com/miraheze/ManageWiki/commit/343b3f8683222397d59ecfec55f1c738838cb544 [17:56:03] 02ManageWiki/03main 07Reception123 03343b3f8 Revert "add option to record closure reasons (T15629) (#794)" (#800)… [17:56:05] [02ManageWiki] 07Reception123 04deleted 03revert-794-Reception123-patch-5 at 03220d66f 13https://api.github.com/repos/miraheze/ManageWiki/commit/220d66f [17:56:11] !log [reception@mwtask181] starting deploy of {'world': True, 'versions': '1.45'} to all [17:56:15] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:58:34] !log [reception@mwtask181] finished deploy of {'world': True, 'versions': '1.45'} to all - SUCCESS in 142s [17:58:37] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:59:57] RECOVERY - cp161 HTTP 4xx/5xx ERROR Rate on cp161 is OK: OK - NGINX Error Rate is 32% [18:01:03] [02CreateWiki] 07codecov[bot] commented on pull request #837: :white_check_mark: All modified and coverable lines are covered by tests. […] 13https://github.com/miraheze/CreateWiki/pull/837#issuecomment-5107854552 [18:01:31] miraheze/ManageWiki - Reception123 the build passed. [18:01:38] miraheze/ManageWiki - Reception123 the build passed. [18:03:16] miraheze/CreateWiki - Reception123 the build passed. [18:03:30] miraheze/CreateWiki - Reception123 the build passed. [19:25:28] [02CreateWiki] 07Reception123 created 03revert-837-revert-828-Reception123-patch-5 (+1 new commit) 13https://github.com/miraheze/CreateWiki/commit/98a846ded806 [19:25:29] 02CreateWiki/03revert-837-revert-828-Reception123-patch-5 07Reception123 0398a846d Revert "Revert "add option to record closure reasons (T15629)" (#837)"… [19:25:38] [02CreateWiki] 07Reception123 opened pull request #838: Revert "Revert "add option to record closure reasons (T15629)"" (03main...03revert-837-revert-828-Reception123-patch-5) 13https://github.com/miraheze/CreateWiki/pull/838 [19:25:54] [02CreateWiki] 07Reception123 merged pull request #838: Revert "Revert "add option to record closure reasons (T15629)"" (03main...03revert-837-revert-828-Reception123-patch-5) 13https://github.com/miraheze/CreateWiki/pull/838 [19:25:54] [02CreateWiki] 07Reception123 pushed 1 new commit to 03main 13https://github.com/miraheze/CreateWiki/commit/409924779f8be8e4e2446dfafada826a44ea44c1 [19:25:55] 02CreateWiki/03main 07Reception123 034099247 Revert "Revert "add option to record closure reasons (T15629)"" (#838)… [19:25:55] [02CreateWiki] 07Reception123 04deleted 03revert-837-revert-828-Reception123-patch-5 at 0398a846d 13https://api.github.com/repos/miraheze/CreateWiki/commit/98a846d [19:25:58] [02ManageWiki] 07Reception123 created 03revert-800-revert-794-Reception123-patch-5 (+1 new commit) 13https://github.com/miraheze/ManageWiki/commit/e6547757d150 [19:25:58] 02ManageWiki/03revert-800-revert-794-Reception123-patch-5 07Reception123 03e654775 Revert "Revert "add option to record closure reasons (T15629) (#794)" (#800)"… [19:26:02] [02ManageWiki] 07Reception123 opened pull request #801: Revert "Revert "add option to record closure reasons (T15629)"" (03main...03revert-800-revert-794-Reception123-patch-5) 13https://github.com/miraheze/ManageWiki/pull/801 [19:26:10] [02ManageWiki] 07Reception123 merged pull request #801: Revert "Revert "add option to record closure reasons (T15629)"" (03main...03revert-800-revert-794-Reception123-patch-5) 13https://github.com/miraheze/ManageWiki/pull/801 [19:26:10] [02ManageWiki] 07Reception123 pushed 1 new commit to 03main 13https://github.com/miraheze/ManageWiki/commit/555871d1c40772bc66bf3c1bf762d54914906785 [19:26:12] 02ManageWiki/03main 07Reception123 03555871d Revert "Revert "add option to record closure reasons (T15629) (#794)" (#800)" (#801)… [19:26:14] [02ManageWiki] 07Reception123 04deleted 03revert-800-revert-794-Reception123-patch-5 at 03e654775 13https://api.github.com/repos/miraheze/ManageWiki/commit/e654775 [19:26:56] !log [reception@mwtask181] starting deploy of {'versions': '1.45', 'upgrade_extensions': 'CreateWiki'} to all [19:27:00] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:27:26] !log [reception@mwtask181] finished deploy of {'versions': '1.45', 'upgrade_extensions': 'CreateWiki'} to all - SUCCESS in 30s [19:27:30] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:27:52] !log [reception@mwtask181] starting deploy of {'versions': '1.45', 'upgrade_extensions': 'ManageWiki'} to all [19:27:55] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:28:16] !log [reception@mwtask181] finished deploy of {'versions': '1.45', 'upgrade_extensions': 'ManageWiki'} to all - SUCCESS in 23s [19:28:19] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:28:32] !log [reception@mwtask181] starting deploy of {'l10n': True, 'versions': '1.45'} to all [19:28:35] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:31:06] [02mw-config] 07Reception123 commented on pull request #6471: Thanks for the suggestions/feedback! As we discussed privately as well, I do think that the local community reason might be a bit too niche for now but we could consider adding it later if it really does come up a lot. As for the others, I think to […] 13https://github.com/miraheze/mw-config/pull/6471#issuecomment-5108777463 [19:31:43] [02mw-config] 07Reception123 pushed 1 new commit to 03Reception123-patch-1 13https://github.com/miraheze/mw-config/commit/ad538a89bdbdcfe1fa61b5f6822421e3f7947f39 [19:31:43] 02mw-config/03Reception123-patch-1 07Reception123 03ad538a8 Update LocalSettings.php [19:31:44] miraheze/ManageWiki - Reception123 the build passed. [19:31:45] miraheze/ManageWiki - Reception123 the build passed. [19:32:09] [02mw-config] 07Reception123 closed pull request #6475: Update LocalSettings.php (07miraheze:03Reception123-patch-1...07dmehus:03patch-17) 13https://github.com/miraheze/mw-config/pull/6475 [19:32:11] [02mw-config] 07Reception123 commented on pull request #6475: Thanks for the suggestions, I've partially integrated and slightly rephrased in #6471! 13https://github.com/miraheze/mw-config/pull/6475#issuecomment-5108787359 [19:33:00] miraheze/mw-config - Reception123 the build passed. [19:33:41] [02mw-config] 07Reception123 merged pull request #6471: set wgCreateWikiClosedReasons T15628 (03main...03Reception123-patch-1) 13https://github.com/miraheze/mw-config/pull/6471 [19:33:41] [02mw-config] 07Reception123 pushed 1 new commit to 03main 13https://github.com/miraheze/mw-config/commit/f36652944bd7971afb59088dee4a6b3e3ba18db9 [19:33:41] 02mw-config/03main 07Reception123 03f366529 set wgCreateWikiClosedReasons T15628 (#6471)… [19:33:43] [02mw-config] 07Reception123 04deleted 03Reception123-patch-1 at 03ad538a8 13https://api.github.com/repos/miraheze/mw-config/commit/ad538a8 [19:34:31] !log [reception@mwtask181] starting deploy of {'pull': 'config', 'config': True} to all [19:34:34] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:34:55] !log [reception@mwtask181] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 24s [19:34:57] miraheze/CreateWiki - Reception123 the build passed. [19:34:58] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:35:10] miraheze/mw-config - Reception123 the build passed. [19:35:53] [02ManageWiki] 07Reception123 pushed 1 new commit to 03main 13https://github.com/miraheze/ManageWiki/commit/dc5829f55090109c03caeba40f05a8c0ebe17a08 [19:35:53] 02ManageWiki/03main 07Reception123 03dc5829f rm 'orother' from form, we don't want other to be default, will be done manually [19:36:14] !log [reception@mwtask181] finished deploy of {'l10n': True, 'versions': '1.45'} to all - SUCCESS in 462s [19:36:17] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:36:31] [02mw-config] 07Reception123 pushed 1 new commit to 03main 13https://github.com/miraheze/mw-config/commit/6887dea2a7289be48e769aaa45ec32a8b3af476c [19:36:31] 02mw-config/03main 07Reception123 036887dea use other separately for close reasons; other shouldn't be default [19:36:56] !log [reception@mwtask181] starting deploy of {'versions': '1.45', 'upgrade_extensions': 'ManageWiki'} to all [19:37:00] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:37:21] !log [reception@mwtask181] finished deploy of {'versions': '1.45', 'upgrade_extensions': 'ManageWiki'} to all - SUCCESS in 24s [19:37:24] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:37:49] miraheze/mw-config - Reception123 the build passed. [19:38:25] !log [reception@mwtask181] starting deploy of {'pull': 'config', 'config': True} to all [19:38:28] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:38:50] !log [reception@mwtask181] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 25s [19:38:54] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:41:20] miraheze/ManageWiki - Reception123 the build passed. [20:02:48] [02TSPortal] 07renovate[bot] merged 03renovate/dev-deps into 03main 13https://github.com/miraheze/TSPortal/compare/d293cc2df65a...a53fd956f901 [20:02:49] [02TSPortal] 07renovate[bot] 04deleted 03renovate/dev-deps at 03a53fd95 13https://api.github.com/repos/miraheze/TSPortal/commit/a53fd95 [21:53:57] PROBLEM - cp161 HTTP 4xx/5xx ERROR Rate on cp161 is WARNING: WARNING - NGINX Error Rate is 45% [21:55:57] RECOVERY - cp161 HTTP 4xx/5xx ERROR Rate on cp161 is OK: OK - NGINX Error Rate is 35%