[03:03:21] PROBLEM - puppet181 Check unit status of listdomains_github_push on puppet181 is CRITICAL: CRITICAL: Status of the systemd unit listdomains_github_push [03:31:21] RECOVERY - puppet181 Check unit status of listdomains_github_push on puppet181 is OK: OK: Status of the systemd unit listdomains_github_push [06:41:03] PROBLEM - db181 Current Load on db181 is CRITICAL: LOAD CRITICAL - total load average: 37.26, 19.46, 7.78 [06:59:03] PROBLEM - db181 Current Load on db181 is WARNING: LOAD WARNING - total load average: 1.24, 7.17, 11.73 [07:03:03] RECOVERY - db181 Current Load on db181 is OK: LOAD OK - total load average: 0.67, 3.50, 9.17 [08:00:36] [02ssl] 07WikiTideBot pushed 1 new commit to 03main 13https://github.com/miraheze/ssl/commit/6193dfeb315d33d0f56e9986595ca4f284371b29 [08:00:36] 02ssl/03main 07WikiTideBot 036193dfe Bot: Auto-update domain lists [09:56:04] miraheze/mw-config - pskyechology the build passed. [09:56:32] [02mw-config] 07pskyechology merged 07Conscience93's pull request #6347: T15121: Set $wgCategoryCollation to 'numeric' on wikitransportwiki (07miraheze:03main...07Conscience93:03patch-1) 13https://github.com/miraheze/mw-config/pull/6347 [09:56:32] [02mw-config] 07pskyechology pushed 1 new commit to 03main 13https://github.com/miraheze/mw-config/commit/5b3bec15001724c89b5b977f09cda4cd4d4c98e4 [09:56:34] 02mw-config/03main 07Conscience93 035b3bec1 T15121: Set $wgCategoryCollation to 'numeric' on wikitransportwiki (#6347)… [09:57:43] miraheze/mw-config - pskyechology the build passed. [09:57:53] !log [skye@mwtask181] starting deploy of {'pull': 'config', 'config': True} to all [09:58:16] !log [skye@mwtask181] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 23s [09:58:40] !log [skye@mwtask171] sudo -u www-data php /srv/mediawiki/1.45/maintenance/run.php updateCollation --wiki=wikitransportwiki (END - exit=0) [10:29:57] [02puppet] 07RhinosF1 created 03RhinosF1-patch-2 (+1 new commit) 13https://github.com/miraheze/puppet/commit/4f95a41322ec [10:29:57] 02puppet/03RhinosF1-patch-2 07RhinosF1 034f95a41 don't set fallback CSP on a 304 [10:30:04] [02puppet] 07RhinosF1 opened pull request #4836: don't set fallback CSP on a 304 (03main...03RhinosF1-patch-2) 13https://github.com/miraheze/puppet/pull/4836 [10:34:29] [02puppet] 07RhinosF1 commented on pull request #4836: @coderabbitai review 13https://github.com/miraheze/puppet/pull/4836#issuecomment-4161618059 [10:34:34] [02puppet] 07coderabbitai[bot] commented on pull request #4836:
[…] 13https://github.com/miraheze/puppet/pull/4836#issuecomment-4161618600 [10:36:23] [02puppet] 07coderabbitai[bot] commented on pull request #4836: No actionable comments were generated in the recent review. 🎉 […] 13https://github.com/miraheze/puppet/pull/4836#issuecomment-4161629277 [11:45:54] [02puppet] 07paladox merged 07RhinosF1's pull request #4836: don't set fallback CSP on a 304 (03main...03RhinosF1-patch-2) 13https://github.com/miraheze/puppet/pull/4836 [11:45:54] [02puppet] 07paladox pushed 1 new commit to 03main 13https://github.com/miraheze/puppet/commit/d0b1aebde4a4e6841b00c26ff9cd86542867aac8 [11:45:55] 02puppet/03main 07RhinosF1 03d0b1aeb don't set fallback CSP on a 304 (#4836) [11:45:57] [02puppet] 07paladox 04deleted 03RhinosF1-patch-2 at 034f95a41 13https://api.github.com/repos/miraheze/puppet/commit/4f95a41 [11:57:22] [02python-functions] 07renovate[bot] 04force-pushed 03renovate/all-deps from 03d9f041e to 0355df08f 13https://api.github.com/repos/miraheze/python-functions/commits/renovate/all-deps [11:57:22] 02python-functions/03renovate/all-deps 07renovate[bot] 0355df08f chore(deps): update all dependencies [12:44:04] [02mw-config] 07YTFGolf pushed 1 new commit to 03main 13https://github.com/miraheze/mw-config/commit/e8c428e8a84cb467f61bd9c2e7c64ee973b48506 [12:44:04] 02mw-config/03main 07WWR 03e8c428e Alphabetise `$wgCategoryCollation` [12:45:21] miraheze/mw-config - YTFGolf the build passed. [12:46:54] let's pretend this is accurate okay [13:14:03] !log [wwr@mwtask171] Starting import for steinworldwiki (XML: ./history.xml; Images: None) (START) [13:14:04] !log [wwr@mwtask171] sudo -u www-data php /srv/mediawiki/1.45/maintenance/run.php importDump --wiki=steinworldwiki --no-updates --username-prefix=wikia:steingame -- ./history.xml (START) [13:18:36] [02TSPortal] 07renovate[bot] created 03renovate/dev-deps (+1 new commit) 13https://github.com/miraheze/TSPortal/commit/5134e506d980 [13:18:37] 02TSPortal/03renovate/dev-deps 07renovate[bot] 035134e50 Update dependency phpunit/phpunit to v13.0.6 [13:28:56] !log [wwr@mwtask171] sudo -u www-data php /srv/mediawiki/1.45/maintenance/run.php importDump --wiki=steinworldwiki --no-updates --username-prefix=wikia:steingame -- ./history.xml (END - exit=0) [13:28:57] !log [wwr@mwtask171] sudo -u www-data php /srv/mediawiki/1.45/maintenance/run.php rebuildall --wiki=steinworldwiki (START) [13:36:29] !log [wwr@mwtask171] sudo -u www-data php /srv/mediawiki/1.45/maintenance/run.php rebuildall --wiki=steinworldwiki (END - exit=0) [13:36:30] !log [wwr@mwtask171] sudo -u www-data php /srv/mediawiki/1.45/maintenance/run.php initEditCount --wiki=steinworldwiki (START) [13:36:31] !log [wwr@mwtask171] sudo -u www-data php /srv/mediawiki/1.45/maintenance/run.php initEditCount --wiki=steinworldwiki (END - exit=0) [13:36:32] !log [wwr@mwtask171] sudo -u www-data php /srv/mediawiki/1.45/maintenance/run.php initSiteStats --wiki=steinworldwiki --update (START) [13:36:33] !log [wwr@mwtask171] sudo -u www-data php /srv/mediawiki/1.45/maintenance/run.php initSiteStats --wiki=steinworldwiki --update (END - exit=0) [13:36:34] !log [wwr@mwtask171] Finished import for steinworldwiki (XML: ./history.xml; Images: None) (END - exit=0) [14:13:53] [02mw-config] 07dependabot[bot] created 03dependabot/composer/phpunit/phpunit-13.0.6 (+1 new commit) 13https://github.com/miraheze/mw-config/commit/12b90f1649ba [14:13:53] 02mw-config/03dependabot/composer/phpunit/phpunit-13.0.6 07dependabot[bot] 0312b90f1 Update phpunit/phpunit requirement from 13.0.5 to 13.0.6… [14:13:55] [02mw-config] 07dependabot[bot] added the label 'php' to pull request #6354 (Update phpunit/phpunit requirement from 13.0.5 to 13.0.6) 13https://github.com/miraheze/mw-config/pull/6354 [14:13:55] [02mw-config] 07dependabot[bot] added the label 'dependencies' to pull request #6354 (Update phpunit/phpunit requirement from 13.0.5 to 13.0.6) 13https://github.com/miraheze/mw-config/pull/6354 [14:13:57] [02mw-config] 07dependabot[bot] opened pull request #6354: Update phpunit/phpunit requirement from 13.0.5 to 13.0.6 (03main...03dependabot/composer/phpunit/phpunit-13.0.6) 13https://github.com/miraheze/mw-config/pull/6354 [14:13:59] [02mw-config] 07dependabot[bot] added the label 'php' to pull request #6354 (Update phpunit/phpunit requirement from 13.0.5 to 13.0.6) 13https://github.com/miraheze/mw-config/pull/6354 [14:14:01] [02mw-config] 07dependabot[bot] added the label 'dependencies' to pull request #6354 (Update phpunit/phpunit requirement from 13.0.5 to 13.0.6) 13https://github.com/miraheze/mw-config/pull/6354 [14:15:09] miraheze/mw-config - dependabot[bot] the build passed. [15:46:05] PROBLEM - mwtask161 Puppet on mwtask161 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_mathoid] [16:00:34] [02ssl] 07WikiTideBot pushed 1 new commit to 03main 13https://github.com/miraheze/ssl/commit/da88f25dd20e70369a669aff9a13ff3cff4daae4 [16:00:34] 02ssl/03main 07WikiTideBot 03da88f25 Bot: Auto-update domain lists [16:12:05] RECOVERY - mwtask161 Puppet on mwtask161 is OK: OK: Puppet is currently enabled, last run 22 seconds ago with 0 failures [16:30:32] [02ssl] 07WikiTideBot pushed 1 new commit to 03main 13https://github.com/miraheze/ssl/commit/fb0d320383604c0c5e68423563b2a99123f287d4 [16:30:32] 02ssl/03main 07WikiTideBot 03fb0d320 Bot: Auto-update domain lists [16:50:42] !log [wwr@mwtask171] Starting import for ppcwiki (XML: ./history.xml; Images: ./images) (START) [16:50:43] !log [wwr@mwtask171] sudo -u www-data php /srv/mediawiki/1.45/maintenance/run.php importDump --wiki=ppcwiki --no-updates --username-prefix=wikia:ppc -- ./history.xml (START) [17:01:36] !log [skye@mwtask171] sudo -u www-data php /srv/mediawiki/1.45/maintenance/run.php purgeParserCache --wiki=vanguardswiki --age=600 (END - exit=0) [17:22:18] !log [wwr@mwtask171] sudo -u www-data php /srv/mediawiki/1.45/maintenance/run.php importDump --wiki=ppcwiki --no-updates --username-prefix=wikia:ppc -- ./history.xml (END - exit=0) [17:22:19] !log [wwr@mwtask171] sudo -u www-data php /srv/mediawiki/1.45/maintenance/run.php importImages --wiki=ppcwiki --sleep=1 '--comment=Importing images from https://ppc.fandom.com/ ([[phorge:T15143|T15143]])' -- ./images (START) [17:37:23] [02landing] 07renovate[bot] 04force-pushed 03renovate/all-deps from 038ad7299 to 03745b096 13https://api.github.com/repos/miraheze/landing/commits/renovate/all-deps [17:37:23] 02landing/03renovate/all-deps 07renovate[bot] 03745b096 Update styfle/cancel-workflow-action action to v0.13.1 [18:05:00] !log [wwr@mwtask171] sudo -u www-data php /srv/mediawiki/1.45/maintenance/run.php importImages --wiki=ppcwiki --sleep=1 '--comment=Importing images from https://ppc.fandom.com/ ([[phorge:T15143|T15143]])' -- ./images (END - exit=0) [18:05:01] !log [wwr@mwtask171] sudo -u www-data php /srv/mediawiki/1.45/maintenance/run.php rebuildall --wiki=ppcwiki (START) [18:21:24] !log [wwr@mwtask171] sudo -u www-data php /srv/mediawiki/1.45/maintenance/run.php rebuildall --wiki=ppcwiki (END - exit=0) [18:21:25] !log [wwr@mwtask171] sudo -u www-data php /srv/mediawiki/1.45/maintenance/run.php initEditCount --wiki=ppcwiki (START) [18:21:26] !log [wwr@mwtask171] sudo -u www-data php /srv/mediawiki/1.45/maintenance/run.php initEditCount --wiki=ppcwiki (END - exit=0) [18:21:27] !log [wwr@mwtask171] sudo -u www-data php /srv/mediawiki/1.45/maintenance/run.php initSiteStats --wiki=ppcwiki --update (START) [18:21:28] !log [wwr@mwtask171] sudo -u www-data php /srv/mediawiki/1.45/maintenance/run.php initSiteStats --wiki=ppcwiki --update (END - exit=0) [18:21:29] !log [wwr@mwtask171] Finished import for ppcwiki (XML: ./history.xml; Images: ./images) (END - exit=0) [20:47:42] PROBLEM - cp161 HTTP 4xx/5xx ERROR Rate on cp161 is WARNING: WARNING - NGINX Error Rate is 44% [20:51:42] RECOVERY - cp161 HTTP 4xx/5xx ERROR Rate on cp161 is OK: OK - NGINX Error Rate is 24% [21:02:58] [02TSPortal] 07renovate[bot] merged 03renovate/dev-deps into 03main 13https://github.com/miraheze/TSPortal/compare/4bbcbec30b2c...5134e506d980 [21:03:06] [02TSPortal] 07renovate[bot] 04deleted 03renovate/dev-deps at 035134e50 13https://api.github.com/repos/miraheze/TSPortal/commit/5134e50 [21:15:59] PROBLEM - db161 APT on db161 is CRITICAL: APT CRITICAL: 75 packages available for upgrade (1 critical updates). [21:17:59] PROBLEM - mem151 APT on mem151 is CRITICAL: APT CRITICAL: 65 packages available for upgrade (1 critical updates). [21:18:16] PROBLEM - os201 APT on os201 is CRITICAL: APT CRITICAL: 65 packages available for upgrade (1 critical updates). [21:18:33] PROBLEM - mw193 APT on mw193 is CRITICAL: APT CRITICAL: 72 packages available for upgrade (3 critical updates). [21:18:34] PROBLEM - ns1 APT on ns1 is CRITICAL: APT CRITICAL: 65 packages available for upgrade (1 critical updates). [21:18:49] PROBLEM - cloud15 APT on cloud15 is CRITICAL: APT CRITICAL: 78 packages available for upgrade (1 critical updates). [21:19:07] PROBLEM - os151 APT on os151 is CRITICAL: APT CRITICAL: 65 packages available for upgrade (1 critical updates). [21:19:33] PROBLEM - db171 APT on db171 is CRITICAL: APT CRITICAL: 75 packages available for upgrade (1 critical updates). [21:19:46] PROBLEM - cloud21 APT on cloud21 is CRITICAL: APT CRITICAL: 88 packages available for upgrade (1 critical updates). [21:22:31] PROBLEM - mw153 APT on mw153 is CRITICAL: APT CRITICAL: 72 packages available for upgrade (3 critical updates). [21:22:46] PROBLEM - mw171 APT on mw171 is CRITICAL: APT CRITICAL: 72 packages available for upgrade (3 critical updates). [21:23:17] PROBLEM - mw191 APT on mw191 is CRITICAL: APT CRITICAL: 72 packages available for upgrade (3 critical updates). [21:23:32] PROBLEM - db182 APT on db182 is CRITICAL: APT CRITICAL: 81 packages available for upgrade (1 critical updates). [21:23:34] PROBLEM - db201 APT on db201 is CRITICAL: APT CRITICAL: 88 packages available for upgrade (1 critical updates). [21:24:36] PROBLEM - kafka182 APT on kafka182 is CRITICAL: APT CRITICAL: 68 packages available for upgrade (1 critical updates). [21:25:18] PROBLEM - bots171 APT on bots171 is CRITICAL: APT CRITICAL: 66 packages available for upgrade (1 critical updates). [21:26:37] PROBLEM - cloud19 APT on cloud19 is CRITICAL: APT CRITICAL: 78 packages available for upgrade (1 critical updates). [21:26:47] PROBLEM - mw192 APT on mw192 is CRITICAL: APT CRITICAL: 72 packages available for upgrade (3 critical updates). [21:26:55] PROBLEM - cp161 APT on cp161 is CRITICAL: APT CRITICAL: 66 packages available for upgrade (1 critical updates). [21:27:15] PROBLEM - cp191 APT on cp191 is CRITICAL: APT CRITICAL: 66 packages available for upgrade (1 critical updates). [21:27:25] PROBLEM - swiftobject171 APT on swiftobject171 is CRITICAL: APT CRITICAL: 68 packages available for upgrade (1 critical updates). [21:28:21] PROBLEM - mem191 APT on mem191 is CRITICAL: APT CRITICAL: 65 packages available for upgrade (1 critical updates). [21:28:47] doing [21:28:55] PROBLEM - os202 APT on os202 is CRITICAL: APT CRITICAL: 67 packages available for upgrade (1 critical updates). [21:28:59] PROBLEM - os162 APT on os162 is CRITICAL: APT CRITICAL: 65 packages available for upgrade (1 critical updates). [21:29:07] !log [somerandomdeveloper@puppet181] Upgraded packages on bots171: libpng16-16t64 [21:29:16] RECOVERY - bots171 APT on bots171 is OK: APT OK: 65 packages available for upgrade (0 critical updates). [21:29:37] PROBLEM - graylog161 APT on graylog161 is CRITICAL: APT CRITICAL: 69 packages available for upgrade (1 critical updates). [21:29:51] PROBLEM - mw151 APT on mw151 is CRITICAL: APT CRITICAL: 72 packages available for upgrade (3 critical updates). [21:30:11] !log [somerandomdeveloper@puppet181] Upgraded packages on cp161: libpng16-16t64 [21:30:20] PROBLEM - mw163 APT on mw163 is CRITICAL: APT CRITICAL: 72 packages available for upgrade (3 critical updates). [21:30:42] !log [somerandomdeveloper@puppet181] Upgraded packages on db161: libpng16-16t64 [21:30:52] RECOVERY - cp161 APT on cp161 is OK: APT OK: 65 packages available for upgrade (0 critical updates). [21:31:33] PROBLEM - db181 APT on db181 is CRITICAL: APT CRITICAL: 75 packages available for upgrade (1 critical updates). [21:31:51] PROBLEM - os191 APT on os191 is CRITICAL: APT CRITICAL: 65 packages available for upgrade (1 critical updates). [21:31:52] !log [somerandomdeveloper@puppet181] Upgraded packages on db151: libpng16-16t64 [21:31:58] RECOVERY - db161 APT on db161 is OK: APT OK: 74 packages available for upgrade (0 critical updates). [21:32:05] !log [somerandomdeveloper@puppet181] Upgraded packages on cloud15: libpng16-16t64 [21:32:16] !log [somerandomdeveloper@puppet181] Upgraded packages on cloud21: libpng16-16t64 [21:32:20] PROBLEM - cloud18 APT on cloud18 is CRITICAL: APT CRITICAL: 78 packages available for upgrade (1 critical updates). [21:32:29] PROBLEM - test151 APT on test151 is CRITICAL: APT CRITICAL: 79 packages available for upgrade (3 critical updates). [21:32:34] PROBLEM - mw181 APT on mw181 is CRITICAL: APT CRITICAL: 72 packages available for upgrade (3 critical updates). [21:32:35] PROBLEM - ns2 APT on ns2 is CRITICAL: APT CRITICAL: 75 packages available for upgrade (1 critical updates). [21:32:45] !log [somerandomdeveloper@puppet181] Upgraded packages on cloud20: libpng16-16t64 [21:32:59] RECOVERY - cloud15 APT on cloud15 is OK: APT OK: 77 packages available for upgrade (0 critical updates). [21:33:08] !log [somerandomdeveloper@puppet181] Upgraded packages on db171: libpng16-16t64 [21:33:19] PROBLEM - eventgate182 APT on eventgate182 is CRITICAL: APT CRITICAL: 66 packages available for upgrade (1 critical updates). [21:33:27] PROBLEM - swiftobject151 APT on swiftobject151 is CRITICAL: APT CRITICAL: 68 packages available for upgrade (1 critical updates). [21:33:29] RECOVERY - db171 APT on db171 is OK: APT OK: 74 packages available for upgrade (0 critical updates). [21:33:32] !log [somerandomdeveloper@puppet181] Upgraded packages on cloud16: libpng16-16t64 [21:33:33] PROBLEM - mwtask181 APT on mwtask181 is CRITICAL: APT CRITICAL: 76 packages available for upgrade (3 critical updates). [21:33:40] PROBLEM - reports171 APT on reports171 is CRITICAL: APT CRITICAL: 67 packages available for upgrade (1 critical updates). [21:33:46] !log [somerandomdeveloper@puppet181] Upgraded packages on db182: libpng16-16t64 [21:33:49] RECOVERY - cloud21 APT on cloud21 is OK: APT OK: 87 packages available for upgrade (0 critical updates). [21:34:01] !log [somerandomdeveloper@puppet181] Upgraded packages on db181: libpng16-16t64 [21:34:15] PROBLEM - swiftobject161 APT on swiftobject161 is CRITICAL: APT CRITICAL: 68 packages available for upgrade (1 critical updates). [21:34:15] !log [somerandomdeveloper@puppet181] Upgraded packages on cp191: libpng16-16t64 [21:34:30] !log [somerandomdeveloper@puppet181] Upgraded packages on bast181: libpng16-16t64 [21:34:30] PROBLEM - os161 APT on os161 is CRITICAL: APT CRITICAL: 65 packages available for upgrade (1 critical updates). [21:34:43] !log [somerandomdeveloper@puppet181] Upgraded packages on cloud19: libpng16-16t64 [21:35:01] !log [somerandomdeveloper@puppet181] Upgraded packages on db192: libpng16-16t64 [21:35:09] PROBLEM - ldap171 APT on ldap171 is CRITICAL: APT CRITICAL: 65 packages available for upgrade (1 critical updates). [21:35:13] PROBLEM - mw152 APT on mw152 is CRITICAL: APT CRITICAL: 72 packages available for upgrade (3 critical updates). [21:35:19] !log [somerandomdeveloper@puppet181] Upgraded packages on db201: libpng16-16t64 [21:35:25] RECOVERY - cp191 APT on cp191 is OK: APT OK: 65 packages available for upgrade (0 critical updates). [21:35:31] RECOVERY - db201 APT on db201 is OK: APT OK: 87 packages available for upgrade (0 critical updates). [21:35:32] PROBLEM - mon181 APT on mon181 is CRITICAL: APT CRITICAL: 77 packages available for upgrade (1 critical updates). [21:35:33] !log [somerandomdeveloper@puppet181] Upgraded packages on cloud18: libpng16-16t64 [21:35:35] PROBLEM - mw201 APT on mw201 is CRITICAL: APT CRITICAL: 72 packages available for upgrade (3 critical updates). [21:35:40] RECOVERY - db181 APT on db181 is OK: APT OK: 74 packages available for upgrade (0 critical updates). [21:35:46] !log [somerandomdeveloper@puppet181] Upgraded packages on eventgate182: libpng16-16t64 [21:35:47] RECOVERY - db182 APT on db182 is OK: APT OK: 80 packages available for upgrade (0 critical updates). [21:36:06] !log [somerandomdeveloper@puppet181] Upgraded packages on graylog161: libpng16-16t64 [21:36:16] !log [somerandomdeveloper@puppet181] Upgraded packages on mattermost2: libpng16-16t64 [21:36:17] RECOVERY - cloud18 APT on cloud18 is OK: APT OK: 77 packages available for upgrade (0 critical updates). [21:36:29] !log [somerandomdeveloper@puppet181] Upgraded packages on matomo151: libpng16-16t64 [21:36:42] !log [somerandomdeveloper@puppet181] Upgraded packages on ldap171: libpng16-16t64 [21:36:43] RECOVERY - cloud19 APT on cloud19 is OK: APT OK: 77 packages available for upgrade (0 critical updates). [21:36:58] !log [somerandomdeveloper@puppet181] Upgraded packages on kafka182: libpng16-16t64 [21:37:02] PROBLEM - mw183 APT on mw183 is CRITICAL: APT CRITICAL: 72 packages available for upgrade (3 critical updates). [21:37:10] RECOVERY - ldap171 APT on ldap171 is OK: APT OK: 64 packages available for upgrade (0 critical updates). [21:37:18] !log [somerandomdeveloper@puppet181] Upgraded packages on mem151: libpng16-16t64 [21:37:19] PROBLEM - mw182 APT on mw182 is CRITICAL: APT CRITICAL: 72 packages available for upgrade (3 critical updates). [21:37:22] RECOVERY - eventgate182 APT on eventgate182 is OK: APT OK: 65 packages available for upgrade (0 critical updates). [21:37:32] !log [somerandomdeveloper@puppet181] Upgraded packages on mem201: libpng16-16t64 [21:37:34] RECOVERY - graylog161 APT on graylog161 is OK: APT OK: 68 packages available for upgrade (0 critical updates). [21:37:50] PROBLEM - swiftobject211 APT on swiftobject211 is CRITICAL: APT CRITICAL: 65 packages available for upgrade (1 critical updates). [21:37:58] !log [somerandomdeveloper@puppet181] Upgraded packages on mw151: libpng-tools, libpng-dev, and libpng16-16t64 [21:38:08] RECOVERY - mem151 APT on mem151 is OK: APT OK: 64 packages available for upgrade (0 critical updates). [21:38:13] !log [somerandomdeveloper@puppet181] Upgraded packages on mem191: libpng16-16t64 [21:38:15] PROBLEM - cloud17 APT on cloud17 is CRITICAL: APT CRITICAL: 78 packages available for upgrade (1 critical updates). [21:38:16] PROBLEM - prometheus151 APT on prometheus151 is CRITICAL: APT CRITICAL: 69 packages available for upgrade (1 critical updates). [21:38:21] RECOVERY - mem191 APT on mem191 is OK: APT OK: 64 packages available for upgrade (0 critical updates). [21:38:27] !log [somerandomdeveloper@puppet181] Upgraded packages on mon181: libpng16-16t64 [21:38:34] RECOVERY - kafka182 APT on kafka182 is OK: APT OK: 67 packages available for upgrade (0 critical updates). [21:38:43] !log [somerandomdeveloper@puppet181] Upgraded packages on mw162: libpng-tools, libpng-dev, and libpng16-16t64 [21:38:51] PROBLEM - changeprop202 APT on changeprop202 is CRITICAL: APT CRITICAL: 66 packages available for upgrade (1 critical updates). [21:38:59] !log [somerandomdeveloper@puppet181] Upgraded packages on mw152: libpng-tools, libpng-dev, and libpng16-16t64 [21:39:10] RECOVERY - mw152 APT on mw152 is OK: APT OK: 69 packages available for upgrade (0 critical updates). [21:39:15] !log [somerandomdeveloper@puppet181] Upgraded packages on mw161: libpng-tools, libpng-dev, and libpng16-16t64 [21:39:16] PROBLEM - mw202 APT on mw202 is CRITICAL: APT CRITICAL: 72 packages available for upgrade (3 critical updates). [21:39:28] RECOVERY - mon181 APT on mon181 is OK: APT OK: 76 packages available for upgrade (0 critical updates). [21:39:33] !log [somerandomdeveloper@puppet181] Upgraded packages on mw163: libpng-tools, libpng-dev, and libpng16-16t64 [21:39:47] RECOVERY - mw151 APT on mw151 is OK: APT OK: 69 packages available for upgrade (0 critical updates). [21:39:50] !log [somerandomdeveloper@puppet181] Upgraded packages on mw171: libpng-tools, libpng-dev, and libpng16-16t64 [21:40:02] PROBLEM - cp201 APT on cp201 is CRITICAL: APT CRITICAL: 66 packages available for upgrade (1 critical updates). [21:40:07] !log [somerandomdeveloper@puppet181] Upgraded packages on mw153: libpng-tools, libpng-dev, and libpng16-16t64 [21:40:17] RECOVERY - mw163 APT on mw163 is OK: APT OK: 69 packages available for upgrade (0 critical updates). [21:40:24] !log [somerandomdeveloper@puppet181] Upgraded packages on mw172: libpng-tools, libpng-dev, and libpng16-16t64 [21:40:31] RECOVERY - mw153 APT on mw153 is OK: APT OK: 69 packages available for upgrade (0 critical updates). [21:40:34] PROBLEM - swiftproxy161 APT on swiftproxy161 is CRITICAL: APT CRITICAL: 66 packages available for upgrade (1 critical updates). [21:40:50] !log [somerandomdeveloper@puppet181] Upgraded packages on mw192: libpng-tools, libpng-dev, and libpng16-16t64 [21:40:55] RECOVERY - mw171 APT on mw171 is OK: APT OK: 69 packages available for upgrade (0 critical updates). [21:41:01] RECOVERY - mw192 APT on mw192 is OK: APT OK: 69 packages available for upgrade (0 critical updates). [21:41:08] !log [somerandomdeveloper@puppet181] Upgraded packages on mw183: libpng-tools, libpng-dev, and libpng16-16t64 [21:41:16] PROBLEM - rdb191 APT on rdb191 is CRITICAL: APT CRITICAL: 65 packages available for upgrade (1 critical updates). [21:41:25] !log [somerandomdeveloper@puppet181] Upgraded packages on mw182: libpng-tools, libpng-dev, and libpng16-16t64 [21:41:44] !log [somerandomdeveloper@puppet181] Upgraded packages on mw181: libpng-tools, libpng-dev, and libpng16-16t64 [21:41:46] PROBLEM - bast161 APT on bast161 is CRITICAL: APT CRITICAL: 77 packages available for upgrade (1 critical updates). [21:42:03] !log [somerandomdeveloper@puppet181] Upgraded packages on mw191: libpng-tools, libpng-dev, and libpng16-16t64 [21:42:06] PROBLEM - db172 APT on db172 is CRITICAL: APT CRITICAL: 75 packages available for upgrade (1 critical updates). [21:42:20] PROBLEM - swiftproxy171 APT on swiftproxy171 is CRITICAL: APT CRITICAL: 66 packages available for upgrade (1 critical updates). [21:42:21] !log [somerandomdeveloper@puppet181] Upgraded packages on mw193: libpng-tools, libpng-dev, and libpng16-16t64 [21:42:29] RECOVERY - mw193 APT on mw193 is OK: APT OK: 69 packages available for upgrade (0 critical updates). [21:42:34] RECOVERY - mw181 APT on mw181 is OK: APT OK: 69 packages available for upgrade (0 critical updates). [21:42:35] PROBLEM - cp171 APT on cp171 is CRITICAL: APT CRITICAL: 66 packages available for upgrade (1 critical updates). [21:42:39] !log [somerandomdeveloper@puppet181] Upgraded packages on mwtask151: libpng-tools, libpng-dev, and libpng16-16t64 [21:42:43] PROBLEM - mwtask171 APT on mwtask171 is CRITICAL: APT CRITICAL: 76 packages available for upgrade (3 critical updates). [21:42:57] !log [somerandomdeveloper@puppet181] Upgraded packages on mw201: libpng-tools, libpng-dev, and libpng16-16t64 [21:42:59] RECOVERY - mw183 APT on mw183 is OK: APT OK: 69 packages available for upgrade (0 critical updates). [21:43:15] !log [somerandomdeveloper@puppet181] Upgraded packages on mw203: libpng-tools, libpng-dev, and libpng16-16t64 [21:43:16] PROBLEM - llm191 APT on llm191 is CRITICAL: APT CRITICAL: 68 packages available for upgrade (1 critical updates). [21:43:25] RECOVERY - mw191 APT on mw191 is OK: APT OK: 69 packages available for upgrade (0 critical updates). [21:43:27] RECOVERY - mw182 APT on mw182 is OK: APT OK: 69 packages available for upgrade (0 critical updates). [21:43:27] PROBLEM - mw173 APT on mw173 is CRITICAL: APT CRITICAL: 72 packages available for upgrade (3 critical updates). [21:43:34] !log [somerandomdeveloper@puppet181] Upgraded packages on mw202: libpng-tools, libpng-dev, and libpng16-16t64 [21:43:34] RECOVERY - mw201 APT on mw201 is OK: APT OK: 69 packages available for upgrade (0 critical updates). [21:43:38] PROBLEM - puppet181 APT on puppet181 is CRITICAL: APT CRITICAL: 71 packages available for upgrade (1 critical updates). [21:43:51] !log [somerandomdeveloper@puppet181] Upgraded packages on mwtask171: libpng-tools, libpng-dev, and libpng16-16t64 [21:43:59] PROBLEM - swiftobject191 APT on swiftobject191 is CRITICAL: APT CRITICAL: 69 packages available for upgrade (1 critical updates). [21:44:04] PROBLEM - mem161 APT on mem161 is CRITICAL: APT CRITICAL: 65 packages available for upgrade (1 critical updates). [21:44:07] !log [somerandomdeveloper@puppet181] Upgraded packages on mwtask161: libpng-tools, libpng-dev, and libpng16-16t64 [21:44:18] PROBLEM - swiftobject201 APT on swiftobject201 is CRITICAL: APT CRITICAL: 69 packages available for upgrade (1 critical updates). [21:44:22] !log [somerandomdeveloper@puppet181] Upgraded packages on os151: libpng16-16t64 [21:44:34] !log [somerandomdeveloper@puppet181] Upgraded packages on ns1: libpng16-16t64 [21:44:41] RECOVERY - mwtask171 APT on mwtask171 is OK: APT OK: 73 packages available for upgrade (0 critical updates). [21:44:48] !log [somerandomdeveloper@puppet181] Upgraded packages on phorge171: libpng16-16t64 [21:44:49] RECOVERY - ns1 APT on ns1 is OK: APT OK: 64 packages available for upgrade (0 critical updates). [21:45:02] !log [somerandomdeveloper@puppet181] Upgraded packages on prometheus151: libpng16-16t64 [21:45:05] RECOVERY - os151 APT on os151 is OK: APT OK: 64 packages available for upgrade (0 critical updates). [21:45:15] RECOVERY - mw202 APT on mw202 is OK: APT OK: 69 packages available for upgrade (0 critical updates). [21:45:15] !log [somerandomdeveloper@puppet181] Upgraded packages on puppet181: libpng16-16t64 [21:45:28] !log [somerandomdeveloper@puppet181] Upgraded packages on os161: libpng16-16t64 [21:45:31] PROBLEM - swiftobject181 APT on swiftobject181 is CRITICAL: APT CRITICAL: 69 packages available for upgrade (1 critical updates). [21:45:39] RECOVERY - puppet181 APT on puppet181 is OK: APT OK: 70 packages available for upgrade (0 critical updates). [21:45:42] !log [somerandomdeveloper@puppet181] Upgraded packages on os191: libpng16-16t64 [21:46:01] !log [somerandomdeveloper@puppet181] Upgraded packages on mwtask181: libpng-tools, libpng-dev, and libpng16-16t64 [21:46:07] RECOVERY - os191 APT on os191 is OK: APT OK: 64 packages available for upgrade (0 critical updates). [21:46:15] RECOVERY - prometheus151 APT on prometheus151 is OK: APT OK: 68 packages available for upgrade (0 critical updates). [21:46:22] !log [somerandomdeveloper@puppet181] Upgraded packages on os202: libpng16-16t64 [21:46:25] PROBLEM - swiftac171 APT on swiftac171 is CRITICAL: APT CRITICAL: 66 packages available for upgrade (1 critical updates). [21:46:30] RECOVERY - os161 APT on os161 is OK: APT OK: 64 packages available for upgrade (0 critical updates). [21:46:37] !log [somerandomdeveloper@puppet181] Upgraded packages on os162: libpng16-16t64 [21:46:50] !log [somerandomdeveloper@puppet181] Upgraded packages on reports171: libpng16-16t64 [21:47:01] RECOVERY - os162 APT on os162 is OK: APT OK: 64 packages available for upgrade (0 critical updates). [21:47:07] !log [somerandomdeveloper@puppet181] Upgraded packages on rdb191: libpng16-16t64 [21:47:14] RECOVERY - rdb191 APT on rdb191 is OK: APT OK: 64 packages available for upgrade (0 critical updates). [21:47:21] !log [somerandomdeveloper@puppet181] Upgraded packages on os201: libpng16-16t64 [21:47:23] RECOVERY - os202 APT on os202 is OK: APT OK: 66 packages available for upgrade (0 critical updates). [21:47:35] !log [somerandomdeveloper@puppet181] Upgraded packages on swiftobject151: libpng16-16t64 [21:47:43] RECOVERY - swiftobject151 APT on swiftobject151 is OK: APT OK: 67 packages available for upgrade (0 critical updates). [21:47:47] RECOVERY - mwtask181 APT on mwtask181 is OK: APT OK: 73 packages available for upgrade (0 critical updates). [21:47:49] !log [somerandomdeveloper@puppet181] Upgraded packages on swiftac171: libpng16-16t64 [21:47:54] RECOVERY - reports171 APT on reports171 is OK: APT OK: 66 packages available for upgrade (0 critical updates). [21:48:04] !log [somerandomdeveloper@puppet181] Upgraded packages on swiftobject171: libpng16-16t64 [21:48:11] RECOVERY - os201 APT on os201 is OK: APT OK: 64 packages available for upgrade (0 critical updates). [21:48:20] !log [somerandomdeveloper@puppet181] Upgraded packages on ns2: libpng16-16t64 [21:48:28] RECOVERY - swiftac171 APT on swiftac171 is OK: APT OK: 65 packages available for upgrade (0 critical updates). [21:48:35] !log [somerandomdeveloper@puppet181] Upgraded packages on swiftobject161: libpng16-16t64 [21:48:39] RECOVERY - ns2 APT on ns2 is OK: APT OK: 74 packages available for upgrade (0 critical updates). [21:48:51] !log [somerandomdeveloper@puppet181] Upgraded packages on swiftobject181: libpng16-16t64 [21:49:04] !log [somerandomdeveloper@puppet181] Upgraded packages on swiftobject211: libpng16-16t64 [21:49:19] !log [somerandomdeveloper@puppet181] Upgraded packages on swiftobject191: libpng16-16t64 [21:49:22] RECOVERY - swiftobject171 APT on swiftobject171 is OK: APT OK: 67 packages available for upgrade (0 critical updates). [21:49:36] RECOVERY - swiftobject181 APT on swiftobject181 is OK: APT OK: 68 packages available for upgrade (0 critical updates). [21:49:37] !log [somerandomdeveloper@puppet181] Upgraded packages on test151: libpng-tools, libpng-dev, and libpng16-16t64 [21:49:52] !log [somerandomdeveloper@puppet181] Upgraded packages on swiftproxy161: libpng16-16t64 [21:49:53] RECOVERY - swiftobject211 APT on swiftobject211 is OK: APT OK: 64 packages available for upgrade (0 critical updates). [21:50:05] RECOVERY - swiftobject191 APT on swiftobject191 is OK: APT OK: 68 packages available for upgrade (0 critical updates). [21:50:06] !log [somerandomdeveloper@puppet181] Upgraded packages on swiftproxy171: libpng16-16t64 [21:50:11] RECOVERY - swiftobject161 APT on swiftobject161 is OK: APT OK: 67 packages available for upgrade (0 critical updates). [21:50:21] !log [somerandomdeveloper@puppet181] Upgraded packages on swiftobject201: libpng16-16t64 [21:50:29] RECOVERY - test151 APT on test151 is OK: APT OK: 76 packages available for upgrade (0 critical updates). [21:50:29] RECOVERY - swiftproxy171 APT on swiftproxy171 is OK: APT OK: 65 packages available for upgrade (0 critical updates). [21:50:46] RECOVERY - swiftproxy161 APT on swiftproxy161 is OK: APT OK: 65 packages available for upgrade (0 critical updates). [21:50:57] !log [somerandomdeveloper@puppet181] Upgraded packages on bast161: libpng16-16t64 [21:51:30] !log [somerandomdeveloper@puppet181] Upgraded packages on db172: libpng16-16t64 [21:51:42] RECOVERY - bast161 APT on bast161 is OK: APT OK: 76 packages available for upgrade (0 critical updates). [21:52:04] RECOVERY - db172 APT on db172 is OK: APT OK: 74 packages available for upgrade (0 critical updates). [21:52:16] RECOVERY - swiftobject201 APT on swiftobject201 is OK: APT OK: 68 packages available for upgrade (0 critical updates). [21:52:48] !log [somerandomdeveloper@puppet181] Upgraded packages on mem161: libpng16-16t64 [21:53:13] !log [somerandomdeveloper@puppet181] Upgraded packages on mw173: libpng-tools, libpng-dev, and libpng16-16t64 [21:53:34] RECOVERY - mw173 APT on mw173 is OK: APT OK: 69 packages available for upgrade (0 critical updates). [21:53:34] !log [somerandomdeveloper@puppet181] Upgraded packages on llm191: libpng16-16t64 [21:54:03] RECOVERY - mem161 APT on mem161 is OK: APT OK: 64 packages available for upgrade (0 critical updates). [21:54:18] !log [somerandomdeveloper@puppet181] Upgraded packages on cp171: libpng16-16t64 [21:54:31] !log [somerandomdeveloper@puppet181] Upgraded packages on cp201: libpng16-16t64 [21:54:41] RECOVERY - cp171 APT on cp171 is OK: APT OK: 65 packages available for upgrade (0 critical updates). [21:54:54] !log [somerandomdeveloper@puppet181] Upgraded packages on changeprop202: libpng16-16t64 [21:55:15] !log [somerandomdeveloper@puppet181] Upgraded packages on cloud17: libpng16-16t64 [21:55:27] RECOVERY - llm191 APT on llm191 is OK: APT OK: 67 packages available for upgrade (0 critical updates). [21:56:05] RECOVERY - cp201 APT on cp201 is OK: APT OK: 65 packages available for upgrade (0 critical updates). [21:56:11] RECOVERY - cloud17 APT on cloud17 is OK: APT OK: 77 packages available for upgrade (0 critical updates). [21:56:51] RECOVERY - changeprop202 APT on changeprop202 is OK: APT OK: 65 packages available for upgrade (0 critical updates). [22:12:41] RECOVERY - db172 Disk Space on db172 is OK: DISK OK - free space: / 3785MiB (12.8% inode=95%); [22:13:21] !log ran "SET GLOBAL slave_connections_needed_for_purge = 0;" on db172 (https://jira.mariadb.org/browse/MDEV-38849) [22:16:10] [02puppet] 07SomeMWDev created 03T15160 (+1 new commit) 13https://github.com/miraheze/puppet/commit/45c972b0397c [22:16:10] 02puppet/03T15160 07SomeRandomDeveloper 0345c972b T15160: Set slave_connections_needed_for_purge to 0… [22:16:27] [02puppet] 07SomeMWDev opened pull request #4837: T15160: Set slave_connections_needed_for_purge to 0 (03main...03T15160) 13https://github.com/miraheze/puppet/pull/4837 [22:17:19] [02puppet] 07SomeMWDev commented on pull request #4837: We need to remove this once we have replication, but we don't right now AFAIK, so this is a temporary solution 13https://github.com/miraheze/puppet/pull/4837#issuecomment-4165921370 [22:19:22] Random silently fixing the DB when the rest of us are saying silly things in various channels. [22:19:31] RECOVERY - db192 Disk Space on db192 is OK: DISK OK - free space: / 135404MiB (52.6% inode=100%); [22:20:52] !log temporarily set slave_connections_needed_for_purge = 0 on db161 and db192 to trigger binlog purging, then undo to match puppet state [22:21:11] lol [22:21:40] 8% => 52% free is kinda satisfying [22:21:42] RECOVERY - db161 Disk Space on db161 is OK: DISK OK - free space: / 305839MiB (34.4% inode=98%); [22:31:38] !log trigger binlog purges on db151, db171 and db181 as well [22:33:04] [02puppet] 07paladox pushed 1 new commit to 03main 13https://github.com/miraheze/puppet/commit/fbb97cc59be5e0239dc15c708f97366e9be98da4 [22:33:04] 02puppet/03main 07SomeRandomDeveloper 03fbb97cc T15160: Set slave_connections_needed_for_purge to 0 (#4837)… [22:33:04] [02puppet] 07paladox merged 07SomeMWDev's pull request #4837: T15160: Set slave_connections_needed_for_purge to 0 (03main...03T15160) 13https://github.com/miraheze/puppet/pull/4837 [22:33:05] [02puppet] 07paladox 04deleted 03T15160 at 0345c972b 13https://api.github.com/repos/miraheze/puppet/commit/45c972b [22:33:21] skye minion #1 is typing [22:33:29] 😭 [22:33:42] omg why are there three [22:33:57] tf happened while I was fixing dbs [22:34:07] you know you wanna join the skye minion army as the Security Boss [22:36:24] idk I was the original one which means I'm the best obviously [22:37:14] you get to sing "we are number one" as a treat [22:38:51] !log test123 [22:38:59] what happened to logbot [22:39:00] ugh [22:39:14] why does everything break when I have time to fix it [22:40:09] !log restart logbot on bots171 [22:40:11] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:40:23] [1/6] are you a real villain well technically nah have you ever caught a good guy like a real superhero have you ever tried a disguise alright you can see I will have to teach you how to be villains [22:40:23] [2/6] we are number 1 [22:40:24] [3/6] we are number 1 [22:40:24] [4/6] now listen closely here's a little lesson in trickery this will go down in hisotry if you wanna be a villain number one you have to catch a hero on th erun [22:40:24] [5/6] just follow my lead and sneak around be careful not to make a sounds [22:40:25] [6/6] I kinda lost it [22:40:32] now look at this net something something throw it at him not me [22:40:35] !log ran "SET GLOBAL slave_connections_needed_for_purge = 0;" on db172 (https://jira.mariadb.org/browse/MDEV-38849) [22:40:37] !log temporarily set slave_connections_needed_for_purge = 0 on db161 and db192 to trigger binlog purging, then undo to match puppet state [22:40:37] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:40:39] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:40:42] !log trigger binlog purges on db151, db171 and db181 as well [22:40:44] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:40:59] [1/2] he'll slip and slide on this banana peel what are you doing [22:41:00] [2/2] we are number 1 hey [22:41:36] we are number 1 we are number 1 we are number 1 [23:03:35] !log [somerandomdeveloper@mwtask181] sudo -u www-data php /srv/mediawiki/1.45/maintenance/run.php MirahezeMagic:GenerateExtensionDatabaseList --wiki=metawiki --extension=bucket --directory=/tmp [23:03:37] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:06:49] !log [somerandomdeveloper@mwtask181] sudo -u www-data foreachwikiindblist /tmp/bucket.php /srv/mediawiki/1.45/maintenance/run.php /srv/mediawiki/1.45/extensions/ManageWiki/maintenance/ResetWikiCaches.php [23:06:51] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:30:29] [02ssl] 07WikiTideBot pushed 1 new commit to 03main 13https://github.com/miraheze/ssl/commit/680466df11baf9ba6585f59cce084342ef2f2691 [23:30:29] 02ssl/03main 07WikiTideBot 03680466d Bot: Auto-update domain lists [23:32:12] !log [somerandomdeveloper@test151] starting deploy of {'versions': '1.45', 'upgrade_extensions': 'OATHAuth'} to test151 [23:32:13] !log [somerandomdeveloper@test151] finished deploy of {'versions': '1.45', 'upgrade_extensions': 'OATHAuth'} to test151 - SUCCESS in 1s [23:32:14] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:32:14] !log [somerandomdeveloper@mwtask181] starting deploy of {'versions': '1.45', 'upgrade_extensions': 'OATHAuth'} to all [23:32:16] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:32:18] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:32:19] scary[ [23:32:39] !log [somerandomdeveloper@mwtask181] finished deploy of {'versions': '1.45', 'upgrade_extensions': 'OATHAuth'} to all - SUCCESS in 24s [23:32:41] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:42:10] !log [somerandomdeveloper@test151] starting deploy of {'versions': '1.45', 'upgrade_extensions': 'Echo'} to test151 [23:42:11] !log [somerandomdeveloper@test151] finished deploy of {'versions': '1.45', 'upgrade_extensions': 'Echo'} to test151 - SUCCESS in 1s [23:42:13] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:42:13] !log [somerandomdeveloper@mwtask181] starting deploy of {'versions': '1.45', 'upgrade_extensions': 'Echo'} to all [23:42:15] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:42:17] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:42:40] !log [somerandomdeveloper@mwtask181] finished deploy of {'versions': '1.45', 'upgrade_extensions': 'Echo'} to all - SUCCESS in 26s [23:42:42] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log