[00:01:50] RECOVERY - ping6 on mattermost1 is OK: PING OK - Packet loss = 0%, RTA = 31.66 ms [00:54:39] PROBLEM - ping6 on mattermost1 is CRITICAL: PING CRITICAL - Packet loss = 37%, RTA = 31.65 ms [01:07:20] RECOVERY - ping6 on mattermost1 is OK: PING OK - Packet loss = 0%, RTA = 31.71 ms [01:14:58] PROBLEM - ping6 on mattermost1 is CRITICAL: PING CRITICAL - Packet loss = 100% [01:21:19] RECOVERY - ping6 on mattermost1 is OK: PING OK - Packet loss = 0%, RTA = 31.65 ms [02:00:17] PROBLEM - mem161 Current Load on mem161 is CRITICAL: LOAD CRITICAL - total load average: 6.40, 3.26, 1.44 [02:02:38] PROBLEM - mem161 Puppet on mem161 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [02:03:07] PROBLEM - mem151 Current Load on mem151 is CRITICAL: LOAD CRITICAL - total load average: 7.62, 4.31, 1.96 [02:03:14] PROBLEM - mem161 APT on mem161 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [02:04:41] PROBLEM - mem151 Puppet on mem151 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [02:06:37] RECOVERY - mem151 Puppet on mem151 is OK: OK: Puppet is currently enabled, last run 32 seconds ago with 0 failures [02:07:07] PROBLEM - mem151 Current Load on mem151 is WARNING: LOAD WARNING - total load average: 1.44, 3.82, 2.41 [02:08:42] RECOVERY - mem161 APT on mem161 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [02:09:07] RECOVERY - mem151 Current Load on mem151 is OK: LOAD OK - total load average: 0.29, 2.58, 2.12 [02:10:27] RECOVERY - mem161 Puppet on mem161 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [02:12:17] PROBLEM - mem161 Current Load on mem161 is WARNING: LOAD WARNING - total load average: 0.40, 3.43, 3.22 [02:14:17] RECOVERY - mem161 Current Load on mem161 is OK: LOAD OK - total load average: 0.07, 2.30, 2.83 [03:15:16] PROBLEM - ping6 on mattermost1 is CRITICAL: PING CRITICAL - Packet loss = 37%, RTA = 31.69 ms [03:15:24] oh shut up [03:16:02] I wonder if that’s a host problem or network problem [03:19:23] RECOVERY - ping6 on mattermost1 is OK: PING OK - Packet loss = 0%, RTA = 31.74 ms [03:29:39] idfk, its going to drive me insane and i don't even use mattermost [03:30:04] PROBLEM - ping6 on mattermost1 is CRITICAL: PING CRITICAL - Packet loss = 28%, RTA = 31.79 ms [03:31:04] ward help me [03:42:46] RECOVERY - ping6 on mattermost1 is OK: PING OK - Packet loss = 0%, RTA = 31.78 ms [03:55:09] !log [macfan@mwtask181] sudo -u www-data php /srv/mediawiki/1.42/maintenance/run.php /srv/mediawiki/1.42/extensions/CentralAuth/maintenance/createLocalAccount.php --wiki=--wiki=sakurapediawiki --user=MacFan4000 (END - exit=0) [03:55:14] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:57:51] !log [macfan@mwtask181] sudo -u www-data php /srv/mediawiki/1.42/maintenance/run.php /srv/mediawiki/1.42/extensions/CentralAuth/maintenance/createLocalAccount.php --wiki=--wiki=sakurapediawiki --user=MacFan4000 (END - exit=0) [03:57:55] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:58:32] !log [macfan@mw181] sudo -u www-data php /srv/mediawiki/1.42/maintenance/run.php /srv/mediawiki/1.42/extensions/CentralAuth/maintenance/createLocalAccount.php --wiki=--wiki=sakurapediawiki --user=MacFan4000 (END - exit=0) [03:58:37] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:58:55] !log [macfan@mw181] sudo -u www-data php /srv/mediawiki/1.42/maintenance/run.php /srv/mediawiki/1.42/extensions/CentralAuth/maintenance/createLocalAccount.php --wiki=--wiki=sakurapediawiki MacFan4000 (END - exit=0) [03:59:00] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:59:25] !log [macfan@mw181] sudo -u www-data php /srv/mediawiki/1.42/maintenance/run.php /srv/mediawiki/1.42/extensions/CentralAuth/maintenance/createLocalAccount.php --wiki=--wiki=sakurapediawiki --username=MacFan4000 (END - exit=0) [03:59:30] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [04:17:05] PROBLEM - ping6 on mattermost1 is CRITICAL: PING CRITICAL - Packet loss = 100% [04:23:25] RECOVERY - ping6 on mattermost1 is OK: PING OK - Packet loss = 0%, RTA = 31.74 ms [04:42:01] PROBLEM - ping6 on mattermost1 is CRITICAL: PING CRITICAL - Packet loss = 28%, RTA = 31.76 ms [04:44:04] RECOVERY - ping6 on mattermost1 is OK: PING OK - Packet loss = 0%, RTA = 31.78 ms [05:13:07] PROBLEM - ping6 on mattermost1 is CRITICAL: PING CRITICAL - Packet loss = 28%, RTA = 31.77 ms [05:19:27] RECOVERY - ping6 on mattermost1 is OK: PING OK - Packet loss = 0%, RTA = 31.76 ms [05:46:51] PROBLEM - ping6 on mattermost1 is CRITICAL: PING CRITICAL - Packet loss = 100% [05:55:21] RECOVERY - ping6 on mattermost1 is OK: PING OK - Packet loss = 0%, RTA = 31.69 ms [06:07:52] PROBLEM - ping6 on mattermost1 is CRITICAL: PING CRITICAL - Packet loss = 37%, RTA = 31.74 ms [06:14:07] RECOVERY - ping6 on mattermost1 is OK: PING OK - Packet loss = 0%, RTA = 31.67 ms [06:39:03] PROBLEM - ping6 on mattermost1 is CRITICAL: PING CRITICAL - Packet loss = 100% [06:45:24] RECOVERY - ping6 on mattermost1 is OK: PING OK - Packet loss = 0%, RTA = 31.75 ms [06:55:49] PROBLEM - ping6 on mattermost1 is CRITICAL: PING CRITICAL - Packet loss = 37%, RTA = 31.83 ms [06:57:52] RECOVERY - ping6 on mattermost1 is OK: PING OK - Packet loss = 0%, RTA = 31.79 ms [07:33:03] PROBLEM - ping6 on mattermost1 is CRITICAL: PING CRITICAL - Packet loss = 100% [07:39:24] RECOVERY - ping6 on mattermost1 is OK: PING OK - Packet loss = 0%, RTA = 31.78 ms [07:51:52] PROBLEM - ping6 on mattermost1 is CRITICAL: PING CRITICAL - Packet loss = 28%, RTA = 31.82 ms [07:53:55] RECOVERY - ping6 on mattermost1 is OK: PING OK - Packet loss = 0%, RTA = 31.77 ms [08:59:10] PROBLEM - ping6 on mattermost1 is CRITICAL: PING CRITICAL - Packet loss = 100% [09:01:13] RECOVERY - ping6 on mattermost1 is OK: PING OK - Packet loss = 0%, RTA = 31.78 ms [09:13:57] PROBLEM - ping6 on mattermost1 is CRITICAL: PING CRITICAL - Packet loss = 44%, RTA = 31.72 ms [09:24:20] RECOVERY - ping6 on mattermost1 is OK: PING OK - Packet loss = 0%, RTA = 31.73 ms [09:51:19] PROBLEM - ping6 on mattermost1 is CRITICAL: PING CRITICAL - Packet loss = 100% [09:55:31] RECOVERY - ping6 on mattermost1 is OK: PING OK - Packet loss = 0%, RTA = 31.67 ms [12:09:16] PROBLEM - ping6 on mattermost1 is CRITICAL: PING CRITICAL - Packet loss = 37%, RTA = 31.73 ms [12:11:35] [02CreateWiki] 07translatewiki pushed 031 commit to 03master [+0/-0/±44] 13https://github.com/miraheze/CreateWiki/compare/1ab0bf11f539...051aee35b01c [12:11:36] [02CreateWiki] 07translatewiki 03051aee3 - Localisation updates from https://translatewiki.net. [12:11:39] [02DataDump] 07translatewiki pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/DataDump/compare/452536f69ec7...57287f7f4d7d [12:11:43] [02DataDump] 07translatewiki 0357287f7 - Localisation updates from https://translatewiki.net. [12:13:24] RECOVERY - ping6 on mattermost1 is OK: PING OK - Packet loss = 0%, RTA = 31.70 ms [12:14:40] miraheze/DataDump - translatewiki the build has errored. [12:17:43] PROBLEM - ping6 on mattermost1 is CRITICAL: PING CRITICAL - Packet loss = 37%, RTA = 31.70 ms [12:19:46] RECOVERY - ping6 on mattermost1 is OK: PING OK - Packet loss = 0%, RTA = 31.75 ms [12:21:35] miraheze/CreateWiki - translatewiki the build passed. [12:24:06] PROBLEM - ping6 on mattermost1 is CRITICAL: PING CRITICAL - Packet loss = 44%, RTA = 31.77 ms [12:30:19] RECOVERY - ping6 on mattermost1 is OK: PING OK - Packet loss = 0%, RTA = 31.70 ms [12:34:12] mattermost [12:34:16] we know [12:35:02] but i'm grumpy :((( [12:37:00] Damn NDA, I’m going to join tech just to shut it his thing up [13:29:54] PROBLEM - ping6 on mattermost1 is CRITICAL: PING CRITICAL - Packet loss = 37%, RTA = 31.85 ms [13:34:06] RECOVERY - ping6 on mattermost1 is OK: PING OK - Packet loss = 0%, RTA = 32.01 ms [14:00:25] PROBLEM - ping6 on mattermost1 is CRITICAL: PING CRITICAL - Packet loss = 100% [14:06:46] RECOVERY - ping6 on mattermost1 is OK: PING OK - Packet loss = 0%, RTA = 31.73 ms [14:11:04] PROBLEM - ping6 on mattermost1 is CRITICAL: PING CRITICAL - Packet loss = 37%, RTA = 32.10 ms [14:21:31] RECOVERY - ping6 on mattermost1 is OK: PING OK - Packet loss = 0%, RTA = 31.83 ms [15:21:10] PROBLEM - ping6 on mattermost1 is CRITICAL: PING CRITICAL - Packet loss = 44%, RTA = 31.81 ms [15:35:45] RECOVERY - ping6 on mattermost1 is OK: PING OK - Packet loss = 0%, RTA = 31.67 ms [15:49:33] PROBLEM - ping6 on mattermost1 is CRITICAL: PING CRITICAL - Packet loss = 100% [15:55:53] RECOVERY - ping6 on mattermost1 is OK: PING OK - Packet loss = 0%, RTA = 31.73 ms [16:15:26] [02ManageWiki] 07AgentIsai created branch 03noperm-warning 13https://github.com/miraheze/ManageWiki/commit/2373ddf1fae45bb2b8557cc918a4aca42513c266 [16:15:29] [02ManageWiki] 07AgentIsai created branch 03noperm-warning - 13https://github.com/miraheze/ManageWiki [16:15:59] [02ManageWiki] 07AgentIsai pushed 031 commit to 03noperm-warning [+0/-0/±2] 13https://github.com/miraheze/ManageWiki/compare/2373ddf1fae4...a8606f432e63 [16:16:00] [02ManageWiki] 07AgentIsai 03a8606f4 - Warn users when they are viewing a wiki's configuration without write access [16:18:22] [02ManageWiki] 07AgentIsai opened pull request 03#494: Warn users when they are viewing a wiki's configuration without write access - 13https://github.com/miraheze/ManageWiki/pull/494 [16:21:01] miraheze/ManageWiki - AgentIsai the build has errored. [16:27:28] [02ManageWiki] 07AgentIsai pushed 031 commit to 03noperm-warning [+0/-0/±1] 13https://github.com/miraheze/ManageWiki/compare/a8606f432e63...f3eaedb72ceb [16:27:30] [02ManageWiki] 07AgentIsai 03f3eaedb - Remove mentions of context-> [16:27:32] [02ManageWiki] 07AgentIsai synchronize pull request 03#494: Warn users when they are viewing a wiki's configuration without write access - 13https://github.com/miraheze/ManageWiki/pull/494 [16:28:55] [02ManageWiki] 07github-actions[bot] pushed 031 commit to 03noperm-warning [+0/-0/±1] 13https://github.com/miraheze/ManageWiki/compare/f3eaedb72ceb...a5abfce9e5c3 [16:28:58] [02ManageWiki] 07github-actions 03a5abfce - CI: lint code to MediaWiki standards [16:29:00] [02ManageWiki] 07github-actions[bot] synchronize pull request 03#494: Warn users when they are viewing a wiki's configuration without write access - 13https://github.com/miraheze/ManageWiki/pull/494 [16:30:16] miraheze/ManageWiki - AgentIsai the build has errored. [17:01:39] PROBLEM - ping6 on mattermost1 is CRITICAL: PING CRITICAL - Packet loss = 37%, RTA = 31.99 ms [17:02:20] So about that [17:02:43] [1/2] Given that this seems a bit not entirely right, I may have been a bit hard on icinga [17:02:44] [2/2] https://cdn.discordapp.com/attachments/808001911868489748/1297968323715399791/image0.jpg?ex=6717dab3&is=67168933&hm=e5e54ff943e62c8d89a07cbfcb9856e9d0bf5b97a6440e6e9c09a9550079a27f& [17:03:22] For someone with access does mattermost actually work for ya rn, [17:07:24] The mobile app ‘works’ for me in that it asks me for a login(which I don’t have) so Idfk [17:12:03] RECOVERY - ping6 on mattermost1 is OK: PING OK - Packet loss = 0%, RTA = 31.69 ms [17:19:29] PROBLEM - ping6 on mattermost1 is CRITICAL: PING CRITICAL - Packet loss = 37%, RTA = 31.68 ms [17:23:25] Yes [17:23:44] Icinga is reporting a genuine intermittent issue though [17:29:42] !log [alex@test151] starting deploy of {'upgrade_world': True, 'versions': '1.43', 'upgrade_extensions': 'all', 'upgrade_skins': 'all'} to test151 [17:29:47] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:36:08] RECOVERY - ping6 on mattermost1 is OK: PING OK - Packet loss = 0%, RTA = 31.75 ms [17:37:38] !log [alex@test151] DEPLOY ABORTED: Non-Zero Exit Code in prep, see output. [17:37:43] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:54:53] PROBLEM - ping6 on mattermost1 is CRITICAL: PING CRITICAL - Packet loss = 60%, RTA = 31.76 ms [17:56:56] RECOVERY - ping6 on mattermost1 is OK: PING OK - Packet loss = 0%, RTA = 31.74 ms [17:59:07] [02puppet] 07redbluegreenhat pushed 031 commit to 03mirabeta-db-firewall [+0/-0/±7] 13https://github.com/miraheze/puppet/commit/94955609b7aa [17:59:09] [02puppet] 07redbluegreenhat 039495560 - Firewall test* from prod db hosts [17:59:11] [02puppet] 07redbluegreenhat created branch 03mirabeta-db-firewall - 13https://github.com/miraheze/puppet [17:59:17] [02puppet] 07redbluegreenhat opened pull request 03#4054: Firewall test* from prod db hosts - 13https://github.com/miraheze/puppet/pull/4054 [18:00:11] miraheze/puppet - redbluegreenhat the build has errored. [18:01:23] PROBLEM - ping6 on mattermost1 is CRITICAL: PING CRITICAL - Packet loss = 100% [18:01:43] [02puppet] 07redbluegreenhat pushed 031 commit to 03mirabeta-db-firewall [+0/-0/±7] 13https://github.com/miraheze/puppet/compare/94955609b7aa...2332bbd0487a [18:01:43] [02puppet] 07redbluegreenhat 032332bbd - Firewall test* from prod db hosts [18:01:47] [02puppet] 07redbluegreenhat synchronize pull request 03#4054: Firewall test* from prod db hosts - 13https://github.com/miraheze/puppet/pull/4054 [18:02:40] miraheze/puppet - redbluegreenhat the build has errored. [18:05:35] RECOVERY - ping6 on mattermost1 is OK: PING OK - Packet loss = 0%, RTA = 31.66 ms [18:06:22] [02puppet] 07redbluegreenhat pushed 031 commit to 03mirabeta-db-firewall [+0/-0/±7] 13https://github.com/miraheze/puppet/compare/2332bbd0487a...28dd41a9fa2e [18:06:24] [02puppet] 07redbluegreenhat 0328dd41a - Firewall test* from prod db hosts [18:06:25] [02puppet] 07redbluegreenhat synchronize pull request 03#4054: Firewall test* from prod db hosts - 13https://github.com/miraheze/puppet/pull/4054 [18:07:15] miraheze/puppet - redbluegreenhat the build has errored. [18:07:44] [02puppet] 07redbluegreenhat pushed 031 commit to 03mirabeta-db-firewall [+0/-0/±7] 13https://github.com/miraheze/puppet/compare/28dd41a9fa2e...a7823b741197 [18:07:45] [02puppet] 07redbluegreenhat 03a7823b7 - Firewall test* from prod db hosts [18:07:47] [02puppet] 07redbluegreenhat synchronize pull request 03#4054: Firewall test* from prod db hosts - 13https://github.com/miraheze/puppet/pull/4054 [18:08:41] miraheze/puppet - redbluegreenhat the build has errored. [18:10:00] [02puppet] 07redbluegreenhat pushed 031 commit to 03mirabeta-db-firewall [+0/-0/±7] 13https://github.com/miraheze/puppet/compare/a7823b741197...c1c1d4746e0b [18:10:03] [02puppet] 07redbluegreenhat 03c1c1d47 - Firewall test* from prod db hosts [18:10:04] [02puppet] 07redbluegreenhat synchronize pull request 03#4054: Firewall test* from prod db hosts - 13https://github.com/miraheze/puppet/pull/4054 [18:12:12] [02puppet] 07redbluegreenhat commented on pull request 03#4054: Firewall test* from prod db hosts - 13https://github.com/miraheze/puppet/pull/4054#issuecomment-2427398724 [18:12:18] [02puppet] 07coderabbitai[bot] commented on pull request 03#4054: Firewall test* from prod db hosts - 13https://github.com/miraheze/puppet/pull/4054#issuecomment-2427398867 [18:12:21] [02puppet] 07coderabbitai[bot] commented on pull request 03#4054: Firewall test* from prod db hosts - 13https://github.com/miraheze/puppet/pull/4054#issuecomment-2427398948 [18:13:46] [02puppet] 07coderabbitai[bot] edited pull request 03#4054: Firewall test* from prod db hosts - 13https://github.com/miraheze/puppet/pull/4054 [18:14:34] [02puppet] 07redbluegreenhat edited pull request 03#4054: Firewall test* from prod db hosts - 13https://github.com/miraheze/puppet/pull/4054 [18:18:15] [02puppet] 07coderabbitai[bot] edited a comment on pull request 03#4054: Firewall test* from prod db hosts - 13https://github.com/miraheze/puppet/pull/4054#issuecomment-2427398948 [18:18:18] [02puppet] 07coderabbitai[bot] reviewed pull request 03#4054 commit - 13https://github.com/miraheze/puppet/pull/4054#discussion_r1809280286 [18:18:19] [02puppet] 07coderabbitai[bot] reviewed pull request 03#4054 commit - 13https://github.com/miraheze/puppet/pull/4054#discussion_r1809280298 [18:18:20] [02puppet] 07coderabbitai[bot] reviewed pull request 03#4054 commit - 13https://github.com/miraheze/puppet/pull/4054#discussion_r1809280291 [18:25:39] [02puppet] 07redbluegreenhat pushed 031 commit to 03mirabeta-db-firewall [+0/-0/±7] 13https://github.com/miraheze/puppet/compare/c1c1d4746e0b...d4319e392c9c [18:25:40] [02puppet] 07redbluegreenhat 03d4319e3 - Firewall test* from prod db hosts [18:25:42] [02puppet] 07redbluegreenhat synchronize pull request 03#4054: Firewall test* from prod db hosts - 13https://github.com/miraheze/puppet/pull/4054 [18:27:54] [02puppet] 07redbluegreenhat pushed 031 commit to 03mirabeta-db-firewall [+0/-0/±7] 13https://github.com/miraheze/puppet/compare/d4319e392c9c...36b0751c9a4a [18:27:55] [02puppet] 07redbluegreenhat 0336b0751 - Firewall test* from prod db hosts [18:27:57] [02puppet] 07redbluegreenhat synchronize pull request 03#4054: Firewall test* from prod db hosts - 13https://github.com/miraheze/puppet/pull/4054 [18:29:21] no DOS line endings on my watch 😤 [18:30:29] PROBLEM - os161 APT on os161 is CRITICAL: APT CRITICAL: 4 packages available for upgrade (4 critical updates). [18:30:29] PROBLEM - graylog161 APT on graylog161 is CRITICAL: APT CRITICAL: 4 packages available for upgrade (4 critical updates). [18:30:41] [02puppet] 07redbluegreenhat pushed 031 commit to 03mirabeta-db-firewall [+0/-0/±7] 13https://github.com/miraheze/puppet/compare/36b0751c9a4a...1cd3edf44644 [18:30:44] [02puppet] 07redbluegreenhat 031cd3edf - Firewall test* from prod db hosts [18:30:47] [02puppet] 07redbluegreenhat synchronize pull request 03#4054: Firewall test* from prod db hosts - 13https://github.com/miraheze/puppet/pull/4054 [18:32:17] PROBLEM - puppet181 APT on puppet181 is CRITICAL: APT CRITICAL: 4 packages available for upgrade (4 critical updates). [18:32:33] PROBLEM - ping6 on mattermost1 is CRITICAL: PING CRITICAL - Packet loss = 100% [18:34:46] !log [alex@puppet181] Upgraded packages openjdk-17-jdk, openjdk-17-jdk-headless, openjdk-17-jre, and openjdk-17-jre-headless on graylog161 [18:34:51] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:34:52] PROBLEM - os151 APT on os151 is CRITICAL: APT CRITICAL: 4 packages available for upgrade (4 critical updates). [18:36:28] RECOVERY - graylog161 APT on graylog161 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [18:36:45] RECOVERY - ping6 on mattermost1 is OK: PING OK - Packet loss = 0%, RTA = 31.70 ms [18:37:30] !log [alex@puppet181] Upgraded packages openjdk-17-jdk, openjdk-17-jdk-headless, openjdk-17-jre, and openjdk-17-jre-headless on os151 [18:37:34] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:38:43] !log [alex@puppet181] Upgraded packages openjdk-17-jdk, openjdk-17-jdk-headless, openjdk-17-jre, and openjdk-17-jre-headless on os161 [18:38:48] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:38:51] RECOVERY - os151 APT on os151 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [18:38:59] !log [alex@puppet181] Upgraded packages openjdk-17-jdk, openjdk-17-jdk-headless, openjdk-17-jre, and openjdk-17-jre-headless on os162 [18:39:04] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:39:25] !log [alex@puppet181] Upgraded packages openjdk-17-jdk, openjdk-17-jdk-headless, openjdk-17-jre, and openjdk-17-jre-headless on puppet181 [18:39:30] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:40:16] RECOVERY - puppet181 APT on puppet181 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [18:40:31] RECOVERY - os161 APT on os161 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [18:43:16] PROBLEM - kafka181 Puppet on kafka181 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [18:43:39] PROBLEM - kafka181 APT on kafka181 is CRITICAL: APT CRITICAL: 2 packages available for upgrade (2 critical updates). [18:45:09] !log [alex@puppet181] restarted puppetserver [18:45:13] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:47:08] PROBLEM - mw153 Puppet on mw153 is CRITICAL: CRITICAL: Puppet has 50 failures. Last run 2 minutes ago with 50 failures. Failed resources (up to 3 shown): File[/etc/vim/vimrc.local],File[/etc/bash.bashrc],File[/etc/skel/.bashrc],File[/opt/mcrouter_2023.07.17.00-1_amd64.deb] [18:47:50] PROBLEM - mw171 Puppet on mw171 is CRITICAL: CRITICAL: Puppet has 65 failures. Last run 3 minutes ago with 65 failures. Failed resources (up to 3 shown): File[/etc/apt/trusted.gpg.d/puppetlabs.gpg],File[/usr/local/bin/puppet-enabled],File[/etc/rsyslog.d],File[/etc/rsyslog.conf] [18:48:38] [02ManageWiki] 07AgentIsai pushed 031 commit to 03noperm-warning [+0/-0/±1] 13https://github.com/miraheze/ManageWiki/compare/a5abfce9e5c3...eec1c9032c91 [18:48:40] [02ManageWiki] 07AgentIsai 03eec1c90 - Fix syntax [18:48:43] [02ManageWiki] 07AgentIsai synchronize pull request 03#494: Warn users when they are viewing a wiki's configuration without write access - 13https://github.com/miraheze/ManageWiki/pull/494 [18:51:24] miraheze/ManageWiki - AgentIsai the build has errored. [18:57:26] PROBLEM - ping6 on mattermost1 is CRITICAL: PING CRITICAL - Packet loss = 44%, RTA = 31.63 ms [19:05:45] RECOVERY - ping6 on mattermost1 is OK: PING OK - Packet loss = 0%, RTA = 32.95 ms [19:11:15] RECOVERY - kafka181 Puppet on kafka181 is OK: OK: Puppet is currently enabled, last run 28 seconds ago with 0 failures [19:15:50] RECOVERY - mw171 Puppet on mw171 is OK: OK: Puppet is currently enabled, last run 17 seconds ago with 0 failures [19:17:08] RECOVERY - mw153 Puppet on mw153 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [19:21:50] [02ManageWiki] 07AgentIsai pushed 031 commit to 03noperm-warning [+0/-0/±1] 13https://github.com/miraheze/ManageWiki/compare/eec1c9032c91...b5e7f31b15db [19:21:52] [02ManageWiki] 07AgentIsai 03b5e7f31 - Syntax [19:21:54] [02ManageWiki] 07AgentIsai synchronize pull request 03#494: Warn users when they are viewing a wiki's configuration without write access - 13https://github.com/miraheze/ManageWiki/pull/494 [19:25:41] PROBLEM - ping6 on mattermost1 is CRITICAL: PING CRITICAL - Packet loss = 100% [19:27:04] miraheze/ManageWiki - AgentIsai the build passed. [19:27:42] [02ManageWiki] 07AgentIsai pushed 031 commit to 03master [+0/-0/±2] 13https://github.com/miraheze/ManageWiki/compare/2373ddf1fae4...4d2e500a0668 [19:27:45] [02ManageWiki] 07AgentIsai 034d2e500 - Warn users when they are viewing a wiki's configuration without write access (#494) [19:27:48] [02ManageWiki] 07AgentIsai closed pull request 03#494: Warn users when they are viewing a wiki's configuration without write access - 13https://github.com/miraheze/ManageWiki/pull/494 [19:27:51] [02ManageWiki] 07AgentIsai deleted branch 03noperm-warning [19:27:52] [02ManageWiki] 07AgentIsai deleted branch 03noperm-warning - 13https://github.com/miraheze/ManageWiki [19:29:08] !log [agent@mwtask181] starting deploy of {'versions': '1.42', 'upgrade_extensions': 'ManageWiki'} to all [19:29:13] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:29:36] !log [agent@mwtask181] finished deploy of {'versions': '1.42', 'upgrade_extensions': 'ManageWiki'} to all - SUCCESS in 28s [19:29:41] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:29:53] RECOVERY - ping6 on mattermost1 is OK: PING OK - Packet loss = 0%, RTA = 31.74 ms [19:32:31] [02ManageWiki] 07AgentIsai pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ManageWiki/compare/4d2e500a0668...15e721e1ecda [19:32:34] [02ManageWiki] 07AgentIsai 0315e721e - Remove duplicate [19:32:54] miraheze/ManageWiki - AgentIsai the build passed. [19:37:45] miraheze/ManageWiki - AgentIsai the build passed. [20:39:48] PROBLEM - baligawiki.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'baligawiki.org' expires in 15 day(s) (Wed 06 Nov 2024 08:35:03 PM GMT +0000). [20:40:08] [02ssl] 07WikiTideSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/cee90cae4407...076cd0157dc2 [20:40:09] [02ssl] 07WikiTideSSLBot 03076cd01 - Bot: Update SSL cert for baligawiki.org [20:41:51] PROBLEM - ping6 on mattermost1 is CRITICAL: PING CRITICAL - Packet loss = 37%, RTA = 31.62 ms [20:48:04] RECOVERY - ping6 on mattermost1 is OK: PING OK - Packet loss = 0%, RTA = 31.66 ms [20:54:28] PROBLEM - ping6 on mattermost1 is CRITICAL: PING CRITICAL - Packet loss = 37%, RTA = 31.60 ms [20:56:31] RECOVERY - ping6 on mattermost1 is OK: PING OK - Packet loss = 0%, RTA = 31.61 ms [21:06:04] PROBLEM - ping6 on mattermost1 is CRITICAL: PING CRITICAL - Packet loss = 37%, RTA = 31.63 ms [21:08:07] RECOVERY - ping6 on mattermost1 is OK: PING OK - Packet loss = 0%, RTA = 31.63 ms [21:22:44] PROBLEM - ping6 on mattermost1 is CRITICAL: PING CRITICAL - Packet loss = 28%, RTA = 31.61 ms [21:29:04] RECOVERY - ping6 on mattermost1 is OK: PING OK - Packet loss = 0%, RTA = 31.64 ms [21:37:48] RECOVERY - baligawiki.org - LetsEncrypt on sslhost is OK: OK - Certificate 'baligawiki.org' will expire on Sun 19 Jan 2025 07:41:32 PM GMT +0000. [22:04:03] PROBLEM - ping6 on mattermost1 is CRITICAL: PING CRITICAL - Packet loss = 37%, RTA = 31.63 ms [22:12:21] RECOVERY - ping6 on mattermost1 is OK: PING OK - Packet loss = 0%, RTA = 31.64 ms [23:33:35] [02python-functions] 07dependabot[bot] created branch 03dependabot/pip/dot-github/coverage-7.6.4 - 13https://github.com/miraheze/python-functions [23:33:36] [02python-functions] 07dependabot[bot] pushed 031 commit to 03dependabot/pip/dot-github/coverage-7.6.4 [+0/-0/±1] 13https://github.com/miraheze/python-functions/commit/e83bbc15034e [23:33:39] [02python-functions] 07dependabot[bot] 03e83bbc1 - Bump coverage from 7.6.3 to 7.6.4 in /.github [23:33:41] [02python-functions] 07dependabot[bot] labeled pull request 03#86: Bump coverage from 7.6.3 to 7.6.4 in /.github - 13https://github.com/miraheze/python-functions/pull/86 [23:33:43] [02python-functions] 07dependabot[bot] opened pull request 03#86: Bump coverage from 7.6.3 to 7.6.4 in /.github - 13https://github.com/miraheze/python-functions/pull/86 [23:33:44] [02python-functions] 07dependabot[bot] labeled pull request 03#86: Bump coverage from 7.6.3 to 7.6.4 in /.github - 13https://github.com/miraheze/python-functions/pull/86 [23:33:45] [02python-functions] 07dependabot[bot] created branch 03dependabot/pip/dot-github/mypy-1.12.1 - 13https://github.com/miraheze/python-functions [23:33:47] [02python-functions] 07dependabot[bot] pushed 031 commit to 03dependabot/pip/dot-github/mypy-1.12.1 [+0/-0/±1] 13https://github.com/miraheze/python-functions/commit/259ddc171902 [23:33:48] [02python-functions] 07dependabot[bot] 03259ddc1 - Bump mypy from 1.12.0 to 1.12.1 in /.github [23:33:50] [02python-functions] 07dependabot[bot] labeled pull request 03#87: Bump mypy from 1.12.0 to 1.12.1 in /.github - 13https://github.com/miraheze/python-functions/pull/87 [23:33:51] [02python-functions] 07dependabot[bot] labeled pull request 03#87: Bump mypy from 1.12.0 to 1.12.1 in /.github - 13https://github.com/miraheze/python-functions/pull/87 [23:33:54] [02python-functions] 07dependabot[bot] opened pull request 03#87: Bump mypy from 1.12.0 to 1.12.1 in /.github - 13https://github.com/miraheze/python-functions/pull/87 [23:37:34] miraheze/python-functions - dependabot[bot] the build passed. [23:37:48] [02python-functions] 07github-merge-queue[bot] created branch 03gh-readonly-queue/master/pr-87-a32ee90dcc5b62885056acd129ffa4dc6487afee 13https://github.com/miraheze/python-functions/commit/4f9a00e351259a4c2f480f16de0a433d88eff0da [23:37:51] [02python-functions] 07github-merge-queue[bot] created branch 03gh-readonly-queue/master/pr-87-a32ee90dcc5b62885056acd129ffa4dc6487afee - 13https://github.com/miraheze/python-functions [23:37:53] [02python-functions] 07github-merge-queue[bot] created branch 03gh-readonly-queue/master/pr-86-4f9a00e351259a4c2f480f16de0a433d88eff0da - 13https://github.com/miraheze/python-functions [23:37:54] [02python-functions] 07github-merge-queue[bot] pushed 031 commit to 03gh-readonly-queue/master/pr-86-4f9a00e351259a4c2f480f16de0a433d88eff0da [+0/-0/±1] 13https://github.com/miraheze/python-functions/commit/e594e22001e1 [23:37:56] [02python-functions] 07dependabot[bot] 03e594e22 - Bump coverage from 7.6.3 to 7.6.4 in /.github (#86) [23:37:58] miraheze/python-functions - dependabot[bot] the build passed. [23:42:03] [02python-functions] 07github-merge-queue[bot] pushed 032 commits to 03master [+0/-0/±2] 13https://github.com/miraheze/python-functions/compare/a32ee90dcc5b...e594e22001e1 [23:42:04] [02python-functions] 07dependabot[bot] 034f9a00e - Bump mypy from 1.12.0 to 1.12.1 in /.github (#87) [23:42:07] [02python-functions] 07dependabot[bot] 03e594e22 - Bump coverage from 7.6.3 to 7.6.4 in /.github (#86) [23:42:10] [02python-functions] 07github-merge-queue[bot] deleted branch 03gh-readonly-queue/master/pr-87-a32ee90dcc5b62885056acd129ffa4dc6487afee - 13https://github.com/miraheze/python-functions [23:42:13] [02python-functions] 07github-merge-queue[bot] deleted branch 03gh-readonly-queue/master/pr-87-a32ee90dcc5b62885056acd129ffa4dc6487afee [23:42:16] [02python-functions] 07github-merge-queue[bot] deleted branch 03gh-readonly-queue/master/pr-86-4f9a00e351259a4c2f480f16de0a433d88eff0da [23:42:18] [02python-functions] 07github-merge-queue[bot] deleted branch 03gh-readonly-queue/master/pr-86-4f9a00e351259a4c2f480f16de0a433d88eff0da - 13https://github.com/miraheze/python-functions [23:42:19] [02python-functions] 07github-actions[bot] closed pull request 03#87: Bump mypy from 1.12.0 to 1.12.1 in /.github - 13https://github.com/miraheze/python-functions/pull/87 [23:42:22] [02python-functions] 07github-actions[bot] deleted branch 03dependabot/pip/dot-github/mypy-1.12.1 - 13https://github.com/miraheze/python-functions [23:42:23] [02python-functions] 07github-actions[bot] closed pull request 03#86: Bump coverage from 7.6.3 to 7.6.4 in /.github - 13https://github.com/miraheze/python-functions/pull/86 [23:42:24] [02python-functions] 07github-actions[bot] deleted branch 03dependabot/pip/dot-github/coverage-7.6.4 [23:42:25] [02python-functions] 07github-actions[bot] deleted branch 03dependabot/pip/dot-github/mypy-1.12.1 [23:42:28] [02python-functions] 07github-actions[bot] deleted branch 03dependabot/pip/dot-github/coverage-7.6.4 - 13https://github.com/miraheze/python-functions [23:46:07] miraheze/python-functions - github-merge-queue[bot] the build passed. [23:56:24] PROBLEM - ping6 on mattermost1 is CRITICAL: PING CRITICAL - Packet loss = 37%, RTA = 31.69 ms [23:58:27] RECOVERY - ping6 on mattermost1 is OK: PING OK - Packet loss = 0%, RTA = 31.67 ms