|
2019-07-03 00:04:12
|
<paladox>
|
!log depool mw1 for upgrade to mw1
|
|
2019-07-03 00:04:17
|
<MirahezeLogbot>
|
Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master
|
|
2019-07-03 00:04:20
|
<paladox>
|
uh, /me fixes that
|
|
2019-07-03 00:04:25
|
<paladox>
|
that's suppose to say mw 1.33
|
|
2019-07-03 00:05:59
|
<Not-7290>
|
['miraheze/puppet'] 'paladox' pushed '' commit to 'master' [+0/-0/±1] 'https://git.io/fjKbJ'
|
|
2019-07-03 00:06:01
|
<Not-7290>
|
['miraheze/puppet'] 'paladox' 'ba78cff' - mw1: Upgrade to mediawiki 1.33
|
|
2019-07-03 00:08:28
|
<icinga-miraheze>
|
PROBLEM - mw1 Puppet on mw1 is WARNING: WARNING: Puppet is currently disabled, message: mw upgrade - paladox, last run 5 minutes ago with 0 failures
|
|
2019-07-03 00:08:37
|
<icinga-miraheze>
|
PROBLEM - cp4 Varnish Backends on cp4 is CRITICAL: 1 backends are down. mw1
|
|
2019-07-03 00:09:17
|
<icinga-miraheze>
|
PROBLEM - cp2 Varnish Backends on cp2 is CRITICAL: 1 backends are down. mw1
|
|
2019-07-03 00:10:32
|
<icinga-miraheze>
|
PROBLEM - cp3 Varnish Backends on cp3 is CRITICAL: 1 backends are down. mw1
|
|
2019-07-03 00:12:32
|
<icinga-miraheze>
|
RECOVERY - cp3 Varnish Backends on cp3 is OK: All 5 backends are healthy
|
|
2019-07-03 00:12:37
|
<icinga-miraheze>
|
RECOVERY - cp4 Varnish Backends on cp4 is OK: All 5 backends are healthy
|
|
2019-07-03 00:13:17
|
<icinga-miraheze>
|
RECOVERY - cp2 Varnish Backends on cp2 is OK: All 5 backends are healthy
|
|
2019-07-03 00:14:28
|
<icinga-miraheze>
|
PROBLEM - mw1 Puppet on mw1 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 36 seconds ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core]
|
|
2019-07-03 00:20:28
|
<icinga-miraheze>
|
RECOVERY - mw1 Puppet on mw1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures
|
|
2019-07-03 00:22:14
|
<paladox>
|
!log repool mw1
|
|
2019-07-03 00:22:19
|
<MirahezeLogbot>
|
Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master
|
|
2019-07-03 00:22:25
|
<paladox>
|
!log depool mw3 for mw upgrade to 1.33
|
|
2019-07-03 00:22:30
|
<MirahezeLogbot>
|
Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master
|
|
2019-07-03 00:24:05
|
<Not-7290>
|
['miraheze/puppet'] 'paladox' pushed '' commit to 'master' [+0/-0/±1] 'https://git.io/fjKbY'
|
|
2019-07-03 00:24:06
|
<Not-7290>
|
['miraheze/puppet'] 'paladox' 'ab08df0' - mw3: Upgrade to mediawiki 1.33
|
|
2019-07-03 00:25:24
|
<icinga-miraheze>
|
PROBLEM - mw3 Puppet on mw3 is WARNING: WARNING: Puppet is currently disabled, message: mw upgrade - paladox, last run 2 minutes ago with 0 failures
|
|
2019-07-03 00:26:32
|
<icinga-miraheze>
|
PROBLEM - cp3 Varnish Backends on cp3 is CRITICAL: 1 backends are down. mw3
|
|
2019-07-03 00:26:37
|
<icinga-miraheze>
|
PROBLEM - cp4 Varnish Backends on cp4 is CRITICAL: 1 backends are down. mw3
|
|
2019-07-03 00:27:09
|
<icinga-miraheze>
|
PROBLEM - mw3 JobQueue on mw3 is CRITICAL: JOBQUEUE CRITICAL - check plugin (check_jobqueue) or PHP errors
|
|
2019-07-03 00:27:17
|
<icinga-miraheze>
|
PROBLEM - cp2 Varnish Backends on cp2 is CRITICAL: 1 backends are down. mw3
|
|
2019-07-03 00:29:09
|
<icinga-miraheze>
|
PROBLEM - mw3 JobQueue on mw3 is UNKNOWN: NRPE: Unable to read output
|
|
2019-07-03 00:30:32
|
<icinga-miraheze>
|
RECOVERY - cp3 Varnish Backends on cp3 is OK: All 5 backends are healthy
|
|
2019-07-03 00:30:37
|
<icinga-miraheze>
|
RECOVERY - cp4 Varnish Backends on cp4 is OK: All 5 backends are healthy
|
|
2019-07-03 00:31:17
|
<icinga-miraheze>
|
RECOVERY - cp2 Varnish Backends on cp2 is OK: All 5 backends are healthy
|
|
2019-07-03 00:31:23
|
<icinga-miraheze>
|
RECOVERY - mw3 Puppet on mw3 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures
|
|
2019-07-03 00:35:03
|
<paladox>
|
!log repool mw2
|
|
2019-07-03 00:35:06
|
<paladox>
|
!loguh
|
|
2019-07-03 00:35:09
|
<paladox>
|
bad
|
|
2019-07-03 00:35:13
|
<paladox>
|
*bah
|
|
2019-07-03 00:35:14
|
<MirahezeLogbot>
|
Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master
|
|
2019-07-03 00:35:40
|
<paladox>
|
!log depool mw2 to upgrade to mw 1.33
|
|
2019-07-03 00:35:45
|
<MirahezeLogbot>
|
Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master
|
|
2019-07-03 00:36:06
|
<Not-7290>
|
['miraheze/puppet'] 'paladox' pushed '' commit to 'master' [+0/-0/±1] 'https://git.io/fjKbz'
|
|
2019-07-03 00:36:08
|
<Not-7290>
|
['miraheze/puppet'] 'paladox' 'b8bd32f' - mw2: Upgrade to mediawiki 1.33
|
|
2019-07-03 00:39:12
|
<paladox>
|
!log running lc on mw1 and mw3
|
|
2019-07-03 00:39:17
|
<icinga-miraheze>
|
PROBLEM - cp2 Varnish Backends on cp2 is CRITICAL: 1 backends are down. mw2
|
|
2019-07-03 00:39:17
|
<MirahezeLogbot>
|
Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master
|
|
2019-07-03 00:39:55
|
<icinga-miraheze>
|
PROBLEM - mw2 Puppet on mw2 is WARNING: WARNING: Puppet is currently disabled, message: mw upgrade - paladox, last run 7 minutes ago with 0 failures
|
|
2019-07-03 00:40:32
|
<icinga-miraheze>
|
PROBLEM - cp3 Varnish Backends on cp3 is CRITICAL: 1 backends are down. mw2
|
|
2019-07-03 00:40:37
|
<icinga-miraheze>
|
PROBLEM - cp4 Varnish Backends on cp4 is CRITICAL: 1 backends are down. mw2
|
|
2019-07-03 00:42:32
|
<icinga-miraheze>
|
RECOVERY - cp3 Varnish Backends on cp3 is OK: All 5 backends are healthy
|
|
2019-07-03 00:42:37
|
<icinga-miraheze>
|
RECOVERY - cp4 Varnish Backends on cp4 is OK: All 5 backends are healthy
|
|
2019-07-03 00:42:43
|
<icinga-miraheze>
|
PROBLEM - mw3 Current Load on mw3 is CRITICAL: CRITICAL - load average: 8.95, 7.39, 5.44
|
|
2019-07-03 00:43:17
|
<icinga-miraheze>
|
RECOVERY - cp2 Varnish Backends on cp2 is OK: All 5 backends are healthy
|
|
2019-07-03 00:45:55
|
<icinga-miraheze>
|
RECOVERY - mw2 Puppet on mw2 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures
|
|
2019-07-03 00:48:36
|
<icinga-miraheze>
|
PROBLEM - mw3 Current Load on mw3 is WARNING: WARNING - load average: 5.24, 7.16, 6.07
|
|
2019-07-03 00:50:20
|
<paladox>
|
!log repool mw2
|
|
2019-07-03 00:50:25
|
<MirahezeLogbot>
|
Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master
|
|
2019-07-03 00:50:33
|
<icinga-miraheze>
|
RECOVERY - mw3 Current Load on mw3 is OK: OK - load average: 5.20, 6.40, 5.90
|
|
2019-07-03 00:54:27
|
<Not-7290>
|
['miraheze/mediawiki'] 'paladox' pushed '' commit to 'REL1_33' [+0/-0/±1] 'https://git.io/fjKbP'
|
|
2019-07-03 00:54:29
|
<Not-7290>
|
['miraheze/mediawiki'] 'paladox' 'c72fb9' - Update pivot
|
|
2019-07-03 00:57:56
|
<Not-7290>
|
['miraheze/mediawiki'] 'paladox' pushed '' commit to 'REL1_33' [+0/-0/±1] 'https://git.io/fjKbD'
|
|
2019-07-03 00:57:58
|
<Not-7290>
|
['miraheze/mediawiki'] 'paladox' 'e862064' - Update foreground
|
|
2019-07-03 00:58:44
|
<Not-7290>
|
['miraheze/mediawiki'] 'paladox' pushed '' commit to 'REL1_33' [+0/-0/±1] 'https://git.io/fjKby'
|
|
2019-07-03 00:58:46
|
<Not-7290>
|
['miraheze/mediawiki'] 'paladox' 'b2e20c' - Update SocialProfile
|
|
2019-07-03 01:08:19
|
<paladox>
|
!log running update.php for all wikis (on mw1 in a screen)
|
|
2019-07-03 01:08:23
|
<MirahezeLogbot>
|
Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master
|
|
2019-07-03 01:15:40
|
<Not-7290>
|
['miraheze/mediawiki'] 'paladox' pushed '' commit to 'REL1_33' [+0/-0/±1] 'https://git.io/fjKbp'
|
|
2019-07-03 01:15:41
|
<Not-7290>
|
['miraheze/mediawiki'] 'paladox' 'ba9d92' - Update DiscordNotifications
|
|
2019-07-03 01:21:10
|
<Not-7290>
|
['miraheze/puppet'] 'paladox' pushed '' commit to 'master' [+0/-0/±1] 'https://git.io/fjKNe'
|
|
2019-07-03 01:21:11
|
<Not-7290>
|
['miraheze/puppet'] 'paladox' '1a74bc' - matomo: Upgrade to 3.10.0
|
|
2019-07-03 01:42:58
|
<Not-7290>
|
['miraheze/puppet'] 'paladox' pushed '' commit to 'master' [+0/-0/±1] 'https://git.io/fjKNs'
|
|
2019-07-03 01:43:00
|
<Not-7290>
|
['miraheze/puppet'] 'paladox' 'fe9a524' - matomo: Use file lock for core:archive command This will prevent multiple consoles from running. Also run it as root so that flock works.
|
|
2019-07-03 01:54:15
|
<Not-7290>
|
['miraheze/MatomoAnalytics'] 'paladox' pushed '' commit to 'master' [+0/-0/±1] 'https://git.io/fjKNW'
|
|
2019-07-03 01:54:16
|
<Not-7290>
|
['miraheze/MatomoAnalytics'] 'paladox' '102daf' - Add missing "formDescriptor" variable
|
|
2019-07-03 01:55:08
|
<Not-7290>
|
['miraheze/mediawiki'] 'paladox' pushed '' commit to 'REL1_33' [+0/-0/±1] 'https://git.io/fjKNl'
|
|
2019-07-03 01:55:10
|
<Not-7290>
|
['miraheze/mediawiki'] 'paladox' 'bde0a2' - Update MA
|
|
2019-07-03 01:56:22
|
<Not-7290>
|
['miraheze/mediawiki'] 'paladox' pushed '' commit to 'REL1_33' [+0/-0/±2] 'https://git.io/fjKNB'
|
|
2019-07-03 01:56:24
|
<Not-7290>
|
['miraheze/mediawiki'] 'paladox' '422b9d' - Update Cargo and PF
|
|
2019-07-03 02:16:14
|
<Not-7290>
|
['miraheze/mediawiki'] 'paladox' pushed '' commit to 'REL1_33' [+0/-0/±1] 'https://git.io/fjKNo'
|
|
2019-07-03 02:16:15
|
<Not-7290>
|
['miraheze/mediawiki'] 'paladox' 'e7cec78' - Update ModernSkylight
|
|
2019-07-03 02:17:10
|
<Not-7290>
|
['miraheze/mediawiki'] 'paladox' pushed '' commit to 'REL1_33' [+0/-0/±1] 'https://git.io/fjKNK'
|
|
2019-07-03 02:17:12
|
<Not-7290>
|
['miraheze/mediawiki'] 'paladox' 'b56c2f' - Update ArticleFeedbackv5
|
|
2019-07-03 02:18:13
|
<Not-7290>
|
['miraheze/mediawiki'] 'paladox' pushed '' commit to 'REL1_33' [+0/-0/±1] 'https://git.io/fjKNP'
|
|
2019-07-03 02:18:14
|
<Not-7290>
|
['miraheze/mediawiki'] 'paladox' 'f5e264e' - Updatem ArticleFeedbackv5
|
|
2019-07-03 02:59:43
|
<icinga-miraheze>
|
PROBLEM - bacula1 Bacula Databases db4 on bacula1 is CRITICAL: CRITICAL: Full, 671533 files, 76.35GB, 2019-06-02 02:58:00 (4.4 weeks ago)
|
|
2019-07-03 04:09:04
|
<icinga-miraheze>
|
PROBLEM - mw1 Current Load on mw1 is WARNING: WARNING - load average: 7.69, 7.07, 4.86
|
|
2019-07-03 04:11:05
|
<icinga-miraheze>
|
RECOVERY - mw1 Current Load on mw1 is OK: OK - load average: 5.32, 6.56, 4.95
|
|
2019-07-03 04:35:10
|
<Not-7290>
|
['miraheze/services'] 'MirahezeSSLBot' pushed '' commit to 'master' [+0/-0/±1] 'https://git.io/fjKAK'
|
|
2019-07-03 04:35:12
|
<Not-7290>
|
['miraheze/services'] 'MirahezeSSLBot' '7a9b90' - BOT: Updating services config for wikis
|
|
2019-07-03 04:41:27
|
<icinga-miraheze>
|
PROBLEM - misc2 Current Load on misc2 is WARNING: WARNING - load average: 3.77, 3.63, 3.19
|
|
2019-07-03 04:43:27
|
<icinga-miraheze>
|
RECOVERY - misc2 Current Load on misc2 is OK: OK - load average: 1.41, 2.87, 2.97
|
|
2019-07-03 04:50:16
|
<icinga-miraheze>
|
PROBLEM - mw3 Current Load on mw3 is CRITICAL: CRITICAL - load average: 9.28, 5.97, 4.10
|
|
2019-07-03 04:54:16
|
<icinga-miraheze>
|
PROBLEM - mw3 Current Load on mw3 is WARNING: WARNING - load average: 7.74, 7.44, 5.17
|
|
2019-07-03 04:56:16
|
<icinga-miraheze>
|
RECOVERY - mw3 Current Load on mw3 is OK: OK - load average: 4.56, 6.36, 5.05
|
|
2019-07-03 05:41:01
|
<icinga-miraheze>
|
PROBLEM - ns1 Current Load on ns1 is WARNING: WARNING - load average: 1.74, 0.91, 0.35
|
|
2019-07-03 05:43:01
|
<icinga-miraheze>
|
RECOVERY - ns1 Current Load on ns1 is OK: OK - load average: 1.05, 0.95, 0.43
|
|
2019-07-03 06:01:19
|
<RhinosF1>
|
503 on Testwiki
|
|
2019-07-03 06:01:19
|
<icinga-miraheze>
|
PROBLEM - misc3 Lizardfs Master Port 1 on misc3 is CRITICAL: connect to address 185.52.1.144 and port 9419: Connection refused
|
|
2019-07-03 06:01:40
|
<icinga-miraheze>
|
PROBLEM - misc3 Lizardfs Master Port 2 on misc3 is CRITICAL: connect to address 185.52.1.144 and port 9420: Connection refused
|
|
2019-07-03 06:02:02
|
<icinga-miraheze>
|
PROBLEM - ns1 GDNSD Datacenters on ns1 is CRITICAL: CRITICAL - 6 datacenters are down: 107.191.126.23/cpweb, 2604:180:0:33b::2/cpweb, 128.199.139.216/cpweb, 2400:6180:0:d0::403:f001/cpweb, 81.4.109.133/cpweb, 2a00:d880:5:8ea::ebc7/cpweb
|
|
2019-07-03 06:02:16
|
<icinga-miraheze>
|
PROBLEM - misc1 GDNSD Datacenters on misc1 is CRITICAL: CRITICAL - 6 datacenters are down: 107.191.126.23/cpweb, 2604:180:0:33b::2/cpweb, 128.199.139.216/cpweb, 2400:6180:0:d0::403:f001/cpweb, 81.4.109.133/cpweb, 2a00:d880:5:8ea::ebc7/cpweb
|
|
2019-07-03 06:02:32
|
<icinga-miraheze>
|
PROBLEM - cp3 Varnish Backends on cp3 is CRITICAL: 3 backends are down. mw1 mw2 mw3
|
|
2019-07-03 06:02:37
|
<icinga-miraheze>
|
PROBLEM - cp4 Varnish Backends on cp4 is CRITICAL: 3 backends are down. mw1 mw2 mw3
|
|
2019-07-03 06:03:11
|
<RhinosF1>
|
https://phabricator.miraheze.org/T4509
|
|
2019-07-03 06:03:11
|
<ZppixBot>
|
[ ⚓ T4509 503 backend fetch failed on public test wiki on cp4 ] - phabricator.miraheze.org
|
|
2019-07-03 06:03:17
|
<icinga-miraheze>
|
PROBLEM - cp2 Varnish Backends on cp2 is CRITICAL: 2 backends are down. mw2 mw3
|
|
2019-07-03 06:03:19
|
<icinga-miraheze>
|
RECOVERY - misc3 Lizardfs Master Port 1 on misc3 is OK: TCP OK - 0.001 second response time on 185.52.1.144 port 9419
|
|
2019-07-03 06:03:30
|
<icinga-miraheze>
|
PROBLEM - cp4 HTTP 4xx/5xx ERROR Rate on cp4 is CRITICAL: CRITICAL - NGINX Error Rate is 65%
|
|
2019-07-03 06:03:36
|
<RhinosF1>
|
JohnLewis, Paladox: ^^^^^ UNBREAK NOE
|
|
2019-07-03 06:03:40
|
<icinga-miraheze>
|
RECOVERY - misc3 Lizardfs Master Port 2 on misc3 is OK: TCP OK - 0.001 second response time on 185.52.1.144 port 9420
|
|
2019-07-03 06:03:40
|
<RhinosF1>
|
NOW
|
|
2019-07-03 06:04:02
|
<Mikeee>
|
no. do it later
|
|
2019-07-03 06:04:02
|
<icinga-miraheze>
|
RECOVERY - ns1 GDNSD Datacenters on ns1 is OK: OK - all datacenters are online
|
|
2019-07-03 06:04:16
|
<icinga-miraheze>
|
RECOVERY - misc1 GDNSD Datacenters on misc1 is OK: OK - all datacenters are online
|
|
2019-07-03 06:04:32
|
<icinga-miraheze>
|
RECOVERY - cp3 Varnish Backends on cp3 is OK: All 5 backends are healthy
|
|
2019-07-03 06:04:34
|
<RhinosF1>
|
Mikeee: looks like everything went down
|
|
2019-07-03 06:04:37
|
<icinga-miraheze>
|
RECOVERY - cp4 Varnish Backends on cp4 is OK: All 5 backends are healthy
|
|
2019-07-03 06:04:39
|
<Mikeee>
|
take a nap and a long lunch
|
|
2019-07-03 06:05:17
|
<icinga-miraheze>
|
RECOVERY - cp2 Varnish Backends on cp2 is OK: All 5 backends are healthy
|
|
2019-07-03 06:05:30
|
<icinga-miraheze>
|
RECOVERY - cp4 HTTP 4xx/5xx ERROR Rate on cp4 is OK: OK - NGINX Error Rate is 6%
|
|
2019-07-03 06:06:20
|
<RhinosF1>
|
And restored
|
|
2019-07-03 06:36:28
|
<icinga-miraheze>
|
PROBLEM - misc2 Puppet on misc2 is CRITICAL: CRITICAL: Puppet has 2 failures. Last run 3 minutes ago with 2 failures. Failed resources (up to 3 shown): Package[php7.3-apcu],Package[php7.3-redis]
|
|
2019-07-03 06:42:18
|
<icinga-miraheze>
|
PROBLEM - misc2 Current Load on misc2 is CRITICAL: CRITICAL - load average: 4.58, 3.27, 2.19
|
|
2019-07-03 06:44:15
|
<icinga-miraheze>
|
RECOVERY - misc2 Current Load on misc2 is OK: OK - load average: 2.75, 3.06, 2.25
|
|
2019-07-03 06:44:27
|
<icinga-miraheze>
|
RECOVERY - misc2 Puppet on misc2 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures
|
|
2019-07-03 07:02:19
|
<icinga-miraheze>
|
PROBLEM - mw3 Current Load on mw3 is CRITICAL: CRITICAL - load average: 14.11, 7.98, 4.61
|
|
2019-07-03 07:03:43
|
<icinga-miraheze>
|
PROBLEM - misc2 Current Load on misc2 is WARNING: WARNING - load average: 3.93, 3.57, 3.01
|
|
2019-07-03 07:05:40
|
<icinga-miraheze>
|
RECOVERY - misc2 Current Load on misc2 is OK: OK - load average: 3.03, 3.39, 3.00
|
|
2019-07-03 07:09:28
|
<icinga-miraheze>
|
PROBLEM - mw2 Current Load on mw2 is CRITICAL: CRITICAL - load average: 9.31, 6.28, 3.44
|
|
2019-07-03 07:09:58
|
<icinga-miraheze>
|
PROBLEM - mw1 Current Load on mw1 is WARNING: WARNING - load average: 7.44, 6.74, 4.79
|
|
2019-07-03 07:11:28
|
<icinga-miraheze>
|
RECOVERY - mw2 Current Load on mw2 is OK: OK - load average: 2.49, 4.76, 3.23
|
|
2019-07-03 07:11:56
|
<icinga-miraheze>
|
RECOVERY - mw1 Current Load on mw1 is OK: OK - load average: 3.44, 5.42, 4.53
|
|
2019-07-03 07:12:16
|
<icinga-miraheze>
|
PROBLEM - mw3 Current Load on mw3 is WARNING: WARNING - load average: 3.32, 7.28, 6.47
|
|
2019-07-03 07:14:16
|
<icinga-miraheze>
|
RECOVERY - mw3 Current Load on mw3 is OK: OK - load average: 3.31, 5.94, 6.07
|
|
2019-07-03 07:23:21
|
<icinga-miraheze>
|
PROBLEM - mw3 JobQueue on mw3 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds.
|
|
2019-07-03 07:25:08
|
<icinga-miraheze>
|
PROBLEM - mw3 Current Load on mw3 is WARNING: WARNING - load average: 7.17, 6.35, 6.02
|
|
2019-07-03 07:25:18
|
<icinga-miraheze>
|
PROBLEM - mw3 JobQueue on mw3 is UNKNOWN: NRPE: Unable to read output
|
|
2019-07-03 07:27:06
|
<icinga-miraheze>
|
RECOVERY - mw3 Current Load on mw3 is OK: OK - load average: 3.82, 5.59, 5.80
|
|
2019-07-03 08:13:05
|
<icinga-miraheze>
|
PROBLEM - mw1 Current Load on mw1 is WARNING: WARNING - load average: 7.42, 6.17, 4.53
|
|
2019-07-03 08:15:05
|
<icinga-miraheze>
|
RECOVERY - mw1 Current Load on mw1 is OK: OK - load average: 3.26, 5.08, 4.33
|
|
2019-07-03 08:34:09
|
<icinga-miraheze>
|
PROBLEM - misc2 Current Load on misc2 is WARNING: WARNING - load average: 3.71, 3.20, 2.92
|
|
2019-07-03 08:36:05
|
<icinga-miraheze>
|
PROBLEM - misc2 Current Load on misc2 is CRITICAL: CRITICAL - load average: 4.37, 3.57, 3.08
|
|
2019-07-03 08:38:02
|
<icinga-miraheze>
|
PROBLEM - misc2 Current Load on misc2 is WARNING: WARNING - load average: 3.43, 3.57, 3.14
|
|
2019-07-03 08:51:37
|
<icinga-miraheze>
|
PROBLEM - misc2 Current Load on misc2 is CRITICAL: CRITICAL - load average: 4.24, 3.99, 3.61
|
|
2019-07-03 08:57:27
|
<icinga-miraheze>
|
PROBLEM - misc2 Current Load on misc2 is WARNING: WARNING - load average: 3.54, 3.90, 3.70
|
|
2019-07-03 09:01:27
|
<icinga-miraheze>
|
PROBLEM - misc2 Current Load on misc2 is CRITICAL: CRITICAL - load average: 4.49, 4.04, 3.77
|
|
2019-07-03 09:07:27
|
<icinga-miraheze>
|
PROBLEM - misc2 Current Load on misc2 is WARNING: WARNING - load average: 3.26, 3.81, 3.76
|
|
2019-07-03 09:11:27
|
<icinga-miraheze>
|
PROBLEM - misc2 Current Load on misc2 is CRITICAL: CRITICAL - load average: 4.41, 4.04, 3.85
|
|
2019-07-03 09:15:27
|
<icinga-miraheze>
|
PROBLEM - misc2 Current Load on misc2 is WARNING: WARNING - load average: 3.81, 3.97, 3.87
|
|
2019-07-03 09:31:27
|
<icinga-miraheze>
|
PROBLEM - misc2 Current Load on misc2 is CRITICAL: CRITICAL - load average: 4.32, 3.85, 3.76
|
|
2019-07-03 09:37:27
|
<icinga-miraheze>
|
PROBLEM - misc2 Current Load on misc2 is WARNING: WARNING - load average: 3.36, 3.87, 3.83
|
|
2019-07-03 09:39:27
|
<icinga-miraheze>
|
PROBLEM - misc2 Current Load on misc2 is CRITICAL: CRITICAL - load average: 4.87, 4.11, 3.91
|
|
2019-07-03 09:43:27
|
<icinga-miraheze>
|
PROBLEM - misc2 Current Load on misc2 is WARNING: WARNING - load average: 3.72, 3.94, 3.88
|
|
2019-07-03 09:49:27
|
<icinga-miraheze>
|
RECOVERY - misc2 Current Load on misc2 is OK: OK - load average: 1.11, 2.53, 3.35
|
|
2019-07-03 10:22:16
|
<icinga-miraheze>
|
PROBLEM - mw3 Current Load on mw3 is CRITICAL: CRITICAL - load average: 11.84, 7.29, 4.41
|
|
2019-07-03 10:25:06
|
<icinga-miraheze>
|
PROBLEM - mw1 Current Load on mw1 is CRITICAL: CRITICAL - load average: 11.16, 7.57, 4.82
|
|
2019-07-03 10:27:04
|
<icinga-miraheze>
|
RECOVERY - mw1 Current Load on mw1 is OK: OK - load average: 4.79, 6.59, 4.81
|
|
2019-07-03 10:28:16
|
<icinga-miraheze>
|
PROBLEM - mw3 Current Load on mw3 is WARNING: WARNING - load average: 4.35, 7.24, 5.58
|
|
2019-07-03 10:30:16
|
<icinga-miraheze>
|
RECOVERY - mw3 Current Load on mw3 is OK: OK - load average: 4.95, 6.36, 5.45
|
|
2019-07-03 11:25:06
|
<icinga-miraheze>
|
PROBLEM - mw1 Current Load on mw1 is CRITICAL: CRITICAL - load average: 11.66, 6.83, 4.42
|
|
2019-07-03 11:25:31
|
<icinga-miraheze>
|
PROBLEM - mw2 Current Load on mw2 is CRITICAL: CRITICAL - load average: 10.15, 5.53, 3.20
|
|
2019-07-03 11:26:37
|
<icinga-miraheze>
|
PROBLEM - cp4 Varnish Backends on cp4 is CRITICAL: 3 backends are down. mw1 mw2 mw3
|
|
2019-07-03 11:26:42
|
<icinga-miraheze>
|
PROBLEM - ns1 GDNSD Datacenters on ns1 is CRITICAL: CRITICAL - 6 datacenters are down: 107.191.126.23/cpweb, 2604:180:0:33b::2/cpweb, 128.199.139.216/cpweb, 2400:6180:0:d0::403:f001/cpweb, 81.4.109.133/cpweb, 2a00:d880:5:8ea::ebc7/cpweb
|
|
2019-07-03 11:27:17
|
<icinga-miraheze>
|
PROBLEM - cp2 Varnish Backends on cp2 is CRITICAL: 1 backends are down. mw2
|
|
2019-07-03 11:28:16
|
<icinga-miraheze>
|
PROBLEM - mw3 Current Load on mw3 is CRITICAL: CRITICAL - load average: 12.41, 8.57, 5.20
|
|
2019-07-03 11:28:37
|
<icinga-miraheze>
|
RECOVERY - cp4 Varnish Backends on cp4 is OK: All 5 backends are healthy
|
|
2019-07-03 11:28:42
|
<icinga-miraheze>
|
RECOVERY - ns1 GDNSD Datacenters on ns1 is OK: OK - all datacenters are online
|
|
2019-07-03 11:29:05
|
<icinga-miraheze>
|
PROBLEM - mw1 Current Load on mw1 is WARNING: WARNING - load average: 5.38, 6.94, 5.11
|
|
2019-07-03 11:29:17
|
<icinga-miraheze>
|
RECOVERY - cp2 Varnish Backends on cp2 is OK: All 5 backends are healthy
|
|
2019-07-03 11:29:28
|
<icinga-miraheze>
|
RECOVERY - mw2 Current Load on mw2 is OK: OK - load average: 5.36, 6.07, 4.01
|
|
2019-07-03 11:30:16
|
<icinga-miraheze>
|
PROBLEM - mw3 Current Load on mw3 is WARNING: WARNING - load average: 5.63, 7.58, 5.26
|
|
2019-07-03 11:31:04
|
<icinga-miraheze>
|
RECOVERY - mw1 Current Load on mw1 is OK: OK - load average: 4.52, 6.08, 5.01
|
|
2019-07-03 11:33:29
|
<icinga-miraheze>
|
PROBLEM - mw2 Current Load on mw2 is WARNING: WARNING - load average: 7.60, 6.94, 4.83
|
|
2019-07-03 11:34:16
|
<icinga-miraheze>
|
RECOVERY - mw3 Current Load on mw3 is OK: OK - load average: 4.72, 6.18, 5.22
|
|
2019-07-03 11:35:28
|
<icinga-miraheze>
|
RECOVERY - mw2 Current Load on mw2 is OK: OK - load average: 4.71, 6.08, 4.76
|
|
2019-07-03 12:32:16
|
<icinga-miraheze>
|
PROBLEM - mw3 Current Load on mw3 is CRITICAL: CRITICAL - load average: 8.70, 6.14, 4.33
|
|
2019-07-03 12:34:16
|
<icinga-miraheze>
|
PROBLEM - mw3 Current Load on mw3 is WARNING: WARNING - load average: 6.97, 6.34, 4.62
|
|
2019-07-03 12:36:16
|
<icinga-miraheze>
|
PROBLEM - mw3 Current Load on mw3 is CRITICAL: CRITICAL - load average: 8.82, 7.40, 5.22
|
|
2019-07-03 12:38:16
|
<icinga-miraheze>
|
PROBLEM - mw3 Current Load on mw3 is WARNING: WARNING - load average: 7.72, 7.55, 5.55
|
|
2019-07-03 12:40:16
|
<icinga-miraheze>
|
RECOVERY - mw3 Current Load on mw3 is OK: OK - load average: 4.62, 6.41, 5.37
|
|
2019-07-03 12:52:48
|
<paladox>
|
!log removing a users PII
|
|
2019-07-03 12:52:53
|
<MirahezeLogbot>
|
Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master
|
|
2019-07-03 13:00:33
|
<Not-7290>
|
['ManageWiki'] 'paladox' created branch 'paladox-patch-2' - 'https://git.io/vpSns'
|
|
2019-07-03 13:00:35
|
<Not-7290>
|
['miraheze/ManageWiki'] 'paladox' pushed '' commit to 'paladox-patch-2' [+0/-0/±1] 'https://git.io/fj6Tk'
|
|
2019-07-03 13:00:36
|
<Not-7290>
|
['miraheze/ManageWiki'] 'paladox' 'f4f4219' - Fix "Field 'perm_addgroupstoself' doesn't have a default value"
|
|
2019-07-03 13:00:38
|
<Not-7290>
|
['ManageWiki'] 'paladox' opened pull request '#111': Fix "Field 'perm_addgroupstoself' doesn't have a default value" - 'https://git.io/fj6TI'
|
|
2019-07-03 13:01:20
|
<Not-7290>
|
['ManageWiki'] 'JohnFLewis' closed pull request '#111': Fix "Field 'perm_addgroupstoself' doesn't have a default value" - 'https://git.io/fj6TI'
|
|
2019-07-03 13:01:22
|
<Not-7290>
|
['miraheze/ManageWiki'] 'JohnFLewis' pushed '' commit to 'master' [+0/-0/±1] 'https://git.io/fj6Tm'
|
|
2019-07-03 13:01:23
|
<Not-7290>
|
['miraheze/ManageWiki'] 'paladox' 'd0a0b59' - Fix "Field 'perm_addgroupstoself' doesn't have a default value" (#111)
|
|
2019-07-03 13:14:25
|
<Not-7290>
|
['miraheze/mediawiki'] 'paladox' pushed '' commit to 'REL1_33' [+0/-0/±1] 'https://git.io/fj6Ta'
|
|
2019-07-03 13:14:26
|
<Not-7290>
|
['miraheze/mediawiki'] 'paladox' 'b1fc67a' - Update MW
|
|
2019-07-03 13:21:05
|
<Not-7290>
|
['miraheze/mw-config'] 'paladox' pushed '' commit to 'master' [+0/-0/±1] 'https://git.io/fj6TP'
|
|
2019-07-03 13:21:06
|
<Not-7290>
|
['miraheze/mw-config'] 'paladox' '607a55' - Remove sitenotice Change-Id: I911c51358e1a98717b5bd6bbf6fead0c3a7da387
|
|
2019-07-03 13:28:41
|
<Not-7290>
|
['mw-config'] 'Amanda-Catherine' opened pull request '#2692': Enable partial blocks on quircwiki and bipolartownwiki T4508 - 'https://git.io/fj6Td'
|
|
2019-07-03 13:29:16
|
<icinga-miraheze>
|
PROBLEM - mw1 Current Load on mw1 is CRITICAL: CRITICAL - load average: 10.64, 6.61, 4.64
|
|
2019-07-03 13:29:29
|
<icinga-miraheze>
|
PROBLEM - mw2 Current Load on mw2 is WARNING: WARNING - load average: 7.34, 5.61, 3.42
|
|
2019-07-03 13:30:16
|
<icinga-miraheze>
|
PROBLEM - mw3 Current Load on mw3 is CRITICAL: CRITICAL - load average: 11.61, 6.94, 4.47
|
|
2019-07-03 13:31:28
|
<icinga-miraheze>
|
RECOVERY - mw2 Current Load on mw2 is OK: OK - load average: 6.40, 6.04, 3.85
|
|
2019-07-03 13:33:29
|
<AmandaCath>
|
paladox: what's up with all the deleted stuff in RC?
|
|
2019-07-03 13:33:43
|
<paladox>
|
ToU enforcement (that's all i can say) :)
|
|
2019-07-03 13:34:20
|
<AmandaCath>
|
Based on the looks it would seem that some username violated the ToU, but I'm not aware of any such clause
|
|
2019-07-03 13:35:13
|
<icinga-miraheze>
|
PROBLEM - mw1 Current Load on mw1 is WARNING: WARNING - load average: 7.02, 7.65, 5.83
|
|
2019-07-03 13:38:18
|
<AmandaCath>
|
So wait a minute... if the violation was anything other than a username, why would the global account log (for presumably a lock) be deleted?
|
|
2019-07-03 13:39:09
|
<icinga-miraheze>
|
RECOVERY - mw1 Current Load on mw1 is OK: OK - load average: 3.11, 5.73, 5.50
|
|
2019-07-03 13:39:11
|
<paladox>
|
It's not a username violation, but i carn't really discuss why we did it.
|
|
2019-07-03 13:40:11
|
<AmandaCath>
|
Oh great you're acting just like the WMF now
|
|
2019-07-03 13:42:16
|
<icinga-miraheze>
|
PROBLEM - mw3 Current Load on mw3 is WARNING: WARNING - load average: 3.73, 7.21, 6.96
|
|
2019-07-03 13:42:24
|
<AmandaCath>
|
WMF: "we banned a long-term enwiki admin for good reasons but we can't say why"
|
|
2019-07-03 13:42:29
|
<paladox>
|
AmandaCath we are not, only that we have legal obligations.
|
|
2019-07-03 13:42:49
|
<AmandaCath>
|
Miraheze: "we banned and deleted all logs of a user but can't say why"
|
|
2019-07-03 13:43:26
|
<AmandaCath>
|
paladox: so if that's the case, why does the summary include "contact staff@ with queries"
|
|
2019-07-03 13:44:02
|
<JohnLewis>
|
because we can disclose to the user or other appropriate people(s)
|
|
2019-07-03 13:44:16
|
<icinga-miraheze>
|
RECOVERY - mw3 Current Load on mw3 is OK: OK - load average: 3.91, 6.23, 6.63
|
|
2019-07-03 13:45:49
|
<AmandaCath>
|
See, this is why IMHO we should have a separate legal team separate from the overall sysadmin team
|
|
2019-07-03 13:45:57
|
<AmandaCath>
|
Especially if we get incorporated
|
|
2019-07-03 13:46:18
|
<Reception123>
|
Currently that's not possible
|
|
2019-07-03 13:46:29
|
<Reception123>
|
we need to have a volunteer willing to do that
|
|
2019-07-03 13:47:06
|
<AmandaCath>
|
I know a couple lawyers - not sure if they would be interested though
|
|
2019-07-03 13:47:38
|
<JohnLewis>
|
well atm all legal matters more or less pass through myself or labsters, despite not being qualified we oversee pretty much anything labelled under ToU
|
|
2019-07-03 13:50:20
|
<AmandaCath>
|
Ok, but considering that I didn't know that until now, on first impression I see paladox seemingly trying to erase all evidence of someone even existing, and then saying "ToU violation, we can't discuss it" sounds very WMF-ish
|
|
2019-07-03 13:50:51
|
<JohnLewis>
|
talk to the US legislative
|
|
2019-07-03 13:51:43
|
<AmandaCath>
|
Oh, so now we're dealing with a potential federal law violation?
|
|
2019-07-03 13:51:56
|
<AmandaCath>
|
That's definitely something for a legal team
|
|
2019-07-03 13:52:23
|
<JohnLewis>
|
well, it's a case of we're complying with US law
|
|
2019-07-03 13:52:37
|
<JohnLewis>
|
we've done our part within the outlines of the law so it's all okay
|
|
2019-07-03 13:53:34
|
<JohnLewis>
|
it's not theoretically a violation of law, but rather a violation of our ToU taken from US law which is slightly more strict that law to protect ourselves
|
|
2019-07-03 13:54:24
|
<AmandaCath>
|
I would have just done centralauth-oversight and hideuser to take care of everything in two clicks and without a public log that would raise questions
|
|
2019-07-03 13:55:11
|
<JohnLewis>
|
paladox chose to handle it how he did, all I can say really
|
|
2019-07-03 13:56:20
|
<AmandaCath>
|
Meh... on a different topic....
|
|
2019-07-03 13:56:33
|
<AmandaCath>
|
how come my PR 2692 isn't showing up on Phab?
|
|
2019-07-03 14:08:10
|
<Not-7290>
|
['mw-config'] 'Amanda-Catherine' synchronize pull request '#2692': Enable partial blocks on quircwiki and bipolartownwiki T4508 - 'https://git.io/fj6Td'
|
|
2019-07-03 14:09:50
|
<RhinosF1>
|
Paladox: Can I get a favour? https://github.com/miraheze/mw-config/pull/2692
|
|
2019-07-03 14:09:51
|
<ZppixBot>
|
[ Enable partial blocks on quircwiki and bipolartownwiki T4508 by Amanda-Catherine · Pull Request #2692 · miraheze/mw-config · GitHub ] - github.com
|
|
2019-07-03 14:13:20
|
<paladox>
|
JohnLewis: should we enable that ^^ for all wikis?
|
|
2019-07-03 14:13:33
|
<paladox>
|
If not that should be in managewiki
|
|
2019-07-03 14:13:53
|
<JohnLewis>
|
all wikis sounds good, plus I've been saying that since before 1.33 was even finished :)
|
|
2019-07-03 14:13:56
|
<paladox>
|
Also i ’m currently mobile
|
|
2019-07-03 14:14:29
|
<AmandaCath>
|
I would oppose doing a global enable simply for procedural reasons - anything that's not required for site functionality should be opt-in or opt-out able
|
|
2019-07-03 14:14:51
|
<AmandaCath>
|
I would do it through ManageWiki but I don't know how
|
|
2019-07-03 14:15:04
|
<AmandaCath>
|
needs to figure out how MW works
|
|
2019-07-03 14:15:58
|
<Not-7290>
|
['mw-config'] 'paladox' reviewed pull request '#2692' commit - 'https://git.io/fj6k1'
|
|
2019-07-03 14:16:56
|
<JohnLewis>
|
afaik it's a temp flag
|
|
2019-07-03 14:17:05
|
<paladox>
|
^
|
|
2019-07-03 14:17:33
|
<JohnLewis>
|
and in 1.34 it'll be default behaviour
|
|
2019-07-03 14:17:45
|
<RhinosF1>
|
JohnLewis: That sounds right
|
|
2019-07-03 14:18:00
|
<RhinosF1>
|
I think it was mentioned in the release email
|
|
2019-07-03 14:20:10
|
<RhinosF1>
|
AmandaCath: can u do the GitHub patch? See review comments
|
|
2019-07-03 14:21:15
|
<AmandaCath>
|
I can do that patch once my network stops crashing :P
|
|
2019-07-03 14:22:27
|
<Not-7290>
|
['mw-config'] 'Amanda-Catherine' synchronize pull request '#2692': Enable partial blocks on quircwiki and bipolartownwiki T4508 - 'https://git.io/fj6Td'
|
|
2019-07-03 14:22:38
|
<Not-7290>
|
['mw-config'] 'Amanda-Catherine' edited pull request '#2692': Enable partial blocks on all wikis by default - 'https://git.io/fj6Td'
|
|
2019-07-03 14:23:58
|
<Not-7290>
|
['mw-config'] 'JohnFLewis' closed pull request '#2692': Enable partial blocks on all wikis by default - 'https://git.io/fj6Td'
|
|
2019-07-03 14:23:59
|
<Not-7290>
|
['miraheze/mw-config'] 'JohnFLewis' pushed '' commit to 'master' [+0/-0/±1] 'https://git.io/fj6kF'
|
|
2019-07-03 14:24:01
|
<Not-7290>
|
['miraheze/mw-config'] 'Amanda-Catherine' 'f37c603' - Enable partial blocks on all wikis by default (#2692) * Enable partial blocks on quircwiki and bipolartownwiki T4508 * Add publictestwiki per request * Enable partial blocks for all wikis by default
|
|
2019-07-03 14:24:29
|
<RhinosF1>
|
Thanks John
|
|
2019-07-03 14:24:34
|
<RhinosF1>
|
& Amanda
|
|
2019-07-03 14:30:43
|
<paladox>
|
AmandaCath:
|
|
2019-07-03 14:30:44
|
<paladox>
|
https://phabricator.miraheze.org/T4510 we are already on MW 1.33
|
|
2019-07-03 14:30:46
|
<ZppixBot>
|
[ ⚓ T4510 Install MediaWiki 1.33 ] - phabricator.miraheze.org
|
|
2019-07-03 14:30:48
|
<paladox>
|
since last night :)
|
|
2019-07-03 14:33:47
|
<AmandaCath>
|
Ah ok
|
|
2019-07-03 14:34:19
|
<AmandaCath>
|
Just out of curiosity, how many of MH staff are on the mailing list?
|
|
2019-07-03 14:34:23
|
<Hispano76>
|
saluda
|
|
2019-07-03 14:34:47
|
<paladox>
|
There’s me so one :P
|
|
2019-07-03 14:39:07
|
<icinga-miraheze>
|
PROBLEM - mw1 Current Load on mw1 is WARNING: WARNING - load average: 7.70, 6.19, 4.65
|
|
2019-07-03 14:40:16
|
<icinga-miraheze>
|
PROBLEM - mw3 Current Load on mw3 is CRITICAL: CRITICAL - load average: 8.44, 6.83, 4.84
|
|
2019-07-03 14:41:58
|
<paladox>
|
JohnLewis: can you take a look at ^^ please?
|
|
2019-07-03 14:42:16
|
<icinga-miraheze>
|
RECOVERY - mw3 Current Load on mw3 is OK: OK - load average: 4.11, 5.85, 4.73
|
|
2019-07-03 14:43:04
|
<icinga-miraheze>
|
RECOVERY - mw1 Current Load on mw1 is OK: OK - load average: 4.66, 5.93, 4.94
|
|
2019-07-03 14:45:30
|
<RhinosF1>
|
paladox, JohnLewis: can one of you undo autoblock #297 on publictestwiki.com pls
|
|
2019-07-03 14:51:15
|
<MH-Discord>
|
<RhinosF1> fixed
|
|
2019-07-03 15:01:10
|
<RhinosF1>
|
also can someone look at https://publictestwiki.com/wiki/TestWiki:Request_permissions#RhinosF1_.28Status:_Open.29
|
|
2019-07-03 15:01:11
|
<ZppixBot>
|
[ TestWiki:Request permissions - TestWiki ] - publictestwiki.com
|
|
2019-07-03 15:25:12
|
<Not-7290>
|
['miraheze/services'] 'MirahezeSSLBot' pushed '' commit to 'master' [+0/-0/±1] 'https://git.io/fj6Lr'
|
|
2019-07-03 15:25:13
|
<Not-7290>
|
['miraheze/services'] 'MirahezeSSLBot' 'bdc54c' - BOT: Updating services config for wikis
|
|
2019-07-03 15:54:20
|
<icinga-miraheze>
|
RECOVERY - wiki.pyxxl.tk - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.pyxxl.tk' will expire on Tue 10 Sep 2019 12:46:18 PM GMT +0000.
|
|
2019-07-03 16:05:12
|
<Not-7290>
|
['miraheze/services'] 'MirahezeSSLBot' pushed '' commit to 'master' [+0/-0/±1] 'https://git.io/fj6t0'
|
|
2019-07-03 16:05:14
|
<Not-7290>
|
['miraheze/services'] 'MirahezeSSLBot' '51831a' - BOT: Updating services config for wikis
|
|
2019-07-03 17:18:24
|
<Hispano76>
|
ping paladox
|
|
2019-07-03 17:18:29
|
<paladox>
|
hi
|
|
2019-07-03 17:19:22
|
<Hispano76>
|
because several deleted wikis (centralwiki..) are still listed in https://meta.miraheze.org/w/index.php?title=Special%3ACentralAuth&target=Hispano76 curiosity
|
|
2019-07-03 17:19:23
|
<ZppixBot>
|
[ Global account information for Hispano76 - Miraheze Meta ] - meta.miraheze.org
|
|
2019-07-03 17:19:25
|
<Hispano76>
|
paladox,
|
|
2019-07-03 17:20:11
|
<Voidwalker>
|
probably because they haven't been completely deleted yet
|
|
2019-07-03 17:20:13
|
<paladox>
|
Hispano76 the wikis are technically not deleted, in so far as they are only hidden from the public (accessing the url)
|
|
2019-07-03 17:21:34
|
<Hispano76>
|
hum?
|
|
2019-07-03 17:21:58
|
<Hispano76>
|
will it be like this now? paladox
|
|
2019-07-03 17:22:07
|
<paladox>
|
Hispano76 the wiki is deleted so that it's hidden (acts like it's deleted), it will be deleted later.
|
|
2019-07-03 17:22:40
|
<Hispano76>
|
aah, ok
|
|
2019-07-03 17:22:59
|
<Hispano76>
|
thanks paladox :)
|
|
2019-07-03 17:23:04
|
<paladox>
|
your welcome :)
|
|
2019-07-03 17:42:11
|
<Not-7290>
|
['miraheze/CreateWiki'] 'JohnFLewis' pushed '' commit to 'master' [+0/-0/±1] 'https://git.io/fj6qb'
|
|
2019-07-03 17:42:13
|
<Not-7290>
|
['miraheze/CreateWiki'] 'JohnFLewis' 'c09806b' - introduce another database connection
|
|
2019-07-03 17:42:16
|
<JohnLewis>
|
paladox: ^
|
|
2019-07-03 17:42:26
|
<paladox>
|
looks
|
|
2019-07-03 17:42:56
|
<paladox>
|
Thanks!
|
|
2019-07-03 17:43:04
|
<icinga-miraheze>
|
PROBLEM - mw1 Current Load on mw1 is CRITICAL: CRITICAL - load average: 8.43, 5.88, 4.34
|
|
2019-07-03 17:43:19
|
<icinga-miraheze>
|
PROBLEM - mw3 JobQueue on mw3 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds.
|
|
2019-07-03 17:43:34
|
<Not-7290>
|
['miraheze/mediawiki'] 'paladox' pushed '' commit to 'REL1_33' [+0/-0/±1] 'https://git.io/fj6qA'
|
|
2019-07-03 17:43:34
|
<paladox>
|
ok, what is causing the high load on mw1..
|
|
2019-07-03 17:43:35
|
<Not-7290>
|
['miraheze/mediawiki'] 'paladox' 'bb83ee' - Update CW
|
|
2019-07-03 17:43:45
|
<JohnLewis>
|
was going to do it by using selectDomain then checking for an exception for that's cleaner
|
|
2019-07-03 17:44:17
|
<icinga-miraheze>
|
PROBLEM - mw3 Current Load on mw3 is CRITICAL: CRITICAL - load average: 14.08, 8.22, 5.26
|
|
2019-07-03 17:45:05
|
<icinga-miraheze>
|
RECOVERY - mw1 Current Load on mw1 is OK: OK - load average: 6.18, 6.08, 4.62
|
|
2019-07-03 17:45:16
|
<icinga-miraheze>
|
PROBLEM - mw3 JobQueue on mw3 is UNKNOWN: NRPE: Unable to read output
|
|
2019-07-03 17:45:28
|
<icinga-miraheze>
|
PROBLEM - mw2 Current Load on mw2 is WARNING: WARNING - load average: 6.92, 5.88, 4.15
|
|
2019-07-03 17:47:28
|
<icinga-miraheze>
|
RECOVERY - mw2 Current Load on mw2 is OK: OK - load average: 4.85, 5.54, 4.24
|
|
2019-07-03 17:54:16
|
<icinga-miraheze>
|
PROBLEM - mw3 Current Load on mw3 is WARNING: WARNING - load average: 5.15, 7.25, 6.43
|
|
2019-07-03 17:55:05
|
<icinga-miraheze>
|
PROBLEM - mw1 Current Load on mw1 is CRITICAL: CRITICAL - load average: 10.37, 7.93, 6.04
|
|
2019-07-03 17:56:16
|
<icinga-miraheze>
|
RECOVERY - mw3 Current Load on mw3 is OK: OK - load average: 4.26, 6.14, 6.12
|
|
2019-07-03 17:57:04
|
<icinga-miraheze>
|
PROBLEM - mw1 Current Load on mw1 is WARNING: WARNING - load average: 6.74, 7.53, 6.13
|
|
2019-07-03 17:59:04
|
<icinga-miraheze>
|
RECOVERY - mw1 Current Load on mw1 is OK: OK - load average: 4.50, 6.43, 5.89
|
|
2019-07-03 18:03:19
|
<icinga-miraheze>
|
PROBLEM - cp2 Varnish Backends on cp2 is CRITICAL: 1 backends are down. mw3
|
|
2019-07-03 18:05:18
|
<icinga-miraheze>
|
RECOVERY - cp2 Varnish Backends on cp2 is OK: All 5 backends are healthy
|
|
2019-07-03 18:35:28
|
<icinga-miraheze>
|
PROBLEM - mw2 Current Load on mw2 is WARNING: WARNING - load average: 7.84, 6.63, 4.94
|
|
2019-07-03 18:37:29
|
<icinga-miraheze>
|
RECOVERY - mw2 Current Load on mw2 is OK: OK - load average: 4.49, 5.77, 4.83
|
|
2019-07-03 18:55:28
|
<icinga-miraheze>
|
PROBLEM - mw2 Current Load on mw2 is CRITICAL: CRITICAL - load average: 10.69, 7.95, 6.48
|
|
2019-07-03 18:56:28
|
<icinga-miraheze>
|
PROBLEM - mw3 Current Load on mw3 is WARNING: WARNING - load average: 7.60, 6.85, 5.11
|
|
2019-07-03 18:57:06
|
<icinga-miraheze>
|
PROBLEM - mw1 Current Load on mw1 is CRITICAL: CRITICAL - load average: 9.40, 6.40, 4.70
|
|
2019-07-03 19:00:23
|
<icinga-miraheze>
|
RECOVERY - mw3 Current Load on mw3 is OK: OK - load average: 5.52, 6.61, 5.43
|
|
2019-07-03 19:01:05
|
<icinga-miraheze>
|
PROBLEM - mw1 Current Load on mw1 is WARNING: WARNING - load average: 6.77, 7.28, 5.50
|
|
2019-07-03 19:03:04
|
<icinga-miraheze>
|
RECOVERY - mw1 Current Load on mw1 is OK: OK - load average: 4.31, 6.21, 5.33
|
|
2019-07-03 19:03:29
|
<icinga-miraheze>
|
PROBLEM - mw2 Current Load on mw2 is WARNING: WARNING - load average: 7.47, 7.75, 7.08
|
|
2019-07-03 19:05:29
|
<icinga-miraheze>
|
PROBLEM - mw2 Current Load on mw2 is CRITICAL: CRITICAL - load average: 8.54, 7.97, 7.23
|
|
2019-07-03 19:07:32
|
<icinga-miraheze>
|
PROBLEM - mw2 Current Load on mw2 is WARNING: WARNING - load average: 7.21, 7.63, 7.20
|
|
2019-07-03 19:10:35
|
<paladox>
|
just noting here that we are looking into ^^
|
|
2019-07-03 19:15:29
|
<icinga-miraheze>
|
PROBLEM - mw2 Current Load on mw2 is CRITICAL: CRITICAL - load average: 9.85, 8.21, 7.43
|
|
2019-07-03 19:19:29
|
<icinga-miraheze>
|
PROBLEM - mw2 Current Load on mw2 is WARNING: WARNING - load average: 6.87, 7.63, 7.39
|
|
2019-07-03 19:23:28
|
<icinga-miraheze>
|
PROBLEM - mw2 Current Load on mw2 is CRITICAL: CRITICAL - load average: 8.11, 7.43, 7.32
|
|
2019-07-03 19:27:31
|
<icinga-miraheze>
|
PROBLEM - mw2 Current Load on mw2 is WARNING: WARNING - load average: 7.23, 7.71, 7.48
|
|
2019-07-03 19:34:35
|
<paladox>
|
!log installing https://github.com/martin-helmich/prometheus-nginxlog-exporter on test1
|
|
2019-07-03 19:34:36
|
<ZppixBot>
|
[ GitHub - martin-helmich/prometheus-nginxlog-exporter: Export metrics from Nginx access log files to Prometheus ] - github.com
|
|
2019-07-03 19:34:41
|
<MirahezeLogbot>
|
Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master
|
|
2019-07-03 19:35:35
|
<icinga-miraheze>
|
PROBLEM - mw2 Current Load on mw2 is CRITICAL: CRITICAL - load average: 9.56, 8.23, 7.71
|
|
2019-07-03 20:01:34
|
<AmandaCath>
|
Error 503 site-wide
|
|
2019-07-03 20:02:17
|
<icinga-miraheze>
|
PROBLEM - misc1 GDNSD Datacenters on misc1 is CRITICAL: CRITICAL - 6 datacenters are down: 107.191.126.23/cpweb, 2604:180:0:33b::2/cpweb, 128.199.139.216/cpweb, 2400:6180:0:d0::403:f001/cpweb, 81.4.109.133/cpweb, 2a00:d880:5:8ea::ebc7/cpweb
|
|
2019-07-03 20:02:36
|
<RhinosF1>
|
Paladox: ^^
|
|
2019-07-03 20:02:37
|
<icinga-miraheze>
|
PROBLEM - cp4 Varnish Backends on cp4 is CRITICAL: 3 backends are down. mw1 mw2 mw3
|
|
2019-07-03 20:02:42
|
<paladox>
|
hmm
|
|
2019-07-03 20:02:44
|
<paladox>
|
checks
|
|
2019-07-03 20:02:55
|
<RhinosF1>
|
AmandaCath: Known, was reported this morning and been happening all day
|
|
2019-07-03 20:02:56
|
<icinga-miraheze>
|
PROBLEM - cp3 Varnish Backends on cp3 is CRITICAL: 3 backends are down. mw1 mw2 mw3
|
|
2019-07-03 20:02:58
|
<icinga-miraheze>
|
PROBLEM - ns1 GDNSD Datacenters on ns1 is CRITICAL: CRITICAL - 6 datacenters are down: 107.191.126.23/cpweb, 2604:180:0:33b::2/cpweb, 128.199.139.216/cpweb, 2400:6180:0:d0::403:f001/cpweb, 81.4.109.133/cpweb, 2a00:d880:5:8ea::ebc7/cpweb
|
|
2019-07-03 20:03:09
|
<RhinosF1>
|
Paladox: u closed my phab task reporting it.
|
|
2019-07-03 20:03:10
|
<icinga-miraheze>
|
PROBLEM - mw1 Current Load on mw1 is CRITICAL: CRITICAL - load average: 14.40, 8.04, 4.91
|
|
2019-07-03 20:03:58
|
<icinga-miraheze>
|
PROBLEM - cp2 Varnish Backends on cp2 is CRITICAL: 3 backends are down. mw1 mw2 mw3
|
|
2019-07-03 20:04:03
|
<icinga-miraheze>
|
PROBLEM - cp2 HTTP 4xx/5xx ERROR Rate on cp2 is WARNING: WARNING - NGINX Error Rate is 48%
|
|
2019-07-03 20:04:16
|
<icinga-miraheze>
|
PROBLEM - mw3 Current Load on mw3 is CRITICAL: CRITICAL - load average: 12.16, 8.99, 5.54
|
|
2019-07-03 20:04:31
|
<RhinosF1>
|
https://phabricator.miraheze.org/T4509 For the record
|
|
2019-07-03 20:04:32
|
<ZppixBot>
|
[ ⚓ T4509 503 backend fetch failed on Most/all servers ] - phabricator.miraheze.org
|
|
2019-07-03 20:04:48
|
<paladox>
|
!log restarting php-fpm across mw*
|
|
2019-07-03 20:04:54
|
<MirahezeLogbot>
|
Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master
|
|
2019-07-03 20:04:57
|
<icinga-miraheze>
|
RECOVERY - ns1 GDNSD Datacenters on ns1 is OK: OK - all datacenters are online
|
|
2019-07-03 20:06:03
|
<icinga-miraheze>
|
RECOVERY - cp2 HTTP 4xx/5xx ERROR Rate on cp2 is OK: OK - NGINX Error Rate is 17%
|
|
2019-07-03 20:06:16
|
<icinga-miraheze>
|
PROBLEM - mw3 Current Load on mw3 is WARNING: WARNING - load average: 4.14, 7.09, 5.27
|
|
2019-07-03 20:06:48
|
<icinga-miraheze>
|
RECOVERY - cp3 Varnish Backends on cp3 is OK: All 5 backends are healthy
|
|
2019-07-03 20:06:55
|
<Not-7290>
|
['miraheze/puppet'] 'paladox' pushed '' commit to 'master' [+5/-0/±0] 'https://git.io/fj6Ou'
|
|
2019-07-03 20:06:57
|
<Not-7290>
|
['miraheze/puppet'] 'paladox' '6e456c' - prometheus: Add nginx exporter
|
|
2019-07-03 20:07:07
|
<icinga-miraheze>
|
PROBLEM - mw1 Current Load on mw1 is WARNING: WARNING - load average: 5.10, 7.99, 5.75
|
|
2019-07-03 20:07:56
|
<icinga-miraheze>
|
RECOVERY - cp2 Varnish Backends on cp2 is OK: All 5 backends are healthy
|
|
2019-07-03 20:08:16
|
<icinga-miraheze>
|
RECOVERY - mw3 Current Load on mw3 is OK: OK - load average: 3.46, 5.90, 5.06
|
|
2019-07-03 20:08:17
|
<icinga-miraheze>
|
RECOVERY - misc1 GDNSD Datacenters on misc1 is OK: OK - all datacenters are online
|
|
2019-07-03 20:08:37
|
<icinga-miraheze>
|
RECOVERY - cp4 Varnish Backends on cp4 is OK: All 5 backends are healthy
|
|
2019-07-03 20:08:47
|
<Not-7290>
|
['miraheze/puppet'] 'paladox' pushed '' commit to 'master' [+5/-0/±0] 'https://git.io/fj6Og'
|
|
2019-07-03 20:08:48
|
<Not-7290>
|
['miraheze/puppet'] 'paladox' '1fe8fe' - prometheus: Add nginx exporter
|
|
2019-07-03 20:09:01
|
<AmandaCath>
|
On a different topic.. why do we have global abuse filter with blocking enabled (30)?
|
|
2019-07-03 20:09:05
|
<icinga-miraheze>
|
RECOVERY - mw1 Current Load on mw1 is OK: OK - load average: 3.28, 6.33, 5.40
|
|
2019-07-03 20:09:25
|
<AmandaCath>
|
There aren't any globally banned users besides LP that I'm aware of
|
|
2019-07-03 20:09:42
|
<AmandaCath>
|
Ping Voidwalker as most recent filter editor
|
|
2019-07-03 20:12:42
|
<paladox>
|
!log hacking puppet manifest to enable nginx exporter on test1
|
|
2019-07-03 20:13:28
|
<MirahezeLogbot>
|
Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master
|
|
2019-07-03 20:16:01
|
<Not-7290>
|
['miraheze/puppet'] 'paladox' pushed '' commit to 'master' [+0/-0/±1] 'https://git.io/fj6OP'
|
|
2019-07-03 20:16:02
|
<Not-7290>
|
['miraheze/puppet'] 'paladox' 'd9dda0' - prometheus: Fix nginx systemd service
|
|
2019-07-03 20:19:50
|
<icinga-miraheze>
|
PROBLEM - misc4 Puppet on misc4 is WARNING: WARNING: Puppet is currently disabled, message: paladox, last run 7 minutes ago with 0 failures
|
|
2019-07-03 20:27:32
|
<paladox>
|
!log adding nginx exporter to mw1
|
|
2019-07-03 20:27:37
|
<MirahezeLogbot>
|
Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master
|
|
2019-07-03 20:28:14
|
<paladox>
|
!log make that all mw*
|
|
2019-07-03 20:28:20
|
<MirahezeLogbot>
|
Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master
|
|
2019-07-03 20:29:34
|
<icinga-miraheze>
|
PROBLEM - mw2 Current Load on mw2 is WARNING: WARNING - load average: 5.81, 6.70, 7.95
|
|
2019-07-03 20:43:28
|
<icinga-miraheze>
|
PROBLEM - mw2 Current Load on mw2 is CRITICAL: CRITICAL - load average: 9.21, 7.11, 7.28
|
|
2019-07-03 20:49:31
|
<icinga-miraheze>
|
PROBLEM - mw2 Current Load on mw2 is WARNING: WARNING - load average: 7.78, 7.87, 7.60
|
|
2019-07-03 20:55:31
|
<icinga-miraheze>
|
PROBLEM - mw2 Current Load on mw2 is CRITICAL: CRITICAL - load average: 9.53, 8.15, 7.70
|
|
2019-07-03 20:57:29
|
<icinga-miraheze>
|
PROBLEM - mw2 Current Load on mw2 is WARNING: WARNING - load average: 3.99, 6.93, 7.33
|
|
2019-07-03 20:57:38
|
<RF1>
|
paladox: given the load issues is it best I hold off bot testing
|
|
2019-07-03 20:57:52
|
<paladox>
|
RF1 yes please.
|
|
2019-07-03 20:59:25
|
<RF1>
|
paladox: thx
|
|
2019-07-03 20:59:28
|
<icinga-miraheze>
|
RECOVERY - mw2 Current Load on mw2 is OK: OK - load average: 2.18, 5.26, 6.67
|
|
2019-07-03 21:01:04
|
<icinga-miraheze>
|
PROBLEM - mw1 Current Load on mw1 is CRITICAL: CRITICAL - load average: 10.04, 6.51, 4.52
|
|
2019-07-03 21:03:04
|
<icinga-miraheze>
|
PROBLEM - mw1 Current Load on mw1 is WARNING: WARNING - load average: 6.99, 6.84, 4.90
|
|
2019-07-03 21:05:04
|
<icinga-miraheze>
|
RECOVERY - mw1 Current Load on mw1 is OK: OK - load average: 4.47, 5.92, 4.79
|
|
2019-07-03 21:18:16
|
<icinga-miraheze>
|
PROBLEM - mw3 Current Load on mw3 is WARNING: WARNING - load average: 6.93, 5.97, 4.69
|
|
2019-07-03 21:20:16
|
<icinga-miraheze>
|
RECOVERY - mw3 Current Load on mw3 is OK: OK - load average: 6.60, 5.97, 4.83
|
|
2019-07-03 22:23:04
|
<icinga-miraheze>
|
PROBLEM - mw1 Current Load on mw1 is WARNING: WARNING - load average: 7.18, 6.09, 4.62
|
|
2019-07-03 22:25:05
|
<icinga-miraheze>
|
RECOVERY - mw1 Current Load on mw1 is OK: OK - load average: 4.35, 5.41, 4.55
|
|
2019-07-03 23:15:10
|
<Not-7290>
|
['puppet'] 'paladox' created branch 'paladox-patch-6' - 'https://git.io/vbiAS'
|
|
2019-07-03 23:15:11
|
<Not-7290>
|
['miraheze/puppet'] 'paladox' pushed '' commit to 'paladox-patch-6' [+0/-0/±1] 'https://git.io/fj6Ge'
|
|
2019-07-03 23:15:13
|
<Not-7290>
|
['miraheze/puppet'] 'paladox' 'b2a0c60' - prometheus: Include nginx exporter in nginx class
|
|
2019-07-03 23:15:14
|
<Not-7290>
|
['puppet'] 'paladox' opened pull request '#1023': prometheus: Include nginx exporter in nginx class - 'https://git.io/fj6Gv'
|
|
2019-07-03 23:16:46
|
<Not-7290>
|
['miraheze/puppet'] 'paladox' pushed '' commit to 'paladox-patch-6' [+0/-0/±1] 'https://git.io/fj6Gf'
|
|
2019-07-03 23:16:48
|
<Not-7290>
|
['miraheze/puppet'] 'paladox' 'f9c12c4' - Update prometheus.yml.erb
|
|
2019-07-03 23:16:49
|
<Not-7290>
|
['puppet'] 'paladox' synchronize pull request '#1023': prometheus: Include nginx exporter in nginx class - 'https://git.io/fj6Gv'
|
|
2019-07-03 23:17:52
|
<Not-7290>
|
['miraheze/puppet'] 'paladox' pushed '' commit to 'paladox-patch-6' [+0/-0/±1] 'https://git.io/fj6GU'
|
|
2019-07-03 23:17:54
|
<Not-7290>
|
['miraheze/puppet'] 'paladox' 'ea41b5' - Update init.pp
|
|
2019-07-03 23:17:55
|
<Not-7290>
|
['puppet'] 'paladox' synchronize pull request '#1023': prometheus: Include nginx exporter in nginx class - 'https://git.io/fj6Gv'
|
|
2019-07-03 23:18:35
|
<Not-7290>
|
['puppet'] 'paladox' closed pull request '#1021': Temporarily blacklist MwClient user agent - 'https://git.io/fjocC'
|
|
2019-07-03 23:18:39
|
<Not-7290>
|
['puppet'] 'paladox' deleted branch 'paladox-patch-4' - 'https://git.io/vbiAS'
|
|
2019-07-03 23:18:40
|
<Not-7290>
|
['miraheze/puppet'] 'paladox' deleted branch 'paladox-patch-4'
|
|
2019-07-03 23:26:00
|
<Not-7290>
|
['puppet'] 'paladox' closed pull request '#1023': prometheus: Include nginx exporter in nginx class - 'https://git.io/fj6Gv'
|
|
2019-07-03 23:26:01
|
<Not-7290>
|
['miraheze/puppet'] 'paladox' pushed '' commit to 'master' [+0/-0/±3] 'https://git.io/fj6GO'
|
|
2019-07-03 23:26:03
|
<Not-7290>
|
['miraheze/puppet'] 'paladox' 'bce8a87' - prometheus: Include nginx exporter in nginx class (#1023) * prometheus: Include nginx exporter in nginx class * Update prometheus.yml.erb * Update init.pp
|
|
2019-07-03 23:26:04
|
<Not-7290>
|
['puppet'] 'paladox' deleted branch 'paladox-patch-6' - 'https://git.io/vbiAS'
|
|
2019-07-03 23:26:06
|
<Not-7290>
|
['miraheze/puppet'] 'paladox' deleted branch 'paladox-patch-6'
|
|
2019-07-03 23:27:43
|
<Not-7290>
|
['miraheze/puppet'] 'paladox' pushed '' commit to 'master' [+0/-0/±1] 'https://git.io/fj6Gs'
|
|
2019-07-03 23:27:45
|
<Not-7290>
|
['miraheze/puppet'] 'paladox' '65a637' - prometheus: Fix config
|
|
2019-07-03 23:27:50
|
<icinga-miraheze>
|
RECOVERY - misc4 Puppet on misc4 is OK: OK: Puppet is currently enabled, last run 28 seconds ago with 0 failures
|
|
2019-07-03 23:30:19
|
<icinga-miraheze>
|
RECOVERY - cp3 Puppet on cp3 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures
|
|
2019-07-03 23:35:36
|
<Not-7290>
|
['ssl'] 'paladox' created branch 'paladox-patch-1' - 'https://git.io/vxP9L'
|
|
2019-07-03 23:35:37
|
<Not-7290>
|
['miraheze/ssl'] 'paladox' pushed '' commit to 'paladox-patch-1' [+0/-0/±1] 'https://git.io/fj6G4'
|
|
2019-07-03 23:35:39
|
<Not-7290>
|
['miraheze/ssl'] 'paladox' '9fb49c' - Remove astrapedia.ru ssl certificate Domain no longer pointing at us
|
|
2019-07-03 23:35:40
|
<Not-7290>
|
['ssl'] 'paladox' opened pull request '#196': Remove astrapedia.ru ssl certificate - 'https://git.io/fj6GB'
|
|
2019-07-03 23:35:53
|
<Not-7290>
|
['miraheze/ssl'] 'paladox' pushed '' commit to 'paladox-patch-1' [+0/-1/±0] 'https://git.io/fj6GR'
|
|
2019-07-03 23:35:55
|
<Not-7290>
|
['miraheze/ssl'] 'paladox' '65ee8a' - Delete astrapedia.ru.crt
|
|
2019-07-03 23:35:56
|
<Not-7290>
|
['ssl'] 'paladox' synchronize pull request '#196': Remove astrapedia.ru ssl certificate - 'https://git.io/fj6GB'
|
|
2019-07-03 23:36:02
|
<Not-7290>
|
['ssl'] 'paladox' closed pull request '#196': Remove astrapedia.ru ssl certificate - 'https://git.io/fj6GB'
|
|
2019-07-03 23:36:03
|
<Not-7290>
|
['miraheze/ssl'] 'paladox' pushed '' commit to 'master' [+0/-1/±1] 'https://git.io/fj6G0'
|
|
2019-07-03 23:36:04
|
<Not-7290>
|
['miraheze/ssl'] 'paladox' 'c9a5f20' - Remove astrapedia.ru ssl certificate (#196) * Remove astrapedia.ru ssl certificate Domain no longer pointing at us * Delete astrapedia.ru.crt
|
|
2019-07-03 23:36:05
|
<Not-7290>
|
['ssl'] 'paladox' deleted branch 'paladox-patch-1' - 'https://git.io/vxP9L'
|
|
2019-07-03 23:36:07
|
<Not-7290>
|
['miraheze/ssl'] 'paladox' deleted branch 'paladox-patch-1'
|
|
2019-07-03 23:50:12
|
<Not-7290>
|
['miraheze/services'] 'MirahezeSSLBot' pushed '' commit to 'master' [+0/-0/±1] 'https://git.io/fj6Go'
|
|
2019-07-03 23:50:13
|
<Not-7290>
|
['miraheze/services'] 'MirahezeSSLBot' 'dc3b17a' - BOT: Updating services config for wikis
|