[06:48:07] <elukey>	 vgutierrez: o/ i see acmechief reporting "Staging_time will be enforced for wikiworkshop / rsa-2048 till 2021-05-16", does it need the usual restart to force the renew?
[06:48:46] <elukey>	 (Also if we could add a quick runbook for people to review I'd be soooo happy :)
[07:00:16] <vgutierrez>	 Errr nope 
[07:00:28] <vgutierrez>	 That's expected 
[07:01:11] <vgutierrez>	 Acme-chief waits 1 week for the tls certs used on the caching cluster 
[07:02:30] <elukey>	 vgutierrez: ah ack! Do we need to change the alert or similar?
[07:07:04] <vgutierrez>	 Probably we should trim it till 21 days 
[07:07:17] <vgutierrez>	 Instead of beginning the warning period at 30 days
[07:07:33] <elukey>	 makes sense yes!
[08:09:57] <vgutierrez>	 elukey: https://gerrit.wikimedia.org/r/c/operations/puppet/+/688176/ should to the trick
[08:11:21] <elukey>	 ack makes sense
[08:40:37] <wikibugs>	 10netops, 10SRE, 10fr-email-preference-center, 10fundraising-tech-ops, 10WMF-NDA: Deploy pfw policy1620422079 for T268501 and T281320 - https://phabricator.wikimedia.org/T282286 (10ayounsi) 05Open→03Resolved
[16:41:50] <wikibugs>	 10netops, 10SRE: routinator: creat gabage collection job - https://phabricator.wikimedia.org/T282469 (10jbond) p:05Triage→03Low
[19:21:18] <wikibugs>	 10Traffic, 10netops, 10SRE: TATA SKY Broadband (AS134674) issues with connecting to upload.wikimedia.org - https://phabricator.wikimedia.org/T275234 (10ssingh) @ayounsi, @Aklapper: I forgot to update this ticket, apologies! Last I checked, all reports were in the green and there wasn't any debugging informat...
[20:08:42] <wikibugs>	 10Traffic, 10netops, 10SRE: TATA SKY Broadband (AS134674) issues with connecting to upload.wikimedia.org - https://phabricator.wikimedia.org/T275234 (10CDanis) There is evidence in our [[ https://wikitech.wikimedia.org/wiki/Network_Error_Logging | NEL ]] data that suggests this problem still exists.  This pa...
[20:18:35] <wikibugs>	 10Acme-chief, 10SRE: acme-chief is down: ValueError: OCSP response status is not successful so the property has no value - https://phabricator.wikimedia.org/T282490 (10Legoktm) p:05Triage→03Unbreak!
[20:36:34] <wikibugs>	 10Acme-chief, 10SRE: acme-chief is down: ValueError: OCSP response status is not successful so the property has no value - https://phabricator.wikimedia.org/T282490 (10Vgutierrez) p:05Unbreak!→03High it looks like a horrible case of bad timing.. acme-chief triggered a certificate renewal for our gitlab cer...