[07:45:56] 10Traffic, 10Desktop Improvements, 10Operations, 10Product-Infrastructure-Team-Backlog, and 4 others: Connection closed while downloading PDF of articles - https://phabricator.wikimedia.org/T266373 (10Urbanecm) [10:08:13] 10Traffic, 10Desktop Improvements, 10Operations, 10Product-Infrastructure-Team-Backlog, and 4 others: Connection closed while downloading PDF of articles - https://phabricator.wikimedia.org/T266373 (10akosiaris) p:05Low→03High More and more duplicates are being merged into this one and stats from tests... [11:41:26] 10Traffic, 10Desktop Improvements, 10Operations, 10Product-Infrastructure-Team-Backlog, and 4 others: Connection closed while downloading PDF of articles - https://phabricator.wikimedia.org/T266373 (10BBlack) I haven't been able to repro this on a public endpoint from my own home connection, even using the... [13:13:55] 10Traffic, 10Desktop Improvements, 10Operations, 10Product-Infrastructure-Team-Backlog, and 4 others: Connection closed while downloading PDF of articles - https://phabricator.wikimedia.org/T266373 (10BBlack) I'm not exactly sure as to why the pattern above emerged, but now I don't think it's relevant at a... [13:38:35] 10Traffic, 10Desktop Improvements, 10Operations, 10Product-Infrastructure-Team-Backlog, and 5 others: Connection closed while downloading PDF of articles - https://phabricator.wikimedia.org/T266373 (10CDanis) Adding to what Brandon says, we do have evidence that it happens on edge DCs other than just eqiad... [13:48:29] 10Traffic, 10Desktop Improvements, 10Operations, 10Product-Infrastructure-Team-Backlog, and 5 others: Connection closed while downloading PDF of articles - https://phabricator.wikimedia.org/T266373 (10BBlack) The proposed changes are live now. It may take a a few hours to confirm that via NEL at our curre... [14:11:37] 10Wikimedia-Apache-configuration, 10Operations: Update 2030.wikimedia.org redirect to new URI - https://phabricator.wikimedia.org/T264797 (10Kormat) Hi. I have merged the gerrit change, but - i'm not sure how long it's going to take to take effect - the current redirect is a 301 (a 'permenant' redirect), so br... [14:59:22] bblack: we were *not* meeting today, is that right...? [15:05:03] 10Wikimedia-Apache-configuration, 10Operations: Update 2030.wikimedia.org redirect to new URI - https://phabricator.wikimedia.org/T264797 (10Urbanecm) 05Open→03Resolved a:03Kormat Did a second HTCP purge after Puppet propagated it everywhere, and it seems to work: ` urbanecm@titanium ~ $ curl --silent... [15:10:21] cdanis: correct [15:14:24] 10Wikimedia-Apache-configuration, 10Operations: Update 2030.wikimedia.org redirect to new URI - https://phabricator.wikimedia.org/T264797 (10sguebo_WMF) >>! In T264797#6630512, @Kormat wrote: > Hi. I have merged the gerrit change, but > - i'm not sure how long it's going to take to take effect > - the current... [15:41:03] 10Traffic, 10Operations, 10Patch-For-Review: Maxmind data update issues for DNS (and others?) - https://phabricator.wikimedia.org/T252577 (10BBlack) 05Open→03Resolved a:03BBlack This should be fixed now! [15:48:23] 10netops, 10Operations, 10ops-codfw: ripe-atlas-codfw is down - https://phabricator.wikimedia.org/T267714 (10Papaul) Connected the device on scs-a1 on port 47 still no connection to serial [17:21:01] 10Wikimedia-Apache-configuration, 10Operations: Update 2030.wikimedia.org redirect to new URI - https://phabricator.wikimedia.org/T264797 (10Abbad) Works very well. THANK you both for your time! [18:35:45] 10Wikimedia-Apache-configuration, 10Operations: Update 2030.wikimedia.org redirect to new URI - https://phabricator.wikimedia.org/T264797 (10Dzahn) Thank you @kormat for merging this! Much appreciated. Also I learned that purgeList can be used by deployers. Nice. [18:59:57] 10Traffic, 10Operations, 10Patch-For-Review: Update certspotter - https://phabricator.wikimedia.org/T204993 (10Dzahn) on icinga1001, alert1001: crons reactivated: ` Notice: /Stage[main]/Certspotter/Cron[certspotter]/ensure: created ` [19:32:50] 10Acme-chief, 10Traffic, 10Operations: Integrate certspotter with certcentral to avoid certspotter notifying us on legitimate certs generated by our certcentral boxes - https://phabricator.wikimedia.org/T204994 (10Dzahn) [19:33:38] 10Traffic, 10Operations, 10Patch-For-Review: Update certspotter - https://phabricator.wikimedia.org/T204993 (10Dzahn) 05Open→03Resolved a:03Dzahn What I know here is: - meanwhile icinga servers are on buster - reviewers approved reverting the "disable cron job" - I merged it, crons are enabled again a... [21:19:00] 10Traffic, 10Desktop Improvements, 10Operations, 10Product-Infrastructure-Team-Backlog, and 4 others: Connection closed while downloading PDF of articles - https://phabricator.wikimedia.org/T266373 (10BBlack) No reports of the PDF truncations in NEL for ~8 hours now, which is a significant break from recen... [21:25:28] 10Traffic, 10Desktop Improvements, 10Operations, 10Product-Infrastructure-Team-Backlog, and 4 others: Connection closed while downloading PDF of articles - https://phabricator.wikimedia.org/T266373 (10RhinosF1) Works for me