[09:09:58] <wikibugs>	 10Traffic, 10SRE, 10Wikimedia-General-or-Unknown, 10User-DannyS712, 10affects-Kiwix-and-openZIM: Pages whose title ends with semicolon (;) are intermittently inaccessible (likely due to ATS) - https://phabricator.wikimedia.org/T238285 (10Kelson)
[09:47:04] <wikibugs>	 10Traffic, 10SRE: provision more machines for eqsin caches - https://phabricator.wikimedia.org/T275046 (10MoritzMuehlenhoff) p:05Triage→03High
[11:54:26] <wikibugs>	 10netops, 10Datasets-General-or-Unknown, 10Dumps-Generation, 10SRE: Packets discarded on dumpsdata1001 - https://phabricator.wikimedia.org/T273713 (10ArielGlenn) Dumpsata1003 is now the primary x,ml/sql dumps NFS server with its shiny 10G NIC. Let's keep an eye on both hosts. The new run starts on the 20th...
[18:18:30] <wikibugs>	 10Traffic, 10Desktop Improvements, 10SRE: CDN cache revalidation on several wikis for desktop improvements deployment pt 2 - https://phabricator.wikimedia.org/T274784 (10BBlack) This seems pretty straight-forward operationally, I think we can replicate the techniques used in T256750 for more wikis in general...
[18:29:36] <wikibugs>	 10Traffic, 10Desktop Improvements, 10SRE: CDN cache revalidation on several wikis for desktop improvements deployment pt 2 - https://phabricator.wikimedia.org/T274784 (10ovasileva) >>! In T274784#6841519, @BBlack wrote: > This seems pretty straight-forward operationally, I think we can replicate the techniqu...
[18:36:51] <wikibugs>	 10Traffic, 10Desktop Improvements, 10SRE, 10Performance-Team (Radar): CDN cache revalidation on several wikis for desktop improvements deployment pt 2 - https://phabricator.wikimedia.org/T274784 (10Krinkle)
[20:05:47] <wikibugs>	 10Traffic, 10SRE: validate or revert the new large_objects_cutoff & nuke_limit settings on upload@eqsin - https://phabricator.wikimedia.org/T275028 (10CDanis) 05Open→03Resolved a:03CDanis Caches have filled, and there's no more fetch failures due to "LRU limited": https://grafana.wikimedia.org/d/00000035...
[20:05:49] <wikibugs>	 10Traffic, 10SRE: cp_upload @ eqsin cascading failures, February 2021 - https://phabricator.wikimedia.org/T274888 (10CDanis)