[01:39:55] <wikibugs>	 10Traffic, 10Infrastructure-Foundations, 10netbox: Restoring Netbox data for lvs3007 - https://phabricator.wikimedia.org/T334253 (10Peachey88)
[07:23:13] <wikibugs>	 10Traffic, 10Infrastructure-Foundations, 10SRE, 10netbox: Restoring Netbox data for lvs3007 - https://phabricator.wikimedia.org/T334253 (10Volans) p:05Triage→03High a:03Volans I've updated on IRC while I was working on this, this is my backlog :)   > So for Netbox, we do have hourly backup, we're jus...
[07:24:37] <wikibugs>	 10netops, 10Infrastructure-Foundations, 10SRE: Automate EVPN switch underlay BGP neighbor peerings - https://phabricator.wikimedia.org/T327934 (10ayounsi) FYI, the above patch caused the following outstanding diff on some cloudsw switches:  `lang=diff Changes for 1 devices: ['cloudsw1-c8-eqiad.mgmt.eqiad.wmn...
[07:56:22] <wikibugs>	 10Traffic, 10Commons, 10SRE: Specific PNG thumbnail of SVG file is outdated / stuck (European caching cluster) - https://phabricator.wikimedia.org/T333042 (10Lionel_Scheepmans) Hello. I still have a problem with the display of a PDF on this page :  https://fr.wikibooks.org/wiki/Utilisateur:Lionel_Scheepmans/...
[07:59:17] <wikibugs>	 10Traffic, 10Commons, 10SRE: Specific PNG thumbnail of SVG file is outdated / stuck (European caching cluster) - https://phabricator.wikimedia.org/T333042 (10Lionel_Scheepmans) Is ther some news about this bug ?
[12:31:27] <wikibugs>	 10netops, 10Infrastructure-Foundations, 10SRE: Add generic mechanism to add static routes on switches - https://phabricator.wikimedia.org/T334281 (10cmooney) p:05Triage→03Low
[12:34:10] <wikibugs>	 10netops, 10Infrastructure-Foundations, 10SRE: Add generic mechanism to add static routes on switches - https://phabricator.wikimedia.org/T334281 (10cmooney)
[12:55:02] <wikibugs>	 10netops, 10Infrastructure-Foundations, 10SRE, 10Patch-For-Review: Add generic mechanism to add static routes on switches - https://phabricator.wikimedia.org/T334281 (10cmooney)
[13:17:18] <wikibugs>	 10Traffic, 10Infrastructure-Foundations, 10SRE, 10netbox: Restoring Netbox data for lvs3007 - https://phabricator.wikimedia.org/T334253 (10ssingh) >>! In T334253#8764695, @Volans wrote: > I've updated on IRC while I was working on this, this is my backlog :)  Many thanks for taking care of this, @volans!...
[13:25:07] <wikibugs>	 10netops, 10Infrastructure-Foundations, 10SRE: Automate EVPN switch underlay BGP neighbor peerings - https://phabricator.wikimedia.org/T327934 (10cmooney) 05Open→03Resolved Indeed Arzhel thanks, my bad I had forgot those were present.  I'll close this one, the static's have been (rather laboriously) deal...
[15:30:53] <wikibugs>	 10Traffic, 10Infrastructure-Foundations, 10SRE, 10netbox: Restoring Netbox data for lvs3007 - https://phabricator.wikimedia.org/T334253 (10Volans) 05Open→03Resolved Perfect, resolving.
[15:51:47] <wikibugs>	 10Traffic, 10SRE, 10serviceops-collab, 10GitLab (Infrastructure), 10Patch-For-Review: Deprecate and disable port 80 for one-off sites under canonical domains - https://phabricator.wikimedia.org/T238720 (10BCornwall)
[15:53:45] <wikibugs>	 10Traffic, 10SRE, 10serviceops-collab, 10GitLab (Infrastructure), 10Patch-For-Review: Deprecate and disable port 80 for one-off sites under canonical domains - https://phabricator.wikimedia.org/T238720 (10BCornwall) 05In progress→03Resolved I went ahead and struck lists off of the.... list since it s...
[16:30:31] <wikibugs>	 10Traffic, 10Commons, 10SRE: Specific PNG thumbnail of SVG file is outdated / stuck (European caching cluster) - https://phabricator.wikimedia.org/T333042 (10Aklapper) @Lionel_Scheepmans In general in all tickets, all known news can be found in the ticket itself. Thus no need to ever ask. Thanks!
[19:48:30] <wikibugs>	 10Traffic, 10Commons, 10MediaWiki-File-management, 10SRE: Why do Wikimedia Commons SVGs sometimes not update? - https://phabricator.wikimedia.org/T334303 (10bd808)
[20:03:11] <wikibugs>	 10Traffic, 10Commons, 10MediaWiki-File-management, 10SRE: PNG thumbnail of Wikimedia Commons SVG file sometimes not updated - https://phabricator.wikimedia.org/T334303 (10Aklapper)
[22:48:47] <wikibugs>	 10Traffic, 10SRE: Upgrade lvs1013-1016 firmware - https://phabricator.wikimedia.org/T334259 (10BCornwall) I've found that 2.84.84.84 (released just last month) is a non-functional version, causing the web interface to break. At first I thought it was enforcing host names (per https://www.dell.com/support/kbdoc...
[22:50:55] <wikibugs>	 10Traffic, 10SRE: Upgrade lvs1013-1016 firmware - https://phabricator.wikimedia.org/T334259 (10BCornwall) Oh, and some of the older idrac firmware enforced :443 redirects, so an SSH tunnel on a different port would cause connectivity issues.  I worked around it by using socat:   ` socat TCP-LISTEN:443,fork TCP...