[01:20:34] 10netops, 10Operations, 10ops-eqiad: Replace eqiad mgmt switches with EX4200s - https://phabricator.wikimedia.org/T213128 (10ayounsi) This is fine, I only need 1 for tests, once in prod they can do without. [08:32:26] hello people :) [08:32:51] I have a question about the svc.eqiad.wmnet domains, and how they should be used in the DNS repo [08:33:27] I have a use case that I am discussing with Data Persistence, namely how to name some aliases for Analytics DB hosts [08:34:12] for example, we'd need to have a CNAME like s1-analytics.replica.svc.eqiad.wmnet that points to dbstore1003 [08:34:27] is it the right name or maybe something like s1-analytics.eqiad.wmnet is better? [08:34:56] I didn't find any convention writtend down in wikitech, so I am wondering if there is one [08:35:08] ideally .svc.eqiad.wmnet in my head are LVS IPs [08:35:24] but I might be wrong :) [09:21:20] 10Certcentral, 10Traffic, 10Operations, 10Goal: Deploy managed LetsEncrypt certs for all public use-cases - https://phabricator.wikimedia.org/T213705 (10Vgutierrez) [09:21:22] 10Certcentral: Avoid inter-hosts puppet dependencies on certificate deployment - https://phabricator.wikimedia.org/T213301 (10Vgutierrez) 05Open→03Resolved [09:22:46] 10Traffic, 10Analytics, 10Operations, 10Performance-Team: Only serve debug HTTP headers when x-wikimedia-debug is present - https://phabricator.wikimedia.org/T210484 (10Gilles) [11:19:50] 10Traffic, 10Operations, 10Performance-Team, 10media-storage: Automatically clean up unused thumbnails in Swift - https://phabricator.wikimedia.org/T211661 (10Gilles) I've looked at bloomd's capabilities and it doesn't have a concept of things expiring, which makes sense given the nature of a bloom filter.... [14:08:40] Krenair: hi! please take a look to https://gerrit.wikimedia.org/r/c/operations/software/certcentral/+/485594 wherever possible [15:09:55] 10Traffic, 10MobileFrontend, 10Operations, 10Readers-Web-Backlog (Tracking): Remove .m. subdomain, serve mobile and desktop variants through the same URL - https://phabricator.wikimedia.org/T214998 (10pmiazga) [15:32:56] vgutierrez, ok [15:34:47] thx [16:12:20] 10Traffic, 10Operations, 10ops-codfw, 10Patch-For-Review: rack/setup/install LVS200[7-10] - https://phabricator.wikimedia.org/T196560 (10Vgutierrez) So, the NIC issue reported in T203194 seems to be fixed after upgrading the NIC firmware to version 21.40 (https://www.dell.com/support/home/us/en/04/drivers/... [16:14:34] elukey: yeah, .svc. are internal LVS IPs [16:19:02] XioNoX: super, at the end I used a different solution, but good to know :) [16:35:22] elukey: we have a couple of "abuse" of discovery entries for similar use cases fwiw [16:35:50] ahahahah [16:37:37] Smart use of router's parental control to block ads : https://www.reddit.com/r/privacy/comments/3tz3ph/blocking_most_advertising_servers_via_factory/ [18:21:06] 10Traffic, 10Operations, 10Performance-Team, 10media-storage: Automatically clean up unused thumbnails in Swift - https://phabricator.wikimedia.org/T211661 (10ori) What orders of magnitude are we talking about with respect to: total number of thumbnails in Swift, and number of thumbnail requests per second? [18:39:04] 10Traffic, 10Operations, 10Performance-Team, 10media-storage: Automatically clean up unused thumbnails in Swift - https://phabricator.wikimedia.org/T211661 (10ori) It seems that Swift has [[ https://docs.openstack.org/swift/latest/api/object-expiration.html | built-in support for object expiration ]], whic... [19:05:23] 10Traffic, 10Operations, 10Performance-Team, 10media-storage: Automatically clean up unused thumbnails in Swift - https://phabricator.wikimedia.org/T211661 (10Gilles) This hadn't been considered because I didn't know that feature existed... Checking on the production Swift servers, swift-object-expirer isn... [19:07:23] 10Traffic, 10Operations, 10Performance-Team, 10media-storage: Automatically clean up unused thumbnails in Swift - https://phabricator.wikimedia.org/T211661 (10Gilles) Well, seems to have been that simple all along: https://packages.debian.org/jessie-backports/swift-object-expirer [19:12:22] 10Traffic, 10Operations, 10Performance-Team, 10media-storage: Automatically clean up unused thumbnails in Swift - https://phabricator.wikimedia.org/T211661 (10Gilles) For setting it on X% of access, preferably async, we'll just need a little logic to check that the thumbnail has a corresponding original. O... [19:22:39] 10Traffic, 10Operations, 10Performance-Team, 10media-storage: Automatically clean up unused thumbnails in Swift - https://phabricator.wikimedia.org/T211661 (10ori) (It might have to be X% of access //on varnish//, since I assume the most oft-requested thumbnails enjoy a very high varnish cache hit rate. Yo... [19:25:07] 10Traffic, 10Operations, 10Performance-Team, 10media-storage: Automatically clean up unused thumbnails in Swift - https://phabricator.wikimedia.org/T211661 (10Gilles) We discussed this a bunch and we believe that basing this on Swift access alone with an expiry of a month is fine. The hottest things can't... [19:52:04] 10Traffic, 10Operations, 10Performance-Team, 10media-storage: Automatically clean up unused thumbnails in Swift - https://phabricator.wikimedia.org/T211661 (10ori) The worry I had was this: a thumbnail that is requested once a minute on average probably has an approximately similar varnish cache hit rate t... [22:12:06] 10Traffic, 10MobileFrontend, 10Operations, 10Readers-Web-Backlog (Tracking): Remove .m. subdomain, serve mobile and desktop variants through the same URL - https://phabricator.wikimedia.org/T214998 (10Jdlrobson) Thanks for raising this. This is clearly not something we ever got satisfyingly right and clear... [22:49:48] 10Traffic, 10MobileFrontend, 10Operations, 10Readers-Web-Backlog (Tracking): Remove .m. subdomain, serve mobile and desktop variants through the same URL - https://phabricator.wikimedia.org/T214998 (10Tgr) Re: SEO, Google's [[https://developers.google.com/search/mobile-sites/mobile-seo/|Mobile SEO Overview... [22:57:22] 10netops, 10Operations, 10fundraising-tech-ops: Deploy pfw policy to allow https to frmon.frdev.wikimedia.org - https://phabricator.wikimedia.org/T215364 (10cwdent) [22:58:35] 10netops, 10Operations, 10fundraising-tech-ops: Deploy pfw policy to allow https to frmon.frdev.wikimedia.org - https://phabricator.wikimedia.org/T215364 (10cwdent) [23:03:03] 10Traffic, 10MobileFrontend, 10Operations, 10Readers-Web-Backlog (Tracking): Remove .m. subdomain, serve mobile and desktop variants through the same URL - https://phabricator.wikimedia.org/T214998 (10tstarling) It complicates SEO in the sense that, when I wrote this task, I was looking at Google Search Co...