[03:31:19] heyyy quick question, is there doc on setting up a local Varnish in a config similar to the wmf cluster, for local development purposes? [03:32:46] I see a vagrant "varnish" role but no Docker recipe [03:33:07] btw this is not for official work for the engineering team I'm on, just a personal project at this point [07:50:44] 10Domains, 10Traffic, 10Okapi, 10SRE: Add enterprise subdomain for OKAPI - https://phabricator.wikimedia.org/T276585 (10Aklapper) [09:18:09] 10netops, 10SRE, 10Patch-For-Review: Auhoritative ports list - https://phabricator.wikimedia.org/T277146 (10Joe) FWIW, the document on wikitech is not authoritative - `service::catalog` in hiera is. [12:10:41] 10netops: Higher latency on Lumen eqiad/esams link - https://phabricator.wikimedia.org/T277654 (10ayounsi) p:05Triage→03Medium [19:00:35] ema hi! ^ ? any tips on creating a local dev setup for Varnish similar to prod? Note this is not for an official approved work task, currently just a personal, currently volunteer, project I'm trying :) [19:00:46] thx in advance! [19:03:31] gilles bd808 marxarelli ^ [19:15:08] AndyRussG: There is an aging mw-vagrant role for it. I think that was from work gilles was doing on thumbor (or pre-thumbor prep) [19:17:45] bd808: right I did see the role [19:17:51] so that's the first thing to try? [19:17:53] thx btw! [19:18:32] I don't know if it is the best thing, but its the one I know exists ;) [19:19:22] I think my "test plan" for the small number of vcl patches I've written is adding b.black as the reviewer [19:19:42] ahh okok right [19:20:15] bd808: yeah sorry for the bother, I was just looking for whom to ping and saw you'd reviewed a few puppet varnish tings [19:20:18] *things [19:21:01] no worries! I wish I had more fun things to point you to [19:21:20] bd808 I guess another option would be to try using a Docker Varnish image, like say https://hub.docker.com/_/varnish [19:21:38] and then try to place there a config similar to what we have on prod, based on the prod puppet repo [19:22:16] recently I've been hating on vagrant a bit [19:22:33] possibly. I know that at one point in the past our varnish package was unique in the universe, but I haven't followed that saga for a few years now [19:23:00] ahhh hmmm interesting [19:23:52] b.black used to manage a 3-4 way merge of various FOSS forks with the open core upstream to get us features that upstream wanted $$$ for [19:24:23] bwahhh well that's kinda insane heheh [19:24:28] That was at least a small part of the motivation for trying out ATS [19:26:26] bd808 btw thx so much... ahh hmmm right... so in this patch for prod puppet I see some varnish config referred... I guess I could follow breadcrumbs there: https://gerrit.wikimedia.org/r/c/operations/puppet/+/561881 [19:28:05] basically what I want to try out is a test of some simple ESI or something similar, to inject a differently-cached object at a specific point in the base html on the outermost cache layer [19:28:30] bd808: again this is for a personal project, so pls don't waste time answering much here if you're busy........ ;p [19:29:30] (I have spoken to b.black previously and pinged earlier, I think he's out tho...) [19:30:14] if your project is not destined for the wikimedia network, then docker for testing is probably a reasonable way to go. I actually don't know much at all about how varnish does what it does. I'm a cargo cult contributor at best to vcl rules. [19:31:27] https://github.com/wikimedia/puppet/tree/production/modules/varnish/files and https://github.com/wikimedia/puppet/tree/production/modules/varnish/templates may provide you some inspiration [19:31:34] bd808 right... welp it would potentially be destined for WMF prod, that is the idea behind it, but it's not approved as a work project [19:31:53] ah cool! [19:32:05] in any case Docker sounds like much more fun than Vagrant [19:33:01] I know that there has been discussion and hopes for edge templating in the past, but b.black and e.ma would be much better advisors on what the blockers have been [19:33:19] yeah [19:33:44] I did find old discussions (an old RFC and Phab task) but couldn't fine anything recent [19:35:03] I think Gabriel was the last vocal and persistent champion for the feature, and then the ATS work probably cooled others off on moving the idea forward again until the edge settled down [19:35:14] ah right [22:04:32] 10Traffic, 10SRE, 10Wikimedia-General-or-Unknown, 10User-DannyS712, 10affects-Kiwix-and-openZIM: Pages whose title ends with semicolon (;) are intermittently inaccessible (likely due to ATS) - https://phabricator.wikimedia.org/T238285 (10valerio.bozzolan)