[07:07:31] <wikibugs_>	 10Traffic, 10MediaWiki-General-or-Unknown, 06Operations: Failure to save recent changes - https://phabricator.wikimedia.org/T150503#2810044 (10Marostegui) @Marshallsumter can this be closed then?
[08:30:27] <wikibugs>	 10Traffic, 10MediaWiki-General-or-Unknown, 06Operations: Failure to save recent changes - https://phabricator.wikimedia.org/T150503#2810098 (10elukey) 05stalled>03Resolved a:03elukey So we found several things to follow up, probably not on this task:  1) nginx proxy_request_buffering (already deployed...
[10:50:47] <wikibugs_>	 10Traffic, 10ArchCom-RfC, 06Commons, 10MediaWiki-File-management, and 14 others: Define an official thumb API - https://phabricator.wikimedia.org/T66214#2810289 (10Gilles) There is contradiction here. You want to serve what's best for the client "automatically", but you want the client to retain some contr...
[14:11:02] <ema>	 we finally got an answer to the vmod ticket: https://github.com/varnishcache/varnish-cache/issues/2041#issuecomment-261926671
[14:11:59] <ema>	 and also to the gethdr_extrachance pull request: https://github.com/varnishcache/varnish-cache/pull/2135#issuecomment-261927051
[14:19:46] <bblack>	 cool
[14:19:56] <bblack>	 I'm gonna response on the latter, I don't think he really gets what's going on here yet.
[14:44:41] <mark>	 bblack: so, wanna mark the goal as complete? https://www.mediawiki.org/wiki/Wikimedia_Engineering/2016-17_Q2_Goals#Technical_Operations
[14:55:51] <paravoid>	 bblack: did you see the mail to xff@ cc: dns-admin@?
[14:56:13] <paravoid>	 xff apparently goes only to Tim, we should probably fix that :)
[14:56:45] <paravoid>	 and I suppose there are two parts to updating entries to our XFF lists, one is the MW one and one is the varnish one
[15:14:13] <bblack>	 well, the varnish one is still zero-controlled
[15:15:23] <bblack>	 I don't see the email in my searches, what was the subject?
[15:16:00] <bblack>	 paravoid: ^ ?
[15:22:06] <paravoid>	 RE: Ticket#2016101010008997 Our organization is blocked from Wikipedia
[15:23:20] <bblack>	 I guess I'm not on dns-admin?
[15:24:20] <bblack>	 paravoid: can you just forward it?
[15:32:45] <bblack>	 paravoid: that's really for MediaWiki to deal with, if they want to add it to their (very long and not very well maintained) trusted-xff list.
[15:34:08] <bblack>	 paravoid: in general, we don't have a good trusted-xff list in varnish.  all we have is the Zero project's proxies database, which they administer, and which this probably doesn't belong in.  There's a ticket about moving that to metawiki for community maintenance and as a potential replacement for the MW-level XFF processing, but that never happened.
[15:34:48] <bblack>	 T89838
[15:34:49] <stashbot>	 T89838: Move proxy IP lists to META for Varnish XFF decoding - https://phabricator.wikimedia.org/T89838
[15:35:43] <bblack>	 basically nobody wants the Sisyphean task of actually trying to maintain a Trusted-XFF database :P
[15:39:18] <bblack>	 I wonder if someone should standardize a PKI type solution to that
[15:40:43] <bblack>	 anyways
[15:51:38] <wikibugs_>	 10Traffic, 10ArchCom-RfC, 06Commons, 10MediaWiki-File-management, and 14 others: Define an official thumb API - https://phabricator.wikimedia.org/T66214#2810806 (10GWicke) I don't see the search for the right granularity as a contradiction, but more as a search for the best set of trade-offs along a contin...
[16:02:57] <bblack>	 disabling puppet for a bit on caches
[16:03:06] <bblack>	 (since puppet compiler sucks at this kind of thing)
[16:06:15] <bblack>	 good thing, I didn't remember to change the ssl_stapling_file directies (not that it would've broken the site or anything, just puppetfail spam)
[16:32:10] <ema>	 I'm getting some secret()-related pcc errors: https://puppet-compiler.wmflabs.org/4621/cp1045.eqiad.wmnet/prod.cp1045.eqiad.wmnet.err 
[16:32:23] <ema>	 Error: secret(): invalid secret ssl/globalsign-2016-ecdsa-unified.key [...]
[16:33:51] <bblack>	 yeah
[16:34:05] <bblack>	 it's because the compiler doesn't pull the latest changes to that stuff
[16:34:27] <bblack>	 oh wait, it's also because I didn't "Submit" the change to the labs-private repo after +2 :P
[16:34:44] <bblack>	 submitted now, although I'm still not sure if it immediately pulls the new stuff for the compiler
[16:34:57] * ema wonders why that doesn't happen automatically
[16:35:05] <bblack>	 I donno
[16:35:11] <bblack>	 it used to! :)
[16:35:28] <bblack>	 anyways, try again, maybe it will work
[16:35:33] <ema>	 thanks
[16:37:33] <ema>	 it worked!
[16:37:36] <bblack>	 yay
[17:50:51] <wikibugs>	 10netops, 10DBA, 06Labs, 10Labs-Infrastructure, and 3 others: Move dbproxy1010 and dbproxy1011 to labs-support network, rename them to labsdbproxy1001 and labsdbproxy1002 - https://phabricator.wikimedia.org/T149170#2811283 (10Cmjohnson) I can move these to rack c5.  Can these be moved anytime or do they ne...
[18:19:54] <wikibugs_>	 10netops, 10DBA, 06Labs, 10Labs-Infrastructure, and 3 others: Move dbproxy1010 and dbproxy1011 to labs-support network, rename them to labsdbproxy1001 and labsdbproxy1002 - https://phabricator.wikimedia.org/T149170#2811430 (10jcrespo) They can be moved at any time, I will schedule downtime now on icinga.
[18:35:25] <wikibugs_>	 10Traffic, 10ArchCom-RfC, 06Commons, 10MediaWiki-File-management, and 14 others: Define an official thumb API - https://phabricator.wikimedia.org/T66214#2811471 (10Gilles) If you're looking for hardware acceleration/battery saving, JPG is probably your best bet. If you want the most lightweight file, then...