[00:53:43] 10Traffic, 10Incident-20160126-WikimediaDomainRedirection, 6operations, 7Documentation: Automate and/or better-document varnish ban procedure for operations staff, so it can be accomplished with more speed and confidence in outage conditions - https://phabricator.wikimedia.org/T124835#1968281 (10BBlack) I'... [01:53:49] bblack: are you up for pushing the testwiki change? [02:26:42] ori: I can tomorrow [04:08:26] sweet [04:08:28] thanks! [08:32:59] 7Varnish, 10Fundraising-Backlog, 10MediaWiki-extensions-CentralNotice, 10Wikimedia-Fundraising, and 3 others: [EPIC] Special:RecordImpression should be used at a very low sample rate - https://phabricator.wikimedia.org/T45250#1968705 (10ori) If fr-tech plans to dedicate a sprint to reduce the rate at which... [08:33:52] 7Varnish, 10Fundraising-Backlog, 10MediaWiki-extensions-CentralNotice, 10Wikimedia-Fundraising, and 3 others: Replace or redo Special:RecordImpression - https://phabricator.wikimedia.org/T45250#1968707 (10ori) [10:04:04] 10Wikimedia-Apache-configuration: Use gzip transfer encoding for SVG files on bits.wikimedia.org - https://phabricator.wikimedia.org/T63442#1968895 (10matej_suchanek) [10:11:03] 10Wikimedia-Apache-configuration, 7Testme: Use gzip transfer encoding for SVG files on bits.wikimedia.org - https://phabricator.wikimedia.org/T63442#1968961 (10matej_suchanek) [10:47:32] 10Wikimedia-Apache-configuration, 10netops, 10Incident-20160126-WikimediaDomainRedirection, 6operations: All wikis under wikimedia.org (Meta, Commons, loginwiki, others) are redirecting to wikimediafoundation.org - https://phabricator.wikimedia.org/T124804#1969049 (10Aklapper) >>! In T124804#1968040, @TheD... [11:54:47] 10Traffic, 6operations: update the multicast purging documentation - https://phabricator.wikimedia.org/T82096#1969329 (10hashar) Great, thank you @BBlack [12:00:54] 10Traffic, 10Incident-20160126-WikimediaDomainRedirection, 6operations, 7Documentation: Automate and/or better-document varnish ban procedure for operations staff, so it can be accomplished with more speed and confidence in outage conditions - https://phabricator.wikimedia.org/T124835#1969361 (10BBlack) 5... [14:13:35] 10Traffic, 10Graphoid, 6Services, 6operations: Remove graphoid from parsoidcache - https://phabricator.wikimedia.org/T110477#1969647 (10BBlack) I'm doing some final validation now (checking request logs for any trailing requests to these hostnames). Will upload the changes to remove this, but not merge ye... [14:18:33] 10Traffic, 10ContentTranslation-cxserver, 6Services, 6operations: Remove cxserver from parsoidcache cluster - https://phabricator.wikimedia.org/T110478#1969652 (10BBlack) FYI, I'm still seeing live requests to the cxserver public hostnames on cache_parsoid, e.g. ``` 32 RxURL c /v1/dictionary/rec... [14:22:48] 10Traffic, 10RESTBase, 6Services, 6operations: Remove restbase from parsoidcache - https://phabricator.wikimedia.org/T110475#1969654 (10BBlack) The problem with the redirect is it's complicated, because we still have this conflict between internal and external RB URLs due to the whole `Host:` header vs `/h... [15:07:37] 10Traffic, 10RESTBase, 6Services, 6operations: Remove restbase from parsoidcache - https://phabricator.wikimedia.org/T110475#1969780 (10BBlack) Well, the other thing I can do to make this simple is just treat it like the legacy citoid/cxserver entrypoints: if it's one of the legacy restbase hostnames, just... [15:13:30] 10Traffic, 10ContentTranslation-cxserver, 6Services, 6operations, 5Patch-For-Review: Remove cxserver from parsoidcache cluster - https://phabricator.wikimedia.org/T110478#1969808 (10Nikerabbit) >>! In T110478#1965406, @BBlack wrote: > Does that imply that **nothing** should be using the hostnames `cxserv... [15:22:20] 10Traffic, 10ContentTranslation-cxserver, 6Services, 6operations, 5Patch-For-Review: Remove cxserver from parsoidcache cluster - https://phabricator.wikimedia.org/T110478#1969829 (10BBlack) Ok. I was under the impression that as part of some eventual plan, the CX extensions would switch to using public... [15:29:55] 10Traffic, 10ContentTranslation-cxserver, 6Services, 6operations, 5Patch-For-Review: Remove cxserver from parsoidcache cluster - https://phabricator.wikimedia.org/T110478#1969853 (10akosiaris) >>! In T110478#1969829, @BBlack wrote: > Ok. I was under the impression that as part of some eventual plan, the... [15:33:34] 10Traffic, 10ContentTranslation-cxserver, 6Services, 6operations, 5Patch-For-Review: Remove cxserver from parsoidcache cluster - https://phabricator.wikimedia.org/T110478#1969870 (10BBlack) @akosiaris - we're talking about two different parts of the problem. Regardless of whether/how cxserver's app code... [15:37:38] 10Traffic, 10ContentTranslation-cxserver, 6Services, 6operations, 5Patch-For-Review: Remove cxserver from parsoidcache cluster - https://phabricator.wikimedia.org/T110478#1969876 (10akosiaris) >>! In T110478#1969870, @BBlack wrote: > @akosiaris - we're talking about two different parts of the problem. R... [16:05:05] 10Traffic, 10ContentTranslation-cxserver, 6Services, 6operations, 5Patch-For-Review: Remove cxserver from parsoidcache cluster - https://phabricator.wikimedia.org/T110478#1969978 (10GWicke) The last time we talked about moving the CXServer API to RB the issue was that some of those APIs are really not re... [16:08:20] 10Traffic, 10ContentTranslation-cxserver, 6Services, 6operations, 5Patch-For-Review: Remove cxserver from parsoidcache cluster - https://phabricator.wikimedia.org/T110478#1969991 (10BBlack) @gwicke no need for the stopgap, we'll just keep doing traffic pass-through of cxserver.wikimedia.org for now (but... [16:09:32] 10Traffic, 10ContentTranslation-cxserver, 6Services, 6operations, 5Patch-For-Review: Remove cxserver from parsoidcache cluster - https://phabricator.wikimedia.org/T110478#1969995 (10GWicke) @bblack: Okay, thanks! [16:25:59] 7Varnish, 10Fundraising-Backlog, 10MediaWiki-extensions-CentralNotice, 10Wikimedia-Fundraising, and 3 others: Replace or redo Special:RecordImpression - https://phabricator.wikimedia.org/T45250#1970035 (10DStrine) @awight @AndyRussG pining you directly for comments. [18:59:25] 7Varnish, 10Fundraising-Backlog, 10MediaWiki-extensions-CentralNotice, 10Wikimedia-Fundraising, and 3 others: Replace or redo Special:RecordImpression - https://phabricator.wikimedia.org/T45250#1970655 (10awight) Oh hi! Sure, the current title is a good summary of what we'd like to do. A low sample rate... [19:34:31] 10Traffic, 6operations: Decrease max object TTL in varnishes - https://phabricator.wikimedia.org/T124954#1970940 (10BBlack) 3NEW [19:57:17] 10Wikimedia-Apache-configuration, 10netops, 10Incident-20160126-WikimediaDomainRedirection, 6operations: All wikis under wikimedia.org (Meta, Commons, loginwiki, others) are redirecting to wikimedia.org - https://phabricator.wikimedia.org/T124804#1971095 (10Krenair) [20:03:23] 10Wikimedia-Apache-configuration, 10netops, 10Incident-20160126-WikimediaDomainRedirection, 6operations: All wikis under wikimedia.org (Meta, Commons, loginwiki, others) are using wikimedia.org VHost, including /wiki/ -> wikimediafoundation.org redirect - https://phabricator.wikimedia.org/T124804#1971105 (1... [20:03:54] 10netops, 10Analytics-Cluster, 6operations, 5codfw-rollout, 3codfw-rollout-Jan-Mar-2016: stat1002 - redis can't connect to mira.codfw.wmnet - https://phabricator.wikimedia.org/T124955#1971110 (10Dzahn) [20:05:07] 10netops, 10Analytics-Cluster, 6operations, 5codfw-rollout, 3codfw-rollout-Jan-Mar-2016: stat1002 - redis can't connect to mira.codfw.wmnet - https://phabricator.wikimedia.org/T124955#1971121 (10Ottomata) Yeah, makes sense! stat1002 is in the Analytics VLAN, so a rule will need to be opened up in the VL... [20:15:44] 10netops, 10Analytics-Cluster, 6operations, 5codfw-rollout, 3codfw-rollout-Jan-Mar-2016: stat1002 - redis can't connect to mira.codfw.wmnet - https://phabricator.wikimedia.org/T124955#1971162 (10Dzahn) fixed by @Faidon , thanks! -- confirmed working now: Package[wikimedia/discovery/analytics]/ensure:... [20:16:02] 10netops, 10Analytics-Cluster, 6operations, 5codfw-rollout, 3codfw-rollout-Jan-Mar-2016: stat1002 - redis can't connect to mira.codfw.wmnet - https://phabricator.wikimedia.org/T124955#1971166 (10Dzahn) 5Open>3Resolved a:3Dzahn [20:48:14] 10Wikimedia-Apache-configuration, 10netops, 10Incident-20160126-WikimediaDomainRedirection, 6operations: All wikis under wikimedia.org (Meta, Commons, loginwiki, others) are using wikimedia.org VHost, including /wiki/ -> wikimediafoundation.org redirect - https://phabricator.wikimedia.org/T124804#1971299 (1... [20:51:08] 10Wikimedia-Apache-configuration, 10netops, 10Incident-20160126-WikimediaDomainRedirection, 6operations, 5Patch-For-Review: All wikis under wikimedia.org (Meta, Commons, loginwiki, others) are using wikimedia.org VHost, including /wiki/ -> wikimediafounda... - https://phabricator.wikimedia.org/T124804#1971323 [20:51:16] 10Wikimedia-Apache-configuration, 10netops, 10Incident-20160126-WikimediaDomainRedirection, 6operations: All wikis under wikimedia.org (Meta, Commons, loginwiki, others) are using wikimedia.org VHost, including /wiki/ -> wikimediafoundation.org redirect - https://phabricator.wikimedia.org/T124804#1971326 (1...