[08:53:25] 10Traffic, 10DNS, 6Labs: librarybase project cannot create a proxy for librarybase.wmflabs.org - https://phabricator.wikimedia.org/T131448#2167425 (10valhallasw) [09:05:33] 10Traffic, 6Operations, 13Patch-For-Review: varnishkafka logrotate cronspam - https://phabricator.wikimedia.org/T129344#2167546 (10elukey) Update: - rsyslog command has been updated to avoid cronspam - files/varnish/varnishkafka_rsyslog.conf has been moved from the puppet repo to the varnishkafka submodule... [09:19:23] 10netops, 10Continuous-Integration-Infrastructure, 6Operations, 10Phabricator, and 4 others: Make sure phab can talk to gearman and nodepool instances can talk to phabricator - https://phabricator.wikimedia.org/T131375#2167638 (10hashar) >>! In T131375#2165682, @mmodell wrote: > @hashar: I don't know how t... [10:29:17] 10Traffic, 6Analytics-Kanban, 6Operations, 13Patch-For-Review: varnishkafka integration with Varnish 4 for analytics - https://phabricator.wikimedia.org/T124278#2167924 (10elukey) Update: we added all the patches (mine + BBlack's) to the latest version of vk's deb package and installed it on cp1043/cp1044... [11:01:18] 10Traffic, 10Analytics, 10Datasets-General-or-Unknown, 6Operations, 13Patch-For-Review: http://dumps.wikimedia.org should redirect to https:// - https://phabricator.wikimedia.org/T128587#2167989 (10ArielGlenn) I'm sending mail to wikitech-l announcing that the switch will go live Monday (Apr 4). [11:18:55] 10Traffic, 10DNS, 6Labs, 6Operations: librarybase project cannot create a proxy for librarybase.wmflabs.org - https://phabricator.wikimedia.org/T131448#2168029 (10Harej) Stating for the record that `http://librarybase.wmflabs.org` worked just fine until today. [11:19:26] 10Traffic, 10DNS, 6Labs, 6Operations: librarybase project cannot create a proxy for librarybase.wmflabs.org - https://phabricator.wikimedia.org/T131448#2168030 (10Harej) p:5Triage>3Unbreak! [11:24:31] 10Traffic, 10DNS, 6Labs, 6Operations: librarybase project cannot create a proxy for librarybase.wmflabs.org - https://phabricator.wikimedia.org/T131448#2168047 (10Dereckson) @yuvipanda Is the priority of this task correctly asserted? [11:26:09] 10Traffic, 10DNS, 6Labs, 6Operations: librarybase project cannot create a proxy for librarybase.wmflabs.org - https://phabricator.wikimedia.org/T131448#2168049 (10Harej) I consider not being able to access Librarybase to be a production outage, the fact that is currently accessible from an alternate URL no... [11:30:14] 10Traffic, 10DNS, 6Labs, 6Operations: librarybase project cannot create a proxy for librarybase.wmflabs.org - https://phabricator.wikimedia.org/T131448#2168050 (10Harej) [11:47:43] 10Traffic, 10DNS, 6Labs, 6Operations: librarybase project cannot create a proxy for librarybase.wmflabs.org - https://phabricator.wikimedia.org/T131448#2168147 (10valhallasw) p:5Unbreak!>3Normal I'm sorry @harej, but given that this is a) labs (and therefore by definition not production) and b) there i... [12:00:16] 10Traffic, 10DNS, 6Labs, 6Operations: librarybase project cannot create a proxy for librarybase.wmflabs.org - https://phabricator.wikimedia.org/T131448#2168165 (10valhallasw) [12:07:19] 10Traffic, 10DNS, 6Labs, 6Operations: librarybase project cannot create a proxy for librarybase.wmflabs.org - https://phabricator.wikimedia.org/T131448#2168196 (10Krenair) 5Open>3Resolved a:3Krenair I've handled this specific case, the generic issue is T131367. Also, not a production outage, this is... [12:30:02] 10Traffic, 10DNS, 6Labs, 6Operations: librarybase project cannot create a proxy for librarybase.wmflabs.org - https://phabricator.wikimedia.org/T131448#2168396 (10BBlack) [12:47:05] 10Traffic, 6Analytics-Kanban, 6Operations: varnishkafka logrotate cronspam - https://phabricator.wikimedia.org/T129344#2168509 (10elukey) [12:52:43] 10Traffic, 6Operations, 13Patch-For-Review: Upgrade to Varnish 4: things to remember - https://phabricator.wikimedia.org/T126206#2168548 (10ema) [13:15:42] 10Traffic, 6Operations, 7Documentation: Update TLS/HTTP documentation on wikitech - https://phabricator.wikimedia.org/T96844#2168643 (10ema) [13:33:36] 10Traffic, 7Varnish, 6Operations, 13Patch-For-Review: Evaluate and Test Limited Deployment of Varnish 4 - https://phabricator.wikimedia.org/T122880#2168713 (10ema) [13:33:57] 10Traffic, 7Varnish, 6Operations: Install XKey vmod - https://phabricator.wikimedia.org/T122881#2168714 (10ema) [13:34:29] 10Traffic, 7Varnish, 6Operations, 13Patch-For-Review: Create separate packages for required vmods - https://phabricator.wikimedia.org/T124281#2168715 (10ema) [13:34:52] 10Traffic, 7Varnish, 6Operations, 13Patch-For-Review, and 2 others: Varnish support for shutting users out of a DC - https://phabricator.wikimedia.org/T129424#2168716 (10ema) [13:36:05] 10Traffic, 7Varnish, 6Operations, 13Patch-For-Review: cache_misc's misc_fetch_large_objects has issues - https://phabricator.wikimedia.org/T128813#2168732 (10ema) [13:36:43] 10Traffic, 7Varnish, 10Continuous-Integration-Infrastructure, 6Operations, 13Patch-For-Review: Make CI run Varnish VCL tests - https://phabricator.wikimedia.org/T128188#2168733 (10ema) [13:37:09] 10Traffic, 7Varnish, 10Analytics, 6Operations: Sort out analytics service dependency issues for cp* cache hosts - https://phabricator.wikimedia.org/T128374#2168736 (10ema) [13:37:20] 10Traffic, 7Varnish, 6Operations, 13Patch-For-Review: Upgrade to Varnish 4: things to remember - https://phabricator.wikimedia.org/T126206#2168737 (10ema) [13:37:32] 7HTTPS, 10Traffic, 7Varnish, 6Operations: Outbound HTTPS for varnish backend instances - https://phabricator.wikimedia.org/T109325#2168738 (10ema) [13:56:47] 10Traffic, 7Varnish, 6Operations: Uprade all cache clusters to Varnish 4 - https://phabricator.wikimedia.org/T131499#2168822 (10ema) [13:57:00] 10Traffic, 7Varnish, 6Operations: Uprade all cache clusters to Varnish 4 - https://phabricator.wikimedia.org/T131499#2168834 (10ema) p:5Triage>3Normal [13:57:29] 10Traffic, 7Varnish, 6Operations, 13Patch-For-Review: Upgrade to Varnish 4: things to remember - https://phabricator.wikimedia.org/T126206#2168836 (10ema) [13:57:31] 10Traffic, 7Varnish, 6Operations: Uprade all cache clusters to Varnish 4 - https://phabricator.wikimedia.org/T131499#2168822 (10ema) [13:57:44] 10Traffic, 7Varnish, 6Operations: Uprade all cache clusters to Varnish 4 - https://phabricator.wikimedia.org/T131499#2168822 (10ema) [13:57:46] 10Traffic, 7Varnish, 6Operations: Port remaining scripts depending on varnishlog.py to new VSL API - https://phabricator.wikimedia.org/T131353#2168838 (10ema) [13:58:36] 10Traffic, 7Varnish, 6Operations, 13Patch-For-Review: Upgrade to Varnish 4: things to remember - https://phabricator.wikimedia.org/T126206#2007434 (10ema) [13:58:38] 10Traffic, 7Varnish, 6Operations, 13Patch-For-Review: Evaluate and Test Limited Deployment of Varnish 4 - https://phabricator.wikimedia.org/T122880#2168839 (10ema) [13:58:59] 10Traffic, 7Varnish, 6Operations: Install XKey vmod - https://phabricator.wikimedia.org/T122881#2168842 (10ema) [13:59:01] 10Traffic, 7Varnish, 6Operations: Uprade all cache clusters to Varnish 4 - https://phabricator.wikimedia.org/T131499#2168822 (10ema) [14:01:00] 10Traffic, 7Varnish, 6Operations: Convert misc cluster to Varnish 4 - https://phabricator.wikimedia.org/T131501#2168861 (10ema) [14:01:37] 10Traffic, 7Varnish, 6Operations: Convert upload cluster to Varnish 4 - https://phabricator.wikimedia.org/T131502#2168876 (10ema) [14:01:39] 10Traffic, 6Operations, 10Phabricator, 7Blocked-on-Operations: Phabricator needs to expose notification daemon (websocket) - https://phabricator.wikimedia.org/T112765#2168889 (10chasemp) >>! In T112765#2166588, @greg wrote: >>>! In T112765#1822062, @chasemp wrote: >> We need to make a plan to get connectiv... [14:02:07] 10Traffic, 7Varnish, 6Operations: Convert text cluster to Varnish 4 - https://phabricator.wikimedia.org/T131503#2168895 (10ema) [14:03:18] 10Traffic, 7Varnish, 6Operations: Install XKey vmod - https://phabricator.wikimedia.org/T122881#2168925 (10ema) [14:03:21] 10Traffic, 7Varnish, 6Operations: Uprade all cache clusters to Varnish 4 - https://phabricator.wikimedia.org/T131499#2168924 (10ema) [14:04:55] 10Traffic, 7Varnish, 6Operations: Uprade all cache clusters to Varnish 4 - https://phabricator.wikimedia.org/T131499#2168822 (10ema) a:3ema [14:05:32] 10Traffic, 7Varnish, 6Operations: Uprade all cache clusters to Varnish 4 - https://phabricator.wikimedia.org/T131499#2168929 (10ema) [14:05:34] 10Traffic, 7Varnish, 6Operations, 13Patch-For-Review: Evaluate and Test Limited Deployment of Varnish 4 - https://phabricator.wikimedia.org/T122880#2168930 (10ema) [14:05:36] 7Varnish, 10MediaWiki-API: Evaluate the feasibility of cache invalidation for the action API - https://phabricator.wikimedia.org/T122867#2168928 (10ema) [14:05:54] 10Traffic, 7Varnish, 6Operations: Uprade all cache clusters to Varnish 4 - https://phabricator.wikimedia.org/T131499#2168822 (10ema) [14:05:56] 10Traffic, 7Varnish, 6Operations: Install XKey vmod - https://phabricator.wikimedia.org/T122881#2168932 (10ema) [14:05:59] 10Traffic, 7Varnish, 6Operations, 13Patch-For-Review: Evaluate and Test Limited Deployment of Varnish 4 - https://phabricator.wikimedia.org/T122880#1916092 (10ema) [14:06:17] 10Traffic, 7Varnish, 6Operations: Uprade all cache clusters to Varnish 4 - https://phabricator.wikimedia.org/T131499#2168822 (10ema) [14:06:20] 10Traffic, 7Varnish, 6Operations, 13Patch-For-Review: Evaluate and Test Limited Deployment of Varnish 4 - https://phabricator.wikimedia.org/T122880#1916092 (10ema) [22:33:10] 7HTTPS, 10Traffic, 6Operations, 10Wiki-Loves-Monuments-General: configure https for www.wikilovesmonuments.org - https://phabricator.wikimedia.org/T118388#1798950 (10JeanFred) Ok, so what needs to be done here? cc @Multichill [22:41:22] 7HTTPS, 10Traffic, 6Operations, 10Wikimedia-Fundraising, 13Patch-For-Review: delete links.email.donate.wikimedia.org (and all other email.donate.*?) from DNS - https://phabricator.wikimedia.org/T130414#2170841 (10Dzahn) @CCogdill_WMF Sorry, i didn't get to this yet and now it's Friday again and i will b... [22:42:57] 7HTTPS, 10Traffic, 6Operations, 10Wikimedia-Fundraising, 13Patch-For-Review: delete links.email.donate.wikimedia.org (and all other email.donate.*?) from DNS - https://phabricator.wikimedia.org/T130414#2170843 (10CCogdill_WMF) No problem, thanks for keeping me updated @Dzahn. Have a nice vacation! [22:56:20] 7HTTPS, 10Traffic, 6Operations, 10Wiki-Loves-Monuments-General: configure https for www.wikilovesmonuments.org - https://phabricator.wikimedia.org/T118388#2170873 (10Dzahn) @JeanFred a WMNL and a WMDE server admin need to work together to fix it [22:57:41] 7HTTPS, 10Traffic, 10Wiki-Loves-Monuments-General: configure https for www.wikilovesmonuments.org - https://phabricator.wikimedia.org/T118388#2170874 (10Krenair) [23:18:31] 10netops, 6Operations: create a test for multicast relay - https://phabricator.wikimedia.org/T82038#2170945 (10Dzahn)