[05:56:39] 10Wikimedia-Apache-configuration, 10Wikimedia-Site-requests, 06Wikisource, 07Community-consensus-needed, 13Patch-For-Review: Move oldwikisource on www.wikisource.org to mul.wikisource.org - https://phabricator.wikimedia.org/T64717#2221748 (10Billinghurst) I wonder whether @Deskana has any comment to add... [07:32:12] 10Traffic, 06Operations, 10RESTBase, 06Services: Decom legacy ex-parsoidcache cxserver, citoid, and restbase service hostnames - https://phabricator.wikimedia.org/T133001#2216638 (10mobrovac) `citoid.wm.org` and `cxserver.wm.org` are still being actively and officially used, as we haven't put them behind R... [07:32:34] 10Traffic, 10Citoid, 10ContentTranslation-cxserver, 06Operations, and 3 others: Decom legacy ex-parsoidcache cxserver, citoid, and restbase service hostnames - https://phabricator.wikimedia.org/T133001#2221836 (10mobrovac) [08:56:06] 10Traffic, 10domains, 06Operations, 06WMF-Legal: Register nlwikipedia.org to prevent squatting - https://phabricator.wikimedia.org/T128968#2221900 (10Multichill) Ok. Can someone please update the list of squatted domain list and close this task? We failed. [08:57:45] 07Varnish, 10Analytics-EventLogging, 06Operations, 10RESTBase, and 2 others: RESTBase should handle the X-Analytics header - https://phabricator.wikimedia.org/T133139#2221908 (10mobrovac) [09:54:28] 10Traffic, 10netops, 06Operations: Consider per-route DCTCP for dc-local traffic on jessie hosts - https://phabricator.wikimedia.org/T128377#2222236 (10akosiaris) p:05Triage>03Low [09:55:02] 10Traffic, 10MediaWiki-Uploading, 06Multimedia, 06Operations, 10Wikimedia-Video: Uploading 1.2GB ogv results in 503 - https://phabricator.wikimedia.org/T128358#2222240 (10akosiaris) p:05Triage>03Normal [10:01:18] 10netops, 10Monitoring, 06Operations, 10Scap3 (Scap3-Adoption-Phase1): Deploy libreNMS with scap3 - https://phabricator.wikimedia.org/T129136#2222353 (10akosiaris) p:05Triage>03Normal [10:06:08] 10Traffic, 06Operations: Images not showing up at Commons - https://phabricator.wikimedia.org/T128961#2091362 (10akosiaris) Anything else left to do here ? Or can we close this one ? [11:13:56] 10Traffic, 10domains, 06Operations, 13Patch-For-Review: wikiknihy.cz - transfer to Wikimedia Czech Republic? - https://phabricator.wikimedia.org/T127573#2222704 (10akosiaris) p:05Triage>03Normal [11:17:00] 10Traffic, 06Operations, 10media-storage, 13Patch-For-Review: don't serve upload.wikimedia.org 'root' from wmfrewrite/swift - https://phabricator.wikimedia.org/T130709#2222712 (10akosiaris) p:05Triage>03Normal [11:17:18] 07HTTPS, 10Traffic, 06Operations, 13Patch-For-Review: enable https for (ubuntu|apt|mirrors).wikimedia.org - https://phabricator.wikimedia.org/T132450#2222713 (10akosiaris) p:05Triage>03Normal [11:19:27] 07HTTPS, 10Traffic, 06Operations, 13Patch-For-Review: Sort out letsencrypt puppetization for simple public hosts - https://phabricator.wikimedia.org/T132812#2222720 (10akosiaris) p:05Triage>03Normal [11:19:44] 10Traffic, 06Operations, 13Patch-For-Review: Host rewrite for /static/ not applied to purges - https://phabricator.wikimedia.org/T130904#2222721 (10akosiaris) p:05Triage>03Normal [11:26:33] 10Traffic, 07Varnish, 06Operations, 13Patch-For-Review: Solve large-object/stream/pass/chunked in our shared VCL - https://phabricator.wikimedia.org/T131761#2222731 (10akosiaris) p:05Triage>03Normal [11:36:06] 10Traffic, 06Operations: Something in WMF infrastructure corrupts responses with certain lengths - https://phabricator.wikimedia.org/T132159#2222764 (10akosiaris) p:05Triage>03High Triaging as high in case this is more widespread. Adding traffic and subscribers as well [13:01:05] 10Traffic, 06Operations: Images not showing up at Commons - https://phabricator.wikimedia.org/T128961#2223095 (10BBlack) 05Open>03Resolved a:03BBlack Close-able AFAIK, we did fix this in the general case for all cache clusters (un-proxying the request, normalizing the cast of the request hostname, stripp... [13:07:08] 10Traffic, 06Operations, 10media-storage, 13Patch-For-Review: don't serve upload.wikimedia.org 'root' from wmfrewrite/swift - https://phabricator.wikimedia.org/T130709#2223164 (10BBlack) 05Open>03Resolved a:03BBlack [13:07:11] 10Traffic, 06Operations, 06Performance-Team, 13Patch-For-Review: Support HTTP/2 - https://phabricator.wikimedia.org/T96848#2223163 (10elukey) Nginx 1.9.15 Changes: ``` *) Bugfix: "recv() failed" errors might occur when using HHVM as a FastCGI server. *) Bugfix: when using HTTP/2 and the "... [13:34:30] 10Traffic, 10ArchCom-RfC, 10Architecture, 10Incident-20150423-Commons, and 6 others: RFC: Re-evaluate varnish-level request-restart behavior on 5xx - https://phabricator.wikimedia.org/T97206#2223365 (10BBlack) 05Open>03Resolved We haven't seen any movement on this ticket in months, and AFAIK varnishes... [13:37:45] 10Traffic, 06Operations, 13Patch-For-Review: Host rewrite for /static/ not applied to purges - https://phabricator.wikimedia.org/T130904#2223402 (10BBlack) Note, there is a script to work around this on deployment of /static/ stuff, on the deployment hosts. But we should still circle back around and fix thi... [13:40:58] 10Traffic, 07Varnish, 06Operations, 13Patch-For-Review: Solve large-object/stream/pass/chunked in our shared VCL - https://phabricator.wikimedia.org/T131761#2223427 (10BBlack) Note: the work in T128813 looks pretty good, and is probably the general pattern we should follow, especially as clusters move to V... [13:42:26] 10Traffic, 07Varnish, 06Operations, 13Patch-For-Review: Solve large-object/stream/pass/chunked in upload cluster better - https://phabricator.wikimedia.org/T131761#2223434 (10BBlack) [13:42:38] 10Traffic, 07Varnish, 06Operations, 13Patch-For-Review: Solve large-object/stream/pass/chunked in upload cluster better - https://phabricator.wikimedia.org/T131761#2177610 (10BBlack) [13:42:40] 10Traffic, 07Varnish, 06Operations: Convert upload cluster to Varnish 4 - https://phabricator.wikimedia.org/T131502#2223437 (10BBlack) [13:46:00] 10Traffic, 06Operations, 06Performance-Team, 13Patch-For-Review: Support HTTP/2 - https://phabricator.wikimedia.org/T96848#2223470 (10BBlack) I backported some of that to our tentative 1.9.14-1+wmf1, but yeah we'll want the rest of the HTTP/2 fixes that have landed since in 1.9.15. Note debian now has the... [13:59:52] 10Traffic, 06Operations: Move californium to an internal host? - https://phabricator.wikimedia.org/T133149#2223542 (10BBlack) [13:59:58] 10Traffic, 10Continuous-Integration-Infrastructure, 06Operations: Move gallium to an internal host? - https://phabricator.wikimedia.org/T133150#2223557 (10BBlack) [15:06:27] 10Traffic, 10Analytics, 10DNS, 06Operations: Create analytics.wikimedia.org - https://phabricator.wikimedia.org/T132407#2223733 (10Nuria) @BBlack: let us know if you think we can proceed with this and whether fab is an acceptable way to deploy [15:06:38] 10Traffic, 10Continuous-Integration-Infrastructure, 06Operations: Move gallium to an internal host? - https://phabricator.wikimedia.org/T133150#2223557 (10Dzahn) it's also running Jenkins. added Hashar to answer if it need the public IP. also see T95757 [15:07:31] 10Traffic, 06Labs, 10Labs-Infrastructure, 06Operations: Move californium to an internal host? - https://phabricator.wikimedia.org/T133149#2223741 (10Dzahn) [15:07:54] 10Traffic, 06Labs, 10Labs-Infrastructure, 06Operations: Move californium to an internal host? - https://phabricator.wikimedia.org/T133149#2223744 (10Dzahn) @Andrew Does the horizon host need the public IP ? [15:11:14] 10Traffic, 10domains, 06Operations, 06WMF-Legal: Register nlwikipedia.org to prevent squatting - https://phabricator.wikimedia.org/T128968#2223762 (10Dzahn) Which list of squatted domains are you referring to? [15:17:18] 10Traffic, 06Operations, 10media-storage, 13Patch-For-Review: don't serve upload.wikimedia.org 'root' from wmfrewrite/swift - https://phabricator.wikimedia.org/T130709#2223769 (10fgiunchedi) 05Resolved>03Open a:05BBlack>03fgiunchedi reopening since we've redirected the homepage which fixed the orig... [15:18:12] 10Traffic, 10Analytics, 10DNS, 06Operations: Create analytics.wikimedia.org - https://phabricator.wikimedia.org/T132407#2223774 (10BBlack) I really have no idea about the fab deployment method (whether it's ok, how we automate it and grant access, where it's fetching data from, etc), or how/when we're goin... [15:22:09] 10Traffic, 06Operations, 10media-storage, 13Patch-For-Review: don't serve upload.wikimedia.org 'root' from wmfrewrite/swift - https://phabricator.wikimedia.org/T130709#2223811 (10BBlack) I guess you mean `crossdomain.xml` and `robots.txt`? Is there a plan for handling them outside of swift in general? I... [15:26:13] 07Varnish, 10Analytics-EventLogging, 06Operations, 10RESTBase, and 2 others: RESTBase should handle the X-Analytics header - https://phabricator.wikimedia.org/T133139#2221908 (10Nuria) The premise of this ticket is .. ahem.. pretty incorrect, let's catch up on IRC. [15:26:28] 10Traffic, 06Operations, 10media-storage, 13Patch-For-Review: don't serve upload.wikimedia.org 'root' from wmfrewrite/swift - https://phabricator.wikimedia.org/T130709#2143868 (10faidon) I'm not sure I understand this task — when/how is rewrite.py is going to go away? We haven't really talked about that.... [15:29:01] 10Traffic, 10domains, 06Operations, 06WMF-Legal: Register nlwikipedia.org to prevent squatting - https://phabricator.wikimedia.org/T128968#2223839 (10jayvdb) http://internal.wikimedia.org/wiki/Squatted_Wikimedia_domains ? (I have no idea if it is still there, but that is where it used to be) [15:33:58] 10Traffic, 10Analytics, 10DNS, 06Operations: Create analytics.wikimedia.org - https://phabricator.wikimedia.org/T132407#2223885 (10akosiaris) >>! In T132407#2211054, @Nuria wrote: > > @BBlack > This would not be a full-fledged service. What we would be deploying either via puppet of fab is just html/js... [15:45:36] 10Traffic, 06Operations, 10media-storage, 13Patch-For-Review: authoritative copy of 'root' files for upload.wikimedia.org is only in swift - https://phabricator.wikimedia.org/T130709#2223905 (10fgiunchedi) [15:48:03] 10Traffic, 06Operations, 10media-storage, 13Patch-For-Review: authoritative copy of 'root' files for upload.wikimedia.org is only in swift - https://phabricator.wikimedia.org/T130709#2223908 (10fgiunchedi) @bblack @faidon I've retitled/clarified a bit the scope of this task since it wasn't clear, originall... [16:03:08] 10Traffic, 10Continuous-Integration-Infrastructure, 06Operations: Move gallium to an internal host? - https://phabricator.wikimedia.org/T133150#2223981 (10hashar) gallium has been setup in 2011 and is still on Precise. It received a public IP to serves the Jenkins web interface. With time, all the http entry... [16:04:01] 10Traffic, 10Continuous-Integration-Infrastructure, 06Operations: Move gallium to an internal host? - https://phabricator.wikimedia.org/T133150#2223557 (10hashar) [16:08:13] 07Varnish, 10Analytics-EventLogging, 06Operations, 10RESTBase, and 2 others: RESTBase should handle the X-Analytics header - https://phabricator.wikimedia.org/T133139#2224008 (10mobrovac) 05Open>03Invalid Nope, that's not what we should do. [16:12:12] 10Traffic, 06Labs, 10Labs-Infrastructure, 06Operations: Move californium to an internal host? - https://phabricator.wikimedia.org/T133149#2224036 (10Andrew) @Dzahn as far as I know it does not, moving it to an internal IP would be fine. [16:21:55] 10Traffic, 10Analytics, 10DNS, 06Operations: Create analytics.wikimedia.org - https://phabricator.wikimedia.org/T132407#2224049 (10Dzahn) Everything Alex already said :) i setup bromine and most of those microsites and yea, it's meant for small static sites. In addition to one of those small puppet roles... [16:24:16] 10Traffic, 10Analytics, 10DNS, 06Operations: Create analytics.wikimedia.org - https://phabricator.wikimedia.org/T132407#2224056 (10BBlack) Well, the impedance mismatch here on the standard static bromine setup and what analytics is asking for then may be all about the static-ness and deployment process. I... [16:29:10] 10Traffic, 10Analytics, 10DNS, 06Operations: Create analytics.wikimedia.org - https://phabricator.wikimedia.org/T132407#2224067 (10Dzahn) It would mostly just be about who has +2 on the gerrit repo that holds the actual site content. If the puppet role on our site git clones with "ensure latest" then there... [16:39:53] 07HTTPS, 10Traffic, 06Operations, 13Patch-For-Review: Sort out letsencrypt puppetization for simple public hosts - https://phabricator.wikimedia.org/T132812#2224125 (10BBlack) [16:48:02] 10Traffic, 10Analytics, 10DNS, 06Operations: Create analytics.wikimedia.org - https://phabricator.wikimedia.org/T132407#2224174 (10Nuria) >It would mostly just be about who has +2 on the gerrit repo that holds the actual site content. If the puppet role on our site git clones with "ensure latest" >then th... [17:11:36] 10Traffic, 10Analytics, 10DNS, 06Operations: Create analytics.wikimedia.org - https://phabricator.wikimedia.org/T132407#2224265 (10BBlack) When you say "build our code" do you mean building client-side javascript code that's ultimately static content from the server's perspective, or do you mean building s... [17:13:36] 10Traffic, 10Analytics, 10DNS, 06Operations: Create analytics.wikimedia.org - https://phabricator.wikimedia.org/T132407#2224292 (10Dzahn) "build code" and "static site" are confusing me a bit. the kind of static site we host on bromine means HTML and CSS and some images. [17:15:28] 10Traffic, 10Analytics, 10DNS, 06Operations: Create analytics.wikimedia.org - https://phabricator.wikimedia.org/T132407#2197243 (10ori) >>! In T132407#2224265, @BBlack wrote: > When you say "build our code" do you mean building client-side javascript code that's ultimately static content from the server's... [17:21:07] 10Traffic, 10domains, 06Operations, 06WMF-Legal: Register nlwikipedia.org to prevent squatting - https://phabricator.wikimedia.org/T128968#2224341 (10Dzahn) Oh, internal.wikimedia.org , i don't think i have access to that. But i asked on the staff channel if somebody can check it. [17:40:41] 10Traffic, 10Analytics, 10DNS, 06Operations: Create analytics.wikimedia.org - https://phabricator.wikimedia.org/T132407#2224373 (10Ottomata) Hm, I had assumed we would just host analytics.wikimedia.org on stat1001. I think we'd like analytics.wikimedia.org to eventually supercede stats.wikimedia.org, an... [17:56:48] 10Traffic, 10Analytics, 10DNS, 06Operations: Create analytics.wikimedia.org - https://phabricator.wikimedia.org/T132407#2224433 (10Nuria) >In general, analytics.wikimedia.org will host static files (html, js, tsvs, etc.), but not just for one service (dashiki / reportcard). Correct, some dashiki plots will... [18:05:41] 10Traffic, 10domains, 06Operations, 06WMF-Legal: Register nlwikipedia.org to prevent squatting - https://phabricator.wikimedia.org/T128968#2224483 (10Dzahn) Correction, i do have access, just had to find it. The page is still there, but the last edit was in May 2013. So it's not really used (by legal ?)... [18:10:44] 10Traffic, 10domains, 06Operations, 06WMF-Legal: Register nlwikipedia.org to prevent squatting - https://phabricator.wikimedia.org/T128968#2224497 (10Dzahn) Added nevertheless : https://internal.wikimedia.org/w/index.php?title=Domain_names%2FSquatted_Wikimedia_domains&type=revision&diff=17196&oldid=17106... [18:21:44] 07HTTPS, 10Traffic, 06Operations: Enforce HTTPS+HSTS on remaining one-off sites in wikimedia.org that don't use standard cache cluster termination - https://phabricator.wikimedia.org/T132521#2224563 (10BBlack) I've started refactoring https://wikitech.wikimedia.org/wiki/HTTPS/domains - it now has the merged... [18:29:57] 10Traffic, 10domains, 06Operations, 06WMF-Legal: Register nlwikipedia.org to prevent squatting - https://phabricator.wikimedia.org/T128968#2224619 (10Dzahn) 05Open>03Invalid Not sure which status is appropriate here. It's certainly not resolved, it's not open anymore, it's not stalled, it wasn't decli... [18:35:12] 10Traffic, 10domains, 06Operations, 06WMF-Legal: Register nlwikipedia.org to prevent squatting - https://phabricator.wikimedia.org/T128968#2224641 (10CRoslof) Thanks for flagging this domain. We have internal tracking documents on the legal team, and I'll make sure nlwikipedia.org is on them. Since it seem... [18:39:21] 10Traffic, 10Analytics, 10DNS, 06Operations: Create analytics.wikimedia.org - https://phabricator.wikimedia.org/T132407#2197243 (10madhuvishy) I want to explain the current setup in labs a little bit and point out that it won't work as is in prod - and needs some re-working. The idea is we have a single in... [19:03:47] 10Traffic, 10Analytics, 10DNS, 06Operations: Create analytics.wikimedia.org - https://phabricator.wikimedia.org/T132407#2224904 (10Ottomata) > these dashboards would have to be served at analytics.wikimedia.org/browser-reports, analytics.wikimedia.org/edit-reports etc. And the apache setup will have to cha... [19:04:19] 10Traffic, 10Analytics, 10DNS, 06Operations: Create analytics.wikimedia.org - https://phabricator.wikimedia.org/T132407#2224906 (10Ottomata) > and use scap3 Actually, I don't think we can use scap3 if they aren't in git, since scap3 deploys via git. [20:59:54] 10Traffic, 06Operations: Fix apache-2.4 + DHE ciphersuites issue - https://phabricator.wikimedia.org/T133217#2225358 (10BBlack) [21:01:49] 10Traffic, 06Operations: Fix apache-2.4 + DHE ciphersuites issue - https://phabricator.wikimedia.org/T133217#2225388 (10BBlack) p:05Triage>03Low [22:38:05] 10netops, 10Analytics-Cluster, 06Analytics-Kanban, 06Operations, 13Patch-For-Review: setup/deploy server analytics1003/WMF4541 - https://phabricator.wikimedia.org/T130840#2225679 (10RobH)