[04:19:53] <wikibugs>	 10Traffic, 10Operations, 10serviceops, 10Patch-For-Review: Applayer services without TLS - https://phabricator.wikimedia.org/T210411 (10Dzahn)
[05:54:50] <wikibugs>	 10Traffic, 10Operations: Tune ATS SSL session cache - https://phabricator.wikimedia.org/T231849 (10Vgutierrez)
[05:55:45] <wikibugs>	 10Traffic, 10Operations: Tune ATS SSL session cache - https://phabricator.wikimedia.org/T231849 (10Vgutierrez) p:05Triage→03Normal
[06:22:36] <wikibugs>	 10Traffic, 10Operations, 10serviceops, 10Patch-For-Review: Applayer services without TLS - https://phabricator.wikimedia.org/T210411 (10Dzahn)
[06:23:11] <wikibugs>	 10Traffic, 10Operations, 10serviceops, 10Patch-For-Review: Applayer services without TLS - https://phabricator.wikimedia.org/T210411 (10Dzahn)
[07:28:42] <wikibugs>	 10Traffic, 10Analytics, 10Analytics-Wikistats, 10Operations, 10Performance-Team (Radar): Piwik JS isn't cached - https://phabricator.wikimedia.org/T230772 (10Nuria) @ema So I understand: caching pass needs to be removed (will do so) and since caching response includes an eTag. Is removing caching: pass s...
[08:28:39] <wikibugs>	 10Traffic, 10Analytics, 10Analytics-Wikistats, 10Operations, and 2 others: Piwik JS isn't cached - https://phabricator.wikimedia.org/T230772 (10ema) >>! In T230772#5460265, @Nuria wrote: > @ema So I understand: caching pass needs to be removed  Yes, and the equivalent change needs to be done for ATS too. I...
[08:31:09] <wikibugs>	 10Traffic, 10Analytics, 10Analytics-Kanban, 10Analytics-Wikistats, and 3 others: Piwik JS isn't cached - https://phabricator.wikimedia.org/T230772 (10Nuria)
[09:01:42] <wikibugs>	 10Traffic, 10MobileFrontend, 10Operations, 10Mobile: https://en.wikipedia.org/wiki/Heteromyidae shows the mobile version on desktop - https://phabricator.wikimedia.org/T231620 (10ema) p:05Triage→03Normal
[09:02:22] <wikibugs>	 10Traffic, 10Operations: Unexpectedly received mobile version of an article while logged out - https://phabricator.wikimedia.org/T231504 (10ema) This should now be fixed. Please let me know if that's not the case!
[09:02:32] <wikibugs>	 10Traffic, 10MobileFrontend, 10Operations, 10Mobile: https://en.wikipedia.org/wiki/Heteromyidae shows the mobile version on desktop - https://phabricator.wikimedia.org/T231620 (10ema) This should now be fixed. Please let me know if that's not the case!
[09:11:37] <wikibugs>	 10Traffic, 10Analytics, 10Analytics-Kanban, 10Analytics-Wikistats, and 3 others: Piwik JS isn't cached - https://phabricator.wikimedia.org/T230772 (10Nuria)
[09:16:02] <wikibugs>	 10Traffic, 10Operations: ATS-tls isn't enforcing the same list of curves as nginx during TLS handshake - https://phabricator.wikimedia.org/T231859 (10Vgutierrez)
[09:17:54] <wikibugs>	 10Traffic, 10Operations: ATS-tls isn't enforcing the same list of curves as nginx during TLS handshake - https://phabricator.wikimedia.org/T231859 (10Vgutierrez) p:05Triage→03Normal
[10:50:30] <wikibugs>	 10Traffic, 10Operations: Cannot download STL files due to network error - https://phabricator.wikimedia.org/T231422 (10ema) The issue happens due to varnish-frontend giving up the fetch from ATS because of lack of free space:  ` --  ObjStatus      200 --  ObjReason      OK --  ObjHeader      Date: Tue, 03 Sep...
[10:53:12] <wikibugs>	 10Traffic, 10Analytics, 10Analytics-Kanban, 10Analytics-Wikistats, and 3 others: Piwik JS isn't cached - https://phabricator.wikimedia.org/T230772 (10Nuria) I think what is left here is to restart apache for settings to take place
[10:55:02] <wikibugs>	 10Traffic, 10Analytics, 10Analytics-Kanban, 10Analytics-Wikistats, and 3 others: Piwik JS isn't cached - https://phabricator.wikimedia.org/T230772 (10Nuria) Restarted with : sudo apache2ctl restart
[13:15:06] <wikibugs>	 10Traffic, 10Operations: Unexpectedly received mobile version of an article while logged out - https://phabricator.wikimedia.org/T231504 (10Mholloway) 05Open→03Resolved Sounds like this can be resolved, then.  I can no longer reproduce the issue, but I'll reopen if I see any further cases.  Thanks!
[13:47:10] <wikibugs>	 10Traffic, 10Commons, 10Operations: Downloading the original SVG of a file on Commons serves a truncated stream - https://phabricator.wikimedia.org/T231753 (10ema) p:05Triage→03Normal
[13:47:47] <wikibugs>	 10Traffic, 10Operations: Cannot download STL files due to network error - https://phabricator.wikimedia.org/T231422 (10ema)
[13:47:50] <wikibugs>	 10Traffic, 10Commons, 10Operations: Downloading the original SVG of a file on Commons serves a truncated stream - https://phabricator.wikimedia.org/T231753 (10ema)
[14:07:34] <wikibugs>	 10Traffic, 10Analytics, 10Analytics-Kanban, 10Analytics-Wikistats, and 3 others: Piwik JS isn't cached - https://phabricator.wikimedia.org/T230772 (10Nuria) I can see the cache-control: max-age=604800 , I think @ema needs to change something on his end so varnish /ATS settings apply?
[15:12:22] <wikibugs>	 10Traffic, 10Operations: Cannot download STL files due to network error - https://phabricator.wikimedia.org/T231422 (10ema) @Gilles: the issue should now be fixed, can you confirm?
[15:18:27] <wikibugs>	 10Traffic, 10Operations: Cannot download STL files due to network error - https://phabricator.wikimedia.org/T231422 (10Gilles) 05Open→03Resolved Fix confirmed
[15:28:20] <wikibugs>	 10Traffic, 10DC-Ops, 10Operations, 10ops-codfw: (OoW) lvs2006 Embedded Flash/SD-CARD iLO errors - https://phabricator.wikimedia.org/T192082 (10Papaul) p:05Normal→03Low
[15:29:12] <wikibugs>	 10Traffic, 10Operations, 10ops-codfw, 10Patch-For-Review: (OoW) lvs2006 crashed into (what it seems) an unrecoverable state - https://phabricator.wikimedia.org/T209337 (10Papaul) p:05Lowest→03Low
[17:24:06] <wikibugs>	 10netops, 10Operations: Check router ACLs for early install SSH access from puppet masters/cumin hosts - https://phabricator.wikimedia.org/T231811 (10ayounsi) Hosts in the `cloud-hosts1-b-eqiad` vlan are behind the `labs-in4` firewall filter (applied on traffic going out of that vlan), which also includes the...
[17:38:16] <wikibugs>	 10netops, 10Analytics, 10Analytics-Kanban, 10Operations, 10ops-eqiad: Move cloudvirtan* hardware out of CloudVPS back into production Analytics VLAN. - https://phabricator.wikimedia.org/T225128 (10Cmjohnson) @Ottomata Do you still need the 2nd port now that you're not doing the cloud thing?  If so which...
[18:46:23] <wikibugs>	 10netops, 10Analytics, 10Analytics-Kanban, 10Operations, 10ops-eqiad: Move cloudvirtan* hardware out of CloudVPS back into production Analytics VLAN. - https://phabricator.wikimedia.org/T225128 (10Ottomata) We don't!    Just Analytics VLAN for now please.
[20:44:43] <wikibugs>	 10netops, 10Operations, 10ops-esams: replace msw1-esams - https://phabricator.wikimedia.org/T185151 (10ayounsi)
[23:58:54] <wikibugs>	 10netops, 10Analytics, 10Analytics-Kanban, 10Operations, 10ops-eqiad: Move cloudvirtan* hardware out of CloudVPS back into production Analytics VLAN. - https://phabricator.wikimedia.org/T225128 (10Cmjohnson) @ottomata All the servers are moved and all  of them but cloudvirtan1003 are connected to the swi...