[08:15:49] 10Traffic, 10Wikimedia-Apache-configuration, 10Operations, 10Mobile, 10Patch-For-Review: Accessing zh-classical.wikipedia.org on a mobile device does not redirect to zh-classical.m.wikipedia.org - https://phabricator.wikimedia.org/T167492#3339304 (10Marostegui) p:05Triage>03Normal [13:23:04] 10Wikimedia-Apache-configuration, 10Wikimedia-Site-requests, 10Wikidata-Sprint: Create a URL rewrite to handle the /data/ path for canonical URLs for machine readable page content - https://phabricator.wikimedia.org/T163922#3340410 (10daniel) [15:17:30] 10netops, 10Labs, 10Labs-Infrastructure, 10Operations, 10ops-codfw: codfw: labtestpuppetmaster2001 switch port configuration - https://phabricator.wikimedia.org/T167321#3340972 (10ayounsi) a:03RobH [15:31:10] 10netops, 10Monitoring, 10Operations: Setup flow monitoring of *internal* network traffic - https://phabricator.wikimedia.org/T79755#3341024 (10ayounsi) a:03ayounsi Prometheus (that didn't exist in 2011) with netstat provides better visibility on problematic frames/segments/datagrams/packets getting in/out... [16:04:02] 10Traffic, 10Fundraising-Backlog, 10MediaWiki-extensions-CentralNotice, 10Operations, and 2 others: Redo /beacon/impression system (formerly Special:RecordImpression) to remove extra round trips on all FR impressions (title was: S:RI should pyroperish) - https://phabricator.wikimedia.org/T45250#3341173 (10N... [16:06:13] 10Traffic, 10netops, 10Operations: High amount of unexpected ICMP dest unreachable toward esams cache clusters - https://phabricator.wikimedia.org/T167691#3341190 (10ayounsi) [17:05:11] 10netops, 10Operations: Faulty link between cr2-codfw and cr1-eqdfw - https://phabricator.wikimedia.org/T167261#3341487 (10Papaul) port 5-6 reference on the patch panel, please see below {F8445373} [17:07:24] 10netops, 10Operations: Faulty link between cr2-codfw and cr1-eqdfw - https://phabricator.wikimedia.org/T167261#3341509 (10faidon) Found an old email from CyrusOne: {F8445376} [17:34:56] 10Wikimedia-Apache-configuration, 10Wikidata, 10Wikimedia-Site-requests, 10Patch-For-Review, and 4 others: [RFC] should wikidata.org/entity/Q12345 do content negotiation, instead of redirecting to wikidata.org/wiki/Special:EntityData/Q36661 first? - https://phabricator.wikimedia.org/T119536#3341656 (10danie... [17:35:22] 10Traffic, 10DNS, 10Labs, 10Labs-Infrastructure, and 3 others: Set SPF (... -all) for toolserver.org - https://phabricator.wikimedia.org/T131930#3341658 (10Reedy) a:03herron [18:31:13] 10netops, 10Operations: Faulty link between cr2-codfw and cr1-eqdfw - https://phabricator.wikimedia.org/T167261#3341949 (10ayounsi) Ticket 830782 opened with CyrusOne [18:41:41] 10Traffic, 10netops, 10Operations: High amount of unexpected ICMP dest unreachable toward esams cache clusters - https://phabricator.wikimedia.org/T167691#3342026 (10ayounsi) Data point, the cp* servers don't send any ICMP packets (the lvs* servers neither), they only receive them from very diverse locations. [18:58:35] 10netops, 10Office-IT, 10Operations: Some BGP sessions to the SF Office down - https://phabricator.wikimedia.org/T167281#3342226 (10ayounsi) a:05ayounsi>03bbogaert [19:37:10] 10netops, 10Labs, 10Labs-Infrastructure, 10Operations, 10ops-codfw: codfw:labtestnet2002 switch port configuration - https://phabricator.wikimedia.org/T167322#3342417 (10RobH) 05Open>03Resolved Ok, fixed and live. [19:42:31] 10Traffic, 10netops, 10Operations: High amount of unexpected ICMP dest unreachable toward esams cache clusters - https://phabricator.wikimedia.org/T167691#3341190 (10BBlack) The cp* should at least occasionally be sending normal ICMP responses correlated with their TCP flows, e.g. "Time Exceeded" and such.... [19:43:00] 10netops, 10Labs, 10Labs-Infrastructure, 10Operations, 10ops-codfw: codfw: labtestneutron2002 switch port configuration - https://phabricator.wikimedia.org/T167326#3342443 (10RobH) 05Open>03Resolved done and live [19:54:57] 10netops, 10Operations, 10ops-eqiad, 10Patch-For-Review: Rack and setup new eqiad row D switch stack (EX4300/QFX5100) - https://phabricator.wikimedia.org/T148506#3342545 (10RobH) [20:02:43] 10netops, 10Operations, 10ops-eqiad, 10Patch-For-Review: Rack and setup new eqiad row D switch stack (EX4300/QFX5100) - https://phabricator.wikimedia.org/T148506#3342607 (10RobH) [20:02:47] 10netops, 10Operations, 10ops-eqiad, 10Patch-For-Review: Rack and setup new eqiad row D switch stack (EX4300/QFX5100) - https://phabricator.wikimedia.org/T148506#2745564 (10RobH) [21:38:49] 10netops, 10Labs, 10Labs-Infrastructure, 10Operations, 10ops-codfw: codfw: labtestpuppetmaster2001 switch port configuration - https://phabricator.wikimedia.org/T167321#3342986 (10RobH) 05Open>03Resolved Done!