[08:48:35] <wikibugs>	 10netops, 10Operations: No LACP info for cr2-esams:ae2 - https://phabricator.wikimedia.org/T253970 (10ayounsi) I had to re-enable the link before AMS-IX figured out how to turn LACP on on their side. Will re-schedule a window another early morning, hopefully they will have figured out what delayed them until t...
[10:38:11] <wikibugs>	 10netops, 10Operations, 10ops-eqiad: eqiad row D switch fabric recabling - https://phabricator.wikimedia.org/T256112 (10ayounsi) p:05Triage→03Medium
[10:38:54] <wikibugs>	 10netops, 10Operations, 10ops-eqiad: eqiad row D switch fabric recabling - https://phabricator.wikimedia.org/T256112 (10ayounsi)
[10:39:48] <wikibugs>	 10netops, 10Operations, 10ops-eqiad: eqiad row D switch fabric recabling - https://phabricator.wikimedia.org/T256112 (10Marostegui) @ayounsi do you have a timeframe for this? The expected downtime is 30 minutes per for the whole row?
[10:40:09] <wikibugs>	 10netops, 10Operations, 10ops-eqiad: eqiad row D switch fabric recabling - https://phabricator.wikimedia.org/T256112 (10ayounsi)
[10:40:12] <wikibugs>	 10netops, 10Operations, 10ops-eqiad: asw2-d1-eqiad:VCP failure - https://phabricator.wikimedia.org/T252797 (10ayounsi)
[10:40:15] <wikibugs>	 10netops, 10Operations, 10ops-eqiad: Three ports on asw2-d-eqiad are not working as expected - https://phabricator.wikimedia.org/T247881 (10ayounsi)
[10:40:18] <wikibugs>	 10netops, 10Operations, 10Sustainability (Incident Prevention): D1<->D8 VC link failure - https://phabricator.wikimedia.org/T251663 (10ayounsi)
[10:40:21] <wikibugs>	 10netops, 10Operations, 10ops-eqiad: upgrade row d to have 3 10G switches - https://phabricator.wikimedia.org/T196487 (10ayounsi)
[11:01:42] <wikibugs>	 10netops, 10Operations, 10ops-eqiad: eqiad row D switch fabric recabling - https://phabricator.wikimedia.org/T256112 (10ayounsi) >>! In T256112#6247946, @Marostegui wrote: > @ayounsi do you have a timeframe for this? The expected downtime is 30 minutes per for the whole row?  There is no expected downtime, b...
[11:07:12] <wikibugs>	 10netops, 10Operations: No LACP info for cr2-esams:ae2 - https://phabricator.wikimedia.org/T253970 (10ayounsi) > I can confirm that I see traffic again and my apologies for the delay in responding, we encountered a provisioning issue which has now been fixed.  Re-scheduled for tomorrow 6am UTC.
[11:37:00] <wikibugs>	 10netops, 10Operations, 10ops-eqiad: asw2-d1-eqiad:VCP failure - https://phabricator.wikimedia.org/T252797 (10ayounsi) 05Open→03Stalled Larger discussion in T256112. Feel free to un-assign it from you until we figure out the overall plan.
[14:54:11] <wikibugs>	 10netops, 10DC-Ops, 10Operations, 10ops-eqiad, 10cloud-services-team (Hardware): (Need By: 2020-06-12) rack/setup/install WMCS 10G switches - https://phabricator.wikimedia.org/T251632 (10Jclark-ctr) sfp`s arrived today will have fibers finished today
[15:47:23] <wikibugs>	 10netops, 10Operations, 10ops-codfw: (Need by: End of July-2020 ) codfw:rack/setup/new management switches - https://phabricator.wikimedia.org/T253154 (10Papaul) @Jgreen I added you to this task so you can keep in track of the replacement of the mgmt switch fmsw-c8.
[15:54:54] <wikibugs>	 10netops, 10Operations, 10ops-codfw: (Need by: End of July-2020 ) codfw:rack/setup/new management switches - https://phabricator.wikimedia.org/T253154 (10Papaul)
[16:08:54] <wikibugs>	 10netops, 10Operations, 10ops-codfw: codfw: rack/setup new srx300 (mr1) - https://phabricator.wikimedia.org/T255577 (10Papaul) @ayounsi i see you changed the CyrusOne OOB configuration on the new mr1. I had it configured on ge-0/0/5 and you set it on ge-0/0/7.  The last port on the SRX300 is ge-0/0/5 and the...
[16:56:41] <wikibugs>	 10netops, 10Operations, 10ops-codfw: codfw: Decommission old mr1 - https://phabricator.wikimedia.org/T256143 (10Papaul)
[16:57:09] <wikibugs>	 10netops, 10Operations, 10ops-codfw: codfw: Decommission old mr1 - https://phabricator.wikimedia.org/T256143 (10Papaul) p:05Triage→03Low
[17:02:22] <wikibugs>	 10netops, 10Operations, 10observability, 10Patch-For-Review: Determine & implement near-term method for escalating network alerts - https://phabricator.wikimedia.org/T237587 (10CDanis) 05Open→03Resolved I think we can call this closed?  LibreNMS and Fastnetmon both send pages (via Icinga) quite well now.
[17:39:42] <wikibugs>	 10netops, 10DC-Ops, 10Operations, 10ops-eqiad, 10cloud-services-team (Hardware): (Need By: 2020-06-12) rack/setup/install WMCS 10G switches - https://phabricator.wikimedia.org/T251632 (10Jclark-ctr) all fibers ran console connected.  @RobH  serial cables need to be ran and what pinout should use?
[18:30:52] <wikibugs>	 10Traffic, 10Operations: Collect client network errors, deprecation, intervention and crash reports - https://phabricator.wikimedia.org/T207860 (10Krinkle)
[18:58:40] <wikibugs>	 10Traffic, 10Operations, 10observability: Collect client network errors, deprecation, intervention and crash reports - https://phabricator.wikimedia.org/T207860 (10CDanis)
[21:45:34] <wikibugs>	 10Traffic, 10Operations: Block hotlinking - https://phabricator.wikimedia.org/T152091 (10Nemo_bis) It's a long-standing Wikimedia policy that we allow hotlinking, or even encourage it. See for instance https://commons.wikimedia.org/wiki/Commons:HOTLINK , which reflects consensus (and Wikimedia Foundation guida...