[10:32:38] 10netops, 10SRE: SNMP: filter out default sub interfaces - https://phabricator.wikimedia.org/T283060 (10ayounsi) 05Open→03Resolved a:03ayounsi Pushed everywhere successfully. ~2400 LibreNMS ports removed. Speed up LibreNMS pooling by ~25%. https://librenms.wikimedia.org/graphs/type=global_poller_modules... [14:19:32] 10Traffic, 10SRE: Let's Encrypt issuance chains update - https://phabricator.wikimedia.org/T283164 (10Vgutierrez) [14:19:47] 10Acme-chief, 10Traffic, 10SRE: Let's Encrypt chain size increase - https://phabricator.wikimedia.org/T283061 (10Vgutierrez) [14:19:49] 10Traffic, 10SRE: Let's Encrypt issuance chains update - https://phabricator.wikimedia.org/T283164 (10Vgutierrez) [14:30:09] 10Traffic, 10SRE: OpenSSL < 1.1.0 compatibility issues with new LE issuance chain - https://phabricator.wikimedia.org/T283165 (10Vgutierrez) [14:42:54] 10Traffic, 10SRE: Let's Encrypt issuance chains update - https://phabricator.wikimedia.org/T283164 (10Vgutierrez) [15:00:46] 10Traffic: BGP Policy on aggregate routes prevents them being created in some circumstances. - https://phabricator.wikimedia.org/T283163 (10Aklapper) [15:09:17] 10Traffic, 10netops: BGP Policy on aggregate routes prevents them being created in some circumstances. - https://phabricator.wikimedia.org/T283163 (10CDanis) p:05Triage→03Medium [15:19:41] 10Traffic, 10Okapi [Wikimedia Enterprise], 10Platform Engineering, 10SRE: Securely connect Wikimedia Enterprise Infrastructure with WMF Kafka Streams - https://phabricator.wikimedia.org/T280628 (10RBrounley_WMF) [15:27:48] 10Traffic, 10netops: BGP Policy on aggregate routes prevents them being created in some circumstances. - https://phabricator.wikimedia.org/T283163 (10cmooney) How to overcome this is a tricky question. I don't believe an AS-path filter on the aggregate can be used as: - We know that route with longer sub-a... [15:30:28] 10Traffic, 10netops: BGP Policy on aggregate routes prevents them being created in some circumstances. - https://phabricator.wikimedia.org/T283163 (10cmooney) [16:27:34] 10Traffic, 10Okapi [Wikimedia Enterprise], 10SRE: "wikimedia.com" DNS transfer to Wikimedia Enterprise's AWS infra - https://phabricator.wikimedia.org/T281428 (10Eugene.chernov) @BBlack, Public Hosted Zone wikimedia.com has been created on the AWS side. Now there is an ability to proceed with interception of... [16:33:47] 10Traffic, 10Okapi [Wikimedia Enterprise], 10SRE: "wikimedia.com" DNS transfer to Wikimedia Enterprise's AWS infra - https://phabricator.wikimedia.org/T281428 (10BBlack) >>! In T281428#7098765, @Eugene.chernov wrote: > [...] now we're ready to check/peek of what we have at the AWS Route53. Awesome, I'll hav... [16:34:18] 10Traffic, 10SRE, 10Patch-For-Review: Deploy Wikidough: Experimental DNS-over-HTTPS (DoH) public resolver - https://phabricator.wikimedia.org/T252132 (10Volans) With the current automation and logic in the generation script, adding just the IP would create this file, that is far from ideal: ` diff --git a/o... [16:35:28] 10Traffic, 10SRE, 10Patch-For-Review: Deploy Wikidough: Experimental DNS-over-HTTPS (DoH) public resolver - https://phabricator.wikimedia.org/T252132 (10Volans) I've updated https://netbox.wikimedia.org/ipam/ip-addresses/8539/ to set the DNS as manual for now so that it doesn't gets auto-generated. [16:35:30] 10Traffic, 10Analytics, 10Analytics-Kanban, 10SRE, 10Patch-For-Review: Add Traffic's notion of "from public cloud" to Analytics webrequest data - https://phabricator.wikimedia.org/T279380 (10JAllemandou) [16:37:32] 10Traffic, 10Analytics, 10Analytics-Kanban, 10SRE, 10Patch-For-Review: Add Traffic's notion of "from public cloud" to Analytics webrequest data - https://phabricator.wikimedia.org/T279380 (10JAllemandou) 05Open→03Resolved The new field is in turnilo with data starting from May 18th 2021. https://w.wi... [17:48:28] 10Traffic, 10SRE, 10observability, 10User-fgiunchedi: Port traffic/netops grafana alerts to AM - https://phabricator.wikimedia.org/T282806 (10lmata) moving to radar for tracking :-) [17:49:36] 10Traffic, 10vm-requests: Please create two Ganeti VMs for Wikidough - https://phabricator.wikimedia.org/T283192 (10ssingh) [17:50:05] 10Traffic, 10vm-requests: Please create two Ganeti VMs for Wikidough - https://phabricator.wikimedia.org/T283192 (10ssingh) [18:23:19] 10netops, 10SRE: routinator: create gabage collection job - https://phabricator.wikimedia.org/T282469 (10ayounsi) [18:28:12] 10netops, 10SRE: routinator: create gabage collection job - https://phabricator.wikimedia.org/T282469 (10ayounsi) @jbond would the upcoming changes in https://github.com/NLnetLabs/routinator/releases/tag/v0.9.0-rc1 solve that issue by using a database instead of the file-system? [20:50:25] 10Traffic, 10Okapi [Wikimedia Enterprise], 10Platform Engineering, 10SRE: Securely connect Wikimedia Enterprise Infrastructure with WMF Kafka Streams - https://phabricator.wikimedia.org/T280628 (10nskaggs) Following. This could be an interesting reference implementation for other uses / problems. I would b... [21:42:26] 10Traffic, 10SRE, 10vm-requests: Please create two Ganeti VMs for Wikidough - https://phabricator.wikimedia.org/T283192 (10Dzahn) a:03Dzahn [21:52:04] 10Traffic, 10SRE, 10vm-requests: Please create two Ganeti VMs for Wikidough - https://phabricator.wikimedia.org/T283192 (10Dzahn) Ready to create Ganeti VM doh2001.wikimedia.org in the ganeti01.svc.codfw.wmnet cluster on row A with 2 vCPUs, 8GB of RAM, 30GB of disk in the public network. Ready to create Ga... [22:12:22] 10Traffic, 10SRE, 10vm-requests: Please create two Ganeti VMs for Wikidough - https://phabricator.wikimedia.org/T283192 (10Dzahn) @ssingh Please add "doh" to the list of clusters on https://wikitech.wikimedia.org/wiki/Infrastructure_naming_conventions [22:23:48] 10Traffic, 10SRE, 10vm-requests: Please create two Ganeti VMs for Wikidough - https://phabricator.wikimedia.org/T283192 (10ssingh) >>! In T283192#7099503, @Dzahn wrote: > @ssingh Please add "doh" to the list of clusters on https://wikitech.wikimedia.org/wiki/Infrastructure_naming_conventions Thank you for t... [23:23:24] 10Traffic, 10SRE, 10vm-requests: Please create two Ganeti VMs for Wikidough - https://phabricator.wikimedia.org/T283192 (10Dzahn) added to DHCP but when i started OS install I noticed we need to add it to partman still. will be back in a little while