[08:54:32] 10netops, 06Infrastructure-Foundations: Apply egress Source Address Validation on the Wikimedia core routers - https://phabricator.wikimedia.org/T372158#10056948 (10ayounsi) > However, in reality, it should be possible to reject all IP packets where the source IP is not part of the IP prefixes that the Foundat... [09:08:36] 10netops, 06Infrastructure-Foundations: Publish, and maintain ASPA records for valid AS14907 upstreams - https://phabricator.wikimedia.org/T372161#10056965 (10ayounsi) > Nevertheless, it should be possible to publish ASPA records in RPKI through the ARIN portal I looked a bit around Arin's RPKI's portal but co... [09:10:01] 10netops, 06Infrastructure-Foundations, 07sre-alert-triage: Alert in need of triage: BGP status (instance cr1-esams) - https://phabricator.wikimedia.org/T372248 (10LSobanski) 03NEW [09:51:44] 10netops, 06Infrastructure-Foundations, 07sre-alert-triage: Alert in need of triage: BGP status (instance cr1-esams) - https://phabricator.wikimedia.org/T372248#10057060 (10ayounsi) a:03ayounsi Emailed AS54994 and cleared the errors for the others. [12:16:55] 06Traffic, 06collaboration-services, 06SRE, 13Patch-For-Review, 10Release-Engineering-Team (Radar): implement anti-abuse features for GitLab (Move GitLab behind the CDN) - https://phabricator.wikimedia.org/T366882#10057373 (10Jelto) I enabled the throttling rule for the production GitLab instance in logg... [14:55:32] 06Traffic, 06collaboration-services, 06SRE, 13Patch-For-Review, 10Release-Engineering-Team (Radar): implement anti-abuse features for GitLab (Move GitLab behind the CDN) - https://phabricator.wikimedia.org/T366882#10058059 (10Dzahn) ACK, sounds like a plan. Same for Gerrit, as you will have seen I upped... [15:44:16] 10netops, 06Infrastructure-Foundations: Publish, and maintain ASPA records for valid AS14907 upstreams - https://phabricator.wikimedia.org/T372161#10058298 (10Southparkfan) Follow-up from IRC: Wikimedia uses the [[ https://www.arin.net/resources/manage/rpki/hosted/ | Hosted RPKI ]], but we assume the ARIN port... [15:53:35] 10netops, 06DBA, 06DC-Ops, 06Infrastructure-Foundations, and 2 others: Migrate codfw row C & D database hosts to new Leaf switches - https://phabricator.wikimedia.org/T370852#10058326 (10ABran-WMF) >>! In T370852#10028352, @Marostegui wrote: > @ABran-WMF please coordinate with @cmooney for this. ack, will... [19:26:00] 06Traffic: Add prometheus metrics - https://phabricator.wikimedia.org/T372338 (10Fabfur) 03NEW [19:28:18] 06Traffic: haproxykafka: feature: add ability to add/remove/modify fields - https://phabricator.wikimedia.org/T372339 (10Fabfur) 03NEW [19:28:48] 06Traffic: haproxykafka: feature: Add prometheus metrics - https://phabricator.wikimedia.org/T372338#10059437 (10Fabfur) [19:31:12] 06Traffic: haproxykafka: feature: Read from TCP UDS socket - https://phabricator.wikimedia.org/T372341 (10Fabfur) 03NEW [19:32:12] 06Traffic: haproxykafka: feature: add ability to add/remove/modify fields - https://phabricator.wikimedia.org/T372339#10059468 (10Fabfur) [19:32:14] 06Traffic: haproxykafka: feature: Add prometheus metrics - https://phabricator.wikimedia.org/T372338#10059469 (10Fabfur) [19:32:16] 06Traffic, 06Data Products, 06Data-Engineering: New software: haproxykafka - https://phabricator.wikimedia.org/T370668#10059470 (10Fabfur) [19:34:40] 06Traffic: haproxykafka: feature: Read from TCP UDS socket - https://phabricator.wikimedia.org/T372341#10059471 (10Vgutierrez) I think we've already established that stream or datagram oriented Unix domain sockets provide the same reliability level on Linux [19:35:18] 06Traffic: haproxykafka: feature: Configuration file - https://phabricator.wikimedia.org/T372342 (10Fabfur) 03NEW [19:39:11] 06Traffic: haproxykafka: feature: Read from TCP UDS socket - https://phabricator.wikimedia.org/T372341#10059501 (10Fabfur) 05Open→03Declined ACK, now I remember the talk about that [19:42:33] 06Traffic: haproxykafka: feature: Ability to print structured messages to stdout - https://phabricator.wikimedia.org/T372344 (10Fabfur) 03NEW [19:53:16] 06Traffic: haproxykafka: feature: Ability to print structured messages to stdout - https://phabricator.wikimedia.org/T372344#10059545 (10Vgutierrez) This would need some filtering and we should be very careful on how it's implemented to not trigger a big performance degradation. I'd say that stdout/file is rule... [20:10:54] 06Traffic: haproxykafka: feature: Ability to print structured messages to stdout - https://phabricator.wikimedia.org/T372344#10059636 (10Fabfur) [20:11:16] 06Traffic: haproxykafka: feature: Ability to print structured messages to stdout - https://phabricator.wikimedia.org/T372344#10059638 (10Fabfur) >>! In T372344#10059545, @Vgutierrez wrote: > This would need some filtering and we should be very careful on how it's implemented to not trigger a big performance degr... [21:37:14] 10netops, 06DC-Ops, 06Infrastructure-Foundations, 10ops-codfw, 06SRE: Request additional mgmt IP range for frack servers - https://phabricator.wikimedia.org/T370164#10060002 (10Dwisehaupt) a:05Dwisehaupt→03None Sorry for the delay, I was out last week. This should be fixed. The connections to the mg... [21:38:56] 10netops, 06DC-Ops, 10fundraising-tech-ops, 06Infrastructure-Foundations, and 2 others: Request additional mgmt IP range for frack servers - https://phabricator.wikimedia.org/T370164#10060015 (10Dwisehaupt)