[08:15:34] 10Traffic, 10Operations, 10observability, 10serviceops: Alert "LVS api codfw port 80/tcp - MediaWiki API cluster- api.svc.eqiad.wmnet IPv4" is flapping - https://phabricator.wikimedia.org/T258614 (10jcrespo) Thanks for your work on this. One clarification, for those of us that are not that familiar with LV... [08:22:16] 10netops, 10Operations, 10observability, 10Patch-For-Review, 10User-fgiunchedi: Migrate role::netmon to Buster - https://phabricator.wikimedia.org/T247967 (10fgiunchedi) [08:38:17] 10Traffic, 10Operations, 10observability, 10serviceops: Alert "LVS api codfw port 80/tcp - MediaWiki API cluster- api.svc.eqiad.wmnet IPv4" is flapping - https://phabricator.wikimedia.org/T258614 (10akosiaris) >>! In T258614#6328624, @jcrespo wrote: > Thanks for your work on this. One clarification, for th... [08:50:17] 10Traffic, 10netops, 10Operations, 10Patch-For-Review: Remove multicast - https://phabricator.wikimedia.org/T257573 (10ayounsi) 05Open→03Resolved Indeed, cleaned up as well: ` rancid-configs/configs$ ag 208.80.153.194 cr1-codfw.wikimedia.org 1661: address 208.80.153.194/32; cr2-codfw.w... [08:58:12] 10Traffic, 10Operations, 10observability, 10serviceops: Alert "LVS api codfw port 80/tcp - MediaWiki API cluster- api.svc.eqiad.wmnet IPv4" is flapping - https://phabricator.wikimedia.org/T258614 (10jcrespo) I see, thanks. [13:09:50] 10netops, 10Operations, 10observability, 10Patch-For-Review, 10User-fgiunchedi: Migrate role::netmon to Buster - https://phabricator.wikimedia.org/T247967 (10fgiunchedi) [13:42:05] 10Traffic, 10Fundraising-Backlog, 10MediaWiki-extensions-CentralNotice, 10Operations, 10Patch-For-Review: TY pages in a subdomain of wikipedia and set hide banner cookie - https://phabricator.wikimedia.org/T251780 (10Krinkle) 05Resolved→03Open [14:06:18] 10netops, 10Operations, 10ops-eqsin: cr3-eqsin disk 1 failure - https://phabricator.wikimedia.org/T257154 (10RobH) [16:52:43] 10Traffic, 10Wikimedia-Apache-configuration, 10Operations, 10Security-Team, and 3 others: Open Redirect in secure.wikimedia.org - https://phabricator.wikimedia.org/T151977 (10sbassett) 05Stalled→03Resolved a:03CDanis Thanks, @cdanis. Looks to be fixed. Resolving and making public. [16:52:48] 10Traffic, 10Wikimedia-Apache-configuration, 10Operations, 10Security-Team, and 3 others: Open Redirect in secure.wikimedia.org - https://phabricator.wikimedia.org/T151977 (10sbassett) [17:11:39] 10Traffic, 10Wikimedia-Apache-configuration, 10Operations, 10Security-Team, and 3 others: Open Redirect in secure.wikimedia.org - https://phabricator.wikimedia.org/T151977 (10ArielGlenn) 05Resolved→03Open Almost resolved, heh. [17:16:43] 10Traffic, 10Wikimedia-Apache-configuration, 10Operations, 10Security-Team, and 3 others: Open Redirect in secure.wikimedia.org - https://phabricator.wikimedia.org/T151977 (10CDanis) 05Open→03Resolved Re-validation forced for ATS-BE, and also a Varnish cache ban has been put in place, so we should no l... [19:27:07] 10Traffic, 10Operations, 10Sustainability (Incident Followup): upload.wikimedia.org returns HTTP status code 503 for truncated urls, not 404 - https://phabricator.wikimedia.org/T106517 (10Aklapper) >>! In T106517#5666579, @ema wrote: > I cannot reproduce with URLs such as https://upload.wikimedia.org/wikiped...