[06:06:30] 10Traffic, 10netops, 10Data-Persistence-Backup, 10SRE, 10SRE-swift-storage: Depool codfw swift cluster - https://phabricator.wikimedia.org/T267338 (10Krinkle) [06:06:45] 10Traffic, 10netops, 10Data-Persistence-Backup, 10SRE, and 2 others: Depool codfw swift cluster - https://phabricator.wikimedia.org/T267338 (10Krinkle) [12:14:42] 10Traffic, 10Desktop Improvements, 10SRE, 10Performance-Team (Radar): CDN cache revalidation on several wikis for desktop improvements deployment pt 2 - https://phabricator.wikimedia.org/T274784 (10jbond) p:05Triage→03Medium [12:17:44] 10Traffic, 10netops, 10SRE: TATA SKY Broadband (AS134674) issues with connecting to upload.wikimedia.org - https://phabricator.wikimedia.org/T275234 (10jbond) p:05Triage→03Medium [12:19:12] 10Traffic, 10SRE: Wikipedia not opening images in any browser except Opera. - https://phabricator.wikimedia.org/T275211 (10jbond) p:05Triage→03Medium @Mrcoolabhishek In case you missed it this seems to be a genral issue with TATA SKY BROADBAND T275234 [12:44:15] 10Traffic, 10SRE: Wikipedia not opening images in any browser except Opera. - https://phabricator.wikimedia.org/T275211 (10Mrcoolabhishek) Ok. Thanks for letting me know. I have emailed Tata sky broadband about this. I don’t know how this could happen. ISPs in India were asked to block certain sites but don’t... [13:18:03] 10netops, 10Datasets-General-or-Unknown, 10Dumps-Generation, 10SRE: Packets discarded on dumpsdata1001 - https://phabricator.wikimedia.org/T273713 (10ArielGlenn) Well the impact is great! I haven't checked the traffic logs yet but the dumps ran much faster, most are done already. Wikidata is the only thing... [15:47:09] 10Traffic, 10netops, 10Data-Persistence-Backup, 10SRE, and 2 others: Depool codfw swift cluster - https://phabricator.wikimedia.org/T267338 (10jcrespo) I have now started 10 threads reading and retrieving commonswiki files to its temporary backup location at dbprov2003. dbprov2003 only has 8TB available, b... [18:59:45] 10netops, 10SRE: Upgrade Routinator 3000 to 0.8.2 - https://phabricator.wikimedia.org/T269738 (10ayounsi) 05Open→03Resolved a:03ayounsi [19:04:01] 10netops, 10SRE, 10observability: active/active links monitoring - https://phabricator.wikimedia.org/T264300 (10ayounsi) 05Open→03Resolved a:03ayounsi I created a LibreNMS traffic bill which already have alerting: https://librenms.wikimedia.org/bill/bill_id=24/ The particularity is that it alerts at th... [19:32:08] XioNoX: oh, good idea re: traffic bill [19:32:43] :)