[00:34:50] 10netops, 10Operations, 10ops-esams: Setup esams atlas anchor - https://phabricator.wikimedia.org/T174637#3568685 (10ayounsi) [00:37:49] 10Traffic, 10netops, 10Operations, 10ops-eqiad: Upgrade BIOS/RBSU/etc on lvs1007 - https://phabricator.wikimedia.org/T167299#3568719 (10RobH) So, the bios and ilom have been updated to the latest version, but the firmware on the NIC can only be flashed via the HP SPP iso boot. [13:35:26] 10Traffic, 10Operations: Fix broken referer categorization for visits from Safari browsers - https://phabricator.wikimedia.org/T154702#3569829 (10Nuria) @TheDJ : noted, please ping us when those changes make it into safari's main version. The bulk of our views is on Safari 10 so if problem is fixed on next ver... [13:38:49] 10Traffic, 10Operations, 10ops-ulsfo, 10Patch-For-Review: replace ulsfo aging servers - https://phabricator.wikimedia.org/T164327#3569839 (10ops-monitoring-bot) Script wmf_auto_reimage was launched by bblack on neodymium.eqiad.wmnet for hosts: ``` ['cp4022.ulsfo.wmnet'] ``` The log can be found in `/var/lo... [13:57:54] <_joe_> ema, bblack what's the maximum TTL of a page in cache? [13:58:44] <_joe_> I mean an html page for one of the wikis (so the text cluster) [14:08:18] _joe_: we're capping beresp.ttl at 1 day on all clusters [14:08:48] <_joe_> ema: so it makes zero sense to send purges relating to events more than 24 hours in the past, right? [14:10:59] _joe_: no, I think it still makes sense to purge stuff older than 24h, the cap is per-layer [14:11:17] see https://phabricator.wikimedia.org/T124954#2035896 [14:11:46] <_joe_> I would say not longer than 48hours then? [14:13:24] <_joe_> uhm, we have 3 layers max, right [14:14:42] 10Traffic, 10Operations, 10ops-ulsfo, 10Patch-For-Review: replace ulsfo aging servers - https://phabricator.wikimedia.org/T164327#3570018 (10ops-monitoring-bot) Completed auto-reimage of hosts: ``` ['cp4022.ulsfo.wmnet'] ``` and were **ALL** successful. [14:14:48] _joe_: ulsfo would be 4 [14:15:09] <_joe_> ulsfo does fe-be-be-be, right [14:15:17] right [14:16:53] <_joe_> if you think this is complex [14:17:03] <_joe_> you haven't tried reasoning about the jobqueue [14:17:40] <_joe_> between rootjobs, recursive generation of children jobs, deduplication (that was broken, btw), stalling/reclaiming/recycling [14:17:51] <_joe_> it's really hard to figure out what's going on there [14:18:24] <_joe_> thanks a lot! Coffee needed [14:22:55] same here [16:52:08] bblack: let me know when you want to have a look at T169175... [16:52:09] T169175: What is a reasonable per-IP ratelimit for maps - https://phabricator.wikimedia.org/T169175 [19:31:14] 10netops, 10Operations, 10fundraising-tech-ops: bonded/redundant network connections for fundraising hosts - https://phabricator.wikimedia.org/T171962#3571236 (10Jgreen) We started testing on mintaka, here's what changed: 1) @ayounsi enabled ge-0/0/11 and added description mintaka:eth1 2) @jgreen did (by... [19:33:18] 10netops, 10Operations, 10fundraising-tech-ops: bonded/redundant network connections for fundraising hosts - https://phabricator.wikimedia.org/T171962#3571237 (10Jgreen) @ayounsi also enabled and labeled frdb2001/eth1's switch port. [19:46:59] 10Traffic, 10Operations: Fix broken referer categorization for visits from Safari browsers - https://phabricator.wikimedia.org/T154702#3571269 (10TheDJ) I have now tested this and the preview does indeed implement origin-when-cross-origin as directed by our meta referrer header.