[14:13:03] 10Traffic, 10Operations: cp3032 ethernet link down (bnx2x dump in the dmesg) - https://phabricator.wikimedia.org/T166758#3653616 (10BBlack) 05Open>03Resolved a:03BBlack Hasn't recurred AFAIK. Note this is similar to bnx2x dmesg we managed to induce on a bunch of upload@ulsfo machines via bad NUMA tuning... [14:13:53] 10Traffic, 10Operations, 10ops-esams: cp3021 failed disk sdb - https://phabricator.wikimedia.org/T148983#3653623 (10BBlack) [16:29:11] Hey, I submitted https://gerrit.wikimedia.org/r/#/c/381050/ for T175381 and was pointed here from puppet swat as it's a change for varnish. [16:29:12] T175381: Remove references to non-existent mfLazyLoadReferences cookies - https://phabricator.wikimedia.org/T175381 [16:33:11] eddiegp: it's been on my backlog to take a look at that, I've seen it [16:33:54] eddiegp: it's probably not a good puppetswat candidate though, we really need to make sure we sort out a few questions first so we're sure we're not facing some cache issues with that change [16:34:13] Oh nice, I'm just going to wait for your review then :) [16:34:39] I'm in a meeting at present, but I'll get back to you in ~30 mins or so if you're around :) [16:34:46] Yeah, I wasn't really sure where to go with it. [16:34:51] Okay, I'll be here. [17:08:21] eddiegp: yeah, so, my concern I was going to ask about was whether UAs were still sending the LazyLoad cookies (e.g. if turn-up happened by eventually having all clients send it, and they still are), in which case turning off the cache split code would effectively invalidate all the current cache contents. [17:09:30] eddiegp: but then I realized I really don't have to ask, I can just check heh. I ran some logging on a few cache frontends during the meeting, no such cookies are coming in at any appreciable rate I don't think. [17:10:17] eddiegp: so, I'll merge it up shortly [17:10:39] Good to hear that, I couldn't have answered it anyways. This is my first puppet patch and I was basically just looking for something "easy to do" (which this task was, given it already had an exact description of what code needs to be removed). ;) [17:11:14] Nice, thanks for that :) [17:12:35] yay for less custom varnish code :) [20:11:18] 10netops, 10Operations, 10fundraising-tech-ops, 10ops-codfw: vcp port down on fasw-c-codfw - https://phabricator.wikimedia.org/T177332#3655009 (10ayounsi) [20:11:34] 10netops, 10Operations, 10fundraising-tech-ops, 10ops-codfw: vcp port down on fasw-c-codfw - https://phabricator.wikimedia.org/T177332#3655022 (10ayounsi) [20:23:57] 10netops, 10Operations, 10fundraising-tech-ops, 10ops-eqiad: Interface error on fasw-c-eqiad:vcp-255/1/0 - https://phabricator.wikimedia.org/T177333#3655036 (10ayounsi)