[01:10:55] 10Domains, 10Traffic, 10Okapi, 10SRE: Subdomain Request - OKAPI - https://phabricator.wikimedia.org/T276585 (10RBrounley_WMF) @Reedy, no it's not a duplicate and that ticket should be deleted. @Aklapper, what's the best way to delete T269686? [01:11:44] 10Domains, 10Traffic, 10Okapi, 10SRE: Subdomain Request - OKAPI - https://phabricator.wikimedia.org/T276585 (10Reedy) >>! In T276585#6903159, @RBrounley_WMF wrote: > @Reedy, no it's not a duplicate and that ticket should be deleted. @Aklapper, what's the best way to delete T269686? You can't delete ticket... [01:12:25] 10Traffic, 10DNS, 10Okapi, 10SRE: Create three Okapi sub-domains (okapi*.wikimedia.org) - https://phabricator.wikimedia.org/T269686 (10RBrounley_WMF) 05Open→03Invalid [01:12:52] 10Domains, 10Traffic, 10Okapi, 10SRE: Subdomain Request - OKAPI - https://phabricator.wikimedia.org/T276585 (10RBrounley_WMF) Done. Thanks @Reedy [07:06:13] vgutierrez: o/ hola, I see that we have a lot of warnings from cp nodes for the wikiworkshops tls cert, and acme-chief on 1001 seems to tell that the cert will is currently "Stage" until the 17th [07:22:28] That's expected [07:22:39] We can safely ack those [07:22:53] I'll do that as soon as I step off the bike [10:12:00] 10netops: Auhoritative ports list - https://phabricator.wikimedia.org/T277146 (10ayounsi) p:05Triage→03Low [11:00:14] 10netops, 10SRE, 10Patch-For-Review: Auhoritative ports list - https://phabricator.wikimedia.org/T277146 (10jbond) this came up before as a minor ask and i used it to create a PoC which used [[ https://gerrit.wikimedia.org/r/c/operations/puppet/+/559536 | custom types ]]. Ultimately i abandoned that as i fe... [12:15:43] vgutierrez: can you gievt eh following a review if you get a sec https://gerrit.wikimedia.org/r/c/operations/puppet/+/670424 [12:16:33] sure [12:16:38] thx [13:27:03] vgutierrez: hello :) Can I interest you in some mucking-about with pybal? [14:02:30] klausman: let's do some pre-work and list what we are going to restart (list of low-traffic standby first, then active ones) [14:18:39] I think the primary in eqiad is lvs1015, secondary lvs1016 [14:19:06] And in codfw its: p: lvs2009 s: lvs2010 [14:25:08] checking [14:27:26] +1 makes sense, the restart should happen in this order: 2010 1016 2009 1015 [14:28:05] that sounds right, even though I couldn't see the lines above "checking" :) [14:28:44] Ok to merge https://gerrit.wikimedia.org/r/c/operations/puppet/+/670818 ? [14:29:38] but yes, that would be a reasonable order in which to carefully restart pybals on core-dc lvses for a new low-traffic service [14:29:43] new service for the kubemasters of the ml cluster, brand new thing [14:33:28] yeah, that makes sense [14:34:51] thanks for the feedback! [14:34:59] anything against us proceeding? [14:35:14] not from my side [14:53:52] ipvsadm output looks good [14:54:49] if so +1 to proceed with 2009 [14:56:26] doen. ipvsadm output still looking good. [15:01:13] 2009 is all green in Icinga, proceed with 1015? [15:03:41] Ok, 1015 also done. [15:04:55] And all green [15:24:10] awesome [17:44:19] 10Traffic, 10InternetArchiveBot, 10SRE, 10Platform Team Workboards (Clinic Duty Team): IAbot sending a huge volume of action=raw requests - https://phabricator.wikimedia.org/T269914 (10jijiki) @Cyberpower678 Please disable the bot until this issue is fixed [17:49:11] 10Traffic, 10InternetArchiveBot, 10SRE, 10Platform Team Workboards (Clinic Duty Team): IAbot sending a huge volume of action=raw requests (HTTP 415 errors) - https://phabricator.wikimedia.org/T269914 (10jijiki)