[09:04:48] FIRING: PuppetFailure: Puppet has failed on logging-hd2005:9100 - https://puppetboard.wikimedia.org/nodes?status=failed - https://grafana.wikimedia.org/d/yOxVDGvWk/puppet - https://alerts.wikimedia.org/?q=alertname%3DPuppetFailure [10:14:48] RESOLVED: PuppetFailure: Puppet has failed on logging-hd2005:9100 - https://puppetboard.wikimedia.org/nodes?status=failed - https://grafana.wikimedia.org/d/yOxVDGvWk/puppet - https://alerts.wikimedia.org/?q=alertname%3DPuppetFailure [11:58:48] FIRING: PuppetFailure: Puppet has failed on graphite1005:9100 - https://puppetboard.wikimedia.org/nodes?status=failed - https://grafana.wikimedia.org/d/yOxVDGvWk/puppet - https://alerts.wikimedia.org/?q=alertname%3DPuppetFailure [12:28:48] RESOLVED: PuppetFailure: Puppet has failed on graphite1005:9100 - https://puppetboard.wikimedia.org/nodes?status=failed - https://grafana.wikimedia.org/d/yOxVDGvWk/puppet - https://alerts.wikimedia.org/?q=alertname%3DPuppetFailure [18:16:05] cwhite do y'all have a repo for your opensearch 2.7 packages? I was wondering if y'all were using `opensearch-min` from https://opensearch.org/artifacts/by-version/#release-2-19-5 which I just became aware of [18:44:28] inflatador: we are using upstream's normal release deb packages. Haven't looked at alternatives. [18:45:14] We're also in the process of configuring the security plugin because it makes sense for our use case. [18:45:19] cwhite ah, I thought y'all rolled your own from before a deb pkg was offered by upstream? Or maybe I hallucinated that converation ;) [18:45:40] we did roll our own before deb packages were offered [18:46:11] but since they started offering one, we've migrated to theirs [18:46:20] ah OK, that clears it up, thanks [18:46:32] re: security plugin, I wrote a blog post about it awhile back https://closedwontfix.it/forming-an-opensearch-2-cluster-with-transport-security-enabled-mtls-and-a-custom-certificate-authority-part-1-of-2.html [18:47:03] I think I'm wrong about OS using the transport port rather than the HTTP port, other than that I think I'm right ;) [18:48:44] Nice! I'll have a look while we're transitioning the beta cluster which is coming soon! :)