[08:32:29] <dcaro>	 morning
[08:40:03] <arturo>	 o/
[10:03:40] <blancadesal>	 morning
[10:09:31] <arturo>	 I have scheduled a tofu-infra dedicated meeting later today for the team, so we can sync and try to get on the same 
[10:15:44] <dhinus>	 arturo: thanks, I also added a comment to T380310
[10:15:45] <stashbot>	 T380310: opentofu shouldn't delete openstack resources - https://phabricator.wikimedia.org/T380310
[10:18:37] <dhinus>	 unrelated: puppet was disabled in toolsbeta-harbor-2, but why is puppet failing on toolsbeta-harbor-1? 
[10:18:44] <dhinus>	 it looks like it's a DNS issue
[10:20:16] <dhinus>	 oh I think it might be another instance of T379927
[10:20:16] <stashbot>	 T379927: Puppet removed "nameserver" line from /etc/resolv.conf - https://phabricator.wikimedia.org/T379927
[10:21:36] <dhinus>	 yep that fixed it
[10:24:44] <dcaro>	 that might have fixed T379633
[10:24:45] <stashbot>	 T379633: unable to log-in to toolsbeta-harbor-1 - https://phabricator.wikimedia.org/T379633
[10:24:48] <dcaro>	 yep
[10:49:26] <dcaro>	 quick review https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/611
[10:53:23] <dhinus>	 +1d, thanks for keeping that diagram up to date
[10:57:21] * dcaro lunch
[13:30:56] <dcaro>	 a couple easy reviews https://gitlab.wikimedia.org/repos/cloud/toolforge/components-api/-/merge_requests?label_name%5B%5D=Needs+review
[13:43:00] <dcaro>	 and another easy one https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/613
[13:57:35] <dhinus>	 dcaro: +1d
[13:58:17] <dcaro>	 thanks! I have more small MRs if you want xd
[14:01:43] <dcaro>	 https://gitlab.wikimedia.org/repos/cloud/toolforge/api-gateway/-/merge_requests/53 https://gitlab.wikimedia.org/repos/cloud/toolforge/components-api/-/merge_requests/41 https://gitlab.wikimedia.org/repos/cloud/toolforge/components-api/-/merge_requests/40 and https://gerrit.wikimedia.org/r/c/operations/puppet/+/1093339 are pretty small/easy to review (I think)
[14:43:39] <dcaro>	 topranks: hi! I'm looking into moving out of graphite for the ceph dashboards, can you remind me where can I find the new stats for interfaces on the switches?
[14:43:53] <dcaro>	 (iirc you had started using them somewhere)
[14:55:30] <dcaro>	 I think I found it https://grafana-rw.wikimedia.org/d/d968a627-b6f6-47fc-9316-e058854a4945/network-interface-throughput-gnmi
[15:19:58] <dcaro>	 another easy review https://gitlab.wikimedia.org/repos/cloud/toolforge/lima-kilo/-/merge_requests/215
[15:58:00] <topranks>	 dcaro: sorry been in meetings 
[15:58:18] <topranks>	 yes that dashboard and these two have some good examples: 
[15:58:23] <topranks>	 https://grafana.wikimedia.org/d/iUATvNzSz/network-queues?orgId=1
[15:58:34] <topranks>	 https://grafana.wikimedia.org/d/f61a7d56-e132-44dc-b9da-d722b11566cf/network-totals-by-site?orgId=1&refresh=30s
[15:59:21] <topranks>	 The stats are mostly correct but we do see occasional gaps for some reason, we are planning to work with o11y to make it more robust and scale it out to capture more metrics 
[15:59:56] <topranks>	 I tend to use them by default over librenms now - they have more granularity that librenms/graphite which should help 
[16:44:04] <arturo>	 I will send an email with a summary of the conversation we had regarding tofu, to cloud-admin@
[16:46:16] <dcaro>	 idp.wikimedia.org is not working for me, anyone has the same issue?
[16:46:53] <arturo>	 dcaro: also not loading here, from firefox in my laptop
[16:47:21] <dcaro>	 oh, getting 503 now
[17:06:26] * arturo offline
[18:42:48] * dcaro off