[00:09:02] FIRING: SystemdUnitFailed: prometheus_arelion_exporter.service on netmon1003:9100 - https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state - https://grafana.wikimedia.org/d/g-AaZRFWk/systemd-status - https://alerts.wikimedia.org/?q=alertname%3DSystemdUnitFailed [04:09:02] FIRING: SystemdUnitFailed: prometheus_arelion_exporter.service on netmon1003:9100 - https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state - https://grafana.wikimedia.org/d/g-AaZRFWk/systemd-status - https://alerts.wikimedia.org/?q=alertname%3DSystemdUnitFailed [07:14:59] 10netops, 06Infrastructure-Foundations: codfw: upgrade routers (2026) - https://phabricator.wikimedia.org/T417871#12383679 (10cmooney) >>! In T417871#12382617, @Papaul wrote: > I spoke with @ssingh and @BCornwall to see if we can schedule the core routers Junos upgrade next week Wednesday at 9am CT, @ssingh wi... [08:09:02] FIRING: SystemdUnitFailed: prometheus_arelion_exporter.service on netmon1003:9100 - https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state - https://grafana.wikimedia.org/d/g-AaZRFWk/systemd-status - https://alerts.wikimedia.org/?q=alertname%3DSystemdUnitFailed [08:34:02] RESOLVED: SystemdUnitFailed: prometheus_arelion_exporter.service on netmon1003:9100 - https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state - https://grafana.wikimedia.org/d/g-AaZRFWk/systemd-status - https://alerts.wikimedia.org/?q=alertname%3DSystemdUnitFailed [08:34:46] https://gerrit.wikimedia.org/r/c/operations/puppet/+/1347412 is the proper fix for ^ [08:39:02] FIRING: SystemdUnitFailed: prometheus_arelion_exporter.service on netmon1003:9100 - https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state - https://grafana.wikimedia.org/d/g-AaZRFWk/systemd-status - https://alerts.wikimedia.org/?q=alertname%3DSystemdUnitFailed [12:02:56] 10netops, 06Infrastructure-Foundations, 06SRE: Missing series for BGP session_state from eqiad CRs since upgrade to 23.4R2-S8.7 - https://phabricator.wikimedia.org/T435909#12384669 (10cmooney) [12:09:02] RESOLVED: SystemdUnitFailed: prometheus_arelion_exporter.service on netmon1003:9100 - https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state - https://grafana.wikimedia.org/d/g-AaZRFWk/systemd-status - https://alerts.wikimedia.org/?q=alertname%3DSystemdUnitFailed [14:25:53] 10netbox, 06Infrastructure-Foundations: Upgrade Netbox to 4.7.x - https://phabricator.wikimedia.org/T371889#12385490 (10cmooney) [14:26:22] 10netops, 06Infrastructure-Foundations: Junos: investigate BGP rib sharding - https://phabricator.wikimedia.org/T320264#12385509 (10ayounsi) [14:27:23] 10netops, 06Infrastructure-Foundations: eqsin: upgrade routers (2026) - https://phabricator.wikimedia.org/T416563#12385519 (10ayounsi) Let's use the upgrade opportunity to enable BGP RIB sharding on cr2-eqsin {T320264} [14:27:36] 10netops, 06Infrastructure-Foundations: codfw: upgrade routers (2026) - https://phabricator.wikimedia.org/T417871#12385522 (10ayounsi) Let's use the upgrade opportunity to enable BGP RIB sharding on one of the two routers {T320264} [14:27:58] 10netops, 06Infrastructure-Foundations: eqiad: upgrade routers (2026) - https://phabricator.wikimedia.org/T417873#12385524 (10ayounsi) [14:28:54] 10netops, 06Infrastructure-Foundations: eqiad: upgrade routers (2026) - https://phabricator.wikimedia.org/T417873#12385527 (10ayounsi) [14:29:28] 10netops, 06Infrastructure-Foundations: eqiad: upgrade routers (2026) - https://phabricator.wikimedia.org/T417873#12385529 (10ayounsi) The new JTAC recommended version for the SRX300 is now Junos 24.4R2-S3. [14:31:26] 10netops, 06Infrastructure-Foundations: eqiad: upgrade routers (2026) - https://phabricator.wikimedia.org/T417873#12385550 (10ayounsi) a:05cmooney→03Papaul @papaul, are you (or someone else in DCops) ok to take care of mr1-eqiad?