[00:31:05] FIRING: [3x] PuppetConstantChange: Puppet performing a change on every puppet run on cumin1002:9100 - https://puppetboard.wikimedia.org/nodes?status=changed - https://grafana.wikimedia.org/d/yOxVDGvWk/puppet - https://alerts.wikimedia.org/?q=alertname%3DPuppetConstantChange [04:31:05] FIRING: [3x] PuppetConstantChange: Puppet performing a change on every puppet run on cumin1002:9100 - https://puppetboard.wikimedia.org/nodes?status=changed - https://grafana.wikimedia.org/d/yOxVDGvWk/puppet - https://alerts.wikimedia.org/?q=alertname%3DPuppetConstantChange [08:14:38] 10netops, 06Infrastructure-Foundations: FPC1 Failure on cr1-esams - take 2 - https://phabricator.wikimedia.org/T403360 (10ayounsi) 03NEW p:05Triage→03High [08:31:05] FIRING: [3x] PuppetConstantChange: Puppet performing a change on every puppet run on cumin1002:9100 - https://puppetboard.wikimedia.org/nodes?status=changed - https://grafana.wikimedia.org/d/yOxVDGvWk/puppet - https://alerts.wikimedia.org/?q=alertname%3DPuppetConstantChange [08:46:49] 10netops, 06Infrastructure-Foundations: FPC1 Failure on cr1-esams - take 2 - https://phabricator.wikimedia.org/T403360#11135283 (10ayounsi) JTAC case 2025-0901-838306 opened. [12:31:05] FIRING: [3x] PuppetConstantChange: Puppet performing a change on every puppet run on cumin1002:9100 - https://puppetboard.wikimedia.org/nodes?status=changed - https://grafana.wikimedia.org/d/yOxVDGvWk/puppet - https://alerts.wikimedia.org/?q=alertname%3DPuppetConstantChange [14:40:45] 10netops, 06DC-Ops, 06Infrastructure-Foundations, 06SRE: ssw1-f1-eqiad: Fan Spinning Upgraded - https://phabricator.wikimedia.org/T400783#11136677 (10ayounsi) p:05Triage→03Low [14:56:46] 10homer, 10SRE-tools, 06Infrastructure-Foundations: Homer: add parallelization support - https://phabricator.wikimedia.org/T250415#11136718 (10ayounsi) p:05High→03Medium Lowering the priority as this has been working fine. [16:31:05] FIRING: [3x] PuppetConstantChange: Puppet performing a change on every puppet run on cumin1002:9100 - https://puppetboard.wikimedia.org/nodes?status=changed - https://grafana.wikimedia.org/d/yOxVDGvWk/puppet - https://alerts.wikimedia.org/?q=alertname%3DPuppetConstantChange [19:47:18] 10netops, 06Infrastructure-Foundations: FPC1 Failure on cr1-esams - take 2 - https://phabricator.wikimedia.org/T403360#11137375 (10ayounsi) JTAC replied saying that a linecard reboot could fix the issue. I did it (see SAL above), so far still working fine, will check tomorrow morning. [20:31:05] FIRING: [3x] PuppetConstantChange: Puppet performing a change on every puppet run on cumin1002:9100 - https://puppetboard.wikimedia.org/nodes?status=changed - https://grafana.wikimedia.org/d/yOxVDGvWk/puppet - https://alerts.wikimedia.org/?q=alertname%3DPuppetConstantChange