[03:11:29] <wikibugs>	 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog: Rejected transactions still getting recurring queue messages - https://phabricator.wikimedia.org/T403024#11178228 (10Ejegg) I think the switch to return new Failure rather than new Success on fraud fail will clear these up as soon as it's deployed:  https...
[03:15:24] <wikibugs>	 06Fundraising-Backlog, 06Fundraising-Tech-Roadmap, 07payments-orchestration: Setup Gravy Adyen AutoRescue - https://phabricator.wikimedia.org/T378630#11178235 (10Ejegg) Hi @MSuijkerbuijk_WMF , as far as I recall Gravy still needs to do some work on their side.
[03:18:28] <wikibugs>	 06Fundraising-Backlog, 06Fundraising-Tech-Roadmap, 07payments-orchestration: Setup Gravy Adyen AutoRescue - https://phabricator.wikimedia.org/T378630#11178240 (10Ejegg) It's being tracked in this big ol' Google Sheet, currently on row 15. Target date for them to deliver full auto-rescue functionality is comi...
[06:38:18] <icinga-wm>	 PROBLEM - check_load on frav1003 is CRITICAL: LOAD CRITICAL - total load average: 30.62, 13.90, 8.50 https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frav1003&service=check_load
[06:43:16] <icinga-wm>	 RECOVERY - check_load on frav1003 is OK: LOAD OK - total load average: 6.09, 11.71, 9.32 https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frav1003&service=check_load
[15:12:08] <icinga-wm>	 PROBLEM - check_disk on frdb2003 is CRITICAL: DISK CRITICAL - free space: /srv 499715MiB (10% inode=99%): /dev 257270MiB (100% inode=99%): /run 51457MiB (99% inode=99%): / 4419MiB (63% inode=89%): /dev/shm 257297MiB (100% inode=99%): /run/lock 5MiB (100% inode=99%): /boot 561MiB (82% inode=99%): /home 8311MiB (67% inode=99%): /tmp 12350MiB (99% inode=99%): /var 25551MiB (96% inode=99%): /var/log 23658MiB (89% inode=99%): /var/tmp 408MiB 
[15:12:08] <icinga-wm>	 e=99%): /var/log/audit 408MiB (99% inode=99%): https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb2003&service=check_disk
[15:17:08] <icinga-wm>	 RECOVERY - check_disk on frdb2003 is OK: DISK OK - free space: /srv 738135MiB (16% inode=99%): /dev 257270MiB (100% inode=99%): /run 51457MiB (99% inode=99%): / 4419MiB (63% inode=89%): /dev/shm 257297MiB (100% inode=99%): /run/lock 5MiB (100% inode=99%): /boot 561MiB (82% inode=99%): /home 8311MiB (67% inode=99%): /tmp 12350MiB (99% inode=99%): /var 25551MiB (96% inode=99%): /var/log 23658MiB (89% inode=99%): /var/tmp 408MiB (99% inode=
[15:17:08] <icinga-wm>	 r/log/audit 408MiB (99% inode=99%): https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb2003&service=check_disk