[00:34:19] <wikibugs>	 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 07payments-orchestration: Log 'pending' details JSON blob for all authorized Gravy transactions - https://phabricator.wikimedia.org/T392156#10872885 (10AnnWF) a:05AnnWF→03None
[01:02:45] <wikibugs>	 06Fundraising-Backlog: Gravy dLocal placeholder fiscal numbers - https://phabricator.wikimedia.org/T395361#10872909 (10AnnWF)
[01:27:43] <wikibugs>	 (03PS1) 10Wfan: remove tax id from dlocal and gravy dlocal countries test link [wikimedia/fundraising/dev] - 10https://gerrit.wikimedia.org/r/1152385 (https://phabricator.wikimedia.org/T395361)
[01:42:23] <wikibugs>	 (03PS1) 10Wfan: add placeholder for gravy dlocal [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1152387 (https://phabricator.wikimedia.org/T395361)
[01:42:34] <wikibugs>	 (03CR) 10Wfan: [V:03+2 C:03+2] remove tax id from dlocal and gravy dlocal countries test link [wikimedia/fundraising/dev] - 10https://gerrit.wikimedia.org/r/1152385 (https://phabricator.wikimedia.org/T395361) (owner: 10Wfan)
[01:49:57] <wikibugs>	 (03PS2) 10Wfan: Use placeholder for gravy dlocal tax ID [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1152387 (https://phabricator.wikimedia.org/T395361)
[01:50:34] <wikibugs>	 03Fundraising Sprint: Jollof Rice, 06Fundraising-Backlog, 13Patch-For-Review: Gravy dLocal placeholder fiscal numbers - https://phabricator.wikimedia.org/T395361#10872927 (10AnnWF)
[05:25:17] <icinga-wm>	 PROBLEM - check_load on frban2002 is CRITICAL: LOAD CRITICAL - total load average: 117.29, 94.29, 48.68 https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frban2002&service=check_load
[05:30:17] <icinga-wm>	 PROBLEM - check_load on frban2002 is CRITICAL: LOAD CRITICAL - total load average: 99.24, 101.58, 64.66 https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frban2002&service=check_load
[05:35:17] <icinga-wm>	 PROBLEM - check_load on frban2002 is CRITICAL: LOAD CRITICAL - total load average: 30.35, 65.28, 60.35 https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frban2002&service=check_load
[05:40:17] <icinga-wm>	 PROBLEM - check_load on frban2002 is CRITICAL: LOAD CRITICAL - total load average: 2.60, 28.13, 45.96 https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frban2002&service=check_load
[05:45:17] <icinga-wm>	 PROBLEM - check_load on frban2002 is CRITICAL: LOAD CRITICAL - total load average: 7.39, 12.71, 34.18 https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frban2002&service=check_load
[06:00:39] <dwisehaupt>	 howdy. kafkatee is chewing away on frban2002.
[06:03:06] <dwisehaupt>	 looks like there was a prod spike of ~1mil req/s about 40 mins ago. which is a far cry above the normal 110-115k.
[06:03:28] <dwisehaupt>	 so nothing broken on our end. just probably dealing with the backlog
[06:10:17] <icinga-wm>	 RECOVERY - check_load on frban2002 is OK: LOAD OK - total load average: 1.79, 2.88, 9.31 https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frban2002&service=check_load
[14:52:07] <icinga-wm>	 PROBLEM - check_disk on frdb2003 is CRITICAL: DISK CRITICAL - free space: /srv 499251MiB (10% inode=99%): /dev 257270MiB (100% inode=99%): /run 51457MiB (99% inode=99%): / 4631MiB (66% inode=89%): /dev/shm 257297MiB (100% inode=99%): /run/lock 5MiB (100% inode=99%): /boot 561MiB (82% inode=99%): /home 8319MiB (67% inode=99%): /tmp 12350MiB (99% inode=99%): /var 25646MiB (96% inode=99%): /var/log 23679MiB (89% inode=99%): /var/tmp 408MiB 
[14:52:08] <icinga-wm>	 e=99%): /var/log/audit 408MiB (99% inode=99%): /run/user/16798 51459MiB (100% inode=99%): https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb2003&service=check_disk
[15:27:07] <icinga-wm>	 RECOVERY - check_disk on frdb2003 is OK: DISK OK - free space: /srv 987330MiB (21% inode=99%): /dev 257270MiB (100% inode=99%): /run 51457MiB (99% inode=99%): / 4631MiB (66% inode=89%): /dev/shm 257297MiB (100% inode=99%): /run/lock 5MiB (100% inode=99%): /boot 561MiB (82% inode=99%): /home 8319MiB (67% inode=99%): /tmp 12350MiB (99% inode=99%): /var 25646MiB (96% inode=99%): /var/log 23679MiB (89% inode=99%): /var/tmp 408MiB (99% inode=
[15:27:08] <icinga-wm>	 r/log/audit 408MiB (99% inode=99%): /run/user/16798 51459MiB (100% inode=99%): https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb2003&service=check_disk