[01:07:06] 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 07Unplanned-Sprint-Work: Activity import issues - https://phabricator.wikimedia.org/T399230#11029768 (10Eileenmcnaughton) Yep - if @Jsimmonds can try again in August (probably from about the middle of the month) [01:10:13] PROBLEM - check_load on fran2001 is CRITICAL: LOAD CRITICAL - total load average: 33.54, 25.51, 13.62 https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=fran2001&service=check_load [01:35:09] RECOVERY - check_load on fran2001 is OK: LOAD OK - total load average: 0.23, 0.75, 4.49 https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=fran2001&service=check_load [01:51:28] 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM: WMFDonor updates in WMF Thank you are unexpected - https://phabricator.wikimedia.org/T400309 (10Eileenmcnaughton) 03NEW [02:08:28] (03PS1) 10Eileen: Use apiv4 in updateWMFDonorLastDonation [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1172134 (https://phabricator.wikimedia.org/T400309) [02:12:41] (03PS1) 10Eileen: Update Contribution.get api call to v4 [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1172135 (https://phabricator.wikimedia.org/T400309) [02:48:48] 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 13Patch-For-Review: WMFDonor updates in WMF Thank you are unexpected - https://phabricator.wikimedia.org/T400309#11029833 (10Eileenmcnaughton) So what seems to be happening is that we have 2 records created when a contribution is created - Contribution... [02:50:55] 06Fundraising-Backlog, 06Fundraising-Tech-Roadmap, 10Wikimedia-Fundraising-CiviCRM, 07fr-acoustic: Populating both_funds_latest_donation_source field - https://phabricator.wikimedia.org/T379700#11029835 (10Eileenmcnaughton) Erm - we haven't 'started' on it in a meaningful way - Anil is trying to figure out... [03:59:51] 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM: Utilise new Default Autocomplete functionality - https://phabricator.wikimedia.org/T400312 (10Eileenmcnaughton) 03NEW [04:41:35] (03PS1) 10Eileen: Set timeout on sftp connection as well as guzzle [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1172169 [06:12:09] PROBLEM - check_memory on fransw2001 is CRITICAL: CRIT Memory 98% used. Largest process: trino-server-co (2833026) = 97.1% https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=fransw2001&service=check_memory [06:17:09] PROBLEM - check_memory on fransw2001 is CRITICAL: CRIT Memory 98% used. Largest process: trino-server-co (2833026) = 97.1% https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=fransw2001&service=check_memory [06:22:09] PROBLEM - check_memory on fransw2001 is CRITICAL: CRIT Memory 98% used. Largest process: trino-server-co (2833026) = 97.1% https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=fransw2001&service=check_memory [06:27:09] RECOVERY - check_memory on fransw2001 is OK: OK Memory 68% used https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=fransw2001&service=check_memory [09:13:15] PROBLEM - check_log_messages on frav1003 is CRITICAL: CRITICAL: check_endpoints_critical (Paypal:2) 2 [=1] https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frav1003&service=check_log_messages [09:18:17] RECOVERY - check_log_messages on frav1003 is OK: OK https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frav1003&service=check_log_messages [13:48:55] (03Abandoned) 10Ejegg: Move Endowment-related MonthlyConvert logic into hook [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/647276 (https://phabricator.wikimedia.org/T269717) (owner: 10Ejegg) [14:20:16] (03PS2) 10Jgleeson: Extract error detection logic into dedicated ErrorChecker [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1167602 (https://phabricator.wikimedia.org/T387411) [14:20:25] (03CR) 10Ejegg: [C:03+2] "Looks like this checks for the failedPaymentStatus in more cases than previously, but I think that should be OK." [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1167602 (https://phabricator.wikimedia.org/T387411) (owner: 10Jgleeson) [14:20:55] (03Merged) 10jenkins-bot: Extract error detection logic into dedicated ErrorChecker [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1167602 (https://phabricator.wikimedia.org/T387411) (owner: 10Jgleeson) [14:30:17] 10fundraising-tech-ops: Fundraising access request for Hawa Ahmed - https://phabricator.wikimedia.org/T399009#11031483 (10AStein-WMF) looking at this now! [14:40:36] (03PS1) 10Ejegg: Add missing parens to constructor calls [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1172333 [14:40:38] (03CR) 10Ejegg: [C:03+2] Add missing parens to constructor calls [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1172333 (owner: 10Ejegg) [14:41:11] (03Merged) 10jenkins-bot: Add missing parens to constructor calls [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1172333 (owner: 10Ejegg) [17:10:23] 10fundraising-tech-ops: Replace fundraising LVS service with BIRD/HAProxy service - https://phabricator.wikimedia.org/T398321#11032313 (10Jgreen) p:05Triage→03High [17:11:21] 06Fundraising-Backlog, 06Wikipedia-Android-App-Backlog, 06Wikipedia-iOS-App-Backlog: Empty JSON response when requesting getPaymentMethods in payments.wikimedia.org - https://phabricator.wikimedia.org/T400201#11032317 (10Jgreen) 05Open→03Resolved a:03Jgreen Closing this because it was caused by a p... [17:11:30] 06Fundraising-Backlog, 06Wikipedia-Android-App-Backlog, 06Wikipedia-iOS-App-Backlog: Empty JSON response when requesting getPaymentMethods in payments.wikimedia.org - https://phabricator.wikimedia.org/T400201#11032321 (10Jgreen) p:05Triage→03High [18:20:18] 03Fundraising Sprint: Naan-Sequitur, 06Fundraising-Backlog, 07fr-current-sprint: Add browserInfo parameters to Gravy for Adyen 3DS flow compatibility - https://phabricator.wikimedia.org/T398845#11032499 (10EMartin) @dkozlowski. Any update on this task since Jack singed off last week? It's the last thing w... [18:27:00] 10Fundraising analytics stack: install and automate dbt-metabase package - https://phabricator.wikimedia.org/T389972#11032520 (10AStein-WMF) yup! [18:28:38] (03PS2) 10Ejegg: Relocate ErrorMapper from Mapper to Errors namespace [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1167603 (https://phabricator.wikimedia.org/T387411) (owner: 10Jgleeson) [18:30:46] (03PS3) 10Ejegg: Relocate ErrorMapper from Mapper to Errors namespace [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1167603 (https://phabricator.wikimedia.org/T387411) (owner: 10Jgleeson) [18:41:33] (03CR) 10Ejegg: [C:03+2] Relocate ErrorMapper from Mapper to Errors namespace [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1167603 (https://phabricator.wikimedia.org/T387411) (owner: 10Jgleeson) [18:42:03] (03Merged) 10jenkins-bot: Relocate ErrorMapper from Mapper to Errors namespace [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1167603 (https://phabricator.wikimedia.org/T387411) (owner: 10Jgleeson) [19:25:58] (03open) 10ejegg: Update csvimport extension to 1.17. [repos/fundraising-tech/community-civicrm] (labs_build) - 10https://gitlab.wikimedia.org/repos/fundraising-tech/community-civicrm/-/merge_requests/20 (https://phabricator.wikimedia.org/T400135) [19:26:18] (03close) 10ejegg: Update CSV import extension [repos/fundraising-tech/community-civicrm] - 10https://gitlab.wikimedia.org/repos/fundraising-tech/community-civicrm/-/merge_requests/19 [19:29:06] (03merge) 10ejegg: Update csvimport extension to 1.17. [repos/fundraising-tech/community-civicrm] (labs_build) - 10https://gitlab.wikimedia.org/repos/fundraising-tech/community-civicrm/-/merge_requests/20 (https://phabricator.wikimedia.org/T400135) [19:47:21] (03open) 10jgreen: Update csvimport extension to 1.17. [repos/fundraising-tech/community-civicrm] - 10https://gitlab.wikimedia.org/repos/fundraising-tech/community-civicrm/-/merge_requests/21 (https://phabricator.wikimedia.org/T400135) [19:49:20] (03merge) 10jgreen: Update csvimport extension to 1.17. [repos/fundraising-tech/community-civicrm] - 10https://gitlab.wikimedia.org/repos/fundraising-tech/community-civicrm/-/merge_requests/21 (https://phabricator.wikimedia.org/T400135) [20:04:13] 03Fundraising Sprint: Naan-Sequitur, 06Fundraising-Backlog, 07Unplanned-Sprint-Work: Benevity import not converting foreign currency matches to USD - https://phabricator.wikimedia.org/T399772#11032784 (10MDemosWMF) @Eileenmcnaughton We've run some files and the conversions seem to be working again! What do y... [20:37:52] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 06FR-donorrelations: Civi: multiple issues with recurring donations - https://phabricator.wikimedia.org/T399339#11032876 (10MBeat33) From talking at standup today and in Slack, it is worth sending an email to the approximately 6k donors whose recurring... [20:39:51] (03PS1) 10Ejegg: Ensure ACH 'chargeback' message is identifiable [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1172405 (https://phabricator.wikimedia.org/T397802) [20:40:18] eileen: are you around at all today? I think ^^^ might stop that refund queue failmail [20:40:27] I can explain on a call if needed [20:40:57] XenoRyet: or if you want to do a quick bit of CR to lower the failmail noise I can explain the context to you [20:48:06] hmmm, I think that's probably actually innocuous enough to self-merge [20:48:20] (03CR) 10Ejegg: [C:03+2] Ensure ACH 'chargeback' message is identifiable [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1172405 (https://phabricator.wikimedia.org/T397802) (owner: 10Ejegg) [20:48:53] (03Merged) 10jenkins-bot: Ensure ACH 'chargeback' message is identifiable [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1172405 (https://phabricator.wikimedia.org/T397802) (owner: 10Ejegg) [20:51:46] (03PS2) 10Ejegg: WIP: Add browser fingerprinting for Gravy 3D Secure (Cards) [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1166867 (https://phabricator.wikimedia.org/T398845) (owner: 10Jgleeson) [20:51:46] (03CR) 10Ejegg: "Looks like a good start! Some suggestions to make it more like the Adyen version." [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1166867 (https://phabricator.wikimedia.org/T398845) (owner: 10Jgleeson) [20:53:16] (03PS1) 10Ejegg: Merge branch 'master' into deployment [wikimedia/fundraising/SmashPig] (deployment) - 10https://gerrit.wikimedia.org/r/1172408 [20:53:55] 06Fundraising-Backlog: Helping Gr4vy with Venmo setup - https://phabricator.wikimedia.org/T400413 (10EMartin) 03NEW [21:09:57] 03Fundraising Sprint: Naan-Sequitur, 06Fundraising-Backlog, 07Unplanned-Sprint-Work: Benevity import not converting foreign currency matches to USD - https://phabricator.wikimedia.org/T399772#11033005 (10Eileenmcnaughton) Sadly I think deleting & reimporting those rows will be easier [21:33:26] ok, that seems to be working on locally [21:38:07] 03Fundraising Sprint: Naan-Sequitur, 06Fundraising-Backlog, 07Unplanned-Sprint-Work: Benevity import not converting foreign currency matches to USD - https://phabricator.wikimedia.org/T399772#11033078 (10MDemosWMF) @Eileenmcnaughton Ah ok, I made a [[ https://civicrm.wikimedia.org/civicrm/admin/search#/edit... [21:38:51] (03CR) 10Ejegg: [C:03+2] Merge branch 'master' into deployment [wikimedia/fundraising/SmashPig] (deployment) - 10https://gerrit.wikimedia.org/r/1172408 (owner: 10Ejegg) [21:39:15] (03Merged) 10jenkins-bot: Merge branch 'master' into deployment [wikimedia/fundraising/SmashPig] (deployment) - 10https://gerrit.wikimedia.org/r/1172408 (owner: 10Ejegg) [21:41:45] !log standalone (IPN listener) SmashPig upgraded from de30a87f to de092313 [21:41:48] Logged the message at https://wikitech.wikimedia.org/wiki/Server_Admin_Log [21:47:08] 06Fundraising-Backlog: Imports are stalled - need to manually push through - https://phabricator.wikimedia.org/T400419 (10MDemosWMF) 03NEW [21:50:27] ok, IPN logs still look fine [21:50:52] so there will be a few more of those failmails while we retry the messages from before the deploy [21:51:06] but hopefully we stop getting them after a few hours [21:55:20] right, let's tag the library version to get it up on payments too [21:57:33] (03PS1) 10Ejegg: Update SmashPig version [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1172417 [21:59:49] (03PS1) 10Ejegg: Merge branch 'master' into deployment [extensions/DonationInterface] (deployment) - 10https://gerrit.wikimedia.org/r/1172419 [21:59:51] (03CR) 10Ejegg: [C:03+2] Merge branch 'master' into deployment [extensions/DonationInterface] (deployment) - 10https://gerrit.wikimedia.org/r/1172419 (owner: 10Ejegg) [22:06:17] (03PS1) 10Ejegg: Update composer.lock for SmashPig 0.9.7.2 [core] (fundraising/REL1_43) - 10https://gerrit.wikimedia.org/r/1172420 [22:06:26] (03CR) 10Ejegg: [C:03+2] Update composer.lock for SmashPig 0.9.7.2 [core] (fundraising/REL1_43) - 10https://gerrit.wikimedia.org/r/1172420 (owner: 10Ejegg) [22:14:58] all the recent failmails for the refund queue are for messages sent a few hours before the deploy still [22:18:09] (03CR) 10CI reject: [V:04-1] Update composer.lock for SmashPig 0.9.7.2 [core] (fundraising/REL1_43) - 10https://gerrit.wikimedia.org/r/1172420 (owner: 10Ejegg) [22:25:55] (03CR) 10Ejegg: [C:03+2] Update SmashPig version [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1172417 (owner: 10Ejegg) [22:28:09] (03Merged) 10jenkins-bot: Update SmashPig version [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1172417 (owner: 10Ejegg) [22:28:10] (03Merged) 10jenkins-bot: Merge branch 'master' into deployment [extensions/DonationInterface] (deployment) - 10https://gerrit.wikimedia.org/r/1172419 (owner: 10Ejegg) [22:32:04] (03PS2) 10Ejegg: Update composer.lock for SmashPig 0.9.7.2 [core] (fundraising/REL1_43) - 10https://gerrit.wikimedia.org/r/1172420 [22:32:09] (03CR) 10Ejegg: Update composer.lock for SmashPig 0.9.7.2 [core] (fundraising/REL1_43) - 10https://gerrit.wikimedia.org/r/1172420 (owner: 10Ejegg) [22:43:01] (03Merged) 10jenkins-bot: Update composer.lock for SmashPig 0.9.7.2 [core] (fundraising/REL1_43) - 10https://gerrit.wikimedia.org/r/1172420 (owner: 10Ejegg)