[00:01:55] 06Fundraising-Backlog, 06FR-donorrelations: Outreach to the donors from T420651 - https://phabricator.wikimedia.org/T421534#11760415 (10MSuijkerbuijk_WMF) Sounds good to me @SHust to send this email to invite to reset the recurring gift. [00:15:07] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10FR-Donor-portal: Donor Portal - Wikiminute video issues on mobile devices - https://phabricator.wikimedia.org/T420782#11760418 (10AnnWF) @KHill-WMF 1: confirmed, and adjusted with the patch, 2: should we do the same for desktop user? I added one for... [00:16:04] (03PS1) 10Wfan: Add play icon for wikiminute and make the image adjustable in mobile [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1262384 (https://phabricator.wikimedia.org/T420782) [00:18:06] (03CR) 10CI reject: [V:04-1] Add play icon for wikiminute and make the image adjustable in mobile [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1262384 (https://phabricator.wikimedia.org/T420782) (owner: 10Wfan) [00:18:29] (03PS2) 10Wfan: Add play icon for wikiminute and make the image adjustable in mobile [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1262384 (https://phabricator.wikimedia.org/T420782) [00:21:04] (03CR) 10CI reject: [V:04-1] Add play icon for wikiminute and make the image adjustable in mobile [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1262384 (https://phabricator.wikimedia.org/T420782) (owner: 10Wfan) [00:22:44] (03PS3) 10Wfan: Add play icon for wikiminute and make the image adjustable in mobile [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1262384 (https://phabricator.wikimedia.org/T420782) [02:03:19] (03PS1) 10Eileen: Merge branch 'master' of https://gerrit.wikimedia.org/r/wikimedia/fundraising/crm into deployment [wikimedia/fundraising/crm] (deployment) - 10https://gerrit.wikimedia.org/r/1262478 [02:03:55] (03CR) 10Eileen: [C:03+2] Merge branch 'master' of https://gerrit.wikimedia.org/r/wikimedia/fundraising/crm into deployment [wikimedia/fundraising/crm] (deployment) - 10https://gerrit.wikimedia.org/r/1262478 (owner: 10Eileen) [02:04:57] (03Merged) 10jenkins-bot: Merge branch 'master' of https://gerrit.wikimedia.org/r/wikimedia/fundraising/crm into deployment [wikimedia/fundraising/crm] (deployment) - 10https://gerrit.wikimedia.org/r/1262478 (owner: 10Eileen) [02:27:52] !log civicrm upgraded from 7138d524 to 58426b1e [02:27:53] Logged the message at https://wikitech.wikimedia.org/wiki/Fundraising/SAL [02:51:51] 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 10FR-WMF-Audit, 05MW-1.46-notes (1.46.0-wmf.22; 2026-03-31), 13Patch-For-Review: Start populating auth_id & capture_id from ipns etc - https://phabricator.wikimedia.org/T421282#11760472 (10Eileenmcnaughton) @Ejegg another case where we have a misma... [02:53:17] ejegg: if you really are still working - I hit another weird one https://phabricator.wikimedia.org/T421282#11760471 [02:55:40] (03PS1) 10Ejegg: Update composer.lock for new SmashPig [core] (fundraising/REL1_43) - 10https://gerrit.wikimedia.org/r/1262533 [02:55:44] (03CR) 10Ejegg: [C:03+2] Update composer.lock for new SmashPig [core] (fundraising/REL1_43) - 10https://gerrit.wikimedia.org/r/1262533 (owner: 10Ejegg) [02:57:02] !log payments-wiki upgraded from d79a98b5 to b239a6b7 [02:57:03] Logged the message at https://wikitech.wikimedia.org/wiki/Fundraising/SAL [02:57:37] looking eileen [02:59:24] looks like they managed to donate twice in 2 seconds [02:59:36] searching with external_identifier in the gravy console shows them both [02:59:43] let's see how they did it [03:00:21] anyway, we should refund one of those [03:02:51] ejegg: yeah - that's also exactly the type I'm trying to ensure gets imported into Civi based on the audit report - I guess we are close - it knows it is missing now but it probably gets rejected in the donation queue processor [03:03:25] - also this script would probably find - https://gerrit.wikimedia.org/r/c/wikimedia/fundraising/SmashPig/+/1255126 [03:03:41] huh, i thought the donation queue processor would just add a |dup-xxx suffix to the invoice_id [03:03:57] if it got an extra message with a different gateway txn id [03:04:30] well they have the SAME gateway_txn_id - albeit different processor_reconciliation_id [03:04:41] oh, i bet opening up the IPN job runner's pending txn search to include resolved ones would have let the duplicates in to civi too [03:05:04] for this one I bet the first one to hit the listener got in, and set the message to resolved [03:05:33] then the second one coming in to the IPN listener didn't find anything because it's still searching for resolved=0 [03:06:55] hmm - I mean we WANT the duplicates in civi cos there are duplicates - but with the same order_id & different gateway_txn_id - in civi we have mismatched gateway_txn_id & payment_orchestrator_reconcilation_id [03:07:56] (03Merged) 10jenkins-bot: Update composer.lock for new SmashPig [core] (fundraising/REL1_43) - 10https://gerrit.wikimedia.org/r/1262533 (owner: 10Ejegg) [03:09:34] 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 10FR-WMF-Audit, 05MW-1.46-notes (1.46.0-wmf.22; 2026-03-31), 13Patch-For-Review: Start populating auth_id & capture_id from ipns etc - https://phabricator.wikimedia.org/T421282#11760485 (10Ejegg) There are two donations within 1 second of each other... [03:09:56] ohhhh the gateway_txn_id in civi doesn't match the recon id?? [03:10:45] hmm, I guess the IPN for the second charge might have been processed before the IPN for the first charge [03:11:50] and since we didn't send the recon ID from payments, it combined the recon ID from the IPN with the rest of the pending message from payments, just based on the order_id match [03:12:25] bah, I guess we should really be tagging every single field with its own 'source' not the message as a whole [03:13:01] so we should send the reconciliation ID from payments too, just for consistency [03:18:04] oh huh, looks like we DO send it from payments wiki [03:18:13] let's see if it got into the pending row [03:18:52] though... with both transactions happening simultaneously in the same session, i wonder if that could have crossed the streams right there [03:19:26] anyway, that payments-wiki deploy seems not to have broken cards or paypal [03:19:45] and should start getting better backend IDs in for the bank transfer methods [03:20:06] ejegg: we do have a helper to convert between the 2 gravy IDs we could use [03:20:10] i'll dig into that mystery more on monday [03:20:32] ok cool - this seems to be the thing that has snuck up & derailed us [03:25:58] well, the two pending blobs logged in payments-wiki are internally consistent [03:26:57] are there any log_wmf_contribution_extra rows showing an update? [03:28:02] oh hey, there are two pending rows [03:29:21] right, so the IPN message lookup should 1) match on both order_id and gateway_id if both are present [03:29:49] and 2) ignore resolved=1 [03:31:33] 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 10FR-WMF-Audit, 05MW-1.46-notes (1.46.0-wmf.22; 2026-03-31), 13Patch-For-Review: Start populating auth_id & capture_id from ipns etc - https://phabricator.wikimedia.org/T421282#11760489 (10Ejegg) Also, there are two rows in the pending table, each i... [03:31:35] OK, I really do need to |away now [03:31:38] see ya!