[00:05:48] (03PS7) 10Eileen: Address notice when original_currency, not currency set [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1217842 (https://phabricator.wikimedia.org/T412612) [00:10:36] (03PS4) 10Eileen: Add handling for orphan reversals [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1243064 (https://phabricator.wikimedia.org/T418191) [00:10:55] (03PS3) 10Eileen: Add partial handling for adjustment scenario [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1243218 (https://phabricator.wikimedia.org/T417347) [00:54:42] FIRING: [2x] CoreRouterInterfaceDown: Core router interface down - pfw1-codfw:reth2 (fasw1-f5 2x25G) - https://wikitech.wikimedia.org/wiki/Network_monitoring#Router_interface_down - https://grafana.wikimedia.org/d/fb403d62-5f03-434a-9dff-bd02b9fff504/network-device-overview?var-instance=pfw1-codfw:9804 - https://alerts.wikimedia.org/?q=alertname%3DCoreRouterInterfaceDown [01:00:36] (03CR) 10Eileen: [C:03+2] Improve individual matching for imports [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1242446 (https://phabricator.wikimedia.org/T416233) (owner: 10Lars SG) [01:14:32] (03PS2) 10Eileen: Add validateBatch action [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1243247 [01:14:32] (03PS1) 10Eileen: Bring back some search kit changes I made on live [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1243295 [01:20:11] PROBLEM - check_load on fran2001 is CRITICAL: LOAD CRITICAL - total load average: 16.64, 26.00, 20.86 https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=fran2001&service=check_load [01:27:15] (03CR) 10Eileen: [V:03+2 C:03+2] Roll up of upstream cv changes since [wikimedia/fundraising/cv] - 10https://gerrit.wikimedia.org/r/1243179 (owner: 10Dwisehaupt) [01:29:30] (03PS1) 10Eileen: Update vendor [wikimedia/fundraising/cv] - 10https://gerrit.wikimedia.org/r/1243297 [01:30:22] (03CR) 10Eileen: [V:03+2 C:03+2] Update vendor [wikimedia/fundraising/cv] - 10https://gerrit.wikimedia.org/r/1243297 (owner: 10Eileen) [01:31:01] 06Fundraising-Backlog, 10fundraising-tech-ops, 10Wikimedia-Fundraising-CiviCRM: Update `cv` to latest upstream - https://phabricator.wikimedia.org/T417959#11649170 (10Eileenmcnaughton) OK - I added the vendor commit https://gerrit.wikimedia.org/r/c/wikimedia/fundraising/cv/+/1243297 So we should be good to... [01:31:55] (03CR) 10CI reject: [V:04-1] Add validateBatch action [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1243247 (owner: 10Eileen) [01:41:37] (03PS1) 10Eileen: Add direct mail upload channel, copy known GL codes to description [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1243299 (https://phabricator.wikimedia.org/T417842) [01:46:04] (03PS2) 10Eileen: Add direct mail upload channel, copy known GL codes to description [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1243299 (https://phabricator.wikimedia.org/T417842) [01:49:40] 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 10FR-Donation-Processing, 13Patch-For-Review: Engage <> Gr4vy for Direct Mail CC and ACH - https://phabricator.wikimedia.org/T417842#11649217 (10Eileenmcnaughton) The channel is there now - this patch ties up loose ends https://gerrit.wikimedia.org/r/... [01:55:09] RECOVERY - check_load on fran2001 is OK: LOAD OK - total load average: 1.78, 2.76, 4.60 https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=fran2001&service=check_load [02:01:37] 06Fundraising-Backlog, 10fundraising-tech-ops, 10Observability-Alerting: Shift frack alerting to use prometheus-alertmanager instead of icinga - https://phabricator.wikimedia.org/T367370#11649235 (10Dwisehaupt) [02:03:59] 06Fundraising-Backlog, 10fundraising-tech-ops: Fundraising access request for Adriana Vargas - https://phabricator.wikimedia.org/T418309#11649236 (10Dwisehaupt) [02:09:36] 06Fundraising-Backlog, 10fundraising-tech-ops: Fundraising access request for Adriana Vargas - https://phabricator.wikimedia.org/T418309#11649242 (10Dwisehaupt) a:03Dwisehaupt Access approval requested. [02:14:02] (03CR) 10Lars SG: [C:03+2] Add direct mail upload channel, copy known GL codes to description [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1243299 (https://phabricator.wikimedia.org/T417842) (owner: 10Eileen) [02:16:05] (03CR) 10Lars SG: [C:03+2] Bring back some search kit changes I made on live [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1243295 (owner: 10Eileen) [02:31:42] (03Merged) 10jenkins-bot: Add direct mail upload channel, copy known GL codes to description [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1243299 (https://phabricator.wikimedia.org/T417842) (owner: 10Eileen) [02:38:11] (03Merged) 10jenkins-bot: Bring back some search kit changes I made on live [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1243295 (owner: 10Eileen) [02:46:08] (03PS14) 10Wfan: Assign location type for 3rd party donaiton [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1237617 (https://phabricator.wikimedia.org/T416052) [03:10:28] (03PS8) 10Cstone: WIP: Handle phone number from the payments form [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1214236 (https://phabricator.wikimedia.org/T380106) [03:23:03] 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 10FR-WMF-Audit: Trustly - Gravy IDs unreliable in audit - https://phabricator.wikimedia.org/T418332 (10Eileenmcnaughton) 03NEW [03:32:13] (03CR) 10Cstone: [C:03+2] "Looks good to me, I think we could do with a couple brand new donation tests a lot are old" [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1217842 (https://phabricator.wikimedia.org/T412612) (owner: 10Eileen) [03:37:35] !log config revision changed from 390d6434 to a0228e6c turn off trustly audit [03:37:36] Logged the message at https://wikitech.wikimedia.org/wiki/Fundraising/SAL [03:44:04] (03PS2) 10Cstone: Make phone more unique for testing [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1243227 [03:44:33] (03CR) 10CI reject: [V:04-1] Make phone more unique for testing [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1243227 (owner: 10Cstone) [03:44:57] (03PS3) 10Cstone: Make phone more unique for testing [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1243227 [03:46:03] (03CR) 10Lars SG: [C:03+2] Make phone more unique for testing [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1243227 (owner: 10Cstone) [03:46:19] thanks larssandergreen ! [03:46:36] (03Merged) 10jenkins-bot: Make phone more unique for testing [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1243227 (owner: 10Cstone) [03:55:07] (03Merged) 10jenkins-bot: Address notice when original_currency, not currency set [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1217842 (https://phabricator.wikimedia.org/T412612) (owner: 10Eileen) [04:01:04] 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 10FR-WMF-Audit: Trustly - Gravy IDs unreliable in audit - https://phabricator.wikimedia.org/T418332#11649330 (10Eileenmcnaughton) Some data tidy up needed as small change in amount on 300 trustly transactions which were incorrectly matched using the ing... [04:07:07] (03PS9) 10Cstone: Handle phone number from the payments form [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1214236 (https://phabricator.wikimedia.org/T380106) [04:09:19] (03PS10) 10Cstone: Handle phone number from the payments form [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1214236 (https://phabricator.wikimedia.org/T380106) [04:12:06] (03PS1) 10Eileen: Try 2 variants of trxn_id for trustly gravy [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1243385 (https://phabricator.wikimedia.org/T418332) [04:19:59] (03CR) 10Eileen: Handle phone number from the payments form (031 comment) [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1214236 (https://phabricator.wikimedia.org/T380106) (owner: 10Cstone) [04:22:48] attempting to write a test for this too ^ [04:25:39] (03CR) 10Eileen: Handle phone number from the payments form (031 comment) [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1214236 (https://phabricator.wikimedia.org/T380106) (owner: 10Cstone) [04:31:39] (03PS1) 10Eileen: Basic phone consent test [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1243392 (https://phabricator.wikimedia.org/T380106) [04:32:20] (03PS11) 10Cstone: Handle phone number from the payments form [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1214236 (https://phabricator.wikimedia.org/T380106) [04:32:29] cstone: I wrote a basic one so I could step through it https://gerrit.wikimedia.org/r/c/wikimedia/fundraising/crm/+/1243392/1 [04:32:43] hah yeah eileen i just added one too im slow [04:33:02] i was trying to figure out how to dynamically get the source and location [04:33:12] but the source is a string right [04:33:15] yours is a bit more... [04:35:26] so I hit 3 things [04:35:26] 2 of them I commented on (only the question about strict comparison is material) [04:35:26] the other is not specific to your patch but is probably easier to fix now - the phone_consent table has a default value of 1 for master_recipient_id and the field is NOT NULL - not sure that makes sense here [04:35:46] oh hmm what is that field [04:36:32] (03PS12) 10Cstone: Handle phone number from the payments form [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1214236 (https://phabricator.wikimedia.org/T380106) [04:41:02] the other opt_in is doing a (bool)$this->getMessage()['Communication.opt_in'] === TRUE [04:46:22] (03PS1) 10Eileen: Fix phone_consent recipient_id incorrectly NULL [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1243398 (https://phabricator.wikimedia.org/T380106) [04:47:28] https://gerrit.wikimedia.org/r/c/wikimedia/fundraising/crm/+/1243398 should fix the master_recipient_id - item 3 above [04:50:16] is the master id the acoustic id? [04:53:02] yep [04:53:17] the original one - that might be orphaned [04:54:19] which original? [04:54:42] FIRING: [2x] CoreRouterInterfaceDown: Core router interface down - pfw1-codfw:reth2 (fasw1-f5 2x25G) - https://wikitech.wikimedia.org/wiki/Network_monitoring#Router_interface_down - https://grafana.wikimedia.org/d/fb403d62-5f03-434a-9dff-bd02b9fff504/network-device-overview?var-instance=pfw1-codfw:9804 - https://alerts.wikimedia.org/?q=alertname%3DCoreRouterInterfaceDown [04:55:12] The original when the opt in comes via Acousticv [04:55:17] so ok to be NULL here [04:59:17] uhg my internet hates me how do I check that it doesnt make a database entry in the test [04:59:20] there has to be one in here doing this [05:00:49] what are you trying to check? [05:01:09] the opt_in = 0 situation [05:03:00] can you retrieve the consent like this? https://gerrit.wikimedia.org/r/c/wikimedia/fundraising/crm/+/1243392/1/ext/wmf-civicrm/tests/phpunit/Civi/WMFQueue/DonationQueueTest.php [05:03:20] yeah that works fine [05:03:58] (03PS3) 10Eileen: Add validateBatch action [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1243247 [05:04:06] i guess its fine just thought it would be helpful when changing the code but its not being helpful [05:05:52] lol [05:06:17] let me know when you are ready for me to look again - my main worry was that === 1 vs string 1 [05:06:38] yeah ill switch it to match what the opt_in is doing I thought i had matched it but nope [05:07:06] was going to rebase over your upgrade but got a helpful [05:07:07] Civi\Core\Exception\DBQueryException: DB Error: syntax error in /srv/civi-sites/wmf/vendor/pear/pear-core-minimal/src/PEAR.php on line 947 [05:07:07] - DB_Error: DB Error: syntax error in unknown on line unknown [05:07:41] more helpful [05:07:41] Civi\Core\Exception\DBQueryException: DB Error: syntax error in /srv/civi-sites/wmf/vendor/pear/pear-core-minimal/src/PEAR.php on line 947 [05:07:41] - DB_Error: DB Error: syntax error in unknown on line unknown [05:07:45] fail [05:07:54] near '= 'ID of the recipient that contains consent history'' at line 3] [05:07:56] there [05:11:49] hmm- that's odd - did I stuff up that copy & paste... [05:13:51] (03PS2) 10Eileen: Fix phone_consent recipient_id incorrectly NULL [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1243398 (https://phabricator.wikimedia.org/T380106) [05:14:14] OK I added an = by accident - fixed [05:14:17] i dont know how i broke my debug but its refusing to stop [05:14:25] like a toddler [05:14:26] how would i access something off of this->message [05:14:32] since debug isnt letting me stop [05:15:12] no im matching the others [05:15:19] it's just an array - ie it's where `$msg` comes from ` $msg = $this->getMessage();` [05:15:34] yeah so this->message['date'] [05:15:37] yep [05:16:44] to be honest I didn't realise we hadn't used that pattern much in that class but in the other classes I try to leave the input message as-it-came-in and make it clear when that is being accessed (as opposed to a wrangled version) [05:17:03] yeah it makes sense I was following an older example [05:17:19] i think the ide autocomplete created a trap [05:17:59] did my friend let you down? [05:18:22] its not your friend its when I was editing the $msg['date'] it disappeared a ) [05:18:29] the small friend inside phpstorm? haha [05:20:21] lol [05:20:36] are you able to +2 this - https://gerrit.wikimedia.org/r/c/wikimedia/fundraising/crm/+/1243247 - it's still very much an iteration process on this code [05:23:52] yeah i can look [05:26:09] (03CR) 10Cstone: [C:03+2] Add validateBatch action [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1243247 (owner: 10Eileen) [05:27:14] cstone: I need to go out for a bit soon but I think you are close on your one? [05:27:23] yeah just doing final testing lemme push it up [05:27:49] (03PS13) 10Cstone: Handle phone number from the payments form [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1214236 (https://phabricator.wikimedia.org/T380106) [05:30:01] (03CR) 10Cstone: Handle phone number from the payments form (033 comments) [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1214236 (https://phabricator.wikimedia.org/T380106) (owner: 10Cstone) [05:31:58] (03CR) 10CI reject: [V:04-1] Localisation updates from https://translatewiki.net. [extensions/DonationInterface] (REL1_44) - 10https://gerrit.wikimedia.org/r/1243465 (owner: 10L10n-bot) [05:34:03] (03CR) 10Eileen: [C:03+2] Handle phone number from the payments form (031 comment) [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1214236 (https://phabricator.wikimedia.org/T380106) (owner: 10Cstone) [05:34:17] woowoo thanks eileen [05:34:20] yeah - I think that's ready for some testing-in-production! [05:34:31] i still have a front end validation patch [05:34:47] lemme update that i think wenjun had a comment [05:34:55] but right now yeah with no validation :) [05:36:05] (03Abandoned) 10Eileen: Basic phone consent test [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1243392 (https://phabricator.wikimedia.org/T380106) (owner: 10Eileen) [05:36:12] (03PS1) 10Cstone: There are four numbers [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1243591 [05:36:22] (03PS1) 10Eileen: Opps missing in commit [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1243592 [05:36:32] cstone: another mis-commit ... ^ [05:36:40] same with mine above it haha [05:36:45] (03CR) 10Eileen: [C:03+2] There are four numbers [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1243591 (owner: 10Cstone) [05:36:52] (03CR) 10Cstone: [C:03+2] Opps missing in commit [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1243592 (owner: 10Eileen) [05:36:53] lol [05:37:16] (03Merged) 10jenkins-bot: There are four numbers [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1243591 (owner: 10Cstone) [05:37:51] is this one OK now? https://gerrit.wikimedia.org/r/c/wikimedia/fundraising/crm/+/1243398 - mostly cos I want to do something that will conflict [05:38:09] oh lemme rerun [05:39:21] yep [05:39:49] (03CR) 10Cstone: [C:03+2] Fix phone_consent recipient_id incorrectly NULL [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1243398 (https://phabricator.wikimedia.org/T380106) (owner: 10Eileen) [05:44:08] (03CR) 10CI reject: [V:04-1] Handle phone number from the payments form [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1214236 (https://phabricator.wikimedia.org/T380106) (owner: 10Cstone) [05:44:39] lul all the tests [05:44:43] guess i didnt run those locally [05:45:56] guess that first check was needed [05:51:19] lol [05:54:15] (03PS14) 10Cstone: Handle phone number from the payments form [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1214236 (https://phabricator.wikimedia.org/T380106) [05:54:40] ^ now with fixed test and less test explosion (hopefully i just checked one but it passed) [05:55:11] (03CR) 10Cstone: Handle phone number from the payments form (032 comments) [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1214236 (https://phabricator.wikimedia.org/T380106) (owner: 10Cstone) [05:55:33] nuu the param array [05:56:20] (03PS15) 10Cstone: Handle phone number from the payments form [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1214236 (https://phabricator.wikimedia.org/T380106) [06:01:52] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM: Add country abbreviation token - https://phabricator.wikimedia.org/T418335 (10Lars) 03NEW [06:02:11] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM: Add country abbreviation token - https://phabricator.wikimedia.org/T418335#11649461 (10Lars) [[ https://github.com/civicrm/civicrm-core/pull/34896 | Upstream PR ]] [06:02:17] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM: Add country abbreviation token - https://phabricator.wikimedia.org/T418335#11649462 (10Lars) a:03Lars [06:03:35] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM: Add country abbreviation token - https://phabricator.wikimedia.org/T418335#11649465 (10Lars) [06:03:46] I think I've arrived at the conclusion we should only trust the trustly txn_id in the trustly settlement files - the gravy ones can't be reliably linked to a contribution as they might relate to a different one. There are some other gotchas in there I guess [06:03:58] (03CR) 10Eileen: [C:03+2] Handle phone number from the payments form [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1214236 (https://phabricator.wikimedia.org/T380106) (owner: 10Cstone) [06:05:12] does it look like it could be due to a bug on gravys end eileen ? [06:11:59] (03Merged) 10jenkins-bot: Opps missing in commit [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1243592 (owner: 10Eileen) [06:14:38] (03Merged) 10jenkins-bot: Fix phone_consent recipient_id incorrectly NULL [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1243398 (https://phabricator.wikimedia.org/T380106) (owner: 10Eileen) [06:16:01] cstone: dunno - it could just be ACH oddness - what might help is storing all the ids on the pending table [06:16:39] ie not just gateway & gateway_txn_id but backend processor_txn_id - then we could do an indexed lookup [06:17:12] & we could move away from gateway_txn_id being 'maybe gravy maybe the payment processor' [06:18:22] Omg internet is finally fixed [06:18:57] eileen: we talked a bit about just saving all the ids like gravy does on their end (like the auth id, capture id, refund id, whatever other id) [06:19:04] Would that be helpful in this situation ? [06:20:09] (03PS1) 10Lars SG: Merge branch 'master' into deployment [wikimedia/fundraising/crm] (deployment) - 10https://gerrit.wikimedia.org/r/1243599 [06:20:27] this is more line smashpig.pending has top level fields & fields hidden in `message` - so would want more at the top level. ditch top level gateway_txn_id or reduce usage in favour of specific backend_processor or orchestrator [06:20:47] (03CR) 10CI reject: [V:04-1] Merge branch 'master' into deployment [wikimedia/fundraising/crm] (deployment) - 10https://gerrit.wikimedia.org/r/1243599 (owner: 10Lars SG) [06:20:53] In this case the trustly id IS reliable but can't be used to pick up the pending record [06:21:05] (03CR) 10Lars SG: "recheck" [wikimedia/fundraising/crm] (deployment) - 10https://gerrit.wikimedia.org/r/1243599 (owner: 10Lars SG) [06:22:58] Sorry eileen kind of brain dead but because gravy isn't giving it to us or we just aren't recording it [06:23:12] 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 07FR-Audience-Dev: Civi and Acoustic field request: Current CY or FY donation count - https://phabricator.wikimedia.org/T418272#11649473 (10MSuijkerbuijk_WMF) This is such a great insight @Lars The size is greater than expected. Any chance I could see... [06:23:29] eileen: this deploy patch is failing because "The .git directory is missing from /src/vendor/wikimedia/smash-pig" which I assume is related to the smashpig upgrade included in the deploy patch. Do I need to do something special for that? [06:23:41] 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 10FR-WMF-Audit: Trustly - Gravy IDs unreliable in reconciliation / settlement reports - https://phabricator.wikimedia.org/T418332#11649474 (10Eileenmcnaughton) [06:24:28] (03PS1) 10Eileen: Fix some data issues from gravy IDs in trustly settlement not relating [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1243600 (https://phabricator.wikimedia.org/T418332) [06:24:44] (03CR) 10CI reject: [V:04-1] Fix some data issues from gravy IDs in trustly settlement not relating [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1243600 (https://phabricator.wikimedia.org/T418332) (owner: 10Eileen) [06:25:00] larssandergreen: ug - I hit that before & I didn't fix it - it just came right - which probably means ejegg fixed it... [06:25:47] (03PS2) 10Eileen: Fix some data issues from gravy IDs in trustly settlement not relating [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1243600 (https://phabricator.wikimedia.org/T418332) [06:26:11] OK, I'll leave it for now and maybe ejegg can have a look in the AM [06:26:19] cstone: via the trustly settlement reports we get Gravy IDs but it turns out they might relate to the first transaction rather than the latest [06:26:41] (03Merged) 10jenkins-bot: Handle phone number from the payments form [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1214236 (https://phabricator.wikimedia.org/T380106) (owner: 10Cstone) [06:26:46] Yeah hmm I'll reread these messages tomorrow before the meeting eileen [06:27:06] (gravy meeting) and see if I can get something to ask them [06:29:45] (03PS1) 10Eileen: Only use trustly IDs when reconciling from trustly settlement report [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1243601 [06:30:42] cstone: well I think ^^ will get us sorted for now & given the low volume of trustly it might well stay that way [06:31:21] the numbers are what is coming back in the trustly settlement report - the best thing we could get out of them is having our order_ids come back that way too... [06:31:40] or generally be available in trustly [06:31:58] Yeah I asked that and it's on the doc I'll see if there's an update on that tomorrow too [06:32:03] cool cool [06:32:21] In gonna go to bed though I can take a look at the patches tomo [06:32:38] thanks - I'm done too I think - [06:35:00] I'll merge your core patch tomorrow larssandergreen if no-one does before then... [06:39:44] thanks eileen, no big rush on those ones [06:41:25] well it looks straight forward, low surface area & has a test. I just figure I'll see if someone else merges first [06:41:57] (03PS1) 10Lars SG: Add address data to Alex sample contact [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1243602 (https://phabricator.wikimedia.org/T418277) [06:48:47] (03CR) 10CI reject: [V:04-1] Only use trustly IDs when reconciling from trustly settlement report [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1243601 (owner: 10Eileen) [07:02:43] 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 07FR-Audience-Dev: Civi and Acoustic field request: Current CY or FY donation count - https://phabricator.wikimedia.org/T418272#11649496 (10Lars) @MSuijkerbuijk_WMF ` +--------------------+---------------+ | contribution_count | contact_count | +------... [08:54:42] FIRING: [2x] CoreRouterInterfaceDown: Core router interface down - pfw1-codfw:reth2 (fasw1-f5 2x25G) - https://wikitech.wikimedia.org/wiki/Network_monitoring#Router_interface_down - https://grafana.wikimedia.org/d/fb403d62-5f03-434a-9dff-bd02b9fff504/network-device-overview?var-instance=pfw1-codfw:9804 - https://alerts.wikimedia.org/?q=alertname%3DCoreRouterInterfaceDown [09:20:19] 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 07FR-Audience-Dev: Civi and Acoustic field request: Current CY or FY donation count - https://phabricator.wikimedia.org/T418272#11649812 (10MSuijkerbuijk_WMF) @NNgu-WMF can talk about the format - we would upload it to Acoustic to create a list that we... [11:05:13] (03CR) 10Thiemo Kreuz (WMDE): "It looks like they are turned off instead of being fixed? Is this intentional? Maybe you can add a line to the commit message that explain" [extensions/CentralNotice] - 10https://gerrit.wikimedia.org/r/1219569 (owner: 10Esanders) [12:50:44] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog: PayPal donation cancellation fails with "The profile ID is invalid" error - https://phabricator.wikimedia.org/T418371 (10jgleeson) 03NEW [12:54:42] FIRING: [2x] CoreRouterInterfaceDown: Core router interface down - pfw1-codfw:reth2 (fasw1-f5 2x25G) - https://wikitech.wikimedia.org/wiki/Network_monitoring#Router_interface_down - https://grafana.wikimedia.org/d/fb403d62-5f03-434a-9dff-bd02b9fff504/network-device-overview?var-instance=pfw1-codfw:9804 - https://alerts.wikimedia.org/?q=alertname%3DCoreRouterInterfaceDown [13:10:41] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog: PayPal donation cancellation fails with "The profile ID is invalid" error - https://phabricator.wikimedia.org/T418371#11650570 (10krobinson) Apologies for the false alarm - it turns out this is a known issue. That error appears if the donor created their... [13:19:26] (03PS2) 10Damilare Adedoyin: Add jquery library to DI for test mocks [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1240731 [13:19:26] (03PS11) 10Damilare Adedoyin: Show login page on expired / invalid checksum [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1239370 [13:19:26] (03PS19) 10Damilare Adedoyin: Ping Civi on Login page to check its status. [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1239778 (https://phabricator.wikimedia.org/T402972) [13:22:46] (03CR) 10CI reject: [V:04-1] Ping Civi on Login page to check its status. [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1239778 (https://phabricator.wikimedia.org/T402972) (owner: 10Damilare Adedoyin) [13:28:35] 03Fundraising Sprint: Dami's Crib πŸ˜€, 06Fundraising-Backlog, 10FR-Donor-portal, 07fr-current-sprint: Revised 'Your active recurring donations' card + new 'Manage your recurring donation' page for Donor Portal - https://phabricator.wikimedia.org/T417822#11650634 (10Damilare) Thanks @EMartin. PayPal's respons... [13:36:00] (03PS20) 10Damilare Adedoyin: Ping Civi on Login page to check its status. [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1239778 (https://phabricator.wikimedia.org/T402972) [13:39:21] (03CR) 10CI reject: [V:04-1] Ping Civi on Login page to check its status. [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1239778 (https://phabricator.wikimedia.org/T402972) (owner: 10Damilare Adedoyin) [13:41:45] (03PS21) 10Damilare Adedoyin: Ping Civi on Login page to check its status. [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1239778 (https://phabricator.wikimedia.org/T402972) [13:44:43] (03CR) 10CI reject: [V:04-1] Ping Civi on Login page to check its status. [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1239778 (https://phabricator.wikimedia.org/T402972) (owner: 10Damilare Adedoyin) [13:50:05] (03PS22) 10Damilare Adedoyin: Ping Civi on Login page to check its status. [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1239778 (https://phabricator.wikimedia.org/T402972) [13:53:59] (03CR) 10CI reject: [V:04-1] Ping Civi on Login page to check its status. [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1239778 (https://phabricator.wikimedia.org/T402972) (owner: 10Damilare Adedoyin) [13:55:10] (03PS23) 10Damilare Adedoyin: Ping Civi on Login page to check its status. [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1239778 (https://phabricator.wikimedia.org/T402972) [13:58:30] (03CR) 10CI reject: [V:04-1] Ping Civi on Login page to check its status. [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1239778 (https://phabricator.wikimedia.org/T402972) (owner: 10Damilare Adedoyin) [13:59:18] (03PS24) 10Damilare Adedoyin: Ping Civi on Login page to check its status. [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1239778 (https://phabricator.wikimedia.org/T402972) [14:03:06] (03CR) 10CI reject: [V:04-1] Ping Civi on Login page to check its status. [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1239778 (https://phabricator.wikimedia.org/T402972) (owner: 10Damilare Adedoyin) [14:03:56] (03PS25) 10Damilare Adedoyin: Ping Civi on Login page to check its status. [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1239778 (https://phabricator.wikimedia.org/T402972) [14:18:11] 03Fundraising Sprint: Dami's Crib πŸ˜€, 06Fundraising-Backlog, 07fr-current-sprint, 07payments-orchestration: Recurring token migration - Paypal - https://phabricator.wikimedia.org/T405483#11650811 (10jgleeson) @krobinson ran into an issue today that prevented the cancellation of legacy PayPal donations in Ci... [14:20:07] (03CR) 10Jgleeson: [C:03+2] "Viking LGTM." [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1243602 (https://phabricator.wikimedia.org/T418277) (owner: 10Lars SG) [14:23:10] PROBLEM - check_load on frban1002 is CRITICAL: LOAD CRITICAL - total load average: 143.81, 116.53, 60.05 https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frban1002&service=check_load [14:25:16] PROBLEM - check_load on frban2002 is CRITICAL: LOAD CRITICAL - total load average: 119.82, 100.64, 59.12 https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frban2002&service=check_load [14:28:14] PROBLEM - check_load on frban1002 is CRITICAL: LOAD CRITICAL - total load average: 114.60, 119.31, 77.48 https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frban1002&service=check_load [14:30:18] PROBLEM - check_load on frban2002 is CRITICAL: LOAD CRITICAL - total load average: 153.19, 120.28, 77.84 https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frban2002&service=check_load [14:33:10] PROBLEM - check_load on frban1002 is CRITICAL: LOAD CRITICAL - total load average: 121.51, 120.52, 88.87 https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frban1002&service=check_load [14:34:44] 03Fundraising Sprint E - 2026, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 10FR-MGFE: Request for improvement to prospecting system to track moves management - https://phabricator.wikimedia.org/T386961#11650870 (10AKanji-WMF) [14:34:46] 03Fundraising Sprint E - 2026, 06Fundraising-Backlog, 07payments-orchestration: [Discussion] Proposal for Handling ACH Donations in CiviCRM - https://phabricator.wikimedia.org/T406663#11650871 (10AKanji-WMF) [14:34:47] 03Fundraising Sprint E - 2026, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 10FR-Email, and 3 others: Civi Searchkit should allow user to export list to acoustic - https://phabricator.wikimedia.org/T301514#11650873 (10AKanji-WMF) [14:34:50] 03Fundraising Sprint E - 2026, 06Fundraising-Backlog, 06FR-donorrelations, 07Documentation: Document existing payment error messages - https://phabricator.wikimedia.org/T379197#11650872 (10AKanji-WMF) [14:35:18] PROBLEM - check_load on frban2002 is CRITICAL: LOAD CRITICAL - total load average: 128.95, 120.92, 89.58 https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frban2002&service=check_load [14:36:43] (03CR) 10Jgleeson: [C:03+2] "Fixes the display weirdness for me. Looks nice and neat afterwards! Thanks" [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1240993 (https://phabricator.wikimedia.org/T413133) (owner: 10Damilare Adedoyin) [14:37:07] TY for the CR jgleeson [14:37:21] (03CR) 10Jgleeson: [C:03+2] "If we need it, we need it :D" [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1240731 (owner: 10Damilare Adedoyin) [14:37:26] np damilare ! [14:38:10] PROBLEM - check_load on frban1002 is CRITICAL: LOAD CRITICAL - total load average: 85.62, 103.70, 90.75 https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frban1002&service=check_load [14:38:51] (03Abandoned) 10Jgleeson: Fix cloud vm hostname used in proxy forward script. [wikimedia/fundraising/dev] - 10https://gerrit.wikimedia.org/r/771446 (owner: 10Jgleeson) [14:39:33] 03Fundraising Sprint: Dami's Crib πŸ˜€, 06Fundraising-Backlog, 10FR-Donor-portal, 07fr-current-sprint: Revised 'Your active recurring donations' card + new 'Manage your recurring donation' page for Donor Portal - https://phabricator.wikimedia.org/T417822#11650909 (10Damilare) a:03Damilare [14:40:16] PROBLEM - check_load on frban2002 is CRITICAL: LOAD CRITICAL - total load average: 85.97, 108.40, 93.70 https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frban2002&service=check_load [14:40:17] (03PS2) 10Jgleeson: Allow Contact.InvalidateChecksum API through CiviProxy [wikimedia/fundraising/dev] - 10https://gerrit.wikimedia.org/r/1237921 (https://phabricator.wikimedia.org/T416353) [14:41:36] 06Fundraising-Backlog, 06Fundraising-Tech-Roadmap: Add "one-time" to header on One-time Payments Wiki - https://phabricator.wikimedia.org/T269897#11650912 (10AKanji-WMF) [14:43:10] PROBLEM - check_load on frban1002 is CRITICAL: LOAD CRITICAL - total load average: 42.44, 69.41, 79.77 https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frban1002&service=check_load [14:44:19] (03Merged) 10jenkins-bot: Add address data to Alex sample contact [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1243602 (https://phabricator.wikimedia.org/T418277) (owner: 10Lars SG) [14:44:31] ACKNOWLEDGEMENT - check_load on frban1002 is CRITICAL: LOAD CRITICAL - total load average: 42.44, 69.41, 79.77 Jeff_Green Duly noted. https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frban1002&service=check_load [14:44:31] (03PS5) 10Damilare Adedoyin: Add refund and inactive recurring status to donations history list. [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1237505 (https://phabricator.wikimedia.org/T416370) [14:44:31] ACKNOWLEDGEMENT - check_load on frban2002 is CRITICAL: LOAD CRITICAL - total load average: 85.97, 108.40, 93.70 Jeff_Green Duly noted. https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frban2002&service=check_load [14:50:29] (03PS10) 10Damilare Adedoyin: Ping Civi on Login page to check its status [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1239779 (https://phabricator.wikimedia.org/T402972) [14:51:55] (03PS11) 10Damilare Adedoyin: Ping Civi on Login page to check its status [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1239779 (https://phabricator.wikimedia.org/T402972) [14:54:49] (03Merged) 10jenkins-bot: Fix breaking line on mobile due to limited space. [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1240993 (https://phabricator.wikimedia.org/T413133) (owner: 10Damilare Adedoyin) [14:54:52] (03Merged) 10jenkins-bot: Add jquery library to DI for test mocks [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1240731 (owner: 10Damilare Adedoyin) [14:54:53] (03Merged) 10jenkins-bot: Show login page on expired / invalid checksum [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1239370 (owner: 10Damilare Adedoyin) [14:58:32] (03CR) 10Damilare Adedoyin: "Thanks for the CR and suggestion ejegg, I just applied your suggestion and tested and it works." [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1239779 (https://phabricator.wikimedia.org/T402972) (owner: 10Damilare Adedoyin) [14:59:17] 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 07fr-acoustic: Acoustic clarity issue on acoustic date fields as they relate to merged CiviCRM contact - https://phabricator.wikimedia.org/T354379#11650990 (10AKanji-WMF) Adding this to your radar @Lars. @Ejegg - any considerations around this given o... [14:59:20] 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 07FR-Audience-Dev: Civi and Acoustic field request: Current CY or FY donation count - https://phabricator.wikimedia.org/T418272#11650991 (10NNgu-WMF) I would need a list of emails, please! I tried to upload lists of Contact IDs to Acoustic as a contact... [15:08:10] RECOVERY - check_load on frban1002 is OK: LOAD OK - total load average: 3.39, 4.60, 20.15 https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frban1002&service=check_load [15:10:16] RECOVERY - check_load on frban2002 is OK: LOAD OK - total load average: 2.94, 4.58, 19.86 https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frban2002&service=check_load [15:11:41] 03Fundraising Sprint: Dami's Crib πŸ˜€, 06Fundraising-Backlog, 07fr-current-sprint, 07payments-orchestration: Recurring token migration - Paypal - https://phabricator.wikimedia.org/T405483#11651059 (10Damilare) Thanks @EMartin and @jgleeson. I had initially placed this message in the wrong phab. PayPal's res... [15:13:03] (03PS5) 10Eileen: Add handling for orphan reversals [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1243064 (https://phabricator.wikimedia.org/T418191) [15:13:41] (03CR) 10Ejegg: [C:03+2] "Flip it and reverse it like Missy..." [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1243064 (https://phabricator.wikimedia.org/T418191) (owner: 10Eileen) [15:23:09] 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 10FR-WMF-Audit: Paypal - handle 'general reversal' - https://phabricator.wikimedia.org/T418191#11651129 (10MBeat33) @Eileenmcnaughton do you know, would the work in this Task enable (or relate to) Civi to cancel annual recurring PayPal donations if the... [15:30:59] (03PS12) 10Damilare Adedoyin: Ping Civi on Login page to check its status [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1239779 (https://phabricator.wikimedia.org/T402972) [15:31:00] (03CR) 10Ejegg: [C:03+2] Ping Civi on Login page to check its status [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1239779 (https://phabricator.wikimedia.org/T402972) (owner: 10Damilare Adedoyin) [15:32:09] 03Fundraising Sprint: Dami's Crib πŸ˜€, 06Fundraising-Backlog, 07fr-current-sprint, 07payments-orchestration: Recurring token migration - Paypal - https://phabricator.wikimedia.org/T405483#11651163 (10krobinson) Is there any way to see volume of donors we have on Legacy still? As these are clearly loyal donor... [15:32:13] (03PS26) 10Damilare Adedoyin: Ping Civi on Login page to check its status. [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1239778 (https://phabricator.wikimedia.org/T402972) [15:35:13] (03Merged) 10jenkins-bot: Add handling for orphan reversals [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1243064 (https://phabricator.wikimedia.org/T418191) (owner: 10Eileen) [15:45:55] 03Fundraising Sprint: Dami's Crib πŸ˜€, 06Fundraising-Backlog, 07fr-current-sprint, 07payments-orchestration: Recurring token migration - Paypal - https://phabricator.wikimedia.org/T405483#11651245 (10Damilare) Thanks @krobinson, [[ https://civicrm.wikimedia.org/civicrm/admin/search#/edit/8359 | this SK ]] sh... [15:51:15] 03Fundraising Sprint: Dami's Crib πŸ˜€, 06Fundraising-Backlog, 07fr-current-sprint, 07payments-orchestration: Recurring token migration - Paypal - https://phabricator.wikimedia.org/T405483#11651273 (10krobinson) Thanks @Damilare However, I believe legacy is only for PayPal donations set up before we migrate... [15:52:01] 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 07FR-Audience-Dev: Civi and Acoustic field request: Current CY or FY donation count - https://phabricator.wikimedia.org/T418272#11651278 (10Lars) What's the timeline for this? If there's enough time, we might be able to get the SK -> Acoustic connection... [15:52:45] (03PS4) 10Esanders: eslint: Fix some remaining warnings [extensions/CentralNotice] - 10https://gerrit.wikimedia.org/r/1219569 [15:52:57] (03CR) 10Esanders: "Done" [extensions/CentralNotice] - 10https://gerrit.wikimedia.org/r/1219569 (owner: 10Esanders) [15:56:51] (03CR) 10Ejegg: "Looks pretty good! I see one translation gotcha, and some opportunities to move some mapping from the Vue logic into the backend code wher" [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1237505 (https://phabricator.wikimedia.org/T416370) (owner: 10Damilare Adedoyin) [15:57:40] oops, forgot to take down the |afk flag... [15:59:17] (03Merged) 10jenkins-bot: Ping Civi on Login page to check its status [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1239779 (https://phabricator.wikimedia.org/T402972) (owner: 10Damilare Adedoyin) [16:00:01] (03CR) 10Thiemo Kreuz (WMDE): "I'm certainly missing something, but doesn't this patch add an exclusion instead of removing one?" [extensions/CentralNotice] - 10https://gerrit.wikimedia.org/r/1219569 (owner: 10Esanders) [16:05:32] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 06FR-donorrelations: Investigate inconsistent email display during record merges - https://phabricator.wikimedia.org/T418320#11651331 (10Lars) a:03Lars This is actually working as intended when the location types of... [16:06:53] (03CR) 10Ejegg: There are four numbers (031 comment) [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1243591 (owner: 10Cstone) [16:08:58] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM: Prevent test email addresses from being MSL-ed in Acoustic - https://phabricator.wikimedia.org/T418011#11651355 (10Lars) Long-term, trying to keep them out of Civi isn't going to work. So instead we can: Add all of the... [16:15:37] 03Fundraising Sprint: Dami's Crib πŸ˜€, 06Fundraising-Backlog, 07fr-current-sprint, 07payments-orchestration: Recurring token migration - Paypal - https://phabricator.wikimedia.org/T405483#11651367 (10Ejegg) @krobinson Unfortunately even with Express Checkout, we still kept creating 'Recurring Payment Profile... [16:17:36] (03CR) 10Ejegg: [V:03+2] build: Updating lodash to 4.17.23 [extensions/DonationInterface] (REL1_43) - 10https://gerrit.wikimedia.org/r/1230758 (owner: 10Libraryupgrader) [16:19:08] hmm, gerrit down? [16:19:18] time for some inbox clearing... [16:20:43] oh, or maybe it's just my internet [16:23:11] 503 Service Unavailable [16:23:11] PROBLEM - check_load on frban1002 is CRITICAL: LOAD CRITICAL - total load average: 130.00, 89.20, 42.36 https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frban1002&service=check_load [16:25:00] oh huh, will check over in -operations [16:25:17] PROBLEM - check_load on frban2002 is CRITICAL: LOAD CRITICAL - total load average: 147.36, 115.49, 60.30 https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frban2002&service=check_load [16:25:42] oh wow it's all of wikimedia [16:28:11] PROBLEM - check_load on frban1002 is CRITICAL: LOAD CRITICAL - total load average: 95.25, 105.13, 63.25 https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frban1002&service=check_load [16:30:17] PROBLEM - check_load on frban2002 is CRITICAL: LOAD CRITICAL - total load average: 100.05, 106.29, 70.77 https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frban2002&service=check_load [16:33:13] PROBLEM - check_load on frban1002 is CRITICAL: LOAD CRITICAL - total load average: 167.39, 140.40, 89.82 https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frban1002&service=check_load [16:34:39] 10fundraising-tech-ops, 10decommission-hardware: decommission frqueue2002.frack.codfw.wmnet - https://phabricator.wikimedia.org/T418393 (10Jgreen) 03NEW [16:34:52] 10fundraising-tech-ops, 10decommission-hardware: decommission frqueue2002.frack.codfw.wmnet - https://phabricator.wikimedia.org/T418393#11651463 (10Jgreen) [16:35:17] PROBLEM - check_load on frban2002 is CRITICAL: LOAD CRITICAL - total load average: 140.66, 127.48, 90.06 https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frban2002&service=check_load [16:35:30] ACKNOWLEDGEMENT - check_load on frban1002 is CRITICAL: LOAD CRITICAL - total load average: 167.39, 140.40, 89.82 Dwisehaupt known - high prod traffic - high frban load https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frban1002&service=check_load [16:35:30] ACKNOWLEDGEMENT - check_load on frban2002 is CRITICAL: LOAD CRITICAL - total load average: 140.66, 127.48, 90.06 Dwisehaupt known - high prod traffic - high frban load https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frban2002&service=check_load [16:36:13] 06Fundraising-Backlog, 10fundraising-tech-ops: Fundraising access request for Adriana Vargas - https://phabricator.wikimedia.org/T418309#11651464 (10Dwisehaupt) [16:36:43] 06Fundraising-Backlog, 10fundraising-tech-ops: Fundraising access request for Adriana Vargas - https://phabricator.wikimedia.org/T418309#11651466 (10Dwisehaupt) 05Openβ†’03Resolved Metabase account verified and welcome email sent. [16:43:26] 14Fundraising Sprint: Vixen, 03Fundraising Sprint: Yabba Dabba Stew, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, and 3 others: Implement recurring donation monthly-to-annual conversion - https://phabricator.wikimedia.org/T388753#11651509 (10AKanji-WMF) Awesome, TY for confirming, @Ejegg - @... [16:45:35] 03Fundraising Sprint: Dami's Crib πŸ˜€, 06Fundraising-Backlog, 10FR-Donor-portal, 07fr-current-sprint: Scoping Donor Portal Operational Emails - https://phabricator.wikimedia.org/T416600#11651525 (10Ejegg) p:05Triageβ†’03Medium a:03Ejegg [16:54:43] FIRING: [2x] CoreRouterInterfaceDown: Core router interface down - pfw1-codfw:reth2 (fasw1-f5 2x25G) - https://wikitech.wikimedia.org/wiki/Network_monitoring#Router_interface_down - https://grafana.wikimedia.org/d/fb403d62-5f03-434a-9dff-bd02b9fff504/network-device-overview?var-instance=pfw1-codfw:9804 - https://alerts.wikimedia.org/?q=alertname%3DCoreRouterInterfaceDown [17:03:34] 10fundraising-tech-ops, 10decommission-hardware, 13Patch-For-Review: decommission frqueue2002.frack.codfw.wmnet - https://phabricator.wikimedia.org/T418393#11651577 (10Jgreen) [17:13:22] FIRING: [3x] CoreRouterInterfaceDown: Core router interface down - pfw1-codfw:reth2 (fasw1-f5 2x25G) - https://wikitech.wikimedia.org/wiki/Network_monitoring#Router_interface_down - https://grafana.wikimedia.org/d/fb403d62-5f03-434a-9dff-bd02b9fff504/network-device-overview?var-instance=pfw1-codfw:9804 - https://alerts.wikimedia.org/?q=alertname%3DCoreRouterInterfaceDown [17:14:43] FIRING: [3x] CoreRouterInterfaceDown: Core router interface down - pfw1-codfw:reth2 (fasw1-f5 2x25G) - https://wikitech.wikimedia.org/wiki/Network_monitoring#Router_interface_down - https://grafana.wikimedia.org/d/fb403d62-5f03-434a-9dff-bd02b9fff504/network-device-overview?var-instance=pfw1-codfw:9804 - https://alerts.wikimedia.org/?q=alertname%3DCoreRouterInterfaceDown [17:16:43] (03PS1) 10Ejegg: Update SmashPig to 1.2.2.13 [wikimedia/fundraising/crm/vendor] - 10https://gerrit.wikimedia.org/r/1243900 [17:16:47] (03CR) 10Ejegg: [C:03+2] Update SmashPig to 1.2.2.13 [wikimedia/fundraising/crm/vendor] - 10https://gerrit.wikimedia.org/r/1243900 (owner: 10Ejegg) [17:17:27] (03PS1) 10Ejegg: Merge branch 'master' into deployment [wikimedia/fundraising/crm] (deployment) - 10https://gerrit.wikimedia.org/r/1243901 [17:17:29] (03CR) 10Ejegg: [C:03+2] Merge branch 'master' into deployment [wikimedia/fundraising/crm] (deployment) - 10https://gerrit.wikimedia.org/r/1243901 (owner: 10Ejegg) [17:22:42] 10fundraising-tech-ops, 06DC-Ops, 10decommission-hardware, 10ops-codfw, 13Patch-For-Review: decommission frqueue2002.frack.codfw.wmnet - https://phabricator.wikimedia.org/T418393#11651700 (10Jgreen) a:05Jgreenβ†’03None [17:25:32] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 06FR-donorrelations: Auth at Adyen, Capturing at Gravy, settled in Civi straggler - https://phabricator.wikimedia.org/T417065#11651714 (10MBeat33) re: the two unrefundable dLocal's at Gravy, [[ https://wikimedia.slack.com/archives/C072S0VFH42/p177201089... [17:28:22] FIRING: [3x] CoreRouterInterfaceDown: Core router interface down - pfw1-codfw:ge-0/0/0 () - https://wikitech.wikimedia.org/wiki/Network_monitoring#Router_interface_down - https://grafana.wikimedia.org/d/fb403d62-5f03-434a-9dff-bd02b9fff504/network-device-overview?var-instance=pfw1-codfw:9804 - https://alerts.wikimedia.org/?q=alertname%3DCoreRouterInterfaceDown [17:34:34] (03Merged) 10jenkins-bot: Update SmashPig to 1.2.2.13 [wikimedia/fundraising/crm/vendor] - 10https://gerrit.wikimedia.org/r/1243900 (owner: 10Ejegg) [17:34:35] (03Merged) 10jenkins-bot: Merge branch 'master' into deployment [wikimedia/fundraising/crm] (deployment) - 10https://gerrit.wikimedia.org/r/1243901 (owner: 10Ejegg) [17:48:22] FIRING: [3x] CoreRouterInterfaceDown: Core router interface down - pfw1-codfw:ge-0/0/0 () - https://wikitech.wikimedia.org/wiki/Network_monitoring#Router_interface_down - https://grafana.wikimedia.org/d/fb403d62-5f03-434a-9dff-bd02b9fff504/network-device-overview?var-instance=pfw1-codfw:9804 - https://alerts.wikimedia.org/?q=alertname%3DCoreRouterInterfaceDown [18:21:01] 03Fundraising Sprint: Dami's Crib πŸ˜€, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 07fr-current-sprint: Send double opt-in confirmation message whenever a contact's email is changed - https://phabricator.wikimedia.org/T407261#11651951 (10SHust) https://wikimedia.zendesk.com/agent/tickets/1841649... [18:30:23] deploying that crm update [18:31:18] larssandergreen: ^^^ any special handling needed for those patches? [18:31:57] ejegg: thanks, no special handling needed [18:33:33] !log fundraising civicrm upgraded from f881e026 to c3157fbf [18:33:34] Logged the message at https://wikitech.wikimedia.org/wiki/Fundraising/SAL [18:37:10] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 06FR-donorrelations: Hide cancel link for Paypal recurrings that cannot be cancelled - https://phabricator.wikimedia.org/T418406 (10Lars) 03NEW [18:41:23] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 06FR-donorrelations: Language Preference Field in β€œPrivacy” Section in Civi Not Editable - https://phabricator.wikimedia.org/T418183#11652032 (10Lars) @Shust Fixed, thanks for flagging this so we can fix upstream! [18:43:21] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10FR-Donation-Processing: USD Benevity import Duplicate Error - https://phabricator.wikimedia.org/T416233#11652041 (10Lars) @Elbar53 @MDemosWMF At long last, this has been fixed! [18:44:01] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 06FR-donorrelations: Hide cancel link for Paypal recurrings that cannot be cancelled - https://phabricator.wikimedia.org/T418406#11652043 (10Lars) p:05Triageβ†’03Medium [18:44:31] 03Fundraising Sprint: Dami's Crib πŸ˜€, 06Fundraising-Backlog, 07fr-combowiki, 07fr-current-sprint: Investigate: On-wiki donations using native HTML5 Payment Request API - https://phabricator.wikimedia.org/T415586#11652044 (10jgleeson) I mentioned that we were looking at this on the Gravy call today, and they... [18:46:11] (03CR) 10Eileen: Add handling for orphan reversals (032 comments) [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1243064 (https://phabricator.wikimedia.org/T418191) (owner: 10Eileen) [18:46:23] (03PS4) 10Eileen: Add partial handling for adjustment scenario [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1243218 (https://phabricator.wikimedia.org/T417347) [19:52:06] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10FR-Donation-Processing: USD Benevity import Duplicate Error - https://phabricator.wikimedia.org/T416233#11652202 (10Elbar53) That's great news @Lars ! [20:04:20] dwisehaupt: are you around for tech talk? [20:04:30] to do some graphing [20:37:18] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 06FR-donorrelations: Language Preference Field in β€œPrivacy” Section in Civi Not Editable - https://phabricator.wikimedia.org/T418183#11652286 (10SHust) Thanks, Lars! [21:10:15] RECOVERY - check_load on frban2002 is OK: LOAD OK - total load average: 3.26, 4.10, 19.83 https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frban2002&service=check_load [21:18:11] RECOVERY - check_load on frban1002 is OK: LOAD OK - total load average: 2.34, 3.77, 19.52 https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frban1002&service=check_load [21:27:21] 10Fundraising analytics stack, 10fundraising-tech-ops: Turnilo access for hahmed-ctr@wikimedia.org - https://phabricator.wikimedia.org/T413250#11652381 (10greg) a:05gregβ†’03None [21:33:56] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM: Update user job status when incomplete or complete with errors import has been completed via import API action - https://phabricator.wikimedia.org/T418416 (10Lars) 03NEW [21:49:43] FIRING: [2x] CoreRouterInterfaceDown: Core router interface down - pfw1-codfw:reth2 (fasw1-f5 2x25G) - https://wikitech.wikimedia.org/wiki/Network_monitoring#Router_interface_down - https://grafana.wikimedia.org/d/fb403d62-5f03-434a-9dff-bd02b9fff504/network-device-overview?var-instance=pfw1-codfw:9804 - https://alerts.wikimedia.org/?q=alertname%3DCoreRouterInterfaceDown [22:02:40] 06Fundraising-Backlog, 10fundraising-tech-ops: Issue new SSL Client Certificate for jianwong - https://phabricator.wikimedia.org/T416277#11652482 (10Dwisehaupt) certificate renewed and sent via email. password sent via sms. [22:09:21] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 06FR-donorrelations: Investigate inconsistent email display during record merges - https://phabricator.wikimedia.org/T418320#11652499 (10SHust) Thanks for the explanation! I'm adding below a summary of what I understo... [22:15:01] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 06FR-donorrelations: Investigate inconsistent email display during record merges - https://phabricator.wikimedia.org/T418320#11652507 (10Lars) Yes, I think ChatGPT summarized it just fine :) We can certainly do both,... [22:18:35] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 06FR-donorrelations: Investigate inconsistent email display during record merges - https://phabricator.wikimedia.org/T418320#11652508 (10SHust) Using what I can to 'un-fry' what’s left of my brain, haha! That’s great n... [22:35:58] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 06FR-donorrelations: Investigate inconsistent email display during record merges - https://phabricator.wikimedia.org/T418320#11652535 (10Lars) [[ https://lab.civicrm.org/dev/core/-/issues/6354 | CiviCRM proposal here ]... [22:41:14] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM: Update user job status when incomplete or complete with errors import has been completed via import API action - https://phabricator.wikimedia.org/T418416#11652542 (10Lars) p:05Triageβ†’03Low [22:52:25] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM: When updating activities via import with id, activity type and date should not be required - https://phabricator.wikimedia.org/T418422 (10Lars) 03NEW [22:52:55] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM: When updating activities via import with id, activity type and date should not be required - https://phabricator.wikimedia.org/T418422#11652572 (10Lars) p:05Triageβ†’03Medium [22:59:46] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM: When updating activities via import with id, activity type, subject and date should not be required - https://phabricator.wikimedia.org/T418422#11652573 (10Lars) [23:09:25] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 07fr-acoustic: Fail Mail (civi1002) run-job: Get mailings from Silverpop failed with code 1 - https://phabricator.wikimedia.org/T418425 (10Eileenmcnaughton) 03NEW [23:11:03] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 07fr-acoustic: Fail Mail (civi1002) run-job: Get mailings from Silverpop failed with code 1 - https://phabricator.wikimedia.org/T418425#11652630 (10Eileenmcnaughton) @bsisolak I discussed our time out issues with you b... [23:15:41] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM: When updating activities via import with id, activity type, subject and date should not be required - https://phabricator.wikimedia.org/T418422#11652658 (10Lars) [[ https://github.com/civicrm/civicrm-core/pull/34918 | Up... [23:28:09] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 07fr-acoustic: Fail Mail (civi1002) run-job: Get mailings from Silverpop failed with code 1 - https://phabricator.wikimedia.org/T418425#11652688 (10bsisolak) Can you provide the calls you are making? [23:30:54] 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 10FR-WMF-Audit: Paypal - handle 'general reversal' - https://phabricator.wikimedia.org/T418191#11652691 (10Eileenmcnaughton) @MBeat33 can you elaborate? [23:33:04] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 07fr-acoustic: Fail Mail (civi1002) run-job: Get mailings from Silverpop failed with code 1 - https://phabricator.wikimedia.org/T418425#11652699 (10Eileenmcnaughton) @bsisolak this one was `getSentMailingsForOrg()` bet... [23:43:36] 10fundraising-tech-ops, 06DC-Ops, 10ops-eqiad, 06SRE: Q3:rack/setup/install frdb1008 - https://phabricator.wikimedia.org/T414374#11652717 (10VRiley-WMF) [23:44:14] 10fundraising-tech-ops, 06DC-Ops, 10ops-eqiad, 06SRE: Q3:rack/setup/install frdb1008 - https://phabricator.wikimedia.org/T414374#11652718 (10VRiley-WMF) Running into another error with the provisioning script. Working on this. [23:47:04] 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 10FR-WMF-Audit: Paypal - handle 'general reversal' - https://phabricator.wikimedia.org/T418191#11652719 (10MBeat33) If a donor requests a refund of their initial recurring annual donation at PayPal (via ordinary request to PayPal, or via dispute at the...