[00:32:28] 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 10FR-WMF-Audit: Paypal - handle 'general reversal' - https://phabricator.wikimedia.org/T418191#11652756 (10Ejegg) Hi @MBeat33, we do have code to cancel the PayPal recurring on the first chargeback, but I see only 223 PayPal cancellations with the reaso... [00:34:34] 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 10FR-WMF-Audit: Paypal - handle 'general reversal' - https://phabricator.wikimedia.org/T418191#11652758 (10Eileenmcnaughton) @MBeat33 just noting that you should open another phab if you think there is something for us to do (it's tangential to this phab) [00:35:42] 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 10FR-WMF-Audit: Paypal - handle 'general reversal' - https://phabricator.wikimedia.org/T418191#11652760 (10MBeat33) Thanks, @Ejegg for confirming that. It might make sense to have the code apply to just chargebacks. And @Eileenmcnaughton got it, will... [00:38:04] (03PS6) 10Ejegg: Send double opt-in email on email prefs opt-in [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1240016 (https://phabricator.wikimedia.org/T407442) [00:38:04] (03PS7) 10Ejegg: Add double opt-in activity from email change [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1240025 (https://phabricator.wikimedia.org/T407442) [00:38:20] ok lars, I think I got to all the suggestions [00:39:28] (03CR) 10Ejegg: "Thanks for the review! I think it should just be sending one email in all cases now. I also addressed the other errors you found in the la" [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1240016 (https://phabricator.wikimedia.org/T407442) (owner: 10Ejegg) [01:02:19] 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 07FR-Audience-Dev: Civi and Acoustic field request: Current CY or FY donation count - https://phabricator.wikimedia.org/T418272#11652818 (10NNgu-WMF) @Lars It would usually take me a day or two to create contact lists and incorporate them into the quer... [01:09:25] 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 07FR-Audience-Dev: Civi and Acoustic field request: Current CY or FY donation count - https://phabricator.wikimedia.org/T418272#11652821 (10Lars) Thanks @NNgu-WMF, we'll see if we can get the export to Acoustic working ({T301514}) before then and if not... [01:41:47] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM: Update user job status when incomplete or complete with errors import has been completed via import API action - https://phabricator.wikimedia.org/T418416#11652855 (10Biggest_luminary) a:03Biggest_luminary [01:49:43] FIRING: [2x] CoreRouterInterfaceDown: Core router interface down - pfw1-codfw:reth2 (fasw1-f5 2x25G) - https://wikitech.wikimedia.org/wiki/Network_monitoring#Router_interface_down - https://grafana.wikimedia.org/d/fb403d62-5f03-434a-9dff-bd02b9fff504/network-device-overview?var-instance=pfw1-codfw:9804 - https://alerts.wikimedia.org/?q=alertname%3DCoreRouterInterfaceDown [02:01:55] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM: Update user job status when incomplete or complete with errors import has been completed via import API action - https://phabricator.wikimedia.org/T418416#11652871 (10Lars) a:05Biggest_luminaryβ†’03None [02:07:44] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM: Update user job status when incomplete or complete with errors import has been completed via import API action - https://phabricator.wikimedia.org/T418416#11652885 (10Lars) [02:08:33] (03PS1) 10Lars SG: Manage expiration date for user jobs on status change [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1244101 (https://phabricator.wikimedia.org/T416039) [02:13:11] (03PS1) 10Lars SG: Add Country ISO Code token [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1244104 (https://phabricator.wikimedia.org/T418335) [02:14:42] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM: When updating activities via import with id, activity type, subject and date should not be required - https://phabricator.wikimedia.org/T418422#11652897 (10Lars) a:03Lars [02:22:35] 06Fundraising-Backlog, 10fundraising-tech-ops: Issue new SSL Client Certificate for sinaba - https://phabricator.wikimedia.org/T417352#11652904 (10Dwisehaupt) certificate renewed and sent via email. password sent via sms. [03:14:05] (03PS1) 10Ejegg: WIP All-purpose Donor Portal message template [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1244138 (https://phabricator.wikimedia.org/T416600) [03:14:07] (03PS1) 10Ejegg: Add activity_tracking to annual conversion [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1244139 [03:18:33] (03CR) 10CI reject: [V:04-1] Add activity_tracking to annual conversion [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1244139 (owner: 10Ejegg) [03:25:20] (03PS2) 10Ejegg: Add activity_tracking to annual conversion [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1244139 [04:23:04] (03CR) 10Eileen: [C:03+2] Add Country ISO Code token [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1244104 (https://phabricator.wikimedia.org/T418335) (owner: 10Lars SG) [04:24:40] (03PS1) 10Eileen: Civix upgrade on exchange rates [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1244167 [04:25:32] (03PS1) 10Eileen: Civix upgrade on wmf-thank you [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1244169 [04:26:51] (03PS1) 10Eileen: Civix upgrade on smashpig [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1244170 [04:27:35] (03PS1) 10Eileen: Civix upgrade on wmf-civicrm [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1244171 [04:29:54] (03PS1) 10Eileen: Example data wip [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1244172 [04:31:16] (03CR) 10CI reject: [V:04-1] Example data wip [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1244172 (owner: 10Eileen) [04:33:09] (03CR) 10CI reject: [V:04-1] Civix upgrade on wmf-civicrm [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1244171 (owner: 10Eileen) [04:33:13] (03CR) 10CI reject: [V:04-1] Civix upgrade on smashpig [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1244170 (owner: 10Eileen) [04:35:47] (03PS2) 10Eileen: Civix upgrade on wmf-civicrm [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1244171 [04:35:49] (03CR) 10CI reject: [V:04-1] Civix upgrade on exchange rates [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1244167 (owner: 10Eileen) [04:36:23] (03CR) 10CI reject: [V:04-1] Civix upgrade on wmf-thank you [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1244169 (owner: 10Eileen) [04:39:28] (03PS1) 10Eileen: Fix deprecation warning [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1244177 [04:41:44] (03Merged) 10jenkins-bot: Add Country ISO Code token [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1244104 (https://phabricator.wikimedia.org/T418335) (owner: 10Lars SG) [04:48:17] (03PS1) 10Eileen: Remove gateway & gateway_txn_id from Settle action [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1244182 [05:00:32] (03CR) 10CI reject: [V:04-1] Localisation updates from https://translatewiki.net. [extensions/DonationInterface] (REL1_45) - 10https://gerrit.wikimedia.org/r/1244224 (owner: 10L10n-bot) [05:20:32] (03CR) 10Cstone: [C:03+2] Fix yesterdays's mistake [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1244181 (owner: 10Eileen) [05:20:44] (03CR) 10Cstone: [C:03+2] Remove gateway & gateway_txn_id from Settle action [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1244182 (owner: 10Eileen) [05:38:43] (03Merged) 10jenkins-bot: Fix yesterdays's mistake [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1244181 (owner: 10Eileen) [05:38:54] (03Merged) 10jenkins-bot: Remove gateway & gateway_txn_id from Settle action [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1244182 (owner: 10Eileen) [05:42:27] 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 10FR-WMF-Audit, 13Patch-For-Review: Trustly - Gravy IDs unreliable in reconciliation / settlement reports - https://phabricator.wikimedia.org/T418332#11653036 (10Eileenmcnaughton) So to articulate what I'm seeing .... January 4th, 2026 9:34 PM Net Am... [05:49:43] FIRING: [2x] CoreRouterInterfaceDown: Core router interface down - pfw1-codfw:reth2 (fasw1-f5 2x25G) - https://wikitech.wikimedia.org/wiki/Network_monitoring#Router_interface_down - https://grafana.wikimedia.org/d/fb403d62-5f03-434a-9dff-bd02b9fff504/network-device-overview?var-instance=pfw1-codfw:9804 - https://alerts.wikimedia.org/?q=alertname%3DCoreRouterInterfaceDown [06:17:12] PROBLEM - check_memory on fransw2002 is CRITICAL: CRIT Memory 98% used. Largest process: trino-server-co (1553) = 97.8% https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=fransw2002&service=check_memory [06:22:12] PROBLEM - check_memory on fransw2002 is CRITICAL: CRIT Memory 98% used. Largest process: trino-server-co (1553) = 97.8% https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=fransw2002&service=check_memory [06:23:50] (03PS2) 10Cstone: Add US only phone validation to start [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1240469 (https://phabricator.wikimedia.org/T380106) [06:24:18] (03CR) 10Cstone: Add US only phone validation to start (031 comment) [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1240469 (https://phabricator.wikimedia.org/T380106) (owner: 10Cstone) [06:24:29] (03CR) 10Cstone: Add US only phone validation to start (031 comment) [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1240469 (https://phabricator.wikimedia.org/T380106) (owner: 10Cstone) [06:27:13] PROBLEM - check_memory on fransw2002 is CRITICAL: CRIT Memory 98% used. Largest process: trino-server-co (1553) = 97.8% https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=fransw2002&service=check_memory [06:37:11] RECOVERY - check_memory on fransw2002 is OK: OK Memory 89% used https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=fransw2002&service=check_memory [06:45:43] 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 10FR-WMF-Audit, 13Patch-For-Review: Trustly - Gravy IDs unreliable in reconciliation / settlement reports - https://phabricator.wikimedia.org/T418332#11653105 (10Cstone) It's interesting the backend_processor_txn_id flips from a gravy id to a trustly... [07:00:53] (03PS3) 10Eileen: Fix some data issues from gravy IDs in trustly settlement not relating [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1243600 (https://phabricator.wikimedia.org/T418332) [07:00:53] (03PS2) 10Eileen: Treat Gravy IDs as unreliable when working from trustly settlement report [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1243601 (https://phabricator.wikimedia.org/T418332) [07:04:00] (03PS1) 10Eileen: Merge branch 'master' of https://gerrit.wikimedia.org/r/wikimedia/fundraising/crm into deployment [wikimedia/fundraising/crm] (deployment) - 10https://gerrit.wikimedia.org/r/1244457 [07:05:28] (03PS2) 10Eileen: Civix upgrade on wmf-thank you [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1244169 [07:09:18] (03CR) 10Eileen: [C:03+2] Add activity_tracking to annual conversion [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1244139 (owner: 10Ejegg) [07:09:29] (03PS3) 10Ejegg: Add activity_tracking to annual conversion [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1244139 [07:11:15] (03CR) 10Eileen: "This would get picked up by doing the WMFConfig.syncCustomFields api since it just has to load the file to call ensureOptionValueExists..." [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1244139 (owner: 10Ejegg) [07:11:43] (03CR) 10Eileen: [C:03+2] Merge branch 'master' of https://gerrit.wikimedia.org/r/wikimedia/fundraising/crm into deployment [wikimedia/fundraising/crm] (deployment) - 10https://gerrit.wikimedia.org/r/1244457 (owner: 10Eileen) [07:14:05] !log civicrm upgraded from c3157fbf to 3ac93e95 [07:14:06] Logged the message at https://wikitech.wikimedia.org/wiki/Fundraising/SAL [07:14:51] (03CR) 10Eileen: [C:03+2] Manage expiration date for user jobs on status change [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1244101 (https://phabricator.wikimedia.org/T416039) (owner: 10Lars SG) [07:22:30] (03CR) 10CI reject: [V:04-1] Civix upgrade on wmf-thank you [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1244169 (owner: 10Eileen) [07:29:22] (03Merged) 10jenkins-bot: Add activity_tracking to annual conversion [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1244139 (owner: 10Ejegg) [07:43:13] (03CR) 10Abijeet Patro: [V:03+2] Localisation updates from https://translatewiki.net. [extensions/DonationInterface] (REL1_45) - 10https://gerrit.wikimedia.org/r/1244224 (owner: 10L10n-bot) [07:45:36] (03CR) 10Abijeet Patro: [V:03+2] Localisation updates from https://translatewiki.net. [extensions/DonationInterface] (REL1_44) - 10https://gerrit.wikimedia.org/r/1243465 (owner: 10L10n-bot) [08:30:20] PROBLEM - check_load on frban2002 is CRITICAL: LOAD CRITICAL - total load average: 112.62, 81.39, 40.91 https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frban2002&service=check_load [08:33:14] PROBLEM - check_load on frban1002 is CRITICAL: LOAD CRITICAL - total load average: 147.40, 100.98, 52.68 https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frban1002&service=check_load [08:35:18] PROBLEM - check_load on frban2002 is CRITICAL: LOAD CRITICAL - total load average: 118.50, 112.31, 66.19 https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frban2002&service=check_load [08:38:14] PROBLEM - check_load on frban1002 is CRITICAL: LOAD CRITICAL - total load average: 89.54, 100.89, 67.07 https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frban1002&service=check_load [08:40:16] PROBLEM - check_load on frban2002 is CRITICAL: LOAD CRITICAL - total load average: 49.36, 84.37, 67.70 https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frban2002&service=check_load [08:43:12] PROBLEM - check_load on frban1002 is CRITICAL: LOAD CRITICAL - total load average: 48.13, 74.72, 66.14 https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frban1002&service=check_load [08:45:18] PROBLEM - check_load on frban2002 is CRITICAL: LOAD CRITICAL - total load average: 18.96, 49.34, 57.69 https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frban2002&service=check_load [08:48:12] PROBLEM - check_load on frban1002 is CRITICAL: LOAD CRITICAL - total load average: 8.64, 39.58, 54.00 https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frban1002&service=check_load [09:00:18] RECOVERY - check_load on frban2002 is OK: LOAD OK - total load average: 3.09, 5.46, 24.50 https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frban2002&service=check_load [09:03:12] RECOVERY - check_load on frban1002 is OK: LOAD OK - total load average: 5.03, 9.07, 24.40 https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frban1002&service=check_load [09:49:43] FIRING: [2x] CoreRouterInterfaceDown: Core router interface down - pfw1-codfw:reth2 (fasw1-f5 2x25G) - https://wikitech.wikimedia.org/wiki/Network_monitoring#Router_interface_down - https://grafana.wikimedia.org/d/fb403d62-5f03-434a-9dff-bd02b9fff504/network-device-overview?var-instance=pfw1-codfw:9804 - https://alerts.wikimedia.org/?q=alertname%3DCoreRouterInterfaceDown [10:24:13] 06Fundraising-Backlog: TJK998DQRHPLNLB9 - In Authorised status - https://phabricator.wikimedia.org/T418457 (10RKumar_WMF) 03NEW [11:05:18] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog: TJK998DQRHPLNLB9 - In Authorised status - https://phabricator.wikimedia.org/T418457#11653714 (10jgleeson) a:03jgleeson [11:51:22] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog: TJK998DQRHPLNLB9 - In Authorised status - https://phabricator.wikimedia.org/T418457#11653941 (10jgleeson) It looks like this user tried 3 times in quick succession and was finally rejected due to triggering our IP Velocity penalty. I see the following in... [12:46:55] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog: TJK998DQRHPLNLB9 - In Authorised status - https://phabricator.wikimedia.org/T418457#11654125 (10jgleeson) Ok, I understand it better now. That final transaction is intentionally left for manual review (stuck at auth). We use the status LEAVE_AT_CONSOLE to... [13:10:05] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog: TJK998DQRHPLNLB9 - In Authorised status - https://phabricator.wikimedia.org/T418457#11654208 (10jgleeson) I dug out an old ticket which talks around this manual review stage https://phabricator.wikimedia.org/T276183 My understanding here is that the pend... [13:49:43] FIRING: [2x] CoreRouterInterfaceDown: Core router interface down - pfw1-codfw:reth2 (fasw1-f5 2x25G) - https://wikitech.wikimedia.org/wiki/Network_monitoring#Router_interface_down - https://grafana.wikimedia.org/d/fb403d62-5f03-434a-9dff-bd02b9fff504/network-device-overview?var-instance=pfw1-codfw:9804 - https://alerts.wikimedia.org/?q=alertname%3DCoreRouterInterfaceDown [14:21:50] (03PS6) 10Damilare Adedoyin: Add refund and inactive recurring status to donations history list. [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1237505 (https://phabricator.wikimedia.org/T416370) [14:24:05] 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 07FR-Audience-Dev: Civi and Acoustic field request: Current CY or FY donation count - https://phabricator.wikimedia.org/T418272#11654608 (10NNgu-WMF) Sounds good, I've made a note to self to check back in on this task around April 1st to see what we nee... [14:24:53] 10Fundraising analytics stack, 10fundraising-tech-ops: SurveyMonkey load data into platform - https://phabricator.wikimedia.org/T385743#11654610 (10NNgu-WMF) Hi all! Are Zendesk or SurveyMonkey data now available in Civi for us to use in audience building? [14:25:21] (03CR) 10CI reject: [V:04-1] Add refund and inactive recurring status to donations history list. [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1237505 (https://phabricator.wikimedia.org/T416370) (owner: 10Damilare Adedoyin) [14:29:11] (03CR) 10Ejegg: "Looking really good now, just one last thing - I think the refundedStatusLocale function is redundant at this point." [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1237505 (https://phabricator.wikimedia.org/T416370) (owner: 10Damilare Adedoyin) [14:56:11] (03PS7) 10Damilare Adedoyin: Add refund and inactive recurring status to donations history list. [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1237505 (https://phabricator.wikimedia.org/T416370) [14:56:57] (03PS8) 10Damilare Adedoyin: Add refund and inactive recurring status to donations history list. [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1237505 (https://phabricator.wikimedia.org/T416370) [15:03:54] (03CR) 10Damilare Adedoyin: "Thanks ejegg for the CR, I've updated the patch with your suggestions and added a response to your last review." [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1237505 (https://phabricator.wikimedia.org/T416370) (owner: 10Damilare Adedoyin) [15:05:29] (03PS9) 10Damilare Adedoyin: Add refund and inactive recurring status to donations history list. [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1237505 (https://phabricator.wikimedia.org/T416370) [15:05:30] (03CR) 10Ejegg: [C:03+2] Add refund and inactive recurring status to donations history list. [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1237505 (https://phabricator.wikimedia.org/T416370) (owner: 10Damilare Adedoyin) [15:06:49] thanks ejegg for the cr! [15:13:06] ty for the nice work [15:13:21] odd about the linter though, i could swear we were using dynamic keys elsewhere [15:27:45] yh, first time I'm seeing the error as well. Looking through seems most have been through the computed function. [15:33:25] (03PS2) 10Ejegg: All-purpose Donor Portal message template [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1244138 (https://phabricator.wikimedia.org/T416600) [15:34:52] (03PS27) 10Damilare Adedoyin: Ping Civi on Login page to check its status. [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1239778 (https://phabricator.wikimedia.org/T402972) [15:44:30] (03Merged) 10jenkins-bot: Add refund and inactive recurring status to donations history list. [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1237505 (https://phabricator.wikimedia.org/T416370) (owner: 10Damilare Adedoyin) [15:48:39] 03Fundraising Sprint: Dami's Crib πŸ˜€, 06Fundraising-Backlog, 10FR-Donor-portal, 07fr-current-sprint, 13Patch-For-Review: Scoping Donor Portal Operational Emails - https://phabricator.wikimedia.org/T416600#11655155 (10SBurnett-WMF) @PPenloglou-WMF and @RLopez-WMF are coordinating on the template build and... [15:49:21] fr-tech this patch is ready for review: https://gerrit.wikimedia.org/r/1244138 [15:49:45] so it's just meant to get something for the email designers to build the template around [15:49:54] it doesn't send any email to donors yet [15:50:25] but I believe we should be able to get the old & new contribution_recur rows in all cases [15:51:36] anyway, it would be great to get that deployed today to let the email designers get to work [15:52:25] ejegg: how about some review trade? [15:54:01] I'll can pick that up. Do you fancy reviewing those Gravy end-to-end UML diagrams I added before I add them to our docs? https://phabricator.wikimedia.org/T418251 [15:54:12] gotta drop kids at a party. back soon [16:00:45] sure thing jgleeson|errand [16:06:25] 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 10FR-Donation-Processing: Engage <> Gr4vy for Direct Mail CC and ACH - https://phabricator.wikimedia.org/T417842#11655308 (10MDemosWMF) Hi all, due to some extra data security work that is needed on Gr4vy's side the testing stage has been pushed back to... [16:12:28] (03PS1) 10Ejegg: Updater fn to add tracking to annual conversion [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1244706 [16:18:13] PROBLEM - check_load on frban1002 is CRITICAL: LOAD CRITICAL - total load average: 110.59, 104.99, 54.72 https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frban1002&service=check_load [16:18:51] 10Fundraising analytics stack, 10fundraising-tech-ops: Turnilo access for hahmed-ctr@wikimedia.org - https://phabricator.wikimedia.org/T413250#11655375 (10HAhmed-WMF) 05Openβ†’03Resolved [16:20:17] PROBLEM - check_load on frban2002 is CRITICAL: LOAD CRITICAL - total load average: 178.54, 115.02, 60.88 https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frban2002&service=check_load [16:23:13] PROBLEM - check_load on frban1002 is CRITICAL: LOAD CRITICAL - total load average: 125.27, 111.56, 71.18 https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frban1002&service=check_load [16:25:17] PROBLEM - check_load on frban2002 is CRITICAL: LOAD CRITICAL - total load average: 135.25, 125.78, 80.05 https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frban2002&service=check_load [16:28:13] PROBLEM - check_load on frban1002 is CRITICAL: LOAD CRITICAL - total load average: 126.89, 118.52, 85.30 https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frban1002&service=check_load [16:29:01] ACKNOWLEDGEMENT - check_load on frban1002 is CRITICAL: LOAD CRITICAL - total load average: 126.89, 118.52, 85.30 Jeff_Green yes, we know https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frban1002&service=check_load [16:29:02] ACKNOWLEDGEMENT - check_load on frban2002 is CRITICAL: LOAD CRITICAL - total load average: 135.25, 125.78, 80.05 Jeff_Green yes, we know https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frban2002&service=check_load [16:32:49] 03Fundraising Sprint: Dami's Crib πŸ˜€, 06Fundraising-Backlog, 07fr-current-sprint: Payments-wiki Gravy card donation & webhook processing UML sequence diagram (full picture) - https://phabricator.wikimedia.org/T418251#11655445 (10Ejegg) Pretty thorough! The gravy adapter generally finalizes the CC status to PE... [16:35:46] ty ejegg [16:57:49] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 13Patch-For-Review: Add country abbreviation token - https://phabricator.wikimedia.org/T418335#11655609 (10Lars) @ppenloglou Should be good to go now [16:58:46] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 13Patch-For-Review: Add country abbreviation token - https://phabricator.wikimedia.org/T418335#11655615 (10ppenloglou) Thanks for the update here! I'll reply back if I'm facing any issues [16:59:15] 03Fundraising Sprint: Dami's Crib πŸ˜€, 06Fundraising-Backlog, 07fr-current-sprint, 07payments-orchestration: Investigate Pix AutomΓ‘tico - https://phabricator.wikimedia.org/T389865#11655620 (10AnnWF) a:03AnnWF [17:20:39] 03Fundraising Sprint: Dami's Crib πŸ˜€, 06Fundraising-Backlog, 10MediaWiki-extensions-DonationInterface, 07fr-current-sprint, and 2 others: We are sending two pending messages for many gravy transactions - https://phabricator.wikimedia.org/T416404#11655711 (10AnnWF) a:03AnnWF [17:23:36] (03PS1) 10Lars SG: Merge branch 'master' into deployment [wikimedia/fundraising/crm] (deployment) - 10https://gerrit.wikimedia.org/r/1244721 [17:40:34] (03CR) 10Lars SG: [C:03+2] Merge branch 'master' into deployment [wikimedia/fundraising/crm] (deployment) - 10https://gerrit.wikimedia.org/r/1244721 (owner: 10Lars SG) [17:41:30] (03Merged) 10jenkins-bot: Merge branch 'master' into deployment [wikimedia/fundraising/crm] (deployment) - 10https://gerrit.wikimedia.org/r/1244721 (owner: 10Lars SG) [17:44:49] !log civicrm upgraded from 3ac93e95 to 2a6001d3 [17:44:50] Logged the message at https://wikitech.wikimedia.org/wiki/Fundraising/SAL [17:49:43] FIRING: [2x] CoreRouterInterfaceDown: Core router interface down - pfw1-codfw:reth2 (fasw1-f5 2x25G) - https://wikitech.wikimedia.org/wiki/Network_monitoring#Router_interface_down - https://grafana.wikimedia.org/d/fb403d62-5f03-434a-9dff-bd02b9fff504/network-device-overview?var-instance=pfw1-codfw:9804 - https://alerts.wikimedia.org/?q=alertname%3DCoreRouterInterfaceDown [18:11:25] 03Fundraising Sprint: Dami's Crib πŸ˜€, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 07fr-current-sprint: Add filters to All / My Imports reports in core - https://phabricator.wikimedia.org/T416040#11655899 (10Lars) It would also be convenient to add a delete button so users can delete complete wit... [18:28:14] RECOVERY - check_load on frban1002 is OK: LOAD OK - total load average: 2.70, 4.55, 21.97 https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frban1002&service=check_load [18:55:18] RECOVERY - check_load on frban2002 is OK: LOAD OK - total load average: 2.52, 4.09, 19.95 https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frban2002&service=check_load [18:57:32] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 13Patch-For-Review: Many temp tables hanging around in Civi - https://phabricator.wikimedia.org/T416039#11656148 (10Lars) @Jgreen This should keep our tmp table in civicrm under control in the future. I've deleted a bu... [19:51:09] (03CR) 10Krinkle: [C:03+2] Disable geotargeting selectors when not editable [extensions/CentralNotice] - 10https://gerrit.wikimedia.org/r/1237562 (https://phabricator.wikimedia.org/T393834) (owner: 10Ejegg) [19:53:02] (03CR) 10Krinkle: [C:03+2] Disable mixin inputs when not editable [extensions/CentralNotice] - 10https://gerrit.wikimedia.org/r/1237584 (https://phabricator.wikimedia.org/T393834) (owner: 10Ejegg) [19:53:19] (03PS2) 10Krinkle: Disable project / language selectors when not editable [extensions/CentralNotice] - 10https://gerrit.wikimedia.org/r/1237590 (https://phabricator.wikimedia.org/T393834) (owner: 10Ejegg) [19:54:40] (03Merged) 10jenkins-bot: Disable geotargeting selectors when not editable [extensions/CentralNotice] - 10https://gerrit.wikimedia.org/r/1237562 (https://phabricator.wikimedia.org/T393834) (owner: 10Ejegg) [19:56:58] (03Merged) 10jenkins-bot: Disable mixin inputs when not editable [extensions/CentralNotice] - 10https://gerrit.wikimedia.org/r/1237584 (https://phabricator.wikimedia.org/T393834) (owner: 10Ejegg) [20:52:45] (03PS1) 10Ejegg: Remove unused global [extensions/CentralNotice] - 10https://gerrit.wikimedia.org/r/1244836 (https://phabricator.wikimedia.org/T299093) [20:53:48] 03Fundraising Sprint: Dami's Crib πŸ˜€, 10MediaWiki-extensions-CentralNotice, 07JavaScript, 13Patch-For-Review: Remove javascript global wgNoticeUserData - https://phabricator.wikimedia.org/T299093#11656510 (10Ejegg) [20:53:57] 03Fundraising Sprint: Dami's Crib πŸ˜€, 10MediaWiki-extensions-CentralNotice, 07JavaScript, 13Patch-For-Review: Remove javascript global wgNoticeUserData - https://phabricator.wikimedia.org/T299093#11656512 (10Ejegg) a:03Ejegg [20:54:10] 03Fundraising Sprint: Dami's Crib πŸ˜€, 10MediaWiki-extensions-CentralNotice, 07JavaScript, 13Patch-For-Review: Remove javascript global wgNoticeUserData - https://phabricator.wikimedia.org/T299093#11656513 (10Ejegg) [21:14:31] (03CR) 10Eileen: [C:03+2] Updater fn to add tracking to annual conversion [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1244706 (owner: 10Ejegg) [21:18:47] (03CR) 10Jgleeson: All-purpose Donor Portal message template (032 comments) [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1244138 (https://phabricator.wikimedia.org/T416600) (owner: 10Ejegg) [21:23:16] (03PS3) 10Ejegg: All-purpose Donor Portal message template [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1244138 (https://phabricator.wikimedia.org/T416600) [21:23:52] ok jgleeson I fixed those /p tags and removed the text version (will autogenerate it from the html version) [21:24:09] cool [21:26:18] ejegg: what's the deal with the "ta" [21:26:21] is that intended [21:26:34] that's scouse shorthand for thanks [21:26:43] I guess to make it clear it's placeholder text! [21:26:45] so works in Liverpool but not sure about the rest of the world [21:26:50] ah [21:27:22] so you wanna leave that in as-is [21:27:48] yeah :) [21:28:06] https://www.scousedictionary.co.uk/ta/ [21:28:14] when Panos / Ramon come up with the real text I'll copy it back to dev [21:28:23] that'll work well with the Liverpool crowd [21:30:14] (03CR) 10Jgleeson: [C:03+2] All-purpose Donor Portal message template [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1244138 (https://phabricator.wikimedia.org/T416600) (owner: 10Ejegg) [21:31:07] ta, jgleeson ! [21:31:11] :) [21:31:39] bye for now [21:32:32] (03PS1) 10Ejegg: Merge branch 'master' into deployment [wikimedia/fundraising/crm] (deployment) - 10https://gerrit.wikimedia.org/r/1244855 [21:32:34] (03CR) 10Ejegg: [C:03+2] Merge branch 'master' into deployment [wikimedia/fundraising/crm] (deployment) - 10https://gerrit.wikimedia.org/r/1244855 (owner: 10Ejegg) [21:33:02] (03Merged) 10jenkins-bot: Updater fn to add tracking to annual conversion [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1244706 (owner: 10Ejegg) [21:38:02] (03PS1) 10Wfan: Update lowconfiedence logic to check current primary location [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1244856 (https://phabricator.wikimedia.org/T416052) [21:40:18] (03CR) 10Wfan: [C:03+2] Add US only phone validation to start [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1240469 (https://phabricator.wikimedia.org/T380106) (owner: 10Cstone) [21:43:07] (03Merged) 10jenkins-bot: Add US only phone validation to start [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1240469 (https://phabricator.wikimedia.org/T380106) (owner: 10Cstone) [21:43:55] 06Fundraising-Backlog, 10MediaWiki-extensions-DonationInterface: Mismatch between "Donate" and "Continue" in SEPA messages - https://phabricator.wikimedia.org/T418538 (10Pcoombe) 03NEW [21:48:42] (03CR) 10Ejegg: [V:03+2 C:03+2] Merge branch 'master' into deployment [wikimedia/fundraising/crm] (deployment) - 10https://gerrit.wikimedia.org/r/1244855 (owner: 10Ejegg) [21:48:49] (03PS15) 10Wfan: Assign location type for 3rd party donaiton [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1237617 (https://phabricator.wikimedia.org/T416052) [21:48:58] (03PS2) 10Wfan: Update lowconfiedence logic to check current primary location [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1244856 (https://phabricator.wikimedia.org/T416052) [21:49:08] (03PS8) 10Wfan: When venmo username update, add activity for old one [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1237625 (https://phabricator.wikimedia.org/T416052) [21:49:43] FIRING: [2x] CoreRouterInterfaceDown: Core router interface down - pfw1-codfw:reth2 (fasw1-f5 2x25G) - https://wikitech.wikimedia.org/wiki/Network_monitoring#Router_interface_down - https://grafana.wikimedia.org/d/fb403d62-5f03-434a-9dff-bd02b9fff504/network-device-overview?var-instance=pfw1-codfw:9804 - https://alerts.wikimedia.org/?q=alertname%3DCoreRouterInterfaceDown [21:52:12] (03PS1) 10Eileen: New log line is waaay too noisy [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1244858 [21:52:19] !log civicrm upgraded from 2a6001d3 to 6995dc03 [21:52:20] Logged the message at https://wikitech.wikimedia.org/wiki/Fundraising/SAL [21:52:35] (03PS2) 10Eileen: New log line is waaay too noisy [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1244858 [21:52:36] (03CR) 10Ejegg: [C:03+2] New log line is waaay too noisy [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1244858 (owner: 10Eileen) [21:54:57] (03CR) 10Lars SG: [V:03+2] New log line is waaay too noisy [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1244858 (owner: 10Eileen) [22:05:58] 03Fundraising Sprint: Dami's Crib πŸ˜€, 06Fundraising-Backlog, 10FR-Donor-portal, 07fr-current-sprint, 13Patch-For-Review: Scoping Donor Portal Operational Emails - https://phabricator.wikimedia.org/T416600#11656687 (10Ejegg) @ppenloglou and @RLopez-WMF - I've deployed a skeleton template with some sample d... [22:07:12] (03CR) 10CI reject: [V:04-1] Update lowconfiedence logic to check current primary location [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1244856 (https://phabricator.wikimedia.org/T416052) (owner: 10Wfan) [22:09:59] (03PS1) 10Ejegg: Japanese localization for RecurUpgrade [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1244862 (https://phabricator.wikimedia.org/T415682) [22:10:09] (03CR) 10CI reject: [V:04-1] Japanese localization for RecurUpgrade [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1244862 (https://phabricator.wikimedia.org/T415682) (owner: 10Ejegg) [22:12:56] (03PS2) 10Ejegg: Japanese localization for RecurUpgrade [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1244862 (https://phabricator.wikimedia.org/T415682) [22:13:11] oh I gotta skedaddle for a bit [22:14:18] (03Merged) 10jenkins-bot: New log line is waaay too noisy [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1244858 (owner: 10Eileen) [22:21:22] 06Fundraising-Backlog: Add Donate link in hamburger menu on mobile for logged in users - https://phabricator.wikimedia.org/T416101#11656729 (10spatton) [22:22:49] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 13Patch-For-Review: Many temp tables hanging around in Civi - https://phabricator.wikimedia.org/T416039#11656730 (10Jgreen) >>! In T416039#11656148, @Lars wrote: > @Jgreen This should keep our tmp table in civicrm unde... [22:24:38] (03PS1) 10Cstone: Add back in logging And fix space [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1244873 (https://phabricator.wikimedia.org/T417435) [22:25:10] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 13Patch-For-Review: Repeat Adyen ApplePay getpaymentmethods calls - https://phabricator.wikimedia.org/T417435#11656740 (10Cstone) Historical info: {T350757} [22:26:29] 06Fundraising-Backlog: Add Donate link in hamburger menu on mobile for logged in users - https://phabricator.wikimedia.org/T416101#11656742 (10spatton) Hi @Commander_Keane, thanks for the ping. I appreciate you bringing this up on the feedback page last fall, too; it helped revive it as a topic for the fundraisi... [22:30:55] (03PS1) 10Eileen: Merge branch 'master' of https://gerrit.wikimedia.org/r/wikimedia/fundraising/crm into deployment [wikimedia/fundraising/crm] (deployment) - 10https://gerrit.wikimedia.org/r/1244876 [22:31:34] (03CR) 10Eileen: [C:03+2] Merge branch 'master' of https://gerrit.wikimedia.org/r/wikimedia/fundraising/crm into deployment [wikimedia/fundraising/crm] (deployment) - 10https://gerrit.wikimedia.org/r/1244876 (owner: 10Eileen) [22:32:26] (03Merged) 10jenkins-bot: Merge branch 'master' of https://gerrit.wikimedia.org/r/wikimedia/fundraising/crm into deployment [wikimedia/fundraising/crm] (deployment) - 10https://gerrit.wikimedia.org/r/1244876 (owner: 10Eileen) [22:36:24] !log civicrm upgraded from 6995dc03 to 162bbf7c [22:36:25] Logged the message at https://wikitech.wikimedia.org/wiki/Fundraising/SAL [22:44:32] (03PS3) 10Wfan: Update lowconfiedence logic to check current primary location [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1244856 (https://phabricator.wikimedia.org/T416052) [23:00:35] (03PS4) 10Eileen: Fix some data issues from gravy IDs in trustly settlement not relating [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1243600 (https://phabricator.wikimedia.org/T418332) [23:51:59] (03PS16) 10Wfan: Assign location type for 3rd party donaiton [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1237617 (https://phabricator.wikimedia.org/T416052) [23:52:07] (03PS9) 10Wfan: When venmo username update, add activity for old one [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1237625 (https://phabricator.wikimedia.org/T416052) [23:52:15] (03PS4) 10Wfan: Re-enable active paypal-ec recurring donor to update their EmailPreference Primary Email [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1237626 (https://phabricator.wikimedia.org/T416056) [23:54:29] 03Fundraising Sprint: Dami's Crib πŸ˜€, 06Fundraising-Backlog, 10FR-Donor-portal, 07fr-current-sprint: Scoping Donor Portal Operational Emails - https://phabricator.wikimedia.org/T416600#11656826 (10ppenloglou) Thank you @Ejegg! I've taken a stab at this, viewable in the template you shared https://civicrm.wi...