[00:00:26] 10Fundraising-Backlog: AMEX rejected transactions through Ingenico are to be ported to Adyen - https://phabricator.wikimedia.org/T338523 (10EMartin) Thanks @Ejegg . Ingenico will transfer the file with the PII directly to Adyen. I will tell them they need to include the Ingenico recurring token in the EchoData... [00:10:59] (03CR) 10Wfan: [C: 03+2] "LGTM! thanks :)" [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/931927 (owner: 10Damilare Adedoyin) [00:12:49] (03Merged) 10jenkins-bot: Some cosmetic updates to the RecurUpgrade form [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/931927 (owner: 10Damilare Adedoyin) [01:00:44] 10Fundraising Sprint Message in a JSON blob, 10Fundraising-Backlog, 10fundraising-tech-ops: Move dlocal report downloads from IP based to dns based - https://phabricator.wikimedia.org/T340075 (10Dwisehaupt) [01:00:56] 10Fundraising Tech - Chaos Crew, 10Fundraising-Backlog: Adyen Audit - manually settled transactions not being imported into civi with the nightly audit file - https://phabricator.wikimedia.org/T325415 (10AnnWF) from Kristine Hancock Some cids and Adyen PSP details of a few recently manually settled by the team... [01:01:21] 10Fundraising Sprint Message in a JSON blob, 10Fundraising-Backlog, 10fundraising-tech-ops: Move dlocal report downloads from IP based to dns based - https://phabricator.wikimedia.org/T340075 (10Dwisehaupt) Config adjusted to use the new sftp.dlocal.com address. [01:37:22] 10Fundraising-Backlog, 10MediaWiki-extensions-CentralNotice: CentralNotice geotargeting broken - https://phabricator.wikimedia.org/T141236 (10AKanji-WMF) 05Open→03Invalid Thank you @HNordeenWMF - closing this out. [02:15:17] 10Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 10fundraising-tech-ops: Reduce the year fields for WMF donor - https://phabricator.wikimedia.org/T339314 (10AKanji-WMF) Hi @ERoden-WMF - is there a broader process we need to follow in order to confirm/approve this proposal? Thinking about stakeholders... [02:32:59] 10Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 10fundraising-tech-ops: Reduce the year fields for WMF donor - https://phabricator.wikimedia.org/T339314 (10ERoden-WMF) Hi @AKanji-WMF I checked with the major gifts managers/directors and they checked with their wider team. They've confirmed these chan... [05:29:35] (03PS1) 10AndyRussG: Add option to not use config-private [wikimedia/fundraising/dev] - 10https://gerrit.wikimedia.org/r/932047 [05:30:49] ^ at least got me a working Donut and apparently-workin Civi! [05:50:50] (03CR) 10CI reject: [V: 04-1] Localisation updates from https://translatewiki.net. [extensions/DonationInterface] (REL1_40) - 10https://gerrit.wikimedia.org/r/932077 (owner: 10L10n-bot) [09:56:20] (03CR) 10Nikerabbit: [V: 03+2] Localisation updates from https://translatewiki.net. [extensions/DonationInterface] (REL1_40) - 10https://gerrit.wikimedia.org/r/932077 (owner: 10L10n-bot) [10:46:32] (03PS2) 10Jgleeson: Add option to not use config-private [wikimedia/fundraising/dev] - 10https://gerrit.wikimedia.org/r/932047 (owner: 10AndyRussG) [10:47:08] (03CR) 10Jgleeson: [V: 03+2 C: 03+2] "I just pushed up a small typo fix. Everything else looks good to me. thanks!" [wikimedia/fundraising/dev] - 10https://gerrit.wikimedia.org/r/932047 (owner: 10AndyRussG) [11:15:22] (03PS4) 10Damilare Adedoyin: Update code references to contribution_tracking: update_silverpop_staging in Silverpop exporter [wikimedia/fundraising/tools] - 10https://gerrit.wikimedia.org/r/931268 (https://phabricator.wikimedia.org/T339854) [11:21:35] (03CR) 10Damilare Adedoyin: "Yaayy tests CI is now passing. Thanks for the CR ejegg, I made the changes but couldn't find the minimal_import.sql file, did you mean min" [wikimedia/fundraising/tools] - 10https://gerrit.wikimedia.org/r/931268 (https://phabricator.wikimedia.org/T339854) (owner: 10Damilare Adedoyin) [11:32:48] (03PS7) 10Damilare Adedoyin: Update code references to contribution_tracking in recurring_get_contribution_tracking_id [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/930204 (https://phabricator.wikimedia.org/T339157) [12:01:38] 10Fundraising Sprint Message in a JSON blob, 10Fundraising-Backlog: Add field value to WMF donor list of statuses and segments - https://phabricator.wikimedia.org/T339297 (10Damilare) a:03Damilare [14:07:02] (03CR) 10Ejegg: Update code references to contribution_tracking: update_silverpop_staging in Silverpop exporter (031 comment) [wikimedia/fundraising/tools] - 10https://gerrit.wikimedia.org/r/931268 (https://phabricator.wikimedia.org/T339854) (owner: 10Damilare Adedoyin) [14:54:46] (03PS45) 10Damilare Adedoyin: IP Velocity Filter: Increase count after first run [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/859168 (https://phabricator.wikimedia.org/T323544) (owner: 10AndyRussG) [14:59:04] 10fundraising-tech-ops, 10DC-Ops, 10SRE, 10ops-eqiad: Q1:rack/setup/install frbast1002, frmon1002, frpig1002 - https://phabricator.wikimedia.org/T319460 (10Jgreen) Confirmed traffic to frpig1001 has stopped. Taking it out of monitoring so we can shut it down and start the decom. [15:05:17] (03CR) 10Damilare Adedoyin: "Thanks ejegg for the CR, I responded inline" [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/859168 (https://phabricator.wikimedia.org/T323544) (owner: 10AndyRussG) [15:19:36] 10Fundraising-Backlog, 10fr-email-preference-center: Create WMF-hosted unsubscribe page - https://phabricator.wikimedia.org/T127401 (10AKanji-WMF) [15:19:40] 10Fundraising Sprint Princess Mongodb, 10Fundraising-Backlog, 10Fr-planning-ahead, 10fr-email-preference-center, 10Epic: Epic: Create Preference Center for donors to manage email subscription preferences - https://phabricator.wikimedia.org/T125272 (10AKanji-WMF) [16:02:50] 10fundraising-tech-ops, 10decommission-hardware: decommission frpig1001.frack.eqiad.wmnet - https://phabricator.wikimedia.org/T340128 (10Jgreen) [16:03:51] 10Fundraising-Backlog, 10fundraising-tech-ops: Switch-over from civi1001 to civi1002 - https://phabricator.wikimedia.org/T329882 (10Jgreen) [16:03:56] 10Fundraising-Backlog, 10fundraising-tech-ops: Migrate process-control jobs from civi1001 to civi1002 - https://phabricator.wikimedia.org/T332632 (10Jgreen) 05Open→03Resolved [16:04:48] 10Fundraising-Backlog, 10fundraising-tech-ops: Switch-over from civi1001 to civi1002 - https://phabricator.wikimedia.org/T329882 (10Jgreen) [16:05:30] 10Fundraising-Backlog, 10fundraising-tech-ops: Switch-over from civi1001 to civi1002 - https://phabricator.wikimedia.org/T329882 (10Jgreen) 05Open→03Resolved [16:20:01] 10Fundraising-Backlog, 10FR-Adyen: Enable Vipps through Adyen - https://phabricator.wikimedia.org/T339937 (10AKanji-WMF) Ideally we'd want this in place by end of Q2 23/24. [16:29:36] 10fundraising-tech-ops, 10Patch-For-Review: install/configure frdev1002 - https://phabricator.wikimedia.org/T285892 (10Jgreen) [16:30:01] 10fundraising-tech-ops, 10Patch-For-Review: install/configure frdev1002 - https://phabricator.wikimedia.org/T285892 (10Jgreen) [16:34:31] (03CR) 10Ejegg: [C: 03+2] "Looks good, seems like all of Eileen's points have been addressed." [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/930204 (https://phabricator.wikimedia.org/T339157) (owner: 10Damilare Adedoyin) [16:38:32] cstone: oh right, from email addresses and names for WMF mail is all configured here now: https://civicrm.wikimedia.org/civicrm/admin/setting/wmf-thankyou [16:39:25] and the failure email seems to use the core CiviCRM from name [16:39:43] In drupal/sites/default/civicrm/extensions/org.wikimedia.smashpig/Civi/Api4/Action/FailureEmail/Send.php [16:39:46] we do [16:40:02] list($domainEmailName, $domainEmailAddress) = \CRM_Core_BAO_Domain::getNameAndEmail(); [16:40:34] So that's the address configured in https://civicrm.wikimedia.org/civicrm/admin/options/from_email_address?reset=1 [16:40:43] and marked as default (for now, the top one) [16:41:11] Let's see if there's a good wiki page to write that on [16:41:36] 10Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 10fundraising-tech-ops: Reduce the year fields for WMF donor - https://phabricator.wikimedia.org/T339314 (10AKanji-WMF) @Eileenmcnaughton let me know if you need anything else to proceed! [16:42:03] I guess the fail address here: https://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/Recurring#Failures_and_retry_logic [16:47:09] (03Merged) 10jenkins-bot: Update code references to contribution_tracking in recurring_get_contribution_tracking_id [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/930204 (https://phabricator.wikimedia.org/T339157) (owner: 10Damilare Adedoyin) [16:56:12] 10Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 10fr-donorservices: Update the recurring payments status - https://phabricator.wikimedia.org/T273520 (10AKanji-WMF) @SHust Could you please confirm whether this is still a need for Donor Relations? [16:56:38] 10fundraising-tech-ops, 10Patch-For-Review: install/configure frdev1002 - https://phabricator.wikimedia.org/T285892 (10Jgreen) [17:07:03] 10fundraising-tech-ops, 10Patch-For-Review: install/configure frdev1002 - https://phabricator.wikimedia.org/T285892 (10Jgreen) [17:20:38] 10fundraising-tech-ops: install/configure frdev1002 - https://phabricator.wikimedia.org/T285892 (10Jgreen) 05Open→03Resolved a:03Jgreen [17:24:08] 10Fundraising-Backlog, 10FR-AutoTY-Email, 10fr-donorservices: Dot instead of comma in Thank you email confirmation French-France, Italian-Italy and Spanish-Spain - https://phabricator.wikimedia.org/T293275 (10AKanji-WMF) 05Open→03Resolved a:03AKanji-WMF Have made a test donation and reviewed the thank... [17:26:59] 10Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 10fr-email-preference-center, 10FR-Email: Investigate acoustic APIs for real time updates - https://phabricator.wikimedia.org/T301515 (10AKanji-WMF) [17:27:32] 10Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 10fr-email-preference-center, 10FR-Email: Investigate acoustic APIs for real time updates - https://phabricator.wikimedia.org/T301515 (10AKanji-WMF) [17:27:36] 10Fundraising Sprint Princess Mongodb, 10Fundraising-Backlog, 10Fr-planning-ahead, 10fr-email-preference-center, 10Epic: Epic: Create Preference Center for donors to manage email subscription preferences - https://phabricator.wikimedia.org/T125272 (10AKanji-WMF) [17:31:01] 10Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM: Email edit ui: allow users to send draft MC emails to themselves - https://phabricator.wikimedia.org/T302444 (10AKanji-WMF) @KHaggard I believe this refers to the monthly convert email - is this task still valid? [17:35:17] 10Fundraising-Backlog: Example Phabricator spec - https://phabricator.wikimedia.org/T234260 (10AKanji-WMF) @Wfan Is this along the lines of what you were thinking when proposing consistent Phab tasks? [17:45:28] 10Fundraising Tech - Chaos Crew, 10Fundraising-Backlog: Test dlocal India recurring ondemand 2nd charge - https://phabricator.wikimedia.org/T338812 (10Cstone) Charged contribution_recur_id=1529945 and got the response "status":"PENDING","status_detail":"The payment is pending.","status_code":"100" Will updat... [17:51:12] PROBLEM - check_ipsec on fran1001 is CRITICAL: Strongswan CRITICAL - ok: 0 not-conn: frban1001_v4 https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=fran1001&service=check_ipsec [17:52:22] ACKNOWLEDGEMENT - check_ipsec on fran1001 is CRITICAL: Strongswan CRITICAL - ok: 0 not-conn: frban1001_v4 Dwisehaupt known due to frban1001 rebuild https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=fran1001&service=check_ipsec [17:52:22] ACKNOWLEDGEMENT - check_puppetrun on fran1001 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 4 minutes ago with 1 failures. Failed resources (up to 3 shown): Mount[/srv/archive/banner_logs] Dwisehaupt known due to frban1001 rebuild https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=fran1001&service=check_puppetrun [17:53:51] 10Fundraising-Backlog, 10MediaWiki-extensions-FundraiserLandingPage, 10donate.wikimedia.org: donate.wikimedia.org landing pages don't have descriptions in search engine results - https://phabricator.wikimedia.org/T254808 (10AKanji-WMF) Confirming that desired timing would be pre-Q2. [17:57:24] 10Fundraising-Backlog, 10MediaWiki-extensions-FundraiserLandingPage, 10donate.wikimedia.org: donate.wikimedia.org landing pages don't have descriptions in search engine results - https://phabricator.wikimedia.org/T254808 (10AKanji-WMF) [17:57:30] 10Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 10MediaWiki-extensions-DonationInterface: CT-to-Civi-Phase 2: send & consume de-concatenated fields - https://phabricator.wikimedia.org/T334904 (10AKanji-WMF) [18:01:12] 10Fundraising-Backlog, 10MediaWiki-extensions-FundraiserLandingPage, 10donate.wikimedia.org: donate.wikimedia.org landing pages don't have descriptions in search engine results - https://phabricator.wikimedia.org/T254808 (10AKanji-WMF) [18:01:14] 10Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 10MediaWiki-extensions-DonationInterface: CT-to-Civi-Phase 2: send & consume de-concatenated fields - https://phabricator.wikimedia.org/T334904 (10AKanji-WMF) [18:01:34] 10Fundraising-Backlog, 10MediaWiki-extensions-DonationInterface, 10FR-Email: Record whether donation was made on a mobile device - https://phabricator.wikimedia.org/T152624 (10AKanji-WMF) [18:01:36] 10Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 10MediaWiki-extensions-DonationInterface: CT-to-Civi-Phase 2: send & consume de-concatenated fields - https://phabricator.wikimedia.org/T334904 (10AKanji-WMF) [18:09:27] 10Fundraising Tech - Chaos Crew, 10Fundraising-Backlog: Adyen Audit - manually settled transactions not being imported into civi with the nightly audit file - https://phabricator.wikimedia.org/T325415 (10LWadleigh) Adyen PSP for donation settled today: T7DRFNWFVB9Z2C32 (No CID yet) [18:21:12] RECOVERY - check_ipsec on fran1001 is OK: Strongswan OK - 1 ESP OK https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=fran1001&service=check_ipsec [18:25:27] (03PS1) 10Ejegg: Combine queries in recurring ct_id lookup [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/932314 (https://phabricator.wikimedia.org/T339157) [18:25:58] damilare: after I merged your patch I realized we could probably combine all those lookups into a single DB query ^^^ [18:28:33] oh nice ejegg, checking [18:31:26] ejegg: I was just looking at that patch [18:31:32] I'm getting test failures [18:31:39] Civi\API\Exception\UnauthorizedException : Authorization failed [18:31:57] ah oops [18:34:56] I think it might just need FALSE passing in [18:35:09] on the query object call [18:38:10] (03CR) 10CI reject: [V: 04-1] Combine queries in recurring ct_id lookup [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/932314 (https://phabricator.wikimedia.org/T339157) (owner: 10Ejegg) [18:43:36] thanks jgleeson, i'll fix that [18:44:00] (03PS2) 10Ejegg: Combine queries in recurring ct_id lookup [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/932314 (https://phabricator.wikimedia.org/T339157) [18:47:14] ejegg: I think invoice_id might need to be trxn_id too [18:48:17] ah yeah, that seems right [18:48:45] sorry, am doing two things at once and not paying enough attention to either of them [18:51:05] I'm also meant to be doing something else [18:51:18] sounds like maintenance week. :) [18:52:27] ok, that's the config changed [18:52:50] the "combining queries" nerd sniped me [18:53:05] let's find a TY email for an unsub link to test [18:55:20] OK, no error in the front-end [18:55:23] let's look at the queues [18:56:39] (03CR) 10CI reject: [V: 04-1] Combine queries in recurring ct_id lookup [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/932314 (https://phabricator.wikimedia.org/T339157) (owner: 10Ejegg) [18:59:36] 10fundraising-tech-ops: reimage fundraising auth role servers to Bullseye - https://phabricator.wikimedia.org/T332808 (10Jgreen) 05Open→03Resolved p:05Triage→03Medium [18:59:39] 10fundraising-tech-ops: Fundraising environment support for Debian 11 (Bullseye) - https://phabricator.wikimedia.org/T277184 (10Jgreen) [19:01:41] 10Fundraising-Backlog, 10fundraising-tech-ops: Migrate payments queue configuration out of localsettings and into puppet - https://phabricator.wikimedia.org/T339966 (10Jgreen) 05Open→03Resolved a:03Jgreen done! [19:03:15] 10Fundraising Sprint Message in a JSON blob, 10Fundraising-Backlog, 10fundraising-tech-ops: Fr-Tech 2022q4 maintenance window - https://phabricator.wikimedia.org/T333485 (10Dwisehaupt) [19:07:59] 10fundraising-tech-ops: reimage fundraising data (frdata) role servers to Bullseye - https://phabricator.wikimedia.org/T335446 (10Jgreen) 05Open→03Resolved a:03Jgreen [19:09:49] 10fundraising-tech-ops, 10decommission-hardware: decommission frbast1001.frack.eqiad.wmnet - https://phabricator.wikimedia.org/T340155 (10Jgreen) [19:11:42] 10fundraising-tech-ops: reimage fundraising bastion (frbast) role servers to Bullseye - https://phabricator.wikimedia.org/T333246 (10Jgreen) [19:11:55] 10fundraising-tech-ops: Fundraising environment support for Debian 11 (Bullseye) - https://phabricator.wikimedia.org/T277184 (10Jgreen) [19:11:57] 10fundraising-tech-ops: reimage fundraising bastion (frbast) role servers to Bullseye - https://phabricator.wikimedia.org/T333246 (10Jgreen) 05Open→03Resolved a:03Jgreen [19:12:31] 10fundraising-tech-ops: reimage fundraising banner-logger role servers to Bullseye - https://phabricator.wikimedia.org/T340085 (10Jgreen) [19:13:23] 10fundraising-tech-ops: reimage fundraising banner-logger role servers to Bullseye - https://phabricator.wikimedia.org/T340085 (10Jgreen) 05Open→03Resolved p:05Triage→03Medium a:03Dwisehaupt [19:13:25] 10fundraising-tech-ops: Fundraising environment support for Debian 11 (Bullseye) - https://phabricator.wikimedia.org/T277184 (10Jgreen) [19:16:02] 10fundraising-tech-ops: Fundraising servers RAID configuration oddities - https://phabricator.wikimedia.org/T312892 (10Jgreen) 05Open→03Resolved p:05Triage→03Low [19:16:23] 10fundraising-tech-ops: Fundraising servers RAID configuration oddities - https://phabricator.wikimedia.org/T312892 (10Jgreen) frbast1001 is dead, long live frbast1001 [19:21:12] 10Fundraising Sprint Message in a JSON blob, 10Fundraising-Backlog: Auto-Rescue Audit processing updates - https://phabricator.wikimedia.org/T340159 (10jgleeson) [19:22:18] (03PS3) 10Ejegg: Combine queries in recurring ct_id lookup [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/932314 (https://phabricator.wikimedia.org/T339157) [19:23:47] 10Fundraising Sprint Message in a JSON blob, 10Fundraising-Backlog: Implement Adyen Auto-Rescue feature to improve donor recurring conversion - https://phabricator.wikimedia.org/T331920 (10jgleeson) @AKanji-WMF Adyen currently supports Auto-Rescue on a per-eligible transaction basis or account-wide basis, as c... [19:30:05] 10Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 10fr-donorservices: Update the recurring payments status - https://phabricator.wikimedia.org/T273520 (10SHust) @AKanji-WMF, ok to resolve this one. Thanks for asking! [19:31:33] (03PS1) 10Damilare Adedoyin: Add field value to WMF donor list of statuses and segments [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/932325 (https://phabricator.wikimedia.org/T339297) [19:38:27] (03CR) 10Jgleeson: [C: 03+2] "LGTM!" [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/932314 (https://phabricator.wikimedia.org/T339157) (owner: 10Ejegg) [19:41:18] :) [19:41:23] thanks jgleeson [19:43:25] np [19:46:12] 10Fundraising Sprint Message in a JSON blob, 10Fundraising-Backlog: Implement Adyen Auto-Rescue feature to improve donor recurring conversion - https://phabricator.wikimedia.org/T331920 (10EMartin) @jgleeson @AKanji-WMF Auto Rescue on a per-eligible transaction basis please. [19:52:31] (03Merged) 10jenkins-bot: Combine queries in recurring ct_id lookup [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/932314 (https://phabricator.wikimedia.org/T339157) (owner: 10Ejegg) [20:01:45] 10Fundraising Sprint Message in a JSON blob, 10Fundraising-Backlog: Auto-Rescue Audit processing updates - https://phabricator.wikimedia.org/T340159 (10EMartin) @jgleeson Yes, we'd like to see the reattempt activity somehow to assess the impact of this. If we capture this, how would we store it and look at it... [20:06:34] PROBLEM - check_ipsec on fran1001 is CRITICAL: Strongswan CRITICAL - ok: 1 connecting: (unnamed) https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=fran1001&service=check_ipsec [20:11:34] PROBLEM - check_ipsec on fran1001 is CRITICAL: Strongswan CRITICAL - ok: 1 connecting: (unnamed) https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=fran1001&service=check_ipsec [20:16:34] PROBLEM - check_ipsec on fran1001 is CRITICAL: Strongswan CRITICAL - ok: 1 connecting: (unnamed) https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=fran1001&service=check_ipsec [20:19:50] ^^ aware of that and looking at it. i think i have it fixed but verifying. [20:21:14] PROBLEM - check_ipsec on fran1001 is CRITICAL: Strongswan CRITICAL - ok: 1 connecting: (unnamed) https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=fran1001&service=check_ipsec [20:22:44] ACKNOWLEDGEMENT - check_ipsec on fran1001 is CRITICAL: Strongswan CRITICAL - ok: 1 connecting: (unnamed) Dwisehaupt known https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=fran1001&service=check_ipsec [20:28:31] jgleeson: well, after an hour or so of banging around with the duplicate order ID bug I still can't replicate it either [20:29:09] I mean, I see that we post it back to the form [20:29:22] hmm, let me try one more thing [20:29:57] oh nice, I just got a fatal exception on prod by using the back button [20:32:16] 10Fundraising Sprint Message in a JSON blob, 10Fundraising-Backlog: Implement Auto-Rescue retryable failure detection - https://phabricator.wikimedia.org/T340163 (10jgleeson) [20:32:47] yeah ejegg it's confusing a-h [20:35:19] 10Fundraising Sprint Message in a JSON blob, 10Fundraising-Backlog: Implement Auto-Rescue Webhook handling - https://phabricator.wikimedia.org/T340164 (10jgleeson) [20:36:08] 10Fundraising Sprint Message in a JSON blob, 10Fundraising-Backlog: Implement Adyen Auto-Rescue feature to improve donor recurring conversion - https://phabricator.wikimedia.org/T331920 (10jgleeson) [20:36:38] 10Fundraising Sprint Message in a JSON blob, 10Fundraising-Backlog: Implement Adyen Auto-Rescue feature to improve donor recurring conversion - https://phabricator.wikimedia.org/T331920 (10jgleeson) ty @EMartin ! [20:41:22] ejegg: anilk - I've added some subtasks and notes to the Adyen Auto-Rescue task. I still need to write out the webhook/IPN handling parts so I'll add that last piece tomorrow. ejegg feel free to update or add anything missed [20:41:33] https://phabricator.wikimedia.org/T331920 [20:42:17] thanks jgleeson - appreciate it - I spoke with Evelyn today and she was also thrilled [20:44:54] thanks jgleeson [20:45:32] PROBLEM - Host fran1001 is DOWN: PING CRITICAL - Packet loss = 100% [20:48:22] anilk: greg-g I just resent an email around that relates to the time-zone bias point on the team norms slides. 'Proposal: Record all the meetings' [20:49:43] one thing I missed off that email and now would add with hindsight is normalizing "meeting recordings catch up time" [20:50:01] that's something that's easily missed on the what did I do today list [20:51:06] RECOVERY - Host fran1001 is UP: PING OK - Packet loss = 0%, RTA = 0.43 ms [20:52:13] one blocker to that was actually remembering to press the record button. I know Christine was great at remembering but maybe we could formalise it better. We could say that the chaos person is the meeting recorder to rotate the responsibility [20:54:35] jgleeson: good ideas. Specifics like who does what is bleeding into process definition which I don't really want to codify inside the Social Norms, BUT! I think having a norm around us being Remote First and Distributed and what that means (in general) is great. [20:54:58] sorry, extraneous Capitalization [20:55:00] 10Fundraising-Backlog, 10fr-email-preference-center: EmailPreferences form lacks template for user-friendly error display - https://phabricator.wikimedia.org/T340167 (10Ejegg) [20:55:32] I felt like that when I ruined that pink floyd song title about refactoring [20:55:35] (03PS1) 10Ejegg: Add template for email prefs submit error [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/932332 (https://phabricator.wikimedia.org/T340167) [20:56:16] dwisehaupt: I'm unsure if the maintenance stuff has broken the (still behind a client cert) email prefs form [20:56:21] when I submit I get an error [20:56:31] but a follow-on error masks the root cause [20:58:42] let me look and see where we are pointed. [20:58:44] oh interesting, that specific follow-on error probably WOULDN'T be caused by a queue push problem [20:59:10] since the catch() around the queue push actually does tell it to use a different template (which exists) [20:59:20] so it must be failing validation [20:59:53] https://phabricator.wikimedia.org/diffusion/EDOI/browse/master/special/EmailPreferences.php$42 [21:00:26] (the validation fail actually uses $this->renderError( $subpage ); ) [21:00:29] 10Fundraising-Backlog: Browser info needs to be sent on initial recurring transactions to improve credit card approval rates - https://phabricator.wikimedia.org/T340168 (10EMartin) [21:00:46] while the queue push catch uses $this->renderError( 'optin' ); [21:00:59] anyway, the template is missing for errors on emailPreference [21:01:08] and that's the follow-on error we're seeing [21:02:10] 10Fundraising-Backlog, 10fr-email-preference-center, 10Patch-For-Review: EmailPreferences form lacks template for user-friendly error display - https://phabricator.wikimedia.org/T340167 (10Ejegg) Note that this form is displayed for a failure in the validation, not for a failure in the queue push. [21:02:54] ok, so validation failure could be a csrf token [21:03:07] I should try this locally... [21:05:06] ejegg: i think something is not 100% there, but not sure what yet. [21:05:16] oh interesting, I was able to submit that time [21:06:42] i'm seeing something i am not expecting with the donor data bit also. [21:12:38] ejegg: i see hits to civiproxy in the apache logs. [21:13:06] (03PS3) 10Jdlrobson: Update extension for wikimedia/remex 2.3.2 (included in 1.37.0-wmf18) [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/711006 (owner: 10C. Scott Ananian) [21:13:13] for a contact id ending in 615 [21:13:26] dwisehaupt: huh, I don't see the queue messages actually getting to frqueue1004 though [21:13:47] dwisehaupt: that should use the queue settings for SmashPig [21:14:02] is /etc/smashpig/main.yaml on frdata also pointing to frqueue1004? [21:14:21] that's my contact ID, so that much is working [21:16:18] yeah. it looks right in the config. [21:16:53] verified i can hit the redis port from frdata [21:19:36] it's using the same port as we're monitoring on civi? [21:20:05] i'm on civi1002 right now and using redis-cli to monitor queue stuffs [21:20:21] and I can keep hitting the 'save preferences' button and nothing gets saved [21:20:33] though I am now seeing success messages on the email prefs form [21:20:36] should be. [21:43:01] 10Fundraising Sprint Message in a JSON blob, 10Fundraising-Backlog, 10fundraising-tech-ops: Fr-Tech 2022q4 maintenance window - https://phabricator.wikimedia.org/T333485 (10Dwisehaupt) [21:43:27] 10Fundraising Sprint Message in a JSON blob, 10Fundraising-Backlog, 10fundraising-tech-ops: Fr-Tech 2022q4 maintenance window - https://phabricator.wikimedia.org/T333485 (10Dwisehaupt) [23:26:09] 10Fundraising Sprint Message in a JSON blob, 10Fundraising-Backlog, 10fundraising-tech-ops: Fr-Tech 2022q4 maintenance window - https://phabricator.wikimedia.org/T333485 (10Dwisehaupt) [23:27:09] 10Fundraising-Backlog, 10Patch-For-Review: Pass additional params from Payments to thank you page URL - https://phabricator.wikimedia.org/T340058 (10HNordeenWMF) hi @jgleeson, clarifying question: if a donor signs up for a monthly donation post-payment, do you know what their recurring parameter come through a... [23:36:30] (03PS2) 10Ejegg: Add template for email prefs submit error [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/932332 (https://phabricator.wikimedia.org/T340167)