[11:29:50] Fundraising Sprint A Wrinkle in Timezones, Fundraising Sprint Visual Basic Instinct, Fundraising-Backlog: FRUEC: Debug minor discrepancy in landing page data between old and new pipelines - https://phabricator.wikimedia.org/T236835 (AndyRussG) == Detailed stats and methodology Windows for log sample... [11:31:09] Fundraising Sprint A Wrinkle in Timezones, Fundraising Sprint Visual Basic Instinct, Fundraising-Backlog: FRUEC: Debug minor discrepancy in landing page data between old and new pipelines - https://phabricator.wikimedia.org/T236835 (AndyRussG) [11:35:30] Fundraising Sprint Rocky Horror Presentation Layer, Fundraising Sprint Sysadmin Kane, Fundraising Sprint Trojan Horse Wisperer, Fundraising Sprint Usual Subscripts, and 3 others: Unusable emails addresses - https://phabricator.wikimedia.org/T231332 (DannyS712) [batch] remove patch for review tag... [16:41:00] fundraising-tech-ops, Operations, ops-eqiad: rack/setup/install frnetmon1001.frack.eqiad.wmnet - https://phabricator.wikimedia.org/T232137 (Cmjohnson) a:Jgreen→Cmjohnson I will work on network setup [17:39:19] fr-tech i just spent 20 minutes trying to remember where core permissions like 'force merge duplicate contacts' are granted in Civi [17:39:41] it's in the drupal permissions interface, in case anyone else runs up against that [17:43:54] huh, i'm still not seeing a force merge button in the UI, even after clearing caches and deleting templates [17:55:36] (CR) XenoRyet: [C: +2] Fix width of lone address fields without going wiggly [extensions/DonationInterface] - https://gerrit.wikimedia.org/r/550911 (https://phabricator.wikimedia.org/T238278) (owner: Ejegg) [17:57:28] (Merged) jenkins-bot: Fix width of lone address fields without going wiggly [extensions/DonationInterface] - https://gerrit.wikimedia.org/r/550911 (https://phabricator.wikimedia.org/T238278) (owner: Ejegg) [18:12:55] (CR) XenoRyet: [C: +2] Ingenico: mark attempts processed by checkout ID [extensions/DonationInterface] - https://gerrit.wikimedia.org/r/550857 (owner: Ejegg) [18:14:51] (Merged) jenkins-bot: Ingenico: mark attempts processed by checkout ID [extensions/DonationInterface] - https://gerrit.wikimedia.org/r/550857 (owner: Ejegg) [18:29:20] Fundraising Sprint A Wrinkle in Timezones, Fundraising Sprint Visual Basic Instinct, Fundraising-Backlog: Get paypal to prevent older paypal recurring from sending inaccurate cancel email - https://phabricator.wikimedia.org/T236506 (XenoRyet) a:XenoRyet [18:33:19] (PS1) Ejegg: Merge branch 'master' into deployment [extensions/DonationInterface] (deployment) - https://gerrit.wikimedia.org/r/551601 [18:34:22] (CR) Ejegg: [C: +2] Merge branch 'master' into deployment [extensions/DonationInterface] (deployment) - https://gerrit.wikimedia.org/r/551601 (owner: Ejegg) [18:35:03] (Merged) jenkins-bot: Merge branch 'master' into deployment [extensions/DonationInterface] (deployment) - https://gerrit.wikimedia.org/r/551601 (owner: Ejegg) [18:43:23] (PS1) Ejegg: Update DonationInterface submodule [core] (fundraising/REL1_31) - https://gerrit.wikimedia.org/r/551608 [18:43:26] (CR) Ejegg: [C: +2] Update DonationInterface submodule [core] (fundraising/REL1_31) - https://gerrit.wikimedia.org/r/551608 (owner: Ejegg) [18:48:20] (Merged) jenkins-bot: Update DonationInterface submodule [core] (fundraising/REL1_31) - https://gerrit.wikimedia.org/r/551608 (owner: Ejegg) [18:50:46] Fundraising Sprint A Wrinkle in Timezones, Fundraising Sprint Visual Basic Instinct, Fundraising-Backlog: Get paypal to prevent older paypal recurring from sending inaccurate cancel email - https://phabricator.wikimedia.org/T236506 (EMartin) Dylan Kozlowski 10:28 AM (20 minutes ago) to Merchant, mdw... [19:03:28] !log updated payments-wiki from 30579d34d8 to 3f99ebecc7 [19:03:32] Logged the message at https://wikitech.wikimedia.org/wiki/Server_Admin_Log [19:07:19] Fundraising-Backlog: Add support for Paypal micro transaction pricing for donations under $6 - https://phabricator.wikimedia.org/T238576 (EMartin) [19:11:41] Fundraising-Backlog: Add support for Paypal micro transaction pricing for donations under $6 - https://phabricator.wikimedia.org/T238576 (Ejegg) If these lower-dollar amounts have to be charged against a different merchant ID, I imagine that will make life harder for Donor Services as well. @MBeat33 has des... [19:17:05] (CR) Ejegg: [C: +2] "This works for me, and the code is clearly written. The hook itself is a bit murky so it takes a bit of stepping around in the core merge " [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/550378 (https://phabricator.wikimedia.org/T232152) (owner: Eileen) [19:17:35] (CR) Ejegg: [C: +2] Comment block fixes - use right urls [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/550579 (owner: Eileen) [19:17:56] (PS6) Ejegg: Comment updates [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/550580 (owner: Eileen) [19:18:51] (PS7) Ejegg: Comment updates [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/550580 (owner: Eileen) [19:19:01] (CR) Ejegg: [C: +2] Comment updates [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/550580 (owner: Eileen) [19:21:03] (PS6) Ejegg: Add boilerplate hook [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/550581 (owner: Eileen) [19:21:28] (CR) Ejegg: [C: +2] "dark mode deduping?" [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/550581 (owner: Eileen) [19:22:37] (PS6) Ejegg: Good intentions boilerplate [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/550582 (owner: Eileen) [19:22:56] (CR) Ejegg: [C: +2] "Oh nice, the mkdocs bit got merged into Civix!" [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/550582 (owner: Eileen) [19:23:00] (Merged) jenkins-bot: Update dedupe so that in force mode the details from the preferred contact are retained [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/550378 (https://phabricator.wikimedia.org/T232152) (owner: Eileen) [19:23:10] (PS5) Ejegg: More missing boilerplate - api4 psr [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/550584 (owner: Eileen) [19:23:16] (Merged) jenkins-bot: Comment block fixes - use right urls [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/550579 (owner: Eileen) [19:23:30] (CR) Ejegg: "rebased out of existence..." [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/550584 (owner: Eileen) [19:24:44] (Merged) jenkins-bot: Comment updates [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/550580 (owner: Eileen) [19:27:47] (Merged) jenkins-bot: Add boilerplate hook [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/550581 (owner: Eileen) [19:28:27] (Merged) jenkins-bot: Good intentions boilerplate [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/550582 (owner: Eileen) [19:29:37] Fundraising-Backlog: Add support for Paypal micro transaction pricing for donations under $6 - https://phabricator.wikimedia.org/T238576 (MBeat33) Thanks @Ejegg If PayPal would be unable to combine the two merchant IDs in the same console/account, that would definitely complicate donor services workflows. [19:31:15] Fundraising Sprint A Wrinkle in Timezones, Fundraising-Backlog, MediaWiki-extensions-DonationInterface: City field and label positioned wrong on India form - https://phabricator.wikimedia.org/T236077 (Ejegg) p:Triage→Normal a:Ejegg [19:54:06] Fundraising Sprint A Wrinkle in Timezones, Fundraising Sprint Visual Basic Instinct, Fundraising-Backlog: Get paypal to prevent older paypal recurring from sending inaccurate cancel email - https://phabricator.wikimedia.org/T236506 (XenoRyet) Paypal's response: > Unfortunately we are not able to m... [20:00:25] PROBLEM - check_puppetrun on civi1001 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues [20:05:21] PROBLEM - check_puppetrun on civi1001 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues [20:10:15] PROBLEM - check_puppetrun on civi1001 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues [20:10:35] (Abandoned) Eileen: More missing boilerplate - api4 psr [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/550584 (owner: Eileen) [20:15:21] RECOVERY - check_puppetrun on civi1001 is OK: OK: Puppet is currently enabled, last run 4 minutes ago with 0 failures [20:44:30] Fundraising-Backlog: Ask other teams for input on extra entries in new pipeline landing page logs - https://phabricator.wikimedia.org/T238592 (AndyRussG) [20:45:43] Fundraising-Backlog: Ask other teams for input on extra entries in new pipeline landing page logs - https://phabricator.wikimedia.org/T238592 (AndyRussG) [20:45:45] Fundraising Sprint Asymmetrical Earth Theory, Fundraising Sprint Bermuda Rhombus (where things disappear then reappear), Fundraising Sprint Cottage Cheese isn't Made of Cottages, Fundraising-Backlog, Epic: [Epic] Fundraising kafkatee changes - https://phabricator.wikimedia.org/T183978 (AndyRus... [20:52:49] Fundraising-Backlog: Investigate: Add support for Paypal micro transaction pricing for donations under $6 - https://phabricator.wikimedia.org/T238576 (DStrine) [20:54:11] Fundraising Sprint A Wrinkle in Timezones, Fundraising-Backlog, FR-Adyen: Adyen audit question: Nov refunds reaching Civi - https://phabricator.wikimedia.org/T238428 (DStrine) [20:54:57] Fundraising Sprint A Wrinkle in Timezones, Fundraising-Backlog: Ingenico iframe says Donate/Cancel Donation in US, Pay/Cancel elsewhere - https://phabricator.wikimedia.org/T238366 (DStrine) p:Triage→Normal [20:55:17] Fundraising-Backlog: FRUEC: Adapt comparison scripts to focus on specific campaigns or other event properties with expected specific values - https://phabricator.wikimedia.org/T238594 (AndyRussG) [20:55:19] Fundraising Sprint A Wrinkle in Timezones, Fundraising-Backlog: AVS score in fraud filters - https://phabricator.wikimedia.org/T238352 (DStrine) [20:55:55] Fundraising Sprint A Wrinkle in Timezones, Fundraising-Backlog: AVS score in fraud filters - https://phabricator.wikimedia.org/T238352 (XenoRyet) a:XenoRyet [21:31:04] eileen: I see that omnimail repair process has --hours_to_add=0 [21:31:12] that sound right? [21:31:38] yep [21:32:31] I'm a little confused as to those timeout failmails [21:33:04] it started at 60k/run and was consistently taking a bit more than an hour [21:33:28] and i've been dialing it all the way back to now fewer than 20k / run and it's still taking a bit more than 55 min [21:44:18] ejegg: I think it's a bug of sorts - i'll take a look after mg [22:06:53] (PS1) Eileen: Merge branch 'master' of https://gerrit.wikimedia.org/r/wikimedia/fundraising/crm into deployment [wikimedia/fundraising/crm] (deployment) - https://gerrit.wikimedia.org/r/551657 [22:07:44] (CR) Eileen: [C: +2] Merge branch 'master' of https://gerrit.wikimedia.org/r/wikimedia/fundraising/crm into deployment [wikimedia/fundraising/crm] (deployment) - https://gerrit.wikimedia.org/r/551657 (owner: Eileen) [22:37:00] (CR) Eileen: [C: +2] "recheck" [wikimedia/fundraising/crm] (deployment) - https://gerrit.wikimedia.org/r/551657 (owner: Eileen) [22:39:22] !log civicrm revision changed from c05c302e54 to 1f454aa69a, config revision is 67685c12f5 [22:39:25] Logged the message at https://wikitech.wikimedia.org/wiki/Server_Admin_Log [22:44:52] ejegg: I'm gonna flush caches now I've deployed that update -but normally we get a couple of failmail when I do that - queue looks pretty sane right now [22:46:18] eileen: no need to stop the donation qc then? [22:46:41] I don't think so - nothing that doesn't recover OK IMHO [22:47:41] Wikimedia-Fundraising-Banners: Donate Later link does not work after donation amount has been selected - https://phabricator.wikimedia.org/T238604 (jbolorinos-ctr) [22:48:52] hmm well drupal cache cleared in no time [22:53:38] hmm the civi one is slow - I think it's cos we don't flush very often & I also think that it relates to the templates_c dir & there is a setting that would improve all of that [22:55:17] done now [23:04:32] Fundraising-Backlog, fundraising-tech-ops: Capture metrics for success and failure of process-control jobs - https://phabricator.wikimedia.org/T235123 (Dwisehaupt) Rolled out new collector and had some fun debugging edge cases. Data is being collected being tracked on the Process Control Jobs dashboard.... [23:05:34] Fundraising-Backlog, fundraising-tech-ops: Capture metrics for success and failure of process-control jobs - https://phabricator.wikimedia.org/T235123 (Dwisehaupt) Open→Resolved p:Triage→Normal [23:11:05] Fundraising Sprint A Wrinkle in Timezones, Fundraising Sprint Usual Subscripts, Fundraising Sprint Visual Basic Instinct, Fundraising-Backlog, FR-Civi-Dedupe: First name field conflicts on nick name not being handled automatically - https://phabricator.wikimedia.org/T238606 (Eileenmcnaughton) [23:12:38] Fundraising Sprint A Wrinkle in Timezones, Fundraising Sprint Visual Basic Instinct, Fundraising-Backlog, FR-Civi-Dedupe, FR-Civi-Prospect: Possible addition to the deduper tool? - https://phabricator.wikimedia.org/T229927 (Eileenmcnaughton) [23:15:05] Fundraising Sprint A Wrinkle in Timezones, Fundraising Sprint Visual Basic Instinct, Fundraising-Backlog, FR-Civi-Dedupe: Civi dedupe: ask 'force merge' script to prefer most recent contrib data - https://phabricator.wikimedia.org/T232152 (Eileenmcnaughton) [23:19:19] Fundraising Sprint A Wrinkle in Timezones, Fundraising Sprint Visual Basic Instinct, Fundraising-Backlog, FR-Civi-Dedupe: Civi dedupe: ask 'force merge' script to prefer most recent contrib data - https://phabricator.wikimedia.org/T232152 (Eileenmcnaughton) @MBeat33 @LeanneS @NNichols @RLewis @kr... [23:24:14] Fundraising Sprint A Wrinkle in Timezones, Fundraising Sprint Usual Subscripts, Fundraising Sprint Visual Basic Instinct, Fundraising-Backlog, FR-Civi-Dedupe: First name field conflicts on nick name not being handled automatically - https://phabricator.wikimedia.org/T238606 (Eileenmcnaughton)... [23:44:54] Fundraising Sprint A Wrinkle in Timezones, Fundraising-Backlog, MediaWiki-extensions-DonationInterface: Fix postal code field when not showing city or state - https://phabricator.wikimedia.org/T238278 (Ejegg) Open→Resolved [23:54:06] (CR) Cstone: [C: +2] "Looks good! Nice you can easily change the lengths with the yaml file." [wikimedia/fundraising/SmashPig] - https://gerrit.wikimedia.org/r/551288 (https://phabricator.wikimedia.org/T228094) (owner: Ejegg) [23:54:26] (Merged) jenkins-bot: Truncate values before making Ingenico API calls [wikimedia/fundraising/SmashPig] - https://gerrit.wikimedia.org/r/551288 (https://phabricator.wikimedia.org/T228094) (owner: Ejegg)