[00:08:38] !log updated fundrasing dashboard from df94248ccf3cc92d9baae7a5dfacca0db6849420 to 6ee656759561d524c1ed8a15ac4da4d0fce887a7 [00:08:43] Logged the message at https://wikitech.wikimedia.org/wiki/Server_Admin_Log [00:16:30] (CR) Ejegg: [C: -1] "Thanks! Mind freshening the legacy stuff to use the last version?" (2 comments) [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/393828 (owner: Jgleeson) [00:17:07] oh hey, gerrit's top line is less overwide [00:19:34] eileen: did you mean to make the configurable CIVICRM_DEADLOCK_RETRIES top out at 3? [00:19:59] oh wait, I think you did update the github patch with $maxTries in the loop [00:21:42] (CR) Ejegg: [C: -1] "still needs loop limit fixed" [wikimedia/fundraising/crm/civicrm] - https://gerrit.wikimedia.org/r/393705 (owner: Eileen) [00:25:12] dang, something's still stopping the per second chart at 31 days... [00:34:43] Wikimedia-Fundraising, Mobile-Content-Service, Wikipedia-Android-App-Backlog, Wikipedia-iOS-App-Backlog, Reading-Infrastructure-Team-Backlog (Kanban): Run Big English fundraising on apps - https://phabricator.wikimedia.org/T181004#3795130 (schoenbaechler) Thanks for the updates @Fjalapeno, @J... [00:34:47] (PS6) Eileen: CRM-21489 resurrect deadlock re-tries [wikimedia/fundraising/crm/civicrm] - https://gerrit.wikimedia.org/r/393705 [00:36:24] ejegg: github patch & our patch in sync now.... [00:36:49] great! [00:37:10] just trying to trigger a deadlock.. thought i had a recipe [00:37:23] ejegg: I managed to trigger a lock on staging [00:37:35] no - it was a deadlock [00:37:38] it's in my comments [00:38:24] I did this on a mysql session [00:38:25] CREATE TABLE put_painon_server SELECt * FROM civicrm_email; [00:38:55] ah, cool [00:38:59] i got one another way [00:41:07] argh date has ticked over on dash (UTC I guess) so we missed getting a top 10 day [00:42:10] Heh, it was only 8 hrs of campaign [00:42:14] plus 1 of test [00:42:40] ah well 'today' (in some tz) we might manage it [00:44:48] I figured out the issue with the Benevity import - it does only stop after a certain number of errors (not duplicates) BUT it's not prechecking for duplicates on the _matched ones - so those show as errors [00:50:59] I'm going to sign off chats but I'll be checking emails through the evening [00:51:03] congrats all!! [00:51:21] dstrine: make sure you open Katie's singing dancing version! [00:51:29] & everyone else too! [00:51:30] eileen: I did :) [00:53:23] (CR) Ejegg: [C: 2] "This looks like it'll do the trick!" [wikimedia/fundraising/crm/civicrm] - https://gerrit.wikimedia.org/r/393705 (owner: Eileen) [00:53:49] (CR) Ejegg: [C: 2] "Oops, meant to +2 v6" [wikimedia/fundraising/crm/civicrm] - https://gerrit.wikimedia.org/r/393705 (owner: Eileen) [00:54:04] ejegg: what do you think re deploying that - I'm around for a few hours but could also leave for tomorrow [00:55:07] there's still a bunch of queue delay... I'd want to do it at the slowest possible hour [00:55:56] ejegg: yeah ok - it should improve things but it's also a scary time to deploy [00:57:56] (Merged) jenkins-bot: CRM-21489 resurrect deadlock re-tries [wikimedia/fundraising/crm/civicrm] - https://gerrit.wikimedia.org/r/393705 (owner: Eileen) [01:09:43] eileen: oh hey, I just realized that your patch makes things better even when the deadlock happens 3x [01:10:02] instead of getting to the exit() code, it's throwing an error we can deal with [01:10:10] :) [01:10:24] ejegg: hopefully! [01:10:45] although - the code was throwing an exception anyway I think [01:11:09] I think there is some code in wmf_civicrm where we bypass the api call address:create directly [01:11:20] and that leads to the exit thing [01:12:13] it was definitely getting here: https://github.com/eileenmcnaughton/civicrm-core/blob/69314aa3b9476dd73f9aa2612b1e7ebdbdd8d3f7/CRM/Core/Error.php#L1011 [01:17:14] ejegg: yep - but from which script? I think api calls won't wind up there but if we bypass the api we may do [01:18:52] ah dang [01:19:27] right, if I just make the deadlock on the email table (with the older code) it does throw a catchable thing [01:19:51] I'm not 100% sure - definitely it does the retry on the merge job [01:20:06] but the other jobs may continue to bypass that code [01:20:18] I've been testing with the queue consumer [01:20:31] and locking the email table in another window [01:48:11] (PS1) Eileen: Apply drupal formatting to file prior to editing [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/393977 [01:49:18] (PS1) Eileen: Comment block tidy ups [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/393978 [02:40:44] going to turn down the rate of CiviMail records... TY mailing is getting really backed up even though donations consumer is fine [02:43:52] !log [02:44:27] !log reduced CiviMail record creation rate from 100% to 50% [02:44:34] Logged the message at https://wikitech.wikimedia.org/wiki/Server_Admin_Log [02:47:00] hmm, slight improvement [02:47:16] maybe should tweak the qc/ty timing [02:47:34] 5 more seconds for the ty job [02:50:39] !log reduced donation queue consumer time limit from 75 to 70 seconds, increased ty mail batch time limit from 40 to 45 seconds [02:50:46] Logged the message at https://wikitech.wikimedia.org/wiki/Server_Admin_Log [02:53:23] hmm, i am starting to wonder if we really need to enforce the separation between those two jobs [02:56:39] ejegg: If you do go for some overlap, don't go anywhere for a while. :) [02:57:12] heh, i'm thinking that should happen AFTER we get eileen's patch up for better deadlock handling [02:57:51] It's possible we don't need to keep them out of eachothers hair anymore, but they used to just slow eachother down way more than running them separately. [02:58:02] You know what would be awesome? [02:58:19] wozzat [02:58:30] Switch the TY job to a read-only db replica. [02:58:44] That would be neat. [02:58:52] * K4-713 sighs [02:59:17] my thought was to make it a queue consumer [02:59:19] Though, I guess the job does need to record that it did a thing. [02:59:32] https://gerrit.wikimedia.org/r/389721 [02:59:46] we know basically everything we need to send the TY at the time of message import [03:00:02] :D [03:00:29] I was wondering if there was a way to pull this apart and make it not dependent on all those reads. [03:00:54] Cool! [03:01:01] :) [03:01:03] Regarding job overlap - even with the deadlock handling hitting contention does cause a delay [03:01:48] I kind of love it when we have to actually drive this thing, though. [03:02:03] hmm, we could at least fetch all the data in the inital select where we get the ids [03:02:15] then we could keep the jobs semi-series [03:02:48] give the qc 100 seconds of every 2 minutes [03:02:54] then start the ty job [03:02:57] Okay, I'm really going to go now. Please text me if something insane happens. :) [03:03:09] heh, i oughtta sleep too [03:03:12] so long! [03:03:15] Good work, everybody! [03:09:07] !log reduced donation queue consumer time limit from 70 to 60 seconds, increased ty mail batch time limit from 45 to 55 seconds [03:09:14] Logged the message at https://wikitech.wikimedia.org/wiki/Server_Admin_Log [03:12:13] well, that's got us to 600 ty mails per run, or 300 / min [03:18:22] Fundraising Dash, Fundraising-Backlog: dash widgets making extraneous requests - https://phabricator.wikimedia.org/T181590#3795344 (Ejegg) [03:22:59] err, how does that ty age spike follow the queue age spike so closely? [03:23:08] shouldn't there be an actual lag? [03:23:18] unless we're thanking the newest first [03:23:26] but... no, we're not [03:23:44] Fundraising Sprint Winter Wanderland, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM: Benevity import failed - https://phabricator.wikimedia.org/T181548#3795356 (Eileenmcnaughton) The issue turns out to be that duplicate transactions on the matching gift (as opposed to the donor gift) are not bei... [03:24:07] Fundraising Sprint Winter Wanderland, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM: Benevity import failed - https://phabricator.wikimedia.org/T181548#3793810 (Eileenmcnaughton) a:Eileenmcnaughton [03:25:39] Fundraising Sprint Winter Wanderland, Fundraising-Backlog, fundraising-tech-ops: Give Civi Access to Thea - https://phabricator.wikimedia.org/T181527#3795364 (Eileenmcnaughton) @jgreen @cwdent - re authorisation question .... what is your position on that (we should document it somewhere!) [03:26:36] Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM, Fr-CiviCRM-dedupe-FY2017/18, Epic: Epic: Dedupe V2: resolve top conflicts - https://phabricator.wikimedia.org/T143057#3795367 (Eileenmcnaughton) [03:26:39] Fundraising Sprint Winter Wanderland, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM: Changing contact records from individual records to organization records - https://phabricator.wikimedia.org/T156193#3795365 (Eileenmcnaughton) Open>Resolved a:Eileenmcnaughton [03:28:35] Fundraising Sprint Winter Wanderland, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM, Fr-CiviCRM-dedupe-FY2017/18: Let dedupe run on orgs - https://phabricator.wikimedia.org/T181089#3795369 (Eileenmcnaughton) a:Eileenmcnaughton This seems functional with the command drush civicrm-merge -... [03:39:28] !log reduced CiviMail sample rate to 0.35 [03:39:35] Logged the message at https://wikitech.wikimedia.org/wiki/Server_Admin_Log [04:00:21] (PS1) Eileen: Put repetitive line of code in their own functions [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/393986 [04:00:23] (PS1) Eileen: Fix checks for existing contributions on Benevity imports to check donor AND matching contributions. [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/393987 (https://phabricator.wikimedia.org/T181548) [12:07:50] Wikimedia-Fundraising, Mobile-Content-Service, Wikipedia-Android-App-Backlog, Wikipedia-iOS-App-Backlog, and 2 others: Run Big English fundraising on apps - https://phabricator.wikimedia.org/T181004#3796178 (JoeWalsh) @cmadeo I updated the screenshot with the line breaks. Let me know if you want... [12:08:25] Wikimedia-Fundraising, Mobile-Content-Service, Wikipedia-Android-App-Backlog, Wikipedia-iOS-App-Backlog, and 2 others: Run Big English fundraising on apps - https://phabricator.wikimedia.org/T181004#3796179 (JoeWalsh) re: length, it's a full screen on a 5/5S/SE: {F11066447} [14:08:51] morning fr-tech! [14:27:24] morning AndyRussG! [14:33:48] Fundraising-Backlog: Pivot and Analytics access for all FR-Tech - https://phabricator.wikimedia.org/T181629#3796522 (AndyRussG) [14:39:39] (PS2) Jgleeson: Restored previous donation counter code (alongside new) [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/393828 [15:18:06] Wikimedia-Fundraising, Mobile-Content-Service, Wikipedia-Android-App-Backlog, Wikipedia-iOS-App-Backlog, and 2 others: Run Big English fundraising on apps - https://phabricator.wikimedia.org/T181004#3796653 (schoenbaechler) @JoeWalsh: I don't recommend to leave out the first paragraph since loca... [15:27:16] good morning AndyRussG and jgleeson|afk [15:27:27] morning dstrine [15:35:38] Wikimedia-Fundraising-Banners: Donation form Other amount field: 'minimum amount' error message - https://phabricator.wikimedia.org/T180751#3796729 (schoenbaechler) In the course of Big English, we've ran a test yesterday that featured an improved “Other” field in the Desktop Small banner. We decided in a ca... [15:54:15] Wikimedia-Fundraising-Banners: Donation form Other amount field: 'minimum amount' error message - https://phabricator.wikimedia.org/T180751#3796826 (MBeat33) Thank you, @schoenbaechler - I like the new Other field a lot, and think it will be more intuitive to donors. [16:02:22] The dash is looking great fr-tech! [16:02:44] :) [16:07:44] fr-tech surge in status codes 'NO_BANNER_AVAILABLE' (3) following changes to campaign around 11 am today [16:07:46] dstrine: [16:08:41] https://pivot.wikimedia.org/#banner_activity_minutely/line-chart/2/EQUQLgxg9AqgKgYWAGgN7APYAdgC5gQAWAhgJYB2KwApgB5YBO1Azs6RpbutnsEwGZVyxALbVeAfQlhSY4AF9kwYhBkdmeANroVazsApU6jFmw55uOfABtSYag2LWqANycBXcV2DMwxBmC8AEwADACMAOwAtGFhUUEAnHAhABy4QRG4ISEAdNkhAFpG5AAmweHRsfFJYQBsuACsACxZuflFisBgAJ5YXsBwAJIAsiASAEoAggByAOIgCoo6quz6xKVG9EysqxaYVgQkhkrG22aclrwCQqL9EKJYZADmlJ26u97v5vgYLg7WxBwJy2pg+lxsdgcTlcH [16:08:43] i86GY1DAcF6/QAynBxoM5kZrNQxOQwBpcJpgAhImEUhJqORaggJCVmABrCQAMXGwAAup0en1eKiQHBFvIlsoVt9lBtgSYdt9wYcyJQpWcwfsrtRBEphHJ8IwMAAraiqBRKL4XUV6Xi/f6AzbS857HgQ+yOZxKNzWTx7BFIlF8jFY2Y4vHUwlaYAAd1IjNIfRKpGInO5vvw/MFwuFaHNHwlZSVoNlqvwRAVtuVBcdfHVN21wHcCIB5CexqzBdNlr+DABQJoIJlZortmd0LdsK9iORvJT/uxJ1x+NDxJolC5Sh5aIFQpFbfw61zPbtKorxeO+7L/YO101t14ACN3BBGYjm9vlhafh2u6X8+feIOoa7gHdT1vG9Cc0WnQNZ2DAkiRJEIqDCRNV2T [16:08:45] YBU03FdtFPb8HQvKsrxrXxiDAOsJAgDASnETpmAwAJJjFM1tx8GjAjzPscLVDVgC1fomAAR08XxSIwdwCWbOMmHo3gKOYCBqTjRtFkzU5sO8CtLy4698CkGQ5E6O8H0ROi31fbMdOoAAhe9HxY4ASncRw32AAAFOAwmGZtqNoyTPm8piAi/NjVNwzjuMkaRZEopRxMNRziBkuSKCbYUOWQch3GsaxNRokQnFIAAvagSgkPiBLAISRJYkkSpYMqyIqoRstygqiuqwS6tElLNBSrjGtsZriuofiavK0TMzjfF7XwQjiOYISKKoWwRDsPAGnkIA= [16:08:50] hmm lemme squish that [16:09:28] https://goo.gl/MgfkP9 [16:18:07] Campaign/banner settings look OK, smells like a bug [16:18:13] fr-tech fr-tech fr-tech ^ [16:21:46] hey AndyRussG here [16:21:51] looking at pivot [16:23:02] AndyRussG: is that UTC? [16:23:07] should be yep [16:23:18] only on buckets A, B, and C. Mainly A and B [16:23:20] pcoombe: FYI [16:24:02] Banner settings look fine on the admin interface, gonna check what's in CN choiceData (campaign data sent to clients) [16:24:20] dstrine: looking [16:24:45] There were more changes to campaigns at 14:50 UTC (large banners changed) but the issue persisted [16:25:09] AndyRussG: even if it's not from a banner settings change I want everyone to be in the loop [16:25:23] yeah for sure [16:25:35] looks like a bug triggered by a setting change [16:27:44] AndyRussG: what exactly does that status mean? It looks like we've regularly been getting spikes of it when we run banner tests https://goo.gl/n4isgt [16:28:48] and it was actually even higher overnight [16:30:12] derp, sorry ignore me AndyRussG. I was looking at code 6 [16:31:42] AndyRussG: is it sending a benner name too? [16:31:55] *banner [16:33:51] oh hey, I can ask pivot [16:34:02] ejegg: null, I think [16:34:07] It means a banner wasn't chosen [16:34:09] ok [16:34:49] pcoombe: normally for oddly-configured campaigns that mix and match device settings among assigned banners [16:35:03] not something I'd expect here [16:35:46] Fundraising-Backlog, Patch-For-Review: Silverpop to Civi donor country error - https://phabricator.wikimedia.org/T181424#3796944 (krobinson) @Ejegg do you need more examples? We are seeing more of these now that the emails are going out en masse, and I can keep tracking if you need. [16:35:58] pcoombe: ejegg: dstrine fr-tech found it! [16:36:13] One of the desktop banners is also set to display for ipads [16:36:26] https://meta.wikimedia.org/wiki/Special:CentralNoticeBanners/edit/B1718_112909_en6C_dsk_p2_sm_txt_katherine [16:36:40] Fundraising-Backlog, Patch-For-Review: Silverpop to Civi donor country error - https://phabricator.wikimedia.org/T181424#3796947 (Ejegg) @krobinson no, I think I have an idea what could be causing it, I just need answers to those two questions I asked @CCogdill_WMF yesterday [16:36:57] So CN is actually including all ipad users in the campaign as well [16:37:03] AndyRussG: oho! [16:37:07] good catch [16:37:19] they're not getting nay banners (other than maybe that one) [16:37:28] oh, nice find AndyRussG [16:37:53] pcoombe: just part of CN silliness [16:38:57] * AndyRussG stares hard at the CN data model [16:39:46] Fundraising-Backlog, Patch-For-Review: Silverpop to Civi donor country error - https://phabricator.wikimedia.org/T181424#3796951 (CCogdill_WMF) Sorry @Ejegg, don't know how I missed that last comment you left yesterday! @CCogdill_WMF so you probably wa... [16:40:57] AndyRussG: I removed iPad from it. Looks like that banner did actually have slightly more impressions in our results. I'll update fr-creative and see if we want to re-run that test [16:41:16] pcoombe: cool! :) [16:41:55] Yeah here you can see ipads appearing in the mix after the changes: https://goo.gl/D4NqXZ [16:43:58] Some ipads did get banners [16:44:16] Fortunately that banner actually works fine on ipads too, so donors shouldn't have had any issues [16:44:24] :) cool [16:45:52] Nice catch AndyRussG! [16:46:29] I guess ipads that got it already had a large banner identifier from a previous campaign, and got switched to a small bucket. The ones that were put onto the bucket with that banner would have seen it, unless it was hidden for another reason... [16:46:43] https://goo.gl/rk3EDv [16:47:54] Not a lot actually saw it, around 74 K since it was added to the campaign (up to where the Pivot data reaches) [16:48:04] spatton: :) [16:48:57] heh wish Pivot included its own URL shortener [16:51:13] (PS1) Ejegg: Update civicrm submodule [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/394081 [16:51:16] (CR) Ejegg: [C: 2] Update civicrm submodule [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/394081 (owner: Ejegg) [16:52:40] (PS1) Ejegg: Update civicrm submodule [wikimedia/fundraising/crm] (deployment) - https://gerrit.wikimedia.org/r/394082 [16:52:48] (CR) Ejegg: [C: 2] Update civicrm submodule [wikimedia/fundraising/crm] (deployment) - https://gerrit.wikimedia.org/r/394082 (owner: Ejegg) [16:53:43] fr-tech I'd like to deploy that before the queue delay really starts building up ^^^ [16:55:13] (Merged) jenkins-bot: Update civicrm submodule [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/394081 (owner: Ejegg) [16:55:15] (Merged) jenkins-bot: Update civicrm submodule [wikimedia/fundraising/crm] (deployment) - https://gerrit.wikimedia.org/r/394082 (owner: Ejegg) [16:57:47] Wikimedia-Fundraising, Mobile-Content-Service, Wikipedia-Android-App-Backlog, Wikipedia-iOS-App-Backlog, and 2 others: Run Big English fundraising on apps - https://phabricator.wikimedia.org/T181004#3796997 (bearND) What I have so far on the server side is the text with the line breaks. The butto... [16:57:56] pcoombe meganhernandez spatton Seddon i'm turning the queue consumers off for a few minutes to update something in CiviCRM [16:58:19] cool, good luck ejegg ! [16:58:54] !log disabled Civi jobs for Deadlock-retry update [16:59:00] Logged the message at https://wikitech.wikimedia.org/wiki/Server_Admin_Log [17:00:09] Wikimedia-Fundraising, Mobile-Content-Service, Wikipedia-Android-App-Backlog, Wikipedia-iOS-App-Backlog, and 2 others: Run Big English fundraising on apps - https://phabricator.wikimedia.org/T181004#3797038 (Fjalapeno) @schoenbaechler We can update the button text, there is no facility to update... [17:00:15] fr-tech be 1 minute late to stand-up! [17:00:51] ok, those seem to work! [17:01:01] re-enabling jobs... [17:01:07] and fr-tech I'll be a minute late too [17:03:35] !log re-enabled Civi jobs [17:03:41] Logged the message at https://wikitech.wikimedia.org/wiki/Server_Admin_Log [17:15:38] Wikimedia-Fundraising, Mobile-Content-Service, Wikipedia-Android-App-Backlog, Wikipedia-iOS-App-Backlog, and 2 others: Run Big English fundraising on apps - https://phabricator.wikimedia.org/T181004#3797082 (Fjalapeno) Just a note deployment, if we want to get this deployed this week, we need to... [17:16:02] !log increased time limit for donation queue consumer from 60 to 70 seconds, reduced thank you job from 55 to 45 seconds [17:16:09] Logged the message at https://wikitech.wikimedia.org/wiki/Server_Admin_Log [17:27:22] Fundraising Sprint Winter Wanderland, Fundraising-Backlog, fundraising-tech-ops: Give Civi Access to Thea - https://phabricator.wikimedia.org/T181527#3797144 (cwdent) We need authorization from Lisa so typically we email her and post her response in the ticket. I'll do that now. [17:30:30] Fundraising-Backlog, MediaWiki-extensions-CentralNotice: make a wiki page for CN status codes - https://phabricator.wikimedia.org/T181652#3797151 (DStrine) [17:31:34] Fundraising Sprint Winter Wanderland, Fundraising-Backlog, fundraising-tech-ops: Civi credential for new Engage user - https://phabricator.wikimedia.org/T181537#3793506 (cwdent) @LeanneS which contact list is that? I usually look for contractors here: https://collab.wikimedia.org/wiki/Fundraising/co... [17:39:06] Fundraising Sprint Winter Wanderland, Fundraising-Backlog, MediaWiki-extensions-CentralNotice: make a wiki page for CN status codes - https://phabricator.wikimedia.org/T181652#3797238 (DStrine) [17:42:04] Fundraising Sprint Winter Wanderland, Fundraising-Backlog, fundraising-tech-ops: Give Civi Access to Thea - https://phabricator.wikimedia.org/T181527#3797261 (cwdent) From: Lisa Gruwell Date: Wed, 29 Nov 2017 09:38:00 -0800 Subject: Re: New Civi account To: Casey Dentinger Fundraising Sprint Winter Wanderland, Fundraising-Backlog, fundraising-tech-ops: Civi credential for new Engage user - https://phabricator.wikimedia.org/T181537#3797327 (LeanneS) @cwdent I put the info on this list: https://collab.wikimedia.org/wiki/Fundraising#Contact_List [18:00:14] PROBLEM - check_redis on frqueue1001 is CRITICAL: CRITICAL: unsubscribe is 307 300 - REDIS 2.8.17 on 127.0.0.1:6379 has 1 databases (db0) with 9 keys, up 64 days 1 hours - memory use is 3.27M (peak 23.12M, 0.08% of max, fragmentation 2.04%), connected_slaves is 2, donations is 15, jobs is 0, jobs-adyen is 0, jobs-paypal is 259, payments-antifraud is 93, payments-init is 368, pending is 206, recurring is 215, refund is 13 [18:01:44] huh [18:02:31] oh hey, unsubscribe alert could probably be even higher [18:05:14] RECOVERY - check_redis on frqueue1001 is OK: OK: REDIS 2.8.17 on 127.0.0.1:6379 has 1 databases (db0) with 7 keys, up 64 days 1 hours - memory use is 2.94M (peak 23.12M, 0.08% of max, fragmentation 2.14%), connected_slaves is 2, donations is 145, jobs is 0, jobs-adyen is 0, jobs-paypal is 231, payments-antifraud is 59, payments-init is 194, pending is 0, recurring is 72, refund is 0, unsubscribe is 10 [18:11:29] Wikimedia-Fundraising, Mobile-Content-Service, Wikipedia-Android-App-Backlog, Wikipedia-iOS-App-Backlog, and 2 others: Run Big English fundraising on apps - https://phabricator.wikimedia.org/T181004#3797369 (JoeWalsh) @bearND thanks for the response JSON. I think "Privacy disclaimer text: " wasn'... [18:12:04] Wikimedia-Fundraising, Mobile-Content-Service, Wikipedia-Android-App-Backlog, Wikipedia-iOS-App-Backlog, and 2 others: Run Big English fundraising on apps - https://phabricator.wikimedia.org/T181004#3797372 (cmadeo) Echoing some thoughts above: I'd prefer to not change the text styling too drasti... [18:13:54] Fundraising Sprint Winter Wanderland, Fundraising-Backlog, fundraising-tech-ops: Give Civi Access to Thea - https://phabricator.wikimedia.org/T181527#3797378 (cwdent) Open>Resolved a:cwdent @TSkaff - you should have an email about the new account, and your cert and password can be found i... [18:14:27] Thanks very much! [18:15:50] tskaff: you bet! [18:16:12] let me know if you have trouble with the cert, it can be confusing [18:30:28] fr-tech anything in particular you want me to tell Scrum of Scrums? [18:34:27] nothing here [18:35:11] ejegg: all good here [18:36:50] Na, I'm good. [18:38:13] cool [18:41:41] Wikimedia-Fundraising, Mobile-Content-Service, Wikipedia-Android-App-Backlog, Wikipedia-iOS-App-Backlog, and 2 others: Run Big English fundraising on apps - https://phabricator.wikimedia.org/T181004#3797473 (JoeWalsh) @bearND also, could you add an extra newline (two total) between the paragraphs... [19:00:42] Wikimedia-Fundraising, Mobile-Content-Service, Wikipedia-Android-App-Backlog, Wikipedia-iOS-App-Backlog, and 2 others: Run Big English fundraising on apps - https://phabricator.wikimedia.org/T181004#3797615 (bearND) ^ Now with double the line breaks and updated button label to "Donate now". [19:19:45] Fundraising Sprint Winter Wanderland, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM: Changing contact records from individual records to organization records - https://phabricator.wikimedia.org/T156193#3797684 (CaitVirtue) If this is done, can we get a demo so we can show users how to do it? [19:23:30] Fundraising-Backlog, Patch-For-Review: Silverpop to Civi donor country error - https://phabricator.wikimedia.org/T181424#3797700 (Ejegg) Thanks @CCogdill_WMF! I've got some fixes underway. I'll look into the XX percentage. I just noticed one more wrinkle with the current logic: if there are two postal a... [19:25:01] Fundraising-Backlog, Patch-For-Review: Silverpop to Civi donor country error - https://phabricator.wikimedia.org/T181424#3797706 (CCogdill_WMF) Definitely! We aren't using postal codes anymore so let's take our most recent data. [19:26:39] Wikimedia-Fundraising, Mobile-Content-Service, Wikipedia-Android-App-Backlog, Wikipedia-iOS-App-Backlog, and 2 others: Run Big English fundraising on apps - https://phabricator.wikimedia.org/T181004#3797709 (bearND) Here are the Android screenshots in light and dark theme on a Nexus 5: {F11072360... [19:42:04] (PS3) Ejegg: Prefer Civi address to contribution_tracking for country [wikimedia/fundraising/tools] - https://gerrit.wikimedia.org/r/393816 (https://phabricator.wikimedia.org/T181424) [19:42:38] OK fr-tech I think that should get CCogdill the address data she wants ^^^ [19:45:06] yes! [19:45:19] hey ejegg if I have another silverpop export request, is now the time to make it? [19:45:26] sure [19:45:39] should I add to the same phab task? new one? [19:45:48] or ask here? :D [19:45:53] new phab task? [19:46:02] good to keep the discussion focused [19:49:38] k! [20:02:44] Fundraising Sprint Winter Wanderland, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM: Changing contact records from individual records to organization records - https://phabricator.wikimedia.org/T156193#3797862 (Eileenmcnaughton) It's currently in 'doing' [20:13:15] (CR) XenoRyet: [C: 1] "Looks pretty ok to me, but I'm not super sivlerpopish. Could probably do with a more experienced set of eyes." [wikimedia/fundraising/tools] - https://gerrit.wikimedia.org/r/393816 (https://phabricator.wikimedia.org/T181424) (owner: Ejegg) [20:14:38] eileen: https://phabricator.wikimedia.org/T156193 this looks resolved and in backlog [20:14:45] XenoRyet: heh, might be time to get more silverpopish! [20:14:50] in the backlog column of the board [20:15:14] You might be the most senior team member that's touched the thing. [20:15:22] Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM, Fr-CiviCRM-dedupe-FY2017/18, Epic: Epic: Dedupe V2: resolve top conflicts - https://phabricator.wikimedia.org/T143057#3797933 (Eileenmcnaughton) [20:15:24] besides me [20:15:38] hmm - the resolved must be a mis-click [20:15:48] want to do a vid chat and talk through it XenoRyet? [20:15:56] It's definitely a hole in my cross-training. [20:16:33] hmm, i could beef up the tests on that patch [20:17:17] Beefier tests never really hurt. [20:18:56] XenoRyet: are you able to run those tests locally? [20:19:06] As for a vid call, let me poke around the code a bit myself first. I feel like I get more out of it that way. [20:19:13] good call [20:19:27] I believe I can, yea. [20:19:59] k, I'mma step out for a bit [20:22:07] I put up a patch to help Leanne with the Benevity issue [20:23:11] actually there are 4 but the first 2 are only formatting & the 3rd is extracting a short function :-) [20:49:31] Wikimedia-Fundraising, Mobile-Content-Service, Wikipedia-Android-App-Backlog, Wikipedia-iOS-App-Backlog, and 2 others: Run Big English fundraising on apps - https://phabricator.wikimedia.org/T181004#3798098 (bearND) Added a more significant delay in there so we can deploy what we have right now (... [20:49:49] Fundraising Sprint Winter Wanderland, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM: Changing contact records from individual records to organization records - https://phabricator.wikimedia.org/T156193#3798101 (CaitVirtue) Ah, OK sorry. It was showing as resolved for us. [20:50:55] Fundraising Sprint Winter Wanderland, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM: Changing contact records from individual records to organization records - https://phabricator.wikimedia.org/T156193#3798103 (Eileenmcnaughton) Yeah David pointed out I had changed the status - but not intention... [20:59:43] Fundraising Sprint Winter Wanderland, Fundraising-Backlog, fundraising-tech-ops: Give Civi Access to Thea - https://phabricator.wikimedia.org/T181527#3798136 (DStrine) Resolved>Open [21:01:35] Fundraising Sprint Winter Wanderland, Fundraising-Backlog, fundraising-tech-ops: Give Civi Access to Thea - https://phabricator.wikimedia.org/T181527#3798141 (Eileenmcnaughton) You should have received a drupal login email now [21:04:41] Fundraising Sprint Winter Wanderland, Fundraising-Backlog, fundraising-tech-ops: Give Civi Access to Thea - https://phabricator.wikimedia.org/T181527#3798173 (TSkaff) Yes thank you all! I did receive an email just haven't logged in yet as I'm buried in the Big English banners but will do so today. Ma... [21:19:07] (PS2) Eileen: Apply drupal formatting to file prior to editing [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/393977 [21:19:09] (PS2) Eileen: Comment block tidy ups [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/393978 [21:19:11] (PS2) Eileen: Put repetitive line of code in their own functions [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/393986 [21:19:13] (PS2) Eileen: Fix checks for existing contributions on Benevity imports to check donor AND matching contributions. [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/393987 (https://phabricator.wikimedia.org/T181548) [21:21:33] hey all going to run to lunch a little late. I'll have my phone near me [21:31:36] Wikimedia-Fundraising, Mobile-Content-Service, Wikipedia-Android-App-Backlog, Wikipedia-iOS-App-Backlog, and 2 others: Run Big English fundraising on apps - https://phabricator.wikimedia.org/T181004#3798281 (bearND) The latest patch is to remove the extra "Privacy disclaimer text: ". Thanks @JoeW... [21:45:23] AndyRussG: just rolled out your change to the test registration to our banners, looks to be working fine so far. thanks! [21:46:37] (CR) Ejegg: [C: 2] Apply drupal formatting to file prior to editing [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/393977 (owner: Eileen) [21:47:17] that was the long one :-0 [21:48:12] Fundraising Sprint Winter Wanderland, Fundraising-Backlog, fundraising-tech-ops: Civi credential for new Engage user - https://phabricator.wikimedia.org/T181537#3798322 (cwdent) Sent to Lisa for approval [21:50:06] Wikimedia-Fundraising, Mobile-Content-Service, Wikipedia-Android-App-Backlog, Wikipedia-iOS-App-Backlog, and 2 others: Run Big English fundraising on apps - https://phabricator.wikimedia.org/T181004#3798323 (JoeWalsh) Updated iOS screenshots: {F11073895} {F11073894} [21:52:36] (CR) Ejegg: [C: 2] Comment block tidy ups [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/393978 (owner: Eileen) [21:54:29] (CR) Ejegg: [C: 2] Put repetitive line of code in their own functions [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/393986 (owner: Eileen) [22:04:12] (Merged) jenkins-bot: Apply drupal formatting to file prior to editing [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/393977 (owner: Eileen) [22:04:15] Fundraising Sprint Winter Wanderland, Fundraising-Backlog, fundraising-tech-ops: Civi credential for new Engage user - https://phabricator.wikimedia.org/T181537#3798378 (LeanneS) Thank you! [22:04:48] (CR) Ejegg: [C: 1] "looks great! One comment on name of existing check fn." (1 comment) [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/393987 (https://phabricator.wikimedia.org/T181548) (owner: Eileen) [22:20:31] (PS3) Eileen: Fix checks for existing contributions on Benevity imports to check donor AND matching contributions. [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/393987 (https://phabricator.wikimedia.org/T181548) [22:21:14] (CR) Eileen: "Good call - I think maybe I couldn't decide so used both adjectives :-)" [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/393987 (https://phabricator.wikimedia.org/T181548) (owner: Eileen) [22:24:59] (Merged) jenkins-bot: Comment block tidy ups [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/393978 (owner: Eileen) [22:28:02] eileen: I'm sorry we didn't get standup time today. What are you up to today? [22:28:32] i see Jerry has not responded to the import task [22:28:38] I can try to ping now... [22:28:55] Wikimedia-Fundraising, Mobile-Content-Service, Wikipedia-Android-App-Backlog, Wikipedia-iOS-App-Backlog, and 2 others: Run Big English fundraising on apps - https://phabricator.wikimedia.org/T181004#3798450 (cmadeo) Thanks for checking in on the button capitalization. I would prefer if we used se... [22:29:28] dstrine - hopefully deploying benevity & then going back to contact change [22:29:34] contact type change [22:29:35] (Merged) jenkins-bot: Put repetitive line of code in their own functions [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/393986 (owner: Eileen) [22:29:55] have been doing a bit of local tidy up on old-half-done git branches to 'clear my desk' [22:30:09] & if Jerry comes back can switch to that [22:30:21] also lots of refreshing dash.... [22:31:01] also trying to get upstreaming PRs to move along a little [22:32:05] but if you wish to redirect my energies you can [22:32:58] eileen: ok we had talked about merging on address for MG and running dedupe on orgs. Are those easy to enable? Or are we trying not to touch the actual dedupe right now? [22:33:51] dstrine: so I looked at the orgs one & hit a bug which is really very intermittant but happens to affect one of the first contacts to be hit [22:33:59] so I have to resolve that first [22:34:06] so slightly bigger than I hoped [22:34:30] ok [22:34:36] but I can work on one of those 2 things now - which do you think I should hit first? [22:35:03] MG feels merging addresses will be the biggest help. [22:35:31] did we actually turn off dedupe in the last few days? [22:35:47] ok - I'll work on that now - [22:36:03] dedupe is off except for contacts with a single donation of $500 or more [22:40:59] pcoombe: cool, thanks! I'll keep an eye out... [22:41:12] Wikimedia-Fundraising, Mobile-Content-Service, Wikipedia-Android-App-Backlog, Wikipedia-iOS-App-Backlog, and 2 others: Run Big English fundraising on apps - https://phabricator.wikimedia.org/T181004#3798494 (bearND) @schoenbaechler > The start time is set to 11/30/2017 16:00:00 UTC We've alread... [22:47:12] Fundraising Sprint Vaporwerewolf, Fundraising Sprint Winter Wanderland, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM: New Civi Import - https://phabricator.wikimedia.org/T172423#3798520 (jkim_wikimedia) Hi Eileen! Sorry for the delay. Answers below: are these always USD? No, there's a chan... [22:47:19] eileen: thanks! [22:53:52] (CR) Ejegg: [C: 2] Fix checks for existing contributions on Benevity imports to check donor AND matching contributions. [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/393987 (https://phabricator.wikimedia.org/T181548) (owner: Eileen) [22:59:21] (Merged) jenkins-bot: Fix checks for existing contributions on Benevity imports to check donor AND matching contributions. [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/393987 (https://phabricator.wikimedia.org/T181548) (owner: Eileen) [23:04:52] Wikimedia-Fundraising, Mobile-Content-Service, Wikipedia-Android-App-Backlog, Wikipedia-iOS-App-Backlog, and 2 others: Run Big English fundraising on apps - https://phabricator.wikimedia.org/T181004#3798560 (schoenbaechler) @bearND > We've already missed today's deployment window. (...) Maybe... [23:05:02] Fundraising Sprint Winter Wanderland, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM, Patch-For-Review: Benevity import failed - https://phabricator.wikimedia.org/T181548#3798561 (LeanneS) Thanks, Eileen! I'm ready to try reimporting once approved. [23:12:55] (PS1) Eileen: Apply drupal formatting to file prior to editing [wikimedia/fundraising/crm] (deployment) - https://gerrit.wikimedia.org/r/394219 [23:12:57] (PS1) Eileen: Comment block tidy ups [wikimedia/fundraising/crm] (deployment) - https://gerrit.wikimedia.org/r/394220 [23:13:05] (PS1) Eileen: Fix checks for existing contributions on Benevity imports to check donor AND matching contributions. [wikimedia/fundraising/crm] (deployment) - https://gerrit.wikimedia.org/r/394221 (https://phabricator.wikimedia.org/T181548) [23:13:15] (PS1) Ejegg: Fix last data point day [wikimedia/fundraising/dash] - https://gerrit.wikimedia.org/r/394222 [23:13:32] (CR) Eileen: [C: 2] "cherry-pick to deployment, already merged to master" [wikimedia/fundraising/crm] (deployment) - https://gerrit.wikimedia.org/r/394219 (owner: Eileen) [23:13:42] (CR) Eileen: [C: 2] "cherry-pick to deployment, already merged to master" [wikimedia/fundraising/crm] (deployment) - https://gerrit.wikimedia.org/r/394220 (owner: Eileen) [23:13:51] (CR) Eileen: [C: 2] "cherry-pick to deployment, already merged to master" [wikimedia/fundraising/crm] (deployment) - https://gerrit.wikimedia.org/r/394221 (https://phabricator.wikimedia.org/T181548) (owner: Eileen) [23:13:57] XenoRyet|food: got a fix for the amount/second chart on the dash: https://gerrit.wikimedia.org/r/394222 [23:14:27] Fundraising Sprint Vaporwerewolf, Fundraising Sprint Winter Wanderland, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM: New Civi Import - https://phabricator.wikimedia.org/T172423#3798573 (DStrine) @Eileenmcnaughton and @Ejegg I was talking with @jkim_wikimedia This import will be used to i... [23:14:46] (Merged) jenkins-bot: Apply drupal formatting to file prior to editing [wikimedia/fundraising/crm] (deployment) - https://gerrit.wikimedia.org/r/394219 (owner: Eileen) [23:14:48] (Merged) jenkins-bot: Comment block tidy ups [wikimedia/fundraising/crm] (deployment) - https://gerrit.wikimedia.org/r/394220 (owner: Eileen) [23:15:05] (Merged) jenkins-bot: Fix checks for existing contributions on Benevity imports to check donor AND matching contributions. [wikimedia/fundraising/crm] (deployment) - https://gerrit.wikimedia.org/r/394221 (https://phabricator.wikimedia.org/T181548) (owner: Eileen) [23:15:15] (PS1) Ejegg: Add API parameter for fix_address [wikimedia/fundraising/crm/civicrm] - https://gerrit.wikimedia.org/r/394223 [23:17:20] (CR) Eileen: [C: 2] "I think this is fine in the context of our codebase but I do think we should record it on the 'adds technical debt' column as I think we n" [wikimedia/fundraising/crm/civicrm] - https://gerrit.wikimedia.org/r/394223 (owner: Ejegg) [23:19:57] Wikimedia-Fundraising, Mobile-Content-Service, Wikipedia-Android-App-Backlog, Wikipedia-iOS-App-Backlog, and 2 others: Run Big English fundraising on apps - https://phabricator.wikimedia.org/T181004#3798584 (bearND) Well, I wanted to give it a couple of hours after the deployment is done due to c... [23:20:22] !log update civicrm from a1022cf2a64c048382a1ae5da7f1f81da0336d62 to 0f95f3e37f9651a5fd262bf1f5e39929abee0d88 (Benevity import fix) [23:20:30] Logged the message at https://wikitech.wikimedia.org/wiki/Server_Admin_Log [23:21:13] (Merged) jenkins-bot: Add API parameter for fix_address [wikimedia/fundraising/crm/civicrm] - https://gerrit.wikimedia.org/r/394223 (owner: Ejegg) [23:23:05] Fundraising Sprint Winter Wanderland, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM, Patch-For-Review: Benevity import failed - https://phabricator.wikimedia.org/T181548#3798589 (Eileenmcnaughton) @LeanneS please try again now. I have deployed a fix which means it will not stop on those line... [23:27:03] Wikimedia-Fundraising, Mobile-Content-Service, Wikipedia-Android-App-Backlog, Wikipedia-iOS-App-Backlog, and 2 others: Run Big English fundraising on apps - https://phabricator.wikimedia.org/T181004#3798590 (bearND) On second thought. I think to make this easy, and since we seem to agree on the t... [23:29:43] Fundraising Sprint Vaporwerewolf, Fundraising Sprint Winter Wanderland, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM: New Civi Import - https://phabricator.wikimedia.org/T172423#3798595 (Eileenmcnaughton) From an import POV I can respect the columns utm_campaign if added - and you would nee... [23:38:35] howdy XenoRyet, I added another teeny thing to the review pile [23:38:43] https://gerrit.wikimedia.org/r/394222 [23:39:14] Cool, I'll take a look in a minute here. [23:40:41] (PS1) Ejegg: Use api to insert address [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/394226 [23:43:39] Fundraising Sprint Winter Wanderland, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM, Patch-For-Review: Benevity import failed - https://phabricator.wikimedia.org/T181548#3798640 (LeanneS) Okay, just tried importing. Many more rows did import, but not all. It resulted in a 504 Gateway Time-ou... [23:44:26] Fundraising Sprint Winter Wanderland, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM, Patch-For-Review: Benevity import failed - https://phabricator.wikimedia.org/T181548#3798642 (Eileenmcnaughton) ug - how many rows in the file? Can you split it in 2? [23:45:23] Fundraising Sprint Winter Wanderland, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM, Patch-For-Review: Benevity import failed - https://phabricator.wikimedia.org/T181548#3798643 (LeanneS) 2710 rows. I'll try splitting it up. [23:47:13] Fundraising Sprint Winter Wanderland, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM, Patch-For-Review: Benevity import failed - https://phabricator.wikimedia.org/T181548#3798648 (LeanneS) Ah, I refreshed and they're now showing! It might just have been delayed during the initial search. Just... [23:47:59] (CR) Eileen: [C: 2] "This is a well-known well-trodden code approach, which is well covered by tests. It mostly wraps the same function but puts exception proc" [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/394226 (owner: Ejegg) [23:51:34] (Merged) jenkins-bot: Use api to insert address [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/394226 (owner: Ejegg) [23:52:45] Fundraising Sprint Winter Wanderland, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM, Patch-For-Review: Benevity import failed - https://phabricator.wikimedia.org/T181548#3793810 (Ejegg) @LeanneS Our setup is a little confusing. We have the real Civi server, and another server in front of it... [23:53:20] (CR) XenoRyet: [C: 2] "Upon further review, I'm comfortable with this." [wikimedia/fundraising/tools] - https://gerrit.wikimedia.org/r/393816 (https://phabricator.wikimedia.org/T181424) (owner: Ejegg) [23:53:22] Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM: Figure out a way to increase php time outs on import jobs - https://phabricator.wikimedia.org/T181688#3798656 (Eileenmcnaughton) [23:53:52] Fundraising Sprint Winter Wanderland, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM, Patch-For-Review: Benevity import failed - https://phabricator.wikimedia.org/T181548#3793810 (Eileenmcnaughton) @LeanneS I just created a follow on task to look at the gateway timeout issue at some point - b... [23:54:53] (Merged) jenkins-bot: Prefer Civi address to contribution_tracking for country [wikimedia/fundraising/tools] - https://gerrit.wikimedia.org/r/393816 (https://phabricator.wikimedia.org/T181424) (owner: Ejegg) [23:56:50] (CR) XenoRyet: [C: 2] Fix last data point day [wikimedia/fundraising/dash] - https://gerrit.wikimedia.org/r/394222 (owner: Ejegg) [23:58:26] (CR) jerkins-bot: [V: -1] Fix last data point day [wikimedia/fundraising/dash] - https://gerrit.wikimedia.org/r/394222 (owner: Ejegg) [23:58:53] ah drat, what's up with that? [23:59:25] ooh, tricksy lint