[00:00:04] ie. query takes 51 seconds now [00:00:21] on staging with cleaned up query, added index (& less data) I can get it under 1 [00:01:09] my suspicion is the fast time would be the same on prod - ie. I think the data size affects the slow queries but not the fast one [00:08:05] Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM: Ensuring converted organization records are consistent - https://phabricator.wikimedia.org/T156194#2970913 (DStrine) p:Triage>Normal [00:08:14] Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM: Changing contact records from individual records to organization records - https://phabricator.wikimedia.org/T156193#2970914 (DStrine) p:Triage>Normal [00:08:48] Fundraising Sprint Baudelaire Bowdlerizer, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM: Slow log in - looks like it's drupal cron - https://phabricator.wikimedia.org/T155084#2970918 (Eileenmcnaughton) a:Eileenmcnaughton [00:14:19] Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM: Spike: What should we do to fix data where blank addresses have overwritten valid addresses - https://phabricator.wikimedia.org/T153917#2970940 (DStrine) p:High>Normal [00:17:01] Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM: Two small edits to the template of the Main Contact Record Page - https://phabricator.wikimedia.org/T137438#2970945 (DStrine) Open>Resolved [00:18:01] Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM: Dedupe and queue consumer are failing due to lots of database timeouts - https://phabricator.wikimedia.org/T143606#2970946 (DStrine) Open>Resolved [00:18:42] Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM, Spike: Spike: unsubscribe might have to be a mailto now, rather than an https link - https://phabricator.wikimedia.org/T143035#2970948 (DStrine) p:High>Normal [00:20:03] Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM, FR-2016-17-Q2-Campaign-Support: Periodically run Civi contact import performance tests, note trends - https://phabricator.wikimedia.org/T146338#2970950 (DStrine) p:High>Normal [00:21:07] Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM, DBA, FR-2016-17-Q2-Campaign-Support, and 2 others: Spike: Look into transaction isolation level and other tricks for easing db contention - https://phabricator.wikimedia.org/T146821#2970952 (DStrine) p:High>Normal [00:22:10] Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM: Coinbase "refunded" contributions not recorded correctly - https://phabricator.wikimedia.org/T118337#2970953 (DStrine) p:High>Normal [00:22:56] Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM: Coinbase "refunded" contributions not recorded correctly - https://phabricator.wikimedia.org/T118337#1797675 (DStrine) Open>declined [00:23:19] Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM: Coinbase "refunded" contributions not recorded correctly - https://phabricator.wikimedia.org/T118337#1797675 (DStrine) Please reopen if this recurs. [00:23:42] Fundraising Sprint William Shatner, Fundraising Sprint X-Ray Spex, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM, Patch-For-Review: Don't include refunded donations in Silverpop export - https://phabricator.wikimedia.org/T117931#2970957 (DStrine) Open>Resolved [00:25:16] Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM: Problems when viewing a contribution; and possible corruption - https://phabricator.wikimedia.org/T118826#2970958 (DStrine) Open>declined [00:25:32] Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM: Problems when viewing a contribution; and possible corruption - https://phabricator.wikimedia.org/T118826#1810179 (DStrine) cannot reproduce. Please reopen if this is seen again. [00:28:08] Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM: Need more information than "Original error: DB Error: unknown error" - https://phabricator.wikimedia.org/T116493#2970962 (DStrine) p:High>Normal [00:29:05] Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM, Epic: [Epic] Improve MG workflow for entering new contributions - https://phabricator.wikimedia.org/T118344#2970963 (DStrine) p:High>Normal [00:29:35] Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM, Epic: [epic] Dedupe CiviCRM - https://phabricator.wikimedia.org/T77938#2970965 (DStrine) [00:29:38] Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM, Epic: [epic] Dedupe exact matches - https://phabricator.wikimedia.org/T111702#2970964 (DStrine) Open>Resolved [00:30:02] Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM, FR-Ingenico, FR-Smashpig, MediaWiki-extensions-DonationInterface: Rename all references to GlobalCollect in code, to Ingenico. Determine if we need to update old database entries - https://phabricator.wikimedia.org/T123249#2970978 (DStrine)... [00:30:33] Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM, fundraising-tech-ops, MediaWiki-extensions-ContributionTracking, MediaWiki-extensions-DonationInterface: Consolidate contribution_tracking code into a single library - https://phabricator.wikimedia.org/T120466#2970979 (DStrine) p:High>... [00:30:51] Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM, MediaWiki-extensions-ContributionTracking, MediaWiki-extensions-DonationInterface, Epic: [epic] SPOF: Use Redis as backend store for contribution_tracking - https://phabricator.wikimedia.org/T119556#2970982 (DStrine) p:High>Normal [00:37:38] hmm, a bunch of recurring charge failed messages. Let's see if that's all because of the library update [00:39:52] well, a bunch did go through successfully in the same run. Let's see if there's a similar volume from yesterday [00:41:15] nah, normal volume, guess there's nothing to worry about [00:50:21] have a good evening, all! [00:50:32] You too [02:39:27] Wikimedia-Fundraising-CiviCRM: Show links to downloadable files in the import log - https://phabricator.wikimedia.org/T156339#2971373 (Eileenmcnaughton) [02:54:00] (PS1) Eileen: wip Matching gifts import. [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/334235 (https://phabricator.wikimedia.org/T115044) [03:05:11] (PS1) Eileen: Add index to nick_name field. [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/334236 (https://phabricator.wikimedia.org/T115044) [03:10:32] (CR) Eileen: "This took around 3 mins to run on staging" [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/334236 (https://phabricator.wikimedia.org/T115044) (owner: Eileen) [03:18:27] (Abandoned) Eileen: wip Matching gifts import. [wikimedia/fundraising/crm] (deployment) - https://gerrit.wikimedia.org/r/331575 (https://phabricator.wikimedia.org/T115044) (owner: Eileen) [03:29:29] (PS2) Eileen: wip Matching gifts import. [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/334235 (https://phabricator.wikimedia.org/T115044) [03:31:03] Fundraising Sprint Autotune Earphones, Fundraising Sprint Baudelaire Bowdlerizer, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM, and 2 others: Create an import method for matching gifts and payroll deductions - https://phabricator.wikimedia.org/T115044#2971423 (Eileenmcnaughton) @RLewis @Lea... [09:11:14] Fundraising-Backlog, MediaWiki-extensions-CentralNotice, Easy: Localizable messages with spaces in the name cause fatal exception - should fail gracefully - https://phabricator.wikimedia.org/T58105#2971728 (Nemo_bis) >>! In T58105#2962290, @DatGuy wrote: > Where are the messages located? I believe th... [15:10:55] fundraising-tech-ops, Operations, Traffic: Fix nits in Fundraising HTTPS/HSTS configs in wikimedia.org domain - https://phabricator.wikimedia.org/T137161#2972789 (BBlack) What about benefactorevents / eventdonations? [15:58:41] Fundraising-Backlog, Analytics-Kanban, Patch-For-Review: Productionize banner impressions druid/pivot dataset - https://phabricator.wikimedia.org/T155141#2972924 (mforns) I think the implementation of the jobs is finished now. I've made some changes to the patch: * banner impressions renamed to banne... [16:11:08] hi cwd! how did it go with the wiki help? [16:11:33] ejegg: good! i sent a recap to the group last night [16:12:00] i was actually able to fix their stuff so that was a relief [16:14:16] Nice! The wiki is looking good [16:15:30] yeah it was made by some college kids from your neck of the woods, worcester polytechnic i think [16:15:34] they did a good job [16:35:57] fundraising-tech-ops: reimage frdb2001 with debian/jessie - https://phabricator.wikimedia.org/T156275#2973071 (Jgreen) Open>Resolved done. [16:39:22] fundraising-tech-ops: rename fdb2001 to frdb2001 - https://phabricator.wikimedia.org/T156274#2973084 (Jgreen) Open>Resolved done [16:44:07] Fundraising Sprint Baudelaire Bowdlerizer, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM: Slow log in - looks like it's drupal cron - https://phabricator.wikimedia.org/T155084#2973100 (CaitVirtue) I timed the load time for my first log in this morning. I'm WFH. It took 52 seconds. [16:55:46] Fundraising Sprint Baudelaire Bowdlerizer, Fundraising-Backlog, MediaWiki-extensions-CentralNotice, Patch-For-Review: CentralNotice: If possible, reduce Varnish cache time for SpecialBannerLoader errors - https://phabricator.wikimedia.org/T151418#2816626 (AndyRussG) This went out with the train t... [16:56:04] Fundraising Sprint Baudelaire Bowdlerizer, Fundraising-Backlog, MediaWiki-extensions-CentralNotice, Patch-For-Review: CentralNotice: If possible, reduce Varnish cache time for SpecialBannerLoader errors - https://phabricator.wikimedia.org/T151418#2973165 (AndyRussG) Open>Resolved [17:20:06] spatton: got a package arriving from your neck of the woods tomorrow - https://www.moogmusic.com/products/semi-modular/mother-32 [17:20:14] * cwd very excite [17:22:13] hey cwd or Jeff_Green do you have any idea what's up with those Civi content match alerts? [17:22:36] hmmm [17:23:27] wonder if it has to do with a client cert for catchpoint? [17:24:14] ah, they'd need one for that check, wouldn't they [17:24:33] can you snooze that alarm till the cert is regenerated? [17:25:02] hrmph, i wouldn't think it would resolve itself though... [17:29:24] Fundraising Sprint Baudelaire Bowdlerizer, Fundraising-Backlog, MediaWiki-extensions-CentralNotice: Method to bypass/purge CentralNotice cache when forcing banner - https://phabricator.wikimedia.org/T154954#2973327 (AndyRussG) Here's another idea, maybe simpler: what about just automatically purging... [17:39:35] got to shovel snow [17:53:45] awww snow! [18:00:31] fr-tech: One could not be a successful scientist without realizing that, in contrast [18:00:31] to the popular conception supported by newspapers and mothers of scientists, [18:00:31] a goodly number of scientists are not only narrow-minded and dull, but also [18:00:32] just stupid. [18:00:32] -- J. D. Watson, "The Double Helix" [18:00:32] -- discuss. [18:04:00] Fundraising Sprint Baudelaire Bowdlerizer, Fundraising-Backlog, MediaWiki-extensions-CentralNotice: Method to bypass/purge CentralNotice cache when forcing banner - https://phabricator.wikimedia.org/T154954#2973465 (DStrine) @AndyRussG this was m first suggestion in our chat last week. You indicated... [18:04:07] fr-tech who's up or -talk? [18:05:13] I don't have much to talk about, but I could rubber-duck if it's needed. [18:06:03] cool, dialing in! [18:06:45] Fundraising Sprint Baudelaire Bowdlerizer, Fundraising-Backlog, MediaWiki-extensions-CentralNotice: Method to bypass/purge CentralNotice cache when forcing banner - https://phabricator.wikimedia.org/T154954#2973468 (AndyRussG) @DStrine aaarg maybe I misunderstood? /me scapegoats Hangout robots... [18:08:03] Fundraising Sprint Baudelaire Bowdlerizer, Fundraising-Backlog, MediaWiki-extensions-CentralNotice: Method to bypass/purge CentralNotice cache when forcing banner - https://phabricator.wikimedia.org/T154954#2973469 (DStrine) well lets proceed with the new suggestion. thanks for working on this! [18:09:18] ejegg: XenoRyet I don't have much to share, and feel I should respond to some comments on the banner impressions Pivot patch to not affect Analytics' awesome momentum...so I'll skip, maybe, unless you think it's important I do otherwise? [18:09:51] k, keep up the good work with analytics! [18:12:54] ejegg: K, thx! (...rather, I'll try to avoid wrench-throwing in the general direction of their good work...) [18:16:19] ejegg i've been meaning to look into that, since it's flapping it fits the pattern we've seen before where some of their check agents are misbehaving [18:16:30] ^^^ the catchpoint thing i mean [18:21:55] Jeff_Green: i was wondering if it could be network issues? noticed the requests were from overseas [18:23:07] yeah it could be [18:30:46] cwd: we're tech-talkin about smashpig stuff if you're interested. [18:30:46] Fundraising Sprint Baudelaire Bowdlerizer, Fundraising Sprint Dirt Farming, Fundraising Sprint Elevator Maintenance 2016, Fundraising-Backlog, and 3 others: Store and update list of currenly working IDEAL banks - https://phabricator.wikimedia.org/T128692#2973533 (Jgreen) I'm not sure yet whether... [18:33:32] XenoRyet: sure, be there shortly [18:38:10] Fundraising-Backlog, MediaWiki-extensions-CentralNotice: CentralNotice: Add region (subdivision) geolocaiton parameter to beacon/impression URL - https://phabricator.wikimedia.org/T156399#2973551 (AndyRussG) [19:12:57] Fundraising-Backlog, MediaWiki-extensions-CentralNotice: CentralNotice: Add region geolocaiton parameter to beacon/impression URL - https://phabricator.wikimedia.org/T156399#2973720 (AndyRussG) [19:13:33] Fundraising-Backlog, MediaWiki-extensions-CentralNotice: CentralNotice: Add region geolocation parameter to beacon/impression URL - https://phabricator.wikimedia.org/T156399#2973551 (AndyRussG) [19:13:49] (PS1) AndyRussG: Add region URL param to beacon/impression [extensions/CentralNotice] - https://gerrit.wikimedia.org/r/334410 (https://phabricator.wikimedia.org/T156399) [19:40:53] Fundraising-Backlog, Analytics-Kanban, Patch-For-Review: Productionize banner impressions druid/pivot dataset - https://phabricator.wikimedia.org/T155141#2973811 (AndyRussG) Hi, all! Thanks so much once again for working on this!!!! :D Here are some notes and questions: - Region data is important. I... [19:49:55] Fundraising-Backlog: Add currency symbol to email export file - https://phabricator.wikimedia.org/T156410#2973874 (CCogdill_WMF) [19:50:06] Fundraising-Backlog: Add currency symbol to email export file - https://phabricator.wikimedia.org/T156410#2973886 (CCogdill_WMF) p:Triage>Normal [20:03:59] are we standing or grooming or both today? [20:22:36] Fundraising-Backlog: Re-investigate using Civi unsusbscribe page for fundraising bulk emails - https://phabricator.wikimedia.org/T156418#2974040 (CCogdill_WMF) [20:22:52] Fundraising-Backlog: Re-investigate using Civi unsusbscribe page for fundraising bulk emails - https://phabricator.wikimedia.org/T156418#2974056 (CCogdill_WMF) p:Triage>Normal [20:24:19] Fundraising-Backlog, Analytics-Kanban, Patch-For-Review: Productionize banner impressions druid/pivot dataset - https://phabricator.wikimedia.org/T155141#2974065 (AndyRussG) Mmm it seems I may have spoken too quickly about region vs. minutely, apologies... If it turns out that it's necessary to choos... [20:27:24] ah good quesiton [20:28:00] dstrine: ^ ? Standup + grooming or just grooming todayz? [20:28:57] * AndyRussG tries to spawn new spelling and grammarz [20:47:09] AndyRussG: we should do both [20:59:02] Fundraising-Backlog: Sync email behavior data with Civi contact records - https://phabricator.wikimedia.org/T156422#2974150 (CCogdill_WMF) [20:59:10] Fundraising-Backlog: Sync email behavior data with Civi contact records - https://phabricator.wikimedia.org/T156422#2974162 (CCogdill_WMF) p:Triage>High [21:09:28] Fundraising-Backlog: Sync email behavior data with Civi contact records - https://phabricator.wikimedia.org/T156422#2974150 (MBeat33) Big +1. This would be really helpful from Donor Services' perspective. Especially the part about retaining data older than 450 days; we're cultivating long term relationships... [21:23:06] (CR) Ejegg: [C: -1] "Looking good! Some naming suggestions, a few other things inline. Will there always be a 1:1 relationship between checks and fixes?" (5 comments) [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/329654 (https://phabricator.wikimedia.org/T152474) (owner: Eileen) [21:50:05] ok, snow shoveling [redux] [23:20:04] Fundraising-Backlog: Design specific pre-campaign verification procedures - https://phabricator.wikimedia.org/T155849#2974539 (DStrine) p:Triage>Normal [23:39:02] XenoRyet: any questions on those patches? [23:41:06] Na, not especially right yet. Kind of got carried away looking at those WIP ones. What do you think is top of the pile for stuff that actually needs merging? [23:44:09] The two pushing enums and data objects down could go regardless of how we do the rest of the library-ization [23:44:47] Also, this would be nice for using PHPUnit mocks: https://gerrit.wikimedia.org/r/333801 [23:45:19] Cool, I'll take a look at those. [23:45:22] And there's some more cleanup in DonationInterface: https://gerrit.wikimedia.org/r/332971 [23:45:36] Always down for DI cleanup [23:46:21] (CR) Ejegg: [C: 2] Add index to nick_name field. [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/334236 (https://phabricator.wikimedia.org/T115044) (owner: Eileen) [23:50:35] (Merged) jenkins-bot: Add index to nick_name field. [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/334236 (https://phabricator.wikimedia.org/T115044) (owner: Eileen) [23:52:20] (PS1) Ejegg: Add cURL wrapper [wikimedia/fundraising/SmashPig] - https://gerrit.wikimedia.org/r/334453 [23:57:56] got a bigger antenna [23:58:07] definitely more solid so far [23:58:14] Nice [23:58:34] also raj asked if i would like to have administrative access to the network [23:58:38] wicked [23:59:03] and maybe help out if he's out of town [23:59:31] and maybe help myself to a few extra mbps [23:59:52] (PS2) Ejegg: Add cURL wrapper [wikimedia/fundraising/SmashPig] - https://gerrit.wikimedia.org/r/334453