[00:29:45] (PS2) Cdentinger: Some logging in PP listener [wikimedia/fundraising/SmashPig] - https://gerrit.wikimedia.org/r/315336 [03:26:37] Hey awight|quartered ... if you're not occupied, quick thoughts on how to enable someone else's debug log (MessageCache) on the beta cluster? (np if you're busy!!!!) [03:27:56] AndyRussG: whew that one will be a serious fire hose [03:28:22] If you think it's a bug in MessageCache, we can bring other people in [03:28:34] We could also write more selective debugging [03:30:14] Oh. Beta cluster [03:30:15] sorry [03:30:30] //gerrit.wikimedia.org/r/operations/mediawiki-config [03:30:34] https://gerrit.wikimedia.org/r/operations/mediawiki-config [03:31:35] Humm, do you know if the *-labs configs apply to the beta cluster? [03:31:49] awight|quartered: it's related to message cache, but not prolly due to a change in that, but in the underlying cache config or something [03:32:21] It would be a line like https://gerrit.wikimedia.org/r/#/c/312124/ [03:32:26] but in the -labs variant I guess [03:32:33] but MessageCache has some degbug log calls already there [03:33:51] yes totally, I think those would work [03:33:58] actually I noticed there are two debugging keys [03:34:06] Here's a WIP in case it's helpful: //gerrit.wikimedia.org/r/315460 [03:34:12] aargh https://gerrit.wikimedia.org/r/315460 [03:34:43] okay yeah [03:34:49] I think this will be the most interesting line, [03:34:49] wfDebugLog( 'MessageCache', __METHOD__ . ": Loading $code... $info\n" ); [03:35:16] Did you have any more thoughts about my workaround where we play with cache expiry when the error is encountered? [03:35:29] Only pressing it cos I think that will give us a bit more information [03:35:50] e.g. if it happens once randomly, or any type of consistent [03:35:54] brb [03:43:55] awight|quartered: heh thanks that WIP looks great :) [03:44:35] yeah I'm not worried just yet about logging all the occurrences that are now bouncing thru Varnish [03:45:00] I was able to more or less reproduce on the beta cluster and have a general theory but not yet the specifics [03:45:31] (hopefully the beta cluster logging will help fill those in...) [03:48:43] Aaaarg network flake [03:54:37] awight|quartered: https://gerrit.wikimedia.org/r/#/c/315460/ [03:54:40] thx! [03:58:27] cool, hope that unearths things [03:58:41] I think you're welcome to merge and deploy to beta [03:59:46] awight|quartered: cool beans, thx!! [03:59:57] good luck with everything!! [04:00:19] :D [04:01:32] ¡¡¡saludos y un abrazote a tod@s!!! [14:39:37] fundraising-tech-ops: replace pay-lvs1001 & pay-lvs1002 with new hardware running jessie - https://phabricator.wikimedia.org/T145103#2708934 (Jgreen) pay-lvs1001 is done, replaced by the box that was formerly pay-lvs1003 [14:45:08] fundraising-tech-ops, Operations, ops-eqiad: pay-lvs1003 hardware swap for pay-lvs1001 - https://phabricator.wikimedia.org/T147932#2708940 (Jgreen) [14:49:48] fundraising-tech-ops: pre-decommission beryllium.frack.eqiad.wmnet - https://phabricator.wikimedia.org/T147934#2708978 (Jgreen) [15:46:16] AndyRussG: cwd ejegg|away XenoRyet|afk can you discuss this in tech talk today? https://phabricator.wikimedia.org/T147096 I was hoping this would be a 15 minutes mental exercise. It doesn't have to be absolutely complete. I need to know who needs extra messaging. [15:47:55] dstrine: ah intresting, thx! [17:00:56] fr-tech: If this is timesharing, give me my share right now. [17:00:56] It's not time yet. [17:00:56] -- discuss. [17:04:46] I'm hanging out fwiw [17:06:27] cwd: I was noticing, a good prep step for the PP API cert renewal would be to identify which services actually use the cert [17:06:36] coming [17:06:46] Is it just the audit processor and not the listener? [17:07:15] hrm, i don't think the listeenr does [17:14:26] one sec! [17:19:53] I'll be there in a sec too! [17:29:07] dstrine I think I'm going to struggle to get enough bandwidth to use talk in 30 mins [17:29:37] ah ok [17:29:45] network is running realllly slow at the moment :-( [17:29:57] (we are in a kind of farm house in the countryside [17:29:59] Let's just talk here [17:30:05] cool [17:30:55] do you have a record of our original estimates for dupes in civi [17:32:07] ejegg: ^^ [17:32:25] I did update some estimates recently [17:32:43] let me log on & see where the script is up to [17:32:53] dstrine: i've got scrum of scrums right now, but I'll keep an eye on this chat [17:33:41] ejegg: we don't have to talk just now this is jsut fyi [17:35:14] I'm trying to run a query to check duplicates but it may be too slow [17:38:13] (PS1) Ejegg: Fix a few timestamps in audit messages [wikimedia/fundraising/tools] - https://gerrit.wikimedia.org/r/315529 (https://phabricator.wikimedia.org/T140667) [17:39:25] eileen1: and awight when the project started...did anyone write down any estimates for dedupe (maybe last year)? [17:40:57] dstrine: hehe. It started like three years ago [17:41:10] I don't recall ever estimating [17:41:29] If I did it was a different scale, in Mingle [17:42:23] ok [17:42:53] dstrine: most of the contacts have been covered by the first path [17:42:57] pass [17:45:19] so my questions still remain. 1.) is it clean enough to be scanned manually by DS? 2.) is it already clean enough for intelligent emails to discuss donor history with a donor? [17:47:41] some numbers I would need to make this assessment: total records in civi. Suspected number or % dupes we think there were before the script started. [17:49:57] I'm trying to run a query to get some more info - but it's slowww…. trying again with a temp table [17:53:21] So here are the figures I think we want [17:53:35] 1) number of contact merges that have taken place [17:53:49] 2) number of deleted & undeleted contacts in the db [17:54:11] 3) number of email addresses that are attached to more than 1 undeleted contact [17:54:28] I've set this query going [17:54:38] CREATE TABLE dev_civicrm.a_temp_table SELECT e.id as email_1_id, e2.id as email_2_id FROM civicrm_email e INNER JOIN civicrm.civicrm_contact c ON c.id = e.contact_id AND is_deleted = 0 INNER JOIN civicrm.civicrm_email e2 ON e2.email = e.email AND e2.contact_id > e.contact_id; [17:54:50] but I don't know how long until it completes [17:55:00] (on staging but against copy of live db) [18:01:46] ok that sounds good. I just realized that I don't have my ubi key. Otherwise I would try to run it too :/ [18:04:22] yeah the temp table is created but now I'm trying to remove rows where contact 2 is deleted - have kicked off a query to see if I can do that [18:04:44] SELECT count(*) FROM dev_civicrm.a_temp_table t INNER JOIN civicrm_contact c ON c.id = t.email_2_id WHERE c.is_deleted = 0; [18:05:35] fr-tech: Anyone have a moment to review more fix for the paypal audit messages? https://gerrit.wikimedia.org/r/315529 [18:06:05] Sure, I can take a look. [18:06:28] thank you [18:11:26] (CR) XenoRyet: [C: 2] Fix a few timestamps in audit messages [wikimedia/fundraising/tools] - https://gerrit.wikimedia.org/r/315529 (https://phabricator.wikimedia.org/T140667) (owner: Ejegg) [18:12:41] (Merged) jenkins-bot: Fix a few timestamps in audit messages [wikimedia/fundraising/tools] - https://gerrit.wikimedia.org/r/315529 (https://phabricator.wikimedia.org/T140667) (owner: Ejegg) [18:13:16] ok this is my next query - hopefully it doesn't take forever SELECT count(DISTINCT e.email) FROM dev_civicrm.a_temp_table t INNER JOIN civicrm_email e ON e.id = t.email_2_id INNER JOIN civicrm_contact c ON c.id = e.contact_id WHERE c.is_deleted = 0; [18:13:39] OK - so I think we have 884544 duplicate email addresses still [18:13:48] ty XenoRyet [18:13:54] No worries [18:13:59] going to deploy one more time... [18:15:17] (PS1) Ejegg: Merge branch 'master' into deploy [wikimedia/fundraising/tools] (deploy) - https://gerrit.wikimedia.org/r/315542 [18:15:27] Fundraising Sprint Stirring The Pot, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM, Spike: SPIKE: investigate level of completeness of civi deduped DB - https://phabricator.wikimedia.org/T146384#2709878 (Eileenmcnaughton) This was too slow to run now we have done a bunch of merges - instead... [18:15:43] (CR) Ejegg: [C: 2] Merge branch 'master' into deploy [wikimedia/fundraising/tools] (deploy) - https://gerrit.wikimedia.org/r/315542 (owner: Ejegg) [18:15:50] (Merged) jenkins-bot: Merge branch 'master' into deploy [wikimedia/fundraising/tools] (deploy) - https://gerrit.wikimedia.org/r/315542 (owner: Ejegg) [18:17:22] eileen1: thanks! that's still a pretty big number but that number might shrink in the next week or so right? [18:17:59] I mean.. once at least 1 script has touched each record.. right? [18:18:00] it's shrinking more slowly now but still shrinking [18:18:12] e.g [18:18:13] Processed id range 10594081 to 10608504 [18:18:13] 18:11:57 Merged 215. Skipped 1552 [18:19:07] Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM: create a dashlet for dedupe script stats - https://phabricator.wikimedia.org/T146229#2709892 (Eileenmcnaughton) Here is the pattern of merges by day SELECT DATE(activity_date_time), activity_type_id, count(*) as number_of_merges FROM civicrm_activity W... [18:19:15] !log updated fundraising tools from cbf4dcd734956f95a7485ce1f420d05222c09e5a to f6d200dc76520298171196c5419b382fe86d9dcd [18:19:21] Logged the message at https://wikitech.wikimedia.org/wiki/Server_Admin_Log, Master [18:19:56] Fundraising Sprint Stirring The Pot, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM, Spike: SPIKE: investigate level of completeness of civi deduped DB - https://phabricator.wikimedia.org/T146384#2709893 (Eileenmcnaughton) By day the dedupes look like (ie. number of dedupes per day) SELECT D... [18:21:30] Fundraising Sprint Stirring The Pot, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM, Spike: SPIKE: investigate level of completeness of civi deduped DB - https://phabricator.wikimedia.org/T146384#2709898 (Eileenmcnaughton) We have merged around 4.5 million contacts MariaDB [civicrm]> SELECT... [18:21:31] eileen1: ok .... how about this: we recheck the number in a week and also give the list to cogdill to compare against her english email lists. Then we ask DS to try manually merging the ones that overlap just for big english [18:21:55] ok - I will look at the conflicts & see what most of them are [18:22:26] eileen1: I'm going to update the task with all this. [18:22:34] I just checked & this one needs a fix [18:22:35] https://gerrit.wikimedia.org/r/#/c/312182/ [18:22:51] deploying this will probably improve out kill rate on the remaining ones [18:25:24] oh also.. eileen1 I realized that your last comment on the task was from last week... so that means everything in the DB has already been touched by at least 1 script already... [18:25:44] well yeah - but one of the scripts was a bit more restrictive [18:26:09] ie it's still catching them when it runs through - but at a slower rate [18:28:33] We should try to get the list of duplicate email addresses and get cogdill to compare them this week and see what kind of overlap there is [18:28:44] I'll add that to the task too. [18:29:48] overlap with ? her email list? [18:29:55] (PS2) Eileen: Resolve conflicts on preferred language. [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/312182 (https://phabricator.wikimedia.org/T146344) [18:30:07] I'll take a look at that eileen1 [18:30:58] ejegg: thanks [18:31:07] it had a merge conflict [18:32:30] MBeat: quick question - the CNT is the contact id isn't it? https://gerrit.wikimedia.org/r/#/c/312952/ [18:32:50] Fundraising Sprint Stirring The Pot, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM, Spike: SPIKE: investigate level of completeness of civi deduped DB - https://phabricator.wikimedia.org/T146384#2709937 (DStrine) From our meeting today: Eileen ran this query: SELECT count(DISTINCT e.email)... [18:33:07] cnt & cid are same from my perspective [18:33:09] contact and contribution have too many letters in common... [18:33:27] eileen1: rosie and leanne are in the room with me to talk other civi things. Can we switch over to gchat? [18:33:28] dstrine: I don't think it's worth me fighting connection to join hangout with leanne & rosie :-( [18:33:35] ok I can do chat [18:33:36] lol [18:34:04] actually I might do better now because most people are eating (off the network) [18:35:24] (CR) Ejegg: [C: 2] Resolve conflicts on preferred language. [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/312182 (https://phabricator.wikimedia.org/T146344) (owner: Eileen) [18:35:29] how do I join in on chat? [18:35:44] rebooting for kernel update... [18:36:30] (CR) Eileen: "Yep Michael says CNT = cid (which I also recalled from using them in the urls to load a contact)" (1 comment) [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/312952 (https://phabricator.wikimedia.org/T137496) (owner: Eileen) [18:37:59] dstrine: I think I've joined but it seems very quiet [18:38:29] (Merged) jenkins-bot: Resolve conflicts on preferred language. [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/312182 (https://phabricator.wikimedia.org/T146344) (owner: Eileen) [18:48:36] fundraising-tech-ops: replace pay-lvs1001 & pay-lvs1002 with new hardware running jessie - https://phabricator.wikimedia.org/T145103#2710060 (Jgreen) [18:48:38] fundraising-tech-ops, Operations, ops-eqiad: Rack/Setup pay-lvs1003 and pay-lvs1004 - https://phabricator.wikimedia.org/T143900#2710059 (Jgreen) Open>Resolved [18:49:10] fundraising-tech-ops: replace pay-lvs1001 & pay-lvs1002 with new hardware running jessie - https://phabricator.wikimedia.org/T145103#2620156 (Jgreen) pay-lvs1002 is done, replaced by the box that was formerly pay-lvs1004 [18:49:14] fundraising-tech-ops: frack eqiad hardware refresh - https://phabricator.wikimedia.org/T133524#2710079 (Jgreen) [18:49:16] fundraising-tech-ops: replace pay-lvs1001 & pay-lvs1002 with new hardware running jessie - https://phabricator.wikimedia.org/T145103#2710078 (Jgreen) Open>Resolved [18:51:19] fundraising-tech-ops, Operations, ops-eqiad: pay-lvs1003/pay-lvs1004 hardware swap for pay-lvs1001/pay-lvs1002 - https://phabricator.wikimedia.org/T147932#2710088 (Jgreen) [18:54:22] ejegg: I think this can be merged https://gerrit.wikimedia.org/r/#/c/312952/ [18:54:46] eileen1: yep, looks good [18:55:01] cool [18:56:52] (PS5) Ejegg: Update backoffice message template to allow receipt resends. [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/312952 (https://phabricator.wikimedia.org/T137496) (owner: Eileen) [18:57:02] (CR) Ejegg: [C: 2] Update backoffice message template to allow receipt resends. [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/312952 (https://phabricator.wikimedia.org/T137496) (owner: Eileen) [19:00:23] (Merged) jenkins-bot: Update backoffice message template to allow receipt resends. [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/312952 (https://phabricator.wikimedia.org/T137496) (owner: Eileen) [19:01:39] (CR) Ejegg: [C: 2] Some logging in PP listener [wikimedia/fundraising/SmashPig] - https://gerrit.wikimedia.org/r/315336 (owner: Cdentinger) [19:02:45] (Merged) jenkins-bot: Some logging in PP listener [wikimedia/fundraising/SmashPig] - https://gerrit.wikimedia.org/r/315336 (owner: Cdentinger) [19:04:13] ejegg: are there any deployments anytime soon? I'll leave those changes to get swept up if code is otherwise going out soonish [19:04:39] eileen1: yeah, I was thinking of updating some libraries today [19:04:45] thanks for the reminder! [19:05:05] ejegg: cool I'll leave it to get caught up - if you remember run the drush updb when you do [19:07:32] Fundraising Sprint Stirring The Pot, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM, Spike: SPIKE: investigate level of completeness of civi deduped DB - https://phabricator.wikimedia.org/T146384#2710174 (CCogdill_WMF) @Dstrine cool, so you recommend exporting the list from that query (removi... [19:10:11] since we have a meeting free afternoon i'm going to flex some time and work on a project at the studio. we have to be here full time next week. i will make it up this evening :) [19:17:34] (PS1) Ejegg: Update DonationInterface library [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/315552 [19:19:32] (CR) Ejegg: [C: 2] "self-merging library update" [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/315552 (owner: Ejegg) [19:22:32] (Merged) jenkins-bot: Update DonationInterface library [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/315552 (owner: Ejegg) [19:29:26] (PS1) Ejegg: Update DonationInterface library [wikimedia/fundraising/crm/vendor] - https://gerrit.wikimedia.org/r/315555 [19:30:14] (CR) Ejegg: [C: 2 V: 2] Update DonationInterface library [wikimedia/fundraising/crm/vendor] - https://gerrit.wikimedia.org/r/315555 (owner: Ejegg) [19:31:09] (PS1) Ejegg: Merge branch 'master' into deployment [wikimedia/fundraising/crm] (deployment) - https://gerrit.wikimedia.org/r/315556 [19:31:16] (CR) Ejegg: [C: 2] Merge branch 'master' into deployment [wikimedia/fundraising/crm] (deployment) - https://gerrit.wikimedia.org/r/315556 (owner: Ejegg) [19:37:19] (Merged) jenkins-bot: Merge branch 'master' into deployment [wikimedia/fundraising/crm] (deployment) - https://gerrit.wikimedia.org/r/315556 (owner: Ejegg) [19:38:34] log updated CiviCRM from 8682821cb591b2861aee1fd167157a1b7aa27abd to 3b76de564aef4dad7807be2d3e570dec38696227 [19:41:00] Fundraising Sprint Octopus Untangling, Fundraising Sprint Pretending This Isn't Happening, Fundraising Sprint Qwerty Thwacking, Fundraising Sprint Rocket Surgery 2016, and 5 others: Decimal dates are breaking our queue consumer - https://phabricator.wikimedia.org/T140667#2710358 (Ejegg) Open>... [19:41:52] Fundraising Sprint Stirring The Pot, Fundraising-Backlog, FR-ActiveMQ, FR-Paypal, and 2 others: Paypal audit messages missing source fields in Redis - https://phabricator.wikimedia.org/T147341#2710365 (Ejegg) Open>Resolved [19:43:11] Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM: Changed Disc Income Decile Labels on Prospect Tab in Civi - https://phabricator.wikimedia.org/T147965#2710369 (RLewis) [19:44:44] battery dying, gonna relocate [19:49:15] Fundraising Sprint Stirring The Pot, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM, Spike: SPIKE: investigate level of completeness of civi deduped DB - https://phabricator.wikimedia.org/T146384#2710404 (Eileenmcnaughton) @CCogdill_WMF I couldn't get that query to run all in one now we have... [20:08:59] (PS5) Ejegg: Remove pre-1.25 API compatibility code [extensions/CentralNotice] - https://gerrit.wikimedia.org/r/311776 (owner: Anomie) [20:09:20] (CR) Ejegg: [C: 2] "Thanks Anomie!" [extensions/CentralNotice] - https://gerrit.wikimedia.org/r/311776 (owner: Anomie) [20:10:54] (Merged) jenkins-bot: Remove pre-1.25 API compatibility code [extensions/CentralNotice] - https://gerrit.wikimedia.org/r/311776 (owner: Anomie) [20:11:03] Fundraising Sprint Stirring The Pot, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM, Spike: SPIKE: investigate level of completeness of civi deduped DB - https://phabricator.wikimedia.org/T146384#2710478 (DStrine) >>! In T146384#2710174, @CCogdill_WMF wrote: > @Dstrine cool, so you recommend... [20:16:31] Fundraising Sprint Rocket Surgery 2016, Fundraising Sprint Stirring The Pot, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM, Patch-For-Review: Receipt/Thank you letters from Civi - Fix template? - https://phabricator.wikimedia.org/T137496#2710483 (Ejegg) Open>Resolved Deployed and... [20:18:55] Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM: Customized Communications Preference field is not working correctly in Civi - https://phabricator.wikimedia.org/T146096#2650601 (DStrine) [20:19:41] Fundraising-Backlog: MARKER for reviewing sprint 3 - https://phabricator.wikimedia.org/T147489#2710510 (DStrine) Open>Invalid [20:23:54] Fundraising Sprint Rocket Surgery 2016, Fundraising Sprint Stirring The Pot, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM, Patch-For-Review: Receipt/Thank you letters from Civi - Fix template? - https://phabricator.wikimedia.org/T137496#2710540 (Eileenmcnaughton) Resolved>Open T... [20:24:31] Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM: Option to specify primary address on merge - https://phabricator.wikimedia.org/T146941#2710545 (DStrine) [20:28:57] (PS1) Ejegg: Merge branch 'master' into deployment [extensions/DonationInterface] (deployment) - https://gerrit.wikimedia.org/r/315566 [20:29:16] (CR) Ejegg: [C: 2] Merge branch 'master' into deployment [extensions/DonationInterface] (deployment) - https://gerrit.wikimedia.org/r/315566 (owner: Ejegg) [20:31:01] Fundraising Sprint Rocket Surgery 2016, Fundraising Sprint Stirring The Pot, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM, Patch-For-Review: Receipt/Thank you letters from Civi - Fix template? - https://phabricator.wikimedia.org/T137496#2710579 (MBeat33) Really fantastic news, thank you... [20:32:46] Fundraising Sprint Rocket Surgery 2016, Fundraising Sprint Stirring The Pot, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM, Patch-For-Review: Receipt/Thank you letters from Civi - Fix template? - https://phabricator.wikimedia.org/T137496#2710580 (LeanneS) @Ejegg and @Eileenmcnaughton th... [20:36:26] (Merged) jenkins-bot: Merge branch 'master' into deployment [extensions/DonationInterface] (deployment) - https://gerrit.wikimedia.org/r/315566 (owner: Ejegg) [20:42:15] (PS1) Ejegg: Merge branch 'master' into deployment [wikimedia/fundraising/SmashPig] (deployment) - https://gerrit.wikimedia.org/r/315569 [20:42:30] OK, I'm going to try to deploy this Adyen jobs thing! [20:43:46] My plan is to deploy to the listener first, run any remaining jobs, then deploy to the job runner host [20:43:57] sweet [20:46:31] (CR) Ejegg: [C: 2] Merge branch 'master' into deployment [wikimedia/fundraising/SmashPig] (deployment) - https://gerrit.wikimedia.org/r/315569 (owner: Ejegg) [20:46:43] (Merged) jenkins-bot: Merge branch 'master' into deployment [wikimedia/fundraising/SmashPig] (deployment) - https://gerrit.wikimedia.org/r/315569 (owner: Ejegg) [20:48:41] Fundraising Sprint Rocket Surgery 2016, Fundraising Sprint Stirring The Pot, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM, Patch-For-Review: Receipt/Thank you letters from Civi - Fix template? - https://phabricator.wikimedia.org/T137496#2710604 (RLewis) Thanks for deploying this, such g... [20:48:50] !log updated SmashPig on listener host from fa0267b6f23505d835fd1557a82c2ea99a6985d8 to 94c7f0d45cb42b8b7dced341e4dea920473991b0 [20:48:58] Logged the message at https://wikitech.wikimedia.org/wiki/Server_Admin_Log, Master [20:48:58] woot, we have paypal logging! [20:57:35] !log updated SmashPig on all hosts from fa0267b6f23505d835fd1557a82c2ea99a6985d8 to 94c7f0d45cb42b8b7dced341e4dea920473991b0 [20:57:37] holler [20:57:42] Logged the message at https://wikitech.wikimedia.org/wiki/Server_Admin_Log, Master [20:57:44] and no fail mail yet [21:01:18] looking good! [21:01:26] Fundraising Sprint Stirring The Pot, Fundraising-Backlog, FR-Adyen, FR-2016-17-Q2-Campaign-Support, Unplanned-Sprint-Work: Adyen GB form not loading correctly - https://phabricator.wikimedia.org/T147475#2710630 (DStrine) [21:01:27] ran the capture job successfully [21:01:44] sweet [21:01:46] let's see about recording it [21:02:24] pending queue hmmm [21:02:37] ack [21:03:17] !log disabled pending queue consumer [21:03:26] Logged the message at https://wikitech.wikimedia.org/wiki/Server_Admin_Log, Master [21:04:03] grr, failed to execute, but why? [21:07:59] d'oh, wrong errorInfo [21:10:15] (PS1) Ejegg: Fix DB error logging [wikimedia/fundraising/SmashPig] - https://gerrit.wikimedia.org/r/315573 [21:10:27] fr-tech CR? ^^^ [21:12:33] or... I can just roll back that one pending / payments_init patch [21:12:52] shouldn't leave that consumer off for long [21:13:26] (CR) Cdentinger: [C: 2] Fix DB error logging [wikimedia/fundraising/SmashPig] - https://gerrit.wikimedia.org/r/315573 (owner: Ejegg) [21:13:39] thanks cwd! [21:14:32] (Merged) jenkins-bot: Fix DB error logging [wikimedia/fundraising/SmashPig] - https://gerrit.wikimedia.org/r/315573 (owner: Ejegg) [21:14:46] (PS1) Ejegg: Merge branch 'master' into deployment [wikimedia/fundraising/SmashPig] (deployment) - https://gerrit.wikimedia.org/r/315574 [21:15:04] (CR) Ejegg: [C: 2] Merge branch 'master' into deployment [wikimedia/fundraising/SmashPig] (deployment) - https://gerrit.wikimedia.org/r/315574 (owner: Ejegg) [21:18:24] (CR) Ejegg: [V: 2] Merge branch 'master' into deployment [wikimedia/fundraising/SmashPig] (deployment) - https://gerrit.wikimedia.org/r/315574 (owner: Ejegg) [21:20:18] !log updated SmashPig from 94c7f0d45cb42b8b7dced341e4dea920473991b0 to 00772cd5c821ad11267bd9355cc24160756361bf [21:20:27] Logged the message at https://wikitech.wikimedia.org/wiki/Server_Admin_Log, Master [21:22:04] ah dang, it's using the wrong db for some reason [21:22:19] will revert that one change for now [21:23:19] eileen: dstrine: Sorry, I missed the dedupe conversation earlier, but I wanted to ask--Once a contact has been deduped, that includes all occurrences of their email even up to the present day, right? If so, it would be possible to cut lists of contacts that we know are deduped and just omit anyone with exactly 1 contribution, for example. [21:24:22] (PS1) Ejegg: Revert "Check payments_init for 'failed' in pending QC" [wikimedia/fundraising/SmashPig] (deployment) - https://gerrit.wikimedia.org/r/315576 [21:24:41] (CR) Ejegg: [C: 2 V: 2] Revert "Check payments_init for 'failed' in pending QC" [wikimedia/fundraising/SmashPig] (deployment) - https://gerrit.wikimedia.org/r/315576 (owner: Ejegg) [21:24:52] (Merged) jenkins-bot: Revert "Check payments_init for 'failed' in pending QC" [wikimedia/fundraising/SmashPig] (deployment) - https://gerrit.wikimedia.org/r/315576 (owner: Ejegg) [21:25:06] awight: no - it might not be all emails :-( if one has a conflict [21:25:39] I do think we can get a bunch more to merge [21:29:03] !log updated SmashPig from 00772cd5c821ad11267bd9355cc24160756361bf to ac6a0f04aad1b5519e8ee3a112dacf2a53efff30 [21:29:10] Logged the message at https://wikitech.wikimedia.org/wiki/Server_Admin_Log, Master [21:29:14] hum, k [21:29:26] Is there a query we can do for that, too? [21:30:00] We could include a flag in the bulk email export perhaps which shows that a contact is deduped and ready for fancy historical memory mailings [21:30:40] ah, phooey, i see [21:36:09] (PS1) Ejegg: Fix how we get queue for RequeueDelayedMessages [wikimedia/fundraising/SmashPig] - https://gerrit.wikimedia.org/r/315580 [21:37:17] ejegg: I can CR that one [21:37:23] thanks awight [21:37:35] could have fixed the settings, but... [21:38:44] (CR) Awight: [C: 2] "Youch, there seem to be more of those lurking beneath the whitecaps," [wikimedia/fundraising/SmashPig] - https://gerrit.wikimedia.org/r/315580 (owner: Ejegg) [21:39:16] oops, duplicate irc windows. brb. [21:41:03] (PS1) Ejegg: Merge branch 'master' into deployment [wikimedia/fundraising/SmashPig] (deployment) - https://gerrit.wikimedia.org/r/315581 [21:41:16] (CR) Ejegg: [C: 2] Merge branch 'master' into deployment [wikimedia/fundraising/SmashPig] (deployment) - https://gerrit.wikimedia.org/r/315581 (owner: Ejegg) [21:44:38] (Merged) jenkins-bot: Fix how we get queue for RequeueDelayedMessages [wikimedia/fundraising/SmashPig] - https://gerrit.wikimedia.org/r/315580 (owner: Ejegg) [21:45:52] Fundraising-Backlog, FR-Amazon, FR-Smashpig: Amazon donation order ids are being set incorrectly by the listener - https://phabricator.wikimedia.org/T147973#2710746 (Ejegg) [21:46:28] (CR) Ejegg: [V: 2] Merge branch 'master' into deployment [wikimedia/fundraising/SmashPig] (deployment) - https://gerrit.wikimedia.org/r/315581 (owner: Ejegg) [21:47:20] !log updated SmashPig from ac6a0f04aad1b5519e8ee3a112dacf2a53efff30 to 28ba033be2f50fc7837c788dc452753ff82284e1 [21:47:28] Logged the message at https://wikitech.wikimedia.org/wiki/Server_Admin_Log, Master [21:49:28] cool, seems stable. [21:49:38] relocating for shrimp [22:01:52] Be in srimp in one minute, having trouble with my headset. [22:13:51] question! CVirtue is trying to get an answer on how many contacts we have in Civi rounded to the nearest thousand [22:14:02] I’m guessing it’s a bad idea for me to run a count cause I’ll make Civi mad [22:14:15] … is that right? dstrine does this merit a phab task? [22:16:53] ccogdill: maybe a task to run the query by eileen ... I dunno what do you think eileen ? [22:18:17] mmkay we can make a task [22:18:19] I figured [22:23:06] Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM, FR-ActiveMQ, FR-Smashpig: Move misplaced messages from ActiveMQ to Redis - https://phabricator.wikimedia.org/T147982#2710934 (Ejegg) [22:23:25] Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM, FR-ActiveMQ, FR-Smashpig: Move misplaced messages from ActiveMQ to Redis - https://phabricator.wikimedia.org/T147982#2710948 (Ejegg) p:Triage>High [22:23:44] Fundraising-Backlog: How many contact records are in CiviCRM? - https://phabricator.wikimedia.org/T147983#2710950 (CaitVirtue) [22:24:05] Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM: How many contact records are in CiviCRM? - https://phabricator.wikimedia.org/T147983#2710968 (CaitVirtue) [22:24:25] Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM: How many contact records are in CiviCRM? - https://phabricator.wikimedia.org/T147983#2710950 (CaitVirtue) p:Triage>High [22:26:37] Fundraising Sprint Stirring The Pot, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM, Spike: SPIKE: investigate level of completeness of civi deduped DB - https://phabricator.wikimedia.org/T146384#2710984 (Eileenmcnaughton) @CCogdill_WMF I couldn't get that query to run all in one now we have... [22:27:06] ccogdill: dstrine I think this might be the answer https://phabricator.wikimedia.org/T146384#2709898 [22:27:38] ohhhhh [22:27:43] eileen the 16079136 figure? [22:27:47] :P that makes sense [22:28:02] Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM, FR-ActiveMQ, FR-Smashpig: Move misplaced messages from ActiveMQ to Redis - https://phabricator.wikimedia.org/T147982#2710994 (Ejegg) [22:28:34] ccogdill: that includes deleted [22:28:41] oh okay so the 11m one [22:28:45] yep [22:29:02] (deleted = merged) [22:29:13] cool [22:29:15] thank you! [22:29:46] no worries - did I tell you someone showed me photos of your presentation on their phone? [22:30:16] no! [22:30:18] that’s awesome [22:30:24] Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM: New fields added to the Prospect Tab in Civi - https://phabricator.wikimedia.org/T147985#2711012 (RLewis) [22:30:30] :-) [22:30:30] I saw a couple people snapping photos. always a nice compliment :) [22:30:53] yeah - people seemed to like it [22:31:15] Fundraising Sprint Pretending This Isn't Happening, Fundraising Sprint Qwerty Thwacking, Fundraising Sprint Rocket Surgery 2016, Fundraising Sprint Stirring The Pot, and 4 others: Donation import should merge and delete pending db info - https://phabricator.wikimedia.org/T141477#2711033 (Ejegg) ... [22:31:27] Fundraising Sprint Rocket Surgery 2016, Fundraising Sprint Stirring The Pot, Fundraising-Backlog, FR-ActiveMQ, Patch-For-Review: Migrate FundraisingEmailUnsubscribe to new queue backend - https://phabricator.wikimedia.org/T145419#2711035 (Ejegg) Open>Resolved [22:31:34] Fundraising-Backlog, FR-Adyen, MediaWiki-extensions-DonationInterface, Epic: [Epic] Create Adyen forms for CA, GB, AU, NZ and IE - https://phabricator.wikimedia.org/T138456#2711037 (XenoRyet) [22:34:11] Fundraising Sprint Hermit Crab Husbandry, Fundraising Sprint Internet Exploring, Fundraising Sprint Jabberwock Slaying, Fundraising Sprint Killing Time, and 16 others: [Epic] All pending producers should write to a single pending queue - https://phabricator.wikimedia.org/T133195#2711065 (Ejegg) ... [22:34:14] Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM, FR-ActiveMQ, FR-Smashpig, and 4 others: [Epic] Consolidate "pending" queue usages - https://phabricator.wikimedia.org/T130897#2711066 (Ejegg) [22:34:18] Fundraising Sprint Stirring The Pot, Fundraising-Backlog, Unplanned-Sprint-Work: List the teams/system that could accidentally break us - https://phabricator.wikimedia.org/T147096#2711069 (DStrine) Open>declined [22:35:41] Fundraising Sprint Rocket Surgery 2016, Fundraising Sprint Stirring The Pot, Fundraising-Backlog, MediaWiki-extensions-CentralNotice, and 2 others: Banner not showing up on site - https://phabricator.wikimedia.org/T144952#2615300 (K4-713) @RobLa-WMF - Thanks for getting involved on this one. Look... [22:36:11] lkhjgkgdh [22:36:12] haha whoops... [22:36:15] one of those days [22:37:09] Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM, FR-ActiveMQ, FR-Smashpig, FR-2016-17-Q2-Bugs: Move misplaced messages from ActiveMQ to Redis - https://phabricator.wikimedia.org/T147982#2711085 (DStrine) [22:47:40] Fundraising-Backlog, FR-Ingenico, FR-2016-17-Q2-Bugs: Duplicate Ingenico iframe bug - https://phabricator.wikimedia.org/T143430#2567887 (DStrine) @spatton meow? [22:47:45] Fundraising Sprint Stirring The Pot, Fundraising-Backlog, FR-PayPal-ExpressCheckout, FR-Paypal: Renew PayPal API certificate. Due date: Aug 1st - https://phabricator.wikimedia.org/T136742#2711126 (cwdent) I have an email out to Matt at PP to see if there's another way to access this section, oth... [23:01:51] Fundraising Sprint Stirring The Pot, Fundraising-Backlog, FR-PayPal-ExpressCheckout, FR-Paypal: Renew PayPal API certificate. Due date: Aug 1st - https://phabricator.wikimedia.org/T136742#2711184 (cwdent) a:Ejegg>cwdent [23:05:30] Fundraising Sprint Testing on Production, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM: New fields added to the Prospect Tab in Civi - https://phabricator.wikimedia.org/T147985#2711205 (DStrine) [23:05:32] Fundraising Sprint Testing on Production, Fundraising-Backlog, FR-Amazon, FR-Smashpig: Amazon donation order ids are being set incorrectly by the listener - https://phabricator.wikimedia.org/T147973#2711207 (DStrine) [23:05:35] Fundraising Sprint Testing on Production, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM, MediaWiki-extensions-DonationInterface, FR-2016-17-Q2-Bugs: Missing ct_id on fredge messages from orphan rectifier - https://phabricator.wikimedia.org/T147873#2711209 (DStrine) [23:05:37] Fundraising Sprint Testing on Production, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM: Changed Disc Income Decile Labels on Prospect Tab in Civi - https://phabricator.wikimedia.org/T147965#2711208 (DStrine) [23:05:40] Fundraising Sprint Stirring The Pot, Fundraising Sprint Testing on Production, Fundraising-Backlog, MediaWiki-extensions-DonationInterface, and 3 others: Show contribution tracking ID in error messages as 'Reference #' - https://phabricator.wikimedia.org/T147679#2711210 (DStrine) [23:05:42] Fundraising Sprint Testing on Production, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM: Civi: restore the 'unsubscribe from spam' option to Main menu - https://phabricator.wikimedia.org/T147571#2711211 (DStrine) [23:05:44] Fundraising Sprint Stirring The Pot, Fundraising Sprint Testing on Production, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM, and 2 others: Missing "gross" and "currency"; positive amount; failmails from donations queue consumer - https://phabricator.wikimedia.org/T147491#2711213 (DStrine) [23:05:46] Fundraising Sprint Stirring The Pot, Fundraising Sprint Testing on Production, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM, and 4 others: New failmail from recurring queue consumer - https://phabricator.wikimedia.org/T147487#2711214 (DStrine) [23:05:48] Fundraising Sprint Testing on Production, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM, FR-2016-17-Q2-Bugs: Generic Individuals Import Error - https://phabricator.wikimedia.org/T147521#2711212 (DStrine) [23:05:50] Fundraising Sprint Stirring The Pot, Fundraising Sprint Testing on Production, Fundraising-Backlog, FR-Adyen, and 2 others: Adyen GB form not loading correctly - https://phabricator.wikimedia.org/T147475#2711215 (DStrine) [23:05:52] Fundraising Sprint Stirring The Pot, Fundraising Sprint Testing on Production, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM, and 2 others: Merge conflict on source - https://phabricator.wikimedia.org/T146946#2711218 (DStrine) [23:05:54] Fundraising Sprint Stirring The Pot, Fundraising Sprint Testing on Production, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM, Spike: SPIKE: investigate level of completeness of civi deduped DB - https://phabricator.wikimedia.org/T146384#2711219 (DStrine) [23:05:56] Fundraising Sprint Stirring The Pot, Fundraising Sprint Testing on Production, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM, and 2 others: Resolve conflicts on preferred language - https://phabricator.wikimedia.org/T146344#2711220 (DStrine) [23:05:59] Fundraising Sprint Rocket Surgery 2016, Fundraising Sprint Stirring The Pot, Fundraising Sprint Testing on Production, Fundraising-Backlog, and 2 others: Orphan rectifier not sending to payments-initial nor payments-fraud queues - https://phabricator.wikimedia.org/T145848#2711222 (DStrine) [23:06:02] Fundraising Sprint Rocket Surgery 2016, Fundraising Sprint Stirring The Pot, Fundraising Sprint Testing on Production, Fundraising-Backlog, and 3 others: [Tracking] Stop producing to ActiveMQ - https://phabricator.wikimedia.org/T145660#2711223 (DStrine) [23:06:05] Fundraising Sprint Rocket Surgery 2016, Fundraising Sprint Stirring The Pot, Fundraising Sprint Testing on Production, Fundraising-Backlog, and 2 others: CentralNotice: Support MariaDB Strict Mode - https://phabricator.wikimedia.org/T145591#2711224 (DStrine) [23:06:08] Fundraising Sprint Qwerty Thwacking, Fundraising Sprint Rocket Surgery 2016, Fundraising Sprint Stirring The Pot, Fundraising Sprint Testing on Production, and 4 others: Investigate the discrepancy between pageview counts and banner impressions for ... - https://phabricator.wikimedia.org/T145565#2711225 [23:06:11] Fundraising Sprint Rocket Surgery 2016, Fundraising Sprint Stirring The Pot, Fundraising Sprint Testing on Production, Fundraising-Backlog, and 2 others: CN Campaign Setting oddities - https://phabricator.wikimedia.org/T145447#2711226 (DStrine) [23:06:14] Fundraising Sprint Rocket Surgery 2016, Fundraising Sprint Stirring The Pot, Fundraising Sprint Testing on Production, Fundraising-Backlog, MediaWiki-extensions-CentralNotice: Impressions slow to update on jaJP dsk campaign - https://phabricator.wikimedia.org/T145446#2711227 (DStrine) [23:06:16] Fundraising Sprint Rocket Surgery 2016, Fundraising Sprint Stirring The Pot, Fundraising Sprint Testing on Production, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM: Longterm fix + regression test for T144489 - https://phabricator.wikimedia.org/T144557#2711229 (DStrine) [23:06:25] Fundraising Sprint Testing on Production, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM, FR-2016-17-Q2-Campaign-Support: Not all online donations getting tagged to Restrictions and Gift Source Fields - https://phabricator.wikimedia.org/T138361#2711234 (DStrine) [23:06:25] Fundraising Sprint Rocket Surgery 2016, Fundraising Sprint Stirring The Pot, Fundraising Sprint Testing on Production, Fundraising-Backlog, and 2 others: Receipt/Thank you letters from Civi - Fix template? - https://phabricator.wikimedia.org/T137496#2711235 (DStrine) [23:06:27] Fundraising Sprint Asbestos Removal 2016, Fundraising Sprint Bloodletting 2016, Fundraising Sprint Testing on Production, Fundraising Sprint X-Ray Spex, and 7 others: [Epic] Do not show donation form error message: "No processors available". Fix UI ... - https://phabricator.wikimedia.org/T117872#2711237 [23:23:20] AndyRussG: could you give an estimate for this: https://phabricator.wikimedia.org/T146880 [23:29:28] gotta run, back in a bit [23:35:40] dstrine: I'd say a 4, though it might have been less if I'd been familiar with that corner of CN, which I should have been [23:35:51] shall I set the points? [23:40:01] Fundraising Sprint Muggle Baiting, Fundraising Sprint Nitpicking, Fundraising Sprint Octopus Untangling, Fundraising Sprint Pretending This Isn't Happening, and 8 others: Run the orphan rectifier job from CRM Jenkins - https://phabricator.wikimedia.org/T141487#2711412 (DStrine) [23:41:38] Fundraising Sprint Rocket Surgery 2016, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM, Unplanned-Sprint-Work: Not able to save activity edits - https://phabricator.wikimedia.org/T137740#2711418 (DStrine) [23:41:46] !log updated civicrm settings to revision a7c7919cf6ff7a4722e0f98aca90c43edfd3ac9c [23:41:54] Logged the message at https://wikitech.wikimedia.org/wiki/Server_Admin_Log, Master [23:42:10] Fundraising Sprint Rocket Surgery 2016, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM, Patch-For-Review, Unplanned-Sprint-Work: Issues manually merging records - https://phabricator.wikimedia.org/T144440#2711419 (DStrine) [23:42:52] Fundraising Sprint Rocket Surgery 2016, Fundraising-Backlog, FR-ActiveMQ, FR-Ingenico, and 3 others: New orphan rectifier balks on CVV="0" - https://phabricator.wikimedia.org/T145846#2711428 (DStrine) [23:43:24] Fundraising Sprint Qwerty Thwacking, Fundraising Sprint Rocket Surgery 2016, Fundraising-Backlog, MediaWiki-extensions-CentralNotice, Patch-For-Review: Banners not allocated correctly - https://phabricator.wikimedia.org/T144393#2711429 (DStrine)