[02:16:40] <awight>	 !log updated tools to livehack2: from 414644eafe4000418760ffe466fac68133be6109 to b54854fcdd7a272ca2af8475affa033517456d07
[02:27:33] <awight>	 !log is there anybody out there
[02:27:34] <wm-bot>	 Key was added
[02:27:40] <awight>	 harrrr
[02:32:11] <slander>	 #751: (AW) P-A:MH -- https://wikimedia.mingle.thoughtworks.com/projects/online_fundraiser/cards/751
[02:32:11] <slander>	 #751: (AW) NV:N -- https://wikimedia.mingle.thoughtworks.com/projects/online_fundraiser/cards/751
[02:32:11] <slander>	 #751: (AW) NV:(s -- https://wikimedia.mingle.thoughtworks.com/projects/online_fundraiser/cards/751
[02:32:11] <slander>	 #751: (AW) NV:N -- https://wikimedia.mingle.thoughtworks.com/projects/online_fundraiser/cards/751
[17:31:54] <grrrit-wm>	 (PS1) Adamw: No longer suppress thank-yous [wikimedia/fundraising/tools] - https://gerrit.wikimedia.org/r/104990
[17:34:40] <K4-713>	 awight: ...ah.
[17:34:48] <awight>	 K4-713: si
[17:34:58] <K4-713>	 About the ones that are already in there and suppressed...
[17:35:04] <K4-713>	 ...we should send those too.
[17:35:07] <awight>	 totally
[17:36:04] <grrrit-wm>	 (CR) Katie Horn: [C: 2 V: 2] No longer suppress thank-yous [wikimedia/fundraising/tools] - https://gerrit.wikimedia.org/r/104990 (owner: Adamw)
[17:36:41] <awight>	 There were quite a few.  btw, in the process of digging around re: possible QA box slurpage of queue messages, I realized that it's very difficult to discriminate which messages were injected by the audit script
[17:37:13] <awight>	 The only technique that hold any promise is to do something crazy and heuristic with the receive_date vs contribution_id
[17:38:45] <K4-713>	 ...
[17:38:57] <K4-713>	 Maybe we should think slightly bigger, here.
[17:39:09] <K4-713>	 And just get a feel for how many people need their tax receipts.
[17:39:33] <K4-713>	 Never mind if it's paypal or whatever.
[17:39:39] <awight>	 no kidding.
[17:40:03] <awight>	 the future solution is to mark contributions with the source metadata...
[17:40:07] <K4-713>	 yep
[17:40:10] <awight>	 but for now, check out this query...
[17:40:14] <K4-713>	 ...oh man.
[17:40:25] <awight>	 ....
[17:40:46] <K4-713>	 I'd *love* to be able to find out in one query, what percentage of transactions are saved by processes that should be safety nets.
[17:40:47] <awight>	 from card https://wikimedia.mingle.thoughtworks.com/projects/online_fundraiser/cards/1231
[17:41:05] <awight>	 select from_days(to_days(receive_date)) as day, count(*) as num, sum(thankyou_date < receive_date + interval 1 day)/count(*) as ty_ontime from civicrm_contribution where receive_date > '20131001' group by to_days(receive_date);
[17:41:09] <awight>	 also
[17:41:29] <awight>	 select from_days(to_days(receive_date)) as day, sum(thankyou_date < '19800000')/count(*) as not_thanked from civicrm_contribution where receive_date > '20131001' group by to_days(receive_date);
[17:42:25] * K4-713  squints

[17:43:36] <K4-713>	 awight: You want to try to shoehorn some source info into transactions while nobody is paying too much attention? :p
[17:46:49] <awight>	 K4-713: whew....
[17:47:06] <K4-713>	 ?
[17:47:44] <awight>	 It's super heuristic...
[17:48:02] <awight>	 I have to visually determine the id range for normal channels, ignoring outliers
[17:48:16] <awight>	 then find the block of ids corresponding to the audit glump
[17:48:25] <awight>	 ... a day at a time
[17:48:30] <K4-713>	 barf.
[17:48:37] <awight>	 which is not the biggest deal for paypal cos it's only been a week
[17:48:45] <awight>	 K4-713: yeah I can do that
[17:48:59] <awight>	 I'll be on the road for 3 or 4 hours but I can make it happen this week
[17:49:11] <K4-713>	 Great. I'll write up a card for that.
[17:49:19] <awight>	 bbrrrrrr
[17:49:27] <awight>	 as Marisa says
[17:49:33] <K4-713>	 haha
[17:50:06] <K4-713>	 And, yeah: Let's approach thanking the unthanked people as a system-wide thing that isn't contained to paypal late audit data.
[17:50:12] <K4-713>	 Probably easier.
[17:50:13] <K4-713>	 ...probably.
[17:50:34] <awight>	 yep.  numbers from the above queries were pretty high.  like, 2-15%
[17:50:40] <K4-713>	 guh
[17:50:55] <awight>	 K4-713: um, you are needed in JJ ;)
[17:50:59] <K4-713>	 We may need to be careful, though...
[17:51:43] <awight>	 btw i will definitely want to roll #920 into this task
[17:51:50] <K4-713>	 I believe there are things in the code that deliberately don't thank some people so Major Gifts can get to them.
[17:51:57] <awight>	 cos... I know we need more than one status for what you just said
[17:52:20] <K4-713>	 Unusually large donations... possibly other things I'm forgetting. But, if they go through the normal process, they should just fail to be thanked again.
[17:52:25] <K4-713>	 I think.
[17:54:39] <awight>	 K4-713: can I also ask you to keep the heat on the Amazon listener kettle?
[17:55:00] <K4-713>	 Sure. You blocked on anything?
[17:55:41] <awight>	 yeah the Amazon config knob does not work.  I've been emailing Pats about it, and I think she decided to wait until today to pass the buck
[17:56:28] <awight>	 Did I say Pats, I meant PPena ;)
[17:57:02] <PPena>	 awight hoi!
[17:57:02] <PPena>	 yeah
[17:57:08] <PPena>	 ok so traffic is down, right?
[17:57:21] <PPena>	 I will try to update it from here and open a ticket if not able to
[17:57:27] <PPena>	 deal?
[17:57:57] <awight>	 PPena: just... pls give me up-to-minute heads-up when you are about to enable
[17:58:26] <PPena>	 yes sir
[17:58:26] <PPena>	 will be in 10 mins
[17:58:29] <PPena>	 i will ping u
[17:58:46] <awight>	 PPena: woot!
[18:00:45] <K4-713>	 Today is already a good day.
[18:00:53] * K4-713  tries not to ruin everything

[18:08:55] <PPena>	 awight oi
[18:09:00] <PPena>	 awight about to try it
[18:09:07] <awight>	 PPena: I'm buckled up!
[18:09:10] <PPena>	 awight roger?
[18:09:18] <PPena>	 awight cool
[18:09:35] <awight>	 hehe, though I'm expecting it to crash on you
[18:09:45] <PPena>	 awight :(
[18:10:01] <PPena>	 party pooper
[18:10:01] <PPena>	 will open a ticker
[18:10:13] <awight>	 oh it crashed?
[18:10:32] <PPena>	 awight any specific email u guys use for amazon tech?
[18:10:48] <awight>	 checking inbox...
[18:11:42] <PPena>	 :(
[18:12:11] <PPena>	 awight will try from the help! inside de acc first and cc business dev
[18:13:43] <awight>	 looks like we don't email them that often ;)
[18:16:37] <awight>	 PPena: you wrote them at fps-am-assist@amazon.com once, that seemed to work
[18:23:16] <PPena>	 cool
[18:27:06] <slander>	 #1275: (K) Tech Task #1275 Post Big English Cleanup of payments.error log: -- https://wikimedia.mingle.thoughtworks.com/projects/online_fundraiser/cards/1275
[18:57:05] <K4-713>	 awight: I made this for you. https://wikimedia.mingle.thoughtworks.com/projects/online_fundraiser/cards/1276
[18:57:06] <slander>	 #1276: (K) Tech Supertask #1276 Add "transaction source" metadata to civicrm transactions: T:TS Description changed -- https://wikimedia.mingle.thoughtworks.com/projects/online_fundraiser/cards/1276
[18:59:05] <slander>	 #1276: (K) BG:#Maef|BC:#Iit -- https://wikimedia.mingle.thoughtworks.com/projects/online_fundraiser/cards/1276
[19:11:06] <slander>	 #1277: (K) Tech Task #1277 Design and document new transaction message format that includes source data: O:K|TS:B|P:SH|TT:D|NT:Y|NV:Y|IU:N|BG:#Maef|BC:#Iit|G-TS:#A|T:TT Description changed -- https://wikimedia.mingle.thoughtworks.com/projects/online_fundraiser/cards/1277
[19:13:06] <slander>	 #1276: (K) Description changed -- https://wikimedia.mingle.thoughtworks.com/projects/online_fundraiser/cards/1276
[19:16:05] <slander>	 #1278: (K) Tech Task #1278 Add new transaction source data columns to civicrm: O:K|TS:B|P:SH|TT:CT|NT:Y|NV:Y|IU:N|T:TT Description changed -- https://wikimedia.mingle.thoughtworks.com/projects/online_fundraiser/cards/1278
[19:16:06] <slander>	 #1278: (K) BG:#Maef|BC:#Iit|G-TS:#A -- https://wikimedia.mingle.thoughtworks.com/projects/online_fundraiser/cards/1278
[19:18:05] <slander>	 #1279: (K) Tech Task #1279 Ensure that all "damaged message" movement functionality respects the original transaction source meta.: O:K|TS:B|P:SH|TT:CT|NT:Y|NV:Y|IU:N|T:TT Description changed -- https://wikimedia.mingle.thoughtworks.com/projects/online_fundraiser/cards/1279
[19:18:06] <slander>	 #1279: (K) BG:#Maef|BC:#Iit|G-TS:#A -- https://wikimedia.mingle.thoughtworks.com/projects/online_fundraiser/cards/1279
[19:20:05] <slander>	 #1280: (K) Tech Task #1280 Alter the queue consumer for initial consumption of transaction source data: O:K|TS:B|P:SH|TT:CT|NT:Y|NV:Y|IU:N|BG:#Maef|BC:#Iit|G-TS:#A|T:TT Description changed -- https://wikimedia.mingle.thoughtworks.com/projects/online_fundraiser/cards/1280
[19:29:19] <awight>	 K4-713: something I'm adding to #1276: job-id
[19:30:17] <awight>	 K4-713: you said "process migrations"
[19:30:19] <awight>	 ;)
[19:30:37] <awight>	 I like
[19:39:38] <awight>	 I even like that you went into explode-on-dots, as if that has not been the condition of my head for months now
[19:45:49] <K4-713>	 baha
[19:45:59] <K4-713>	 I'm still adding tasks to the super.
[20:08:47] <awight>	 K4|lunchmeeting: yeah we need some front-line subtasks such as #1269
[20:09:14] <awight>	 Good call on #1279, btw
[22:43:05] <slander>	 #1281: (K) Tech Task #1281 DonationInterface: Alter queue message generation to include transaction source data: O:K|TS:B|P:SH|TT:CT|NT:Y|NV:Y|IU:N|TA:DI|BG:#Maef|BC:#Iit|G-TS:#A|T:TT Description changed -- https://wikimedia.mingle.thoughtworks.com/projects/online_fundraiser/cards/1281
[22:48:06] <slander>	 #1282: (K) Tech Task #1282 ALL Payments Listeners: Alter queue message generation to include transaction source data: O:K|TS:B|P:SH|TT:CT|NT:Y|NV:Y|IU:N|TA:PL|BG:#Maef|BC:#Iit|G-TS:#A|T:TT Description changed -- https://wikimedia.mingle.thoughtworks.com/projects/online_fundraiser/cards/1282