[00:01:52] (Merged) jenkins-bot: Check contact_hash if contact_id exists [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/383260 (https://phabricator.wikimedia.org/T177663) (owner: Ejegg) [00:19:10] does anyone have an opinion on my semantics issue (in comment on https://gerrit.wikimedia.org/r/#/c/384906/ ) [00:21:40] (PS2) Eileen: WIP Switch Omnimail job progress tracking to it's own table. [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/384906 (https://phabricator.wikimedia.org/T177451) [00:27:43] (CR) jerkins-bot: [V: -1] WIP Switch Omnimail job progress tracking to it's own table. [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/384906 (https://phabricator.wikimedia.org/T177451) (owner: Eileen) [05:07:00] (CR) XenoRyet: [C: 2] Check for duplicate subscr_cancel [wikimedia/fundraising/tools] - https://gerrit.wikimedia.org/r/381292 (owner: Ejegg) [05:07:02] (Merged) jenkins-bot: Check for duplicate subscr_cancel [wikimedia/fundraising/tools] - https://gerrit.wikimedia.org/r/381292 (owner: Ejegg) [05:16:03] (PS3) Eileen: Switch Omnimail job progress tracking to it's own table. [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/384906 (https://phabricator.wikimedia.org/T177451) [07:38:19] (PS1) Eileen: Test consolidation in prep for switching away from setting [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/384936 (https://phabricator.wikimedia.org/T177451) [07:42:12] (CR) jerkins-bot: [V: -1] Test consolidation in prep for switching away from setting [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/384936 (https://phabricator.wikimedia.org/T177451) (owner: Eileen) [07:46:07] (PS1) Eileen: CRM-21324 - Support 'null' on date fields in the api [wikimedia/fundraising/crm/civicrm] - https://gerrit.wikimedia.org/r/384940 (https://phabricator.wikimedia.org/T177451) [07:53:26] (PS2) Eileen: Test consolidation in prep for switching away from setting [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/384936 (https://phabricator.wikimedia.org/T177451) [07:57:15] (CR) jerkins-bot: [V: -1] Test consolidation in prep for switching away from setting [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/384936 (https://phabricator.wikimedia.org/T177451) (owner: Eileen) [08:10:26] (PS3) Eileen: Test consolidation in prep for switching away from setting [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/384936 (https://phabricator.wikimedia.org/T177451) [08:12:26] (PS4) Eileen: Switch Omnimail job progress tracking to it's own table. [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/384906 (https://phabricator.wikimedia.org/T177451) [08:58:48] Wikimedia-Fundraising-Campaigns (FY Q1 Jul-Sep 2017), Wikimedia-CentralNotice-Administration (Q3-2017): WMF Fundraising 2017-18 - Brazil (16 August - 30 August, 2 October - 16 October) - https://phabricator.wikimedia.org/T170252#3693002 (Pcoombe) Open>Resolved [08:58:57] Wikimedia-Fundraising-Campaigns (FY Q1 Jul-Sep 2017), Wikimedia-CentralNotice-Administration (Q3-2017): WMF Fundraising 2017-18 - Belgium (19 September - 17 October) - https://phabricator.wikimedia.org/T170256#3693003 (Pcoombe) Open>Resolved [09:01:41] Wikimedia-Fundraising-Campaigns (FY Q2 Oct-Dec 2017), Wikimedia-CentralNotice-Administration (Q4-2017): WMF Fundraising 2017-18 - Big English banners - https://phabricator.wikimedia.org/T170260#3693005 (Pcoombe) [09:09:36] (PS1) Eileen: Switch to using a table to track omnimail job progress [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/384953 (https://phabricator.wikimedia.org/T177451) [09:13:23] (CR) jerkins-bot: [V: -1] Switch to using a table to track omnimail job progress [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/384953 (https://phabricator.wikimedia.org/T177451) (owner: Eileen) [09:23:37] (CR) Eileen: "depends on https://gerrit.wikimedia.org/r/#/c/384940/" [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/384953 (https://phabricator.wikimedia.org/T177451) (owner: Eileen) [13:08:07] Fundraising Sprint Synchronized Screaming, Fundraising Sprint turtles that are robotic that destroy the whole world with their foot, Fundraising-Backlog, Unplanned-Sprint-Work: donatewiki_counts and banner impressions missing in pgehres database - https://phabricator.wikimedia.org/T177331#3693707 (... [14:25:22] (CR) Mepps: [C: 2] "Looks good! Small typo in weird but since it's in the comments it doesn't affect functionality." [wikimedia/fundraising/crm/civicrm] - https://gerrit.wikimedia.org/r/384940 (https://phabricator.wikimedia.org/T177451) (owner: Eileen) [14:29:15] (Merged) jenkins-bot: CRM-21324 - Support 'null' on date fields in the api [wikimedia/fundraising/crm/civicrm] - https://gerrit.wikimedia.org/r/384940 (https://phabricator.wikimedia.org/T177451) (owner: Eileen) [14:33:49] hi jgleeson! [14:59:15] fr-tech: https://phabricator.wikimedia.org/T177331#3693707 :( [14:59:29] Sorry to start the day with a sad emoji! [14:59:34] Morning, btw :) [14:59:52] AndyRussG want to talk out the impressions issues? [15:00:44] Fundraising-Backlog, FR-Smashpig: Write Ganglia monitors for SmashPig database things - https://phabricator.wikimedia.org/T162946#3180988 (Dzahn) This should probably be renamed to "add SmashPig database things to grafana"? [15:11:36] mepps: sure... [15:12:33] I'm volunteering as a rubber duck :)--want ot chat on irc or in queenmary? [15:13:06] mepps: either one! [15:13:51] mepps: I don't have much in the way of dilemmas about it right now, BTW... But maybe explaining more details will shed some new light [15:14:13] AndyRussG do you feel like you know what steps are needed to fix it? [15:14:21] what do you mean no current dilemmas? [15:14:43] Well, the bits that I've worked on and know about are working fine [15:15:35] So basically after the call to beacon/impression, the data goes several paths to get to us [15:16:02] what are those paths? [15:16:07] One path is the old path that is breaking, but that everyone relies on [15:16:29] what is that path? [15:16:30] That's through a thing called Kafka and Kafkatee [15:17:17] I don't know really much about that pipeline, other than it creates files on one of our servers with the impression data, nearly in real-time, at a sample rate of 1:10 [15:17:48] And then it gets slurped into the old pgehres database by a python program [15:18:02] So I know about the python program that slurps [15:18:21] But the issue is further up along the pipeline [15:19:27] The same pipeline is used to get click tracking data from e-mails [15:19:37] That's why e-mails have also been an issue [15:20:08] For impression data (and also e-mail click data, I assume) there is another route that the data also goes [15:20:48] Into a thing called "Hive" and "Hadoop" (I think both components of the same system), a mass data store with a nice query interface, where all of our weblogs go and are queriable [15:21:28] who knows whats going on there? where is the code that handles that stored? [15:21:33] We can get all the same data there, but queries are slow and not part of the FR-Online workflow [15:22:48] (and then Druid is the even newer system that is fed by data from Hive, and allows immediate queries, but on a limited number of parameters, also not part of the FR-Online workflow, but a candidate perhaps for eventually replacing the current workflow, though definitely not just now) [15:23:17] mepps: you mean the bit that's breaking? Jeff_Green and cwd know more, and so do folks from analytics [15:23:48] jeff says it does not at this point look like the same problem [15:23:58] I guess there's at some point some kind of interface between what fr-tech ops work with and what analytics works with [15:25:55] Jeff_Green: aaarg hmmm... Maybe the issue was just lag then? [15:25:56] although hadoop is always a couple hours behind so if this is a very new glitch we won't be able to see it in the comparison until later today [15:26:23] AndyRussG: could be? I'd have to know more about what window of time she's looking at [15:26:24] Jeff_Green could those couple hours cause what ccogdill saw? [15:26:33] could be, let's find out [15:28:04] would she be looking at data from donate.wm.o or from the beaconimpressions stuff? I don't have a great method for looking for loss on the latter since that's complicated by the 1:10 sampling [15:29:25] hummm dunno.... [15:29:31] ejegg: morning!! :) ^ [15:29:36] Fundraising Sprint Synchronized Screaming, Fundraising Sprint turtles that are robotic that destroy the whole world with their foot, Fundraising-Backlog, Unplanned-Sprint-Work: donatewiki_counts and banner impressions missing in pgehres database - https://phabricator.wikimedia.org/T177331#3694234 (... [15:30:35] Fundraising Sprint Synchronized Screaming, Fundraising Sprint turtles that are robotic that destroy the whole world with their foot, Fundraising-Backlog, Unplanned-Sprint-Work: donatewiki_counts and banner impressions missing in pgehres database - https://phabricator.wikimedia.org/T177331#3694236 (... [15:32:47] AndyRussG: hello! [15:32:52] :) [15:33:35] Jeff_Green: in her comment she mentions utm_source LIKE 'sp5155%". I guess I was assuming that's for e-mails, but really I have no idea [15:33:40] hmm, let's see [15:33:47] hi jgleeson! [15:33:48] Jeff_Green: Caitlin was looking at donatewiki landing page counts. I've not had chance to look at banner impressions in detail yet. [15:34:49] dstrine: sure, in firefox or chrome. [15:35:04] I don't have safari available, and that's the browser we'd be changing things for [15:35:12] pcoombe: ok cool, so that should be covered by the hive comparison I did, assuming the data has made it to hive already [15:35:32] ejegg: do you have a link I could use? [15:35:39] sure! [15:35:41] or would this all be local? [15:35:46] ok cool [15:35:50] nope, I can give you a prod link [15:35:55] cool and thanks [15:36:25] ejegg: if by chance you'd like Safari testing, we have SauceLabs, works nice-ish [15:36:54] oh right, the logins would be on officewiki I guess? [15:38:04] ejegg: hmm dunno, I have an account associated with my WMF e-mail address. I think maybe register w/ your work e-mail and then ask on #wikimedia-releng? If it's not fast, lmk and I can test, or just send you my creds, whichever u prefer :) [15:38:25] Or heh maybe there is somehting on officwiki [15:38:26] ok, cool. looks like dstrine can take a safari screenshot for right now [15:38:33] Ah cool :) [15:39:03] oh yeah, says 'Create your own free OSS account' [15:41:45] Ah cool! [15:42:08] hmm, not obvious how to do that in the saucelabs account settings tho [15:42:34] ejegg: there is a bit of a song and dance you have to do to get dev tools on an i-device... it's doable tho [15:43:26] ejegg: hmm so I'm not sure how to use that link to get the adyen page. If I have cookies enabled, I get the iframe. If I turn cookies off, I get the bug from T176913. I don't know how to get the full adyen page cause we haven't implemented your suggested change. [15:43:27] Fundraising Sprint Synchronized Screaming, Fundraising Sprint turtles that are robotic that destroy the whole world with their foot, Fundraising-Backlog, Unplanned-Sprint-Work: donatewiki_counts and banner impressions missing in pgehres database - https://phabricator.wikimedia.org/T177331#3694294 (... [15:43:28] T176913: adyen cookie error after entering information on Safari - https://phabricator.wikimedia.org/T176913 [15:44:01] dstrine: ohhh, you wanted to see how it would look to do the full redirect! [15:44:05] sorry, misunderstood [15:44:11] yeah it's cool [15:44:39] yeah I want to show people what the full adyen page looks like [15:44:59] ejegg i'm looking at that right now, haven't found any documentation from adyen on full redirect [15:45:03] but maybe i'm missing something? [15:45:05] So, right now we only have a single skin configured [15:45:31] I've seen their pages before but I don't want to get an incorrect screen shot [15:45:41] mepps it would be just like our iframe code, except instead of posting the form in the iframe we would post it in the top frame [15:45:45] dstrine: fr-tech pcoombe just got an idea about a backup for this Kafkatee pgehres flakification... What if, as a backup solution, we re-implemented the scripts used to query pgehers, but fetching the data from Druid instead? [15:46:00] dstrine: we've got our one skin styled for iframe, so it's totally minimal [15:46:05] That way the interface for fr-online would look identical [15:46:08] No change in workflow [15:46:22] Just a backup way to get the data in case Kafka tees up on us again [15:46:27] ejegg, would the user still fill out their data on our form? [15:46:29] dstrine: we could configure a second skin for full redirects [15:46:58] AndyRussG I'm confused, are you talking about the same bug as ejegg? [15:46:59] ejegg: I was assuming a full redirect [15:47:07] mepps yep, they'd still fill out the contact info with us, then when they choose a CC type (assuming validation succeeds) it would just do a full redirect [15:47:10] AndyRussG: let me get back to you on that [15:47:14] AndyRussG: if it doesn't change our workflow, and you're confident it will be reliable, it's fine with me! [15:47:30] dstrine: a full redirect just for Safari, right? [15:48:12] ejegg: can we also tell if they have cookies enabled? if they do, they can still use our form [15:48:58] a few people do get nervous when they can detect redirects happening in a flow like ours. [15:49:13] so I'd still want to keep it to a minimum [15:49:19] dstrine testing for third party cookies would be tricky - we'd have to open an iframe onto a separate domain that we control, have it set a cookie and reload, then test for the same cookie, then have some way for paymentswiki to talk to that other domain to get the result of the test [15:49:39] ugh ok nevermind [15:50:13] mepps: not quite... Basically it would be a way to get around the Kafkatee pipeline problem (the cause of which we don't know) without changing the way the folks who use the data access it [15:50:22] pcoombe: cool! :) [15:50:36] okay AndyRussG yeah i think we're talking about two different things separately [15:50:43] ejegg: this suggests it's possible to check for 3rd party support, but I haven't tested it https://stackoverflow.com/a/34991552/3438044 [15:50:50] ejegg: umm yeah then we really do need to see what their page is going to look like before we commit to this [15:51:12] ejegg is there documentation on skins? [15:51:14] mepps: yes there are conflicting bug discussions vying for limited IRC space [15:51:19] i'm currently getting skin null does not exist [15:51:39] * AndyRussG decides to talk politics and... some other controversial topic... instead [15:51:50] AndyRussG you're comment just would have made sense for th eother discussion! [15:52:03] mepps: right... [15:52:04] we should just all say really generic things that would fit any conversation [15:52:09] Aarrrg I hate those skin nulls [15:52:11] So itchy! [15:52:39] "Yes I agree that is the course of action we should take in regards to this problem" [15:52:56] :) [15:52:56] AndyRussG that actually covered the error I'd just seen! [15:53:16] mepps: yeah um if you can just, tighten up the nulls on those skins that'll be great ;) [15:54:26] mepps yeah, lemme see [15:54:26] mepps: heh I imagine :) [15:55:12] mepps you configure them here: https://ca-test.adyen.com/ca/ca/skin/skins.shtml [15:55:22] It's not working yet but I'm investigating a possible solution [15:55:25] dang, where's ours? [15:55:39] Trying to avoid the rabbit hole [15:55:39] oh shoot, do we have two company test accounts? [15:56:45] ejegg uh oh! [16:14:51] Fundraising Sprint Ivory Tower Defense Games, Fundraising Sprint Judgement Suspenders, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM, Patch-For-Review: Enable ability to look up contacts by phone number - https://phabricator.wikimedia.org/T97372#3694364 (DStrine) [16:15:11] Fundraising Sprint Judgement Suspenders, Fundraising-Backlog, FR-PayPal-ExpressCheckout, MediaWiki-extensions-DonationInterface, and 3 others: "Return to PayPal" error not handled right for recurring - https://phabricator.wikimedia.org/T165089#3694365 (DStrine) [16:16:10] Fundraising Sprint Judgement Suspenders, Fundraising-Backlog, FR-Smashpig, Patch-For-Review, Unplanned-Sprint-Work: SmashPig pending db pruner is broken - https://phabricator.wikimedia.org/T161260#3694368 (DStrine) [16:16:35] Fundraising Sprint Ivory Tower Defense Games, Fundraising Sprint Judgement Suspenders, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM, Patch-For-Review: Thank you letter from civi mangles non-$ currencies - https://phabricator.wikimedia.org/T151957#3694369 (DStrine) [16:17:12] Fundraising Sprint Judgement Suspenders, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM, Patch-For-Review, Unplanned-Sprint-Work: Store merchant reference in invoice id - https://phabricator.wikimedia.org/T165696#3694370 (DStrine) [16:17:34] Fundraising Sprint Judgement Suspenders, Fundraising-Backlog, MediaWiki-extensions-DonationInterface, Unplanned-Sprint-Work: New resultswitcher framebusting order messes up error display - https://phabricator.wikimedia.org/T165106#3694372 (DStrine) [16:18:09] Fundraising Sprint Judgement Suspenders, Fundraising-Backlog, MediaWiki-extensions-ContributionTracking, RelEng-Archive-FY201718-Q1, and 3 others: Clean up Contribution Tracking settings in main wmf config repo - https://phabricator.wikimedia.org/T147479#3694373 (DStrine) [16:18:35] Fundraising Sprint Judgement Suspenders, Fundraising-Backlog, Patch-For-Review, Unplanned-Sprint-Work: Drush thank you task naming causes confusion - https://phabricator.wikimedia.org/T165671#3694374 (DStrine) [17:20:25] Fundraising Sprint Judgement Suspenders, Fundraising Sprint Kickstopper, Fundraising-Backlog, FR-Smashpig, and 3 others: DonationInterface needs to use the same data keys as the backend - https://phabricator.wikimedia.org/T165818#3694552 (DStrine) [17:25:14] fr-tech any news for scrum of scrums? [17:26:55] Nothing here, thanks. [17:30:32] nope! [17:34:37] hmm ejegg using a new skin seems with how account is setup but i'm still looking into it [17:36:40] okay i might have an idea [17:39:02] ejegg: nothing here, thanks! [17:39:11] k, cool [17:46:01] Fundraising Sprint Costlier Alternative, Fundraising Sprint Deferential Equations, Fundraising Sprint English Cuisine, Fundraising Sprint Far Beer, and 11 others: CentralNotice banner sequence: implement feature for MVP - https://phabricator.wikimedia.org/T144453#3694626 (DStrine) [17:48:57] Fundraising Sprint Loose Lego Carpeting, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM, Patch-For-Review, Unplanned-Sprint-Work: Restore all of the Saved Field Mappings list to Civi - https://phabricator.wikimedia.org/T169886#3694639 (DStrine) [17:49:32] Fundraising Sprint Kickstopper, Fundraising Sprint Loose Lego Carpeting, Fundraising-Backlog, fundraising-tech-ops, and 4 others: Figure out a sane way to deploy SmashPig.yaml configuration - https://phabricator.wikimedia.org/T147503#3694642 (DStrine) [17:50:17] Fundraising Sprint Kickstopper, Fundraising Sprint Loose Lego Carpeting, Fundraising-Backlog, fundraising-tech-ops, and 3 others: Make /etc/smashpig config dir - https://phabricator.wikimedia.org/T169585#3694644 (DStrine) [17:52:08] Fundraising Sprint Synchronized Screaming, Fundraising Sprint turtles that are robotic that destroy the whole world with their foot, Fundraising-Backlog, Unplanned-Sprint-Work: donatewiki_counts and banner impressions missing in pgehres database - https://phabricator.wikimedia.org/T177331#3694648 (... [19:28:18] Fundraising Sprint Synchronized Screaming, Fundraising Sprint turtles that are robotic that destroy the whole world with their foot, Fundraising-Backlog, Unplanned-Sprint-Work: donatewiki_counts and banner impressions missing in pgehres database - https://phabricator.wikimedia.org/T177331#3694900 (... [19:46:16] (CR) Eileen: "recheck" [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/384953 (https://phabricator.wikimedia.org/T177451) (owner: Eileen) [19:56:19] (PS1) Ejegg: Merge branch 'master' into deployment [wikimedia/fundraising/crm] (deployment) - https://gerrit.wikimedia.org/r/385028 [19:56:25] (CR) Ejegg: [C: 2] Merge branch 'master' into deployment [wikimedia/fundraising/crm] (deployment) - https://gerrit.wikimedia.org/r/385028 (owner: Ejegg) [19:58:17] Fundraising Sprint Synchronized Screaming, Fundraising Sprint turtles that are robotic that destroy the whole world with their foot, Fundraising-Backlog, Unplanned-Sprint-Work: donatewiki_counts and banner impressions missing in pgehres database - https://phabricator.wikimedia.org/T177331#3694979 (... [19:58:48] (PS1) Eileen: Update CiviCRM submodule [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/385031 [19:59:26] (CR) Eileen: "recheck" [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/384953 (https://phabricator.wikimedia.org/T177451) (owner: Eileen) [19:59:35] (CR) Eileen: [C: 2] Update CiviCRM submodule [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/385031 (owner: Eileen) [20:01:10] (PS5) Eileen: Switch Omnimail job progress tracking to it's own table. [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/384906 (https://phabricator.wikimedia.org/T177451) [20:01:12] (PS4) Eileen: Test consolidation in prep for switching away from setting [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/384936 (https://phabricator.wikimedia.org/T177451) [20:01:14] (PS1) Eileen: Upgrader for switching omnimail job [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/385034 (https://phabricator.wikimedia.org/T177451) [20:01:16] (Merged) jenkins-bot: Merge branch 'master' into deployment [wikimedia/fundraising/crm] (deployment) - https://gerrit.wikimedia.org/r/385028 (owner: Ejegg) [20:03:19] (Merged) jenkins-bot: Update CiviCRM submodule [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/385031 (owner: Eileen) [20:11:32] (CR) jerkins-bot: [V: -1] Switch to using a table to track omnimail job progress [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/384953 (https://phabricator.wikimedia.org/T177451) (owner: Eileen) [20:18:01] (CR) jerkins-bot: [V: -1] Test consolidation in prep for switching away from setting [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/384936 (https://phabricator.wikimedia.org/T177451) (owner: Eileen) [20:26:49] (PS6) Eileen: Switch Omnimail job progress tracking to it's own table. [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/384906 (https://phabricator.wikimedia.org/T177451) [20:26:51] (PS2) Eileen: Upgrader for switching omnimail job [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/385034 (https://phabricator.wikimedia.org/T177451) [20:26:53] (PS5) Eileen: Test consolidation in prep for switching away from setting [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/384936 (https://phabricator.wikimedia.org/T177451) [20:30:31] dang I've mixed up my commits - seem to have pushed up the wrong one & hunting through all my branches to figure out the 'good' stuff from the bad [20:34:33] (CR) jerkins-bot: [V: -1] Test consolidation in prep for switching away from setting [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/384936 (https://phabricator.wikimedia.org/T177451) (owner: Eileen) [20:36:14] (PS6) Eileen: Test consolidation in prep for switching away from setting [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/384936 (https://phabricator.wikimedia.org/T177451) [20:45:17] eileen1: i like to call that "gitting got" [20:46:06] where i burn an entire afternoon on a git snafu [20:46:56] hah, luvit [20:47:15] the term, i mean [20:47:29] the thing in itself is frustrating as hell [20:47:56] heh, how bout a script to run unit tests on every commit in 'git reflog' [20:48:52] like bisect, but on state history instead of a branch [20:49:18] !log updated CiviCRM from 7c26791589af7ee2798def303aaaf863038a65c9 to b9d2067671dd68e1c3466863ffd10ab2748c7eaf [20:49:24] Logged the message at https://wikitech.wikimedia.org/wiki/Server_Admin_Log [20:52:08] (PS1) Ejegg: (trivial) Fix index value for overall message age [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/385080 [20:53:09] ok, the contact_hash check didn't blow up the import pipeline [20:53:17] I think we are nearly back [20:54:04] Fundraising Sprint Murphy's Lawyer, Fundraising-Backlog, Unplanned-Sprint-Work: SQL challenge: Mailing and donation data - https://phabricator.wikimedia.org/T169591#3695127 (DStrine) [20:54:18] (PS2) Eileen: Add table & entity to track omnimail job progress [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/384953 (https://phabricator.wikimedia.org/T177451) [20:57:29] I have the test-passing version of this one up again now https://gerrit.wikimedia.org/r/#/c/384936/ [21:05:06] (PS7) Eileen: Switch Omnimail job progress tracking to it's own table. [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/384906 (https://phabricator.wikimedia.org/T177451) [21:06:43] (PS8) Eileen: Switch Omnimail job progress tracking to it's own table. [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/384906 (https://phabricator.wikimedia.org/T177451) [21:06:45] (PS3) Eileen: Switch over to new table & entity to track omnimail job progress [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/384953 (https://phabricator.wikimedia.org/T177451) [21:08:49] (PS7) Eileen: Test consolidation in prep for switching away from setting [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/384936 (https://phabricator.wikimedia.org/T177451) [21:08:51] (PS9) Eileen: Switch Omnimail job progress tracking to it's own table. [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/384906 (https://phabricator.wikimedia.org/T177451) [21:08:53] (PS4) Eileen: Switch over to new table & entity to track omnimail job progress [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/384953 (https://phabricator.wikimedia.org/T177451) [21:11:07] Fundraising Sprint Murphy's Lawyer, Fundraising Sprint Navel Warfare, Wikimedia-Fundraising-CiviCRM, Patch-For-Review: increase email limit from 50 to 700 in civi - https://phabricator.wikimedia.org/T170900#3695188 (DStrine) [21:12:18] Fundraising Sprint Navel Warfare, Fundraising-Backlog, FR-PayPal-ExpressCheckout, Patch-For-Review, Unplanned-Sprint-Work: Paypal EC subscr start messages not recording amount - https://phabricator.wikimedia.org/T171546#3695190 (DStrine) [21:12:55] Fundraising Sprint Murphy's Lawyer, Fundraising Sprint Navel Warfare, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM, Patch-For-Review: "Thank-you Sent" field auto populating date - https://phabricator.wikimedia.org/T170440#3695191 (DStrine) [21:13:22] Fundraising Sprint Navel Warfare, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM, FR-Email, and 2 others: Make sure silverpop export does not add default date for last_donation date - https://phabricator.wikimedia.org/T171920#3695192 (DStrine) [21:13:50] Fundraising Sprint Navel Warfare, Fundraising-Backlog, MediaWiki-extensions-DonationInterface, MW-1.30-release-notes (WMF-deploy-2017-08-01_(1.30.0-wmf.12)), and 2 others: Compound order IDs should never end in ".0" - https://phabricator.wikimedia.org/T171891#3695198 (DStrine) [21:14:15] Fundraising Sprint Navel Warfare, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM, FR-Email, and 2 others: Do we need to add handling for the 2 silverpop mails that would not retrieve properly - https://phabricator.wikimedia.org/T171433#3695199 (DStrine) [21:14:51] Fundraising Sprint Navel Warfare, Fundraising-Backlog, FR-Email, Patch-For-Review, Unplanned-Sprint-Work: Leave blank values in Silverpop file blank, not NULL - https://phabricator.wikimedia.org/T91692#3695202 (DStrine) [21:22:48] (CR) jerkins-bot: [V: -1] Switch over to new table & entity to track omnimail job progress [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/384953 (https://phabricator.wikimedia.org/T177451) (owner: Eileen) [21:32:21] Fundraising Sprint Prank Seatbelt, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM, Fr-CiviCRM-dedupe-FY2017/18, and 2 others: spike: dedupe or other feature? cleanup names and addresses in civi - https://phabricator.wikimedia.org/T173776#3695243 (DStrine) [21:34:12] Fundraising Sprint Prank Seatbelt, Fundraising-Backlog, Continuous-Integration-Config, Patch-For-Review, Unplanned-Sprint-Work: Continuous integration: wikimedia/fundraising/tools/DjangoBannerStats needs V+2 jobs - https://phabricator.wikimedia.org/T121723#3695244 (DStrine) [21:34:56] Fundraising Sprint Prank Seatbelt, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM, FR-WMF-Audit, and 2 others: WX audit files: deal with sparse refund records - https://phabricator.wikimedia.org/T173875#3695257 (DStrine) [21:35:32] Fundraising Sprint Synchronized Screaming, Fundraising Sprint turtles that are robotic that destroy the whole world with their foot, Fundraising-Backlog, Unplanned-Sprint-Work: donatewiki_counts and banner impressions missing in pgehres database - https://phabricator.wikimedia.org/T177331#3695261 (... [21:35:35] Fundraising Sprint Prank Seatbelt, Fundraising-Backlog, Patch-For-Review, Unplanned-Sprint-Work: Replace deprecated transaction.commit_manually in DjangoBannerLoader - https://phabricator.wikimedia.org/T162504#3695262 (DStrine) [21:36:20] Fundraising Sprint Prank Seatbelt, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM, FR-Ingenico, and 3 others: Ingenico WX audit parser: refunds missing gateway_txn_id - https://phabricator.wikimedia.org/T173457#3695265 (DStrine) [21:52:00] (PS5) Eileen: Switch over to new table & entity to track omnimail job progress [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/384953 (https://phabricator.wikimedia.org/T177451) [21:56:39] Fundraising Sprint Quill Pencil, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM, Patch-For-Review, Unplanned-Sprint-Work: Scripts with a time limit should use real process elapsed time - https://phabricator.wikimedia.org/T174690#3695302 (DStrine) [21:57:10] Fundraising Sprint Quill Pencil, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM, Fr-CiviCRM-dedupe-FY2017/18, and 2 others: Remove invalid City data from DB - https://phabricator.wikimedia.org/T174985#3695303 (DStrine) [21:57:27] Fundraising Sprint Quill Pencil, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM, Fr-CiviCRM-dedupe-FY2017/18, and 2 others: Update wmf_civicrm import normalisation to set city to NULL when it is ‘0’ or ‘City/Town’ or ‘NoCity’ - https://phabricator.wikimedia.org/T174980#3695304 (DStrine) [21:57:48] Fundraising Sprint Kickstopper, Fundraising Sprint Loose Lego Carpeting, Fundraising Sprint Quill Pencil, Fundraising-Backlog, and 4 others: Deal with paypal EC error 11607, show thank you page - https://phabricator.wikimedia.org/T165635#3695305 (DStrine) [21:59:20] Fundraising Sprint Quill Pencil, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM, Fr-CiviCRM-dedupe-FY2017/18, and 2 others: Data clean up - remove double spaces html ampersands from first & last names - https://phabricator.wikimedia.org/T175107#3695306 (DStrine) [22:01:03] Fundraising Sprint Quill Pencil, Fundraising-Analysis, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM, and 2 others: Recurring slow query (around 10 secs) from thank you job - https://phabricator.wikimedia.org/T149745#3695307 (DStrine) [22:08:08] XenoRyet: mepps hey, BTW I'm back online, in case you've questions or anything about silly CN code... Mmmm I should start using those |away suffixes again... [22:08:25] Fundraising Sprint RadioActivewear, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM, Unplanned-Sprint-Work: Manage groups page seems to be refreshing groups when it shouldn't - https://phabricator.wikimedia.org/T176258#3695311 (DStrine) [22:08:46] Fundraising Sprint RadioActivewear, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM, Patch-For-Review, Unplanned-Sprint-Work: Add placeholding & limit to omnimail recipients, like groupmember - https://phabricator.wikimedia.org/T176255#3695317 (DStrine) [22:09:09] Fundraising Sprint RadioActivewear, Fundraising-Backlog, FR-PayPal-ExpressCheckout, Unplanned-Sprint-Work: Investigate PayPal-EC related FailMail - https://phabricator.wikimedia.org/T176339#3695318 (DStrine) [22:09:44] Fundraising Sprint RadioActivewear, Fundraising-Backlog, Unplanned-Sprint-Work: Deploy French thank you email - https://phabricator.wikimedia.org/T176585#3695319 (DStrine) [22:10:11] Fundraising Sprint RadioActivewear, Fundraising-Backlog, MediaWiki-extensions-DonationInterface, MW-1.31-release-notes (WMF-deploy-2017-09-26 (1.31.0-wmf.1)), and 2 others: Fix warnings in Amount staging helper - https://phabricator.wikimedia.org/T160962#3695320 (DStrine) [22:11:08] Fundraising Sprint RadioActivewear, Fundraising-Backlog, FR-Adyen, MediaWiki-extensions-DonationInterface, and 3 others: Adyen credit card fields not styled correctly on iOS devices - https://phabricator.wikimedia.org/T176420#3695325 (DStrine) [22:11:43] Fundraising Sprint RadioActivewear, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM: Donation Queue consumer should stop trying to hit ganglia - https://phabricator.wikimedia.org/T176167#3695326 (DStrine) [22:21:52] Fundraising Sprint Synchronized Screaming, Fundraising-Backlog, Patch-For-Review, Unplanned-Sprint-Work: Add currency symbol to email export file - https://phabricator.wikimedia.org/T156410#3695359 (DStrine) [22:22:46] Fundraising Sprint Navel Warfare, Fundraising Sprint Outie Inverter, Fundraising Sprint Prank Seatbelt, Fundraising Sprint Quill Pencil, and 4 others: Are we losing transactions witih repeated ct_id? - https://phabricator.wikimedia.org/T171349#3695363 (DStrine) [22:23:12] Fundraising Sprint Synchronized Screaming, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM, Patch-For-Review, Unplanned-Sprint-Work: Import donations from audit files where the log lines are missing - https://phabricator.wikimedia.org/T176923#3695369 (DStrine) [22:23:35] Fundraising Sprint Synchronized Screaming, Fundraising Tech Backlog, Fundraising-Backlog, Patch-For-Review, Unplanned-Sprint-Work: look at possible drupal logging snafu causing excessive log volume - https://phabricator.wikimedia.org/T121799#3695370 (DStrine) [22:24:08] Fundraising Sprint Synchronized Screaming, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM, Patch-For-Review, Unplanned-Sprint-Work: Add editorconfig files to our codebase to deal with whitespace pain? - https://phabricator.wikimedia.org/T177725#3695373 (DStrine) [22:25:20] Fundraising Sprint Synchronized Screaming, Fundraising-Backlog, Chinese-Sites, Patch-For-Review, Unplanned-Sprint-Work: Update postal address in Thank You email - https://phabricator.wikimedia.org/T177230#3695378 (DStrine) [22:48:41] (CR) Paladox: "> Is manifest version 2 OK to use under REL1_27 ?" [extensions/FundraisingEmailUnsubscribe] - https://gerrit.wikimedia.org/r/307044 (https://phabricator.wikimedia.org/T142392) (owner: Paladox)