[00:11:45] (PS2) Ssmith: Add timepickers and inform user of selection [wikimedia/fundraising/dash] - https://gerrit.wikimedia.org/r/154201 [00:11:51] (CR) jenkins-bot: [V: -1] Add timepickers and inform user of selection [wikimedia/fundraising/dash] - https://gerrit.wikimedia.org/r/154201 (owner: Ssmith) [03:56:09] (PS1) EBernhardson: Use correct field names with addExtensionUpdate [extensions/CentralNotice] - https://gerrit.wikimedia.org/r/154231 [09:11:04] (CR) Raimond Spekking: [C: 2 V: 2] Localisation updates from https://translatewiki.net. [extensions/ContributionReporting] - https://gerrit.wikimedia.org/r/154165 (owner: L10n-bot) [09:11:42] (CR) Raimond Spekking: [C: 2 V: 2] Localisation updates from https://translatewiki.net. [extensions/CentralNotice] - https://gerrit.wikimedia.org/r/154162 (owner: L10n-bot) [11:50:40] (CR) Qgil: "Is this changeset waiting for reviewers or is it still WIP?" [wikimedia/fundraising/tools] - https://gerrit.wikimedia.org/r/99266 (owner: Awight) [11:53:58] (CR) Qgil: [C: -1] "Is this changeset waiting for reviewers or is it still WIP?" [wikimedia/fundraising/tools] - https://gerrit.wikimedia.org/r/104141 (owner: Awight) [16:11:35] (PS1) Ejegg: WP: Put stripped email in MerchantReference2 [extensions/DonationInterface] - https://gerrit.wikimedia.org/r/154282 [16:40:01] oh no, gerrit's bored of us! [17:26:46] awight: were you using some cool transliteration thing for your dedup diff? [17:27:03] i mean dedupe review [17:39:47] atgo: for the WorldPay transcoding card, do you know if we need to transliterate kanji and such, or just eastern european and cyrillic type scripts that have straightforward equivalents? [17:40:01] https://wikimedia.mingle.thoughtworks.com/projects/online_fundraiser/cards/1766 [17:55:47] ejegg: omg yeah I don't think transliteration is a win [17:57:19] OK, then just strip out anything that can't be converted directly to western encoding equiv? [17:57:42] Or replace with question marks, which is what the PHP fn I'm using for eastern european does with kanji [17:58:12] ugh nok [19:21:02] ejegg: no, I have no transliteration magick. It is an evil and impossible practice tho [19:21:18] ejegg: but-- I thought the issue was transcoding, not transliteration?? [19:21:49] yeah that card says transcoding [19:22:37] Oh, is there some way to transcode kanji into iso8859-1? [19:23:38] ejegg: err. umm.. [19:24:13] oof, we are effed. [19:25:30] For characters like the eastern european accented consonents that have no iso8859-1 representation, i thought it would at least be nice to have the consonent sans hacek, which you can get with iconv('UTF-8', 'ISO-8859-1//TRANSLIT', 'stuff') [19:26:10] eergh. It would be good to call WorldPay out on this, IMO. [19:26:30] yeah, actually we'd have to convert the whole XML post [19:26:35] really away now [19:26:40] enjoy lunch [19:38:15] (PS1) Ssmith: List filters dynamically [wikimedia/fundraising/dash] - https://gerrit.wikimedia.org/r/154310 [19:38:21] (CR) jenkins-bot: [V: -1] List filters dynamically [wikimedia/fundraising/dash] - https://gerrit.wikimedia.org/r/154310 (owner: Ssmith) [19:57:45] ejegg: sorry to slow you down, WorldPay will almost certainly refuse to fix anything on their end, so you're probably right that transliteration is the only solution. [20:00:30] It would have to be the whole XML post though, since putting the iso8859 accented characters back into a UTF8 XML doc will screw it up before we even send it out. So that will be trickier than the single-field munging I'm doing. [20:01:13] I think xml has an explicit charset declaration, so you can encode the entire document as lat1? [20:01:38] right-oh. [20:01:56] I see, but it will take more extensive DonationInterface munging [20:02:02] yeah [20:08:35] awight: is this appropriate use of staging vars and the stage_ function? https://gerrit.wikimedia.org/r/#/c/154282/ [20:09:05] i need to get set up to hit the WP testing endpoint [20:13:41] ejegg: yeah for sure! [20:13:51] thanks! [20:14:22] There was some theory about replacing the at-sign with another punctuation, but I think I prefer what you've done here. [20:14:38] (CR) Awight: WP: Put stripped email in MerchantReference2 (1 comment) [extensions/DonationInterface] - https://gerrit.wikimedia.org/r/154282 (owner: Ejegg) [20:15:42] looked like + was rejected too, so I figured I'd choose the least offensive separator [20:19:46] hah! Yeah I don't know how we choose these winning payment processors... [20:20:57] Jeff_Green: hey, did you succeed in reviving the recurring alert? https://wikimedia.mingle.thoughtworks.com/projects/online_fundraiser/cards/1186 [20:21:13] I think we're wondering, is it alive, and is the threshold set to something very low? [20:21:25] oh [20:22:13] OK missing_thank_yous=1: recurring_gc_contribs_missed=384: recurring_gc_failures_missed=0: recurring_gc_jobs_required=1014: recurring_gc_schedule_sanity=0  [20:22:36] hah missing_thank_yous>11,000 so that's funny [20:22:45] (PS2) Ejegg: WorldPay: Put stripped email in MerchantReference2 [extensions/DonationInterface] - https://gerrit.wikimedia.org/r/154282 [20:22:50] Jeff_Green: are those the thresholds? [20:23:06] no. getting those now [20:23:27] those are alert outputs, then? [20:24:05] (CR) Ejegg: "fixed copypasta" [extensions/DonationInterface] - https://gerrit.wikimedia.org/r/154282 (owner: Ejegg) [20:24:30] see email [20:24:39] ugh, you have to specifically comment on the old patch set to publish inline replies? [20:24:54] ejegg: yep :-/ [20:25:10] (CR) Ejegg: "fixed copypasta" (1 comment) [extensions/DonationInterface] - https://gerrit.wikimedia.org/r/154282 (owner: Ejegg) [20:25:29] Jeff_Green: oh wow, thanks. Is that stuff coming from puppet / puppet-priv / elsewhere? [20:25:55] regular puppet, hardcoded in the script :-) [20:26:05] woot :p [20:26:18] so, we're hoping to set the recurring_gc_contribs_missed threshold to very low. [20:26:41] But currently I've disabled the job for misbehavior, so... I'll ping u when we can set that threshold. [20:26:46] Where do the alerts go? [20:26:57] i think they go to fr-tech only [20:30:58] Jeff_Green: I've never seen one. I guess that's a good thing... [20:31:03] ha [20:31:29] Jeff_Green: so ahem, that's perl then. What executes it? [20:31:45] It would be nice to have a mini doc on this, one day. [20:31:51] the nagios_nsca script [20:32:00] which runs on every machine in frack [20:32:00] ok thx [20:32:01] on cron [20:32:27] it runs nagios plugins as specified in /etc/nagios_nsca.conf and injects them to the nsca master [20:34:21] (CR) Awight: [C: 2] WorldPay: Put stripped email in MerchantReference2 [extensions/DonationInterface] - https://gerrit.wikimedia.org/r/154282 (owner: Ejegg) [20:34:33] (Merged) jenkins-bot: WorldPay: Put stripped email in MerchantReference2 [extensions/DonationInterface] - https://gerrit.wikimedia.org/r/154282 (owner: Ejegg) [20:37:05] (CR) Awight: [C: 2] "Cool!" (1 comment) [wikimedia/fundraising/dash] - https://gerrit.wikimedia.org/r/154310 (owner: Ssmith) [20:37:36] (CR) Awight: "@pizzacat: needs manual rebase" [wikimedia/fundraising/dash] - https://gerrit.wikimedia.org/r/151137 (owner: Ssmith) [20:38:40] (CR) Awight: [C: -1] "Just dinging for the gitignore thing" (1 comment) [wikimedia/fundraising/dash] - https://gerrit.wikimedia.org/r/151237 (owner: Ssmith) [20:39:02] (CR) Awight: [C: 2] Show selected submenus for filters [wikimedia/fundraising/dash] - https://gerrit.wikimedia.org/r/151256 (owner: Ssmith) [20:39:25] (CR) Awight: [C: 2] Fix checkbox padding [wikimedia/fundraising/dash] - https://gerrit.wikimedia.org/r/153860 (owner: Ssmith) [20:40:32] (CR) Awight: [C: 2] Add timepickers and inform user of selection [wikimedia/fundraising/dash] - https://gerrit.wikimedia.org/r/154201 (owner: Ssmith) [20:52:10] ejegg|away: I'm finding really scary behavior with the CRM phpunit tests... [20:52:23] lemme know if you have a minute to help [20:53:36] There's something in phpunit which converts "undefined variable" notices into an exception, and it's not working on the first test of any suite. [20:56:23] pizzzacat: hey, you have a rebase issue beginning at https://gerrit.wikimedia.org/r/151137 [20:56:26] sorry! [20:56:43] also, want to finish that node_modules thing we were working on? [20:57:01] yes [21:14:00] awight what's the link for the sql queries? [21:15:30] atgo: https://collab.wikimedia.org/wiki/Fundraising/Engineering/Fun_SQL_Queries [21:15:37] thanks! [21:15:43] atgo: I have ten minutes available at any time u need [21:16:00] sure.. i think it's probably good for me to just get familiar now and then when i'm back we can do more teaching [21:16:09] i don't promise to actually retain much if we do it now and then i leave for 2 weeks :) [21:16:28] * awight tee-hees [21:16:43] preparing to Burn out, I see [21:18:41] awight: weird behavior - let me try to reproduce. any patch set you want me to look at for that? [21:18:55] that was re: phpunit [21:20:01] awight: atgo: ejegg: Hi everyone... Quick ?: for the schema change for CentralNotice infrastructure, I should only put meta as the affected wiki on the bug? https://bugzilla.wikimedia.org/enter_bug.cgi [21:20:19] awight: oh man, i wouldn't be suprised if it had to do with that TemporaryErrorScope BS [21:21:22] (^ just realized that link does nothing...) [21:21:39] ha yeah.. i'm poking around. i have no idea.. awight? [21:22:04] This is the one really: https://bugzilla.wikimedia.org/enter_bug.cgi?assigned_to=wikibugs-l%40lists.wikimedia.org&attach_text=&blocked=49188&bug_file_loc=http%3A%2F%2F&bug_severity=normal&bug_status=NEW&cf_browser=---&cf_platform=--- [21:22:04] &comment=Short%20description%3A%0D%0A%0D%0AWhich%20wikis%20are%20affected%3A%0D%0A%0D%0AWhich%20tables%3A%0D%0A%0D%0AWhat%20is%20the%20change%20to%20those%20tables%3A%0D%0A%0D%0ALinks%20to%20gerrit%20changes%20and%2For%20other%20related%20bug%20reports.&component=General%2FUnknown&contenttypeentry=&contenttypemethod=autodetect&contenttypeselection=text%2Fplain&data=&dependson=&description=&flag_type- [21:22:04] 3=X&form_name=enter_bug&keywords=schema-change%2C%20&maketemplate=Remember%20values%20as%20bookmarkable%20template&op_sys=All&product=Wikimedia&rep_platform=All&short_desc=&target_milestone=---&version=unspecified [21:22:45] errrm [21:22:49] bit.ly? [21:22:53] tinyurl? [21:24:06] It's so much more impressive like that, no? [21:24:23] and so much more impossible to click on [21:24:25] :P [21:24:33] One sec [21:24:56] http://bit.ly/VsVE63 [21:25:24] hey cc [21:25:26] ccogdill: [21:25:29] AndyRussG: yeah the only affected wiki should be meta [21:25:31] oh man. that was a mess. [21:25:38] awight: thanks! [21:25:41] yeah atgo? [21:25:43] and: lol URL [21:25:54] ccogdill: did you see the email from sebastiaan 8 days ago about some SEPA transactions coming through? [21:25:55] ejegg: I think it's Drupal replacing PHPUnit's error handler [21:25:59] atgo: sorry [21:26:03] :( [21:26:04] could be civi or drupal, actually [21:26:12] he no worries... i meant my typing AndyRussG [21:26:12] yeah [21:26:21] so... i'm not entirely sure what to do with that [21:26:32] haha [21:26:33] let me find it [21:26:37] the-wub thinks it's all shut down. i don't think katie even turned it on in production [21:26:49] have you.. heard anything? [21:27:18] atgo: eergh, fwiw I was supposed to shut DD down on the backend and did not [21:27:29] (PS2) Ssmith: Fix checkbox padding [wikimedia/fundraising/dash] - https://gerrit.wikimedia.org/r/153860 [21:27:31] (PS2) Ssmith: Better time period selection panel [wikimedia/fundraising/dash] - https://gerrit.wikimedia.org/r/151237 [21:27:32] awight: that might explain it [21:27:33] (PS2) Ssmith: List filters dynamically [wikimedia/fundraising/dash] - https://gerrit.wikimedia.org/r/154310 [21:27:35] (PS2) Ssmith: Change modal selections for time period choices [wikimedia/fundraising/dash] - https://gerrit.wikimedia.org/r/151137 [21:27:36] that needs to happen. [21:27:37] (PS2) Ssmith: Show selected submenus for filters [wikimedia/fundraising/dash] - https://gerrit.wikimedia.org/r/151256 [21:27:39] (PS3) Ssmith: Add timepickers and inform user of selection [wikimedia/fundraising/dash] - https://gerrit.wikimedia.org/r/154201 [21:27:47] flood!! [21:27:49] pizzzacat blowing up irc [21:27:59] yeah awight... that's really important that that get shut off. [21:28:01] that TemporaryErrorScope definitely does replace it, but i'm not sure if it's in effect where you're seeing the issue [21:28:04] no wonder she logged out before doing that [21:28:15] when were you supposed to do that? [21:28:21] july 30 or so? [21:28:57] i mean we shouldn't be sending anyone there from the front end, but still... [21:29:03] sorry atgo, got distracted rereading that email. by have you heard anything, do you mean from GC? [21:29:13] or from donors attempting to use DD [21:29:14] I haven’t noticed any DD transactions coming through [21:29:16] nope [21:29:21] just 1 guy asking if he could [21:29:29] want me to run a report in GC and see [21:29:30] ? [21:29:52] i'm doing that right now [21:30:06] they're all our standard form amounts [21:30:08] is Phoebe saying recurrings are the ones that kept going? [21:30:13] where are these people getting these forms? [21:30:21] oh maybe [21:30:41] I didn’t get the attachment she’s referencing so I’m not sure [21:30:53] can you send it to me? I can look up the transactions she’s talking about to see [21:32:08] we think it might be the recurring jobs [21:32:38] merci! [21:32:41] checking now [21:32:44] thanks [21:33:00] yeah from the console it look slike they stopped on the 11, which is when awight shut down recurring for another reason [21:33:33] yeah atgo, you can tell by the effort ID that they’re reccuring [21:33:47] ok. oy [21:34:07] AndyRussG: standup? [21:34:54] so the good news is, I think all the ones that weren’t rejected are pending at status 600 [21:34:58] they’ll never process [21:40:39] (CR) Hashar: [C: 1 V: 1] "Confirmed the updater columns names now matches the ones from the patches files." [extensions/CentralNotice] - https://gerrit.wikimedia.org/r/154231 (owner: EBernhardson) [21:48:14] awight: noon next Wednesday OK? [21:51:12] ejegg: yep! [21:51:37] awight: the patch is https://gerrit.wikimedia.org/r/#/c/154231/ [21:51:50] beta labs failing [21:52:32] rockin [21:53:04] AndyRussG: ^^ u aware of this? [21:53:06] ejegg or you could +2 it, anyone who groks CentralNotice [21:54:39] (CR) Awight: [C: 2] "OK Thanks for finding this!" [extensions/CentralNotice] - https://gerrit.wikimedia.org/r/154231 (owner: EBernhardson) [21:54:46] thanks! [22:00:03] hey pizzzacat do you want either of those 2 new cards to be in the current sprint? [22:00:13] (which ends wednesday) [22:00:56] it's ok to put them in the next sprint [22:01:03] :) [22:01:19] I may or may not start them earlier [22:01:21] but yeah [22:01:35] they def. won't get done by wednesday [22:05:41] awight: Yes I did see it [22:05:49] cool [22:06:09] awight: once coinbase has their sftp, will there be add'l tech work? just writing up a status update on the project [22:07:18] atgo_: yep. maybe 2 points of difficult [22:07:21] cool thanks [22:07:28] awight: woops just looking closely... "beta labs failing"??? [22:07:29] atgo_: hey, can you paste me one of the bad dd order IDs [22:07:48] awight: yeah.. it'll take a sec [22:07:49] AndyRussG: yeah it was something about the schema migration--the column name we were checking for was wrong [22:07:52] I killed beta labs? [22:07:53] why does my name always add a _? [22:07:54] it's fixed now though [22:07:55] hehe [22:08:07] atgo_: it's the second you [22:08:19] awight: 9611903905 [22:08:26] atgo_: cos your client constantly disconnects and reconnects, and you aren't allowed to take the name of someone who is only recently deceased [22:08:29] thx! [22:08:35] grumble [22:09:32] atgo: but yeah, your client should be able to help you set your name back after the ghost expires [22:10:08] It also happens when IRC does some weird ancient network "split" think, I think [22:10:18] "thing, I think", I meant [22:11:39] awight: do you need more from gc console? [22:12:02] atgo: no, thx! [22:12:22] ccogdill: just to confirm, I'm about to cancel all active DD recurring subscriptions in Civi [22:12:53] awight: was beta labs really failing 'cos of that? I do remember those parameters and thinking that they didn't necessarily follow the column name exactly... Hmmm many apologies in any case 8p [22:13:13] I did test it locally too [22:13:31] AndyRussG: oh wow, really? thought the column name was actually used [22:13:46] awesome awight, sounds good to me [22:13:50] But not sure what kind of fail thay're talking about [22:13:53] Well it looks now like it is, and that I was wrong [22:14:04] probably good to have you do that before I send the email saying they won’t process [22:14:06] AndyRussG: All I can imagine is that the upgrade job would fail the second time [22:14:13] oh. that's what it must have been [22:14:17] ccogdill: hehe yes perfect [22:14:25] ccogdill fwiw we haven't been processing them anyway since non-sepa flows don't work [22:14:26] Aaaah maybe that's it yeah [22:14:34] yeah [22:14:43] it looked like they all failed one way or another [22:14:47] I’m not worried about it! [22:15:02] ccogdill: atgo says many are "pending" still. yikes! [22:15:07] yeah [22:15:09] at 600 [22:15:15] yeah they are, but they won't go through [22:15:20] at least it’s a dead-end kind of pending [22:15:20] we need to shut it down fo sho [22:15:33] only I can process them :x [22:16:38] ccogdill: done, 463 cancellations [22:16:47] woo! [22:16:49] so wait... [22:17:03] there were only 463 active DD recurrings? [22:17:16] that query I ran to get my list for the email had a little over 600 [22:17:24] do you think my list was wrong? [22:17:52] ccogdill: I found 838 total, and 463 were not already cancelled. [22:17:57] hmmmm [22:18:04] Where did you run the query? [22:18:06] silverpop? [22:18:09] civi [22:18:21] this was the thing in mingle #1871 [22:18:24] ccogdill: do you have that list stored somewhere? [22:18:34] mmm… in silverpop [22:18:37] awight: yeah that's it, it fails when you re-run update.php... Thanks!!! [22:18:39] want me to put in in fileserv [22:18:45] ? [22:18:59] AndyRussG: or, I think since they were starting with a brand-new schema, the first run of update failed [22:19:04] ccogdill: sure thx [22:19:16] ccogdill: meanwhile, I'll actually read your query now [22:19:24] :) [22:19:27] I just tried applying it locally on my local schema that's already updated, and it died [22:19:45] ccogdill: maybe it's the date range :-/ [22:19:52] yeah [22:20:02] Function: DatabaseBase::sourceFile( /home/home/Wikimedia/CentralNotice/infrastructure/extensions/CentralNotice/patches/patch-template-logging-comments.sql ) [22:20:02] Error: 1060 Duplicate column name 'tmplog_comment' (localhost) [22:20:03] wait, but... more? [22:20:12] AndyRussG: yep, ok we are not crazy :p [22:20:21] would you just do 7/1 - present? [22:20:35] ccogdill: I... don't know what I would do in Civi [22:20:39] hah [22:21:04] is this a mysql situation or ? [22:21:22] ccogdill: I did my query in mysql [22:21:33] so I can compare with your list and see what happened [22:21:49] k [22:22:43] As is... clearly stated in the commit message... [22:24:38] * awight adjusts collar [22:24:46] (CR) AndyRussG: "Big woops, apologies & thanks!!!!!" [extensions/CentralNotice] - https://gerrit.wikimedia.org/r/154231 (owner: EBernhardson) [22:25:33] okay awight it’s in the Silverpop queries folder in fundraising fileserv [22:25:47] ccogdill: rad, I'll look at this in a bit thx! [22:25:49] the file name is long, but it’s the only one that starts with DDrecurring [22:25:52] thank yoU! [22:56:56] ccogdill: OK, I can get a list of 631 subscriptions which... pretty much match yours. [22:57:05] yep [22:57:07] awesome! [22:57:13] okay, that makes me feel better [22:57:21] thank you for double checking [22:58:03] Unfortunately, I destroyed the data which would let me check why only 463 were not already cancelled [22:59:54] haha [22:59:57] I think that’s okay [23:04:43] (PS1) Awight: Prevent Drupal from taking over PHPUnit's error handler [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/154357 [23:04:48] ejegg: nasty one! ^^ [23:05:43] HAH none of our tests pass now. [23:24:27] (PS1) Awight: Fix totally mangled recurring code [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/154361 [23:24:29] (PS1) Awight: fix typo [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/154362 [23:56:54] AndyRussG: did you have any luck with phpunit's "test doubles"? [23:57:36] It looks like it doesn't actually override autoloading, so you need to pass your mock object into the code under test directly? [23:57:37] awight: test doubles and me are best buddies [23:57:57] hehehe now I have seen you lie [23:58:12] There's a whole bunch of methods available via $this [23:58:22] Simplest one is $this->getMock [23:58:26] Is that what you're talking about? [23:58:35] yeah, I'm reading http://phpunit.de/manual/4.1/en/test-doubles.html [23:58:50] but for example I want to intercept sent emails... [23:59:04] so I guess I'd need to already have dependency injection or something :-/ [23:59:48] Hmmm