[00:34:08] Fundraising Sprint Raw data can give you salmonella, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM, Patch-For-Review: Figure out best way to make current employer ' a movable feast' - https://phabricator.wikimedia.org/T204182 (NNichols) @Eileenmcnaughton I've moved things around a little on... [00:43:17] Fundraising Sprint Raw data can give you salmonella, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM, Patch-For-Review: Figure out best way to make current employer ' a movable feast' - https://phabricator.wikimedia.org/T204182 (Eileenmcnaughton) @NNichols I have some more patches to deploy -... [00:56:53] (PS1) Eileen: groupContact BAO - standardize add function [wikimedia/fundraising/crm/civicrm] - https://gerrit.wikimedia.org/r/461016 [01:15:24] (CR) Ejegg: [C: 2] Remove apiv4 now it is in core [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/461003 (owner: Eileen) [01:20:20] Fundraising Sprint Raw data can give you salmonella, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM: Unable to make edits from Summary Screen - https://phabricator.wikimedia.org/T203266 (NNichols) @Eileenmcnaughton Yes I can confirm those are each individual issues we've encountered 1. I created... [01:20:55] (Merged) jenkins-bot: Remove apiv4 now it is in core [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/461003 (owner: Eileen) [01:40:58] (CR) Ejegg: [C: 2] CiviCRM updates to support ContactLayoutEditor [wikimedia/fundraising/crm/civicrm] - https://gerrit.wikimedia.org/r/460998 (https://phabricator.wikimedia.org/T204172) (owner: Eileen) [01:44:59] (CR) Ejegg: [C: 2] groupContact BAO - standardize add function [wikimedia/fundraising/crm/civicrm] - https://gerrit.wikimedia.org/r/461016 (owner: Eileen) [01:47:10] (Merged) jenkins-bot: CiviCRM updates to support ContactLayoutEditor [wikimedia/fundraising/crm/civicrm] - https://gerrit.wikimedia.org/r/460998 (https://phabricator.wikimedia.org/T204172) (owner: Eileen) [01:47:12] (PS1) Eileen: Further fix on contactlayout [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/461018 [01:50:56] (Merged) jenkins-bot: groupContact BAO - standardize add function [wikimedia/fundraising/crm/civicrm] - https://gerrit.wikimedia.org/r/461016 (owner: Eileen) [01:53:46] (PS2) Ejegg: Api4 updates (supports contact editor) [wikimedia/fundraising/crm/civicrm] - https://gerrit.wikimedia.org/r/461000 (https://phabricator.wikimedia.org/T204182) (owner: Eileen) [01:53:56] (CR) Ejegg: [C: 2] Api4 updates (supports contact editor) [wikimedia/fundraising/crm/civicrm] - https://gerrit.wikimedia.org/r/461000 (https://phabricator.wikimedia.org/T204182) (owner: Eileen) [01:59:58] (Merged) jenkins-bot: Api4 updates (supports contact editor) [wikimedia/fundraising/crm/civicrm] - https://gerrit.wikimedia.org/r/461000 (https://phabricator.wikimedia.org/T204182) (owner: Eileen) [02:07:29] Alⅼɑһ is dⲟing [02:09:13] (CR) Ejegg: [C: 2] Upstream updates to contact layout extension [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/461007 (https://phabricator.wikimedia.org/T204181) (owner: Eileen) [02:10:35] that spambot's replacement character for the second l makes it look like it's talking about Aaliyah and forgot an a [02:13:56] I think I’m gonna drop this step “email to advise outage is starting” - I feel like the email I just sent is enough [02:14:35] They have been warned! [02:15:06] (Merged) jenkins-bot: Upstream updates to contact layout extension [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/461007 (https://phabricator.wikimedia.org/T204181) (owner: Eileen) [02:23:49] eileen_: I tried cc all, cvapi system.flush, and force-reload in browser, but I still can't get editing to work in the groups profile block with the latest patch [02:24:16] If I click edit it just shows 'save' and 'cancel' buttons with no group list nor lookup [02:24:47] I've got all the civicrm updates you've put up for review [02:26:29] ejegg: hmm I’ll do git pull etc now it’s merged & see if there is something else I haven’t put up [02:31:24] ejegg: hmm doesn’t seem to be anything missing - I wonder if you are testing something different to me & have hit a bug [02:31:28] that I didn’t [02:31:41] when you go to the contact layout editor page does that display OK? [02:31:53] yeah, everything looks good except the groups [02:32:07] when I'm on an individual contact page [02:32:25] (PS1) Eileen: CiviCRM submodule update [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/461020 [02:32:28] When it loaded first, I had one group on the person. Then pressing save removed it [02:32:46] hmm ok - well let’s get everything else out & then figure that out [02:32:49] err, when it loaded first, the single group on the person displayed fine in non-edit mode [02:33:04] then when I clicked edit, there was just the save and cancel button, no group displayed [02:33:13] anyway, yeah, let's do the deploy first [02:33:18] FWIW I only tested groups as a field in a profile with other fields already in it - if it makes a difference [02:33:28] (CR) Eileen: [C: 2] CiviCRM submodule update [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/461020 (owner: Eileen) [02:33:43] ah, I had it in its own block, but in a profile with other blocks [02:33:49] just merging to deployment [02:34:01] let’s screen share & compare - either after or tomorrow [02:34:40] k [02:35:07] are we actually taking campaigns down? Just stopping the q is enough I think [02:35:15] yes [02:35:22] want me to stop that? [02:36:04] yes please [02:37:28] why is zuul always slow when you are watching? [02:37:36] https://gerrit.wikimedia.org/r/#/c/wikimedia/fundraising/crm/+/461020/ [02:37:46] !log disabled fundraising CiviCRM jobs for 5.6 update [02:37:51] Logged the message at https://wikitech.wikimedia.org/wiki/Server_Admin_Log [02:37:58] a watched zuul... never merges? [02:38:55] :-) [02:38:56] ok, those jobs are off [02:38:56] (PS1) Eileen: Merge branch 'master' of https://gerrit.wikimedia.org/r/wikimedia/fundraising/crm into deployment [wikimedia/fundraising/crm] (deployment) - https://gerrit.wikimedia.org/r/461021 [02:39:08] (CR) Eileen: [C: 2] Merge branch 'master' of https://gerrit.wikimedia.org/r/wikimedia/fundraising/crm into deployment [wikimedia/fundraising/crm] (deployment) - https://gerrit.wikimedia.org/r/461021 (owner: Eileen) [02:41:01] (Merged) jenkins-bot: Merge branch 'master' of https://gerrit.wikimedia.org/r/wikimedia/fundraising/crm into deployment [wikimedia/fundraising/crm] (deployment) - https://gerrit.wikimedia.org/r/461021 (owner: Eileen) [02:41:09] Fundraising Sprint Owls, Fundraising Sprint Pluto is still a planet, Fundraising Sprint Queue is pronounced GJif, Fundraising Sprint Raw data can give you salmonella, and 2 others: Mailing data double counting in CiviCRM? - https://phabricator.wikimedia.org/T200240 (Eileenmcnaughton) Just did a c... [02:42:22] you know I just went to do row 3 & found I don’t know what directory to do that in [02:42:45] eileen_: /var/log/remote [02:42:49] on frlog1001 [02:43:13] that is logs from the central syslog collector [02:43:18] ah cool [02:43:20] lotsa fun stuff there [02:43:56] !log civicrm revision changed from b0d7df4e60 to 2d9360cfac [02:44:00] Logged the message at https://wikitech.wikimedia.org/wiki/Server_Admin_Log [02:45:06] ok upgrade is running - won’t take long [02:46:05] hmm fail mail - I thought queues were off ejegg [02:46:47] argh, I didn't say 'y' to 'restart service' [02:46:49] sorry [02:47:17] ohh, there's an issue in a job spec [02:47:22] doesn't say which one [02:47:59] ah crud, new ingenico orphan slayer config was there [02:48:03] need to revert that [02:48:18] eileen_: where can i find the trigger script? [02:48:28] sites/all/modules/wmf_civicrm/4.7.trigger.mysql [02:48:39] ejegg: ah well we’re almost done now [02:48:53] scripts have run except for trigger script [02:49:06] hmm i don''t see it [02:49:54] eileen_: is it the scripts subdir? [02:50:55] yes [02:50:58] sorry [02:51:03] is there anything in the "drop" one that's not in the other? it appears to contain the drops too [02:51:05] np! [02:53:22] i can run that whenever [02:54:59] cwd yeah ignore the drop one- just run the other one [02:55:45] eileen_: ok, good to go now? [02:55:47] yes [02:56:50] eileen_: done [02:56:58] 458 rows [02:57:15] great - we are up to ‘Convince each other for a bit that it all works' [02:57:52] & then restarting the queues [02:58:18] :) [02:59:01] ejegg: wanna restart the queues [02:59:11] sure thing [03:01:16] cwd is replication all good? [03:01:47] !log restarted fundraising CiviCRM jobs [03:01:52] Logged the message at https://wikitech.wikimedia.org/wiki/Server_Admin_Log [03:02:01] yep looks finje [03:02:09] (swedish) [03:02:17] :) [03:02:42] Fundraising Sprint Raw data can give you salmonella, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM, Patch-For-Review: Profile won't save if contact_id is in it - https://phabricator.wikimedia.org/T204181 (Eileenmcnaughton) @NNichols you should be able to re-add this field now as we have depl... [03:05:31] Fundraising Sprint Raw data can give you salmonella, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM: Contact summary screen - tag block not working - https://phabricator.wikimedia.org/T204172 (Eileenmcnaughton) @NNichols you should be able to edit the tag field now in a profile. I have logged 2... [03:06:15] Fundraising Sprint Raw data can give you salmonella, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM, Patch-For-Review: Figure out best way to make current employer ' a movable feast' - https://phabricator.wikimedia.org/T204182 (Eileenmcnaughton) @NNichols you should be able to re-add this fi... [03:06:30] ok all good - I’ll email people to say [03:08:27] \o/ [03:08:36] easiest upgrade ever [03:09:47] cwd yeah - we often just deploy these - but the double whammy of a trigger update & a snaffu last week made that less appealing [03:10:09] yeah, i never did get to the bottom of that [03:15:27] ejegg: that profile isn’t working for me now - but I can’t see problems on live [03:16:01] oh weird [03:16:26] eileen_: it's pretty late here - want to go over that tomorrow? [03:16:39] yeah I think what we deployed is fine [03:16:48] & that is not urgent as I can’t see a prob on live [03:23:24] Allɑh iѕ ⅾoiᥒɡ [05:04:30] Aⅼⅼɑh is ԁⲟіng [05:37:16] Fundraising Sprint Raw data can give you salmonella, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM, Patch-For-Review: Figure out best way to make current employer ' a movable feast' - https://phabricator.wikimedia.org/T204182 (Eileenmcnaughton) [05:37:35] Fundraising Sprint Raw data can give you salmonella, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM, Patch-For-Review: Profile won't save if contact_id is in it - https://phabricator.wikimedia.org/T204181 (Eileenmcnaughton) [05:38:29] Fundraising Sprint Owls, Fundraising Sprint Pluto is still a planet, Fundraising Sprint Queue is pronounced GJif, Fundraising Sprint Raw data can give you salmonella, and 3 others: slow anonymous save - https://phabricator.wikimedia.org/T199753 (Eileenmcnaughton) @LeanneS this should be improved... [05:38:46] Fundraising Sprint Raw data can give you salmonella, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM: Contact summary screen - tag block not working - https://phabricator.wikimedia.org/T204172 (Eileenmcnaughton) [05:39:47] Fundraising Sprint Owls, Fundraising Sprint Pluto is still a planet, Fundraising Sprint Queue is pronounced GJif, Fundraising Sprint Raw data can give you salmonella, and 3 others: slow anonymous save - https://phabricator.wikimedia.org/T199753 (Eileenmcnaughton) [05:40:11] Fundraising Sprint Queue is pronounced GJif, Fundraising Sprint Raw data can give you salmonella, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM, Patch-For-Review: investigate if year summary field are slowing queue - https://phabricator.wikimedia.org/T202446 (Eileenmcnaughton) [05:40:45] Fundraising Sprint Owls, Fundraising Sprint Pluto is still a planet, Fundraising Sprint Queue is pronounced GJif, Fundraising Sprint Raw data can give you salmonella, and 2 others: Mailing data double counting in CiviCRM? - https://phabricator.wikimedia.org/T200240 (Eileenmcnaughton) [05:53:18] Fundraising Sprint Owls, Fundraising Sprint Pluto is still a planet, Fundraising Sprint Queue is pronounced GJif, Fundraising Sprint Raw data can give you salmonella, and 2 others: Import log files not including all skipped rows - https://phabricator.wikimedia.org/T200031 (Eileenmcnaughton) Last... [08:37:02] Alⅼaһ іs doinɡ [09:53:50] Αⅼlah iѕ ԁоiᥒg [09:53:50] s∪n iѕ ᥒot doinɡ Aⅼlаh іѕ ԁoⅰᥒg [12:28:47] Allаh іs ԁοing [12:28:47] ѕ∪ᥒ iѕ not ԁοiᥒg Allaһ ⅰs ԁοinɡ [12:28:47] mooᥒ is ᥒഠt dⲟing Ꭺⅼlah is ԁoing [12:46:57] Wikimedia-Fundraising-CiviCRM: Civi access for Rosie Lewis - https://phabricator.wikimedia.org/T204607 (CaitVirtue) Approved [13:46:12] Jeff_Green, I think it might be due to them both producing different rates [13:46:57] I think different fx vendors produce different end of day rates depending on who they use as the benchmark [13:47:32] That's bizarre, how can markets function that way? [13:47:48] Also it looks like you can query oanda's historical tables directly from google sheets [13:48:42] my thinking is that any way this can be accomplished directly within Google Sheets is preferable to creating dependencies on three teams to achieve the same thing [13:50:27] spot fx will be traded at numerous different "venues" across the country/world all having their own end of day prices. such as centralised exchanges (CMEX) to OTC/Interbank/Other venues which have their own prices. The different pricing is what keeps currency arbitrage alive and well [13:51:12] oh really, so we can get oanda via the google wrapper functions? I'll take a look at your links [13:52:10] lemme add a link, I didn't included it yet b/c I didn't understand how google's data would be less than sufficient for this purpose [13:53:00] https://productforums.google.com/forum/#!topic/docs/8KFGMOAQqIk [13:53:24] oanda are a third party broker really, taking prices from the "interbank" rate [13:53:43] where the banks decide amongst themselves how much they like each currency [13:53:48] yeah [13:55:12] also I have no idea if our oanda contract gives us direct access to the data in question [13:57:23] hmmm that looks like to me someone is effectively hitting the public facing api [13:57:52] which I don't know if you can access for commercial purposes freely [13:58:06] I imagine our account is a specific API access account [13:58:23] maybe there's an authenticated API you can hit directly with a contract [13:58:24] and the latter is at risk of oanda blocking/changing how it works [13:59:13] Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM: Civi: searches yielding DB error: syntax error - https://phabricator.wikimedia.org/T204712 (MBeat33) [13:59:14] we might run into problems sending auth values, if they are sent as custom headers [13:59:31] I'll see if I can out via our integration with oanda, how we auth at current [14:01:10] We could call and ask them if it's possible to integrate to Sheets this way, and if so how? Worst case it's a no. [14:01:55] would we be happy putting out credentials within the google sheet function space? [14:02:00] putting our* [14:02:21] I guess it's only wmf staff who have access to the doc [14:02:35] either way we're talking about putting credentials there [14:02:59] it's also concievable they'll tell us it's fine to use the public API [14:03:15] seems unlikely but you never know [14:04:36] actually [14:04:46] it looks like that person is scraping the data [14:04:52] and not hitting an api [14:04:55] I missed this part: [14:05:02] =index(importHTML("http://www.oanda.com/currency/historical-rates-classic?date_fmt=normal&dat [14:05:08] importHTML( [14:05:09] ya [14:05:31] that could get messy [14:05:40] this exact approach doesn't seem awesome [14:06:47] but I've gotta think the problem of using oanda historical data in google sheets is something that comes up all the time, so they probably have an answer either way if we ask [14:07:50] also how far off can they be from Google Finance, and how do we know which exchange rate is actually more appropriate in the context of employee expense reports [14:08:51] I just feel like we're working awfully hard, and ending up at a pretty arcane solution for this problem. [14:08:54] Jeff_Green, https://github.com/wikimedia/wikimedia-fundraising-crm/blob/master/sites/all/modules/exchange_rates/retrievers/OandaRetriever.php#L47 [14:09:06] looks like we're using auth headers [14:09:36] I think reaching out to them is a good idea [14:09:53] dstrine, are you about? [14:18:56] Jeff_Green, I've sent a note over to pats to see if she has a contact we can discuss it with [14:19:07] cool, thanks [14:19:08] catch up on it later [15:00:36] jgleeson|away / Jeff_Green / cwd we wouldn't want to hit the OANDA API from the google sheet even if we could - we pay for a certain amount of lookups, and do them each day from the Civi job [15:01:07] we don't want to look everything up twice just so we can use it for donation conversion + expense reports [15:02:41] is the projected traffic from employee timesheets really significant in the face of the donor traffic? it seems like it would be a blip [15:03:40] in civi, we have a nightly job that looks up all currency rates once per day, then those are stored in the db for use converting donations [15:04:02] right [15:04:06] for expense reports we would do the same, right? [15:04:13] but store them in a sheet? [15:04:40] or is the idea to somehow only look things up once when someone submits an expense in that currency? [15:04:55] i dunno [15:05:18] seems to me the google finance data would be good enough for reimbursements [15:05:23] what's the problem with copying the data from the db to the sheets? [15:05:42] Jeff_Green: yeah, but for some reason finance dept wants OANDA [15:06:59] Aⅼlaһ іѕ doіng [15:06:59] ѕuᥒ iѕ ᥒοt doinɡ Allah іs doing [15:06:59] ⅿοon ⅰs not ԁഠіᥒɡ Aⅼⅼɑh iѕ doⅰᥒg [15:07:10] I look at it as an entropy thing...on the one hand we could have a solution that's entirely in Sheets and when it breaks there would be one place to look, and framework to understand, thus a task for one person. The proposed thing involves knowledge of Sheets, plus access and knowledge of Civi code, plus knowledge and access for the Ops aspect. [15:07:30] It's a lot of places where it can break, and it will be a runaround if/when it happens to figure out who has to fix it. [15:08:31] consider how much time it's already taken to try to architect it [15:15:52] !log updated process-control to f9ab984c5d [15:15:57] Logged the message at https://wikitech.wikimedia.org/wiki/Server_Admin_Log [15:16:07] ejegg i think i just enabled the orphan slayer, i'm not totally sure if it wasn't already enabled? [15:16:35] Fundraising Sprint Raw data can give you salmonella, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM: Contact summary screen - tag block not working - https://phabricator.wikimedia.org/T204172 (NNichols) @Eileenmcnaughton Yes! I have tested it out on a few profiles (individual and org) and it loo... [15:16:44] mepps it wasn't - I saw that file last night when I was turning the jobs off and on [15:17:02] it had the command commented out instead of the schedule, which was causing a yaml parse error [15:17:05] so I changed that [15:18:58] Fundraising Sprint Raw data can give you salmonella, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM, Patch-For-Review: Profile won't save if contact_id is in it - https://phabricator.wikimedia.org/T204181 (NNichols) @Eileenmcnaughton Yes! I added the contact ID back into the block we origina... [15:19:19] !log updated process-control to c03857f6a6 [15:19:24] Logged the message at https://wikitech.wikimedia.org/wiki/Server_Admin_Log [15:19:36] gotcha ejegg, okay then i just enabled the job [15:20:12] Aⅼlɑh іs ԁoⅰng [15:21:29] Fundraising Sprint Raw data can give you salmonella, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM, Patch-For-Review: Figure out best way to make current employer ' a movable feast' - https://phabricator.wikimedia.org/T204182 (NNichols) @Eileenmcnaughton You ARE the best. It works great.... [15:37:57] he jgleeson|away just signing on. thanks for looking at oanda. [15:40:46] Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM: Civi: some CIDs not opening - https://phabricator.wikimedia.org/T204731 (MBeat33) [15:45:09] Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM: Civi: some CIDs not opening - https://phabricator.wikimedia.org/T204731 (MBeat33) [15:45:52] fr-tech were you able to meet for this? Is it updated? https://phabricator.wikimedia.org/T204480 [15:48:10] dstrine: ah yeah, that's updated [15:52:36] fr-tech anyone have any idea where this non-functional "CollabPad" tab comes from on the CN admin UI on the beta cluster? https://meta.wikimedia.beta.wmflabs.org/wiki/Special:CentralNotice [15:53:01] ooh, weird [15:53:26] yeah [15:53:43] I was just checking stuff ahead of adding all CN updates to the train [15:54:33] Hmm it's also elsewhere, see the top of this: https://meta.wikimedia.beta.wmflabs.org/wiki/Special:SpecialPages [15:55:56] fr-tech MBeat just created this. I'm wondering if it is due to civi stuff last night. I agree it's probably close if not counts for UNB: https://phabricator.wikimedia.org/T204731 [15:56:39] also I may not emerge from meetings until 11:30am pacific so please discuss in my absence [15:57:32] fr-tech ejegg for simplicity, I'm only going to put the performance team's thing on today's CentralNotice train. They've been waiting for that for a while... Nothing else seems urgent in the backloged CN stuff, and I want to figure out what's odd on the beta cluster before doing a more general deploy [15:57:41] sound good? [15:58:47] (PS1) AndyRussG: Add performance mark for when banner is inserted [extensions/CentralNotice] (wmf_deploy) - https://gerrit.wikimedia.org/r/461151 (https://phabricator.wikimedia.org/T195840) [15:59:50] also thanks jgleeson|away for talking to Tony. [16:00:21] (CR) AndyRussG: [C: 2] Add performance mark for when banner is inserted [extensions/CentralNotice] (wmf_deploy) - https://gerrit.wikimedia.org/r/461151 (https://phabricator.wikimedia.org/T195840) (owner: AndyRussG) [16:00:41] oh lol UNB=UBN :P [16:03:53] (CR) jerkins-bot: [V: -1] Add performance mark for when banner is inserted [extensions/CentralNotice] (wmf_deploy) - https://gerrit.wikimedia.org/r/461151 (https://phabricator.wikimedia.org/T195840) (owner: AndyRussG) [16:30:15] wait wat? looks like we missed the train [16:30:28] There's now an earlier "European Train" [16:30:34] Oh well, I can book a SWAT slot [16:33:14] (CR) jenkins-bot: Add performance mark for when banner is inserted [extensions/CentralNotice] (wmf_deploy) - https://gerrit.wikimedia.org/r/461151 (https://phabricator.wikimedia.org/T195840) (owner: AndyRussG) [16:34:21] Wikimedia-Fundraising, MediaWiki-extensions-NavigationTiming, Performance-Team, Patch-For-Review: Track when a CentralNotice banner was displayed to the user in NavTiming - https://phabricator.wikimedia.org/T195840 (Addshore) It looks like this has been merged but left un deployed on the wmf.20 b... [16:39:49] Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM: Civi: some CIDs not opening - https://phabricator.wikimedia.org/T204731 (MBeat33) Kind of a longshot, but the CID above has a _ in the email address; other CIDs without that seem to load. [16:48:34] (PS1) Thcipriani: Revert "Add performance mark for when banner is inserted" [extensions/CentralNotice] (wmf_deploy) - https://gerrit.wikimedia.org/r/461163 [16:52:35] (CR) Thcipriani: [C: 2] "Reverting as this was pulled down to deployment servers unintentionally." [extensions/CentralNotice] (wmf_deploy) - https://gerrit.wikimedia.org/r/461163 (owner: Thcipriani) [17:01:07] (CR) jerkins-bot: [V: -1] Revert "Add performance mark for when banner is inserted" [extensions/CentralNotice] (wmf_deploy) - https://gerrit.wikimedia.org/r/461163 (owner: Thcipriani) [17:04:48] cwd or Jeff_Green we're looking to reconstruct some data that donationInterface corrupted, but should hopefully be in the web logs from last thursday [17:05:04] can we get access to the payments server web logs from then please? [17:05:51] sure, for which processor? [17:06:10] (CR) Thcipriani: Revert "Add performance mark for when banner is inserted" [extensions/CentralNotice] (wmf_deploy) - https://gerrit.wikimedia.org/r/461163 (owner: Thcipriani) [17:06:14] (CR) Thcipriani: [C: 2] Revert "Add performance mark for when banner is inserted" [extensions/CentralNotice] (wmf_deploy) - https://gerrit.wikimedia.org/r/461163 (owner: Thcipriani) [17:06:32] the paypal form was screwing up the meaning of opt_in querystring param [17:06:50] fr-tech I think I'll skip tech-talk today, try to make progress with translate stuff, is that okok? [17:07:42] cwd so if you wanted to filter for requests to PaypalExpressGateway that would work [17:07:54] AndyRussG: sounds fine [17:08:03] ejegg: okok thx! [17:08:11] we're just looking into fixing data from a paymentswiki bug [17:08:22] okok have fun! [17:13:31] ejegg: this wouldn't be part of what makes it to /var/log/remote? [17:13:53] cwd no, we don't log the raw querystrings [17:14:14] ok, these are probably spread out across the payments servers [17:14:28] i'll gather them together [17:14:30] and by the time we send the pending message we'd already corrupted the value [17:14:33] thanks! [17:14:42] np [17:15:13] (Merged) jenkins-bot: Revert "Add performance mark for when banner is inserted" [extensions/CentralNotice] (wmf_deploy) - https://gerrit.wikimedia.org/r/461163 (owner: Thcipriani) [17:24:38] (CR) jenkins-bot: Revert "Add performance mark for when banner is inserted" [extensions/CentralNotice] (wmf_deploy) - https://gerrit.wikimedia.org/r/461163 (owner: Thcipriani) [17:35:35] Ꭺlⅼaһ is ⅾоіng [17:35:35] ѕun іѕ not dοiᥒɡ Allɑh іs ⅾഠіng [17:35:35] mഠon is ᥒⲟt doiᥒg Аlⅼаh іѕ dⲟⅰnɡ [17:39:59] joke is on them, my laptop has very few of those code points [17:42:47] https://www.whois.com/whois/156.218.194.154 [17:45:10] oh hey, spam report email addy [17:47:48] MBeat and fr-tech We're putting en2C up again momentarily if that's ok. This is for a 24-hr test (that we couldn't complete last week, due the PayPal form error). [17:48:19] Sure tskaff! [17:48:31] thanks for headsup, tskaff [17:48:51] Cool! [17:48:56] fr-tech is just now working on trying to rescue the opt_in data from last week's test - we think we can reconstruct the donors' actual choices from web logs [17:49:48] Thanks ejegg, that would be amazing, let us know! [17:50:55] ejegg: in the ind the data doesn't go through the main Varnish and into Hive, then? [17:50:59] end [17:51:31] cwd / Jeff_Green the payments cluster doesn't share varnish boxes with the main cluster, does it? [17:51:44] nope [17:51:58] we have no varnish caching [17:53:08] cwd: but does the webrequest go through the main varnish somehow? [17:53:50] as in, do fr boxes directly fact the internet with public IPs set to our domain names? [17:54:04] yeah basically [17:54:24] cwd: so no interaction at all with the Varnishes on the main cluster, right? [17:54:59] *face [17:55:10] i am pretty sure that is correct [17:55:15] ah ok... thx [17:55:17] our servers advertise public IPs [17:55:59] but my understanding is they are "actually" on the external interfaces of the firewall [17:56:09] $ host payments.wikimedia.org [17:56:11] payments.wikimedia.org has address 208.80.155.5 [17:56:56] yeah so if you look on payments you would actually see loopback set to that [17:57:19] hmmm [17:58:06] tskaff: are we likely to also test en2C or 6C again later this week? [17:59:01] So today would be the en2C 24 hour test; then we'd like to test 4C Wednesday again (the usual time), if that all works for you? [17:59:09] AndyRussG: so when it arrives at the firewall (the public interface) it sees payments as the final destination [17:59:25] and then pybal does a thing i don't understand very well [18:00:55] so from my connection i see a couple wikimedia related hops before pfw [18:01:57] cwd: ah ok thx... Yeah I'm just quickly looking in Hive to see if by chance there is anything [18:05:19] AndyRussG: what kind of anything? [18:05:55] cwd: any records of webrequests to payments [18:06:13] to see if that's a place to look for opt-in data ^ [18:06:36] So far nothing [18:08:25] yeah so it looks like it's some load balancer thing that sends the request directly on to the FR cluster [18:08:35] so no chance for the data to go into Hive [18:09:02] MBeat: We'd like to test 4C Wednesday again (the usual time), if that works for you? [18:09:36] sure thing, that’s better than thursday actually, ty tskaff [18:10:26] Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM: Civi: some CIDs not opening - https://phabricator.wikimedia.org/T204731 (mepps) @ejegg @eileen I just tried to go to this CID and it seems to have timed out. This is not happening on all cids. [18:13:03] cwd ejegg fr-tech yeah just double-checked, no payments webrequest data in Hive, at least that I could find [18:13:30] Using this Hive query: select * from wmf.webrequest where uri_host like 'payments%' and year = 2018 and month = 9 and day = 15 limit 5; [18:17:34] yeah the load balancer is pybal [18:17:39] on the pay-lvs servers [18:18:12] but they are also behind the firewall which is the pfw address [18:27:56] Alⅼɑh is dοinɡ [18:27:56] ѕᥙᥒ iѕ ᥒഠt ⅾoiᥒɡ Αlⅼаh іs ԁoіng [18:42:29] cwd: yea makes sense [18:42:47] Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM, fundraising-tech-ops: Can we track number of deadlocks - https://phabricator.wikimedia.org/T204597 (cwdent) Open>Resolved @Eileenmcnaughton looks like we already do: https://grafana.wikimedia.org/dashboard/db/fundraising-database?panelId=29&... [19:06:03] Alⅼаh is ԁⲟіnɡ [19:26:49] Jeff_Green, https://phabricator.wikimedia.org/T200227#4595229 [19:27:03] looks like we can go direct from Google sheets [19:28:15] wow nice [19:34:45] AndyRussG: meeting? [19:35:26] Fundraising Sprint Pluto is still a planet, Fundraising Sprint Queue is pronounced GJif, Fundraising Sprint Raw data can give you salmonella, Fundraising-Backlog, and 3 others: Deal with Ingenico Connect code 300620: MerchantReference XXXX already exists - https://phabricator.wikimedia.org/T201773 (... [19:35:28] Fundraising Sprint Queue is pronounced GJif, Fundraising Sprint Raw data can give you salmonella, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM, Patch-For-Review: Thank You email for Stripe Import - https://phabricator.wikimedia.org/T202099 (Ejegg) Open>Resolved [19:35:53] XenoRyet: one sec! [19:49:08] Fundraising Sprint Raw data can give you salmonella, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM: Unable to make edits from Summary Screen - https://phabricator.wikimedia.org/T203266 (Eileenmcnaughton) [19:49:11] Fundraising Sprint Raw data can give you salmonella, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM, Patch-For-Review: Figure out best way to make current employer ' a movable feast' - https://phabricator.wikimedia.org/T204182 (Eileenmcnaughton) Open>Resolved [19:50:27] Fundraising Sprint Raw data can give you salmonella, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM: Unable to make edits from Summary Screen - https://phabricator.wikimedia.org/T203266 (Eileenmcnaughton) [19:50:33] Fundraising Sprint Raw data can give you salmonella, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM, Patch-For-Review: Profile won't save if contact_id is in it - https://phabricator.wikimedia.org/T204181 (Eileenmcnaughton) Open>Resolved [19:50:59] Fundraising Sprint Raw data can give you salmonella, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM: Unable to make edits from Summary Screen - https://phabricator.wikimedia.org/T203266 (Eileenmcnaughton) [19:51:02] Fundraising Sprint Raw data can give you salmonella, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM: Contact summary screen - tag block not working - https://phabricator.wikimedia.org/T204172 (Eileenmcnaughton) Open>Resolved [19:56:38] Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM: dedupe failmails since yesterday's civi update - https://phabricator.wikimedia.org/T204760 (Eileenmcnaughton) [20:09:00] Fundraising-Backlog: Review emergency procedures for holidays - https://phabricator.wikimedia.org/T204763 (DStrine) [20:11:58] Fundraising Sprint Karma chameleons hide amongst us, Fundraising Sprint Lactose is unusually tolerant, Fundraising Sprint Matt Damon to head up Space Force, Fundraising Sprint Naming Sprints Is Not Important, and 10 others: Create Ingenico orphan rectifier ... - https://phabricator.wikimedia.org/T163949 [20:12:04] Fundraising Sprint Queue is pronounced GJif, Fundraising Sprint Raw data can give you salmonella, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM, Patch-For-Review: investigate if year summary field are slowing queue - https://phabricator.wikimedia.org/T202446 (Eileenmcnaughton) Open>... [20:13:12] Fundraising Sprint Raw data can give you salmonella, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM: Civi: did script delete a contact's email address? - https://phabricator.wikimedia.org/T203198 (Eileenmcnaughton) Open>Resolved [20:17:01] Fundraising Sprint Queue is pronounced GJif, Fundraising-Backlog, MediaWiki-extensions-DonationInterface, Patch-For-Review: Use Composer merge plugin for payments-wiki - https://phabricator.wikimedia.org/T185547 (DStrine) [20:19:14] Fundraising-Backlog, Fr-CentralNotice-Translation-Bugs, MediaWiki-extensions-CentralNotice, MediaWiki-extensions-Translate, and 2 others: "Internal error" on testwiki's Special:LanguageStats due to non-existing CentralNotice banner - https://phabricator.wikimedia.org/T157997 (Krinkle) @DStrine St... [20:22:29] Fundraising Sprint Raw data can give you salmonella, Fundraising-Backlog: Deploy French Thank you letter translation - https://phabricator.wikimedia.org/T204480 (jgleeson) Open>Resolved [20:24:24] Fundraising Sprint Naming Sprints Is Not Important, Fundraising Sprint Owls, Fundraising Sprint Pluto is still a planet, Fundraising Sprint Queue is pronounced GJif, and 3 others: Investigate why Ingenico donation did not recur on 6/14 - https://phabricator.wikimedia.org/T199331 (DStrine) [20:25:57] Fundraising Sprint Queue is pronounced GJif, Fundraising Sprint Raw data can give you salmonella, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM, Patch-For-Review: Corporate Gift selection for Engage instance - https://phabricator.wikimedia.org/T201883 (Eileenmcnaughton) [20:26:20] Fundraising Sprint Queue is pronounced GJif, Fundraising Sprint Raw data can give you salmonella, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM: FY17-18 total not reflected in WMF Donor section - https://phabricator.wikimedia.org/T202102 (DStrine) [20:26:33] Fundraising Sprint Pluto is still a planet, Fundraising Sprint Queue is pronounced GJif, Fundraising Sprint Raw data can give you salmonella, Fundraising-Backlog, Unplanned-Sprint-Work: Inserting Images into Civi mail - https://phabricator.wikimedia.org/T202330 (DStrine) [20:28:20] Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM: Civi: some CIDs not opening - https://phabricator.wikimedia.org/T204731 (DStrine) p:Triage>Unbreak! [20:35:06] Fundraising-Backlog, MediaWiki-extensions-DonationInterface: Update FormChooser settings, coordinate with fr-online - https://phabricator.wikimedia.org/T204768 (Ejegg) [20:35:27] Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM: Reconstruct opt_in data from buggy paypal form - https://phabricator.wikimedia.org/T204769 (Ejegg) [20:37:19] Fundraising Sprint S 2018, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM: Civi: some CIDs not opening - https://phabricator.wikimedia.org/T204731 (DStrine) [20:37:22] Fundraising Sprint Raw data can give you salmonella, Fundraising Sprint S 2018, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM: Unable to make edits from Summary Screen - https://phabricator.wikimedia.org/T203266 (DStrine) [20:37:26] Fundraising Sprint Raw data can give you salmonella, Fundraising Sprint S 2018, Fundraising-Backlog, Language-Team, and 4 others: Save times for changes to translation variable text in centralnotice paralysingly slow - https://phabricator.wikimedia.org/T203925 (DStrine) [20:37:32] Fundraising Sprint S 2018, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM: Reconstruct opt_in data from buggy paypal form - https://phabricator.wikimedia.org/T204769 (DStrine) [20:37:34] Fundraising Sprint S 2018, Fundraising-Backlog: Review emergency procedures for holidays - https://phabricator.wikimedia.org/T204763 (DStrine) [20:37:39] Fundraising Sprint S 2018, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM: dedupe failmails since yesterday's civi update - https://phabricator.wikimedia.org/T204760 (DStrine) [20:37:41] Fundraising Sprint S 2018, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM: Civi: searches yielding DB error: syntax error - https://phabricator.wikimedia.org/T204712 (DStrine) [20:37:43] Fundraising Sprint Raw data can give you salmonella, Fundraising Sprint S 2018, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM: RichText fields munged - https://phabricator.wikimedia.org/T204179 (DStrine) [20:37:45] Fundraising Sprint Pluto is still a planet, Fundraising Sprint Queue is pronounced GJif, Fundraising Sprint Raw data can give you salmonella, Fundraising Sprint S 2018, and 2 others: Banner previews occasionally fail to load - https://phabricator.wikimedia.org/T200853 (DStrine) [20:37:48] Fundraising Sprint S 2018, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM: Benevity import errors - https://phabricator.wikimedia.org/T204008 (DStrine) [20:37:50] Fundraising Sprint Owls, Fundraising Sprint Pluto is still a planet, Fundraising Sprint Queue is pronounced GJif, Fundraising Sprint Raw data can give you salmonella, and 3 others: Import log files not including all skipped rows - https://phabricator.wikimedia.org/T200031 (DStrine) [20:37:52] Fundraising Sprint Asymmetrical Earth Theory, Fundraising Sprint Bermuda Rhombus (where things disappear then reappear), Fundraising Sprint Cottage Cheese isn't Made of Cottages, Fundraising Sprint Dinosaur Cookies co-existed with Gingerbread People, and 2... - https://phabricator.wikimedia.org/T178930 [20:37:55] Fundraising Sprint Karma chameleons hide amongst us, Fundraising Sprint Lactose is unusually tolerant, Fundraising Sprint Matt Damon to head up Space Force, Fundraising Sprint Naming Sprints Is Not Important, and 7 others: New scripts to ingress data from K... - https://phabricator.wikimedia.org/T195594 [20:37:57] Fundraising Sprint Owls, Fundraising Sprint Pluto is still a planet, Fundraising Sprint Queue is pronounced GJif, Fundraising Sprint Raw data can give you salmonella, and 4 others: slow anonymous save - https://phabricator.wikimedia.org/T199753 (DStrine) [20:37:59] Fundraising Sprint Gravity wasn't always this pushy, Fundraising Sprint HTTP originally stood for Happy Turtle Transfer Protocol, Fundraising Sprint Ivory and eggshell white are the same color, Fundraising Sprint Junebugs prefer July, and 11 others: Ingenic... - https://phabricator.wikimedia.org/T190098 [20:38:01] Fundraising Sprint Lactose is unusually tolerant, Fundraising Sprint Matt Damon to head up Space Force, Fundraising Sprint Naming Sprints Is Not Important, Fundraising Sprint Owls, and 5 others: DB schemas (production changes and test DB) and SQL commands ... - https://phabricator.wikimedia.org/T196564 [20:38:03] Fundraising Sprint Lactose is unusually tolerant, Fundraising Sprint Matt Damon to head up Space Force, Fundraising Sprint Naming Sprints Is Not Important, Fundraising Sprint Owls, and 5 others: Write a specification for mapping banner/landing page impressi... - https://phabricator.wikimedia.org/T196563 [20:38:05] Fundraising Sprint Raw data can give you salmonella, Fundraising Sprint S 2018, Fundraising-Backlog, FR-Amazon, and 3 others: Support Amazon payments initiated off paymentswiki - https://phabricator.wikimedia.org/T194317 (DStrine) [20:38:07] Fundraising Sprint Pluto is still a planet, Fundraising Sprint Queue is pronounced GJif, Fundraising Sprint Raw data can give you salmonella, Fundraising Sprint S 2018, and 3 others: Create opt-IN page for fundraisingEmailUnsubscribe, consume messages - https://phabricator.wikimedia.org/T200576 (D... [20:38:09] Fundraising Sprint Owls, Fundraising Sprint Pluto is still a planet, Fundraising Sprint Queue is pronounced GJif, Fundraising Sprint Raw data can give you salmonella, and 3 others: Queries and maybe scripts to verify equivalence of data in new-Kafka-pipelin... - https://phabricator.wikimedia.org/T198752 [20:38:11] Fundraising Sprint Raw data can give you salmonella, Fundraising Sprint S 2018, Fundraising-Backlog, Epic: Update EventLogging schema for CentralNotice - https://phabricator.wikimedia.org/T203499 (DStrine) [20:38:13] Fundraising Sprint Raw data can give you salmonella, Fundraising Sprint S 2018, Fundraising-Backlog, Fr-Ingenico-integration_2017-18, and 2 others: Ingenico Recurring: Card rejection is not a cause for failmail - https://phabricator.wikimedia.org/T203291 (DStrine) [20:38:15] Fundraising Sprint Owls, Fundraising Sprint Pluto is still a planet, Fundraising Sprint Queue is pronounced GJif, Fundraising Sprint Raw data can give you salmonella, and 3 others: Mailing data double counting in CiviCRM? - https://phabricator.wikimedia.org/T200240 (DStrine) [21:21:12] Allaһ is doing [21:26:00] Fundraising Sprint Sasquatches can't find us either, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM: Civi: searches yielding DB error: syntax error - https://phabricator.wikimedia.org/T204712 (Eileenmcnaughton) a:Eileenmcnaughton [21:26:14] Fundraising Sprint Sasquatches can't find us either, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM: Civi: some CIDs not opening - https://phabricator.wikimedia.org/T204731 (Eileenmcnaughton) a:Eileenmcnaughton [21:26:58] Fundraising Sprint Sasquatches can't find us either, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM: dedupe failmails since yesterday's civi update - https://phabricator.wikimedia.org/T204760 (Eileenmcnaughton) a:Eileenmcnaughton [22:37:03] (PS1) Eileen: Early return on no contact. [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/461242 [22:37:56] (PS1) Eileen: Fix fatal on empty result - don't interact with cache if no contacts [wikimedia/fundraising/crm/civicrm] - https://gerrit.wikimedia.org/r/461243 (https://phabricator.wikimedia.org/T204712) [22:42:48] Aⅼlɑһ iѕ doing [22:42:49] ѕun is nοt doiᥒg Allaһ is ԁоing [22:42:49] ⅿooᥒ is ᥒot doіᥒg Αⅼⅼah іs doⅰᥒɡ [22:44:19] I just put up a patch for the empty search fatal error - https://gerrit.wikimedia.org/r/#/c/wikimedia/fundraising/crm/civicrm/+/461243/ [22:48:37] mepps: I don’t yet know if he can but I asked Tim if he can join us for tech talk tomorrow (as a billable hour for him) [22:49:36] Cool eileen [23:15:05] (PS1) Eileen: WIP fix for cache miss [wikimedia/fundraising/crm/civicrm] - https://gerrit.wikimedia.org/r/461248 (https://phabricator.wikimedia.org/T204731) [23:59:50] (PS1) Eileen: Remove another cache bypass [wikimedia/fundraising/crm/civicrm] - https://gerrit.wikimedia.org/r/461257