[07:22:39] fundraising-tech-ops, Operations, netops: adjust NAT mapping for frdata.wikimedia.org - https://phabricator.wikimedia.org/T196656#4270975 (ayounsi) a:ayounsi This needs to be pushed for the NAT change: ```lang=diff [edit security nat static rule-set static-nat rule public-reporting then static-na... [13:04:58] (PS9) Mepps: Move errored messages to damaged queue [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/430800 (https://phabricator.wikimedia.org/T191654) [13:05:00] (PS1) Mepps: Update composer with latest, especially new damaged database in smashpig [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/439590 [13:12:12] Fundraising Sprint Karma chameleons hide amongst us, Fundraising Sprint Lactose is unusually tolerant, Fundraising-Backlog, Patch-For-Review: Help switch over foundation pages to donate wiki - https://phabricator.wikimedia.org/T193663#4271982 (mepps) @ejegg Let's chat today about when to deploy t... [13:14:52] (PS4) Mepps: Change documentation variables and test to outline where changes are needed Also, update templates with direct links [extensions/DonationInterface] - https://gerrit.wikimedia.org/r/437357 (https://phabricator.wikimedia.org/T193663) [13:16:05] (PS5) Mepps: Change documentation variables and test to outline where changes are needed [extensions/DonationInterface] - https://gerrit.wikimedia.org/r/437357 (https://phabricator.wikimedia.org/T193663) [13:16:53] (PS1) Mepps: Also, update templates with direct links [extensions/DonationInterface] - https://gerrit.wikimedia.org/r/439592 (https://phabricator.wikimedia.org/T193663) [14:42:53] hey ejegg|away, just caught your email to ingenico. I've had some issues creating hosting checkouts with ingenico, did the credentials for https://api-sandbox.globalcollect.com/ change? [14:46:36] jgleeson: the email about payment ids? [14:46:54] yeah, unrelated to my question [14:46:59] ah, ok [14:47:27] i don't think the creds have changed, but i haven't tried this morning [14:47:36] what errors do you get? [14:48:16] POST request to https://api-sandbox.globalcollect.com/v1/2930/hostedcheckouts failed 3 times [14:48:34] and if I browse to that URL the cert is invalid, but not sure if we're verifying ssl [14:48:43] huh, that sounds more like connection errors [14:48:44] s/ssl/tls/ [14:48:50] oh, huh! [14:49:04] expired? [14:49:16] nope dates look ok [14:49:31] I'll try again [14:49:39] might be intermittent [14:49:48] Fundraising-Backlog: Machine Learning for Fraud Detection - https://phabricator.wikimedia.org/T190523#4272392 (saurabhbatra96) declined>Open [14:50:06] ahhhh [14:50:08] actually [14:50:14] do we need to be on the VPN to test with ingenico? [14:50:23] maybe it's that and I've forgotten [14:50:35] jgleeson: not the Connect API [14:50:42] at least not till now [14:51:14] Fundraising-Backlog: Machine Learning for Fraud Detection - https://phabricator.wikimedia.org/T190523#4075836 (saurabhbatra96) Hi @srishakatux , reopening this because the project is still underway and we're tracking here, removed the GSoC tag though. [14:53:02] still seems to be failing. I've gotta jump off now for a physio appointment but will be back later. Hopefully it will be back! [15:24:07] hmm ejegg i'm getting an ssl error too.. [15:24:12] with ingenico locally [15:28:26] oh i see you're still away elliott [15:30:55] Fundraising Sprint Karma chameleons hide amongst us, Fundraising Sprint Lactose is unusually tolerant, Fundraising-Backlog, Patch-For-Review: Help switch over foundation pages to donate wiki - https://phabricator.wikimedia.org/T193663#4272574 (Pcoombe) @mepps I'm still working on some design chan... [15:32:26] Fundraising Sprint Karma chameleons hide amongst us, Fundraising Sprint Lactose is unusually tolerant, Fundraising-Backlog, Patch-For-Review: Help switch over foundation pages to donate wiki - https://phabricator.wikimedia.org/T193663#4272578 (mepps) Thanks @pcoombe! Also @dstrine for your planni... [15:32:41] mepps: ok, i'm getting an error too [15:32:56] I guess one of us should write to merchantservices [15:54:12] ejegg would that be jerry? [15:58:02] mepps we can cc him [15:58:19] merchantservices@ is the generic help address [16:23:59] oh hey, my error was totally unrelated [16:24:20] I updated to php7.2 and for some reason that deleted php-curl liv [16:24:22] *lib [16:25:25] or... hmm, looks like it's still there? [16:25:30] but curl_init isn't found [16:26:51] ohhh, weird, php7.0-fpm is still running [16:29:24] ugh, and php7.2-fpm is all 'bad gateway'... [16:29:34] that'll teach me not to dist-upgrade [16:48:26] mepps, I see you are having issues also [16:48:47] (CR) Imarlier: [C: 1] Add performance mark for when banner is inserted [extensions/CentralNotice] - https://gerrit.wikimedia.org/r/436792 (https://phabricator.wikimedia.org/T195840) (owner: Gilles) [16:48:48] is it convenient for you to write the email or do you want me to put one together? [16:48:51] yeah jgleeson--i was going to email merchatnservices [16:48:58] ok great, thanks! [17:03:47] hmm should we see if this is affecting prod too? [17:04:45] okay looks like prod is working at least [17:10:38] (PS1) Ejegg: Update Ingenico API sandbox URL [wikimedia/fundraising/SmashPig] - https://gerrit.wikimedia.org/r/439630 [17:11:01] (CR) jerkins-bot: [V: -1] Update Ingenico API sandbox URL [wikimedia/fundraising/SmashPig] - https://gerrit.wikimedia.org/r/439630 (owner: Ejegg) [17:11:54] ah, needs test updates ^^^ [17:13:25] hmm, also, could not resolve that other url... [17:19:39] https://epayments-api.developer-ingenico.com/s2sapi/v1/en_US/java/endpoints.html [17:19:42] aha [17:20:19] mepps / jgleeson: it's 'https://eu.sandbox.api-ingenico.com' [17:20:49] just got a request through [17:23:07] (PS2) Ejegg: Update Ingenico API sandbox URL [wikimedia/fundraising/SmashPig] - https://gerrit.wikimedia.org/r/439630 [17:25:51] ejegg for future reference, where did you find that url? [17:26:19] (PS1) Ejegg: Make sure we're adding numbers in AdyenAudit [wikimedia/fundraising/SmashPig] - https://gerrit.wikimedia.org/r/439634 [17:26:36] mepps at https://epayments-api.developer-ingenico.com/s2sapi/v1/en_US/java/endpoints.html [17:28:04] hmm ejegg i can see the request going through now in the log but i'm still getting an error message.. [17:28:13] what's the error message now? [17:29:40] nothing in the logs ejegg but i'm seeing this alert: There was an error processing your request. [17:31:12] mepps huh, do you get the RETURNED FROM CURL line in the log? [17:31:23] with a partialRedirectUrl? [17:31:42] yup ejegg [17:32:03] mepps and after that, 'Adding response data' ? [17:32:35] then a few lines later, 'Redirecting for transaction' ? [17:34:12] whew, php7.2 is a LOT stricter than 7.0 [17:34:29] I'mma have to fix a lot of stuff in di to get tests passing [17:35:50] yup ejegg i see all of that [17:43:10] mepps weird, ok, so what comes back to the browser? [17:43:25] if you look at the response in dev tools? [17:47:58] yeah i don't see it actually redirecting in the network tab [17:48:14] and nothing is coming up in the console [17:48:34] mepps so nothing comes back from the request to api.php? [17:48:54] you're not still hanging on to the request in the debugger, are you? [17:49:19] ohh i'm seeing a composer error now.. [17:49:23] that 'redirecting' is a bit of a misnomer [17:49:29] it's actually opening an iframe [17:50:03] yeah i figured [17:50:09] i'm reinstalling the composer packages [17:50:50] k, hope that helps! [17:51:05] have we made any recent changes in the smashpig queuewrapper? [17:51:10] nope [17:51:20] don't think so, anyway [17:52:01] oh weird, there was some strange local file change--i don't know why it persisted after i deleted vendor.. [17:52:13] okay working as expected now [17:52:55] great! [17:53:16] here's the patch to change the default: https://gerrit.wikimedia.org/r/439630 [17:53:30] argh, nobody got assigned to it! [17:53:41] what's up, gerrit-reviewer-bot? [17:54:07] weeeird [17:54:19] https://tools.wmflabs.org/gerrit-reviewer-bot/ [17:54:25] (CR) Mepps: [C: 2] Update Ingenico API sandbox URL [wikimedia/fundraising/SmashPig] - https://gerrit.wikimedia.org/r/439630 (owner: Ejegg) [17:54:28] error: SMalyshev does not identify a registered user or group [17:54:28] fatal: one or more updates failed; review output above [17:54:56] (Merged) jenkins-bot: Update Ingenico API sandbox URL [wikimedia/fundraising/SmashPig] - https://gerrit.wikimedia.org/r/439630 (owner: Ejegg) [17:58:15] weird, there's definitely an Smalyshev user in gerrit. case sensitive, I guess? [17:59:10] just fixed the case in the reviewers page to see if that helps [18:01:42] thank ejegg, mepps [18:01:51] thanks* [19:24:59] fr-tech: I have to run an errand so prob won't be around before the scheduled check in [19:25:10] 10-4 [19:25:18] back asap [19:25:26] We can probably do any needed check-ins later via text-mode [19:43:31] fundraising-tech-ops, Operations, ops-codfw, Patch-For-Review: Rack/Setup frbast2001.frack.codfw.wmnet - https://phabricator.wikimedia.org/T196417#4273516 (Jgreen) a:Jgreen>None [19:43:34] fundraising-tech-ops, Operations, ops-eqiad: rack frdata1001 - https://phabricator.wikimedia.org/T187364#4273522 (Jgreen) a:Jgreen>None [19:44:53] fundraising-tech-ops, Operations, netops: adjust NAT mapping for frdata.wikimedia.org - https://phabricator.wikimedia.org/T196656#4273538 (Jgreen) [19:44:55] fundraising-tech-ops, Operations, ops-eqiad: rack frdata1001 - https://phabricator.wikimedia.org/T187364#3973195 (Jgreen) [19:49:16] (PS2) Ejegg: Update composer with latest, especially new damaged database in smashpig [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/439590 (owner: Mepps) [19:49:27] (CR) Ejegg: [C: 2] Update composer with latest, especially new damaged database in smashpig [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/439590 (owner: Mepps) [19:55:12] (Merged) jenkins-bot: Update composer with latest, especially new damaged database in smashpig [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/439590 (owner: Mepps) [20:25:05] fr-tech: an ops specific questions? [20:25:23] i'm leaving for prague on friday, going to do a presentation on fundraising at the offsite [20:26:04] Fundraising Sprint HTTP originally stood for Happy Turtle Transfer Protocol, Fundraising Sprint Ivory and eggshell white are the same color, Fundraising Sprint Junebugs prefer July, Fundraising Sprint Karma chameleons hide amongst us, and 4 others:... - https://phabricator.wikimedia.org/T170973#4273708 [20:26:21] also in the middle of setting up frmon1001, the fundraising prometheus/grafana host [20:38:07] (CR) Jgleeson: "I've managed to put through a test on this after clearing out the dummy payment processor data as discussed, once done I could run the db " [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/426068 (https://phabricator.wikimedia.org/T188678) (owner: Ejegg) [20:42:56] Fundraising Sprint Karma chameleons hide amongst us, Fundraising Sprint Lactose is unusually tolerant, Fundraising-Backlog, Patch-For-Review: Help switch over foundation pages to donate wiki - https://phabricator.wikimedia.org/T193663#4273783 (mepps) @Pcoombe Are you comfortable with us switching... [21:03:13] Fundraising Sprint Karma chameleons hide amongst us, Fundraising Sprint Lactose is unusually tolerant, Fundraising-Backlog, Patch-For-Review: Help switch over foundation pages to donate wiki - https://phabricator.wikimedia.org/T193663#4273876 (Pcoombe) @mepps Can we hold off on that for a few day... [22:07:24] (PS1) Ejegg: Fix counting uncountables [extensions/DonationInterface] - https://gerrit.wikimedia.org/r/439780 [22:07:36] fr-tech ^^^ [22:07:47] little bit of future-proofing for the DI code [22:08:12] (I needed that much to keep running tests on PHP 7.2) [22:24:06] cwd: one question, can you think of any further ops tasks to add to https://phabricator.wikimedia.org/T183978? [22:25:35] I was thinking creating the test database, but since it's in existing MariaDB instance, it's just a SQL command, so it's a part of T196564 [22:25:36] T196564: DB schemas (production changes and test DB) and SQL commands to run for new banner and LP impression data from EL - https://phabricator.wikimedia.org/T196564 [22:25:43] thx!!!! [22:33:05] (PS7) Ejegg: Audit functions can deal with multiple logs for one date [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/435220 (https://phabricator.wikimedia.org/T195337) [22:33:07] (PS5) Ejegg: Audit: allow log_filename functions to return arrays [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/435286 (https://phabricator.wikimedia.org/T195337) [22:33:09] (PS8) Ejegg: Ingenico audit handles both APIs [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/435293 (https://phabricator.wikimedia.org/T195337) [22:37:49] AndyRussG: ah yeah the test database [22:38:26] is Katie not here today? [22:39:24] (PS41) Ejegg: SmashPig payment processor extension [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/426068 (https://phabricator.wikimedia.org/T188678) [22:39:46] eileen: she was here earlier for our checking, I guess just not on IRC? [22:39:58] yeah got her! [22:44:34] (PS42) Ejegg: SmashPig payment processor extension [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/426068 (https://phabricator.wikimedia.org/T188678) [22:44:40] cwd: yeah I guess it'll just be a CREATE DATABASE statement... Forgive my ignorance... If I understand correctly, there is but one master MariaDB for all FR production databases, is that right? [22:45:28] AndyRussG: well basically, payments servers have their own wiki dbs [22:45:38] hmm right [22:45:43] and frdev has some stuff none of the others do [22:45:51] hmm [22:47:05] In ecom (frdev1001:/srv/br) there's lots of sql that brings civicrm, drupal and pgehres together [22:47:18] That's the one that we have replicated [22:47:20] right? [22:47:33] i think so? [22:47:35] * cwd checks [22:47:38] hmmm [22:48:16] AndyRussG: yep that's correct [22:48:21] dev_* are the ones that are only local [22:48:23] for staging [22:49:20] okok cool... I think that main one is where we'd put the parallel test database (for stuff from new Kafka topics, parallel of pgehres), so that we can run the same queries with both test and live data [22:49:26] is that okok? [22:49:40] cwd, also fr-tech ^ ? [22:49:59] yeah, sounds right [22:49:59] Or is it dicey to put testing data in the same production MariaDeeBee instance? [22:50:26] hmmm [22:50:35] What Would Jeff Do [22:51:14] i don't personally have a problem with it [22:51:19] it's temporary [22:52:27] yeah [22:52:54] might it be a strain on that DB and replication hardware? [22:53:19] We probably wouldn't have it turned up to the same sample rate as the production pgehres data ingress [22:53:24] anything is possible but it doesn't strike me as likely [22:53:32] hmmm okok [22:53:33] i bet the importer machines would choke before the db [22:58:42] (PS43) Ejegg: SmashPig payment processor extension [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/426068 (https://phabricator.wikimedia.org/T188678) [23:08:06] (CR) jerkins-bot: [V: -1] SmashPig payment processor extension [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/426068 (https://phabricator.wikimedia.org/T188678) (owner: Ejegg) [23:12:31] (PS10) Ejegg: Move errored messages to damaged queue [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/430800 (https://phabricator.wikimedia.org/T191654) (owner: Mepps) [23:12:52] (CR) Ejegg: [C: 2] Move errored messages to damaged queue [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/430800 (https://phabricator.wikimedia.org/T191654) (owner: Mepps) [23:17:54] (Merged) jenkins-bot: Move errored messages to damaged queue [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/430800 (https://phabricator.wikimedia.org/T191654) (owner: Mepps) [23:19:26] (CR) Ejegg: "Thanks jgleeson!" [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/426068 (https://phabricator.wikimedia.org/T188678) (owner: Ejegg) [23:26:18] (PS44) Ejegg: SmashPig payment processor extension [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/426068 (https://phabricator.wikimedia.org/T188678) [23:26:35] (PS45) Ejegg: SmashPig payment processor extension [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/426068 (https://phabricator.wikimedia.org/T188678) [23:40:43] (PS1) Eileen: Further upstream fixes in 5.3 release [wikimedia/fundraising/crm/civicrm] - https://gerrit.wikimedia.org/r/439788 [23:51:48] (PS2) Ejegg: Another upstream fix [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/437897 (owner: Eileen) [23:52:31] (CR) Ejegg: [C: 2] Another upstream fix [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/437897 (owner: Eileen) [23:58:07] (Merged) jenkins-bot: Another upstream fix [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/437897 (owner: Eileen) [23:58:43] I'm gonna deploy that along with the library updates [23:59:45] (PS1) Ejegg: Merge branch 'master' into deployment [wikimedia/fundraising/crm] (deployment) - https://gerrit.wikimedia.org/r/439795 [23:59:52] (CR) Ejegg: [C: 2] Merge branch 'master' into deployment [wikimedia/fundraising/crm] (deployment) - https://gerrit.wikimedia.org/r/439795 (owner: Ejegg)