[01:29:14] !log updated staging civicrm database and triggers [01:29:19] Logged the message at https://wikitech.wikimedia.org/wiki/Server_Admin_Log [15:07:42] Wikimedia-Fundraising-Campaigns (FY Q3 Jan-Mar 2017), Wikimedia-CentralNotice-Administration (Q1-2017): WMF Fundraising - 16/17 - Sweden (7 Feb - 7 Mar) - https://phabricator.wikimedia.org/T156815#3075863 (Pcoombe) [15:24:49] Fundraising Sprint Baudelaire Bowdlerizer, Fundraising Sprint Costlier Alternative, Fundraising Sprint Deferential Equations, Fundraising Sprint Dirt Farming, and 8 others: Store and update list of currently working iDEAL banks - https://phabricator.wikimedia.org/T128692#3075952 (DStrine) [15:36:47] fundraising-tech-ops: replace db1008 with new hardware running jessie - https://phabricator.wikimedia.org/T145107#3075988 (Jgreen) pfw/iptables policies (fundraising private puppet): commit 8e403abe1e552b078d217479c9f48ed23d892380 Author: Jeff Green Date: Mon Mar 6 15:32:57 2017 +00... [15:37:05] fundraising-tech-ops: replace lutetium with new hardware running debian/jessie - https://phabricator.wikimedia.org/T145110#3075997 (Jgreen) pfw/iptables policies (fundraising private puppet): commit 8e403abe1e552b078d217479c9f48ed23d892380 Author: Jeff Green Date: Mon Mar 6 15:32:57... [15:37:15] fundraising-tech-ops: replace indium (eqiad fundraising logger) with new hardware running jessie - https://phabricator.wikimedia.org/T145116#3075998 (Jgreen) pfw/iptables policies (fundraising private puppet): commit 8e403abe1e552b078d217479c9f48ed23d892380 Author: Jeff Green Date:... [15:38:19] fundraising-tech-ops: configure TLS for fundraising syslog collection - https://phabricator.wikimedia.org/T142994#3076004 (Jgreen) pfw/iptables policies to remove 10514/tcp (fundraising private puppet): commit 8e403abe1e552b078d217479c9f48ed23d892380 Author: Jeff Green Date: Mon Mar... [15:41:18] fundraising-tech-ops, Operations, netops: set up firewall policies for barium, lutetium, db1025, and indium replacement servers - https://phabricator.wikimedia.org/T159336#3076013 (Jgreen) [15:43:16] fundraising-tech-ops, Operations, netops: set up firewall policies for barium, lutetium, db1025, and indium replacement servers - https://phabricator.wikimedia.org/T159336#3064590 (Jgreen) Also (fundraising private repo): commit 8e403abe1e552b078d217479c9f48ed23d892380 Author: Jeff Green Fundraising-Backlog, fundraising-tech-ops: database access to additional CPS analyst - https://phabricator.wikimedia.org/T155746#3076334 (Ottomata) [18:00:21] fr-tech: Recession is when your neighbor loses his job. Depression is when you [18:00:21] lose your job. These economic downturns are very difficult to predict, [18:00:23] but sophisticated econometric modeling houses like Data Resources and [18:00:24] Chase Econometrics have successfully predicted 14 of the last 3 recessions. [18:00:24] -- discuss. [18:01:39] fr-tech internet is spotty in the airbnb today, lemme pop back on from the cafe [18:01:57] oops, fr-standup time [18:02:35] my whole tube is currently occupied with pxe booting a vm [18:04:47] whoa, hardcore [18:06:17] prepping the test civi replacement [18:06:55] * awight is tempted to read logs [18:08:01] nuts--no logs since Feb 19 [18:08:08] Also wikibugs is dead here? [18:08:48] wm-bot: help [18:10:16] ah really? dang [18:10:28] wm-bot: @trusted [18:10:44] wm-bot: what you should have said when I asked "help": https://meta.wikimedia.org/wiki/Wm-bot [18:12:29] wm-bot: ask [18:12:44] !ask [18:12:44] Please feel free to ask your question: if anybody who knows the answer is around, they will surely reply. Don't ask for help or for attention before actually asking your question, that's just a waste of time - both yours and everybody else's. :) [18:12:48] omg [18:13:16] wm-bot: @logon [18:13:26] I am running http://meta.wikimedia.org/wiki/WM-Bot version wikimedia bot v. 2.8.0.0 [libirc v. 1.0.3] my source code is licensed under GPL and located at https://github.com/benapetr/wikimedia-bot I will be very happy if you fix my bugs or implement new features [18:13:26] @help [18:13:32] silly [18:13:37] @logon [18:13:37] Channel is already logged [18:13:40] not. [18:13:52] I trust: mwalker!.*@wikimedia/mwalker-wmf (2admin), .*@wikimedia/Adamw (2admin), .*@wikimedia/katiehorn (2admin), .*@wikipedia/jgreen (2admin), .*!.*@wikimedia/jeremyb (2admin), .*@fsf/member/marktraceur (2admin), [18:13:52] @trusted [18:13:59] ooh [18:14:24] User not found, sorry [18:14:24] @trustdel .*mwalker.* [18:14:32] oh hey [18:14:58] User was deleted from access list [18:14:58] @trustdel mwalker!.*@wikimedia/mwalker-wmf [18:15:40] Successfully added .*@wikimedia/cdentinger-wmf [18:15:40] @trustadd .*@wikimedia/cdentinger-wmf admin [18:15:51] cwd: ^ [18:16:12] http://bots.wmflabs.org/dump/%23wikimedia-fundraising.htm [18:16:12] @info [18:16:35] awight: ty :) [18:16:50] what can i do now? [18:18:14] I am running http://meta.wikimedia.org/wiki/WM-Bot version wikimedia bot v. 2.8.0.0 [libirc v. 1.0.3] my source code is licensed under GPL and located at https://github.com/benapetr/wikimedia-bot I will be very happy if you fix my bugs or implement new features [18:18:14] @help [18:18:16] awight: ejegg@wikimedia/ejegg too plz? [18:18:29] Successfully added .*@wikimedia/ejegg [18:18:29] @trustadd .*@wikimedia/ejegg admin [18:18:34] thanks! [18:19:23] We should populate this stuff for fun: [18:19:28] !floss is https://www.mediawiki.org/wiki/Fundraising_tech/Free_Software_Citizenship [18:19:29] Key was added [18:19:32] !floss [18:19:32] https://www.mediawiki.org/wiki/Fundraising_tech/Free_Software_Citizenship [18:19:42] !ask del [18:19:42] Successfully removed ask [18:19:51] @logoff [18:20:19] Maybe the default destination changed? [18:24:13] neat [18:25:24] Fundraising-Backlog, WM-Bot: wm-bot is not logging #wikimedia-fundraising? - https://phabricator.wikimedia.org/T159731#3076524 (awight) [18:25:32] oh good, at least wikibugs_ is behaving. [18:25:57] wikibugs_: wup some sense into wm-bot, si vous plait [18:26:47] wm-dev log stops 2/19 too [18:27:41] @statistics on [18:27:46] ejegg|meet: oh! Good find [18:28:25] whoa, wm-bot is C# [18:28:36] hahaha [18:30:17] X| [18:31:23] Fundraising-Backlog, WM-Bot: wm-bot is not logging #wikimedia-fundraising? - https://phabricator.wikimedia.org/T159731#3076585 (Matthewrbowker) Open>Invalid Please see T159659 for an explanation. [18:34:58] Who has chan op here? [18:35:14] We need the logs url updated to (a shortened) http://wm-bot.wmflabs.org/browser/index.php?display=%23wikimedia-fundraising [18:35:48] Jeff_Green: ^^^ ? [18:36:57] let's see if I can do it... [18:37:34] nope [18:44:19] gulp [18:44:40] still poking at IRC [18:48:08] /msg chanserv access #wikimedia-fundraising list [18:48:23] I have some access, it seems [18:48:26] wups [18:50:57] Jeff_Green: done--sorry for crying wolf there [18:51:21] glad you figured it out [18:51:34] Fundraising-Backlog, WM-Bot: wm-bot is not logging #wikimedia-fundraising? - https://phabricator.wikimedia.org/T159731#3076680 (awight) @Matthewrbowker Thanks for the link! [18:51:34] Hey wikibugs_, you are welcome! [18:51:50] yess, bot death match [18:55:24] dang, wifi no functiona at the airbnb and now a Juan Valdez cafe too. the whole town is on the fritz! [18:56:07] cell data holding strong though [18:56:18] think I'll finally try that iDEAL lookup deploy [18:56:51] cwd, can you help push out the new SmashPig.yaml settings? [18:57:40] sure, one sec [18:58:21] yeah my network is out too [18:58:24] tethered to phone [18:58:28] 50+ mph gusts today [18:58:31] something blew over [18:58:51] ejegg: http://c10.quickcachr.fotos.sapo.pt/i/n010181b9/5912463_ZKdvK.gif [18:59:15] haha [18:59:30] We had some torrential hail showers yesterday [18:59:53] I hear Slim's out a few billion lately [19:01:02] Due to ForEx? [19:01:15] guesso [19:01:53] wish the rich guys would just joust each other like the old days [19:02:52] hehe a la All Quiet on the Western Front [19:03:02] i don't understand -'s in yaml [19:03:13] just put them in their boxers, armed with a bat, and give out tickets to watch [19:03:17] at least in a decoding to php objects context [19:03:19] (PS1) Ejegg: Merge branch 'master' into deployment [extensions/DonationInterface] (deployment) - https://gerrit.wikimedia.org/r/341367 [19:03:34] cwd should be numeric-indexed arrays [19:03:47] but I may have misformatted [19:03:50] I didn't realize Mexico is all like, http://www.veteranstoday.com/wp-content/uploads/2015/09/trump-pinata-03.jpg [19:04:04] ejegg: i also see one instance of "ingenigo" [19:04:18] cwd ooh, fixing [19:04:48] (CR) Ejegg: [C: 2] Merge branch 'master' into deployment [extensions/DonationInterface] (deployment) - https://gerrit.wikimedia.org/r/341367 (owner: Ejegg) [19:05:49] (Merged) jenkins-bot: Merge branch 'master' into deployment [extensions/DonationInterface] (deployment) - https://gerrit.wikimedia.org/r/341367 (owner: Ejegg) [19:08:12] cwd ok, fixed that typo and looked over the rest. I think it's fine [19:08:49] cool, checkin [19:09:25] Is any of that file as it appear in /etc rendered from puppet template vars? [19:10:13] *appeaers [19:10:16] *appears [19:10:24] pears. lots of pears [19:12:03] ejegg: i don't believe so, pretty sure that file is verbatim [19:14:34] cwd cool. does it look OK to deploy now? [19:15:11] checking... [19:16:49] should get some sort of yaml linter going on [19:17:13] yar. again, i am reassured when vim makes things the expected colors [19:18:18] heh yep [19:20:15] XenoRyet: hi, do you have a WIP for the recurring normalization? I was wondering what approach you were taking to code reuse... [19:20:37] I had the weird thought that we might be able to do something with var_maps and Transformers [19:21:09] I haven't uploaded anything yet. I'm more or less just pulling stuff over as-is. I'm open to changing things up if you have a better idea though. [19:21:20] What do you have in mind? [19:21:46] hehe, the old recurring code has like 40 comments from awight on a commit a while back [19:21:47] just imagining we could make it more similar to normal normalization [19:21:48] lemme see [19:22:23] XenoRyet: by pulling stuff over, does that mean copying recurring.module code into SmashPig or something? [19:23:15] Yea, more or less. It needs massaged into the structure ejegg built a bit, but basically yea. [19:23:37] XenoRyet: here's awight's critique of the old stuff: https://gerrit.wikimedia.org/r/309618 [19:23:54] reading [19:24:12] /o\ [19:25:22] ejegg: are you confident we'll be able to reach this new endpoint through the firewalls? [19:25:31] cwd d'oh [19:25:32] right [19:25:35] just occurred to me [19:25:40] * ejegg pings [19:26:33] XenoRyet: Well I can dig minimal changes for now, but I think there's a lot of room for improvement whenever we're ready to do so [19:26:56] cwd negatory. i suppose that would have been a good test of the error handling! [19:27:11] But the existing code is pretty fragile and crappy [19:27:12] heh indeed [19:27:20] cwd will make a ticket for the fw rules [19:28:35] awight: I'm down to do some cleaning up while we're here, particularly if you have an idea about a better structure. [19:33:00] XenoRyet: My only thought so far is, encapsulate in Transformers [19:33:30] We can start with a monolithic copy of old code if that makes sense, but then extract reusable and conceptual groups [19:34:01] ejegg: will this new conf hurt anything without the new code? [19:34:23] cwd nope [19:34:41] cool, i'll just let it go out then and we'll be ready whenever [19:34:48] awight: +lots pushing transformers down into SmashPig [19:35:20] ejegg: not sure what the migration will look like for that, but yeah that's gotta happen eventually. [19:35:40] shouldn't be too tough since the SmashPig stuff is namespaced, right? [19:35:44] Maybe the base interfaces are defined in SmashPig, and DI keeps its implementations for now. [19:37:39] ah right, we'd need to rethink the fact that they get the gateway adapters passed in as a param [19:39:51] good call [19:39:57] darn. [19:40:34] K, maybe they're stateful and have a setGateway accessor? [19:52:39] (PS1) Ejegg: Update DonationInterface submodule [core] (fundraising/REL1_27) - https://gerrit.wikimedia.org/r/341375 [19:52:46] (CR) Ejegg: [C: 2] Update DonationInterface submodule [core] (fundraising/REL1_27) - https://gerrit.wikimedia.org/r/341375 (owner: Ejegg) [20:01:28] (Merged) jenkins-bot: Update DonationInterface submodule [core] (fundraising/REL1_27) - https://gerrit.wikimedia.org/r/341375 (owner: Ejegg) [20:01:47] ok, here go the fireworks [20:05:39] !log updated payments-wiki from 66d812517acc47a8a7e07b5fe269950b21c86be3 to f991f154d69479e5260267afa88ee29d8049e6be [20:05:44] Logged the message at https://wikitech.wikimedia.org/wiki/Server_Admin_Log [20:06:03] k, no immediate explosion [20:14:35] Fundraising Sprint Baudelaire Bowdlerizer, Fundraising Sprint Costlier Alternative, Fundraising Sprint Deferential Equations, Fundraising Sprint Dirt Farming, and 8 others: Store and update list of currently working iDEAL banks - https://phabricator.wikimedia.org/T128692#2082991 (Ejegg) This is d... [20:25:26] Fundraising Sprint Deferential Equations, Fundraising Sprint English Cuisine, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM: Spike: What should we do to fix data where blank addresses have overwritten valid addresses - https://phabricator.wikimedia.org/T153917#3077259 (Eileenmcnaughton) [20:25:29] Fundraising Sprint Deferential Equations, Fundraising Sprint English Cuisine, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM, Patch-For-Review: Create table to track blank addresses created of these on live. As we resolve them we will delete... - https://phabricator.wikimedia.org/T159396#3077258 [20:28:28] eileen: staging should be all up to date btw [20:28:45] cwd thannks! [20:29:09] I'm just backing up the address table & log table to my home dir so I can restore just those 2 tables if I need to run more than once [20:29:51] groovy [20:43:51] Fundraising Sprint Baudelaire Bowdlerizer, Fundraising Sprint Costlier Alternative, Fundraising Sprint Deferential Equations, Fundraising Sprint Dirt Farming, and 8 others: Store and update list of currently working iDEAL banks - https://phabricator.wikimedia.org/T128692#3077309 (Ejegg) Seems to... [21:01:38] Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM: Slow query on live triggered by user dedupe - https://phabricator.wikimedia.org/T159752#3077396 (Eileenmcnaughton) [21:05:05] Fundraising Sprint English Cuisine, Fundraising-Backlog, FR-Amazon, FR-PayPal-ExpressCheckout, and 3 others: Assisted currency conversion for PayPal is broken again - https://phabricator.wikimedia.org/T98447#1268061 (DStrine) [21:05:41] (PS2) Eileen: Remove unchanged insertions of blank addresses. [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/340686 (https://phabricator.wikimedia.org/T159402) [21:06:58] Fundraising-Backlog, FR-PayPal-ExpressCheckout: Enable PayPal EC everywhere it's available - https://phabricator.wikimedia.org/T159755#3077463 (awight) [21:07:40] Fundraising Sprint English Cuisine, Fundraising-Backlog, FR-PayPal-ExpressCheckout: Enable PayPal EC everywhere it's available - https://phabricator.wikimedia.org/T159755#3077463 (DStrine) [21:08:13] Fundraising Sprint English Cuisine, Fundraising-Backlog, FR-PayPal-ExpressCheckout: IPN listener should normalize new PayPal recurring messages - https://phabricator.wikimedia.org/T157074#3077480 (XenoRyet) a:XenoRyet [21:17:09] (PS3) Eileen: Remove unchanged insertions of blank addresses. [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/340686 (https://phabricator.wikimedia.org/T159402) [21:25:09] (PS4) Eileen: Remove unchanged insertions of blank addresses. [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/340686 (https://phabricator.wikimedia.org/T159402) [21:29:27] Fundraising-Backlog: Offline importer should sanitize email addresses - https://phabricator.wikimedia.org/T159758#3077594 (awight) [21:41:58] (PS1) Awight: Copy accepted currencies from PayPal legacy to express checkout [extensions/DonationInterface] - https://gerrit.wikimedia.org/r/341429 (https://phabricator.wikimedia.org/T159755) [21:42:39] Fundraising Sprint English Cuisine, Fundraising-Backlog, FR-PayPal-ExpressCheckout, Patch-For-Review: Enable PayPal EC everywhere it's available - https://phabricator.wikimedia.org/T159755#3077463 (awight) a:awight [21:46:26] Fundraising Sprint English Cuisine, Fundraising-Backlog, FR-Amazon, FR-PayPal-ExpressCheckout, and 3 others: Assisted currency conversion for PayPal is broken again - https://phabricator.wikimedia.org/T98447#3077647 (awight) Something is borken. https://payments.wikimedia.org/index.php?title=Spe... [21:53:14] (CR) jerkins-bot: [V: -1] Copy accepted currencies from PayPal legacy to express checkout [extensions/DonationInterface] - https://gerrit.wikimedia.org/r/341429 (https://phabricator.wikimedia.org/T159755) (owner: Awight) [21:57:34] Fundraising Sprint English Cuisine, Fundraising-Backlog, FR-Amazon, FR-PayPal-ExpressCheckout, and 3 others: Assisted currency conversion for PayPal is broken again - https://phabricator.wikimedia.org/T98447#3077691 (awight) Very odd-- https://payments.wikimedia.org/index.php?title=Special:Paypal... [21:57:45] Fundraising Sprint English Cuisine, Fundraising-Backlog, FR-Amazon, FR-PayPal-ExpressCheckout, and 3 others: Assisted currency conversion for PayPal is broken again - https://phabricator.wikimedia.org/T98447#3077693 (awight) a:awight [22:01:51] (PS5) Eileen: Remove unchanged insertions of blank addresses. [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/340686 (https://phabricator.wikimedia.org/T159402) [22:12:13] Fundraising Sprint English Cuisine, Fundraising-Backlog, FR-Amazon, FR-PayPal-ExpressCheckout, and 3 others: Assisted currency conversion for PayPal is broken again - https://phabricator.wikimedia.org/T98447#3077765 (awight) K the PP legacy bug was simply that we never turned the interstitial war... [22:14:48] !log update payments-wiki config to a591e4cea6cfc4e64c6c7a5b9aa74a9d44a8ef97 [22:14:53] Logged the message at https://wikitech.wikimedia.org/wiki/Server_Admin_Log [22:18:22] Fundraising Sprint English Cuisine, Fundraising-Backlog, FR-Amazon, FR-PayPal-ExpressCheckout, and 3 others: Assisted currency conversion for PayPal is broken again - https://phabricator.wikimedia.org/T98447#3077812 (awight) And then the bad news: I enabled NotifyOnConversion and nothing changed. [22:38:41] Fundraising-Backlog, fundraising-tech-ops: Make it possible for fr-tech to acknowledge icinga alerts - https://phabricator.wikimedia.org/T152725#3077914 (Jgreen) I think that should have worked, but maybe you tried while we were still working out kinks in the config. Can you try again and let us know if... [22:59:16] jeez, I get to the cafe with good wifi and as soon as my meeting starts the power goes out. [23:01:14] Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM: Spike: investigate getting silverpop data into civi - https://phabricator.wikimedia.org/T159767#3077997 (DStrine) [23:01:52] Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM: Spike: investigate getting silverpop data into civi - https://phabricator.wikimedia.org/T159767#3078015 (DStrine) [23:10:53] back in a bit! [23:11:15] oops, i seem to have copied that engage lib in with no indication of the source in headers [23:11:29] in the git commit message, I hope... [23:12:38] nope :( [23:16:36] snagged from drupal mebbe? http://cgit.drupalcode.org/silverpop/tree/lib/Engage.php [23:16:49] or... that's in a /lib/ subdir too [23:35:14] ejegg: awight do you have any thoughts on what the financial type in the benevity imports is supposed to reflect? [23:38:19] eileen: not sure, but IMO we're free to reinvent the meanings. The various type fields are full of historical accident and should be made more consistent, one day... [23:38:25] eileen: that field usually holds things like 'cash', 'stock', etc, right? [23:38:34] i wonder if the puppet maintainers ever considered sticking the entire king james bible in stdout just to see if anyone would notice [23:38:41] would 'Employee match' make sense? [23:38:45] cwd :P [23:39:12] ...or rather 'employer match' [23:39:13] ? [23:39:27] Or Benevity [23:39:33] would be simple.... [23:39:40] sure, that would be clear [23:39:45] I'll suggest that [23:40:45] (PS6) Eileen: Remove unchanged insertions of blank addresses. [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/340686 (https://phabricator.wikimedia.org/T159402) [23:54:41] awight: I'm not clear if this is fully resolved - or more to look at https://phabricator.wikimedia.org/T159455 [23:56:40] eileen: I'd say, the two title bugs are unresolved, and maybe should be split into two tasks. [23:57:11] Meanwhile, backfilling the empty names seems to have been its own task as well. [23:58:02] awight, eileen, I think the 'email displaying as sort name' is not a bug [23:58:13] just a consequence of the blankening [23:58:28] yeah, awight did fix some of those I believe [23:58:28] and the fact that Civi treats sort/display name as calculated fields [23:59:08] oho, right, for the users we had to backfill from log tables, the sort / display names won't have been recalculated [23:59:26] so we need to either fix those in the db or touch the records via api [23:59:28] I thought they were in the end - but I can do some queries [23:59:59] ejegg: Good way to look at it, email as sort name is a feature ;)