[02:12:08] (PS1) Ejegg: Option to prune empty values in Mapper [wikimedia/fundraising/SmashPig] - https://gerrit.wikimedia.org/r/465544 (https://phabricator.wikimedia.org/T202783) [02:12:47] (CR) jerkins-bot: [V: -1] Option to prune empty values in Mapper [wikimedia/fundraising/SmashPig] - https://gerrit.wikimedia.org/r/465544 (https://phabricator.wikimedia.org/T202783) (owner: Ejegg) [02:20:11] (PS2) Ejegg: Option to prune empty values in Mapper [wikimedia/fundraising/SmashPig] - https://gerrit.wikimedia.org/r/465544 (https://phabricator.wikimedia.org/T202783) [02:20:12] (PS1) Ejegg: Add user_ip mapping to createPayment, prune empty values [wikimedia/fundraising/SmashPig] - https://gerrit.wikimedia.org/r/465545 (https://phabricator.wikimedia.org/T202783) [02:31:48] (PS4) Ejegg: Store IP address with payment tokens [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/464476 (https://phabricator.wikimedia.org/T202783) [02:31:50] (PS1) Ejegg: WIP send user_ip with recurring payments [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/465546 (https://phabricator.wikimedia.org/T202783) [02:38:28] (CR) jerkins-bot: [V: -1] WIP send user_ip with recurring payments [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/465546 (https://phabricator.wikimedia.org/T202783) (owner: Ejegg) [02:40:11] (PS1) Ejegg: Update SmashPig [extensions/DonationInterface] - https://gerrit.wikimedia.org/r/465548 [02:40:19] (CR) Ejegg: [C: 2] Update SmashPig [extensions/DonationInterface] - https://gerrit.wikimedia.org/r/465548 (owner: Ejegg) [02:41:55] (PS1) Ejegg: Update SmashPig library [extensions/DonationInterface/vendor] - https://gerrit.wikimedia.org/r/465550 [02:42:00] (CR) Ejegg: [C: 2] Update SmashPig library [extensions/DonationInterface/vendor] - https://gerrit.wikimedia.org/r/465550 (owner: Ejegg) [02:42:21] (PS1) Ejegg: Merge branch 'master' into deployment [extensions/DonationInterface] (deployment) - https://gerrit.wikimedia.org/r/465551 [02:42:44] (CR) jerkins-bot: [V: -1] Merge branch 'master' into deployment [extensions/DonationInterface] (deployment) - https://gerrit.wikimedia.org/r/465551 (owner: Ejegg) [02:42:53] (PS2) Ejegg: Merge branch 'master' into deployment [extensions/DonationInterface] (deployment) - https://gerrit.wikimedia.org/r/465551 [02:42:55] (CR) Ejegg: [C: 2] Merge branch 'master' into deployment [extensions/DonationInterface] (deployment) - https://gerrit.wikimedia.org/r/465551 (owner: Ejegg) [02:43:14] (Merged) jenkins-bot: Update SmashPig [extensions/DonationInterface] - https://gerrit.wikimedia.org/r/465548 (owner: Ejegg) [02:43:16] (CR) jerkins-bot: [V: -1] Merge branch 'master' into deployment [extensions/DonationInterface] (deployment) - https://gerrit.wikimedia.org/r/465551 (owner: Ejegg) [02:47:48] (CR) Ejegg: [V: 2 C: 2] Update SmashPig library [extensions/DonationInterface/vendor] - https://gerrit.wikimedia.org/r/465550 (owner: Ejegg) [02:48:05] (CR) Ejegg: [C: 2] Merge branch 'master' into deployment [extensions/DonationInterface] (deployment) - https://gerrit.wikimedia.org/r/465551 (owner: Ejegg) [02:49:05] (Merged) jenkins-bot: Merge branch 'master' into deployment [extensions/DonationInterface] (deployment) - https://gerrit.wikimedia.org/r/465551 (owner: Ejegg) [02:50:25] (PS1) Ejegg: Update DonationInterface submodule [core] (fundraising/REL1_27) - https://gerrit.wikimedia.org/r/465552 [02:50:31] (CR) Ejegg: [C: 2] Update DonationInterface submodule [core] (fundraising/REL1_27) - https://gerrit.wikimedia.org/r/465552 (owner: Ejegg) [02:53:56] (Merged) jenkins-bot: Update DonationInterface submodule [core] (fundraising/REL1_27) - https://gerrit.wikimedia.org/r/465552 (owner: Ejegg) [02:55:30] !log updated payments-wiki from 1472604b6e to 7fb1aae963 [02:55:31] Logged the message at https://wikitech.wikimedia.org/wiki/Server_Admin_Log [03:06:32] well, that all still looks good [05:18:16] PROBLEM - check_ipsec on civi1001 is CRITICAL: Strongswan CRITICAL - ok: 0 not-conn: americium_v4 [05:18:17] PROBLEM - check_ipsec on americium is CRITICAL: Strongswan CRITICAL - ok: 0 not-conn: civi1001_v4 [05:23:16] PROBLEM - check_ipsec on civi1001 is CRITICAL: Strongswan CRITICAL - ok: 0 not-conn: americium_v4 [05:23:26] PROBLEM - check_ipsec on americium is CRITICAL: Strongswan CRITICAL - ok: 0 not-conn: civi1001_v4 [05:28:16] RECOVERY - check_ipsec on civi1001 is OK: Strongswan OK - 1 ESP OK [05:28:17] RECOVERY - check_ipsec on americium is OK: Strongswan OK - 1 ESP OK [08:10:18] (CR) Eileen: [C: 2] Store IP address with payment tokens [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/464476 (https://phabricator.wikimedia.org/T202783) (owner: Ejegg) [08:16:16] (Merged) jenkins-bot: Store IP address with payment tokens [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/464476 (https://phabricator.wikimedia.org/T202783) (owner: Ejegg) [13:37:27] fundraising-tech-ops, Operations, netops: Qualys scans causing problematic pfw logspam - https://phabricator.wikimedia.org/T206431 (Jgreen) Open>Resolved a:Jgreen The underlying problem was that bellatrix was logging to the root partition rather than the /srv data partition as it should.... [13:57:40] Fundraising-Backlog, Operations, Traffic, HTTPS: Re-evaluate use of EV certificates for payments.wm.o? - https://phabricator.wikimedia.org/T204931 (Jgreen) EV certs do seem to have lost almost all their value. That said the cost difference over an OV cert is under $100. Also, I'm not sure whose d... [14:01:39] Fundraising-Backlog, Operations, Traffic, HTTPS: Re-evaluate use of EV certificates for payments.wm.o? - https://phabricator.wikimedia.org/T204931 (Krenair) >>! In T204931#4648564, @Liuxinyu970226 wrote: > @krenair please, no more DV certs, that's the reason why jawiki, ugwiki, wuuwiki, zhwiki, z... [14:04:04] Fundraising-Backlog, Operations, Traffic, HTTPS: Re-evaluate use of EV certificates for payments.wm.o? - https://phabricator.wikimedia.org/T204931 (BBlack) >>! In T204931#4654860, @Krenair wrote: >>>! In T204931#4648564, @Liuxinyu970226 wrote: >> @krenair please, no more DV certs, that's the reas... [14:32:46] morning cwd and Jeff_Green ! [14:33:32] hey ejegg, how's it going? [14:33:52] pretty good. did you have a productive day off? [14:34:40] yep, did some winterizing and painting and stuff! [14:39:53] nice. [14:40:17] I was hoping to update the CiviCRM db triggers this morning. Do you have a minute to run a sql script? [14:40:32] I'll just turn off the jobs for safety [14:41:49] sure [14:41:53] the new triggers file is on civi1001 under /srv/org.wikimedia.civicrm-files/civicrm/ConfigAndLog/CiviCRM.trigger5bbd215940e8a1d42303569d27a548446b737759870c8.sql [14:41:56] are banners up? [14:42:16] don't think so - they decided to test tomorrow rather than today [14:42:33] since the main cluster datacenter switch is happening [14:43:18] !log turned off fundraising scheduled jobs [14:43:19] Logged the message at https://wikitech.wikimedia.org/wiki/Server_Admin_Log [14:44:07] ok [14:45:05] OK, looks like the jobs are finished [14:45:14] ok [14:47:37] ejegg: ok done, I think [14:47:38] no errors [14:47:54] thanks! [14:48:12] np! [14:48:30] I'll try sending a dollar to the endowment and see if it skips the wmf_donor columns as expected [14:48:35] great [14:51:56] !log turned fundraising scheduled jobs back on [14:51:57] Logged the message at https://wikitech.wikimedia.org/wiki/Server_Admin_Log [14:52:24] oh hey, sox are doing pretty good so far this postseason [14:52:39] astros next, huh? [14:53:04] october: the month I pay any attention to sports (some years) [14:54:09] ha [15:02:31] Fundraising Sprint Sasquatches can't find us either, Fundraising Sprint They Live, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM, Patch-For-Review: Support Tracking endowment contributions in civi - https://phabricator.wikimedia.org/T203601 (Ejegg) OK, this looks good. I donated at payme... [15:09:35] (PS1) Ejegg: Update SmashPig [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/465642 [15:09:41] (CR) Ejegg: [C: 2] Update SmashPig [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/465642 (owner: Ejegg) [15:11:27] (PS1) Ejegg: Update SmashPig [wikimedia/fundraising/crm/vendor] - https://gerrit.wikimedia.org/r/465643 [15:11:29] (CR) Ejegg: [C: 2] Update SmashPig [wikimedia/fundraising/crm/vendor] - https://gerrit.wikimedia.org/r/465643 (owner: Ejegg) [15:15:44] (Merged) jenkins-bot: Update SmashPig [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/465642 (owner: Ejegg) [15:25:50] (Merged) jenkins-bot: Update SmashPig [wikimedia/fundraising/crm/vendor] - https://gerrit.wikimedia.org/r/465643 (owner: Ejegg) [15:26:47] fr-tech any news for scrum of scrums? [15:26:58] sorry for the last minute ask... starts in 4 [15:27:20] ejegg: 3... 2... [15:27:26] Mm nothing here, thx! [15:29:39] fundraising-tech-ops, Operations, netops: icinga reports frbast2001.frack.eqiad.wmnet as host down - https://phabricator.wikimedia.org/T206637 (Jgreen) [15:46:10] Fundraising-Backlog, Operations, Traffic, HTTPS: Re-evaluate use of EV certificates for payments.wm.o? - https://phabricator.wikimedia.org/T204931 (Jgreen) >>! In T204931#4654860, @Krenair wrote: > > Presumably whoever would be responsible for purchasing a renewal has to consider this. It's one... [15:49:12] Fundraising-Backlog, Operations, Traffic, HTTPS: Re-evaluate use of EV certificates for payments.wm.o? - https://phabricator.wikimedia.org/T204931 (BBlack) The kicker probably wouldn't be the monetary cost. It would be that if you didn't require EV, you could auto-issue certs from LetsEncrypt an... [15:56:12] (PS1) Ejegg: Merge branch 'master' into deployment [wikimedia/fundraising/crm] (deployment) - https://gerrit.wikimedia.org/r/465651 [16:01:57] ACKNOWLEDGEMENT - Host frbast2001 is DOWN: PING CRITICAL - Packet loss = 100% daniel_zahn https://phabricator.wikimedia.org/T206637 [16:05:07] :| [16:05:47] Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM, FR-Paypal: subscr_modify messages lead to failmail - https://phabricator.wikimedia.org/T206650 (Ejegg) [16:06:28] what's up with that? switchover related, cwd? [16:06:43] not sure [16:06:52] (CR) Ejegg: [C: 2] Merge branch 'master' into deployment [wikimedia/fundraising/crm] (deployment) - https://gerrit.wikimedia.org/r/465651 (owner: Ejegg) [16:06:58] Fundraising Sprint Sasquatches can't find us either, Fundraising Sprint They Live, Fundraising-Backlog: Review emergency procedures for holidays - https://phabricator.wikimedia.org/T204763 (XenoRyet) a:XenoRyet [16:08:17] (Merged) jenkins-bot: Merge branch 'master' into deployment [wikimedia/fundraising/crm] (deployment) - https://gerrit.wikimedia.org/r/465651 (owner: Ejegg) [16:08:44] Jeff_Green: confused by that icinga-wm message [16:09:14] !log updated CiviCRM from 1165e7ed79 to 4cc21d61c5 [16:09:15] Logged the message at https://wikitech.wikimedia.org/wiki/Server_Admin_Log [16:09:23] did dzahn ack it with that ticket as the message? [16:17:02] cwd: I don't know either [16:19:39] Fundraising-Backlog, Operations, Traffic, HTTPS: Re-evaluate use of EV certificates for payments.wm.o? - https://phabricator.wikimedia.org/T204931 (Jgreen) >>! In T204931#4655176, @BBlack wrote: > The kicker probably wouldn't be the monetary cost. It would be that if you didn't require EV, you c... [16:35:53] Fundraising-Backlog, Operations, Traffic, HTTPS: Re-evaluate use of EV certificates for payments.wm.o? - https://phabricator.wikimedia.org/T204931 (cwdent) @BBlack I have been exploring options and it sounds like the DNS TXT record challege would allow us to issue certs without disturbing the hos... [16:45:56] Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM: can't save any changes to prospect tab - https://phabricator.wikimedia.org/T206242 (CaitVirtue) I am. It's not on all records. I'm specifically having the problem with CID 8711748. [16:47:58] Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM: can't save any changes to a specific record's prospect tab - https://phabricator.wikimedia.org/T206242 (CaitVirtue) [16:48:18] Fundraising Sprint They Live, Fundraising-Backlog, MediaWiki-extensions-CentralNotice: Delay in French mobile banners showing up in Banner Allocation - https://phabricator.wikimedia.org/T206562 (DStrine) [16:48:24] Fundraising-Backlog, Operations, Traffic, HTTPS: Re-evaluate use of EV certificates for payments.wm.o? - https://phabricator.wikimedia.org/T204931 (Krenair) That is being set up for prod at the moment actually, but it relies on trusted servers SSHing to prod auth DNS machines. I'm not sure frack... [17:21:31] Fundraising-Backlog, Operations, Traffic, HTTPS: Re-evaluate use of EV certificates for payments.wm.o? - https://phabricator.wikimedia.org/T204931 (Jgreen) >>! In T204931#4655430, @Krenair wrote: > How complex is the payments site? Is it possible to do http challenges there? Off the top of my he... [17:47:22] Fundraising-Backlog, Operations, Traffic, HTTPS: Re-evaluate use of EV certificates for payments.wm.o? - https://phabricator.wikimedia.org/T204931 (Krenair) >>! In T204931#4655504, @Jgreen wrote: >>>! In T204931#4655430, @Krenair wrote: >> How complex is the payments site? Is it possible to do ht... [17:49:33] Fundraising-Backlog, Operations, Traffic, HTTPS: Re-evaluate use of EV certificates for payments.wm.o? - https://phabricator.wikimedia.org/T204931 (Jgreen) >>! In T204931#4655857, @Krenair wrote: > > Oh wow, okay - I was expecting you to say it was behind LVS or something but not that. Ha, well... [17:51:03] RECOVERY - Host frbast2001 is UP: PING OK - Packet loss = 0%, RTA = 36.29 ms [17:54:55] fundraising-tech-ops, Operations, netops: icinga reports frbast2001.frack.eqiad.wmnet as host down - https://phabricator.wikimedia.org/T206637 (Jgreen) Open>Resolved a:Jgreen This is fixed. - fix nagios_nsca.conf in prod puppet for frbast2001's new IP - fix modules/network/data/data.yaml... [18:01:39] Fundraising-Backlog, fundraising-tech-ops: Deploy CiviCRM trigger update - https://phabricator.wikimedia.org/T206584 (cwdent) Open>Resolved a:cwdent @Jgreen did this [18:39:13] XenoRyet: did you want to do the mid-sprint check-in? [18:39:33] Wikimedia-Fundraising-Banners, donate.wikimedia.org: Add Carte Bancaire logo and enable card type logos in France - https://phabricator.wikimedia.org/T204545 (Pcoombe) Thanks @schoenbaechler but the gradient on that extract doesn't look great and the file size would be a problem. It should be possible to... [18:39:39] Oh sure. Probably be a quick one, but there's a few things we could talk about probably. [18:44:32] (CR) Ejegg: "recheck" [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/463195 (https://phabricator.wikimedia.org/T204008) (owner: Eileen) [18:45:49] (PS2) Ejegg: [alphaish] Functional import using batch api. [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/463898 (https://phabricator.wikimedia.org/T204008) (owner: Eileen) [18:51:20] (CR) jerkins-bot: [V: -1] [alphaish] Functional import using batch api. [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/463898 (https://phabricator.wikimedia.org/T204008) (owner: Eileen) [19:08:24] (CR) jerkins-bot: [V: -1] Switch to csv package [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/463195 (https://phabricator.wikimedia.org/T204008) (owner: Eileen) [19:17:29] Fundraising-Backlog, fundraising-tech-ops, Operations, Traffic: SSL cert for links.email.wikimedia.org - https://phabricator.wikimedia.org/T188561 (CCogdill_WMF) @Jgreen @BBlack thanks for bumping this and continuing to check. It does look like the SSL rating has bumped up to an A: https://www.ss... [19:29:23] Fundraising Sprint They Live, Fundraising-Backlog, MediaWiki-extensions-CentralNotice: Delay in French mobile banners showing up in Banner Allocation - https://phabricator.wikimedia.org/T206562 (AndyRussG) Thanks!! Checked the data in Turnilo (formerly Pivot), and it shows the problem happened as des... [19:33:17] fr-tech: -talk? [21:27:51] Wikimedia-Fundraising-Banners, donate.wikimedia.org: Add Carte Bancaire logo and enable card type logos in France - https://phabricator.wikimedia.org/T204545 (schoenbaechler) Nice and props to you @Pcoombe, it even works and looks fine on IE11! 👏 {F26500035} [22:10:18] (CR) XenoRyet: [C: 2] Option to prune empty values in Mapper [wikimedia/fundraising/SmashPig] - https://gerrit.wikimedia.org/r/465544 (https://phabricator.wikimedia.org/T202783) (owner: Ejegg) [22:11:18] (CR) XenoRyet: [C: 2] Add user_ip mapping to createPayment, prune empty values [wikimedia/fundraising/SmashPig] - https://gerrit.wikimedia.org/r/465545 (https://phabricator.wikimedia.org/T202783) (owner: Ejegg) [22:11:28] (Merged) jenkins-bot: Option to prune empty values in Mapper [wikimedia/fundraising/SmashPig] - https://gerrit.wikimedia.org/r/465544 (https://phabricator.wikimedia.org/T202783) (owner: Ejegg) [22:11:53] (Merged) jenkins-bot: Add user_ip mapping to createPayment, prune empty values [wikimedia/fundraising/SmashPig] - https://gerrit.wikimedia.org/r/465545 (https://phabricator.wikimedia.org/T202783) (owner: Ejegg) [22:52:15] (PS1) Cdentinger: new audit download script [wikimedia/fundraising/tools] - https://gerrit.wikimedia.org/r/465789