[01:53:00] Fundraising Sprint They Live, Fundraising-Backlog, MediaWiki-extensions-CentralNotice: Delay in French mobile banners showing up in Banner Allocation - https://phabricator.wikimedia.org/T206562 (AndyRussG) Just checking stuff to eliminate possible causes: there's nothing odd in the [[ https://wikitec... [04:04:51] Fundraising Sprint They Live, Fundraising-Backlog, MediaWiki-extensions-CentralNotice: Delay in French mobile banners showing up in Banner Allocation - https://phabricator.wikimedia.org/T206562 (AndyRussG) Also nothing stands out in logstash for that time: [[ https://logstash.wikimedia.org/goto/5fe01... [13:47:30] fundraising-tech-ops: EPIC: migrate fundraising hosts to Debian Stretch - https://phabricator.wikimedia.org/T185013 (Jgreen) [13:47:34] fundraising-tech-ops, Patch-For-Review: rename saiph.frack.codfw.wmnet to frpig2001.frack.codfw.wmnet and reimage with Debian Stretch - https://phabricator.wikimedia.org/T203521 (Jgreen) Open>Resolved a:Jgreen this is done [15:17:59] Fundraising Sprint They Live, Fundraising-Backlog, Fr-Ingenico-integration_2017-18, MediaWiki-extensions-DonationInterface, and 2 others: Invalid locale sent to new Ingenico API - https://phabricator.wikimedia.org/T206093 (jgleeson) @Ejegg Looks like this just got a little tricker. We've got Inge... [15:19:09] (CR) Jgleeson: "Looks like we've had another locale failure. https://phabricator.wikimedia.org/T206093#4661726" [extensions/DonationInterface] - https://gerrit.wikimedia.org/r/466930 (https://phabricator.wikimedia.org/T206093) (owner: Ejegg) [16:14:37] fr-tech is the "Advancement QCI" thing at 10 am Pacific where dstrine-away mentioned he's presenting? Or is that something else? [16:17:44] AndyRussG: it is at 10am [16:17:49] dstrine: cool! [16:18:33] break a leg... errr a slide! It'll go great :) [16:42:28] fundraising-tech-ops, Operations, decommission, ops-codfw, Patch-For-Review: decom rigel.frack.codfw.wmnet - https://phabricator.wikimedia.org/T202535 (Jgreen) [16:48:55] Well, something big just blew over. brb [16:50:30] where is the link to this QCI meeting? [16:54:12] cwd +1 [16:55:33] fundraising-tech-ops: fix freeradius vs libpam-yubico too many open files bug - https://phabricator.wikimedia.org/T148863 (Jgreen) Open>Resolved a:Jgreen Closing this because the restart strategy is imperfect but 'good enough' for the time being. [17:05:22] Are we all supposed to be in the QCI meeting? I don't think I got an invite. [17:07:35] XenoRyet: i didn't either, not sure which calendar it is on [17:08:43] I calendar stalk everyone on the team, so I just picked it up from David's [17:09:58] cwd, looks like it's going to overrun our checkin as well, but we can do that in text mode later if you want. [17:10:28] XenoRyet: works for me [17:12:20] XenoRyet: i am gonna deploy the new ssl cert for payments today [17:12:35] Good times [17:12:49] after this snafu: https://phabricator.wikimedia.org/T205504#4660385 [17:13:17] I thought I had seen a snag in that and was trying to remember what it was. [17:13:40] it was pretty educational [17:13:56] but did not make me hate corporate ssl any less [17:14:18] That's the way of it I suppose [17:32:31] Fundraising-Backlog, Wikimedia-Fundraising, fundraising-tech-ops, Operations, SRE-Access-Requests: Frdev1001 server and mysql access - https://phabricator.wikimedia.org/T206478 (jkim_wikimedia) Hey @cwdent , could you help me with the SSH key? I have my yubikey handy. Thx! [17:33:20] cwd, that link didn't work for me [17:33:40] oh right it's a procurement task [17:33:46] i guess they are private [17:33:50] ah [17:34:36] well the lesson is all ssl certs must be registered by the CA at https://crt.sh/?q=payments.wikimedia.org [17:34:40] or chrome will not load the site [17:35:07] Fundraising-Backlog, fundraising-tech-ops, Operations: reports.frdev.wm.o -- still in use? - https://phabricator.wikimedia.org/T170640 (Jgreen) Open>Resolved This site is removed. I left most of the puppet code intact so we can, in theory, bring it back up quickly if we decide to do so. [17:39:39] huh? [17:40:11] like an official step? [17:41:59] "crt.sh is a web interface to a distributed database called the certificate transparency logs" [17:42:11] huh, hadn't come across that before [17:56:12] yeah it's crazy [17:56:30] also the check where the browser validates it doesn't appear in browser tools [17:56:39] it's an external request [17:57:27] Fundraising-Backlog, Wikimedia-Fundraising, fundraising-tech-ops, Operations, SRE-Access-Requests: Frdev1001 server and mysql access - https://phabricator.wikimedia.org/T206478 (cwdent) @jkim_wikimedia these are the basic instructions for making an ssh key: https://wikitech.wikimedia.org/wiki... [18:11:49] Fundraising Sprint They Live, Fundraising-Backlog, MediaWiki-extensions-CentralNotice: Delay in French mobile banners showing up in Banner Allocation - https://phabricator.wikimedia.org/T206562 (AndyRussG) Also just re-checked CentralNotice logs... I don't see any changes in any of them around 18:40... [18:16:55] AndyRussG, I'm curious about the event streaming/logging point raised in QCI. What were/are we using which pre-dates kafka? [18:21:53] jgleeson kafka [18:24:18] It's just more involved than the adopted names for the old and new pipelines imply [18:26:11] But there's nothing in there that you haven't heard about I think [18:28:27] In fact both old and new pipelines use kafka and even a bit of kafkatee [18:29:01] ah cool [18:29:12] thanks for the explanation :) [18:29:16] AndyRussG, [18:32:12] :) yw [18:32:24] Back in a bit! [18:50:52] Fundraising-Backlog, Wikimedia-Fundraising, fundraising-tech-ops, Operations, SRE-Access-Requests: Frdev1001 server and mysql access - https://phabricator.wikimedia.org/T206478 (jkim_wikimedia) Hey @cwdent, here's the public key: /Users/jkim/.ssh/id_rsa.pub What is the output of the yubikey?... [18:59:14] Fundraising-Backlog, Wikimedia-Fundraising, fundraising-tech-ops, Operations, SRE-Access-Requests: Frdev1001 server and mysql access - https://phabricator.wikimedia.org/T206478 (cwdent) @jkim_wikimedia If you plug it into your laptop and touch the button it will spit out some text. The first... [19:17:24] Fundraising-Backlog, Wikimedia-Fundraising, fundraising-tech-ops, Operations, SRE-Access-Requests: Frdev1001 server and mysql access - https://phabricator.wikimedia.org/T206478 (jkim_wikimedia) @cwdent ccccccgdrdri [19:23:15] Fundraising-Backlog, Wikimedia-Fundraising, fundraising-tech-ops, Operations, SRE-Access-Requests: Frdev1001 server and mysql access - https://phabricator.wikimedia.org/T206478 (cwdent) @jkim_wikimedia thanks! As far as the public key I need the actual contents of the file which you can see... [19:30:18] Fundraising-Backlog, Wikimedia-Fundraising, fundraising-tech-ops, Operations, SRE-Access-Requests: Frdev1001 server and mysql access - https://phabricator.wikimedia.org/T206478 (jkim_wikimedia) ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC+ItHLDwXZYoK8b3LEff1bM6UydLGFXMCprg+LVLkwDR4fQFSEMNMLAsdNoXn... [19:46:46] Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM: can't save any changes to specific records' prospect tabs - https://phabricator.wikimedia.org/T206242 (DStrine) @CaitVirtue I was not able to reproduce using that CID. @Eileenmcnaughton @LeanneS @NNichols can you try with that CID? [19:59:02] Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM: can't save any changes to specific records' prospect tabs - https://phabricator.wikimedia.org/T206242 (Eileenmcnaughton) I was able to save "

ljkjl  link

" (which includes a url) to 2... [22:33:39] (CR) Eileen: "Regarding " would it make sense to have a single array property to hold them all, pass the progress object as part of the import() signatu" [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/463898 (https://phabricator.wikimedia.org/T204008) (owner: Eileen) [22:52:28] Fundraising-Backlog, Wikimedia-Fundraising, fundraising-tech-ops, Operations, SRE-Access-Requests: Frdev1001 server and mysql access - https://phabricator.wikimedia.org/T206478 (cwdent) @jkim_wikimedia thanks, I now have enough info to make the accounts and will find time in the next day or two. [22:53:45] (PS5) Eileen: Switch to csv package [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/463195 (https://phabricator.wikimedia.org/T204008) [22:53:47] (PS3) Eileen: [alphaish] Functional import using batch api. [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/463898 (https://phabricator.wikimedia.org/T204008) [22:53:49] (PS2) Eileen: Use filter xss rather than check plain on the log output - this lets us view links [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/463899 [22:59:59] (CR) jerkins-bot: [V: -1] Use filter xss rather than check plain on the log output - this lets us view links [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/463899 (owner: Eileen) [23:01:05] (CR) jerkins-bot: [V: -1] [alphaish] Functional import using batch api. [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/463898 (https://phabricator.wikimedia.org/T204008) (owner: Eileen) [23:17:19] (CR) jerkins-bot: [V: -1] Switch to csv package [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/463195 (https://phabricator.wikimedia.org/T204008) (owner: Eileen)