[01:41:25] (PS3) Cstone: Monthly Convert: Variant 012, flipped button order of 011 [extensions/DonationInterface] - https://gerrit.wikimedia.org/r/638225 [01:42:25] Wikimedia-Fundraising-Banners, Wikidata, JavaScript, Wikimedia-production-error: Banner on German Wikipedia and wikidata.org throwing NS_ERROR_FILE_CORRUPTED: error - https://phabricator.wikimedia.org/T267267 (Urbanecm) I blame https://de.wikipedia.org/w/index.php?title=A&banner=B20_WMDE_Test_09_... [01:43:10] (PS2) Cstone: Monthly Convert: Variant 013, flipped button order of 006 [extensions/DonationInterface] - https://gerrit.wikimedia.org/r/638238 [01:45:34] (PS3) Cstone: Monthly Convert: Variant 013, flipped button order of 006 [extensions/DonationInterface] - https://gerrit.wikimedia.org/r/638238 [01:57:23] (PS4) Cstone: Monthly Convert: Variant 013, flipped button order of 006 [extensions/DonationInterface] - https://gerrit.wikimedia.org/r/638238 [02:00:49] (PS2) Cstone: Monthly Convert: Variant 014, flipped buttons of 011 with text change [extensions/DonationInterface] - https://gerrit.wikimedia.org/r/638239 [03:22:33] Fundraising-Backlog, MediaWiki-extensions-CLDR: Is CldrCurrency still used? - https://phabricator.wikimedia.org/T267285 (Reedy) [07:31:51] (PS1) Eileen: Update Stripe file mapping [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/639448 (https://phabricator.wikimedia.org/T267255) [09:22:31] PROBLEM - check_puppetrun on frdb1001 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 5 minutes ago with 1 failures. Failed resources (up to 3 shown): Package[mariadb-client] [09:27:35] PROBLEM - check_puppetrun on frdb1001 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 10 minutes ago with 1 failures. Failed resources (up to 3 shown): Package[mariadb-client] [10:06:30] PROBLEM - check_puppetrun on frdb2002 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 4 minutes ago with 1 failures. Failed resources (up to 3 shown): Package[mariadb-client] [10:42:44] PROBLEM - check_puppetrun on frav1002 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 7 minutes ago with 1 failures. Failed resources (up to 3 shown): Package[mariadb-client] [14:59:05] (CR) Mepps: "My understanding is we don't want to update this until we hear back from Stripe." [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/639448 (https://phabricator.wikimedia.org/T267255) (owner: Eileen) [15:02:30] PROBLEM - check_kafkatee on frban2001 is CRITICAL: CRITICAL: kafka-jumbo1001:down [15:02:34] PROBLEM - check_kafkatee on frban1001 is CRITICAL: CRITICAL: kafka-jumbo1001:down [15:07:30] PROBLEM - check_kafkatee on frban2001 is CRITICAL: CRITICAL: kafka-jumbo1001:down [15:07:30] PROBLEM - check_kafkatee on frban1001 is CRITICAL: CRITICAL: kafka-jumbo1001:down [15:12:30] PROBLEM - check_kafkatee on frban2001 is CRITICAL: CRITICAL: kafka-jumbo1001:down [15:12:38] PROBLEM - check_kafkatee on frban1001 is CRITICAL: CRITICAL: kafka-jumbo1001:down [15:14:19] ACKNOWLEDGEMENT - check_kafkatee on frban1001 is CRITICAL: CRITICAL: kafka-jumbo1001:down Jeff_Green Analytics is working on kafka-jumbo1001 [15:14:19] ACKNOWLEDGEMENT - check_kafkatee on frban2001 is CRITICAL: CRITICAL: kafka-jumbo1001:down Jeff_Green Analytics is working on kafka-jumbo1001 [15:19:43] Fundraising-Backlog, FR-AutoTY-Email: Endowment TY email review Q2 2020 - https://phabricator.wikimedia.org/T267336 (MBeat33) [15:21:37] Fundraising-Backlog, FR-AutoTY-Email: Endowment TY email review Q2 2020 - https://phabricator.wikimedia.org/T267336 (MBeat33) p:Triage→High This is a really high priority given the level of Endowment activity (emails are live)! [15:22:30] RECOVERY - check_kafkatee on frban2001 is OK: OK: brokers:9 topics:2 [15:22:32] RECOVERY - check_kafkatee on frban1001 is OK: OK: brokers:9 topics:1 [15:23:10] Fundraising-Backlog, FR-AutoTY-Email: Endowment TY email review Q2 2020 - https://phabricator.wikimedia.org/T267336 (MBeat33) [15:38:41] Fundraising-Backlog, FR-AutoTY-Email, Fr-endowment: Endowment TY email review Q2 2020 - https://phabricator.wikimedia.org/T267336 (MBeat33) [15:39:15] Wikimedia-Fundraising-Banners: 2020-11-05 en6C pre-test: desktop large batch - https://phabricator.wikimedia.org/T267152 (jbolorinos-ctr) Verified the following buttons redirect correctly to Ingenico and Adyen URLs: Ingenico: ✅ Yes, I'll give monthly ✅ No thanks, I'll give once ✅ Yes I'll donate monthly, bu... [16:11:37] Fundraising-Backlog, MediaWiki-extensions-CLDR: Is CldrCurrency still used? - https://phabricator.wikimedia.org/T267285 (DStrine) Thanks for the note. We are in a strict code freeze until January. But in January to June we usually clean up a lot of stuff. [16:21:21] Fundraising-Backlog, MediaWiki-extensions-CLDR: Is CldrCurrency still used? - https://phabricator.wikimedia.org/T267285 (Reedy) Cheers. It's not urgent for sure, and would only be removed in cldr master Though, if it is used, it's possibly a good sign that #vps-project-codesearch might need to be scanni... [16:32:29] PROBLEM - check_kafkatee on frban2001 is CRITICAL: CRITICAL: kafka-jumbo1002:down [16:32:33] PROBLEM - check_kafkatee on frban1001 is CRITICAL: CRITICAL: kafka-jumbo1002:down [16:37:33] PROBLEM - check_kafkatee on frban1001 is CRITICAL: CRITICAL: kafka-jumbo1002:down [16:37:33] PROBLEM - check_kafkatee on frban2001 is CRITICAL: CRITICAL: kafka-jumbo1002:down [16:38:21] Fundraising Sprint Vagranty McVagrantface, Fundraising-Backlog, FR-AutoTY-Email, Fr-endowment: Endowment TY email review Q2 2020 - https://phabricator.wikimedia.org/T267336 (DStrine) [16:42:29] RECOVERY - check_kafkatee on frban2001 is OK: OK: brokers:9 topics:2 [16:42:39] RECOVERY - check_kafkatee on frban1001 is OK: OK: brokers:9 topics:1 [16:48:46] (PS1) Cstone: Remove matching gifts language from endowment thank you. [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/639584 [16:49:11] Fundraising Sprint Vagranty McVagrantface, Fundraising-Backlog, FR-AutoTY-Email, Fr-endowment, Patch-For-Review: Endowment TY email review Q2 2020 - https://phabricator.wikimedia.org/T267336 (Cstone) a:Cstone [16:49:28] Wikimedia-Fundraising-Banners: 2020-11-05 en6C pre-test: desktop small batch - https://phabricator.wikimedia.org/T267153 (jbolorinos-ctr) Verified the following buttons redirect correctly to Ingenico and Adyen URLs: Ingenico: ✅ Yes, I'll give monthly ✅ No thanks, I'll give once ✅ Yes I'll donate monthly, bu... [17:00:37] Fundraising Sprint Vagranty McVagrantface, Fundraising-Backlog, Android-app-Bugs, Operations, and 4 others: Deal with donatewiki Thank You page launching in apps - https://phabricator.wikimedia.org/T259312 (CDanis) [17:12:29] PROBLEM - check_kafkatee on frban2001 is CRITICAL: CRITICAL: kafka-jumbo1003:down, kafka-jumbo1002:down [17:12:39] PROBLEM - check_kafkatee on frban1001 is CRITICAL: CRITICAL: kafka-jumbo1002:down, kafka-jumbo1003:down [17:12:43] RECOVERY - check_puppetrun on frav1002 is OK: OK: Puppet is currently enabled, last run 40 seconds ago with 0 failures [17:17:29] PROBLEM - check_kafkatee on frban2001 is CRITICAL: CRITICAL: kafka-jumbo1002:down, kafka-jumbo1003:down [17:17:39] PROBLEM - check_kafkatee on frban1001 is CRITICAL: CRITICAL: kafka-jumbo1002:down, kafka-jumbo1003:down [17:22:33] PROBLEM - check_kafkatee on frban2001 is CRITICAL: CRITICAL: kafka-jumbo1002:down, kafka-jumbo1003:down [17:22:39] PROBLEM - check_kafkatee on frban1001 is CRITICAL: CRITICAL: kafka-jumbo1002:down, kafka-jumbo1003:down [17:25:18] ACKNOWLEDGEMENT - check_kafkatee on frban1001 is CRITICAL: CRITICAL: kafka-jumbo1002:down, kafka-jumbo1003:down Dwisehaupt known. [17:25:18] ACKNOWLEDGEMENT - check_kafkatee on frban2001 is CRITICAL: CRITICAL: kafka-jumbo1002:down, kafka-jumbo1003:down Dwisehaupt known. [17:37:31] RECOVERY - check_kafkatee on frban1001 is OK: OK: brokers:9 topics:1 [17:37:39] RECOVERY - check_kafkatee on frban2001 is OK: OK: brokers:9 topics:2 [17:40:14] Fundraising Sprint Vagranty McVagrantface, Fundraising-Backlog, Android-app-Bugs, Operations, and 4 others: Deal with donatewiki Thank You page launching in apps - https://phabricator.wikimedia.org/T259312 (CDanis) Sorry, there's a small mess here -- parts of the relevant behavior are specified i... [17:57:29] PROBLEM - check_kafkatee on frban2001 is CRITICAL: CRITICAL: kafka-jumbo1004:down [17:57:39] PROBLEM - check_kafkatee on frban1001 is CRITICAL: CRITICAL: kafka-jumbo1004:down [17:59:08] ACKNOWLEDGEMENT - check_kafkatee on frban1001 is CRITICAL: CRITICAL: kafka-jumbo1004:down Dwisehaupt More prod maint work going on. [17:59:08] ACKNOWLEDGEMENT - check_kafkatee on frban2001 is CRITICAL: CRITICAL: kafka-jumbo1004:down Dwisehaupt More prod maint work going on. [18:21:23] Fundraising Sprint Princess Mongodb, Fundraising-Backlog, FR-dlocal: Dlocal cancel buttons don't go back to the payments wiki form - https://phabricator.wikimedia.org/T229336 (DStrine) [18:27:29] RECOVERY - check_kafkatee on frban2001 is OK: OK: brokers:9 topics:2 [18:27:37] RECOVERY - check_kafkatee on frban1001 is OK: OK: brokers:9 topics:1 [18:37:33] PROBLEM - check_kafkatee on frban2001 is CRITICAL: CRITICAL: kafka-jumbo1005:down [18:37:39] PROBLEM - check_kafkatee on frban1001 is CRITICAL: CRITICAL: kafka-jumbo1005:down [18:42:33] PROBLEM - check_kafkatee on frban2001 is CRITICAL: CRITICAL: kafka-jumbo1005:down [18:42:39] PROBLEM - check_kafkatee on frban1001 is CRITICAL: CRITICAL: kafka-jumbo1005:down [18:48:28] Fundraising-Backlog: Unclear error message for unsupported credit card - https://phabricator.wikimedia.org/T244588 (jbolorinos-ctr) [18:52:13] Fundraising-Backlog: Unclear error message for unsupported credit card - https://phabricator.wikimedia.org/T244588 (jbolorinos-ctr) While testing T267152 I noticed this unclear error message DOES appear for the US (although not for GB) {F32438618} [18:57:29] RECOVERY - check_kafkatee on frban2001 is OK: OK: brokers:9 topics:2 [18:57:39] RECOVERY - check_kafkatee on frban1001 is OK: OK: brokers:9 topics:1 [19:04:17] ejegg: meeting? [19:04:26] ack! [19:11:29] PROBLEM - check_puppetrun on frdb2002 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 9 minutes ago with 1 failures. Failed resources (up to 3 shown): Package[mariadb-client] [19:12:29] PROBLEM - check_puppetrun on frdb2001 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 11 minutes ago with 1 failures. Failed resources (up to 3 shown): Package[mariadb-client] [19:12:33] PROBLEM - check_puppetrun on frdb1003 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 11 minutes ago with 1 failures. Failed resources (up to 3 shown): Package[mariadb-client] [19:12:39] PROBLEM - check_puppetrun on frdb1001 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 10 minutes ago with 1 failures. Failed resources (up to 3 shown): Package[mariadb-client] [19:16:28] ACKNOWLEDGEMENT - check_puppetrun on frdb1001 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 10 minutes ago with 1 failures. Failed resources (up to 3 shown): Package[mariadb-client] Dwisehaupt known, acking until config changes or package locks can be made. [19:16:28] ACKNOWLEDGEMENT - check_puppetrun on frdb1003 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 11 minutes ago with 1 failures. Failed resources (up to 3 shown): Package[mariadb-client] Dwisehaupt known, acking until config changes or package locks can be made. [19:16:28] ACKNOWLEDGEMENT - check_puppetrun on frdb2001 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 11 minutes ago with 1 failures. Failed resources (up to 3 shown): Package[mariadb-client] Dwisehaupt known, acking until config changes or package locks can be made. [19:16:28] ACKNOWLEDGEMENT - check_puppetrun on frdb2002 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 9 minutes ago with 1 failures. Failed resources (up to 3 shown): Package[mariadb-client] Dwisehaupt known, acking until config changes or package locks can be made. [19:47:29] RECOVERY - check_puppetrun on frdb2001 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [19:49:34] lolol CiviMcRestFace is another option for proxying calls: https://civicrm.org/blog/jaapjansma/civiproxy-and-civimcrestface-sprint-in-bonn [19:51:35] lol [20:15:14] Fundraising Sprint Vagranty McVagrantface, Fundraising-Backlog, FR-Email: Investigate email preference center prototype - https://phabricator.wikimedia.org/T266607 (jgleeson) We had a discussion with fr-tech-ops on this subject today and talked through potential configurations. Elliott made notes [... [20:32:24] (CR) Eileen: [C: +2] "Seems straight forward" [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/639584 (owner: Cstone) [20:33:36] (CR) Eileen: "> Patch Set 1:" [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/639448 (https://phabricator.wikimedia.org/T267255) (owner: Eileen) [20:34:39] (CR) Eileen: "Actually it was by email" [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/639448 (https://phabricator.wikimedia.org/T267255) (owner: Eileen) [20:35:07] Fundraising Sprint Vagranty McVagrantface, Fundraising-Backlog, Patch-For-Review: Stripe Import error: INVALID_FILE_FORMAT This file is missing column headers - https://phabricator.wikimedia.org/T267255 (Eileenmcnaughton) From Stripe Hi Jerry, Thanks for getting in touch with us. I hope you're doin... [20:51:39] Fundraising Sprint Vagranty McVagrantface, Fundraising-Backlog: matching gifts values don't match between databases - https://phabricator.wikimedia.org/T266475 (Eileenmcnaughton) @MNoorWMF can you confirm this is closable? [21:07:49] Fundraising-Backlog, fr-donorservices: Invalid Pares Decline Error - https://phabricator.wikimedia.org/T247023 (MBeat33) Thank you for this info, @EMartin. We have broadened our donor-facing error messaging for this case (which Ingenico provided years ago) to be about more than just a 3DS validation erro... [21:11:33] RECOVERY - check_puppetrun on frdb2002 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [21:55:27] wow - my laptop just arrived - so now I have to figure out how to set up my first ever ubuntu laptop.... [21:58:49] eileen: this might help some: Received: from civi1001 (civi1001.frack.eqiad.wmnet [10.64.40.109]) by [21:58:53] gah. [21:59:06] https://wikitech.wikimedia.org/wiki/Wmf-sre-laptop [21:59:36] thanks! [21:59:41] i hope to eventually get some hooks in there for an fr-tech laptop to add in the more pci specific stuff too, but haven't gotten the spare time yet. [22:10:29] Fundraising-Backlog, fundraising-tech-ops: Create new job to send Civi thank you emails over smtp through frmx hosts - https://phabricator.wikimedia.org/T267259 (Dwisehaupt) After some discussion we have decided to split this into two new send mail scripts per civi host. The reason for this is that if we... [22:12:04] Fundraising-Backlog, fundraising-tech-ops: Create new job to send Civi thank you emails over smtp through frmx hosts - https://phabricator.wikimedia.org/T267259 (Dwisehaupt) [22:39:14] (PS1) Ejegg: Deal with another possible paypal gateway miscode [wikimedia/fundraising/tools] - https://gerrit.wikimedia.org/r/639636 [22:39:38] fr-tech there's a little fix that should stop us getting so many failmails for missing subscr_ids ^^^ [22:40:00] so we happen to use the subscr_id format as a way to tell which donations are paypal_ec [22:45:20] hmm, I guess another way to go would be to default the gateway to paypal_ec and only use 'paypal' when the subscr_id starts with 'S-' [23:18:22] so with this laptop - this is my first ever attempt to actually install a 'nix [23:18:45] so am not quite sure what my first step should be [23:18:53] so far I have plugged it in :-) [23:19:21] oh. [23:19:27] hmmm... [23:21:39] I put the ubuntu iso on a flash drive i think and then installed from there [23:21:47] honestly, it's probably easiest to download the latest ubuntu install medium on a usb key and install from it. ensure that you select the option for full disk encryption when installing. [23:22:06] i was looking to see if i had a doc on it but looks like i don't. [23:23:20] as for what release, personally i prefer the LTS version (currently 20.04) for stability. but there shouldn't be too much of an issue if you go with the latest 20.10 [23:27:53] ok cool thanks - next job - figure out where my USB is :-)