[00:02:23] (CR) Cstone: [C: +2] "looks good" [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/654703 (https://phabricator.wikimedia.org/T271189) (owner: Eileen) [00:12:07] cstone: so I also put up 2 patches to make that actually start to run on the Japanese peeps https://gerrit.wikimedia.org/r/c/wikimedia/fundraising/crm/+/654708 will stop excluding them & the one above it will get the deferred ones going again [00:14:45] (CR) Cstone: [C: +2] Revert "Exclude Japanese language emails from eoy_receipts run" [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/654708 (https://phabricator.wikimedia.org/T271189) (owner: Eileen) [00:15:11] (CR) Cstone: [C: +2] Requeue deferred Japanese emails [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/654715 (https://phabricator.wikimedia.org/T271189) (owner: Eileen) [00:15:19] ok cool eileen [00:16:13] now the jenkins wait! [00:19:02] (Merged) jenkins-bot: Update ja eoy email to remove the salutation [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/654703 (https://phabricator.wikimedia.org/T271189) (owner: Eileen) [00:24:35] jenkins needs a theme song. [00:32:35] (Merged) jenkins-bot: Revert "Exclude Japanese language emails from eoy_receipts run" [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/654708 (https://phabricator.wikimedia.org/T271189) (owner: Eileen) [00:35:44] (Merged) jenkins-bot: Requeue deferred Japanese emails [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/654715 (https://phabricator.wikimedia.org/T271189) (owner: Eileen) [00:36:59] Fundraising-Backlog, fundraising-tech-ops: adjust fr-log-announcer to use IRC more securely - https://phabricator.wikimedia.org/T122104 (Dwisehaupt) Open→Resolved This was completed a while ago. closing. [00:45:05] (PS1) Eileen: Merge branch 'master' of https://gerrit.wikimedia.org/r/wikimedia/fundraising/crm into deployment [wikimedia/fundraising/crm] (deployment) - https://gerrit.wikimedia.org/r/654722 [00:45:26] (CR) Eileen: [C: +2] Merge branch 'master' of https://gerrit.wikimedia.org/r/wikimedia/fundraising/crm into deployment [wikimedia/fundraising/crm] (deployment) - https://gerrit.wikimedia.org/r/654722 (owner: Eileen) [00:50:08] !log civicrm revision changed from 95fefcb421 to 2df572bdcd, config revision is 603c0ff4a0 [00:50:10] Logged the message at https://wikitech.wikimedia.org/wiki/Server_Admin_Log [00:51:47] Fundraising Sprint A 2021, Fundraising Sprint Zeitgeistbusters, Fundraising-Backlog, Patch-For-Review: Japanese name issues in EOY receipt - https://phabricator.wikimedia.org/T271189 (Eileenmcnaughton) Japanese emails are now going out without the name - current status of emails select status,... [00:52:25] Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM: Low-prevalence name issue((s) on contacts with dupe rows with null names - https://phabricator.wikimedia.org/T271378 (Eileenmcnaughton) [00:55:41] dstrine: MBeat japanese emails are going out (nameless) now [00:55:51] oh ok cool [00:58:30] I gotta run but I'll update people in about an hour [01:00:59] cstone: I gotta go out for a bit for a scan of my knee. I have just deployed that change & will check in again in a couple of hours - but I really can't see it causing any problems [01:01:14] okie ill be around [01:56:08] Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM: Low-prevalence name issue(s) on contacts with dupe rows with null names - https://phabricator.wikimedia.org/T271378 (Reedy) [02:41:00] I got my end of year receipt :) [06:14:23] (PS1) Eileen: Drupal update to 7.77 [wikimedia/fundraising/crm/drupal] - https://gerrit.wikimedia.org/r/654736 [06:14:25] (PS1) Eileen: Re-apply WMF patches [wikimedia/fundraising/crm/drupal] - https://gerrit.wikimedia.org/r/654737 [06:28:11] (CR) jerkins-bot: [V: -1] Drupal update to 7.77 [wikimedia/fundraising/crm/drupal] - https://gerrit.wikimedia.org/r/654736 (owner: Eileen) [06:30:21] (PS1) Eileen: Update mrmarkfrench/silverpop-php-connector [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/654739 (https://phabricator.wikimedia.org/T269811) [09:57:30] PROBLEM - check_swap on frdb2001 is CRITICAL: SWAP CRITICAL - 1% free (0 MB out of 7627 MB) [10:02:30] PROBLEM - check_swap on frdb2001 is CRITICAL: SWAP CRITICAL - 1% free (1 MB out of 7627 MB) [10:07:30] PROBLEM - check_swap on frdb2001 is CRITICAL: SWAP CRITICAL - 0% free (0 MB out of 7627 MB) [10:12:30] PROBLEM - check_swap on frdb2001 is CRITICAL: SWAP CRITICAL - 1% free (0 MB out of 7627 MB) [10:17:30] PROBLEM - check_swap on frdb2001 is CRITICAL: SWAP CRITICAL - 1% free (0 MB out of 7627 MB) [10:22:30] PROBLEM - check_swap on frdb2001 is CRITICAL: SWAP CRITICAL - 1% free (0 MB out of 7627 MB) [10:27:30] PROBLEM - check_swap on frdb2001 is CRITICAL: SWAP CRITICAL - 1% free (0 MB out of 7627 MB) [10:32:28] PROBLEM - check_swap on frdb2001 is CRITICAL: SWAP CRITICAL - 1% free (0 MB out of 7627 MB) [10:37:30] PROBLEM - check_swap on frdb2001 is CRITICAL: SWAP CRITICAL - 1% free (3 MB out of 7627 MB) [10:42:34] PROBLEM - check_swap on frdb2001 is CRITICAL: SWAP CRITICAL - 1% free (19 MB out of 7627 MB) [10:47:30] PROBLEM - check_swap on frdb2001 is CRITICAL: SWAP CRITICAL - 1% free (0 MB out of 7627 MB) [10:52:30] PROBLEM - check_swap on frdb2001 is CRITICAL: SWAP CRITICAL - 1% free (0 MB out of 7627 MB) [10:57:30] PROBLEM - check_swap on frdb2001 is CRITICAL: SWAP CRITICAL - 1% free (1 MB out of 7627 MB) [11:02:30] PROBLEM - check_swap on frdb2001 is CRITICAL: SWAP CRITICAL - 1% free (10 MB out of 7627 MB) [11:07:30] PROBLEM - check_swap on frdb2001 is CRITICAL: SWAP CRITICAL - 1% free (12 MB out of 7627 MB) [11:12:30] PROBLEM - check_swap on frdb2001 is CRITICAL: SWAP CRITICAL - 1% free (15 MB out of 7627 MB) [11:17:24] PROBLEM - check_swap on frdb2001 is CRITICAL: SWAP CRITICAL - 1% free (16 MB out of 7627 MB) [11:22:30] PROBLEM - check_swap on frdb2001 is CRITICAL: SWAP CRITICAL - 1% free (20 MB out of 7627 MB) [11:27:30] PROBLEM - check_swap on frdb2001 is CRITICAL: SWAP CRITICAL - 1% free (20 MB out of 7627 MB) [11:32:30] PROBLEM - check_swap on frdb2001 is CRITICAL: SWAP CRITICAL - 1% free (0 MB out of 7627 MB) [11:37:34] PROBLEM - check_swap on frdb2001 is CRITICAL: SWAP CRITICAL - 1% free (2 MB out of 7627 MB) [11:42:34] PROBLEM - check_swap on frdb2001 is CRITICAL: SWAP CRITICAL - 1% free (14 MB out of 7627 MB) [14:01:34] PROBLEM - check_puppetrun on fran1001 is CRITICAL: CRITICAL: Puppet has 2 failures. Last run 1 minute ago with 2 failures. Failed resources (up to 3 shown): Exec[superset_db_upgrade] [14:06:34] PROBLEM - check_puppetrun on fran1001 is CRITICAL: CRITICAL: Puppet has 2 failures. Last run 1 minute ago with 2 failures. Failed resources (up to 3 shown): Exec[superset_db_upgrade] [14:11:34] PROBLEM - check_puppetrun on fran1001 is CRITICAL: CRITICAL: Puppet has 2 failures. Last run 6 minutes ago with 2 failures. Failed resources (up to 3 shown): Exec[superset_db_upgrade] [14:12:17] Fundraising-Backlog, fundraising-tech-ops, FR-Tech-Analytics: Upgrade Fundraising Superset to 0.37.x - https://phabricator.wikimedia.org/T262439 (Jgreen) This was a minor disaster. I tried upgrade using commit 7bdc41487a3, which is the version that was successful in virtualbox testing. The upgrade f... [14:12:35] minor disaster [14:16:30] RECOVERY - check_puppetrun on fran1001 is OK: OK: Puppet is currently enabled, last run 11 seconds ago with 0 failures [14:28:11] Fundraising Sprint A 2021, Fundraising-Backlog: Step 2 Investigate spreedly - https://phabricator.wikimedia.org/T271075 (jgleeson) Put this down for now as understanding PayPal & Adyen integrations seem to be a prerequisite. [14:28:25] Fundraising Sprint A 2021, Fundraising-Backlog: Step 2 Investigate spreedly - https://phabricator.wikimedia.org/T271075 (jgleeson) a:jgleeson→None [14:28:28] Fundraising-Backlog, fundraising-tech-ops, FR-Tech-Analytics: Upgrade Fundraising Superset to 0.37.x - https://phabricator.wikimedia.org/T262439 (Jgreen) Open→Resolved a:Jgreen [14:29:09] Fundraising Sprint A 2021, Fundraising-Backlog: Sep 1: Investigate Adyen drop-in-web - https://phabricator.wikimedia.org/T271076 (jgleeson) a:jgleeson [14:43:24] Fundraising-Backlog, fundraising-tech-ops: Set up the data delivery tool base software - https://phabricator.wikimedia.org/T270647 (Jgreen) [14:43:37] fundraising-tech-ops, SRE: (Need By: 2020-09-30) rack/setup/install frmx1001 & frdata1002 - https://phabricator.wikimedia.org/T260181 (Jgreen) Open→Resolved [14:43:57] fundraising-tech-ops, SRE: (Need By: 2020-09-30) rack/setup/install frmx1001 & frdata1002 - https://phabricator.wikimedia.org/T260181 (Jgreen) a:Jgreen [16:46:19] Fundraising-Backlog, fundraising-tech-ops, Security: Run composer.lock version vulnerability checker daily - https://phabricator.wikimedia.org/T154720 (Dwisehaupt) duplicate→Resolved [19:33:02] fundraising-tech-ops, SRE: hw troubleshooting: Illegal opcode error on boot for frdb1001.frack.eqiad.wmnet - https://phabricator.wikimedia.org/T271284 (Cmjohnson) a:Cmjohnson→Dwisehaupt This server is well out of warranty but a quick google check because I have never seen an Illegal opcode error... [20:21:05] fundraising-tech-ops, DC-Ops, SRE, ops-codfw: (Need By: 2021-01-30) rack/setup/install frqueue2002.frack.codfw.wmnet - https://phabricator.wikimedia.org/T269481 (Jgreen) [20:34:06] Fundraising-Backlog, Analytics, Event-Platform: CentralNoticeBannerHistory and CentralNoticeImpression Event Platform Migration - https://phabricator.wikimedia.org/T271168 (EYener) Hi all! CCing @AndyRussG - do we in Fundraising need IP data for either CentralNoticeImpressions or CentralNoticeBannerH... [20:37:03] fundraising-tech-ops, DC-Ops, SRE, ops-codfw: (Need By: 2021-01-30) rack/setup/install frqueue2002.frack.codfw.wmnet - https://phabricator.wikimedia.org/T269481 (Jgreen) [20:38:32] Fundraising-Backlog, Analytics, Event-Platform: CentralNoticeBannerHistory and CentralNoticeImpression Event Platform Migration - https://phabricator.wikimedia.org/T271168 (AndyRussG) >>! In T271168#6729693, @EYener wrote: > Hi all! CCing @AndyRussG - do we in Fundraising need IP data for either Cent... [20:45:52] Fundraising-Backlog, Analytics, Event-Platform: CentralNoticeBannerHistory and CentralNoticeImpression Event Platform Migration - https://phabricator.wikimedia.org/T271168 (AndyRussG) @Ottomata hey also (apologies if this question has already been resolved) is there any action needed on our part for... [21:01:14] Fundraising-Backlog, Analytics, Event-Platform: CentralNoticeBannerHistory and CentralNoticeImpression Event Platform Migration - https://phabricator.wikimedia.org/T271168 (Ottomata) Oh...that is a bit of a problem then. Can we change that so that it logs using the EventLogging client JS? [22:04:16] (CR) Mepps: [C: +2] Campaign filtering [extensions/CentralNotice] - https://gerrit.wikimedia.org/r/604279 (https://phabricator.wikimedia.org/T268646) (owner: AlexPinchuk) [22:08:52] (Merged) jenkins-bot: Campaign filtering [extensions/CentralNotice] - https://gerrit.wikimedia.org/r/604279 (https://phabricator.wikimedia.org/T268646) (owner: AlexPinchuk) [22:31:57] fundraising-tech-ops: adjust gerrit wikimedia/fundraising/analytics project for fundraising deploy use - https://phabricator.wikimedia.org/T271111 (Jgreen) Open→Resolved a:Jgreen This is done, we have fundraising/analytics configured as a private repo and a service/bot user in Gerrit that can acc... [23:05:25] (CR) Cstone: [C: +2] "Nice! Good to have them all in an easier to find place too." [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/652454 (https://phabricator.wikimedia.org/T270680) (owner: Eileen) [23:07:03] (CR) Cstone: [C: +2] Remove update function that aligned prod with options on a new install [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/652460 (https://phabricator.wikimedia.org/T270680) (owner: Eileen) [23:07:31] (CR) Cstone: [C: +2] Remove update 8055 as it does index fixes not needed on new installs [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/652461 (https://phabricator.wikimedia.org/T270680) (owner: Eileen) [23:25:23] (CR) jerkins-bot: [V: -1] Remove update function that aligned prod with options on a new install [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/652460 (https://phabricator.wikimedia.org/T270680) (owner: Eileen) [23:25:25] (CR) jerkins-bot: [V: -1] Remove update 8055 as it does index fixes not needed on new installs [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/652461 (https://phabricator.wikimedia.org/T270680) (owner: Eileen) [23:56:13] (PS2) Cstone: Remove update function that aligned prod with options on a new install [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/652460 (https://phabricator.wikimedia.org/T270680) (owner: Eileen)