[00:29:53] fundraising-tech-ops: adjust gerrit wikimedia/fundraising/analytics project for fundraising deploy use - https://phabricator.wikimedia.org/T271111 (thcipriani) [00:35:27] !log civicrm revision changed from 6be8a130df to 1d5f6365ba, config revision is d8756a45c1 [00:35:30] Logged the message at https://wikitech.wikimedia.org/wiki/Server_Admin_Log [00:43:23] I just did a test run on emailing excluding Japanese. 1 out of 1000 was excluded & updated to the deferred_ja status which seems good - I'm going to re-enable the jobs now [00:46:24] !log process-control config revision is c38eaa20ed [00:46:26] Logged the message at https://wikitech.wikimedia.org/wiki/Server_Admin_Log [00:49:15] Fundraising Sprint A 2021, Fundraising Sprint Zeitgeistbusters, Fundraising-Backlog, Patch-For-Review: Japanese name issues in EOY receipt - https://phabricator.wikimedia.org/T271189 (Eileenmcnaughton) I just deployed the fix & re-enabled the jobs but - then I realised that it's possible there... [00:55:36] !log process-control config revision is 9bc3d67b02 [00:55:36] job off again :-( - I realise we actually cached the names so need to update or recalculate + not only Japanese affected (I found one Chinese) [00:55:39] Logged the message at https://wikitech.wikimedia.org/wiki/Server_Admin_Log [00:56:18] cstone: are you still there? [01:23:36] (PS1) Legoktm: build: Updating mediawiki/minus-x to 1.1.1 [extensions/DonationInterface] - https://gerrit.wikimedia.org/r/654564 (https://phabricator.wikimedia.org/T271180) [01:33:58] hey eileen im back now [01:39:57] but I have to go in 10 [09:00:00] (PS1) Eileen: Update existing (unsent) mails with the name in bad characters. [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/654594 [09:03:59] (CR) jerkins-bot: [V: -1] Update existing (unsent) mails with the name in bad characters. [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/654594 (owner: Eileen) [09:49:14] (PS2) Eileen: Update existing (unsent) mails with the name in bad characters. [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/654594 [09:52:24] PROBLEM - check_mysql on frdb2001 is CRITICAL: Slave IO: Preparing Slave SQL: Yes Seconds Behind Master: (null) [09:57:24] RECOVERY - check_mysql on frdb2001 is OK: Uptime: 54341 Threads: 12 Questions: 790222 Slow queries: 20 Opens: 1438 Flush tables: 1 Open tables: 864 Queries per second avg: 14.541 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 0 [15:42:16] fr-tech does someone want to represent the team at scrum of scrums? [15:42:29] starts in 50 min [15:44:03] etherpad here  http://etherpad.wikimedia.org/p/Scrum-of-Scrums [15:44:34] meet link is Unirse con Google Meet: https://meet.google.com/cjo-ejuo-njs [15:48:13] I could try but maybe jgleeson wants to? [15:48:32] no mepps that would be great if you could I have to start cooking around then [15:48:40] cool jgleeson [15:48:46] thanks much!! [15:48:48] fr-tech any news for scrum of scrums? [15:49:09] AndyRussG do we have any other teams blocking us on anything CN related? [15:49:27] also hi ejegg|away! [15:49:38] our end of year send is off to a start/stop/start mepps :)_ [15:51:16] thanks jgleeson [15:52:04] thanks for the heads up ejegg|away. hope it's all going well and see you in a few weeks! [15:54:48] AndyRussG do we have any blockers from other teams? [15:54:55] or dstrine ^^ [16:11:07] mepps: looks like AndyRussG is OOO for the rest of the week [16:13:46] Fundraising Sprint A 2021, Fundraising-Backlog: Step 2 Investigate spreedly - https://phabricator.wikimedia.org/T271075 (jgleeson) a:jgleeson [16:14:15] Fundraising-Backlog, FR-Civi-Prospect, Fr-endowment: Need a very special group created - https://phabricator.wikimedia.org/T271333 (NNichols) [16:15:27] thanks jgleeson [16:29:38] mepps: I installed https://chrome.google.com/webstore/detail/stayfocusd/laankejkbhbdhmipfmgcngdelahlfoji?hl=en today [16:29:56] and added facebook, bbc, whatsapp web and youtube to it [16:30:05] and it's worked a handful of times already! [16:30:34] when I go on auto pilot and try to access one of them it hits me with Shouldn't you be working? [16:34:45] heh, good link there, as I find myself maybe refreshing the election news sites a little too frequently ;-) [16:44:08] nice jgleeson! [17:31:39] Fundraising-Backlog, fundraising-tech-ops, Security: Run composer.lock version vulnerability checker daily - https://phabricator.wikimedia.org/T154720 (Jgreen) [17:31:46] Fundraising-Backlog, fundraising-tech-ops: create and/or automate tools for auditing composer-installed php packages - https://phabricator.wikimedia.org/T154509 (Jgreen) [17:35:48] Fundraising-Backlog, fundraising-tech-ops: create and/or automate tools for auditing composer-installed php packages - https://phabricator.wikimedia.org/T154509 (Jgreen) from an IRC discussion with legoktm: * there's a daily CI job (eg https://integration.wikimedia.org/ci/job/mediawiki-php-security/) th... [17:40:48] (CR) Jforrester: [C: +2] build: Updating mediawiki/minus-x to 1.1.1 [extensions/DonationInterface] - https://gerrit.wikimedia.org/r/654564 (https://phabricator.wikimedia.org/T271180) (owner: Legoktm) [17:43:21] (Merged) jenkins-bot: build: Updating mediawiki/minus-x to 1.1.1 [extensions/DonationInterface] - https://gerrit.wikimedia.org/r/654564 (https://phabricator.wikimedia.org/T271180) (owner: Legoktm) [18:01:14] Fundraising-Backlog, fundraising-tech-ops: create and/or automate tools for auditing composer-installed php packages - https://phabricator.wikimedia.org/T154509 (Jgreen) [18:08:09] I've jgleeson|dinner cstone yep I turned the job off again last night when I realised some Chinese / Italian donors were affected too - I put up a patch that should fix & we can get them out [18:10:41] the issue is that the 'names' are already populated https://gerrit.wikimedia.org/r/c/wikimedia/fundraising/crm/+/654594 [18:11:21] fundraising-tech-ops, SRE, netops, Patch-For-Review: Manage frack switches with Netbox - https://phabricator.wikimedia.org/T268802 (Dwisehaupt) a:Dwisehaupt [18:15:38] fundraising-tech-ops: Add syntax checking and linting to fr-tech-ops repos - https://phabricator.wikimedia.org/T253899 (Dwisehaupt) Open→Resolved a:Dwisehaupt We are at a going point for this now. Closing. [18:35:16] That patch (654594) is updating our stored names so it should be fairly easy to review for people who haven't been in the thick of the code too [18:49:05] (PS2) Eileen: Remove unused function [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/652456 (https://phabricator.wikimedia.org/T270680) [18:49:08] (CR) Jgleeson: [C: +2] "Discussed on tech-talk. Looks good!" [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/654594 (owner: Eileen) [19:06:42] (Merged) jenkins-bot: Update existing (unsent) mails with the name in bad characters. [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/654594 (owner: Eileen) [19:08:08] (PS1) Eileen: Merge branch 'master' of https://gerrit.wikimedia.org/r/wikimedia/fundraising/crm into deployment [wikimedia/fundraising/crm] (deployment) - https://gerrit.wikimedia.org/r/654665 [19:08:57] (CR) Eileen: [C: +2] Merge branch 'master' of https://gerrit.wikimedia.org/r/wikimedia/fundraising/crm into deployment [wikimedia/fundraising/crm] (deployment) - https://gerrit.wikimedia.org/r/654665 (owner: Eileen) [19:11:38] !log civicrm revision changed from 1d5f6365ba to 95fefcb421, config revision is 9bc3d67b02 [19:11:40] Logged the message at https://wikitech.wikimedia.org/wiki/Server_Admin_Log [19:13:26] !log process-control config revision is 2909e8b9ed [19:13:26] - back on again [19:13:28] Logged the message at https://wikitech.wikimedia.org/wiki/Server_Admin_Log [19:37:53] !log increased batch processes on eoy_receipt - now 9000 per hour process-control config revision is 7b8319b97d [19:37:55] Logged the message at https://wikitech.wikimedia.org/wiki/Server_Admin_Log [20:12:49] the EOY run with with the higher limit job started at :04 and finished on the mailer at :09. we should have no issue with the larger volume at this stage. [20:12:55] i'm gonna grab some lunch. [20:12:58] back in a few. [21:25:58] Fundraising Sprint A 2021, Fundraising Sprint Zeitgeistbusters, Fundraising-Backlog, Patch-For-Review: Japanese name issues in EOY receipt - https://phabricator.wikimedia.org/T271189 (DStrine) Per @jrobell we should remove the greeting and send to Japanese donors when possible. [21:26:56] (PS15) Mepps: Add unit tests for CampaignType [extensions/CentralNotice] - https://gerrit.wikimedia.org/r/649420 (https://phabricator.wikimedia.org/T268646) [21:30:44] (CR) jerkins-bot: [V: -1] Add unit tests for CampaignType [extensions/CentralNotice] - https://gerrit.wikimedia.org/r/649420 (https://phabricator.wikimedia.org/T268646) (owner: Mepps) [21:42:01] (CR) Mepps: [C: +2] "Updated my db locally correctly." [extensions/CentralNotice] - https://gerrit.wikimedia.org/r/647349 (https://phabricator.wikimedia.org/T268646) (owner: Mepps) [21:46:46] (Merged) jenkins-bot: Schema updates for campaign filtering [extensions/CentralNotice] - https://gerrit.wikimedia.org/r/647349 (https://phabricator.wikimedia.org/T268646) (owner: Mepps) [21:49:31] Fundraising Sprint A 2021, Fundraising Sprint Xtreme Lolcats, Fundraising Sprint Yellow hornets of kindness and healing, Fundraising Sprint Zeitgeistbusters, and 3 others: Code review, fix major and minor issues, follow up on new requirements, write tests a... - https://phabricator.wikimedia.org/T268646 [21:54:27] (PS59) Mepps: Campaign filtering [extensions/CentralNotice] - https://gerrit.wikimedia.org/r/604279 (https://phabricator.wikimedia.org/T268646) (owner: AlexPinchuk) [21:54:29] (PS1) Mepps: CampaignType: Hide forced campaign type selections in user prefs [extensions/CentralNotice] - https://gerrit.wikimedia.org/r/654682 [21:58:58] !log process-control config revision is 603c0ff4a0 [21:59:01] Logged the message at https://wikitech.wikimedia.org/wiki/Server_Admin_Log [21:59:49] !log increased batch size for eoy_receipt to 4000 per run when frmx1001 is the primary mx [21:59:51] Logged the message at https://wikitech.wikimedia.org/wiki/Server_Admin_Log [22:50:39] (PS1) Eileen: Update ja eoy email to remove the salutation [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/654703 (https://phabricator.wikimedia.org/T271185) [22:51:01] dstrine - my understanding is that ^^ has been agreed now? [22:58:08] eileen: yes [22:58:59] ok - cstone might be a good one for you to review (change to Japanese text) [22:59:28] eileen: I guess we have 2 tasks regarding this. I updated this one: https://phabricator.wikimedia.org/T271189 [23:00:09] dstrine: yep - one should be about the mangled names & the other about the Japanese issue [23:00:17] I think I just committed against the wrong one..... [23:01:15] (PS1) Eileen: Revert "Exclude Japanese language emails from eoy_receipts run" [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/654708 (https://phabricator.wikimedia.org/T271189) [23:01:23] I just fixed the commit to the right one [23:02:10] (PS2) Eileen: Update ja eoy email to remove the salutation [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/654703 (https://phabricator.wikimedia.org/T271189) [23:02:54] eileen i can look [23:03:34] no more Christinesama [23:05:37] :-) [23:06:01] I didn't catch that ???-san [23:07:56] Fundraising Sprint A 2021, Fundraising Sprint Zeitgeistbusters, Fundraising-Backlog, Patch-For-Review: Japanese names not all rendering correctly in eoy receipt - https://phabricator.wikimedia.org/T271185 (Eileenmcnaughton) Just to summarise where we are at. At the moment the job is running but J... [23:08:10] Fundraising Sprint A 2021, Fundraising Sprint Zeitgeistbusters, Fundraising-Backlog: run the end of year receipt - https://phabricator.wikimedia.org/T271158 (Eileenmcnaughton) [23:08:26] Fundraising Sprint A 2021, Fundraising Sprint Zeitgeistbusters, Fundraising-Backlog, Patch-For-Review: Japanese names not all rendering correctly in eoy receipt - https://phabricator.wikimedia.org/T271185 (Eileenmcnaughton) Open→Resolved a:Eileenmcnaughton [23:08:46] even if its ???sama we were still being super polite [23:15:13] :-) [23:22:17] (CR) jerkins-bot: [V: -1] Revert "Exclude Japanese language emails from eoy_receipts run" [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/654708 (https://phabricator.wikimedia.org/T271189) (owner: Eileen) [23:22:59] (CR) jerkins-bot: [V: -1] Update ja eoy email to remove the salutation [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/654703 (https://phabricator.wikimedia.org/T271189) (owner: Eileen) [23:23:21] cstone: sigh - my test to check the name now fails! [23:23:32] nuuuu [23:23:43] haha i was waiting for jenkins to finish its hard work [23:30:01] Fundraising Sprint A 2021, Fundraising Sprint Zeitgeistbusters, Fundraising-Backlog: Low-prevalence name issue((s) on contacts with dupe rows with null names - https://phabricator.wikimedia.org/T271378 (Eileenmcnaughton) [23:30:30] cstone: I don't want to waste my test - I'll have to see about changing it to another manglable language [23:32:29] hebrew maybe? [23:33:16] pt ro look like they have manglable greetings too [23:35:25] (PS3) Eileen: Update ja eoy email to remove the salutation [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/654703 (https://phabricator.wikimedia.org/T271189) [23:35:31] cstone: check the hack ^^ [23:36:07] that works [23:43:20] (PS2) Eileen: Revert "Exclude Japanese language emails from eoy_receipts run" [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/654708 (https://phabricator.wikimedia.org/T271189) [23:43:49] I rebased that one so tests can run concurrently :-) [23:47:26] (PS1) Eileen: Requeue deferred Japanese emails [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/654715 (https://phabricator.wikimedia.org/T271189) [23:49:12] cstone: looks like all those update patches are in merge conflict now - should I terrorise releng by rebasing :-) [23:49:33] i think they only get mad after like 20+ :P [23:51:17] yeah - they might get there .... I think I'll leave it for now - the next one isn't in conflict (https://gerrit.wikimedia.org/r/c/wikimedia/fundraising/crm/+/652454/3) so there's no hurry [23:53:13] (PS3) Eileen: Move creation of Mailing loction type to extension [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/652481 (https://phabricator.wikimedia.org/T270680) [23:53:37] It looks ^^ was the first stale one so I rebased that