[00:49:30] if anyone gets to it this (super easy) patch is the start of the ones I was hoping to get merged https://gerrit.wikimedia.org/r/c/wikimedia/fundraising/crm/+/669973/1 [00:54:37] i can eileen [00:54:48] thanks cstone [00:55:15] I'll have another crack at the merge plugin when the other 2 are merged [00:56:18] (CR) Cstone: [C: +2] Update gitignore for sites move [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/669973 (https://phabricator.wikimedia.org/T273822) (owner: Eileen) [00:56:32] the geocoder one? [00:59:19] cstone: yep - there are 2 parts to that one [00:59:28] 1) a required url change in composer.json [00:59:34] & 2) update geocoder [00:59:51] I put them together because it seemed to make jenkins less grumpy [01:00:04] because it didn't like a composer.json change without a composer.lock change [01:00:24] but - I think upgrading geocoder is safe due to our test cover & our lean use of it anyway [01:00:39] ditto omnimail (the next one) [01:01:07] for some reason (maybe a bug) updating composer-merge-plugin is messing with our versions a bit :-( [01:01:22] but I'm just going with 'take this as a chance to get onto the latest' [01:13:10] (Merged) jenkins-bot: Update gitignore for sites move [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/669973 (https://phabricator.wikimedia.org/T273822) (owner: Eileen) [01:17:25] (CR) Cstone: [C: +2] Update directory path and geocoder [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/670018 (https://phabricator.wikimedia.org/T273822) (owner: Eileen) [01:17:33] looks good for me locally eileen [01:18:01] thanks - yeah we have good test cover too [01:33:16] (Merged) jenkins-bot: Update directory path and geocoder [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/670018 (https://phabricator.wikimedia.org/T273822) (owner: Eileen) [01:38:20] eileen: I'm having some test failures locally with the omnimal one but reinstalling it to see if it repeats [01:38:31] cstone: hmm ok [01:39:39] cstone: if you get fails due to left over data re-running can also help ie run with --stop-on-failure & if it *might* leave you in a cleaner state [01:51:11] eileen: its weird it finishes all the tests fine but then [01:51:13] OK (516 tests, 5729 assertions) [01:51:13] [10-Mar-2021 01:47:01 UTC] PHP Fatal error: Uncaught RuntimeException: Stream is detached in /buildkit/build/wmff/civicrm/vendor/guzzlehttp/psr7/src/Stream.php:89 [01:51:41] ok hang on [01:52:05] yeah - that is because it has trouble in the test environment sometimes [01:52:14] when omnimail is deconstructed it tries to log out [01:52:22] ahh [01:52:26] and that can fail [01:52:36] it's a known intermittent error [01:56:30] (CR) Cstone: [C: +2] Update omnimail/omnimail [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/670020 (owner: Eileen) [01:58:11] yay - now I just have to figure out the csv grumpiness :-) [01:59:32] :) [02:12:13] (Merged) jenkins-bot: Update omnimail/omnimail [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/670020 (owner: Eileen) [02:59:47] Fundraising Sprint Downed power line jump rope, Fundraising Sprint Esperantoland, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM: Benevity Import Error - https://phabricator.wikimedia.org/T271416 (Eileenmcnaughton) I imported this file. It didn't fail for me and all rows are imported now. I d... [05:09:07] Fundraising Sprint Downed power line jump rope, Fundraising Sprint Esperantoland, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM: Benevity Import Error - https://phabricator.wikimedia.org/T271416 (Eileenmcnaughton) I'm going to try to talk myself through this error in the hope it can make som... [05:35:53] Fundraising Sprint Downed power line jump rope, Fundraising Sprint Esperantoland, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM: Benevity Import Error - https://phabricator.wikimedia.org/T271416 (Eileenmcnaughton) Ok I maybe found something I didn't quite expect - it looks like the contribut... [05:49:11] (CR) Eileen: "recheck" [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/669977 (https://phabricator.wikimedia.org/T267881) (owner: Eileen) [07:34:24] (CR) jerkins-bot: [V: -1] Localisation updates from https://translatewiki.net. [extensions/DonationInterface] - https://gerrit.wikimedia.org/r/670381 (owner: L10n-bot) [07:39:41] (CR) Raimond Spekking: [C: +2] "false positive" [extensions/DonationInterface] - https://gerrit.wikimedia.org/r/670381 (owner: L10n-bot) [09:25:16] (PS1) Eileen: Remove extraneous white space [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/670418 [09:32:07] (PS5) Eileen: Upgrade wikimedia/composer-merge-plugin to version 2 [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/669977 (https://phabricator.wikimedia.org/T267881) [09:39:55] (CR) jerkins-bot: [V: -1] Upgrade wikimedia/composer-merge-plugin to version 2 [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/669977 (https://phabricator.wikimedia.org/T267881) (owner: Eileen) [10:10:37] (PS6) Eileen: Upgrade wikimedia/composer-merge-plugin to version 2 [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/669977 (https://phabricator.wikimedia.org/T267881) [10:20:53] (CR) jerkins-bot: [V: -1] Upgrade wikimedia/composer-merge-plugin to version 2 [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/669977 (https://phabricator.wikimedia.org/T267881) (owner: Eileen) [10:43:28] Fundraising Sprint Downed power line jump rope, Fundraising Sprint Esperantoland, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM: Benevity Import Error - https://phabricator.wikimedia.org/T271416 (RLewis) @Eileenmcnaughton thanks so much for your clear response here. I will definitely try imp... [10:49:45] (PS7) Eileen: Upgrade wikimedia/composer-merge-plugin to version 2 [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/669977 (https://phabricator.wikimedia.org/T267881) [10:53:30] (PS8) Eileen: Upgrade wikimedia/composer-merge-plugin to version 2 [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/669977 (https://phabricator.wikimedia.org/T267881) [10:54:06] (PS9) Eileen: Upgrade wikimedia/composer-merge-plugin to version 2 [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/669977 (https://phabricator.wikimedia.org/T267881) [11:24:22] Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM: Endowment import specific request for finance reconciliation - https://phabricator.wikimedia.org/T276591 (RLewis) @DStrine we're going to go with adding two new gift sources in Civi - Retirement Gift - Endowment Specified and Realized PG Gift - Endowmen... [11:30:48] Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM: Endowment import specific request for finance reconciliation - https://phabricator.wikimedia.org/T276591 (RLewis) @Eileenmcnaughton I added the fields but they aren't showing in the drop down option when I search under Gift Source in Civi. {F34149494} [13:37:51] Fundraising Sprint Corrugated super slide, Fundraising Sprint Downed power line jump rope, Fundraising Sprint Esperantoland, Fundraising-Backlog, and 5 others: BannerExistenceException due to non-existing CentralNotice banner (after Special:LanguageStats vi... - https://phabricator.wikimedia.org/T157997 [13:39:47] fundraising-tech-ops: Plan for FY 2020-21 Q3 maintenance window - https://phabricator.wikimedia.org/T268056 (Jgreen) [13:41:54] fundraising-tech-ops: Plan for FY 2020-21 Q3 maintenance window - https://phabricator.wikimedia.org/T268056 (Jgreen) [13:45:48] fundraising-tech-ops: Plan for FY 2020-21 Q3 maintenance window - https://phabricator.wikimedia.org/T268056 (Jgreen) [13:52:54] fundraising-tech-ops: Plan for FY 2020-21 Q3 maintenance window - https://phabricator.wikimedia.org/T268056 (Jgreen) [13:53:43] PROBLEM - check_puppetrun on frqueue1003 is CRITICAL: CRITICAL: Puppet has 9 failures. Last run 6 minutes ago with 9 failures. Failed resources (up to 3 shown): File[/etc/send_nsca.cfg],File[/usr/local/bin/nagios_nsca],File[/etc/vim/vimrc.local],File[/etc/update-motd.d/99-footer] [13:58:43] PROBLEM - check_puppetrun on frqueue1003 is CRITICAL: CRITICAL: Puppet has 9 failures. Last run 11 minutes ago with 9 failures. Failed resources (up to 3 shown): File[/etc/send_nsca.cfg],File[/usr/local/bin/nagios_nsca],File[/etc/vim/vimrc.local],File[/etc/update-motd.d/99-footer] [14:03:43] RECOVERY - check_puppetrun on frqueue1003 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [14:34:41] fundraising-tech-ops: Plan for FY 2020-21 Q3 maintenance window - https://phabricator.wikimedia.org/T268056 (Jgreen) [14:40:11] fundraising-tech-ops: Plan for FY 2020-21 Q3 maintenance window - https://phabricator.wikimedia.org/T268056 (Jgreen) [14:53:01] fundraising-tech-ops: Plan for FY 2020-21 Q3 maintenance window - https://phabricator.wikimedia.org/T268056 (Jgreen) [14:53:46] fundraising-tech-ops: Plan for FY 2020-21 Q3 maintenance window - https://phabricator.wikimedia.org/T268056 (Jgreen) [14:54:57] fundraising-tech-ops: Plan for FY 2020-21 Q3 maintenance window - https://phabricator.wikimedia.org/T268056 (Jgreen) [15:23:07] Fundraising-Backlog, FR-LATAM, FR-dlocal: Mexico payment form error - https://phabricator.wikimedia.org/T275156 (EMartin) To close this task out, Dlocal reported today that they heard back from the issuer and found they had a setting wrong on their side that caused this card to be blocked. They corr... [15:40:37] fundraising-tech-ops: Plan for FY 2020-21 Q3 maintenance window - https://phabricator.wikimedia.org/T268056 (Jgreen) [15:48:11] fundraising-tech-ops: Plan for FY 2020-21 Q3 maintenance window - https://phabricator.wikimedia.org/T268056 (Jgreen) [15:55:04] fundraising-tech-ops: Plan for FY 2020-21 Q3 maintenance window - https://phabricator.wikimedia.org/T268056 (Jgreen) [15:56:38] fundraising-tech-ops: Plan for FY 2020-21 Q3 maintenance window - https://phabricator.wikimedia.org/T268056 (Jgreen) [15:59:53] fundraising-tech-ops: Plan for FY 2020-21 Q3 maintenance window - https://phabricator.wikimedia.org/T268056 (Jgreen) [16:00:37] PROBLEM - check_mysql on frdev1001 is CRITICAL: Cant connect to local MySQL server through socket /var/run/mysqld/mysqld.sock (2) [16:03:34] fundraising-tech-ops: Plan for FY 2020-21 Q3 maintenance window - https://phabricator.wikimedia.org/T268056 (Jgreen) [16:03:44] Fundraising Sprint Corrugated super slide, Fundraising Sprint Downed power line jump rope, Fundraising Sprint Esperantoland, Fundraising-Backlog, and 5 others: BannerExistenceException due to non-existing CentralNotice banner (after Special:LanguageStats vi... - https://phabricator.wikimedia.org/T157997 [16:04:17] fundraising-tech-ops: Plan for FY 2020-21 Q3 maintenance window - https://phabricator.wikimedia.org/T268056 (Jgreen) [16:05:37] RECOVERY - check_mysql on frdev1001 is OK: Uptime: 29 Threads: 10 Questions: 62 Slow queries: 2 Opens: 36 Flush tables: 1 Open tables: 30 Queries per second avg: 2.137 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 0 [16:39:25] fundraising-tech-ops: Plan for FY 2020-21 Q3 maintenance window - https://phabricator.wikimedia.org/T268056 (Jgreen) [16:44:49] fr-tech any thoughts on where new i18n messages for the e-mail pref center form in DonationInterface should go? [16:45:10] I don't want to put them in gateway_common/i18n since they're not for a gateway [16:46:36] Fundraising Sprint Corrugated super slide, Fundraising Sprint Downed power line jump rope, Fundraising-Backlog, Fr-CentralNotice-Translation-Bugs, and 4 others: BannerExistenceException due to non-existing CentralNotice banner (after Special:LanguageStats v... - https://phabricator.wikimedia.org/T157997 [16:52:37] PROBLEM - check_puppetrun on frdb1003 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 5 minutes ago with 1 failures. Failed resources (up to 3 shown): Package[mariadb-client] [16:55:41] PROBLEM - check_puppetrun on frdev1001 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 8 minutes ago with 1 failures. Failed resources (up to 3 shown): Package[mariadb-client] [16:55:56] AndyRussG: would it make sense to have an email preferences specific folder for all things that don't really belong to gatewayish type stuff?? maybe that would make it easier to migrate the code to its own extension if we ever get around to it? just a thought! [16:56:05] ACKNOWLEDGEMENT - check_puppetrun on frdb1003 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 5 minutes ago with 1 failures. Failed resources (up to 3 shown): Package[mariadb-client] Dwisehaupt known - addressing in maint today. [16:56:05] ACKNOWLEDGEMENT - check_puppetrun on frdev1001 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 8 minutes ago with 1 failures. Failed resources (up to 3 shown): Package[mariadb-client] Dwisehaupt known - addressing in maint today. [16:57:53] jgleeson: yeah I think that may be it [17:00:18] jgleeson: there is an email_forms directory but so far I don't see any mustache template directories that also have an i18n subdirectory [17:07:08] fundraising-tech-ops: Plan for FY 2020-21 Q3 maintenance window - https://phabricator.wikimedia.org/T268056 (Dwisehaupt) [17:43:38] PROBLEM - check_puppetrun on frqueue2001 is CRITICAL: CRITICAL: Puppet has 3 failures. Last run 3 minutes ago with 3 failures. Failed resources (up to 3 shown): File[/etc/send_nsca.cfg],File[/usr/local/bin/nagios_nsca],File[/etc/vim/vimrc.local] [17:43:38] PROBLEM - check_redis on frqueue2001 is CRITICAL: CRITICAL: replication_delay data is missing - REDIS 5.0.3 on 127.0.0.1:6379 has 1 databases (db0) with 3 keys, up 3 minutes 38 seconds - memory use is 1.84M (peak 1.84M, 0.06% of max, fragmentation 2.53%) [17:47:38] PROBLEM - check_redis on frqueue1004 is CRITICAL: CRITICAL: replication_delay data is missing - REDIS 5.0.3 on 127.0.0.1:6379 has 1 databases (db0) with 3 keys, up 4 minutes 31 seconds - memory use is 1.84M (peak 1.84M, 0.06% of max, fragmentation 2.53%) [17:48:34] RECOVERY - check_puppetrun on frqueue2001 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [17:48:34] PROBLEM - check_redis on frqueue2001 is CRITICAL: CRITICAL: replication_delay data is missing - REDIS 5.0.3 on 127.0.0.1:6379 has 1 databases (db0) with 3 keys, up 8 minutes 37 seconds - memory use is 1.82M (peak 1.84M, 0.06% of max, fragmentation 2.56%) [17:51:27] PROBLEM - check_mysql on frdb2002 is CRITICAL: Slave IO: No Slave SQL: No Seconds Behind Master: (null) [17:52:27] PROBLEM - check_mysql on frdb2001 is CRITICAL: Slave IO: No Slave SQL: No Seconds Behind Master: (null) [17:52:33] PROBLEM - check_redis on frqueue2002 is CRITICAL: CRITICAL: replication_delay data is missing - REDIS 5.0.3 on 127.0.0.1:6379 has 1 databases (db0) with 3 keys, up 10 minutes 54 seconds - memory use is 1.82M (peak 1.84M, 0.06% of max, fragmentation 2.61%) [17:52:37] PROBLEM - check_redis on frqueue1004 is CRITICAL: CRITICAL: replication_delay data is missing - REDIS 5.0.3 on 127.0.0.1:6379 has 1 databases (db0) with 3 keys, up 9 minutes 30 seconds - memory use is 1.82M (peak 1.84M, 0.06% of max, fragmentation 2.78%) [17:52:53] PROBLEM - check_mysql on frdb1002 is CRITICAL: Cant connect to local MySQL server through socket /var/run/mysqld/mysqld.sock (2 No such file or directory) [17:53:33] PROBLEM - check_redis on frqueue2001 is CRITICAL: CRITICAL: replication_delay data is missing - REDIS 5.0.3 on 127.0.0.1:6379 has 1 databases (db0) with 3 keys, up 13 minutes 37 seconds - memory use is 1.82M (peak 1.84M, 0.06% of max, fragmentation 2.56%) [17:53:37] PROBLEM - check_mysql on frdb1004 is CRITICAL: Slave IO: No Slave SQL: No Seconds Behind Master: (null) [17:53:37] PROBLEM - check_puppetrun on frqueue1003 is CRITICAL: CRITICAL: Puppet has 9 failures. Last run 6 minutes ago with 9 failures. Failed resources (up to 3 shown): File[/etc/send_nsca.cfg],File[/usr/local/bin/nagios_nsca],File[/etc/vim/vimrc.local],File[/etc/update-motd.d/99-footer] [17:54:31] ACKNOWLEDGEMENT - check_mysql on frdb1002 is CRITICAL: Cant connect to local MySQL server through socket /var/run/mysqld/mysqld.sock (2 No such file or directory) Dwisehaupt origin server swap. [17:56:27] RECOVERY - check_mysql on frdb2002 is OK: Uptime: 1119595 Threads: 13 Questions: 25576304 Slow queries: 656 Opens: 38214 Flush tables: 1 Open tables: 1269 Queries per second avg: 22.844 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 0 [17:57:33] RECOVERY - check_mysql on frdb2001 is OK: Uptime: 1037297 Threads: 13 Questions: 23081465 Slow queries: 544 Opens: 21702 Flush tables: 1 Open tables: 1149 Queries per second avg: 22.251 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 0 [17:57:37] RECOVERY - check_redis on frqueue2002 is OK: OK: REDIS 5.0.3 on 127.0.0.1:6379 has 1 databases (db0) with 2 keys, up 15 minutes 55 seconds - replication_delay is 8, memory use is 1.84M (peak 1.86M, 0.06% of max, fragmentation 2.94%) [17:57:37] RECOVERY - check_redis on frqueue1004 is OK: OK: REDIS 5.0.3 on 127.0.0.1:6379 has 1 databases (db0) with 2 keys, up 14 minutes 31 seconds - replication_delay is 6, memory use is 1.84M (peak 1.88M, 0.06% of max, fragmentation 2.91%) [17:58:33] RECOVERY - check_redis on frqueue2001 is OK: OK: REDIS 5.0.3 on 127.0.0.1:6379 has 1 databases (db0) with 2 keys, up 18 minutes 38 seconds - replication_delay is 4, memory use is 1.84M (peak 1.86M, 0.06% of max, fragmentation 2.90%) [17:58:33] PROBLEM - check_mysql on frdb1004 is CRITICAL: Slave IO: No Slave SQL: No Seconds Behind Master: (null) [17:58:35] PROBLEM - check_puppetrun on frqueue1003 is CRITICAL: CRITICAL: Puppet has 9 failures. Last run 11 minutes ago with 9 failures. Failed resources (up to 3 shown): File[/etc/send_nsca.cfg],File[/usr/local/bin/nagios_nsca],File[/etc/vim/vimrc.local],File[/etc/update-motd.d/99-footer] [17:59:38] Fundraising-Backlog, FR-LATAM, FR-dlocal: DLocal not loading on IE 11 - https://phabricator.wikimedia.org/T276333 (jbolorinos-ctr) Hey @Ejegg and @DStrine it looks like it was recently decided to drop support for IE on wiki - https://lists.wikimedia.org/pipermail/wikitech-l/2021-March/094319.html S... [18:03:09] Fundraising-Backlog, Thank-You-Page: Thankyou page link invalid for UK donors - https://phabricator.wikimedia.org/T276928 (Pcoombe) If I just open https://donate.wikimedia.org/ without a language specified in the URL, then it gives me uselang=en-gb, which it must be pulling from my browser settings. Mos... [18:03:43] RECOVERY - check_puppetrun on frqueue1003 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [18:03:53] RECOVERY - check_mysql on frdb1004 is OK: Uptime: 778298 Threads: 13 Questions: 19423050 Slow queries: 429 Opens: 20732 Flush tables: 1 Open tables: 1138 Queries per second avg: 24.955 [18:05:07] Fundraising-Backlog, FR-LATAM, FR-dlocal: DLocal not loading on IE 11 - https://phabricator.wikimedia.org/T276333 (DStrine) I'd say keep it open until we hear back from dlocal. We can't do anything for these users unless we want to block them or try to direct them to "other ways to give" [18:05:45] Fundraising-Backlog, FR-LATAM, FR-dlocal: DLocal not loading on IE 11 - https://phabricator.wikimedia.org/T276333 (Pcoombe) @jbolorinos-ctr That is only for newly added features. We've not yet had any discussion about dropping IE11 support for fundraising - I'm not opposed to that but it needs a disc... [18:06:50] fundraising-tech-ops: Plan for FY 2020-21 Q3 maintenance window - https://phabricator.wikimedia.org/T268056 (Jgreen) [18:10:56] Fundraising-Backlog, FR-LATAM, FR-dlocal: DLocal not loading on IE 11 - https://phabricator.wikimedia.org/T276333 (EMartin) Just fyi/update, Dlocal came back to me yesterday with an evasive answer indicating we should encourage the use of other browsers but they did not answer the specific question a... [18:14:33] fundraising-tech-ops, Patch-For-Review: Plan for FY 2020-21 Q3 maintenance window - https://phabricator.wikimedia.org/T268056 (Dwisehaupt) [18:24:01] (PS1) Jgleeson: Updating composer dependencies [extensions/FundraisingEmailUnsubscribe] (fundraising/REL1_35) - https://gerrit.wikimedia.org/r/670554 [18:26:31] fundraising-tech-ops, Patch-For-Review: Plan for FY 2020-21 Q3 maintenance window - https://phabricator.wikimedia.org/T268056 (Jgreen) [18:37:30] fr-tech: i'll be doing the kernel upgrade on frdev1001 real soon now. it will be rebooted. [18:37:43] 10-4 [18:40:41] RECOVERY - check_puppetrun on frdev1001 is OK: OK: Puppet is currently enabled, last run 26 seconds ago with 0 failures [18:42:41] PROBLEM - check_puppetrun on frdb1002 is CRITICAL: CRITICAL: Puppet has 2 failures. Last run 50 seconds ago with 2 failures. Failed resources (up to 3 shown): Package[mariadb-client],Package[percona-toolkit] [18:47:35] frdev1001 back on line with kernel and mariadb update [18:47:39] RECOVERY - check_puppetrun on frdb1003 is OK: OK: Puppet is currently enabled, last run 37 seconds ago with 0 failures [18:49:55] fundraising-tech-ops, Patch-For-Review: Plan for FY 2020-21 Q3 maintenance window - https://phabricator.wikimedia.org/T268056 (Dwisehaupt) [18:52:33] RECOVERY - check_puppetrun on frdb1002 is OK: OK: Puppet is currently enabled, last run 3 minutes ago with 0 failures [18:56:57] !log all fundraising servers are now running buster - T254198 [18:57:03] Logged the message at https://wikitech.wikimedia.org/wiki/Server_Admin_Log [18:57:04] T254198: Epic: Upgrade fundraising servers to buster - https://phabricator.wikimedia.org/T254198 [18:57:18] * dwisehaupt throws a party [18:57:52] fundraising-tech-ops: Epic: Upgrade fundraising servers to buster - https://phabricator.wikimedia.org/T254198 (Dwisehaupt) [18:58:58] fundraising-tech-ops: Epic: Upgrade fundraising servers to buster - https://phabricator.wikimedia.org/T254198 (Dwisehaupt) Open→Resolved a:Dwisehaupt With the work in T268056, the last host has been converted to buster. We are all buster hosts now. [19:01:04] fundraising-tech-ops, Patch-For-Review: Plan for FY 2020-21 Q3 maintenance window - https://phabricator.wikimedia.org/T268056 (Dwisehaupt) [19:24:33] fundraising-tech-ops: Plan for FY 2020-21 Q3 maintenance window - https://phabricator.wikimedia.org/T268056 (Jgreen) [19:42:09] I finally got the composer-merge-plugin to pass - the issue is that when the vendor directory does not already exist then composer install will install composer-merge-plugin - which then (on clean install only) runs composer update as it knows that it was unable to 'do it's thing' on the first install as it was not installed. However, this means that CI actually runs a slightly more recent version of some packages than dev [19:42:09] / live are running. It became an issue when it tried to update league/csv which has some incompatibility. I fixed that by changing composer.json to be more explicit [19:42:09] However, it still updates the following beyond the lock file during CI [19:42:10] Updating wikimedia/smash-pig (v0.6.7 => v0.6.8): [19:42:10] Updating phpseclib/phpseclib (2.0.11 => 2.0.30) [19:42:10] Updating php-http/message (1.6.0 => 1.9.1): Downloading [19:43:05] (that won't flow through to prod) - [19:43:05] I'm inclined to think we should update those 3 but I don't know the considerations around smash-pig [20:00:39] (CR) Eileen: Merge branch 'master' of ssh://gerrit.wikimedia.org:29418/wikimedia/fundraising/crm into deployment [wikimedia/fundraising/crm] (deployment) - https://gerrit.wikimedia.org/r/668206 (owner: Eileen) [20:00:43] fundraising-tech-ops: Plan for FY 2020-21 Q3 maintenance window - https://phabricator.wikimedia.org/T268056 (Jgreen) [20:15:19] Fundraising-Backlog: Issue with Adyen notifications - https://phabricator.wikimedia.org/T277095 (EMartin) [20:20:55] Fundraising-Backlog: Issue with Adyen notifications - https://phabricator.wikimedia.org/T277095 (Cstone) This was me testing during the downtime [20:21:29] (PS1) Eileen: revert 18782 [wikimedia/fundraising/crm/civicrm] - https://gerrit.wikimedia.org/r/670571 [20:25:00] (CR) Jgleeson: [V: +2 C: +2] revert 18782 [wikimedia/fundraising/crm/civicrm] - https://gerrit.wikimedia.org/r/670571 (owner: Eileen) [20:25:54] (PS1) Eileen: Revert "Updated triggers for 5.35" [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/670572 [20:30:13] Wikimedia-Fundraising-Banners: India Pretest Launch Banners - https://phabricator.wikimedia.org/T276596 (Pcoombe) @jbolorinos-ctr I've added the India payment methods and logos to the desktop banners above. Going to work on the mobile ones tomorrow and will let you know when those are done as well. [20:30:27] (PS1) Eileen: Submodule update CiviCRM: [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/670574 [20:30:35] (CR) Eileen: [C: +2] Submodule update CiviCRM: [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/670574 (owner: Eileen) [20:50:39] (CR) Eileen: [C: +2] Merge branch 'master' of ssh://gerrit.wikimedia.org:29418/wikimedia/fundraising/crm into deployment [wikimedia/fundraising/crm] (deployment) - https://gerrit.wikimedia.org/r/668206 (owner: Eileen) [20:51:44] (Abandoned) Eileen: Revert "Updated triggers for 5.35" [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/670572 (owner: Eileen) [20:55:36] (CR) Cstone: [C: +2] Remove extraneous white space [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/670418 (owner: Eileen) [21:02:53] Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM, FR-AutoTY-Email, fr-donorservices: Civi: EoY recurring receipt email – 2021 catchall for retro - https://phabricator.wikimedia.org/T271883 (KHaggard) [21:03:02] (CR) Eileen: [C: +2] "recheck" [wikimedia/fundraising/crm] (deployment) - https://gerrit.wikimedia.org/r/668206 (owner: Eileen) [21:13:03] (PS1) Eileen: Vendor update [wikimedia/fundraising/crm/vendor] - https://gerrit.wikimedia.org/r/670584 [21:16:30] !log civicrm revision changed from b13e70d968 to 550be50105, config revision is 970b10b0b3 [21:16:35] Logged the message at https://wikitech.wikimedia.org/wiki/Server_Admin_Log [21:22:01] (Merged) jenkins-bot: Remove extraneous white space [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/670418 (owner: Eileen) [21:36:02] fundraising-tech-ops: fix staging contribution tracking configuration - https://phabricator.wikimedia.org/T277099 (Jgreen) [21:38:34] !log stopping mysql replication on frdb1003 and starting utf8mb4 table alters under a root screen session [21:38:40] Logged the message at https://wikitech.wikimedia.org/wiki/Server_Admin_Log [21:38:50] !log stopping mysql replication on frdev1001 and starting utf8mb4 table alters under a root screen session [21:38:55] Logged the message at https://wikitech.wikimedia.org/wiki/Server_Admin_Log [21:43:35] fundraising-tech-ops: FY2020-21 Q3 maintenance window - https://phabricator.wikimedia.org/T268056 (Jgreen) [21:44:04] fundraising-tech-ops: FY2020-21 Q3 maintenance window - https://phabricator.wikimedia.org/T268056 (Jgreen) [21:51:39] !log upgraded mariadb and keeping replication stopped on frdb1002 to start the utf8mb4 table alters under a root screen session [21:51:44] Logged the message at https://wikitech.wikimedia.org/wiki/Server_Admin_Log [22:08:04] fundraising-tech-ops: FY2020-21 Q3 maintenance window - https://phabricator.wikimedia.org/T268056 (Jgreen) [22:19:23] Fundraising-Backlog, Analytics, FR-Tech-Analytics: Whitelist Portal and WikipediaApp event data for (sanitized) long-term storage - https://phabricator.wikimedia.org/T273246 (EYener) Hi @mforns getting back to you on this. I'll schedule a meeting for next week with you, myself, @Jdrewniak, @mpopov ,... [22:27:31] Fundraising-Backlog: Issue with Adyen notifications - https://phabricator.wikimedia.org/T277095 (EMartin) Just received this update: LIVE: WikimediaDonations is accepting Notifications again Notifications WikimediaDonations is accepting Notifications again on url https://payments-listener.wikimed... [22:28:00] Fundraising-Backlog: Issue with Adyen notifications - https://phabricator.wikimedia.org/T277095 (EMartin) Open→Resolved p:Triage→Low a:EMartin [22:51:57] AndyRussG: one thing that would be nice on the docker is if the home directory was /srv/civi-sites (currently when you run docker-composer base the homedir is the root) or we had a bunch of symlinks in the root to navigate more quickly [23:06:14] eileen: hmmm like what sort of symlinks? [23:06:32] pretty much links to everything in /srv/civi-sites [23:06:37] we can definitely make $HOME be /srv/civi-sites also [23:06:46] yep - that would be my first choice [23:07:21] K I can do that [23:07:33] AndyRussG: also I hit an issue with the last commit - ./config/database:/etc/mysql/conf.d: [23:07:45] with the : at the end I get an error saying type is required [23:07:50] without the : I don't [23:09:33] eileen: in which commit do you see a : at the end? [23:09:41] I don't have one locally [23:09:49] This is in docker-compose.yml, no? [23:10:17] yep [23:10:47] yeah the : at the end is a mistak [23:10:49] e [23:11:04] eileen: are you sure that's not something you have only locally? [23:11:09] ok cool - if I can figure out what is going on locally and it IS committed I'll fix [23:12:01] cool thx! [23:13:54] eileen: these are the most recent Gerrit changes for fundraising-dev/dev-images, though if you're not doing anything in the Mediawiki/Payments realm, I think you can safely ignore them updates there... https://gerrit.wikimedia.org/r/c/wikimedia/fundraising/dev/+/669613 https://gerrit.wikimedia.org/r/c/releng/dev-images/+/663294 [23:15:37] AndyRussG: ok - let's assume it was something weird locally since I seem to be going backwards - I want to get python 3 (not 2.7) onto the civicrm container & check tools into civi-sites so I can run the silverpop code [23:17:19] eileen: ahhh yis that sounds good... hmmm there is python3, you just have to call it explicitly btw [23:17:51] You could add stuff to setup.sh so it pulls down the tools repo [23:17:52] oh right - thanks [23:18:02] yeah I think I have that working for the repo [23:18:10] ah cool beans! [23:18:16] but somehow now gerrit is squacking at me [23:18:31] I had started on a new image, civicrm-jobs, with the idea that that'd be where we'd run process-control, run-job, tools and such [23:18:42] with the current civicrm container being the one that just runs apache [23:19:19] hmm I'm sorry to hear about Gerrit's behaviour.... [23:20:44] (PS1) Eileen: Add tools repo to checkout [wikimedia/fundraising/dev] - https://gerrit.wikimedia.org/r/670612 [23:27:49] I've beaten gerrit [23:28:40] yeah - I dunno if a new container makes sense or not - I guess for me tools feels like 'the sort of code you would work on when working with civi' [23:28:55] whereas process-control maybe a little less so [23:29:20] fundraising-tech-ops: FY2020-21 Q3 maintenance window - https://phabricator.wikimedia.org/T268056 (Dwisehaupt) [23:29:21] because all the things you run through process control you'd normally just run via drush when working on civi [23:29:52] eileen: right [23:30:16] well the standard Docker thing is one long-running process per container [23:30:29] yeah tools is just a script or 2 that you run [23:30:39] right [23:30:40] process-control can run it [23:30:56] right so in the current container the main process is apache [23:31:25] and the idea would be that in the other container the main process would be cron or something like that, that runs the jobs that you have set up to run on a schedule [23:31:32] and that could also be the place to run stuff manually [23:31:49] so that'd be the container that would have pre-installed everything needed for python tools and such [23:32:24] and really it'd be exactly the same Civi and Buildkit "install", in that all the same config and source would be visible in the same locations inside the container [23:32:53] so you could still run the python scripts within the civi container anyway? [23:33:14] instead of thinking of it as a different virtual machine, you can think of it as a slightly different sandbox environment, but with the same shared config and source directectories [23:33:19] this is the PR that adds clonging https://gerrit.wikimedia.org/r/c/wikimedia/fundraising/dev/+/670612 [23:33:20] yes you could [23:33:27] ok cool [23:33:49] ah nice thanks!!! [23:33:50] & yeah mentally I don't really have containers in my mind [23:34:22] eileen: I'm gonna be mostly afk for the next little while, kids will be here soon and I gotta mop the floors and all that stuff [23:34:32] I'll check back here often tho [23:34:41] ok - this stuff isn't high priority [23:34:50] so pls don't hesitate to ping! ahhh I just might take a bit to respond :) [23:34:53] I'm just trying to run Dallas's patch [23:35:00] ah cool! [23:35:18] K back in a bit! :) thx again for the Gerrit change! [23:41:02] !log disabled silverpop daily run in process-control until utf8mb4 conversion completes on frdev1001 [23:41:08] Logged the message at https://wikitech.wikimedia.org/wiki/Server_Admin_Log [23:42:18] Fundraising-Backlog, FR-Docker: Docker request - Improve defaults for composer - https://phabricator.wikimedia.org/T277114 (Eileenmcnaughton) [23:46:52] Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM: Database can now support emjois but our dedupe script can't - https://phabricator.wikimedia.org/T277115 (Eileenmcnaughton)