[00:06:02] (PS1) Eileen: Merge branch 'master' of https://gerrit.wikimedia.org/r/wikimedia/fundraising/crm into deployment [wikimedia/fundraising/crm] (deployment) - https://gerrit.wikimedia.org/r/640569 [00:08:18] (CR) Eileen: [C: +2] Merge branch 'master' of https://gerrit.wikimedia.org/r/wikimedia/fundraising/crm into deployment [wikimedia/fundraising/crm] (deployment) - https://gerrit.wikimedia.org/r/640569 (owner: Eileen) [00:09:42] !log civicrm revision changed from d0cd7f6dbb to e5d12cc46c, config revision is e2d133eff4 [00:09:47] Logged the message at https://wikitech.wikimedia.org/wiki/Server_Admin_Log [00:10:33] Fundraising Sprint Vagranty McVagrantface, Fundraising Sprint We all meet again, Fundraising-Backlog: Stripe Import error: INVALID_FILE_FORMAT This file is missing column headers - https://phabricator.wikimedia.org/T267255 (Eileenmcnaughton) @jkim_wikimedia sorry looks like it wasn't in the deploy -... [00:13:13] https://gerrit.wikimedia.org/r/c/wikimedia/fundraising/crm/+/638177 [00:35:31] fundraising-tech-ops: Adjust postfix to go graceful restarts when possible - https://phabricator.wikimedia.org/T267698 (Dwisehaupt) [00:39:35] fundraising-tech-ops: Adjust postfix to do graceful restarts when possible - https://phabricator.wikimedia.org/T267698 (Dwisehaupt) [05:20:38] PROBLEM - check_mysql on frdev1001 is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1220 [05:25:38] RECOVERY - check_mysql on frdev1001 is OK: Uptime: 6757255 Threads: 18 Questions: 934631383 Slow queries: 3895019 Opens: 229284792 Flush tables: 1 Open tables: 200 Queries per second avg: 138.315 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 0 [14:22:06] Fundraising-Backlog, fundraising sprint Theme songs for programming languages, FR-Email: Civi to IBM export: Yesterday's files were sent today - https://phabricator.wikimedia.org/T265352 (KHaggard) Resolved→Open The civi export file failed again this morning, but we already had emails go out... [14:44:07] Fundraising-Backlog, fundraising sprint Theme songs for programming languages, FR-Email: Civi to IBM export: Yesterday's files were sent today - https://phabricator.wikimedia.org/T265352 (jgleeson) Hi @KHaggard Eileen is working today but she won't be on until later. I will jump on shortly and see... [15:33:46] Fundraising-Backlog, fundraising sprint Theme songs for programming languages, FR-Email: Civi to IBM export: Yesterday's files were sent today - https://phabricator.wikimedia.org/T265352 (KHaggard) Thanks! @Ejegg looked into it and send over the files again. I processed them on my side and so I think... [17:05:27] (PS1) Jgleeson: Fixed mysql db names in suppression list queries [wikimedia/fundraising/tools] - https://gerrit.wikimedia.org/r/640697 [17:15:53] Fundraising-Backlog, fundraising sprint Theme songs for programming languages, FR-Email: Civi to IBM export: Yesterday's files were sent today - https://phabricator.wikimedia.org/T265352 (KHaggard) Issue is resolved for today! Big thanks to @Ejegg and @jgleeson. From what I read in the chat and email... [17:17:46] Fundraising-Backlog, fundraising sprint Theme songs for programming languages, FR-Email: Civi to IBM export: Yesterday's files were sent today - https://phabricator.wikimedia.org/T265352 (KHaggard) p:Unbreak!→High [17:45:02] Fundraising Sprint Vagranty McVagrantface, Fundraising Sprint We all meet again, Fundraising-Backlog: Stripe Import error: INVALID_FILE_FORMAT This file is missing column headers - https://phabricator.wikimedia.org/T267255 (jkim_wikimedia) Hey Eileen, still getting the import error: INVALID_FILE_FORM... [18:33:14] Fundraising-Backlog, fundraising sprint Theme songs for programming languages, FR-Email: Civi to IBM export: Yesterday's files were sent today - https://phabricator.wikimedia.org/T265352 (DStrine) @KHaggard and @MNoorWMF from this point on, could you make separate tasks every time you see an error? P... [19:22:59] Fundraising-Backlog, fundraising sprint Theme songs for programming languages, FR-Email: Civi to IBM export: Yesterday's files were sent today - https://phabricator.wikimedia.org/T265352 (KHaggard) Sure thing, @DStrine ! Apologies, I was under the impression that re-using the same task was preferred,... [19:50:27] Fundraising Sprint We all meet again, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM, FR-Email: Categorize all the email export failures and suggest a solution - https://phabricator.wikimedia.org/T267757 (DStrine) [21:07:16] Fundraising-Backlog, fr-donorservices: Ingenico: 'multiple payment options' message - https://phabricator.wikimedia.org/T267759 (MBeat33) [21:10:57] Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM, fr-donorservices: Civi: unsearchable email domain? - https://phabricator.wikimedia.org/T267760 (MBeat33) [22:42:33] PROBLEM - check_puppetrun on frav1002 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 6 minutes ago with 1 failures. Failed resources (up to 3 shown): Package[mariadb-client] [22:46:52] ACKNOWLEDGEMENT - check_puppetrun on frav1002 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 6 minutes ago with 1 failures. Failed resources (up to 3 shown): Package[mariadb-client] Dwisehaupt mariadb client point upgrade [22:53:37] PROBLEM - check_puppetrun on frdb1004 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 7 minutes ago with 1 failures. Failed resources (up to 3 shown): Package[mariadb-client] [22:57:42] ACKNOWLEDGEMENT - check_puppetrun on frdb1004 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 7 minutes ago with 1 failures. Failed resources (up to 3 shown): Package[mariadb-client] Dwisehaupt mariadb point upgrade