[00:19:21] (PS3) Eileen: Change Omnimail Forgetme so that it writes Erase requests to the database & processes in a separate job. [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/487333 (https://phabricator.wikimedia.org/T199747) [00:24:59] (CR) jerkins-bot: [V: -1] Change Omnimail Forgetme so that it writes Erase requests to the database & processes in a separate job. [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/487333 (https://phabricator.wikimedia.org/T199747) (owner: Eileen) [01:09:53] Fundraising-Backlog, Fr-CiviCRM-dedupe-FY2017/18: add Civi Dedupe Admin permission for Sandra - https://phabricator.wikimedia.org/T214866 (MBeat33) Open→Resolved a:MBeat33 Thank you. [04:14:05] Fundraising Sprint Bert and Ernie's Excellent Adventure, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM: Issue with Engage reconciliation report - https://phabricator.wikimedia.org/T213877 (Eileenmcnaughton) a:Eileenmcnaughton [04:17:23] Fundraising Sprint A series of unfortunate event handlers, Fundraising Sprint Bert and Ernie's Excellent Adventure, Fundraising Sprint Window dressing is mostly olive oil, Fundraising Sprint XML ate my homework, and 2 others: slow loading of contribution ta... - https://phabricator.wikimedia.org/T209415 [21:17:14] PROBLEM - check_payments_wiki on payments1004 is CRITICAL: HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - string OK not found on https://payments1004.frack.eqiad.wmnet:443https://payments.wikimedia.org/index.php/Special:SystemStatus - 1233 bytes in 0.037 second response time [21:18:38] (PS1) Ejegg: Delete composer.lock and vendor [extensions/DonationInterface] - https://gerrit.wikimedia.org/r/487538 [21:18:43] (CR) Ejegg: [C: +2] Delete composer.lock and vendor [extensions/DonationInterface] - https://gerrit.wikimedia.org/r/487538 (owner: Ejegg) [21:20:04] (Merged) jenkins-bot: Delete composer.lock and vendor [extensions/DonationInterface] - https://gerrit.wikimedia.org/r/487538 (owner: Ejegg) [21:22:14] PROBLEM - check_payments_wiki on payments1004 is CRITICAL: HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - string OK not found on https://payments1004.frack.eqiad.wmnet:443https://payments.wikimedia.org/index.php/Special:SystemStatus - 1233 bytes in 0.035 second response time [21:24:44] (PS1) Ejegg: Update DonationInterface submodule [core] (fundraising/REL1_31) - https://gerrit.wikimedia.org/r/487539 [21:25:00] (CR) Ejegg: [C: +2] Update DonationInterface submodule [core] (fundraising/REL1_31) - https://gerrit.wikimedia.org/r/487539 (owner: Ejegg) [21:25:42] !log updated payments-wiki-staging to fundraising/REL1_31 branch [21:25:43] Logged the message at https://wikitech.wikimedia.org/wiki/Server_Admin_Log [21:27:08] PROBLEM - check_payments_wiki on payments1004 is CRITICAL: HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - string OK not found on https://payments1004.frack.eqiad.wmnet:443https://payments.wikimedia.org/index.php/Special:SystemStatus - 1233 bytes in 0.039 second response time [21:32:14] PROBLEM - check_payments_wiki on payments1004 is CRITICAL: HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - string OK not found on https://payments1004.frack.eqiad.wmnet:443https://payments.wikimedia.org/index.php/Special:SystemStatus - 1233 bytes in 0.039 second response time [21:37:14] PROBLEM - check_payments_wiki on payments1004 is CRITICAL: HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - string OK not found on https://payments1004.frack.eqiad.wmnet:443https://payments.wikimedia.org/index.php/Special:SystemStatus - 1233 bytes in 0.038 second response time [21:38:51] (Merged) jenkins-bot: Update DonationInterface submodule [core] (fundraising/REL1_31) - https://gerrit.wikimedia.org/r/487539 (owner: Ejegg) [21:42:14] PROBLEM - check_payments_wiki on payments1004 is CRITICAL: HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - string OK not found on https://payments1004.frack.eqiad.wmnet:443https://payments.wikimedia.org/index.php/Special:SystemStatus - 1233 bytes in 0.036 second response time [21:46:40] (PS1) Ejegg: Update vendor and composer.lock [core] (fundraising/REL1_31) - https://gerrit.wikimedia.org/r/487542 [21:46:58] (CR) Ejegg: [C: +2] Update vendor and composer.lock [core] (fundraising/REL1_31) - https://gerrit.wikimedia.org/r/487542 (owner: Ejegg) [21:47:14] PROBLEM - check_payments_wiki on payments1004 is CRITICAL: HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - string OK not found on https://payments1004.frack.eqiad.wmnet:443https://payments.wikimedia.org/index.php/Special:SystemStatus - 1233 bytes in 0.039 second response time [21:50:23] (CR) jerkins-bot: [V: -1] Update vendor and composer.lock [core] (fundraising/REL1_31) - https://gerrit.wikimedia.org/r/487542 (owner: Ejegg) [21:51:58] (CR) Ejegg: [C: +2] "recheck" [core] (fundraising/REL1_31) - https://gerrit.wikimedia.org/r/487542 (owner: Ejegg) [21:52:14] PROBLEM - check_payments_wiki on payments1004 is CRITICAL: HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - string OK not found on https://payments1004.frack.eqiad.wmnet:443https://payments.wikimedia.org/index.php/Special:SystemStatus - 1233 bytes in 0.039 second response time [21:55:39] (Merged) jenkins-bot: Update vendor and composer.lock [core] (fundraising/REL1_31) - https://gerrit.wikimedia.org/r/487542 (owner: Ejegg) [21:57:12] PROBLEM - check_payments_wiki on payments1004 is CRITICAL: HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - string OK not found on https://payments1004.frack.eqiad.wmnet:443https://payments.wikimedia.org/index.php/Special:SystemStatus - 1233 bytes in 0.034 second response time [21:57:50] !log updated payments-wiki-staging from 7767c7027e to 52a271e681 [21:57:50] Logged the message at https://wikitech.wikimedia.org/wiki/Server_Admin_Log [22:02:14] PROBLEM - check_payments_wiki on payments1004 is CRITICAL: HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - string OK not found on https://payments1004.frack.eqiad.wmnet:443https://payments.wikimedia.org/index.php/Special:SystemStatus - 1233 bytes in 0.035 second response time [22:07:14] PROBLEM - check_payments_wiki on payments1004 is CRITICAL: HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - string OK not found on https://payments1004.frack.eqiad.wmnet:443https://payments.wikimedia.org/index.php/Special:SystemStatus - 1233 bytes in 0.036 second response time [22:12:14] PROBLEM - check_payments_wiki on payments1004 is CRITICAL: HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - string OK not found on https://payments1004.frack.eqiad.wmnet:443https://payments.wikimedia.org/index.php/Special:SystemStatus - 1233 bytes in 0.036 second response time [22:17:14] PROBLEM - check_payments_wiki on payments1004 is CRITICAL: HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - string OK not found on https://payments1004.frack.eqiad.wmnet:443https://payments.wikimedia.org/index.php/Special:SystemStatus - 1233 bytes in 0.037 second response time [22:22:14] PROBLEM - check_payments_wiki on payments1004 is CRITICAL: HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - string OK not found on https://payments1004.frack.eqiad.wmnet:443https://payments.wikimedia.org/index.php/Special:SystemStatus - 1233 bytes in 0.035 second response time [22:27:14] PROBLEM - check_payments_wiki on payments1004 is CRITICAL: HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - string OK not found on https://payments1004.frack.eqiad.wmnet:443https://payments.wikimedia.org/index.php/Special:SystemStatus - 1233 bytes in 0.040 second response time [22:32:14] PROBLEM - check_payments_wiki on payments1004 is CRITICAL: HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - string OK not found on https://payments1004.frack.eqiad.wmnet:443https://payments.wikimedia.org/index.php/Special:SystemStatus - 1233 bytes in 0.035 second response time [22:37:14] PROBLEM - check_payments_wiki on payments1004 is CRITICAL: HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - string OK not found on https://payments1004.frack.eqiad.wmnet:443https://payments.wikimedia.org/index.php/Special:SystemStatus - 1233 bytes in 0.034 second response time [22:42:14] PROBLEM - check_payments_wiki on payments1004 is CRITICAL: HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - string OK not found on https://payments1004.frack.eqiad.wmnet:443https://payments.wikimedia.org/index.php/Special:SystemStatus - 1233 bytes in 0.031 second response time [22:47:14] PROBLEM - check_payments_wiki on payments1004 is CRITICAL: HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - string OK not found on https://payments1004.frack.eqiad.wmnet:443https://payments.wikimedia.org/index.php/Special:SystemStatus - 1233 bytes in 0.037 second response time [22:52:14] RECOVERY - check_payments_wiki on payments1004 is OK: HTTP OK: HTTP/1.1 200 OK - 736 bytes in 0.033 second response time