[00:20:15] PROBLEM - check_mysql on frdev1001 is CRITICAL: Slave IO: Yes Slave SQL: No Seconds Behind Master: (null) [00:25:15] PROBLEM - check_mysql on frdev1001 is CRITICAL: Slave IO: Yes Slave SQL: No Seconds Behind Master: (null) [00:30:15] PROBLEM - check_mysql on frdev1001 is CRITICAL: Slave IO: Yes Slave SQL: No Seconds Behind Master: (null) [00:35:15] PROBLEM - check_mysql on frdev1001 is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1246 [00:40:15] RECOVERY - check_mysql on frdev1001 is OK: Uptime: 1275950 Threads: 4 Questions: 350726664 Slow queries: 387518 Opens: 30418 Flush tables: 1 Open tables: 200 Queries per second avg: 274.874 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 231 [07:10:15] PROBLEM - check_puppetrun on frdev1001 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 1 minute ago with 1 failures. Failed resources (up to 3 shown): Package[mariadb-client] [07:15:15] PROBLEM - check_puppetrun on frdev1001 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 6 minutes ago with 1 failures. Failed resources (up to 3 shown): Package[mariadb-client] [07:20:15] RECOVERY - check_puppetrun on frdev1001 is OK: OK: Puppet is currently enabled, last run 58 seconds ago with 0 failures [08:18:46] (CR) jerkins-bot: [V: -1] Localisation updates from https://translatewiki.net. [extensions/DonationInterface] - https://gerrit.wikimedia.org/r/552422 (owner: L10n-bot) [09:22:41] (CR) Raimond Spekking: [C: +2] "false positive" [extensions/DonationInterface] - https://gerrit.wikimedia.org/r/552422 (owner: L10n-bot) [09:27:28] (CR) jerkins-bot: [V: -1] Localisation updates from https://translatewiki.net. [extensions/DonationInterface] - https://gerrit.wikimedia.org/r/552422 (owner: L10n-bot) [09:32:36] (CR) Raimond Spekking: [C: +2] "recheck" [extensions/DonationInterface] - https://gerrit.wikimedia.org/r/552422 (owner: L10n-bot) [09:33:25] (CR) jerkins-bot: [V: -1] Localisation updates from https://translatewiki.net. [extensions/DonationInterface] - https://gerrit.wikimedia.org/r/552422 (owner: L10n-bot) [09:37:59] (CR) Raimond Spekking: [C: +2] "[RuntimeException]" [extensions/DonationInterface] - https://gerrit.wikimedia.org/r/552422 (owner: L10n-bot) [09:45:35] (CR) jerkins-bot: [V: -1] Localisation updates from https://translatewiki.net. [extensions/DonationInterface] - https://gerrit.wikimedia.org/r/552422 (owner: L10n-bot) [12:18:07] (CR) Thiemo Kreuz (WMDE): "The commit message currently doesn't explain the motivation for this change, and what the rule does. Is this making the linter more strict" [extensions/CentralNotice] - https://gerrit.wikimedia.org/r/550392 (owner: Fomafix) [12:55:13] PROBLEM - check_mysql on frdev1001 is CRITICAL: Slave IO: Yes Slave SQL: No Seconds Behind Master: (null) [13:00:13] PROBLEM - check_mysql on frdev1001 is CRITICAL: Slave IO: Yes Slave SQL: No Seconds Behind Master: (null) [13:05:13] PROBLEM - check_mysql on frdev1001 is CRITICAL: Slave IO: Yes Slave SQL: No Seconds Behind Master: (null) [13:15:13] RECOVERY - check_mysql on frdev1001 is OK: Uptime: 22554 Threads: 3 Questions: 18509216 Slow queries: 782 Opens: 535 Flush tables: 1 Open tables: 199 Queries per second avg: 820.662 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 0 [14:41:52] (PS31) Ejegg: Finer geo targeting [extensions/CentralNotice] - https://gerrit.wikimedia.org/r/518449 (https://phabricator.wikimedia.org/T102848) (owner: Vedmaka Wakalaka) [14:42:42] (CR) Ejegg: "PS31: Improve region display in campaign table." [extensions/CentralNotice] - https://gerrit.wikimedia.org/r/518449 (https://phabricator.wikimedia.org/T102848) (owner: Vedmaka Wakalaka) [14:44:50] (CR) jerkins-bot: [V: -1] Finer geo targeting [extensions/CentralNotice] - https://gerrit.wikimedia.org/r/518449 (https://phabricator.wikimedia.org/T102848) (owner: Vedmaka Wakalaka) [14:53:52] (PS32) Ejegg: Finer geo targeting [extensions/CentralNotice] - https://gerrit.wikimedia.org/r/518449 (https://phabricator.wikimedia.org/T102848) (owner: Vedmaka Wakalaka) [14:56:51] (CR) jerkins-bot: [V: -1] Finer geo targeting [extensions/CentralNotice] - https://gerrit.wikimedia.org/r/518449 (https://phabricator.wikimedia.org/T102848) (owner: Vedmaka Wakalaka) [14:57:25] Fundraising Sprint A Wrinkle in Timezones, Fundraising Sprint Visual Basic Instinct, Fundraising-Backlog, Fr-cross-training, and 2 others: Rebase and finish Geotargeting (sub national targeting) - https://phabricator.wikimedia.org/T226438 (Ejegg) Patch set 32 includes all the improvements I can... [15:00:13] Fundraising Sprint A Wrinkle in Timezones, Fundraising Sprint Sysadmin Kane, Fundraising Sprint Trojan Horse Wisperer, Fundraising Sprint Usual Subscripts, and 4 others: Civi: create annual $ summary TY email button - https://phabricator.wikimedia.org/T221271 (jgleeson) Hey all So the new code w... [15:02:32] (PS33) Ejegg: Finer geo targeting [extensions/CentralNotice] - https://gerrit.wikimedia.org/r/518449 (https://phabricator.wikimedia.org/T102848) (owner: Vedmaka Wakalaka) [16:14:47] (PS3) Jgleeson: WIP: add contact_id filter to wmf_eoy_receipt module [wikimedia/fundraising/crm] - https://gerrit.wikimedia.org/r/552089 (https://phabricator.wikimedia.org/T238691) [16:25:22] fundraising-tech-ops, DC-Ops, Operations, decommission: decommission alnilam.frack.codfw.wmnet - https://phabricator.wikimedia.org/T238233 (Papaul) [16:25:35] fundraising-tech-ops, DC-Ops, Operations, decommission: decommission alnilam.frack.codfw.wmnet - https://phabricator.wikimedia.org/T238233 (Papaul) Open→Resolved Complete [17:44:25] Fundraising Sprint A Wrinkle in Timezones, Fundraising-Backlog: Old donation with new Endowment appeal - https://phabricator.wikimedia.org/T238876 (DStrine) [17:52:20] Fundraising Sprint A Wrinkle in Timezones, Fundraising-Backlog: Old donation with new Endowment appeal - https://phabricator.wikimedia.org/T238876 (Ejegg) The log shows that donation was edited twice recently by @RLewis - on 2019-11-12 22:32:46 she changed the appeal from 06annualfundraiser to E19_20, th... [17:52:38] now that's a very apropos ticket for the sprint title! ^^^^ [17:55:45] :) [18:08:04] Fundraising Sprint A Wrinkle in Timezones, Fundraising-Backlog: Old donation with new Endowment appeal - https://phabricator.wikimedia.org/T238876 (RLewis) @Ejegg could this be a bug? I have no idea why I would have edited this record or changed the direct appeal for this contact. I've looked in the chan... [20:23:11] PROBLEM - check_apache2 on payments2003 is CRITICAL: PROCS CRITICAL: 0 processes with command name apache2 [20:23:15] PROBLEM - check_mysql on payments2003 is CRITICAL: Cant connect to local MySQL server through socket /var/run/mysqld/mysqld.sock (2 No such file or directory) [20:23:15] PROBLEM - check_nginx on payments2003 is CRITICAL: PROCS CRITICAL: 0 processes with command name nginx [20:23:21] PROBLEM - check_payments_wiki on payments2003 is CRITICAL: connect to address payments2003.frack.codfw.wmnet and port 443: Connection refused [20:23:23] PROBLEM - check_ssl on payments2003 is CRITICAL: SSL CRITICAL - failed to connect or SSL handshake:Connection refused [20:28:11] RECOVERY - check_apache2 on payments2003 is OK: PROCS OK: 6 processes with command name apache2 [20:28:15] PROBLEM - check_mysql on payments2003 is CRITICAL: Cant connect to local MySQL server through socket /var/run/mysqld/mysqld.sock (2 No such file or directory) [20:28:15] RECOVERY - check_nginx on payments2003 is OK: PROCS OK: 49 processes with command name nginx [20:28:15] RECOVERY - check_payments_wiki on payments2003 is OK: HTTP OK: HTTP/1.1 200 OK - 406 bytes in 0.012 second response time [20:28:21] RECOVERY - check_ssl on payments2003 is OK: SSL OK - Certificate payments.wikimedia.org valid until 2020-11-24 23:59:59 +0000 (expires in 368 days) [20:33:15] PROBLEM - check_mysql on payments2003 is CRITICAL: Cant connect to local MySQL server through socket /var/run/mysqld/mysqld.sock (2 No such file or directory) [20:38:15] PROBLEM - check_mysql on payments2003 is CRITICAL: Cant connect to local MySQL server through socket /var/run/mysqld/mysqld.sock (2 No such file or directory) [20:43:15] PROBLEM - check_mysql on payments2003 is CRITICAL: Cant connect to local MySQL server through socket /var/run/mysqld/mysqld.sock (2 No such file or directory) [20:48:15] PROBLEM - check_mysql on payments2003 is CRITICAL: Cant connect to local MySQL server through socket /var/run/mysqld/mysqld.sock (2 No such file or directory) [20:53:15] PROBLEM - check_mysql on payments2003 is CRITICAL: Cant connect to local MySQL server through socket /var/run/mysqld/mysqld.sock (2 No such file or directory) [20:58:15] PROBLEM - check_mysql on payments2003 is CRITICAL: Cant connect to local MySQL server through socket /var/run/mysqld/mysqld.sock (2 No such file or directory) [21:00:36] fundraising-tech-ops, Operations, ops-eqiad: (No Need By Date Provided) rack/setup/install frban1001.eqiad.wmnet - https://phabricator.wikimedia.org/T234068 (wiki_willy) [21:03:15] PROBLEM - check_mysql on payments2003 is CRITICAL: Cant connect to local MySQL server through socket /var/run/mysqld/mysqld.sock (2 No such file or directory) [21:08:15] RECOVERY - check_mysql on payments2003 is OK: Uptime: 258 Threads: 1 Questions: 1 Slow queries: 0 Opens: 17 Flush tables: 1 Open tables: 11 Queries per second avg: 0.003 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 0 [21:15:10] (PS1) Cstone: Update SmashPig to 0.5.11.1 [core] (fundraising/REL1_31) - https://gerrit.wikimedia.org/r/552577 [21:16:49] (CR) jerkins-bot: [V: -1] Update SmashPig to 0.5.11.1 [core] (fundraising/REL1_31) - https://gerrit.wikimedia.org/r/552577 (owner: Cstone) [21:28:01] fundraising-tech-ops, Operations, ops-codfw: (No Need By Date Provided) rack/setup/install frban2001.frack.codfw.wmnet - https://phabricator.wikimedia.org/T234069 (wiki_willy) [21:46:37] Fundraising Sprint A Wrinkle in Timezones, Fundraising-Backlog: AVS score in fraud filters - https://phabricator.wikimedia.org/T238352 (EMartin) Hi Dylan, rather than play with AVS scores during this critical period, would it be possible to change the "score country map" score for IE, UK, NZ by -25 poin... [21:52:19] (PS2) Cstone: Update SmashPig to v0.5.11.1 [core] (fundraising/REL1_31) - https://gerrit.wikimedia.org/r/552577 [21:53:30] (CR) jerkins-bot: [V: -1] Update SmashPig to v0.5.11.1 [core] (fundraising/REL1_31) - https://gerrit.wikimedia.org/r/552577 (owner: Cstone) [23:00:48] (CR) Cstone: "recheck" [core] (fundraising/REL1_31) - https://gerrit.wikimedia.org/r/552577 (owner: Cstone) [23:05:42] (CR) Cstone: "recheck" [extensions/DonationInterface] - https://gerrit.wikimedia.org/r/552341 (https://phabricator.wikimedia.org/T238785) (owner: Cstone) [23:08:49] (CR) Cstone: "recheck" [extensions/DonationInterface] - https://gerrit.wikimedia.org/r/552422 (owner: L10n-bot)