[00:43:22] PROBLEM - Mediawiki Error Rate on graphite-labs is CRITICAL: CRITICAL: 60.00% of data above the critical threshold [10.0] [03:57:05] PROBLEM - puppet last run on doc1001 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues [04:23:37] RECOVERY - puppet last run on doc1001 is OK: OK: Puppet is currently enabled, last run 49 seconds ago with 0 failures [07:06:06] 10Project-Admins: Create a component project for the EditAccount extension - https://phabricator.wikimedia.org/T205293 (10Umherirrender) >>! In T205293#4779182, @ashley wrote: > EditAccount doesn't currently support AuthManager (T135264) and is bascially abandonware at this point. Given that and the fact that [[... [08:22:26] PROBLEM - Puppet staleness on deployment-ms-be03 is CRITICAL: CRITICAL: 44.44% of data above the critical threshold [43200.0] [12:24:22] RECOVERY - Mediawiki Error Rate on graphite-labs is OK: OK: Less than 1.00% above the threshold [1.0] [13:18:30] PROBLEM - Long lived cherry-picks on puppetmaster on deployment-puppetmaster03 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [16:15:55] 10Gerrit, 10Security: Disable SSLv2, SSLv3, TLS 1.0 and TLS 1.1 in apache for gerrit.wikimedia.org - https://phabricator.wikimedia.org/T221499 (10Bawolff) https://www.ssllabs.com/ssltest/analyze.html?d=gerrit.wikimedia.org&s=2620%3a0%3a861%3a3%3a208%3a80%3a154%3a85&latest suggests ssl3 is already disabled Mak... [16:15:57] 10Gerrit, 10Security: Disable SSLv2, SSLv3, TLS 1.0 and TLS 1.1 in apache for gerrit.wikimedia.org - https://phabricator.wikimedia.org/T221499 (10Bawolff) [16:18:20] 10Gerrit, 10Security: Disable SSLv2, SSLv3, TLS 1.0 and TLS 1.1 in apache for gerrit.wikimedia.org - https://phabricator.wikimedia.org/T221499 (10Krenair) Am guessing this is a default for built-in TLS support that does not apply with our apache proxy in front? [16:19:50] 10Gerrit, 10Security: Disable TLS 1.0 and 1.1 in apache for gerrit.wikimedia.org - https://phabricator.wikimedia.org/T221499 (10Krenair) [17:20:34] 10Project-Admins: Create a component project for the EditAccount extension - https://phabricator.wikimedia.org/T205293 (10Aklapper) 05Open→03Declined a:05ashley→03None [17:57:23] PROBLEM - Mediawiki Error Rate on graphite-labs is CRITICAL: CRITICAL: 20.00% of data above the critical threshold [10.0] [19:03:22] PROBLEM - Mediawiki Error Rate on graphite-labs is CRITICAL: CRITICAL: 40.00% of data above the critical threshold [10.0] [19:13:24] RECOVERY - Mediawiki Error Rate on graphite-labs is OK: OK: Less than 1.00% above the threshold [1.0] [19:43:57] 10Release-Engineering-Team (Next), 10Scap, 10WMF-JobQueue, 10Core Platform Team Backlog (Watching / External), and 2 others: Add jobrunner servers to Scap canary process - https://phabricator.wikimedia.org/T172480 (10Krinkle) This task was referenced as actionable for aa recent incident. 10Phabricator: Query "ManiphestTaskQuery" failed to return a value from getPagingValueMap() for column "rank". - https://phabricator.wikimedia.org/T221509 (10Tgr)