[00:31:17] PROBLEM - Long lived cherry-picks on puppetmaster on deployment-puppetmaster02 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [01:27:38] PROBLEM - Free space - all mounts on deployment-fluorine02 is CRITICAL: CRITICAL: deployment-prep.deployment-fluorine02.diskspace._srv.byte_percentfree (<11.11%) [03:49:19] 10Gerrit: Setup mirror for gerrit to clone from GitHub for repo design/style-guide - https://phabricator.wikimedia.org/T189370#4040880 (10Krinkle) 05Open>03stalled As far as I know that comment just means they haven’t done an initial import yet (manually). It will not be a mirror. Please let them handle it t... [04:00:54] PROBLEM - puppet last run on contint2001 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues [04:31:03] RECOVERY - puppet last run on contint2001 is OK: OK: Puppet is currently enabled, last run 3 minutes ago with 0 failures [04:47:29] PROBLEM - Mediawiki Error Rate on graphite-labs is CRITICAL: CRITICAL: 80.00% of data above the critical threshold [10.0] [06:17:30] PROBLEM - Mediawiki Error Rate on graphite-labs is CRITICAL: CRITICAL: 60.00% of data above the critical threshold [10.0] [07:12:40] RECOVERY - Free space - all mounts on deployment-fluorine02 is OK: OK: All targets OK [09:49:26] (03CR) 10Thiemo Kreuz (WMDE): "> […] if the first class is a Exception subclass and then the second class is the main one for the file." [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/418000 (owner: 10Thiemo Kreuz (WMDE)) [10:34:09] 10Continuous-Integration-Config: Jenkins randomly fails tests for AbuseFilter - https://phabricator.wikimedia.org/T189411#4041051 (10Daimona) [10:54:06] PROBLEM - Host deployment-videoscaler01 is DOWN: CRITICAL - Host Unreachable (10.68.19.130) [10:54:53] PROBLEM - Host deployment-tmh01 is DOWN: CRITICAL - Host Unreachable (10.68.16.211) [12:30:53] PROBLEM - Puppet errors on deployment-ores01 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [14:51:51] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (Someday), 10Jenkins: Install the blue ocean plugin alongside jenkins 2.x upgrade - https://phabricator.wikimedia.org/T155840#4041186 (10Paladox) bump, @hashar i think we can do this now :), we are running the latest jenkins 2.x update + thi... [14:53:15] PROBLEM - Host deployment-puppetdb01 is DOWN: CRITICAL - Host Unreachable (10.68.23.76) [14:53:44] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (Someday), 10Jenkins: Install the BlueOcean plugin on jenkins - https://phabricator.wikimedia.org/T155840#4041187 (10Paladox) [16:33:17] PROBLEM - Puppet errors on deployment-logstash2 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [16:57:42] 10Phabricator-Sprint-Extension, 10Technical-Debt: Deprecate Phabricator Sprint extension - https://phabricator.wikimedia.org/T90906#1070848 (10kwisatz) I'm a little confused as to the status of this and related projects. I just set up #phragile to discover that it doesn't add any value to what the sprint exten... [18:12:49] (03PS1) 10Umherirrender: Validate phpunit annotations [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/418732 (https://phabricator.wikimedia.org/T176031) [18:25:01] (03PS2) 10Umherirrender: Validate phpunit annotations [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/418732 (https://phabricator.wikimedia.org/T176031) [18:25:41] (03CR) 10Umherirrender: "Patch Set 2: Restored one test case" [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/418732 (https://phabricator.wikimedia.org/T176031) (owner: 10Umherirrender) [18:34:37] PROBLEM - App Server Main HTTP Response on deployment-mediawiki07 is CRITICAL: HTTP CRITICAL: HTTP/1.1 500 hphp_invoke - string 'Wikipedia' not found on 'http://en.wikipedia.beta.wmflabs.org:80/wiki/Main_Page?debug=true' - 287 bytes in 0.006 second response time [18:52:30] PROBLEM - Mediawiki Error Rate on graphite-labs is CRITICAL: CRITICAL: 20.00% of data above the critical threshold [10.0] [18:54:28] PROBLEM - Puppet errors on deployment-secureredirexperiment is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [19:52:30] PROBLEM - Mediawiki Error Rate on graphite-labs is CRITICAL: CRITICAL: 80.00% of data above the critical threshold [10.0] [21:08:21] PROBLEM - Puppet errors on deployment-mx02 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [21:53:34] PROBLEM - Puppet errors on deployment-maps02 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [23:38:36] PROBLEM - Puppet errors on saucelabs-01 is CRITICAL: CRITICAL: 22.22% of data above the critical threshold [0.0] [23:39:31] PROBLEM - Puppet errors on deployment-memc06 is CRITICAL: CRITICAL: 33.33% of data above the critical threshold [0.0]