[00:01:03] PROBLEM - Mediawiki Error Rate on graphite-labs is CRITICAL: CRITICAL: 20.00% of data above the critical threshold [10.0] [00:21:36] 10Release-Engineering-Team-TODO, 10Core Platform Team, 10Wikimedia-Site-requests, 10MW-1.34-notes (1.34.0-wmf.22; 2019-09-10), and 2 others: Consider enabling wgExtensionInfoMTime in wmf-production - https://phabricator.wikimedia.org/T187154 (10Krinkle) [00:29:51] 10Continuous-Integration-Config, 10RESTBase, 10Documentation, 10good first bug: Remove link to defunct https://rest.wikimedia.org/ on https://doc.wikimedia.org/ - https://phabricator.wikimedia.org/T227766 (10Krinkle) On doc.wikimedia.org, we usually target developers contributing to the software or develop... [01:01:04] PROBLEM - Mediawiki Error Rate on graphite-labs is CRITICAL: CRITICAL: 20.00% of data above the critical threshold [10.0] [01:16:05] PROBLEM - Mediawiki Error Rate on graphite-labs is CRITICAL: CRITICAL: 20.00% of data above the critical threshold [10.0] [02:11:03] PROBLEM - Mediawiki Error Rate on graphite-labs is CRITICAL: CRITICAL: 20.00% of data above the critical threshold [10.0] [04:11:02] PROBLEM - Mediawiki Error Rate on graphite-labs is CRITICAL: CRITICAL: 20.00% of data above the critical threshold [10.0] [04:55:41] PROBLEM - Free space - all mounts on deployment-deploy01 is CRITICAL: CRITICAL: deployment-prep.deployment-deploy01.diskspace.root.byte_percentfree (<10.00%) [05:05:41] RECOVERY - Free space - all mounts on deployment-deploy01 is OK: OK: All targets OK [05:26:45] PROBLEM - Free space - all mounts on deployment-deploy01 is CRITICAL: CRITICAL: deployment-prep.deployment-deploy01.diskspace.root.byte_percentfree (<10.00%) [05:56:00] PROBLEM - Mediawiki Error Rate on graphite-labs is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [10.0] [06:05:08] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (CI & Testing services), 10Release-Engineering-Team-TODO, 10Zuul: Jenkins 'test' pipeline should cancel old jobs after new patch sets - https://phabricator.wikimedia.org/T229708 (10greg) p:05Triage→03Normal [06:07:11] 10Release-Engineering-Team, 10Cleanup, 10Maps, 10Repository-Admins: Delete (rather than archive) the maps/kartotherian and maps/tilerator repos - https://phabricator.wikimedia.org/T228483 (10greg) >>! In T228483#5456468, @MarcoAurelio wrote: > So they can decide about the deletions on Gerrit. as long as t... [06:07:25] 10Release-Engineering-Team (Development services), 10Release-Engineering-Team-TODO, 10Cleanup, 10Maps, 10Repository-Admins: Delete (rather than archive) the maps/kartotherian and maps/tilerator repos - https://phabricator.wikimedia.org/T228483 (10greg) [06:09:05] 10Gerrit, 10Release-Engineering-Team (Development services), 10Release-Engineering-Team-TODO, 10Cleanup, and 3 others: Gerrit repositories mediawiki/services/service-runner and mediawiki/services/service-template-node appear abandoned - https://phabricator.wikimedia.org/T231953 (10greg) [06:56:43] RECOVERY - Free space - all mounts on deployment-deploy01 is OK: OK: All targets OK [07:07:46] RECOVERY - Free space - all mounts on deployment-fluorine02 is OK: OK: All targets OK [07:09:51] (03CR) 10Filippo Giunchedi: [C: 03+1] "I'm not a kibana/js expert by any stretch of imagination, LGTM to my untrained eye. I've added Timo as he might be interested." [releng/phatality] - 10https://gerrit.wikimedia.org/r/531047 (https://phabricator.wikimedia.org/T230752) (owner: 1020after4) [07:24:34] 10Release-Engineering-Team-TODO (201909), 10Parsoid, 10Wikimedia-production-error: parsoid emits: Html2Wt/WikitextSerializer.php:1423 PHP Notice: Undefined offset: 50 - https://phabricator.wikimedia.org/T232183 (10hashar) [07:27:45] 10Release-Engineering-Team-TODO (201909), 10Parsoid, 10Wikimedia-production-error: parsoid emits: Html2Wt/WikitextSerializer.php:1423 PHP Notice: Undefined offset: 50 - https://phabricator.wikimedia.org/T232183 (10hashar) [07:30:00] 10Release-Engineering-Team (Deployment services), 10Release-Engineering-Team-TODO (201909), 10Patch-For-Review, 10Release, 10Train Deployments: 1.34.0-wmf.21 deployment blockers - https://phabricator.wikimedia.org/T220746 (10hashar) 1.34.0-wmf.21 is now on all wikis. [07:36:58] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (CI & Testing services), 10Release-Engineering-Team-TODO (201909): Bump CI php72 images given we've moved production to 7.2.22 - https://phabricator.wikimedia.org/T232165 (10hashar) p:05Triage→03High Yes we should definitely rebuild all... [07:40:49] 10Release-Engineering-Team (Development services), 10Release-Engineering-Team-TODO, 10Cleanup, 10Maps, 10Repository-Admins: Delete (rather than archive) the maps/kartotherian and maps/tilerator repos - https://phabricator.wikimedia.org/T228483 (10Mathew.onipe) Let's wait for @MSantos or @Mholloway opinio... [08:11:02] PROBLEM - Mediawiki Error Rate on graphite-labs is CRITICAL: CRITICAL: 20.00% of data above the critical threshold [10.0] [08:43:37] 10Project-Admins, 10translatewiki.net: Convert T41480 ("Issues affecting translatewiki.net") to a project tag - https://phabricator.wikimedia.org/T231991 (10Aklapper) Okay, we need to settle on a name here I guess. After that I could proceed. [09:21:38] 10Release-Engineering-Team-TODO (201908): Read Kubernetes book - https://phabricator.wikimedia.org/T230007 (10Aklapper) @LarsWirzenius: This open task is tagged with RelEng-201908 but that project tag has been archived, so this task will not be shown on any workboard by default. Could you please either associate... [09:21:40] 10Release-Engineering-Team-TODO (201908): Determine CI PoC evaluation criteria - https://phabricator.wikimedia.org/T230006 (10Aklapper) @LarsWirzenius: This open task is tagged with RelEng-201908 but that project tag has been archived, so this task will not be shown on any workboard by default. Could you please... [10:11:02] PROBLEM - Mediawiki Error Rate on graphite-labs is CRITICAL: CRITICAL: 20.00% of data above the critical threshold [10.0] [10:23:16] 10Continuous-Integration-Config, 10Code-Health-Metrics, 10Code-Health: Error in code coverage reports for extensions in codehealth-pipeline - https://phabricator.wikimedia.org/T232195 (10kostajh) [10:23:25] 10Continuous-Integration-Config, 10Code-Health-Metrics, 10Code-Health: Error in code coverage reports for extensions in codehealth-pipeline - https://phabricator.wikimedia.org/T232195 (10kostajh) [10:54:13] 10Release-Engineering-Team-TODO (201908): Read Kubernetes book - https://phabricator.wikimedia.org/T230007 (10LarsWirzenius) 05Open→03Resolved [10:54:35] 10Release-Engineering-Team-TODO (201908): Determine CI PoC evaluation criteria - https://phabricator.wikimedia.org/T230006 (10LarsWirzenius) 05Open→03Resolved [11:05:50] How hard is it to get max_user_connections raised? https://phabricator.wikimedia.org/T232210 [11:07:16] Nemo_bis: sounds like a question for #wikimedia-cloud to me [11:07:56] Lucas_WMDE: yes sorry, it's the previous window in my irssi :P [11:08:16] ah ok :) [11:14:59] thcipriani: any ideas about T232195? [11:15:12] T232195: Error in code coverage reports for extensions in codehealth-pipeline - https://phabricator.wikimedia.org/T232195 [12:11:06] PROBLEM - Mediawiki Error Rate on graphite-labs is CRITICAL: CRITICAL: 20.00% of data above the critical threshold [10.0] [13:16:31] (03Abandoned) 1020after4: Support ubuntu 16.04 [releng/local-charts] - 10https://gerrit.wikimedia.org/r/524623 (owner: 1020after4) [13:18:17] (03CR) 1020after4: "> Patch Set 4: Code-Review+1" [releng/phatality] - 10https://gerrit.wikimedia.org/r/531047 (https://phabricator.wikimedia.org/T230752) (owner: 1020after4) [13:30:50] 10Release-Engineering-Team (Development services), 10Release-Engineering-Team-TODO, 10Cleanup, 10Maps, 10Repository-Admins: Delete (rather than archive) the maps/kartotherian and maps/tilerator repos - https://phabricator.wikimedia.org/T228483 (10MSantos) `maps/(kartotherian|tilerator)/package` remain ac... [14:11:01] PROBLEM - Mediawiki Error Rate on graphite-labs is CRITICAL: CRITICAL: 20.00% of data above the critical threshold [10.0] [14:11:07] (03CR) 10Filippo Giunchedi: [C: 03+1] "> Patch Set 4:" [releng/phatality] - 10https://gerrit.wikimedia.org/r/531047 (https://phabricator.wikimedia.org/T230752) (owner: 1020after4) [14:13:25] (03CR) 1020after4: "> Patch Set 4:" [releng/phatality] - 10https://gerrit.wikimedia.org/r/531047 (https://phabricator.wikimedia.org/T230752) (owner: 1020after4) [14:13:37] (03CR) 10Krinkle: Phatality plugin for kibana (032 comments) [releng/phatality] - 10https://gerrit.wikimedia.org/r/531047 (https://phabricator.wikimedia.org/T230752) (owner: 1020after4) [14:18:58] 10Release-Engineering-Team-TODO, 10Core Platform Team, 10Wikimedia-Site-requests, 10MW-1.34-notes (1.34.0-wmf.22; 2019-09-10), and 2 others: Consider enabling wgExtensionInfoMTime in wmf-production - https://phabricator.wikimedia.org/T187154 (10WDoranWMF) @Krinkle Which piece should CPT look at? [14:24:33] 10Release-Engineering-Team (Development services), 10Release-Engineering-Team-TODO, 10Cleanup, 10Maps, 10Repository-Admins: Delete (rather than archive) the maps/kartotherian and maps/tilerator repos - https://phabricator.wikimedia.org/T228483 (10Mholloway) +1, delete away. [14:40:39] 10Release-Engineering-Team-TODO, 10Core Platform Team, 10Wikimedia-Site-requests, 10MW-1.34-notes (1.34.0-wmf.22; 2019-09-10), and 2 others: Consider enabling wgExtensionInfoMTime in wmf-production - https://phabricator.wikimedia.org/T187154 (10Krinkle) Initial data from the PHP72 roll out so far, comparin... [14:45:28] 10Continuous-Integration-Config, 10Release-Engineering-Team (CI & Testing services), 10CPT Initiatives (API Integration Tests), 10Core Platform Team Workboards (Purple): Set up CI for mediawiki/tools/api-testing - https://phabricator.wikimedia.org/T230340 (10hashar) Gave it a try and I have something worki... [14:46:24] 10Continuous-Integration-Config, 10Release-Engineering-Team (CI & Testing services), 10CPT Initiatives (API Integration Tests), 10Core Platform Team Workboards (Purple): Set up CI for mediawiki/tools/api-testing - https://phabricator.wikimedia.org/T230340 (10hashar) The two tests failing are: ` 1) Move a... [14:46:45] 10Continuous-Integration-Config, 10Release-Engineering-Team (CI & Testing services), 10Release-Engineering-Team-TODO (201909), 10CPT Initiatives (API Integration Tests), 10Core Platform Team Workboards (Purple): Set up CI for mediawiki/tools/api-testing - https://phabricator.wikimedia.org/T230340 (10hasha... [14:47:55] 10Release-Engineering-Team-TODO, 10Core Platform Team, 10Wikimedia-Site-requests, 10MW-1.34-notes (1.34.0-wmf.22; 2019-09-10), and 2 others: Consider enabling wgExtensionInfoMTime in wmf-production - https://phabricator.wikimedia.org/T187154 (10Krinkle) >>! In T187154#5471378, @WDoranWMF wrote: > @Krinkle... [14:48:19] 10Release-Engineering-Team-TODO, 10Core Platform Team, 10Wikimedia-Site-requests, 10MW-1.34-notes (1.34.0-wmf.22; 2019-09-10), and 2 others: Consider enabling wgExtensionInfoMTime in wmf-production - https://phabricator.wikimedia.org/T187154 (10Krinkle) [14:50:57] 10:50:24 + git fetch --depth 2 --quiet git://contint1001.wikimedia.org/operations/software/conftool refs/zuul/master/Zffe61a2d1f3043178462f7c561f111fb [14:51:00] 10:50:24 fatal: remote error: access denied or repository not exported: /operations/software/conftool [14:51:43] don't think I've seen that one before [14:51:52] ah yeah you lack privileges, you need to have been at the wmf for more than 5 years [14:51:58] no really [14:51:59] 😂 [14:52:01] https://phabricator.wikimedia.org/T187897 [14:52:06] hashar: this was from a docker worker [14:52:09] https://integration.wikimedia.org/ci/job/conftool-tox-docker/368/console [14:52:13] yeah [14:52:14] so [14:52:25] so CI fetch from a couple of git-daemon instances on contint1001 and contint2001 [14:52:36] which I guess has some nasty race condition or just get overloaded from time to time :-\ [14:53:06] * hashar digs in logs [14:54:07] Sep 6 14:50:24 contint1001 git-daemon[31715]: '/srv/zuul/git/operations/software/conftool' does not appear to be a git repository [14:54:08] :-\ [14:54:38] (time is utc, the message comes from contint1001) [15:00:06] 10Continuous-Integration-Config, 10Release-Engineering-Team (CI & Testing services), 10Release-Engineering-Team-TODO (201909), 10CPT Initiatives (API Integration Tests), 10Core Platform Team Workboards (Purple): Set up CI for mediawiki/tools/api-testing - https://phabricator.wikimedia.org/T230340 (10danie... [15:05:20] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (CI & Testing services), 10Release-Engineering-Team-TODO: fatal: remote error: access denied or repository not exported: /mediawiki/extensions/ReadingLists - https://phabricator.wikimedia.org/T187897 (10hashar) That still happens from time t... [15:05:32] 10Release-Engineering-Team-TODO, 10Core Platform Team, 10Wikimedia-Site-requests, 10CPT Initiatives (PHP7 (TEC4)), and 3 others: Consider enabling wgExtensionInfoMTime in wmf-production - https://phabricator.wikimedia.org/T187154 (10WDoranWMF) [15:06:14] cdanis: thanks I have updated the task T187897 with some traces. There is some race condition I think between git merge operations and git-daemon checking whether .git dir exists and trying to chdir to it [15:06:15] T187897: fatal: remote error: access denied or repository not exported: /mediawiki/extensions/ReadingLists - https://phabricator.wikimedia.org/T187897 [15:06:17] ;-\ [15:06:23] thanks hashar! [15:06:29] so really, no clue [15:06:43] unless we hack git to report more detailed error as to why it considers the repo to not be a repo! [15:55:11] 10Release-Engineering-Team-TODO, 10Core Platform Team, 10Wikimedia-Site-requests, 10CPT Initiatives (PHP7 (TEC4)), and 3 others: Consider enabling wgExtensionInfoMTime in wmf-production - https://phabricator.wikimedia.org/T187154 (10WDoranWMF) @Krinkle Ok thanks you for this. Given the 1.34 tag is this lik... [16:11:03] PROBLEM - Mediawiki Error Rate on graphite-labs is CRITICAL: CRITICAL: 20.00% of data above the critical threshold [10.0] [16:27:40] legoktm hi, i'm wondering if you could upload texvc to debian buster please? :) [16:27:51] says [ Source: mediawiki-math ] [16:27:55] https://packages.debian.org/stretch/texvc [16:46:20] 10Release-Engineering-Team-TODO, 10Core Platform Team, 10Wikimedia-Site-requests, 10CPT Initiatives (PHP7 (TEC4)), and 2 others: Consider enabling wgExtensionInfoMTime in wmf-production - https://phabricator.wikimedia.org/T187154 (10Krinkle) @WDoranWMF Ah no. I do think this is important, but not //that//... [16:46:24] 10Release-Engineering-Team-TODO, 10Core Platform Team, 10Wikimedia-Site-requests, 10CPT Initiatives (PHP7 (TEC4)), and 2 others: Consider enabling wgExtensionInfoMTime in wmf-production - https://phabricator.wikimedia.org/T187154 (10Krinkle) [16:50:37] 10Release-Engineering-Team-TODO, 10Core Platform Team, 10Wikimedia-Site-requests, 10CPT Initiatives (PHP7 (TEC4)), and 2 others: Consider enabling wgExtensionInfoMTime in wmf-production - https://phabricator.wikimedia.org/T187154 (10WDoranWMF) Great, thank you [17:10:38] 10MediaWiki-Releasing, 10MediaWiki-Installer, 10MW-1.34-release: Bundle TextExtracts with MediaWiki - https://phabricator.wikimedia.org/T229127 (10Jdforrester-WMF) [18:08:56] PROBLEM - Puppet errors on deployment-cpjobqueue is CRITICAL: (Service Check Timed Out) [18:08:57] PROBLEM - Free space - all mounts on integration-agent-docker-1001 is CRITICAL: (Service Check Timed Out) [18:09:00] PROBLEM - Puppet staleness on deployment-memc04 is CRITICAL: (Service Check Timed Out) [18:09:02] PROBLEM - Puppet staleness on deployment-logstash03 is CRITICAL: (Service Check Timed Out) [18:09:05] PROBLEM - Free space - all mounts on deployment-imagescaler01 is CRITICAL: (Service Check Timed Out) [18:09:05] PROBLEM - Free space - all mounts on integration-castor03 is CRITICAL: (Service Check Timed Out) [18:09:09] PROBLEM - Puppet staleness on integration-slave-docker-1058 is CRITICAL: (Service Check Timed Out) [18:09:10] PROBLEM - Puppet staleness on deployment-sessionstore01 is CRITICAL: (Service Check Timed Out) [18:09:18] PROBLEM - Puppet errors on integration-slave-docker-1043 is CRITICAL: (Service Check Timed Out) [18:09:20] PROBLEM - Puppet staleness on deployment-restbase01 is CRITICAL: (Service Check Timed Out) [18:09:24] PROBLEM - Free space - all mounts on deployment-hadoop-test-2 is CRITICAL: (Service Check Timed Out) [18:09:25] PROBLEM - Puppet staleness on integration-castor03 is CRITICAL: (Service Check Timed Out) [18:09:28] PROBLEM - Puppet staleness on deployment-acme-chief04 is CRITICAL: (Service Check Timed Out) [18:09:28] PROBLEM - Puppet staleness on deployment-elastic06 is CRITICAL: (Service Check Timed Out) [18:09:30] PROBLEM - Puppet errors on integration-slave-jessie-1001 is CRITICAL: (Service Check Timed Out) [18:09:33] PROBLEM - Puppet staleness on deployment-alex-test is CRITICAL: (Service Check Timed Out) [18:09:36] PROBLEM - Puppet errors on deployment-ircd is CRITICAL: (Service Check Timed Out) [18:09:38] PROBLEM - Puppet errors on integration-cumin is CRITICAL: (Service Check Timed Out) [18:09:44] PROBLEM - Puppet errors on deployment-acme-chief04 is CRITICAL: (Service Check Timed Out) [18:11:47] PROBLEM - Free space - all mounts on deployment-logstash2 is CRITICAL: (Service Check Timed Out) [18:15:33] Project beta-scap-eqiad build #265825: 04FAILURE in 37 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/265825/ [18:21:02] RECOVERY - Puppet staleness on integration-slave-jessie-1004 is OK: OK: Less than 1.00% above the threshold [3600.0] [19:10:59] hashar: https://gerrit.wikimedia.org/r/#/c/integration/config/+/534861 etc. [19:28:27] James_F: yeah :) [19:28:40] James_F: the devil is that adding some of those dependencies would also bring in dependencies of those [19:28:49] and potentially a lot of extensions for which tests will be run [19:28:51] but well .. [19:37:01] !log Reloading zuul for Id07a109accc88b138193463a8e7335a60e501910 Add UniversalLanguageSelector to ExternalGuidance's dependencies [19:37:06] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [19:51:44] !log Reloading zuul for https://gerrit.wikimedia.org/r/#/c/integration/config/+/534862/ https://gerrit.wikimedia.org/r/#/c/integration/config/+/534863/ https://gerrit.wikimedia.org/r/#/c/integration/config/+/534864/ [19:51:46] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [19:59:56] !log Reloading Zuul to deploy https://gerrit.wikimedia.org/r/534872 [19:59:57] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [20:11:04] PROBLEM - Mediawiki Error Rate on graphite-labs is CRITICAL: CRITICAL: 20.00% of data above the critical threshold [10.0] [21:26:59] PROBLEM - Puppet errors on deployment-sca01 is CRITICAL: (Service Check Timed Out) [21:26:59] PROBLEM - Mediawiki Error Rate on graphite-labs is CRITICAL: (Service Check Timed Out) [21:26:59] PROBLEM - Puppet errors on integration-slave-jessie-1002 is CRITICAL: (Service Check Timed Out) [21:27:00] PROBLEM - Puppet staleness on deployment-eventgate-1 is CRITICAL: (Service Check Timed Out) [21:27:00] PROBLEM - Puppet errors on integration-cumin is CRITICAL: (Service Check Timed Out) [21:27:00] PROBLEM - Puppet errors on deployment-memc06 is CRITICAL: (Service Check Timed Out) [21:27:00] PROBLEM - Free space - all mounts on deployment-prometheus02 is CRITICAL: (Service Check Timed Out) [21:27:00] PROBLEM - Free space - all mounts on deployment-kafka-jumbo-1 is CRITICAL: (Service Check Timed Out) [21:27:00] PROBLEM - Puppet staleness on deployment-sessionstore02 is CRITICAL: (Service Check Timed Out) [21:27:00] PROBLEM - Puppet errors on deployment-deploy01 is CRITICAL: (Service Check Timed Out) [21:27:00] PROBLEM - Puppet errors on deployment-docker-mathoid01 is CRITICAL: (Service Check Timed Out) [21:27:00] PROBLEM - Puppet errors on deployment-elastic05 is CRITICAL: (Service Check Timed Out) [21:27:00] PROBLEM - Free space - all mounts on deployment-deploy01 is CRITICAL: (Service Check Timed Out) [21:31:37] RECOVERY - Puppet errors on deployment-sca01 is OK: OK: Less than 1.00% above the threshold [2.0] [21:31:37] RECOVERY - Puppet errors on integration-slave-jessie-1002 is OK: OK: Less than 1.00% above the threshold [2.0] [21:31:37] RECOVERY - Puppet staleness on deployment-eventgate-1 is OK: OK: Less than 1.00% above the threshold [3600.0] [21:31:37] RECOVERY - Puppet errors on integration-cumin is OK: OK: Less than 1.00% above the threshold [2.0] [21:31:37] RECOVERY - Free space - all mounts on deployment-kafka-jumbo-1 is OK: OK: deployment-prep.deployment-kafka-jumbo-1.diskspace._mnt_kafka.byte_percentfree (No valid datapoints found) [21:31:37] RECOVERY - Puppet errors on deployment-memc06 is OK: OK: Less than 1.00% above the threshold [2.0] [21:31:37] RECOVERY - Free space - all mounts on deployment-prometheus02 is OK: OK: All targets OK [21:31:40] RECOVERY - Puppet staleness on deployment-sessionstore02 is OK: OK: Less than 1.00% above the threshold [3600.0] [21:31:41] RECOVERY - Puppet errors on deployment-deploy01 is OK: OK: Less than 1.00% above the threshold [2.0] [21:31:42] RECOVERY - Free space - all mounts on deployment-aqs01 is OK: OK: All targets OK [21:31:42] RECOVERY - Puppet errors on deployment-elastic05 is OK: OK: Less than 1.00% above the threshold [2.0] [21:31:42] RECOVERY - Free space - all mounts on integration-slave-docker-1050 is OK: OK: All targets OK [21:31:44] RECOVERY - Puppet errors on integration-slave-jessie-1004 is OK: OK: Less than 1.00% above the threshold [2.0] [21:31:45] RECOVERY - Puppet errors on deployment-docker-mathoid01 is OK: OK: Less than 1.00% above the threshold [2.0] [22:11:02] PROBLEM - Mediawiki Error Rate on graphite-labs is CRITICAL: CRITICAL: 20.00% of data above the critical threshold [10.0] [22:46:42] RECOVERY - Free space - all mounts on deployment-deploy01 is OK: OK: All targets OK