[00:11:10] RECOVERY - Mediawiki Error Rate on graphite-labs is OK: OK: Less than 1.00% above the threshold [1.0] [03:25:40] PROBLEM - Puppet errors on deployment-secureredirexperiment is CRITICAL: CRITICAL: 55.56% of data above the critical threshold [0.0] [03:32:28] 10Beta-Cluster-Infrastructure, 10MediaWiki-extensions-WikimediaMaintenance, 10User-MarcoAurelio: Allow dumpInterwiki.php to be run on Cloud VPS/Toolforge - https://phabricator.wikimedia.org/T172040#3484131 (10bd808) #toolforge and the shared clone of MediaWiki it provides are not intended to be a location fo... [03:45:42] PROBLEM - Puppet errors on deployment-mathoid is CRITICAL: CRITICAL: 50.00% of data above the critical threshold [0.0] [04:00:40] RECOVERY - Puppet errors on deployment-secureredirexperiment is OK: OK: Less than 1.00% above the threshold [0.0] [04:17:33] Project selenium-MultimediaViewer » firefox,beta,Linux,BrowserTests build #470: 04FAILURE in 21 min: https://integration.wikimedia.org/ci/job/selenium-MultimediaViewer/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=BrowserTests/470/ [04:20:41] RECOVERY - Puppet errors on deployment-mathoid is OK: OK: Less than 1.00% above the threshold [0.0] [07:53:28] (03CR) 10Legoktm: [C: 032] Use float division for the percentage [integration/commit-message-validator] - 10https://gerrit.wikimedia.org/r/368546 (owner: 10XZise) [07:54:06] (03Merged) 10jenkins-bot: Use float division for the percentage [integration/commit-message-validator] - 10https://gerrit.wikimedia.org/r/368546 (owner: 10XZise) [11:11:12] (03PS6) 10Paladox: [operations-puppet-catalog-compiler] Adding it to jenkins job builder [integration/config] - 10https://gerrit.wikimedia.org/r/315994 (https://phabricator.wikimedia.org/T97513) [11:11:42] (03Abandoned) 10Paladox: Update email regex part 2 [integration/config] - 10https://gerrit.wikimedia.org/r/325140 (owner: 10Paladox) [11:18:24] PROBLEM - Puppet errors on deployment-ms-be03 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [11:20:14] PROBLEM - Puppet errors on deployment-ms-be04 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [11:20:57] (03PS5) 10Paladox: Update composer to 1.4.2 [integration/composer] - 10https://gerrit.wikimedia.org/r/340791 (https://phabricator.wikimedia.org/T125343) [11:21:13] PROBLEM - Puppet errors on deployment-sca02 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [12:24:43] PROBLEM - Puppet errors on deployment-mira is CRITICAL: CRITICAL: 50.00% of data above the critical threshold [0.0] [13:04:42] RECOVERY - Puppet errors on deployment-mira is OK: OK: Less than 1.00% above the threshold [0.0] [13:14:33] PROBLEM - Puppet errors on deployment-pdfrender02 is CRITICAL: CRITICAL: 20.00% of data above the critical threshold [0.0] [13:46:46] Yippee, build fixed! [13:46:47] Project selenium-VisualEditor » firefox,beta,Linux,BrowserTests build #476: 09FIXED in 2 min 45 sec: https://integration.wikimedia.org/ci/job/selenium-VisualEditor/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=BrowserTests/476/ [13:54:31] RECOVERY - Puppet errors on deployment-pdfrender02 is OK: OK: Less than 1.00% above the threshold [0.0] [15:16:41] PROBLEM - Puppet errors on deployment-mathoid is CRITICAL: CRITICAL: 60.00% of data above the critical threshold [0.0] [15:51:42] RECOVERY - Puppet errors on deployment-mathoid is OK: OK: Less than 1.00% above the threshold [0.0] [16:12:40] PROBLEM - Puppet errors on deployment-mathoid is CRITICAL: CRITICAL: 20.00% of data above the critical threshold [0.0] [16:52:42] RECOVERY - Puppet errors on deployment-mathoid is OK: OK: Less than 1.00% above the threshold [0.0] [17:55:45] PROBLEM - Puppet errors on deployment-mira is CRITICAL: CRITICAL: 55.56% of data above the critical threshold [0.0] [18:35:44] RECOVERY - Puppet errors on deployment-mira is OK: OK: Less than 1.00% above the threshold [0.0] [21:13:39] PROBLEM - Puppet errors on deployment-mathoid is CRITICAL: CRITICAL: 30.00% of data above the critical threshold [0.0] [21:53:41] RECOVERY - Puppet errors on deployment-mathoid is OK: OK: Less than 1.00% above the threshold [0.0] [23:26:43] PROBLEM - Puppet errors on deployment-mira is CRITICAL: CRITICAL: 66.67% of data above the critical threshold [0.0]