[00:02:11] PROBLEM - Puppet failure on deployment-sca02 is CRITICAL 55.56% of data above the critical threshold [0.0] [00:37:14] RECOVERY - Puppet failure on deployment-sca02 is OK Less than 1.00% above the threshold [0.0] [04:30:23] Yippee, build fixed! [04:30:23] Project browsertests-MultimediaViewer-en.wikipedia.beta.wmflabs.org-windows_7-internet_explorer-9-sauce build #504: FIXED in 38 min: https://integration.wikimedia.org/ci/job/browsertests-MultimediaViewer-en.wikipedia.beta.wmflabs.org-windows_7-internet_explorer-9-sauce/504/ [05:21:19] 10Continuous-Integration-Infrastructure, 7Technical-Debt, 7Tracking: All repositories should pass jshint test (tracking) - https://phabricator.wikimedia.org/T62619#1463080 (10Legoktm) [05:34:46] Yippee, build fixed! [05:34:47] Project browsertests-Gather-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce build #200: FIXED in 13 min: https://integration.wikimedia.org/ci/job/browsertests-Gather-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce/200/ [06:49:32] RECOVERY - Free space - all mounts on deployment-videoscaler01 is OK All targets OK [07:28:11] PROBLEM - Puppet failure on deployment-bastion is CRITICAL 44.44% of data above the critical threshold [0.0] [07:46:27] PROBLEM - Puppet failure on deployment-urldownloader is CRITICAL 20.00% of data above the critical threshold [0.0] [07:46:51] PROBLEM - Puppet failure on mira is CRITICAL 20.00% of data above the critical threshold [0.0] [07:47:37] PROBLEM - Puppet failure on deployment-memc03 is CRITICAL 30.00% of data above the critical threshold [0.0] [07:48:35] PROBLEM - Puppet failure on deployment-memc04 is CRITICAL 40.00% of data above the critical threshold [0.0] [07:48:35] PROBLEM - Puppet failure on deployment-memc02 is CRITICAL 40.00% of data above the critical threshold [0.0] [07:48:43] PROBLEM - Puppet failure on deployment-elastic06 is CRITICAL 30.00% of data above the critical threshold [0.0] [07:48:55] PROBLEM - Puppet failure on deployment-apertium01 is CRITICAL 30.00% of data above the critical threshold [0.0] [07:49:49] PROBLEM - Puppet failure on deployment-mediawiki03 is CRITICAL 20.00% of data above the critical threshold [0.0] [07:50:39] PROBLEM - Puppet failure on deployment-parsoid05 is CRITICAL 40.00% of data above the critical threshold [0.0] [07:50:39] PROBLEM - Puppet failure on deployment-zookeeper01 is CRITICAL 60.00% of data above the critical threshold [0.0] [07:51:33] PROBLEM - Puppet failure on deployment-zotero01 is CRITICAL 60.00% of data above the critical threshold [0.0] [07:51:54] PROBLEM - Puppet failure on deployment-kafka02 is CRITICAL 60.00% of data above the critical threshold [0.0] [07:53:16] PROBLEM - Puppet failure on deployment-sca02 is CRITICAL 44.44% of data above the critical threshold [0.0] [07:53:28] PROBLEM - Puppet failure on deployment-stream is CRITICAL 30.00% of data above the critical threshold [0.0] [07:53:31] PROBLEM - Puppet failure on deployment-mediawiki02 is CRITICAL 40.00% of data above the critical threshold [0.0] [07:54:15] PROBLEM - Puppet failure on deployment-db2 is CRITICAL 33.33% of data above the critical threshold [0.0] [07:54:39] PROBLEM - Puppet failure on deployment-cxserver03 is CRITICAL 60.00% of data above the critical threshold [0.0] [07:54:56] PROBLEM - Puppet failure on deployment-pdf02 is CRITICAL 30.00% of data above the critical threshold [0.0] [07:57:20] PROBLEM - Puppet failure on deployment-sca01 is CRITICAL 55.56% of data above the critical threshold [0.0] [07:58:06] PROBLEM - Puppet failure on deployment-sentry2 is CRITICAL 66.67% of data above the critical threshold [0.0] [07:58:54] PROBLEM - Puppet failure on deployment-videoscaler01 is CRITICAL 50.00% of data above the critical threshold [0.0] [07:59:53] PROBLEM - Puppet failure on deployment-redis01 is CRITICAL 30.00% of data above the critical threshold [0.0] [07:59:55] PROBLEM - Puppet failure on deployment-fluorine is CRITICAL 50.00% of data above the critical threshold [0.0] [08:00:23] PROBLEM - Puppet failure on deployment-pdf01 is CRITICAL 60.00% of data above the critical threshold [0.0] [08:00:23] PROBLEM - Puppet failure on deployment-elastic07 is CRITICAL 22.22% of data above the critical threshold [0.0] [08:01:43] PROBLEM - Puppet failure on deployment-salt is CRITICAL 20.00% of data above the critical threshold [0.0] [08:01:47] PROBLEM - Puppet failure on deployment-eventlogging02 is CRITICAL 50.00% of data above the critical threshold [0.0] [08:02:13] PROBLEM - Puppet failure on deployment-test is CRITICAL 33.33% of data above the critical threshold [0.0] [08:03:33] PROBLEM - Puppet failure on deployment-elastic05 is CRITICAL 30.00% of data above the critical threshold [0.0] [08:06:17] PROBLEM - Puppet failure on deployment-jobrunner01 is CRITICAL 22.22% of data above the critical threshold [0.0] [08:07:41] PROBLEM - Puppet failure on deployment-upload is CRITICAL 20.00% of data above the critical threshold [0.0] [08:09:13] PROBLEM - Puppet failure on deployment-db1 is CRITICAL 33.33% of data above the critical threshold [0.0] [08:10:28] PROBLEM - Puppet failure on deployment-elastic08 is CRITICAL 50.00% of data above the critical threshold [0.0] [08:11:04] PROBLEM - Puppet failure on deployment-mediawiki01 is CRITICAL 22.22% of data above the critical threshold [0.0] [08:11:06] PROBLEM - Puppet failure on deployment-redis02 is CRITICAL 55.56% of data above the critical threshold [0.0] [08:15:26] PROBLEM - Puppet failure on deployment-mathoid is CRITICAL 60.00% of data above the critical threshold [0.0] [08:19:06] PROBLEM - Puppet failure on deployment-logstash2 is CRITICAL 66.67% of data above the critical threshold [0.0] [08:54:09] RECOVERY - Puppet failure on deployment-logstash2 is OK Less than 1.00% above the threshold [0.0] [08:54:13] RECOVERY - Puppet failure on deployment-db1 is OK Less than 1.00% above the threshold [0.0] [08:55:28] RECOVERY - Puppet failure on deployment-mathoid is OK Less than 1.00% above the threshold [0.0] [08:55:28] RECOVERY - Puppet failure on deployment-elastic08 is OK Less than 1.00% above the threshold [0.0] [08:56:06] RECOVERY - Puppet failure on deployment-redis02 is OK Less than 1.00% above the threshold [0.0] [08:56:30] RECOVERY - Puppet failure on deployment-urldownloader is OK Less than 1.00% above the threshold [0.0] [08:57:38] RECOVERY - Puppet failure on deployment-upload is OK Less than 1.00% above the threshold [0.0] [08:58:10] RECOVERY - Puppet failure on deployment-bastion is OK Less than 1.00% above the threshold [0.0] [08:58:42] RECOVERY - Puppet failure on deployment-elastic06 is OK Less than 1.00% above the threshold [0.0] [08:58:52] RECOVERY - Puppet failure on deployment-apertium01 is OK Less than 1.00% above the threshold [0.0] [08:59:44] RECOVERY - Puppet failure on deployment-mediawiki03 is OK Less than 1.00% above the threshold [0.0] [09:00:38] RECOVERY - Puppet failure on deployment-zookeeper01 is OK Less than 1.00% above the threshold [0.0] [09:00:38] RECOVERY - Puppet failure on deployment-parsoid05 is OK Less than 1.00% above the threshold [0.0] [09:01:06] RECOVERY - Puppet failure on deployment-mediawiki01 is OK Less than 1.00% above the threshold [0.0] [09:01:31] RECOVERY - Puppet failure on deployment-zotero01 is OK Less than 1.00% above the threshold [0.0] [09:04:37] RECOVERY - Puppet failure on deployment-cxserver03 is OK Less than 1.00% above the threshold [0.0] [09:06:52] RECOVERY - Puppet failure on deployment-kafka02 is OK Less than 1.00% above the threshold [0.0] [09:07:18] RECOVERY - Puppet failure on deployment-sca01 is OK Less than 1.00% above the threshold [0.0] [09:08:11] RECOVERY - Puppet failure on deployment-sca02 is OK Less than 1.00% above the threshold [0.0] [09:08:27] RECOVERY - Puppet failure on deployment-stream is OK Less than 1.00% above the threshold [0.0] [09:08:35] RECOVERY - Puppet failure on deployment-mediawiki02 is OK Less than 1.00% above the threshold [0.0] [09:08:35] RECOVERY - Puppet failure on deployment-memc02 is OK Less than 1.00% above the threshold [0.0] [09:08:57] RECOVERY - Puppet failure on deployment-videoscaler01 is OK Less than 1.00% above the threshold [0.0] [09:09:11] RECOVERY - Puppet failure on deployment-db2 is OK Less than 1.00% above the threshold [0.0] [09:09:53] RECOVERY - Puppet failure on deployment-fluorine is OK Less than 1.00% above the threshold [0.0] [09:09:55] RECOVERY - Puppet failure on deployment-pdf02 is OK Less than 1.00% above the threshold [0.0] [09:10:23] RECOVERY - Puppet failure on deployment-pdf01 is OK Less than 1.00% above the threshold [0.0] [09:11:41] RECOVERY - Puppet failure on deployment-salt is OK Less than 1.00% above the threshold [0.0] [09:12:40] RECOVERY - Puppet failure on deployment-memc03 is OK Less than 1.00% above the threshold [0.0] [09:13:34] RECOVERY - Puppet failure on deployment-memc04 is OK Less than 1.00% above the threshold [0.0] [09:14:54] RECOVERY - Puppet failure on deployment-redis01 is OK Less than 1.00% above the threshold [0.0] [09:15:20] RECOVERY - Puppet failure on deployment-elastic07 is OK Less than 1.00% above the threshold [0.0] [09:16:18] RECOVERY - Puppet failure on deployment-jobrunner01 is OK Less than 1.00% above the threshold [0.0] [09:16:48] RECOVERY - Puppet failure on deployment-eventlogging02 is OK Less than 1.00% above the threshold [0.0] [09:17:08] RECOVERY - Puppet failure on deployment-test is OK Less than 1.00% above the threshold [0.0] [09:18:06] RECOVERY - Puppet failure on deployment-sentry2 is OK Less than 1.00% above the threshold [0.0] [09:18:30] RECOVERY - Puppet failure on deployment-elastic05 is OK Less than 1.00% above the threshold [0.0] [09:22:25] PROBLEM - Puppet failure on deployment-mx is CRITICAL 100.00% of data above the critical threshold [0.0] [09:31:49] RECOVERY - Puppet failure on mira is OK Less than 1.00% above the threshold [0.0] [09:43:52] Project browsertests-Echo-en.wikipedia.beta.wmflabs.org-linux-chrome-sauce build #551: FAILURE in 6 min 51 sec: https://integration.wikimedia.org/ci/job/browsertests-Echo-en.wikipedia.beta.wmflabs.org-linux-chrome-sauce/551/ [11:45:30] PROBLEM - Free space - all mounts on deployment-videoscaler01 is CRITICAL deployment-prep.deployment-videoscaler01.diskspace._var.byte_percentfree (<50.00%) [12:00:14] (03PS3) 10Hashar: Migrate mediawiki-core-code-coverage job to labs [integration/config] - 10https://gerrit.wikimedia.org/r/225063 (https://phabricator.wikimedia.org/T93559) [12:00:52] (03CR) 10Hashar: [C: 04-1] Use npm for CollapsibleVector (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/224819 (owner: 10Paladox) [12:01:53] (03PS12) 10Hashar: Use npm for CollapsibleVector [integration/config] - 10https://gerrit.wikimedia.org/r/224819 (owner: 10Paladox) [12:03:39] (03CR) 10Hashar: [C: 032] Use npm for CollapsibleVector [integration/config] - 10https://gerrit.wikimedia.org/r/224819 (owner: 10Paladox) [12:04:57] (03Merged) 10jenkins-bot: Use npm for CollapsibleVector [integration/config] - 10https://gerrit.wikimedia.org/r/224819 (owner: 10Paladox) [12:22:51] (03PS1) 10Florianschmidtwelzow: Remove Mantle from dependency tree for several extensions [integration/config] - 10https://gerrit.wikimedia.org/r/225687 [12:23:41] (03PS2) 10Florianschmidtwelzow: Remove Mantle from dependency tree for several extensions [integration/config] - 10https://gerrit.wikimedia.org/r/225687 [12:24:42] (03CR) 10Hashar: [C: 04-1] Update MsUpload tests (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/225231 (owner: 10Paladox) [12:25:12] (03PS4) 10Hashar: Update MsUpload tests [integration/config] - 10https://gerrit.wikimedia.org/r/225231 (owner: 10Paladox) [12:27:15] (03PS5) 10Hashar: Update MsUpload tests [integration/config] - 10https://gerrit.wikimedia.org/r/225231 (owner: 10Paladox) [12:28:12] PROBLEM - Puppet failure on integration-slave-trusty-1013 is CRITICAL 55.56% of data above the critical threshold [0.0] [12:30:32] (03PS3) 10Florianschmidtwelzow: Remove Mantle from dependency tree for several extensions [integration/config] - 10https://gerrit.wikimedia.org/r/225687 [12:31:53] (03CR) 10Luis Felipe Schenone: [C: 031] Update MsUpload tests [integration/config] - 10https://gerrit.wikimedia.org/r/225231 (owner: 10Paladox) [12:35:24] (03PS6) 10Hashar: Update MsUpload tests [integration/config] - 10https://gerrit.wikimedia.org/r/225231 (owner: 10Paladox) [12:39:30] (03CR) 10Hashar: [C: 032] "I also removed the mwext-MsUpload-* jobs since this change switch to the generic jobs. Hence I deleted from Jenkins:" [integration/config] - 10https://gerrit.wikimedia.org/r/225231 (owner: 10Paladox) [12:41:43] (03Merged) 10jenkins-bot: Update MsUpload tests [integration/config] - 10https://gerrit.wikimedia.org/r/225231 (owner: 10Paladox) [12:42:23] (03CR) 10Paladox: "Thankyou I was looking for the old tests to delete them but didn't find them. But thanks." [integration/config] - 10https://gerrit.wikimedia.org/r/225231 (owner: 10Paladox) [12:44:45] (03PS12) 10Paladox: Update tests for Vector skin [integration/config] - 10https://gerrit.wikimedia.org/r/224824 [12:45:10] (03PS10) 10Paladox: Update tests for Metrolook [integration/config] - 10https://gerrit.wikimedia.org/r/224834 [12:45:27] (03CR) 10Hashar: [C: 04-1] "Can you also add a npm package.json to that repo so we can check i18n files with the banana linter? Thanks!" [integration/config] - 10https://gerrit.wikimedia.org/r/225291 (owner: 10Paladox) [12:46:34] (03PS11) 10Paladox: Update theme tests [integration/config] - 10https://gerrit.wikimedia.org/r/224838 [12:46:46] (03CR) 10Paladox: [C: 031] Update theme tests [integration/config] - 10https://gerrit.wikimedia.org/r/224838 (owner: 10Paladox) [12:48:32] (03CR) 10Hashar: [C: 04-1] Update MwEmbedSupport tests (033 comments) [integration/config] - 10https://gerrit.wikimedia.org/r/225239 (owner: 10Paladox) [12:48:40] (03CR) 10Paladox: "Ok will do after doing the php check for the other extensions." [integration/config] - 10https://gerrit.wikimedia.org/r/225291 (owner: 10Paladox) [12:49:35] Yippee, build fixed! [12:49:35] Project browsertests-VisualEditor-language-screenshot-os_x_10.10-firefox ยป en,contintLabsSlave && UbuntuTrusty build #64: FIXED in 23 min: https://integration.wikimedia.org/ci/job/browsertests-VisualEditor-language-screenshot-os_x_10.10-firefox/LANGUAGE_SCREENSHOT_CODE=en,label=contintLabsSlave%20&&%20UbuntuTrusty/64/ [12:55:18] Project browsertests-GettingStarted-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #538: FAILURE in 1 min 17 sec: https://integration.wikimedia.org/ci/job/browsertests-GettingStarted-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce/538/ [13:08:16] RECOVERY - Puppet failure on integration-slave-trusty-1013 is OK Less than 1.00% above the threshold [0.0] [13:13:37] (03PS11) 10Paladox: Update tests for Metrolook [integration/config] - 10https://gerrit.wikimedia.org/r/224834 [13:13:59] (03CR) 10Paladox: [C: 031] Update tests for Metrolook [integration/config] - 10https://gerrit.wikimedia.org/r/224834 (owner: 10Paladox) [13:17:10] (03PS4) 10Paladox: Update MwEmbedSupport tests [integration/config] - 10https://gerrit.wikimedia.org/r/225239 [13:17:50] (03CR) 10Paladox: [C: 031] Update MwEmbedSupport tests [integration/config] - 10https://gerrit.wikimedia.org/r/225239 (owner: 10Paladox) [13:18:34] (03CR) 10Hashar: [C: 04-1] Update AjaxLogin tests (032 comments) [integration/config] - 10https://gerrit.wikimedia.org/r/225289 (owner: 10Paladox) [13:23:50] (03PS4) 10Paladox: Check for json in BreadCrumbs [integration/config] - 10https://gerrit.wikimedia.org/r/225291 [13:26:45] (03PS5) 10Paladox: Check for json in BreadCrumbs [integration/config] - 10https://gerrit.wikimedia.org/r/225291 [13:31:59] (03PS6) 10Paladox: Update BreadCrumbs tests [integration/config] - 10https://gerrit.wikimedia.org/r/225291 [13:34:42] (03PS6) 10Thcipriani: Add service deploy via scap [tools/scap] - 10https://gerrit.wikimedia.org/r/224374 [13:36:41] (03PS4) 10Paladox: Update AjaxLogin tests [integration/config] - 10https://gerrit.wikimedia.org/r/225289 [13:48:26] (03PS13) 10Paladox: Update tests for Vector skin [integration/config] - 10https://gerrit.wikimedia.org/r/224824 [13:48:53] (03CR) 10Paladox: [C: 031] Update tests for Vector skin [integration/config] - 10https://gerrit.wikimedia.org/r/224824 (owner: 10Paladox) [13:50:23] (03PS12) 10Paladox: Update theme tests [integration/config] - 10https://gerrit.wikimedia.org/r/224838 [13:52:06] (03CR) 10Paladox: [C: 031] Update theme tests [integration/config] - 10https://gerrit.wikimedia.org/r/224838 (owner: 10Paladox) [13:55:22] (03PS7) 10Paladox: Update interwiki tests [integration/config] - 10https://gerrit.wikimedia.org/r/225313 [14:03:36] (03PS5) 10Paladox: Update tests in vector extension [integration/config] - 10https://gerrit.wikimedia.org/r/225029 [14:07:24] (03PS5) 10Paladox: Update SyntaxHighlight_GeSHi tests [integration/config] - 10https://gerrit.wikimedia.org/r/225035 [14:09:13] (03PS6) 10Paladox: Update SyntaxHighlight_GeSHi tests [integration/config] - 10https://gerrit.wikimedia.org/r/225035 [14:37:03] Project browsertests-MobileFrontend-SmokeTests-linux-chrome-sauce build #196: FAILURE in 9 min 2 sec: https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-SmokeTests-linux-chrome-sauce/196/ [14:37:33] zeljkof-conferen: where are you ? [14:38:04] vikasyaligar: 2nd floor, coming to the room in 10 mins, had a chat with my family [14:38:13] (03PS4) 10Paladox: Update ConfirmAccount tests [integration/config] - 10https://gerrit.wikimedia.org/r/225311 [14:38:14] zeljkof-conferen: ok! great :) [14:39:08] Project browsertests-Wikidata-SmokeTests-linux-firefox-sauce build #318: FAILURE in 22 min: https://integration.wikimedia.org/ci/job/browsertests-Wikidata-SmokeTests-linux-firefox-sauce/318/ [14:39:40] (03PS3) 10Paladox: Remove unused mwext-MaintenanceShell [integration/config] - 10https://gerrit.wikimedia.org/r/225293 [14:39:50] (03CR) 10Paladox: [C: 031] Remove unused mwext-MaintenanceShell [integration/config] - 10https://gerrit.wikimedia.org/r/225293 (owner: 10Paladox) [14:42:43] (03PS1) 10Paladox: Add composer-test to MaintenanceShell [integration/config] - 10https://gerrit.wikimedia.org/r/225693 [14:43:48] (03PS2) 10Paladox: Add composer-test to MaintenanceShell [integration/config] - 10https://gerrit.wikimedia.org/r/225693 [14:53:58] (03PS3) 10Paladox: Add composer-test to MaintenanceShell [integration/config] - 10https://gerrit.wikimedia.org/r/225693 [14:58:00] (03PS4) 10Paladox: Update ShoutWikiAds tests [integration/config] - 10https://gerrit.wikimedia.org/r/225298 [15:01:09] (03PS4) 10Paladox: Update CheckUser tests [integration/config] - 10https://gerrit.wikimedia.org/r/225182 [15:03:15] (03CR) 10Paladox: Update CheckUser tests (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/225182 (owner: 10Paladox) [15:05:28] (03PS4) 10Paladox: Update Maintenance extension tests [integration/config] - 10https://gerrit.wikimedia.org/r/225222 [15:06:05] 6Release-Engineering, 10MediaWiki-Maintenance-scripts, 10MediaWiki-Redirects, 5Patch-For-Review: namespaceDupes not handling deleted namespace redirects as desired - https://phabricator.wikimedia.org/T91401#1463536 (10He7d3r) @FcoLeonSaudanha: the problem you reported on https://www.facebook.com/groups/gru... [15:08:12] (03PS4) 10Paladox: Update farmer tests [integration/config] - 10https://gerrit.wikimedia.org/r/225042 [15:09:06] (03CR) 10Paladox: [C: 031] Update farmer tests [integration/config] - 10https://gerrit.wikimedia.org/r/225042 (owner: 10Paladox) [15:09:40] (03CR) 10Paladox: [C: 031] Update Maintenance extension tests [integration/config] - 10https://gerrit.wikimedia.org/r/225222 (owner: 10Paladox) [15:23:28] PROBLEM - Puppet failure on deployment-cache-bits01 is CRITICAL 100.00% of data above the critical threshold [0.0] [15:25:58] 6Release-Engineering, 10MediaWiki-Maintenance-scripts, 10MediaWiki-Redirects, 5Patch-For-Review: namespaceDupes not handling deleted namespace redirects as desired - https://phabricator.wikimedia.org/T91401#1463543 (10FcoLeonSaudanha) @He7d3r, I understand,,But, there is way to recover such deleted pages h... [16:25:37] (03PS1) 10Paladox: Add check for json in TwitterLogin [integration/config] - 10https://gerrit.wikimedia.org/r/225711 [16:25:55] (03PS2) 10Paladox: Add check for json in TwitterLogin [integration/config] - 10https://gerrit.wikimedia.org/r/225711 [16:29:14] (03PS1) 10Paladox: Update TwitterLogin tests [integration/config] - 10https://gerrit.wikimedia.org/r/225712 [16:29:39] (03PS2) 10Paladox: Update TwitterLogin tests [integration/config] - 10https://gerrit.wikimedia.org/r/225712 [16:34:36] (03PS3) 10Paladox: Update TwitterLogin tests [integration/config] - 10https://gerrit.wikimedia.org/r/225712 [16:35:34] (03PS3) 10Paladox: Add check for json in TwitterLogin [integration/config] - 10https://gerrit.wikimedia.org/r/225711 [17:20:51] 10Browser-Tests: Zoom functionality does not work for language screenshots in Mac OS X - https://phabricator.wikimedia.org/T106289#1463813 (10Vikassy) 3NEW a:3Vikassy [18:07:50] PROBLEM - Free space - all mounts on deployment-fluorine is CRITICAL deployment-prep.deployment-fluorine.diskspace.root.byte_percentfree (<100.00%) [18:54:26] 6Release-Engineering, 6Commons, 6operations: Please whitelist the domain "archive.org" for sideloading on Commons - https://phabricator.wikimedia.org/T106293#1463959 (10brion) [18:55:44] 6Release-Engineering, 6Commons, 6operations: Please whitelist the domain "archive.org" for sideloading on Commons - https://phabricator.wikimedia.org/T106293#1463962 (10Fuzheado) "It's not already?" = Probably should do it right away [18:58:07] 6Release-Engineering, 6Commons, 6operations: Please whitelist the domain "archive.org" for sideloading on Commons - https://phabricator.wikimedia.org/T106293#1463971 (10Krenair) Please read https://meta.wikimedia.org/wiki/Requesting_wiki_configuration_changes [20:12:45] PROBLEM - Puppet failure on deployment-salt is CRITICAL 30.00% of data above the critical threshold [0.0] [20:19:32] PROBLEM - Puppet failure on deployment-elastic05 is CRITICAL 20.00% of data above the critical threshold [0.0] [20:19:36] PROBLEM - Puppet failure on deployment-memc04 is CRITICAL 20.00% of data above the critical threshold [0.0] [20:20:08] PROBLEM - Puppet failure on deployment-logstash2 is CRITICAL 33.33% of data above the critical threshold [0.0] [20:20:52] PROBLEM - Puppet failure on deployment-redis01 is CRITICAL 20.00% of data above the critical threshold [0.0] [20:20:56] PROBLEM - Puppet failure on deployment-pdf02 is CRITICAL 30.00% of data above the critical threshold [0.0] [20:21:22] PROBLEM - Puppet failure on deployment-elastic07 is CRITICAL 33.33% of data above the critical threshold [0.0] [20:21:22] PROBLEM - Puppet failure on deployment-pdf01 is CRITICAL 40.00% of data above the critical threshold [0.0] [20:21:26] PROBLEM - Puppet failure on deployment-mathoid is CRITICAL 30.00% of data above the critical threshold [0.0] [20:21:28] PROBLEM - Puppet failure on deployment-elastic08 is CRITICAL 30.00% of data above the critical threshold [0.0] [20:22:04] PROBLEM - Puppet failure on deployment-redis02 is CRITICAL 33.33% of data above the critical threshold [0.0] [20:22:48] PROBLEM - Puppet failure on deployment-eventlogging02 is CRITICAL 50.00% of data above the critical threshold [0.0] [20:23:08] PROBLEM - Puppet failure on deployment-test is CRITICAL 55.56% of data above the critical threshold [0.0] [20:23:38] PROBLEM - Puppet failure on deployment-upload is CRITICAL 60.00% of data above the critical threshold [0.0] [20:23:38] PROBLEM - Puppet failure on deployment-memc03 is CRITICAL 60.00% of data above the critical threshold [0.0] [20:24:06] PROBLEM - Puppet failure on deployment-sentry2 is CRITICAL 55.56% of data above the critical threshold [0.0] [20:24:13] PROBLEM - Puppet failure on deployment-bastion is CRITICAL 44.44% of data above the critical threshold [0.0] [20:24:13] PROBLEM - Puppet failure on deployment-sca02 is CRITICAL 55.56% of data above the critical threshold [0.0] [20:24:35] PROBLEM - Puppet failure on deployment-memc02 is CRITICAL 60.00% of data above the critical threshold [0.0] [20:24:57] PROBLEM - Puppet failure on deployment-videoscaler01 is CRITICAL 40.00% of data above the critical threshold [0.0] [20:25:13] PROBLEM - Puppet failure on deployment-db1 is CRITICAL 70.00% of data above the critical threshold [0.0] [20:25:17] PROBLEM - Puppet failure on deployment-db2 is CRITICAL 66.67% of data above the critical threshold [0.0] [20:27:05] PROBLEM - Puppet failure on deployment-mediawiki01 is CRITICAL 66.67% of data above the critical threshold [0.0] [20:27:19] PROBLEM - Puppet failure on deployment-jobrunner01 is CRITICAL 22.22% of data above the critical threshold [0.0] [20:39:12] RECOVERY - Puppet failure on deployment-sca02 is OK Less than 1.00% above the threshold [0.0] [20:40:13] RECOVERY - Puppet failure on deployment-db2 is OK Less than 1.00% above the threshold [0.0] [20:40:57] RECOVERY - Puppet failure on deployment-pdf02 is OK Less than 1.00% above the threshold [0.0] [20:41:25] RECOVERY - Puppet failure on deployment-pdf01 is OK Less than 1.00% above the threshold [0.0] [20:43:38] RECOVERY - Puppet failure on deployment-memc03 is OK Less than 1.00% above the threshold [0.0] [20:44:34] RECOVERY - Puppet failure on deployment-memc04 is OK Less than 1.00% above the threshold [0.0] [20:44:37] RECOVERY - Puppet failure on deployment-memc02 is OK Less than 1.00% above the threshold [0.0] [20:45:51] RECOVERY - Puppet failure on deployment-redis01 is OK Less than 1.00% above the threshold [0.0] [20:46:19] RECOVERY - Puppet failure on deployment-elastic07 is OK Less than 1.00% above the threshold [0.0] [20:47:41] RECOVERY - Puppet failure on deployment-salt is OK Less than 1.00% above the threshold [0.0] [20:47:45] RECOVERY - Puppet failure on deployment-eventlogging02 is OK Less than 1.00% above the threshold [0.0] [20:48:12] RECOVERY - Puppet failure on deployment-test is OK Less than 1.00% above the threshold [0.0] [20:49:06] RECOVERY - Puppet failure on deployment-sentry2 is OK Less than 1.00% above the threshold [0.0] [20:49:38] RECOVERY - Puppet failure on deployment-elastic05 is OK Less than 1.00% above the threshold [0.0] [20:51:28] RECOVERY - Puppet failure on deployment-mathoid is OK Less than 1.00% above the threshold [0.0] [20:51:32] RECOVERY - Puppet failure on deployment-elastic08 is OK Less than 1.00% above the threshold [0.0] [20:52:04] RECOVERY - Puppet failure on deployment-mediawiki01 is OK Less than 1.00% above the threshold [0.0] [20:52:20] RECOVERY - Puppet failure on deployment-jobrunner01 is OK Less than 1.00% above the threshold [0.0] [20:53:40] RECOVERY - Puppet failure on deployment-upload is OK Less than 1.00% above the threshold [0.0] [20:55:10] RECOVERY - Puppet failure on deployment-logstash2 is OK Less than 1.00% above the threshold [0.0] [20:55:18] RECOVERY - Puppet failure on deployment-db1 is OK Less than 1.00% above the threshold [0.0] [20:57:05] RECOVERY - Puppet failure on deployment-redis02 is OK Less than 1.00% above the threshold [0.0] [20:59:11] RECOVERY - Puppet failure on deployment-bastion is OK Less than 1.00% above the threshold [0.0] [21:09:57] RECOVERY - Puppet failure on deployment-videoscaler01 is OK Less than 1.00% above the threshold [0.0] [21:18:28] PROBLEM - Puppet failure on deployment-parsoidcache02 is CRITICAL 100.00% of data above the critical threshold [0.0] [21:26:16] PROBLEM - Puppet failure on deployment-cache-text03 is CRITICAL 100.00% of data above the critical threshold [0.0] [21:49:54] (03PS2) 10Galorefitz: Sniff to check for space in single line comments [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/224648 (https://phabricator.wikimedia.org/T101872) [21:50:48] (03CR) 10Galorefitz: "Thank you so much Polybuildr! :)" [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/224648 (https://phabricator.wikimedia.org/T101872) (owner: 10Galorefitz) [22:03:46] PROBLEM - Puppet failure on deployment-eventlogging02 is CRITICAL 30.00% of data above the critical threshold [0.0] [22:05:09] PROBLEM - Puppet failure on deployment-sentry2 is CRITICAL 33.33% of data above the critical threshold [0.0] [22:05:37] PROBLEM - Puppet failure on deployment-elastic05 is CRITICAL 20.00% of data above the critical threshold [0.0] [22:06:53] PROBLEM - Puppet failure on deployment-redis01 is CRITICAL 50.00% of data above the critical threshold [0.0] [22:07:21] PROBLEM - Puppet failure on deployment-elastic07 is CRITICAL 55.56% of data above the critical threshold [0.0] [22:08:17] PROBLEM - Puppet failure on deployment-jobrunner01 is CRITICAL 44.44% of data above the critical threshold [0.0] [22:09:09] PROBLEM - Puppet failure on deployment-test is CRITICAL 66.67% of data above the critical threshold [0.0] [22:11:19] PROBLEM - Puppet failure on deployment-db1 is CRITICAL 40.00% of data above the critical threshold [0.0] [22:12:27] PROBLEM - Puppet failure on deployment-mathoid is CRITICAL 20.00% of data above the critical threshold [0.0] [22:12:29] PROBLEM - Puppet failure on deployment-elastic08 is CRITICAL 30.00% of data above the critical threshold [0.0] [22:12:30] PROBLEM - Puppet failure on deployment-zotero01 is CRITICAL 40.00% of data above the critical threshold [0.0] [22:13:04] PROBLEM - Puppet failure on deployment-mediawiki01 is CRITICAL 44.44% of data above the critical threshold [0.0] [22:13:06] PROBLEM - Puppet failure on deployment-redis02 is CRITICAL 44.44% of data above the critical threshold [0.0] [22:14:40] PROBLEM - Puppet failure on deployment-upload is CRITICAL 60.00% of data above the critical threshold [0.0] [22:14:42] PROBLEM - Puppet failure on deployment-elastic06 is CRITICAL 40.00% of data above the critical threshold [0.0] [22:14:52] PROBLEM - Puppet failure on deployment-apertium01 is CRITICAL 50.00% of data above the critical threshold [0.0] [22:15:11] PROBLEM - Puppet failure on deployment-bastion is CRITICAL 22.22% of data above the critical threshold [0.0] [22:16:11] PROBLEM - Puppet failure on deployment-logstash2 is CRITICAL 33.33% of data above the critical threshold [0.0] [22:16:43] PROBLEM - Puppet failure on deployment-zookeeper01 is CRITICAL 20.00% of data above the critical threshold [0.0] [22:17:29] PROBLEM - Puppet failure on deployment-urldownloader is CRITICAL 40.00% of data above the critical threshold [0.0] [22:17:53] PROBLEM - Puppet failure on mira is CRITICAL 30.00% of data above the critical threshold [0.0] [22:19:38] PROBLEM - Puppet failure on deployment-memc03 is CRITICAL 30.00% of data above the critical threshold [0.0] [22:20:38] PROBLEM - Puppet failure on deployment-cxserver03 is CRITICAL 30.00% of data above the critical threshold [0.0] [22:20:38] PROBLEM - Puppet failure on deployment-memc04 is CRITICAL 40.00% of data above the critical threshold [0.0] [22:20:38] PROBLEM - Puppet failure on deployment-memc02 is CRITICAL 50.00% of data above the critical threshold [0.0] [22:20:48] PROBLEM - Puppet failure on deployment-mediawiki03 is CRITICAL 30.00% of data above the critical threshold [0.0] [22:21:40] PROBLEM - Puppet failure on deployment-parsoid05 is CRITICAL 60.00% of data above the critical threshold [0.0] [22:22:54] PROBLEM - Puppet failure on deployment-kafka02 is CRITICAL 50.00% of data above the critical threshold [0.0] [22:24:30] PROBLEM - Puppet failure on deployment-stream is CRITICAL 20.00% of data above the critical threshold [0.0] [22:24:30] PROBLEM - Puppet failure on deployment-mediawiki02 is CRITICAL 40.00% of data above the critical threshold [0.0] [22:26:14] PROBLEM - Puppet failure on deployment-db2 is CRITICAL 55.56% of data above the critical threshold [0.0] [22:26:58] PROBLEM - Puppet failure on deployment-pdf02 is CRITICAL 40.00% of data above the critical threshold [0.0] [22:27:23] PROBLEM - Puppet failure on deployment-pdf01 is CRITICAL 30.00% of data above the critical threshold [0.0] [22:28:21] PROBLEM - Puppet failure on deployment-sca01 is CRITICAL 66.67% of data above the critical threshold [0.0] [22:30:13] PROBLEM - Puppet failure on deployment-sca02 is CRITICAL 66.67% of data above the critical threshold [0.0] [22:30:55] PROBLEM - Puppet failure on deployment-fluorine is CRITICAL 30.00% of data above the critical threshold [0.0] [22:30:57] PROBLEM - Puppet failure on deployment-videoscaler01 is CRITICAL 60.00% of data above the critical threshold [0.0] [22:33:42] PROBLEM - Puppet failure on deployment-salt is CRITICAL 40.00% of data above the critical threshold [0.0] [23:14:28] 10Beta-Cluster, 10MediaWiki-Internationalization, 7Wikimedia-log-errors: Viewing beta's en_rtlwiki just throws a fatal exception - https://phabricator.wikimedia.org/T106125#1464392 (10Jdforrester-WMF)