[03:33:48] Yippee, build fixed! [03:33:48] Project browsertests-MultimediaViewer-en.wikipedia.beta.wmflabs.org-windows_7-internet_explorer-11-sauce build #155: FIXED in 31 min: https://integration.wikimedia.org/ci/job/browsertests-MultimediaViewer-en.wikipedia.beta.wmflabs.org-windows_7-internet_explorer-11-sauce/155/ [03:56:04] Yippee, build fixed! [03:56:05] Project browsertests-Core-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #373: FIXED in 12 min: https://integration.wikimedia.org/ci/job/browsertests-Core-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce/373/ [04:05:43] Yippee, build fixed! [04:05:44] Project browsertests-Flow-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #434: FIXED in 48 min: https://integration.wikimedia.org/ci/job/browsertests-Flow-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce/434/ [04:57:04] Project browsertests-VisualEditor-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #487: FAILURE in 51 min: https://integration.wikimedia.org/ci/job/browsertests-VisualEditor-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce/487/ [05:14:59] Project beta-scap-eqiad build #35240: FAILURE in 56 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/35240/ [05:25:07] Project beta-scap-eqiad build #35241: STILL FAILING in 1 min 7 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/35241/ [05:35:26] Yippee, build fixed! [05:35:27] Project beta-scap-eqiad build #35242: FIXED in 1 min 31 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/35242/ [05:51:33] Yippee, build fixed! [05:51:34] Project browsertests-Flow-en.wikipedia.beta.wmflabs.org-windows_8-internet_explorer-sauce build #352: FIXED in 44 min: https://integration.wikimedia.org/ci/job/browsertests-Flow-en.wikipedia.beta.wmflabs.org-windows_8-internet_explorer-sauce/352/ [10:06:02] PROBLEM - Puppet failure on deployment-memc03 is CRITICAL: CRITICAL: 33.33% of data above the critical threshold [0.0] [10:09:34] PROBLEM - Puppet failure on deployment-redis01 is CRITICAL: CRITICAL: 66.67% of data above the critical threshold [0.0] [10:09:38] PROBLEM - Puppet failure on deployment-mathoid is CRITICAL: CRITICAL: 66.67% of data above the critical threshold [0.0] [10:11:12] PROBLEM - Puppet failure on deployment-restbase02 is CRITICAL: CRITICAL: 75.00% of data above the critical threshold [0.0] [10:34:35] RECOVERY - Puppet failure on deployment-redis01 is OK: OK: Less than 1.00% above the threshold [0.0] [10:34:41] RECOVERY - Puppet failure on deployment-mathoid is OK: OK: Less than 1.00% above the threshold [0.0] [10:36:05] RECOVERY - Puppet failure on deployment-memc03 is OK: OK: Less than 1.00% above the threshold [0.0] [10:36:15] RECOVERY - Puppet failure on deployment-restbase02 is OK: OK: Less than 1.00% above the threshold [0.0] [11:35:23] Project beta-scap-eqiad build #35278: FAILURE in 1 min 3 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/35278/ [11:45:14] Project beta-scap-eqiad build #35279: STILL FAILING in 1 min 8 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/35279/ [11:55:37] Yippee, build fixed! [11:55:38] Project beta-scap-eqiad build #35280: FIXED in 1 min 27 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/35280/ [12:31:38] PROBLEM - Puppet failure on deployment-mx is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [16:45:09] PROBLEM - Puppet failure on deployment-cache-mobile03 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [16:46:21] PROBLEM - Puppet failure on deployment-pdf01 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [17:54:56] Project beta-scap-eqiad build #35315: FAILURE in 1 min 2 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/35315/ [18:05:22] Project beta-scap-eqiad build #35316: STILL FAILING in 1 min 26 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/35316/ [18:08:51] PROBLEM - Puppet failure on deployment-eventlogging02 is CRITICAL: CRITICAL: 22.22% of data above the critical threshold [0.0] [18:09:19] PROBLEM - Puppet failure on deployment-upload is CRITICAL: CRITICAL: 37.50% of data above the critical threshold [0.0] [18:16:03] Yippee, build fixed! [18:16:03] Project beta-scap-eqiad build #35317: FIXED in 2 min 0 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/35317/ [18:22:07] PROBLEM - Puppet failure on deployment-logstash1 is CRITICAL: CRITICAL: 50.00% of data above the critical threshold [0.0] [18:34:18] RECOVERY - Puppet failure on deployment-upload is OK: OK: Less than 1.00% above the threshold [0.0] [18:36:47] Project browsertests-MultimediaViewer-en.wikipedia.beta.wmflabs.org-windows_7-internet_explorer-11-sauce build #156: FAILURE in 34 min: https://integration.wikimedia.org/ci/job/browsertests-MultimediaViewer-en.wikipedia.beta.wmflabs.org-windows_7-internet_explorer-11-sauce/156/ [18:38:49] RECOVERY - Puppet failure on deployment-eventlogging02 is OK: OK: Less than 1.00% above the threshold [0.0] [18:47:08] RECOVERY - Puppet failure on deployment-logstash1 is OK: OK: Less than 1.00% above the threshold [0.0] [19:06:25] Project browsertests-Flow-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #435: FAILURE in 49 min: https://integration.wikimedia.org/ci/job/browsertests-Flow-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce/435/ [19:59:24] Yippee, build fixed! [19:59:25] Project browsertests-VisualEditor-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #488: FIXED in 52 min: https://integration.wikimedia.org/ci/job/browsertests-VisualEditor-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce/488/