[00:01:58] <shinken-wm>	 RECOVERY - Puppet run on deployment-eventlogging03 is OK: OK: Less than 1.00% above the threshold [0.0]
[00:02:02] <bd808>	 thcipriani: if you run into any more VMs that are hung like logstash2 was, a note on https://phabricator.wikimedia.org/T141673 would be great
[00:02:29] <thcipriani>	 ack, will do
[00:03:09] * bd808 suspects something wonky in the kernel versions we are running on the bare metal
[00:14:21] <shinken-wm>	 RECOVERY - Puppet run on deployment-eventlogging04 is OK: OK: Less than 1.00% above the threshold [0.0]
[02:29:16] <wikibugs>	 07Browser-Tests, 10MobileFrontend, 06Reading-Web-Backlog, 03Reading-Web-Sprint-77-Segmentation-fault, and 5 others: Spike [2hrs] Wikidata description browser tests do not run anywhere - https://phabricator.wikimedia.org/T137756#2507400 (10dr0ptp4kt) Excellent.
[13:04:22] <wmf-insecte>	 Project selenium-Math » chrome,beta,Linux,contintLabsSlave && UbuntuTrusty build #97: 04FAILURE in 21 sec: https://integration.wikimedia.org/ci/job/selenium-Math/BROWSER=chrome,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/97/
[14:58:30] <shinken-wm>	 PROBLEM - Puppet run on deployment-sca02 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0]
[14:59:16] <shinken-wm>	 PROBLEM - Puppet run on deployment-sca01 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0]
[15:44:55] <wmf-insecte>	 Yippee, build fixed!
[15:44:56] <wmf-insecte>	 Project selenium-MobileFrontend » firefox,beta,Linux,contintLabsSlave && UbuntuTrusty build #97: 09FIXED in 22 min: https://integration.wikimedia.org/ci/job/selenium-MobileFrontend/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/97/
[15:57:57] <shinken-wm>	 PROBLEM - Puppet run on integration-slave-trusty-1013 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0]
[20:53:36] <wmf-insecte>	 Yippee, build fixed!
[20:53:37] <wmf-insecte>	 Project selenium-Wikidata » firefox,test,Linux,contintLabsSlave && UbuntuTrusty build #70: 09FIXED in 2 hr 3 min: https://integration.wikimedia.org/ci/job/selenium-Wikidata/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=test,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/70/
[21:31:47] <shinken-wm>	 PROBLEM - Puppet run on deployment-aqs01 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0]
[21:33:23] <shinken-wm>	 PROBLEM - Puppet run on integration-slave-precise-1002 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0]
[21:34:38] <shinken-wm>	 PROBLEM - Puppet run on integration-slave-precise-1012 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0]
[21:35:44] <shinken-wm>	 PROBLEM - Puppet run on integration-slave-precise-1011 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0]
[21:42:49] <shinken-wm>	 PROBLEM - Puppet run on deployment-changeprop is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0]
[22:34:21] <wikibugs>	 10Continuous-Integration-Infrastructure, 07Jenkins: Some Jenkins jobs tend to be stuck and never times out - https://phabricator.wikimedia.org/T138281#2508933 (10hashar)
[22:36:26] <wikibugs>	 10Continuous-Integration-Infrastructure, 07Jenkins: Some Jenkins jobs tend to be stuck and never times out - https://phabricator.wikimedia.org/T138281#2508935 (10hashar) 05Open>03Resolved a:03hashar Fixed on CI havent seen that jbd2/vda1 issue in July.  Guess some upstream package in Jessie fixed it.