[09:47:17] what's up with deployment-tin? looks like puppet is not running there [09:48:06] !log puppet on deployment-tin looks like it is not running properly [09:48:09] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [11:08:06] PROBLEM - Puppet run on integration-c1 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [12:17:30] 10Beta-Cluster-Infrastructure: Request for sysop on zhwp beta cluster - https://phabricator.wikimedia.org/T161949#3148117 (10vjudge404) [12:18:18] 10Beta-Cluster-Infrastructure: Request for sysop on zhwp beta cluster - https://phabricator.wikimedia.org/T161949#3148129 (10vjudge404) p:05Triage>03Normal [12:40:32] 10Beta-Cluster-Infrastructure: Request for sysop on zhwp beta cluster - https://phabricator.wikimedia.org/T161949#3148139 (10Hydriz) 05Open>03Resolved a:03Hydriz Done! [13:06:46] 10Browser-Tests-Infrastructure, 07Documentation, 07Easy: audit/update headers in files - https://phabricator.wikimedia.org/T69141#3148183 (10Rammanojpotla) I want to solve the issue. Can anyone give the details of this issue ? [13:07:26] PROBLEM - SSH on deployment-mcs01 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:07:54] PROBLEM - SSH on deployment-db04 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:08:04] PROBLEM - SSH on integration-slave-jessie-android is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:09:03] Project beta-scap-eqiad build #148996: 04FAILURE in 4 min 10 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/148996/ [13:09:10] PROBLEM - SSH on deployment-jobrunner02 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:09:26] PROBLEM - App Server Main HTTP Response on deployment-mediawiki06 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:10:17] PROBLEM - SSH on deployment-apertium02 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:12:16] RECOVERY - SSH on deployment-mcs01 is OK: SSH OK - OpenSSH_6.7p1 Debian-5+deb8u3 (protocol 2.0) [13:12:44] RECOVERY - SSH on deployment-db04 is OK: SSH OK - OpenSSH_6.7p1 Debian-5+deb8u3 (protocol 2.0) [13:12:54] RECOVERY - SSH on integration-slave-jessie-android is OK: SSH OK - OpenSSH_6.7p1 Debian-5+deb8u3 (protocol 2.0) [13:14:02] RECOVERY - SSH on deployment-jobrunner02 is OK: SSH OK - OpenSSH_6.7p1 Debian-5+deb8u3 (protocol 2.0) [13:14:18] RECOVERY - App Server Main HTTP Response on deployment-mediawiki06 is OK: HTTP OK: HTTP/1.1 200 OK - 45867 bytes in 1.667 second response time [13:15:09] RECOVERY - SSH on deployment-apertium02 is OK: SSH OK - OpenSSH_6.7p1 Debian-5+deb8u3 (protocol 2.0) [13:16:05] PROBLEM - Puppet run on integration-publishing is CRITICAL: CRITICAL: 66.67% of data above the critical threshold [0.0] [13:16:31] Yippee, build fixed! [13:16:32] Project beta-scap-eqiad build #148997: 09FIXED in 1 min 38 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/148997/ [13:31:02] RECOVERY - Puppet run on integration-publishing is OK: OK: Less than 1.00% above the threshold [0.0] [13:46:10] Project selenium-VisualEditor » firefox,beta,Linux,BrowserTests build #354: 04FAILURE in 2 min 10 sec: https://integration.wikimedia.org/ci/job/selenium-VisualEditor/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=BrowserTests/354/ [13:49:09] PROBLEM - Puppet run on buildlog is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [15:26:15] PROBLEM - Puppet run on deployment-mediawiki04 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [15:28:26] PROBLEM - Puppet run on deployment-tin is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [15:35:19] PROBLEM - Puppet run on deployment-tmh01 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [15:42:23] PROBLEM - Puppet run on deployment-mediawiki06 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [15:44:55] Project selenium-MobileFrontend » chrome,beta,Linux,BrowserTests build #377: 04FAILURE in 22 min: https://integration.wikimedia.org/ci/job/selenium-MobileFrontend/BROWSER=chrome,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=BrowserTests/377/ [15:45:28] PROBLEM - Puppet run on deployment-mediawiki05 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [15:49:08] PROBLEM - Puppet run on deployment-jobrunner02 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [15:50:58] PROBLEM - Puppet run on deployment-mira is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [15:52:16] Project selenium-MobileFrontend » firefox,beta,Linux,BrowserTests build #377: 04FAILURE in 30 min: https://integration.wikimedia.org/ci/job/selenium-MobileFrontend/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=BrowserTests/377/ [17:44:16] 06Release-Engineering-Team, 10MediaWiki-Authentication-and-authorization, 05MW-1.29-release (WMF-deploy-2017-04-04_(1.29.0-wmf.19)), 05MW-1.29-release-notes, 13Patch-For-Review: Jenkins Browser tests for Wikibase/Popups etc are failing: Invalid CSRF token... - https://phabricator.wikimedia.org/T160519#3101972 [19:36:04] RainbowSprinkles: can you check the wikitech-l mod queue for an announcement of the MediaWiki Platform team by Victoria? [19:36:30] * bd808 has no mod bit there [19:38:42] Platonides: ^ I think you are a wiktech-l mod too [21:36:58] 10Gerrit, 06Release-Engineering-Team: Update gerrit to 2.13.7 - https://phabricator.wikimedia.org/T158946#3148601 (10demon) No. [21:49:23] 10Gerrit, 06Release-Engineering-Team, 06Operations: Gerrit Index inconsistent - https://phabricator.wikimedia.org/T161966#3148604 (10Paladox) [21:50:27] 10Gerrit, 06Release-Engineering-Team, 06Operations: Gerrit Index inconsistent - https://phabricator.wikimedia.org/T161966#3148617 (10Paladox) [21:54:43] 10Gerrit, 06Release-Engineering-Team, 06Operations: Gerrit Index inconsistent - https://phabricator.wikimedia.org/T161966#3148622 (10Paladox) 05Open>03declined It seems gerrit has supper powers and managed to figure out a merge conflict just as a change was being merged.