[11:06:52] 10MediaWiki-Codesniffer: Position of boolean operators inside an if condition - https://phabricator.wikimedia.org/T116561#2150682 (10Aashaka) a:3Aashaka [11:41:57] (03PS2) 10Paladox: [parsoidsvc] Update npm tests [integration/config] - 10https://gerrit.wikimedia.org/r/279529 [12:09:05] RECOVERY - Puppet run on deployment-conftool is OK: OK: Less than 1.00% above the threshold [0.0] [12:40:09] (03PS21) 10Zfilipin: WIP Simplify creating of Jenkins jobs for running browser tests daily [integration/config] - 10https://gerrit.wikimedia.org/r/274136 (https://phabricator.wikimedia.org/T128190) [12:42:36] (03PS22) 10Zfilipin: WIP Simplify creating of Jenkins jobs for running browser tests daily [integration/config] - 10https://gerrit.wikimedia.org/r/274136 (https://phabricator.wikimedia.org/T128190) [12:45:34] Project selenium-MultimediaViewer » beta-windows_8_1-internet_explorer_11,contintLabsSlave && UbuntuTrusty build #1: 04FAILURE in 14 sec: https://integration.wikimedia.org/ci/job/selenium-MultimediaViewer/MEDIAWIKI_ENVIRONMENT=beta-windows_8_1-internet_explorer_11,label=contintLabsSlave%20&&%20UbuntuTrusty/1/ [12:45:35] Project selenium-MultimediaViewer » mediawiki,contintLabsSlave && UbuntuTrusty build #1: 04FAILURE in 15 sec: https://integration.wikimedia.org/ci/job/selenium-MultimediaViewer/MEDIAWIKI_ENVIRONMENT=mediawiki,label=contintLabsSlave%20&&%20UbuntuTrusty/1/ [12:45:36] Project selenium-MultimediaViewer » beta-windows_8-internet_explorer_10,contintLabsSlave && UbuntuTrusty build #1: 04FAILURE in 16 sec: https://integration.wikimedia.org/ci/job/selenium-MultimediaViewer/MEDIAWIKI_ENVIRONMENT=beta-windows_8-internet_explorer_10,label=contintLabsSlave%20&&%20UbuntuTrusty/1/ [12:45:37] Project selenium-MultimediaViewer » beta-mac-chrome,contintLabsSlave && UbuntuTrusty build #1: 04FAILURE in 16 sec: https://integration.wikimedia.org/ci/job/selenium-MultimediaViewer/MEDIAWIKI_ENVIRONMENT=beta-mac-chrome,label=contintLabsSlave%20&&%20UbuntuTrusty/1/ [12:45:38] Project selenium-MultimediaViewer » beta-windows_7-internet_explorer_9,contintLabsSlave && UbuntuTrusty build #1: 04FAILURE in 18 sec: https://integration.wikimedia.org/ci/job/selenium-MultimediaViewer/MEDIAWIKI_ENVIRONMENT=beta-windows_7-internet_explorer_9,label=contintLabsSlave%20&&%20UbuntuTrusty/1/ [12:45:39] Project selenium-MultimediaViewer » beta-mac-safari,contintLabsSlave && UbuntuTrusty build #1: 04FAILURE in 18 sec: https://integration.wikimedia.org/ci/job/selenium-MultimediaViewer/MEDIAWIKI_ENVIRONMENT=beta-mac-safari,label=contintLabsSlave%20&&%20UbuntuTrusty/1/ [12:45:41] Project selenium-MultimediaViewer » beta-linux-firefox,contintLabsSlave && UbuntuTrusty build #1: 04FAILURE in 20 sec: https://integration.wikimedia.org/ci/job/selenium-MultimediaViewer/MEDIAWIKI_ENVIRONMENT=beta-linux-firefox,label=contintLabsSlave%20&&%20UbuntuTrusty/1/ [12:45:45] Project selenium-MultimediaViewer » beta-windows_7-internet_explorer_11,contintLabsSlave && UbuntuTrusty build #1: 04FAILURE in 25 sec: https://integration.wikimedia.org/ci/job/selenium-MultimediaViewer/MEDIAWIKI_ENVIRONMENT=beta-windows_7-internet_explorer_11,label=contintLabsSlave%20&&%20UbuntuTrusty/1/ [12:53:07] PROBLEM - App Server bits response on deployment-mediawiki02 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:57:13] (03PS23) 10Zfilipin: WIP Simplify creating of Jenkins jobs for running browser tests daily [integration/config] - 10https://gerrit.wikimedia.org/r/274136 (https://phabricator.wikimedia.org/T128190) [12:59:34] Project selenium-PageTriage » beta,contintLabsSlave && UbuntuTrusty build #1: 09SUCCESS in 1 min 5 sec: https://integration.wikimedia.org/ci/job/selenium-PageTriage/MEDIAWIKI_ENVIRONMENT=beta,label=contintLabsSlave%20&&%20UbuntuTrusty/1/ [13:02:33] Project selenium-PageTriage » chrome,beta,contintLabsSlave && UbuntuTrusty build #2: 09SUCCESS in 1 min 0 sec: https://integration.wikimedia.org/ci/job/selenium-PageTriage/BROWSER=chrome,MEDIAWIKI_ENVIRONMENT=beta,label=contintLabsSlave%20&&%20UbuntuTrusty/2/ [13:02:42] Project selenium-PageTriage » firefox,beta,contintLabsSlave && UbuntuTrusty build #2: 09SUCCESS in 1 min 10 sec: https://integration.wikimedia.org/ci/job/selenium-PageTriage/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,label=contintLabsSlave%20&&%20UbuntuTrusty/2/ [13:04:09] (03PS24) 10Zfilipin: WIP Simplify creating of Jenkins jobs for running browser tests daily [integration/config] - 10https://gerrit.wikimedia.org/r/274136 (https://phabricator.wikimedia.org/T128190) [13:10:27] (03PS25) 10Zfilipin: WIP Simplify creating of Jenkins jobs for running browser tests daily [integration/config] - 10https://gerrit.wikimedia.org/r/274136 (https://phabricator.wikimedia.org/T128190) [13:11:55] Project selenium-PdfHandler » firefox,beta,contintLabsSlave && UbuntuTrusty build #1: 04FAILURE in 10 sec: https://integration.wikimedia.org/ci/job/selenium-PdfHandler/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,label=contintLabsSlave%20&&%20UbuntuTrusty/1/ [13:14:23] Project selenium-PdfHandler » firefox,test,contintLabsSlave && UbuntuTrusty build #2: 09SUCCESS in 36 sec: https://integration.wikimedia.org/ci/job/selenium-PdfHandler/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=test,label=contintLabsSlave%20&&%20UbuntuTrusty/2/ [13:18:40] (03PS26) 10Zfilipin: WIP Simplify creating of Jenkins jobs for running browser tests daily [integration/config] - 10https://gerrit.wikimedia.org/r/274136 (https://phabricator.wikimedia.org/T128190) [13:19:58] Project selenium-QuickSurveys » chrome,beta,contintLabsSlave && UbuntuTrusty build #1: 04FAILURE in 25 sec: https://integration.wikimedia.org/ci/job/selenium-QuickSurveys/BROWSER=chrome,MEDIAWIKI_ENVIRONMENT=beta,label=contintLabsSlave%20&&%20UbuntuTrusty/1/ [13:26:00] (03PS27) 10Zfilipin: WIP Simplify creating of Jenkins jobs for running browser tests daily [integration/config] - 10https://gerrit.wikimedia.org/r/274136 (https://phabricator.wikimedia.org/T128190) [13:27:17] Project selenium-RelatedArticles » chrome,beta-desktop,contintLabsSlave && UbuntuTrusty build #1: 04FAILURE in 14 sec: https://integration.wikimedia.org/ci/job/selenium-RelatedArticles/BROWSER=chrome,MEDIAWIKI_ENVIRONMENT=beta-desktop,label=contintLabsSlave%20&&%20UbuntuTrusty/1/ [13:27:17] Project selenium-RelatedArticles » chrome,beta-mobile,contintLabsSlave && UbuntuTrusty build #1: 04FAILURE in 14 sec: https://integration.wikimedia.org/ci/job/selenium-RelatedArticles/BROWSER=chrome,MEDIAWIKI_ENVIRONMENT=beta-mobile,label=contintLabsSlave%20&&%20UbuntuTrusty/1/ [13:32:34] (03PS28) 10Zfilipin: WIP Simplify creating of Jenkins jobs for running browser tests daily [integration/config] - 10https://gerrit.wikimedia.org/r/274136 (https://phabricator.wikimedia.org/T128190) [13:35:22] Project selenium-WikiLove » firefox,beta,contintLabsSlave && UbuntuTrusty build #1: 09SUCCESS in 1 min 49 sec: https://integration.wikimedia.org/ci/job/selenium-WikiLove/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,label=contintLabsSlave%20&&%20UbuntuTrusty/1/ [13:38:43] Project selenium-CentralAuth » firefox,beta,contintLabsSlave && UbuntuTrusty build #5: 09SUCCESS in 1 min 50 sec: https://integration.wikimedia.org/ci/job/selenium-CentralAuth/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,label=contintLabsSlave%20&&%20UbuntuTrusty/5/ [14:25:09] Project selenium-MultimediaViewer » safari,mediawiki,Windows 8.1,10.0,contintLabsSlave && UbuntuTrusty build #3: 04FAILURE in 2 min 44 sec: https://integration.wikimedia.org/ci/job/selenium-MultimediaViewer/BROWSER=safari,MEDIAWIKI_ENVIRONMENT=mediawiki,PLATFORM=Windows%208.1,VERSION=10.0,label=contintLabsSlave%20&&%20UbuntuTrusty/3/ [14:25:10] Project selenium-MultimediaViewer » firefox,mediawiki,Windows 7,9.0,contintLabsSlave && UbuntuTrusty build #3: 04FAILURE in 2 min 45 sec: https://integration.wikimedia.org/ci/job/selenium-MultimediaViewer/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=mediawiki,PLATFORM=Windows%207,VERSION=9.0,label=contintLabsSlave%20&&%20UbuntuTrusty/3/ [14:25:11] Project selenium-MultimediaViewer » safari,mediawiki,Windows 8.1,9.0,contintLabsSlave && UbuntuTrusty build #3: 04FAILURE in 2 min 45 sec: https://integration.wikimedia.org/ci/job/selenium-MultimediaViewer/BROWSER=safari,MEDIAWIKI_ENVIRONMENT=mediawiki,PLATFORM=Windows%208.1,VERSION=9.0,label=contintLabsSlave%20&&%20UbuntuTrusty/3/ [14:25:11] Project selenium-MultimediaViewer » firefox,mediawiki,OS X 10.9,11.0,contintLabsSlave && UbuntuTrusty build #3: 04FAILURE in 2 min 46 sec: https://integration.wikimedia.org/ci/job/selenium-MultimediaViewer/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=mediawiki,PLATFORM=OS%20X%2010.9,VERSION=11.0,label=contintLabsSlave%20&&%20UbuntuTrusty/3/ [14:25:12] Project selenium-MultimediaViewer » safari,mediawiki,Windows 8.1,11.0,contintLabsSlave && UbuntuTrusty build #3: 04FAILURE in 2 min 46 sec: https://integration.wikimedia.org/ci/job/selenium-MultimediaViewer/BROWSER=safari,MEDIAWIKI_ENVIRONMENT=mediawiki,PLATFORM=Windows%208.1,VERSION=11.0,label=contintLabsSlave%20&&%20UbuntuTrusty/3/ [14:25:12] Project selenium-MultimediaViewer » internet_explorer,beta,Linux,11.0,contintLabsSlave && UbuntuTrusty build #3: 04FAILURE in 2 min 46 sec: https://integration.wikimedia.org/ci/job/selenium-MultimediaViewer/BROWSER=internet_explorer,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,VERSION=11.0,label=contintLabsSlave%20&&%20UbuntuTrusty/3/ [14:25:13] Project selenium-MultimediaViewer » internet_explorer,mediawiki,Windows 7,11.0,contintLabsSlave && UbuntuTrusty build #3: 04FAILURE in 2 min 46 sec: https://integration.wikimedia.org/ci/job/selenium-MultimediaViewer/BROWSER=internet_explorer,MEDIAWIKI_ENVIRONMENT=mediawiki,PLATFORM=Windows%207,VERSION=11.0,label=contintLabsSlave%20&&%20UbuntuTrusty/3/ [14:25:13] Project selenium-MultimediaViewer » internet_explorer,mediawiki,Windows 8.1,11.0,contintLabsSlave && UbuntuTrusty build #3: 04FAILURE in 2 min 47 sec: https://integration.wikimedia.org/ci/job/selenium-MultimediaViewer/BROWSER=internet_explorer,MEDIAWIKI_ENVIRONMENT=mediawiki,PLATFORM=Windows%208.1,VERSION=11.0,label=contintLabsSlave%20&&%20UbuntuTrusty/3/ [14:25:14] Project selenium-MultimediaViewer » chrome,mediawiki,Windows 8,,contintLabsSlave && UbuntuTrusty build #3: 04FAILURE in 2 min 47 sec: https://integration.wikimedia.org/ci/job/selenium-MultimediaViewer/BROWSER=chrome,MEDIAWIKI_ENVIRONMENT=mediawiki,PLATFORM=Windows%208,VERSION=,label=contintLabsSlave%20&&%20UbuntuTrusty/3/ [14:25:14] Project selenium-MultimediaViewer » internet_explorer,mediawiki,Windows 8,,contintLabsSlave && UbuntuTrusty build #3: 04FAILURE in 2 min 47 sec: https://integration.wikimedia.org/ci/job/selenium-MultimediaViewer/BROWSER=internet_explorer,MEDIAWIKI_ENVIRONMENT=mediawiki,PLATFORM=Windows%208,VERSION=,label=contintLabsSlave%20&&%20UbuntuTrusty/3/ [14:25:15] Project selenium-MultimediaViewer » internet_explorer,mediawiki,Windows 8,10.0,contintLabsSlave && UbuntuTrusty build #3: 04FAILURE in 2 min 48 sec: https://integration.wikimedia.org/ci/job/selenium-MultimediaViewer/BROWSER=internet_explorer,MEDIAWIKI_ENVIRONMENT=mediawiki,PLATFORM=Windows%208,VERSION=10.0,label=contintLabsSlave%20&&%20UbuntuTrusty/3/ [14:25:15] Project selenium-MultimediaViewer » chrome,mediawiki,Linux,,contintLabsSlave && UbuntuTrusty build #3: 04FAILURE in 2 min 48 sec: https://integration.wikimedia.org/ci/job/selenium-MultimediaViewer/BROWSER=chrome,MEDIAWIKI_ENVIRONMENT=mediawiki,PLATFORM=Linux,VERSION=,label=contintLabsSlave%20&&%20UbuntuTrusty/3/ [14:25:16] Project selenium-MultimediaViewer » safari,mediawiki,Windows 8.1,,contintLabsSlave && UbuntuTrusty build #3: 04FAILURE in 2 min 49 sec: https://integration.wikimedia.org/ci/job/selenium-MultimediaViewer/BROWSER=safari,MEDIAWIKI_ENVIRONMENT=mediawiki,PLATFORM=Windows%208.1,VERSION=,label=contintLabsSlave%20&&%20UbuntuTrusty/3/ [14:25:16] Project selenium-MultimediaViewer » chrome,mediawiki,Windows 8.1,9.0,contintLabsSlave && UbuntuTrusty build #3: 04FAILURE in 2 min 49 sec: https://integration.wikimedia.org/ci/job/selenium-MultimediaViewer/BROWSER=chrome,MEDIAWIKI_ENVIRONMENT=mediawiki,PLATFORM=Windows%208.1,VERSION=9.0,label=contintLabsSlave%20&&%20UbuntuTrusty/3/ [14:25:17] Project selenium-MultimediaViewer » internet_explorer,beta,Windows 8,10.0,contintLabsSlave && UbuntuTrusty build #3: 04FAILURE in 2 min 49 sec: https://integration.wikimedia.org/ci/job/selenium-MultimediaViewer/BROWSER=internet_explorer,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Windows%208,VERSION=10.0,label=contintLabsSlave%20&&%20UbuntuTrusty/3/ [14:25:17] Project selenium-MultimediaViewer » chrome,beta,Linux,10.0,contintLabsSlave && UbuntuTrusty build #3: 04FAILURE in 2 min 49 sec: https://integration.wikimedia.org/ci/job/selenium-MultimediaViewer/BROWSER=chrome,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,VERSION=10.0,label=contintLabsSlave%20&&%20UbuntuTrusty/3/ [14:25:18] Project selenium-MultimediaViewer » internet_explorer,mediawiki,Windows 8.1,9.0,contintLabsSlave && UbuntuTrusty build #3: 04FAILURE in 2 min 50 sec: https://integration.wikimedia.org/ci/job/selenium-MultimediaViewer/BROWSER=internet_explorer,MEDIAWIKI_ENVIRONMENT=mediawiki,PLATFORM=Windows%208.1,VERSION=9.0,label=contintLabsSlave%20&&%20UbuntuTrusty/3/ [14:25:18] Project selenium-MultimediaViewer » firefox,beta,Linux,9.0,contintLabsSlave && UbuntuTrusty build #3: 04FAILURE in 2 min 51 sec: https://integration.wikimedia.org/ci/job/selenium-MultimediaViewer/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,VERSION=9.0,label=contintLabsSlave%20&&%20UbuntuTrusty/3/ [14:25:19] Project selenium-MultimediaViewer » firefox,mediawiki,Windows 8,11.0,contintLabsSlave && UbuntuTrusty build #3: 04FAILURE in 2 min 51 sec: https://integration.wikimedia.org/ci/job/selenium-MultimediaViewer/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=mediawiki,PLATFORM=Windows%208,VERSION=11.0,label=contintLabsSlave%20&&%20UbuntuTrusty/3/ [14:25:20] Project selenium-MultimediaViewer » firefox,beta,Windows 8,9.0,contintLabsSlave && UbuntuTrusty build #3: 04FAILURE in 2 min 51 sec: https://integration.wikimedia.org/ci/job/selenium-MultimediaViewer/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Windows%208,VERSION=9.0,label=contintLabsSlave%20&&%20UbuntuTrusty/3/ [14:25:31] Project selenium-MultimediaViewer » firefox,beta,Windows 7,9.0,contintLabsSlave && UbuntuTrusty build #3: 04FAILURE in 3 min 0 sec: https://integration.wikimedia.org/ci/job/selenium-MultimediaViewer/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Windows%207,VERSION=9.0,label=contintLabsSlave%20&&%20UbuntuTrusty/3/ [14:25:32] Project selenium-MultimediaViewer » firefox,mediawiki,Linux,11.0,contintLabsSlave && UbuntuTrusty build #3: 04FAILURE in 3 min 0 sec: https://integration.wikimedia.org/ci/job/selenium-MultimediaViewer/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=mediawiki,PLATFORM=Linux,VERSION=11.0,label=contintLabsSlave%20&&%20UbuntuTrusty/3/ [14:25:33] Project selenium-MultimediaViewer » internet_explorer,beta,Windows 7,11.0,contintLabsSlave && UbuntuTrusty build #3: 04FAILURE in 3 min 0 sec: https://integration.wikimedia.org/ci/job/selenium-MultimediaViewer/BROWSER=internet_explorer,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Windows%207,VERSION=11.0,label=contintLabsSlave%20&&%20UbuntuTrusty/3/ [14:25:33] Project selenium-MultimediaViewer » safari,beta,Linux,11.0,contintLabsSlave && UbuntuTrusty build #3: 04FAILURE in 3 min 0 sec: https://integration.wikimedia.org/ci/job/selenium-MultimediaViewer/BROWSER=safari,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,VERSION=11.0,label=contintLabsSlave%20&&%20UbuntuTrusty/3/ [14:25:34] Project selenium-MultimediaViewer » chrome,mediawiki,Windows 8,9.0,contintLabsSlave && UbuntuTrusty build #3: 04FAILURE in 3 min 0 sec: https://integration.wikimedia.org/ci/job/selenium-MultimediaViewer/BROWSER=chrome,MEDIAWIKI_ENVIRONMENT=mediawiki,PLATFORM=Windows%208,VERSION=9.0,label=contintLabsSlave%20&&%20UbuntuTrusty/3/ [14:25:34] Project selenium-MultimediaViewer » safari,beta,Windows 7,,contintLabsSlave && UbuntuTrusty build #3: 04FAILURE in 3 min 1 sec: https://integration.wikimedia.org/ci/job/selenium-MultimediaViewer/BROWSER=safari,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Windows%207,VERSION=,label=contintLabsSlave%20&&%20UbuntuTrusty/3/ [14:25:35] Project selenium-MultimediaViewer » chrome,beta,Windows 7,9.0,contintLabsSlave && UbuntuTrusty build #3: 04FAILURE in 3 min 1 sec: https://integration.wikimedia.org/ci/job/selenium-MultimediaViewer/BROWSER=chrome,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Windows%207,VERSION=9.0,label=contintLabsSlave%20&&%20UbuntuTrusty/3/ [14:25:35] Project selenium-MultimediaViewer » internet_explorer,beta,OS X 10.9,9.0,contintLabsSlave && UbuntuTrusty build #3: 04FAILURE in 3 min 2 sec: https://integration.wikimedia.org/ci/job/selenium-MultimediaViewer/BROWSER=internet_explorer,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=OS%20X%2010.9,VERSION=9.0,label=contintLabsSlave%20&&%20UbuntuTrusty/3/ [14:25:36] Project selenium-MultimediaViewer » internet_explorer,beta,Windows 7,9.0,contintLabsSlave && UbuntuTrusty build #3: 04FAILURE in 3 min 2 sec: https://integration.wikimedia.org/ci/job/selenium-MultimediaViewer/BROWSER=internet_explorer,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Windows%207,VERSION=9.0,label=contintLabsSlave%20&&%20UbuntuTrusty/3/ [14:25:36] Project selenium-MultimediaViewer » safari,mediawiki,Linux,11.0,contintLabsSlave && UbuntuTrusty build #3: 04FAILURE in 3 min 2 sec: https://integration.wikimedia.org/ci/job/selenium-MultimediaViewer/BROWSER=safari,MEDIAWIKI_ENVIRONMENT=mediawiki,PLATFORM=Linux,VERSION=11.0,label=contintLabsSlave%20&&%20UbuntuTrusty/3/ [14:25:37] Project selenium-MultimediaViewer » internet_explorer,beta,Windows 8.1,,contintLabsSlave && UbuntuTrusty build #3: 04FAILURE in 3 min 2 sec: https://integration.wikimedia.org/ci/job/selenium-MultimediaViewer/BROWSER=internet_explorer,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Windows%208.1,VERSION=,label=contintLabsSlave%20&&%20UbuntuTrusty/3/ [14:25:37] Project selenium-MultimediaViewer » safari,beta,OS X 10.9,9.0,contintLabsSlave && UbuntuTrusty build #3: 04FAILURE in 3 min 3 sec: https://integration.wikimedia.org/ci/job/selenium-MultimediaViewer/BROWSER=safari,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=OS%20X%2010.9,VERSION=9.0,label=contintLabsSlave%20&&%20UbuntuTrusty/3/ [14:25:38] Project selenium-MultimediaViewer » safari,beta,Linux,9.0,contintLabsSlave && UbuntuTrusty build #3: 04FAILURE in 3 min 3 sec: https://integration.wikimedia.org/ci/job/selenium-MultimediaViewer/BROWSER=safari,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,VERSION=9.0,label=contintLabsSlave%20&&%20UbuntuTrusty/3/ [14:25:38] Project selenium-MultimediaViewer » chrome,beta,Windows 8,11.0,contintLabsSlave && UbuntuTrusty build #3: 04FAILURE in 3 min 3 sec: https://integration.wikimedia.org/ci/job/selenium-MultimediaViewer/BROWSER=chrome,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Windows%208,VERSION=11.0,label=contintLabsSlave%20&&%20UbuntuTrusty/3/ [14:25:39] Project selenium-MultimediaViewer » chrome,beta,Linux,9.0,contintLabsSlave && UbuntuTrusty build #3: 04FAILURE in 3 min 4 sec: https://integration.wikimedia.org/ci/job/selenium-MultimediaViewer/BROWSER=chrome,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,VERSION=9.0,label=contintLabsSlave%20&&%20UbuntuTrusty/3/ [14:25:40] Project selenium-MultimediaViewer » chrome,mediawiki,Windows 7,11.0,contintLabsSlave && UbuntuTrusty build #3: 04FAILURE in 3 min 4 sec: https://integration.wikimedia.org/ci/job/selenium-MultimediaViewer/BROWSER=chrome,MEDIAWIKI_ENVIRONMENT=mediawiki,PLATFORM=Windows%207,VERSION=11.0,label=contintLabsSlave%20&&%20UbuntuTrusty/3/ [14:25:40] Project selenium-MultimediaViewer » chrome,mediawiki,Windows 7,,contintLabsSlave && UbuntuTrusty build #3: 04FAILURE in 3 min 4 sec: https://integration.wikimedia.org/ci/job/selenium-MultimediaViewer/BROWSER=chrome,MEDIAWIKI_ENVIRONMENT=mediawiki,PLATFORM=Windows%207,VERSION=,label=contintLabsSlave%20&&%20UbuntuTrusty/3/ [14:25:40] Project selenium-MultimediaViewer » internet_explorer,mediawiki,Windows 7,,contintLabsSlave && UbuntuTrusty build #3: 04FAILURE in 3 min 4 sec: https://integration.wikimedia.org/ci/job/selenium-MultimediaViewer/BROWSER=internet_explorer,MEDIAWIKI_ENVIRONMENT=mediawiki,PLATFORM=Windows%207,VERSION=,label=contintLabsSlave%20&&%20UbuntuTrusty/3/ [14:25:41] Project selenium-MultimediaViewer » safari,mediawiki,OS X 10.9,,contintLabsSlave && UbuntuTrusty build #3: 04FAILURE in 3 min 5 sec: https://integration.wikimedia.org/ci/job/selenium-MultimediaViewer/BROWSER=safari,MEDIAWIKI_ENVIRONMENT=mediawiki,PLATFORM=OS%20X%2010.9,VERSION=,label=contintLabsSlave%20&&%20UbuntuTrusty/3/ [14:25:41] Project selenium-MultimediaViewer » safari,mediawiki,Linux,,contintLabsSlave && UbuntuTrusty build #3: 04FAILURE in 3 min 6 sec: https://integration.wikimedia.org/ci/job/selenium-MultimediaViewer/BROWSER=safari,MEDIAWIKI_ENVIRONMENT=mediawiki,PLATFORM=Linux,VERSION=,label=contintLabsSlave%20&&%20UbuntuTrusty/3/ [14:25:53] Project selenium-MultimediaViewer » safari,beta,Windows 8,10.0,contintLabsSlave && UbuntuTrusty build #3: 04FAILURE in 3 min 12 sec: https://integration.wikimedia.org/ci/job/selenium-MultimediaViewer/BROWSER=safari,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Windows%208,VERSION=10.0,label=contintLabsSlave%20&&%20UbuntuTrusty/3/ [14:25:53] Project selenium-MultimediaViewer » internet_explorer,mediawiki,Windows 8,9.0,contintLabsSlave && UbuntuTrusty build #3: 04FAILURE in 3 min 13 sec: https://integration.wikimedia.org/ci/job/selenium-MultimediaViewer/BROWSER=internet_explorer,MEDIAWIKI_ENVIRONMENT=mediawiki,PLATFORM=Windows%208,VERSION=9.0,label=contintLabsSlave%20&&%20UbuntuTrusty/3/ [14:25:54] Project selenium-MultimediaViewer » firefox,mediawiki,OS X 10.9,9.0,contintLabsSlave && UbuntuTrusty build #3: 04FAILURE in 3 min 13 sec: https://integration.wikimedia.org/ci/job/selenium-MultimediaViewer/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=mediawiki,PLATFORM=OS%20X%2010.9,VERSION=9.0,label=contintLabsSlave%20&&%20UbuntuTrusty/3/ [14:25:54] Project selenium-MultimediaViewer » safari,mediawiki,Windows 7,11.0,contintLabsSlave && UbuntuTrusty build #3: 04FAILURE in 3 min 15 sec: https://integration.wikimedia.org/ci/job/selenium-MultimediaViewer/BROWSER=safari,MEDIAWIKI_ENVIRONMENT=mediawiki,PLATFORM=Windows%207,VERSION=11.0,label=contintLabsSlave%20&&%20UbuntuTrusty/3/ [14:25:55] Project selenium-MultimediaViewer » internet_explorer,beta,Windows 7,,contintLabsSlave && UbuntuTrusty build #3: 04FAILURE in 3 min 15 sec: https://integration.wikimedia.org/ci/job/selenium-MultimediaViewer/BROWSER=internet_explorer,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Windows%207,VERSION=,label=contintLabsSlave%20&&%20UbuntuTrusty/3/ [14:25:55] Project selenium-MultimediaViewer » chrome,mediawiki,OS X 10.9,9.0,contintLabsSlave && UbuntuTrusty build #3: 04FAILURE in 3 min 15 sec: https://integration.wikimedia.org/ci/job/selenium-MultimediaViewer/BROWSER=chrome,MEDIAWIKI_ENVIRONMENT=mediawiki,PLATFORM=OS%20X%2010.9,VERSION=9.0,label=contintLabsSlave%20&&%20UbuntuTrusty/3/ [14:25:57] Project selenium-MultimediaViewer » firefox,beta,Linux,10.0,contintLabsSlave && UbuntuTrusty build #3: 04FAILURE in 3 min 16 sec: https://integration.wikimedia.org/ci/job/selenium-MultimediaViewer/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,VERSION=10.0,label=contintLabsSlave%20&&%20UbuntuTrusty/3/ [14:25:57] Project selenium-MultimediaViewer » safari,mediawiki,OS X 10.9,11.0,contintLabsSlave && UbuntuTrusty build #3: 04FAILURE in 3 min 16 sec: https://integration.wikimedia.org/ci/job/selenium-MultimediaViewer/BROWSER=safari,MEDIAWIKI_ENVIRONMENT=mediawiki,PLATFORM=OS%20X%2010.9,VERSION=11.0,label=contintLabsSlave%20&&%20UbuntuTrusty/3/ [14:25:57] Project selenium-MultimediaViewer » chrome,beta,Windows 7,10.0,contintLabsSlave && UbuntuTrusty build #3: 04FAILURE in 3 min 16 sec: https://integration.wikimedia.org/ci/job/selenium-MultimediaViewer/BROWSER=chrome,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Windows%207,VERSION=10.0,label=contintLabsSlave%20&&%20UbuntuTrusty/3/ [14:25:57] Project selenium-MultimediaViewer » safari,beta,OS X 10.9,,contintLabsSlave && UbuntuTrusty build #3: 04FAILURE in 3 min 17 sec: https://integration.wikimedia.org/ci/job/selenium-MultimediaViewer/BROWSER=safari,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=OS%20X%2010.9,VERSION=,label=contintLabsSlave%20&&%20UbuntuTrusty/3/ [14:25:58] Project selenium-MultimediaViewer » internet_explorer,mediawiki,Windows 8,11.0,contintLabsSlave && UbuntuTrusty build #3: 04FAILURE in 3 min 17 sec: https://integration.wikimedia.org/ci/job/selenium-MultimediaViewer/BROWSER=internet_explorer,MEDIAWIKI_ENVIRONMENT=mediawiki,PLATFORM=Windows%208,VERSION=11.0,label=contintLabsSlave%20&&%20UbuntuTrusty/3/ [14:25:59] Project selenium-MultimediaViewer » safari,mediawiki,Windows 8,10.0,contintLabsSlave && UbuntuTrusty build #3: 04FAILURE in 3 min 17 sec: https://integration.wikimedia.org/ci/job/selenium-MultimediaViewer/BROWSER=safari,MEDIAWIKI_ENVIRONMENT=mediawiki,PLATFORM=Windows%208,VERSION=10.0,label=contintLabsSlave%20&&%20UbuntuTrusty/3/ [14:26:00] Project selenium-MultimediaViewer » firefox,mediawiki,Windows 8.1,10.0,contintLabsSlave && UbuntuTrusty build #3: 04FAILURE in 3 min 18 sec: https://integration.wikimedia.org/ci/job/selenium-MultimediaViewer/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=mediawiki,PLATFORM=Windows%208.1,VERSION=10.0,label=contintLabsSlave%20&&%20UbuntuTrusty/3/ [14:26:00] Project selenium-MultimediaViewer » chrome,mediawiki,Windows 8,10.0,contintLabsSlave && UbuntuTrusty build #3: 04FAILURE in 3 min 18 sec: https://integration.wikimedia.org/ci/job/selenium-MultimediaViewer/BROWSER=chrome,MEDIAWIKI_ENVIRONMENT=mediawiki,PLATFORM=Windows%208,VERSION=10.0,label=contintLabsSlave%20&&%20UbuntuTrusty/3/ [14:26:02] Project selenium-MultimediaViewer » firefox,mediawiki,OS X 10.9,,contintLabsSlave && UbuntuTrusty build #3: 04FAILURE in 3 min 19 sec: https://integration.wikimedia.org/ci/job/selenium-MultimediaViewer/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=mediawiki,PLATFORM=OS%20X%2010.9,VERSION=,label=contintLabsSlave%20&&%20UbuntuTrusty/3/ [14:33:08] PROBLEM - App Server bits response on deployment-mediawiki02 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:33:16] Project selenium-WikiLove » firefox,beta,contintLabsSlave && UbuntuTrusty build #2: 04FAILURE in 1 min 16 sec: https://integration.wikimedia.org/ci/job/selenium-WikiLove/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,label=contintLabsSlave%20&&%20UbuntuTrusty/2/ [15:01:19] (03PS29) 10Zfilipin: WIP Simplify creating of Jenkins jobs for running browser tests daily [integration/config] - 10https://gerrit.wikimedia.org/r/274136 (https://phabricator.wikimedia.org/T128190) [15:06:12] 10Continuous-Integration-Infrastructure, 6Release-Engineering-Team: doc.wikimedia.org should be running PHP 5.5+, not 5.3 -> demos etc. don't work - https://phabricator.wikimedia.org/T127504#2151161 (10Paladox) Should project operations be added. [15:09:17] zeljkof: whoa, what happened to the browser tests ^^^ [15:10:51] greg-g: I am moving jobs from old browsertests-* to new selenium-* template [15:10:53] https://integration.wikimedia.org/ci/view/selenium/ [15:11:08] ah [15:11:08] so things are failing here and there [15:11:21] but this is the winner :) https://integration.wikimedia.org/ci/view/selenium/job/selenium-MultimediaViewer/ [15:11:54] working on excluding unneeded jobs from the table https://gerrit.wikimedia.org/r/#/c/279601/3/tests/browser/ci.yml,cm [15:16:11] It seems that https://integration.wikimedia.org/ci/computer/ci-jessie-wikimedia-61518/ and https://integration.wikimedia.org/ci/computer/ci-jessie-wikimedia-61638/ are offline One of them because Jenkins failed to launch the slave agent on it and the other because of Gearman [15:16:21] legoktm jzerebecki Krinkle ^^ [15:16:39] zeljkof: hah, gotcha [15:18:23] zeljkof: Hi could windows 10 be added to the os at https://integration.wikimedia.org/ci/view/selenium/job/selenium-MultimediaViewer/ [15:18:25] please [15:18:49] paladox: sure [15:18:57] just to make the job green first :) [15:19:08] zeljkof: Ok and thanks [15:19:19] you can add it yourself here https://gerrit.wikimedia.org/r/#/c/279601/3/tests/browser/ci.yml,cm [15:19:22] (03PS1) 10Aashaka: Add sniff to check if boolean operator on same line inside 'if condition' [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/279615 (https://phabricator.wikimedia.org/T116561) [15:19:33] but please wait until the job is green [15:20:32] zeljkof: Thanks for the link and i will wait until it is green. [15:21:18] 10MediaWiki-Codesniffer, 13Patch-For-Review: Position of boolean operators inside an if condition - https://phabricator.wikimedia.org/T116561#2151186 (10Aashaka) @Legoktm : Please review :) [15:21:31] zeljkof: In the version is 10.0 for internet explorer or is that run for all the three browser [15:21:58] 10Beta-Cluster-Infrastructure, 10MediaWiki-User-login-and-signup, 10MediaWiki-extensions-CentralAuth, 7Beta-Cluster-reproducible: Getting logged out frequently in Beta Cluster - https://phabricator.wikimedia.org/T130896#2151187 (10greg) @Tgr @Anomie: This was filed in centralauth/login projects. Can you he... [15:22:02] paladox: yes :) [15:22:12] all browsers for now [15:22:20] working on better exclude section [15:22:31] zeljkof: Ok, thanks for explaning. [15:26:10] zeljkof: Do you know why they are failing here https://integration.wikimedia.org/ci/view/selenium/job/selenium-MultimediaViewer/ since i carn't find any where, where it shows why it is not working [15:27:05] paladox: the jobs are failing because I am moving them to new selenium-* template from old browsertests-* template [15:27:11] still work in progress [15:27:32] new: https://integration.wikimedia.org/ci/view/selenium/ [15:27:53] old: https://integration.wikimedia.org/ci/view/BrowserTests/view/-Dashboard/ [15:28:01] task: https://phabricator.wikimedia.org/T128190 [15:28:04] zeljkof: Oh, is there a template we can add as experimental [15:28:06] thanks [15:28:25] paladox: did not understand you [15:28:48] I have a meeting with greg-g in a couple of minutes, so I might be slow to respond for the next 30 minutes or so [15:30:00] zeljkof: You said that we are moving to the new selenium test and replacing browsertests with it. Is there a template in integration/config we can use to test the new test with by adding it in experimental [15:30:15] paladox: I see [15:30:24] no, these tests are running daily, not triggered by gerrit [15:31:03] Oh ok [15:33:04] zeljkof: It passes math, could we do something like - beta-BROWSER (BROWSER should be replaced with the actual browser like chrome) [15:33:09] https://gerrit.wikimedia.org/r/#/c/273909/19/tests/browser/ci.yml [15:36:46] Yippee, build fixed! [15:36:47] Project browsertests-RelatedArticles-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce build #86: 09FIXED in 46 sec: https://integration.wikimedia.org/ci/job/browsertests-RelatedArticles-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce/86/ [15:39:42] PROBLEM - Host deployment-mediawiki01 is DOWN: PING CRITICAL - Packet loss = 100% [15:41:24] RECOVERY - Host deployment-mediawiki01 is UP: PING OK - Packet loss = 0%, RTA = 0.56 ms [15:46:25] PROBLEM - App Server bits response on deployment-mediawiki01 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:03:28] paladox: not sure I understood you again :) [16:03:44] 6Release-Engineering-Team: Blockers to deploying 1.27-wmf.11 - https://phabricator.wikimedia.org/T125143#2151239 (10matmarex) [16:04:10] zeljkof: It seems that math passes probaly because we doint include the os maybe we can do it to the other tests [16:08:52] paladox: well, math does not need a lot of browser/os/version combinations [16:08:55] some repos do [16:10:38] Oh ok, thanks for explaning [16:13:39] 10Beta-Cluster-Infrastructure, 10MediaWiki-User-login-and-signup, 10MediaWiki-extensions-CentralAuth, 7Beta-Cluster-reproducible: Getting logged out frequently in Beta Cluster - https://phabricator.wikimedia.org/T130896#2151309 (10greg) [16:13:41] 6Release-Engineering-Team: MW-1.27.0-wmf.19 deployment blockers - https://phabricator.wikimedia.org/T130227#2151308 (10greg) [16:13:58] 6Release-Engineering-Team: MW-1.27.0-wmf.19 deployment blockers - https://phabricator.wikimedia.org/T130227#2130361 (10greg) Marking as a blocker for now until it is diagnosed. [16:14:15] 10Beta-Cluster-Infrastructure, 10MediaWiki-User-login-and-signup, 10MediaWiki-extensions-CentralAuth, 7Beta-Cluster-reproducible: Getting logged out frequently in Beta Cluster - https://phabricator.wikimedia.org/T130896#2149955 (10greg) Marking as a blocker for wmf.19 for now until it is diagnosed. [16:18:12] 10Continuous-Integration-Infrastructure: mediawiki-core-qunit job failing often with the same error about "has-cors" Node module - https://phabricator.wikimedia.org/T130934#2151323 (10matmarex) [16:23:25] greg-g: Thanks for clarification at T130227, I was not sure. Generaly add such a task in doubt? [16:23:25] T130227: MW-1.27.0-wmf.19 deployment blockers - https://phabricator.wikimedia.org/T130227 [16:24:25] Luke081515: yeah, I can always remove it :) [16:24:31] ok :) [16:26:52] 10Continuous-Integration-Infrastructure: mediawiki-core-qunit job failing often with the same error about "has-cors" Node module - https://phabricator.wikimedia.org/T130934#2151355 (10matmarex) Same: https://gerrit.wikimedia.org/r/#/c/279524/ - https://integration.wikimedia.org/ci/job/mediawiki-core-qunit/61928/... [16:27:16] could somebody look into https://phabricator.wikimedia.org/T130934 ? perhaps it's just some cache that needs clearing, again [16:29:39] 'lo [16:29:42] 16:24:30 Warning: file_put_contents(): Only 0 of 9261 bytes written, possibly out of free disk space in /mnt/jenkins-workspace/workspace/mediawiki-extensions-php55/src/vendor/oyejorge/less.php/lib/Less/Parser.php on [16:29:45] https://integration.wikimedia.org/ci/job/mediawiki-extensions-php55/2121/console [16:29:59] on integration-slave-trusty-1002 [16:32:26] ori: https://tools.wmflabs.org/nagf/?project=integration#h_integration-slave-trusty-1002_memory [16:32:53] /tmp might be a different mountpoint [16:33:16] ori: Oh yes i think that is limited to 200-300 mb [16:33:50] I know it is in 200 but carn't rember the precise amout. Jessie on the other hand dosent have this limit and you can use as much. [16:34:18] nod [16:34:20] hmmm [16:34:51] ori: Im hitting this problem with npm [16:35:04] Project beta-scap-eqiad build #95281: 04FAILURE in 16 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/95281/ [16:35:37] ori: We need to switch qunit tests to jessie but because somethings that it needs aren't avalible like php and composer we carn't [16:35:56] I think we need to increase the limit to something like 300-400mb [16:35:59] ori ^^ [16:38:39] my ssh config is messed up and i can't ssh into the hosts [16:39:36] PROBLEM - Puppet run on deployment-restbase01 is CRITICAL: CRITICAL: 22.22% of data above the critical threshold [0.0] [16:40:50] Project selenium-CentralNotice » chrome,beta,Windows 7,,contintLabsSlave && UbuntuTrusty build #8: 09SUCCESS in 40 sec: https://integration.wikimedia.org/ci/job/selenium-CentralNotice/BROWSER=chrome,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Windows%207,VERSION=,label=contintLabsSlave%20&&%20UbuntuTrusty/8/ [16:40:53] Project selenium-CentralNotice » chrome,beta,Linux,,contintLabsSlave && UbuntuTrusty build #8: 09SUCCESS in 43 sec: https://integration.wikimedia.org/ci/job/selenium-CentralNotice/BROWSER=chrome,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,VERSION=,label=contintLabsSlave%20&&%20UbuntuTrusty/8/ [16:41:21] Project selenium-CentralNotice » chrome,beta,OS X 10.9,,contintLabsSlave && UbuntuTrusty build #8: 09SUCCESS in 1 min 11 sec: https://integration.wikimedia.org/ci/job/selenium-CentralNotice/BROWSER=chrome,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=OS%20X%2010.9,VERSION=,label=contintLabsSlave%20&&%20UbuntuTrusty/8/ [16:42:20] ori: it's probably not your ssh config. i'm unable to ssh to that host as well [16:42:25] looks to be a dns issue [16:42:57] (there's no answer for integration-slave-trusty-1002.eqiad.wmflabs from the labs dns [16:44:37] andrewbogott ^^ [16:44:57] thanks, paladox :) [16:45:07] Your welcome :) [16:45:07] I am not very interruptible right now, sorry [16:45:20] if we can't resolve the dns issue, let's just take that slave out of the pool [16:45:25] Project selenium-CentralNotice » firefox,beta,Linux,,contintLabsSlave && UbuntuTrusty build #9: 09SUCCESS in 52 sec: https://integration.wikimedia.org/ci/job/selenium-CentralNotice/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,VERSION=,label=contintLabsSlave%20&&%20UbuntuTrusty/9/ [16:45:32] Project selenium-CentralNotice » firefox,beta,Windows 7,,contintLabsSlave && UbuntuTrusty build #9: 09SUCCESS in 59 sec: https://integration.wikimedia.org/ci/job/selenium-CentralNotice/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Windows%207,VERSION=,label=contintLabsSlave%20&&%20UbuntuTrusty/9/ [16:46:05] Yippee, build fixed! [16:46:06] Project beta-scap-eqiad build #95282: 09FIXED in 1 min 16 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/95282/ [16:46:07] Project selenium-CentralNotice » firefox,beta,OS X 10.9,,contintLabsSlave && UbuntuTrusty build #9: 09SUCCESS in 1 min 34 sec: https://integration.wikimedia.org/ci/job/selenium-CentralNotice/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=OS%20X%2010.9,VERSION=,label=contintLabsSlave%20&&%20UbuntuTrusty/9/ [16:46:11] andrewbogott: no problem. i'll bug in -labs or depool the instance [16:46:44] marxarelli: Yeh [16:46:53] PROBLEM - Puppet run on deployment-mathoid is CRITICAL: CRITICAL: 60.00% of data above the critical threshold [0.0] [16:52:18] PROBLEM - Puppet run on deployment-cxserver03 is CRITICAL: CRITICAL: 33.33% of data above the critical threshold [0.0] [16:56:42] Project selenium-CentralAuth » firefox,beta,Linux,,contintLabsSlave && UbuntuTrusty build #9: 09SUCCESS in 1 min 56 sec: https://integration.wikimedia.org/ci/job/selenium-CentralAuth/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,VERSION=,label=contintLabsSlave%20&&%20UbuntuTrusty/9/ [16:59:29] !log depooling integration-slave-trusty-1002 until DNS resolution can be resolved. still investigating disk space issue [16:59:32] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master [17:01:07] Project selenium-CirrusSearch » firefox,beta,Linux,,contintLabsSlave && UbuntuTrusty build #3: 09SUCCESS in 50 sec: https://integration.wikimedia.org/ci/job/selenium-CirrusSearch/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,VERSION=,label=contintLabsSlave%20&&%20UbuntuTrusty/3/ [17:05:43] Project selenium-Core » firefox,beta,Linux,,contintLabsSlave && UbuntuTrusty build #3: 04FAILURE in 1 min 53 sec: https://integration.wikimedia.org/ci/job/selenium-Core/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,VERSION=,label=contintLabsSlave%20&&%20UbuntuTrusty/3/ [17:10:02] Project selenium-Echo » chrome,beta,Linux,,contintLabsSlave && UbuntuTrusty build #3: 04FAILURE in 2 min 54 sec: https://integration.wikimedia.org/ci/job/selenium-Echo/BROWSER=chrome,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,VERSION=,label=contintLabsSlave%20&&%20UbuntuTrusty/3/ [17:10:27] Project selenium-Echo » firefox,beta,Linux,,contintLabsSlave && UbuntuTrusty build #3: 04FAILURE in 3 min 18 sec: https://integration.wikimedia.org/ci/job/selenium-Echo/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,VERSION=,label=contintLabsSlave%20&&%20UbuntuTrusty/3/ [17:10:38] 10Continuous-Integration-Infrastructure, 6Labs, 10Labs-Infrastructure: Cannot SSH to a few CI slaves - https://phabricator.wikimedia.org/T129640#2111479 (10dduvall) We're still seeing this. It looks like a DNS replication issue perhaps. Resolution from NS2 gives no answer while NS1 responds just fine. ``` ~... [17:11:15] 10Continuous-Integration-Infrastructure, 6Labs, 10Labs-Infrastructure: Cannot SSH to a few CI slaves due to DNS failure - https://phabricator.wikimedia.org/T129640#2151437 (10dduvall) [17:13:12] marxarelli: Hi would deleting integration-slave-trusty-1002 and then re create it fix the problem since then it would be setup as new. [17:14:17] paladox: definitely, that's an option [17:14:51] marxarelli: I would say as it has happend again we should see if deleting and recreating it fixes the problem. [17:14:57] Thanks for replying [17:15:04] 10Beta-Cluster-Infrastructure, 6Operations, 10Traffic, 13Patch-For-Review, 7Puppet: Fix puppet on deployment-cache* hosts in beta cluster - https://phabricator.wikimedia.org/T129270#2151441 (10BBlack) @Krenair - I've modified the patch substantially, can you re-check on deployment-prep that it solves the... [17:16:20] Project selenium-GettingStarted » firefox,beta,Linux,,contintLabsSlave && UbuntuTrusty build #3: 04FAILURE in 40 sec: https://integration.wikimedia.org/ci/job/selenium-GettingStarted/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,VERSION=,label=contintLabsSlave%20&&%20UbuntuTrusty/3/ [17:16:27] paladox: yeah, no problem. i'm going to look at our current trusty capacity and see if we can just delete the instances. otherwise, let's rebuild them [17:16:35] marxarelli: Would we be able to increase the size of tmp from 200 something mb to 300mb or 400mb since it keeps causing memorys problems for npm because we have to download phantomjs for each test consuming alot of memory [17:16:35] that should work around the dns issue [17:17:05] marxarelli: Yeh. Would we have enough memory to be able to increase tmp please. [17:17:48] paladox: a 200 mb bump sounds feasible [17:18:41] worst case scenario, we run one fewer executor [17:18:51] marxarelli: Thanks, i wonder if we can update phantomjs at https://github.com/wikimedia/integration-phantomjs so we can reduce the amout of memory we are using for oojs please. [17:19:03] Project selenium-Math » firefox,beta,Linux,,contintLabsSlave && UbuntuTrusty build #38: 09SUCCESS in 34 sec: https://integration.wikimedia.org/ci/job/selenium-Math/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,VERSION=,label=contintLabsSlave%20&&%20UbuntuTrusty/38/ [17:19:04] Project selenium-Math » chrome,beta,Linux,,contintLabsSlave && UbuntuTrusty build #38: 09SUCCESS in 34 sec: https://integration.wikimedia.org/ci/job/selenium-Math/BROWSER=chrome,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,VERSION=,label=contintLabsSlave%20&&%20UbuntuTrusty/38/ [17:19:33] paladox: oh, i didn't even know that we maintained a fork :) [17:19:58] marxarelli: I think we doint we just have it installed on the servers [17:20:04] oh i see, it's not a fork [17:20:06] yeah [17:22:29] Project selenium-Gather » chrome,beta,Linux,,contintLabsSlave && UbuntuTrusty build #5: 04FAILURE in 9 min 25 sec: https://integration.wikimedia.org/ci/job/selenium-Gather/BROWSER=chrome,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,VERSION=,label=contintLabsSlave%20&&%20UbuntuTrusty/5/ [17:23:46] marxarelli: Looking at the repo im not sure if it is a fork or we use it at all. Can you see if phantomjs is installed at /usr/bin/phantomjs [17:23:49] please [17:24:17] paladox: dduvall@integration-slave-trusty-1014:~$ /usr/bin/phantomjs --version => 1.9.0 [17:24:36] marxarelli: Looks like a fork we doint use, thanks, is there any way we can update it please to 2.1.1. [17:26:07] paladox: me thinks we'd need a backport to trusty. not something i can handle atm, but feel free to file a task. i'm going to submit a patch for upping the tmpfs size [17:26:35] marxarelli: Ok thanks, and thanks for upping the limit [17:29:33] Project selenium-Flow » chrome,beta,Linux,,contintLabsSlave && UbuntuTrusty build #3: 04FAILURE in 19 min: https://integration.wikimedia.org/ci/job/selenium-Flow/BROWSER=chrome,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,VERSION=,label=contintLabsSlave%20&&%20UbuntuTrusty/3/ [17:30:09] https://github.com/wikimedia/integration-phantomjs is not used. [17:30:14] beware of that [17:30:46] That's old [17:31:03] We use the standard package, not this oldone [17:31:22] 10Continuous-Integration-Infrastructure, 6Operations: Update phantomjs to 2.1.1 on trusty - https://phabricator.wikimedia.org/T130940#2151512 (10Paladox) [17:32:02] Krinkle marxarelli ^^ [17:32:12] thanks, paladox [17:32:22] Your welcome [17:33:35] > "Mirror of PhantomJS that we used to use on production-level continuous integration nodes. No longer used now that CI is fully in labs." [17:33:37] Krinkle: i'm looking at bumping the tmpfs size to 512M, but that seems like it might be too high based on current memory usage. do you think we could do with fewer apache prefork processes? [17:33:43] I've made it read-only and deleted the github mirror [17:33:55] Project selenium-PageTriage » chrome,beta,Linux,,contintLabsSlave && UbuntuTrusty build #4: 09SUCCESS in 5 min 21 sec: https://integration.wikimedia.org/ci/job/selenium-PageTriage/BROWSER=chrome,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,VERSION=,label=contintLabsSlave%20&&%20UbuntuTrusty/4/ [17:34:06] Project selenium-PageTriage » firefox,beta,Linux,,contintLabsSlave && UbuntuTrusty build #4: 09SUCCESS in 5 min 32 sec: https://integration.wikimedia.org/ci/job/selenium-PageTriage/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,VERSION=,label=contintLabsSlave%20&&%20UbuntuTrusty/4/ [17:34:21] marxarelli: Dunno, I defer to Antoine. It's all different now. [17:34:29] kk [17:34:36] Krinkle thanks, ive created a task for phantomjs even though you said it is never gonna happen but at least theres a task now. [17:34:52] I think it's a non-issue for the time being. It seems solved in Nodepool by having node_modules cached, so it stays around from gate pipeline for test builds [17:35:11] ok [17:35:18] Project selenium-QuickSurveys » chrome,beta,Linux,,contintLabsSlave && UbuntuTrusty build #2: 04FAILURE in 58 sec: https://integration.wikimedia.org/ci/job/selenium-QuickSurveys/BROWSER=chrome,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,VERSION=,label=contintLabsSlave%20&&%20UbuntuTrusty/2/ [17:35:22] paladox: Also, if you stop updating phantomjs it might actually match the pre-installed version eventually and not end up re-downloading :) [17:35:32] Project selenium-PdfHandler » firefox,test,Linux,,contintLabsSlave && UbuntuTrusty build #4: 09SUCCESS in 4 min 20 sec: https://integration.wikimedia.org/ci/job/selenium-PdfHandler/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=test,PLATFORM=Linux,VERSION=,label=contintLabsSlave%20&&%20UbuntuTrusty/4/ [17:35:40] Oh ok [17:36:30] marxarelli: Would setting tmp limit at 400mb for now be enoguh todo it for now until we can do apache. [17:37:39] Project selenium-RelatedArticles » chrome,beta-desktop,Linux,,contintLabsSlave && UbuntuTrusty build #2: 04FAILURE in 11 sec: https://integration.wikimedia.org/ci/job/selenium-RelatedArticles/BROWSER=chrome,MEDIAWIKI_ENVIRONMENT=beta-desktop,PLATFORM=Linux,VERSION=,label=contintLabsSlave%20&&%20UbuntuTrusty/2/ [17:37:40] paladox: not sure exactly. we'll have to experiment with it. i'm submitting a patch for 384m (+128m) and we can see from there [17:37:58] Project selenium-RelatedArticles » chrome,beta-mobile,Linux,,contintLabsSlave && UbuntuTrusty build #2: 04FAILURE in 30 sec: https://integration.wikimedia.org/ci/job/selenium-RelatedArticles/BROWSER=chrome,MEDIAWIKI_ENVIRONMENT=beta-mobile,PLATFORM=Linux,VERSION=,label=contintLabsSlave%20&&%20UbuntuTrusty/2/ [17:38:04] marxarelli: Thanks for working on this. [17:38:49] 6Release-Engineering-Team, 15User-greg: Better method for tracking/planning rotating point people for train/sos? - https://phabricator.wikimedia.org/T130944#2151581 (10greg) [17:38:51] 10Continuous-Integration-Infrastructure, 6Labs, 6Operations: Update phantomjs to 2.1.1 on trusty - https://phabricator.wikimedia.org/T130940#2151595 (10Paladox) [17:39:25] paladox: btw, https://gerrit.wikimedia.org/r/#/c/269880/ [17:39:26] 6Release-Engineering-Team: MW-1.27.0-wmf.20 deployment blockers - https://phabricator.wikimedia.org/T130945#2151605 (10greg) [17:39:37] so maybe 384m will be the "sweet spot" :) [17:39:41] 6Release-Engineering-Team: MW-1.27.0-wmf.19 deployment blockers - https://phabricator.wikimedia.org/T130227#2130361 (10greg) [17:40:04] marxarelli: Yeh thanks [17:41:27] 3Scap3, 6Labs, 10Tool-Labs: Setup a proper deployment strategy for Kubernetes - https://phabricator.wikimedia.org/T129311#2151641 (10yuvipanda) [17:44:07] paladox, ori: is there a bug for this tmp disk space issue? [17:47:18] Project selenium-WikiLove » firefox,beta,Linux,,contintLabsSlave && UbuntuTrusty build #3: 09SUCCESS in 7 min 54 sec: https://integration.wikimedia.org/ci/job/selenium-WikiLove/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,VERSION=,label=contintLabsSlave%20&&%20UbuntuTrusty/3/ [17:48:53] Project selenium-Flow » firefox,beta,Linux,,contintLabsSlave && UbuntuTrusty build #3: 04FAILURE in 38 min: https://integration.wikimedia.org/ci/job/selenium-Flow/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,VERSION=,label=contintLabsSlave%20&&%20UbuntuTrusty/3/ [18:03:34] hmm [18:03:41] something is wrong with puppet on deployment-cache-text04 [18:03:55] the puppet config looked quite broken, so I changed that [18:04:01] cleaned up certs and tried again [18:04:13] but when trying to make a new cert request: [18:04:14] Error: Could not request certificate: SSL_connect returned=1 errno=0 state=error: certificate verify failed: [self signed certificate in certificate chain for /CN=Puppet CA: deployment-puppetmaster.deployment-prep.eqiad.wmflabs] [18:06:51] Krenair: I'd say file a task, we're kind of short staffed today (tyler and mukunda have the day off) [18:07:23] am still looking at it, posted here in hopes that someone else would know what's up [18:07:25] Yippee, build fixed! [18:07:26] Project selenium-MultimediaViewer » chrome,beta,Linux,,contintLabsSlave && UbuntuTrusty build #10: 09FIXED in 41 min: https://integration.wikimedia.org/ci/job/selenium-MultimediaViewer/BROWSER=chrome,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,VERSION=,label=contintLabsSlave%20&&%20UbuntuTrusty/10/ [18:07:52] Yippee, build fixed! [18:07:52] Project selenium-MultimediaViewer » chrome,beta,Windows 7,,contintLabsSlave && UbuntuTrusty build #10: 09FIXED in 42 min: https://integration.wikimedia.org/ci/job/selenium-MultimediaViewer/BROWSER=chrome,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Windows%207,VERSION=,label=contintLabsSlave%20&&%20UbuntuTrusty/10/ [18:08:27] Krenair: :) thanks [18:08:40] now there are different errors [18:08:42] Yippee, build fixed! [18:08:42] Project selenium-MultimediaViewer » safari,beta,Windows 7,,contintLabsSlave && UbuntuTrusty build #10: 09FIXED in 43 min: https://integration.wikimedia.org/ci/job/selenium-MultimediaViewer/BROWSER=safari,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Windows%207,VERSION=,label=contintLabsSlave%20&&%20UbuntuTrusty/10/ [18:10:01] Yippee, build fixed! [18:10:01] Project selenium-MultimediaViewer » safari,beta,OS X 10.9,,contintLabsSlave && UbuntuTrusty build #10: 09FIXED in 44 min: https://integration.wikimedia.org/ci/job/selenium-MultimediaViewer/BROWSER=safari,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=OS%20X%2010.9,VERSION=,label=contintLabsSlave%20&&%20UbuntuTrusty/10/ [18:10:08] Error: Could not retrieve catalog from remote server: Error 400 on SERVER: Could not find class role::cache::text for deployment-cache-text04.deployment-prep.eqiad.wmflabs on node deployment-cache-text04.deployment-prep.eqiad.wmflabs [18:10:09] wat [18:11:48] Yippee, build fixed! [18:11:48] Project selenium-MultimediaViewer » firefox,beta,Windows 7,,contintLabsSlave && UbuntuTrusty build #10: 09FIXED in 46 min: https://integration.wikimedia.org/ci/job/selenium-MultimediaViewer/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Windows%207,VERSION=,label=contintLabsSlave%20&&%20UbuntuTrusty/10/ [18:12:15] Yippee, build fixed! [18:12:15] Project selenium-MultimediaViewer » firefox,beta,Linux,11.0,contintLabsSlave && UbuntuTrusty build #10: 09FIXED in 46 min: https://integration.wikimedia.org/ci/job/selenium-MultimediaViewer/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,VERSION=11.0,label=contintLabsSlave%20&&%20UbuntuTrusty/10/ [18:13:42] krenair@deployment-puppetmaster:/var/lib/git/operations/puppet$ git grep role::cache::text [18:13:43] modules/role/manifests/cache/text.pp:class role::cache::text { [18:14:06] Yippee, build fixed! [18:14:06] Project selenium-QuickSurveys » chrome,beta,Linux,,contintLabsSlave && UbuntuTrusty build #4: 09FIXED in 8 min 47 sec: https://integration.wikimedia.org/ci/job/selenium-QuickSurveys/BROWSER=chrome,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,VERSION=,label=contintLabsSlave%20&&%20UbuntuTrusty/4/ [18:16:27] PROBLEM - App Server bits response on deployment-mediawiki01 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:16:31] turns out this was https://phabricator.wikimedia.org/T120814#1861757 [18:16:39] bits response? wart? [18:16:41] wat?* [18:17:00] 10Beta-Cluster-Infrastructure, 7WorkType-Maintenance: deployment-cache-text04 points to wrong puppetmaster - https://phabricator.wikimedia.org/T120814#2151738 (10Krenair) [18:17:15] Yippee, build fixed! [18:17:15] Project selenium-RelatedArticles » chrome,beta-desktop,Linux,,contintLabsSlave && UbuntuTrusty build #4: 09FIXED in 34 sec: https://integration.wikimedia.org/ci/job/selenium-RelatedArticles/BROWSER=chrome,MEDIAWIKI_ENVIRONMENT=beta-desktop,PLATFORM=Linux,VERSION=,label=contintLabsSlave%20&&%20UbuntuTrusty/4/ [18:17:35] Yippee, build fixed! [18:17:36] Project selenium-RelatedArticles » chrome,beta-mobile,Linux,,contintLabsSlave && UbuntuTrusty build #4: 09FIXED in 54 sec: https://integration.wikimedia.org/ci/job/selenium-RelatedArticles/BROWSER=chrome,MEDIAWIKI_ENVIRONMENT=beta-mobile,PLATFORM=Linux,VERSION=,label=contintLabsSlave%20&&%20UbuntuTrusty/4/ [18:17:59] 10Beta-Cluster-Infrastructure, 7WorkType-Maintenance: deployment-cache-mobile04 puppet Could not find class role::cache::mobile | deployment-cache-text04 Could not find class role::cache::text - https://phabricator.wikimedia.org/T120811#2151740 (10Krenair) 5Resolved>3Open Happening again on cache-text04, `... [18:18:32] 10Beta-Cluster-Infrastructure, 7WorkType-Maintenance: deployment-cache-mobile04 puppet Could not find class role::cache::mobile | deployment-cache-text04 Could not find class role::cache::text - https://phabricator.wikimedia.org/T120811#2151742 (10Krenair) ```krenair@deployment-puppetmaster:/var/lib/git/operat... [18:19:38] Project selenium-MobileFrontend » chrome,beta,Linux,,contintLabsSlave && UbuntuTrusty build #4: 04FAILURE in 57 min: https://integration.wikimedia.org/ci/job/selenium-MobileFrontend/BROWSER=chrome,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,VERSION=,label=contintLabsSlave%20&&%20UbuntuTrusty/4/ [18:20:49] Project beta-update-databases-eqiad build #7373: 04FAILURE in 49 sec: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/7373/ [18:26:43] Project selenium-MobileFrontend » firefox,beta,Linux,,contintLabsSlave && UbuntuTrusty build #4: 04FAILURE in 1 hr 4 min: https://integration.wikimedia.org/ci/job/selenium-MobileFrontend/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,VERSION=,label=contintLabsSlave%20&&%20UbuntuTrusty/4/ [18:26:52] 10Beta-Cluster-Infrastructure, 7WorkType-Maintenance: deployment-cache-mobile04 puppet Could not find class role::cache::mobile | deployment-cache-text04 Could not find class role::cache::text - https://phabricator.wikimedia.org/T120811#2151755 (10Krenair) 5Open>3Resolved After fiddling around with puppet... [18:32:25] It looks like mysql is crashier than usual on the integration slaves [18:33:08] yesterday it was down on precise-1011, and just now it was down on precise-1002 [18:33:26] I restarted it, but that might be worth investigating [18:33:27] 10Beta-Cluster-Infrastructure, 6Operations, 10Traffic, 13Patch-For-Review, 7Puppet: Fix puppet on deployment-cache* hosts in beta cluster - https://phabricator.wikimedia.org/T129270#2151780 (10Krenair) >>! In T129270#2151441, @BBlack wrote: > @Krenair - I've modified the patch substantially, can you re-c... [18:37:08] 10Continuous-Integration-Infrastructure, 5Gerrit-Migration, 3releng-201516-q4, 10Differential: Spec out needed glue for Differential to Gearman to Nodepool - https://phabricator.wikimedia.org/T130949#2151786 (10greg) [18:37:53] 10Continuous-Integration-Infrastructure, 5Gerrit-Migration, 3releng-201516-q4, 10Differential: Build glue from Differential to Gearman to Nodepool - https://phabricator.wikimedia.org/T130950#2151799 (10greg) [18:38:48] 10Continuous-Integration-Infrastructure, 5Gerrit-Migration, 3releng-201617-q1, 10Differential: Build glue from Differential to Gearman to Nodepool - https://phabricator.wikimedia.org/T130950#2151799 (10greg) [18:42:03] marxarelli: I doint think so but there are many tasks with things like memory problems or cannot open package.json. [18:49:56] 5Gerrit-Migration, 3releng-201516-q4, 10Differential, 7Documentation, 7WorkType-NewFunctionality: Document example Differential workflows (with Gerrit equivalents) - https://phabricator.wikimedia.org/T117058#2151855 (10greg) [18:52:36] 10Continuous-Integration-Infrastructure: Investigage crashing mysql on integration slaves - https://phabricator.wikimedia.org/T130951#2151857 (10greg) [18:52:49] ejegg: thanks, I just created and sub'd you to ^ [18:53:17] we're a little short staffed today (2 of 6 engineers taking the day off, and 2 of the remaining four are in Europe) :/ [18:53:47] oh right good friday and all! [18:54:00] thanks greg-g [18:56:31] 5Gerrit-Migration, 3releng-201617-q1: Document workflow and creation of CI jobs in Differential - https://phabricator.wikimedia.org/T130952#2151873 (10greg) [18:57:31] 10Beta-Cluster-Infrastructure, 6Operations, 10Traffic, 13Patch-For-Review, 7Puppet: Fix puppet on deployment-cache* hosts in beta cluster - https://phabricator.wikimedia.org/T129270#2151889 (10Krenair) 5Open>3Resolved [19:06:22] 10Continuous-Integration-Infrastructure: Investigage crashing mysql on integration slaves - https://phabricator.wikimedia.org/T130951#2151901 (10Ejegg) Currently down on precise-1012 as well [19:22:03] Project beta-update-databases-eqiad build #7374: 04STILL FAILING in 41 sec: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/7374/ [19:25:54] 6Release-Engineering-Team, 15User-greg: Update [[Requests_for_comment/Migrate_code_review_and_management_to_Phabricator_from_Gerrit]] - https://phabricator.wikimedia.org/T130664#2151934 (10greg) ....yak shaving some #gerrit-migration task'ing and https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Tea... [19:29:54] ejegg: mysql appears to be up on precise-1012. did you restart it? [19:30:19] yep [19:30:24] looks like it failed a previous upgrade attempt [19:30:38] upgrading mysql? [19:30:39] "Mar 25 19:06:47 integration-slave-precise-1012 /etc/mysql/debian-start[26820]: FATAL ERROR: Upgrade failed" [19:30:54] huh, it restarted fine [19:31:05] maybe this is a once-per-machine failure [19:31:17] possibly [19:32:19] it seems to be running ok atm [19:32:20] 10Continuous-Integration-Config, 10OOjs-UI, 13Patch-For-Review: Demos is totally broken; files not present in the rsync? - https://phabricator.wikimedia.org/T130678#2151962 (10Paladox) 5Open>3Resolved a:3Paladox This is now fixed. See https://doc.wikimedia.org/oojs-ui/master/demos/ [19:32:20] thanks marxarelli for fire fighting things you weren't planning to fire fight today [19:32:32] yeah, thanks for looking into this! [19:33:03] np! [19:34:01] oh, interesting. i had no idea /var/lib/mysql was on tmpfs [19:34:08] seems like overkill [19:34:18] there was a reason..... [19:34:50] https://phabricator.wikimedia.org/T96230 [19:34:54] Switch MySQL storage to tmpfs [19:35:07] heh, our 'unit' tests do a ridiculous amount of db setup and teardown [19:35:33] might as well leave it all in ram [19:36:20] ejegg: yeah, stupid integration tests masquerading as "unit" tests [19:36:29] (03PS2) 10JanZerebecki: [Dice] Archive extension [integration/config] - 10https://gerrit.wikimedia.org/r/279550 (owner: 10Paladox) [19:36:38] but that memory could be used elsewhere ... [19:36:56] and i have serious doubts about the performance benefits [19:37:10] (03CR) 10JanZerebecki: [C: 032] [Dice] Archive extension [integration/config] - 10https://gerrit.wikimedia.org/r/279550 (owner: 10Paladox) [19:37:21] in my experience, you get a lot more milage from tuning tmp locations, etc. [19:37:31] (03CR) 10Paladox: "Thanks." [integration/config] - 10https://gerrit.wikimedia.org/r/279550 (owner: 10Paladox) [19:38:12] Krinkle's comment on that ticket shows 40%+ speed improvements on tmpfs [19:38:15] (03Merged) 10jenkins-bot: [Dice] Archive extension [integration/config] - 10https://gerrit.wikimedia.org/r/279550 (owner: 10Paladox) [19:38:34] yeah, just saw that :) [19:41:05] marxarelli: I'd treat the phantomjs situation as a non-issue for now. Maybe make sure jobs are indeed rm-rf;ing their tmp dir at the end and maybe raise the memory a little. Long-term: Migrate to nodepool which doesn't need that big download since it'll be cached. Also mid-long-term (iff we can't migrate all to nodepool within feasible time): Convert [19:41:05] persistent instances to be single-executor instead of 4 multi executors (and slight smaller instance). Which gives it more memory (= the same amount of memory we give nodepool instances) [19:41:23] The current memory provision is known to be too small [19:41:51] which is why we created a ci1.medium custom instance type in labs, but after 1-2 years we're still not using it an instead sharing an m1.large instance with 4 executors. [19:42:55] Krinkle: right. i've submitted a patch to bump the tmpfs size by 128m for now, and mentioned the long-term plan to move to nodepool https://gerrit.wikimedia.org/r/#/c/279640/ [19:43:00] Right now the 'only' thing blocking migrating the jobs that are failing to nodepool is having a PHP binary. [19:43:08] Migration of MySQL to tmpfs was not an optimisation, it was necessary for MW developers to do their job effectively and for SWAT to work in < 2 hours. It was also a prerequisite to enabling MySQL in the first place (before that we used sqlite on tmpfs, we never used mysql without tmpfs). [19:44:43] James_F: Yep, its running php 5.6 which should really be php 5.5. Plus no composer. So composer also needs installing. [19:48:01] paladox: Running 5.5 instead of 5.6 is a nice-to-have, but really we don't care. [19:49:07] James_F: Ok, then composer is the only thing that needs installing and for us to actually use php. Since php is installed but we carn't use it since doing something like php returns with php unkown or carn't find php [19:50:01] James_F: I think they want php 5.5 on jessie since they want to move the hhvm and php tests to it too. [19:56:05] (03PS1) 10MaxSem: Archive ApiSandbox [integration/config] - 10https://gerrit.wikimedia.org/r/279665 [19:57:13] Krinkle: sure. i'm not sure anything was said to the contrary. still, i wonder if we can find a better setup that doesn't require tmpfs on each instance, whether its tuning innodb (log size/flush, disable safe writes, etc.) or moving to a centralized integration db [19:57:49] i have doubts about the tenability of single executors and fwiw, we still discuss the possibility of lighter weight isolation in ci via lxc/etc. [19:58:27] (03CR) 10JanZerebecki: [C: 04-1] "This won't work as is, as it is not using Mediawikis phpunit.php . So a new job is needed that generates coverage for Mediawiki extensions" [integration/config] - 10https://gerrit.wikimedia.org/r/279196 (https://phabricator.wikimedia.org/T71685) (owner: 10Jdlrobson) [20:00:43] (03CR) 10Paladox: "recheck" [integration/config] - 10https://gerrit.wikimedia.org/r/279529 (owner: 10Paladox) [20:05:21] (03PS5) 10JanZerebecki: [ZeroPortal] and [ZeroBanner] Add extension dependencies [integration/config] - 10https://gerrit.wikimedia.org/r/279400 (owner: 10Paladox) [20:05:29] (03PS6) 10JanZerebecki: [ZeroPortal] and [ZeroBanner] Add extension dependencies [integration/config] - 10https://gerrit.wikimedia.org/r/279400 (owner: 10Paladox) [20:05:49] (03CR) 10JanZerebecki: [C: 032] [ZeroPortal] and [ZeroBanner] Add extension dependencies [integration/config] - 10https://gerrit.wikimedia.org/r/279400 (owner: 10Paladox) [20:06:02] Thanks jzerebecki [20:06:55] jzerebecki: Could you also merge https://gerrit.wikimedia.org/r/#/c/274296/ and https://gerrit.wikimedia.org/r/#/c/274302/ please. [20:07:18] jzerebecki: and https://gerrit.wikimedia.org/r/#/c/279529/ please [20:07:53] (03Merged) 10jenkins-bot: [ZeroPortal] and [ZeroBanner] Add extension dependencies [integration/config] - 10https://gerrit.wikimedia.org/r/279400 (owner: 10Paladox) [20:08:39] 10Beta-Cluster-Infrastructure: Create Account fails on beta cluster wrt spoofuser table - https://phabricator.wikimedia.org/T88008#1002176 (10Nikki) This seems to be happening again, I get the same error trying to create an account on http://commons.wikimedia.beta.wmflabs.org/ [20:10:07] 10Beta-Cluster-Infrastructure, 13Patch-For-Review: Output of wmf-beta-update-databases.py is not clear on errors - https://phabricator.wikimedia.org/T110407#1577237 (10greg) This is happening again... ``` 19:20:41 Traceback (most recent call last): 19:20:41 File "/usr/local/bin/wmf-beta-update-databases.py... [20:13:26] (03PS3) 10JanZerebecki: Rename relevancylab -> relevanceforge [integration/config] - 10https://gerrit.wikimedia.org/r/279085 (owner: 10EBernhardson) [20:13:37] (03CR) 10JanZerebecki: [C: 032] Rename relevancylab -> relevanceforge [integration/config] - 10https://gerrit.wikimedia.org/r/279085 (owner: 10EBernhardson) [20:17:35] (03Merged) 10jenkins-bot: Rename relevancylab -> relevanceforge [integration/config] - 10https://gerrit.wikimedia.org/r/279085 (owner: 10EBernhardson) [20:17:41] 10Beta-Cluster-Infrastructure: Create Account fails on beta cluster wrt spoofuser table - https://phabricator.wikimedia.org/T88008#1002176 (10Krenair) Then you need to make a new ticket, @Nikki [20:19:02] marxarelli: Hi do you know that slave you took offline, do you know what it was used for since there is a queue at https://integration.wikimedia.org/zuul/ and its getting bigger. If possible could we delete the slave and re create it to see if that will sort out our dns issues please. [20:19:33] paladox: yes, i'll start provisioning replacements [20:19:36] (03Abandoned) 10Jdlrobson: Publish MobileFrontend phpunit test coverage [integration/config] - 10https://gerrit.wikimedia.org/r/279196 (https://phabricator.wikimedia.org/T71685) (owner: 10Jdlrobson) [20:19:47] marxarelli: Thank you. :) [20:19:49] thanks for keeping an eye on the queue [20:19:57] Your welcome [20:20:00] 10Beta-Cluster-Infrastructure: Create Account fails on beta cluster wrt spoofuser table - https://phabricator.wikimedia.org/T88008#2152057 (10Krenair) (I just ran the same fix, but now there's a different error) [20:20:31] Yippee, build fixed! [20:20:32] Project beta-update-databases-eqiad build #7375: 09FIXED in 30 sec: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/7375/ [20:21:02] paladox: the root cause of the failures on those nodes isn't related to dns, anyway, so we can safely add them back into the pool while we re-provision [20:21:30] marxarelli: With https://gerrit.wikimedia.org/r/#/c/279529/ would that allow us to pull some resources from precise. Since i think that is the only repo using npm 0.8. [20:21:37] marxarelli: Oh, thanks [20:22:21] marxarelli: DO you know why https://integration.wikimedia.org/ci/computer/ci-jessie-wikimedia-61518/ and https://integration.wikimedia.org/ci/computer/ci-jessie-wikimedia-61638/ are offline [20:25:45] yurik: Hi could you have a look at https://gerrit.wikimedia.org/r/#/c/279367/ since it is failing ZeroPortal because scribunto is not in the gate because of performance reasons causing ZeroPortal to fail because it requires this. Could you and a check to make sure that scribunto is available otherwise the file wont be loaded. [20:25:59] please [20:27:27] paladox: no idea about those instances [20:27:42] paladox, but it fails the build [20:27:59] yurik: Yes because of ZeroPortal [20:28:12] marxarelli: Oh [20:29:03] paladox, i will try to look at it early next week. could you create a task for it please [20:29:14] yurik: Ok [20:29:15] thanks [20:34:14] yurik: https://phabricator.wikimedia.org/T130958 [20:37:00] 10Beta-Cluster-Infrastructure: Create Account fails on beta cluster wrt spoofuser table - https://phabricator.wikimedia.org/T88008#2152126 (10Krenair) I just had to run it again... If it happens for you still @Nikki, try making a new ticket [20:37:28] marxarelli: It shows that one is because of Offline due to Gearman request and the other because Ping response time is too long or timed out. [20:41:05] (03PS2) 10JanZerebecki: Remove jobs for ApiSandbox [integration/config] - 10https://gerrit.wikimedia.org/r/279665 (owner: 10MaxSem) [20:41:17] (03CR) 10JanZerebecki: "I changed the repo to read only in gerrit." [integration/config] - 10https://gerrit.wikimedia.org/r/279665 (owner: 10MaxSem) [20:41:25] (03PS3) 10JanZerebecki: Remove jobs for ApiSandbox [integration/config] - 10https://gerrit.wikimedia.org/r/279665 (owner: 10MaxSem) [20:41:34] (03CR) 10JanZerebecki: [C: 032] Remove jobs for ApiSandbox [integration/config] - 10https://gerrit.wikimedia.org/r/279665 (owner: 10MaxSem) [20:47:13] (03Merged) 10jenkins-bot: Remove jobs for ApiSandbox [integration/config] - 10https://gerrit.wikimedia.org/r/279665 (owner: 10MaxSem) [20:50:30] (03PS5) 10JanZerebecki: [SemanticDrilldown] Remove mw-checks-test test [integration/config] - 10https://gerrit.wikimedia.org/r/263377 (owner: 10Paladox) [20:51:19] (03PS6) 10JanZerebecki: [SemanticDrilldown] Remove mw-checks-test template [integration/config] - 10https://gerrit.wikimedia.org/r/263377 (owner: 10Paladox) [20:52:12] (03CR) 10JanZerebecki: [C: 032] [SemanticDrilldown] Remove mw-checks-test template [integration/config] - 10https://gerrit.wikimedia.org/r/263377 (owner: 10Paladox) [20:53:01] (03Merged) 10jenkins-bot: [SemanticDrilldown] Remove mw-checks-test template [integration/config] - 10https://gerrit.wikimedia.org/r/263377 (owner: 10Paladox) [20:55:30] (03PS4) 10JanZerebecki: [SemanticSifter] Add dependencie on SemanticMediaWiki [integration/config] - 10https://gerrit.wikimedia.org/r/265393 (owner: 10Paladox) [20:56:43] 10Beta-Cluster-Infrastructure: Create Account fails on beta cluster wrt spoofuser table - https://phabricator.wikimedia.org/T88008#2152156 (10Nikki) It's working now, thanks! :) [20:57:17] (03CR) 10JanZerebecki: [C: 032] [SemanticSifter] Add dependencie on SemanticMediaWiki [integration/config] - 10https://gerrit.wikimedia.org/r/265393 (owner: 10Paladox) [20:58:12] (03Merged) 10jenkins-bot: [SemanticSifter] Add dependencie on SemanticMediaWiki [integration/config] - 10https://gerrit.wikimedia.org/r/265393 (owner: 10Paladox) [20:58:56] marxarelli: Hi do you know what this is https://integration.wikimedia.org/ci/computer/integration-lightslave-jessie-1002/ Since it is the only one and says it is a lightslave and shoud it be migrated to be a slave with name ci-jessie-wikimedia-(number) [20:59:58] paladox: hmm, not sure. it's running an old jessie image looks like [21:00:13] perhaps it's a leftover experiment from the nodepool project [21:00:22] i'd have to ask hashar [21:00:34] marxarelli: Oh, could we remove it and create another slave for jessie please. [21:01:47] marxarelli: We could also delete and recreate https://integration.wikimedia.org/ci/computer/integration-slave-trusty-1005/ please. [21:02:09] paladox: i'm in the process of doing that :) [21:02:46] marxarelli: Oh, sorry. [21:03:03] np [21:03:38] ok. [21:06:18] !log repooling integration-slave-trusty-{1005,1002} to help with load while replacement instances are provisioning [21:06:21] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master [21:16:44] marxarelli: Looms like memory problems again https://integration.wikimedia.org/ci/job/npm-run-doc/5387/console its running on integration-slave-trusty-1016 plus i only rebased the patch for oojs-ui. [21:16:46] (03CR) 10JanZerebecki: [C: 04-1] "Do the affected jobs already use castor?" [integration/config] - 10https://gerrit.wikimedia.org/r/279102 (owner: 10Paladox) [21:17:09] Could you have a look in tmp to see if it cleared out properly please. [21:18:13] (03CR) 10Paladox: "No because oojs-ui requires php and composer which are not yet available to use on Jessie." [integration/config] - 10https://gerrit.wikimedia.org/r/279102 (owner: 10Paladox) [21:18:38] (03Abandoned) 10Paladox: Add params['PHANTOMJS_CDNURL'] = 'http://cnpmjs.org/downloads' to parameter_fuctions.py [integration/config] - 10https://gerrit.wikimedia.org/r/279102 (owner: 10Paladox) [21:21:17] Yippee, build fixed! [21:21:18] Project browsertests-QuickSurveys-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce build #217: 09FIXED in 5 min 17 sec: https://integration.wikimedia.org/ci/job/browsertests-QuickSurveys-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce/217/ [21:28:23] PROBLEM - Puppet run on integration-slave-trusty-1024 is CRITICAL: CRITICAL: 60.00% of data above the critical threshold [0.0] [21:29:32] marxarelli|afk ^^ [21:29:51] marxarelli|afk: marxarelli: Looms like memory problems again https://integration.wikimedia.org/ci/job/npm-run-doc/5387/console its running on integration-slave-trusty-1016 plus i only rebased the patch for oojs-ui. [21:29:56] Could you have a look in tmp to see if it cleared out properly please. [21:31:38] PROBLEM - Puppet run on integration-slave-trusty-1025 is CRITICAL: CRITICAL: 60.00% of data above the critical threshold [0.0] [21:43:19] RECOVERY - Puppet run on integration-slave-trusty-1024 is OK: OK: Less than 1.00% above the threshold [0.0] [21:46:37] RECOVERY - Puppet run on integration-slave-trusty-1025 is OK: OK: Less than 1.00% above the threshold [0.0] [22:02:14] PROBLEM - Host deployment-upload is DOWN: CRITICAL - Host Unreachable (10.68.16.189) [22:04:59] 10Continuous-Integration-Config: generalize extension submodule handling - https://phabricator.wikimedia.org/T130966#2152304 (10JanZerebecki) [22:05:37] 10Continuous-Integration-Config: generalize extension submodule handling - https://phabricator.wikimedia.org/T130966#2152318 (10JanZerebecki) [22:06:25] PROBLEM - Puppet run on integration-slave-trusty-1024 is CRITICAL: CRITICAL: 30.00% of data above the critical threshold [0.0] [22:09:44] (03CR) 10JanZerebecki: [C: 04-1] "Looks good but ve-submodules-update needs to be refactored to remove the duplication. See zuul-cloner-extdeps in the same file with its ar" [integration/config] - 10https://gerrit.wikimedia.org/r/262432 (https://phabricator.wikimedia.org/T121479) (owner: 10Paladox) [22:11:21] !log rebooting integration-slave-trusty-{1024,1025} before pooling as replacements for trusty-1002 and trusty-1005 [22:11:24] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master [22:14:32] !log creating new jenkins node for integration-slave-trusty-1024 [22:14:35] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master [22:15:19] (03PS3) 10JanZerebecki: [CirrusSearch] Update Jenkins tests [integration/config] - 10https://gerrit.wikimedia.org/r/274990 (owner: 10Paladox) [22:15:28] (03CR) 10JanZerebecki: [C: 032] [CirrusSearch] Update Jenkins tests [integration/config] - 10https://gerrit.wikimedia.org/r/274990 (owner: 10Paladox) [22:16:24] RECOVERY - Puppet run on integration-slave-trusty-1024 is OK: OK: Less than 1.00% above the threshold [0.0] [22:16:31] (03Merged) 10jenkins-bot: [CirrusSearch] Update Jenkins tests [integration/config] - 10https://gerrit.wikimedia.org/r/274990 (owner: 10Paladox) [22:18:06] (03PS7) 10Paladox: Fix dirty VisualEditor submodule [integration/config] - 10https://gerrit.wikimedia.org/r/262432 (https://phabricator.wikimedia.org/T121479) [22:19:34] (03PS8) 10Paladox: Fix dirty VisualEditor submodule [integration/config] - 10https://gerrit.wikimedia.org/r/262432 (https://phabricator.wikimedia.org/T121479) [22:20:56] PROBLEM - Host integration-slave-trusty-1024 is DOWN: PING CRITICAL - Packet loss = 100% [22:21:56] PROBLEM - Host integration-slave-trusty-1025 is DOWN: CRITICAL - Host Unreachable (10.68.19.27) [22:27:39] marxarelli: Hi do you know why it keeps errroring out with https://integration.wikimedia.org/ci/job/npm/60220/console [22:28:03] It is happening with other users to. There was a task reported today, plus a few more that are duplicate about this error [22:28:09] Do you know if we can fix it. [22:28:12] please [22:28:51] (03CR) 10JanZerebecki: [C: 04-1] "That is better but still one duplicate. grep can take multiple files as arguments so you can just list both files as arguments to one invo" [integration/config] - 10https://gerrit.wikimedia.org/r/262432 (https://phabricator.wikimedia.org/T121479) (owner: 10Paladox) [22:30:18] (03CR) 10Paladox: "@JanZerebecki how do I do that please." [integration/config] - 10https://gerrit.wikimedia.org/r/262432 (https://phabricator.wikimedia.org/T121479) (owner: 10Paladox) [22:33:36] RECOVERY - Host integration-slave-trusty-1025 is UP: PING OK - Packet loss = 0%, RTA = 0.59 ms [22:33:52] RECOVERY - Host integration-slave-trusty-1024 is UP: PING OK - Packet loss = 0%, RTA = 0.95 ms [22:35:18] (03CR) 10JanZerebecki: "Are the added jobs passing?" [integration/config] - 10https://gerrit.wikimedia.org/r/274432 (owner: 10Paladox) [22:36:46] (03CR) 10JanZerebecki: "Why remove jshint entirely?" [integration/config] - 10https://gerrit.wikimedia.org/r/276119 (owner: 10Paladox) [22:36:58] Yippee, build fixed! [22:36:58] Project browsertests-Flow-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #999: 09FIXED in 25 min: https://integration.wikimedia.org/ci/job/browsertests-Flow-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce/999/ [22:37:07] 3Scap3, 6Labs, 10Tool-Labs, 13Patch-For-Review: Setup a proper deployment strategy for Kubernetes - https://phabricator.wikimedia.org/T129311#2152357 (10yuvipanda) Intermediate alternative if we can't actually get scap to do this in the meantime: 1. The k8s build script extracts the tar into a well known... [22:38:27] (03PS3) 10JanZerebecki: [DonationInterface] Add dependency on ContributionTracking [integration/config] - 10https://gerrit.wikimedia.org/r/275041 (owner: 10Paladox) [22:38:29] (03CR) 10Paladox: "Reommended by hashar for repos that doint have js files." [integration/config] - 10https://gerrit.wikimedia.org/r/276119 (owner: 10Paladox) [22:38:31] (03PS4) 10JanZerebecki: [DonationInterface] Add dependency on ContributionTracking [integration/config] - 10https://gerrit.wikimedia.org/r/275041 (owner: 10Paladox) [22:38:39] (03CR) 10JanZerebecki: [C: 032] [DonationInterface] Add dependency on ContributionTracking [integration/config] - 10https://gerrit.wikimedia.org/r/275041 (owner: 10Paladox) [22:38:52] (03CR) 10Paladox: "I'm not sure." [integration/config] - 10https://gerrit.wikimedia.org/r/274432 (owner: 10Paladox) [22:40:36] (03Merged) 10jenkins-bot: [DonationInterface] Add dependency on ContributionTracking [integration/config] - 10https://gerrit.wikimedia.org/r/275041 (owner: 10Paladox) [22:41:27] (03CR) 10JanZerebecki: [C: 04-1] "We need to make sure of that." [integration/config] - 10https://gerrit.wikimedia.org/r/274432 (owner: 10Paladox) [22:41:53] (03PS2) 10JanZerebecki: [FundraisingTranslateWorkflow] Move jsonlint to check: and remove jshint [integration/config] - 10https://gerrit.wikimedia.org/r/276119 (owner: 10Paladox) [22:42:08] (03CR) 10JanZerebecki: [C: 032] [FundraisingTranslateWorkflow] Move jsonlint to check: and remove jshint [integration/config] - 10https://gerrit.wikimedia.org/r/276119 (owner: 10Paladox) [22:43:12] (03Merged) 10jenkins-bot: [FundraisingTranslateWorkflow] Move jsonlint to check: and remove jshint [integration/config] - 10https://gerrit.wikimedia.org/r/276119 (owner: 10Paladox) [22:45:42] (03CR) 10Paladox: "@JanZerebecki could you review and merge please." [integration/config] - 10https://gerrit.wikimedia.org/r/279529 (owner: 10Paladox) [22:47:57] (03PS3) 10Paladox: [oojs/core] Switch repo to npm [integration/config] - 10https://gerrit.wikimedia.org/r/277761 (https://phabricator.wikimedia.org/T128089) [22:48:29] (03PS6) 10JanZerebecki: [Flow] Add missing dependencies in parameter_functions.py [integration/config] - 10https://gerrit.wikimedia.org/r/274302 (owner: 10Paladox) [22:48:35] (03PS7) 10JanZerebecki: [Flow] Add missing dependencies in parameter_functions.py [integration/config] - 10https://gerrit.wikimedia.org/r/274302 (owner: 10Paladox) [22:48:47] (03CR) 10JanZerebecki: [C: 032] [Flow] Add missing dependencies in parameter_functions.py [integration/config] - 10https://gerrit.wikimedia.org/r/274302 (owner: 10Paladox) [22:49:47] (03Merged) 10jenkins-bot: [Flow] Add missing dependencies in parameter_functions.py [integration/config] - 10https://gerrit.wikimedia.org/r/274302 (owner: 10Paladox) [22:58:08] (03CR) 10JanZerebecki: "Seems the execution of composer from the npm entry point is gone from that repo." [integration/config] - 10https://gerrit.wikimedia.org/r/277761 (https://phabricator.wikimedia.org/T128089) (owner: 10Paladox) [22:58:15] (03PS4) 10JanZerebecki: [oojs/core] Switch repo to npm [integration/config] - 10https://gerrit.wikimedia.org/r/277761 (https://phabricator.wikimedia.org/T128089) (owner: 10Paladox) [22:58:33] (03CR) 10JanZerebecki: [C: 032] [oojs/core] Switch repo to npm [integration/config] - 10https://gerrit.wikimedia.org/r/277761 (https://phabricator.wikimedia.org/T128089) (owner: 10Paladox) [22:59:25] (03Merged) 10jenkins-bot: [oojs/core] Switch repo to npm [integration/config] - 10https://gerrit.wikimedia.org/r/277761 (https://phabricator.wikimedia.org/T128089) (owner: 10Paladox) [23:02:57] (03PS6) 10JanZerebecki: [Thanks] Add dependencies in parameter_functions.py [integration/config] - 10https://gerrit.wikimedia.org/r/274296 (owner: 10Paladox) [23:04:49] Krinkle or marxarelli: Hi do you know why https://integration.wikimedia.org/ci/job/mediawiki-extensions-qunit/36604/console is failing. [23:04:56] please [23:06:46] marxarelli: Could you cherry pick https://gerrit.wikimedia.org/r/#/c/279640/ onto the slaves so we can test it please. [23:07:07] Yippee, build fixed! [23:07:08] Project browsertests-Gather-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce build #461: 09FIXED in 10 min: https://integration.wikimedia.org/ci/job/browsertests-Gather-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce/461/ [23:07:13] (03PS7) 10JanZerebecki: [Thanks] Add dependencies in parameter_functions.py [integration/config] - 10https://gerrit.wikimedia.org/r/274296 (owner: 10Paladox) [23:07:21] (03CR) 10JanZerebecki: [C: 032] [Thanks] Add dependencies in parameter_functions.py [integration/config] - 10https://gerrit.wikimedia.org/r/274296 (owner: 10Paladox) [23:08:23] (03Merged) 10jenkins-bot: [Thanks] Add dependencies in parameter_functions.py [integration/config] - 10https://gerrit.wikimedia.org/r/274296 (owner: 10Paladox) [23:13:38] !log reloading zuul fro 0aec21d..2d7e050 [23:13:41] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master [23:15:20] jzerebecki: Thanks for merging my patches. Could you merge https://gerrit.wikimedia.org/r/#/c/279529/ please. [23:15:36] paladox: i've cherry picked it but it's not going to take effect without a manual depooling and `mount -o remount`. give me a bit and i'll take care of it [23:16:10] marxarelli: Thanks, and thanks for working on it. [23:22:53] !log pooled new trusty slaves integration-slave-trusty-1024 and integration-slave-trusty-1025 [23:22:56] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master [23:23:25] paladox: that looks like I should be awake when reviewing it... so not now [23:23:43] jzerebecki: Oh ok [23:27:14] !log starting rolling offline/remount/online of trusty slaves to increase tmpfs size [23:27:16] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master [23:27:43] 7Browser-Tests, 10MobileFrontend: `Generic special page features.Search from Watchlist` test failing - https://phabricator.wikimedia.org/T130971#2152450 (10Jdlrobson) [23:30:33] 7Browser-Tests, 10MobileFrontend: `Generic special page features.Search from Watchlist` test failing - https://phabricator.wikimedia.org/T130971#2152480 (10Jdlrobson) [23:30:35] 10Browser-Tests-Infrastructure, 10Reading-Web, 13Patch-For-Review, 5WMF-deploy-2016-03-22_(1.27.0-wmf.18): Fix MobileFrontend scenarios that fail at en.wikipedia.beta.wmflabs.org or do not run them daily - https://phabricator.wikimedia.org/T94156#2152479 (10Jdlrobson) [23:30:50] 7Browser-Tests, 10MobileFrontend: `Generic special page features.Search from Watchlist` test failing - https://phabricator.wikimedia.org/T130971#2152450 (10Jdlrobson) [23:30:52] 10Browser-Tests-Infrastructure, 10MobileFrontend: Net::ReadTimeout in MobileFrontend browser tests - https://phabricator.wikimedia.org/T129328#2152495 (10Jdlrobson) [23:31:21] 7Browser-Tests, 10MobileFrontend: `Generic special page features.Search from Watchlist` test failing - https://phabricator.wikimedia.org/T130971#2152450 (10Jdlrobson) [23:32:03] 10MediaWiki-Codesniffer, 3Google-Summer-of-Code-2016: Improving static analysis tools for MediaWiki(GSoC 2016 Proposal) - https://phabricator.wikimedia.org/T130456#2152497 (10Billghost) Ok @Niharika thanks for the suggestion I will be mostly focusing on this proposal: https://phabricator.wikimedia.org/T130455 [23:32:56] Project browsertests-MobileFrontend-SmokeTests-linux-chrome-sauce build #463: 15ABORTED in 33 sec: https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-SmokeTests-linux-chrome-sauce/463/ [23:34:15] 3Scap3, 6Labs, 10Tool-Labs, 13Patch-For-Review: Setup a proper deployment strategy for Kubernetes - https://phabricator.wikimedia.org/T129311#2152511 (10yuvipanda) [23:41:32] !log completed rolling manual deploy of https://gerrit.wikimedia.org/r/#/c/279640/ to trusty slaves [23:41:34] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master [23:54:21] !log deleting jenkins nodes integration-slave-trusty-1002 and integration-slave-trusty-1005 [23:54:28] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master [23:55:18] !log deleting instances integration-slave-trusty-1002 and integration-slave-trusty-1005 [23:55:44] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master [23:57:13] PROBLEM - Host integration-slave-trusty-1002 is DOWN: CRITICAL - Host Unreachable (10.68.17.12) [23:58:21] PROBLEM - Host integration-slave-trusty-1005 is DOWN: CRITICAL - Host Unreachable (10.68.17.98) [23:58:47] PROBLEM - Host integration-trusty-1026 is DOWN: CRITICAL - Host Unreachable (10.68.17.98) [23:59:13] 10Continuous-Integration-Infrastructure, 6Labs, 10Labs-Infrastructure: Cannot SSH to a few CI slaves due to DNS failure - https://phabricator.wikimedia.org/T129640#2152572 (10dduvall) I've gone ahead and replaced the integration instances per @yuvipanda in IRC (new instances are `integration-slave-trusty-102... [23:59:46] 10Browser-Tests-Infrastructure, 10MobileFrontend: Net::ReadTimeout in MobileFrontend browser tests when visiting Watchlist page - https://phabricator.wikimedia.org/T129328#2152574 (10Jdlrobson)