[01:46:00] PROBLEM - Free space - all mounts on deployment-fluorine02 is CRITICAL: CRITICAL: deployment-prep.deployment-fluorine02.diskspace._srv.byte_percentfree (<50.00%) [02:54:21] (03Abandoned) 10Mholloway: Run apps-android-wikipedia-npm-node-6-jessie only when js files change [integration/config] - 10https://gerrit.wikimedia.org/r/384531 (https://phabricator.wikimedia.org/T177016) (owner: 10Mholloway) [03:07:14] (03PS6) 10Legoktm: zuul: add tests for mediawiki/tools/phan/SecurityCheckPlugin [integration/config] - 10https://gerrit.wikimedia.org/r/396486 (https://phabricator.wikimedia.org/T182199) (owner: 10MarcoAurelio) [03:07:28] (03PS7) 10Legoktm: zuul: add tests for mediawiki/tools/phan/SecurityCheckPlugin [integration/config] - 10https://gerrit.wikimedia.org/r/396486 (https://phabricator.wikimedia.org/T182199) (owner: 10MarcoAurelio) [03:07:57] (03CR) 10Legoktm: [C: 032] zuul: add tests for mediawiki/tools/phan/SecurityCheckPlugin [integration/config] - 10https://gerrit.wikimedia.org/r/396486 (https://phabricator.wikimedia.org/T182199) (owner: 10MarcoAurelio) [03:09:05] (03Merged) 10jenkins-bot: zuul: add tests for mediawiki/tools/phan/SecurityCheckPlugin [integration/config] - 10https://gerrit.wikimedia.org/r/396486 (https://phabricator.wikimedia.org/T182199) (owner: 10MarcoAurelio) [03:13:45] 10Continuous-Integration-Config, 10MediaWiki-SecurityCheckPlugin, 10Security-Team, 10Patch-For-Review, 10User-MarcoAurelio: Make jenkins run composer test (with php7) on mediawiki/tools/phan/SecurityCheckPlugin.git - https://phabricator.wikimedia.org/T182199#3824663 (10Legoktm) 05Open>03Resolved a:0... [03:13:46] !log deployed https://gerrit.wikimedia.org/r/396486 [03:13:53] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [03:52:15] 10Scap, 10Packaging: SCAP: Upload debian package version 3.7.4-1 - https://phabricator.wikimedia.org/T182347#3824714 (10mmodell) [03:52:17] 10Release-Engineering-Team, 10ORES, 10Operations, 10Scoring-platform-team: Connection timeout from tin to new ores servers - https://phabricator.wikimedia.org/T181661#3824715 (10mmodell) [03:52:49] 10Scap, 10Operations, 10Packaging: SCAP: Upload debian package version 3.7.4-1 - https://phabricator.wikimedia.org/T182347#3821018 (10mmodell) p:05Triage>03High High priority because the new version of scap will help with debugging {T181661} [04:54:50] PROBLEM - Mediawiki Error Rate on graphite-labs is CRITICAL: CRITICAL: 20.00% of data above the critical threshold [10.0] [05:14:50] PROBLEM - Mediawiki Error Rate on graphite-labs is CRITICAL: CRITICAL: 20.00% of data above the critical threshold [10.0] [06:24:36] 10Continuous-Integration-Infrastructure, 10MediaWiki-Platform-Team (MWPT-Q2-Oct-Dec-2017), 10Patch-For-Review: Create pretty landing page at https://doc.wikimedia.org/cover/ - https://phabricator.wikimedia.org/T146970#3824775 (10Legoktm) 05Open>03Resolved I changed my mind, I'm OK with the directory name... [07:11:01] RECOVERY - Free space - all mounts on deployment-fluorine02 is OK: OK: All targets OK [08:54:13] PROBLEM - Long lived cherry-picks on puppetmaster on deployment-puppetmaster02 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [12:22:59] Yippee, build fixed! [12:23:00] Project selenium-GettingStarted » firefox,beta,Linux,BrowserTests build #611: 09FIXED in 58 sec: https://integration.wikimedia.org/ci/job/selenium-GettingStarted/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=BrowserTests/611/ [14:32:22] Project selenium-WikiLove » firefox,beta,Linux,BrowserTests build #602: 04FAILURE in 21 sec: https://integration.wikimedia.org/ci/job/selenium-WikiLove/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=BrowserTests/602/ [15:25:22] Project selenium-MobileFrontend » firefox,beta,Linux,BrowserTests build #655: 04FAILURE in 3 min 22 sec: https://integration.wikimedia.org/ci/job/selenium-MobileFrontend/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=BrowserTests/655/ [15:59:42] 10Release-Engineering-Team, 10Scoring-platform-team: Scap is unhappy about deploying from a branch other than master - https://phabricator.wikimedia.org/T182498#3825297 (10awight) [16:01:36] Project selenium-CentralNotice » firefox,beta,Linux,BrowserTests build #608: 04FAILURE in 36 sec: https://integration.wikimedia.org/ci/job/selenium-CentralNotice/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=BrowserTests/608/ [16:03:04] Project selenium-CentralNotice » firefox,beta,OS X 10.9,BrowserTests build #608: 04FAILURE in 2 min 3 sec: https://integration.wikimedia.org/ci/job/selenium-CentralNotice/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=OS%20X%2010.9,label=BrowserTests/608/ [16:07:31] 10Release-Engineering-Team, 10Scap, 10ORES, 10Operations, 10Scoring-platform-team: Connection timeout from tin to new ores servers - https://phabricator.wikimedia.org/T181661#3825309 (10awight) This is affecting me in production, now: ``` Timeout, server scb2004.codfw.wmnet not responding. 16:01:39 conn... [18:05:35] 10Gerrit, 10Documentation, 10Google-Code-in-2017, 10Need-volunteer: Update Wikimedia's Gerrit documentation for new user interface in Gerrit 2.15 - https://phabricator.wikimedia.org/T179759#3825410 (10Aklapper) [19:05:48] RECOVERY - Mediawiki Error Rate on graphite-labs is OK: OK: Less than 1.00% above the threshold [1.0] [19:09:44] 10MediaWiki-Releasing, 10MediaWiki-General-or-Unknown: Create a MediaWiki package for download which contain basic elements of the English Wikipedia - https://phabricator.wikimedia.org/T165195#3825816 (10Aklapper) [19:51:48] PROBLEM - Mediawiki Error Rate on graphite-labs is CRITICAL: CRITICAL: 60.00% of data above the critical threshold [10.0] [20:20:53] PROBLEM - Puppet errors on deployment-ms-be04 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [20:22:33] 10Continuous-Integration-Config, 10MinusX, 10Google-Code-in-2017: Add MinusX to MediaWiki extensions and PHP library repos - https://phabricator.wikimedia.org/T175794#3825846 (10Aklapper) > Umherirrender added a project: Google-Code-in-2017. @Umherirrender: Do you plan to mentor this task for #GCI2017? If so... [20:41:50] RECOVERY - Mediawiki Error Rate on graphite-labs is OK: OK: Less than 1.00% above the threshold [1.0] [20:42:50] 10Continuous-Integration-Config, 10Composer, 10Patch-For-Review: Composer\Downloader\TransportException in mwext-testextension-hhvm-jessie - https://phabricator.wikimedia.org/T182266#3825850 (10Legoktm) AFAIK there's no outbound HTTP(S) proxy - @hashar is that correct? [20:42:53] Project selenium-Echo » chrome,beta,Linux,BrowserTests build #604: 04FAILURE in 1 min 53 sec: https://integration.wikimedia.org/ci/job/selenium-Echo/BROWSER=chrome,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=BrowserTests/604/ [20:46:31] PROBLEM - Puppet errors on deployment-ms-be03 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0]