[00:01:50] !log Reloading Zuul to deploy https://gerrit.wikimedia.org/r/240934 [00:01:53] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master [00:12:09] 10Beta-Cluster, 6Collaboration-Team-Backlog, 10MediaWiki-Recent-changes: [enwiki-betacluster] Special: Recent changes page is not displayed correctly - https://phabricator.wikimedia.org/T113660#1673332 (10greg) [00:14:00] 10Browser-Tests, 6Release-Engineering-Team, 10Reading-Web, 5Patch-For-Review: Failed Jenkins job sets Sauce Labs job to passed - https://phabricator.wikimedia.org/T105589#1673337 (10greg) [00:30:07] (03PS1) 10Krinkle: Remove 'jshint' job from WikimediaEvents (already has 'npm') [integration/config] - 10https://gerrit.wikimedia.org/r/240938 [00:46:04] (03CR) 10Krinkle: [C: 032] Remove 'jshint' job from WikimediaEvents (already has 'npm') [integration/config] - 10https://gerrit.wikimedia.org/r/240938 (owner: 10Krinkle) [00:46:40] Yippee, build fixed! [00:46:41] Project UploadWizard-api-commons.wikimedia.beta.wmflabs.org build #2648: FIXED in 40 sec: https://integration.wikimedia.org/ci/job/UploadWizard-api-commons.wikimedia.beta.wmflabs.org/2648/ [00:46:46] PROBLEM - Puppet staleness on deployment-restbase01 is CRITICAL: CRITICAL: 10.00% of data above the critical threshold [43200.0] [00:46:51] (03Merged) 10jenkins-bot: Remove 'jshint' job from WikimediaEvents (already has 'npm') [integration/config] - 10https://gerrit.wikimedia.org/r/240938 (owner: 10Krinkle) [00:55:39] PROBLEM - Puppet staleness on integration-dev is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [43200.0] [00:59:31] !log Reloading Zuul to deploy https://gerrit.wikimedia.org/r/240938 [00:59:34] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master [01:44:39] (03PS1) 10Legoktm: Don't run mediawiki-*-hhvm-composer for old release branches either [integration/config] - 10https://gerrit.wikimedia.org/r/240952 [01:45:39] (03CR) 10Legoktm: "Caused https://gerrit.wikimedia.org/r/240951 to fail" [integration/config] - 10https://gerrit.wikimedia.org/r/240952 (owner: 10Legoktm) [01:55:39] 6Release-Engineering-Team, 6Performance-Team, 10Traffic, 6operations, 7Varnish: Verify traffic to static resources from past branches does indeed drain - https://phabricator.wikimedia.org/T102991#1673434 (10ori) Brandon's conclusions seem right to me. What is left to do here? ("Delete the branches automa... [02:05:58] 6Release-Engineering-Team, 6Performance-Team, 10Traffic, 6operations, 7Varnish: Verify traffic to static resources from past branches does indeed drain - https://phabricator.wikimedia.org/T102991#1673451 (10Krinkle) If the only source of traffic to old wmf-branches' w/static directories is from facebook... [02:24:23] (03PS1) 10Legoktm: Add experimental 'mediawiki-core-phpcs' job [integration/config] - 10https://gerrit.wikimedia.org/r/240954 [02:24:45] (03CR) 10Krinkle: [C: 032] DonationInterface should track master in the main cluster [tools/release] - 10https://gerrit.wikimedia.org/r/230705 (owner: 10Awight) [02:25:02] (03Merged) 10jenkins-bot: DonationInterface should track master in the main cluster [tools/release] - 10https://gerrit.wikimedia.org/r/230705 (owner: 10Awight) [02:26:42] (03CR) 10Legoktm: [C: 032] Add experimental 'mediawiki-core-phpcs' job [integration/config] - 10https://gerrit.wikimedia.org/r/240954 (owner: 10Legoktm) [02:26:52] err [02:26:57] (03CR) 10Legoktm: Add experimental 'mediawiki-core-phpcs' job [integration/config] - 10https://gerrit.wikimedia.org/r/240954 (owner: 10Legoktm) [02:28:21] (03CR) 10jenkins-bot: [V: 04-1] Add experimental 'mediawiki-core-phpcs' job [integration/config] - 10https://gerrit.wikimedia.org/r/240954 (owner: 10Legoktm) [02:29:04] (03CR) 10Legoktm: [C: 032] Add experimental 'mediawiki-core-phpcs' job [integration/config] - 10https://gerrit.wikimedia.org/r/240954 (owner: 10Legoktm) [02:30:45] (03Merged) 10jenkins-bot: Add experimental 'mediawiki-core-phpcs' job [integration/config] - 10https://gerrit.wikimedia.org/r/240954 (owner: 10Legoktm) [02:31:06] !log deploying https://gerrit.wikimedia.org/r/240954 [02:31:10] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master [03:01:01] 10Continuous-Integration-Config, 10MediaWiki-Codesniffer: Craft a Jenkins job that runs PHP_CodeSniffer for mw/core using composer - https://phabricator.wikimedia.org/T102598#1673468 (10Legoktm) I took a stab at this today by creating a job that runs `vendor/bin/phpcs -v --extensions=php,php5,inc,sample .` exc... [03:20:59] Yippee, build fixed! [03:21:00] Project browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #829: FIXED in 38 min: https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-firefox-sauce/829/ [04:25:10] Project browsertests-MultimediaViewer-en.wikipedia.beta.wmflabs.org-windows_7-internet_explorer-9-sauce build #572: FAILURE in 33 min: https://integration.wikimedia.org/ci/job/browsertests-MultimediaViewer-en.wikipedia.beta.wmflabs.org-windows_7-internet_explorer-9-sauce/572/ [05:22:43] (03PS1) 10Krinkle: Remove jshint and extension-unittests-generic from TopTenPages [integration/config] - 10https://gerrit.wikimedia.org/r/240967 [05:22:56] (03CR) 10Krinkle: [C: 032] Remove jshint and extension-unittests-generic from TopTenPages [integration/config] - 10https://gerrit.wikimedia.org/r/240967 (owner: 10Krinkle) [05:23:50] (03Merged) 10jenkins-bot: Remove jshint and extension-unittests-generic from TopTenPages [integration/config] - 10https://gerrit.wikimedia.org/r/240967 (owner: 10Krinkle) [05:40:29] Yippee, build fixed! [05:40:29] Project browsertests-MultimediaViewer-en.wikipedia.beta.wmflabs.org-os_x_10.9-chrome-sauce build #203: FIXED in 24 min: https://integration.wikimedia.org/ci/job/browsertests-MultimediaViewer-en.wikipedia.beta.wmflabs.org-os_x_10.9-chrome-sauce/203/ [05:42:02] 10Beta-Cluster, 6Collaboration-Team-Backlog, 10MediaWiki-Recent-changes: [enwiki-betacluster] Special: Recent changes page is not displayed correctly - https://phabricator.wikimedia.org/T113660#1673600 (10Luke081515) a:3Luke081515 I can try if the reason for this is a wrong mediawiki systemmessage [06:28:48] 10Continuous-Integration-Config, 10MediaWiki-Codesniffer: Craft a Jenkins job that runs PHP_CodeSniffer for mw/core using composer - https://phabricator.wikimedia.org/T102598#1673618 (10polybuildr) IIRC, it uses our phpcs.xml only if we don't specify any files to check. Try doing the same thing without specify... [07:10:07] Project browsertests-Flow-en.wikipedia.beta.wmflabs.org-linux-firefox-monobook-sauce build #580: FAILURE in 45 min: https://integration.wikimedia.org/ci/job/browsertests-Flow-en.wikipedia.beta.wmflabs.org-linux-firefox-monobook-sauce/580/ [07:30:56] 10Beta-Cluster, 6Collaboration-Team-Backlog, 10MediaWiki-Recent-changes: [enwiki-betacluster] Special: Recent changes page is not displayed correctly - https://phabricator.wikimedia.org/T113660#1673661 (10Luke081515) 5Open>3Resolved [[http://en.wikipedia.beta.wmflabs.org/w/index.php?title=MediaWiki%3ARec... [07:36:21] ha [07:36:24] polybuildr is right [07:37:58] (03PS1) 10Legoktm: Fix mediawiki-core-phpcs job [integration/config] - 10https://gerrit.wikimedia.org/r/240976 [07:38:17] (03PS2) 10Legoktm: Fix mediawiki-core-phpcs job [integration/config] - 10https://gerrit.wikimedia.org/r/240976 [07:39:01] (03CR) 10Legoktm: [C: 032] "Deployed" [integration/config] - 10https://gerrit.wikimedia.org/r/240976 (owner: 10Legoktm) [07:40:03] 10Continuous-Integration-Config, 10MediaWiki-Codesniffer: Craft a Jenkins job that runs PHP_CodeSniffer for mw/core using composer - https://phabricator.wikimedia.org/T102598#1673666 (10Legoktm) ok, that was silly. It works now! https://integration.wikimedia.org/ci/job/mediawiki-core-phpcs/6/console [07:40:44] (03Merged) 10jenkins-bot: Fix mediawiki-core-phpcs job [integration/config] - 10https://gerrit.wikimedia.org/r/240976 (owner: 10Legoktm) [08:25:21] (03PS5) 10Hashar: Migrate tox*jessie jobs to Nodepool instances [integration/config] - 10https://gerrit.wikimedia.org/r/240705 [08:26:28] (03CR) 10Hashar: [C: 032] "Lets be bold" [integration/config] - 10https://gerrit.wikimedia.org/r/240705 (owner: 10Hashar) [08:26:44] !log Migrating tox.*jessie jobs to Nodepool instances | https://gerrit.wikimedia.org/r/#/c/240705/ [08:26:48] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master [08:28:18] (03Merged) 10jenkins-bot: Migrate tox*jessie jobs to Nodepool instances [integration/config] - 10https://gerrit.wikimedia.org/r/240705 (owner: 10Hashar) [08:34:35] Yippee, build fixed! [08:34:36] Project browsertests-MultimediaViewer-en.wikipedia.beta.wmflabs.org-os_x_10.9-safari-sauce build #732: FIXED in 24 min: https://integration.wikimedia.org/ci/job/browsertests-MultimediaViewer-en.wikipedia.beta.wmflabs.org-os_x_10.9-safari-sauce/732/ [09:11:18] 10Deployment-Systems, 10ContentTranslation-Deployments, 10MediaWiki-extensions-ContentTranslation, 10Unplanned-Sprint-Work, and 4 others: is shown instead of the actual message on Special:ContentTranslation in ... - https://phabricator.wikimedia.org/T112964#1673854 [09:12:11] 10Gerrit-Migration, 6RelEng-Admin: Outline work (outcomes and outputs) of RelEng's Q2 Gerrit migration work - https://phabricator.wikimedia.org/T110623#1673858 (10Qgil) > sidenote: Should this be talked about that the Dev Summit? The Summit fits perfectly in your timeline. It would make sense to have a sessio... [09:15:31] 10MediaWiki-Releasing, 10ReleaseTaggerBot: Change how ReleaseTaggerBot handles major MW releases - https://phabricator.wikimedia.org/T113628#1673866 (10Jdforrester-WMF) I strongly counsel against this change. "Blockers for MW1.26" is an excellent project to create, with manual curation of what's actually impo... [09:32:40] (03PS6) 10Amire80: Archive Narayam and WebFonts [integration/config] - 10https://gerrit.wikimedia.org/r/232726 (https://phabricator.wikimedia.org/T110178) [09:36:25] (03CR) 10Amire80: [C: 031] Revert "Let MW-Selenium 1.x use the local test suite configuration" [integration/config] - 10https://gerrit.wikimedia.org/r/240701 (https://phabricator.wikimedia.org/T111510) (owner: 10Zfilipin) [09:37:59] (03PS1) 10Hashar: Migrate integration/dashboard tox jobs to Jessie [integration/config] - 10https://gerrit.wikimedia.org/r/241002 [09:42:20] (03PS1) 10Hashar: Migrate labs/tools/forrestbot tox jobs to Jessie [integration/config] - 10https://gerrit.wikimedia.org/r/241004 [09:42:33] (03CR) 10Hashar: [C: 032] Migrate labs/tools/forrestbot tox jobs to Jessie [integration/config] - 10https://gerrit.wikimedia.org/r/241004 (owner: 10Hashar) [09:42:46] (03CR) 10Hashar: [C: 032] Migrate integration/dashboard tox jobs to Jessie [integration/config] - 10https://gerrit.wikimedia.org/r/241002 (owner: 10Hashar) [09:45:30] !log phasing out tox.*trusty jobs in favor of tox.*jessie jobs on Nodepool instances. python3.4 is available here which was the main use for -trusty [09:45:33] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master [09:45:43] !sal [09:45:43] https://tools.wmflabs.org/sal/releng [09:48:09] qa-morebots: ping [09:48:09] I am a logbot running on tools-exec-1213. [09:48:09] Messages are logged to https://tools.wmflabs.org/sal/releng. [09:48:09] To log a message, type !log . [09:48:30] !log Updated qa-morebots SAL link from https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL to https://tools.wmflabs.org/sal/releng [09:48:33] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master [09:48:37] bah [09:49:03] qa-morebots: help [09:49:03] I am a logbot running on tools-exec-1213. [09:49:03] Messages are logged to https://tools.wmflabs.org/sal/releng. [09:49:03] To log a message, type !log . [09:50:03] (03Merged) 10jenkins-bot: Migrate integration/dashboard tox jobs to Jessie [integration/config] - 10https://gerrit.wikimedia.org/r/241002 (owner: 10Hashar) [09:50:05] (03Merged) 10jenkins-bot: Migrate labs/tools/forrestbot tox jobs to Jessie [integration/config] - 10https://gerrit.wikimedia.org/r/241004 (owner: 10Hashar) [09:51:24] (03CR) 10Hashar: "recheck" [integration/dashboard] - 10https://gerrit.wikimedia.org/r/238691 (owner: 10Hashar) [09:59:36] Project browsertests-Flow-en.wikipedia.beta.wmflabs.org-linux-chrome-monobook-sauce build #569: FAILURE in 38 min: https://integration.wikimedia.org/ci/job/browsertests-Flow-en.wikipedia.beta.wmflabs.org-linux-chrome-monobook-sauce/569/ [10:08:08] (03PS1) 10Hashar: Migrate labs/tools/wikibugs2 tox jobs to Jessie [integration/config] - 10https://gerrit.wikimedia.org/r/241009 [10:10:59] (03PS1) 10Hashar: Migrate operations/software/* tox jobs to Jessie [integration/config] - 10https://gerrit.wikimedia.org/r/241010 [10:11:12] (03CR) 10Hashar: [C: 032] Migrate labs/tools/wikibugs2 tox jobs to Jessie [integration/config] - 10https://gerrit.wikimedia.org/r/241009 (owner: 10Hashar) [10:11:17] (03CR) 10Hashar: [C: 032] Migrate operations/software/* tox jobs to Jessie [integration/config] - 10https://gerrit.wikimedia.org/r/241010 (owner: 10Hashar) [10:12:05] (03Merged) 10jenkins-bot: Migrate labs/tools/wikibugs2 tox jobs to Jessie [integration/config] - 10https://gerrit.wikimedia.org/r/241009 (owner: 10Hashar) [10:12:07] (03Merged) 10jenkins-bot: Migrate operations/software/* tox jobs to Jessie [integration/config] - 10https://gerrit.wikimedia.org/r/241010 (owner: 10Hashar) [10:36:03] (03CR) 1020after4: [C: 031] "python decorators: not so great actually" [tools/scap] - 10https://gerrit.wikimedia.org/r/240912 (owner: 10Thcipriani) [10:41:01] 10Deployment-Systems, 10ContentTranslation-Deployments, 10MediaWiki-extensions-ContentTranslation, 10Unplanned-Sprint-Work, and 4 others: is shown instead of the actual message on Special:ContentTranslation in ... - https://phabricator.wikimedia.org/T112964#1674093 [10:58:43] (03PS1) 10Hashar: Migrate pywikibot/* tox jobs from Trusty to Jessie [integration/config] - 10https://gerrit.wikimedia.org/r/241011 [11:31:03] RECOVERY - App Server Main HTTP Response on deployment-mediawiki02 is OK: HTTP OK: HTTP/1.1 200 OK - 45606 bytes in 0.663 second response time [11:33:36] RECOVERY - English Wikipedia Main page on beta-cluster is OK: HTTP OK: HTTP/1.1 200 OK - 45884 bytes in 0.853 second response time [11:33:39] RECOVERY - English Wikipedia Mobile Main page on beta-cluster is OK: HTTP OK: HTTP/1.1 200 OK - 36158 bytes in 0.511 second response time [11:35:16] PROBLEM - Puppet failure on deployment-memc03 is CRITICAL: CRITICAL: 50.00% of data above the critical threshold [0.0] [11:35:24] PROBLEM - Puppet failure on deployment-upload is CRITICAL: CRITICAL: 83.33% of data above the critical threshold [0.0] [11:35:31] PROBLEM - Puppet failure on deployment-elastic06 is CRITICAL: CRITICAL: 83.33% of data above the critical threshold [0.0] [11:35:34] PROBLEM - Puppet failure on deployment-poolcounter01 is CRITICAL: CRITICAL: 42.86% of data above the critical threshold [0.0] [11:35:34] PROBLEM - Puppet failure on integration-saltmaster is CRITICAL: CRITICAL: 66.67% of data above the critical threshold [0.0] [11:35:35] PROBLEM - Puppet failure on deployment-eventlogging03 is CRITICAL: CRITICAL: 85.71% of data above the critical threshold [0.0] [11:35:35] PROBLEM - Puppet failure on deployment-mathoid is CRITICAL: CRITICAL: 16.67% of data above the critical threshold [0.0] [11:35:41] PROBLEM - Puppet failure on deployment-stream is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [11:35:47] PROBLEM - Puppet failure on deployment-bastion is CRITICAL: CRITICAL: 14.29% of data above the critical threshold [0.0] [11:35:47] PROBLEM - Puppet failure on integration-slave-precise-1012 is CRITICAL: CRITICAL: 83.33% of data above the critical threshold [0.0] [11:35:48] PROBLEM - Puppet failure on integration-slave-precise-1011 is CRITICAL: CRITICAL: 71.43% of data above the critical threshold [0.0] [11:35:49] PROBLEM - Puppet failure on deployment-sentry2 is CRITICAL: CRITICAL: 85.71% of data above the critical threshold [0.0] [11:35:52] PROBLEM - Puppet failure on integration-slave-trusty-1011 is CRITICAL: CRITICAL: 85.71% of data above the critical threshold [0.0] [11:35:56] PROBLEM - Puppet failure on deployment-mediawiki03 is CRITICAL: CRITICAL: 71.43% of data above the critical threshold [0.0] [11:35:59] PROBLEM - Puppet failure on deployment-puppetmaster is CRITICAL: CRITICAL: 14.29% of data above the critical threshold [0.0] [11:35:59] PROBLEM - Puppet failure on deployment-redis02 is CRITICAL: CRITICAL: 14.29% of data above the critical threshold [0.0] [11:36:01] PROBLEM - Puppet failure on deployment-redis02 is CRITICAL: CRITICAL: 14.29% of data above the critical threshold [0.0] [11:36:02] PROBLEM - Puppet failure on deployment-puppetmaster is CRITICAL: CRITICAL: 14.29% of data above the critical threshold [0.0] [11:36:02] PROBLEM - Puppet failure on integration-slave-trusty-1012 is CRITICAL: CRITICAL: 66.67% of data above the critical threshold [0.0] [11:36:03] PROBLEM - Puppet failure on deployment-mediawiki01 is CRITICAL: CRITICAL: 71.43% of data above the critical threshold [0.0] [11:36:04] PROBLEM - Puppet failure on deployment-elastic05 is CRITICAL: CRITICAL: 14.29% of data above the critical threshold [0.0] [11:36:04] PROBLEM - Puppet failure on deployment-urldownloader is CRITICAL: CRITICAL: 14.29% of data above the critical threshold [0.0] [11:36:09] PROBLEM - Puppet failure on integration-slave-trusty-1016 is CRITICAL: CRITICAL: 71.43% of data above the critical threshold [0.0] [11:36:10] PROBLEM - Puppet failure on integration-raita is CRITICAL: CRITICAL: 71.43% of data above the critical threshold [0.0] [11:36:10] PROBLEM - Puppet failure on deployment-zookeeper01 is CRITICAL: CRITICAL: 85.71% of data above the critical threshold [0.0] [11:36:10] PROBLEM - Puppet failure on deployment-mediawiki02 is CRITICAL: CRITICAL: 75.00% of data above the critical threshold [0.0] [11:36:16] PROBLEM - Puppet failure on deployment-elastic08 is CRITICAL: CRITICAL: 14.29% of data above the critical threshold [0.0] [11:36:16] PROBLEM - Puppet failure on deployment-elastic07 is CRITICAL: CRITICAL: 14.29% of data above the critical threshold [0.0] [11:36:57] PROBLEM - Puppet failure on deployment-restbase01 is CRITICAL: CRITICAL: 75.00% of data above the critical threshold [0.0] [11:36:57] PROBLEM - Puppet failure on deployment-cache-text04 is CRITICAL: CRITICAL: 37.50% of data above the critical threshold [0.0] [11:36:57] PROBLEM - Puppet failure on deployment-memc04 is CRITICAL: CRITICAL: 62.50% of data above the critical threshold [0.0] [11:37:03] PROBLEM - Puppet failure on deployment-salt is CRITICAL: CRITICAL: 62.50% of data above the critical threshold [0.0] [11:37:07] PROBLEM - Puppet failure on deployment-redis01 is CRITICAL: CRITICAL: 37.50% of data above the critical threshold [0.0] [11:37:33] PROBLEM - Puppet failure on deployment-cache-upload04 is CRITICAL: CRITICAL: 87.50% of data above the critical threshold [0.0] [11:37:33] PROBLEM - Puppet failure on deployment-jobrunner01 is CRITICAL: CRITICAL: 12.50% of data above the critical threshold [0.0] [11:37:43] PROBLEM - Puppet failure on integration-publisher is CRITICAL: CRITICAL: 75.00% of data above the critical threshold [0.0] [11:37:45] PROBLEM - Puppet failure on deployment-cxserver03 is CRITICAL: CRITICAL: 33.33% of data above the critical threshold [0.0] [11:37:47] PROBLEM - Puppet failure on mira is CRITICAL: CRITICAL: 77.78% of data above the critical threshold [0.0] [11:37:51] PROBLEM - Puppet failure on deployment-memc02 is CRITICAL: CRITICAL: 75.00% of data above the critical threshold [0.0] [11:38:04] PROBLEM - Puppet failure on integration-slave-precise-1013 is CRITICAL: CRITICAL: 66.67% of data above the critical threshold [0.0] [11:38:08] PROBLEM - Puppet failure on integration-slave-trusty-1017 is CRITICAL: CRITICAL: 87.50% of data above the critical threshold [0.0] [11:38:08] PROBLEM - Puppet failure on deployment-db1 is CRITICAL: CRITICAL: 88.89% of data above the critical threshold [0.0] [11:38:12] PROBLEM - Puppet failure on integration-slave-trusty-1013 is CRITICAL: CRITICAL: 66.67% of data above the critical threshold [0.0] [11:38:12] PROBLEM - Puppet failure on integration-labsvagrant is CRITICAL: CRITICAL: 88.89% of data above the critical threshold [0.0] [11:38:14] PROBLEM - Puppet failure on deployment-parsoid05 is CRITICAL: CRITICAL: 77.78% of data above the critical threshold [0.0] [11:38:21] PROBLEM - Puppet failure on deployment-apertium01 is CRITICAL: CRITICAL: 88.89% of data above the critical threshold [0.0] [11:38:22] PROBLEM - Puppet failure on integration-slave-trusty-1015 is CRITICAL: CRITICAL: 87.50% of data above the critical threshold [0.0] [11:39:55] 10Continuous-Integration-Infrastructure: Remove PhantomJS from the CI infrastructure - https://phabricator.wikimedia.org/T113279#1674204 (10zeljkofilipin) >>! In T113279#1672610, @hashar wrote: > I guess if we ever want to do such feature switch, we would probably go with a cookie (assuming the browsers drivers... [11:41:22] PROBLEM - Puppet failure on deployment-zotero01 is CRITICAL: CRITICAL: 60.00% of data above the critical threshold [0.0] [11:41:42] RECOVERY - Puppet staleness on deployment-restbase01 is OK: OK: Less than 1.00% above the threshold [3600.0] [11:45:49] RECOVERY - Puppet failure on deployment-sentry2 is OK: OK: Less than 1.00% above the threshold [0.0] [11:52:53] Yippee, build fixed! [11:52:53] Project beta-code-update-eqiad build #73819: FIXED in 1 min 15 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/73819/ [11:53:12] (03CR) 10jenkins-bot: [V: 04-1] Migrate pywikibot/* tox jobs from Trusty to Jessie [integration/config] - 10https://gerrit.wikimedia.org/r/241011 (owner: 10Hashar) [11:55:34] RECOVERY - Puppet failure on deployment-mathoid is OK: OK: Less than 1.00% above the threshold [0.0] [11:56:31] PROBLEM - Puppet failure on integration-slave-precise-1014 is CRITICAL: CRITICAL: 60.00% of data above the critical threshold [0.0] [11:57:07] PROBLEM - Puppet failure on deployment-db2 is CRITICAL: CRITICAL: 22.22% of data above the critical threshold [0.0] [11:59:06] PROBLEM - Puppet failure on deployment-kafka02 is CRITICAL: CRITICAL: 55.56% of data above the critical threshold [0.0] [12:01:08] RECOVERY - Puppet failure on integration-slave-trusty-1016 is OK: OK: Less than 1.00% above the threshold [0.0] [12:01:12] RECOVERY - Puppet failure on deployment-mediawiki02 is OK: OK: Less than 1.00% above the threshold [0.0] [12:01:58] PROBLEM - Puppet failure on integration-puppetmaster is CRITICAL: CRITICAL: 60.00% of data above the critical threshold [0.0] [12:03:18] RECOVERY - Puppet failure on integration-slave-trusty-1013 is OK: OK: Less than 1.00% above the threshold [0.0] [12:07:11] PROBLEM - Puppet failure on integration-lightslave-jessie-1002 is CRITICAL: CRITICAL: 33.33% of data above the critical threshold [0.0] [12:14:29] (03CR) 10Hashar: "recheck" [integration/config] - 10https://gerrit.wikimedia.org/r/241011 (owner: 10Hashar) [12:17:39] RECOVERY - Puppet failure on deployment-jobrunner01 is OK: OK: Less than 1.00% above the threshold [0.0] [12:18:07] (03CR) 10Hashar: "recheck" [integration/config] - 10https://gerrit.wikimedia.org/r/241011 (owner: 10Hashar) [12:18:48] (03CR) 10Hashar: "recheck" [integration/config] - 10https://gerrit.wikimedia.org/r/241011 (owner: 10Hashar) [12:26:54] PROBLEM - Puppet failure on deployment-pdf01 is CRITICAL: CRITICAL: 20.00% of data above the critical threshold [0.0] [12:27:00] PROBLEM - Puppet failure on angry-caching-proxy is CRITICAL: CRITICAL: 20.00% of data above the critical threshold [0.0] [12:29:06] PROBLEM - Puppet failure on deployment-sca02 is CRITICAL: CRITICAL: 44.44% of data above the critical threshold [0.0] [12:31:16] PROBLEM - Puppet failure on deployment-sca01 is CRITICAL: CRITICAL: 55.56% of data above the critical threshold [0.0] [12:31:34] PROBLEM - Puppet failure on integration-slave-trusty-1023 is CRITICAL: CRITICAL: 60.00% of data above the critical threshold [0.0] [12:31:58] RECOVERY - Puppet failure on deployment-restbase01 is OK: OK: Less than 1.00% above the threshold [0.0] [12:32:02] PROBLEM - Puppet failure on deployment-tmh01 is CRITICAL: CRITICAL: 22.22% of data above the critical threshold [0.0] [12:36:48] PROBLEM - Puppet failure on deployment-sentry2 is CRITICAL: CRITICAL: 40.00% of data above the critical threshold [0.0] [12:40:16] andrewbogott: seems we can't delete instance anymore. I have a bunch pending in 'deleting' state [12:41:52] hashar: there’s some congestion left over from the outage. I think it will clear on its own but I’m looking [12:42:16] I hope it is not Nodepool causing the congestion [12:43:46] (03CR) 10Zfilipin: [C: 031] "Is there anything else left to be done here?" [integration/config] - 10https://gerrit.wikimedia.org/r/232726 (https://phabricator.wikimedia.org/T110178) (owner: 10Amire80) [12:47:10] RECOVERY - Puppet failure on integration-lightslave-jessie-1002 is OK: OK: Less than 1.00% above the threshold [0.0] [12:47:30] RECOVERY - Puppet failure on deployment-cache-upload04 is OK: OK: Less than 1.00% above the threshold [0.0] [12:48:58] Yippee, build fixed! [12:48:59] Project browsertests-ContentTranslation-language-screenshot-os_x_10.10-firefox » en,contintLabsSlave && UbuntuTrusty build #9: FIXED in 1 min 33 sec: https://integration.wikimedia.org/ci/job/browsertests-ContentTranslation-language-screenshot-os_x_10.10-firefox/LANGUAGE_SCREENSHOT_CODE=en,label=contintLabsSlave%20&&%20UbuntuTrusty/9/ [12:50:52] RECOVERY - Puppet failure on integration-slave-trusty-1011 is OK: OK: Less than 1.00% above the threshold [0.0] [12:51:55] Project browsertests-ContentTranslation-language-screenshot-os_x_10.10-firefox » af,contintLabsSlave && UbuntuTrusty build #10: FAILURE in 1 min 9 sec: https://integration.wikimedia.org/ci/job/browsertests-ContentTranslation-language-screenshot-os_x_10.10-firefox/LANGUAGE_SCREENSHOT_CODE=af,label=contintLabsSlave%20&&%20UbuntuTrusty/10/ [12:53:24] Project browsertests-ContentTranslation-language-screenshot-os_x_10.10-firefox » nl,contintLabsSlave && UbuntuTrusty build #10: SUCCESS in 2 min 38 sec: https://integration.wikimedia.org/ci/job/browsertests-ContentTranslation-language-screenshot-os_x_10.10-firefox/LANGUAGE_SCREENSHOT_CODE=nl,label=contintLabsSlave%20&&%20UbuntuTrusty/10/ [12:54:35] Project browsertests-ContentTranslation-language-screenshot-os_x_10.10-firefox » zh-hans,contintLabsSlave && UbuntuTrusty build #10: SUCCESS in 3 min 49 sec: https://integration.wikimedia.org/ci/job/browsertests-ContentTranslation-language-screenshot-os_x_10.10-firefox/LANGUAGE_SCREENSHOT_CODE=zh-hans,label=contintLabsSlave%20&&%20UbuntuTrusty/10/ [12:55:59] Project browsertests-ContentTranslation-language-screenshot-os_x_10.10-firefox » et,contintLabsSlave && UbuntuTrusty build #10: SUCCESS in 5 min 13 sec: https://integration.wikimedia.org/ci/job/browsertests-ContentTranslation-language-screenshot-os_x_10.10-firefox/LANGUAGE_SCREENSHOT_CODE=et,label=contintLabsSlave%20&&%20UbuntuTrusty/10/ [12:56:05] RECOVERY - Puppet failure on deployment-urldownloader is OK: OK: Less than 1.00% above the threshold [0.0] [12:56:09] RECOVERY - Puppet failure on integration-raita is OK: OK: Less than 1.00% above the threshold [0.0] [12:56:13] RECOVERY - Puppet failure on deployment-elastic08 is OK: OK: Less than 1.00% above the threshold [0.0] [12:57:20] Project browsertests-ContentTranslation-language-screenshot-os_x_10.10-firefox » ja,contintLabsSlave && UbuntuTrusty build #10: SUCCESS in 6 min 35 sec: https://integration.wikimedia.org/ci/job/browsertests-ContentTranslation-language-screenshot-os_x_10.10-firefox/LANGUAGE_SCREENSHOT_CODE=ja,label=contintLabsSlave%20&&%20UbuntuTrusty/10/ [12:58:19] RECOVERY - Puppet failure on deployment-apertium01 is OK: OK: Less than 1.00% above the threshold [0.0] [12:58:26] Project browsertests-ContentTranslation-language-screenshot-os_x_10.10-firefox » sv,contintLabsSlave && UbuntuTrusty build #10: SUCCESS in 7 min 40 sec: https://integration.wikimedia.org/ci/job/browsertests-ContentTranslation-language-screenshot-os_x_10.10-firefox/LANGUAGE_SCREENSHOT_CODE=sv,label=contintLabsSlave%20&&%20UbuntuTrusty/10/ [13:00:24] Project browsertests-ContentTranslation-language-screenshot-os_x_10.10-firefox » de,contintLabsSlave && UbuntuTrusty build #10: SUCCESS in 9 min 38 sec: https://integration.wikimedia.org/ci/job/browsertests-ContentTranslation-language-screenshot-os_x_10.10-firefox/LANGUAGE_SCREENSHOT_CODE=de,label=contintLabsSlave%20&&%20UbuntuTrusty/10/ [13:01:53] Project browsertests-ContentTranslation-language-screenshot-os_x_10.10-firefox » fi,contintLabsSlave && UbuntuTrusty build #10: SUCCESS in 11 min: https://integration.wikimedia.org/ci/job/browsertests-ContentTranslation-language-screenshot-os_x_10.10-firefox/LANGUAGE_SCREENSHOT_CODE=fi,label=contintLabsSlave%20&&%20UbuntuTrusty/10/ [13:02:44] RECOVERY - Puppet failure on mira is OK: OK: Less than 1.00% above the threshold [0.0] [13:03:00] Project browsertests-ContentTranslation-language-screenshot-os_x_10.10-firefox » ms,contintLabsSlave && UbuntuTrusty build #10: SUCCESS in 12 min: https://integration.wikimedia.org/ci/job/browsertests-ContentTranslation-language-screenshot-os_x_10.10-firefox/LANGUAGE_SCREENSHOT_CODE=ms,label=contintLabsSlave%20&&%20UbuntuTrusty/10/ [13:03:06] RECOVERY - Puppet failure on integration-slave-precise-1013 is OK: OK: Less than 1.00% above the threshold [0.0] [13:03:08] RECOVERY - Puppet failure on integration-slave-trusty-1017 is OK: OK: Less than 1.00% above the threshold [0.0] [13:03:14] 5Release-Engineering-Epics, 7Epic, 5Patch-For-Review, 7Tracking: Fix or delete browsertests* Jenkins jobs that are failing for more than a week - https://phabricator.wikimedia.org/T94150#1674342 (10zeljkofilipin) [13:04:04] RECOVERY - Puppet failure on deployment-kafka02 is OK: OK: Less than 1.00% above the threshold [0.0] [13:04:06] Project browsertests-ContentTranslation-language-screenshot-os_x_10.10-firefox » sl,contintLabsSlave && UbuntuTrusty build #10: SUCCESS in 13 min: https://integration.wikimedia.org/ci/job/browsertests-ContentTranslation-language-screenshot-os_x_10.10-firefox/LANGUAGE_SCREENSHOT_CODE=sl,label=contintLabsSlave%20&&%20UbuntuTrusty/10/ [13:04:41] 10Continuous-Integration-Config: job analytics-wikistats has zuul trigger but is not in integration/config - https://phabricator.wikimedia.org/T113725#1674345 (10JanZerebecki) 3NEW [13:05:15] Project browsertests-ContentTranslation-language-screenshot-os_x_10.10-firefox » uk,contintLabsSlave && UbuntuTrusty build #10: SUCCESS in 14 min: https://integration.wikimedia.org/ci/job/browsertests-ContentTranslation-language-screenshot-os_x_10.10-firefox/LANGUAGE_SCREENSHOT_CODE=uk,label=contintLabsSlave%20&&%20UbuntuTrusty/10/ [13:05:28] RECOVERY - Puppet failure on deployment-elastic06 is OK: OK: Less than 1.00% above the threshold [0.0] [13:05:30] RECOVERY - Puppet failure on deployment-eventlogging03 is OK: OK: Less than 1.00% above the threshold [0.0] [13:05:36] 10Continuous-Integration-Config: job analytics-wikistats has zuul trigger but vanished from integration/config - https://phabricator.wikimedia.org/T113725#1674354 (10JanZerebecki) [13:05:42] RECOVERY - Puppet failure on deployment-stream is OK: OK: Less than 1.00% above the threshold [0.0] [13:05:55] RECOVERY - Puppet failure on deployment-mediawiki03 is OK: OK: Less than 1.00% above the threshold [0.0] [13:06:02] RECOVERY - Puppet failure on deployment-redis02 is OK: OK: Less than 1.00% above the threshold [0.0] [13:06:02] RECOVERY - Puppet failure on deployment-puppetmaster is OK: OK: Less than 1.00% above the threshold [0.0] [13:06:03] RECOVERY - Puppet failure on integration-slave-trusty-1012 is OK: OK: Less than 1.00% above the threshold [0.0] [13:06:03] RECOVERY - Puppet failure on deployment-mediawiki01 is OK: OK: Less than 1.00% above the threshold [0.0] [13:06:08] 5Release-Engineering-Epics, 7Epic, 5Patch-For-Review, 7Tracking: Fix or delete browsertests* Jenkins jobs that are failing for more than a week - https://phabricator.wikimedia.org/T94150#1674356 (10zeljkofilipin) [13:06:11] RECOVERY - Puppet failure on deployment-zookeeper01 is OK: OK: Less than 1.00% above the threshold [0.0] [13:06:19] RECOVERY - Puppet failure on deployment-sca01 is OK: OK: Less than 1.00% above the threshold [0.0] [13:06:25] RECOVERY - Puppet failure on deployment-zotero01 is OK: OK: Less than 1.00% above the threshold [0.0] [13:06:41] RECOVERY - Puppet failure on integration-slave-trusty-1023 is OK: OK: Less than 1.00% above the threshold [0.0] [13:06:42] Project browsertests-ContentTranslation-language-screenshot-os_x_10.10-firefox » br,contintLabsSlave && UbuntuTrusty build #10: SUCCESS in 15 min: https://integration.wikimedia.org/ci/job/browsertests-ContentTranslation-language-screenshot-os_x_10.10-firefox/LANGUAGE_SCREENSHOT_CODE=br,label=contintLabsSlave%20&&%20UbuntuTrusty/10/ [13:06:55] RECOVERY - Puppet failure on deployment-pdf01 is OK: OK: Less than 1.00% above the threshold [0.0] [13:06:57] RECOVERY - Puppet failure on integration-puppetmaster is OK: OK: Less than 1.00% above the threshold [0.0] [13:06:57] RECOVERY - Puppet failure on deployment-cache-text04 is OK: OK: Less than 1.00% above the threshold [0.0] [13:07:03] RECOVERY - Puppet failure on angry-caching-proxy is OK: OK: Less than 1.00% above the threshold [0.0] [13:07:05] RECOVERY - Puppet failure on deployment-db2 is OK: OK: Less than 1.00% above the threshold [0.0] [13:07:45] RECOVERY - Puppet failure on deployment-cxserver03 is OK: OK: Less than 1.00% above the threshold [0.0] [13:08:07] Project browsertests-ContentTranslation-language-screenshot-os_x_10.10-firefox » ru,contintLabsSlave && UbuntuTrusty build #10: SUCCESS in 17 min: https://integration.wikimedia.org/ci/job/browsertests-ContentTranslation-language-screenshot-os_x_10.10-firefox/LANGUAGE_SCREENSHOT_CODE=ru,label=contintLabsSlave%20&&%20UbuntuTrusty/10/ [13:08:12] RECOVERY - Puppet failure on integration-labsvagrant is OK: OK: Less than 1.00% above the threshold [0.0] [13:08:18] RECOVERY - Puppet failure on deployment-parsoid05 is OK: OK: Less than 1.00% above the threshold [0.0] [13:08:18] RECOVERY - Puppet failure on integration-slave-trusty-1015 is OK: OK: Less than 1.00% above the threshold [0.0] [13:09:06] RECOVERY - Puppet failure on deployment-sca02 is OK: OK: Less than 1.00% above the threshold [0.0] [13:09:40] Project browsertests-ContentTranslation-language-screenshot-os_x_10.10-firefox » bs,contintLabsSlave && UbuntuTrusty build #10: SUCCESS in 18 min: https://integration.wikimedia.org/ci/job/browsertests-ContentTranslation-language-screenshot-os_x_10.10-firefox/LANGUAGE_SCREENSHOT_CODE=bs,label=contintLabsSlave%20&&%20UbuntuTrusty/10/ [13:10:18] RECOVERY - Puppet failure on deployment-memc03 is OK: OK: Less than 1.00% above the threshold [0.0] [13:11:03] Project browsertests-ContentTranslation-language-screenshot-os_x_10.10-firefox » zh-hant,contintLabsSlave && UbuntuTrusty build #10: SUCCESS in 20 min: https://integration.wikimedia.org/ci/job/browsertests-ContentTranslation-language-screenshot-os_x_10.10-firefox/LANGUAGE_SCREENSHOT_CODE=zh-hant,label=contintLabsSlave%20&&%20UbuntuTrusty/10/ [13:11:56] RECOVERY - Puppet failure on deployment-memc04 is OK: OK: Less than 1.00% above the threshold [0.0] [13:12:03] RECOVERY - Puppet failure on deployment-tmh01 is OK: OK: Less than 1.00% above the threshold [0.0] [13:12:04] RECOVERY - Puppet failure on deployment-salt is OK: OK: Less than 1.00% above the threshold [0.0] [13:12:06] RECOVERY - Puppet failure on deployment-redis01 is OK: OK: Less than 1.00% above the threshold [0.0] [13:12:27] Project browsertests-ContentTranslation-language-screenshot-os_x_10.10-firefox » krc,contintLabsSlave && UbuntuTrusty build #10: SUCCESS in 21 min: https://integration.wikimedia.org/ci/job/browsertests-ContentTranslation-language-screenshot-os_x_10.10-firefox/LANGUAGE_SCREENSHOT_CODE=krc,label=contintLabsSlave%20&&%20UbuntuTrusty/10/ [13:12:40] RECOVERY - Puppet failure on integration-publisher is OK: OK: Less than 1.00% above the threshold [0.0] [13:12:48] RECOVERY - Puppet failure on deployment-memc02 is OK: OK: Less than 1.00% above the threshold [0.0] [13:12:56] 5Release-Engineering-Epics, 7Epic, 5Patch-For-Review, 7Tracking: Fix or delete failing browsertests* Jenkins jobs - https://phabricator.wikimedia.org/T94150#1674366 (10zeljkofilipin) [13:13:34] Project browsertests-ContentTranslation-language-screenshot-os_x_10.10-firefox » it,contintLabsSlave && UbuntuTrusty build #10: SUCCESS in 22 min: https://integration.wikimedia.org/ci/job/browsertests-ContentTranslation-language-screenshot-os_x_10.10-firefox/LANGUAGE_SCREENSHOT_CODE=it,label=contintLabsSlave%20&&%20UbuntuTrusty/10/ [13:14:46] Project browsertests-ContentTranslation-language-screenshot-os_x_10.10-firefox » pl,contintLabsSlave && UbuntuTrusty build #10: SUCCESS in 24 min: https://integration.wikimedia.org/ci/job/browsertests-ContentTranslation-language-screenshot-os_x_10.10-firefox/LANGUAGE_SCREENSHOT_CODE=pl,label=contintLabsSlave%20&&%20UbuntuTrusty/10/ [13:15:32] RECOVERY - Puppet failure on integration-saltmaster is OK: OK: Less than 1.00% above the threshold [0.0] [13:15:32] RECOVERY - Puppet failure on deployment-poolcounter01 is OK: OK: Less than 1.00% above the threshold [0.0] [13:15:55] Project browsertests-ContentTranslation-language-screenshot-os_x_10.10-firefox » hi,contintLabsSlave && UbuntuTrusty build #10: SUCCESS in 25 min: https://integration.wikimedia.org/ci/job/browsertests-ContentTranslation-language-screenshot-os_x_10.10-firefox/LANGUAGE_SCREENSHOT_CODE=hi,label=contintLabsSlave%20&&%20UbuntuTrusty/10/ [13:16:06] RECOVERY - Puppet failure on deployment-elastic05 is OK: OK: Less than 1.00% above the threshold [0.0] [13:16:14] RECOVERY - Puppet failure on deployment-elastic07 is OK: OK: Less than 1.00% above the threshold [0.0] [13:16:51] RECOVERY - Puppet failure on deployment-sentry2 is OK: OK: Less than 1.00% above the threshold [0.0] [13:17:14] Project browsertests-ContentTranslation-language-screenshot-os_x_10.10-firefox » gl,contintLabsSlave && UbuntuTrusty build #10: SUCCESS in 26 min: https://integration.wikimedia.org/ci/job/browsertests-ContentTranslation-language-screenshot-os_x_10.10-firefox/LANGUAGE_SCREENSHOT_CODE=gl,label=contintLabsSlave%20&&%20UbuntuTrusty/10/ [13:18:46] 5Release-Engineering-Epics, 7Epic, 5Patch-For-Review, 7Tracking: Fix or delete failing browsertests* Jenkins jobs - https://phabricator.wikimedia.org/T94150#1674380 (10zeljkofilipin) [13:18:48] 10Browser-Tests, 10MediaWiki-extensions-CentralNotice: Fix or delete failing CentralNotice browsertests Jenkins jobs - https://phabricator.wikimedia.org/T94151#1674376 (10zeljkofilipin) 5Resolved>3Open [13:18:51] 10Browser-Tests, 10Fundraising-Backlog, 10MediaWiki-extensions-CentralNotice, 5Patch-For-Review: CentralNotice bucket improvements, step 3 bis part 2: moar better cross-browser tests - https://phabricator.wikimedia.org/T86092#1674381 (10zeljkofilipin) [13:20:13] 5Release-Engineering-Epics, 7Epic, 5Patch-For-Review, 7Tracking: Fix or delete failing browsertests* Jenkins jobs - https://phabricator.wikimedia.org/T94150#1156290 (10zeljkofilipin) [13:20:22] RECOVERY - Puppet failure on deployment-upload is OK: OK: Less than 1.00% above the threshold [0.0] [13:20:44] Project browsertests-ContentTranslation-language-screenshot-os_x_10.10-firefox » ar,contintLabsSlave && UbuntuTrusty build #10: SUCCESS in 29 min: https://integration.wikimedia.org/ci/job/browsertests-ContentTranslation-language-screenshot-os_x_10.10-firefox/LANGUAGE_SCREENSHOT_CODE=ar,label=contintLabsSlave%20&&%20UbuntuTrusty/10/ [13:20:48] RECOVERY - Puppet failure on integration-slave-precise-1012 is OK: OK: Less than 1.00% above the threshold [0.0] [13:20:48] RECOVERY - Puppet failure on integration-slave-precise-1011 is OK: OK: Less than 1.00% above the threshold [0.0] [13:22:10] Project browsertests-ContentTranslation-language-screenshot-os_x_10.10-firefox » id,contintLabsSlave && UbuntuTrusty build #10: SUCCESS in 31 min: https://integration.wikimedia.org/ci/job/browsertests-ContentTranslation-language-screenshot-os_x_10.10-firefox/LANGUAGE_SCREENSHOT_CODE=id,label=contintLabsSlave%20&&%20UbuntuTrusty/10/ [13:23:07] RECOVERY - Puppet failure on deployment-db1 is OK: OK: Less than 1.00% above the threshold [0.0] [13:23:39] Project browsertests-ContentTranslation-language-screenshot-os_x_10.10-firefox » tr,contintLabsSlave && UbuntuTrusty build #10: SUCCESS in 32 min: https://integration.wikimedia.org/ci/job/browsertests-ContentTranslation-language-screenshot-os_x_10.10-firefox/LANGUAGE_SCREENSHOT_CODE=tr,label=contintLabsSlave%20&&%20UbuntuTrusty/10/ [13:25:07] Project browsertests-ContentTranslation-language-screenshot-os_x_10.10-firefox » mk,contintLabsSlave && UbuntuTrusty build #10: SUCCESS in 34 min: https://integration.wikimedia.org/ci/job/browsertests-ContentTranslation-language-screenshot-os_x_10.10-firefox/LANGUAGE_SCREENSHOT_CODE=mk,label=contintLabsSlave%20&&%20UbuntuTrusty/10/ [13:25:44] RECOVERY - Puppet failure on deployment-bastion is OK: OK: Less than 1.00% above the threshold [0.0] [13:26:38] 10Browser-Tests, 10CirrusSearch, 6Discovery: Fix or delete failing CirrusSearch browsertests Jenkins jobs - https://phabricator.wikimedia.org/T113727#1674394 (10zeljkofilipin) 3NEW a:3zeljkofilipin [13:27:08] Project browsertests-ContentTranslation-language-screenshot-os_x_10.10-firefox » yue,contintLabsSlave && UbuntuTrusty build #10: SUCCESS in 36 min: https://integration.wikimedia.org/ci/job/browsertests-ContentTranslation-language-screenshot-os_x_10.10-firefox/LANGUAGE_SCREENSHOT_CODE=yue,label=contintLabsSlave%20&&%20UbuntuTrusty/10/ [13:28:13] Project browsertests-ContentTranslation-language-screenshot-os_x_10.10-firefox » ko,contintLabsSlave && UbuntuTrusty build #10: SUCCESS in 37 min: https://integration.wikimedia.org/ci/job/browsertests-ContentTranslation-language-screenshot-os_x_10.10-firefox/LANGUAGE_SCREENSHOT_CODE=ko,label=contintLabsSlave%20&&%20UbuntuTrusty/10/ [13:29:19] 5Release-Engineering-Epics, 7Epic, 5Patch-For-Review, 7Tracking: Fix or delete failing browsertests* Jenkins jobs - https://phabricator.wikimedia.org/T94150#1674405 (10zeljkofilipin) [13:29:27] Project browsertests-ContentTranslation-language-screenshot-os_x_10.10-firefox » nb,contintLabsSlave && UbuntuTrusty build #10: SUCCESS in 38 min: https://integration.wikimedia.org/ci/job/browsertests-ContentTranslation-language-screenshot-os_x_10.10-firefox/LANGUAGE_SCREENSHOT_CODE=nb,label=contintLabsSlave%20&&%20UbuntuTrusty/10/ [13:30:15] !log stopped nodepool. Instances cant be deleted on labs due to ongoing issue [13:30:18] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master [13:30:46] Project browsertests-ContentTranslation-language-screenshot-os_x_10.10-firefox » hu,contintLabsSlave && UbuntuTrusty build #10: SUCCESS in 40 min: https://integration.wikimedia.org/ci/job/browsertests-ContentTranslation-language-screenshot-os_x_10.10-firefox/LANGUAGE_SCREENSHOT_CODE=hu,label=contintLabsSlave%20&&%20UbuntuTrusty/10/ [13:30:51] 5Release-Engineering-Epics, 7Epic, 5Patch-For-Review, 7Tracking: Fix or delete failing browsertests* Jenkins jobs - https://phabricator.wikimedia.org/T94150#1156290 (10zeljkofilipin) [13:31:33] RECOVERY - Puppet failure on integration-slave-precise-1014 is OK: OK: Less than 1.00% above the threshold [0.0] [13:32:17] Project browsertests-ContentTranslation-language-screenshot-os_x_10.10-firefox » ka,contintLabsSlave && UbuntuTrusty build #10: SUCCESS in 41 min: https://integration.wikimedia.org/ci/job/browsertests-ContentTranslation-language-screenshot-os_x_10.10-firefox/LANGUAGE_SCREENSHOT_CODE=ka,label=contintLabsSlave%20&&%20UbuntuTrusty/10/ [13:33:39] Project browsertests-ContentTranslation-language-screenshot-os_x_10.10-firefox » es,contintLabsSlave && UbuntuTrusty build #10: SUCCESS in 42 min: https://integration.wikimedia.org/ci/job/browsertests-ContentTranslation-language-screenshot-os_x_10.10-firefox/LANGUAGE_SCREENSHOT_CODE=es,label=contintLabsSlave%20&&%20UbuntuTrusty/10/ [13:35:01] Project browsertests-ContentTranslation-language-screenshot-os_x_10.10-firefox » pt,contintLabsSlave && UbuntuTrusty build #10: SUCCESS in 44 min: https://integration.wikimedia.org/ci/job/browsertests-ContentTranslation-language-screenshot-os_x_10.10-firefox/LANGUAGE_SCREENSHOT_CODE=pt,label=contintLabsSlave%20&&%20UbuntuTrusty/10/ [13:35:38] 10Browser-Tests, 6Collaboration-Team-Backlog, 10Echo: Fix or delete failing Echo browsertests Jenkins jobs - https://phabricator.wikimedia.org/T94152#1674443 (10zeljkofilipin) 5duplicate>3Open [13:35:40] 5Release-Engineering-Epics, 7Epic, 5Patch-For-Review, 7Tracking: Fix or delete failing browsertests* Jenkins jobs - https://phabricator.wikimedia.org/T94150#1674448 (10zeljkofilipin) [13:36:11] Project browsertests-ContentTranslation-language-screenshot-os_x_10.10-firefox » kn,contintLabsSlave && UbuntuTrusty build #10: SUCCESS in 45 min: https://integration.wikimedia.org/ci/job/browsertests-ContentTranslation-language-screenshot-os_x_10.10-firefox/LANGUAGE_SCREENSHOT_CODE=kn,label=contintLabsSlave%20&&%20UbuntuTrusty/10/ [13:36:46] 5Release-Engineering-Epics, 7Epic, 5Patch-For-Review, 7Tracking: Fix or delete failing browsertests* Jenkins jobs - https://phabricator.wikimedia.org/T94150#1156290 (10zeljkofilipin) [13:37:20] Project browsertests-ContentTranslation-language-screenshot-os_x_10.10-firefox » ro,contintLabsSlave && UbuntuTrusty build #10: SUCCESS in 46 min: https://integration.wikimedia.org/ci/job/browsertests-ContentTranslation-language-screenshot-os_x_10.10-firefox/LANGUAGE_SCREENSHOT_CODE=ro,label=contintLabsSlave%20&&%20UbuntuTrusty/10/ [13:38:40] Project browsertests-ContentTranslation-language-screenshot-os_x_10.10-firefox » hr,contintLabsSlave && UbuntuTrusty build #10: FAILURE in 47 min: https://integration.wikimedia.org/ci/job/browsertests-ContentTranslation-language-screenshot-os_x_10.10-firefox/LANGUAGE_SCREENSHOT_CODE=hr,label=contintLabsSlave%20&&%20UbuntuTrusty/10/ [13:39:36] 10Browser-Tests, 10CirrusSearch, 6Discovery: Fix or delete failing CirrusSearch browsertests Jenkins jobs - https://phabricator.wikimedia.org/T113727#1674476 (10dcausse) This test has been marked with `@expect_failure` on our side. So I think it's safe to remove the "Fill in search term and click search" tes... [13:39:41] 5Release-Engineering-Epics, 7Epic, 5Patch-For-Review, 7Tracking: Fix or delete failing browsertests* Jenkins jobs - https://phabricator.wikimedia.org/T94150#1674484 (10zeljkofilipin) [13:39:42] 10Browser-Tests, 6Collaboration-Team-Backlog, 10Flow: Fix or delete failing Flow browsertests Jenkins jobs - https://phabricator.wikimedia.org/T94153#1674477 (10zeljkofilipin) 5Resolved>3Open a:5SBisson>3None [13:39:59] Project browsertests-ContentTranslation-language-screenshot-os_x_10.10-firefox » he,contintLabsSlave && UbuntuTrusty build #10: FAILURE in 49 min: https://integration.wikimedia.org/ci/job/browsertests-ContentTranslation-language-screenshot-os_x_10.10-firefox/LANGUAGE_SCREENSHOT_CODE=he,label=contintLabsSlave%20&&%20UbuntuTrusty/10/ [13:40:25] 5Release-Engineering-Epics, 7Epic, 5Patch-For-Review, 7Tracking: Fix or delete failing browsertests* Jenkins jobs - https://phabricator.wikimedia.org/T94150#1156290 (10zeljkofilipin) [13:41:06] Project browsertests-ContentTranslation-language-screenshot-os_x_10.10-firefox » sr,contintLabsSlave && UbuntuTrusty build #10: SUCCESS in 50 min: https://integration.wikimedia.org/ci/job/browsertests-ContentTranslation-language-screenshot-os_x_10.10-firefox/LANGUAGE_SCREENSHOT_CODE=sr,label=contintLabsSlave%20&&%20UbuntuTrusty/10/ [13:41:31] 5Release-Engineering-Epics, 7Epic, 5Patch-For-Review, 7Tracking: Fix or delete failing browsertests* Jenkins jobs - https://phabricator.wikimedia.org/T94150#1156290 (10zeljkofilipin) [13:42:34] Project browsertests-ContentTranslation-language-screenshot-os_x_10.10-firefox » fa,contintLabsSlave && UbuntuTrusty build #10: SUCCESS in 51 min: https://integration.wikimedia.org/ci/job/browsertests-ContentTranslation-language-screenshot-os_x_10.10-firefox/LANGUAGE_SCREENSHOT_CODE=fa,label=contintLabsSlave%20&&%20UbuntuTrusty/10/ [13:43:58] Project browsertests-ContentTranslation-language-screenshot-os_x_10.10-firefox » hsb,contintLabsSlave && UbuntuTrusty build #10: SUCCESS in 53 min: https://integration.wikimedia.org/ci/job/browsertests-ContentTranslation-language-screenshot-os_x_10.10-firefox/LANGUAGE_SCREENSHOT_CODE=hsb,label=contintLabsSlave%20&&%20UbuntuTrusty/10/ [13:45:09] (03CR) 10jenkins-bot: [V: 04-1] Migrate integration-config-tox-dib from Trusty to Jessie [integration/config] - 10https://gerrit.wikimedia.org/r/241013 (owner: 10Hashar) [13:45:19] Project browsertests-ContentTranslation-language-screenshot-os_x_10.10-firefox » ps,contintLabsSlave && UbuntuTrusty build #10: SUCCESS in 54 min: https://integration.wikimedia.org/ci/job/browsertests-ContentTranslation-language-screenshot-os_x_10.10-firefox/LANGUAGE_SCREENSHOT_CODE=ps,label=contintLabsSlave%20&&%20UbuntuTrusty/10/ [13:45:30] (03CR) 10Hashar: "recheck" [integration/config] - 10https://gerrit.wikimedia.org/r/241013 (owner: 10Hashar) [13:46:33] Project browsertests-ContentTranslation-language-screenshot-os_x_10.10-firefox » ce,contintLabsSlave && UbuntuTrusty build #10: SUCCESS in 55 min: https://integration.wikimedia.org/ci/job/browsertests-ContentTranslation-language-screenshot-os_x_10.10-firefox/LANGUAGE_SCREENSHOT_CODE=ce,label=contintLabsSlave%20&&%20UbuntuTrusty/10/ [13:47:07] 10Browser-Tests, 6Collaboration-Team-Backlog, 10Flow: Fix or delete failing Flow browsertests Jenkins jobs - https://phabricator.wikimedia.org/T94153#1674490 (10zeljkofilipin) [13:47:24] 10Browser-Tests, 6Collaboration-Team-Backlog, 10Echo: Fix or delete failing Echo browsertests Jenkins jobs - https://phabricator.wikimedia.org/T94152#1674491 (10zeljkofilipin) [13:47:57] Project browsertests-ContentTranslation-language-screenshot-os_x_10.10-firefox » fr,contintLabsSlave && UbuntuTrusty build #10: SUCCESS in 57 min: https://integration.wikimedia.org/ci/job/browsertests-ContentTranslation-language-screenshot-os_x_10.10-firefox/LANGUAGE_SCREENSHOT_CODE=fr,label=contintLabsSlave%20&&%20UbuntuTrusty/10/ [13:49:08] Project browsertests-ContentTranslation-language-screenshot-os_x_10.10-firefox » sco,contintLabsSlave && UbuntuTrusty build #10: SUCCESS in 58 min: https://integration.wikimedia.org/ci/job/browsertests-ContentTranslation-language-screenshot-os_x_10.10-firefox/LANGUAGE_SCREENSHOT_CODE=sco,label=contintLabsSlave%20&&%20UbuntuTrusty/10/ [13:50:24] Project browsertests-ContentTranslation-language-screenshot-os_x_10.10-firefox » el,contintLabsSlave && UbuntuTrusty build #10: SUCCESS in 59 min: https://integration.wikimedia.org/ci/job/browsertests-ContentTranslation-language-screenshot-os_x_10.10-firefox/LANGUAGE_SCREENSHOT_CODE=el,label=contintLabsSlave%20&&%20UbuntuTrusty/10/ [13:50:34] (03CR) 10Hashar: [C: 032] Migrate pywikibot/* tox jobs from Trusty to Jessie [integration/config] - 10https://gerrit.wikimedia.org/r/241011 (owner: 10Hashar) [13:51:38] Project browsertests-ContentTranslation-language-screenshot-os_x_10.10-firefox » cs,contintLabsSlave && UbuntuTrusty build #10: SUCCESS in 1 hr 0 min: https://integration.wikimedia.org/ci/job/browsertests-ContentTranslation-language-screenshot-os_x_10.10-firefox/LANGUAGE_SCREENSHOT_CODE=cs,label=contintLabsSlave%20&&%20UbuntuTrusty/10/ [13:52:14] (03Merged) 10jenkins-bot: Migrate pywikibot/* tox jobs from Trusty to Jessie [integration/config] - 10https://gerrit.wikimedia.org/r/241011 (owner: 10Hashar) [13:52:51] Project browsertests-ContentTranslation-language-screenshot-os_x_10.10-firefox » om,contintLabsSlave && UbuntuTrusty build #10: SUCCESS in 1 hr 2 min: https://integration.wikimedia.org/ci/job/browsertests-ContentTranslation-language-screenshot-os_x_10.10-firefox/LANGUAGE_SCREENSHOT_CODE=om,label=contintLabsSlave%20&&%20UbuntuTrusty/10/ [13:54:06] Project browsertests-ContentTranslation-language-screenshot-os_x_10.10-firefox » lb,contintLabsSlave && UbuntuTrusty build #10: SUCCESS in 1 hr 3 min: https://integration.wikimedia.org/ci/job/browsertests-ContentTranslation-language-screenshot-os_x_10.10-firefox/LANGUAGE_SCREENSHOT_CODE=lb,label=contintLabsSlave%20&&%20UbuntuTrusty/10/ [13:55:21] Project browsertests-ContentTranslation-language-screenshot-os_x_10.10-firefox » vi,contintLabsSlave && UbuntuTrusty build #10: SUCCESS in 1 hr 4 min: https://integration.wikimedia.org/ci/job/browsertests-ContentTranslation-language-screenshot-os_x_10.10-firefox/LANGUAGE_SCREENSHOT_CODE=vi,label=contintLabsSlave%20&&%20UbuntuTrusty/10/ [13:56:43] Project browsertests-ContentTranslation-language-screenshot-os_x_10.10-firefox » ilo,contintLabsSlave && UbuntuTrusty build #10: SUCCESS in 1 hr 5 min: https://integration.wikimedia.org/ci/job/browsertests-ContentTranslation-language-screenshot-os_x_10.10-firefox/LANGUAGE_SCREENSHOT_CODE=ilo,label=contintLabsSlave%20&&%20UbuntuTrusty/10/ [13:57:58] Project browsertests-ContentTranslation-language-screenshot-os_x_10.10-firefox » ast,contintLabsSlave && UbuntuTrusty build #10: SUCCESS in 1 hr 7 min: https://integration.wikimedia.org/ci/job/browsertests-ContentTranslation-language-screenshot-os_x_10.10-firefox/LANGUAGE_SCREENSHOT_CODE=ast,label=contintLabsSlave%20&&%20UbuntuTrusty/10/ [13:59:11] Project browsertests-ContentTranslation-language-screenshot-os_x_10.10-firefox » hy,contintLabsSlave && UbuntuTrusty build #10: SUCCESS in 1 hr 8 min: https://integration.wikimedia.org/ci/job/browsertests-ContentTranslation-language-screenshot-os_x_10.10-firefox/LANGUAGE_SCREENSHOT_CODE=hy,label=contintLabsSlave%20&&%20UbuntuTrusty/10/ [14:00:50] 5Release-Engineering-Epics, 7Epic, 5Patch-For-Review, 7Tracking: Fix or delete failing browsertests* Jenkins jobs - https://phabricator.wikimedia.org/T94150#1674514 (10zeljkofilipin) [14:02:49] 10Browser-Tests, 5Release-Engineering-Epics, 7Epic, 5Patch-For-Review, 7Tracking: Fix or delete failing browsertests* Jenkins jobs - https://phabricator.wikimedia.org/T94150#1156290 (10zeljkofilipin) [14:03:34] 5Release-Engineering-Epics, 7Epic, 7Tracking: [EPIC] trigger browser tests from Gerrit (tracking) - https://phabricator.wikimedia.org/T55697#1674517 (10zeljkofilipin) [14:05:35] 10Browser-Tests, 6Release-Engineering-Team, 7Tracking: Update repositories that use mediawiki_selenium Ruby gem 1.x - https://phabricator.wikimedia.org/T94083#1674522 (10zeljkofilipin) [14:11:11] 6Release-Engineering-Team, 10Wikidata: make core wmf branches only use submodule branches that run with it in CI - https://phabricator.wikimedia.org/T113731#1674540 (10JanZerebecki) 3NEW [14:12:07] 6Release-Engineering-Team, 10Wikidata: make core wmf branches only use submodule branches that run with it in CI - https://phabricator.wikimedia.org/T113731#1674559 (10JanZerebecki) Should we do what I suggested in the description for Wikidata? [14:12:36] 6Release-Engineering-Team, 10Wikidata: make core wmf branches only use submodule branches that run with it in CI - https://phabricator.wikimedia.org/T113731#1674562 (10JanZerebecki) [14:13:14] Yippee, build fixed! [14:13:15] Project browsertests-QuickSurveys-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce build #14: FIXED in 3 min 55 sec: https://integration.wikimedia.org/ci/job/browsertests-QuickSurveys-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce/14/ [14:16:08] 10Browser-Tests, 10ContentTranslation-cxserver: Fix or delete failing ContentTranslation browsertests Jenkins jobs - https://phabricator.wikimedia.org/T113734#1674579 (10zeljkofilipin) 3NEW [14:17:27] !log nodepool: regenerated new image ci-jessie-wikimedia-1443190440 to add libssl-dev ( https://gerrit.wikimedia.org/r/#/c/241037/ ) [14:17:30] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master [14:17:47] 10Browser-Tests, 5Release-Engineering-Epics, 7Epic, 5Patch-For-Review, 7Tracking: Fix or delete failing browsertests* Jenkins jobs - https://phabricator.wikimedia.org/T94150#1674589 (10zeljkofilipin) [14:18:23] 10Browser-Tests, 5Release-Engineering-Epics, 7Epic, 5Patch-For-Review, 7Tracking: Fix or delete failing browsertests* Jenkins jobs - https://phabricator.wikimedia.org/T94150#1156290 (10zeljkofilipin) [14:23:19] 10Browser-Tests, 10ContentTranslation-cxserver: Fix or delete failing ContentTranslation browsertests Jenkins jobs - https://phabricator.wikimedia.org/T113734#1674599 (10zeljkofilipin) [14:25:29] Yippee, build fixed! [14:25:29] Project browsertests-ContentTranslation-language-screenshot-os_x_10.10-firefox » af,contintLabsSlave && UbuntuTrusty build #11: FIXED in 1 min 31 sec: https://integration.wikimedia.org/ci/job/browsertests-ContentTranslation-language-screenshot-os_x_10.10-firefox/LANGUAGE_SCREENSHOT_CODE=af,label=contintLabsSlave%20&&%20UbuntuTrusty/11/ [14:25:53] 10Browser-Tests, 6Collaboration-Team-Backlog, 10Flow: Fix or delete failing Flow browsertests Jenkins jobs - https://phabricator.wikimedia.org/T94153#1674604 (10zeljkofilipin) p:5High>3Normal [14:26:07] 10Browser-Tests, 10MediaWiki-extensions-MultimediaViewer: Fix failed MultimediaViewer browsertests Jenkins jobs - https://phabricator.wikimedia.org/T94157#1674609 (10zeljkofilipin) p:5High>3Normal [14:28:54] 10Browser-Tests, 10ContentTranslation-cxserver: Fix or delete failing ContentTranslation browsertests Jenkins jobs - https://phabricator.wikimedia.org/T113734#1674612 (10zeljkofilipin) [14:31:45] (03CR) 10Hashar: [C: 032] Migrate integration-config-tox-dib from Trusty to Jessie [integration/config] - 10https://gerrit.wikimedia.org/r/241013 (owner: 10Hashar) [14:32:21] PROBLEM - Puppet failure on deployment-sca01 is CRITICAL: CRITICAL: 55.56% of data above the critical threshold [0.0] [14:33:34] 10Browser-Tests, 5Release-Engineering-Epics, 7Epic, 7Tracking: Fix or delete failing browsertests* Jenkins jobs - https://phabricator.wikimedia.org/T94150#1674641 (10zeljkofilipin) [14:40:57] 6Release-Engineering-Team, 7Tracking: Fix easy problems reported by RuboCop - https://phabricator.wikimedia.org/T91485#1674677 (10zeljkofilipin) [14:41:59] (03Merged) 10jenkins-bot: Migrate integration-config-tox-dib from Trusty to Jessie [integration/config] - 10https://gerrit.wikimedia.org/r/241013 (owner: 10Hashar) [14:45:53] (03PS1) 10Hashar: [TopTenPages] restore mw unit tests [integration/config] - 10https://gerrit.wikimedia.org/r/241049 [14:46:37] 10Continuous-Integration-Config, 7I18n: Configure banana checker for i18n files to run on all MediaWiki extensions (tracking) - https://phabricator.wikimedia.org/T94547#1674706 (10siebrand) [14:46:49] (03CR) 10Hashar: "We need extension-unittests-generic for the MediaWiki core structure tests. Added back with https://gerrit.wikimedia.org/r/241049" (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/240967 (owner: 10Krinkle) [14:47:04] (03CR) 10Hashar: [C: 032] [TopTenPages] restore mw unit tests [integration/config] - 10https://gerrit.wikimedia.org/r/241049 (owner: 10Hashar) [14:51:26] (03Merged) 10jenkins-bot: [TopTenPages] restore mw unit tests [integration/config] - 10https://gerrit.wikimedia.org/r/241049 (owner: 10Hashar) [14:53:10] (03PS1) 10Hashar: Remove tox-*-trusty job templates [integration/config] - 10https://gerrit.wikimedia.org/r/241051 [14:53:20] zeljkof: finally I have migrated the tox jobs from Trusty straight to Nodepool instances and Debian [14:53:27] only had a single issue which was trivial to fix :-} [14:53:36] hashar: yeah! :) [14:53:41] beer time! [14:53:47] so basically tox*trusty jobs are gone [14:53:52] will have to phase out the jessie ones [14:54:07] wow, nice improvement [14:54:16] we are slowly getting to the CI nirvana ;) [15:00:07] !log deleted Jenkins jobs *tox*-trusty ( https://gerrit.wikimedia.org/r/#/c/241051/ ) [15:00:11] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master [15:00:48] (03CR) 10Hashar: [C: 032] "Deleted Jenkins jobs *tox*-trusty" [integration/config] - 10https://gerrit.wikimedia.org/r/241051 (owner: 10Hashar) [15:00:52] 10Browser-Tests: Fix easy problems reported by RuboCop in ContentTranslation - https://phabricator.wikimedia.org/T113742#1674738 (10zeljkofilipin) 3NEW a:3zeljkofilipin [15:02:23] (03Merged) 10jenkins-bot: Remove tox-*-trusty job templates [integration/config] - 10https://gerrit.wikimedia.org/r/241051 (owner: 10Hashar) [15:02:34] 6Release-Engineering-Team, 7Tracking: Fix easy problems reported by RuboCop - https://phabricator.wikimedia.org/T91485#1674748 (10zeljkofilipin) [15:06:35] 3releng-201516-q2: [keyresult] CI cluster responds to spike in queued builds by starting and registering additional jenkins slaves - https://phabricator.wikimedia.org/T111106#1674754 (10hashar) Some jobs are being migrated to Nodepool. Right now it has a base pool of 10 instances and can raise it up to 20 depend... [15:07:08] (03CR) 10Chad: [C: 032] De-decorate inside_git_dir [tools/scap] - 10https://gerrit.wikimedia.org/r/240912 (owner: 10Thcipriani) [15:07:20] RECOVERY - Puppet failure on deployment-sca01 is OK: OK: Less than 1.00% above the threshold [0.0] [15:09:21] (03Merged) 10jenkins-bot: De-decorate inside_git_dir [tools/scap] - 10https://gerrit.wikimedia.org/r/240912 (owner: 10Thcipriani) [15:12:52] 10MediaWiki-Releasing, 6Developer-Relations, 10Wikimedia-Blog-Content, 3DevRel-November-2015, 5MW-1.26-release: Write blog post announcing MW 1.26 - https://phabricator.wikimedia.org/T112842#1674764 (10hashar) If we could reuse the blog content for the wiki page that would be nice. From another bug: >>!... [15:23:41] 10Browser-Tests, 10CirrusSearch, 6Discovery: Fix failing CirrusSearch browsertests Jenkins jobs - https://phabricator.wikimedia.org/T113727#1674803 (10zeljkofilipin) [15:28:35] hashar: hey there. i have a small android amendment patch for your consideration when you have time. this isn't blocking us presently: https://gerrit.wikimedia.org/r/#/c/239902/2 [15:34:38] niedzielski: good morning :) [15:34:56] hashar: \o [15:35:09] niedzielski: have you updated the related job already ? [15:35:21] (03PS3) 10Hashar: Run adb-setup before Android emulator tests [integration/config] - 10https://gerrit.wikimedia.org/r/239902 (owner: 10Niedzielski) [15:35:55] niedzielski: don't bother. doing it and +2 ing :} [15:36:00] hashar: i have not deployed. it's not clear to me if i should be doing that before or after +2 [15:36:19] for a single job like that, we usually do the deploy [15:36:21] test it works [15:36:22] then +2 [15:36:32] deployed [15:36:44] will retriever the last build of https://duckduckgo.com/?q=integration.wikimedia.org/ci/job/+apps-android-wikipedia-test&t=osx [15:36:45] grr [15:37:14] niedzielski: https://integration.wikimedia.org/ci/job/apps-android-wikipedia-test/240/consoleFull [15:37:21] it is running [15:37:25] if that works just fine we can +2 [15:37:36] so in theory you can adjust it as needed [15:38:02] hashar: sounds good. in the future, i will try to abide by this workflow [15:38:17] niedzielski: that is the fastest way for you to iterate :-} [15:38:44] you should be fine unless you attempt to update some other crazy jobs we have :D [15:39:27] (03CR) 10Hashar: "Deployed" [integration/config] - 10https://gerrit.wikimedia.org/r/239902 (owner: 10Niedzielski) [15:39:51] hashar: so far the android ones have seemed pretty sane [15:40:08] hashar: woah, no more tox on trusty? :D [15:40:16] (03PS2) 10Chad: Remove PHP localization cache code [tools/scap] - 10https://gerrit.wikimedia.org/r/240440 [15:40:46] legoktm: yeah gone !!!!!!!!!!!!!!!! [15:40:59] can we do precise too? ^.^ [15:41:00] legoktm: I have moved the -trusty and -jessie jobs to Nodepool Debian instances [15:41:04] yeah hmm [15:41:15] one breakage at the time! [15:41:32] hehe [15:41:33] I would like to see how nodepool / labs behave with the pywikibot/* activity over the week-end [15:41:58] also need to write down a nice doc to explain how to do the switch so others can handle it. The basic one is https://wikitech.wikimedia.org/wiki/Nodepool#Job_migration [15:42:06] and probably need to write an integration test [15:42:16] hashar: ok looks good [15:42:23] niedzielski: yeah I guess [15:42:32] SUCCESS implies +2 :-} [15:42:45] (03CR) 10Hashar: [C: 032] "It passes" [integration/config] - 10https://gerrit.wikimedia.org/r/239902 (owner: 10Niedzielski) [15:42:53] yeah, you HAVE to +2 [15:43:13] legoktm: in theory it is just about renaming the existing tox jobs (that runs on Precise) to be prefixed with -jessie [15:43:23] (03PS1) 10Chad: Remove wikiversions.cdb code now that we use wikiversions.php [tools/scap] - 10https://gerrit.wikimedia.org/r/241061 [15:43:35] legoktm: the Zuul regex that applies the parameter function should match them all. Iirc it is pretty wide ^tox.*-jessie$ [15:43:49] legoktm: but some jobs have the repo as a prefix [15:44:02] hmm, and they need to be generic? [15:44:14] not necessarly [15:44:19] the pywikibot ones have a prefix so they don't get into the mediawiki queue [15:44:25] yeah [15:44:34] and we might well end up decoupling all the jobs again [15:44:44] since workspace consumption on the slaves is no more going to be a concern [15:44:53] though the # of jobs on master and JJB slowness would [15:45:07] a potential idea was to prefix the job with some queue-name maybe [15:45:10] like mediawiki-tox [15:45:14] miscqueue-tox [15:46:38] that sounds reasonable [15:46:52] (03Merged) 10jenkins-bot: Run adb-setup before Android emulator tests [integration/config] - 10https://gerrit.wikimedia.org/r/239902 (owner: 10Niedzielski) [15:47:52] anyway [15:48:00] I want to migrate all tox jobs to Nodepool [15:48:10] ostriches: we should probably remove the PHP LocalisationCache from core too [15:48:15] and update the nodepool doc + trainfolks [15:48:15] and then announce it widely [15:48:20] :D [15:48:26] next step will be to migrate the ruby/bundler jobs [15:48:30] then npm [15:48:41] and composer? :) [15:48:46] but we will most probably need a shared packages cache [15:49:01] for composer, in the current situation we would need Zend 5.3 / HHVM [15:49:08] ehh right. [15:49:09] and a way to cache mediawiki/core in the images [15:49:11] so hmm [15:49:25] mediawiki.migration(stalled) [15:49:44] middle term definitely [15:49:49] I want to raise the issue of PHP 5.3 first [15:50:04] or find a way to provide it in the Jessie images [15:52:25] 10Continuous-Integration-Config, 7Technical-Debt: Migrate "analytics-*" jobs to Jenkins Job Builder - https://phabricator.wikimedia.org/T97514#1674893 (10hashar) [15:52:27] 10Continuous-Integration-Config: job analytics-wikistats has zuul trigger but vanished from integration/config - https://phabricator.wikimedia.org/T113725#1674892 (10hashar) [15:53:16] 10Continuous-Integration-Config: job analytics-wikistats has zuul trigger but vanished from integration/config - https://phabricator.wikimedia.org/T113725#1674345 (10hashar) Yup that is related to {T97514}. From there, I think I removed the jobs from JJB because analytics at the time wanted to configure them vi... [15:53:53] well I am off for now [15:54:09] will be on/off randomly over the week-end to monitor nodepool behavior and tests results [15:56:14] andrewbogott: Nodepool is a success so far! Kudos :-} [15:56:44] have a good week-end. In case of troubles ring the phone (on office wiki) [15:56:56] sounds good [15:58:00] guess I will need a few outages to write the troubleshooting doc [16:01:14] 10Continuous-Integration-Config: job analytics-wikistats has zuul trigger but vanished from integration/config - https://phabricator.wikimedia.org/T113725#1674910 (10JanZerebecki) [16:01:15] 10Continuous-Integration-Config, 7Technical-Debt: Migrate "analytics-*" jobs to Jenkins Job Builder - https://phabricator.wikimedia.org/T97514#1674911 (10JanZerebecki) [16:01:26] 10Continuous-Integration-Config, 7Technical-Debt: Migrate "analytics-*" jobs to Jenkins Job Builder - https://phabricator.wikimedia.org/T97514#1244558 (10JanZerebecki) [16:01:27] 10Continuous-Integration-Config: job analytics-wikistats has zuul trigger but vanished from integration/config - https://phabricator.wikimedia.org/T113725#1674345 (10JanZerebecki) [16:03:14] PROBLEM - Puppet failure on deployment-parsoidcache02 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [16:03:14] PROBLEM - Puppet failure on deployment-mx is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [16:03:14] PROBLEM - Puppet failure on integration-slave-jessie-1001 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [16:05:13] (03PS1) 10Thcipriani: [WIP] Add optional canary deploy group and check [tools/scap] - 10https://gerrit.wikimedia.org/r/241066 (https://phabricator.wikimedia.org/T113073) [16:06:37] 10Deployment-Systems, 3Scap3, 5Patch-For-Review: Scap3 should be able to deploy/rollback service config as part of deploy - https://phabricator.wikimedia.org/T109512#1674938 (10thcipriani) a:3thcipriani [16:08:19] (03PS12) 10Chad: A context manager for managing nested loggers [tools/scap] - 10https://gerrit.wikimedia.org/r/239028 (owner: 1020after4) [16:08:22] (03PS1) 10Chad: Convert log.Timer and log.Stats to use context logger [tools/scap] - 10https://gerrit.wikimedia.org/r/241067 [16:09:59] (03CR) 10Chad: [C: 032] A context manager for managing nested loggers [tools/scap] - 10https://gerrit.wikimedia.org/r/239028 (owner: 1020after4) [16:10:16] (03Merged) 10jenkins-bot: A context manager for managing nested loggers [tools/scap] - 10https://gerrit.wikimedia.org/r/239028 (owner: 1020after4) [16:12:09] (03CR) 10Chad: [C: 032] Simplify logging in ssh module [tools/scap] - 10https://gerrit.wikimedia.org/r/238959 (owner: 10Chad) [16:13:58] (03CR) 10Chad: [C: 032] Use context logger and stop passing one to sudo_check_call [tools/scap] - 10https://gerrit.wikimedia.org/r/240126 (owner: 10Chad) [16:14:05] (03CR) 10Chad: [C: 032] Convert log.Timer and log.Stats to use context logger [tools/scap] - 10https://gerrit.wikimedia.org/r/241067 (owner: 10Chad) [16:20:21] all the +2's [16:20:59] greg-g: ostriches on the loose! [16:21:08] :) [16:22:11] thcipriani: also, I smiled when I saw your WIP above. Was going to reply to that email I sent a couple nights ago, but I'll just have this IRC message be sufficient (but not really full of content) [16:24:59] (03PS8) 10Chad: Simplify logging in ssh module [tools/scap] - 10https://gerrit.wikimedia.org/r/238959 [16:25:02] (03PS3) 10Chad: Use context logger and stop passing one to sudo_check_call [tools/scap] - 10https://gerrit.wikimedia.org/r/240126 [16:25:05] (03PS1) 10Chad: Convert most of utils to use context loggers too! [tools/scap] - 10https://gerrit.wikimedia.org/r/241068 [16:25:33] greg-g: :D now we just need to get our post-deploy-ducks in a row and canary should be pretty much done-zo. [16:25:46] Dangit. I didn't mean to re-string all of that. [16:25:56] (03Merged) 10jenkins-bot: Convert log.Timer and log.Stats to use context logger [tools/scap] - 10https://gerrit.wikimedia.org/r/241067 (owner: 10Chad) [16:25:57] thcipriani: sweet [16:28:30] (03PS1) 10Legoktm: Replace mediawiki-core-phpcs-HEAD with mediawiki-core-phpcs [integration/config] - 10https://gerrit.wikimedia.org/r/241071 (https://phabricator.wikimedia.org/T102598) [16:31:12] (03PS2) 10Legoktm: Replace mediawiki-core-phpcs-HEAD with mediawiki-core-phpcs [integration/config] - 10https://gerrit.wikimedia.org/r/241071 (https://phabricator.wikimedia.org/T102598) [16:33:37] (03PS1) 10Dduvall: Propagate structured logging from target to deploy host [tools/scap] - 10https://gerrit.wikimedia.org/r/241074 (https://phabricator.wikimedia.org/T113085) [16:33:45] happy scappy [16:37:00] (03CR) 10Legoktm: [C: 032] Replace mediawiki-core-phpcs-HEAD with mediawiki-core-phpcs [integration/config] - 10https://gerrit.wikimedia.org/r/241071 (https://phabricator.wikimedia.org/T102598) (owner: 10Legoktm) [16:38:19] (03CR) 10Greg Grossmeier: Use Semantic versioning format for deploy notes (031 comment) [tools/release] - 10https://gerrit.wikimedia.org/r/239562 (https://phabricator.wikimedia.org/T67306) (owner: 10Florianschmidtwelzow) [16:39:29] 10Deployment-Systems, 5Patch-For-Review: Adopt Semantic Versioning format for WMF deploy branches beginning with 1.27.0-wmf.1 - https://phabricator.wikimedia.org/T67306#1675069 (10greg) My comment on the linked patch: Sorry, I'm just now replying to this. Can we do [[MediaWiki 1.27/wmf.1]] please, for the wi... [16:40:40] (03Merged) 10jenkins-bot: Replace mediawiki-core-phpcs-HEAD with mediawiki-core-phpcs [integration/config] - 10https://gerrit.wikimedia.org/r/241071 (https://phabricator.wikimedia.org/T102598) (owner: 10Legoktm) [16:41:38] !log deploying https://gerrit.wikimedia.org/r/241071 [16:41:41] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master [16:43:52] (03CR) 10Florianschmidtwelzow: Use Semantic versioning format for deploy notes (031 comment) [tools/release] - 10https://gerrit.wikimedia.org/r/239562 (https://phabricator.wikimedia.org/T67306) (owner: 10Florianschmidtwelzow) [16:44:33] (03PS1) 10Thcipriani: Fix log_context to detect positional argument [tools/scap] - 10https://gerrit.wikimedia.org/r/241076 [16:45:18] (03CR) 10Thcipriani: [C: 032] Fix log_context to detect positional argument [tools/scap] - 10https://gerrit.wikimedia.org/r/241076 (owner: 10Thcipriani) [16:45:59] 10Deployment-Systems, 5Patch-For-Review: Adopt Semantic Versioning format for WMF deploy branches beginning with 1.27.0-wmf.1 - https://phabricator.wikimedia.org/T67306#1675129 (10greg) >>! In T67306#1675069, @greg wrote: > Can we do [[MediaWiki 1.27/wmf.1]] please, for the wiki page names? I updated https://... [16:46:15] (03PS1) 10Florianschmidtwelzow: Use new page name for wmf release notes [tools/release] - 10https://gerrit.wikimedia.org/r/241078 (https://phabricator.wikimedia.org/T67306) [16:46:45] 10Continuous-Integration-Config, 10MediaWiki-Codesniffer, 5Patch-For-Review: Craft a Jenkins job that runs PHP_CodeSniffer for mw/core using composer - https://phabricator.wikimedia.org/T102598#1675133 (10Legoktm) 5Open>3Resolved a:3Legoktm Patches: * {49ff333ba92840dadec93734561ad690f3d66e23} * {8da8c... [16:48:01] (03PS2) 10Dduvall: Revert "Let MW-Selenium 1.x use the local test suite configuration" [integration/config] - 10https://gerrit.wikimedia.org/r/240701 (https://phabricator.wikimedia.org/T111510) (owner: 10Zfilipin) [16:48:41] (03Merged) 10jenkins-bot: Fix log_context to detect positional argument [tools/scap] - 10https://gerrit.wikimedia.org/r/241076 (owner: 10Thcipriani) [16:48:47] (03CR) 10Florianschmidtwelzow: "Follow up: Ia074f1a0aebf1e7685" [tools/release] - 10https://gerrit.wikimedia.org/r/239562 (https://phabricator.wikimedia.org/T67306) (owner: 10Florianschmidtwelzow) [16:49:08] (03CR) 10Greg Grossmeier: [C: 032] "You rock." [tools/release] - 10https://gerrit.wikimedia.org/r/241078 (https://phabricator.wikimedia.org/T67306) (owner: 10Florianschmidtwelzow) [16:50:12] (03CR) 10Dduvall: [C: 032] Revert "Let MW-Selenium 1.x use the local test suite configuration" [integration/config] - 10https://gerrit.wikimedia.org/r/240701 (https://phabricator.wikimedia.org/T111510) (owner: 10Zfilipin) [16:51:26] 10Deployment-Systems, 10Traffic, 6operations: Varnish cache busting desired for /static/$VERSION/ resources which change within the lifetime of a WMF release branch - https://phabricator.wikimedia.org/T99096#1675208 (10Jdlrobson) Does this also impact beta labs? I'm seeing old css/js in debug mode on T99096 [16:53:10] 10Deployment-Systems, 10Traffic, 6operations: Varnish cache busting desired for /static/$VERSION/ resources which change within the lifetime of a WMF release branch - https://phabricator.wikimedia.org/T99096#1675231 (10greg) No, Beta Cluster doesn't use wmfXX release branches. [16:54:47] 10Deployment-Systems, 10Traffic, 6operations: Varnish cache busting desired for /static/$VERSION/ resources which change within the lifetime of a WMF release branch - https://phabricator.wikimedia.org/T99096#1675267 (10Krenair) I think it does. beta remains on php-master all the time and so this problem is m... [16:55:15] 10Deployment-Systems, 10Traffic, 6operations: Varnish cache busting desired for /static/$VERSION/ resources which change within the lifetime of a branch - https://phabricator.wikimedia.org/T99096#1675271 (10Krenair) [16:55:29] 10Deployment-Systems, 10Traffic, 6operations: Varnish cache busting desired for /static/$VERSION/ resources which change within the lifetime of a branch - https://phabricator.wikimedia.org/T99096#1675273 (10greg) Bah, you're right, I was conflating tasks in my head with another related one. [17:01:05] 10Deployment-Systems, 10Traffic, 6operations: Varnish cache busting desired for /static/$VERSION/ resources which change within the lifetime of a branch - https://phabricator.wikimedia.org/T99096#1675315 (10Jdlrobson) [17:02:28] (03CR) 10Chad: [C: 032] Convert most of utils to use context loggers too! [tools/scap] - 10https://gerrit.wikimedia.org/r/241068 (owner: 10Chad) [17:02:48] (03Merged) 10jenkins-bot: Revert "Let MW-Selenium 1.x use the local test suite configuration" [integration/config] - 10https://gerrit.wikimedia.org/r/240701 (https://phabricator.wikimedia.org/T111510) (owner: 10Zfilipin) [17:02:51] (03Merged) 10jenkins-bot: Convert most of utils to use context loggers too! [tools/scap] - 10https://gerrit.wikimedia.org/r/241068 (owner: 10Chad) [17:15:06] phpcs is the first place where jenkins runs something faster than my laptop :| [17:16:07] (03PS1) 10Legoktm: Trigger phpcs jobs if phpcs.xml is modified [integration/config] - 10https://gerrit.wikimedia.org/r/241086 [17:16:37] (03PS2) 10Legoktm: Trigger phpcs jobs if phpcs.xml is modified [integration/config] - 10https://gerrit.wikimedia.org/r/241086 [17:16:47] (03CR) 10Legoktm: [C: 032] Trigger phpcs jobs if phpcs.xml is modified [integration/config] - 10https://gerrit.wikimedia.org/r/241086 (owner: 10Legoktm) [17:17:34] (03Merged) 10jenkins-bot: Trigger phpcs jobs if phpcs.xml is modified [integration/config] - 10https://gerrit.wikimedia.org/r/241086 (owner: 10Legoktm) [17:18:03] !log deploying https://gerrit.wikimedia.org/r/241086 [17:18:06] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master [17:29:24] !bash "So basically it'll look like the old DOS defragger" -- Mukunda [17:35:50] (03CR) 10Chad: [C: 032] Propagate structured logging from target to deploy host [tools/scap] - 10https://gerrit.wikimedia.org/r/241074 (https://phabricator.wikimedia.org/T113085) (owner: 10Dduvall) [17:39:07] (03Merged) 10jenkins-bot: Propagate structured logging from target to deploy host [tools/scap] - 10https://gerrit.wikimedia.org/r/241074 (https://phabricator.wikimedia.org/T113085) (owner: 10Dduvall) [17:39:28] 10Deployment-Systems, 3Scap3, 5Patch-For-Review: Support event logging propagation from target to deployment host - https://phabricator.wikimedia.org/T113085#1675501 (10demon) [17:39:30] 10Deployment-Systems, 3Scap3, 5Patch-For-Review: Improve scap's output - https://phabricator.wikimedia.org/T109858#1675500 (10demon) [17:41:39] ostriches: twentyafterfour :) :) [17:42:01] https://tools.wmflabs.org/bash/quip/AVAFjWgf1oXzWjit5sE7 [17:42:14] hehehe [17:43:13] (03PS1) 10Legoktm: Add -s flag to mediawiki-core-phpcs for easy debugging [integration/config] - 10https://gerrit.wikimedia.org/r/241096 [17:44:18] 10MediaWiki-Releasing, 10ReleaseTaggerBot: Change how ReleaseTaggerBot handles major MW releases - https://phabricator.wikimedia.org/T113628#1675514 (10greg) I don't think you're understanding my proposal then, because no where does this throw away the work that RTB does, it just moves it to #MW-X.YY-release-n... [17:45:35] (03CR) 10Legoktm: [C: 032] "Deployed" [integration/config] - 10https://gerrit.wikimedia.org/r/241096 (owner: 10Legoktm) [17:45:40] 10MediaWiki-Releasing, 10ReleaseTaggerBot: Change how ReleaseTaggerBot handles major MW releases - https://phabricator.wikimedia.org/T113628#1675523 (10greg) (Also, the change would happen for 1.26, only for 1.27 onwards, just to be explicit) [17:46:04] wouldn't* (wikibugs doesn't announce comment edits) [17:48:21] (03Merged) 10jenkins-bot: Add -s flag to mediawiki-core-phpcs for easy debugging [integration/config] - 10https://gerrit.wikimedia.org/r/241096 (owner: 10Legoktm) [17:51:10] phab doesn't notify anyone on comment edits :( [17:54:37] 10Continuous-Integration-Infrastructure, 6Release-Engineering-Team, 10Wikidata: make core wmf branches only use submodule branches that run with it in CI - https://phabricator.wikimedia.org/T113731#1675563 (10greg) [17:57:49] 10MediaWiki-Releasing, 10ReleaseTaggerBot: Change how ReleaseTaggerBot handles major MW releases - https://phabricator.wikimedia.org/T113628#1675586 (10greg) The question really is: Who "owns" the MW-X.YY-release projects, the team managing the release of MW or a bot/the release notes? :) I go with the former... [18:00:30] legoktm: yeah, and when you mistype and change your meaning to the opposite, that's kind of annoying :) [18:04:31] 10Beta-Cluster, 6Collaboration-Team-Backlog, 10MediaWiki-Recent-changes: [enwiki-betacluster] Special: Recent changes page is not displayed correctly - https://phabricator.wikimedia.org/T113660#1675604 (10Mattflaschen) Thanks. I don't know why it doesn't show that message at http://en.wikipedia.beta.wmflabs... [18:06:00] PROBLEM - Free space - all mounts on integration-slave-trusty-1013 is CRITICAL: CRITICAL: integration.integration-slave-trusty-1013.diskspace._mnt.byte_percentfree (<10.00%) [18:13:39] 10MediaWiki-Releasing, 10ReleaseTaggerBot: Change how ReleaseTaggerBot handles major MW releases - https://phabricator.wikimedia.org/T113628#1675635 (10greg) (sorry, I'm thinking in piece-meal today...) Why have the bot move instead of the release team? Because people already treat the #MW-X.YY-release projec... [18:18:21] 10Deployment-Systems, 3Scap3: Fetch submodules from the deploy host - https://phabricator.wikimedia.org/T113777#1675645 (10dduvall) 3NEW a:3dduvall [18:19:03] 10Deployment-Systems, 3Scap3, 5Patch-For-Review: Improve scap's output - https://phabricator.wikimedia.org/T109858#1675658 (10dduvall) [18:19:05] 10Deployment-Systems, 3Scap3, 5Patch-For-Review: Support event logging propagation from target to deployment host - https://phabricator.wikimedia.org/T113085#1675657 (10dduvall) 5Open>3Resolved [18:22:13] 10Deployment-Systems, 3Scap3: Limit structured logging output for now - https://phabricator.wikimedia.org/T113779#1675683 (10dduvall) 3NEW a:3dduvall [18:24:55] 6Release-Engineering-Team, 15User-greg: Investigate https://scrutinizer-ci.com/pricing WMF logo use - https://phabricator.wikimedia.org/T110396#1675709 (10greg) >>! In T110396#1633983, @greg wrote: > Thank you for the clarification. I'll reach out to them next week. wrist, priorities, etc got in the way. Emai... [18:26:19] 10Continuous-Integration-Infrastructure, 6operations: Forbid quoted booleans in puppet manifests - https://phabricator.wikimedia.org/T113783#1675730 (10Andrew) 3NEW [18:28:59] twentyafterfour, greg-g: did we get to any solution about the right way to deploy portals? [18:31:38] 10Browser-Tests, 6Collaboration-Team-Backlog, 10Echo: Fix or delete failing Echo browsertests Jenkins jobs - https://phabricator.wikimedia.org/T94152#1675758 (10Mattflaschen) These will all be rewritten due to the rewrite of the Echo frontend. [18:32:16] 10Continuous-Integration-Infrastructure, 7WorkType-Maintenance: New Trusty slaves can't run the mediawiki qunit jobs - https://phabricator.wikimedia.org/T113489#1675762 (10hashar) Tried again and a build passed: https://integration.wikimedia.org/ci/job/hashar-T113489/4/ But the next one failed https://integ... [18:34:45] 10Continuous-Integration-Config, 6operations: Forbid quoted booleans in puppet manifests - https://phabricator.wikimedia.org/T113783#1675765 (10hashar) [18:37:32] 10Continuous-Integration-Config, 6operations: Forbid quoted booleans in puppet manifests - https://phabricator.wikimedia.org/T113783#1675776 (10hashar) Seems like we want to enable the relevant puppet-lint check http://puppet-lint.com/checks/quoted_booleans/ Unfortunately some of our classes expect quoted boo... [18:38:13] 10Beta-Cluster, 6operations, 7Shinken: Make the Shinken IRC alert bot use colors - https://phabricator.wikimedia.org/T113785#1675779 (10greg) 3NEW [18:40:25] 10Continuous-Integration-Config, 6operations, 5Patch-For-Review: Forbid quoted booleans in puppet manifests - https://phabricator.wikimedia.org/T113783#1675795 (10hashar) Example: https://integration.wikimedia.org/ci/job/operations-puppet-puppetlint-strict/29104/console [18:48:46] 10Continuous-Integration-Config, 6operations, 5Patch-For-Review: Forbid quoted booleans in puppet manifests - https://phabricator.wikimedia.org/T113783#1675815 (10greg) Only the quoted_booleans warnings (71 of 'em): {P2094} [18:50:32] (03PS1) 10Chad: Comment typofix [tools/scap] - 10https://gerrit.wikimedia.org/r/241114 [19:09:23] 10Continuous-Integration-Infrastructure, 7WorkType-Maintenance: New Trusty slaves can't run the mediawiki qunit jobs - https://phabricator.wikimedia.org/T113489#1675854 (10hashar) Doing a diff between the debug logs does not show anything suspicious. [19:10:53] Project browsertests-VisualEditor-language-screenshot-os_x_10.10-firefox » zh-hans,contintLabsSlave && UbuntuTrusty build #75: ABORTED in 9 hr 26 min: https://integration.wikimedia.org/ci/job/browsertests-VisualEditor-language-screenshot-os_x_10.10-firefox/LANGUAGE_SCREENSHOT_CODE=zh-hans,label=contintLabsSlave%20&&%20UbuntuTrusty/75/ [19:36:25] SMalyshev: I still think the right way is to just check out a submodule but several people disagreed so :-/ [19:37:02] twentyafterfour: so how we could move this forward? [19:39:18] SMalyshev: I really don't know of any better way than what I suggested yesterday [19:40:08] SMalyshev: Well, I could just set up a git clone that auto-updates the master branch periodically [19:40:16] via puppet [19:40:27] then any commits to master [19:40:38] would automatically appear live after 20 minutes [19:40:45] that doesn't give any way to do rollback though [19:41:14] twentyafterfour: master branch of what? [19:41:55] your portals repo [19:42:06] no forget all that. I'm going to set it up to use scap [20:26:47] (03CR) 10Ori.livneh: [C: 032] Remove wikiversions.cdb code now that we use wikiversions.php [tools/scap] - 10https://gerrit.wikimedia.org/r/241061 (owner: 10Chad) [20:27:03] (03CR) 10Ori.livneh: [C: 032] Remove PHP localization cache code [tools/scap] - 10https://gerrit.wikimedia.org/r/240440 (owner: 10Chad) [20:27:23] (03Merged) 10jenkins-bot: Remove PHP localization cache code [tools/scap] - 10https://gerrit.wikimedia.org/r/240440 (owner: 10Chad) [20:27:26] (03Merged) 10jenkins-bot: Remove wikiversions.cdb code now that we use wikiversions.php [tools/scap] - 10https://gerrit.wikimedia.org/r/241061 (owner: 10Chad) [21:01:58] 6Release-Engineering-Team, 7Tracking: Fix easy problems reported by RuboCop - https://phabricator.wikimedia.org/T91485#1676519 (10zeljkofilipin) [21:04:30] 10Browser-Tests, 10Continuous-Integration-Infrastructure, 10VisualEditor, 5Patch-For-Review: browsertests-VisualEditor-language-screenshot-os_x_10.10-firefox jenkins job failing - https://phabricator.wikimedia.org/T111510#1676537 (10zeljkofilipin) 5Open>3Resolved [21:09:05] 10Browser-Tests, 6Collaboration-Team-Backlog, 10Echo: Fix or delete failing Echo browsertests Jenkins jobs - https://phabricator.wikimedia.org/T94152#1676556 (10zeljkofilipin) @Mattflaschen should we delete the jobs? We can easily restore them once they are green again. [21:19:14] 10Browser-Tests, 6Collaboration-Team-Backlog, 10Echo: Fix or delete failing Echo browsertests Jenkins jobs - https://phabricator.wikimedia.org/T94152#1676570 (10Mattflaschen) Let's keep them for now, since @mooeypoo is actively working on the rewrite. [21:27:16] 10Browser-Tests, 7I18n, 5Patch-For-Review: Hacking: Load i18n messages from MediaWiki to browser tests - https://phabricator.wikimedia.org/T90577#1676575 (10zeljkofilipin) @qgil: the related commit is ready to be merged. It is waiting for review. [21:28:47] 5Continuous-Integration-Scaling: Add monitoring and capacity planning for Nodepool - https://phabricator.wikimedia.org/T113806#1676584 (10hashar) 3NEW [21:29:20] 5Continuous-Integration-Scaling: Add monitoring and capacity planning for Nodepool - https://phabricator.wikimedia.org/T113806#1676593 (10hashar) Will fill sub tasks eventually. Some I can pair them with @zeljkofilipin for puppet level up :-} [21:29:35] 5Continuous-Integration-Scaling, 7Nodepool: Add monitoring and capacity planning for Nodepool - https://phabricator.wikimedia.org/T113806#1676594 (10hashar) [21:29:45] it is never ending [21:29:53] brain dumped. Have a good week-end [21:30:31] hashar: enjoy your weekend! [21:34:42] 10Browser-Tests, 6Release-Engineering-Team, 7Tracking: Update repositories that use mediawiki_selenium Ruby gem 1.x - https://phabricator.wikimedia.org/T94083#1676631 (10zeljkofilipin) [21:34:44] 10Browser-Tests, 10MediaWiki-extensions-ZeroBanner: Update ZeroBanner repository to mediawiki_selenium Ruby gem 1.1 - https://phabricator.wikimedia.org/T99657#1676626 (10zeljkofilipin) 5Open>3Invalid a:3zeljkofilipin Obsoleted by T113463 [21:37:00] zeljkof: Hello ! I will try to take care of my wikimania tasks backlog tomorrow. :) [21:37:14] vikasyaligar: great! :) [21:37:38] I have just rebased https://gerrit.wikimedia.org/r/#/c/225288/ [21:38:12] zeljkof: Awesome ! Thank you :) [21:38:14] the only thing left is https://gerrit.wikimedia.org/r/#/c/225845/ [21:38:24] and welcome back! :) [21:38:42] zeljkof: Thank you! :) [21:38:43] also, if it is almost midnight here, what time is it for you?! ;) [21:39:16] 3 am morning :) [21:39:38] OK ! I think I can get done with this one(https://gerrit.wikimedia.org/r/#/c/225845/) now :) [21:39:48] oh, you young kids... :D [21:40:07] vikasyaligar: yeah, I was just not sure what it was all about [21:40:38] zeljkof: https://github.com/amire80/screenshot#007-2015-07-19 [21:41:11] vikasyaligar: now I remember! :) [21:41:21] I could have looked there myself... [21:41:29] Yippee, build fixed! [21:41:30] Project browsertests-CirrusSearch-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #716: FIXED in 51 sec: https://integration.wikimedia.org/ci/job/browsertests-CirrusSearch-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce/716/ [21:41:40] anyway, feel free to add the explanation to the commit message [21:42:08] zeljkof: Hmm ! Yup. [21:44:21] zeljkof: Was there a phabricator ticket for this(https://gerrit.wikimedia.org/r/#/c/225845/2) ? [21:44:29] 10Browser-Tests, 5Release-Engineering-Epics, 7Epic, 7Tracking: Fix or delete failing browsertests* Jenkins jobs - https://phabricator.wikimedia.org/T94150#1676652 (10zeljkofilipin) [21:44:32] 10Browser-Tests, 10CirrusSearch, 6Discovery, 5Patch-For-Review: Fix failing CirrusSearch browsertests Jenkins jobs - https://phabricator.wikimedia.org/T113727#1676650 (10zeljkofilipin) 5Open>3Resolved Back to green! {icon money color=green} https://integration.wikimedia.org/ci/view/BrowserTests/view/C... [21:44:51] vikasyaligar: hm, not sure [21:44:57] that is what confused me [21:45:11] there should be, right? I remember us talking about it [21:45:21] not sure if anybody created a task [21:46:02] zeljkof: ah ! I remember creating github issue: https://github.com/amire80/screenshot/issues/12. I might have forgotten to create phabricator ticket. [21:46:33] reference it in the commit [21:46:47] there is probably no need to copy the issue to phab [21:46:56] zeljkof: OK [21:46:58] but feel free to do it, if you prefere [21:47:01] prefer [21:47:45] zeljkof: I will create phabricator ticket next time :). This time I will reference it with github issue. [21:47:59] vikasyaligar: yeah, that should be fine [21:48:09] I just do not do anything without a phab ticket :) [21:49:49] zeljkof: haha [21:49:59] zeljkof: Done. Updated: https://gerrit.wikimedia.org/r/#/c/225845/ [21:52:57] vikasyaligar: merged [21:53:03] will rerun the tests [21:53:15] zeljkof: woohoo ! Thank you :) [21:53:40] vikasyaligar: thank _you_ ;) [21:54:43] 10Continuous-Integration-Config, 10MediaWiki-Codesniffer: Craft a Jenkins job that runs PHP_CodeSniffer for mw/core using composer - https://phabricator.wikimedia.org/T102598#1676684 (10Ricordisamoa) [21:55:50] vikasyaligar: don't hold your breath, the last build took 9.5 hours :) [21:55:51] https://integration.wikimedia.org/ci/view/BrowserTests/view/language-screenshot/job/browsertests-VisualEditor-language-screenshot-os_x_10.10-firefox/buildTimeTrend [21:56:38] zeljkof: Hmm ! But it failed :( [21:57:03] I think it is because of this: https://phabricator.wikimedia.org/T111525 [21:57:06] vikasyaligar: actually, I think just a few jobs failed, i18n files are missing [21:57:25] zeljkof: Yup ! Let me submit a patch for that now. [21:57:54] assign the task to yourself, so amir knows you are working on it [21:58:00] zeljkof: OK ! [21:58:09] great [21:58:58] 10Browser-Tests, 10VisualEditor: No such file or directory - i18n/af.json (Errno::ENOENT) - https://phabricator.wikimedia.org/T111525#1676697 (10Vikassy) a:5Amire80>3Vikassy Ah ! Forgot about this one. I will take care of this. [21:59:45] 10Browser-Tests, 10VisualEditor: No such file or directory - i18n/af.json (Errno::ENOENT) - https://phabricator.wikimedia.org/T111525#1676709 (10zeljkofilipin) [21:59:48] 10Browser-Tests, 10VisualEditor: Delete or fix failed VisualEditor browsertests Jenkins job - https://phabricator.wikimedia.org/T94162#1676708 (10zeljkofilipin) [22:01:51] PROBLEM - Puppet failure on deployment-restbase02 is CRITICAL: CRITICAL: 50.00% of data above the critical threshold [0.0] [22:04:37] eek [22:04:47] thcipriani: ^ related to what you just merged in prod? [22:04:53] keyholder arming needed? [22:04:57] looking [22:05:58] 10Browser-Tests, 10MediaWiki-extensions-GettingStarted: Upgrade GettingStarted browser tests to use mediawiki_selenium 1.x - https://phabricator.wikimedia.org/T99655#1676722 (10zeljkofilipin) a:3zeljkofilipin [22:07:59] greg-g: fixed. [22:08:07] wee [22:08:09] what was it? [22:08:16] just an ordering problem: a user has to exist before they can chown stuff :) [22:08:20] (03PS1) 10Dduvall: Release minor version 1.6.0 [selenium] - 10https://gerrit.wikimedia.org/r/241234 [22:08:23] stupid rules [22:14:42] 10Browser-Tests: Release and announce mediawiki_selenium 1.6.0 - https://phabricator.wikimedia.org/T113811#1676732 (10dduvall) 3NEW a:3dduvall [22:15:13] (03PS2) 10Dduvall: Release minor version 1.6.0 [selenium] - 10https://gerrit.wikimedia.org/r/241234 (https://phabricator.wikimedia.org/T113811) [22:19:44] (03CR) 10Zfilipin: [C: 032] Release minor version 1.6.0 [selenium] - 10https://gerrit.wikimedia.org/r/241234 (https://phabricator.wikimedia.org/T113811) (owner: 10Dduvall) [22:21:36] zeljkof: w00t [22:21:46] thanks dawg [22:21:52] RECOVERY - Puppet failure on deployment-restbase02 is OK: OK: Less than 1.00% above the threshold [0.0] [22:22:19] marxarelli: yo! :D [22:24:41] (03Merged) 10jenkins-bot: Release minor version 1.6.0 [selenium] - 10https://gerrit.wikimedia.org/r/241234 (https://phabricator.wikimedia.org/T113811) (owner: 10Dduvall) [22:27:55] 10Browser-Tests, 5Patch-For-Review: Release and announce mediawiki_selenium 1.6.0 - https://phabricator.wikimedia.org/T113811#1676815 (10dduvall) The gem has been released. I'll message the QA mailing list on Monday when my brain is working unless @zeljkofilipin beats me to it. [22:28:06] 10Browser-Tests, 6Release-Engineering-Team, 5Patch-For-Review: Release and announce mediawiki_selenium 1.6.0 - https://phabricator.wikimedia.org/T113811#1676816 (10greg) [22:37:21] PROBLEM - Free space - all mounts on deployment-bastion is CRITICAL: CRITICAL: deployment-prep.deployment-bastion.diskspace._var.byte_percentfree (<33.33%) [22:42:28] zeljkof: https://gerrit.wikimedia.org/r/#/c/241248/ [22:57:21] RECOVERY - Free space - all mounts on deployment-bastion is OK: OK: All targets OK [22:57:46] every day at about this time that alert goes off and fixes itself :( [22:58:04] * greg-g will get over it until it fills up to 100% [23:04:18] heh, I fixed that one. I'm pretty sure usually someone is fixing it :) [23:04:53] ugh [23:11:01] PROBLEM - Free space - all mounts on integration-slave-trusty-1013 is CRITICAL: CRITICAL: integration.integration-slave-trusty-1013.diskspace._mnt.byte_percentfree (<50.00%) [23:14:27] ooo, another one? [23:24:40] thcipriani is the invisible hand that regulates disk space