[00:13:30] <grrrit-wm>	 (03CR) 10EBernhardson: "in addition to my comments please look at the jenkins output" (035 comments) [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/275747 (https://phabricator.wikimedia.org/T130004) (owner: 10Lethexie)
[00:16:38] <wikibugs>	 03Scap3: Scap hangs when a server isn't responsive - https://phabricator.wikimedia.org/T136255#2328750 (10bd808) If the host is completely down or aborts the ssh connection, scap will note the failure and move on. The problems happen when the ssh connection is established but the host is unresponsive. There is n...
[00:22:42] <wikibugs>	 10Deployment-Systems, 03Scap3, 06Operations: Warning: rename(): Permission denied in /srv/mediawiki/wmf-config/CommonSettings.php on line 189 - https://phabricator.wikimedia.org/T136258#2328753 (10Dereckson)
[00:35:55] <wikibugs>	 10Beta-Cluster-Infrastructure, 06Operations, 07Puppet: Hiera hierarchy hieradata/role/* is not applied on labs (eg  deployment-prep) - https://phabricator.wikimedia.org/T136080#2322414 (10scfc) Is this task a duplicate of T120165?
[00:37:48] <wikibugs>	 10Beta-Cluster-Infrastructure, 06Operations, 07Puppet: Hiera hierarchy hieradata/role/* is not applied on labs (eg  deployment-prep) - https://phabricator.wikimedia.org/T136080#2322414 (10Dzahn) yes, i think that's a duplicate. a real "merge" of the content is still being missed for these cases
[00:53:36] <wikibugs>	 10Deployment-Systems, 03Scap3, 06Operations: Warning: rename(): Permission denied in /srv/mediawiki/wmf-config/CommonSettings.php on line 189 - https://phabricator.wikimedia.org/T136258#2328799 (10bd808) These are temp files for the WM globals cache. The files in /tmp are being created with l10nupdate:l10nup...
[01:33:32] <wikibugs>	 10Continuous-Integration-Infrastructure: operations-puppet-tox-pep8-jessie jobs broken: rsync No such file or directory - https://phabricator.wikimedia.org/T136261#2328843 (10bd808)
[01:57:17] <wmf-insecte>	 Yippee, build fixed!
[01:57:18] <wmf-insecte>	 Project browsertests-Wikidata-WikidataTests-Group0-SmokeTests-linux-firefox-sauce build #59: 09FIXED in 17 min: https://integration.wikimedia.org/ci/job/browsertests-Wikidata-WikidataTests-Group0-SmokeTests-linux-firefox-sauce/59/
[02:14:07] <wikibugs>	 03Scap3: Scap hangs when a server isn't responsive - https://phabricator.wikimedia.org/T136255#2328860 (10mmodell) p:05Triage>03Normal We certainly could add some sort of timeout to abort and/or retry, however, as @bd808 already pointed out, it's difficult to know where to set the timeout.  In general I do t...
[02:17:14] <wmf-insecte>	 Project selenium-QuickSurveys » chrome,beta,Linux,contintLabsSlave && UbuntuTrusty build #35: 04FAILURE in 4 min 13 sec: https://integration.wikimedia.org/ci/job/selenium-QuickSurveys/BROWSER=chrome,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/35/
[02:52:12] <shinken-wm>	 PROBLEM - Free space - all mounts on deployment-fluorine is CRITICAL: CRITICAL: deployment-prep.deployment-fluorine.diskspace._srv.byte_percentfree (<100.00%)
[04:29:37] <wikibugs>	 10Deployment-Systems, 03Scap3, 06Operations, 13Patch-For-Review: Warning: rename(): Permission denied in /srv/mediawiki/wmf-config/CommonSettings.php on line 189 - https://phabricator.wikimedia.org/T136258#2328938 (10bd808) Temporary files left by l10nupdate failures can be cleaned up with: ``` sudo -u l10...
[05:01:51] <grrrit-wm>	 (03CR) 10Florianschmidtwelzow: "Thanks for merging, Hashar :)" [integration/config] - 10https://gerrit.wikimedia.org/r/288514 (owner: 10Florianschmidtwelzow)
[06:30:28] <shinken-wm>	 PROBLEM - App Server Main HTTP Response on deployment-mediawiki02 is CRITICAL: Connection refused
[06:44:15] <shinken-wm>	 PROBLEM - App Server Main HTTP Response on deployment-mediawiki01 is CRITICAL: Connection refused
[06:44:31] <shinken-wm>	 PROBLEM - English Wikipedia Mobile Main page on beta-cluster is CRITICAL: HTTP CRITICAL: HTTP/1.1 503 Service Unavailable - string 'Wikipedia' not found on 'http://en.m.wikipedia.beta.wmflabs.org:80/wiki/Main_Page?debug=true' - 2165 bytes in 0.004 second response time
[06:45:05] <shinken-wm>	 PROBLEM - Puppet run on deployment-kafka04 is CRITICAL: CRITICAL: 33.33% of data above the critical threshold [0.0]
[06:46:24] <shinken-wm>	 PROBLEM - English Wikipedia Main page on beta-cluster is CRITICAL: HTTP CRITICAL: HTTP/1.1 503 Service Unavailable - string 'Wikipedia' not found on 'http://en.wikipedia.beta.wmflabs.org:80/wiki/Main_Page?debug=true' - 2165 bytes in 0.013 second response time
[06:51:24] <shinken-wm>	 RECOVERY - English Wikipedia Main page on beta-cluster is OK: HTTP OK: HTTP/1.1 200 OK - 43281 bytes in 1.027 second response time
[06:54:32] <shinken-wm>	 RECOVERY - English Wikipedia Mobile Main page on beta-cluster is OK: HTTP OK: HTTP/1.1 200 OK - 29453 bytes in 0.711 second response time
[06:55:28] <shinken-wm>	 RECOVERY - App Server Main HTTP Response on deployment-mediawiki02 is OK: HTTP OK: HTTP/1.1 200 OK - 42944 bytes in 0.803 second response time
[06:55:51] <icinga-wm>	 RECOVERY - puppet last run on gallium is OK: OK: Puppet is currently enabled, last run 38 seconds ago with 0 failures
[06:57:59] <shinken-wm>	 PROBLEM - App Server Main HTTP Response on deployment-mediawiki03 is CRITICAL: Connection refused
[07:07:03] <shinken-wm>	 RECOVERY - Free space - all mounts on deployment-fluorine is OK: OK: All targets OK
[07:14:16] <shinken-wm>	 RECOVERY - App Server Main HTTP Response on deployment-mediawiki01 is OK: HTTP OK: HTTP/1.1 200 OK - 42944 bytes in 0.903 second response time
[07:15:24] <wikibugs>	 03Scap3, 06Revision-Scoring-As-A-Service: Scap3 checks should act based on alphabetical order of checks - https://phabricator.wikimedia.org/T136253#2328523 (10mobrovac) I'm strongly opposing this. Having Scap3 reorder the checks in whichever way means that its users must have intimate knowledge of the system i...
[07:21:57] <shinken-wm>	 RECOVERY - Puppet run on integration-slave-precise-1002 is OK: OK: Less than 1.00% above the threshold [0.0]
[07:23:01] <shinken-wm>	 RECOVERY - App Server Main HTTP Response on deployment-mediawiki03 is OK: HTTP OK: HTTP/1.1 200 OK - 42938 bytes in 1.440 second response time
[07:31:35] <gehel>	 !log deployment-prep deploying new elasticsearch plugins (T133124)
[07:31:36] <stashbot>	 T133124: Devise a plan on how to upgrade to Elasticsearch 2.3 without turning user-facing search features off - https://phabricator.wikimedia.org/T133124
[07:31:41] <qa-morebots>	 Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master
[07:36:13] <dcausse>	 !log deployment-prep elastic: updating cirrussearch warmers (T133124)
[07:36:13] <stashbot>	 T133124: Devise a plan on how to upgrade to Elasticsearch 2.3 without turning user-facing search features off - https://phabricator.wikimedia.org/T133124
[07:36:18] <qa-morebots>	 Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master
[07:48:08] <gehel>	 !log deployment-prep upgrading elasticsearch to 2.3.3 and restarting (T133124)
[07:48:08] <stashbot>	 T133124: Devise a plan on how to upgrade to Elasticsearch 2.3 without turning user-facing search features off - https://phabricator.wikimedia.org/T133124
[07:48:13] <qa-morebots>	 Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master
[08:09:15] <wikibugs>	 03Scap3, 06Revision-Scoring-As-A-Service: Scap3 checks should act based on alphabetical order of checks - https://phabricator.wikimedia.org/T136253#2329179 (10Ladsgroup) >>! In T136253#2329091, @mobrovac wrote: > I'm strongly opposing this. Having Scap3 reorder the checks in whichever way means that its users...
[08:20:07] <wikibugs>	 03Scap3, 06Revision-Scoring-As-A-Service: Scap3 checks should act based on alphabetical order of checks - https://phabricator.wikimedia.org/T136253#2329211 (10mobrovac) >>! In T136253#2329179, @Ladsgroup wrote: > Scap3 reorder checks randomly (since it turn the yaml file to a dictionary and order in dictionari...
[08:25:33] <wikibugs>	 10Continuous-Integration-Infrastructure: castor-load reports when cache has not been populated yet "broken: rsync No such file or directory" (eg: operations-puppet-tox-pep8-jessie jobs) - https://phabricator.wikimedia.org/T136261#2329229 (10hashar)
[08:27:06] <wikibugs>	 10Continuous-Integration-Infrastructure: castor-load reports when cache has not been populated yet "broken: rsync No such file or directory" (eg: operations-puppet-tox-pep8-jessie jobs) - https://phabricator.wikimedia.org/T136261#2328843 (10hashar) The error shows up in the console but is actually ignored (via:...
[08:27:25] <wikibugs>	 10Continuous-Integration-Infrastructure: castor-load reports when cache has not been populated yet "broken: rsync No such file or directory" (eg: operations-puppet-tox-pep8-jessie jobs) - https://phabricator.wikimedia.org/T136261#2328843 (10hashar) p:05Triage>03Normal
[08:42:35] <wikibugs>	 10Continuous-Integration-Infrastructure: castor rsyncd spam logs with forward name lookup for ci-trusty-wikimedia-95202.contintcloud.eqiad.wmflabs failed: Name or service not known - https://phabricator.wikimedia.org/T136276#2329257 (10hashar)
[08:58:50] <wikibugs>	 07Browser-Tests, 13Patch-For-Review: Make Selenium tests work with AuthManager - https://phabricator.wikimedia.org/T135884#2314108 (10JanZerebecki) I looked at a few of these patches and they do not update the Gemfile.lock after the Gemfile was changed. Please amend so they can be merged.
[09:15:14] <wikibugs>	 07Browser-Tests, 10Wikidata, 07Tracking: [tracking] make Wikidata browsertests non-flaky - https://phabricator.wikimedia.org/T92619#2329336 (10JanZerebecki)
[09:15:18] <wikibugs>	 10Browser-Tests-Infrastructure, 10MobileFrontend, 06Reading-Web-Backlog, 07Upstream: Upstream: Issue with Chrome driver with resizing window - https://phabricator.wikimedia.org/T88288#2329334 (10JanZerebecki) 05Resolved>03declined AFAIK it happens all the time on saucelabs, but as a non-free service I...
[09:18:06] <grrrit-wm>	 (03CR) 10JanZerebecki: [C: 032] Drop Gather from testing infrastructure [integration/config] - 10https://gerrit.wikimedia.org/r/290822 (https://phabricator.wikimedia.org/T136176) (owner: 10Jdlrobson)
[09:19:43] <grrrit-wm>	 (03Merged) 10jenkins-bot: Drop Gather from testing infrastructure [integration/config] - 10https://gerrit.wikimedia.org/r/290822 (https://phabricator.wikimedia.org/T136176) (owner: 10Jdlrobson)
[09:24:41] <jzerebecki>	 !log reloading zuul for d38ad0a..6798539
[09:24:46] <qa-morebots>	 Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master
[09:37:35] <wikibugs>	 10Continuous-Integration-Infrastructure: castor-load reports when cache has not been populated yet "broken: rsync No such file or directory" (eg: operations-puppet-tox-pep8-jessie jobs) - https://phabricator.wikimedia.org/T136261#2329390 (10hashar) 05Open>03Resolved a:03hashar I have tried various approach...
[09:42:14] <shinken-wm>	 RECOVERY - Puppet run on deployment-kafka04 is OK: OK: Less than 1.00% above the threshold [0.0]
[09:45:34] <grrrit-wm>	 (03PS1) 10JanZerebecki: Add Wikibase selenium job [integration/config] - 10https://gerrit.wikimedia.org/r/290904 (https://phabricator.wikimedia.org/T128190) 
[09:53:38] <tgr>	 jzerebecki: I'm not familiar with ruby tooling; I tried 'bundler update mediawiki_selenium' for the patches and it ended changing a bunch of seemingly unrelated things in the lockfile, like mime-types
[09:53:47] <tgr>	 is that OK or am I doing something wrong?
[10:01:03] <jzerebecki>	 tgr: I'm a ruby beginner. I'd say that is ok, it seems to update everything not just that one gem. but maybe zeljkof has an opinion?
[10:01:41] <tgr>	 he is off for the rest of the week, I believe
[10:03:58] <zeljkof>	 tgr: if the tests do not break, that is fine
[10:10:41] <hashar>	 tgr yeah bundler is quite annoying
[10:10:55] <hashar>	 it is not conservative when doing updates though maybe one can :  bundle update mediawiki_selenium
[10:11:35] <Nikerabbit>	 is it a problem if other things get updated as well? :o
[10:12:59] <hashar>	 depends :)
[10:13:14] <hashar>	 then if tests still pass just fine, it is not a big deal
[10:30:28] <grrrit-wm>	 (03PS3) 10Hashar: Migrate mediawiki-phpunit-phpflavour-composer to nodepool [integration/config] - 10https://gerrit.wikimedia.org/r/290806 (https://phabricator.wikimedia.org/T135001) (owner: 10Paladox)
[10:30:43] <wikibugs>	 10Continuous-Integration-Config, 05Continuous-Integration-Scaling, 07Tracking: Track what tests we have left to convert to nodepool (tracking) - https://phabricator.wikimedia.org/T136249#2329476 (10hashar)
[10:31:23] <wikibugs>	 10Continuous-Integration-Infrastructure, 13Patch-For-Review: castor rsyncd spam logs with forward name lookup for ci-trusty-wikimedia-95202.contintcloud.eqiad.wmflabs failed: Name or service not known - https://phabricator.wikimedia.org/T136276#2329477 (10hashar) p:05Triage>03Low
[10:35:52] <wikibugs>	 10Continuous-Integration-Infrastructure: mwext-qunit job has karma stall when chromium disconnect - https://phabricator.wikimedia.org/T136188#2329480 (10hashar) > I'm wondering is it this https://chromium.googlesource.com/chromium/src/+/5672f89725063a8e2edadef7e76448a57f869e7b that resolves it.  That seems to bl...
[10:38:49] <wikibugs>	 10Beta-Cluster-Infrastructure, 06Operations, 07Puppet: Hiera hierarchy hieradata/role/* is not applied on labs (eg  deployment-prep) - https://phabricator.wikimedia.org/T136080#2322414 (10hashar)
[10:39:04] <wikibugs>	 10Continuous-Integration-Infrastructure: mwext-qunit job has karma stall when chromium disconnect - https://phabricator.wikimedia.org/T136188#2329494 (10Paladox) Woops Oh sorry I forgot .dll is only Windows files.
[10:39:12] <wikibugs>	 10Beta-Cluster-Infrastructure, 06Operations, 07Puppet: Hiera hierarchy hieradata/role/* is not applied on labs (eg  deployment-prep) - https://phabricator.wikimedia.org/T136080#2322414 (10hashar) Thanks @scfc marked this as a duplicate of T120165. I have copy pasted my extended task description there.
[10:39:45] <wikibugs>	 10Beta-Cluster-Infrastructure, 06Labs, 06Operations, 07Puppet: Implement role based hiera lookups for labs - https://phabricator.wikimedia.org/T120165#1847021 (10hashar)
[10:41:41] <wikibugs>	 10Continuous-Integration-Infrastructure: mwext-qunit job has karma stall when chromium disconnect - https://phabricator.wikimedia.org/T136188#2329520 (10Paladox) I did have problems with chrome 50 on Windows where opening a new tab and you type a website in to take a long time. Chrome 51 seems to improve that an...
[10:44:54] <wikibugs>	 10Beta-Cluster-Infrastructure, 06Labs, 06Operations, 07Puppet: Implement role based hiera lookups for labs - https://phabricator.wikimedia.org/T120165#2329534 (10Joe) The role keyword is used in production to refer to large groups of hosts; we DEFINITELY don't want to have role lookups in labs for the same...
[12:02:36] <wikibugs>	 10Continuous-Integration-Config, 10Hovercards: add rake entrypoint and rubocop to ext:Popups - https://phabricator.wikimedia.org/T136285#2329626 (10JanZerebecki)
[12:03:08] <wikibugs>	 07Browser-Tests, 10Continuous-Integration-Config, 10Hovercards, 07Ruby: add rake entrypoint and rubocop to ext:Popups - https://phabricator.wikimedia.org/T136285#2329638 (10JanZerebecki)
[12:32:42] <tgr>	 jzerebecki: thanks for the merges! I took a shot at mediawiki_api-wikidata in https://github.com/wmde/WikidataApiGem/pull/9 but ran into some kind of circular error where the new version would have to be released first for the commit creating the new version to pass
[12:37:31] <jzerebecki>	 tgr: the error is "NoMethodError: undefined method `spec' for nil:NilClass", maybe one of the upgraded dependencies droped ruby 1.9.3 support?
[12:37:49] <jzerebecki>	 tgr: the pr works on ruby 2.0.0
[12:44:35] <wikibugs>	 03Scap3, 06Revision-Scoring-As-A-Service: Scap3 checks should act based on alphabetical order of checks - https://phabricator.wikimedia.org/T136253#2329739 (10Ladsgroup) >>! In T136253#2329211, @mobrovac wrote: >>>! In T136253#2329179, @Ladsgroup wrote: >> Scap3 reorder checks randomly (since it turn the yaml...
[13:01:32] <grrrit-wm>	 (03PS1) 10Hashar: (wip) php extensions compilation (wip) [integration/config] - 10https://gerrit.wikimedia.org/r/290925 
[13:02:09] <jzerebecki>	 tgr: so maybe the job testing with ruby 1.9.3 can be dropped, if we don't need that anymore
[13:02:50] <wikibugs>	 05Continuous-Integration-Scaling, 13Patch-For-Review, 07WorkType-NewFunctionality: Migrate PHP extensions building jobs to Nodepool - https://phabricator.wikimedia.org/T134381#2329806 (10hashar) Probably want to clear out the list of PHP extensions we still maintain/care about.  The Zend php test always exit...
[13:03:59] <wikibugs>	 05Continuous-Integration-Scaling, 13Patch-For-Review, 07WorkType-NewFunctionality: Migrate PHP extensions building jobs to Nodepool - https://phabricator.wikimedia.org/T134381#2263851 (10hashar) a:05hashar>03None
[13:05:40] <tgr>	 jzerebecki: I tried bundler install locally (on ruby 1.9.3) and that worked
[13:08:21] <tgr>	 jzerebecki: https://github.com/travis-ci/travis-ci/issues/5239 suggests this is a bundler bug and you can work around it by forcing a newer bundler than the one used by travis
[13:11:45] <kart_>	 hashar: https://integration.wikimedia.org/zuul/ stuck?
[13:12:05] <kart_>	 cxserver patch
[13:12:12] <kart_>	 tests are passing
[13:12:31] <kart_>	 OK. it is done :)
[13:18:23] <grrrit-wm>	 (03PS1) 10Hashar: jsduck-jessie no more install from rubygems [integration/config] - 10https://gerrit.wikimedia.org/r/290928 (https://phabricator.wikimedia.org/T109005) 
[13:20:47] <grrrit-wm>	 (03PS1) 10Hashar: Make jsduck to output its version [integration/config] - 10https://gerrit.wikimedia.org/r/290929 
[13:21:04] <grrrit-wm>	 (03CR) 10Hashar: [C: 032] Make jsduck to output its version [integration/config] - 10https://gerrit.wikimedia.org/r/290929 (owner: 10Hashar)
[13:21:06] <grrrit-wm>	 (03CR) 10Hashar: [C: 032] jsduck-jessie no more install from rubygems [integration/config] - 10https://gerrit.wikimedia.org/r/290928 (https://phabricator.wikimedia.org/T109005) (owner: 10Hashar)
[13:22:44] <grrrit-wm>	 (03Merged) 10jenkins-bot: jsduck-jessie no more install from rubygems [integration/config] - 10https://gerrit.wikimedia.org/r/290928 (https://phabricator.wikimedia.org/T109005) (owner: 10Hashar)
[13:22:46] <grrrit-wm>	 (03Merged) 10jenkins-bot: Make jsduck to output its version [integration/config] - 10https://gerrit.wikimedia.org/r/290929 (owner: 10Hashar)
[13:35:20] <jzerebecki>	 tgr: looks good. something came up, which is why I can't merge it. you might need to find someone else to do it or wait until I get to it.
[13:42:20] <wikibugs>	 10Continuous-Integration-Config, 05Continuous-Integration-Scaling, 07WorkType-NewFunctionality: Migrate qunit jobs to Nodepool - https://phabricator.wikimedia.org/T136301#2329996 (10hashar)
[13:43:01] <grrrit-wm>	 (03PS1) 10Hashar: dib: ship in localhost vhost and browsers [integration/config] - 10https://gerrit.wikimedia.org/r/290932 (https://phabricator.wikimedia.org/T136301) 
[13:43:57] <wikibugs>	 10Continuous-Integration-Infrastructure, 10ArticlePlaceholder, 10Wikidata: [Task] Investigate why QUnit tests time out randomly - https://phabricator.wikimedia.org/T136303#2330030 (10thiemowmde)
[13:44:34] <wikibugs>	 10Continuous-Integration-Infrastructure, 10ArticlePlaceholder, 10Wikidata, 03Wikidata-Sprint-2016-05-24: [Task] Investigate why QUnit tests time out randomly - https://phabricator.wikimedia.org/T136303#2330042 (10thiemowmde) p:05Triage>03Normal
[13:46:50] <wikibugs>	 03Scap3, 06Revision-Scoring-As-A-Service: Scap3 checks should act based on alphabetical order of checks - https://phabricator.wikimedia.org/T136253#2330045 (10thcipriani) The problem we found is that, rather than executing from top to bottom, Ores promote checks were running in an unknown order.  Random orderi...
[13:47:49] <wmf-insecte>	 Yippee, build fixed!
[13:47:49] <wmf-insecte>	 Project selenium-VisualEditor » firefox,beta,Linux,contintLabsSlave && UbuntuTrusty build #32: 09FIXED in 3 min 48 sec: https://integration.wikimedia.org/ci/job/selenium-VisualEditor/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/32/
[13:48:08] <wikibugs>	 03Scap3, 06Revision-Scoring-As-A-Service: Scap3 checks should not be random - https://phabricator.wikimedia.org/T136253#2330046 (10thcipriani)
[13:52:43] <grrrit-wm>	 (03CR) 10Hashar: [C: 032] dib: ship in localhost vhost and browsers [integration/config] - 10https://gerrit.wikimedia.org/r/290932 (https://phabricator.wikimedia.org/T136301) (owner: 10Hashar)
[13:53:28] <grrrit-wm>	 (03Merged) 10jenkins-bot: dib: ship in localhost vhost and browsers [integration/config] - 10https://gerrit.wikimedia.org/r/290932 (https://phabricator.wikimedia.org/T136301) (owner: 10Hashar)
[14:08:02] <grrrit-wm>	 (03CR) 10Paladox: dib: ship in localhost vhost and browsers (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/290932 (https://phabricator.wikimedia.org/T136301) (owner: 10Hashar)
[14:23:08] <grrrit-wm>	 (03PS1) 10Hashar: dib: localhost-worker must belong to jenkins user [integration/config] - 10https://gerrit.wikimedia.org/r/290939 (https://phabricator.wikimedia.org/T136301) 
[14:43:26] <grrrit-wm>	 (03PS1) 10Lokal Profil: Add Jenkins job for mediawiki/extensions/Wikispeech [integration/config] - 10https://gerrit.wikimedia.org/r/290943 (https://phabricator.wikimedia.org/T136196) 
[14:45:12] <grrrit-wm>	 (03CR) 10Lokal Profil: "First time I've done this so please be extra suspicious =)" [integration/config] - 10https://gerrit.wikimedia.org/r/290943 (https://phabricator.wikimedia.org/T136196) (owner: 10Lokal Profil)
[14:45:24] <wikibugs>	 10Continuous-Integration-Config, 10Wikispeech, 13Patch-For-Review: Investigate continous integration hook - https://phabricator.wikimedia.org/T136196#2330289 (10Lokal_Profil)
[15:00:57] <wikibugs>	 10Continuous-Integration-Infrastructure, 10ArticlePlaceholder, 10Wikidata, 03Wikidata-Sprint-2016-05-24: [Task] Investigate why QUnit jobs time out randomly - https://phabricator.wikimedia.org/T136303#2330358 (10JanZerebecki)
[15:03:14] <wikibugs>	 10Continuous-Integration-Infrastructure, 10ArticlePlaceholder, 10Wikidata, 03Wikidata-Sprint-2016-05-24: [Task] Investigate why QUnit jobs time out randomly - https://phabricator.wikimedia.org/T136303#2330030 (10Paladox) Hi yes @hashar tried looking into this but thinks it may be up to the recent karma upd...
[15:03:26] <paladox>	 hashar:  HI ^^
[15:03:40] <paladox>	 hashar could we see if chromium 51 fixes the qunit problems please.
[15:04:08] <wikibugs>	 10Continuous-Integration-Infrastructure: qunit jobs have karma stall when chromium disconnect - https://phabricator.wikimedia.org/T136188#2330363 (10hashar)
[15:04:17] <wikibugs>	 10Continuous-Integration-Infrastructure, 10ArticlePlaceholder, 10Wikidata, 03Wikidata-Sprint-2016-05-24: [Task] Investigate why QUnit jobs time out randomly - https://phabricator.wikimedia.org/T136303#2330364 (10hashar)
[15:04:19] <wikibugs>	 10Continuous-Integration-Infrastructure: qunit jobs have karma stall when chromium disconnect - https://phabricator.wikimedia.org/T136188#2326191 (10hashar)
[15:05:00] <wikibugs>	 10Continuous-Integration-Infrastructure, 10ArticlePlaceholder, 10Wikidata, 03Wikidata-Sprint-2016-05-24: [Task] Investigate why QUnit jobs time out randomly - https://phabricator.wikimedia.org/T136303#2330030 (10hashar) Made a dupe of {T136188}   Might have been caused by mw 72b0d9da08d6ea8c1842d76aaefe8e5...
[15:07:43] <dcausse>	 someone with admin rights on http://meta.wikimedia.beta.wmflabs.org/ could add "Dcausse" in "Translation administrators" please? :)
[15:22:25] <paladox>	 hashar: https://github.com/karma-runner/karma/issues/1514
[15:22:50] <wikibugs>	 10Continuous-Integration-Infrastructure: qunit jobs have karma stall when chromium disconnect - https://phabricator.wikimedia.org/T136188#2330440 (10Paladox) Maybe this https://github.com/karma-runner/karma/issues/1514
[15:29:48] <wikibugs>	 10scap: Merge scap scripts "mwscriptwikiset" and "foreachwikiindblist" into one - https://phabricator.wikimedia.org/T109798#2330475 (10bd808) Another difference between the two scripts is that `foreachwikiindblist` uses `expanddblist` to support list files which use the dblist expression language ("list + list -...
[15:30:57] <wikibugs>	 05Continuous-Integration-Scaling, 10OOjs-UI, 13Patch-For-Review, 07WorkType-NewFunctionality: Migrate OOjs UI npm, npm-run-doc and npm-run-demos CI jobs to Nodepool - https://phabricator.wikimedia.org/T128091#2330478 (10Jdforrester-WMF) \o/
[15:31:10] <paladox>	 hashar: Another error https://integration.wikimedia.org/ci/job/mediawiki-phpunit-hhvm-trusty/1102/console
[15:31:27] <paladox>	 thcipriani or hashar could you abort https://integration.wikimedia.org/ci/job/mediawiki-phpunit-hhvm-trusty/1102/console please.
[15:31:34] <paladox>	 It seems to be a mysql error.
[15:33:44] <wikibugs>	 03Scap3, 06Revision-Scoring-As-A-Service: Scap3 checks should not be random - https://phabricator.wikimedia.org/T136253#2330492 (10Ladsgroup) Hey, @thcipriani You suggested my to change name of checks to 01_foo, 02_bar, etc. The first implication is "alphabetical is our goal". Sorry if I misunderstood you.  Yu...
[15:38:00] <wikibugs>	 10Continuous-Integration-Infrastructure, 13Patch-For-Review: qunit jobs have karma stall when chromium disconnect - https://phabricator.wikimedia.org/T136188#2330496 (10Paladox) The only update to the chrome karma launcher is  https://github.com/karma-runner/karma-chrome-launcher/commit/600e1b66f60eda64b18a23a...
[15:38:52] <paladox>	 James_F: Hi would you be able to review https://gerrit.wikimedia.org/r/#/c/290952 please
[15:39:05] <paladox>	 We are trying to solve https://phabricator.wikimedia.org/T136188 and that might help
[15:39:32] <paladox>	 I think we may need to put karma in verbose mode temporarily so when it next happends we get more info.
[15:39:40] <paladox>	 hashar ^^
[15:39:53] <James_F>	 paladox: Hmm. We tried that in (I think) VE and it didn't work very well.
[15:40:00] <James_F>	 (Two years ago.)
[15:40:03] <paladox>	 Oh
[15:40:11] <James_F>	 Maybe this problem will work with that though.
[15:40:26] <James_F>	 (In the end we had to re-write some of the unit tests, I believe.)
[15:40:47] <paladox>	 James_F: Yes, i think we should try, and if it dosen't we should try verbose temporily to get more info.
[15:40:51] <paladox>	 Oh
[15:46:06] <wmf-insecte>	 Yippee, build fixed!
[15:46:07] <wmf-insecte>	 Project selenium-MobileFrontend » firefox,beta,Linux,contintLabsSlave && UbuntuTrusty build #28: 09FIXED in 24 min: https://integration.wikimedia.org/ci/job/selenium-MobileFrontend/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/28/
[15:50:31] <wikibugs>	 03Scap3, 06Revision-Scoring-As-A-Service: Scap3 checks should not be random - https://phabricator.wikimedia.org/T136253#2330581 (10thcipriani) >>! In T136253#2330492, @Ladsgroup wrote: > Hey, > @thcipriani You suggested me to change name of checks to 01_foo, 02_bar, etc. The first implication is "alphabetical...
[16:08:36] <wikibugs>	 10Continuous-Integration-Infrastructure, 05Gerrit-Migration, 06Release-Engineering-Team, 10Differential, and 3 others: Investigate migrating the Wikipedia Android App to Differential - https://phabricator.wikimedia.org/T134505#2330711 (10Niedzielski) After some internal discussion, we're tentatively planni...
[16:11:52] <grrrit-wm>	 (03PS1) 10Paladox: Remove duplicate include contint::browsers [integration/config] - 10https://gerrit.wikimedia.org/r/290959 
[16:17:40] <paladox>	 James_F: Hi could you abort https://integration.wikimedia.org/ci/job/mediawiki-phpunit-hhvm-trusty/1102/ please.
[16:22:32] <grrrit-wm>	 (03Restored) 10Paladox: Add pywikibot-npm-node-4.3 experimental job to pywikibot/i18n [integration/config] - 10https://gerrit.wikimedia.org/r/290703 (https://phabricator.wikimedia.org/T130207) (owner: 10Paladox)
[16:22:37] <grrrit-wm>	 (03PS3) 10Paladox: Add pywikibot-npm-node-4.3 experimental job to pywikibot/i18n [integration/config] - 10https://gerrit.wikimedia.org/r/290703 (https://phabricator.wikimedia.org/T130207) 
[16:23:04] <grrrit-wm>	 (03PS4) 10Paladox: Migrate mediawiki-phpunit-phpflavour-composer to nodepool [integration/config] - 10https://gerrit.wikimedia.org/r/290806 (https://phabricator.wikimedia.org/T135001) 
[16:23:12] <Luke081515>	 hi, can someone kill this build? It timed out, but isn't marked as failed yet, so the whole test hangs since about one and a half our: https://integration.wikimedia.org/ci/job/mediawiki-phpunit-hhvm-trusty/1102/console
[16:23:16] <Luke081515>	 *hour
[16:23:34] <paladox>	 Luke081515 hi i have already asked above.
[16:23:39] <Luke081515>	 ok
[16:23:49] <paladox>	 ostriches or ejegg ^^
[16:25:38] <legoktm>	 killed
[16:25:42] <Luke081515>	 thx
[16:25:58] <paladox>	 legoktm: Thanks :)
[16:26:54] <Amir1>	 hey twentyafterfour and thcipriani: I get this error while running puppet agent in deployment-ores-web
[16:26:55] <Amir1>	 Error: Could not retrieve catalog from remote server: Error 400 on SERVER: secret(): invalid secret keyholder/deploy-service.pub at /etc/puppet/modules/scap/manifests/target.pp:83 on node deployment-ores-web.deployment-prep.eqiad.wmflabs
[16:27:07] <thcipriani>	 Amir1: oh.
[16:27:16] <thcipriani>	 we're seeing that in production as well.
[16:27:31] * thcipriani digs in deployment-puppetmaster
[16:37:46] <grrrit-wm>	 (03PS1) 10EBernhardson: Expect specific output from sniffs [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/290975 
[16:38:06] <thcipriani>	 Amir1: should be working now
[16:38:19] <Amir1>	 \o/
[16:38:20] <Amir1>	 thanks
[16:39:50] <thcipriani>	 Amir1: thanks for pointing that out, helped fix prod more quickly :)
[16:39:52] <Amir1>	 yup it works now
[16:40:14] <Amir1>	 awesome, thank you for being responsive and awesome, keeping being it
[16:40:20] <Amir1>	 *keep being
[16:40:36] <thcipriani>	 :D
[16:47:18] <grrrit-wm>	 (03CR) 10EBernhardson: "a followup could probably merge the various foo_pass.php and foo_fail.php, or should i do that here?" [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/290975 (owner: 10EBernhardson)
[17:04:39] <grrrit-wm>	 (03CR) 10Krinkle: "Casting a timeout to success seems bad. There are lots of things that could cause a timeout due to issues in our QUnit, Karma or MW config" [integration/config] - 10https://gerrit.wikimedia.org/r/290794 (https://phabricator.wikimedia.org/T119143) (owner: 10Hashar)
[17:11:20] <wikibugs>	 07Browser-Tests, 10Continuous-Integration-Config, 10Hovercards, 06Reading-Web-Backlog, 07Ruby: add rake entrypoint and rubocop to ext:Popups - https://phabricator.wikimedia.org/T136285#2331025 (10Jdlrobson) p:05Triage>03Normal
[17:24:44] <dcausse>	 gerrit/jenkins/dependency problem: I have a kind of cyclic dependency issue with vendor and a patch in an extension
[17:25:13] <legoktm>	 dcausse: make the extension depends-on the vendor patch, and force merge the vendor one
[17:25:16] <dcausse>	 vendor patch: https://gerrit.wikimedia.org/r/#/c/290985/ taht will execute the old extension test that are not compatible with the new dep
[17:26:08] <dcausse>	 legoktm: ok thanks, make sens
[17:26:12] <dcausse>	 *sense
[17:26:35] <tgr>	 jzerebecki: around?
[17:33:30] <legoktm>	 ebernhardson: uh wow, that looks amazing.
[17:40:29] <ebernhardson>	 legoktm: thanks!
[17:40:46] <ebernhardson>	 i was reviewing lethexie's patch and wasn't happy with the assertions, so fixed it
[17:41:08] <ebernhardson>	 would also be nice to do something similar for the fixers...but thats a little more involved
[17:41:55] <legoktm>	 do we need to have empty files for all the _pass ones?
[17:42:13] <ebernhardson>	 hmm, we could probably drop those. But i was thinking about merging all the _pass and _fail files
[17:44:57] <legoktm>	 hat makes sense...we can test that code is not failing by having it not show up in the .expect report
[17:44:59] <legoktm>	 that*
[17:47:29] <grrrit-wm>	 (03CR) 10Legoktm: [C: 032] "Good start - we should look at the individual tests in follow-ups to make sure they're testing what they actually should be testing" [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/290975 (owner: 10EBernhardson)
[17:50:08] <grrrit-wm>	 (03Merged) 10jenkins-bot: Expect specific output from sniffs [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/290975 (owner: 10EBernhardson)
[18:12:01] <grrrit-wm>	 (03PS1) 10EBernhardson: Assert fixers do as intended [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/291001 
[18:13:07] <grrrit-wm>	 (03PS2) 10EBernhardson: Assert fixers do as intended [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/291001 
[18:15:17] <grrrit-wm>	 (03CR) 10jenkins-bot: [V: 04-1] Assert fixers do as intended [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/291001 (owner: 10EBernhardson)
[18:18:41] <Luke081515>	 hi, can someone take a look at https://integration.wikimedia.org/ci/job/mediawiki-core-qunit/65769/console? seems like it is hanging
[18:18:53] <Luke081515>	 and that actually blocks another patch at gate-and-submit
[18:19:44] <Luke081515>	 jzerebecki, legoktm ^
[18:19:44] <tgr>	 Luke081515: it will time out in 5 minutes or so
[18:19:50] <Luke081515>	 hm, ok
[18:20:04] <legoktm>	 aborted
[18:20:24] <Luke081515>	 thx
[18:20:28] <grrrit-wm>	 (03PS3) 10EBernhardson: Assert fixers do as intended [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/291001 
[18:28:03] <grrrit-wm>	 (03Abandoned) 10Hashar: Make mwext-qunit to timeout earlier and not fail [integration/config] - 10https://gerrit.wikimedia.org/r/290794 (https://phabricator.wikimedia.org/T119143) (owner: 10Hashar)
[18:35:49] <paladox>	 legoktm: Hi could you abort https://integration.wikimedia.org/ci/job/mediawiki-parsertests-hhvm-trusty/1100/console please.
[18:35:51] <paladox>	 hashar ^^
[18:36:27] <legoktm>	 done
[18:36:47] <paladox>	 Thanks
[18:36:50] <wikibugs>	 10Continuous-Integration-Infrastructure, 10MediaWiki-Unit-tests: Cannot write to the test database in @dataProvider methods - https://phabricator.wikimedia.org/T136348#2331453 (10ori)
[18:38:16] <paladox>	 legoktm: It seems to be another mysql error.
[18:38:37] <paladox>	 hashar ^^
[18:43:35] <wikibugs>	 10Continuous-Integration-Infrastructure: mwext-qunit fails during Mysql install (and maybe teardown) - https://phabricator.wikimedia.org/T136171#2331478 (10Paladox) 05Resolved>03Open Re opening it still happends..  we had to abort https://integration.wikimedia.org/ci/job/mediawiki-parsertests-hhvm-trusty/110...
[18:44:34] <wikibugs>	 10Continuous-Integration-Infrastructure: mwext-qunit fails during Mysql install (and maybe teardown) - https://phabricator.wikimedia.org/T136171#2331480 (10Paladox) 05Open>03Resolved Woops sorry this task is about a different test.
[18:46:50] <wikibugs>	 10Continuous-Integration-Infrastructure: PHPUnit job hangs for two hours after SlowTimer warning - https://phabricator.wikimedia.org/T136349#2331486 (10Tgr)
[18:49:04] <paladox>	 hashar ^^
[18:56:03] <madhuvishy>	 hashar: Hi! I've had two +1's on my patch here - https://review.openstack.org/#/c/313196/, but they don't seem to merge it - do you know how we can move it along?
[18:56:28] <ori>	 madhuvishy: I've had some luck going on their IRC channel and asking there
[18:56:43] <madhuvishy>	 ori: aah okay I can do that
[18:57:25] <madhuvishy>	 ori: just on #openstack?
[18:57:57] <ori>	 that or #openstack-dev	
[19:02:44] <hashar>	 madhuvishy: you want #openstack-infra :)
[19:03:01] <hashar>	 madhuvishy: guess I will do some python review sprint tomorrow  if time allow
[19:03:01] <madhuvishy>	 hashar: ah thank you :)
[19:03:24] <hashar>	 madhuvishy: there is only a few core reviewers on jenkins-job-builder unfortunately
[19:03:30] <hashar>	 and some like me are quite inactive :(
[19:03:35] <madhuvishy>	 hashar: oh cool! I also have two patches to integration/config. One is blocked on this patch
[19:04:06] <hashar>	 notice that
[19:04:41] <madhuvishy>	 hashar: right, i will ping them on openstack-infra anyway - let's see :) 
[19:04:45] <hashar>	 yeah
[19:04:51] <hashar>	 will try to catch up tomorrow
[19:05:53] <madhuvishy>	 hashar: thanks!
[19:08:33] <paladox>	 hashar: Thanks for working on qunit today.
[19:08:43] <paladox>	 preparing to bring it to nodepool
[19:08:51] <hashar>	 paladox: no point
[19:08:55] <hashar>	 it is not ready yet
[19:09:03] <paladox>	 Ok
[19:09:03] <hashar>	 I have to provision the images and make sure they work
[19:09:07] <paladox>	 Oh
[19:09:13] <hashar>	 once that is done,  the migration would be quite trivial in JJB conf :)
[19:10:00] <paladox>	 Ok
[19:10:20] <paladox>	 hashar: would you be able to review https://gerrit.wikimedia.org/r/#/c/290806/ and https://gerrit.wikimedia.org/r/#/c/290959/ please
[19:10:38] <paladox>	 and https://gerrit.wikimedia.org/r/#/c/290703/ please.
[19:10:40] <paladox>	 :)
[19:11:01] <paladox>	 hashar: Also can we upgrade mw extension testunits tests to nodepool
[19:11:02] <paladox>	 please
[19:11:18] <paladox>	 Since we can migrate the php one to trusty and the hhvm to jessie
[19:14:06] <grrrit-wm>	 (03CR) 10Paladox: "recheck" [integration/config] - 10https://gerrit.wikimedia.org/r/288608 (owner: 10Hashar)
[19:14:48] <paladox>	 hashar: Also this dint merge https://gerrit.wikimedia.org/r/#/c/288608/ when you +2
[19:15:17] <grrrit-wm>	 (03CR) 10Paladox: [C: 031] Add Jenkins job for mediawiki/extensions/Wikispeech [integration/config] - 10https://gerrit.wikimedia.org/r/290943 (https://phabricator.wikimedia.org/T136196) (owner: 10Lokal Profil)
[19:17:49] <grrrit-wm>	 (03CR) 10Paladox: [C: 04-1] "Plese could you add a npm entry point to that repo." [integration/config] - 10https://gerrit.wikimedia.org/r/290943 (https://phabricator.wikimedia.org/T136196) (owner: 10Lokal Profil)
[19:18:02] <grrrit-wm>	 (03CR) 10Paladox: "please." [integration/config] - 10https://gerrit.wikimedia.org/r/290943 (https://phabricator.wikimedia.org/T136196) (owner: 10Lokal Profil)
[19:31:50] <paladox>	 hashar: Also this dint merge https://gerrit.wikimedia.org/r/#/c/288608/ when you +2
[19:33:37] <hashar>	 Project policy requires all submissions to be a fast-forward.
[19:33:37] <hashar>	 Please rebase the change locally and upload again for review.
[19:33:42] <hashar>	 paladox: that needs a rebase
[19:33:50] <paladox>	 Oh
[19:33:54] <hashar>	 the messages are in the wrong order
[19:34:10] <paladox>	 Yep, possibly fix in a newer gerrit realse.
[19:34:10] <paladox>	 hashar: would you be able to review https://gerrit.wikimedia.org/r/#/c/290806/ and https://gerrit.wikimedia.org/r/#/c/290959/ please
[19:34:13] <hashar>	 with Gerrit inserting the complaint message before Zuul had a change to report the gate pipeline succeeded
[19:34:16] <paladox>	 and https://gerrit.wikimedia.org/r/#/c/290703/ please.
[19:34:19] <paladox>	 Oh
[19:34:40] <hashar>	 got some puppet magic to do 
[19:34:54] <paladox>	 Ok
[19:35:15] <paladox>	 hashar im wondering can we convert mw test-extensions tests to nodepool
[19:35:24] <paladox>	 since they doint require chrome
[19:35:36] <paladox>	 and we have converted some tests that are similar to them.
[19:35:56] <paladox>	 Im thinking we convert the php one to trusty noddepool and the other hhvm to jessie 
[19:39:59] <grrrit-wm>	 (03PS2) 10Paladox: Convert integration-composer-check* to a job template [integration/config] - 10https://gerrit.wikimedia.org/r/288608 (owner: 10Hashar)
[19:40:06] <paladox>	 hashar: ^^ i rebased.
[19:40:26] <grrrit-wm>	 (03CR) 10Paladox: "I rebased." [integration/config] - 10https://gerrit.wikimedia.org/r/288608 (owner: 10Hashar)
[19:41:01] <grrrit-wm>	 (03CR) 10Paladox: "Needs re c+2 please." [integration/config] - 10https://gerrit.wikimedia.org/r/288608 (owner: 10Hashar)
[19:47:26] <grrrit-wm>	 (03CR) 10Hashar: Convert integration-composer-check* to a job template [integration/config] - 10https://gerrit.wikimedia.org/r/288608 (owner: 10Hashar)
[19:47:38] <grrrit-wm>	 (03CR) 10Hashar: [C: 032] "Great, and still a noop in JJB :)" [integration/config] - 10https://gerrit.wikimedia.org/r/288608 (owner: 10Hashar)
[19:49:34] <grrrit-wm>	 (03Merged) 10jenkins-bot: Convert integration-composer-check* to a job template [integration/config] - 10https://gerrit.wikimedia.org/r/288608 (owner: 10Hashar)
[19:49:40] <hashar>	 paladox: done
[19:49:49] <paladox>	 hashar: Thanks :)
[19:49:55] <ori>	 there's an echo job that has been running for 20m: https://integration.wikimedia.org/ci/job/mwext-qunit/16816/
[19:50:07] <paladox>	 hashar ^^
[19:50:09] <ori>	 19:32:18 26 05 2016 19:32:18.854:DEBUG [karma]: Run complete, exiting. 
[19:50:15] <ori>	 seems to have hung
[19:50:26] <paladox>	 ori we have been having a tone of qunit problems
[19:50:34] <paladox>	 Workaround is to abort it.
[19:51:06] <paladox>	 legoktm ^^
[19:51:26] <legoktm>	 aborted
[19:51:40] <paladox>	 Thanks legoktm
[19:52:57] <wikibugs>	 10Continuous-Integration-Infrastructure, 13Patch-For-Review: qunit jobs have karma stall when chromium disconnect - https://phabricator.wikimedia.org/T136188#2331726 (10Legoktm) p:05Triage>03Unbreak! UBN because I'm aborting stuck jobs every hour or so.
[19:53:10] <ori>	 thanks
[19:54:16] <ori>	 hrm
[19:54:18] <ori>	 19:53:43 Fatal error: Class 'Elastica\Query\Script' not found in /mnt/jenkins-workspace/workspace/mediawiki-extensions-php55/src/extensions/CirrusSearch/tests/unit/Search/FiltersTest.php on line 44
[19:54:23] <ori>	 https://integration.wikimedia.org/ci/job/mediawiki-extensions-php55/4325/console
[19:55:16] <paladox>	 Im not sure why it is failing. But it isen't linking to the change.
[19:55:57] <paladox>	 hashar: https://phabricator.wikimedia.org/T136188
[20:00:37] <ebernhardson>	 ori: in the process of merging all our es2.x updates, should all be merged soon and then work
[20:00:52] <ori>	 aha, thanks!
[20:00:57] <ebernhardson>	 the vendor patch is still running tests
[20:02:23] <wikibugs>	 03Scap3, 10scap, 13Patch-For-Review: scap::target shouldn't allow users to redefine the user's key - https://phabricator.wikimedia.org/T132747#2331745 (10mmodell) 05Open>03Resolved
[20:02:27] <hashar>	 ori: ebernhardson if that is a serie of commit, one can propose a  merge commit (no ff) in Gerrit
[20:02:31] <hashar>	 then +2 that merge commit change
[20:02:38] <hashar>	 and all the serie should merge (hopefully ) 
[20:02:38] <ebernhardson>	 hashar: it's in 6 different repo's though
[20:02:46] <hashar>	 ahhhhh
[20:02:49] <hashar>	 neat :=)
[20:02:59] <hashar>	 such a pity we can not do an octopus merge accross repos
[20:04:36] <hashar>	 legoktm: lovely :)
[20:04:59] <hashar>	 legoktm: honestly I should have reverted that as soon as I noticed the Karma update.  But I though the issue would be easy to figure out :(
[20:05:43] <paladox>	 hashar: :)
[20:05:56] <paladox>	 Upstream need to fix it.
[20:06:14] <paladox>	 It was karma 13 upgrading from 12.
[20:06:57] <wikibugs>	 10Continuous-Integration-Infrastructure, 13Patch-For-Review: qunit jobs have karma stall when chromium disconnect - https://phabricator.wikimedia.org/T136188#2331768 (10hashar) cherry picked to wmf/1.28.0-wmf.3 which got cut with the potentially offending commit: ``` $ git branch --contains 72b0d9da08d6ea8c184...
[20:07:13] <ebernhardson>	 ori: it looks to have merged now, see if your thing works now?
[20:07:31] <wikibugs>	 06Release-Engineering-Team, 05Release: MW-1.28.0-wmf.3 deployment blockers - https://phabricator.wikimedia.org/T135559#2331782 (10mmodell)
[20:08:38] <paladox>	 hashar it failed to merge
[20:09:21] <hashar>	 yeah 00:01:08.552 Fatal error: Class undefined: Elastica\Query\Script in /mnt/jenkins-workspace/workspace/mediawiki-extensions-hhvm/src/extensions/CirrusSearch/tests/unit/Search/FiltersTest.php on line 44
[20:09:26] <hashar>	 gate is unstable :D
[20:10:32] <paladox>	 Oh same error as ori said above
[20:10:37] <hashar>	 yeah
[20:10:39] <hashar>	 it is transient
[20:10:48] <paladox>	 Oh
[20:10:51] <hashar>	 erik/ori are in the process of merging some big change that has some tricky dependencies
[20:10:54] <hashar>	 so it is a one off error
[20:11:00] <hashar>	 or off by one
[20:11:01] <hashar>	 or whatever
[20:11:14] <hashar>	 the change is in the gate-and-submit and seems to pass 
[20:11:21] <paladox>	 ok :)
[20:12:47] <wikibugs>	 10Continuous-Integration-Infrastructure, 13Patch-For-Review: qunit jobs have karma stall when chromium disconnect - https://phabricator.wikimedia.org/T136188#2331818 (10hashar) Potential culpirt 72b0d9da08d6ea8c1842d76aaefe8e57046a2026 is reverted in master.  Will need to monitor/wait a bit and see whether tha...
[20:13:09] <wikibugs>	 10Continuous-Integration-Infrastructure, 13Patch-For-Review, 07WorkType-Maintenance: qunit jobs have karma stall when chromium disconnect - https://phabricator.wikimedia.org/T136188#2331822 (10hashar)
[20:14:36] <paladox>	 legoktm: Hi, would you be able to work on https://phabricator.wikimedia.org/T135075 please.
[20:14:37] <paladox>	 :)
[20:17:18] <grrrit-wm>	 (03PS2) 10Hashar: dib: fix contint::localhost-worker [integration/config] - 10https://gerrit.wikimedia.org/r/290939 (https://phabricator.wikimedia.org/T136301) 
[20:17:46] <legoktm>	 paladox: I won't have time for that right now, sorry
[20:17:52] <paladox>	 Ok
[20:17:54] <legoktm>	 I'm already behind on my 1.27 stuff
[20:20:09] <wmf-insecte>	 Project beta-update-databases-eqiad build #8809: 04FAILURE in 7.7 sec: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/8809/
[20:20:45] <paladox>	 Oh
[20:30:39] <wikibugs>	 06Release-Engineering-Team, 05Release: MW-1.28.0-wmf.4 deployment blockers - https://phabricator.wikimedia.org/T136040#2331892 (10mmodell)
[20:31:17] <wikibugs>	 06Release-Engineering-Team, 05Release: MW-1.28.0-wmf.3 deployment blockers - https://phabricator.wikimedia.org/T135559#2331895 (10mmodell)
[20:33:53] <grrrit-wm>	 (03CR) 10Paladox: [C: 031] dib: fix contint::localhost-worker [integration/config] - 10https://gerrit.wikimedia.org/r/290939 (https://phabricator.wikimedia.org/T136301) (owner: 10Hashar)
[20:34:13] <grrrit-wm>	 (03PS6) 10Paladox: Migrate mediawiki core jsduck test to jessie [integration/config] - 10https://gerrit.wikimedia.org/r/290791 (https://phabricator.wikimedia.org/T119143) 
[20:34:31] <wikibugs>	 10Continuous-Integration-Infrastructure, 05Gerrit-Migration, 06Release-Engineering-Team, 10Differential, and 3 others: Investigate migrating the Wikipedia Android App to Differential - https://phabricator.wikimedia.org/T134505#2331915 (10mmodell) cool
[20:34:32] <grrrit-wm>	 (03PS3) 10Paladox: [CentralAuth] Add composer-test test [integration/config] - 10https://gerrit.wikimedia.org/r/288819 
[20:59:40] <wikibugs>	 06Release-Engineering-Team (Deployment-Blockers), 05Release: MW-1.28.0-wmf.5 deployment blockers - https://phabricator.wikimedia.org/T136042#2331970 (10mmodell)
[20:59:43] <wikibugs>	 06Release-Engineering-Team (Deployment-Blockers), 05Release: MW-1.28.0-wmf.4 deployment blockers - https://phabricator.wikimedia.org/T136040#2331971 (10mmodell)
[20:59:45] <wikibugs>	 06Release-Engineering-Team (Deployment-Blockers), 05Release: MW-1.28.0-wmf.3 deployment blockers - https://phabricator.wikimedia.org/T135559#2331972 (10mmodell)
[20:59:47] <wikibugs>	 06Release-Engineering-Team (Deployment-Blockers), 13Patch-For-Review, 05Release, 05WMF-deploy-2016-05-17_(1.28.0-wmf.2): MW-1.28.0-wmf.2 deployment blockers - https://phabricator.wikimedia.org/T134450#2331973 (10mmodell)
[20:59:51] <wikibugs>	 06Release-Engineering-Team (Deployment-Blockers), 05Release: 1.28.0-wmf.1 deployment blockers - https://phabricator.wikimedia.org/T134249#2331975 (10mmodell)
[20:59:53] <wikibugs>	 06Release-Engineering-Team (Deployment-Blockers), 13Patch-For-Review, 05Release: MW-1.27.0-wmf.23 deployment blockers - https://phabricator.wikimedia.org/T131557#2331976 (10mmodell)
[20:59:55] <wikibugs>	 06Release-Engineering-Team (Deployment-Blockers), 05Release: MW-1.27.0-wmf.21 deployment blockers - https://phabricator.wikimedia.org/T131555#2331978 (10mmodell)
[20:59:57] <wikibugs>	 06Release-Engineering-Team (Deployment-Blockers), 13Patch-For-Review, 05Release: MW-1.27.0-wmf.22 deployment blockers - https://phabricator.wikimedia.org/T131556#2331977 (10mmodell)
[20:59:59] <wikibugs>	 06Release-Engineering-Team (Deployment-Blockers), 05Release: MW-1.27.0-wmf.18 deployment blockers - https://phabricator.wikimedia.org/T129691#2331981 (10mmodell)
[21:00:01] <wikibugs>	 06Release-Engineering-Team (Deployment-Blockers), 05Release: MW-1.27.0-wmf.20 deployment blockers - https://phabricator.wikimedia.org/T130945#2331979 (10mmodell)
[21:00:03] <wikibugs>	 06Release-Engineering-Team (Deployment-Blockers), 05Release: MW-1.27.0-wmf.19 deployment blockers - https://phabricator.wikimedia.org/T130227#2331980 (10mmodell)
[21:00:05] <wikibugs>	 06Release-Engineering-Team (Deployment-Blockers), 05Release: MW-1.27.0-wmf.17 deployment blockers - https://phabricator.wikimedia.org/T128872#2331982 (10mmodell)
[21:00:07] <wikibugs>	 06Release-Engineering-Team (Deployment-Blockers), 05Release: MW-1.27.0-wmf.16 deployment blockers - https://phabricator.wikimedia.org/T128218#2331983 (10mmodell)
[21:00:09] <wikibugs>	 06Release-Engineering-Team (Deployment-Blockers), 13Patch-For-Review, 05Release: MW 1.27.0-wmf.14 deployment blockers - https://phabricator.wikimedia.org/T125597#2331984 (10mmodell)
[21:00:11] <wikibugs>	 06Release-Engineering-Team (Deployment-Blockers), 05Release: MW 1.27.0-wmf.12 deployment blockers - https://phabricator.wikimedia.org/T125475#2331986 (10mmodell)
[21:00:13] <wikibugs>	 06Release-Engineering-Team (Deployment-Blockers), 13Patch-For-Review, 05Release: MW 1.27.0-wmf.13 deployment blockers - https://phabricator.wikimedia.org/T125596#2331985 (10mmodell)
[21:02:48] <wikibugs>	 10Continuous-Integration-Config, 05Continuous-Integration-Scaling, 13Patch-For-Review, 07WorkType-NewFunctionality: Migrate qunit jobs to Nodepool - https://phabricator.wikimedia.org/T136301#2332005 (10hashar) Got a bunch of troubles building the image. Currently stuck with:  * jsduck gem install failling...
[21:03:25] <wikibugs>	 06Release-Engineering-Team (Deployment-Blockers), 05Release, 05WMF-deploy-2016-05-17_(1.28.0-wmf.2): MW-1.28.0-wmf.2 deployment blockers - https://phabricator.wikimedia.org/T134450#2332007 (10mmodell)
[21:03:40] <twentyafterfour>	 yay spam
[21:03:44] <wikibugs>	 10Continuous-Integration-Config, 05Continuous-Integration-Scaling, 13Patch-For-Review, 07WorkType-NewFunctionality: Migrate qunit jobs to Nodepool - https://phabricator.wikimedia.org/T136301#2332010 (10hashar)
[21:04:52] <paladox>	 hashar: It froze
[21:04:53] <paladox>	 https://integration.wikimedia.org/ci/job/mwext-qunit/16832/console
[21:04:58] <paladox>	 legoktm ^^
[21:05:04] <paladox>	 its chromium causing the problem
[21:06:13] <hashar>	 paladox: please report that change + build link on the task
[21:06:20] <paladox>	 Ok
[21:06:45] <hashar>	 good catch :)
[21:06:55] <hashar>	 and yeah seems Chromium 50 is the next to blame
[21:07:38] <paladox>	 Your welcome
[21:07:47] <wikibugs>	 10Continuous-Integration-Infrastructure, 13Patch-For-Review, 07WorkType-Maintenance: qunit jobs have karma stall when chromium disconnect - https://phabricator.wikimedia.org/T136188#2332019 (10Paladox) This continues to fail even when we reverted https://gerrit.wikimedia.org/r/#/c/289662/  Test failure https...
[21:07:51] <paladox>	 hashar: Maybe we should try chromium 51.
[21:09:06] <hashar>	 paladox: it is not in Trusty yet
[21:09:14] <paladox>	 Oh.
[21:09:24] <paladox>	 Is there a way we can update directly from google
[21:09:34] <paladox>	 Or maybe downgrade to 49.
[21:09:40] <paladox>	 please
[21:10:38] <paladox>	 hashar: https://gerrit.wikimedia.org/r/#/c/291104/
[21:12:32] <paladox>	 hashar https://www.google.com/chrome/browser/desktop/index.html?platform=linux
[21:12:42] <paladox>	 for ubuntu and debian
[21:12:48] <paladox>	 It has the .deb package.
[21:13:16] <wikibugs>	 10Continuous-Integration-Config, 05Continuous-Integration-Scaling, 13Patch-For-Review, 07WorkType-NewFunctionality: Migrate qunit jobs to Nodepool - https://phabricator.wikimedia.org/T136301#2332028 (10hashar)
[21:19:11] <paladox>	 hashar: https://chromium.googlesource.com/chromium/src/+/master/docs/linux_build_instructions.md
[21:19:30] <ori>	 it takes ages to build
[21:19:30] <hashar>	 paladox: at this point either we get the Chromium 49 package from Ubuntu
[21:19:42] <paladox>	 ori: Oh
[21:19:42] <hashar>	 or wait for them to push 51
[21:19:52] <ori>	 * Memory: >16GB is highly recommended.  * Disk space: Expect a full checkout and build to take nearly 100GB. 
[21:19:53] <paladox>	 hashar: i think downgrade to 49.
[21:19:59] <paladox>	 Oh
[21:20:00] <hashar>	 there is exactly 0 chance we are going to build it ourselves / maintain a chromium  package
[21:20:33] <wmf-insecte>	 Project beta-update-databases-eqiad build #8810: 04STILL FAILING in 32 sec: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/8810/
[21:20:42] <paladox>	 Ok
[21:25:08] <paladox>	 hashar :
[21:25:08] <paladox>	 http://chromium.woolyss.com/#linux
[21:25:12] <paladox>	 ori ^^
[21:25:37] <ori>	 paladox: I'm not involved, I don't know how this software stack is configured
[21:25:44] <paladox>	 Oh ok
[21:25:45] <ori>	 I am just making unhelpful remarks from the sidelines as usual
[21:25:51] <paladox>	 Oh
[21:27:23] <paladox>	 hashar: https://launchpad.net/~canonical-chromium-builds/+archive/ubuntu/stage
[21:28:39] <wikibugs>	 10Continuous-Integration-Infrastructure, 13Patch-For-Review, 07WorkType-Maintenance: qunit jobs have karma stall when chromium disconnect - https://phabricator.wikimedia.org/T136188#2332093 (10hashar) Next step is to find the previous Chromium packages from Ubuntu Trusty. We had:  | chromium-chromedriver:amd...
[21:30:23] <ori>	 hashar: there's a good chance it'll be in /var/cache/apt/archives
[21:30:30] <ori>	 on any machine this was installed on
[21:30:36] <hashar>	 ori: yeah tried it is gone already :(
[21:30:56] <ori>	 it's on osmium
[21:31:22] <hashar>	 there are three of them needed apparently
[21:31:23] <ori>	 not the chromedriver one
[21:31:27] <hashar>	 :(
[21:35:08] <hashar>	 ori: they are still on mirrors apparently :)
[21:35:08] <hashar>	 http://us.archive.ubuntu.com/ubuntu/pool/universe/c/chromium-browser/
[21:36:30] <paladox>	 hashar: :)
[21:40:39] <wikibugs>	 10Continuous-Integration-Infrastructure, 13Patch-For-Review, 07WorkType-Maintenance: qunit jobs have karma stall when chromium disconnect - https://phabricator.wikimedia.org/T136188#2332122 (10hashar) https://mirrors.wikimedia.org/ubuntu/pool/universe/c/chromium-browser/chromium-chromedriver_49.0.2623.108-0u...
[21:42:12] <paladox>	 legoktm ^^
[21:42:18] <hashar>	 !log downgrading chromium-browser on integration-slave-1015  T136188
[21:42:19] <stashbot>	 T136188: qunit jobs have karma stall when chromium disconnect - https://phabricator.wikimedia.org/T136188
[21:42:23] <qa-morebots>	 Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master
[21:43:21] <hashar>	 of course it does not work :D
[21:44:00] <hashar>	  chromium-browser depends on libdbus-1-3 (>= 1.9.14); however:
[21:44:00] <hashar>	   Version of libdbus-1-3:amd64 on system is 1.6.18-0ubuntu4.3.
[21:44:30] <paladox>	 Oh
[21:44:49] <hashar>	 I have pick the wrong packages
[21:44:54] <hashar>	 they are for an older ubuntu
[21:44:56] <paladox>	 hashar: Oh
[21:45:54] <paladox>	 hashar: It seems the only one is chromium 48
[21:46:07] <paladox>	 http://us.archive.ubuntu.com/ubuntu/pool/universe/c/chromium-browser/chromium-browser-dbg_48.0.2564.82-0ubuntu0.15.04.1.1193_amd64.deb
[21:46:19] <paladox>	 http://us.archive.ubuntu.com/ubuntu/pool/universe/c/chromium-browser/chromium-browser-dbg_48.0.2564.82-0ubuntu0.15.04.1.1193_i386.deb
[21:46:27] <hashar>	 that is not for trusty
[21:46:42] <paladox>	 hashar: no but is newer and should work i think.
[21:46:46] <hashar>	 0.15.04 is the ubuntu release
[21:46:50] <paladox>	 hashar: Oh
[21:46:59] <hashar>	 trusty is 14.04
[21:47:13] <hashar>	 ie it is the release of April 2014  --> 14.04
[21:47:20] <hashar>	 15.04 is the one from April 2015
[21:47:30] <wikibugs>	 10Continuous-Integration-Infrastructure, 13Patch-For-Review, 07WorkType-Maintenance: qunit jobs have karma stall when chromium disconnect - https://phabricator.wikimedia.org/T136188#2332160 (10hashar) The linked packages aboves are wrong, they are for some outdated Ubuntu release, not Trusty. So I really hav...
[21:47:54] <hashar>	 !log integration-slave-trusty-1015 still on Chromium 50 .. T136188
[21:47:55] <stashbot>	 T136188: qunit jobs have karma stall when chromium disconnect - https://phabricator.wikimedia.org/T136188
[21:47:59] <qa-morebots>	 Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master
[21:48:09] <paladox>	 hashar: The only chromium packaged for 14.04 is 50.
[21:49:08] <paladox>	 hashar this one https://launchpad.net/ubuntu/+source/chromium-browser/49.0.2623.108-0ubuntu0.14.04.1.1113
[21:49:18] <paladox>	 it is the repo for the package we are using.
[21:50:16] <wikibugs>	 10Continuous-Integration-Infrastructure, 13Patch-For-Review, 07WorkType-Maintenance: qunit jobs have karma stall when chromium disconnect - https://phabricator.wikimedia.org/T136188#2332165 (10hashar) So that is rather transient issue and at midnight there is not much more I can do to find the 0.49 package....
[21:50:27] <wikibugs>	 10Continuous-Integration-Infrastructure, 13Patch-For-Review, 07WorkType-Maintenance: qunit jobs have karma stall when chromium disconnect - https://phabricator.wikimedia.org/T136188#2332166 (10Paladox) @hashar try https://launchpad.net/ubuntu/+source/chromium-browser/49.0.2623.108-0ubuntu0.14.04.1.1113 since...
[21:53:13] <paladox>	 or just use the  51.0.2704.63-0ubuntu0.14.04.1.1119 package
[21:53:16] <paladox>	 https://launchpad.net/~canonical-chromium-builds/+archive/ubuntu/stage
[21:53:20] <paladox>	 hashar ^^
[21:55:04] <ori>	 hashar: we have all the packages on carbon
[21:55:10] <ori>	 i can place them anywhere you want in prod
[21:55:12] <ori>	 just let me know
[21:55:18] <ori>	 all the 49 versions, i mean
[21:55:30] <paladox>	 :) thanks ori
[21:55:53] <hashar>	 ori: I guess I can hit carbon from labs ? 
[21:56:17] <wikibugs>	 10Continuous-Integration-Infrastructure, 13Patch-For-Review, 07WorkType-Maintenance: qunit jobs have karma stall when chromium disconnect - https://phabricator.wikimedia.org/T136188#2332170 (10hashar) I have found some via https://launchpad.net/ubuntu/trusty/amd64/chromium-browser/49.0.2623.108-0ubuntu0.14.0...
[21:56:39] <hashar>	 or rutherfordium.eqiad.wmnet which is people.wm.o :)
[21:56:48] <hashar>	 ori: up to you really. Will wget them on all the slaves
[21:57:17] <ori>	 voila
[21:57:17] <ori>	 http://mirrors.wikimedia.org/ubuntu/pool/universe/c/chromium-browser/
[21:57:48] <hashar>	 ah yeah hmm
[21:57:50] <hashar>	 no :D
[21:57:53] <hashar>	 I tried those one
[21:58:06] <hashar>	 and that is apparently for Ubuntu from 2012
[21:58:07] <hashar>	 :(
[21:58:15] <hashar>	 the deps fail
[21:58:19] <hashar>	 will try the other ones I found
[21:58:28] <hashar>	 from https://launchpad.net/ubuntu/trusty/amd64/chromium-browser/49.0.2623.108-0ubuntu0.14.04.1.1113
[21:58:30] <ori>	 are you sure? the mtime is 30-Mar-2016
[21:58:33] <hashar>	 + exploring the URLs
[21:58:44] <hashar>	 yeah March 30 is when Ubuntu build 49
[21:58:58] <hashar>	 and I guess they went as far as rebuilding for Lucid or whatever old version
[21:59:38] <ori>	 ahhh
[21:59:41] <paladox>	 hashar: Plus it is the same person who created those as in the changelog at http://changelogs.ubuntu.com/changelogs/pool/universe/c/chromium-browser/chromium-browser_50.0.2661.102-0ubuntu0.14.04.1.1117/changelog
[21:59:45] <paladox>	 ori ^^
[22:00:14] <hashar>	 ori: I think I got the proper one from launchpad :)
[22:00:28] <paladox>	 :)
[22:01:38] <paladox>	 hashar http://launchpadlibrarian.net/249878696/chromium-browser_49.0.2623.108-0ubuntu0.14.04.1.1113_amd64.deb
[22:13:41] <wikibugs>	 10Continuous-Integration-Infrastructure, 13Patch-For-Review, 07WorkType-Maintenance: qunit jobs have karma stall when chromium disconnect - https://phabricator.wikimedia.org/T136188#2332236 (10hashar) Archived them on https://people.wikimedia.org/~hashar/debs/chromium_49_trusty/  I the downloaded the package...
[22:14:19] <hashar>	 archived at https://people.wikimedia.org/~hashar/debs/chromium_49_trusty/ 
[22:14:26] <paladox>	 hashar: :)
[22:14:47] <hashar>	 stupid puppet
[22:14:51] <hashar>	 it doesn't like hold package
[22:14:52] <hashar>	 :(
[22:16:14] <paladox>	 Oh
[22:16:23] <paladox>	 hashar: https://gerrit.wikimedia.org/r/#/c/291104/
[22:19:26] <hashar>	 for god sake
[22:19:32] <hashar>	 everything is broken somehow ...
[22:19:47] <paladox>	 Oh
[22:20:41] <wmf-insecte>	 Yippee, build fixed!
[22:20:42] <wmf-insecte>	 Project beta-update-databases-eqiad build #8811: 09FIXED in 40 sec: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/8811/
[22:23:00] <hashar>	 !log salt -v '*trusty*' cmd.run 'puppet agent --disable "Chromium needs to be v49. See T136188"'
[22:23:01] <stashbot>	 T136188: qunit jobs have karma stall when chromium disconnect - https://phabricator.wikimedia.org/T136188
[22:23:05] <qa-morebots>	 Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master
[22:24:18] <wikibugs>	 10Continuous-Integration-Infrastructure, 13Patch-For-Review, 07WorkType-Maintenance: qunit jobs have karma stall when chromium disconnect - https://phabricator.wikimedia.org/T136188#2332277 (10hashar) a:03hashar Current state is:  * We are back to Chromium 49 on Trusty slaves * Karma packages in MediaWiki...
[22:24:28] <wikibugs>	 10Continuous-Integration-Infrastructure, 13Patch-For-Review, 07WorkType-Maintenance: qunit jobs have karma stall when chromium disconnect - https://phabricator.wikimedia.org/T136188#2332279 (10hashar) p:05Unbreak!>03High
[22:25:00] <shinken-wm>	 PROBLEM - Puppet run on integration-slave-trusty-1016 is CRITICAL: CRITICAL: 55.56% of data above the critical threshold [0.0]
[22:26:04] <hashar>	 well I think that is good enough for today
[22:26:07] <hashar>	 crashing
[22:27:05] <paladox>	 hashar: Thanks
[22:27:46] <hashar>	 thx for your pointers paladox :)
[22:27:56] <paladox>	 Your welcome :)
[22:28:12] <hashar>	 ori: thank you !
[22:28:19] <paladox>	 hashar: https://integration.wikimedia.org/ci/job/mediawiki-extensions-qunit/44812/console
[22:28:20] <hashar>	 ori: all back to Chromium 49 for now.
[22:28:25] <paladox>	 test froze ^^
[22:28:26] <ori>	 i didn't help at all :)
[22:28:29] <ori>	 thanks for fixing it hashar
[22:28:31] <paladox>	 but before we downgraded.
[22:28:40] <hashar>	 paladox: that is chromium 50..
[22:28:46] <paladox>	 Yep
[22:28:59] <paladox>	 Could we abort it since it is running for 26mins.
[22:29:00] <paladox>	 please
[22:29:06] <hashar>	 that job been running since before the upgrade
[22:29:08] <hashar>	 did
[22:29:08] <shinken-wm>	 PROBLEM - Puppet run on integration-slave-trusty-1013 is CRITICAL: CRITICAL: 55.56% of data above the critical threshold [0.0]
[22:29:32] <paladox>	 yes
[22:29:42] <paladox>	 hashar integration-slave-trusty-101
[22:29:46] <paladox>	 m> PROBLEM - Puppet run on integration-slave-trusty-1013 is CRITICAL: CRITICAL: 55.56% of data above the critical threshold [0.0]
[22:30:14] <hashar>	 have a good night!
[22:30:20] <hashar>	 time for me to crash to bed for real
[22:30:27] <paladox>	 Ok bye
[22:31:04] <ori>	 good night hashar
[22:32:02] <paladox>	 legoktm: Chromium has been downgraded now by hashar.
[22:32:15] <legoktm>	 awesome
[22:32:16] <paladox>	 This https://gerrit.wikimedia.org/r/#/c/288579/ failed because it was still running chromium 50.
[22:51:01] <wikibugs>	 05Gerrit-Migration, 03releng-201516-q4: Phase 1 repository migrations to Differential (goal - end of June 2016) - https://phabricator.wikimedia.org/T130418#2332390 (10greg)
[23:10:29] <Krenair>	 https://integration.wikimedia.org/zuul/ - something wrong with ops/puppet?
[23:12:14] <wikibugs>	 06Release-Engineering-Team, 06Developer-Relations, 06Team-Practices: Setup a codereview hour for non amrican people - https://phabricator.wikimedia.org/T136370#2332431 (10Luke081515)
[23:12:19] <wikibugs>	 06Release-Engineering-Team, 06Developer-Relations, 06Team-Practices: Setup a codereview hour for non amrican people - https://phabricator.wikimedia.org/T136370#2332444 (10Luke081515) p:05Triage>03Normal
[23:14:13] <wikibugs>	 06Release-Engineering-Team, 06Developer-Relations, 06Team-Practices: Setup a codereview hour for non american people - https://phabricator.wikimedia.org/T136370#2332453 (10Krenair)
[23:28:47] <wikibugs>	 06Release-Engineering-Team, 06Developer-Relations, 06Team-Practices: Setup a codereview hour for non american people - https://phabricator.wikimedia.org/T136370#2332431 (10Paladox) Maybe hold two code review hours a day like SWAT does. So maybe 2-4pm (utc) and 8-10pm utc. Would give many users more chances o...
[23:29:51] <grrrit-wm>	 (03CR) 10Legoktm: [C: 032] Assert fixers do as intended [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/291001 (owner: 10EBernhardson)
[23:30:52] <grrrit-wm>	 (03Merged) 10jenkins-bot: Assert fixers do as intended [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/291001 (owner: 10EBernhardson)
[23:34:16] <wikibugs>	 06Release-Engineering-Team, 06Developer-Relations, 06Team-Practices: Setup a codereview hour for non american people - https://phabricator.wikimedia.org/T136370#2332431 (10Danny_B) >>! In T136370#2332476, @Paladox wrote: > Maybe hold two code review hours a day like SWAT does. So maybe 2-4pm (utc) and 8-10pm...