[00:08:58] <grrrit-wm1>	 (03PS1) 10Catrope: Add Marielle Volz to trusted users for tests [integration/zuul-config] - 10https://gerrit.wikimedia.org/r/167992 
[00:38:30] <grrrit-wm1>	 (03CR) 10Catrope: [V: 032] Blank out repo and leave a note [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/167997 (owner: 10Jforrester)
[00:38:48] <grrrit-wm1>	 (03CR) 10Catrope: [V: 032] Blank out repo and leave a note [integration/zuul-config] - 10https://gerrit.wikimedia.org/r/167995 (owner: 10Jforrester)
[01:06:55] <spagewmf>	 https://github.com/cheezy/page-object/wiki/Nested-Elements says "skierpage edited this page on Feb 11". I have *no memory* of doing this. Spooky...
[01:11:13] <icinga-wm>	 PROBLEM - BetaLabs: Puppet freshness check on labmon1001 is CRITICAL: CRITICAL: deployment-prep.deployment-logstash1.puppetagent.time_since_last_run.value (100.00%) WARN: deployment-prep.deployment-pdf01.puppetagent.time_since_last_run.value (100.00%)  
[01:35:08] <wikibugs>	 3Wikimedia Labs / 3deployment-prep (beta): Beta Labs: API PrefixSearch is taking a very long time to return, and returns nothing when it does - 10https://bugzilla.wikimedia.org/72332#c4 (10James Forrester) 5ASSI>3NEW a:3None Moving to Beta Labs.
[02:10:07] <icinga-wm>	 PROBLEM - BetaLabs: Puppet freshness check on labmon1001 is CRITICAL: CRITICAL: deployment-prep.deployment-logstash1.puppetagent.time_since_last_run.value (100.00%) WARN: deployment-prep.deployment-pdf01.puppetagent.time_since_last_run.value (100.00%)  
[03:09:47] <icinga-wm>	 PROBLEM - BetaLabs: Puppet freshness check on labmon1001 is CRITICAL: CRITICAL: deployment-prep.deployment-logstash1.puppetagent.time_since_last_run.value (100.00%) WARN: deployment-prep.deployment-pdf01.puppetagent.time_since_last_run.value (100.00%)  
[03:39:01] <wmf-insecte>	 Project browsertests-Flow-test2.wikipedia.org-windows_8-internet_explorer-sauce build #223: FAILURE in 38 min: https://integration.wikimedia.org/ci/job/browsertests-Flow-test2.wikipedia.org-windows_8-internet_explorer-sauce/223/
[04:04:22] <wmf-insecte>	 Project browsertests-Echo-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #135: FAILURE in 9 min 51 sec: https://integration.wikimedia.org/ci/job/browsertests-Echo-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce/135/
[04:11:26] <icinga-wm>	 PROBLEM - BetaLabs: Puppet freshness check on labmon1001 is CRITICAL: CRITICAL: deployment-prep.deployment-logstash1.puppetagent.time_since_last_run.value (100.00%) WARN: deployment-prep.deployment-pdf01.puppetagent.time_since_last_run.value (100.00%)  
[05:10:57] <icinga-wm>	 PROBLEM - BetaLabs: Puppet freshness check on labmon1001 is CRITICAL: CRITICAL: deployment-prep.deployment-logstash1.puppetagent.time_since_last_run.value (100.00%) WARN: deployment-prep.deployment-pdf01.puppetagent.time_since_last_run.value (100.00%)  
[06:10:47] <icinga-wm>	 PROBLEM - BetaLabs: Puppet freshness check on labmon1001 is CRITICAL: CRITICAL: deployment-prep.deployment-logstash1.puppetagent.time_since_last_run.value (100.00%) WARN: deployment-prep.deployment-pdf01.puppetagent.time_since_last_run.value (100.00%)  
[06:33:53] <wikibugs>	 3Wikimedia Labs / 3deployment-prep (beta): Beta Labs: API PrefixSearch is taking a very long time to return, and returns nothing when it does - 10https://bugzilla.wikimedia.org/72332#c5 (10Sam Reed (reedy)) Didn't Chad remove numerous search instances from beta?
[06:54:46] <wmf-insecte>	 Yippee, build fixed!
[06:54:47] <wmf-insecte>	 Project browsertests-MultimediaViewer-en.wikipedia.beta.wmflabs.org-linux-chrome-sauce build #240: FIXED in 26 min: https://integration.wikimedia.org/ci/job/browsertests-MultimediaViewer-en.wikipedia.beta.wmflabs.org-linux-chrome-sauce/240/
[06:55:18] <wmf-insecte>	 Project browsertests-Math-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #186: FAILURE in 31 sec: https://integration.wikimedia.org/ci/job/browsertests-Math-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce/186/
[07:10:13] <icinga-wm>	 PROBLEM - BetaLabs: Puppet freshness check on labmon1001 is CRITICAL: CRITICAL: deployment-prep.deployment-logstash1.puppetagent.time_since_last_run.value (100.00%) WARN: deployment-prep.deployment-pdf01.puppetagent.time_since_last_run.value (100.00%)  
[08:09:51] <icinga-wm>	 PROBLEM - BetaLabs: Puppet freshness check on labmon1001 is CRITICAL: CRITICAL: deployment-prep.deployment-pdf01.puppetagent.time_since_last_run.value (60.00%) deployment-prep.deployment-logstash1.puppetagent.time_since_last_run.value (100.00%)  
[08:46:07] <hashar>	 zeljkof: morniing :)
[08:46:17] <zeljkof>	 hashar: morning :)
[09:01:42] <grrrit-wm1>	 (03PS3) 10Zfilipin: ZeroPortal has browser tests [integration/config] - 10https://gerrit.wikimedia.org/r/166553 (https://bugzilla.wikimedia.org/72326) 
[09:02:22] <wikibugs>	 3Wikimedia / 3Quality Assurance: ZeroPortal browsertests fails early due to auth issue with zero.wikimedia.org - 10https://bugzilla.wikimedia.org/72326 (10Željko Filipin) 5PATC>3NEW
[09:07:06] <hashar>	 !log Jenkins: upgrading gearman-plugin from 0.0.7-1-g3811bb8 to 0.1.0-1-gfa5f083 .  Ie bring us to latest version + 1 commit
[09:07:08] <qa-morebots>	 Logged the message, Master
[09:11:21] <icinga-wm>	 PROBLEM - BetaLabs: Puppet freshness check on labmon1001 is CRITICAL: CRITICAL: deployment-prep.deployment-pdf01.puppetagent.time_since_last_run.value (100.00%) deployment-prep.deployment-logstash1.puppetagent.time_since_last_run.value (100.00%)  
[09:13:54] <grrrit-wm1>	 (03PS1) 10Zfilipin: Run RuboCop and Ruby jobs for CentralAuth [integration/config] - 10https://gerrit.wikimedia.org/r/168056 (https://bugzilla.wikimedia.org/69245) 
[09:14:30] <zeljkof>	 hashar: am I missing something here? ^
[09:14:57] <zeljkof>	 that is the second last problem to solve before moving rubocop from experimental
[09:15:08] <zeljkof>	 (the last thing is fixing core)
[09:16:07] <hashar>	 zeljkof: will look in a few minutes
[09:16:12] <hashar>	 finishing a bug reply
[09:17:07] <grrrit-wm1>	 (03CR) 10jenkins-bot: [V: 04-1] Run RuboCop and Ruby jobs for CentralAuth [integration/config] - 10https://gerrit.wikimedia.org/r/168056 (https://bugzilla.wikimedia.org/69245) (owner: 10Zfilipin)
[09:20:20] <grrrit-wm1>	 (03CR) 10Zfilipin: "recheck" [integration/config] - 10https://gerrit.wikimedia.org/r/168056 (https://bugzilla.wikimedia.org/69245) (owner: 10Zfilipin)
[09:21:21] <grrrit-wm1>	 (03PS2) 10Zfilipin: Run RuboCop and Ruby jobs for CentralAuth [integration/config] - 10https://gerrit.wikimedia.org/r/168056 (https://bugzilla.wikimedia.org/69245) 
[09:35:50] <hashar>	 zeljkof: sorry rather long comment written :D
[09:37:10] <hashar>	 00:00:09.427 Job mwext-CentralAuth-bundle-rubocop not defined
[09:37:10] <hashar>	 00:00:09.427 Job mwext-CentralAuth-ruby1.9.3lint not defined
[09:37:16] <hashar>	 zeljkof: the jobs haven't been created in Jenkins
[09:37:23] <hashar>	 so the Zuul test complains about it 
[09:37:49] <zeljkof>	 i have pushed the jobs
[09:37:57] <hashar>	 because if the change get merged in it would have Zuul attempts to trigger unknown job
[09:38:02] <zeljkof>	 but recheck did not run yet
[09:38:11] <hashar>	 maybe on patch proposal we should not look at Jenkins
[09:38:18] <hashar>	 and only have that verification happens on +2
[09:41:58] <hashar>	 zuul is broken :D
[09:54:30] <zeljkof>	 hashar: https://gerrit.wikimedia.org/r/#/c/168056/
[09:54:32] <zeljkof>	 all green now
[09:56:34] <grrrit-wm1>	 (03CR) 10Hashar: [C: 032] Run RuboCop and Ruby jobs for CentralAuth [integration/config] - 10https://gerrit.wikimedia.org/r/168056 (https://bugzilla.wikimedia.org/69245) (owner: 10Zfilipin)
[09:56:39] <hashar>	 zeljkof: nice :-)
[09:59:18] <grrrit-wm1>	 (03CR) 10Hashar: [C: 04-1] "That is not going to work since zero.wikimedia.org has restricted access. See my comment https://bugzilla.wikimedia.org/show_bug.cgi?id=72" [integration/config] - 10https://gerrit.wikimedia.org/r/166553 (https://bugzilla.wikimedia.org/72326) (owner: 10Zfilipin)
[10:00:30] <grrrit-wm1>	 (03Merged) 10jenkins-bot: Run RuboCop and Ruby jobs for CentralAuth [integration/config] - 10https://gerrit.wikimedia.org/r/168056 (https://bugzilla.wikimedia.org/69245) (owner: 10Zfilipin)
[10:02:36] <hashar>	 zuul reloaded!
[10:08:51] <icinga-wm>	 PROBLEM - BetaLabs: Puppet freshness check on labmon1001 is CRITICAL: CRITICAL: deployment-prep.deployment-pdf01.puppetagent.time_since_last_run.value (100.00%) deployment-prep.deployment-logstash1.puppetagent.time_since_last_run.value (100.00%)  
[10:18:11] <wikibugs>	 3Wikimedia / 3Continuous integration: Zuul: reporting of successful test runs blocked on unrelated, incomplete test runs - 10https://bugzilla.wikimedia.org/71029#c3 (10Antoine "hashar" Musso (WMF)) See also https://phabricator.wikimedia.org/T795
[10:28:45] <hashar>	 zeljkof_: it would be nice to have the rubocop change to land for mediawiki/core but it needs a bit more work
[10:29:10] <hashar>	 specially in ignoring some materials that might be present in a developer working copy
[10:29:11] <zeljkof_>	 hashar: we can move rubocop from experimental for all repos except core now, right?
[10:29:24] <zeljkof_>	 so I would do that, and then work on core
[10:29:42] <hashar>	 I would move it out of experimental but keep them non voting
[10:29:51] <zeljkof_>	 hashar: yes, for at least week or two
[10:29:53] <hashar>	 then get some wiki doc written and announce the new job to everyone
[10:29:56] <zeljkof_>	 until wee see what happens
[10:30:16] <hashar>	 then have each dev team propose the rubocop to be made voting once they have play tested it 
[10:30:25] <hashar>	 then after a week or so, force it for everyone :-]
[10:31:40] <zeljkof_>	 hashar: sounds good 
[10:33:21] <icinga-wm>	 PROBLEM - BetaLabs: Puppet freshness check on labmon1001 is CRITICAL: CRITICAL: deployment-prep.deployment-pdf01.puppetagent.time_since_last_run.value (100.00%) deployment-prep.deployment-logstash1.puppetagent.time_since_last_run.value (100.00%)  
[10:37:00] <hashar>	 restart time
[10:40:11] <hashar>	 zeljkof: I am heading out for lunch with a friend from the coworking place
[10:40:12] <hashar>	 so should be back around 2pm
[10:40:25] <hashar>	 and we can get the mw/core change amended/merged :-}
[10:40:26] <hashar>	 bbl
[11:10:51] <icinga-wm>	 PROBLEM - BetaLabs: Puppet freshness check on labmon1001 is CRITICAL: CRITICAL: deployment-prep.deployment-pdf01.puppetagent.time_since_last_run.value (100.00%) deployment-prep.deployment-logstash1.puppetagent.time_since_last_run.value (100.00%)  
[11:24:58] <grrrit-wm1>	 (03PS1) 10Zfilipin: Enable RuboCop jobs for all repositories where it was experimental [integration/config] - 10https://gerrit.wikimedia.org/r/168061 (https://bugzilla.wikimedia.org/69245) 
[11:35:35] * zeljkof is out of lunch
[11:50:45] <hashar>	 zeljkof: ok back
[11:53:22] <grrrit-wm1>	 (03PS2) 10Hashar: Add Marielle Volz to trusted users for tests [integration/config] - 10https://gerrit.wikimedia.org/r/167994 (owner: 10Catrope)
[11:53:39] <grrrit-wm1>	 (03CR) 10jenkins-bot: [V: 04-1] Add Marielle Volz to trusted users for tests [integration/config] - 10https://gerrit.wikimedia.org/r/167994 (owner: 10Catrope)
[11:53:46] <grrrit-wm1>	 (03CR) 10Hashar: [C: 032] "Deploying :)" [integration/config] - 10https://gerrit.wikimedia.org/r/167994 (owner: 10Catrope)
[11:58:06] <grrrit-wm1>	 (03Merged) 10jenkins-bot: Add Marielle Volz to trusted users for tests [integration/config] - 10https://gerrit.wikimedia.org/r/167994 (owner: 10Catrope)
[12:02:06] <grrrit-wm1>	 (03PS1) 10Hashar: zuul: replaces 'email_filter' by 'email' [integration/config] - 10https://gerrit.wikimedia.org/r/168063 
[12:02:08] <grrrit-wm1>	 (03CR) 10jenkins-bot: [V: 04-1] zuul: replaces 'email_filter' by 'email' [integration/config] - 10https://gerrit.wikimedia.org/r/168063 (owner: 10Hashar)
[12:02:15] <hashar>	 bah
[12:03:29] * zeljkof is back
[12:03:45] <grrrit-wm1>	 (03PS2) 10Hashar: zuul: replaces 'email_filter' by 'email' [integration/config] - 10https://gerrit.wikimedia.org/r/168063 
[12:03:49] <hashar>	 i am there as well zeljkof  :D
[12:04:39] <zeljkof>	 hashar: looks like this is the only ruby file in VE/VE repo, and rubocop does not find it by default
[12:04:40] <zeljkof>	 https://github.com/wikimedia/VisualEditor/blob/master/.docs/CustomTags.rb
[12:04:55] <zeljkof>	 will include it in the rubocop dotfile
[12:05:02] <hashar>	 probably because .docs  has a leading dot
[12:05:10] <zeljkof>	 yes, probably
[12:08:52] <icinga-wm>	 PROBLEM - BetaLabs: Puppet freshness check on labmon1001 is CRITICAL: CRITICAL: deployment-prep.deployment-pdf01.puppetagent.time_since_last_run.value (100.00%) deployment-prep.deployment-logstash1.puppetagent.time_since_last_run.value (100.00%)  
[12:11:42] <hashar>	     Agreeing to the Xcode/iOS license requires admin privileges, please re-run as root via sudo.
[12:11:45] <hashar>	 screw you xcode
[12:31:34] <grrrit-wm1>	 (03CR) 10Hashar: [C: 032] zuul: replaces 'email_filter' by 'email' [integration/config] - 10https://gerrit.wikimedia.org/r/168063 (owner: 10Hashar)
[12:34:48] <grrrit-wm1>	 (03Merged) 10jenkins-bot: zuul: replaces 'email_filter' by 'email' [integration/config] - 10https://gerrit.wikimedia.org/r/168063 (owner: 10Hashar)
[12:42:03] <hashar>	 zeljkof: have any time to review the pending changes we have in integration/config and get rubocop moved from experimental to test ?
[12:44:58] <zeljkof>	 hashar: sure
[12:45:03] <zeljkof>	 that I what I do all the time
[12:45:21] <zeljkof>	 playing with visualeditor/visualeditor now, next is mediawiki/vagrant
[12:45:25] <zeljkof>	 both have some ruby files
[12:45:31] <hashar>	 hehe
[12:45:45] <hashar>	 so I got a change to prevent bundle based jobs from processing submodules
[12:46:01] <hashar>	 the issue you had yesterday with a mediawiki/core  change for a wmf branch which ended up having all the extensions cloned in the workspace
[12:46:02] <hashar>	 https://gerrit.wikimedia.org/r/#/c/167798/
[12:46:04] <zeljkof>	 did you push it?
[12:46:07] <grrrit-wm1>	 (03PS2) 10Hashar: bundle jobs no more process submodules [integration/config] - 10https://gerrit.wikimedia.org/r/167798 
[12:46:10] <hashar>	 nop
[12:46:12] <hashar>	 I dont think
[12:46:16] <hashar>	 rebased
[12:46:28] <hashar>	 I don't think we have any bundle job requiring submodules
[12:46:48] <hashar>	 since they are currently only rubocop jobs :D
[12:46:50] <zeljkof>	 hashar: same here
[12:47:02] <hashar>	 so I will refresh the jobs and merge it :D
[12:47:16] <grrrit-wm1>	 (03CR) 10Zfilipin: [C: 031] bundle jobs no more process submodules [integration/config] - 10https://gerrit.wikimedia.org/r/167798 (owner: 10Hashar)
[12:47:22] <zeljkof>	 hashar: please do
[12:47:32] <zeljkof>	 should I +2 the above? ^
[12:47:40] <hashar>	 another one is injecting the ruby version  in GEM_HOME path https://gerrit.wikimedia.org/r/#/c/166555/
[12:47:49] <hashar>	 that is the per instance gem cache
[12:48:08] <hashar>	 and some gems are compiled ones, so if we have a gem compiled with  ruby 1.9x  , it is not going to work for ruby 2.x job
[12:48:33] <zeljkof>	 do we even need ruby 1.9 jobs?
[12:48:34] <hashar>	 hopefully `ruby -e 'puts RUBY_VERSION'`"  is enough
[12:48:43] <hashar>	 I don't know :-)
[12:48:45] <hashar>	 just wanna be safe
[12:49:01] <zeljkof>	 hm
[12:49:04] <hashar>	 I am assuming RUBY_VERSION is the binary compatibility version
[12:49:12] <zeljkof>	 but calling `ruby -e 'puts RUBY_VERSION'`
[12:49:20] <hashar>	 it is probably good enough for us since we only have two binary version having different RUBY_VERSION
[12:49:20] <zeljkof>	 that will always output the current ruby version, right?
[12:49:27] <hashar>	 yeah
[12:49:33] <hashar>	 which might not be the gem version we end up using :/
[12:49:42] <hashar>	 I commented about it at https://gerrit.wikimedia.org/r/#/c/166555/3/jjb/job-templates-browsertests.yaml
[12:49:53] <zeljkof>	 I mean, the default one 
[12:50:00] <hashar>	 ahh
[12:50:06] <hashar>	 yeah that is true
[12:50:13] <hashar>	 I guess I will rewrite it 
[12:50:14] <zeljkof>	 so it would be 1.8 all the time
[12:50:19] <hashar>	 depends
[12:50:26] <hashar>	 on Trusty instance it is probably 1.9.3
[12:50:37] <zeljkof>	 yes, but it will never be 2.0, right?
[12:50:45] <grrrit-wm1>	 (03CR) 10Hashar: [C: 032] "refreshing jobs" [integration/config] - 10https://gerrit.wikimedia.org/r/167798 (owner: 10Hashar)
[12:52:25] <hashar>	 ruby on trusty is 1.9.3
[12:52:40] <hashar>	 on Trusty we have:
[12:52:45] <hashar>	 gem       gem1.9.1  gem1.9.3  gem2.0    
[12:52:45] <hashar>	 ruby       ruby1.9.1  ruby1.9.3  ruby2.0    
[12:52:45] <hashar>	 :D
[12:53:17] <hashar>	 and on Precise there is no *2.0  but there are *1.8 instead
[12:53:58] <grrrit-wm1>	 (03Merged) 10jenkins-bot: bundle jobs no more process submodules [integration/config] - 10https://gerrit.wikimedia.org/r/167798 (owner: 10Hashar)
[12:54:23] <zeljkof>	 hashar: I do not see a way how we could signal the builder which ruby to use
[12:54:31] <zeljkof>	 in the current setup
[12:54:47] <zeljkof>	 but we could introduce a new jjb variable, ruby_version, or something like that
[12:54:55] <hashar>	 yeah that is what I was thinking about
[12:55:01] <zeljkof>	 or just set up instances to run 2.0 all the time
[12:55:09] <hashar>	 or that :D
[12:55:20] <hashar>	 hence my email last week to have  the gems to require 2.0
[12:55:25] <zeljkof>	 we run browser tests only trusty and ruby 2 and that is it
[12:55:26] <hashar>	 and make sure devs switch to ruby2.0 as well
[12:55:51] <hashar>	 I was looking for bundle to enforce ruby2+ to be used, possibly by adding in GemFile something like:   require ruby>=2.0
[12:55:55] <zeljkof>	 just go for it and hardcode 2.0 everywhere in browser tests
[12:55:57] <hashar>	 but couldn't find a syntax to do that
[12:56:15] <zeljkof>	 but gemfile does not help us in this case, rigth?
[12:56:26] <hashar>	 well if someone runs   bundle install
[12:56:31] <zeljkof>	 it is a separate problem
[12:56:32] <hashar>	 I am not sure which version is going to be used
[12:56:34] <hashar>	 probably 1.9
[12:56:39] <zeljkof>	 related, but separate
[12:56:41] <hashar>	 or whatever version they have by default
[12:56:52] <zeljkof>	 but 1.9 and 2.0 should both work
[12:57:05] <zeljkof>	 the only problem is jenkins machines
[12:57:08] <hashar>	 yeah
[12:57:13] <zeljkof>	 where we reuse gems
[12:57:18] <hashar>	 to confirm, are you fine having the bundle based jobs to always use ruby 2 ?
[12:57:27] <zeljkof>	 I say, let's just switch to 2.0 
[12:57:31] <hashar>	 +3
[12:57:36] <zeljkof>	 yes
[12:57:44] <hashar>	 will rebase
[12:57:45] <hashar>	 and amend
[12:58:01] <zeljkof>	 we can communicate the change, I can investigate how to document it in gemfile
[13:06:09] <grrrit-wm1>	 (03PS4) 10Hashar: Namespace GEM_HOME based on ruby version [integration/config] - 10https://gerrit.wikimedia.org/r/166555 
[13:06:25] <hashar>	 we will see what happens with ^^^ :D
[13:07:48] <zeljkof>	 hashar: is there a reason now for "puts ruby_version"?
[13:07:55] <zeljkof>	 since we already know it is 2.0
[13:08:50] <hashar>	 to vary the cache
[13:09:03] <zeljkof>	 but we can just hardcode 2.0, right?
[13:09:09] <hashar>	 since the current one is populated with gems compiled with whatever ruby version is the default
[13:09:47] <zeljkof>	 ok, so in 4 years when we move to another ubuntu lts that will come handy ;)
[13:10:00] <icinga-wm>	 PROBLEM - BetaLabs: Puppet freshness check on labmon1001 is CRITICAL: CRITICAL: deployment-prep.deployment-pdf01.puppetagent.time_since_last_run.value (100.00%) deployment-prep.deployment-logstash1.puppetagent.time_since_last_run.value (100.00%)  
[13:11:14] <grrrit-wm1>	 (03CR) 10Zfilipin: [C: 031] "One minor comment inline, but fine with me." (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/166555 (owner: 10Hashar)
[13:49:56] <grrrit-wm1>	 (03CR) 10Hashar: Namespace GEM_HOME based on ruby version (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/166555 (owner: 10Hashar)
[13:50:20] <hashar>	 holy hell that changes every jobs :/
[13:50:52] <zeljkof>	 hashar: have to go, will be back in the evening
[13:58:48] <hashar>	 okk
[14:08:28] <grrrit-wm1>	 (03PS5) 10Hashar: Switch ruby jobs to ruby 2.0 [integration/config] - 10https://gerrit.wikimedia.org/r/166555 
[14:11:19] <icinga-wm>	 PROBLEM - BetaLabs: Puppet freshness check on labmon1001 is CRITICAL: CRITICAL: deployment-prep.deployment-pdf01.puppetagent.time_since_last_run.value (100.00%) deployment-prep.deployment-logstash1.puppetagent.time_since_last_run.value (100.00%)  
[14:15:02] <grrrit-wm1>	 (03PS6) 10Hashar: Switch ruby jobs to ruby 2.0 [integration/config] - 10https://gerrit.wikimedia.org/r/166555 
[14:19:13] <grrrit-wm1>	 (03PS7) 10Hashar: Switch ruby jobs to ruby 2.0 [integration/config] - 10https://gerrit.wikimedia.org/r/166555 
[14:20:41] <grrrit-wm1>	 (03CR) 10Hashar: "Had to adjust a few more jobs to use UbuntuTrusty instead of UbuntuPrecise. That change is potentially nasty, I would deploy them in batc" [integration/config] - 10https://gerrit.wikimedia.org/r/166555 (owner: 10Hashar)
[14:25:37] <hashar>	 off be back later
[15:10:49] <icinga-wm>	 PROBLEM - BetaLabs: Puppet freshness check on labmon1001 is CRITICAL: CRITICAL: deployment-prep.deployment-pdf01.puppetagent.time_since_last_run.value (100.00%) deployment-prep.deployment-logstash1.puppetagent.time_since_last_run.value (100.00%)  
[16:10:05] <icinga-wm>	 PROBLEM - BetaLabs: Puppet freshness check on labmon1001 is CRITICAL: CRITICAL: deployment-prep.deployment-logstash1.puppetagent.time_since_last_run.value (100.00%)  
[16:27:35] <chrismcmahon>	 @seen marxarelli
[16:27:41] <chrismcmahon>	 that trick never works
[16:54:38] <wikibugs>	 3Wikimedia Labs / 3deployment-prep (beta): Mobile redirect goes to wrong domain name on beta labs - 10https://bugzilla.wikimedia.org/71079 (10Greg Grossmeier)
[16:54:41] <wikibugs>	 3Wikimedia Labs / 3deployment-prep (beta): Automatic mobile redirects for MobileFrontend on Betalabs - 10https://bugzilla.wikimedia.org/46620 (10Greg Grossmeier)
[16:55:09] <wikibugs>	 3Wikimedia Labs / 3deployment-prep (beta): Mobile redirect goes to wrong domain name on beta labs - 10https://bugzilla.wikimedia.org/71079#c8 (10Greg Grossmeier) a:5Sam Reed (reedy)>3Brion Vibber Hey Brion, Reedy suggested you taking a look into this one (Apple devices not redirecting to the mobile domai...
[16:56:37] <wikibugs>	 3Wikimedia Labs / 3deployment-prep (beta): Automatic mobile redirects for MobileFrontend on Betalabs - 10https://bugzilla.wikimedia.org/46620#c2 (10Sam Reed (reedy)) 5NEW>3RESO/FIX This seems to work fine for me on my Android at least. Bar bug 71079 at least (don't have an apple device to test on)
[16:58:22] <wikibugs>	 3Wikimedia Labs / 3deployment-prep (beta): Mobile redirect goes to wrong domain name on beta labs - 10https://bugzilla.wikimedia.org/71079#c9 (10Brion Vibber) If I go to http://en.wikipedia.beta.wmflabs.org on my iPad Air (iOS 8.1) I get redirected to http://en.m.wikipedia.beta.wmflabs.org and I see the mobi...
[17:10:22] <wikibugs>	 3Wikimedia Labs / 3deployment-prep (beta): Mobile redirect goes to wrong domain name on beta labs - 10https://bugzilla.wikimedia.org/71079#c10 (10Sam Reed (reedy)) (In reply to Brion Vibber from comment #9) > If I go directly to http://www.en.m.wikipedia.beta.wmflabs.org then I get > "mobile domains are not...
[17:11:47] <icinga-wm>	 PROBLEM - BetaLabs: Puppet freshness check on labmon1001 is CRITICAL: CRITICAL: deployment-prep.deployment-logstash1.puppetagent.time_since_last_run.value (100.00%)  
[17:13:54] <wikibugs>	 3Wikimedia Labs / 3deployment-prep (beta): Mobile redirect goes to wrong domain name on beta labs - 10https://bugzilla.wikimedia.org/71079#c11 (10Brion Vibber) Logging in keeps me on en.m.wikipedia.beta.wmflabs.org; I cannot reproduce the bug except by manually typing in the wrong domain.
[17:38:41] <wikibugs>	 3Wikimedia Labs / 3deployment-prep (beta): beta labs goes 503 for a short time - 10https://bugzilla.wikimedia.org/72366 (10Chris McMahon) 3NEW p:3Unprio s:3normal a:3None I am seeing a number of 503s from beta labs but upon checking, everything looks normal.  Here is an example: https://integration.w...
[17:42:38] <wikibugs>	 3Wikimedia Labs / 3deployment-prep (beta): beta labs goes 503 for a short time - 10https://bugzilla.wikimedia.org/72366#c1 (10Chris McMahon) adding Ori in case this might be a consequence of HHVM
[17:53:59] <wmf-insecte>	 Yippee, build fixed!
[17:54:00] <wmf-insecte>	 Project browsertests-MultimediaViewer-en.wikipedia.beta.wmflabs.org-windows_7-internet_explorer-9-sauce build #83: FIXED in 40 min: https://integration.wikimedia.org/ci/job/browsertests-MultimediaViewer-en.wikipedia.beta.wmflabs.org-windows_7-internet_explorer-9-sauce/83/
[17:57:23] <wikibugs>	 3Wikimedia Labs / 3deployment-prep (beta): Mobile redirect goes to wrong domain name on beta labs - 10https://bugzilla.wikimedia.org/71079#c12 (10Greg Grossmeier) 5NEW>3ASSI Kaldari: Can you still reproduce your issue here? What are the exact steps that Brion can try?
[18:10:40] <icinga-wm>	 PROBLEM - BetaLabs: Puppet freshness check on labmon1001 is CRITICAL: CRITICAL: deployment-prep.deployment-logstash1.puppetagent.time_since_last_run.value (100.00%)  
[18:14:40] <chrismcmahon>	 zeljkof: marxarelli this Yahoo presentation is dragging
[18:14:53] <marxarelli>	 chrismcmahon: yeah it is
[18:15:06] <zeljkof>	 chrismcmahon: it is probably for people that do not breathe that stuff all day :)
[18:15:35] <zeljkof>	 but I hear that similar story over and over
[18:15:46] <zeljkof>	 from different people/companies
[18:15:54] <zeljkof>	 and our story is not much different
[18:17:38] <chrismcmahon>	 we need a catchy name like "WikiCuke" (not really)
[18:18:10] <marxarelli>	 "Cuki" :)
[18:18:15] <zeljkof>	 WikiNuke :)
[18:18:27] <marxarelli>	 heheh
[18:18:50] <csteipp>	 chrismcmahon: Ping me when you have a few minutes to talk about the proxy
[18:19:34] <zeljkof>	 chrismcmahon, marxarelli: interesting that they like watir api
[18:20:52] <zeljkof>	 I was expecting to see more code by now
[18:21:25] <zeljkof>	 actually, any code
[18:22:02] <chrismcmahon>	 csteipp: marxarelli ^^ sure, I want to retire or update the card at https://wikimedia.mingle.thoughtworks.com/projects/scrum_of_scrums/cards/135
[18:22:06] <marxarelli>	 i agree. some feature/scenario examples would be interesting
[18:23:00] <zeljkof>	 selenium/watir api difference would be way more clear if the code was on the slide
[18:23:41] <chrismcmahon>	 I'm in a room that's booked as of 7 minutes from now. I might bail on this presentation at that point
[18:24:55] <wmf-insecte>	 Project browsertests-MultimediaViewer-en.wikipedia.beta.wmflabs.org-windows_7-internet_explorer-11-sauce build #30: FAILURE in 22 min: https://integration.wikimedia.org/ci/job/browsertests-MultimediaViewer-en.wikipedia.beta.wmflabs.org-windows_7-internet_explorer-11-sauce/30/
[18:25:03] <marxarelli>	 chrismcmahon, csteipp: the env layer i'm working on (which will allow for easier browser customization e.g. setting a proxy) might be ready enough to experiment with. perhaps centralauth BTs could be a good place to experiment with it
[18:26:18] <chrismcmahon>	 huh. that's pretty verbose
[18:26:27] <marxarelli>	 chrismcmahon: i'm in Lovelace on 6 if you want to join, but i'm feeling the same way
[18:27:00] <chrismcmahon>	 marxarelli: yeah, this guy only has another 30 minutes, I don't think he's going to get past the basics
[18:27:47] <chrismcmahon>	 hrm, and I don't like "set" either, iirc it's a different and sketchier approach than send_keys
[18:28:14] <zeljkof>	 wow, looks like they are not even using page-object gem
[18:28:27] <chrismcmahon>	 yep
[18:31:45] <chrismcmahon>	 zeljkof: maybe you do do a webinar for Sauce :-) WMF seems to be like Yahoo but dialed to 11
[18:32:08] <zeljkof>	 chrismcmahon: :)
[18:33:15] <chrismcmahon>	 I killed the sound but I'm still watching the slides
[18:36:54] <grrrit-wm1>	 (03PS1) 10Ejegg: Temporarily make jslint non-voting in fundraising/dash [integration/config] - 10https://gerrit.wikimedia.org/r/168127 
[18:41:24] <grrrit-wm1>	 (03CR) 10Ssmith: [C: 032] Temporarily make jslint non-voting in fundraising/dash [integration/config] - 10https://gerrit.wikimedia.org/r/168127 (owner: 10Ejegg)
[18:41:40] <grrrit-wm1>	 (03CR) 10Ssmith: [V: 032] Temporarily make jslint non-voting in fundraising/dash [integration/config] - 10https://gerrit.wikimedia.org/r/168127 (owner: 10Ejegg)
[19:03:27] <mutante>	 cscott: you are now a "contint-admin" and have shell on gallium.. should let you deploy zuul changes
[19:03:47] <mutante>	 merged your change. saw it create your home/key
[19:11:27] <icinga-wm>	 PROBLEM - BetaLabs: Puppet freshness check on labmon1001 is CRITICAL: CRITICAL: deployment-prep.deployment-logstash1.puppetagent.time_since_last_run.value (100.00%)  
[19:18:20] <wmf-insecte>	 Yippee, build fixed!
[19:18:20] <wmf-insecte>	 Project browsertests-Echo-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #137: FIXED in 9 min 48 sec: https://integration.wikimedia.org/ci/job/browsertests-Echo-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce/137/
[19:42:57] <cscott>	 mutante: I have the *power*
[19:43:25] <cscott>	 thanks
[19:43:32] <mutante>	 yw
[19:49:15] <wmf-insecte>	 Yippee, build fixed!
[19:49:15] <wmf-insecte>	 Project browsertests-Echo-en.wikipedia.beta.wmflabs.org-linux-chrome-sauce build #122: FIXED in 8 min 58 sec: https://integration.wikimedia.org/ci/job/browsertests-Echo-en.wikipedia.beta.wmflabs.org-linux-chrome-sauce/122/
[19:51:10] <wikibugs>	 3Wikimedia / 3Quality Assurance: Pending fails upon not finding an element (a failure case that should pass) - 10https://bugzilla.wikimedia.org/72379 (10Jeff Hobson) 3NEW p:3Unprio s:3normal a:3None Reiterating Phabricator task T600 here by request.  The following code within a step definition fails,...
[19:53:53] <wikibugs>	 3Wikimedia / 3Quality Assurance: Pending fails upon not finding an element (a failure case that should pass) - 10https://bugzilla.wikimedia.org/72379#c1 (10Chris McMahon)  Can you link to the code for this test?
[20:10:37] <icinga-wm>	 PROBLEM - BetaLabs: Puppet freshness check on labmon1001 is CRITICAL: CRITICAL: deployment-prep.deployment-logstash1.puppetagent.time_since_last_run.value (100.00%)  
[20:54:05] <bd808>	 !log Enabled puppet on deployment-logstash1
[20:54:07] <qa-morebots>	 Logged the message, Master
[21:07:36] <icinga-wm>	 RECOVERY - BetaLabs: Puppet freshness check on labmon1001 is OK: OK: All targets OK  
[21:51:58] <grrrit-wm1>	 (03CR) 10Hashar: "+2 :) Thank you for the clean up!" [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/167997 (owner: 10Jforrester)
[21:52:24] <grrrit-wm1>	 (03CR) 10Hashar: "+2 :) Thank you for the clean up!" [integration/zuul-config] - 10https://gerrit.wikimedia.org/r/167995 (owner: 10Jforrester)
[21:53:22] <grrrit-wm1>	 (03CR) 10Jforrester: "Je vous en prie. :-)" [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/167997 (owner: 10Jforrester)
[22:20:38] <wmf-insecte>	 Project browsertests-MultimediaViewer-en.wikipedia.beta.wmflabs.org-linux-chrome-sauce build #241: FAILURE in 19 min: https://integration.wikimedia.org/ci/job/browsertests-MultimediaViewer-en.wikipedia.beta.wmflabs.org-linux-chrome-sauce/241/
[22:21:38] <wmf-insecte>	 Yippee, build fixed!
[22:21:39] <wmf-insecte>	 Project browsertests-Math-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #187: FIXED in 59 sec: https://integration.wikimedia.org/ci/job/browsertests-Math-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce/187/
[22:37:16] <wmf-insecte>	 Project browsertests-UniversalLanguageSelector-commons.wikimedia.beta.wmflabs.org-linux-firefox-sauce build #236: FAILURE in 22 min: https://integration.wikimedia.org/ci/job/browsertests-UniversalLanguageSelector-commons.wikimedia.beta.wmflabs.org-linux-firefox-sauce/236/
[23:18:37] <wikibugs>	 3Wikimedia Labs / 3deployment-prep (beta): Beta Labs: API PrefixSearch is taking a very long time to return, and returns nothing when it does - 10https://bugzilla.wikimedia.org/72332#c6 (10Greg Grossmeier) (In reply to Sam Reed (reedy) from comment #5) > Didn't Chad remove numerous search instances from beta...
[23:29:07] <wikibugs>	 3Wikimedia Labs / 3deployment-prep (beta): Beta Labs: API PrefixSearch is taking a very long time to return, and returns nothing when it does - 10https://bugzilla.wikimedia.org/72332#c7 (10Chad H.) deployment-elastic01 through 04 don't exist anymore.  They're replaced with deployment-elastic05 through 08.  T...
[23:32:08] <wikibugs>	 3Wikimedia Labs / 3deployment-prep (beta): Beta Labs: API PrefixSearch is taking a very long time to return, and returns nothing when it does - 10https://bugzilla.wikimedia.org/72332#c9 (10Sam Reed (reedy)) Config is still on the old servers.... https://noc.wikimedia.org/conf/highlight.php?file=CirrusSearch-...