[00:30:55] <wikibugs>	 6Release-Engineering-Team, 6Discovery, 3Discovery-Portal-Sprint: Automatically deploy Wikimedia portals to betalabs - https://phabricator.wikimedia.org/T124848#1968218 (10MaxSem) 3NEW
[00:33:48] <wikibugs>	 6Release-Engineering-Team, 6Discovery, 3Discovery-Portal-Sprint: Automatically deploy Wikimedia portals to  Beta Cluster - https://phabricator.wikimedia.org/T124848#1968229 (10greg)
[00:34:01] <James_F>	 greg-g: :-)
[00:34:05] <wikibugs>	 10Beta-Cluster-Infrastructure, 6Release-Engineering-Team, 6Discovery, 3Discovery-Portal-Sprint: Automatically deploy Wikimedia portals to  Beta Cluster - https://phabricator.wikimedia.org/T124848#1968218 (10greg)
[00:34:17] <greg-g>	 James_F: :)
[00:34:29] <wikibugs>	 10Beta-Cluster-Infrastructure, 6Labs, 10Labs-Infrastructure, 6operations: beta: Get SSL certificates for *.{projects}.beta.wmflabs.org - https://phabricator.wikimedia.org/T50501#1968235 (10bd808)
[00:34:33] <wikibugs>	 10Beta-Cluster-Infrastructure, 6Labs, 10Labs-Infrastructure: Setup real ssl certs for Beta Cluster using a restricted project - https://phabricator.wikimedia.org/T75919#1968234 (10bd808)
[00:35:49] <wikibugs>	 10Beta-Cluster-Infrastructure, 6Release-Engineering-Team, 6Discovery, 3Discovery-Portal-Sprint: Automatically deploy Wikimedia portals to  Beta Cluster - https://phabricator.wikimedia.org/T124848#1968239 (10debt)
[02:35:05] <wmf-insecte>	 Project browsertests-WikiLove-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #829: 04FAILURE in 2 min 4 sec: https://integration.wikimedia.org/ci/job/browsertests-WikiLove-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce/829/
[02:39:50] <grrrit-wm>	 (03PS1) 10Cdentinger: WIP: Adds DonationInterface test against mediawiki 1.25 [integration/config] - 10https://gerrit.wikimedia.org/r/266653 (https://phabricator.wikimedia.org/T124105) 
[02:44:35] <shinken-wm>	 PROBLEM - App Server Main HTTP Response on deployment-mediawiki02 is CRITICAL: CRITICAL - Socket timeout after 10 seconds
[02:54:28] <shinken-wm>	 RECOVERY - App Server Main HTTP Response on deployment-mediawiki02 is OK: HTTP OK: HTTP/1.1 200 OK - 39492 bytes in 0.571 second response time
[04:39:21] <ebernhardson>	 is it possible to add my own annotations to graphite for use in grafana? i seem to have found the documentation but graphite gives be a 401 Unauthorized..so i guess the question is what i need to wire up to use the right password?
[04:39:36] <ebernhardson>	 mostly i want to add some annotations to a load test of codfw es i'm doing to mark when it transitions to higher concurrency levels
[04:40:25] <ebernhardson>	 took a quick poke around scap since deployments use annotations, but didn't see reference to the annotations api there
[04:46:27] <thcipriani|afk>	 ebernhardson: FWIW scap just does counts via UDP: https://github.com/wikimedia/scap/blob/master/scap/log.py#L478
[04:47:45] <ebernhardson>	 thcipriani|afk: oh of course, somehow in my head i had graphite annotations for grafana mixed with the annotations that show up in logstash fatalmonitor
[04:47:53] <ebernhardson>	 maybe we just don't use these anywhere currently..hmm
[06:15:36] <shinken-wm>	 PROBLEM - App Server Main HTTP Response on deployment-mediawiki02 is CRITICAL: CRITICAL - Socket timeout after 10 seconds
[06:20:26] <shinken-wm>	 RECOVERY - App Server Main HTTP Response on deployment-mediawiki02 is OK: HTTP OK: HTTP/1.1 200 OK - 39505 bytes in 0.969 second response time
[07:54:46] <wikibugs>	 10Beta-Cluster-Infrastructure, 10Spelling-Dictionary, 5Patch-For-Review: beta-code-update fails because of partial submodule in SpellingDictionary - https://phabricator.wikimedia.org/T124266#1968664 (10JanZerebecki) 5Open>3Resolved
[09:00:18] <hashar>	 !log beta:  commenting out "latency-monitor-threshold 100" parameter from any /etc/redis/redis.conf we have ( https://phabricator.wikimedia.org/T124677 ). Puppet will not reapply it unless distribution is Jessie
[09:00:21] <qa-morebots>	 Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master
[09:05:20] <wikibugs>	 10Beta-Cluster-Infrastructure: Redis latency monitor config change broke Redis in Beta Cluster - https://phabricator.wikimedia.org/T124677#1968795 (10hashar) The status of the `latency-monitor-threshold ` setting:  | Instance | Distribution | Status |--|--|-- | deployment-redis01 | Trust | Commented out previous...
[09:05:48] <wikibugs>	 10Beta-Cluster-Infrastructure: Redis latency monitor config change broke Redis in Beta Cluster - https://phabricator.wikimedia.org/T124677#1968797 (10Joe) So, the issue was:  # Probably a redis puppet change was first merged on the beta puppetmaster without a conditional guard on the latency threshold config, wh...
[09:16:06] <paladox>	 hashar: Please could you review https://gerrit.wikimedia.org/r/#/c/266679/
[09:19:32] <hashar>	 paladox: will do this morning
[09:19:39] <hashar>	 gotta review a lot more changes
[09:19:47] <paladox>	 hashar: Thanks. And ok.
[09:25:50] <wikibugs>	 10Beta-Cluster-Infrastructure: Redis latency monitor config change broke Redis in Beta Cluster - https://phabricator.wikimedia.org/T124677#1968846 (10hashar) 5Open>3Resolved So it is all fixed now.  Thank you @joe for the helpful summary !
[09:55:03] <Luke0815152>	 hashar: Currently round?
[09:55:13] <hashar>	 Luke0815152: hello yeah I am there
[09:55:41] <hashar>	 though not round at all, but more like in a square box
[09:55:41] <shinken-wm>	 PROBLEM - English Wikipedia Mobile Main page on beta-cluster is CRITICAL: CRITICAL - Socket timeout after 10 seconds
[09:56:05] <Luke0815152>	 My problem: You closed T124677, but I'm still not able to delete a page at commons: Unable to connect to redis server deployment-redis01.eqiad.wmflabs.
[09:56:13] <Luke0815152>	 (commons beta)
[09:56:41] <hashar>	 oops
[09:56:53] <hashar>	 we were talking about it in #wikimedia-operations a few minutes ago
[09:57:02] <hashar>	 the redis-server refused to start for some reason
[09:57:12] <hashar>	 but it is supposed to be running now :(
[09:57:25] <Luke0815152>	 Should I try it again?
[09:57:55] <hashar>	 should have been fixed a couple days ago already
[09:58:09] <hashar>	 Jan 25th  around 7pm  UTC
[09:58:27] <hashar>	 root@deployment-redis01:~# initctl list|grep -i redis
[09:58:27] <hashar>	 redis-instance-tcp_6379 start/running
[09:58:28] <hashar>	 redis-instance-tcp_6378 start/running
[09:58:28] <hashar>	 redis-instance-tcp_6380 start/running
[09:58:30] <hashar>	 redis-instance-tcp_6381 start/running
[09:59:20] <hashar>	 but nothing listening to them ...
[09:59:21] <hashar>	 grrr
[09:59:31] <Luke0815152>	 hashar: "The page was deleted" :)
[09:59:54] <Luke0815152>	 (Deletion log); 10:59 . . Luke081515 (talk | contribs | block) deleted page User:Rcubey ‎(Spam)
[10:00:20] <hashar>	 stupid puppet
[10:00:21] <hashar>	 Notice: /Stage[main]/Redis/Service[redis-server]/ensure: ensure changed 'running' to 'stopped'
[10:00:23] <hashar>	 eek
[10:00:32] <shinken-wm>	 RECOVERY - English Wikipedia Mobile Main page on beta-cluster is OK: HTTP OK: HTTP/1.1 200 OK - 31698 bytes in 0.715 second response time
[10:00:42] <hashar>	 oh
[10:01:41] <wmf-insecte>	 Project browsertests-Flow-en.wikipedia.beta.wmflabs.org-linux-chrome-monobook-sauce build #696: 04STILL FAILING in 40 min: https://integration.wikimedia.org/ci/job/browsertests-Flow-en.wikipedia.beta.wmflabs.org-linux-chrome-monobook-sauce/696/
[10:01:51] <Luke0815152>	 hashar: Now it's down again
[10:02:46] <hashar>	 Luke0815152: yeah I am playing with the instance
[10:02:52] <hashar>	 trying to figure out what is going on
[10:03:58] <Luke0815152>	 ok
[10:07:51] <hashar>	 !log mass restarting redis-server process on deployment-redis01
[10:07:54] <qa-morebots>	 Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master
[10:08:02] <hashar>	 !log mass restarting redis-server process on deployment-redis01 (for https://phabricator.wikimedia.org/T124677 )
[10:08:04] <qa-morebots>	 Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master
[10:09:18] <Luke0815152>	 I have to go now, but thank you for your help, hashar.... (me bouncer will be here anyway ;))
[10:10:08] <hashar>	 Luke081515|away: thanks for the notification
[10:10:46] <wikibugs>	 10Beta-Cluster-Infrastructure: Redis latency monitor config change broke Redis in Beta Cluster - https://phabricator.wikimedia.org/T124677#1968958 (10hashar) On deployment-redis01 I have manually ran `/etc/init.d/redis-server start` it started listening on 6379   Then when running puppet: ``` Notice: /Stage[main...
[10:19:34] <hashar>	 zeljkof: around ?
[10:28:05] <wmf-insecte>	 Yippee, build fixed!
[10:28:06] <wmf-insecte>	 Project browsertests-CentralNotice-en.wikipedia.beta.wmflabs.org-linux-chrome-sauce build #578: 09FIXED in 32 sec: https://integration.wikimedia.org/ci/job/browsertests-CentralNotice-en.wikipedia.beta.wmflabs.org-linux-chrome-sauce/578/
[10:28:20] <wmf-insecte>	 Yippee, build fixed!
[10:28:20] <wmf-insecte>	 Project browsertests-CentralNotice-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #576: 09FIXED in 44 sec: https://integration.wikimedia.org/ci/job/browsertests-CentralNotice-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce/576/
[10:28:55] <wmf-insecte>	 Yippee, build fixed!
[10:28:55] <wmf-insecte>	 Project browsertests-WikiLove-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #830: 09FIXED in 1 min 56 sec: https://integration.wikimedia.org/ci/job/browsertests-WikiLove-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce/830/
[10:29:17] <hashar>	 !log triggered bunch of browser tests, deployment-redis01 was dead/faulty
[10:29:19] <qa-morebots>	 Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master
[10:29:54] <zeljkof>	 hashar: yes!
[10:30:32] <hashar>	 zeljkof: can we get mediawiki-selnium updated ? Would need to CR+2 the change that adds rake
[10:30:34] <hashar>	 then tag / release
[10:30:52] <hashar>	 https://gerrit.wikimedia.org/r/#/c/266205/ /D
[10:31:00] <wmf-insecte>	 Yippee, build fixed!
[10:31:01] <wmf-insecte>	 Project browsertests-GettingStarted-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #734: 09FIXED in 58 sec: https://integration.wikimedia.org/ci/job/browsertests-GettingStarted-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce/734/
[10:32:18] <wmf-insecte>	 Yippee, build fixed!
[10:32:19] <wmf-insecte>	 Project browsertests-QuickSurveys-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce build #156: 09FIXED in 4 min 9 sec: https://integration.wikimedia.org/ci/job/browsertests-QuickSurveys-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce/156/
[10:34:19] <hashar>	 tis magic
[10:35:24] <zeljkof>	 hashar: will do right now
[10:45:00] <zeljkof>	 hashar: hm, strange
[10:45:36] <zeljkof>	 "bundle exec rake" works just fine for mediawiki/selenium on my machine, even without your path
[10:45:36] <zeljkof>	 patch
[10:45:36] <zeljkof>	 https://gerrit.wikimedia.org/r/#/c/266205/
[10:45:47] <zeljkof>	 does it fail in CI?
[10:47:21] <hashar>	 zeljkof: it fails on my local machine
[10:47:25] <zeljkof>	 but rake is not in Gemfile.lock
[10:47:32] <hashar>	 eek
[10:47:36] <zeljkof>	 I am not sure why it runs fine on my machine :)
[10:48:08] <hashar>	 let me try again
[10:48:43] <hashar>	 rake -T
[10:48:44] <hashar>	 etc
[10:48:49] <hashar>	  /usr/local/Cellar/ruby21/2.1.7/lib/ruby/2.1.0/rake/version.rb:2: warning: already initialized constant Rake::VERSION
[10:48:56] <hashar>	  /Users/amusso/.gem/gems/rake-10.4.2/lib/rake.rb:24: warning: previous definition of VERSION was here
[10:49:02] <hashar>	 double rake :-}
[10:49:30] <zeljkof>	 but even if you have rake on the machine, "bundle exec" would namespace it to the version in Gemfile.lock
[10:49:37] <zeljkof>	 and complain if it is not there
[10:49:51] <hashar>	 zeljkof: the Gemfile.lock isn't updated 
[10:49:58] <hashar>	 because rake is already there
[10:50:15] <zeljkof>	 I am just looking, it is not there :/
[10:50:23] <zeljkof>	 let me double check
[10:50:33] <hashar>	 must be a dependency of one of the other gems
[10:50:42] <zeljkof>	 no, it is not
[10:51:16] <hashar>	 ahhh
[10:51:21] <hashar>	 Gemfile.lock is in gitignore :D
[10:53:03] <zeljkof>	 just noticed that
[10:53:35] <zeljkof>	 but rake is not there anyway
[10:55:51] * hashar tries again
[10:56:02] <hashar>	 so
[10:56:12] <hashar>	 with current master,   bundle install doesn't add rake in Gemfile.lock
[10:56:55] <hashar>	 but is added with my patch :D
[10:57:02] <hashar>	 seems all fine to me
[11:01:59] <zeljkof>	 ok, testing, merging and releasing
[11:03:21] <wikibugs>	 6Release-Engineering-Team, 10DBA, 10MediaWiki-Configuration, 6operations, and 2 others: codfw is in read only according to mediawiki - https://phabricator.wikimedia.org/T124795#1969195 (10Joe) jcrespo: how do we make it 100% read-only? is there an easy way to do that?  I agree that we should stop using cro...
[11:06:03] <grrrit-wm>	 (03CR) 10Zfilipin: "$ gem build mediawiki_selenium.gemspec" [selenium] - 10https://gerrit.wikimedia.org/r/266205 (owner: 10Hashar)
[11:06:32] <hashar>	 eek
[11:06:39] <hashar>	 zeljkof: so we need to select a specific version of rake ?
[11:07:05] <zeljkof>	 hashar: yes
[11:07:07] <zeljkof>	 doing it
[11:07:14] <zeljkof>	 is that a problem?
[11:07:22] <zeljkof>	 bundle install will just do it
[11:07:52] <hashar>	 WARNING:  pessimistic dependency on rubocop (~> 0.29.1, development) may be overly strict
[11:07:52] <hashar>	   if rubocop is semantically versioned, use:
[11:07:52] <hashar>	     add_development_dependency 'rubocop', '~> 0.29', '>= 0.29.1'
[11:08:10] <zeljkof>	 hashar: hm, I do not get that warning :/
[11:08:26] <grrrit-wm>	 (03PS3) 10Zfilipin: Add rake as a dependency [selenium] - 10https://gerrit.wikimedia.org/r/266205 (owner: 10Hashar)
[11:08:32] <hashar>	 ah
[11:08:56] <grrrit-wm>	 (03CR) 10Zfilipin: "$ gem build mediawiki_selenium.gemspec" [selenium] - 10https://gerrit.wikimedia.org/r/266205 (owner: 10Hashar)
[11:09:17] <grrrit-wm>	 (03CR) 10Zfilipin: "Patch set 3 fixes "gem build" warning." [selenium] - 10https://gerrit.wikimedia.org/r/266205 (owner: 10Hashar)
[11:09:19] <hashar>	 time for CR+2
[11:09:26] <hashar>	 then craft a commit to bump version to 1.7.0
[11:11:18] <grrrit-wm>	 (03CR) 10Zfilipin: [C: 032] Add rake as a dependency [selenium] - 10https://gerrit.wikimedia.org/r/266205 (owner: 10Hashar)
[11:11:49] <zeljkof>	 hashar: why minor version bump? we just fix a couple of problems
[11:12:02] <zeljkof>	 shouldn't it be a patch release?
[11:12:09] <zeljkof>	 1.6.4?
[11:12:58] <hashar>	 yeah could be considered a bug fix indeed :D
[11:13:24] <grrrit-wm>	 (03Merged) 10jenkins-bot: Add rake as a dependency [selenium] - 10https://gerrit.wikimedia.org/r/266205 (owner: 10Hashar)
[11:13:55] <hashar>	 zeljkof:  so 1.6.4 ;}
[11:14:10] <zeljkof>	 hashar: deal! :)
[11:14:30] <zeljkof>	 not related, but what is the deal with this? https://gerrit.wikimedia.org/r/#/c/265513/
[11:14:59] <zeljkof>	 I thought js things are now moved to "grunt test"
[11:15:27] <zeljkof>	 and it is just a matter of updating a file in the local repo, not in integration/config
[11:15:32] <zeljkof>	 am I missing something?
[11:15:44] <zeljkof>	 or, are they unaware of the recent changes?
[11:33:45] <hashar>	 zeljkof: the qunit job is slightly different
[11:33:55] <hashar>	 it setup mediawiki so it can be used over a web server
[11:34:03] <zeljkof>	 hashar: I see
[11:34:14] <hashar>	 and we have the test runner pointing to Special:JavaScriptTest or something like that
[11:34:16] <zeljkof>	 that is what I need for browser tests :)
[11:34:37] <grrrit-wm>	 (03PS2) 10Hashar: [QuickSurveys] Add QUnit tests [integration/config] - 10https://gerrit.wikimedia.org/r/265513 (https://phabricator.wikimedia.org/T124309) (owner: 10Paladox)
[11:34:55] <wikibugs>	 10Continuous-Integration-Config, 10QuickSurveys, 5Patch-For-Review: QuickSurveys doesn't run qunit on commit basis - https://phabricator.wikimedia.org/T124309#1969284 (10hashar) a:3Paladox
[11:36:40] <hashar>	 zeljkof: we already have that!  mwext-mw-selenium
[11:37:09] <zeljkof>	 hashar: but for ruby, right?
[11:37:14] <zeljkof>	 I need it for javascript
[11:39:15] <grrrit-wm>	 (03CR) 10Hashar: [C: 032] [QuickSurveys] Add QUnit tests [integration/config] - 10https://gerrit.wikimedia.org/r/265513 (https://phabricator.wikimedia.org/T124309) (owner: 10Paladox)
[11:40:07] <grrrit-wm>	 (03Merged) 10jenkins-bot: [QuickSurveys] Add QUnit tests [integration/config] - 10https://gerrit.wikimedia.org/r/265513 (https://phabricator.wikimedia.org/T124309) (owner: 10Paladox)
[11:42:40] <grrrit-wm>	 (03PS1) 10Zfilipin: Release patch version 1.6.4 [selenium] - 10https://gerrit.wikimedia.org/r/266699 
[11:42:55] <zeljkof>	 hashar: ^
[11:43:08] <zeljkof>	 take a quick look if you have a minute
[11:43:17] <zeljkof>	 if it looks good I will merge and release
[11:46:35] <grrrit-wm>	 (03CR) 10Hashar: [C: 032] Release patch version 1.6.4 [selenium] - 10https://gerrit.wikimedia.org/r/266699 (owner: 10Zfilipin)
[11:46:42] <hashar>	 zeljkof: yup looked at it CR+2 ed it
[11:46:49] <hashar>	 zeljkof: dont forget to git tag :-}
[11:47:09] <zeljkof>	 "rake release" does it automagically :)
[11:47:25] <grrrit-wm>	 (03CR) 10Hashar: "Validated on https://gerrit.wikimedia.org/r/#/c/266576/" [integration/config] - 10https://gerrit.wikimedia.org/r/265513 (https://phabricator.wikimedia.org/T124309) (owner: 10Paladox)
[11:47:37] <wikibugs>	 10Continuous-Integration-Config, 10QuickSurveys, 5Patch-For-Review: QuickSurveys doesn't run qunit on commit basis - https://phabricator.wikimedia.org/T124309#1969325 (10hashar) 5Open>3Resolved Validated on https://gerrit.wikimedia.org/r/#/c/266576/   mwext-qunit SUCCESS in 1m 35s
[11:48:04] <grrrit-wm>	 (03Merged) 10jenkins-bot: Release patch version 1.6.4 [selenium] - 10https://gerrit.wikimedia.org/r/266699 (owner: 10Zfilipin)
[11:53:03] <grrrit-wm>	 (03CR) 10Zfilipin: "$ bundle exec rake release" [selenium] - 10https://gerrit.wikimedia.org/r/266699 (owner: 10Zfilipin)
[11:53:31] <grrrit-wm>	 (03CR) 10Zfilipin: "https://rubygems.org/gems/mediawiki_selenium/versions/1.6.4" [selenium] - 10https://gerrit.wikimedia.org/r/266699 (owner: 10Zfilipin)
[11:55:34] <hashar>	 hurrah
[12:08:52] <hashar>	 zeljkof: I will handle the mediawiki-selenium version bump
[12:09:34] <zeljkof>	 hashar: great
[12:47:09] <wmf-insecte>	 Project browsertests-PdfHandler-test2.wikipedia.org-linux-firefox-sauce build #773: 04FAILURE in 1 min 9 sec: https://integration.wikimedia.org/ci/job/browsertests-PdfHandler-test2.wikipedia.org-linux-firefox-sauce/773/
[12:48:36] <hashar>	 zeljkof: bundle update mediawiki-selenium   is annoying
[12:48:41] <hashar>	 it bumps all dependencies :(
[12:49:16] <zeljkof>	 hashar: why are you updating all dependencies?
[12:49:19] <zeljkof>	 for the gem?
[12:49:23] <hashar>	 bundle does it
[12:49:32] <hashar>	 well it updates all the dependencies of mediawiki-selenium
[12:49:39] <hashar>	 even if there are proper matches in the lock
[12:50:50] <wmf-insecte>	 Project beta-scap-eqiad build #87828: 04FAILURE in 6 min 12 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/87828/
[12:54:27] <zeljkof>	 hashar: wait, _why_ are you updating dependencies for the gem?
[12:54:45] <hashar>	 well
[12:54:53] <hashar>	 in Gemfile I bump the version to 1.6.4
[12:54:57] <hashar>	 and run bundle update
[12:55:09] <hashar>	 or should I bundleinstall
[12:55:14] <zeljkof>	 no
[12:55:16] <zeljkof>	 bundle install
[12:55:22] <zeljkof>	 will install everything you need
[12:55:40] <zeljkof>	 "bundle update" tries to get the latest version of every dependency
[12:56:24] <hashar>	 that still bump various entries in the lock file :(
[12:57:15] <zeljkof>	 maybe lock file is changed by the previous "bundle update"
[12:57:24] <zeljkof>	 delete it and run "bundle install" again
[12:57:31] <zeljkof>	 it will recreate gemfile.lock file
[12:59:22] <hashar>	 I did that
[12:59:32] <hashar>	 bundle install stil update bunch of dependencies :D
[13:00:38] <wmf-insecte>	 Yippee, build fixed!
[13:00:38] <wmf-insecte>	 Project beta-scap-eqiad build #87829: 09FIXED in 6 min 12 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/87829/
[13:01:45] <zeljkof>	 maybe rake needs something more up to date
[13:01:47] <zeljkof>	 not sure
[13:01:51] <zeljkof>	 post the diff :)
[13:03:51] <hashar>	 somehow it bumps page-object bla
[13:03:56] <hashar>	 copy pasting
[13:04:27] <hashar>	 Using page-object 1.1.1 (was 1.1.0)
[13:05:27] <hashar>	 zeljkof: http://pastebin.com/mtvyJHUv
[13:07:27] <zeljkof>	 I see
[13:07:53] <zeljkof>	 the gemfile says 1.1.0 or higher, but not 1.2x
[13:08:21] * zeljkof is out of lunch
[13:13:35] <hashar>	 we would want something like  gem install mediawiki_selenium --conservative
[13:35:37] <hashar>	 looks like bundle install reresolve all dependencies :/
[13:41:18] <zeljkof>	 that is because Gemfile.lock is in .gitignore
[14:03:46] <hashar>	 zeljkof: which .gitignore ?
[14:03:54] <hashar>	 the one from mediawiki-selenium?
[14:03:59] <zeljkof>	 yes
[14:04:02] <hashar>	 oh
[14:04:12] <zeljkof>	 when it is in the repo, then bundler know which versions to pick
[14:04:19] <zeljkof>	 since it is not there, it has to resolve
[14:04:35] <hashar>	 and I checked,  bundle install does resolve the dependencies of dependency
[14:04:52] <hashar>	 and since mediawiki_selenium seems to have loose requirements, random things are injected
[14:05:30] <zeljkof>	 yes, that is why we usually have lock file in git
[14:05:33] <zeljkof>	 but not for gems
[14:05:37] <zeljkof>	 forgot the reason
[14:05:42] <hashar>	 so even with a lock file in CentralAuth
[14:05:47] <hashar>	 it all behave as if I ran bundle update
[14:06:22] <hashar>	 so I dont know what to do ;-}
[14:13:02] <hashar>	 zeljkof: i crafted some lame draft changes
[14:13:04] <hashar>	 https://gerrit.wikimedia.org/r/#/c/266725/
[14:13:12] <hashar>	 that is the mediawiki_selenium dependencies being updated since they are loose
[14:13:33] <hashar>	 and https://gerrit.wikimedia.org/r/#/c/266726/  is what I was expecting from bundle install, i.e. only update  mediawiki_selenium and not all of its own dependencies
[14:13:43] <hashar>	 since they are fulfilled by the .lock file
[14:14:34] <zeljkof>	 hashar: want to pair on it tomorrow?
[14:14:36] <zeljkof>	 or now?
[14:15:02] <hashar>	 well
[14:15:04] <hashar>	 there is nothing to pair really
[14:15:07] <hashar>	 unless we fix bundler :-}
[14:15:16] <hashar>	 and it is dependency manager monillio something
[14:15:32] <hashar>	 I am just wondering how you get mediawiki_selenium updated
[14:15:42] <hashar>	 should we get all its dependencies updated as well? or be more conservative
[14:16:23] <zeljkof>	 hashar: sorry, I am confused :)
[14:16:27] <zeljkof>	 what are you doing?
[14:16:32] <zeljkof>	 is there a task for it?
[14:20:44] <hashar>	 for what?
[14:20:52] <hashar>	 yeah the task is https://phabricator.wikimedia.org/T105589
[14:21:08] <hashar>	 i.e. mediawiki_selenium failing to display the sauce labs url
[14:21:09] <hashar>	 :D
[14:21:35] <hashar>	 and I wanted to bump solely mediawiki_selenium without bumping all its dependencies unless it is actually really needed
[14:21:51] <hashar>	 but seems it is not really possible. So I am wondering how we do it usually
[14:23:39] <zeljkof>	 bundle update mediawiki_selenium
[14:23:42] <zeljkof>	 did you try that?
[14:24:39] <hashar>	 yeah that updates everything to latest version matching the gem file requirement
[14:26:31] <zeljkof>	 strange
[14:26:36] <zeljkof>	 just leave it at that
[14:26:38] <zeljkof>	 it should be find
[14:26:40] <zeljkof>	 fine
[14:28:10] <hashar>	 OH
[14:28:19] <hashar>	 no forget e
[14:28:19] <hashar>	 :D
[14:29:47] <hashar>	 so
[14:29:58] <hashar>	 if I set = 1.6.3  then run   bundle lock --update=mediawiki_selenium
[14:30:03] <hashar>	 it does refresh the dependencies for the gem
[14:30:40] <hashar>	 then reverting back to ~> 1.6.3  and running bundle update mediawiki_selenium , it is bumped to 1.6.4  and since the other deps got update nothing else is changed
[14:30:50] <hashar>	 zeljkof: so I just blindly update all mediawiki_selenium dependencies right ?
[14:34:27] <zeljkof>	 hashar: yes, that should be fine
[14:34:43] <zeljkof>	 mw-sel knows what it needs, bundler should figure it out just fine
[14:44:32] <hashar>	 zeljkof: so i can just  https://gerrit.wikimedia.org/r/266737     :D
[14:44:51] * hashar looks at https://integration.wikimedia.org/ci/job/mwext-mw-selenium/3183/consoleFull
[14:45:27] <zeljkof>	 hashar: looks good to me
[14:45:31] <zeljkof>	 should I +2 it?
[14:46:20] <hashar>	 yeah
[14:46:26] <hashar>	 that one is harmless for Gerrit patches
[14:46:32] <hashar>	 since no scenario runs
[14:46:45] <hashar>	 once it lands, I will rebase the addition of new browser tests that jon made on https://gerrit.wikimedia.org/r/#/c/260881/
[14:46:48] <hashar>	 (well recheck)
[14:47:11] <zeljkof>	 hashar: I did the same thing recently https://github.com/wikimedia/mediawiki-extensions-MultimediaViewer/commit/0b8b4c4716dd5958661697419d05be7b5c95f1e6
[14:47:32] <hashar>	 yeah
[14:47:40] <hashar>	 but in that commit, that is not updating the other dependencies
[14:47:44] <hashar>	 though maybe they were uptodate
[14:48:20] <zeljkof>	 yes, maybe that was just because there was nothing to update
[14:49:20] <hashar>	 we will see
[14:51:42] <hashar>	 hey
[14:51:44] <hashar>	 fails https://integration.wikimedia.org/ci/job/mwext-mw-selenium/3185/console
[14:51:56] <hashar>	  undefined method `session_id' for #<Selenium::WebDriver::Driver:0x00000002366148> (NoMethodError)
[14:51:57] <hashar>	 :D
[14:52:50] <zeljkof>	 hm
[14:52:57] <zeljkof>	 strange, where is it used?
[14:54:18] <hashar>	 updating the bug report
[14:54:32] <hashar>	 john patch is https://gerrit.wikimedia.org/r/#/c/260881/10
[14:54:46] <hashar>	 it passes with 1.6.3
[14:54:52] <hashar>	 fails with 1.6.4 + its dependencies bump
[14:55:16] <hashar>	 and I triggered the browser test https://integration.wikimedia.org/ci/job/browsertests-MultimediaViewer-en.wikipedia.beta.wmflabs.org-windows_8-internet_explorer-10-sauce/298/consoleFull  its running still
[14:58:23] <wikibugs>	 6Release-Engineering-Team, 10Browser-Tests-Infrastructure, 10Reading-Web, 5Patch-For-Review: MW-Selenium associates wrong SauceLabs job with Jenkins artifact - https://phabricator.wikimedia.org/T105589#1969736 (10hashar) So we have bumped mediawiki_selenium from 1.6.3 to 1.6.4 as well as its dependencies....
[14:59:02] <hashar>	 -    selenium-webdriver (2.48.1)
[14:59:04] <hashar>	 +    selenium-webdriver (2.49.0)
[14:59:04] <hashar>	 grbblbl
[14:59:18] <wikibugs>	 6Release-Engineering-Team, 10Browser-Tests-Infrastructure, 10Reading-Web, 5Patch-For-Review: MW-Selenium associates wrong SauceLabs job with Jenkins artifact - https://phabricator.wikimedia.org/T105589#1969738 (10hashar) Might be due to: ``` lang=diff -    selenium-webdriver (2.48.1) +    selenium-webdrive...
[15:09:06] <shinken-wm>	 PROBLEM - App Server Main HTTP Response on deployment-mediawiki01 is CRITICAL: CRITICAL - Socket timeout after 10 seconds
[15:11:43] <shinken-wm>	 PROBLEM - English Wikipedia Mobile Main page on beta-cluster is CRITICAL: CRITICAL - Socket timeout after 10 seconds
[15:14:12] <wmf-insecte>	 Project browsertests-Wikidata-WikidataTests-linux-firefox build #86: 04STILL FAILING in 1 hr 16 min: https://integration.wikimedia.org/ci/job/browsertests-Wikidata-WikidataTests-linux-firefox/86/
[15:15:37] <wmf-insecte>	 Project beta-scap-eqiad build #87836: 04FAILURE in 39 min: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/87836/
[15:18:59] <shinken-wm>	 RECOVERY - App Server Main HTTP Response on deployment-mediawiki01 is OK: HTTP OK: HTTP/1.1 200 OK - 39521 bytes in 0.481 second response time
[15:21:29] <shinken-wm>	 RECOVERY - English Wikipedia Mobile Main page on beta-cluster is OK: HTTP OK: HTTP/1.1 200 OK - 31698 bytes in 0.723 second response time
[15:27:03] <wmf-insecte>	 Yippee, build fixed!
[15:27:04] <wmf-insecte>	 Project beta-scap-eqiad build #87837: 09FIXED in 9 min 13 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/87837/
[16:26:01] <grrrit-wm>	 (03CR) 10Hashar: [C: 04-1] "That looks promising! There is a few trivial issues which i commented about inline, once solved the next step will be to deploy the job a" (032 comments) [integration/config] - 10https://gerrit.wikimedia.org/r/266653 (https://phabricator.wikimedia.org/T124105) (owner: 10Cdentinger)
[16:43:39] <hashar>	 zeljkof: I have learned about    bundle viz -v --requirements
[16:43:47] <hashar>	 zeljkof: generates a graph of all the dependencies :-}
[16:47:56] <grrrit-wm>	 (03CR) 10Ejegg: "Exciting! One note on deps.txt." (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/266653 (https://phabricator.wikimedia.org/T124105) (owner: 10Cdentinger)
[16:55:14] <zeljkof>	 hashar: cool
[16:55:24] <hashar>	 and in short 1.6.4 seems to fail
[16:55:35] <hashar>	 or at least the MultimediaViewer browser tests break completely 
[16:55:46] <zeljkof>	 hashar: hm, strange
[16:55:59] <hashar>	 I am reverting it
[16:58:05] <wikibugs>	 6Release-Engineering-Team, 10Browser-Tests-Infrastructure, 10Reading-Web, 5Patch-For-Review, 5WMF-deploy-2016-02-02_(1.27.0-wmf.12): MW-Selenium associates wrong SauceLabs job with Jenkins artifact - https://phabricator.wikimedia.org/T105589#1970160 (10hashar) So I crafted a change that revert the seleni...
[16:59:02] <zeljkof>	 I have pairing session with Dan now, we could take a look
[17:01:24] <wikibugs>	 6Release-Engineering-Team, 10Browser-Tests-Infrastructure, 10Reading-Web, 5Patch-For-Review, 5WMF-deploy-2016-02-02_(1.27.0-wmf.12): MW-Selenium associates wrong SauceLabs job with Jenkins artifact - https://phabricator.wikimedia.org/T105589#1970175 (10hashar) Full stack trace from a scenario failing on...
[17:02:48] <hashar>	 zeljkof: I am reverting the version bump meanwhile ( that is https://gerrit.wikimedia.org/r/#/c/266766/ )
[17:03:27] <zeljkof>	 hashar: ugh, I should have tested it locally before releasing the gem :/
[17:03:34] <hashar>	 yeah I guess
[17:03:38] <hashar>	 though dan must have tested it 
[17:03:52] <hashar>	 stuff happens ;-}
[17:09:11] <wikibugs>	 6Release-Engineering-Team, 10Browser-Tests-Infrastructure, 10Reading-Web, 5Patch-For-Review, 5WMF-deploy-2016-02-02_(1.27.0-wmf.12): MW-Selenium associates wrong SauceLabs job with Jenkins artifact - https://phabricator.wikimedia.org/T105589#1970205 (10hashar) Reverted. I have `recheck` https://gerrit.wi...
[17:09:21] <hashar>	 marxarelli: good morning :-}
[17:09:30] <marxarelli>	 hashar: morning
[17:09:37] <zeljkof>	 marxarelli: https://gerrit.wikimedia.org/r/#/c/257928/
[17:09:40] <marxarelli>	 morning PST
[17:09:52] <zeljkof>	 https://phabricator.wikimedia.org/T99653
[17:10:06] <hashar>	 marxarelli: we released mediawiki_selenium 1.6.4 but it screw up MultimediaViewer tests being proposed at https://gerrit.wikimedia.org/r/#/c/260881/10 as well as https://integration.wikimedia.org/ci/job/browsertests-MultimediaViewer-en.wikipedia.beta.wmflabs.org-windows_8-internet_explorer-10-sauce/  :D
[17:10:17] <hashar>	 so I reverted the bump in MultimediaViewer :(
[17:12:42] <hashar>	 but maybe I am utterly confused :}
[17:17:24] <zeljkof>	 hashar: you only executed ie10 jenkins job for MMV?
[17:17:28] <marxarelli>	 hashar: we should probably try one of the chrome or firefox jobs
[17:17:38] <hashar>	 yeah I have picked a random one
[17:17:53] <hashar>	 the actual test to run from Gerrit patchset are implemented with https://gerrit.wikimedia.org/r/#/c/260881/10
[17:18:10] <hashar>	 and when I have recheck after selenium_webdriver 1.6.4 got merged, it started falling horribly
[17:18:16] <hashar>	 on a revert, they pass again
[17:19:10] <hashar>	 I even crafted a change that solely update mediawiki_selenium (i.e. does not change its dependencies)
[17:19:12] <marxarelli>	 hashar: ah, ok
[17:19:14] <hashar>	 and it fails as well :/
[17:19:42] <hashar>	 my test change was https://gerrit.wikimedia.org/r/#/c/266765/
[17:19:47] <hashar>	 which remove the dependencies update
[17:19:54] <hashar>	 and depends on the browser tests being worked on
[17:19:56] <hashar>	 and that fails :/
[17:20:13] <hashar>	 indicating mediawiki_selenium 1.6.4 is at fault somehow :(
[17:20:18] <marxarelli>	 btw, for future releases, anything that changes class/method signatures should probably be a minor version bump
[17:20:26] <marxarelli>	 i.e. 1.7.0
[17:20:59] <marxarelli>	 hashar: zeljkof and i are debugging it now
[17:21:06] <marxarelli>	 if you want to join our pairing
[17:21:25] <hashar>	 yeah we thought about 1.7.0  but decided after all it was just a bug fix :D
[17:22:09] <hashar>	 gotta rush out 
[17:22:18] <hashar>	 marxarelli: zeljkof good luck with debug!
[17:45:39] <ostriches>	 thcipriani: D109, when you get a chance. Should be trivial, came across it when poking something else for csteipp.
[17:48:22] <thcipriani>	 ostriches: {{done}}
[17:49:11] <grrrit-wm>	 (03PS2) 10Cdentinger: WIP: Adds DonationInterface test against mediawiki 1.25 [integration/config] - 10https://gerrit.wikimedia.org/r/266653 (https://phabricator.wikimedia.org/T124105) 
[17:49:35] <ostriches>	 thcipriani: I have a feeling the actual patch path will end up becoming something like /srv/patches/{REPO}/{VERSION}, but this is at least a step in the right direction in the meantime :)
[17:49:40] <wikibugs>	 5Release-Engineering-Epics, 10Gather, 10MobileFrontend, 10Reading-Web-Planning, and 2 others: [EPIC] Create a formal release process for MobileFrontend/Gather - https://phabricator.wikimedia.org/T100296#1970380 (10Jhernandez) 5Open>3Resolved a:3Jhernandez I suggest we do a different task, they are fr...
[17:50:17] <grrrit-wm>	 (03PS1) 10Dduvall: Fixed `NoMethodError` in `EmbedBrowserSession` helper [selenium] - 10https://gerrit.wikimedia.org/r/266776 
[17:51:41] <grrrit-wm>	 (03PS2) 10Dduvall: Fixed `NoMethodError` in `EmbedBrowserSession` helper [selenium] - 10https://gerrit.wikimedia.org/r/266776 
[17:51:59] <thcipriani>	 ostriches: whatever is easy to automate and makes sense for folks, I'm for it. +1 for small steps :)
[17:52:01] <grrrit-wm>	 (03PS3) 10Dduvall: Fixed `NoMethodError` in `EmbedBrowserSession` helper [selenium] - 10https://gerrit.wikimedia.org/r/266776 
[17:55:04] <grrrit-wm>	 (03CR) 10Zfilipin: [C: 032] Fixed `NoMethodError` in `EmbedBrowserSession` helper [selenium] - 10https://gerrit.wikimedia.org/r/266776 (owner: 10Dduvall)
[17:56:35] <grrrit-wm>	 (03Merged) 10jenkins-bot: Fixed `NoMethodError` in `EmbedBrowserSession` helper [selenium] - 10https://gerrit.wikimedia.org/r/266776 (owner: 10Dduvall)
[17:59:32] <grrrit-wm>	 (03PS1) 10Dduvall: Release patch version 1.6.5 [selenium] - 10https://gerrit.wikimedia.org/r/266780 
[18:00:29] <grrrit-wm>	 (03CR) 10Zfilipin: [C: 032] Release patch version 1.6.5 [selenium] - 10https://gerrit.wikimedia.org/r/266780 (owner: 10Dduvall)
[18:01:50] <grrrit-wm>	 (03Merged) 10jenkins-bot: Release patch version 1.6.5 [selenium] - 10https://gerrit.wikimedia.org/r/266780 (owner: 10Dduvall)
[18:07:00] <grrrit-wm>	 (03PS3) 10Cdentinger: WIP: Adds DonationInterface test against mediawiki 1.25 [integration/config] - 10https://gerrit.wikimedia.org/r/266653 (https://phabricator.wikimedia.org/T124105) 
[18:27:21] <gwicke>	 any phab experts around? I'm trying to query for bugs by priority and tags
[18:27:44] <gwicke>	 https://phabricator.wikimedia.org/search/query/advanced/ is lacking the priority part, but upstream phab has it: https://secure.phabricator.com/maniphest/query/advanced/
[18:28:37] <Krenair>	 they're two separate search forms
[18:28:42] <Krenair>	 one is phabricator search, one is maniphest search
[18:28:56] <Krenair>	 you're looking for https://phabricator.wikimedia.org/maniphest/query/advanced/
[18:29:20] <Krenair>	 upstream also has https://secure.phabricator.com/search/query/advanced/ just like us
[18:29:23] <gwicke>	 ahh, thanks!
[18:29:33] <gwicke>	 didn't notice the different URL
[18:29:46] <gwicke>	 strange to have two different "advanced search" forms
[18:29:52] <Krenair>	 well it does say 'Search' in the top left instead of 'Maniphest'
[18:30:15] <Krenair>	 it's not just two
[18:30:35] <Krenair>	 a lot of phabricator applications have their own search, not just maniphest
[18:30:53] <Krenair>	 e.g. projects: https://secure.phabricator.com/project/query/advanced/
[18:31:11] <Krenair>	 or paste: https://secure.phabricator.com/paste/query/advanced/
[18:33:37] <gwicke>	 kk
[18:47:56] <wikibugs>	 7Blocked-on-RelEng, 6Phabricator: iridium:/var/log/phd/daemons.log is growing too much (took 20% of filesystem space) - https://phabricator.wikimedia.org/T124651#1970626 (10dduvall)
[19:05:09] <wikibugs>	 6Release-Engineering-Team, 6Services, 6operations, 7Puppet, 7service-runner: Create a standard puppet module for service-runner services - https://phabricator.wikimedia.org/T89901#1970677 (10GWicke) @mobrovac, should we resolve this task?
[19:09:42] <wikibugs>	 7Blocked-on-RelEng, 6Phabricator: iridium:/var/log/phd/daemons.log is growing too much (took 20% of filesystem space) - https://phabricator.wikimedia.org/T124651#1970724 (10demon) a:3demon Gotcha. So what happens here is that when repos are deleted on Gerrit they're not necessarily marked as inactive here. I...
[19:10:07] <wikibugs>	 7Blocked-on-RelEng, 6Phabricator: iridium:/var/log/phd/daemons.log is growing too much (took 20% of filesystem space) - https://phabricator.wikimedia.org/T124651#1970753 (10demon) p:5Triage>3Unbreak!
[19:14:16] <wikibugs>	 7Blocked-on-RelEng, 6Phabricator: iridium:/var/log/phd/daemons.log is growing too much (took 20% of filesystem space) - https://phabricator.wikimedia.org/T124651#1970817 (10jcrespo) I do not think this requires "unbreak now" priority- I personally made sure to archive it before it the filesystem got full. It i...
[19:17:19] <wikibugs>	 7Blocked-on-RelEng, 6Phabricator: iridium:/var/log/phd/daemons.log is growing too much (took 20% of filesystem space) - https://phabricator.wikimedia.org/T124651#1970834 (10demon) p:5Unbreak!>3Normal UBN was mainly until we got the log to stop growing uncontrollably. I think those repos were it, so I'm low...
[19:44:46] <wikibugs>	 10Deployment-Systems, 10RESTBase, 6Services, 7Blocked-on-Operations: RESTBase deployment process - https://phabricator.wikimedia.org/T103344#1971004 (10GWicke)
[20:01:05] <shinken-wm>	 PROBLEM - App Server Main HTTP Response on deployment-mediawiki01 is CRITICAL: CRITICAL - Socket timeout after 10 seconds
[20:01:15] <shinken-wm>	 PROBLEM - English Wikipedia Main page on beta-cluster is CRITICAL: CRITICAL - Socket timeout after 10 seconds
[20:02:39] <shinken-wm>	 PROBLEM - English Wikipedia Mobile Main page on beta-cluster is CRITICAL: CRITICAL - Socket timeout after 10 seconds
[20:05:35] <shinken-wm>	 PROBLEM - App Server Main HTTP Response on deployment-mediawiki02 is CRITICAL: CRITICAL - Socket timeout after 10 seconds
[20:08:53] <wikibugs>	 6Release-Engineering-Team, 6Services, 6operations, 7Puppet, 7service-runner: Create a standard puppet module for service-runner services - https://phabricator.wikimedia.org/T89901#1971131 (10mobrovac) 5Open>3Resolved a:5GWicke>3mobrovac
[20:09:01] <wikibugs>	 6Release-Engineering-Team, 6Services, 6operations, 7Puppet, 7service-runner: Create a standard puppet module for service-runner services - https://phabricator.wikimedia.org/T89901#1048322 (10mobrovac) Indeed @Gwicke :) Done.
[20:09:46] <wikibugs>	 7Blocked-on-RelEng, 6Phabricator: iridium:/var/log/phd/daemons.log is growing too much (took 20% of filesystem space) - https://phabricator.wikimedia.org/T124651#1971136 (10mmodell) I think we should have logrotate on the phd log. There are a lot of conditions that come up which will cause phd to log somewhat...
[20:10:59] <shinken-wm>	 RECOVERY - App Server Main HTTP Response on deployment-mediawiki01 is OK: HTTP OK: HTTP/1.1 200 OK - 39517 bytes in 0.817 second response time
[20:11:09] <shinken-wm>	 RECOVERY - English Wikipedia Main page on beta-cluster is OK: HTTP OK: HTTP/1.1 200 OK - 39842 bytes in 1.454 second response time
[20:12:31] <shinken-wm>	 RECOVERY - English Wikipedia Mobile Main page on beta-cluster is OK: HTTP OK: HTTP/1.1 200 OK - 31799 bytes in 0.748 second response time
[20:15:26] <shinken-wm>	 RECOVERY - App Server Main HTTP Response on deployment-mediawiki02 is OK: HTTP OK: HTTP/1.1 200 OK - 39513 bytes in 1.104 second response time
[20:29:39] <grrrit-wm>	 (03PS1) 10Paladox: [AWS] Update Jenkins Tests [integration/config] - 10https://gerrit.wikimedia.org/r/266806 
[20:31:19] <grrrit-wm>	 (03PS2) 10Paladox: [AWS] Update Jenkins Tests [integration/config] - 10https://gerrit.wikimedia.org/r/266806 
[21:01:45] <grrrit-wm>	 (03PS1) 10Paladox: Update jslint [integration/config] - 10https://gerrit.wikimedia.org/r/266911 
[21:08:53] <thedj>	 hmm, i have a merge failure on a qunit test case for TMH REL_1.26, but it looks like karma is just failing....
[21:08:56] <thedj>	 https://integration.wikimedia.org/ci/job/mediawiki-extensions-qunit/28013/console
[21:10:05] <thedj>	 are there any known issues atm in that area ?
[21:13:25] <paladox>	 thedj: Probaly because karma needs updating on that branch too.
[21:14:51] <paladox>	 thedj: Also yes karma broke all tests when one of the dependacys was updated. So we had to update karma.
[21:15:41] <wikibugs>	 10Deployment-Systems, 3Scap3, 7WorkType-NewFunctionality: Remove apache dependency from scap3 deployment host - https://phabricator.wikimedia.org/T116630#1971419 (10thcipriani) @mmodell you could include it as part of the `git_server` argument, e.g., `git_server = tin.eqiad.wmflabs:8080`.  What changed to po...
[21:16:18] <paladox>	 thedj: But also i got script error even using the updated karma on some extensions which doint even use js files.
[21:18:18] <paladox>	 thedj: Also shows this error Notice: Undefined variable: timedMediaDir in /mnt/jenkins-workspace/workspace/mediawiki-extensions-qunit/src/extensions/TimedMediaHandler/TimedMediaHandler.hooks.php on line <i>56</i></th></tr>
[21:18:18] <paladox>	 20:58:50 <tr><th align='left' bgcolor='#e9b96e' colspan='5'>Call Stack</th></tr>
[21:19:51] <cscott>	 !log updated OCG to version 64050af0456a43344b32e3e93561a79207565eaf (should be no-op after yesterday's deploy)
[21:19:55] <qa-morebots>	 Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master
[21:25:40] <paladox>	 thedj: Problem fixed now. I re added the missing config $timedMediaDir back to global.
[21:26:20] <thedj>	 paladox: ah right. now i see that too.
[21:26:35] <thedj>	 weird that the inital jenkins verify succeeded ...
[21:28:08] <paladox>	 thedj: Yes. but Southparkfan dosent seem to be whitelisted so the qunit wasent run it only was run when you +2.
[21:30:25] <thedj>	 paladox: thx
[21:30:41] <paladox>	 thedj: Your welcome. :)
[21:35:25] <thedj>	 and on to the next..
[21:35:44] <thedj>	 now i have a parsertest failing on core, for a JS patch
[21:35:44] <thedj>	 21:19:52 1) TimingTest::testMark
[21:35:44] <thedj>	 21:19:52 Failed asserting that 1453929537.4101 is greater than 1453929537.4101.
[21:35:48] <thedj>	 21:19:52 
[21:35:50] <thedj>	 21:19:52 /mnt/jenkins-workspace/workspace/mediawiki-phpunit-hhvm/src/tests/phpunit/includes/libs/TimingTest.php:60
[21:38:04] <thedj>	 https://gerrit.wikimedia.org/r/#/c/264603/
[22:31:49] <wikibugs>	 10Beta-Cluster-Infrastructure, 6Services, 6operations: Move Node.JS services to Jessie and Node 4.2 - https://phabricator.wikimedia.org/T124989#1971690 (10mobrovac) 3NEW
[22:32:14] <wikibugs>	 10Beta-Cluster-Infrastructure, 6Services, 6operations: Move Node.JS services to Jessie and Node 4.2 - https://phabricator.wikimedia.org/T124989#1971709 (10mobrovac)
[22:40:32] <matt_flaschen>	 marxarelli, does Special:Version not update with every deploy to Beta Cluster?  I think someone explained this to me but I forgot.
[22:41:04] <wikibugs>	 6Release-Engineering-Team, 10Browser-Tests-Infrastructure, 6Security, 5MW-1.27-release-notes, and 2 others: Update all repositories that use mediawiki_selenium Ruby gem to version 1.6.x - https://phabricator.wikimedia.org/T114241#1971778 (10dduvall)
[22:42:08] <marxarelli>	 matt_flaschen: doesn't it?
[22:42:18] <greg-g>	 it should
[22:42:24] <marxarelli>	 i see 1.27alpha
[22:42:30] <marxarelli>	 20:22, 27 January 2016
[22:42:57] <marxarelli>	 mw-core 5346065e0222004cd4293ad33ae331280ce86e2b which was 2 hours ago
[22:43:53] <wikibugs>	 10Beta-Cluster-Infrastructure, 6Services, 6operations: Move Node.JS services to Jessie and Node 4.2 - https://phabricator.wikimedia.org/T124989#1971808 (10mobrovac)
[22:44:05] <marxarelli>	 yeah, that's the HEAD of master
[22:44:49] <greg-g>	 matt_flaschen: are oyu seeing something different?
[22:48:48] <grrrit-wm>	 (03PS4) 10Cdentinger: WIP: Adds DonationInterface test against mediawiki 1.25 [integration/config] - 10https://gerrit.wikimedia.org/r/266653 (https://phabricator.wikimedia.org/T124105) 
[22:51:18] <matt_flaschen>	 marxarelli, how about for extensions?  http://en.wikipedia.beta.wmflabs.org/wiki/Special:Version shows Flow (1.1 (a97344e)), but that's not latest and apparently not what's deployed (since a fix not in that is there)
[22:52:24] <marxarelli>	 matt_flaschen: hmm... maybe the update job is just being slow?
[22:52:26] * marxarelli goes to check
[22:53:20] <matt_flaschen>	 marxarelli, but I think it's actually deployed.
[22:53:52] <matt_flaschen>	 Because T124608 is fixed.
[22:56:06] <wikibugs>	 10Continuous-Integration-Infrastructure, 10MediaWiki-General-or-Unknown: Propagate build status from Travis CI back to Gerrit - https://phabricator.wikimedia.org/T124999#1971858 (10ori) 3NEW
[22:56:57] <wikibugs>	 10Continuous-Integration-Infrastructure, 10MediaWiki-General-or-Unknown: Propagate build status from Travis CI back to Gerrit - https://phabricator.wikimedia.org/T124999#1971868 (10JanZerebecki)
[22:56:59] <wikibugs>	 10Continuous-Integration-Infrastructure, 10MediaWiki-RfCs, 5Patch-For-Review: [RFC] Optional Travis integration for Jenkins - https://phabricator.wikimedia.org/T114421#1971869 (10JanZerebecki)
[22:57:21] <grrrit-wm>	 (03CR) 10Ejegg: "Maybe we need a different workspace? Looks like zuul-cloner re-uses the src directory. Here's some output from the existing job:" [integration/config] - 10https://gerrit.wikimedia.org/r/266653 (https://phabricator.wikimedia.org/T124105) (owner: 10Cdentinger)
[22:57:22] <wikibugs>	 10Continuous-Integration-Infrastructure, 10MediaWiki-General-or-Unknown: Propagate build status from Travis CI back to Gerrit - https://phabricator.wikimedia.org/T124999#1971874 (10GWicke) See also: https://phabricator.wikimedia.org/T78410
[22:59:47] <marxarelli>	 matt_flaschen: yeah, that's strange. let me check deployment-bastion
[23:00:42] <marxarelli>	 HEAD on deployment-bastion is 1b07ebc67a
[23:01:02] <marxarelli>	 for Flow that is
[23:01:53] <marxarelli>	 and the scap job has been running without any hiccups
[23:02:37] <marxarelli>	 thcipriani, ostriches: do you know why Special:Version wouldn't be up-to-date on beta?
[23:02:43] <marxarelli>	 (see backscroll)
[23:04:14] * marxarelli goes to deployment-mediawiki01 to bypass varnish
[23:15:00] <thcipriani>	 marxarelli: this does ring a bell...
[23:15:07] <wikibugs>	 6Release-Engineering-Team, 15User-greg: Reframe Q3 goals in form of the proposed process from TPG by Dec 4th - https://phabricator.wikimedia.org/T119268#1971946 (10greg) 5Open>3Resolved Done: https://www.mediawiki.org/w/index.php?title=Wikimedia_Release_Engineering_Team%2FGoals%2F201516Q3&type=revision&dif...
[23:15:35] <James_F>	 Eurgh.
[23:15:54] <James_F>	 The CI patch to test MW-core against 55 but REL1_26 against 53 is beyond me, I fear.
[23:19:02] <Reedy>	 If in doubt, hack it
[23:19:55] <marxarelli>	 thcipriani, matt_flaschen: i'm seeing the same thing directly on deployment-mediawiki01 so not a (varnish) caching issue
[23:20:21] <James_F>	 Reedy: Ha.
[23:20:23] <matt_flaschen>	 marxarelli, it might be a known issue, I have some vague recollection but I can't recall the details.
[23:20:33] <Reedy>	 James_F: I think the examples are there
[23:20:39] <Reedy>	 Just regex not version comparison
[23:21:03] <Reedy>	     skip-if:
[23:21:03] <Reedy>	       - project: '^mediawiki/core$'
[23:21:03] <Reedy>	         branch: (?:^REL1_23$|^REL1_24$|^fundraising/REL.*)
[23:21:05] <James_F>	 Reedy: Yeah, somewhere. The repo changes structure more often than I write commits to it, though.
[23:21:20] <Reedy>	 I guess you need to add something like that to the 5.3 jobs
[23:21:29] * James_F nods.
[23:21:40] <James_F>	 Possibly for the root job templates.
[23:21:43] <wikibugs>	 10Deployment-Systems, 3Scap3, 7WorkType-NewFunctionality: Remove apache dependency from scap3 deployment host - https://phabricator.wikimedia.org/T116630#1971968 (10mmodell) @thcipriani: We were talking about completely replacing the apache server on `tin` / `mirra` with a python http implementation. For tha...
[23:21:57] <Reedy>	 And then add branch: (?:^REL1_2[3-6]$) to the 5.5 jobs
[23:22:34] * James_F nods.
[23:23:00] <Reedy>	 Not brilliant, but version numbers won't be changing too frequently, so shouldn't be too much of a maintenance burdon
[23:24:24] <Reedy>	 Or just open a task and assign it to legoktm
[23:24:25] <Reedy>	 :D
[23:24:33] <James_F>	 Ha.
[23:24:37] <James_F>	 He's in .au
[23:25:30] <wikibugs>	 10Beta-Cluster-Infrastructure, 6Services: Migrate BetaCluster Node.JS services to Jessie and Node 4.2 - https://phabricator.wikimedia.org/T125003#1971975 (10mobrovac) 3NEW a:3mobrovac
[23:25:48] <wikibugs>	 10Beta-Cluster-Infrastructure, 6Services, 6operations: Move Node.JS services to Jessie and Node 4.2 - https://phabricator.wikimedia.org/T124989#1971985 (10mobrovac)
[23:25:51] <wikibugs>	 10Beta-Cluster-Infrastructure, 6Services: Migrate BetaCluster Node.JS services to Jessie and Node 4.2 - https://phabricator.wikimedia.org/T125003#1971986 (10mobrovac)
[23:28:17] <wikibugs>	 10Beta-Cluster-Infrastructure, 6Services: Migrate BetaCluster Node.JS services to Jessie and Node 4.2 - https://phabricator.wikimedia.org/T125003#1971998 (10mobrovac) @hashar, AFAIK, `deployment-parsoid05` and `deployment-cxserver03` are Jenkins slaves, right? What do we need to do in order to move them to Jes...
[23:28:38] <wikibugs>	 10Continuous-Integration-Config, 5Continuous-Integration-Scaling, 5Patch-For-Review, 7WorkType-NewFunctionality: Migrate javascript npm CI jobs to Nodepool - https://phabricator.wikimedia.org/T119143#1972001 (10mobrovac)
[23:28:42] <wikibugs>	 10Beta-Cluster-Infrastructure, 6Services, 6operations: Move Node.JS services to Jessie and Node 4.2 - https://phabricator.wikimedia.org/T124989#1972000 (10mobrovac)
[23:32:37] <greg-g>	 James_F: already or still in the air?
[23:32:56] <James_F>	 greg-g: I imagine he's landed by now.
[23:33:04] <andrewbogott>	 Can someone give me a hand with this?  https://gerrit.wikimedia.org/r/#/c/266940/
[23:34:13] <grrrit-wm>	 (03PS1) 10Jforrester: WIP: Test MW-core against PHP55 for master/REL1_27+ [integration/config] - 10https://gerrit.wikimedia.org/r/266941 
[23:34:19] <andrewbogott>	 Jenkins seems to be rejecting every patch in my extension
[23:34:57] <grrrit-wm>	 (03CR) 10Jforrester: "This is partial and getting ridiculous (and almost certainly won't work)." [integration/config] - 10https://gerrit.wikimedia.org/r/266941 (owner: 10Jforrester)
[23:35:05] <grrrit-wm>	 (03CR) 10jenkins-bot: [V: 04-1] WIP: Test MW-core against PHP55 for master/REL1_27+ [integration/config] - 10https://gerrit.wikimedia.org/r/266941 (owner: 10Jforrester)
[23:36:18] <greg-g>	 23:32:40 1) ApiDocumentationTest::testDocumentationExists with data set "Module query+novainstances with MiserMode=false, AllowCategorizedRecentChanges=false" ('query+novainstances', array(false, false))
[23:36:20] <Reedy>	 andrewbogott: looks vaguely like some sort of missing dependency on Ldap?
[23:36:22] <greg-g>	 23:32:40 Undefined property: AuthPlugin::$boundAs
[23:36:24] <thedj>	 rel eng wizards.. any reason why a parsertest behaves differently when run from phpunit compared to run from parserTests.php ?
[23:36:25] <greg-g>	 23:32:40 2) ApiDocumentationTest::testDocumentationExists with data set "Module query+novainstances with MiserMode=true, AllowCategorizedRecentChanges=true" ('query+novainstances', array(true, true))
[23:36:29] <greg-g>	 23:32:40 Undefined property: AuthPlugin::$boundAs
[23:36:34] <Reedy>	 23:32:40 Undefined property: AuthPlugin::$boundAs
[23:36:50] <greg-g>	 Reedy: :)
[23:36:55] <Reedy>	 if ( $wgAuth->boundAs !== $wgOpenStackManagerLDAPUser ) {
[23:37:04] <Reedy>	 I presume an isset on boundAs or something
[23:37:23] * Reedy tries
[23:38:12] <Reedy>	 https://gerrit.wikimedia.org/r/266942
[23:38:15] <Reedy>	 See if that passes...
[23:38:44] <Reedy>	 lol, nope
[23:39:09] <Reedy>	 PHP Fatal error:  Class 'LdapAuthenticationPlugin' not found in /mnt/jenkins-workspace/workspace/mwext-testextension-php53/src/extensions/OpenStackManager/nova/OpenStackNovaProject.php on line 695
[23:39:14] <Reedy>	 Yup, that's a dependancy issue
[23:39:19] <andrewbogott>	 I was kind of assuming the solution was "turn off that test since it’s clearly broken for existing deployed code"
[23:42:12] <grrrit-wm>	 (03CR) 10Jforrester: "(Anyone who knows what they're doing is welcome to take this over and actually make it work; MW-core's CI is so complicated nowadays…)" [integration/config] - 10https://gerrit.wikimedia.org/r/266941 (owner: 10Jforrester)
[23:42:46] <Reedy>	 James_F: skip-if and invert the regex? ?! not matches
[23:43:11] <James_F>	 Reedy: I… did?
[23:43:32] <James_F>	 Reedy: Clearly, not well. ;-)
[23:45:33] <Reedy>	 It seems it doesn't like the nesting
[23:46:02] <greg-g>	 thedj: my guess is that the answer might be "parser tests are black magic"
[23:46:20] <jzerebecki>	 !log work around https://phabricator.wikimedia.org/T117710 : salt --show-timeout '*slave*' cmd.run 'rm -rf /mnt/jenkins-workspace/workspace/mwext-testextension-hhvm/src/skins/BlueSky'
[23:46:25] <qa-morebots>	 Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master
[23:49:28] <jzerebecki>	 !log integration-slave-precise-1011:~$ sudo -i /etc/init.d/salt-minion restart
[23:49:33] <qa-morebots>	 Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master
[23:50:56] <James_F>	 Reedy: I'll leave it for cleverer people than me.
[23:51:10] <Reedy>	 I'd dig into it, but I can't spend hours on something like that tonight :P
[23:51:27] <James_F>	 Reedy: I said 'cleverer'. ;-P
[23:51:31] * James_F ducks out of the way.
[23:51:42] <wikibugs>	 10Continuous-Integration-Infrastructure: integration salt times out to some hosts - https://phabricator.wikimedia.org/T125006#1972084 (10JanZerebecki) 3NEW
[23:52:06] <wikibugs>	 10Continuous-Integration-Infrastructure: integration salt times out to some hosts - https://phabricator.wikimedia.org/T125006#1972091 (10JanZerebecki) Trying to restart the minion on integration-slave-precise-1011.eqiad.wmflabs didn't help.
[23:52:52] <thedj>	 greg-g: feared as much
[23:54:51] <wikibugs>	 10Continuous-Integration-Infrastructure: some tests run from mwext-testextension-hhvm will pick up files from extensions that were not checked out for this job - https://phabricator.wikimedia.org/T117710#1972095 (10JanZerebecki) Needed to do this again.
[23:57:07] <thedj>	 ah....
[23:57:39] <thedj>	 right. so phpunit uses mock objects, which ParserTests.php does not use
[23:59:09] <wikibugs>	 10Continuous-Integration-Infrastructure: some tests run from mwext-testextension-hhvm will pick up files from extensions that were not checked out for this job - https://phabricator.wikimedia.org/T117710#1972117 (10JanZerebecki) ``` 21:45:12 1) Warning 21:45:12 The data provider specified for ResourcesTest::test...