[00:15:18] <chrismcmahon>	 I made some Jenkins builds for Flow on test2 and disabled the ones for beta until the db issue is resolved.
[00:19:12] <wmf-selenium-bot>	 Project Flow-test2.wikipedia.org-linux-firefox build #1: FAILURE in 2 min 59 sec: https://wmf.ci.cloudbees.com/job/Flow-test2.wikipedia.org-linux-firefox/1/
[00:20:18] <chrismcmahon>	 sweet
[00:20:43] <chrismcmahon>	 heh. wrong URL
[00:20:52] <wmf-selenium-bot>	 Project Flow-test2-wikipedia-org-linux-chrome build #1: ABORTED in 4 min 1 sec: https://wmf.ci.cloudbees.com/job/Flow-test2-wikipedia-org-linux-chrome/1/
[00:20:52] <wmf-selenium-bot>	 Project Flow-test2.wikipedia.org-internet-explorer-10 build #1: ABORTED in 1 min 40 sec: https://wmf.ci.cloudbees.com/job/Flow-test2.wikipedia.org-internet-explorer-10/1/
[00:20:57] <wmf-selenium-bot>	 Project Flow-test2.wikipedia.org-internet-explorer-9 build #1: ABORTED in 5.4 sec: https://wmf.ci.cloudbees.com/job/Flow-test2.wikipedia.org-internet-explorer-9/1/
[00:30:11] <wmf-selenium-bot>	 Project Flow-test2-wikipedia-org-linux-chrome build #2: FAILURE in 4 min 28 sec: https://wmf.ci.cloudbees.com/job/Flow-test2-wikipedia-org-linux-chrome/2/
[00:36:31] <wmf-selenium-bot>	 Project Flow-test2.wikipedia.org-internet-explorer-9 build #2: FAILURE in 6 min 17 sec: https://wmf.ci.cloudbees.com/job/Flow-test2.wikipedia.org-internet-explorer-9/2/
[00:36:38] <wmf-selenium-bot>	 Project Flow-test2.wikipedia.org-internet-explorer-10 build #2: FAILURE in 6 min 26 sec: https://wmf.ci.cloudbees.com/job/Flow-test2.wikipedia.org-internet-explorer-10/2/
[00:38:39] <chrismcmahon>	 tweak tweak tweak
[00:49:32] <chrismcmahon>	 gah.  I need to give Selenium_user oversight rights on test2 and I can't
[03:09:37] <wmf-selenium-bot>	 Project browsertests-commons.wikimedia.beta.wmflabs.org-windows-internet_explorer_9 build #457: FAILURE in 3 min 54 sec: https://wmf.ci.cloudbees.com/job/browsertests-commons.wikimedia.beta.wmflabs.org-windows-internet_explorer_9/457/
[03:10:39] <wmf-selenium-bot>	 Yippee, build fixed!
[03:10:39] <wmf-selenium-bot>	 Project browsertests-commons.wikimedia.beta.wmflabs.org-windows-internet_explorer_10 build #346: FIXED in 4 min 56 sec: https://wmf.ci.cloudbees.com/job/browsertests-commons.wikimedia.beta.wmflabs.org-windows-internet_explorer_10/346/
[03:26:24] <wmf-selenium-bot>	 Project browsertests-en.wikipedia.beta.wmflabs.org-linux-chrome build #530: FAILURE in 16 min: https://wmf.ci.cloudbees.com/job/browsertests-en.wikipedia.beta.wmflabs.org-linux-chrome/530/
[03:29:24] <wmf-selenium-bot>	 Project browsertests-en.wikipedia.beta.wmflabs.org-linux-firefox build #508: FAILURE in 18 min: https://wmf.ci.cloudbees.com/job/browsertests-en.wikipedia.beta.wmflabs.org-linux-firefox/508/
[04:12:22] <wmf-selenium-bot>	 Yippee, build fixed!
[04:12:22] <wmf-selenium-bot>	 Project browsertests-en.wikipedia.beta.wmflabs.org-windows-internet_explorer_8 build #414: FIXED in 22 min: https://wmf.ci.cloudbees.com/job/browsertests-en.wikipedia.beta.wmflabs.org-windows-internet_explorer_8/414/
[04:33:31] <wmf-selenium-bot>	 Project browsertests-test2.wikipedia.org-linux-chrome build #777: FAILURE in 19 min: https://wmf.ci.cloudbees.com/job/browsertests-test2.wikipedia.org-linux-chrome/777/
[05:22:56] <wmf-selenium-bot>	 Yippee, build fixed!
[05:22:57] <wmf-selenium-bot>	 Project browsertests-test2.wikipedia.org-windows-internet_explorer_6 build #591: FIXED in 27 min: https://wmf.ci.cloudbees.com/job/browsertests-test2.wikipedia.org-windows-internet_explorer_6/591/
[05:30:31] <wmf-selenium-bot>	 Yippee, build fixed!
[05:30:31] <wmf-selenium-bot>	 Project browsertests-test2.wikipedia.org-windows-internet_explorer_7 build #595: FIXED in 30 min: https://wmf.ci.cloudbees.com/job/browsertests-test2.wikipedia.org-windows-internet_explorer_7/595/
[05:52:41] <wmf-selenium-bot>	 Yippee, build fixed!
[05:52:42] <wmf-selenium-bot>	 Project browsertests-test2.wikipedia.org-windows-internet_explorer_8 build #615: FIXED in 29 min: https://wmf.ci.cloudbees.com/job/browsertests-test2.wikipedia.org-windows-internet_explorer_8/615/
[06:29:22] <wmf-selenium-bot>	 Project MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-firefox build #218: FAILURE in 18 min: https://wmf.ci.cloudbees.com/job/MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-firefox/218/
[07:00:30] <wmf-selenium-bot>	 Project TwnMainPage-sandbox.translatewiki.net-linux-firefox build #117: FAILURE in 12 min: https://wmf.ci.cloudbees.com/job/TwnMainPage-sandbox.translatewiki.net-linux-firefox/117/
[10:29:31] <grrrit-wm>	 (CR) Siebrand: "Is this work in progress or can it be merged?" [integration/jenkins-job-builder-config] - https://gerrit.wikimedia.org/r/100800 (owner: Hashar)
[15:28:56] <vandrew>	 Tobi_WMDE: I have changed the credentials as you said, should I change anything else?
[15:33:18] <grrrit-wm>	 (PS1) Hashar: integration-jjb-config-test now points to git:// Zuul URL [integration/jenkins-job-builder-config] - https://gerrit.wikimedia.org/r/101003
[15:33:24] <grrrit-wm>	 (CR) jenkins-bot: [V: -1] integration-jjb-config-test now points to git:// Zuul URL [integration/jenkins-job-builder-config] - https://gerrit.wikimedia.org/r/101003 (owner: Hashar)
[15:33:51] <grrrit-wm>	 (PS2) Hashar: integration-jjb-config-test now points to git:// Zuul URL [integration/jenkins-job-builder-config] - https://gerrit.wikimedia.org/r/101003
[15:33:56] <grrrit-wm>	 (CR) jenkins-bot: [V: -1] integration-jjb-config-test now points to git:// Zuul URL [integration/jenkins-job-builder-config] - https://gerrit.wikimedia.org/r/101003 (owner: Hashar)
[15:37:22] <grrrit-wm>	 (PS3) Hashar: integration-jjb-config-test now points to git:// Zuul URL [integration/jenkins-job-builder-config] - https://gerrit.wikimedia.org/r/101003
[15:38:23] <grrrit-wm>	 (CR) Hashar: [C: 2] "deployed" [integration/jenkins-job-builder-config] - https://gerrit.wikimedia.org/r/101003 (owner: Hashar)
[15:38:39] <grrrit-wm>	 (Merged) jenkins-bot: integration-jjb-config-test now points to git:// Zuul URL [integration/jenkins-job-builder-config] - https://gerrit.wikimedia.org/r/101003 (owner: Hashar)
[15:38:49] <grrrit-wm>	 (PS2) Hashar: Enable voting phpcs-strict-HEAD for LocalisationUpdate [integration/jenkins-job-builder-config] - https://gerrit.wikimedia.org/r/100785 (owner: Siebrand)
[15:39:32] <grrrit-wm>	 (PS3) Hashar: Add Python 3.3 syntax checker [integration/jenkins-job-builder-config] - https://gerrit.wikimedia.org/r/98275 (owner: Merlijn van Deen)
[15:39:42] <grrrit-wm>	 (CR) jenkins-bot: [V: -1] Add Python 3.3 syntax checker [integration/jenkins-job-builder-config] - https://gerrit.wikimedia.org/r/98275 (owner: Merlijn van Deen)
[15:40:12] <grrrit-wm>	 (PS1) Cmcmahon: focus on the Login button before clicking it [qa/browsertests] - https://gerrit.wikimedia.org/r/101004
[15:40:47] <hashar>	 chrismcmahon: ah chris hello :-]
[15:41:04] <chrismcmahon>	 hi hashar
[15:41:07] <hashar>	 chrismcmahon: regarding the 503, I have fixed two issues that caused puppet to restart Apache on beta
[15:41:13] <hashar>	 that might have been causing the 503
[15:41:13] <chrismcmahon>	 hashar: thanks!
[15:41:17] <hashar>	 both fixed
[15:41:34] <hashar>	 but might not fully solve the 503 issue
[15:41:40] <chrismcmahon>	 OK, I will watch for those.  we are getting them consistently for Chrome but not for Firefox, you know
[15:41:54] <hashar>	 yeah that might be a different tissue
[15:42:16] <grrrit-wm>	 (CR) Cmcmahon: [C: 2] focus on the Login button before clicking it [qa/browsertests] - https://gerrit.wikimedia.org/r/101004 (owner: Cmcmahon)
[15:57:53] <grrrit-wm>	 (CR) Hashar: "> Is this work in progress or can it be merged?" [integration/jenkins-job-builder-config] - https://gerrit.wikimedia.org/r/100800 (owner: Hashar)
[16:26:45] <grrrit-wm>	 (CR) Hashar: "So I got hit by that issue (log dir not being writable by apache). I thought about creating a simple shell script that would create both l" [integration/jenkins-job-builder-config] - https://gerrit.wikimedia.org/r/95309 (owner: Krinkle)
[16:30:12] <vandrew>	 zeljkof: hey, are you here ?
[16:31:22] <zeljkof>	 vandrew: in a meeting
[16:31:39] <vandrew>	 oh, ok, I'll contact you later then
[16:33:06] <wmf-selenium-bot>	 Project Flow-en.wikipedia.beta.wmflabs.org-linux-chrome build #109: FAILURE in 11 min: https://wmf.ci.cloudbees.com/job/Flow-en.wikipedia.beta.wmflabs.org-linux-chrome/109/
[16:54:23] <Tobi_WMDE>	 vandrew: will have no time today to look at it again, I can look at it tomorrow if that is ok
[16:57:31] <vandrew>	 Tobi_WMDE: it is ok
[16:57:36] <grrrit-wm>	 (CR) Hashar: [C: 2] "Job mwext-LocalisationUpdate-phpcs-strict-HEAD created in Jenkins. Will need Zuul triggers now :-]" [integration/jenkins-job-builder-config] - https://gerrit.wikimedia.org/r/100785 (owner: Siebrand)
[16:57:52] <grrrit-wm>	 (Merged) jenkins-bot: Enable voting phpcs-strict-HEAD for LocalisationUpdate [integration/jenkins-job-builder-config] - https://gerrit.wikimedia.org/r/100785 (owner: Siebrand)
[16:58:15] <grrrit-wm>	 (PS5) Hashar: (WIP) (WIP) visualeditor-doitall (WIP) (WIP) [integration/jenkins-job-builder-config] - https://gerrit.wikimedia.org/r/100800
[16:58:17] <grrrit-wm>	 (PS2) Hashar: make browsertest runner a macro [integration/jenkins-job-builder-config] - https://gerrit.wikimedia.org/r/100798
[17:05:50] <grrrit-wm>	 (CR) Siebrand: "@hashar: I think you have been trolled :D." [integration/jenkins-job-builder-config] - https://gerrit.wikimedia.org/r/100800 (owner: Hashar)
[17:10:25] <hashar>	 ah
[17:10:31] <hashar>	 remembers me I need to takeover this IRC channel
[17:25:04] <chrismcmahon>	 hey JeffHall did you see the overnight failures on the VE tests?  I took a quick look, seems like it's maintenance
[17:25:23] <hashar>	 I restarted the apaches on beta a few times today
[17:25:25] <hashar>	 might have been the cause
[17:25:33] <hashar>	 if you still get some 503, please ping on the bug report
[17:25:37] <JeffHall>	 chrismcmahon: Yeah, "More" menu in VE is now known as "Insert" - testing a fix for that locally now
[17:25:47] <hashar>	 I got varnish logging details, will be able to investigate any 503 tomorrow
[17:26:12] <chrismcmahon>	 JeffHall: groovy, thanks
[17:26:59] <hashar>	 chrismcmahon: and I get the jenkins job more or less working yesterday night :-D   https://integration.wikimedia.org/ci/job/visualeditor-doitall/24/console
[17:27:07] <hashar>	 at least boot PArsoid / VisualEditor / run cucumber
[17:27:24] <hashar>	 blatantly failing because of some random reason I still have to investigate
[17:30:29] * chrismcmahon  goes back to Flow and making IE tests pass

[17:31:58] <hashar>	 enjo
[17:31:58] <hashar>	 y
[17:32:01] <hashar>	 off for tonight
[18:06:24] <wmf-selenium-bot>	 Project browsertests-commons.wikimedia.beta.wmflabs.org-windows-internet_explorer_10 build #347: FAILURE in 40 sec: https://wmf.ci.cloudbees.com/job/browsertests-commons.wikimedia.beta.wmflabs.org-windows-internet_explorer_10/347/
[18:11:08] <wmf-selenium-bot>	 Yippee, build fixed!
[18:11:09] <wmf-selenium-bot>	 Project browsertests-commons.wikimedia.beta.wmflabs.org-windows-internet_explorer_9 build #458: FIXED in 5 min 16 sec: https://wmf.ci.cloudbees.com/job/browsertests-commons.wikimedia.beta.wmflabs.org-windows-internet_explorer_9/458/
[18:23:29] <wmf-selenium-bot>	 Yippee, build fixed!
[18:23:30] <wmf-selenium-bot>	 Project browsertests-en.wikipedia.beta.wmflabs.org-linux-chrome build #531: FIXED in 17 min: https://wmf.ci.cloudbees.com/job/browsertests-en.wikipedia.beta.wmflabs.org-linux-chrome/531/
[18:29:18] <wmf-selenium-bot>	 Yippee, build fixed!
[18:29:18] <wmf-selenium-bot>	 Project browsertests-en.wikipedia.beta.wmflabs.org-linux-firefox build #509: FIXED in 18 min: https://wmf.ci.cloudbees.com/job/browsertests-en.wikipedia.beta.wmflabs.org-linux-firefox/509/
[18:30:41] <chrismcmahon>	 hoping to see a lot of FIXED today
[18:35:45] <vandrew>	 hmm
[20:07:30] <grrrit-wm>	 (PS1) Cmcmahon: still seeing some login issues, this should wait for completion [qa/browsertests] - https://gerrit.wikimedia.org/r/101057
[20:08:07] <grrrit-wm>	 (CR) Cmcmahon: [C: 2] "more robustification for IE" [qa/browsertests] - https://gerrit.wikimedia.org/r/101057 (owner: Cmcmahon)
[20:10:46] <grrrit-wm>	 (Merged) jenkins-bot: still seeing some login issues, this should wait for completion [qa/browsertests] - https://gerrit.wikimedia.org/r/101057 (owner: Cmcmahon)
[20:40:37] <wmf-selenium-bot>	 Project browsertests-test2.wikipedia.org-windows-internet_explorer_7 build #596: FAILURE in 31 min: https://wmf.ci.cloudbees.com/job/browsertests-test2.wikipedia.org-windows-internet_explorer_7/596/
[20:59:13] <wmf-selenium-bot>	 Project browsertests-test2.wikipedia.org-windows-internet_explorer_8 build #616: FAILURE in 29 min: https://wmf.ci.cloudbees.com/job/browsertests-test2.wikipedia.org-windows-internet_explorer_8/616/
[21:13:27] <hashar>	 chrismcmahon: I am now an owner for this IRC channel so can finely tweak rules / settings :D
[21:13:39] <chrismcmahon>	 thanks hashar
[21:14:10] <hashar>	 turned out our IRC channels are unsurprisingly managed by volunteers!  dungodung gave me ownership :-]
[21:14:16] <hashar>	 I loooooove our mouvement
[21:14:21] <hashar>	 community
[21:19:24] <chrismcmahon>	 dungodung has been helpful in the past as I recall
[21:19:36] <hashar>	 definitely
[21:22:34] <chrismcmahon>	 yay for better login, it was masking a real bug:  https://bugzilla.wikimedia.org/show_bug.cgi?id=58409
[21:22:54] <wmf-selenium-bot>	 Yippee, build fixed!
[21:22:54] <wmf-selenium-bot>	 Project Flow-test2.wikipedia.org-linux-firefox build #4: FIXED in 6 min 0 sec: https://wmf.ci.cloudbees.com/job/Flow-test2.wikipedia.org-linux-firefox/4/
[21:23:14] <chrismcmahon>	 yay Flow tests for Firefox passing too!
[21:27:00] <hashar>	 azeaze
[21:30:26] <hashar>	 well done chrismcmahon !
[21:30:40] <hashar>	 will have to integrate them for Gerrit as well
[21:31:26] <JeffHall>	 chrismcmahon: When you have some free minutes, I have a couple of Gerrit commits for review that we'll need to get merged in order to get Visual Editor browser tests up-to-date with the new VE features
[21:32:23] <chrismcmahon>	 JeffHall: omw, looking
[21:32:34] <JeffHall>	 chrismcmahon: Thanks!
[21:34:44] <chrismcmahon>	 JeffHall: thanks for pinging.  when I see something like s/More/Insert/ it makes me very thankful for page objects.
[21:35:34] <JeffHall>	 chrismcmahon: Yeah, I love the framework we're using for browser tests - it makes the simple things simple!
[21:38:14] <grrrit-wm>	 (PS1) Hashar: mediawiki-core-lint made concurrent [integration/jenkins-job-builder-config] - https://gerrit.wikimedia.org/r/101109
[21:47:57] <chrismcmahon>	 new 503 from Chrome/beta labs/Barack Obama page.  https://saucelabs.com/jobs/6164b3a2cbc44fb1a90aa32ccace1d8c
[21:51:01] <grrrit-wm>	 (CR) Hashar: [C: 2] mediawiki-core-lint made concurrent [integration/jenkins-job-builder-config] - https://gerrit.wikimedia.org/r/101109 (owner: Hashar)
[21:51:29] <grrrit-wm>	 (Merged) jenkins-bot: mediawiki-core-lint made concurrent [integration/jenkins-job-builder-config] - https://gerrit.wikimedia.org/r/101109 (owner: Hashar)
[21:51:35] <hashar>	 chrismcmahon: might just be a slow parse
[21:52:42] <hashar>	 2013-12-12 21:20:02 deployment-apache33 enwiki: 63.39 Barack_Obama
[21:52:42] <hashar>	 :(
[21:52:57] <hashar>	 from /data/project/logs/slow-parse.log
[21:53:26] <chrismcmahon>	 hashar: so that is just a timeout from Varnish then?
[21:53:27] <hashar>	 I am not sure whether LUA is enabled on beta
[21:53:34] <hashar>	 yeah might just be a timeout
[21:53:52] <hashar>	 we might want to make sure LUA is enabled
[21:53:59] <chrismcmahon>	 that's what I thought when I saw the 63.39 value
[21:54:08] <hashar>	 then import LUA modules  from production and replace the current barrack obbama page with the new one from prod
[21:54:21] <hashar>	 that would use LUA instead of MediaWiki templates which are slow
[21:54:35] <chrismcmahon>	 that would  be good, actually, I had not thought of that
[21:56:56] <chrismcmahon>	 I still wonder why it is only Chrome that gets these and not Firefox
[22:19:31] <hashar>	 no clue :(
[22:20:14] <wmf-selenium-bot>	 Yippee, build fixed!
[22:20:15] <wmf-selenium-bot>	 Project TwnMainPage-sandbox.translatewiki.net-linux-firefox build #118: FIXED in 13 min: https://wmf.ci.cloudbees.com/job/TwnMainPage-sandbox.translatewiki.net-linux-firefox/118/
[22:30:52] <grrrit-wm>	 (CR) Hashar: [C: 1] "Nice! That will most probably help finding phantomjs bugs :-]" [selenium] - https://gerrit.wikimedia.org/r/100375 (owner: Zfilipin)
[23:23:52] <chrismcmahon>	 JeffHall: getting some weird failures in the latest Chrome build: https://wmf.ci.cloudbees.com/job/VisualEditor-en.wikipedia.beta.wmflabs.org-linux-chrome/lastCompletedBuild/testReport/
[23:24:22] <chrismcmahon>	 after login a screen shows up saying "No data received".  either that or the beta warning does not get dismissed.
[23:24:31] <chrismcmahon>	 browsers suck :-)
[23:25:10] <chrismcmahon>	 I have an idea about dismissing the beta warning for good, but the "No data received" screen is new to me.
[23:25:55] <JeffHall>	 chrismcmahon: Looking for the "No data received" message....
[23:26:48] <chrismcmahon>	 JeffHall:  check the screencast on https://saucelabs.com/jobs/fd22931cca18465a9824b80e71f7587a
[23:27:45] <JeffHall>	 chrismcmahon: Ah, that is rather ugly :(
[23:28:13] <chrismcmahon>	 JeffHall: don't believe I've ever seen that until just now, it is on a number of those failures.
[23:30:08] <JeffHall>	 chrismcmahon: Yeah, that one is new to me as well, and the Selenium log captured via Sauce is not very helpful
[23:33:16] <JeffHall>	 chrismcmahon: Looks like the related Firefox run for VE in betalabs ran OK except for a known bug with Transclusion templates, so I might kick off the Chrome job again to see if the "No data received" condition repeats
[23:33:28] <chrismcmahon>	 ok
[23:33:41] <JeffHall>	 chrismcmahon: Looks like an environmental issue, since the Selenium log reports no errors or warnings
[23:33:54] <chrismcmahon>	 I hope so :(
[23:40:23] <wmf-selenium-bot>	 Project VisualEditor-test2.wikipedia.org-linux-firefox build #209: ABORTED in 9 min 33 sec: https://wmf.ci.cloudbees.com/job/VisualEditor-test2.wikipedia.org-linux-firefox/209/
[23:40:31] <wmf-selenium-bot>	 Project VisualEditor-test2.wikipedia.org-linux-chrome build #184: ABORTED in 30 min: https://wmf.ci.cloudbees.com/job/VisualEditor-test2.wikipedia.org-linux-chrome/184/
[23:41:48] <chrismcmahon>	 hmm, might have a bug in VE templates/transclusion
[23:44:41] <JeffHall>	 chrismcmahon: I logged this bug earlier today: https://bugzilla.wikimedia.org/show_bug.cgi?id=58406
[23:45:17] <chrismcmahon>	 that would be the bug, yes JeffHall :-)
[23:45:20] <wmf-selenium-bot>	 Yippee, build fixed!
[23:45:21] <wmf-selenium-bot>	 Project Flow-test2-wikipedia-org-linux-chrome build #6: FIXED in 4 min 56 sec: https://wmf.ci.cloudbees.com/job/Flow-test2-wikipedia-org-linux-chrome/6/
[23:47:00] <chrismcmahon>	 JeffHall: reminded me of this one I filed a long time ago, might be worth doing an "Also see"  https://bugzilla.wikimedia.org/show_bug.cgi?id=53231
[23:48:39] <JeffHall>	 chrismcmahon: Yep, makes sense to me - done!
[23:55:44] <chrismcmahon>	 JeffHall: I have a thought about dismissing the beta warning I will probably hack on early tomorrow if you don't get to it.  otherwise I'm about done for the day.
[23:56:36] <JeffHall>	 chrismcmahon: What needs to change for the beta warning?
[23:57:49] <chrismcmahon>	 JeffHall: I just thought I'd kill it over and over a few times in a loop if I can't think of anything else.  Maybe we could have a config setting that would dismiss it in test envs, it doesn't do us any good.