[00:01:04] James_F JeffHall yeah, I was going to +2 the test except that the test found that bug instead. nicely done JeffHall [00:01:48] see y'all tomorrow [03:28:04] Project browsertests-en.wikipedia.beta.wmflabs.org-linux-chrome build #512: FAILURE in 19 min: https://wmf.ci.cloudbees.com/job/browsertests-en.wikipedia.beta.wmflabs.org-linux-chrome/512/ [03:30:23] Project browsertests-en.wikipedia.beta.wmflabs.org-linux-firefox build #489: FAILURE in 20 min: https://wmf.ci.cloudbees.com/job/browsertests-en.wikipedia.beta.wmflabs.org-linux-firefox/489/ [04:27:35] Yippee, build fixed! [04:27:36] Project browsertests-test2.wikipedia.org-linux-firefox build #735: FIXED in 19 min: https://wmf.ci.cloudbees.com/job/browsertests-test2.wikipedia.org-linux-firefox/735/ [05:11:30] Yippee, build fixed! [05:11:31] Project browsertests-test2.wikipedia.org-windows-internet_explorer_7 build #579: FIXED in 28 min: https://wmf.ci.cloudbees.com/job/browsertests-test2.wikipedia.org-windows-internet_explorer_7/579/ [05:57:10] Project MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome build #110: FAILURE in 15 min: https://wmf.ci.cloudbees.com/job/MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome/110/ [06:23:36] Yippee, build fixed! [06:23:37] Project MobileFrontend-test2.m.wikipedia.org-linux-firefox build #118: FIXED in 16 min: https://wmf.ci.cloudbees.com/job/MobileFrontend-test2.m.wikipedia.org-linux-firefox/118/ [07:20:51] Project VisualEditor-en.wikipedia.beta.wmflabs.org-linux-firefox build #190: FAILURE in 41 min: https://wmf.ci.cloudbees.com/job/VisualEditor-en.wikipedia.beta.wmflabs.org-linux-firefox/190/ [08:12:54] Hi zeljkof [08:13:11] good morning mayankmadan! [08:13:52] Its actually afternoon :) [08:13:55] Here [08:14:06] I know :) [08:17:25] mayankmadan: did you have a question? [08:18:23] Well there is a problem [08:18:41] there are not problems, just challenges! :) [08:19:51] You might need to extend the deadline of the task as i have cyber olympiad tomorrow then another exam on day after tomorrow. So i might not get the time to work on the task [08:20:02] zeljkof: ^ [08:20:10] mayankmadan: no problem [08:20:32] should I extend the task right now, or will you ping me in a day or to? [08:20:32] day or two? [08:20:37] Not now but later it might be needed [08:20:51] I will ping you [08:21:05] mayankmadan: no problem, ping any of the mentors, somebody will extend the deadline [08:21:21] the best way is to leave the comment at code-in site, that is how all mentors will see it [08:22:28] I thought you had a problem with pdf parser :) [09:29:32] (PS1) Nikerabbit: Add Translate-meta.wikimedia.org-linux-firefox [selenium] - https://gerrit.wikimedia.org/r/99054 [09:33:45] (PS1) Hashar: rm old MediaWiki-GIT-Fetching job [integration/jenkins] - https://gerrit.wikimedia.org/r/99055 [09:34:00] (CR) Hashar: [C: 2] rm old MediaWiki-GIT-Fetching job [integration/jenkins] - https://gerrit.wikimedia.org/r/99055 (owner: Hashar) [09:34:17] (PS2) Hashar: rm old MediaWiki-GIT-Fetching job [integration/jenkins] - https://gerrit.wikimedia.org/r/99055 [09:34:21] (PS2) Nikerabbit: Add Translate-meta.wikimedia.org-linux-firefox [selenium] - https://gerrit.wikimedia.org/r/99054 [09:34:23] (CR) Hashar: [C: 2] rm old MediaWiki-GIT-Fetching job [integration/jenkins] - https://gerrit.wikimedia.org/r/99055 (owner: Hashar) [09:34:27] (Merged) jenkins-bot: rm old MediaWiki-GIT-Fetching job [integration/jenkins] - https://gerrit.wikimedia.org/r/99055 (owner: Hashar) [09:39:31] Project Translate-meta.wikimedia.org-linux-firefox build #1: SUCCESS in 1 min 49 sec: https://wmf.ci.cloudbees.com/job/Translate-meta.wikimedia.org-linux-firefox/1/ [10:39:11] (PS1) Hashar: phantomjs tests put logs in /log/ now [integration/jenkins-job-builder-config] - https://gerrit.wikimedia.org/r/99064 [10:39:54] (CR) Hashar: [C: 2] phantomjs tests put logs in /log/ now [integration/jenkins-job-builder-config] - https://gerrit.wikimedia.org/r/99064 (owner: Hashar) [10:40:13] (Merged) jenkins-bot: phantomjs tests put logs in /log/ now [integration/jenkins-job-builder-config] - https://gerrit.wikimedia.org/r/99064 (owner: Hashar) [12:16:31] (CR) Zfilipin: [C: 2] Prefer double-quoted strings in Ruby code [qa/browsertests] - https://gerrit.wikimedia.org/r/97849 (owner: Mayankmadan) [12:17:22] (CR) Zfilipin: [C: 2] Prefer double-quoted strings in Ruby code [selenium] - https://gerrit.wikimedia.org/r/97756 (owner: Mayankmadan) [12:17:24] (Merged) jenkins-bot: Prefer double-quoted strings in Ruby code [selenium] - https://gerrit.wikimedia.org/r/97756 (owner: Mayankmadan) [12:18:54] hashar: do you have a minute? [12:19:04] zeljkof: yup [12:19:24] polishing up the jenkins job to trigger phantomjs browser tests [12:19:25] I am trying to merge this into master https://gerrit.wikimedia.org/r/#/c/97849/ [12:20:01] but when I give it +2 and publish comments, nothing happens [12:20:18] yeah it is not configured [12:20:22] let me add it to zuul [12:20:26] if I give it +2 and click publish and submit gerrit says "needs verified" [12:20:43] hashar: how did we merge commits so far? :) [12:21:28] (PS1) Hashar: qa/browsertests now has gate-and-submit [integration/zuul-config] - https://gerrit.wikimedia.org/r/99071 [12:21:32] by submitting the patch ? [12:21:44] (PS2) Hashar: qa/browsertests now has gate-and-submit [integration/zuul-config] - https://gerrit.wikimedia.org/r/99071 [12:22:10] hashar: but how to I submit the patch? [12:22:22] (CR) Hashar: [C: 2] qa/browsertests now has gate-and-submit [integration/zuul-config] - https://gerrit.wikimedia.org/r/99071 (owner: Hashar) [12:22:33] there is not "submit" option [12:22:48] zeljkof: when a change has V+2 and CR+2 you have a button in Gerrit that let you [Submit patch] [12:23:24] (Merged) jenkins-bot: qa/browsertests now has gate-and-submit [integration/zuul-config] - https://gerrit.wikimedia.org/r/99071 (owner: Hashar) [12:23:40] zuul reloading [12:23:55] once it has, you can CR+2 and Zuul will merge it [12:24:18] should probably make https://integration.wikimedia.org/ci/job/qa-browsertests-build/ voting as well [12:24:22] 97849 has cr+2 from me and +1 from jenkins-bot [12:24:44] how can it get v+2? [12:24:49] I have to set it manually? [12:24:49] jenkins does it [12:24:56] err Zuul via the jenkins-bot user in Gerrit [12:25:21] hashar: but why didn't it do it for this commit? [12:25:36] ahh [12:25:55] good question [12:27:12] hashar: and why there is "verified" option when reviewing code, when that should be set only by the bot? [12:27:24] it is not disabled on that repo [12:27:32] by default project owners are able to vote Verified [12:28:05] anyway, qa/browsertests will now merge change on CR+2 :-] [12:28:14] that is known in Zuul has the gate-and-submit pipeline [12:28:29] jobs in that pipeline are executed whenever someone vote CR+2 [12:28:29] hashar: great, thanks [12:28:39] if they pass, Zuul submit the patch [12:28:43] another question, if I can :) [12:29:00] I have +2 the wrong commit, and now it is merged https://gerrit.wikimedia.org/r/#/c/98777/ [12:29:09] is there a way to unmerge it? :) [12:29:17] just revert change? [12:29:23] that will create another commit, right? [12:30:04] no way [12:30:05] you have to revert it [12:30:17] oh well... [12:30:24] just press [Revert Change] [12:30:28] that will cause Gerrit to create a new patchsetfor you which you can then CR+2 :-] [12:30:55] but then I have to create _another_ commit to apply the first change back to review, right? [12:31:10] too many patches to review, and mistakes happen :( [12:31:41] hashar: thanks, I will clean up the mess [12:36:33] yeah it happens [12:36:44] the thing in git is that the commit sha1 is based on the parent commit [12:36:49] so you can just make a commit disappear [12:36:58] or you have to rewrite all the child commits as well [12:37:04] aka A -> B -> C [12:37:06] if you get rid of C [12:37:09] err [12:37:15] if you get rid of B, i.e. A -> C [12:37:23] the parent of C went from B to A [12:37:30] and thus the sha1 of C will be different [12:47:47] hashar: I have recently read a book on git internals [12:47:58] crazy stuff [12:48:23] it is :-D [12:48:32] think about git as a tree [12:48:38] with branches and leaves :D [12:48:40] leaf [12:48:41] whatever [12:51:03] (PS1) Hashar: mw-install-sqlite: always create sqlite datadir [integration/jenkins] - https://gerrit.wikimedia.org/r/99080 [12:51:12] (CR) Hashar: [C: 2] mw-install-sqlite: always create sqlite datadir [integration/jenkins] - https://gerrit.wikimedia.org/r/99080 (owner: Hashar) [12:51:16] (Merged) jenkins-bot: mw-install-sqlite: always create sqlite datadir [integration/jenkins] - https://gerrit.wikimedia.org/r/99080 (owner: Hashar) [12:52:49] still get to get the ULS change merged in rbmblb [13:03:31] hashar: you know what would be cool? [13:03:42] to run cirrus search tests on wmf jenkins! [13:04:10] we are not running them on cloudbees because we do not have a public machine where cirrus is behaving [13:05:19] those browser tests are broken [13:05:35] yeah cirrus will be nice [13:05:50] hashar: they are not broken as far as I know [13:05:53] ULS is broken again https://integration.wikimedia.org/ci/job/mwext-browsertests-UniversalLanguageSelector-phantomjs/65/consoleFull [13:06:07] we just do not have a site where to run them [13:06:09] When I click on an input box [13:06:10] unable to locate element, using {:id=>"searchInput", :tag_name=>"input or textarea", :type=>"(any text type)"} (Watir::Exception::UnknownObjectException) [13:06:51] hashar: you should really pair with either me or language people on getting uls+phantomjs tests to behave :) [13:07:47] we should all pair together [13:08:04] is niklas the one writing much of them for ULS ? [13:08:08] hashar: then it is not pairing :) [13:08:19] both Nikerabbit and Amir [13:08:34] and Kartik wrote a few [13:08:42] will mail nike / amir [13:09:37] hashar: feel free to cc me [13:09:59] you can join us for one of our regular pairing sessions, 10-12 mon-thu [13:10:08] you can join amir and me tomorrow [13:13:13] mail sent :] [13:13:14] yeah [13:13:23] which channel are you pairing in ? #mediawiki-i18n ? [13:13:32] hashar: hangouts :) [13:13:37] ah [13:13:45] would you mind inviting me to the recurrent event ? :] [13:14:03] hashar: sure, will do right now [13:14:54] done [13:14:59] you should get e-mails [13:20:32] yeah got 411 of them unread [13:23:04] :) [13:23:22] I am "inbox zero" type [13:23:29] my inbox is always empty [13:27:35] yeah I need to spend a couple days cleaning them [13:51:19] plop [14:30:30] yo zeljkof [14:30:31] single quotes are preferred in Ruby, right? [14:30:40] aharoni: no [14:30:46] double? [14:30:52] aharoni: yes [14:30:58] kinda curious. [14:31:03] https://github.com/styleguide/ruby [14:31:07] yes, surprised me too [14:31:25] OK. [14:31:28] aharoni: I grew up thinking single quotes are the way to go [14:31:52] in Perl and PHP single are preferred so as *not* to trigger interpolation by mistake. [14:31:56] oh well, whatever. [14:31:57] and then the other day I read github ruby styleguide and see that all I know about strings is wrong :( [14:32:03] standards are for making things easier :) [14:32:17] easier = think less [14:32:20] aharoni: that is the hope :) [14:32:45] aharoni: interested in pairing with hashar and me tomorrow? [14:32:54] on phantomjs tests for uls [14:33:10] it should be fun running tests in headless browser [14:35:14] challenge being to make the ULS browser tests to pass on a freshly installed mediawiki/core + ULS with default settings :D [14:35:28] hashar: fun timez :) [14:35:54] http://enwp.org/warez [14:35:55] :D [14:36:48] hashar: you have lost me :) [14:37:49] the warez community (aka The Scene) is interesting to study [14:37:51] https://en.wikipedia.org/wiki/Warez_(scene) [14:38:04] that is a bit like open source community, though most activities are … illegals :D [14:38:15] they even have standards! https://en.wikipedia.org/wiki/Standard_(warez) [14:38:26] * hashar has lost everyone in Wikipedia [15:14:06] hashar: around? [15:19:44] zeljkof: yesss [15:20:06] I am trying to run tests using phantomjs on cloudbees [15:20:13] https://wmf.ci.cloudbees.com/job/phantomjs/ [15:20:25] how do you tell selenium where phantomjs is located? [15:25:53] hmm [15:26:11] and how do you install phantomjs? [15:26:30] I think it is in the PATH [15:26:35] so installed with apt-get install phantomjs [15:26:54] ah you npm install phantomjs [15:26:55] hashar: cloudbees uses fedora, and I can not use yum, no sudo [15:27:02] no clue where npm ends up installing it though [15:27:14] apparently in /scratch/jenkins/workspace/phantomjs/node_modules/phantomjs [15:27:18] so maybe /scratch/jenkins/workspace/phantomjs/node_modules/phantomjs/bin/phantomjs [15:27:27] "Phantomjs binary available at /scratch/jenkins/workspace/phantomjs/node_modules/phantomjs/lib/phantom/bin/phantomjs" [15:27:33] yes [15:27:46] but I am not sure how to tell selenium that phantomjs is not in path [15:28:09] if I copy it to the same folder where the tests run? :) [15:28:22] lemme try [15:31:12] does not work [15:33:50] * zeljkof is out to lunch [16:12:25] (CR) Jhall: [C: 1] Merging the readme files of other repositories with this one. [selenium] - https://gerrit.wikimedia.org/r/98577 (owner: Mayankmadan) [16:20:31] hi zeljkof I think you might have just broken all the builds https://wmf.ci.cloudbees.com/job/browsertests-en.wikipedia.beta.wmflabs.org-linux-firefox/lastCompletedBuild/testReport/ [16:21:10] chrismcmahon: uh oh [16:21:20] I do not think I did anything [16:21:35] well, I did merge double quotes commit [16:21:43] I can not look now, I have to go [16:21:49] but I will take a look in 2-3 hours [16:22:47] zeljkof: getting "Unable to pick a platform" -- did you do something to the template for the phantomjs build? [16:23:03] yes, but I have just added a site [16:23:07] nothing to the template itself [16:23:28] and no, did not change the template to add phantomjs [16:24:27] hmmm [16:29:12] zeljkof: all of the builds are definitely broken https://wmf.ci.cloudbees.com/job/Flow-en.wikipedia.beta.wmflabs.org-linux-firefox/100/testReport/(root)/Edit%20existing%20title/Edit_an_existing_title/ [16:29:23] ugh [16:32:32] I think most of the Visual Editor test failures via CloudBees were due to the "Save page" button being broken in betalabs - will file a bug [16:34:10] chrismcmahon: I really have to go now [16:34:15] will take a look later today [16:35:04] JeffHall: yes, but builds running now are not launching a browser [16:36:27] chrismcmahon: Yeah, I was just looking at the "overnight" failures for VE tests - haven't yet run into the larger issue with browsers not launching... [16:47:39] JeffHall: I'm guessing the problem is somewhere in https://gerrit.wikimedia.org/r/#/c/97756/ I'm going to revert that [16:48:49] JeffHall: I am looking through recent merges https://gerrit.wikimedia.org/r/#/q/status:merged,n,z . Besides this, Z did not change the Jenkins template, so this is a likely source of the issue. [16:49:15] chrismcmahon: Yeah, seems like reverting that 97756 change is a pretty discrete "undo" [16:50:28] JeffHall: I think the problem likely lies with double-quotes inside double quotes referring to either ENV vars or Sauce properties, and since the scheduled builds kick off in an hour I'm going to revert now, check the result, and ask questions later. [16:51:09] chrismcmahon: Makes sense to me :) [16:51:29] (PS1) Cmcmahon: Revert "Prefer double-quoted strings in Ruby code" [selenium] - https://gerrit.wikimedia.org/r/99151 [16:52:43] (CR) Cmcmahon: [C: 2] "This change seems to have broken all the Jenkins builds, Sauce reports "Unable to pick a platform" for every build in every repo." [selenium] - https://gerrit.wikimedia.org/r/99151 (owner: Cmcmahon) [16:53:55] checking now... [16:57:40] JeffHall: sweet, it worked. [16:57:44] whew [16:58:39] chrismcmahon: Excellent! That 97756 change was just code styling, so we don't lose much by reverting that [16:59:21] JeffHall: not at all. and I'm not even sure that preferring double-quotes is a Great Idea anyway, so a little more attention there would be good. [17:01:49] JeffHall: also, fwiw, the Sauce error message "Unable to pick a platform" means that for some reason Sauce does not have enough information to launch a browser for your particular build. It is a sign that something is drastically misconfigured, that the build is not passing information to Sauce Labs correctly. We see that when we hack on the Jenkins build configuration. The fact that today we work from only one "template" for every b [17:03:16] short break brb [18:01:27] Project browsertests-commons.wikimedia.beta.wmflabs.org-linux-chrome build #501: FAILURE in 22 sec: https://wmf.ci.cloudbees.com/job/browsertests-commons.wikimedia.beta.wmflabs.org-linux-chrome/501/ [18:01:37] Project browsertests-commons.wikimedia.beta.wmflabs.org-windows-internet_explorer_10 build #331: FAILURE in 10 sec: https://wmf.ci.cloudbees.com/job/browsertests-commons.wikimedia.beta.wmflabs.org-windows-internet_explorer_10/331/ [18:04:55] Project browsertests-test2.wikipedia.org-linux-chrome build #762: FAILURE in 22 sec: https://wmf.ci.cloudbees.com/job/browsertests-test2.wikipedia.org-linux-chrome/762/ [18:05:18] Project browsertests-test2.wikipedia.org-linux-firefox build #736: FAILURE in 22 sec: https://wmf.ci.cloudbees.com/job/browsertests-test2.wikipedia.org-linux-firefox/736/ [18:05:19] Project browsertests-commons.wikimedia.beta.wmflabs.org-linux-firefox build #464: FAILURE in 4 min 9 sec: https://wmf.ci.cloudbees.com/job/browsertests-commons.wikimedia.beta.wmflabs.org-linux-firefox/464/ [18:06:12] Project browsertests-test2.wikipedia.org-windows-internet_explorer_7 build #580: FAILURE in 20 sec: https://wmf.ci.cloudbees.com/job/browsertests-test2.wikipedia.org-windows-internet_explorer_7/580/ [18:06:28] Project Flow-en.wikipedia.beta.wmflabs.org-internet-explorer-10 build #19: FAILURE in 11 sec: https://wmf.ci.cloudbees.com/job/Flow-en.wikipedia.beta.wmflabs.org-internet-explorer-10/19/ [18:07:02] Project Flow-en.wikipedia.beta.wmflabs.org-linux-chrome build #88: FAILURE in 13 sec: https://wmf.ci.cloudbees.com/job/Flow-en.wikipedia.beta.wmflabs.org-linux-chrome/88/ [18:07:30] Project MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-firefox build #203: FAILURE in 26 sec: https://wmf.ci.cloudbees.com/job/MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-firefox/203/ [18:07:56] Project MobileFrontend-en.m.wikipedia.org-linux-firefox build #191: FAILURE in 25 sec: https://wmf.ci.cloudbees.com/job/MobileFrontend-en.m.wikipedia.org-linux-firefox/191/ [18:08:22] Project MobileFrontend-test2.m.wikipedia.org-linux-firefox build #119: FAILURE in 26 sec: https://wmf.ci.cloudbees.com/job/MobileFrontend-test2.m.wikipedia.org-linux-firefox/119/ [18:08:35] Project Translate-sandbox.translatewiki.net-linux-firefox build #91: FAILURE in 13 sec: https://wmf.ci.cloudbees.com/job/Translate-sandbox.translatewiki.net-linux-firefox/91/ [18:08:57] Project TwnMainPage-sandbox.translatewiki.net-linux-firefox build #99: FAILURE in 21 sec: https://wmf.ci.cloudbees.com/job/TwnMainPage-sandbox.translatewiki.net-linux-firefox/99/ [18:09:01] Project Translate-meta.wikimedia.org-linux-firefox build #2: FAILURE in 1 min 0 sec: https://wmf.ci.cloudbees.com/job/Translate-meta.wikimedia.org-linux-firefox/2/ [18:09:16] Project UniversalLanguageSelector-commons.wikimedia.beta.wmflabs.org-linux-firefox build #172: FAILURE in 19 sec: https://wmf.ci.cloudbees.com/job/UniversalLanguageSelector-commons.wikimedia.beta.wmflabs.org-linux-firefox/172/ [18:09:37] Project UniversalLanguageSelector-en.wikipedia.beta.wmflabs.org-linux-firefox build #44: FAILURE in 36 sec: https://wmf.ci.cloudbees.com/job/UniversalLanguageSelector-en.wikipedia.beta.wmflabs.org-linux-firefox/44/ [18:09:38] Project UniversalLanguageSelector-sandbox.translatewiki.net-linux-firefox build #89: FAILURE in 21 sec: https://wmf.ci.cloudbees.com/job/UniversalLanguageSelector-sandbox.translatewiki.net-linux-firefox/89/ [18:10:56] wow, wmf-selenium-bot got all wordy [18:11:32] gah, still getting 'unable to pick a platform', wtf [18:12:07] oh, weird and an account problem with Cloudbees [18:12:12] bah [18:21:41] Your current plan 'Base Quarterly' at quarterly is no longer offered. You can however still use it at your existing rate since you subscribed to it before May 9th, 2013 [18:27:27] Plan named after me, nice :P [18:41:16] such a helpful message: "This node has an availability policy that will "CloudBees Swarm". Currently, this mandates that the node be offline." A different message points me to a page saying our account details are no longer offered. Anyway, sorting now... [19:52:20] @seen zeljkof [21:06:53] chrismcmahon: zeljkov disconnected at 11:35 eastern today. I have not seen him back. [21:11:16] chrismcmahon: are cloudbees failures under control? should I work on that today, or can it wait until tomorrow? [21:12:31] hi zeljkof I think it's OK [21:12:46] chrismcmahon: ok, then I will get some sleep and work on that tomorrow [21:13:13] zeljkof: I have a support ticket in with Cloudbees but the issue is with Sauce Labs afaict. [21:13:55] zeljkof: do you know if we have a password for the Sauce account? I am not aware of one, and when you submitted a support ticket back in the spring, it went to Sauce by way of Cloudbees [21:16:00] chrismcmahon: no, we get to sauce by clicking a link at cloudbees https://grandcentral.cloudbees.com/services/goto/sauce_labs [21:16:16] chrismcmahon: uh oh, I think I know what was the problem, and I think I have fixed it now [21:16:52] zeljkof: ? [21:17:02] chrismcmahon: testing.... [21:19:33] zeljkof: ULS tests are giving a Sauce Labs error: https://wmf.ci.cloudbees.com/job/UniversalLanguageSelector-sandbox.translatewiki.net-linux-firefox/90/testReport/(root)/Accept-Language/Accept_Language__outline_example_____de___Hauptseite___/ [21:23:41] chrismcmahon: looks like sauce changed their plans [21:23:58] looks like the problem was that by mistake I have deleted sauce service from cloudbees today [21:24:17] I have reenabled it now, but looks like we no longer have open source account with unlimited minutes [21:24:23] I will fix that now too [21:27:33] zeljkof: OK, I didn't expect that. Let me know if you need the contact info for people I've spoken to at Cloudbees [21:28:15] chrismcmahon: I think I have fixed the problem now [21:28:36] looks like enabling the account again created new username/key, and jenkins had the old ones [21:28:40] testing [21:30:46] Yippee, build fixed! [21:30:46] Project Translate-meta.wikimedia.org-linux-firefox build #5: FIXED in 1 min 13 sec: https://wmf.ci.cloudbees.com/job/Translate-meta.wikimedia.org-linux-firefox/5/ [21:31:11] chrismcmahon: we are back to green now [21:31:19] sorry about that [21:31:30] I will send e-mail to qa list now [21:38:47] Yippee, build fixed! [21:38:47] Project Flow-en.wikipedia.beta.wmflabs.org-linux-chrome build #93: FIXED in 6 min 9 sec: https://wmf.ci.cloudbees.com/job/Flow-en.wikipedia.beta.wmflabs.org-linux-chrome/93/ [21:48:41] chrismcmahon: you can cancel support requests, it was my fault [21:48:47] I have sent e-mail to qa list with details [21:49:30] zeljkof: done [21:50:49] chrismcmahon: thanks [22:01:23] good night