[00:41:11] (03PS1) 10Dduvall: WIP Environment abstraction layer [selenium] - 10https://gerrit.wikimedia.org/r/159644 [02:13:01] 3Wikimedia / 3Continuous integration: CI: mw-api-siteinfo.py should more clearly report site failure - 10https://bugzilla.wikimedia.org/70695 (10spage) 3NEW p:3Unprio s:3normal a:3None When betalabs was completely down with all page and API requests giving a 404, browser tests failed, bug 70648. Tha... [02:14:30] 3Wikimedia Labs / 3deployment-prep (beta): Beta Cluster api.php, index.php, load.php return 404 (caused failed browser tests) - 10https://bugzilla.wikimedia.org/70648#c3 (10spage) 5NEW>3RESO/WOR I think beta labs is working now (thanks to the work of jeremyb and others), though I think this warrants a po... [03:24:46] 3Wikimedia / 3Quality Assurance: Beta Cluster stopped receiving code updates (beta-scap-eqiad failing) - 10https://bugzilla.wikimedia.org/70696 (10James Forrester) 3NEW p:3Unprio s:3major a:3None beta-scap-eqiad has been failing since the 09-Sep-2014 23:45:52 run. Don't know where to look for the lo... [03:24:52] * James_F sighs. [03:24:58] 3Wikimedia / 3Quality Assurance: Beta Cluster stopped receiving code updates (beta-scap-eqiad failing) - 10https://bugzilla.wikimedia.org/70696 (10James Forrester) p:5Unprio>3High [03:26:51] James_F: https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=labmon1001&service=Monitor+for+puppet+failures+on+beta+labs [03:26:57] now i wonder if you will have the login [03:27:22] it should be labs credentials but you also need LDAP group membership [03:42:45] I'll be on for a couple mins in ~10. see if there's anything obvious before I crash [04:20:03] hey krinkle [04:24:38] (03CR) 10Krinkle: [C: 04-2] "{name}-jsduck is the generic template. VisualEditor-jsduck is a different template with different configuration. If you deference that job" [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/159475 (owner: 10Zfilipin) [04:27:23] jeremyb: hola sir, how'd the train ride go? [04:27:44] 3Wikimedia / 3Quality Assurance: Beta Cluster stopped receiving code updates (beta-scap-eqiad failing) - 10https://bugzilla.wikimedia.org/70696#c1 (10Bryan Davis) The problem this time is something to do with the l10nupdate phase as shown in the scap jenkins job log bad place for wikibugs to truncate [04:28:55] greg-g: errr, didn't write anything :( (i did have a 5 or 10 min nap though!) [04:30:00] huh. i wonder where mergeMessageFileList.php is coming from [04:30:04] not in jjb conf [04:30:14] i guess it's actually called by scap [04:30:40] confusing because we had an error with the same script before. but i think maybe it's different [04:31:10] jeremyb: so, just sooner than later I'd love a simple timeline of what happened, I can take it from there. [04:31:18] right [04:31:33] thanks muchly, sir [04:32:44] 3Wikimedia / 3Quality Assurance: Beta Cluster stopped receiving code updates (beta-scap-eqiad failing) - 10https://bugzilla.wikimedia.org/70696#c2 (10Bryan Davis) Running manually says this: $ mwscript mergeMessageFileList.php --wiki="eowiki" --list-file="/a/common/wmf-config/extension-list" PHP Notice: Un... [04:39:59] 3Wikimedia / 3Quality Assurance: Beta Cluster stopped receiving code updates (beta-scap-eqiad failing) - 10https://bugzilla.wikimedia.org/70696#c3 (10Bryan Davis) I see that I837fe40e493f32a787987ad6eb9ce0625dfbfab6 has attempted to make the appropriate config change and that commit is checked out where I ex... [04:44:59] 3Wikimedia / 3Quality Assurance: Beta Cluster stopped receiving code updates (beta-scap-eqiad failing) - 10https://bugzilla.wikimedia.org/70696#c4 (10Bryan Davis) The problem is right there in the command that scap is running: --list-file="/a/common/wmf-config/extension-list" Scap is not using extension-lis... [04:47:51] jeremyb: Hi [04:48:00] jeremyb: What's up? [04:50:10] Krinkle: was going to ask about what i was seeing on the latest scap fail. but looks like bd808|BUFFER is on it already [04:50:33] (seee wikibugs above) [04:51:44] 3Wikimedia / 3Quality Assurance: Beta Cluster stopped receiving code updates (beta-scap-eqiad failing) - 10https://bugzilla.wikimedia.org/70696#c5 (10Bryan Davis) (In reply to Bryan Davis from comment #4) > The problem is right there in the command that scap is running: > --list-file="/a/common/wmf-config/ex... [04:56:15] k [04:56:36] I'm not that familiar with scap. [04:56:42] Currently at a conference but let me know if I can help. [04:58:53] Krinkle: actually not urgent now but the reason i poked you was because I couldn't tell from jenkins output which was running where. (e.g. whether or not a machine had ssh'd to another machine. etc.) [04:59:57] especially for error messages it's important. then you can copy from jenkins log to CLI on the same machine where it just failed and diagnose. (strace, different params, etc.) [05:02:02] !log Cherry-picked I621d14e4b75a8415b16077fb27ca956c4de4c4c3 to scap to try and fix l10n update issue [05:02:03] Logged the message, Master [05:04:59] 3Wikimedia / 3Quality Assurance: Beta Cluster stopped receiving code updates (beta-scap-eqiad failing) - 10https://bugzilla.wikimedia.org/70696#c7 (10Bryan Davis) Using a realm specific file doesn't work because the target file is "extension-list-labs" and not "extension-list.labs" [05:08:03] 3Wikimedia / 3Quality Assurance: Beta Cluster stopped receiving code updates (beta-scap-eqiad failing) - 10https://bugzilla.wikimedia.org/70696#c8 (10Bryan Davis) And extension-list-labs is pretty obviously meant to be additive to extension-list ans not a replacement. [05:10:44] !log Reverted cherry-pick of I621d14e4b75a8415b16077fb27ca956c4de4c4c3 in scap; not the actual problem [05:10:46] Logged the message, Master [05:16:45] 3Wikimedia / 3Quality Assurance: Reorg of code layout in Parsoid module breaks l10nupdate build in beta and halts scap - 10https://bugzilla.wikimedia.org/70696#c10 (10Bryan Davis) 5PATC>3NEW (In reply to Bryan Davis from comment #3) > I see that I837fe40e493f32a787987ad6eb9ce0625dfbfab6 has attempted to... [05:27:24] wikitech sidebar needs a link to releng SAL :) [05:40:36] greg-g: you have mail, i get sleep [08:08:15] (03Abandoned) 10Zfilipin: WIP Trying to use variable for VisualEditor job [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/159475 (owner: 10Zfilipin) [08:25:44] 3Wikimedia / 3Continuous integration: CI: mw-api-siteinfo.py should more clearly report site failure - 10https://bugzilla.wikimedia.org/70695#c1 (10Željko Filipin) It would be nice if the script would have helpful error messages, but I do not think this script's job is to check if beta is down. We should hav... [08:38:40] hi everybody! It seems the regular sync of master to beta isn't working. [08:39:08] deployment-prep's /srv/mediawiki/php-master/extensions/Echo/modules/overlay/ext.echo.overlay.js is the latest, but deployment-mediawiki02 doesn't have it. [08:41:45] !log deployment-mediawiki01/02 are not getting latest code [08:41:46] Logged the message, Master [08:45:07] ah, this is probably https://bugzilla.wikimedia.org/show_bug.cgi?id=70696 [09:43:29] 3Wikimedia / 3Continuous integration: CI: mw-api-siteinfo.py should more clearly report site failure - 10https://bugzilla.wikimedia.org/70695#c2 (10spage) (In reply to Željko Filipin from comment #1) > I do not think this script's job is to check if beta is down. I agree, but it should die when its request... [10:05:57] !log deployment-prep upgraded luasandbox and hhvm across the cluster [10:05:59] Logged the message, Master [10:07:59] 3Wikimedia Labs / 3deployment-prep (beta): Determine first pass list of icinga-alerting data from graphite.wmflabs - 10https://bugzilla.wikimedia.org/70141#c9 (10Yuvi Panda) There now exists monitoring for puppet failures and disk space (https://icinga.wikimedia.org/cgi-bin/icinga/status.cgi?search_string=la... [10:13:44] 3Wikimedia Labs / 3deployment-prep (beta): Determine first pass list of icinga-alerting data from graphite.wmflabs - 10https://bugzilla.wikimedia.org/70141#c10 (10Yuvi Panda) Note that the alert are for all the machines, in betalabs, not just for the ones listed. I added more features to our check_graphite s... [10:14:14] 3Wikimedia / 3Continuous integration: CI: mw-api-siteinfo.py should more clearly report site failure - 10https://bugzilla.wikimedia.org/70695#c3 (10Željko Filipin) (In reply to spage from comment #2) > I agree, but it should die when its request fails, not later when it > json.loads() the bad response. I t... [10:37:36] (03PS2) 10Zfilipin: WIP Moved the first Wikidata job from WMDE Jenkins [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/157699 [10:41:29] 3Wikimedia / 3Continuous integration: CI: mw-api-siteinfo.py should more clearly report site failure - 10https://bugzilla.wikimedia.org/70695#c4 (10Antoine "hashar" Musso) Watch out, we have python requests 0.8.2 which might not have response.raise_for_status() [11:12:20] greg-g: bd808|BUFFER there's a puppet failure on betalabs https://icinga.wikimedia.org/cgi-bin/icinga/status.cgi?search_string=labmon someone needs to go poke :) [11:12:30] (03PS3) 10Zfilipin: WIP Moved the first Wikidata job from WMDE Jenkins [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/157699 [11:23:45] 3Wikimedia Labs / 3deployment-prep (beta): Determine first pass list of icinga-alerting data from graphite.wmflabs - 10https://bugzilla.wikimedia.org/70141#c13 (10Yuvi Panda) Also, who is responsible for fixing the errors that pop up? There are puppet failures on videoscaler-01 now, and I've no idea how to f... [11:25:24] Hello zeljkof! [11:25:34] vikasyaligar: in a meeting [11:25:40] ah ok [11:30:12] (03PS4) 10Zfilipin: Moved the first Wikidata job from WMDE Jenkins [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/157699 [11:31:45] 3Wikimedia Labs / 3deployment-prep (beta): Determine first pass list of icinga-alerting data from graphite.wmflabs - 10https://bugzilla.wikimedia.org/70141#c14 (10Yuvi Panda) (On that note, I'd also remove myself from the alert groups once the initial setting up is stabilized) [11:33:15] (03CR) 10Tobias Gritschacher: [C: 031] Moved the first Wikidata job from WMDE Jenkins [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/157699 (owner: 10Zfilipin) [11:33:33] (03CR) 10Tobias Gritschacher: "fine with merging that" [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/157699 (owner: 10Zfilipin) [11:34:01] (03CR) 10Zfilipin: [C: 032] Moved the first Wikidata job from WMDE Jenkins [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/157699 (owner: 10Zfilipin) [11:36:12] (03Merged) 10jenkins-bot: Moved the first Wikidata job from WMDE Jenkins [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/157699 (owner: 10Zfilipin) [12:26:45] aharoni: is it my connection, or yours? [12:26:52] I do not see you in the hangout [12:30:05] aharoni: can you hear me? [12:56:35] zeljkof: do you know if the WMF fundraising team have browsertests? e.g. bannertests [12:56:53] I do not know, but I do not think so [12:58:24] zeljkof: ok. because we have now... :) [12:58:36] Tobi_WMDE_SWE: :) [12:58:41] sorry, in a meeting with aharoni [12:59:05] zeljkof: nP. thx for the answer.. we can discuss this next week [13:04:14] 3Wikimedia Labs / 3deployment-prep (beta): Setup monitoring for Beta cluster - 10https://bugzilla.wikimedia.org/51497#c7 (10Yuvi Panda) There's now alerts for the following things for betalabs: - Low space on /var - Low space on / - Puppet staleness (warn at 1h, crit at 12h) - Puppet failure events Note th... [13:35:47] Tobi_WMDE_SWE: I think we need some browser tests in most extensions deployed to production, but we are far from there [13:38:32] zeljkof: our (WMDE's) fundraising software is not really an extension. It is currently also not open source and not public. We're working on getting it open source. But we have a new employee working on it now and since I've introduced him to browsertests a few weeks back he had made a lot of progress there.. which is great! another one that cares about [13:38:32] browsertests! yay. [13:39:08] Tobi_WMDE_SWE: :) [14:45:54] (03PS2) 10Zfilipin: Add Rubocop files. [ruby/api] - 10https://gerrit.wikimedia.org/r/159630 (https://bugzilla.wikimedia.org/70605) (owner: 10Damienkan) [14:49:14] 3Wikimedia / 3Quality Assurance: fix problems found by rubocop in mediawiki/ruby/api repo - 10https://bugzilla.wikimedia.org/70605#c2 (10Željko Filipin) Damien, please assign the bug to yourself so other people know you are working on it. That will prevent somebody else working on it and duplicating the effo... [14:52:45] (03CR) 10Zfilipin: [C: 04-1] "Looks like you have submitted an empty .rubocop.yml file. It should contain this:" [ruby/api] - 10https://gerrit.wikimedia.org/r/159630 (https://bugzilla.wikimedia.org/70605) (owner: 10Damienkan) [15:01:32] !log Fixed incorrect $::deployment_server_override var on deployment-videoscaler01; deployment-bastion.eqiad.wmflabs is correct and deployment-salt.eqiad.wmflabs is not [15:01:33] Logged the message, Master [15:09:08] !log Updated hhvm-luasandbox to latest version on mediawiki03 and verified that mediawiki0[12] were already updated [15:09:10] Logged the message, Master [15:36:59] 3Wikimedia / 3Continuous integration: CI: mw-api-siteinfo.py should more clearly report site failure - 10https://bugzilla.wikimedia.org/70695 (10Željko Filipin) [15:37:14] 3Wikimedia Labs / 3deployment-prep (beta): Setup monitoring for Beta cluster - 10https://bugzilla.wikimedia.org/51497 (10Željko Filipin) [15:39:06] is beta not updating? [15:40:02] yay merge messages [15:40:15] is this parsoid? or something new/else? [15:48:23] on deployment bastion, i can run merge messages w/o error [15:49:59] 3Wikimedia / 3Quality Assurance: Reorg of code layout in Parsoid module breaks l10nupdate build in beta and halts scap - 10https://bugzilla.wikimedia.org/70696#c11 (10Bryan Davis) Looks like Sam has fixed this by merging Idea5db96fba68d50d29ca31678cf6e26229c56db which I noticed last night but didn't want to... [15:56:59] 3Wikimedia / 3Quality Assurance: Reorg of code layout in Parsoid module breaks l10nupdate build in beta and halts scap - 10https://bugzilla.wikimedia.org/70696 (10Bryan Davis) 5NEW>3RESO/FIX [15:59:59] greg-g: bd808 cleared the puppet errors on betalabs :) [16:00:09] greg-g: thoughts on other things to setup? [16:00:24] YuviPanda: not right now, (and going into meeting) [16:00:27] YuviPanda: thanks a ton! [16:00:36] greg-g: cool :) ping later if you need more. [16:00:44] * YuviPanda goes to add more things to monitor for toollabs [16:00:45] when we run into more broken things I'll think "is a monitor needed here?" from now on ;) [16:01:25] greg-g: :) cool [16:01:36] bd808: if scap can write things to graphite, we can monitor those as well [16:01:38] graphite/statsd [16:04:00] YuviPanda: It tries to actually. The statsd endpoint is in the scap.cfg file [16:04:16] bd808: oh. [16:04:25] bd808: where's scap.cfg? [16:04:33] also can it send to labs graphite on labs/ [16:04:33] ? [16:04:45] YuviPanda: https://github.com/wikimedia/mediawiki-tools-scap/blob/master/scap.cfg#L91 [16:05:37] There may or may not be problems in the statsd packets scap sends [16:05:58] I've never figured out if txstatsd is wrong or the scap code [16:06:29] YuviPanda: client is at https://github.com/wikimedia/mediawiki-tools-scap/blob/master/scap/log.py#L248-L274 [16:12:01] !log Updated scap to include I0f7f5cae72a87f68d861340d11632fb429c557b9 [16:12:03] Logged the message, Master [16:12:05] YuviPanda: ^ [16:13:12] !log Now that scap is pointed to labmon1001.eqiad.wmnet the deployment-graphite.eqiad.wmflabs host can probably be deleted; it never really worked anyway [16:13:13] Logged the message, Master [16:17:34] bd808: bd808 oh, cool. Are you gonna delete it? I can simplify some code in puppet if so [16:18:10] YuviPanda: Feel free to kill it and make puppet nicer [16:18:15] shall do [16:31:25] James_F: ie10 tests for ve fail completely (by design, I guess) but for safari 32 out of 47 scenarios passed :) https://integration.wikimedia.org/ci/job/browsertests-VisualEditor-en.wikipedia.beta.wmflabs.org-os_x_10.9-safari-sauce/lastCompletedBuild/testReport/ [16:32:51] zeljkof: Woo. We'll need to follow-up there. [16:37:59] chrismcmahon: I keep meaning to talk to you about the user accounts we're using for testing. Let me know when you have a few minutes, or if it would be easier to setup a meeting early next week. [16:45:31] hi csteipp, I have a meeting in 15 minutes, or drop an email? [16:45:57] chrismcmahon: I'll send you an email and we can either bash things out there, or schedule something [16:46:19] csteipp: sounds good, thanks [18:31:26] greg-g: not sure if you did anything with my mail yet. have a couple minor things to add I think [18:32:44] jeremyb: I haven't had time yet, copy/paste it to a wikipage on wikitech, then make your changes? I can clean up after [19:10:14] aude, everyone: tests on beta labs that login failed with "Unexpected non-MediaWiki exception encountered, of type "BadMethodCallException" [19:10:18] [2fbb486e] /wiki/Main_Page Exception from line 164 of /srv/mediawiki/php-master/extensions/Wikidata/vendor/wikibase/data-model/src/Entity/Item.php: Call to a member function hasLinkWithSiteId() on a non-object (NULL)" [19:11:03] omg [19:11:20] thanks [19:12:37] http://wikidata.beta.wmflabs.org/wiki/Q2558 :( [19:14:30] aude it seems to be just visiting beta labs' Main_Page whether logged in or not, which is what the Special:UserLogin does [19:15:18] don't know if it is hhvm related, but probably not [19:17:10] it's from Wikibase/client/includes/hooks/LanguageLinkBadgeDisplay.php(82) , but not all pages trigger it, e.g. http://en.wikipedia.beta.wmflabs.org/wiki/Dido_Sotiriou is OK [19:17:59] no surprise :/ [19:18:31] i bet our nw serialization code does not like those items [19:18:44] which is bad, but good to know [19:19:00] 3Wikimedia / 3Continuous integration: hphpize inject $PWD used at time of building to HHVM_INCLUDE_DIRS - 10https://bugzilla.wikimedia.org/68944 (10Ori Livneh) 5NEW>3RESO/FIX [19:21:29] 3Wikimedia / 3Quality Assurance: Flow browser tests consistently fail with Timeout::Error (Timeout::Error) - 10https://bugzilla.wikimedia.org/69013#c4 (10spage) 5NEW>3RESO/FIX We haven't seen this error in Flow tests for several weeks, so declaring fixed. (Nowadays our beta labs issue is Bug 68125 - bro... [19:56:54] (03PS4) 10Chad: Jenkins job for elasticsearch-swift plugin [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/158396 (owner: 10Manybubbles) [20:00:20] 3Wikimedia Labs / 3deployment-prep (beta): beta labs down with Wikidata error - 10https://bugzilla.wikimedia.org/70740 (10Chris McMahon) 3NEW p:3Unprio s:3critic a:3None Visit http://en.wikipedia.beta.wmflabs.org/. Get error: Unexpected non-MediaWiki exception encountered, of type "BadMethodCallExce... [20:15:22] YuviPanda: hey, so i see we have contactgroup "betalabs" [20:15:28] yeah [20:15:30] and also toollabs [20:15:53] did you want to add scfc to beta? [20:16:07] which one should i use as the basis for notifications in this channel [20:16:14] betalabs, right [20:16:39] is QA a larger group than betalabs? [20:17:08] mutante: no, to toollabs. [20:17:12] mutante: he got added to toollabs [20:17:20] mutante: betalabs is just the deployment-prep project and nothing more [20:17:37] mutante: for this channel, you should use betalabs, yes [20:17:47] alright! hold on :) [20:17:59] i'm trying to just copy the wikidata setup [20:18:01] cool [20:18:05] to get you IRC stuff in here [20:19:44] 3Wikimedia Labs / 3deployment-prep (beta): beta labs down with Wikidata error - 10https://bugzilla.wikimedia.org/70740#c1 (10Chris McMahon) 5NEW>3RESO/FIX aude reverted the bad commit [20:21:03] mutante: would also be nice to get the toollabs stuff in #wikimedia-labs [20:27:14] YuviPanda: whenever i want to add you on gerrit, i get "SuchABot" first :) [20:27:19] https://gerrit.wikimedia.org/r/#/c/159827/1 [20:28:50] (03PS5) 10Chad: Jenkins job for elasticsearch-swift plugin [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/158396 (owner: 10Manybubbles) [20:59:31] Jenkins, you so crazy [20:59:41] !log https://integration.wikimedia.org/ci/ is down with 503 errors [20:59:43] Logged the message, Master [20:59:50] spagewmf: it was just restarted [20:59:58] see -operations [21:00:53] ori: thanks. Someone suggested we log issues with beta labs here, as -operations is high traffic. [21:03:27] Project browsertests-Math-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #101: SUCCESS in 1 min 16 sec: https://integration.wikimedia.org/ci/job/browsertests-Math-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce/101/ [21:05:23] Project browsertests-MultimediaViewer-en.wikipedia.beta.wmflabs.org-linux-chrome-sauce build #158: SUCCESS in 3 min 9 sec: https://integration.wikimedia.org/ci/job/browsertests-MultimediaViewer-en.wikipedia.beta.wmflabs.org-linux-chrome-sauce/158/ [21:08:54] Project browsertests-MultimediaViewer-mediawiki.org-linux-firefox-sauce build #159: SUCCESS in 3 min 28 sec: https://integration.wikimedia.org/ci/job/browsertests-MultimediaViewer-mediawiki.org-linux-firefox-sauce/159/ [21:09:43] Project browsertests-GettingStarted-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #32: STILL FAILING in 48 sec: https://integration.wikimedia.org/ci/job/browsertests-GettingStarted-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce/32/ [21:10:19] Project UploadWizard-api-commons.wikimedia.org build #544: SUCCESS in 34 sec: https://integration.wikimedia.org/ci/job/UploadWizard-api-commons.wikimedia.org/544/ [21:22:46] Project browsertests-UniversalLanguageSelector-commons.wikimedia.beta.wmflabs.org-linux-firefox-sauce build #154: SUCCESS in 20 min: https://integration.wikimedia.org/ci/job/browsertests-UniversalLanguageSelector-commons.wikimedia.beta.wmflabs.org-linux-firefox-sauce/154/ [21:29:11] Project browsertests-Flow-test2.wikipedia.org-linux-chrome-sauce build #145: STILL FAILING in 6 min 24 sec: https://integration.wikimedia.org/ci/job/browsertests-Flow-test2.wikipedia.org-linux-chrome-sauce/145/ [21:32:00] Project browsertests-MultimediaViewer-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #158: SUCCESS in 2 min 48 sec: https://integration.wikimedia.org/ci/job/browsertests-MultimediaViewer-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce/158/ [21:42:39] Project browsertests-Echo-test2.wikipedia.org-linux-firefox-sauce build #36: STILL FAILING in 10 min: https://integration.wikimedia.org/ci/job/browsertests-Echo-test2.wikipedia.org-linux-firefox-sauce/36/ [21:51:14] 3Wikimedia Labs / 3deployment-prep (beta): Setup a mediawiki03 (or what not) on Beta Cluster that we can direct the security scanning work to - 10https://bugzilla.wikimedia.org/70181#c11 (10Dan Duvall) I've cherry-picked the patch to deployment-salt.eqiad.wmflabs and the last scap deployment seems to have sy... [21:51:47] greg-g: ^ can i/you resolve? [21:53:29] marxarelli: Are all the gerrit patched merged? [21:53:34] *patches [21:53:56] bd808|MOBILE: cherry-picked but not merged [21:54:25] I don't like to close until things are merged, but YMMV :) [21:54:47] good job on getting that working though [21:54:51] i typically feel the same way. this seemed slightly different since it's already "live" [21:55:00] but i'm good to wait [21:55:12] just trying to do some bug housekeeping [21:55:46] pro tip I got from multiple people; if you need reviews from opsen pester them on irc a lot [21:55:54] Project browsertests-VisualEditor-en.wikipedia.beta.wmflabs.org-os_x_10.9-safari-sauce build #11: STILL FAILING in 52 min: https://integration.wikimedia.org/ci/job/browsertests-VisualEditor-en.wikipedia.beta.wmflabs.org-os_x_10.9-safari-sauce/11/ [21:55:57] haha [21:56:02] awesome tip [21:56:02] if that doesn't work after a week, email m.ark [21:56:47] "kid in the backseat" technique :) [21:56:50] i like it [21:57:01] the one who was at the dentist? [21:57:24] I was worried about being annoying when I started. Turns out that if you are not you'll probably get lost in the shuffle [21:57:36] this IS real life [22:01:33] :) is this real? [22:01:46] Project browsertests-VisualEditor-test2.wikipedia.org-linux-firefox-sauce build #176: STILL FAILING in 51 min: https://integration.wikimedia.org/ci/job/browsertests-VisualEditor-test2.wikipedia.org-linux-firefox-sauce/176/ [22:02:05] don't support the IRC pestering. make them not filter gerrit mail anymore instead :) [22:03:56] * marxarelli pesters mutante for a merge of https://gerrit.wikimedia.org/r/#/c/159520/ [22:04:05] please? [22:04:07] :) [22:04:30] Project UploadWizard-api-commons.wikimedia.beta.wmflabs.org build #682: SUCCESS in 28 sec: https://integration.wikimedia.org/ci/job/UploadWizard-api-commons.wikimedia.beta.wmflabs.org/682/ [22:04:40] security audits? [22:05:04] i'll add it to the queue (tm) [22:05:22] not a real audit, as in "the man" [22:05:46] but we have a volunteer running security scans against one instance in the beta cluster [22:06:01] wait, beta has it's own dsh groups, i see [22:06:09] and already +1 from bd808.. ok, good enough [22:06:35] rad. thanks! [22:06:56] yay! [22:07:06] merged [22:07:12] +1000 [22:51:46] 3Wikimedia / 3Quality Assurance: Create browser test builds for MMV in IE back to IE8 - 10https://bugzilla.wikimedia.org/70744 (10Chris McMahon) 3NEW p:3Unprio s:3major a:3None This is a great demo project [23:01:05] there you go, Icinga-wm [23:01:09] James_F|Away: [23:03:22] CUSTOM - BetaLabs: Low disk space on / on labmon1001 is OK: OK: All targets OK [23:03:40] ^ test, works [23:06:15] 3Wikimedia / 3Quality Assurance: Create browser test builds for MMV in IE back to IE8 - 10https://bugzilla.wikimedia.org/70744 (10Greg Grossmeier) p:5Unprio>3High [23:10:33] mutante: yay [23:11:23] greg-g: :) done both at once, betalabs -> -qa and toollabs -> -labs [23:12:05] mutante: I said in -labs, but again, thanks! [23:12:07] chrismcmahon or marxarelli : I'm using HIDDEN=true and my browser tests are appearing on-screen. Did something change? [23:14:07] spagewmf: it's HEADLESS actually [23:14:33] great, thanks [23:14:34] HEADLESS=true bundle exec cucumber ... [23:14:36] np [23:15:14] marxarelli knows all the env switches :-) [23:16:38] I put the ones I know in https://www.mediawiki.org/wiki/Quality_Assurance/Browser_testing/Running_tests (ought to be a table), I should read my own code. I've been Ctrl-R finding old cucumber command lines and every one has the wrong environment variable 8-) [23:26:26] jeremyb: the incident report https://wikitech.wikimedia.org/wiki/Incident_documentation/20140910-BetaCluster you said you wanted to edit/change some things [23:27:14] jeremyb: when you're done, pleaes email Ops and QA (qa@lists.w.o) [23:27:22] ACK (afk) [23:27:38] jeremyb: ACK the AFK ;) [23:28:56] mutante: Thanks! [23:38:37] greg-g: how do you get volunteers to do paperwork ?! :) [23:40:03] spagewmf: don't call it that! [23:58:02] spagewmf: what, who?