[00:48:13] Yippee, build fixed! [00:48:14] Project browsertests-Flow-en.wikipedia.beta.wmflabs.org-windows_8-internet_explorer-sauce build #271: FIXED in 49 min: https://integration.wikimedia.org/ci/job/browsertests-Flow-en.wikipedia.beta.wmflabs.org-windows_8-internet_explorer-sauce/271/ [01:17:29] Project browsertests-CirrusSearch-test2.wikipedia.org-linux-firefox-sauce build #258: FAILURE in 2 min 53 sec: https://integration.wikimedia.org/ci/job/browsertests-CirrusSearch-test2.wikipedia.org-linux-firefox-sauce/258/ [02:55:04] Yippee, build fixed! [02:55:05] Project browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce build #327: FIXED in 1 hr 18 min: https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce/327/ [04:13:39] Yippee, build fixed! [04:13:40] Project browsertests-Flow-en.wikipedia.beta.wmflabs.org-linux-firefox-monobook-sauce build #126: FIXED in 1 hr 4 min: https://integration.wikimedia.org/ci/job/browsertests-Flow-en.wikipedia.beta.wmflabs.org-linux-firefox-monobook-sauce/126/ [06:12:23] Project browsertests-VisualEditor-test2.wikipedia.org-linux-chrome-sauce build #304: STILL FAILING in 1 hr 2 min: https://integration.wikimedia.org/ci/job/browsertests-VisualEditor-test2.wikipedia.org-linux-chrome-sauce/304/ [06:16:34] Project browsertests-Flow-en.wikipedia.beta.wmflabs.org-linux-chrome-monobook-sauce build #112: SUCCESS in 1 hr 1 min: https://integration.wikimedia.org/ci/job/browsertests-Flow-en.wikipedia.beta.wmflabs.org-linux-chrome-monobook-sauce/112/ [08:48:03] (03PS3) 10Hashar: Only trigger JJB config diff when changed [integration/config] - 10https://gerrit.wikimedia.org/r/170323 [08:48:16] (03CR) 10Hashar: [C: 032] Only trigger JJB config diff when changed [integration/config] - 10https://gerrit.wikimedia.org/r/170323 (owner: 10Hashar) [08:48:27] (03CR) 10jenkins-bot: [V: 04-1] Only trigger JJB config diff when changed [integration/config] - 10https://gerrit.wikimedia.org/r/170323 (owner: 10Hashar) [08:52:00] (03Merged) 10jenkins-bot: Only trigger JJB config diff when changed [integration/config] - 10https://gerrit.wikimedia.org/r/170323 (owner: 10Hashar) [08:58:07] (03PS1) 10Hashar: Trigger analytics-aggregator-tox-py27 [integration/config] - 10https://gerrit.wikimedia.org/r/172954 [08:59:16] (03CR) 10Hashar: "Job deployed:" [integration/config] - 10https://gerrit.wikimedia.org/r/172954 (owner: 10Hashar) [09:10:38] (03PS2) 10Hashar: qunit-cleanup: rm -f when deleting file [integration/config] - 10https://gerrit.wikimedia.org/r/166027 [10:06:28] (03CR) 10Hashar: [C: 032] "Jobs refreshed:" [integration/config] - 10https://gerrit.wikimedia.org/r/166027 (owner: 10Hashar) [10:09:57] (03Merged) 10jenkins-bot: qunit-cleanup: rm -f when deleting file [integration/config] - 10https://gerrit.wikimedia.org/r/166027 (owner: 10Hashar) [10:23:40] 3Wikimedia / 3Continuous integration: Restrict 'integration' Gerrit group - 10https://bugzilla.wikimedia.org/73303 (10Antoine "hashar" Musso (WMF)) p:5Unprio>3Normal s:5normal>3enhanc [10:23:59] Project browsertests-VisualEditor-language-screenshot-linux-firefox » lb,contintLabsSlave && UbuntuTrusty build #41: FAILURE in 22 min: https://integration.wikimedia.org/ci/job/browsertests-VisualEditor-language-screenshot-linux-firefox/LANGUAGE_SCREENSHOT_CODE=lb,label=contintLabsSlave%20&&%20UbuntuTrusty/41/ [10:31:04] Project browsertests-VisualEditor-language-screenshot-linux-firefox » ro,contintLabsSlave && UbuntuTrusty build #41: FAILURE in 29 min: https://integration.wikimedia.org/ci/job/browsertests-VisualEditor-language-screenshot-linux-firefox/LANGUAGE_SCREENSHOT_CODE=ro,label=contintLabsSlave%20&&%20UbuntuTrusty/41/ [10:31:52] (03PS1) 10Hashar: mediawiki-vendor-integration -> mediawiki-phpunit [integration/config] - 10https://gerrit.wikimedia.org/r/172970 (https://bugzilla.wikimedia.org/72787) [10:33:26] 3Wikimedia / 3Continuous integration: Jenkins: Rename mediawiki-vendor-integration to mediawiki-core-phpunit - 10https://bugzilla.wikimedia.org/72787#c2 (10Antoine "hashar" Musso (WMF)) s:5normal>3enhanc The patch above copy paste the existing job as "mediawiki-phpunit". [10:49:57] 3Wikimedia / 3Continuous integration: CI Trusty slaves no more have hhvm installed - 10https://bugzilla.wikimedia.org/73356 (10Antoine "hashar" Musso (WMF)) 3NEW p:3Unprio s:3normal a:3None The hhvm package is no more being installed on the Trusty continuous integration slaves, as an example integrat... [11:00:05] Project browsertests-VisualEditor-language-screenshot-linux-firefox » sv,contintLabsSlave && UbuntuTrusty build #41: FAILURE in 59 min: https://integration.wikimedia.org/ci/job/browsertests-VisualEditor-language-screenshot-linux-firefox/LANGUAGE_SCREENSHOT_CODE=sv,label=contintLabsSlave%20&&%20UbuntuTrusty/41/ [11:02:09] !log bringing back integration-slave1008 to the pool. The label had a typo. https://integration.wikimedia.org/ci/computer/integration-slave1008/ [11:02:12] Logged the message, Master [11:13:55] !log apt-get upgrade / maintenance on all slaves [11:13:56] Logged the message, Master [11:18:41] PROBLEM - CI: Low disk space on /var on labmon1001 is CRITICAL: CRITICAL: integration.integration-puppetmaster.diskspace._var.byte_avail.value (11.11%) [11:28:43] 3Wikimedia Labs / 3deployment-prep (beta): deployment-parsoidcache02 is not using betalabs puppetmaster - 10https://bugzilla.wikimedia.org/73357 (10Yuvi Panda) 3NEW p:3Unprio s:3normal a:3None It is still using virt1000, which is the general labs puppetmaster. I don't think this is intentional :) Thi... [11:44:28] Yippee, build fixed! [11:44:28] Project browsertests-MultimediaViewer-en.wikipedia.beta.wmflabs.org-linux-chrome-sauce build #284: FIXED in 36 min: https://integration.wikimedia.org/ci/job/browsertests-MultimediaViewer-en.wikipedia.beta.wmflabs.org-linux-chrome-sauce/284/ [12:01:26] (03CR) 10Zfilipin: add builds for CentralNotice to beta labs (033 comments) [integration/config] - 10https://gerrit.wikimedia.org/r/172810 (owner: 10Cmcmahon) [12:12:37] Project browsertests-Flow-en.wikipedia.beta.wmflabs.org-linux-firefox-monobook-sauce build #127: FAILURE in 1 hr 4 min: https://integration.wikimedia.org/ci/job/browsertests-Flow-en.wikipedia.beta.wmflabs.org-linux-firefox-monobook-sauce/127/ [12:27:11] PROBLEM - CI: Low disk space on /var on labmon1001 is CRITICAL: CRITICAL: integration.integration-puppetmaster.diskspace._var.byte_avail.value (11.11%) [13:11:40] 3Wikimedia / 3Quality Assurance: mediawiki_selenium always use the same default xvfb display 99 - 10https://bugzilla.wikimedia.org/71602#c6 (10Antoine "hashar" Musso (WMF)) 5PATC>3NEW p:5Low>3High The patch has been merged and is included in mediawiki_selenium 0.4.1. We have to adjust all repositori... [13:27:47] (03CR) 10Hashar: [C: 032] "Deploying using git deploy for production slaves and git pull on labs slaves" [integration/jenkins] - 10https://gerrit.wikimedia.org/r/172756 (https://bugzilla.wikimedia.org/73311) (owner: 10Hashar) [13:27:54] (03Merged) 10jenkins-bot: Point Doxygen input filter to Zend PHP [integration/jenkins] - 10https://gerrit.wikimedia.org/r/172756 (https://bugzilla.wikimedia.org/73311) (owner: 10Hashar) [13:31:40] 3Wikimedia / 3Continuous integration: CI Trusty slaves no more have hhvm installed - 10https://bugzilla.wikimedia.org/73356#c1 (10Antoine "hashar" Musso (WMF)) Timo, I have unpooled integration-slave1009 since it is missing hhvm and left a note pointing to this bug. https://integration.wikimedia.org/ci/comp... [13:32:43] Tobi_WMDE_SW: I am in the hangout [13:38:40] 3Wikimedia / 3Continuous integration: [project] trigger browser tests from Gerrit (tracking) - 10https://bugzilla.wikimedia.org/53697 (10Jan Zerebecki) [14:04:55] 3Wikimedia / 3Continuous integration: [project] trigger browser tests from Gerrit (tracking) - 10https://bugzilla.wikimedia.org/53697#c8 (10Antoine "hashar" Musso (WMF)) (In reply to Matthew Flaschen from comment #7) > What's the status of this? Are there any projects that have browser tests > trigge... [14:30:33] (03PS4) 10Hashar: Migrate mw doxygen to zuul-cloner and Trusty [integration/config] - 10https://gerrit.wikimedia.org/r/166034 (https://bugzilla.wikimedia.org/46771) [14:30:35] (03CR) 10jenkins-bot: [V: 04-1] Migrate mw doxygen to zuul-cloner and Trusty [integration/config] - 10https://gerrit.wikimedia.org/r/166034 (https://bugzilla.wikimedia.org/46771) (owner: 10Hashar) [14:31:37] (03CR) 10Hashar: "PS4 no more a wip, updated some settings to match production target. The patch now updates the job mediawiki-core-doxygen-publish instead" [integration/config] - 10https://gerrit.wikimedia.org/r/166034 (https://bugzilla.wikimedia.org/46771) (owner: 10Hashar) [14:34:14] (03CR) 10Hashar: "Following that workaround I have filled bug 72837 : "Jenkins: migrate mediawiki-core-doxygen-publish to zuul cloner"" [integration/config] - 10https://gerrit.wikimedia.org/r/170386 (https://bugzilla.wikimedia.org/72826) (owner: 10BryanDavis) [14:34:42] (03PS5) 10Hashar: Migrate mw doxygen to zuul-cloner and Trusty [integration/config] - 10https://gerrit.wikimedia.org/r/166034 (https://bugzilla.wikimedia.org/46771) [14:34:43] 3Wikimedia / 3Continuous integration: mediawiki-core-doxygen-publish job needs mediawiki/vendor - 10https://bugzilla.wikimedia.org/72826#c3 (10Antoine "hashar" Musso (WMF)) Following that workaround I have filled bug 72837 : "Jenkins: migrate mediawiki-core-doxygen-publish to zuul cloner" Which is implement... [14:35:42] (03CR) 10Hashar: "Resolved conflict with https://gerrit.wikimedia.org/r/#/c/170386/ which added a git entry to clone vendor (was for fixing bug 72826 - "med" [integration/config] - 10https://gerrit.wikimedia.org/r/166034 (https://bugzilla.wikimedia.org/46771) (owner: 10Hashar) [14:46:43] 3Wikimedia / 3Continuous integration: Update doxygen from 1.7.x to 1.8.x on gallium - 10https://bugzilla.wikimedia.org/46771 (10Antoine "hashar" Musso (WMF)) [14:46:43] 3Wikimedia / 3Continuous integration: Jenkins: migrate mediawiki-core-doxygen-publish to zuul cloner - 10https://bugzilla.wikimedia.org/72837 (10Antoine "hashar" Musso (WMF)) [14:56:03] (03CR) 10Hashar: "Job updated:" [integration/config] - 10https://gerrit.wikimedia.org/r/166034 (https://bugzilla.wikimedia.org/46771) (owner: 10Hashar) [15:17:05] Project browsertests-CentralNotice-en.wikipedia.beta.wmflabs.org-linux-chrome-sauce build #1: FAILURE in 20 sec: https://integration.wikimedia.org/ci/job/browsertests-CentralNotice-en.wikipedia.beta.wmflabs.org-linux-chrome-sauce/1/ [15:27:00] (03PS1) 10Hashar: mwcore-docgen: drop TARGET_PROJECTDIR [integration/jenkins] - 10https://gerrit.wikimedia.org/r/173009 [15:27:42] (03CR) 10Hashar: [C: 032] mwcore-docgen: drop TARGET_PROJECTDIR [integration/jenkins] - 10https://gerrit.wikimedia.org/r/173009 (owner: 10Hashar) [15:27:44] (03Merged) 10jenkins-bot: mwcore-docgen: drop TARGET_PROJECTDIR [integration/jenkins] - 10https://gerrit.wikimedia.org/r/173009 (owner: 10Hashar) [15:45:00] (03PS1) 10Hashar: Make sure ZUUL_UUID is present when syncing doc [integration/config] - 10https://gerrit.wikimedia.org/r/173016 [15:45:16] (03PS6) 10Hashar: Migrate mw doxygen to zuul-cloner and Trusty [integration/config] - 10https://gerrit.wikimedia.org/r/166034 (https://bugzilla.wikimedia.org/46771) [15:55:02] (03PS7) 10Hashar: Migrate mw doxygen to zuul-cloner and Trusty [integration/config] - 10https://gerrit.wikimedia.org/r/166034 (https://bugzilla.wikimedia.org/46771) [16:07:26] (03PS1) 10Hashar: Link to ruby gems documentation [integration/docroot] - 10https://gerrit.wikimedia.org/r/173019 [16:08:10] (03CR) 10Hashar: [C: 032] "That will update https://doc.wikimedia.org/ :)" [integration/docroot] - 10https://gerrit.wikimedia.org/r/173019 (owner: 10Hashar) [16:08:12] (03Merged) 10jenkins-bot: Link to ruby gems documentation [integration/docroot] - 10https://gerrit.wikimedia.org/r/173019 (owner: 10Hashar) [16:10:12] (03CR) 10Hashar: [C: 032] "Jobs updated:" [integration/config] - 10https://gerrit.wikimedia.org/r/173016 (owner: 10Hashar) [16:13:56] (03Merged) 10jenkins-bot: Make sure ZUUL_UUID is present when syncing doc [integration/config] - 10https://gerrit.wikimedia.org/r/173016 (owner: 10Hashar) [16:14:32] (03PS1) 10Hashar: For ruby gems, only publish master doc [integration/config] - 10https://gerrit.wikimedia.org/r/173022 [16:16:28] (03CR) 10Hashar: [C: 032] "Changes merged in the env-abstraction-layer branch of mediawiki/selenium ended up overriding the documentation generated for the master br" [integration/config] - 10https://gerrit.wikimedia.org/r/173022 (owner: 10Hashar) [16:16:36] (03Merged) 10jenkins-bot: For ruby gems, only publish master doc [integration/config] - 10https://gerrit.wikimedia.org/r/173022 (owner: 10Hashar) [16:19:55] (03PS8) 10Hashar: Migrate mw doxygen to zuul-cloner and Trusty [integration/config] - 10https://gerrit.wikimedia.org/r/166034 (https://bugzilla.wikimedia.org/46771) [16:36:57] RECOVERY - CI: Low disk space on /var on labmon1001 is OK: OK: All targets OK [16:38:58] (03PS1) 10Hashar: Avoid cleaning doc when ZUUL_UUID is not set [integration/config] - 10https://gerrit.wikimedia.org/r/173028 [16:43:50] (03CR) 10Hashar: [C: 032] "Refreshed publish-doc" [integration/config] - 10https://gerrit.wikimedia.org/r/173028 (owner: 10Hashar) [16:47:11] (03Merged) 10jenkins-bot: Avoid cleaning doc when ZUUL_UUID is not set [integration/config] - 10https://gerrit.wikimedia.org/r/173028 (owner: 10Hashar) [17:15:49] hi James_F is it known that ?veaction=edit does nothing on beta labs right now. e.g. http://en.wikipedia.beta.wmflabs.org/wiki/0.36437403591400674?veaction=edit I don't see any js errors. [17:16:56] or with multiple args http://en.wikipedia.beta.wmflabs.org/wiki/Links_VisualEditor_Test?vehidebetadialog=true&veaction=edit [17:24:33] chrismcmahon: I see a 503 for the JS payload… [17:25:01] chrismcmahon: "http://bits.beta.wmflabs.org/en.wikipedia.beta.wmflabs.org/load.php?debug=false&lang=en-gb&modules=startup&only=scripts&skin=vector&*" [17:25:12] chrismcmahon: Looks like someone broke something in MW. [17:25:31] hrm, ok [17:25:56] (03PS1) 10Cscott: Experimental travis integration. [integration/config] - 10https://gerrit.wikimedia.org/r/173045 [17:26:48] (03PS1) 10Cscott: Add travis-set-env.sh helper for travis integration. [integration/jenkins] - 10https://gerrit.wikimedia.org/r/173046 [17:27:20] (03PS2) 10Cscott: Experimental travis integration. [integration/config] - 10https://gerrit.wikimedia.org/r/173045 [17:34:00] (03PS2) 10Cscott: Add travis-set-env.sh helper for travis integration. [integration/jenkins] - 10https://gerrit.wikimedia.org/r/173046 [17:35:49] (03PS1) 10Hashar: Zuul function to set DOC_PATH prefix (WIP) [integration/config] - 10https://gerrit.wikimedia.org/r/173049 [17:36:11] 3Wikimedia Labs / 3deployment-prep (beta): Bits broken on beta labs: ReferenceError: mw is not defined - 10https://bugzilla.wikimedia.org/73377 (10James Forrester) a:3None [17:39:55] (03PS1) 10Hashar: Add flake8 to integration/config [integration/config] - 10https://gerrit.wikimedia.org/r/173053 [17:40:11] (03PS2) 10Hashar: Zuul function to set DOC_PATH prefix (WIP) [integration/config] - 10https://gerrit.wikimedia.org/r/173049 [17:42:41] 3Wikimedia Labs / 3deployment-prep (beta): Bits broken on beta labs: ReferenceError: mw is not defined - 10https://bugzilla.wikimedia.org/73377#c3 (10etonkovidova) Failed to load resource: the server responded with a status of 503 (Service Unavailable) http://bits.beta.wmflabs.org/en.wikipedia.beta.wmflabs.o... [17:45:02] Project browsertests-Wikidata-SmokeTests-linux-firefox-sauce build #52: STILL FAILING in 28 min: https://integration.wikimedia.org/ci/job/browsertests-Wikidata-SmokeTests-linux-firefox-sauce/52/ [18:23:55] 3Wikimedia Labs / 3deployment-prep (beta): Bits broken on beta labs: ReferenceError: mw is not defined - 10https://bugzilla.wikimedia.org/73377#c4 (10Bryan Davis) Nov 13 18:22:44 deployment-mediawiki01 hhvm: #012Fatal error: Class undefined: ResourceLoaderTemplateModule in /srv/mediawiki/php-master/includes/... [18:25:34] Project browsertests-PageTriage-en.wikipedia.beta.wmflabs.org-linux-chrome-sauce build #226: FAILURE in 1 min 38 sec: https://integration.wikimedia.org/ci/job/browsertests-PageTriage-en.wikipedia.beta.wmflabs.org-linux-chrome-sauce/226/ [18:28:04] bd808: does that mean it's an HHVM fatal? [18:28:17] yup [18:28:29] caused by RL somehow [18:28:51] git grep ResourceLoaderTemplateModule returns nothing in core [18:29:47] https://github.com/wikimedia/mediawiki-extensions-ZeroBanner/blob/a3febadd1b63f92cafd9ef84459fd5b010312e8f/ZeroBanner.php#L84 [18:32:08] Not beta's fault that it found broken code. :) [18:32:10] 3Wikimedia Labs / 3deployment-prep (beta): Bits broken on beta labs: ReferenceError: mw is not defined - 10https://bugzilla.wikimedia.org/73377#c5 (10Bryan Davis) This commit is breaking ZeroBanner This commit is breaking ZeroBanner [18:33:04] Now, the real problem is why did nobody else take the time to look at the mother fucking error logs! [18:33:43] bd808: yay! [18:33:47] Project browsertests-MultimediaViewer-en.wikipedia.beta.wmflabs.org-os_x_10.9-safari-sauce build #282: FAILURE in 1 min 43 sec: https://integration.wikimedia.org/ci/job/browsertests-MultimediaViewer-en.wikipedia.beta.wmflabs.org-os_x_10.9-safari-sauce/282/ [18:36:20] mid-air collisions can go to hell [18:37:43] < mr_hat> mid-air collisions: you got to hell. you go to hell and you die [18:38:30] =:) [18:38:40] huh, unintentional neat looking smiley [18:39:25] I dub it the Mr T smiley. I pity the fool who doesn't smile at that. [18:39:34] * bd808 needs to sleep more? [18:39:59] bd808: yes and yes? [18:40:37] greg-g: re: GCI, IMO it's mostly just bad timing. one one hand we're addressing lots of technical debt with rubocop and refactoring, and those take some significant experience to do well. otoh we also are working with new and newish repos like CentralNotice, ongoing Flow stuff, that professor from the midwest. [18:41:03] so it's just a bad environment for newbies right now [18:41:18] * greg-g nods [18:41:19] yeah [18:42:06] If they'd ever get reviewed and merged there are a zillion puppet3 style fixes needed in operations/puppet [18:42:23] greg-g: zeljko had the professor working in the AFTv5 repo because it's stale. oh, and Rummana, speaking of newbies [18:43:23] oh, I figured she'd be working on VE stuff [18:44:18] greg-g: yeah, but I'd rather work with Rummana than a GCI intern [18:44:26] given my choice of newbies [18:44:33] totally [18:45:29] greg-g: and even then, was in the middle of something with Rummana when all the iframes disappeared :-) which is a drag for e.g. a high school kid, having to deal with architecture changes on the fly [18:48:38] marxarelli: ah, you're here. you're about to talk about image-based regression testing I think. just fyi, Zeljko did some experimenting with Sikuli at one point, I know we can run that [18:50:45] marxarelli: https://bugzilla.wikimedia.org/show_bug.cgi?id=54393 we wanted it for typing exotic characters, but it ended up not being useful and was ultimately removed later [18:53:44] Project browsertests-Flow-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #353: FAILURE in 19 min: https://integration.wikimedia.org/ci/job/browsertests-Flow-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce/353/ [18:56:33] chrismcmahon: looks fun. this is more for (broad stroke) regression testing though [18:58:43] marxarelli: yeah, I know it's possible to do e.g. CSS regression testing by comparing pixel-by-pixel. I've seen it done but never done it in anger myself. If we were to do that I would want a funded mandate for it, it needs framework. [18:59:22] which does not exist today [18:59:23] chrismcmahon: believe me, i'm not going to promise anything. just exploring :) [18:59:27] Project browsertests-CirrusSearch-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #267: FAILURE in 2 min 47 sec: https://integration.wikimedia.org/ci/job/browsertests-CirrusSearch-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce/267/ [19:00:26] marxarelli: here's a cool case: https://78462f86-a-fe558111-s-sites.googlegroups.com/a/harryrobinson.net/www/exploratory-automation.pdf?attachauth=ANoY7cr120xdGrr3ssL5uyPDRBv1NM7rZtUm8bbfNYvmysry3btMhqKyi4GjJw2MjdUvQoCkN3Iu8ERkwmgbFguQziOJrBMKk8oCAJJyD9ms-FhaLcln9XBySP2jzDJ79aLFJ9wnQHCM-NDvdobDiwr_OmYIzVuJT7sECBy2kkkMPh2nX87qJ4r6kIeTXsVBK8xY-ZnPOHPxh5q_7hMCh9GXriK86xLoL6fFAGeGxsqc9hOT0FHR9L8%3D&attredirects=0 [19:14:49] Project browsertests-Core-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #291: FAILURE in 19 min: https://integration.wikimedia.org/ci/job/browsertests-Core-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce/291/ [19:16:43] Project browsertests-Flow-en.wikipedia.beta.wmflabs.org-linux-chrome-monobook-sauce build #113: FAILURE in 17 min: https://integration.wikimedia.org/ci/job/browsertests-Flow-en.wikipedia.beta.wmflabs.org-linux-chrome-monobook-sauce/113/ [19:25:45] huh. did we just re-do the whole appearance of Special:Preferences? seems so... [19:31:16] Project browsertests-Echo-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #183: FAILURE in 14 min: https://integration.wikimedia.org/ci/job/browsertests-Echo-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce/183/ [19:36:19] chrismcmalunch: looks like not on purpose [19:39:28] (03PS3) 10Dduvall: Strict configuration lookup [selenium] (env-abstraction-layer) - 10https://gerrit.wikimedia.org/r/172905 [19:40:22] (03CR) 10Dduvall: [C: 032] Strict configuration lookup [selenium] (env-abstraction-layer) - 10https://gerrit.wikimedia.org/r/172905 (owner: 10Dduvall) [19:40:33] (03PS3) 10Dduvall: Reimplemented API helper [selenium] (env-abstraction-layer) - 10https://gerrit.wikimedia.org/r/172906 [19:44:41] greg-g: "not on purpose"? [19:46:45] (03CR) 10QChris: [C: 031] "(I have CR+2, but I guess I should leave merging to others?)" [integration/config] - 10https://gerrit.wikimedia.org/r/172954 (owner: 10Hashar) [19:48:39] Project browsertests-Flow-en.wikipedia.beta.wmflabs.org-linux-chrome-sauce build #322: FAILURE in 17 min: https://integration.wikimedia.org/ci/job/browsertests-Flow-en.wikipedia.beta.wmflabs.org-linux-chrome-sauce/322/ [19:49:42] 3Wikimedia Labs / 3deployment-prep (beta): request administrator rights on metawiki beta for user Jmorgan (WMF) - 10https://bugzilla.wikimedia.org/73382 (10Jonathan Morgan) 3NEW p:3Unprio s:3normal a:3None Hi, can I get administrator rights on http://meta.wikimedia.beta.wmflabs.org/ ? This account wi... [19:54:42] 3Wikimedia Labs / 3deployment-prep (beta): request administrator rights on metawiki beta for user Jmorgan (WMF) - 10https://bugzilla.wikimedia.org/73382#c1 (10John F. Lewis) 5NEW>3RESO/FIX a:3John F. Lewis Done. [19:57:47] chrismcmahon: yeah, due to bits breakage previously seen [20:01:11] (03PS4) 10Dduvall: Reimplemented API helper [selenium] (env-abstraction-layer) - 10https://gerrit.wikimedia.org/r/172906 [20:01:34] bad day for beta labs :-) [20:02:40] sucks when someone breaks the build :) [20:02:56] we need a "blame" mode for beta :) [20:03:52] i.e. small set of smoke tests that triggers that triggers `git blame` runs followed by public shaming [20:04:26] it died again today? [20:04:41] marxarelli: e.g. https://integration.wikimedia.org/ci/job/browsertests-Core-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce/ [20:04:43] YuviPanda: not it, the code people put on it [20:04:57] big difference [20:05:00] ie: it did it's job [20:05:00] aaah :) [20:06:13] chrismcmahon: right ... still missing the public shaming aspect though :) [20:06:44] Project browsertests-WikiLove-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #258: FAILURE in 4 min 29 sec: https://integration.wikimedia.org/ci/job/browsertests-WikiLove-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce/258/ [20:06:51] YuviPanda: unexpected browser test failure for VE pointed to Template pointed to HHVM pointed to Mobile pointed to deprecated shared code (or something like that, not sure I followed the whole thing). and then bits is 503 on [20:07:02] beta labs [20:08:27] Project browsertests-VisualEditor-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #406: FAILURE in 34 min: https://integration.wikimedia.org/ci/job/browsertests-VisualEditor-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce/406/ [20:08:48] yeah yeah yeah, thanks Jenkins [20:12:30] Yippee, build fixed! [20:12:31] Project browsertests-CirrusSearch-test2.wikipedia.org-linux-firefox-sauce build #260: FIXED in 4 min 2 sec: https://integration.wikimedia.org/ci/job/browsertests-CirrusSearch-test2.wikipedia.org-linux-firefox-sauce/260/ [20:12:45] heh :) [20:14:14] Project browsertests-PageTriage-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #226: FAILURE in 1 min 43 sec: https://integration.wikimedia.org/ci/job/browsertests-PageTriage-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce/226/ [20:14:40] 3Wikimedia Labs / 3deployment-prep (beta): request administrator rights on metawiki beta for user Jmorgan (WMF) - 10https://bugzilla.wikimedia.org/73382#c2 (10Jonathan Morgan) Thank you, John! [20:19:57] Project browsertests-Echo-en.wikipedia.beta.wmflabs.org-linux-chrome-sauce build #166: FAILURE in 13 min: https://integration.wikimedia.org/ci/job/browsertests-Echo-en.wikipedia.beta.wmflabs.org-linux-chrome-sauce/166/ [20:21:16] ohai shinken-wm [20:25:08] anyone know why i'm getting a 503 on http://bits.beta.wmflabs.org/en.wikipedia.beta.wmflabs.org/load.php?debug=false&lang=en&modules=startup&only=scripts&skin=vector&* ? [20:26:20] cscott: yes. https://bugzilla.wikimedia.org/show_bug.cgi?id=73377 [20:27:27] chrismcmahon: thanks. it looks like i can safely ignore this, then, Top Men are working on it and will make sure it doesn't get to production? [20:30:03] cscott: that's my understanding. that TemplateThingie brought down HHVM which brought down bits, I think the last fix just got merged [20:30:19] cool, thanks. [20:30:27] might need to tweak HHVM or something, I'm not sure [20:30:57] last time i ignored a problem in beta it turned out there was an API deprecation and OCG stopped working in production two weeks later. so i'm more careful to find the root cause of beta breakage now. [20:31:43] cscott: yeah, I think there is still something funny going on, but people are working on it [20:34:38] where people == jon and jeff, per that bug [20:41:25] 3Wikimedia Labs / 3deployment-prep (beta): deployment-parsoidcache02 is not using betalabs puppetmaster - 10https://bugzilla.wikimedia.org/73357 (10Greg Grossmeier) p:5Unprio>3Normal [21:11:18] greg-g: is mmodel around today? bunch of unrelated to previous thing puppet failures on beta http://shinken.wmflabs.org/problems [21:29:01] Project browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce build #329: FAILURE in 1 hr 34 min: https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce/329/ [21:30:17] twentyafterfour: ^ [21:30:24] YuviPanda: mmodell == twentyafterfour [21:31:03] here [21:33:30] Project browsertests-PdfHandler-test2.wikipedia.org-linux-firefox-sauce build #198: FAILURE in 4 min 27 sec: https://integration.wikimedia.org/ci/job/browsertests-PdfHandler-test2.wikipedia.org-linux-firefox-sauce/198/ [21:36:40] I don't have access to http://shinken.wmflabs.org/problems [21:42:37] YuviPanda: ^ [21:58:20] (03PS3) 10Hashar: Function to set DOC_PATH prefix on publish jobs [integration/config] - 10https://gerrit.wikimedia.org/r/173049 [22:00:19] twentyafterfour: guest/guest [22:02:23] (03CR) 10Hashar: [C: 032] "Job created:" [integration/config] - 10https://gerrit.wikimedia.org/r/173053 (owner: 10Hashar) [22:05:11] twentyafterfour: it's not actually real auth :) [22:05:40] (03Merged) 10jenkins-bot: Add flake8 to integration/config [integration/config] - 10https://gerrit.wikimedia.org/r/173053 (owner: 10Hashar) [22:06:23] YuviPanda: I don't know what "CRITICAL: 100.00% of data above the critical threshold [0.0]" means... is that the failure you were talking about? [22:07:30] (03CR) 10Hashar: "recheck" [integration/config] - 10https://gerrit.wikimedia.org/r/173049 (owner: 10Hashar) [22:08:33] (03CR) 10Hashar: "recheck" [integration/config] - 10https://gerrit.wikimedia.org/r/173049 (owner: 10Hashar) [22:09:35] (03CR) 10Hashar: "The child change https://gerrit.wikimedia.org/r/#/c/173049/ passed flake8 \O/ https://integration.wikimedia.org/ci/job/integration-config-" [integration/config] - 10https://gerrit.wikimedia.org/r/173053 (owner: 10Hashar) [22:12:26] (03PS4) 10Hashar: Function to set DOC_SUBPATH on publish jobs [integration/config] - 10https://gerrit.wikimedia.org/r/173049 [22:13:15] twentyafterfour: yup [22:13:18] twentyafterfour: that means puppet failure [22:13:22] very descriptive failure [22:17:11] Project browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #364: FAILURE in 2 hr 2 min: https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-firefox-sauce/364/ [22:47:35] 3Wikimedia Labs / 3deployment-prep (beta): deployment-parsoidcache02 is not using betalabs puppetmaster - 10https://bugzilla.wikimedia.org/73357#c1 (10Antoine "hashar" Musso (WMF)) 5NEW>3ASSI a:3Antoine "hashar" Musso (WMF) Indeed: deployment-parsoidcache02:~$ grep server /etc/puppet/puppet.conf serve... [22:54:00] (03CR) 10Hashar: "Added Timo and Greg for information. Have to actually test it, maybe I will sneak this patch in prod during european morning and see what" [integration/config] - 10https://gerrit.wikimedia.org/r/173049 (owner: 10Hashar) [23:04:27] 3Wikimedia Labs / 3deployment-prep (beta): deployment-parsoidcache02 is not using betalabs puppetmaster - 10https://bugzilla.wikimedia.org/73357#c2 (10Antoine "hashar" Musso (WMF)) I have upgraded varnish while at it (apt-get upgrade + restart of the varnish* services): Unpacking varnish (3.0.6plus~x-wm3)... [23:08:32] (03CR) 10Hashar: "The Jenkins job configuration can be done by whoever is in the wmf ldap group, but the Zuul configuration deployment needs to be done manu" [integration/config] - 10https://gerrit.wikimedia.org/r/172954 (owner: 10Hashar) [23:36:19] 3Wikimedia Labs / 3deployment-prep (beta): deployment-parsoidcache02 is not using betalabs puppetmaster - 10https://bugzilla.wikimedia.org/73357#c3 (10Antoine "hashar" Musso (WMF)) 5ASSI>3RESO/FIX deployment-parsoidcache02 is now using betalabs puppetmaster and salt master. Varnish has been upgraded. I... [23:53:39] Project browsertests-Echo-test2.wikipedia.org-linux-firefox-sauce build #163: FAILURE in 23 min: https://integration.wikimedia.org/ci/job/browsertests-Echo-test2.wikipedia.org-linux-firefox-sauce/163/