[00:00:31] trying to run our tests in FF in xvfb was ludicrous, we destroyed gallium trying that [00:00:38] :( [00:00:48] chrismcmahon: I smell a proposal, yes? :) [00:01:16] I made every developer workstation in our office a jenkins slave for overnight testing. :) [00:01:31] what is this "workstation" thing you mention? [00:01:40] w00t. moar powarrr [00:01:52] We had a virtualbox vm that hooked up to the master and provided a test paltform [00:02:32] It didn't mess with anything outside the vm so nobody cared. [00:03:01] greg-g: The are the thing that people buy because they cost 1/2 of what a laptop costs and are generally faster [00:03:04] I think tests are bogging, but I have 4 now using resources but not yet failing [00:03:34] bd808: oh, you mean gaming machines [00:03:43] :) [00:09:47] bd808|BUFFER: fwiw, I threw a long-ass CirrusSearch test into the mix, is running now [00:29:12] bd808|BUFFER: greg-g interesting: https://saucelabs.com/tests/801da5035cc942f69b1b07ab477c345e [00:29:45] don't think I've ever seen that one before [00:30:08] bd808|BUFFER: greg-g upload hung for MF https://saucelabs.com/tests/696306e9277e4704b44c59a769e3cd44 [00:47:09] (03CR) 10jenkins-bot: [V: 04-1] Sort the email_filter literal [integration/zuul-config] - 10https://gerrit.wikimedia.org/r/151250 (owner: 10Awight) [00:47:19] (03CR) 10jenkins-bot: [V: 04-1] Use the verbose re flag to unminify the email_filter [integration/zuul-config] - 10https://gerrit.wikimedia.org/r/151249 (owner: 10Awight) [08:34:05] can someone comment on https://gerrit.wikimedia.org/r/#/c/147173/1 about ignoring directories [12:45:03] https://integration.wikimedia.org/zuul/ everything seems to be stuck [12:51:09] 3Wikimedia / 3Continuous integration: Jenkins/Zuul something stuck - 10https://bugzilla.wikimedia.org/69045 (10Niklas Laxström) 3NEW p:3Unprio s:3major a:3None https://integration.wikimedia.org/zuul/ it's not processing my Translate jobs currently. [13:44:12] Sob. https://stackoverflow.com/a/12434924 [13:49:57] What should I do when a single test has been running for 100+ min with ever-growing memory consumed? strace doesn't tell much if anything [13:50:01] PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND [13:50:04] 26567 vagrant 20 0 5907904 4.282g 28184 R 116.9 54.9 105:47.87 php phpunit.php [13:57:52] I usually hack the MediaWikiFooBarTestRunner.php to print name of the test it is executing to figure out which one it is [13:58:18] Nikerabbit: it's enough to use --debug (or --verbose?) for that [13:58:24] (now doing) [13:58:26] tests should have timeouts [13:58:32] is it not working for you [13:58:40] "it" what [14:02:22] (I also had tried --tap, but then phpunit crashed with "Stack overflow", pasted earlier on) [14:08:53] 3Wikimedia / 3Continuous integration: Jenkins/Zuul something stuck - 10https://bugzilla.wikimedia.org/69045 (10Antoine "hashar" Musso) a:3Antoine "hashar" Musso [14:10:23] 3Wikimedia / 3Continuous integration: Jenkins/Zuul something stuck - 10https://bugzilla.wikimedia.org/69045#c1 (10Antoine "hashar" Musso) 5NEW>3RESO/DUP That is Bug 63760 - Jobs are sometime no more being triggered by Zuul / Jenkins Will spend sometime investigating and report there then reboot the serv... [14:10:23] 3Wikimedia / 3Continuous integration: Jobs are sometime no more being triggered by Zuul / Jenkins - 10https://bugzilla.wikimedia.org/63760#c10 (10Antoine "hashar" Musso) *** Bug 69045 has been marked as a duplicate of this bug. *** [14:14:03] Starting test 'DonationInterface_Adapter_GlobalCollect_GlobalCollectTestCase::testGCFormLoad'. [14:14:06] Maybe that's it [14:21:22] 3Wikimedia / 3Continuous integration: Jenkins/Zuul something stuck - 10https://bugzilla.wikimedia.org/69045#c2 (10Krinkle) I depooled/repooled the jenkins slave on gallium, but that didn't help. Also restarted Jenkins to no avail. Finally did a force stop/start of zuul and that brought it back. [14:29:57] 3Wikimedia / 3Continuous integration: Jenkins/Zuul something stuck - 10https://bugzilla.wikimedia.org/69045#c3 (10Antoine "hashar" Musso) Timo restarted Zuul :) [14:35:22] 3Wikimedia / 3Continuous integration: jenkins-bot just posted FAILURE - 10https://bugzilla.wikimedia.org/60624#c3 (10Antoine "hashar" Musso) 5NEW>3RESO/INV Sorry this bug is too old, we have no log anymore for January. Potentially it was a manual test to ensure some connection. Zuul has no code path I... [23:10:24] (03PS1) 10Legoktm: Add tox (flake8) job for pywikibot/bots/CommonsDelinker [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/151365 [23:16:10] (03PS1) 10Legoktm: zuul config for pywikibot-bots-CommonsDelinker-tox-flake8 job (nonvoting) [integration/zuul-config] - 10https://gerrit.wikimedia.org/r/151366