Gentoo Websites Logo
Go to: Gentoo Home Documentation Forums Lists Bugs Planet Store Wiki Get Gentoo!
Bug 449748 - dev-python/nose: nosetests multiprocessing fragile on pypy
Summary: dev-python/nose: nosetests multiprocessing fragile on pypy
Status: RESOLVED OBSOLETE
Alias: None
Product: Gentoo Linux
Classification: Unclassified
Component: Current packages (show other bugs)
Hardware: All Linux
: Normal normal (vote)
Assignee: Python Gentoo Team
URL:
Whiteboard:
Keywords:
Depends on:
Blocks:
 
Reported: 2013-01-02 10:53 UTC by Michał Górny
Modified: 2016-02-03 09:07 UTC (History)
1 user (show)

See Also:
Package list:
Runtime testing required: ---


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Michał Górny archtester Gentoo Infrastructure gentoo-dev Security 2013-01-02 10:53:13 UTC
dev-python/nose tries hard to run tests faster using multiprocessing. But to be honest, this is rather fragile and I don't really feel like it's helpful.

Most importantly, pypy fails all the way with it. It seems that thanks to it, the JIT warm-up problem is even worse, and the reaping is so delayed that it's easy to run out of memory.

Also, it seems not really expected with our distutils-r1 parallel builds. That probably depends on the test suite, but with nosetests one it's even easier to run out of memory and the timeouts are easy to hit as well.

I wonder if we shouldn't just disable that thing globally.
Comment 1 Mike Gilbert gentoo-dev 2013-01-02 16:15:54 UTC
By "globally", do you mean adding --processes=1 to ebuilds? Or creating some wrapper function to do it? Or what?
Comment 2 Michał Górny archtester Gentoo Infrastructure gentoo-dev Security 2013-01-02 19:59:50 UTC
(In reply to comment #1)
> By "globally", do you mean adding --processes=1 to ebuilds? Or creating some
> wrapper function to do it? Or what?

I was more thinking of either modifying the package or adding some global configuration file. At least for pypy, if feasible.
Comment 3 Justin Lecher (RETIRED) gentoo-dev 2016-02-03 09:06:58 UTC
commit 103f27857659150cd7b94a8d31ee8dd96b6ff5b6
Author: Justin Lecher <jlec@gentoo.org>
Date:   Wed Feb 3 09:34:20 2016 +0100

    dev-python/nose: Drop old

    obsoletes:

    Gentoo-Bug: https://bugs.gentoo.org/show_bug.cgi?id=449748
    Gentoo-Bug: https://bugs.gentoo.org/show_bug.cgi?id=449748
    Gentoo-Bug: https://bugs.gentoo.org/show_bug.cgi?id=462126
    Gentoo-Bug: https://bugs.gentoo.org/show_bug.cgi?id=466080
    Gentoo-Bug: https://bugs.gentoo.org/show_bug.cgi?id=485022

    Package-Manager: portage-2.2.27
    Signed-off-by: Justin Lecher <jlec@gentoo.org>

    https://gitweb.gentoo.org/repo/gentoo.git/commit/?id=103f27857659150cd7b94a8d31ee8dd96b6ff5b6
Comment 4 Justin Lecher (RETIRED) gentoo-dev 2016-02-03 09:07:03 UTC
commit 103f27857659150cd7b94a8d31ee8dd96b6ff5b6
Author: Justin Lecher <jlec@gentoo.org>
Date:   Wed Feb 3 09:34:20 2016 +0100

    dev-python/nose: Drop old

    obsoletes:

    Gentoo-Bug: https://bugs.gentoo.org/show_bug.cgi?id=449748
    Gentoo-Bug: https://bugs.gentoo.org/show_bug.cgi?id=449748
    Gentoo-Bug: https://bugs.gentoo.org/show_bug.cgi?id=462126
    Gentoo-Bug: https://bugs.gentoo.org/show_bug.cgi?id=466080
    Gentoo-Bug: https://bugs.gentoo.org/show_bug.cgi?id=485022

    Package-Manager: portage-2.2.27
    Signed-off-by: Justin Lecher <jlec@gentoo.org>

    https://gitweb.gentoo.org/repo/gentoo.git/commit/?id=103f27857659150cd7b94a8d31ee8dd96b6ff5b6