Created attachment 541190 [details]
I have these pythons enabled:
*/* PYTHON_TARGETS: python3_6 python3_5 python2_7 pypy3
*/* PYTHON_SINGLE_TARGET: -* python3_6
I also enabled FEATURES="test", and python packages often fail the test now. All pythons are tested, but pypy3 is tested first (probably because it's alphabetically before "python"), and if it fails, the build aborts.
pypy generally fails more than cpython, so I don't know whether test failure is related to pypy, or not. So I can mistakenly mark bug reports (e.g. https://bugs.gentoo.org/662232) as related to pypy3 while it's not.
How feasible is it to reverse the order in which pythons are tested? Or test all of them regardless of whether any previous python failed; this could even be done in parallel. That way I can know for sure in my bug reports which package fails on pypy only, and which fail on every python.
Note about the linked bug: I don't actually know whether it's pypy-only, and I have no way to check, unless I disable pypy3 for the package, which would lead to many other changes in my use flags because of dependencies.