Bug 662234

Summary:	dev-python/pypy order during test phase
Product:	Gentoo Linux	Reporter:	Alexey <alexey+gentoo>
Component:	Current packages	Assignee:	Python Gentoo Team <python>
Status:	UNCONFIRMED ---
Severity:	normal	CC:	jstein
Priority:	Normal	Keywords:	TESTFAILURE
Version:	unspecified
Hardware:	All
OS:	Linux
Whiteboard:
Package list:		Runtime testing required:	---
Attachments:	emerge --info

Description Alexey 2018-07-27 07:39:01 UTC

Created attachment 541190 [details]
emerge --info

I have these pythons enabled:
*/* PYTHON_TARGETS: python3_6 python3_5 python2_7 pypy3
*/* PYTHON_SINGLE_TARGET: -* python3_6

I also enabled FEATURES="test", and python packages often fail the test now. All pythons are tested, but pypy3 is tested first (probably because it's alphabetically before "python"), and if it fails, the build aborts.

pypy generally fails more than cpython, so I don't know whether test failure is related to pypy, or not. So I can mistakenly mark bug reports (e.g. https://bugs.gentoo.org/662232) as related to pypy3 while it's not.

How feasible is it to reverse the order in which pythons are tested? Or test all of them regardless of whether any previous python failed; this could even be done in parallel. That way I can know for sure in my bug reports which package fails on pypy only, and which fail on every python.

Comment 1 Alexey 2018-07-27 07:41:10 UTC

Note about the linked bug: I don't actually know whether it's pypy-only, and I have no way to check, unless I disable pypy3 for the package, which would lead to many other changes in my use flags because of dependencies.