Bug 529924 – dev-python/pytest-2.6.4 - Tests hang with pypy3

• Product: Gentoo Linux
• Status: RESOLVED INVALID

[Description Paolo Pedroni 2014-11-20 10:18:18 UTC]

Created attachment 389840 [details]
pytest-2.6.4:20141120-095242.log.gz

Since I like to experiment I have PYTHON_TARGETS="python2_7 python3_4 pypy pypy3" in my /etc/portage/make.conf.

Today dev-python/pytest enable the python_targets_pypy3 USE flag and I tried to emerge it, but it hangs at the pypy3 portion of the tests. The last thing I see at the console is:

SKIP [1] /var/tmp/portage/dev-python/pytest-2.6.4/work/pytest-2.6.4/testing/test_parseopt.py:247: need to be run with py.test executable, not /var/tmp/portage/dev-python/pytest-2.6.4/work/pytest-2.6.4-pypy/lib/pytest.py
SKIP [1] /var/tmp/portage/dev-python/pytest-2.6.4/work/pytest-2.6.4/testing/test_unittest.py:340: could not import 'twisted.trial.unittest'
SKIP [1] /var/tmp/portage/dev-python/pytest-2.6.4/work/pytest-2.6.4/testing/conftest.py:117: no suitable python2.6 found
SKIP [1] /var/tmp/portage/dev-python/pytest-2.6.4/work/pytest-2.6.4/testing/python/integration.py:136: could not import 'mock'
SKIP [1] /var/tmp/portage/dev-python/pytest-2.6.4/work/pytest-2.6.4-pypy/lib/_pytest/core.py:142: plugin 'xdist' is missing
SKIP [11] /var/tmp/portage/dev-python/pytest-2.6.4/work/pytest-2.6.4/testing/test_runner.py:296: could not import 'xdist.plugin'
SKIP [1] /var/tmp/portage/dev-python/pytest-2.6.4/work/pytest-2.6.4/testing/python/integration.py:116: could not import 'unittest.mock'
SKIP [1] /var/tmp/portage/dev-python/pytest-2.6.4/work/pytest-2.6.4/testing/test_unittest.py:327: could not import 'twisted.trial.unittest'
SKIP [1] /var/tmp/portage/dev-python/pytest-2.6.4/work/pytest-2.6.4/testing/python/integration.py:166: could not import 'mock'
SKIP [4] /var/tmp/portage/dev-python/pytest-2.6.4/work/pytest-2.6.4/testing/test_unittest.py:367: could not import 'twisted.trial.unittest'
SKIP [1] /var/tmp/portage/dev-python/pytest-2.6.4/work/pytest-2.6.4/testing/python/integration.py:102: could not import 'unittest.mock'
SKIP [1] /var/tmp/portage/dev-python/pytest-2.6.4/work/pytest-2.6.4/testing/test_unittest.py:353: could not import 'twisted.trial.unittest'
SKIP [1] /var/tmp/portage/dev-python/pytest-2.6.4/work/pytest-2.6.4-pypy/lib/_pytest/skipping.py:142: condition: sys.version_info < (2,5) or '__pypy__' in sys.builtin_module_names or sys.platform.startswith('java')
SKIP [14] /var/tmp/portage/dev-python/pytest-2.6.4/work/pytest-2.6.4-pypy/lib/_pytest/pytester.py:532: pypy-64 bit not supported
SKIP [1] /var/tmp/portage/dev-python/pytest-2.6.4/work/pytest-2.6.4-pypy/lib/_pytest/skipping.py:142: condition: "__pypy__" in sys.modules
SKIP [1] /var/tmp/portage/dev-python/pytest-2.6.4/work/pytest-2.6.4/testing/python/integration.py:188: could not import 'mock'
SKIP [1] /var/tmp/portage/dev-python/pytest-2.6.4/work/pytest-2.6.4-pypy/lib/_pytest/skipping.py:142: condition: sys.version_info >= (2,6)
SKIP [1] /var/tmp/portage/dev-python/pytest-2.6.4/work/pytest-2.6.4-pypy/lib/_pytest/skipping.py:142: packages without __init__.py not supported on python 2
SKIP [1] /var/tmp/portage/dev-python/pytest-2.6.4/work/pytest-2.6.4/testing/conftest.py:117: no suitable python3.3 found
SKIP [1] /var/tmp/portage/dev-python/pytest-2.6.4/work/pytest-2.6.4/testing/test_unittest.py:314: could not import 'twisted.trial.unittest'
XPASS testing/test_doctest.py::TestDoctests::()::test_simple_doctestfile pypy leaks one FD

====================================== 1080 passed, 46 skipped, 12 xfailed, 1 xpassed in 350.78 seconds =======================================

That is the summary of the pypy tests.

This is what I get from "ps af" after more than 15 minutes staring at the screen:

$ ps af
  PID TTY      STAT   TIME COMMAND
25236 tty7     Ssl+   3:29 /usr/bin/X -br -novtswitch -quiet :0 vt7 -nolisten tcp -auth /var/run/xauth/A:0-buVsxb
32063 pts/6    Ss     0:00 /bin/bash
32136 pts/6    R+     0:00  \_ ps af
22923 pts/5    Ss     0:00 /bin/bash
30237 pts/5    S+     0:00  \_ ssh paolop2
 4207 pts/4    Ss     0:00 /bin/bash
 4253 pts/4    S+     0:00  \_ ssh mediacenter
 4095 pts/2    Ss     0:00 /bin/bash
 4129 pts/2    S+     0:00  \_ ssh paolop
 4051 pts/1    Ss     0:00 /bin/bash
27521 pts/1    S+     0:00  \_ sudo emerge -1v pytest
27523 pts/1    S+     0:38      \_ /usr/bin/python3.4 -b /usr/lib/python-exec/python3.4/emerge -1v pytest
28259 pts/1    S+     0:00          \_ [dev-python/pytest-2.6.4] sandbox /usr/lib/portage/python3.4/ebuild.sh test
28261 pts/1    S+     0:00              \_ /bin/bash /usr/lib/portage/python3.4/ebuild.sh test
28278 pts/1    S+     0:00                  \_ /bin/bash /usr/lib/portage/python3.4/ebuild.sh test
28313 pts/1    S+     0:00                      \_ tee -a /var/tmp/portage/dev-python/pytest-2.6.4/temp/build-pypy3.log
28320 pts/1    S+     0:00                      \_ /bin/bash /usr/lib/portage/python3.4/ebuild.sh test
28417 pts/1    S+     0:47                          \_ /usr/bin/pypy3 /var/tmp/portage/dev-python/pytest-2.6.4/work/pytest-2.6.4-pypy3/lib/pytest.py --ignore=doc/en/example/nonpython/test_simple.yml
32162 tty2     Ss+    0:00 /sbin/mingetty --noclear tty2
19225 tty3     Ss+    0:00 /sbin/mingetty --noclear tty3
31276 tty4     Ss+    0:00 /sbin/mingetty --noclear tty4
30351 tty5     Ss+    0:00 /sbin/mingetty --noclear tty5

# emerge --info =dev-python/pytest-2.6.4
Portage 2.2.14 (python 3.4.2-final-0, default/linux/amd64/13.0/desktop/kde/systemd, gcc-4.8.3, glibc-2.19-r1, 3.18.0-rc5 x86_64)
=================================================================
                         System Settings
=================================================================
System uname: Linux-3.18.0-rc5-x86_64-AMD_Phenom-tm-_II_X6_1100T_Processor-with-gentoo-2.2
KiB Mem:    12027380 total,    236716 free
KiB Swap:    8643068 total,   8637544 free
Timestamp of tree: Thu, 20 Nov 2014 08:15:01 +0000
ld GNU gold (Gentoo 2.24 p1.4 2.24) 1.11
distcc 3.1 x86_64-pc-linux-gnu [enabled]
ccache version 3.1.9 [disabled]
app-shells/bash:          4.3_p30-r1
dev-java/java-config:     2.2.0
dev-lang/perl:            5.20.1-r2
dev-lang/python:          2.7.7, 3.4.2
dev-util/ccache:          3.1.9-r3
dev-util/cmake:           2.8.12.2-r1
dev-util/pkgconfig:       0.28-r1
sys-apps/baselayout:      2.2
sys-apps/openrc:          0.12.4
sys-apps/sandbox:         2.6-r1
sys-devel/autoconf:       2.69
sys-devel/automake:       1.11.6-r1, 1.13.4
sys-devel/binutils:       2.24-r3
sys-devel/gcc:            4.8.3
sys-devel/gcc-config:     1.7.3
sys-devel/libtool:        2.4.2-r1
sys-devel/make:           4.0-r1
sys-kernel/linux-headers: 3.16 (virtual/os-headers)
sys-libs/glibc:           2.19-r1
Repositories: gentoo x-portage
ACCEPT_KEYWORDS="amd64"
ACCEPT_LICENSE="* -@EULA"
CBUILD="x86_64-pc-linux-gnu"
CFLAGS="-O2 -pipe -march=amdfam10 -msahf -mlzcnt -mpopcnt --param l1-cache-size=64 --param l1-cache-line-size=64 --param l2-cache-size=512 -flto=7 -fuse-linker-plugin -floop-interchange -floop-strip-mine -floop-block -fgraphite-identity"
CHOST="x86_64-pc-linux-gnu"
CONFIG_PROTECT="/etc /usr/share/config /usr/share/gnupg/qualified.txt /var/lib/hsqldb"
CONFIG_PROTECT_MASK="/etc/ca-certificates.conf /etc/env.d /etc/fonts/fonts.conf /etc/gconf /etc/gentoo-release /etc/revdep-rebuild /etc/sandbox.d /etc/terminfo"
CXXFLAGS="-O2 -pipe -march=amdfam10 -msahf -mlzcnt -mpopcnt --param l1-cache-size=64 --param l1-cache-line-size=64 --param l2-cache-size=512 -flto=7 -fuse-linker-plugin -floop-interchange -floop-strip-mine -floop-block -fgraphite-identity"
DISTDIR="/usr/portage/distfiles"
EMERGE_DEFAULT_OPTS="--keep-going y --with-bdeps y"
FCFLAGS="-O2 -pipe"
FEATURES="assume-digests binpkg-logs compress-build-logs config-protect-if-modified distcc distlocks ebuild-locks merge-sync news parallel-fetch protect-owned sandbox sfperms split-elog split-log strict test unknown-features-warn unmerge-logs unmerge-orphans userfetch userpriv usersandbox usersync xattr"
FFLAGS="-O2 -pipe"
GENTOO_MIRRORS="http://ftp.halifax.rwth-aachen.de/gentoo/ http://tux.rainside.sk/gentoo/ http://gentoo.mneisen.org/ http://gentoo.tiscali.nl/ http://gentoo.inode.at/"
LANG="it_IT.UTF-8"
LDFLAGS="-Wl,-O1 -Wl,--as-needed -Wl,--hash-style=gnu -Wl,--sort-common -flto=7 -fuse-linker-plugin -floop-interchange -floop-strip-mine -floop-block -fgraphite-identity"
MAKEOPTS="-j12"
PKGDIR="/usr/portage/packages"
PORTAGE_CONFIGROOT="/"
PORTAGE_RSYNC_OPTS="--recursive --links --safe-links --perms --times --omit-dir-times --compress --force --whole-file --delete --stats --human-readable --timeout=180 --exclude=/distfiles --exclude=/local --exclude=/packages"
PORTAGE_TMPDIR="/var/tmp"
PORTDIR="/usr/portage"
PORTDIR_OVERLAY="/usr/local/portage"
SYNC="rsync://rsync.europe.gentoo.org/gentoo-portage"
USE="3dnow X a52 aac aalib acl acpi adns alsa amd64 ao audiofile bash-completion bluetooth branding bzip2 cairo caps cdda cddb cdparanoia cdr cli cracklib crypt css cups curl cxx dbus declarative dga djvu dri dts dvd dvdr emboss encode exif expat fam fbcon ffmpeg fftw firefox flac fontconfig foomaticdb fortran ftp gd gdbm geoip gif gimp glamor gmp gnutls gphoto2 gpm graphviz gstreamer gtk handbook iconv icu idn ieee1394 imagemagick imlib ipv6 java javascript jbig jpeg jpeg2k kde kipi lame lcms libass libcaca libnotify libsamplerate lm_sensors lua lzma lzo mad mmap mmx mng modules mp3 mp4 mpeg mplayer multilib musicbrainz ncurses nls nptl nsplugin offensive ogg openal openexr opengl openmp pam pango pcre pdf phonon plasma png policykit postscript ppds pulseaudio qt3support qt4 rdesktop readline recode samba scanner sdl semantic-desktop session smartcard sndfile sockets speex spell sqlite sqlite3 sse sse2 ssl startup-notification svg symlink syslog systemd sysvipc taglib theora threads tidy tiff truetype udev udisks unicode upower usb vcd vdpau vim-syntax vnc vorbis wayland win32codecs wmf wxwidgets x264 xattr xcb xcomposite xinerama xml xpm xscreensaver xv xvid yahoo zlib" ABI_X86="64" ALSA_CARDS="hda-intel virmidi" APACHE2_MODULES="authn_core authz_core socache_shmcb unixd actions alias auth_basic authn_alias authn_anon authn_dbm authn_default authn_file authz_dbm authz_default authz_groupfile authz_host authz_owner authz_user autoindex cache cgi cgid dav dav_fs dav_lock deflate dir disk_cache env expires ext_filter file_cache filter headers include info log_config logio mem_cache mime mime_magic negotiation rewrite setenvif speling status unique_id userdir usertrack vhost_alias" CALLIGRA_FEATURES="kexi words flow plan sheets stage tables krita karbon braindump author" CAMERAS="kodak ptp2" COLLECTD_PLUGINS="df interface irq load memory rrdtool swap syslog" ELIBC="glibc" GPSD_PROTOCOLS="ashtech aivdm earthmate evermore fv18 garmin garmintxt gpsclock itrax mtk3301 nmea ntrip navcom oceanserver oldstyle oncore rtcm104v2 rtcm104v3 sirf superstar2 timing tsip tripmate tnt ublox ubx" GRUB_PLATFORMS="pc" INPUT_DEVICES="evdev" KERNEL="linux" LCD_DEVICES="bayrad cfontz cfontz633 glk hd44780 lb216 lcdm001 mtxorb ncurses text" LIBREOFFICE_EXTENSIONS="nlpsolver" LINGUAS="it" OFFICE_IMPLEMENTATION="libreoffice" PHP_TARGETS="php5-5" PYTHON_SINGLE_TARGET="python2_7" PYTHON_TARGETS="python2_7 python3_4 pypy pypy3" RUBY_TARGETS="ruby20" SANE_BACKENDS="epson epson2" USERLAND="GNU" VIDEO_CARDS="radeon r600" XTABLES_ADDONS="quota2 psd pknock lscan length2 ipv4options ipset ipp2p iface geoip fuzzy condition tee tarpit sysrq steal rawnat logmark ipmark dhcpmac delude chaos account"
Unset:  CPPFLAGS, CTARGET, INSTALL_MASK, LC_ALL, PORTAGE_BUNZIP2_COMMAND, PORTAGE_COMPRESS, PORTAGE_COMPRESS_FLAGS, PORTAGE_RSYNC_EXTRA_OPTS, USE_PYTHON

=================================================================
                        Package Settings
=================================================================

dev-python/pytest-2.6.4 was built with the following:
USE="test -doc" ABI_X86="64" PYTHON_TARGETS="pypy pypy3 python2_7 python3_4 -python3_3"

# emerge -1pqv =dev-python/pytest-2.6.4
[ebuild   R   ] dev-python/pytest-2.6.4  USE="{test*} -doc" PYTHON_TARGETS="pypy pypy3 python2_7 python3_4 -python3_3"

[Comment 1 Paolo Pedroni 2014-11-21 11:27:50 UTC]

Fixed by rebuilding dev-python/pypy3 without LTO. Closing as INVALID.