Bug 694538 – dev-python/flaky-3.1.1 fails tests with python-2.7.15

• Product: Gentoo Linux
• Status: RESOLVED OBSOLETE

[Description Paolo Pedroni 2019-09-16 08:17:03 UTC]

Created attachment 589970 [details]
flaky-3.1.1:20190916-072559.log.gz

====================================== test session starts =======================================
platform linux2 -- Python 2.7.15, pytest-3.10.1, py-1.5.4, pluggy-0.11.0
rootdir: /var/tmp/portage/dev-python/flaky-3.1.1/work/flaky-3.1.1, inifile:
plugins: flaky-3.1.1, virtualenv-1.2.11, twisted-1.10, shutil-1.2.11, cov-2.6.1, hypothesis-3.59.1
collected 68 items / 52 deselected

test/test_pytest/test_pytest_example.py .s..x...s.....                                     [ 87%]
test/test_pytest/pytest_generate_example/test_pytest_generate_example.py .                 [100%]F [100%]

============================================ FAILURES ============================================
_______________ TestExample.test_flaky_thing_that_fails_then_succeeds[dummy_list0] _______________

>       lambda: ihook(item=item, **kwds),
        when=when,
    )

../flaky-3.1.1-python2_7/lib/flaky/flaky_pytest_plugin.py:271: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 

pyfuncitem = <Function 'test_flaky_thing_that_fails_then_succeeds[dummy_list0]'>

    def pytest_pyfunc_call(pyfuncitem):
        if _instances.gr_twisted is not None:
            if _instances.gr_twisted.dead:
>               raise RuntimeError("twisted reactor has stopped")
E               RuntimeError: twisted reactor has stopped

/usr/lib64/python2.7/site-packages/pytest_twisted.py:123: RuntimeError
===Flaky Test Report===

test_something_flaky failed (1 runs remaining out of 2).
        <type 'exceptions.AssertionError'>
        assert 1 > 1
 +  where 1 = len([0])
        [<TracebackEntry /var/tmp/portage/dev-python/flaky-3.1.1/work/flaky-3.1.1/test/test_pytest/test_pytest_example.py:20>]
test_something_flaky passed 1 out of the required 1 times. Success!
test_flaky_thing_that_fails_then_succeeds failed (2 runs remaining out of 3).
        <type 'exceptions.AssertionError'>
        assert 0 >= 1
 +  where 0 = TestExample._threshold
        [<TracebackEntry /var/tmp/portage/dev-python/flaky-3.1.1/work/flaky-3.1.1/test/test_pytest/test_pytest_example.py:43>]
test_flaky_thing_that_fails_then_succeeds passed 1 out of the required 2 times. Running test again until it passes 2 times.
test_flaky_thing_that_fails_then_succeeds passed 2 out of the required 2 times. Success!
test_flaky_thing_that_succeeds_then_fails_then_succeeds passed 1 out of the required 2 times. Running test again until it passes 2 times.
test_flaky_thing_that_succeeds_then_fails_then_succeeds passed 2 out of the required 2 times. Success!
test_flaky_thing_that_always_passes passed 1 out of the required 2 times. Running test again until it passes 2 times.
test_flaky_thing_that_always_passes passed 2 out of the required 2 times. Success!
test_flaky_thing_that_fails_then_succeeds failed (1 runs remaining out of 2).
        <type 'exceptions.AssertionError'>
        assert 0 >= 1
 +  where 0 = TestExampleFlakyTests._threshold
        [<TracebackEntry /var/tmp/portage/dev-python/flaky-3.1.1/work/flaky-3.1.1/test/test_pytest/test_pytest_example.py:81>]
test_flaky_thing_that_fails_then_succeeds passed 1 out of the required 1 times. Success!
test_flaky_thing_that_fails_then_succeeds failed (1 runs remaining out of 2).
        <type 'exceptions.AssertionError'>
        assert 0 >= 1
 +  where 0 = TestExampleFlakyTestCase._threshold
        [<TracebackEntry /var/tmp/portage/dev-python/flaky-3.1.1/work/flaky-3.1.1/test/test_pytest/test_pytest_example.py:95>]
test_flaky_thing_that_fails_then_succeeds passed 1 out of the required 1 times. Success!
test_flaky_thing_that_fails_then_succeeds passed 1 out of the required 1 times. Success!
test_requiring_my_fixture failed (1 runs remaining out of 2).
        <type 'exceptions.AssertionError'>
        assert 1 > 1
 +  where 1 = len([0])
        [<TracebackEntry /var/tmp/portage/dev-python/flaky-3.1.1/work/flaky-3.1.1/test/test_pytest/test_pytest_example.py:120>]
test_requiring_my_fixture passed 1 out of the required 1 times. Success!
test_something_flaky failed (1 runs remaining out of 2).
        <type 'exceptions.AssertionError'>
        assert 0 >= 1
 +  where 0 = TestExampleRerunFilter._threshold
        [<TracebackEntry /var/tmp/portage/dev-python/flaky-3.1.1/work/flaky-3.1.1/test/test_pytest/test_pytest_example.py:135>]
test_something_flaky passed 1 out of the required 1 times. Success!
test_something_flaky[dummy_list0] failed (1 runs remaining out of 2).
        <type 'exceptions.AssertionError'>
        assert 1 > 1
 +  where 1 = len([0])
        [<TracebackEntry /var/tmp/portage/dev-python/flaky-3.1.1/work/flaky-3.1.1/test/test_pytest/pytest_generate_example/test_pytest_generate_example.py:10>]
test_something_flaky[dummy_list0] passed 1 out of the required 1 times. Success!
test_flaky_thing_that_fails_then_succeeds[dummy_list0] failed (1 runs remaining out of 2).
        <type 'exceptions.AssertionError'>
        assert 0 >= 1
 +  where 0 = TestExample._threshold
        [<TracebackEntry /var/tmp/portage/dev-python/flaky-3.1.1/work/flaky-3.1.1/test/test_pytest/pytest_generate_example/test_pytest_generate_example.py:20>]
test_flaky_thing_that_fails_then_succeeds[dummy_list0] failed; it passed 0 out of the required 1 times.
        <type 'exceptions.RuntimeError'>
        twisted reactor has stopped
        [<TracebackEntry /var/tmp/portage/dev-python/flaky-3.1.1/work/flaky-3.1.1-python2_7/lib/flaky/flaky_pytest_plugin.py:271>, <TracebackEntry /usr/lib64/python2.7/site-packages/pytest_twisted.py:123>]

===End Flaky Test Report===
============ 1 failed, 12 passed, 2 skipped, 52 deselected, 1 xfailed in 0.20 seconds ============

Last time I emerged the package, in April, it worked.

dev-python/flaky-3.4.0 fails at the same point with the same error

dev-python/flaky-3.5.3 fails before that point, with pypy, with a different error.

# emerge --info =dev-python/flaky-3.1.1
Portage 2.3.69 (python 3.6.5-final-0, default/linux/amd64/17.1/desktop/plasma/systemd, gcc-9.2.0, glibc-2.29-r2, 5.2.11-gentoo x86_64)
=================================================================
                         System Settings
=================================================================
System uname: Linux-5.2.11-gentoo-x86_64-Intel-R-_Core-TM-_i5-8400_CPU_@_2.80GHz-with-gentoo-2.6
KiB Mem:    16130052 total,   3097804 free
KiB Swap:   16777212 total,  16559612 free
Timestamp of repository gentoo: Mon, 09 Sep 2019 10:00:01 +0000
Head commit of repository gentoo: 1a2e6530f5a3c2ceb3aea515b6c00da0d91fb3b9
sh dash 0.5.9.1-r3
ld GNU gold (Gentoo 2.32 p2 2.32.0) 1.16
distcc 3.3.3 x86_64-pc-linux-gnu [enabled]
ccache version 3.7.2 [disabled]
app-shells/bash:          4.4_p23-r1::gentoo
dev-java/java-config:     2.2.0-r4::gentoo
dev-lang/perl:            5.28.2-r1::gentoo
dev-lang/python:          2.7.15::gentoo, 3.6.5::gentoo
dev-util/ccache:          3.7.2::gentoo
dev-util/cmake:           3.14.6::gentoo
sys-apps/baselayout:      2.6-r1::gentoo
sys-apps/sandbox:         2.13::gentoo
sys-devel/autoconf:       2.13-r1::gentoo, 2.69-r4::gentoo
sys-devel/automake:       1.16.1-r1::gentoo
sys-devel/binutils:       2.32-r1::gentoo
sys-devel/gcc:            9.2.0::gentoo
sys-devel/gcc-config:     2.0::gentoo
sys-devel/libtool:        2.4.6-r3::gentoo
sys-devel/make:           4.2.1-r4::gentoo
sys-kernel/linux-headers: 4.19::gentoo (virtual/os-headers)
sys-libs/glibc:           2.29-r2::gentoo
Repositories:

gentoo
    location: /usr/portage
    sync-type: rsync
    sync-uri: rsync://rsync.gentoo.org/gentoo-portage
    priority: -1000
    sync-rsync-extra-opts: 
    sync-rsync-verify-max-age: 24
    sync-rsync-verify-metamanifest: yes
    sync-rsync-verify-jobs: 1

x-portage
    location: /usr/local/portage
    masters: gentoo
    priority: 0

ACCEPT_KEYWORDS="amd64"
ACCEPT_LICENSE="* -@EULA"
CBUILD="x86_64-pc-linux-gnu"
CFLAGS="-O2 -pipe -frecord-gcc-switches -march=skylake -mabm -flto=6"
CHOST="x86_64-pc-linux-gnu"
CONFIG_PROTECT="/etc /usr/lib64/libreoffice/program/sofficerc /usr/share/config /usr/share/gnupg/qualified.txt"
CONFIG_PROTECT_MASK="/etc/ca-certificates.conf /etc/dconf /etc/env.d /etc/fonts/fonts.conf /etc/gconf /etc/gentoo-release /etc/revdep-rebuild /etc/sandbox.d /etc/terminfo"
CXXFLAGS="-O2 -pipe -frecord-gcc-switches -march=skylake -mabm -flto=6"
DISTDIR="/usr/portage/distfiles"
EMERGE_DEFAULT_OPTS="--keep-going y --with-bdeps y"
ENV_UNSET="DBUS_SESSION_BUS_ADDRESS DISPLAY GOBIN PERL5LIB PERL5OPT PERLPREFIX PERL_CORE PERL_MB_OPT PERL_MM_OPT XAUTHORITY XDG_CACHE_HOME XDG_CONFIG_HOME XDG_DATA_HOME XDG_RUNTIME_DIR"
FCFLAGS="-O2 -pipe -frecord-gcc-switches -march=skylake -mabm -flto=6"
FEATURES="assume-digests binpkg-docompress binpkg-dostrip binpkg-logs cgroup compress-build-logs config-protect-if-modified distcc distlocks ebuild-locks ipc-sandbox merge-sync multilib-strict network-sandbox news parallel-fetch pid-sandbox preserve-libs protect-owned sandbox sfperms sign split-elog split-log strict strict-keepdir test unknown-features-warn unmerge-logs unmerge-orphans userfetch userpriv usersandbox usersync xattr"
FFLAGS="-O2 -pipe -frecord-gcc-switches -march=skylake -mabm -flto=6"
GENTOO_MIRRORS="http://mirrors.evowise.com/gentoo/ https://mirrors.evowise.com/gentoo/ http://mirror.eu.oneandone.net/linux/distributions/gentoo/gentoo/ http://mirror.netcologne.de/gentoo/"
LANG="it_IT.utf8"
LDFLAGS="-Wl,-O1 -Wl,--as-needed -Wl,--hash-style=gnu -Wl,--sort-common -flto=6"
LINGUAS="it it_IT"
MAKEOPTS="-j19 -l6"
PKGDIR="/var/cache/binpkgs"
PORTAGE_CONFIGROOT="/"
PORTAGE_RSYNC_OPTS="--recursive --links --safe-links --perms --times --omit-dir-times --compress --force --whole-file --delete --stats --human-readable --timeout=180 --exclude=/distfiles --exclude=/local --exclude=/packages --exclude=/.git"
PORTAGE_TMPDIR="/var/tmp"
USE="X a52 aac aalib acl acpi activities adns alsa amd64 ao audiofile bash-completion bluetooth branding bzip2 cairo caps cdda cddb cdparanoia cdr cli crypt css cups curl cxx dbus declarative dga djvu dri dts dvd dvdr emboss encode exif expat fbcon ffmpeg fftw flac fontconfig foomaticdb fortran ftp gd gdbm geoip gif gimp glamor gmp gnutls gphoto2 gpm graphviz gtk handbook iconv icu idn imagemagick imlib ipv6 java javascript jbig jpeg jpeg2k kde kipi kwallet lame lcms libass libnotify libsamplerate libtirpc lm_sensors lua lzma lzo mad mmap mng mp3 mp4 mpeg mplayer multilib musicbrainz ncurses nls nptl nsplugin offensive ogg openal opengl openmp pam pango pcre pdf phonon plasma png policykit postscript ppds pulseaudio qml qt5 rdesktop readline recode samba sctp sdl seccomp sndfile sockets speex spell split-usr sqlite ssl startup-notification subversion svg symlink syslog systemd sysvipc taglib test theora threads tidy tiff truetype udev udisks unicode upower usb vaapi vcd vim-syntax vnc vorbis wayland widgets win32codecs wmf wxwidgets x264 xattr xcb xcomposite xine xml xpm xscreensaver xv xvid yahoo zlib" ABI_X86="64" ADA_TARGET="gnat_2018" ALSA_CARDS="hda-intel virmidi" APACHE2_MODULES="authn_core authz_core socache_shmcb unixd actions alias auth_basic authn_alias authn_anon authn_dbm authn_default authn_file authz_dbm authz_default authz_groupfile authz_host authz_owner authz_user autoindex cache cgi cgid dav dav_fs dav_lock deflate dir disk_cache env expires ext_filter file_cache filter headers include info log_config logio mem_cache mime mime_magic negotiation rewrite setenvif speling status unique_id userdir usertrack vhost_alias" CALLIGRA_FEATURES="karbon sheets words" CAMERAS="kodak ptp2" COLLECTD_PLUGINS="df interface irq load memory rrdtool swap syslog" CPU_FLAGS_X86="aes avx avx2 f16c fma3 mmx mmxext pclmul popcnt sse sse2 sse3 sse4_1 sse4_2 ssse3" CURL_SSL="gnutls" ELIBC="glibc" GPSD_PROTOCOLS="ashtech aivdm earthmate evermore fv18 garmin garmintxt gpsclock isync itrax mtk3301 nmea ntrip navcom oceanserver oldstyle oncore rtcm104v2 rtcm104v3 sirf skytraq superstar2 timing tsip tripmate tnt ublox ubx" INPUT_DEVICES="libinput" KERNEL="linux" L10N="it en" LCD_DEVICES="bayrad cfontz cfontz633 glk hd44780 lb216 lcdm001 mtxorb ncurses text" LIBREOFFICE_EXTENSIONS="nlpsolver wiki-publisher" NETBEANS_MODULES="apisupport cnd groovy gsf harness ide identity j2ee java mobility nb php profiler soa visualweb webcommon websvccommon xml" OFFICE_IMPLEMENTATION="libreoffice" PHP_TARGETS="php7-2" POSTGRES_TARGETS="postgres10 postgres11" PYTHON_SINGLE_TARGET="python3_6" PYTHON_TARGETS="python2_7 python3_6 pypy pypy3" RUBY_TARGETS="ruby24" USERLAND="GNU" VIDEO_CARDS="intel i965" XTABLES_ADDONS="quota2 psd pknock lscan length2 ipv4options ipset ipp2p iface geoip fuzzy condition tee tarpit sysrq steal rawnat logmark ipmark dhcpmac delude chaos account"
Unset:  CC, CPPFLAGS, CTARGET, CXX, INSTALL_MASK, LC_ALL, PORTAGE_BINHOST, PORTAGE_BUNZIP2_COMMAND, PORTAGE_COMPRESS, PORTAGE_COMPRESS_FLAGS, PORTAGE_RSYNC_EXTRA_OPTS

=================================================================
                        Package Settings
=================================================================

dev-python/flaky-3.1.1::gentoo was built with the following:
USE="test" ABI_X86="(64)" PYTHON_TARGETS="pypy pypy3 python2_7 python3_6 -python3_5"
CFLAGS="-O2 -pipe -frecord-gcc-switches -march=sandybridge -mno-aes -mno-avx -mno-xsave -mno-xsaveopt -flto=2"
CXXFLAGS="-O2 -pipe -frecord-gcc-switches -march=sandybridge -mno-aes -mno-avx -mno-xsave -mno-xsaveopt -flto=2"
LDFLAGS="-Wl,-O1 -Wl,--as-needed -Wl,--hash-style=gnu -Wl,--sort-common -flto=2"

# emerge -1pqv =dev-python/flaky-3.1.1
[ebuild   R   ] dev-python/flaky-3.1.1  USE="test" PYTHON_TARGETS="pypy pypy3 python2_7 python3_6 -python3_5"

[Comment 1 Arthur Zamarin 2021-08-20 13:02:13 UTC]

python 2.7 isn't in tree.