Created attachment 528170 [details] dev-python/pytest-forked-0.2:20180421-185336.log =========================================== short test summary info ============================================ FAIL testing/test_boxed.py::test_functional_boxed_capturing[no] XFAIL testing/test_boxed.py::test_functional_boxed_capturing[sys] capture cleanup needed XFAIL testing/test_boxed.py::test_functional_boxed_capturing[fd] capture cleanup needed =================================================== FAILURES =================================================== _____________________________________ test_functional_boxed_capturing[no] ______________________________________ testdir = <Testdir local('/var/tmp/portage/dev-python/pytest-forked-0.2/temp/pytest-of-portage/pytest-0/testdir/test_functional_boxed_capturing0')> capmode = 'no' @needsfork @pytest.mark.parametrize("capmode", [ "no", pytest.mark.xfail("sys", reason="capture cleanup needed"), pytest.mark.xfail("fd", reason="capture cleanup needed")]) def test_functional_boxed_capturing(testdir, capmode): p1 = testdir.makepyfile(""" import os import sys def test_function(): sys.stdout.write("hello\\n") sys.stderr.write("world\\n") os.kill(os.getpid(), 15) """) result = testdir.runpytest(p1, "--forked", "--capture=%s" % capmode) result.stdout.fnmatch_lines(""" *CRASHED* *stdout* hello *stderr* world *1 failed* > """) E Failed: nomatch: '*CRASHED*' E and: u'============================================= test session starts ==============================================' E and: u'platform linux2 -- Python 2.7.14, pytest-3.2.2, py-1.5.3, pluggy-0.4.0' E and: u'rootdir: /var/tmp/portage/dev-python/pytest-forked-0.2/temp/pytest-of-portage/pytest-0/testdir/test_functional_boxed_capturing0, inifile:' E and: u'plugins: forked-0.2, xprocess-0.12.1, virtualenv-1.2.11, subtesthack-0.1.1, shutil-1.2.11, localserver-0.3.7, isort-0.1.0, flake8-0.8.1, expect-1.1.0, cov-2.5.1, hypothesis-3.50.1, flaky-3.4.0, betamax-0.8.0, backports.unittest-mock-1.3' E and: u'collected 1 item' E and: u'' E and: u'test_functional_boxed_capturing.py f' E and: u'===Flaky Test Report===' E and: u'' E and: u'' E and: u'===End Flaky Test Report===' E and: u'' E and: u'=================================================== FAILURES ===================================================' E and: u'________________________________________________ test_function _________________________________________________' E fnmatch: '*CRASHED*' E with: u'/var/tmp/portage/dev-python/pytest-forked-0.2/temp/pytest-of-portage/pytest-0/testdir/test_functional_boxed_capturing0/test_functional_boxed_capturing.py:2: running the test CRASHED with signal 0' E nomatch: '*stdout*' E and: u'----------------------------------------------- captured stderr ------------------------------------------------' E and: u"/usr/lib64/python2.7/site-packages/flaky/flaky_pytest_plugin.py:276: KeyError: <Function 'test_function'>" E and: u'=========================================== 1 failed in 0.02 seconds ===========================================' E and: u'' E remains unmatched: '*stdout*' ../../../../../work/pytest-forked-0.2/testing/test_boxed.py:44: Failed --------------------------------------------- Captured stdout call --------------------------------------------- ============================================= test session starts ============================================== platform linux2 -- Python 2.7.14, pytest-3.2.2, py-1.5.3, pluggy-0.4.0 rootdir: /var/tmp/portage/dev-python/pytest-forked-0.2/temp/pytest-of-portage/pytest-0/testdir/test_functional_boxed_capturing0, inifile: plugins: forked-0.2, xprocess-0.12.1, virtualenv-1.2.11, subtesthack-0.1.1, shutil-1.2.11, localserver-0.3.7, isort-0.1.0, flake8-0.8.1, expect-1.1.0, cov-2.5.1, hypothesis-3.50.1, flaky-3.4.0, betamax-0.8.0, backports.unittest-mock-1.3 collected 1 item test_functional_boxed_capturing.py f ===Flaky Test Report=== ===End Flaky Test Report=== =================================================== FAILURES =================================================== ________________________________________________ test_function _________________________________________________ /var/tmp/portage/dev-python/pytest-forked-0.2/temp/pytest-of-portage/pytest-0/testdir/test_functional_boxed_capturing0/test_functional_boxed_capturing.py:2: running the test CRASHED with signal 0 ----------------------------------------------- captured stderr ------------------------------------------------ /usr/lib64/python2.7/site-packages/flaky/flaky_pytest_plugin.py:276: KeyError: <Function 'test_function'> =========================================== 1 failed in 0.02 seconds =========================================== ================================ 1 failed, 2 passed, 2 xfailed in 0.43 seconds ================================= * ERROR: dev-python/pytest-forked-0.2::gentoo failed (test phase): * Tests failed under python2.7 * * Call stack: * ebuild.sh, line 124: Called src_test * environment, line 2644: Called distutils-r1_src_test * environment, line 888: Called _distutils-r1_run_foreach_impl 'python_test' * environment, line 350: Called python_foreach_impl 'distutils-r1_run_phase' 'python_test' * environment, line 2184: Called multibuild_foreach_variant '_python_multibuild_wrapper' 'distutils-r1_run_phase' 'python_test' * environment, line 1542: Called _multibuild_run '_python_multibuild_wrapper' 'distutils-r1_run_phase' 'python_test' * environment, line 1540: Called _python_multibuild_wrapper 'distutils-r1_run_phase' 'python_test' * environment, line 562: Called distutils-r1_run_phase 'python_test' * environment, line 819: Called python_test * environment, line 2546: Called die * The specific snippet of code: * py.test -v || die "Tests failed under ${EPYTHON}"
occam ~ # emerge --info '=dev-python/pytest-forked-0.2::gentoo' Portage 2.3.31 (python 3.6.5-final-0, default/linux/amd64/17.0/hardened, gcc-7.2.0, glibc-2.26-r6, 4.15.3-gentoo-o0 x86_64) ================================================================= System Settings ================================================================= System uname: Linux-4.15.3-gentoo-o0-x86_64-Intel-R-_Core-TM-_i5-2520M_CPU_@_2.50GHz-with-gentoo-2.4.1 KiB Mem: 8001552 total, 2612932 free KiB Swap: 16777212 total, 15442864 free Timestamp of repository gentoo: Fri, 20 Apr 2018 11:30:01 +0000 Head commit of repository gentoo: 235f9534d5f6571fd67de7ec7410eb206dacf14c Timestamp of repository eroen: Sun, 30 Oct 2016 21:58:42 +0000 Head commit of repository sapher: 9ef31d0bf6a902342746fb03a445d4f8b7ddabef Head commit of repository wiktorb: 722797c27affae074c3d7b0a628cad1bdff2041c Head commit of repository gentoo-snappy: 0ea79c799ebe1bc6cd924b9dd707b710eea24e83 Head commit of repository stuff: e679cb453d3f698c48051d9aaa4de0d4e22e86b7 sh bash 4.4_p19 ld GNU ld (Gentoo 2.29.1 p2) 2.29.1 ccache version 3.3.4 [disabled] app-shells/bash: 4.4_p19::gentoo dev-java/java-config: 2.2.0-r3::gentoo dev-lang/perl: 5.26.1-r2::gentoo dev-lang/python: 2.7.14-r1::gentoo, 3.4.8::gentoo, 3.5.5::gentoo, 3.6.5::gentoo dev-util/ccache: 3.3.4-r1::gentoo dev-util/cmake: 3.11.1::gentoo dev-util/pkgconfig: 0.29.2::gentoo sys-apps/baselayout: 2.4.1-r2::gentoo sys-apps/openrc: 0.35.5::gentoo sys-apps/sandbox: 2.13::gentoo sys-devel/autoconf: 2.13::gentoo, 2.69-r4::gentoo sys-devel/automake: 1.13.4-r2::gentoo, 1.14.1-r2::gentoo, 1.15.1-r2::gentoo, 1.16.1-r1::gentoo sys-devel/binutils: 2.29.1-r1::gentoo, 2.30-r1::gentoo sys-devel/gcc: 6.4.0-r1::gentoo, 7.2.0-r1::gentoo, 7.3.0-r1::gentoo sys-devel/gcc-config: 1.9.1::gentoo sys-devel/libtool: 2.4.6-r5::gentoo sys-devel/make: 4.2.1-r3::gentoo sys-kernel/linux-headers: 4.16-r1::gentoo (virtual/os-headers) sys-libs/glibc: 2.26-r6::gentoo Repositories: gentoo location: /usr/portage sync-type: rsync sync-uri: rsync://rsync.gentoo.org/gentoo-portage priority: -1000 sync-rsync-verify-jobs: 1 sync-rsync-verify-max-age: 24 sync-rsync-verify-metamanifest: yes sync-rsync-extra-opts: --exclude ChangeLog* --exclude /metadata/cache/ --stats --delay-updates -c crossdev location: /var/lib/portage/crossdev masters: gentoo gamerlay eroen eroen location: /usr/local/portage masters: gentoo priority: 0 sapher location: /var/lib/overlays/sapher sync-type: git sync-uri: https://github.com/apinsard/sapher-overlay.git masters: gentoo wiktorb location: /var/lib/overlays/wiktorb sync-type: git sync-uri: https://github.com/wiktor-b/overlay.git masters: gentoo dotnet location: /var/lib/layman/dotnet masters: gentoo priority: 50 enlightenment location: /var/lib/layman/enlightenment masters: gentoo priority: 50 flora location: /var/lib/layman/flora masters: gentoo priority: 50 gamerlay location: /var/lib/layman/gamerlay masters: gentoo priority: 50 gentoo-snappy location: /usr/local/portage/gentoo-snappy sync-type: git sync-uri: https://github.com/zyga/gentoo-snappy.git masters: gentoo priority: 50 glc location: /var/lib/layman/glc masters: gentoo priority: 50 hardened-development location: /var/lib/layman/hardened-development masters: gentoo priority: 50 haskell location: /var/lib/layman/haskell masters: gentoo priority: 50 hasufell location: /var/lib/layman/hasufell masters: gentoo priority: 50 java location: /var/lib/layman/java masters: gentoo priority: 50 laurentb location: /var/lib/layman/laurentb masters: gentoo priority: 50 roslin location: /var/lib/layman/roslin masters: gentoo priority: 50 stuff location: /var/lib/layman/stuff sync-type: git sync-uri: https://github.com/istitov/stuff.git masters: gentoo priority: 50 sunrise location: /var/lib/layman/sunrise masters: gentoo priority: 50 toolchain location: /var/lib/layman/toolchain masters: gentoo priority: 50 v-fox location: /var/lib/layman/v-fox masters: gentoo priority: 50 ACCEPT_KEYWORDS="amd64 ~amd64" ACCEPT_LICENSE="*" CBUILD="x86_64-pc-linux-gnu" CFLAGS="-march=corei7-avx -pipe -Og -g -gdwarf-4" CHOST="x86_64-pc-linux-gnu" CONFIG_PROTECT="/etc /usr/share/config /usr/share/easy-rsa /usr/share/gnupg/qualified.txt" CONFIG_PROTECT_MASK="/etc/ca-certificates.conf /etc/dconf /etc/env.d /etc/fonts/fonts.conf /etc/gconf /etc/gentoo-release /etc/revdep-rebuild /etc/sandbox.d /etc/terminfo /etc/texmf/language.dat.d /etc/texmf/language.def.d /etc/texmf/updmap.d /etc/texmf/web2c" CXXFLAGS="-march=corei7-avx -pipe -Og -g -gdwarf-4" DISTDIR="/var/distfiles" EMERGE_DEFAULT_OPTS="--jobs=1 --autounmask --quiet-build --nospinner --verbose-conflicts --verbose-slot-rebuilds" FCFLAGS="-O2 -pipe" FEATURES="assume-digests binpkg-logs binpkg-multi-instance cgroup collision-protect compressdebug config-protect-if-modified distlocks ebuild-locks fixlafiles installsources ipc-sandbox merge-sync multilib-strict network-sandbox news parallel-fetch parallel-install preserve-libs protect-owned sandbox sfperms split-log splitdebug strict strict-keepdir test unknown-features-warn unmerge-logs unmerge-orphans userfetch userpriv usersandbox usersync xattr" FFLAGS="-O2 -pipe" GENTOO_MIRRORS="" LANG="en_GB.utf8" LDFLAGS="-Wl,-O1 -Wl,--as-needed -Wl,--hash-style=gnu" LINGUAS="en gb us en_US en_GB eng jbo no nb nn no_NO nb_NO nn_NO nor" MAKEOPTS="-j4 -l10" PKGDIR="/var/packages" PORTAGE_CONFIGROOT="/" PORTAGE_RSYNC_EXTRA_OPTS="--exclude ChangeLog* --exclude /metadata/cache/ --stats --delay-updates -c" PORTAGE_RSYNC_OPTS="--recursive --links --safe-links --perms --times --omit-dir-times --compress --force --whole-file --delete --stats --human-readable --timeout=180 --exclude=/distfiles --exclude=/local --exclude=/packages --exclude=/.git" PORTAGE_TMPDIR="/var/tmp" USE="X a52 aac acl alsa amd64 apng audio audiofile avresample avx bash-completion bdf bluray bzip2 cairo caps cb cdda cdparanoia cdr cjk corefonts crypt cups curl cxx ddate declarative detex device-mapper dga dia djvu dts dvd dvi2tty dvipdfm ebook egl exif fam ffmpeg fftw fits flac fontconfig g3dvl gallium gbm gcrypt gif gimp git glamor glib glibc-omitfp gmp gnuplot gnutls gold gpm graphics graphviz gs gstreamer gtk gtk3 hardened highlight hscolour iconv icu id3tag idn imagemagick imlib inotify iproute2 ipv6 jbig jpeg jpeg2k jpg json kde kde4 kpathsea latex lcms libffi libssh2 libv4l luatex lvm lvm2 lzma lzo man metric mikmod mkv mms mmx mng mp3 mpeg mpg123 multilib multimedia musepack ncurses netlink nptl nut ocr odbc offensive ogg opengl openmp openvg optimization optimized-qmake opus pam pango pcre pdf pgf phonon pie png postscript private-headers pstricks pth publishers python3 qt3support qt4 raw readline samba sbsms scanner science sdl seccomp smp sna sndfile speex spell sqlite sse sse2 sse3 sse4 sse41 sse4_1 sse4_2 ssh ssl ssp ssse3 svg t1lib tesseract theora threads tiff tls truetype udev unicode usb v4l v4l2 vaapi video vorbis vpx webp wmf x264 xanim xattr xcb xcomposite xetex xft xinerama xkb xml xmlpatterns xorg xosd xpm xrandr xtpax xv xvid xvmc xz zlib zsh-completion" ABI_X86="32 64" APACHE2_MODULES="authn_core authz_core socache_shmcb unixd actions alias auth_basic authn_alias authn_anon authn_dbm authn_default authn_file authz_dbm authz_default authz_groupfile authz_host authz_owner authz_user autoindex cache cgi cgid dav dav_fs dav_lock deflate dir disk_cache env expires ext_filter file_cache filter headers include info log_config logio mem_cache mime mime_magic negotiation rewrite setenvif speling status unique_id userdir usertrack vhost_alias" CALLIGRA_FEATURES="karbon plan sheets stage words" COLLECTD_PLUGINS="df interface irq load memory rrdtool swap syslog" CPU_FLAGS_X86="mmx sse sse2 avx sse3 ssse3 sse4_1 aes avx mmxext popcnt sse3 sse4_1 sse4_2 ssse3" CURL_SSL="openssl" ELIBC="glibc" GPSD_PROTOCOLS="ashtech aivdm earthmate evermore fv18 garmin garmintxt gpsclock isync itrax mtk3301 nmea ntrip navcom oceanserver oldstyle oncore rtcm104v2 rtcm104v3 sirf skytraq superstar2 timing tsip tripmate tnt ublox ubx" GRUB_PLATFORMS="efi-64" INPUT_DEVICES="evdev synaptics" KERNEL="linux" L10N="en en-US en-GB eng" LCD_DEVICES="bayrad cfontz cfontz633 glk hd44780 lb216 lcdm001 mtxorb ncurses text" LIBREOFFICE_EXTENSIONS="presenter-console presenter-minimizer" LLVM_TARGETS="AArch64 ARM BPF X86" OFFICE_IMPLEMENTATION="libreoffice" PHP_TARGETS="php5-3" POSTGRES_TARGETS="postgres10" PYTHON_SINGLE_TARGET="python3_6" PYTHON_TARGETS="python2_7 python3_4 python3_5 python3_6" QEMU_SOFTMMU_TARGETS="x86_64 i386" RUBY_TARGETS="ruby22" SANE_BACKENDS="plustek" USERLAND="GNU" VIDEO_CARDS="intel i965 ilo" XTABLES_ADDONS="quota2 psd pknock lscan length2 ipv4options ipset ipp2p iface geoip fuzzy condition tee tarpit sysrq steal rawnat logmark ipmark dhcpmac delude chaos account" Unset: CC, CPPFLAGS, CTARGET, CXX, ENV_UNSET, INSTALL_MASK, LC_ALL, PORTAGE_BINHOST, PORTAGE_BUNZIP2_COMMAND, PORTAGE_COMPRESS, PORTAGE_COMPRESS_FLAGS occam ~ # emerge -pqv '=dev-python/pytest-forked-0.2::gentoo' [ebuild N ] dev-python/pytest-forked-0.2 USE="{test}" PYTHON_TARGETS="python2_7 python3_4 python3_5 python3_6 -pypy -pypy3"
The plugin flaky is not compatible with the pytest-forked plugin. From the README [1] of flaky (section Compatibility): [...] Works with pytest-xdist but not with the --boxed option. Doctests cannot be marked flaky. Note that pytest-forked is the split out of the --boxed option of pytest-xdist [2]. pytest (and its plugins) sadly has the annoying property of loading all plugins on the system by default (see bug #661218 for a similar problem with pytest-relaxed). A fix is to run the test suite with the "-p no:flaky" argument, which prevents pytest from loading the flaky plugin [4]. That is changing the test suite invocation to py.test -v -p no:flaky || die "Tests failed under ${EPYTHON}" Hope this helps. [1] https://github.com/box/flaky/blob/7240d7569bc8717970a1e0d570ef3cb519102749/README.rst [2] Its slogan on the Github page [3] is "extracted --boxed from pytest-xdist to ensure backward compat" [3] https://github.com/pytest-dev/pytest-forked [4] https://docs.pytest.org/en/latest/usage.html#disabling-plugins
(In reply to Maram from comment #2) > The plugin flaky is not compatible with the pytest-forked plugin. > > From the README [1] of flaky (section Compatibility): > > [...] Works with pytest-xdist but not with the --boxed option. Doctests > cannot be marked flaky. > > Note that pytest-forked is the split out of the --boxed option of > pytest-xdist [2]. > > pytest (and its plugins) sadly has the annoying property of loading all > plugins on the system by default (see bug #661218 for a similar problem with > pytest-relaxed). > > A fix is to run the test suite with the "-p no:flaky" argument, which > prevents pytest from loading the flaky plugin [4]. That is changing the test > suite invocation to > > py.test -v -p no:flaky || die "Tests failed under ${EPYTHON}" > > Hope this helps. > > [1] > https://github.com/box/flaky/blob/7240d7569bc8717970a1e0d570ef3cb519102749/ > README.rst > [2] Its slogan on the Github page [3] is "extracted --boxed from > pytest-xdist to ensure backward compat" > [3] https://github.com/pytest-dev/pytest-forked > [4] https://docs.pytest.org/en/latest/usage.html#disabling-plugins This works. Great! Thanks.
Old version now gone.
