Gentoo Websites Logo
Go to: Gentoo Home Documentation Forums Lists Bugs Planet Store Wiki Get Gentoo!
Bug 580528 - dev-python/pytest with dev-python/pytest-capturelog fails tests
Summary: dev-python/pytest with dev-python/pytest-capturelog fails tests
Status: RESOLVED OBSOLETE
Alias: None
Product: Gentoo Linux
Classification: Unclassified
Component: [OLD] Development (show other bugs)
Hardware: All Linux
: Normal normal (vote)
Assignee: Python Gentoo Team
URL:
Whiteboard:
Keywords:
Depends on:
Blocks:
 
Reported: 2016-04-19 14:15 UTC by eroen
Modified: 2019-04-09 14:12 UTC (History)
2 users (show)

See Also:
Package list:
Runtime testing required: ---


Attachments
build.log (build.log,31.74 KB, text/plain)
2016-04-19 14:15 UTC, eroen
Details
pytest-3.0.4 build.log (build.log,376.09 KB, text/plain)
2016-11-30 20:38 UTC, eroen
Details

Note You need to log in before you can comment on or make changes to this bug.
Description eroen 2016-04-19 14:15:40 UTC
Created attachment 431232 [details]
build.log

If dev-python/pytest-capturelog is not installed, the test suite passes.

...
testing/test_cache.py::TestNewAPI::test_cache_failure_warns FAILED
=========================== short test summary info ============================
XFAIL testing/acceptance_test.py::TestInvocationVariants::()::test_noclass_discovery_if_not_testcase
  decide: feature or bug
SKIP [1] testing/test_assertinterpret.py:337: condition: sys.version_info >= (2,6)
SKIP [1] testing/test_assertrewrite.py:496: packages without __init__.py not supported on python 2

=================================== FAILURES ===================================
_____________________ TestNewAPI.test_cache_failure_warns ______________________

self = <test_cache.TestNewAPI instance at 0x7fe2c147c758>
testdir = <Testdir local('/var/tmp/portage/dev-python/pytest-2.8.7/temp/pytest-of-portage/pytest-0/testdir/test_cache_failure_warns0')>

    @pytest.mark.skipif(sys.platform.startswith('win'), reason='no chmod on windows')
    def test_cache_failure_warns(self, testdir):
        testdir.tmpdir.ensure_dir('.cache').chmod(0)
        testdir.makepyfile("""
                def test_pass():
                    pass
    
            """)
        result = testdir.runpytest('-rw')
        assert result.ret == 0
        result.stdout.fnmatch_lines([
            "*could not create cache path*",
>           "*1 pytest-warnings*",
        ])
E       Failed: remains unmatched: '*1 pytest-warnings*', see stderr

../../../../../work/pytest-2.8.7/testing/test_cache.py:56: Failed
----------------------------- Captured stdout call -----------------------------
running: /usr/bin/python2.7 /var/tmp/portage/dev-python/pytest-2.8.7/work/pytest-2.8.7-python2_7/lib/pytest.py --basetemp=/var/tmp/portage/dev-python/pytest-2.8.7/temp/pytest-of-portage/pytest-0/testdir/test_cache_failure_warns0/runpytest-0 -rw --basetemp=/var/tmp/portage/dev-python/pytest-2.8.7/temp/pytest-of-portage/pytest-0/testdir/basetemp
     in: /var/tmp/portage/dev-python/pytest-2.8.7/temp/pytest-of-portage/pytest-0/testdir/test_cache_failure_warns0
============================= test session starts ==============================
platform linux2 -- Python 2.7.10, pytest-2.8.7, py-1.4.30, pluggy-0.3.1
rootdir: /var/tmp/portage/dev-python/pytest-2.8.7/temp/pytest-of-portage/pytest-0/testdir/test_cache_failure_warns0, inifile: 
plugins: capturelog-0.7
collected 1 items

test_cache_failure_warns.py .

============================ pytest-warning summary ============================
WI1 /usr/lib64/python2.7/site-packages/pytest_capturelog.py:171 'pytest_runtest_makereport' hook uses deprecated __multicall__ argument
WI9 None could not create cache path /var/tmp/portage/dev-python/pytest-2.8.7/temp/pytest-of-portage/pytest-0/testdir/test_cache_failure_warns0/.cache/v/cache/lastfailed
================= 1 passed, 2 pytest-warnings in 0.01 seconds ==================
----------------------------- Captured stderr call -----------------------------
nomatch: '*could not create cache path*'
    and: u'============================= test session starts =============================='
    and: u'platform linux2 -- Python 2.7.10, pytest-2.8.7, py-1.4.30, pluggy-0.3.1'
    and: u'rootdir: /var/tmp/portage/dev-python/pytest-2.8.7/temp/pytest-of-portage/pytest-0/testdir/test_cache_failure_warns0, inifile: '
    and: u'plugins: capturelog-0.7'
    and: u'collected 1 items'
    and: u''
    and: u'test_cache_failure_warns.py .'
    and: u''
    and: u'============================ pytest-warning summary ============================'
    and: u"WI1 /usr/lib64/python2.7/site-packages/pytest_capturelog.py:171 'pytest_runtest_makereport' hook uses deprecated __multicall__ argument"
fnmatch: '*could not create cache path*'
   with: u'WI9 None could not create cache path /var/tmp/portage/dev-python/pytest-2.8.7/temp/pytest-of-portage/pytest-0/testdir/test_cache_failure_warns0/.cache/v/cache/lastfailed'
nomatch: '*1 pytest-warnings*'
    and: u'================= 1 passed, 2 pytest-warnings in 0.01 seconds =================='
!!!!!!!!!!!!!!!!!!!! Interrupted: stopping after 1 failures !!!!!!!!!!!!!!!!!!!!
 1 failed, 189 passed, 2 skipped, 1 xfailed, 1 pytest-warnings in 39.69 seconds 
 * ERROR: dev-python/pytest-2.8.7::gentoo failed (test phase):
 *   tests failed with python2.7
 * 
 * Call stack:
 *     ebuild.sh, line  133:  Called src_test
 *   environment, line 3615:  Called distutils-r1_src_test
 *   environment, line  940:  Called _distutils-r1_run_foreach_impl 'python_test'
 *   environment, line  289:  Called python_foreach_impl 'distutils-r1_run_phase' 'python_test'
 *   environment, line 3122:  Called multibuild_foreach_variant '_python_multibuild_wrapper' 'distutils-r1_run_phase' 'python_test'
 *   environment, line 2224:  Called _multibuild_run '_python_multibuild_wrapper' 'distutils-r1_run_phase' 'python_test'
 *   environment, line 2222:  Called _python_multibuild_wrapper 'distutils-r1_run_phase' 'python_test'
 *   environment, line  565:  Called distutils-r1_run_phase 'python_test'
 *   environment, line  873:  Called python_test
 *   environment, line 3493:  Called die
 * The specific snippet of code:
 *           "${PYTHON}" "${BUILD_DIR}"/lib/pytest.py -x -v --runpytest=subprocess || die "tests failed with ${EPYTHON}";



If it is not immediately obvious, the warning

    WI1 /usr/lib64/python2.7/site-packages/pytest_capturelog.py:171 'pytest_runtest_makereport' hook uses deprecated __multicall__ argument

from a file installed by pytest-capturelog causes the number of pytest-warnings to be 2, rather than the expected 1.
Comment 1 eroen 2016-04-19 14:16:24 UTC
localhost ~ # emerge --info '=dev-python/pytest-2.8.7::gentoo'
Portage 2.2.26 (python 2.7.10-final-0, default/linux/amd64/13.0, gcc-4.9.3, glibc-2.22-r4, 4.1.15-gentoo-r1 x86_64)
=================================================================
                         System Settings
=================================================================
System uname: Linux-4.1.15-gentoo-r1-x86_64-Intel-R-_Core-TM-_i5-2520M_CPU_@_2.50GHz-with-gentoo-2.2
KiB Mem:     4043252 total,   3865132 free
KiB Swap:          0 total,         0 free
Timestamp of repository gentoo: Tue, 19 Apr 2016 00:45:01 +0000
sh bash 4.3_p42-r1
ld GNU ld (Gentoo 2.25.1 p1.1) 2.25.1
app-shells/bash:          4.3_p42-r1::gentoo
dev-lang/perl:            5.20.2::gentoo
dev-lang/python:          2.7.10-r1::gentoo, 3.4.3-r1::gentoo
dev-util/pkgconfig:       0.28-r2::gentoo
sys-apps/baselayout:      2.2::gentoo
sys-apps/openrc:          0.19.1::gentoo
sys-apps/sandbox:         2.10-r1::gentoo
sys-devel/autoconf:       2.69::gentoo
sys-devel/automake:       1.14.1::gentoo, 1.15::gentoo
sys-devel/binutils:       2.25.1-r1::gentoo
sys-devel/gcc:            4.9.3::gentoo
sys-devel/gcc-config:     1.7.3::gentoo
sys-devel/libtool:        2.4.6::gentoo
sys-devel/make:           4.1-r1::gentoo
sys-kernel/linux-headers: 4.3::gentoo (virtual/os-headers)
sys-libs/glibc:           2.22-r4::gentoo
Repositories:

gentoo
    location: /usr/portage
    sync-type: rsync
    sync-uri: rsync://rsync.gentoo.org/gentoo-portage
    priority: -1000

ACCEPT_KEYWORDS="amd64"
ACCEPT_LICENSE="* -@EULA"
CBUILD="x86_64-pc-linux-gnu"
CFLAGS="-O2 -pipe"
CHOST="x86_64-pc-linux-gnu"
CONFIG_PROTECT="/etc"
CONFIG_PROTECT_MASK="/etc/ca-certificates.conf /etc/env.d /etc/gconf /etc/gentoo-release /etc/sandbox.d /etc/terminfo"
CXXFLAGS="-O2 -pipe"
DISTDIR="/usr/portage/distfiles"
FCFLAGS="-O2 -pipe"
FEATURES="assume-digests binpkg-logs config-protect-if-modified distlocks ebuild-locks fixlafiles merge-sync news parallel-fetch preserve-libs protect-owned sandbox sfperms strict unknown-features-warn unmerge-logs unmerge-orphans userfetch userpriv usersandbox usersync xattr"
FFLAGS="-O2 -pipe"
GENTOO_MIRRORS="http://distfiles.gentoo.org"
LDFLAGS="-Wl,-O1 -Wl,--as-needed"
PKGDIR="/usr/portage/packages"
PORTAGE_CONFIGROOT="/"
PORTAGE_RSYNC_OPTS="--recursive --links --safe-links --perms --times --omit-dir-times --compress --force --whole-file --delete --stats --human-readable --timeout=180 --exclude=/distfiles --exclude=/local --exclude=/packages"
PORTAGE_TMPDIR="/var/tmp"
USE="acl amd64 berkdb bindist bzip2 cli cracklib crypt cxx dri fortran gdbm iconv ipv6 mmx mmxext modules multilib ncurses nls nptl openmp pam pcre readline seccomp session sse sse2 ssl tcpd unicode xattr zlib" ABI_X86="64" ALSA_CARDS="ali5451 als4000 atiixp atiixp-modem bt87x ca0106 cmipci emu10k1x ens1370 ens1371 es1938 es1968 fm801 hda-intel intel8x0 intel8x0m maestro3 trident usb-audio via82xx via82xx-modem ymfpci" APACHE2_MODULES="authn_core authz_core socache_shmcb unixd actions alias auth_basic authn_alias authn_anon authn_dbm authn_default authn_file authz_dbm authz_default authz_groupfile authz_host authz_owner authz_user autoindex cache cgi cgid dav dav_fs dav_lock deflate dir disk_cache env expires ext_filter file_cache filter headers include info log_config logio mem_cache mime mime_magic negotiation rewrite setenvif speling status unique_id userdir usertrack vhost_alias" CALLIGRA_FEATURES="kexi words flow plan sheets stage tables krita karbon braindump author" CAMERAS="ptp2" COLLECTD_PLUGINS="df interface irq load memory rrdtool swap syslog" CPU_FLAGS_X86="mmx mmxext sse sse2" ELIBC="glibc" GPSD_PROTOCOLS="ashtech aivdm earthmate evermore fv18 garmin garmintxt gpsclock itrax mtk3301 nmea ntrip navcom oceanserver oldstyle oncore rtcm104v2 rtcm104v3 sirf superstar2 timing tsip tripmate tnt ublox ubx" INPUT_DEVICES="keyboard mouse evdev" KERNEL="linux" LCD_DEVICES="bayrad cfontz cfontz633 glk hd44780 lb216 lcdm001 mtxorb ncurses text" LIBREOFFICE_EXTENSIONS="presenter-console presenter-minimizer" OFFICE_IMPLEMENTATION="libreoffice" PHP_TARGETS="php5-5" PYTHON_SINGLE_TARGET="python2_7" PYTHON_TARGETS="python2_7 python3_4" RUBY_TARGETS="ruby20 ruby21" USERLAND="GNU" VIDEO_CARDS="fbdev glint intel mach64 mga nouveau nv r128 radeon savage sis tdfx trident vesa via vmware dummy v4l" XTABLES_ADDONS="quota2 psd pknock lscan length2 ipv4options ipset ipp2p iface geoip fuzzy condition tee tarpit sysrq steal rawnat logmark ipmark dhcpmac delude chaos account"
Unset:  CC, CPPFLAGS, CTARGET, CXX, EMERGE_DEFAULT_OPTS, INSTALL_MASK, LANG, LC_ALL, MAKEOPTS, PORTAGE_BUNZIP2_COMMAND, PORTAGE_COMPRESS, PORTAGE_COMPRESS_FLAGS, PORTAGE_RSYNC_EXTRA_OPTS, USE_PYTHON

localhost ~ # emerge -pqv '=dev-python/pytest-2.8.7::gentoo'
[ebuild  N    ] dev-python/pytest-2.8.7  USE="{test} -doc" PYTHON_TARGETS="python2_7 python3_4 -pypy -pypy3 -python3_3 -python3_5" 

 * IMPORTANT: 9 news items need reading for repository 'gentoo'.
 * Use eselect news read to view new items.
Comment 2 eroen 2016-04-19 14:16:58 UTC
[ebuild   R   ] dev-python/pytest-capturelog-0.7  USE="{-test}" PYTHON_TARGETS="python2_7 python3_4 -pypy -pypy3 -python3_3 -python3_5"
Comment 3 eroen 2016-11-30 20:38:18 UTC
Created attachment 454794 [details]
pytest-3.0.4 build.log

With pytest-3.0.4, a large number of tests fail if dev-python/pytest-capturelog-0.7 is installed. The test suite passes if pytest-capturelog is not installed.


=================================== FAILURES ===================================
_______________________ TestDurations.test_calls_show_2 ________________________

self = <acceptance_test.TestDurations instance at 0x7efebd603ea8>
testdir = <Testdir local('/var/tmp/portage/dev-python/pytest-3.0.4/temp/pytest-of-portage/pytest-0/testdir/test_calls_show_20')>

    def test_calls_show_2(self, testdir):
        testdir.makepyfile(self.source)
        result = testdir.runpytest("--durations=2")
        assert result.ret == 0
        lines = result.stdout.get_lines_after("*slowest*durations*")
>       assert "4 passed" in lines[2]
E       assert '4 passed' in '============================ pytest-warning summary ============================'

../../../../../work/pytest-3.0.4/testing/acceptance_test.py:703: AssertionError
----------------------------- Captured stdout call -----------------------------
============================= test session starts ==============================
platform linux2 -- Python 2.7.12, pytest-3.0.4, py-1.4.30, pluggy-0.4.0
rootdir: /var/tmp/portage/dev-python/pytest-3.0.4/temp/pytest-of-portage/pytest-0/testdir/test_calls_show_20, inifile: 
plugins: hypothesis-3.6.0, xdist-1.15.0, capturelog-0.7
collected 4 items

test_calls_show_2.py ....

=========================== slowest 2 test durations ===========================
0.02s call     test_calls_show_2.py::test_3
0.01s call     test_calls_show_2.py::test_2
============================ pytest-warning summary ============================
WI1 /usr/lib64/python2.7/site-packages/pytest_capturelog.py:171 'pytest_runtest_makereport' hook uses deprecated __multicall__ argument
WC1 None pytest_funcarg__caplog: declaring fixtures using "pytest_funcarg__" prefix is deprecated and scheduled to be removed in pytest 4.0.  Please remove the prefix and use the @pytest.fixture decorator instead.
WC1 None pytest_funcarg__capturelog: declaring fixtures using "pytest_funcarg__" prefix is deprecated and scheduled to be removed in pytest 4.0.  Please remove the prefix and use the @pytest.fixture decorator instead.
================= 4 passed, 3 pytest-warnings in 0.04 seconds ==================
(...)
 56 failed, 1616 passed, 40 skipped, 13 xfailed, 3 pytest-warnings in 115.40 seconds 
 * ERROR: dev-python/pytest-3.0.4::gentoo failed (test phase):
 *   tests failed with python2.7
 * 
 * Call stack:
 *     ebuild.sh, line  115:  Called src_test
 *   environment, line 2641:  Called distutils-r1_src_test
 *   environment, line  825:  Called _distutils-r1_run_foreach_impl 'python_test'
 *   environment, line  316:  Called python_foreach_impl 'distutils-r1_run_phase' 'python_test'
 *   environment, line 2144:  Called multibuild_foreach_variant '_python_multibuild_wrapper' 'distutils-r1_run_phase' 'python_test'
 *   environment, line 1448:  Called _multibuild_run '_python_multibuild_wrapper' 'distutils-r1_run_phase' 'python_test'
 *   environment, line 1446:  Called _python_multibuild_wrapper 'distutils-r1_run_phase' 'python_test'
 *   environment, line  516:  Called distutils-r1_run_phase 'python_test'
 *   environment, line  757:  Called python_test
 *   environment, line 2519:  Called die
 * The specific snippet of code:
 *           "${PYTHON}" "${BUILD_DIR}"/lib/pytest.py -v testing || die "tests failed with ${EPYTHON}";
Comment 4 Michał Górny archtester Gentoo Infrastructure gentoo-dev Security 2019-04-09 14:12:11 UTC
pytest-capturelog is removed now.