Gentoo Websites Logo
Go to: Gentoo Home Documentation Forums Lists Bugs Planet Store Wiki Get Gentoo!
Bug 701336 - dev-python/coverage-4.5.4 fails several tests with pypy
Summary: dev-python/coverage-4.5.4 fails several tests with pypy
Status: RESOLVED OBSOLETE
Alias: None
Product: Gentoo Linux
Classification: Unclassified
Component: Current packages (show other bugs)
Hardware: All Linux
: Normal normal (vote)
Assignee: Robin Johnson
URL:
Whiteboard:
Keywords: TESTFAILURE
Depends on:
Blocks:
 
Reported: 2019-11-27 15:11 UTC by Paolo Pedroni
Modified: 2021-03-02 00:30 UTC (History)
2 users (show)

See Also:
Package list:
Runtime testing required: ---


Attachments
coverage-4.5.4:20191127-145442.log.gz (coverage-4.5.4:20191127-145442.log.gz,20.56 KB, application/gzip)
2019-11-27 15:11 UTC, Paolo Pedroni
Details

Note You need to log in before you can comment on or make changes to this bug.
Description Paolo Pedroni 2019-11-27 15:11:27 UTC
Created attachment 597604 [details]
coverage-4.5.4:20191127-145442.log.gz

=== PyPy 2.7.13 (pypy 7.2.0.final.0) with Python tracer (../../../../../../../usr/bin/pypy) ===
======================================================== test session starts ========================================================
platform linux2 -- Python 2.7.13[pypy-7.2.0-final], pytest-4.5.0, py-1.5.4, pluggy-0.11.0
rootdir: /var/tmp/portage/dev-python/coverage-4.5.4/work/coverage-4.5.4-pypy, inifile: setup.cfg
plugins: virtualenv-1.2.11, shutil-1.2.11, hypothesis-3.59.1, flaky-3.6.1
collected 797 items
[...]
====================================================== short test summary info ======================================================
FAILED tests/test_arcs.py::MiscArcTest::test_pathologically_long_code_object - AssertionError: 2 failed assertions:
FAILED tests/test_concurrency.py::MultiprocessingTest::test_multiprocessing_with_branching - AssertionError: Regex didn't match: '...
FAILED tests/test_farm.py::test_farm[tests/farm/annotate/run_multi.py] - Exception: command exited abnormally
FAILED tests/test_html.py::HtmlWithUnparsableFilesTest::test_dothtml_not_python - AssertionError: '' != 'No data to report.'
FAILED tests/test_process.py::ProcessTest::test_combine_with_aliases - AssertionError: 3 != 1
FAILED tests/test_process.py::ProcessTest::test_combine_with_rc - AssertionError: 'Name                                           ...
FAILED tests/test_process.py::AliasedCommandTest::test_wrong_alias_doesnt_work - AssertionError: 'Code coverage for Python' unexpe...
FAILED tests/test_process.py::FailUnderTest::test_report_42p86_is_not_ok - AssertionError: 'TOTAL 486 478 1.65%' != 'forty_two_plu...
FAILED tests/test_process.py::FailUnderTest::test_report_43_is_not_ok - AssertionError: 'TOTAL 486 478 2%' != 'forty_two_plus.py 7...
FAILED tests/test_process.py::FailUnderTest::test_report_43_is_ok - AssertionError: 2 != 0
FAILED tests/test_process.py::UnicodeFilePathsTest::test_accented_directory - AssertionError: 'Name                               ...
FAILED tests/test_process.py::UnicodeFilePathsTest::test_accented_dot_py - AssertionError: 'Name                                  ...
FAILED tests/test_summary.py::SummaryTest::test_report - AssertionError: 'TOTAL 487 474 3%' != 'TOTAL 8 0 100%'
FAILED tests/test_summary.py::SummaryTest::test_report_branches - AssertionError: 7 != 3
FAILED tests/test_summary.py::SummaryTest::test_report_omitting - AssertionError: 7 != 3
FAILED tests/test_summary.py::SummaryTest::test_report_precision - AssertionError: 9 != 7 : Name                                  ...
FAILED tests/test_summary.py::SummaryTest::test_report_show_missing - AssertionError: 7 != 3
FAILED tests/test_summary.py::SummaryTest::test_report_show_missing_branches - AssertionError: 7 != 3
FAILED tests/test_summary.py::SummaryTest::test_report_show_missing_branches_and_lines - AssertionError: Lists differ: ['Name     ...
FAILED tests/test_summary.py::SummaryTest::test_report_skip_covered_all_files_covered - AssertionError: 8 != 4 : Name             ...
FAILED tests/test_summary.py::SummaryTest::test_report_skip_covered_branches - AssertionError: 9 != 7 : Name                      ...
FAILED tests/test_summary.py::SummaryTest::test_report_skip_covered_branches_with_totals - AssertionError: 10 != 8 : Name         ...
FAILED tests/test_summary.py::SummaryTest::test_report_skip_covered_longfilename - AssertionError: 8 != 4 : Name                  ...
FAILED tests/test_summary.py::SummaryTest::test_report_skip_covered_no_branches - AssertionError: 9 != 7 : Name                   ...
======================================== 24 failed, 729 passed, 44 skipped in 180.00 seconds ========================================
 * ERROR: dev-python/coverage-4.5.4::gentoo failed (test phase):
 *   (no error message)

Tests work "as expected" with python-2.7 and python-3.7 (1 failure as in bug #700458), but pypy (and pypy3 as well) give many more errors.

# emerge --info =dev-python/coverage-4.5.4
Portage 2.3.79 (python 3.7.5-final-0, default/linux/amd64/17.1/desktop/plasma/systemd, gcc-9.2.0, glibc-2.29-r2, 5.3.12-gentoo x86_64)
=================================================================
                         System Settings
=================================================================
System uname: Linux-5.3.12-gentoo-x86_64-Intel-R-_Core-TM-_i5-8400_CPU_@_2.80GHz-with-gentoo-2.6
KiB Mem:    16129872 total,    784092 free
KiB Swap:   16777212 total,  16737084 free
Timestamp of repository gentoo: Wed, 27 Nov 2019 08:30:01 +0000
Head commit of repository gentoo: 7edee983d2a0d55012a7b4ce162f1f1fd860500b
sh dash 0.5.9.1-r3
ld GNU gold (Gentoo 2.32 p2 2.32.0) 1.16
distcc 3.3.3 x86_64-pc-linux-gnu [disabled]
ccache version 3.7.4 [disabled]
app-shells/bash:          4.4_p23-r1::gentoo
dev-java/java-config:     2.2.0-r4::gentoo
dev-lang/perl:            5.28.2-r1::gentoo
dev-lang/python:          2.7.16::gentoo, 3.7.5-r1::gentoo
dev-util/ccache:          3.7.4::gentoo
dev-util/cmake:           3.14.6::gentoo
sys-apps/baselayout:      2.6-r1::gentoo
sys-apps/sandbox:         2.13::gentoo
sys-devel/autoconf:       2.13-r1::gentoo, 2.69-r4::gentoo
sys-devel/automake:       1.16.1-r1::gentoo
sys-devel/binutils:       2.32-r1::gentoo
sys-devel/gcc:            9.2.0-r2::gentoo
sys-devel/gcc-config:     2.1::gentoo
sys-devel/libtool:        2.4.6-r3::gentoo
sys-devel/make:           4.2.1-r4::gentoo
sys-kernel/linux-headers: 4.19::gentoo (virtual/os-headers)
sys-libs/glibc:           2.29-r2::gentoo
Repositories:

gentoo
    location: /usr/portage
    sync-type: rsync
    sync-uri: rsync://rsync.gentoo.org/gentoo-portage
    priority: -1000
    sync-rsync-verify-jobs: 1
    sync-rsync-verify-max-age: 24
    sync-rsync-verify-metamanifest: yes
    sync-rsync-extra-opts: 

x-portage
    location: /usr/local/portage
    masters: gentoo
    priority: 0

ACCEPT_KEYWORDS="amd64"
ACCEPT_LICENSE="* -@EULA"
CBUILD="x86_64-pc-linux-gnu"
CFLAGS="-O2 -pipe -frecord-gcc-switches -march=skylake -mabm -flto=6"
CHOST="x86_64-pc-linux-gnu"
CONFIG_PROTECT="/etc /usr/lib64/libreoffice/program/sofficerc /usr/share/config /usr/share/gnupg/qualified.txt"
CONFIG_PROTECT_MASK="/etc/ca-certificates.conf /etc/dconf /etc/env.d /etc/fonts/fonts.conf /etc/gconf /etc/gentoo-release /etc/revdep-rebuild /etc/sandbox.d /etc/terminfo"
CXXFLAGS="-O2 -pipe -frecord-gcc-switches -march=skylake -mabm -flto=6"
DISTDIR="/usr/portage/distfiles"
EMERGE_DEFAULT_OPTS="--keep-going y --with-bdeps y"
ENV_UNSET="DBUS_SESSION_BUS_ADDRESS DISPLAY GOBIN PERL5LIB PERL5OPT PERLPREFIX PERL_CORE PERL_MB_OPT PERL_MM_OPT XAUTHORITY XDG_CACHE_HOME XDG_CONFIG_HOME XDG_DATA_HOME XDG_RUNTIME_DIR"
FCFLAGS="-O2 -pipe -frecord-gcc-switches -march=skylake -mabm -flto=6"
FEATURES="assume-digests binpkg-docompress binpkg-dostrip binpkg-logs cgroup compress-build-logs config-protect-if-modified distlocks ebuild-locks ipc-sandbox merge-sync multilib-strict network-sandbox news parallel-fetch pid-sandbox preserve-libs protect-owned sandbox sfperms sign split-elog split-log strict strict-keepdir test unknown-features-warn unmerge-logs unmerge-orphans userfetch userpriv usersandbox usersync xattr"
FFLAGS="-O2 -pipe -frecord-gcc-switches -march=skylake -mabm -flto=6"
GENTOO_MIRRORS="http://mirrors.evowise.com/gentoo/ https://mirrors.evowise.com/gentoo/ http://mirror.eu.oneandone.net/linux/distributions/gentoo/gentoo/ http://mirror.netcologne.de/gentoo/"
LANG="it_IT.utf8"
LDFLAGS="-Wl,-O1 -Wl,--as-needed -Wl,--hash-style=gnu -Wl,--sort-common -flto=6"
LINGUAS="it it_IT"
MAKEOPTS="-j7 -l6"
PKGDIR="/var/cache/binpkgs"
PORTAGE_CONFIGROOT="/"
PORTAGE_RSYNC_OPTS="--recursive --links --safe-links --perms --times --omit-dir-times --compress --force --whole-file --delete --stats --human-readable --timeout=180 --exclude=/distfiles --exclude=/local --exclude=/packages --exclude=/.git"
PORTAGE_TMPDIR="/var/tmp"
USE="X a52 aac aalib acl acpi activities adns alsa amd64 ao audiofile bash-completion bluetooth branding bzip2 cairo caps cdda cddb cdparanoia cdr cli crypt css cups curl cxx dbus declarative dga djvu dri dts dvd dvdr emboss encode exif expat fbcon ffmpeg fftw flac fontconfig foomaticdb fortran ftp gd gdbm geoip gif gimp gmp gnutls gphoto2 gpm graphviz gtk handbook iconv icu idn imagemagick imlib ipv6 java javascript jbig jemalloc jpeg jpeg2k kde kipi kwallet lame lcms libass libnotify libsamplerate libtirpc lm_sensors lua lzma lzo mad mmap mng mp3 mp4 mpeg mplayer multilib musicbrainz ncurses nls nptl nsplugin offensive ogg openal opengl openmp pam pango pcre pdf phonon plasma png policykit postscript ppds pulseaudio qml qt5 rdesktop readline recode samba sctp sdl seccomp sndfile sockets speex spell split-usr sqlite ssl startup-notification subversion svg symlink syslog systemd sysvipc taglib test theora threads tidy tiff truetype udev udisks unicode upower usb vaapi vala vcd vim-syntax vnc vorbis wavpack wayland widgets win32codecs wmf wxwidgets x264 xattr xcb xcomposite xine xml xpm xscreensaver xv xvid yahoo zlib zstd" ABI_X86="64" ADA_TARGET="gnat_2018" ALSA_CARDS="hda-intel virmidi" APACHE2_MODULES="authn_core authz_core socache_shmcb unixd actions alias auth_basic authn_alias authn_anon authn_dbm authn_default authn_file authz_dbm authz_default authz_groupfile authz_host authz_owner authz_user autoindex cache cgi cgid dav dav_fs dav_lock deflate dir disk_cache env expires ext_filter file_cache filter headers include info log_config logio mem_cache mime mime_magic negotiation rewrite setenvif speling status unique_id userdir usertrack vhost_alias" CALLIGRA_FEATURES="karbon sheets words" CAMERAS="kodak ptp2" COLLECTD_PLUGINS="df interface irq load memory rrdtool swap syslog" CPU_FLAGS_X86="aes avx avx2 f16c fma3 mmx mmxext pclmul popcnt sse sse2 sse3 sse4_1 sse4_2 ssse3" CURL_SSL="gnutls" ELIBC="glibc" GPSD_PROTOCOLS="ashtech aivdm earthmate evermore fv18 garmin garmintxt gpsclock greis isync itrax mtk3301 nmea ntrip navcom oceanserver oldstyle oncore rtcm104v2 rtcm104v3 sirf skytraq superstar2 timing tsip tripmate tnt ublox ubx" INPUT_DEVICES="libinput" KERNEL="linux" L10N="it en" LCD_DEVICES="bayrad cfontz cfontz633 glk hd44780 lb216 lcdm001 mtxorb ncurses text" LIBREOFFICE_EXTENSIONS="nlpsolver wiki-publisher" NETBEANS_MODULES="apisupport cnd groovy gsf harness ide identity j2ee java mobility nb php profiler soa visualweb webcommon websvccommon xml" OFFICE_IMPLEMENTATION="libreoffice" PHP_TARGETS="php7-2" POSTGRES_TARGETS="postgres10 postgres11" PYTHON_SINGLE_TARGET="python3_7" PYTHON_TARGETS="python2_7 python3_7 pypy pypy3" RUBY_TARGETS="ruby24" USERLAND="GNU" VIDEO_CARDS="intel i965" XTABLES_ADDONS="quota2 psd pknock lscan length2 ipv4options ipset ipp2p iface geoip fuzzy condition tee tarpit sysrq steal rawnat logmark ipmark dhcpmac delude chaos account"
Unset:  CC, CPPFLAGS, CTARGET, CXX, INSTALL_MASK, LC_ALL, PORTAGE_BINHOST, PORTAGE_BUNZIP2_COMMAND, PORTAGE_COMPRESS, PORTAGE_COMPRESS_FLAGS, PORTAGE_RSYNC_EXTRA_OPTS

# emerge -1pqv =dev-python/coverage-4.5.4
[ebuild     U ] dev-python/coverage-4.5.4 [4.5.2] USE="test*" PYTHON_TARGETS="pypy pypy3 python2_7 python3_7 -python3_5 -python3_6 -python3_8%"
Comment 1 Paolo Pedroni 2019-11-27 15:15:00 UTC
Failing tests with pypy3 are:
====================================================== short test summary info ======================================================
FAILED tests/test_arcs.py::SimpleArcTest::test_multiline - AssertionError: 2 failed assertions:
FAILED tests/test_arcs.py::LoopArcTest::test_multiline_dict_comp - AssertionError: 2 failed assertions:
FAILED tests/test_arcs.py::MiscArcTest::test_dict_literal - AssertionError: 2 failed assertions:
FAILED tests/test_arcs.py::MiscArcTest::test_pathologically_long_code_object - AssertionError: 2 failed assertions:
FAILED tests/test_arcs.py::MiscArcTest::test_unpacked_literals - AssertionError: 2 failed assertions:
FAILED tests/test_arcs.py::LambdaArcTest::test_multiline_lambda - AssertionError: 2 failed assertions:
FAILED tests/test_process.py::ProcessTest::test_lang_c - AssertionError: 'Traceback (most recent call last):\n  Fil[223 chars]8)\n...
FAILED tests/test_process.py::AliasedCommandTest::test_wrong_alias_doesnt_work - AssertionError: 'Code coverage for Python' unexpe...
======================================== 8 failed, 755 passed, 34 skipped in 215.89 seconds =========================================
Comment 2 Michał Górny archtester Gentoo Infrastructure gentoo-dev Security 2021-03-02 00:30:56 UTC
Tests are now restricted.