Bug 832833 – dev-python/ipyparallel-8.1.0-r1: fails tests (just timeouts?)

• Product: Gentoo Linux
• Status: RESOLVED OBSOLETE

[Description Sam James 2022-02-07 08:26:35 UTC]

Created attachment 764500 [details]
build.log

-- Docs: https://docs.pytest.org/en/stable/warnings.html
========================================================================= short test summary info =========================================================================
SKIPPED [1] ipyparallel/tests/clienttest.py:86: Test requires distributed
SKIPPED [3] ipyparallel/tests/test_joblib.py:25: Requires joblib >= 0.10
SKIPPED [5] ipyparallel/tests/test_mpi.py:24: Requires mpiexec
SKIPPED [5] ipyparallel/tests/test_slurm.py:18: Requires slurm
SKIPPED [10] ipyparallel/tests/conftest.py:171: Needs docker compose
SKIPPED [6] ipyparallel/tests/clienttest.py:86: Test requires cloudpickle
SKIPPED [2] ipyparallel/tests/clienttest.py:86: Test requires pandas
XFAIL ipyparallel/tests/test_view_broadcast.py::TestBroadcastViewCoalescing::test_target_ordering
  coalescing view doesn't preserve target order
XPASS ipyparallel/tests/test_view_broadcast.py::TestBroadcastViewCoalescing::test_apply_displaypub displaypub ordering not preserved
XPASS ipyparallel/tests/test_view_broadcast.py::TestBroadcastViewCoalescing::test_map map not yet implemented
XPASS ipyparallel/tests/test_view_broadcast.py::TestBroadcastViewCoalescing::test_map_empty_sequence map not yet implemented
XPASS ipyparallel/tests/test_view_broadcast.py::TestBroadcastViewCoalescing::test_map_iterable map not yet implemented
XPASS ipyparallel/tests/test_view_broadcast.py::TestBroadcastViewCoalescing::test_map_numpy map not yet implemented
XPASS ipyparallel/tests/test_view_broadcast.py::TestBroadcastViewCoalescing::test_map_ref map not yet implemented
XPASS ipyparallel/tests/test_view_broadcast.py::TestBroadcastViewCoalescing::test_map_reference map not yet implemented
XPASS ipyparallel/tests/test_view_broadcast.py::TestBroadcastViewCoalescing::test_scatter_tracked Tracking gets disconnected from original message
FAILED ipyparallel/tests/test_asyncresult.py::AsyncResultTest::test_map_wait_first_exception - AssertionError: assert 4 == 1
FAILED ipyparallel/tests/test_view.py::TestView::test_compositeerror_render_exception - AssertionError: 0 != 4 : -------------------------------------------------------...
FAILED ipyparallel/tests/test_view_broadcast.py::TestBroadcastViewCoalescing::test_compositeerror_render_exception - AssertionError: 0 != 4 : --------------------------...
FAILED ipyparallel/tests/test_view_broadcast.py::TestBroadcastViewCoalescing::test_execute_raises - TimeoutError: Result not ready.
================================ 4 failed, 419 passed, 32 skipped, 25 deselected, 1 xfailed, 8 xpassed, 299 warnings in 799.73s (0:13:19) =================================
 * ERROR: dev-python/ipyparallel-8.1.0-r1::gentoo failed (test phase):
 *   pytest failed with python3.8
 * 

----

# emerge --info
Portage 3.0.30 (python 3.9.10-final-0, default/linux/arm/17.0/armv7a, gcc-11.2.1, glibc-2.34-r6, 5.15.16-gentoo-dist armv8l)
=================================================================
System uname: Linux-5.15.16-gentoo-dist-armv8l-ARMv8_Processor_rev_1_-v8l-with-glibc2.34
KiB Mem:   131629944 total,  66876664 free
KiB Swap:   25067512 total,  25067512 free
Timestamp of repository gentoo: Mon, 07 Feb 2022 08:07:05 +0000
sh bash 5.1_p16
ld GNU ld (Gentoo 2.37_p1 p1) 2.37
app-misc/pax-utils:        1.3.3::gentoo
app-shells/bash:           5.1_p16::gentoo
dev-lang/perl:             5.34.0-r6::gentoo
dev-lang/python:           3.8.12_p1-r1::gentoo, 3.9.10::gentoo, 3.10.2::gentoo
dev-lang/rust-bin:         1.58.1::gentoo
dev-util/cmake:            3.22.1::gentoo
dev-util/meson:            0.61.1::gentoo
sys-apps/baselayout:       2.8::gentoo
sys-apps/openrc:           0.44.10::gentoo
sys-apps/sandbox:          2.29::gentoo
sys-devel/autoconf:        2.13-r1::gentoo, 2.71-r1::gentoo
sys-devel/automake:        1.16.5::gentoo
sys-devel/binutils:        2.37_p1-r1::gentoo
sys-devel/binutils-config: 5.4::gentoo
sys-devel/gcc:             11.2.1_p20220115::gentoo
sys-devel/gcc-config:      2.5-r1::gentoo
sys-devel/libtool:         2.4.6-r6::gentoo
sys-devel/llvm:            13.0.1::gentoo
sys-devel/make:            4.3::gentoo
sys-kernel/linux-headers:  5.16::gentoo (virtual/os-headers)
sys-libs/glibc:            2.34-r6::gentoo
Repositories:

gentoo
    location: /var/db/repos/gentoo
    sync-type: rsync
    sync-uri: rsync://rsync.gentoo.org/gentoo-portage
    priority: -1000
    sync-rsync-extra-opts: 
    sync-rsync-verify-metamanifest: yes
    sync-rsync-verify-jobs: 1
    sync-rsync-verify-max-age: 24

ACCEPT_KEYWORDS="arm ~arm"
ACCEPT_LICENSE="*"
CBUILD="armv7a-unknown-linux-gnueabihf"
CFLAGS="-O2 -pipe -march=armv7-a -mfpu=vfpv3-d16 -mfloat-abi=hard -frecord-gcc-switches"
CHOST="armv7a-unknown-linux-gnueabihf"
CONFIG_PROTECT="/etc /usr/share/gnupg/qualified.txt"
CONFIG_PROTECT_MASK="/etc/ca-certificates.conf /etc/dconf /etc/env.d /etc/fonts/fonts.conf /etc/gconf /etc/gentoo-release /etc/php/apache2-php7.4/ext-active/ /etc/php/apache2-php8.1/ext-active/ /etc/php/cgi-php7.4/ext-active/ /etc/php/cgi-php8.1/ext-active/ /etc/php/cli-php7.4/ext-active/ /etc/php/cli-php8.1/ext-active/ /etc/revdep-rebuild /etc/sandbox.d /etc/terminfo /etc/texmf/language.dat.d /etc/texmf/language.def.d /etc/texmf/updmap.d /etc/texmf/web2c"
CXXFLAGS="-O2 -pipe -march=armv7-a -mfpu=vfpv3-d16 -mfloat-abi=hard -frecord-gcc-switches"
DISTDIR="/var/cache/distfiles"
EMERGE_DEFAULT_OPTS="--keep-going --complete-graph --usepkg=y --with-bdeps=y --deep"
ENV_UNSET="CARGO_HOME DBUS_SESSION_BUS_ADDRESS DISPLAY GOBIN GOPATH PERL5LIB PERL5OPT PERLPREFIX PERL_CORE PERL_MB_OPT PERL_MM_OPT XAUTHORITY XDG_CACHE_HOME XDG_CONFIG_HOME XDG_DATA_HOME XDG_RUNTIME_DIR"
FCFLAGS="-O2 -pipe -march=armv7-a -mfpu=vfpv3-d16 -mfloat-abi=hard -frecord-gcc-switches"
FEATURES="assume-digests binpkg-docompress binpkg-dostrip binpkg-logs binpkg-multi-instance buildpkg buildpkg-live config-protect-if-modified distlocks ebuild-locks fixlafiles ipc-sandbox multilib-strict network-sandbox news parallel-fetch parallel-install pid-sandbox preserve-libs protect-owned qa-unresolved-soname-deps sandbox sfperms strict unknown-features-warn unmerge-logs unmerge-orphans userfetch userpriv usersandbox usersync xattr"
FFLAGS="-O2 -pipe -march=armv7-a -mfpu=vfpv3-d16 -mfloat-abi=hard -frecord-gcc-switches"
GENTOO_MIRRORS="http://distfiles.gentoo.org"
LANG="en_US.utf8"
LDFLAGS="-Wl,-O1 -Wl,--as-needed -Wl,--defsym=__gentoo_check_ldflags__=0"
PKGDIR="/var/cache/binpkgs"
PORTAGE_CONFIGROOT="/"
PORTAGE_RSYNC_OPTS="--recursive --links --safe-links --perms --times --omit-dir-times --compress --force --whole-file --delete --stats --human-readable --timeout=180 --exclude=/distfiles --exclude=/local --exclude=/packages --exclude=/.git"
PORTAGE_TMPDIR="/var/tmp"
SHELL="/bin/bash"
USE="acl arm bzip2 cli crypt dbus dri elogind fortran gdbm iconv ipv6 libglvnd ncurses nls nptl openmp pam pcre readline seccomp split-usr ssl unicode xattr zlib" ADA_TARGET="gnat_2020" APACHE2_MODULES="authn_core authz_core socache_shmcb unixd actions alias auth_basic authn_alias authn_anon authn_dbm authn_default authn_file authz_dbm authz_default authz_groupfile authz_host authz_owner authz_user autoindex cache cgi cgid dav dav_fs dav_lock deflate dir disk_cache env expires ext_filter file_cache filter headers include info log_config logio mem_cache mime mime_magic negotiation rewrite setenvif speling status unique_id userdir usertrack vhost_alias" CALLIGRA_FEATURES="karbon sheets words" COLLECTD_PLUGINS="df interface irq load memory rrdtool swap syslog" CPU_FLAGS_ARM="edsp thumb thumb2 v4 v5 v6 v7 vfp" ELIBC="glibc" GPSD_PROTOCOLS="ashtech aivdm earthmate evermore fv18 garmin garmintxt gpsclock greis isync itrax mtk3301 nmea ntrip navcom oceanserver oldstyle oncore rtcm104v2 rtcm104v3 sirf skytraq superstar2 timing tsip tripmate tnt ublox ubx" INPUT_DEVICES="libinput" KERNEL="linux" L10N="en en-US en-GB" LCD_DEVICES="bayrad cfontz cfontz633 glk hd44780 lb216 lcdm001 mtxorb ncurses text" LIBREOFFICE_EXTENSIONS="presenter-console presenter-minimizer" LUA_SINGLE_TARGET="lua5-1" LUA_TARGETS="lua5-1" OFFICE_IMPLEMENTATION="libreoffice" PHP_TARGETS="php7-4 php8-0" POSTGRES_TARGETS="postgres12 postgres13" PYTHON_SINGLE_TARGET="python3_9" PYTHON_TARGETS="python3_9 python3_8" RUBY_TARGETS="ruby26 ruby27" USERLAND="GNU" VIDEO_CARDS="exynos fbdev omap dummy v4l" XTABLES_ADDONS="quota2 psd pknock lscan length2 ipv4options ipset ipp2p iface geoip fuzzy condition tee tarpit sysrq proto steal rawnat logmark ipmark dhcpmac delude chaos account"
Unset:  ADDR2LINE, AR, ARFLAGS, AS, ASFLAGS, CC, CCLD, CONFIG_SHELL, CPP, CPPFLAGS, CTARGET, CXX, CXXFILT, ELFEDIT, EXTRA_ECONF, F77FLAGS, FC, GCOV, GPROF, INSTALL_MASK, LC_ALL, LD, LEX, LFLAGS, LIBTOOL, LINGUAS, MAKE, MAKEFLAGS, MAKEOPTS, NM, OBJCOPY, OBJDUMP, PORTAGE_BINHOST, PORTAGE_BUNZIP2_COMMAND, PORTAGE_COMPRESS, PORTAGE_COMPRESS_FLAGS, PORTAGE_RSYNC_EXTRA_OPTS, RANLIB, READELF, RUSTFLAGS, SIZE, STRINGS, STRIP, YACC, YFLAGS

[Comment 1 Sam James 2022-02-07 08:51:55 UTC]

Same on ia64, which figures. Seems like mostly/all timeouts, so not worried.

[Comment 2 Alex Fan 2022-02-10 09:48:03 UTC]

reproduced in riscv as well.

TestBroadcastViewCoalescing::test_compositeerror_render_exception (inherited from TestView::test_compositeerror_render_exception) and TestBroadcastViewCoalescing::test_execute_raises seem to relate to client/asyncresult::get(timeout=None) when there is an exception happens. https://github.com/ipython/ipyparallel/blob/a8e721e5fe940e1eb41d64a2affbb5d2e8e9c1f4/ipyparallel/client/asyncresult.py#L313 seems to be the piece to blame. But magically, these tests succeed if I load it in debugger.

Additionally, if mpiexec, cloudpickle, pandas are installed, ipyparallel/tests/clienttest.py and test_magics.py::TestParallelMagics::test_cellpx_stream will  fail. These are purely timeout. ipyparallel/tests/test_mpi.py may also fail due to mpi oversubscribing.