Bug 909567 – dev-python/websockets-11.0.3-r1 fails tests if sys-apps/pkgcore is not installed

• Product: Gentoo Linux
• Status: CONFIRMED ---

[Description Paolo Pedroni 2023-07-03 15:46:02 UTC]

Created attachment 865097 [details]
websockets-11.0.3-r1:20230703-151853.log.gz - No pkgcore, tests fail

Without dev-python/pkgcore:
===================================================== short test summary info ======================================================
SKIPPED [1] tests/legacy/test_client_server.py:1352: asyncio.coroutine has been removed in Python 3.11
SKIPPED [1] tests/legacy/test_client_server.py:1368: asyncio.coroutine has been removed in Python 3.11
SKIPPED [2] tests/sync/test_connection.py:681: works only on BSD
SKIPPED [1] tests/sync/test_connection.py:445: only relevant on the client-side
SKIPPED [1] tests/sync/test_connection.py:418: only relevant on the client-side
FAILED tests/legacy/test_client_server.py::ClientServerTests::test_explicit_host_port - ValueError: 'example.com' does not appear to be an IPv4 or IPv6 address
FAILED tests/legacy/test_client_server.py::SecureClientServerTests::test_explicit_host_port - ValueError: 'example.com' does not appear to be an IPv4 or IPv6 address
=============================== 2 failed, 1285 passed, 6 skipped, 1 deselected, 3 warnings in 6.59s ================================
pytest-xprocess reminder::Be sure to terminate the started process by running 'pytest --xkill' if you have not explicitly done so in your fixture with 'xprocess.getinfo(<process_name>).terminate()'.
 * ERROR: dev-python/websockets-11.0.3-r1::gentoo failed (test phase):
 *   pytest failed with python3.11

After installing dev-python/pkgcore:
============================================================================================= short test summary info =============================================================================================
SKIPPED [1] tests/legacy/test_client_server.py:1352: asyncio.coroutine has been removed in Python 3.11
SKIPPED [1] tests/legacy/test_client_server.py:1368: asyncio.coroutine has been removed in Python 3.11
SKIPPED [2] tests/sync/test_connection.py:681: works only on BSD
SKIPPED [1] tests/sync/test_connection.py:445: only relevant on the client-side
SKIPPED [1] tests/sync/test_connection.py:418: only relevant on the client-side
============================================================================ 1287 passed, 6 skipped, 1 deselected, 3 warnings in 5.70s ============================================================================
pytest-xprocess reminder::Be sure to terminate the started process by running 'pytest --xkill' if you have not explicitly done so in your fixture with 'xprocess.getinfo(<process_name>).terminate()'.
>>> Completed testing dev-python/websockets-11.0.3-r1

# emerge --info =dev-python/websockets-11.0.3-r1
Portage 3.0.46 (python 3.11.4-final-0, default/linux/amd64/17.1/desktop/systemd/merged-usr, gcc-12, glibc-2.37-r3, 6.1.31-gentoo x86_64)
=================================================================
                         System Settings
=================================================================
System uname: Linux-6.1.31-gentoo-x86_64-AMD_Phenom-tm-_II_X6_1100T_Processor-with-glibc2.37
KiB Mem:    16060700 total,   7402484 free
KiB Swap:    8388604 total,   7830268 free
Timestamp of repository gentoo: Mon, 03 Jul 2023 13:15:01 +0000
Head commit of repository gentoo: 4269b04a2ffc324157687e204b143175ffff84f6
sh dash 0.5.12
ld GNU ld (Gentoo 2.39 p6) 2.39.0
distcc 3.4 x86_64-pc-linux-gnu [enabled]
ccache version 4.8.2 [disabled]
app-misc/pax-utils:        1.3.5::gentoo
app-shells/bash:           5.1_p16-r6::gentoo
dev-java/java-config:      2.3.1-r1::gentoo
dev-lang/perl:             5.36.1-r2::gentoo
dev-lang/python:           3.11.4::gentoo
dev-lang/rust:             1.69.0-r1::gentoo
dev-util/ccache:           4.8.2::gentoo
dev-util/cmake:            3.26.4-r1::gentoo
dev-util/meson:            1.1.1::gentoo
sys-apps/baselayout:       2.13-r1::gentoo
sys-apps/sandbox:          2.32::gentoo
sys-apps/systemd:          253.3-r1::gentoo
sys-devel/autoconf:        2.71-r6::gentoo
sys-devel/automake:        1.16.5::gentoo
sys-devel/binutils:        2.39-r5::gentoo, 2.40-r5::gentoo
sys-devel/binutils-config: 5.5::gentoo
sys-devel/clang:           16.0.5::gentoo
sys-devel/gcc:             12.3.1_p20230526::gentoo
sys-devel/gcc-config:      2.11::gentoo
sys-devel/libtool:         2.4.7-r1::gentoo
sys-devel/lld:             16.0.5::gentoo
sys-devel/llvm:            15.0.7-r3::gentoo, 16.0.5::gentoo
sys-devel/make:            4.4.1-r1::gentoo
sys-kernel/linux-headers:  6.1::gentoo (virtual/os-headers)
sys-libs/glibc:            2.37-r3::gentoo
Repositories:

gentoo
    location: /var/db/repos/gentoo
    sync-type: rsync
    sync-uri: rsync://rsync.europe.gentoo.org/gentoo-portage
    priority: -1000
    volatile: True
    sync-rsync-verify-max-age: 24
    sync-rsync-verify-metamanifest: yes
    sync-rsync-verify-jobs: 1
    sync-rsync-extra-opts: 

x-portage
    location: /usr/local/portage
    masters: gentoo
    priority: 0
    volatile: True

ACCEPT_KEYWORDS="amd64"
ACCEPT_LICENSE="@FREE"
AR="/usr/bin/gcc-ar"
CBUILD="x86_64-pc-linux-gnu"
CFLAGS="-O2 -pipe -frecord-gcc-switches -march=amdfam10 -flto=6"
CHOST="x86_64-pc-linux-gnu"
CONFIG_PROTECT="/etc /usr/lib64/libreoffice/program/sofficerc /usr/share/config /usr/share/easy-rsa /usr/share/gnupg/qualified.txt"
CONFIG_PROTECT_MASK="/etc/ca-certificates.conf /etc/dconf /etc/env.d /etc/fonts/fonts.conf /etc/gconf /etc/gentoo-release /etc/revdep-rebuild /etc/sandbox.d"
CXXFLAGS="-O2 -pipe -frecord-gcc-switches -march=amdfam10 -flto=6"
DISTDIR="/var/cache/distfiles"
EMERGE_DEFAULT_OPTS="--keep-going y --with-bdeps y"
ENV_UNSET="CARGO_HOME DBUS_SESSION_BUS_ADDRESS DISPLAY GDK_PIXBUF_MODULE_FILE GOBIN GOPATH PERL5LIB PERL5OPT PERLPREFIX PERL_CORE PERL_MB_OPT PERL_MM_OPT XAUTHORITY XDG_CACHE_HOME XDG_CONFIG_HOME XDG_DATA_HOME XDG_RUNTIME_DIR XDG_STATE_HOME"
FCFLAGS="-O2 -pipe -frecord-gcc-switches -march=amdfam10 -flto=6"
FEATURES="assume-digests binpkg-docompress binpkg-dostrip binpkg-logs buildpkg-live cgroup compress-build-logs config-protect-if-modified distcc distlocks ebuild-locks ipc-sandbox merge-sync multilib-strict network-sandbox news parallel-fetch pid-sandbox preserve-libs protect-owned qa-unresolved-soname-deps sandbox sfperms split-elog split-log strict test unknown-features-warn unmerge-logs unmerge-orphans userfetch userpriv usersandbox usersync xattr"
FFLAGS="-O2 -pipe -frecord-gcc-switches -march=amdfam10 -flto=6"
GENTOO_MIRRORS="http://ftp.tu-ilmenau.de/mirror/gentoo/ https://ftp.tu-ilmenau.de/mirror/gentoo/ http://mirror.init7.net/gentoo/ https://mirror.init7.net/gentoo/"
LANG="it_IT.UTF-8"
LDFLAGS="-Wl,-O1 -Wl,--as-needed -Wl,--hash-style=gnu -Wl,--sort-common -flto=6"
LEX="flex"
LINGUAS="it it_IT"
MAKEOPTS="-j23 -l6"
NM="/usr/bin/gcc-nm"
PKGDIR="/var/cache/binpkgs"
PORTAGE_CONFIGROOT="/"
PORTAGE_RSYNC_OPTS="--recursive --links --safe-links --perms --times --omit-dir-times --compress --force --whole-file --delete --stats --human-readable --timeout=180 --exclude=/distfiles --exclude=/local --exclude=/packages --exclude=/.git"
PORTAGE_TMPDIR="/var/tmp"
RANLIB="/usr/bin/gcc-ranlib"
SHELL="/bin/bash"
USE="X a52 aac aalib acl acpi alsa amd64 ao audiofile bash-completion bluetooth branding brotli bzip2 cairo caps cdda cddb cdparanoia cdr cli crypt css cups curl dbus dga djvu dri dts dvd dvdr encode exif expat fbcon ffmpeg fftw flac fontconfig fortran ftp gd gdbm gif gmp gnutls gpm graphviz gtk gui guile iconv icu idn imagemagick imlib inotify introspection ipv6 jbig jemalloc jpeg jpeg2k kde lame lcms libass libnotify libsamplerate libtirpc lm-sensors lua lz4 lzma lzo mad magic mhash mmap mng mp3 mp4 mpeg multilib musicbrainz ncurses nls nptl offensive ogg openal opengl openmp pam pango pcre pdf png policykit postscript ppds pulseaudio qt5 rdesktop readline samba sctp sdl seccomp sndfile sound speex spell sqlite ssl startup-notification svg symlink syslog systemd taglib test test-rust theora threads tiff truetype udev udisks unicode upower usb vaapi vala vdpau verify-sig vim-syntax vorbis vulkan wavpack wayland webp win32codecs wmf wxwidgets x264 xattr xcb xcomposite xft xinerama xml xpm xscreensaver xv xvid zip zlib zstd" ABI_X86="64" ADA_TARGET="gnat_2021" ALSA_CARDS="hda-intel virmidi" APACHE2_MODULES="authn_core authz_core socache_shmcb unixd actions alias auth_basic authn_alias authn_anon authn_dbm authn_default authn_file authz_dbm authz_default authz_groupfile authz_host authz_owner authz_user autoindex cache cgi cgid dav dav_fs dav_lock deflate dir disk_cache env expires ext_filter file_cache filter headers include info log_config logio mem_cache mime mime_magic negotiation rewrite setenvif speling status unique_id userdir usertrack vhost_alias" CALLIGRA_FEATURES="karbon sheets words" CAMERAS="ptp2" COLLECTD_PLUGINS="df interface irq load memory rrdtool swap syslog" CPU_FLAGS_X86="3dnow 3dnowext mmx mmxext popcnt sse sse2 sse3 sse4a" CURL_SSL="gnutls" ELIBC="glibc" GPSD_PROTOCOLS="ashtech aivdm earthmate evermore fv18 garmin garmintxt gpsclock greis isync itrax mtk3301 nmea ntrip navcom oceanserver oldstyle oncore rtcm104v2 rtcm104v3 sirf skytraq superstar2 timing tsip tripmate tnt ublox ubx" GRUB_PLATFORMS="pc" INPUT_DEVICES="libinput" KERNEL="linux" L10N="it en" LCD_DEVICES="bayrad cfontz cfontz633 glk hd44780 lb216 lcdm001 mtxorb ncurses text" LIBREOFFICE_EXTENSIONS="presenter-console presenter-minimizer" LLVM_TARGETS="AMDGPU" LUA_SINGLE_TARGET="lua5-1" LUA_TARGETS="lua5-1" OFFICE_IMPLEMENTATION="libreoffice" PHP_TARGETS="php8-1" POSTGRES_TARGETS="postgres12 postgres13" PYTHON_SINGLE_TARGET="python3_11" PYTHON_TARGETS="python3_11" RUBY_TARGETS="ruby31" VIDEO_CARDS="radeon r600" XTABLES_ADDONS="quota2 psd pknock lscan length2 ipv4options ipset ipp2p iface geoip fuzzy condition tee tarpit sysrq proto steal rawnat logmark ipmark dhcpmac delude chaos account"
Unset:  ADDR2LINE, ARFLAGS, AS, ASFLAGS, CC, CCLD, CONFIG_SHELL, CPP, CPPFLAGS, CTARGET, CXX, CXXFILT, ELFEDIT, EXTRA_ECONF, F77FLAGS, FC, GCOV, GPROF, INSTALL_MASK, LC_ALL, LD, LFLAGS, LIBTOOL, MAKE, MAKEFLAGS, OBJCOPY, OBJDUMP, PORTAGE_BINHOST, PORTAGE_BUNZIP2_COMMAND, PORTAGE_COMPRESS, PORTAGE_COMPRESS_FLAGS, PORTAGE_RSYNC_EXTRA_OPTS, READELF, RUSTFLAGS, SIZE, STRINGS, STRIP, YACC, YFLAGS

=================================================================
                        Package Settings
=================================================================

dev-python/websockets-11.0.3-r1::gentoo was built with the following:
USE="native-extensions test -debug" ABI_X86="(64)" PYTHON_TARGETS="python3_11 (-pypy3) -python3_10 (-python3_12)"

# emerge -1pqv =dev-python/websockets-11.0.3-r1
[ebuild   R   ] dev-python/websockets-11.0.3-r1  USE="native-extensions test -debug" PYTHON_TARGETS="python3_11 (-pypy3) -python3_10 (-python3_12)"

[Comment 1 Paolo Pedroni 2023-07-03 15:47:32 UTC]

Created attachment 865098 [details]
websockets-11.0.3-r1:20230703-153932.log.gz - dev-python/pkgcore installed, tests succeed

[Comment 2 Sam James 2023-07-03 15:47:48 UTC]

dev-python/pkgcore doesn't exist. Do you mean sys-apps/pkgcore (if so, wtf?) or something else?

[Comment 3 Sam James 2023-07-03 16:45:02 UTC]

pypy3, py3.10 pass for me, py3.11 doesn't?

[Comment 4 Ninpo 2023-07-03 17:49:35 UTC]

Nothing to do with pkgcore, the test failed because DNS failed. Likely got rate limited by DNS provider somewhere along the way with the large number of tests run at once.

I ran into this same issue, restarted my pihole and the issue went away.

[Comment 5 Sam James 2023-07-03 18:53:25 UTC]

I just don't get it yet. It's really flaky for me. Also, network-sandbox should mean it's not DNS related, but dunno yet.

[Comment 6 Larry the Git Cow 2023-07-03 18:55:56 UTC]

The bug has been closed via the following commit(s):

https://gitweb.gentoo.org/repo/gentoo.git/commit/?id=68007460cfb265fe0e791eaffacc2d86f7d500ff

commit 68007460cfb265fe0e791eaffacc2d86f7d500ff
Author:     Michał Górny <[e-mail]>
AuthorDate: 2023-07-03 18:43:23 +0000
Commit:     Michał Górny <[e-mail]>
CommitDate: 2023-07-03 18:55:53 +0000

    dev-python/websockets: Deselect tests needing DNS
    
    Closes: https://bugs.gentoo.org/909567
    Signed-off-by: Michał Górny <[e-mail]>

 dev-python/websockets/websockets-11.0.3-r1.ebuild | 4 ++++
 1 file changed, 4 insertions(+)

[Comment 7 Paolo Pedroni 2023-07-04 08:26:17 UTC]

(In reply to Sam James from comment #2)
> dev-python/pkgcore doesn't exist. Do you mean sys-apps/pkgcore (if so, wtf?)
> or something else?

I meant that. Sorry, I was in a hurry.

[Comment 8 Ninpo 2023-07-06 02:16:53 UTC]

Caused by https://github.com/python/cpython/issues/103848

See https://bugs.gentoo.org/909747 for full explanation

[Comment 9 Ninpo 2023-07-06 02:18:40 UTC]

Unsure why this randomly succeeds (though I suspect asyncio eating the exception), but this has bad test data for the test, passing unencoded [example.com] as part of the URL after // which is invalid.