Gentoo Websites Logo
Go to: Gentoo Home Documentation Forums Lists Bugs Planet Store Wiki Get Gentoo!
Bug 928660 - dev-python/jedi-0.19.1: tests fail when running portage using pypy3
Summary: dev-python/jedi-0.19.1: tests fail when running portage using pypy3
Status: UNCONFIRMED
Alias: None
Product: Gentoo Linux
Classification: Unclassified
Component: Current packages (show other bugs)
Hardware: AMD64 Linux
: Normal normal
Assignee: Python Gentoo Team
URL:
Whiteboard:
Keywords: TESTFAILURE
Depends on:
Blocks:
 
Reported: 2024-04-06 01:11 UTC by Robert
Modified: 2024-04-06 19:23 UTC (History)
2 users (show)

See Also:
Package list:
Runtime testing required: ---


Attachments
dev-python/jedi-0.19.1 build log (jedi-0.19.1:20240405-223504.log.xz,119.12 KB, text/plain)
2024-04-06 01:19 UTC, Robert
Details

Note You need to log in before you can comment on or make changes to this bug.
Description Robert 2024-04-06 01:11:48 UTC
Tests for jedi-0.19.1 fail due to missing python3.10 executable.
Even when USE python_targets_3_10 is not enabled.

From what I can see in the build log pypy3 reports its own version string as 3.10.13 (which is correct AFAIK) but the jedi tests then attempt to call python3.10 as an executable. 

From the following lines of the build log, it seems that the test fixture that jedi uses attempts to find the correct python version to run on its own.
Since emerge is running using pypy3 it gets the version identifier 3.10 which the test fixture assumes is the executable python3.10

###### !! Log Data Begins !! ######

=========================================================== ERRORS ============================================================
_________________________________________ ERROR at setup of test_cache_get_signatures _________________________________________

request = <SubRequest 'environment' for <Function test_cache_get_signatures>>

    @pytest.fixture(scope='session')
    def environment(request):
        version = request.config.option.env
        if version is None:
            v = str(sys.version_info[0]) + str(sys.version_info[1])
            version = os.environ.get('JEDI_TEST_ENVIRONMENT', v)
    
        if request.config.option.interpreter_env or version == 'interpreter':
            return InterpreterEnvironment()
    
        if '.' not in version:
            version = version[0] + '.' + version[1:]
>       return get_system_environment(version)

request    = <SubRequest 'environment' for <Function test_cache_get_signatures>>
v          = '310'
version    = '3.10'

conftest.py:105: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _

version = '3.10'

    def get_system_environment(version, *, env_vars=None):
        """
        Return the first Python environment found for a string of the form 'X.Y'
        where X and Y are the major and minor versions of Python.
    
        :raises: :exc:`.InvalidPythonEnvironment`
        :returns: :class:'. Environment`
        """
        exe = which('python' + version)
        if exe:
            if exe == sys.executable:
                return SameEnvironment()
            return Environment(exe)
    
        if os.name == 'nt':
            for exe in _get_executables_from_windows_registry(version):
                try:
                    return Environment(exe, env_vars=env_vars)
                except InvalidPythonEnvironment:
                    pass
>       raise InvalidPythonEnvironment("Cannot find executable python%s." % version)
E       jedi.api.environment.InvalidPythonEnvironment: Cannot find executable python3.10.

env_vars   = None
exe        = None
version    = '3.10'

jedi/api/environment.py:353: InvalidPythonEnvironment

###### !! Log Data Ends !! ######

Then follows some thousands of lines to a similar effect.

As a workaround I created an env file for jedi that provides JEDI_TEST_ENVIRONMENT=3.11 and this causes the tests to run successfully.
So, it is likely the only issue is with the python version detection.

Reproducible: Always

Steps to Reproduce:
1. 
  Ensure python_targets_pypy3 and python_single_target_pypy3 are unmasked
2.
  Ensure pypy3 is installed
3.
  Configure portage to use pypy3 through /etc/python-exec
4.
  Enable FEATURES="test" in make.conf
5.
  `emerge dev-python/jedi-0.19.1`
Actual Results:  
Fails to emerge due to test failures

Expected Results:  
Emerges successfully

Portage 3.0.61 (python 3.10.13-final-0, default/linux/amd64/23.0/desktop/systemd, gcc-13, glibc-2.38-r10, 6.6.21-gentooHeavy-Optimisation x86_64)
=================================================================
                         System Settings
=================================================================
System uname: Linux-6.6.21-gentooHeavy-Optimisation-x86_64-Intel-R-_Core-TM-_i7-6820HQ_CPU_@_2.70GHz-with-glibc2.38
KiB Mem:    32638360 total,    601764 free
KiB Swap:   67106812 total,  66554308 free
Timestamp of repository gentoo: Mon, 01 Apr 2024 23:00:00 +0000
Head commit of repository gentoo: af12d78e6190b0b91855dddd7aab2fdfcb301b28
Timestamp of repository guru: Tue, 02 Apr 2024 00:03:32 +0000
Head commit of repository guru: 26c2d11f87b4bb11d0795f305d9661d471fafbae

Timestamp of repository steam-overlay: Mon, 01 Apr 2024 09:52:34 +0000
Head commit of repository steam-overlay: df56c1f3b01bdddcaef056f2c7b1a7773e348234

Timestamp of repository wayland-desktop: Mon, 01 Apr 2024 09:52:50 +0000
Head commit of repository wayland-desktop: 189da9699530dc8cec92c08063824313a7e68f96

sh bash 5.1_p16-r6
ld GNU ld (Gentoo 2.41 p5) 2.41.0
distcc 3.4 x86_64-pc-linux-gnu [enabled]
app-misc/pax-utils:        1.3.7::gentoo
app-shells/bash:           5.1_p16-r6::gentoo
dev-build/autoconf:        2.13-r8::gentoo, 2.71-r6::gentoo
dev-build/automake:        1.16.5-r2::gentoo
dev-build/cmake:           3.28.3::gentoo
dev-build/libtool:         2.4.7-r4::gentoo
dev-build/make:            4.4.1-r1::gentoo
dev-build/meson:           1.3.2::gentoo
dev-java/java-config:      2.3.3-r1::gentoo
dev-lang/perl:             5.38.2-r2::gentoo
dev-lang/python:           2.7.18_p16-r2::gentoo, 3.11.8_p1::gentoo, 3.12.2_p1::gentoo
dev-lang/rust:             1.76.0-r1::gentoo
sys-apps/baselayout:       2.15::gentoo
sys-apps/sandbox:          2.38::gentoo
sys-apps/systemd:          255.4::gentoo
sys-devel/binutils:        2.41-r5::gentoo
sys-devel/binutils-config: 5.5::gentoo
sys-devel/clang:           17.0.6::gentoo
sys-devel/gcc:             13.2.1_p20240210::gentoo
sys-devel/gcc-config:      2.11::gentoo
sys-devel/llvm:            17.0.6::gentoo
sys-kernel/linux-headers:  6.6-r1::gentoo (virtual/os-headers)
sys-libs/glibc:            2.38-r10::gentoo
Repositories:

gentoo
    location: /var/db/repos/gentoo
    sync-type: rsync
    sync-uri: rsync://192.168.0.49/gentoo-portage
    priority: -1000
    volatile: False
    sync-rsync-extra-opts: 
    sync-rsync-verify-jobs: 1
    sync-rsync-verify-max-age: 24
    sync-rsync-verify-metamanifest: yes

guru
    location: /var/db/repos/guru
    sync-type: git
    sync-uri: https://github.com/gentoo-mirror/guru.git
    masters: gentoo
    volatile: False

local
    location: /var/db/repos/local
    masters: gentoo
    volatile: False

steam-overlay
    location: /var/db/repos/steam-overlay
    sync-type: git
    sync-uri: https://github.com/gentoo-mirror/steam-overlay.git
    masters: gentoo
    volatile: False

wayland-desktop
    location: /var/db/repos/wayland-desktop
    sync-type: git
    sync-uri: https://github.com/gentoo-mirror/wayland-desktop.git
    masters: gentoo
    volatile: False

ACCEPT_KEYWORDS="amd64"
ACCEPT_LICENSE="@FREE"
CBUILD="x86_64-pc-linux-gnu"
CFLAGS="-march=skylake -O2 -pipe -ftree-vectorize -fvect-cost-model=very-cheap -fomit-frame-pointer"
CHOST="x86_64-pc-linux-gnu"
CONFIG_PROTECT="/etc /usr/share/config /usr/share/gnupg/qualified.txt /usr/share/themes/oxygen-gtk/gtk-2.0"
CONFIG_PROTECT_MASK="/etc/ca-certificates.conf /etc/dconf /etc/env.d /etc/fonts/fonts.conf /etc/gconf /etc/gentoo-release /etc/revdep-rebuild /etc/sandbox.d /etc/texmf/language.dat.d /etc/texmf/language.def.d /etc/texmf/updmap.d /etc/texmf/web2c"
CXXFLAGS="-march=skylake -O2 -pipe -ftree-vectorize -fvect-cost-model=very-cheap -fomit-frame-pointer"
DISTDIR="/var/cache/distfiles"
EMERGE_DEFAULT_OPTS="--jobs 4 --load-average 7.2 --ask --tree"
ENV_UNSET="CARGO_HOME DBUS_SESSION_BUS_ADDRESS DISPLAY GDK_PIXBUF_MODULE_FILE GOBIN GOPATH PERL5LIB PERL5OPT PERLPREFIX PERL_CORE PERL_MB_OPT PERL_MM_OPT XAUTHORITY XDG_CACHE_HOME XDG_CONFIG_HOME XDG_DATA_HOME XDG_RUNTIME_DIR XDG_STATE_HOME"
FCFLAGS="-march=skylake -O2 -pipe -ftree-vectorize -fvect-cost-model=very-cheap -fomit-frame-pointer"
FEATURES="assume-digests binpkg-docompress binpkg-dostrip binpkg-logs binpkg-multi-instance buildpkg-live clean-logs config-protect-if-modified distcc distlocks ebuild-locks fixlafiles ipc-sandbox merge-sync multilib-strict network-sandbox news parallel-fetch parallel-install pid-sandbox pkgdir-index-trusted preserve-libs protect-owned qa-unresolved-soname-deps sandbox sfperms split-elog split-log strict test unknown-features-warn unmerge-logs unmerge-orphans userfetch userpriv usersandbox usersync xattr"
FFLAGS="-march=skylake -O2 -pipe -ftree-vectorize -fvect-cost-model=very-cheap -fomit-frame-pointer"
GENTOO_MIRRORS="https://mirror.bytemark.co.uk/gentoo/ http://distfiles.gentoo.org"
LANG="en_GB.utf8"
LDFLAGS="-Wl,-O1 -Wl,--as-needed -Wl,-z,pack-relative-relocs"
LEX="flex"
LINGUAS="en en_GB en_US"
MAKEOPTS="-j48 -l8"
PKGDIR="/var/cache/binpkgs"
PORTAGE_CONFIGROOT="/"
PORTAGE_RSYNC_OPTS="--recursive --links --safe-links --perms --times --omit-dir-times --compress --force --whole-file --delete --stats --human-readable --timeout=180 --exclude=/distfiles --exclude=/local --exclude=/packages --exclude=/.git"
PORTAGE_TMPDIR="/var/tmp"
SHELL="/bin/bash"
USE="X a52 aac acl acpi alsa amd64 bluetooth branding bzip2 cairo caps cdda cdr cet crypt cups dbus dri dts dvd dvdr egl encode exif flac gdbm gif gpm gstreamer gui harfbuzz iconv icu ipv6 iwd jpeg lcms ldac libnotify libtirpc lto lzma mad man mng modules-sign mp3 mp4 mpeg multilib ncurses nls nvdec nvenc ogg opengl openmp opus pam pango pcre pdf pgo pipewire png policykit ppds pulseaudio qml qt5 qt6 readline screencast sdl seccomp secureboot sound spell ssl startup-notification svg systemd test test-rust tiff truetype udev udisks unicode upower usb vaapi vdpau vorbis vulkan wayland wxwidgets x264 xattr xcb xft xml xv xvid zeroconf zlib zsh-completion zstd" ABI_X86="64" ADA_TARGET="gcc_12" APACHE2_MODULES="authn_core authz_core socache_shmcb unixd actions alias auth_basic authn_anon authn_dbm authn_file authz_dbm authz_groupfile authz_host authz_owner authz_user autoindex cache cgi cgid dav dav_fs dav_lock deflate dir env expires ext_filter file_cache filter headers include info log_config logio mime mime_magic negotiation rewrite setenvif speling status unique_id userdir usertrack vhost_alias" CALLIGRA_FEATURES="karbon sheets words" COLLECTD_PLUGINS="df interface irq load memory rrdtool swap syslog" CPU_FLAGS_X86="mmx mmxext sse sse2 aes avx avx2 f16c fma3 pclmul popcnt rdrand sse3 sse4_1 sse4_2 ssse3" ELIBC="glibc" GPSD_PROTOCOLS="ashtech aivdm earthmate evermore fv18 garmin garmintxt gpsclock greis isync itrax mtk3301 ntrip navcom oceanserver oncore rtcm104v2 rtcm104v3 sirf skytraq superstar2 tsip tripmate tnt ublox" INPUT_DEVICES="synaptics libinput" KERNEL="linux" L10N="en en-GB en-US" LCD_DEVICES="bayrad cfontz glk hd44780 lb216 lcdm001 mtxorb text" LUA_SINGLE_TARGET="lua5-1" LUA_TARGETS="luajit lua5-1 lua5-3 lua5-4" OFFICE_IMPLEMENTATION="libreoffice" PHP_TARGETS="php8-1" POSTGRES_TARGETS="postgres15" PYTHON_SINGLE_TARGET="python3_11" PYTHON_TARGETS="python3_11 pypy3" RUBY_TARGETS="ruby31" VIDEO_CARDS="nvidia" XTABLES_ADDONS="quota2 psd pknock lscan length2 ipv4options ipp2p iface geoip fuzzy condition tarpit sysrq proto logmark ipmark dhcpmac delude chaos account"
Unset:  ADDR2LINE, AR, ARFLAGS, AS, ASFLAGS, CC, CCLD, CONFIG_SHELL, CPP, CPPFLAGS, CTARGET, CXX, CXXFILT, ELFEDIT, EXTRA_ECONF, F77FLAGS, FC, GCOV, GPROF, INSTALL_MASK, LC_ALL, LD, LFLAGS, LIBTOOL, MAKE, MAKEFLAGS, NM, OBJCOPY, OBJDUMP, PORTAGE_BINHOST, PORTAGE_BUNZIP2_COMMAND, PORTAGE_COMPRESS, PORTAGE_COMPRESS_FLAGS, PORTAGE_RSYNC_EXTRA_OPTS, PYTHONPATH, RANLIB, READELF, RUSTFLAGS, SIZE, STRINGS, STRIP, YACC, YFLAGS

=================================================================
                        Package Settings
=================================================================

dev-python/jedi-0.19.1::gentoo was built with the following:
USE="-doc -test" ABI_X86="(64)" PYTHON_TARGETS="pypy3 python3_11 -python3_10 -python3_12"
FEATURES="assume-digests binpkg-docompress binpkg-dostrip binpkg-logs binpkg-multi-instance buildpkg-live clean-logs config-protect-if-modified distcc distlocks ebuild-locks fixlafiles ipc-sandbox merge-sync multilib-strict network-sandbox news parallel-fetch parallel-install pid-sandbox pkgdir-index-trusted preserve-libs protect-owned qa-unresolved-soname-deps sandbox sfperms split-elog split-log strict unknown-features-warn unmerge-logs unmerge-orphans userfetch userpriv usersandbox usersync xattr"
Comment 1 Robert 2024-04-06 01:19:27 UTC
Created attachment 889549 [details]
dev-python/jedi-0.19.1 build log

This log is about 150,000 lines long. 
I have hopefully put the relevant lines in the original comment.
But am providing the full build log (xz compressed) just in case