Updating to python-3.13 fails random at test.test_concurrent_futures.test_shutdown worker non-zero exit code (Exit code 1). I've first tried with jit enabled and expected the cause here. A second attempt worked and python installed with jit enabled. But then an 'emerge -pvDNu world' stuck. So rebuilding without jit and the build failed again with the same error: 0:01:45 load avg: 9.69 [434/435] test_zipimport passed 0:20:00 load avg: 1.52 [435/435] test.test_concurrent_futures.test_shutdown worker non-zero exit code (Exit code 1) test_cancel_futures (test.test_concurrent_futures.test_shutdown.ProcessPoolForkProcessPoolShutdownTest.test_cancel_futures) ... 0.24s ok test_context_manager_shutdown (test.test_concurrent_futures.test_shutdown.ProcessPoolForkProcessPoolShutdownTest.test_context_manager_shutdown) ... 0.03s ok test_del_shutdown (test.test_concurrent_futures.test_shutdown.ProcessPoolForkProcessPoolShutdownTest.test_del_shutdown) ... 0.10s ok test_hang_gh83386 (test.test_concurrent_futures.test_shutdown.ProcessPoolForkProcessPoolShutdownTest.test_hang_gh83386) shutdown(wait=False) doesn't hang at exit with running futures. ... skipped 'Hangs, see https://github.com/python/cpython/issues/83386' 0.00s test_hang_gh94440 (test.test_concurrent_futures.test_shutdown.ProcessPoolForkProcessPoolShutdownTest.test_hang_gh94440) shutdown(wait=True) doesn't hang when a future was submitted and ... 0.02s ok test_hang_issue12364 (test.test_concurrent_futures.test_shutdown.ProcessPoolForkProcessPoolShutdownTest.test_hang_issue12364) ... 1.04s ok test_interpreter_shutdown (test.test_concurrent_futures.test_shutdown.ProcessPoolForkProcessPoolShutdownTest.test_interpreter_shutdown) ... 1.50s ok test_processes_terminate (test.test_concurrent_futures.test_shutdown.ProcessPoolForkProcessPoolShutdownTest.test_processes_terminate) ... 0.04s ok test_run_after_shutdown (test.test_concurrent_futures.test_shutdown.ProcessPoolForkProcessPoolShutdownTest.test_run_after_shutdown) ... 0.00s ok test_shutdown_no_wait (test.test_concurrent_futures.test_shutdown.ProcessPoolForkProcessPoolShutdownTest.test_shutdown_no_wait) ... 0.04s ok test_submit_after_interpreter_shutdown (test.test_concurrent_futures.test_shutdown.ProcessPoolForkProcessPoolShutdownTest.test_submit_after_interpreter_shutdown) ... 0.27s ok test_cancel_futures (test.test_concurrent_futures.test_shutdown.ProcessPoolForkserverProcessPoolShutdownTest.test_cancel_futures) ... 0.52s ok test_context_manager_shutdown (test.test_concurrent_futures.test_shutdown.ProcessPoolForkserverProcessPoolShutdownTest.test_context_manager_shutdown) ... 0.32s ok test_del_shutdown (test.test_concurrent_futures.test_shutdown.ProcessPoolForkserverProcessPoolShutdownTest.test_del_shutdown) ... 0.32s ok test_hang_gh83386 (test.test_concurrent_futures.test_shutdown.ProcessPoolForkserverProcessPoolShutdownTest.test_hang_gh83386) shutdown(wait=False) doesn't hang at exit with running futures. ... skipped 'Hangs, see https://github.com/python/cpython/issues/83386' 0.00s test_hang_gh94440 (test.test_concurrent_futures.test_shutdown.ProcessPoolForkserverProcessPoolShutdownTest.test_hang_gh94440) shutdown(wait=True) doesn't hang when a future was submitted and ... 0.20s ok test_hang_issue12364 (test.test_concurrent_futures.test_shutdown.ProcessPoolForkserverProcessPoolShutdownTest.test_hang_issue12364) ... 1.33s ok test_interpreter_shutdown (test.test_concurrent_futures.test_shutdown.ProcessPoolForkserverProcessPoolShutdownTest.test_interpreter_shutdown) ... 1.85s ok test_processes_terminate (test.test_concurrent_futures.test_shutdown.ProcessPoolForkserverProcessPoolShutdownTest.test_processes_terminate) ... Timeout (0:20:00)! Thread 0x00007f8ec64006c0 (most recent call first): File "/var/tmp/portage/dev-lang/python-3.13.0/work/Python-3.13.0/Lib/concurrent/futures/process.py", line 182 in _on_queue_feeder_error File "/var/tmp/portage/dev-lang/python-3.13.0/work/Python-3.13.0/Lib/multiprocessing/queues.py", line 290 in _feed File "/var/tmp/portage/dev-lang/python-3.13.0/work/Python-3.13.0/Lib/threading.py", line 992 in run File "/var/tmp/portage/dev-lang/python-3.13.0/work/Python-3.13.0/Lib/threading.py", line 1041 in _bootstrap_inner File "/var/tmp/portage/dev-lang/python-3.13.0/work/Python-3.13.0/Lib/threading.py", line 1012 in _bootstrap Thread 0x00007f8ec6e006c0 (most recent call first): File "/var/tmp/portage/dev-lang/python-3.13.0/work/Python-3.13.0/Lib/threading.py", line 1092 in join File "/var/tmp/portage/dev-lang/python-3.13.0/work/Python-3.13.0/Lib/multiprocessing/queues.py", line 217 in _finalize_join File "/var/tmp/portage/dev-lang/python-3.13.0/work/Python-3.13.0/Lib/multiprocessing/util.py", line 216 in __call__ File "/var/tmp/portage/dev-lang/python-3.13.0/work/Python-3.13.0/Lib/multiprocessing/queues.py", line 149 in join_thread File "/var/tmp/portage/dev-lang/python-3.13.0/work/Python-3.13.0/Lib/concurrent/futures/process.py", line 566 in _join_executor_internals File "/var/tmp/portage/dev-lang/python-3.13.0/work/Python-3.13.0/Lib/concurrent/futures/process.py", line 557 in join_executor_internals File "/var/tmp/portage/dev-lang/python-3.13.0/work/Python-3.13.0/Lib/concurrent/futures/process.py", line 380 in run File "/var/tmp/portage/dev-lang/python-3.13.0/work/Python-3.13.0/Lib/threading.py", line 1041 in _bootstrap_inner File "/var/tmp/portage/dev-lang/python-3.13.0/work/Python-3.13.0/Lib/threading.py", line 1012 in _bootstrap Thread 0x00007f8ec8e1b300 (most recent call first): File "/var/tmp/portage/dev-lang/python-3.13.0/work/Python-3.13.0/Lib/threading.py", line 1092 in join File "/var/tmp/portage/dev-lang/python-3.13.0/work/Python-3.13.0/Lib/concurrent/futures/process.py", line 854 in shutdown File "/var/tmp/portage/dev-lang/python-3.13.0/work/Python-3.13.0/Lib/test/test_concurrent_futures/test_shutdown.py", line 274 in test_processes_terminate File "/var/tmp/portage/dev-lang/python-3.13.0/work/Python-3.13.0/Lib/unittest/case.py", line 606 in _callTestMethod File "/var/tmp/portage/dev-lang/python-3.13.0/work/Python-3.13.0/Lib/unittest/case.py", line 651 in run File "/var/tmp/portage/dev-lang/python-3.13.0/work/Python-3.13.0/Lib/unittest/case.py", line 707 in __call__ File "/var/tmp/portage/dev-lang/python-3.13.0/work/Python-3.13.0/Lib/unittest/suite.py", line 122 in run File "/var/tmp/portage/dev-lang/python-3.13.0/work/Python-3.13.0/Lib/unittest/suite.py", line 84 in __call__ File "/var/tmp/portage/dev-lang/python-3.13.0/work/Python-3.13.0/Lib/unittest/suite.py", line 122 in run File "/var/tmp/portage/dev-lang/python-3.13.0/work/Python-3.13.0/Lib/unittest/suite.py", line 84 in __call__ File "/var/tmp/portage/dev-lang/python-3.13.0/work/Python-3.13.0/Lib/unittest/runner.py", line 240 in run File "/var/tmp/portage/dev-lang/python-3.13.0/work/Python-3.13.0/Lib/test/libregrtest/single.py", line 57 in _run_suite File "/var/tmp/portage/dev-lang/python-3.13.0/work/Python-3.13.0/Lib/test/libregrtest/single.py", line 37 in run_unittest File "/var/tmp/portage/dev-lang/python-3.13.0/work/Python-3.13.0/Lib/test/libregrtest/single.py", line 135 in test_func File "/var/tmp/portage/dev-lang/python-3.13.0/work/Python-3.13.0/Lib/test/libregrtest/single.py", line 91 in regrtest_runner File "/var/tmp/portage/dev-lang/python-3.13.0/work/Python-3.13.0/Lib/test/libregrtest/single.py", line 138 in _load_run_test File "/var/tmp/portage/dev-lang/python-3.13.0/work/Python-3.13.0/Lib/test/libregrtest/single.py", line 181 in _runtest_env_changed_exc File "/var/tmp/portage/dev-lang/python-3.13.0/work/Python-3.13.0/Lib/test/libregrtest/single.py", line 281 in _runtest File "/var/tmp/portage/dev-lang/python-3.13.0/work/Python-3.13.0/Lib/test/libregrtest/single.py", line 310 in run_single_test File "/var/tmp/portage/dev-lang/python-3.13.0/work/Python-3.13.0/Lib/test/libregrtest/worker.py", line 77 in worker_process File "/var/tmp/portage/dev-lang/python-3.13.0/work/Python-3.13.0/Lib/test/libregrtest/worker.py", line 112 in main File "/var/tmp/portage/dev-lang/python-3.13.0/work/Python-3.13.0/Lib/test/libregrtest/worker.py", line 116 in <module> File "<frozen runpy>", line 88 in _run_code File "<frozen runpy>", line 198 in _run_module_as_main Total duration: 20 min Total tests: run=37,460 skipped=1,380 Total test files: run=426/435 failed=1 skipped=32 resource_denied=9 Result: FAILURE make: *** [Makefile:904: profile-run-stamp] Error 2 Seems this is not jit-specific but affects python-3.13 at all. Seems some kind of timing or parallelism error, as it doesn't happen every time. Reproducible: Always
emerge --info Portage 3.0.66.1 (python 3.10.14-final-0, default/linux/amd64/23.0/systemd, gcc-14, glibc-2.40-r4, 6.11.0-rc7-00017-gbc83b4d1f086 x86_64) ================================================================= System uname: Linux-6.11.0-rc7-00017-gbc83b4d1f086-x86_64-AMD_Ryzen_7_PRO_4750U_with_Radeon_Graphics-with-glibc2.40 KiB Mem: 32155012 total, 1111816 free KiB Swap: 2097148 total, 954060 free Head commit of repository gentoo: 1ac3796c86dfe9a5f06bd4818b9a090b426bae46 Head commit of repository guru: 89e8a8006385f725c13101ad4a2affa68c883727 Head commit of repository kde: 29325c91f247a991add960c5a286486c8841bc1a Head commit of repository qt: 5bb4bfb222c72dcecc60b734db952c9870dde84e Head commit of repository x11: 6c0050760b497487e548b06f2eee526193b9c892 sh bash 5.2_p37 ld GNU ld (Gentoo 2.43 p2) 2.43.1 app-misc/pax-utils: 1.3.8::gentoo app-shells/bash: 5.2_p37::gentoo dev-build/autoconf: 2.13-r8::gentoo, 2.72-r1::gentoo dev-build/automake: 1.17-r1::gentoo dev-build/cmake: 3.30.4::gentoo dev-build/libtool: 2.5.3::gentoo dev-build/make: 4.4.1-r100::gentoo dev-build/meson: 1.5.2::gentoo dev-java/java-config: 2.3.4::gentoo dev-lang/perl: 5.40.0::gentoo dev-lang/python: 3.11.10_p1::gentoo, 3.12.7_p1::gentoo, 3.13.0::gentoo dev-lang/rust: 1.81.0::gentoo sys-apps/baselayout: 2.15::gentoo sys-apps/sandbox: 2.39::gentoo sys-apps/systemd: 256.6::gentoo sys-devel/binutils: 2.43-r1::gentoo sys-devel/binutils-config: 5.5.2::gentoo sys-devel/clang: 18.1.8::gentoo, 19.1.1::gentoo sys-devel/gcc: 14.2.1_p20240921::gentoo sys-devel/gcc-config: 2.11::gentoo sys-devel/lld: 18.1.8::gentoo sys-devel/llvm: 18.1.8-r4::gentoo, 19.1.1::gentoo sys-kernel/linux-headers: 6.10::gentoo (virtual/os-headers) sys-libs/glibc: 2.40-r4::gentoo Repositories: gentoo location: /var/db/repos/gentoo sync-type: git sync-uri: git://anongit.gentoo.org/repo/gentoo.git priority: -1000 volatile: False crossdev location: /var/db/repos/portage-crossdev masters: gentoo priority: 10 volatile: False guru location: /var/db/repos/guru sync-type: git sync-uri: https://anongit.gentoo.org/git/repo/proj/guru.git masters: gentoo priority: 50 volatile: False kde location: /var/db/repos/kde sync-type: git sync-uri: git://anongit.gentoo.org/proj/kde.git masters: gentoo priority: 50 volatile: False local location: /var/db/repos/local masters: gentoo priority: 50 volatile: False qt location: /var/db/repos/qt sync-type: git sync-uri: git://anongit.gentoo.org/proj/qt.git masters: gentoo priority: 50 volatile: False steam-overlay location: /var/db/repos/steam-overlay masters: gentoo priority: 50 volatile: False x11 location: /var/db/repos/x11 sync-type: git sync-uri: https://anongit.gentoo.org/git/proj/x11.git masters: gentoo priority: 50 volatile: False ACCEPT_KEYWORDS="amd64 ~amd64" ACCEPT_LICENSE="@FREE" CBUILD="x86_64-pc-linux-gnu" CFLAGS="-O2 -fuse-ld=mold -march=znver2 -mtune=znver2 --param l1-cache-size=32 --param l1-cache-line-size=64 --param l2-cache-size=512 -ftree-vectorize -fvect-cost-model=cheap -pipe" CHOST="x86_64-pc-linux-gnu" CONFIG_PROTECT="/etc /usr/lib64/libreoffice/program/sofficerc /usr/share/config /usr/share/gnupg/qualified.txt /var/bind" CONFIG_PROTECT_MASK="/etc/ca-certificates.conf /etc/dconf /etc/env.d /etc/fonts/fonts.conf /etc/gconf /etc/gentoo-release /etc/php/apache2-php8.3/ext-active/ /etc/php/cgi-php8.3/ext-active/ /etc/php/cli-php8.3/ext-active/ /etc/php/fpm-php8.3/ext-active/ /etc/php/phpdbg-php8.3/ext-active/ /etc/revdep-rebuild /etc/sandbox.d /etc/texmf/language.dat.d /etc/texmf/language.def.d /etc/texmf/updmap.d /etc/texmf/web2c" CXXFLAGS="-O2 -fuse-ld=mold -march=znver2 -mtune=znver2 --param l1-cache-size=32 --param l1-cache-line-size=64 --param l2-cache-size=512 -ftree-vectorize -fvect-cost-model=cheap -pipe" DISTDIR="/var/cache/distfiles" EMERGE_DEFAULT_OPTS="--with-bdeps=y --quiet-build=n" ENV_UNSET="CARGO_HOME DBUS_SESSION_BUS_ADDRESS DISPLAY GDK_PIXBUF_MODULE_FILE GOBIN GOPATH PERL5LIB PERL5OPT PERLPREFIX PERL_CORE PERL_MB_OPT PERL_MM_OPT XAUTHORITY XDG_CACHE_HOME XDG_CONFIG_HOME XDG_DATA_HOME XDG_RUNTIME_DIR XDG_STATE_HOME" FCFLAGS="-O2 -fuse-ld=mold -march=znver2 -mtune=znver2 --param l1-cache-size=32 --param l1-cache-line-size=64 --param l2-cache-size=512 -ftree-vectorize -fvect-cost-model=cheap -pipe" FEATURES="assume-digests binpkg-docompress binpkg-dostrip binpkg-logs buildpkg-live config-protect-if-modified distlocks ebuild-locks fixlafiles ipc-sandbox merge-sync merge-wait metadata-transfer multilib-strict network-sandbox news parallel-fetch pid-sandbox pkgdir-index-trusted preserve-libs protect-owned qa-unresolved-soname-deps sandbox sfperms strict unknown-features-warn unmerge-logs unmerge-orphans userfetch userpriv usersandbox usersync xattr" FFLAGS="-O2 -fuse-ld=mold -march=znver2 -mtune=znver2 --param l1-cache-size=32 --param l1-cache-line-size=64 --param l2-cache-size=512 -ftree-vectorize -fvect-cost-model=cheap -pipe" GENTOO_MIRRORS="http://distfiles.gentoo.org" LANG="C.UTF8" LDFLAGS="-Wl,-O1 -Wl,--as-needed -Wl,-z,pack-relative-relocs" LEX="flex" LINGUAS="de en" MAKEOPTS="-j16 -l16" PKGDIR="/var/cache/binpkgs" PORTAGE_CONFIGROOT="/" PORTAGE_RSYNC_OPTS="--recursive --links --safe-links --perms --times --omit-dir-times --compress --force --whole-file --delete --stats --human-readable --timeout=180 --exclude=/distfiles --exclude=/local --exclude=/packages --exclude=/.git" PORTAGE_TMPDIR="/var/tmp" SHELL="/bin/bash" USE="X a52 aac aacplus aacs acl activities alsa alt-svc amd64 amr amrenc anacron avif bdplus blake2 bluetooth bluray boost brotli bzip2 cairo caps cdda celt cet chm corefonts crypt cryptsetup cups dav1d dbus dell device-mapper djvu drm dts dvd ebook editorconfig efi egl encode eps epub evdev exif faac fdk ffmpeg fftw flac fontconfig gbm gdbm gif git glslang gmp gpg gphoto2 gpm graphviz harfbuzz heif http2 http3 hwloc iconv icu id3tag io-uring ipv6 ithreads jemalloc jpeg jpegxl kate kf6compat kipi lcms lensfun libaom libatomic libcxx libcxxabi libde265 libdovi libffi libinput libkms libnotify libplacebo libsamplerate libtirpc libunwind libxml2 lm-sensors lto lz4 lzma lzo mad matroska mjpeg mmap mng modern-top mp3 mpeg mtp multilib mysql ncurses networkmanager nfs nls ogg openal opencl opencv openexr opengl openmp openssl opus pam pango parted pcre pcre16 pdf pgo pipewire plasma png policykit postscript proton pulseaudio python qml qt5 qt6 quic rav1e raw readline rtmp rust-analyzer rust-src scanner schroedinger screencast sdl sdl2 seccomp sift smp sndfile sox speex spice spirv sqlite ssl subversion svg svt-av1 system-harfbuzz system-icu system-jpeg system-jsoncpp system-libvpx system-sqlite system-tbb system-zlib systemd taglib tesseract test-rust theora threads thumbnail tiff truetype udev udisks uefi unicode urandom usb usbredir user-session v4l vaapi vde vhosts virgl virt-network virtfs vorbis vpx vte vulkan wavpack wayland webp websockets wmf x264 x265 xattr xcb xcomposite xkb xml xmp xpm xv xvid xxhash zink zip zlib zstd" ABI_X86="64" ADA_TARGET="gcc_12" APACHE2_MODULES="authn_core authz_core socache_shmcb unixd actions alias auth_basic authn_anon authn_dbm authn_file authz_dbm authz_groupfile authz_host authz_owner authz_user autoindex cache cgi cgid dav dav_fs dav_lock deflate dir env expires ext_filter file_cache filter headers include info log_config logio mime mime_magic negotiation rewrite setenvif speling status unique_id userdir usertrack vhost_alias" CALLIGRA_FEATURES="karbon sheets words" CAMERAS="canon ricoh ricoh_g3" COLLECTD_PLUGINS="df interface irq load memory rrdtool swap syslog" CPU_FLAGS_X86="aes avx avx2 f16c fma3 mmx mmxext pclmul popcnt rdrand sha sse sse2 sse3 ssse3 sse4_1 sse4_2" CURL_QUIC="openssl" ELIBC="glibc" GPSD_PROTOCOLS="ashtech aivdm earthmate evermore fv18 garmin garmintxt gpsclock greis isync itrax mtk3301 ntrip navcom oceanserver oncore rtcm104v2 rtcm104v3 sirf skytraq superstar2 tsip tripmate tnt ublox" GRUB_PLATFORMS="efi-32 efi-64 pc" GUILE_SINGLE_TARGET="3-0" GUILE_TARGETS="3-0" INPUT_DEVICES="evdev libinput synaptics" KERNEL="linux" L10N="de en en-US" LCD_DEVICES="bayrad cfontz glk hd44780 lb216 lcdm001 mtxorb text" LLVM_SLOT="18" LLVM_TARGETS="AMDGPU BPF NVPTX SPIRV X86 WebAssembly" LUA_SINGLE_TARGET="lua5-1" LUA_TARGETS="lua5-1 lua5-2 lua5-3 lua5-4 luajit" OFFICE_IMPLEMENTATION="libreoffice" PHP_TARGETS="php8-2" POSTGRES_TARGETS="postgres16" PYTHON_SINGLE_TARGET="python3_12" PYTHON_TARGETS="python3_12 python3_13 pypy3" QEMU_SOFTMMU_TARGETS="aarch64 arm i386 x86_64" QEMU_USER_TARGETS="aarch64 arm" RUBY_TARGETS="ruby31 ruby32 ruby33" VIDEO_CARDS="amdgpu" XTABLES_ADDONS="quota2 psd pknock lscan length2 ipv4options ipp2p iface geoip fuzzy condition tarpit sysrq proto logmark ipmark dhcpmac delude chaos account" Unset: ADDR2LINE, AR, ARFLAGS, AS, ASFLAGS, CC, CCLD, CONFIG_SHELL, CPP, CPPFLAGS, CTARGET, CXX, CXXFILT, ELFEDIT, EXTRA_ECONF, F77FLAGS, FC, GCOV, GPROF, INSTALL_MASK, LC_ALL, LD, LFLAGS, LIBTOOL, MAKE, MAKEFLAGS, NM, OBJCOPY, OBJDUMP, PORTAGE_BINHOST, PORTAGE_BUNZIP2_COMMAND, PORTAGE_COMPRESS, PORTAGE_COMPRESS_FLAGS, PORTAGE_RSYNC_EXTRA_OPTS, PYTHONPATH, RANLIB, READELF, RUSTFLAGS, SIZE, STRINGS, STRIP, YACC, YFLAGS
I don't know why but disabling PGO helps flaggie =dev-lang/python-3.13.0-r100 -pgo or #USE="-pgo" emerge -1av python [ebuild NS ] dev-lang/python-3.13.0-r100 [3.11.10_p1, 3.12.7_p1, 3.13.0] USE="ensurepip gdbm ncurses readline sqlite ssl tk -bluetooth -build -debug -examples (-jit) -libedit -pgo* -test -valgrind -verify-sig (-gil%*)" LLVM_SLOT="18"
