meson.build:48:26: ERROR: <PythonExternalProgram 'python3' -> ['/var/tmp/portage/net-libs/libmbim-1.28.4/temp/python3. 12/bin/python3']> is not a valid python or it is missing distutils Reproducible: Always emerge --info '=net-libs/libmbim-1.28.4::gentoo' Portage 3.0.49 (python 3.11.4-final-0, default/linux/amd64/17.1/desktop/plasma/systemd/merged-usr, gcc-13, glibc-2.37-r3, 6.4.7-gentoo x86_64) ================================================================= System Settings ================================================================= System uname: Linux-6.4.7-gentoo-x86_64-AMD_Ryzen_9_5900X_12-Core_Processor-with-glibc2.37 KiB Mem: 65782948 total, 33936700 free KiB Swap: 6291452 total, 6291452 free Timestamp of repository gentoo: Sat, 29 Jul 2023 12:31:43 +0000 Head commit of repository gentoo: 6f9102cd7c942764c9cbd1cbb0f500ff10063d61 Head commit of repository audio-overlay: 1cc17ad752e55915a910463ef7d446aca92f2334 sh bash 5.2_p15-r6 ld GNU ld (Gentoo 2.40 p5) 2.40.0 app-misc/pax-utils: 1.3.7::gentoo app-shells/bash: 5.2_p15-r6::gentoo dev-java/java-config: 2.3.1-r1::gentoo dev-lang/perl: 5.38.0-r1::gentoo dev-lang/python: 3.11.4::gentoo, 3.12.0_beta4_p1::gentoo dev-lang/rust: 1.71.0::gentoo dev-util/cmake: 3.27.1::gentoo dev-util/meson: 1.2.0::gentoo sys-apps/baselayout: 2.14::gentoo sys-apps/sandbox: 2.37::gentoo sys-apps/systemd: 253.7::gentoo sys-devel/autoconf: 2.71-r7::gentoo sys-devel/automake: 1.16.5-r1::gentoo sys-devel/binutils: 2.40-r6::gentoo sys-devel/binutils-config: 5.5::gentoo sys-devel/gcc: 13.2.0::gentoo sys-devel/gcc-config: 2.11::gentoo sys-devel/libtool: 2.4.7-r1::gentoo sys-devel/llvm: 16.0.6::gentoo sys-devel/make: 4.4.1-r1::gentoo sys-kernel/linux-headers: 6.4::gentoo (virtual/os-headers) sys-libs/glibc: 2.37-r3::gentoo Repositories: gentoo location: /var/db/repos/gentoo sync-type: git sync-uri: https://anongit.gentoo.org/git/repo/sync/gentoo.git priority: -1000 volatile: False audio-overlay location: /var/db/repos/audio-overlay sync-type: git sync-uri: https://github.com/gentoo-audio/audio-overlay.git masters: gentoo volatile: False local location: /var/db/repos/local masters: gentoo volatile: False ACCEPT_KEYWORDS="amd64 ~amd64" ACCEPT_LICENSE="* -@EULA" AR="ar" CBUILD="x86_64-pc-linux-gnu" CC="gcc" CFLAGS="-O2 -march=native -fomit-frame-pointer -pipe" CHOST="x86_64-pc-linux-gnu" CONFIG_PROTECT="/etc /usr/share/config /usr/share/gnupg/qualified.txt" CONFIG_PROTECT_MASK="/etc/ca-certificates.conf /etc/dconf /etc/env.d /etc/fonts/fonts.conf /etc/gconf /etc/gentoo-release /etc/revdep-rebuild /etc/sandbox.d" CXX="g++" CXXFLAGS="-O2 -march=native -fomit-frame-pointer -pipe" DISTDIR="/var/cache/distfiles" EMERGE_DEFAULT_OPTS="--with-bdeps y --autounmask-keep-masks" ENV_UNSET="CARGO_HOME DBUS_SESSION_BUS_ADDRESS DISPLAY GDK_PIXBUF_MODULE_FILE GOBIN GOPATH PERL5LIB PERL5OPT PERLPREFIX PERL_CORE PERL_MB_OPT PERL_MM_OPT XAUTHORITY XDG_CACHE_HOME XDG_CONFIG_HOME XDG_DATA_HOME XDG_RUNTIME_DIR XDG_STATE_HOME" FCFLAGS="-O2 -pipe" FEATURES="assume-digests binpkg-docompress binpkg-dostrip binpkg-logs buildpkg-live clean-logs config-protect-if-modified distlocks ebuild-locks fixlafiles ipc-sandbox merge-sync multilib-strict network-sandbox news parallel-fetch pid-sandbox preserve-libs protect-owned qa-unresolved-soname-deps sandbox sfperms strict unknown-features-warn unmerge-logs unmerge-orphans userfetch userpriv usersandbox usersync xattr" FFLAGS="-O2 -pipe" GENTOO_MIRRORS="http://gentoo.osuosl.org/" LANG="en_US.utf8" LDFLAGS="-Wl,-O2 -Wl,--as-needed" LEX="flex" LINGUAS="en_US en" MAKEOPTS="V=1 -j1" NM="nm" PKGDIR="/var/cache/binpkgs" PORTAGE_CONFIGROOT="/" PORTAGE_RSYNC_OPTS="--recursive --links --safe-links --perms --times --omit-dir-times --compress --force --whole-file --delete --stats --human-readable --timeout=180 --exclude=/distfiles --exclude=/local --exclude=/packages --exclude=/.git" PORTAGE_TMPDIR="/var/tmp" RANLIB="ranlib" SHELL="/bin/bash" USE="X a52 aac aalib acl acpi activities alsa amd64 amr apache2 audiofile bash-completion bluray branding btrfs bzip2 cairo caps cdaudio cdda cddb cdparanoia cdr cdrdao chm chromecast cleartype cli colord corefonts crypt cups curl dbus declarative djvu dri dssi dts dv dvb dvd dvdr ebook egl encode exif fam fdk ffmpeg flac fortran gdbm gif gles2 gmp google gphoto2 gpm gstreamer gtk gtk3 gtk4 gui iconv icu imagemagick imap imlib introspection ios ipod ipv6 jack java jpeg jpeg2k kde kpathsea kvm kwallet ladspa lame lash lcms libffi libinput libnotify libtirpc linguas_en_US lm-sensors lv2 lvm lzma mad marble midi mmap mng mozilla mp3 mp4 mpeg mtp multimedia musicbrainz ncurses network nls nodrm nptl nsplugin numa ofx ogg opencl openexr opengl openmp opus pam pango pcre pdf pipewire pipewire-alsa plasma png policykit ppds pulseaudio qemu qml qt5 readline rtmp rust sasl scanner screencast sdl seccomp semantic-desktop slp smp sndfile sound speex spell ssl startup-notification subversion svg systemd test-rust theora threads tiff tk transparency truetype type1 udev udisks unicode unwind upower usb v4l vaapi vcd vdpau vim-syntax vorbis vpx vst vulkan wav wavpack wayland webp widgets wmf wxwidgets x264 x265 xattr xcb xcomposite xft xine xkb xml xscreensaver xv xvid zlib" ABI_X86="64" ADA_TARGET="gnat_2021" APACHE2_MODULES="authn_core authz_core socache_shmcb unixd actions alias auth_basic authn_alias authn_anon authn_dbm authn_default authn_file authz_dbm authz_default authz_groupfile authz_host authz_owner authz_user autoindex cache cgi cgid dav dav_fs dav_lock deflate dir disk_cache env expires ext_filter file_cache filter headers include info log_config logio mem_cache mime mime_magic negotiation rewrite setenvif speling status unique_id userdir usertrack vhost_alias" CALLIGRA_FEATURES="karbon sheets words" CAMERAS="*" COLLECTD_PLUGINS="df interface irq load memory rrdtool swap syslog" CPU_FLAGS_X86="aes avx avx2 f16c fma3 mmx mmxext pclmul popcnt rdrand sha sse sse2 sse3 sse4_1 sse4_2 sse4a ssse3" ELIBC="glibc" GPSD_PROTOCOLS="ashtech aivdm earthmate evermore fv18 garmin garmintxt gpsclock greis isync itrax mtk3301 nmea ntrip navcom oceanserver oldstyle oncore rtcm104v2 rtcm104v3 sirf skytraq superstar2 timing tsip tripmate tnt ublox ubx" GRUB_PLATFORMS="efi-64" INPUT_DEVICES="libinput wacom" KERNEL="linux" LCD_DEVICES="bayrad cfontz cfontz633 glk hd44780 lb216 lcdm001 mtxorb ncurses text" LIBREOFFICE_EXTENSIONS="presenter-console presenter-minimizer" LUA_SINGLE_TARGET="lua5-1" LUA_TARGETS="lua5-1" NGINX_MODULES_HTTP="autoindex fancyindex fastcgi gzip" OFFICE_IMPLEMENTATION="libreoffice" PHP_TARGETS="php8-1" POSTGRES_TARGETS="postgres15" PYTHON_SINGLE_TARGET="python3_11" PYTHON_TARGETS="python3_11" QEMU_SOFTMMU_TARGETS="x86_64" QEMU_USER_TARGETS="x86_64" RUBY_TARGETS="(-ruby27) (-ruby30) ruby31 ruby32" SANE_BACKENDS="epson epson2" VIDEO_CARDS="amdgpu radeonsi" XTABLES_ADDONS="quota2 psd pknock lscan length2 ipv4options ipset ipp2p iface geoip fuzzy condition tee tarpit sysrq proto steal rawnat logmark ipmark dhcpmac delude chaos account" Unset: ADDR2LINE, ARFLAGS, AS, ASFLAGS, CCLD, CONFIG_SHELL, CPP, CPPFLAGS, CTARGET, CXXFILT, ELFEDIT, EXTRA_ECONF, F77FLAGS, FC, GCOV, GPROF, INSTALL_MASK, LC_ALL, LD, LFLAGS, LIBTOOL, MAKE, MAKEFLAGS, OBJCOPY, OBJDUMP, PORTAGE_BINHOST, PORTAGE_BUNZIP2_COMMAND, PORTAGE_COMPRESS, PORTAGE_COMPRESS_FLAGS, PORTAGE_RSYNC_EXTRA_OPTS, READELF, RUSTFLAGS, SIZE, STRINGS, STRIP, YACC, YFLAGS
Created attachment 866560 [details] build log
I can confirm the behaviour as soon as python3.12 is installed. If I remove python3.12 (and use python3.11) the package builds properly.
Just needs to use python-any-r1.
If your merge failed because you depend on modemmanager, adding this to your use flags will remove this dep: net-misc/modemmanager -mbim -qrtr -qmi
Error comes from meson.build's find_installation('python3') rather than something custom libmbim itself is doing, and: 16:28 < ztrawhcse> ionen: yeah, meson itself doesn't care if you have distutils, and meson's find_program('python3') doesn't care either, but the find_installation() bits that are specifically intended to compile python extensions and install them to site-packages... do need distutils to figure out how to compile/link against the python installation But one thing is that this doesn't install anything to site-packages...? My impression is that this is using the wrong way to find python. fwics it's only using it to call a command: command: [ python, mbim_mkenums, And with find_program distutils shouldn't matter.
Either way I'll just drop 3.12 compat for now so it's stop failing over this. I think this should ideally be handled upstream. And meanwhile it'd probably be better to either patch meson.build than add a setuptools check, or wait till a bump that fixes it to add compat.
Yup, this is a common weirdness. The "correct" way to find a program -- any program -- is to use `find_program('XXX')`, but some people think that just because `import('python').find_installation()` exists that it is somehow the "better" way to... find a program. The reality is that find_installation runs some relatively slow checks which aren't guaranteed to succeed (witness the requirement for distutils) that is totally irrelevant for finding a program, but vital for compiling C extensions against the Python headers. Slow is, naturally, bad. :D In this case it happens to break entirely. Switching to find_program() is a nice optimization that also makes it compatible with python 3.12 without adding a pointless dependency on dev-python/setuptools.
The bug has been referenced in the following commit(s): https://gitweb.gentoo.org/repo/gentoo.git/commit/?id=7ca859d13f44e10a66ccc50af5b346ac768db6fd commit 7ca859d13f44e10a66ccc50af5b346ac768db6fd Author: Ionen Wolkens <ionen@gentoo.org> AuthorDate: 2023-07-30 20:44:19 +0000 Commit: Ionen Wolkens <ionen@gentoo.org> CommitDate: 2023-07-30 20:44:38 +0000 net-libs/libmbim: disable py3.12 Just a quick fix until it's properly handled. Bug: https://bugs.gentoo.org/911418 Signed-off-by: Ionen Wolkens <ionen@gentoo.org> net-libs/libmbim/libmbim-1.28.4.ebuild | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-)
The bug has been referenced in the following commit(s): https://gitweb.gentoo.org/repo/gentoo.git/commit/?id=02345e335d511c93f991e50a7dfa3e6521cd8f64 commit 02345e335d511c93f991e50a7dfa3e6521cd8f64 Author: Sam James <sam@gentoo.org> AuthorDate: 2023-08-18 10:51:41 +0000 Commit: Sam James <sam@gentoo.org> CommitDate: 2023-08-18 10:51:41 +0000 gui-libs/vte-common: disable py3.12 See the discussion in bug #911418. Bug: https://bugs.gentoo.org/911418 Bug: https://bugs.gentoo.org/912397 Signed-off-by: Sam James <sam@gentoo.org> gui-libs/vte-common/vte-common-0.72.2.ebuild | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) https://gitweb.gentoo.org/repo/gentoo.git/commit/?id=8dfad705738e62c917c2fb29fbc08d364d0d1d52 commit 8dfad705738e62c917c2fb29fbc08d364d0d1d52 Author: Sam James <sam@gentoo.org> AuthorDate: 2023-08-18 10:50:55 +0000 Commit: Sam James <sam@gentoo.org> CommitDate: 2023-08-18 10:50:55 +0000 dev-libs/glib: disable py3.12 See the discussion in bug #911418. Bug: https://bugs.gentoo.org/911418 Bug: https://bugs.gentoo.org/912437 Signed-off-by: Sam James <sam@gentoo.org> dev-libs/glib/glib-2.76.3.ebuild | 2 +- dev-libs/glib/glib-2.76.4.ebuild | 2 +- dev-libs/glib/glib-2.77.1.ebuild | 2 +- 3 files changed, 3 insertions(+), 3 deletions(-)
The bug has been referenced in the following commit(s): https://gitweb.gentoo.org/repo/gentoo.git/commit/?id=df8e5c3eef098554b4201b616f4bf5c8c8d5b045 commit df8e5c3eef098554b4201b616f4bf5c8c8d5b045 Author: Sam James <sam@gentoo.org> AuthorDate: 2023-08-18 10:53:18 +0000 Commit: Sam James <sam@gentoo.org> CommitDate: 2023-08-18 10:53:18 +0000 sys-apps/systemd-utils: disable py3.12 See the discussion in bug #911418. Bug: https://bugs.gentoo.org/911418 Bug: https://bugs.gentoo.org/911990 Signed-off-by: Sam James <sam@gentoo.org> sys-apps/systemd-utils/systemd-utils-253.5.ebuild | 2 +- sys-apps/systemd-utils/systemd-utils-253.6.ebuild | 2 +- sys-apps/systemd-utils/systemd-utils-253.7.ebuild | 2 +- sys-apps/systemd-utils/systemd-utils-253.8.ebuild | 2 +- 4 files changed, 4 insertions(+), 4 deletions(-)
The bug has been referenced in the following commit(s): https://gitweb.gentoo.org/repo/gentoo.git/commit/?id=fb90f5c637e8eed1f52dd81f033d4d41ac2c272a commit fb90f5c637e8eed1f52dd81f033d4d41ac2c272a Author: Sam James <sam@gentoo.org> AuthorDate: 2023-08-18 10:55:02 +0000 Commit: Sam James <sam@gentoo.org> CommitDate: 2023-08-18 10:55:02 +0000 x11-libs/vte: disable py3.12 See the discussion in bug #911418. Bug: https://bugs.gentoo.org/911418 Bug: https://bugs.gentoo.org/912452 Signed-off-by: Sam James <sam@gentoo.org> x11-libs/vte/vte-0.72.2.ebuild | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) https://gitweb.gentoo.org/repo/gentoo.git/commit/?id=20ddf3af01a6fd7508a4a9d7140755b54886fc31 commit 20ddf3af01a6fd7508a4a9d7140755b54886fc31 Author: Sam James <sam@gentoo.org> AuthorDate: 2023-08-18 10:54:29 +0000 Commit: Sam James <sam@gentoo.org> CommitDate: 2023-08-18 10:54:29 +0000 gui-libs/vte: disable py3.12 See the discussion in bug #911418. Bug: https://bugs.gentoo.org/911418 Bug: https://bugs.gentoo.org/912452 Signed-off-by: Sam James <sam@gentoo.org> gui-libs/vte/vte-0.72.2.ebuild | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-)
The bug has been referenced in the following commit(s): https://gitweb.gentoo.org/repo/gentoo.git/commit/?id=f2cee4e88141419da9816f23f70196140a57c233 commit f2cee4e88141419da9816f23f70196140a57c233 Author: John Helmert III <ajak@gentoo.org> AuthorDate: 2023-09-10 17:45:29 +0000 Commit: John Helmert III <ajak@gentoo.org> CommitDate: 2023-09-10 18:03:51 +0000 dev-util/rizin: disable py3.12 See the discussion in bug #911418. Bug: https://bugs.gentoo.org/911418 Signed-off-by: John Helmert III <ajak@gentoo.org> dev-util/rizin/rizin-0.6.1.ebuild | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-)
The bug has been closed via the following commit(s): https://gitweb.gentoo.org/repo/gentoo.git/commit/?id=c0ad7b00c772c71a74ec42be0bf594ee9198b71c commit c0ad7b00c772c71a74ec42be0bf594ee9198b71c Author: Sam James <sam@gentoo.org> AuthorDate: 2023-10-03 16:13:02 +0000 Commit: Sam James <sam@gentoo.org> CommitDate: 2023-10-03 16:13:51 +0000 dev-util/meson: backport PEP632 py3.12 fixes, revert bindgen breakage * Backport PEP632 fixes for Python 3.12 * Revert bindgen patch on 1.2.x branch which broke Mesa Closes: https://bugs.gentoo.org/914989 Closes: https://bugs.gentoo.org/915014 Closes: https://bugs.gentoo.org/911418 Closes: https://bugs.gentoo.org/911990 Closes: https://bugs.gentoo.org/912397 Closes: https://bugs.gentoo.org/912437 Closes: https://bugs.gentoo.org/912452 Closes: https://bugs.gentoo.org/912282 Signed-off-by: Sam James <sam@gentoo.org> ...ndency-ensure-that-setuptools-doesn-t-inj.patch | 39 ++++++ ...le-stop-using-distutils-schemes-on-suffic.patch | 72 +++++++++++ ...le-refactor-pypy-detection-into-a-consist.patch | 36 ++++++ ...le-stop-using-distutils-link-to-libpython.patch | 72 +++++++++++ ...est-case-to-not-import-distutils-on-pytho.patch | 31 +++++ ...e-PyPI-metadata-as-supporting-python-3.12.patch | 25 ++++ ...-apply-global-project-and-environment-C-a.patch | 141 +++++++++++++++++++++ dev-util/meson/meson-1.2.2-r1.ebuild | 122 ++++++++++++++++++ 8 files changed, 538 insertions(+)