Gentoo Websites Logo
Go to: Gentoo Home Documentation Forums Lists Bugs Planet Store Wiki Get Gentoo!

Bug 932712

Summary: dev-python/pycuda-2024.1 - numpy/arrayobject.h: No such file or directory
Product: Gentoo Linux Reporter: Leonid Kopylov <leonchik1976>
Component: Current packagesAssignee: Gentoo Science Related Packages <sci>
Status: UNCONFIRMED ---    
Severity: normal CC: 2sks05fxw, harrisl, jstein, parona, richard.yao
Priority: Normal    
Version: unspecified   
Hardware: All   
OS: Linux   
See Also: https://github.com/inducer/pycuda/issues/450
https://github.com/inducer/pycuda/pull/451
Whiteboard:
Package list:
Runtime testing required: ---
Bug Depends on:    
Bug Blocks: 930951    
Attachments: build.log
Another build log

Description Leonid Kopylov 2024-05-25 07:20:48 UTC
# emerge -pqv '=dev-python/pycuda-2024.1::gentoo'
[ebuild  N    ] dev-python/pycuda-2024.1  USE="examples -test" PYTHON_TARGETS="python3_11 python3_12 -python3_10"

# emerge --info '=dev-python/pycuda-2024.1::gentoo'
Portage 3.0.64 (python 3.12.3-final-0, default/linux/amd64/23.0/desktop/gnome/systemd, gcc-14, glibc-2.39-r6, 6.9.1-gentoo-amd64 x86_64)
=================================================================
                         System Settings
=================================================================
System uname: Linux-6.9.1-gentoo-amd64-x86_64-13th_Gen_Intel-R-_Core-TM-_i7-1360P-with-glibc2.39
KiB Mem:    63328580 total,  33609960 free
KiB Swap:    8388604 total,   8388604 free
Timestamp of repository gentoo: Fri, 24 May 2024 06:30:00 +0000
Head commit of repository gentoo: 9aa2b1a14f8c5d41f02b5112c31e9a2f47e928b1
sh bash 5.2_p26-r3
ld GNU ld (Gentoo 2.42 p3) 2.42.0
ccache version 4.9.1 [enabled]
app-misc/pax-utils:        1.3.7::gentoo
app-shells/bash:           5.2_p26-r3::gentoo
dev-build/autoconf:        2.71-r7::gentoo, 2.72-r1::gentoo
dev-build/automake:        1.16.5-r2::gentoo
dev-build/cmake:           3.29.3::gentoo
dev-build/libtool:         2.4.7-r4::gentoo
dev-build/make:            4.4.1-r1::gentoo
dev-build/meson:           1.4.0-r1::gentoo
dev-java/java-config:      2.3.3-r1::gentoo
dev-lang/perl:             5.38.2-r5::gentoo
dev-lang/python:           3.11.9-r1::gentoo, 3.12.3-r1::gentoo, 3.13.0_beta1_p2::gentoo
dev-lang/rust:             1.77.1::gentoo
dev-lang/rust-bin:         1.77.1::gentoo
dev-util/ccache:           4.9.1-r1::gentoo
sys-apps/baselayout:       2.15::gentoo
sys-apps/sandbox:          2.38::gentoo
sys-apps/systemd:          255.6::gentoo
sys-devel/binutils:        2.42-r1::gentoo
sys-devel/binutils-config: 5.5::gentoo
sys-devel/clang:           15.0.7-r3::gentoo, 16.0.6::gentoo, 17.0.6::gentoo, 18.1.6::gentoo
sys-devel/gcc:             12.3.1_p20240502::gentoo, 13.3.0::gentoo, 14.1.1_p20240518::gentoo
sys-devel/gcc-config:      2.11::gentoo
sys-devel/llvm:            15.0.7-r3::gentoo, 16.0.6::gentoo, 17.0.6::gentoo, 18.1.6::gentoo
sys-kernel/linux-headers:  6.9::gentoo (virtual/os-headers)
sys-libs/glibc:            2.39-r6::gentoo
Repositories:

gentoo
    location: /var/db/repos/gentoo
    sync-type: rsync
    sync-uri: rsync://gentoo.kopylovs.net/gentoo-portage
    priority: -1000
    volatile: False
    sync-rsync-verify-metamanifest: yes
    sync-rsync-verify-jobs: 1
    sync-rsync-extra-opts:
    sync-rsync-verify-max-age: 3

Binary Repositories:

gentoobinhost
    priority: 1
    sync-uri: https://distfiles.gentoo.org/releases/amd64/binpackages/23.0/x86-64

ACCEPT_KEYWORDS="amd64 ~amd64"
ACCEPT_LICENSE="* -@EULA android AnyDesk-TOS geekbench google-chrome Intel-SDP microsoft-edge Microsoft-vscode NVIDIA-CUDA NVIDIA-SDK OPERA-2018 PUEL-11 RAR TeamViewer Vivaldi"
CBUILD="x86_64-pc-linux-gnu"
CFLAGS="-march=native -O2 -pipe -fomit-frame-pointer"
CHOST="x86_64-pc-linux-gnu"
CONFIG_PROTECT="/etc /usr/share/gnupg/qualified.txt"
CONFIG_PROTECT_MASK="/etc/ca-certificates.conf /etc/dconf /etc/env.d /etc/fonts/fonts.conf /etc/gconf /etc/gentoo-release /etc/revdep-rebuild /etc/sandbox.d /etc/texmf/language.dat.d /etc/texmf/language.def.d /etc/texmf/updmap.d /etc/texmf/web2c"
CXXFLAGS="-march=native -O2 -pipe -fomit-frame-pointer"
DISTDIR="/var/cache/distfiles"
ENV_UNSET="CARGO_HOME DBUS_SESSION_BUS_ADDRESS DISPLAY GDK_PIXBUF_MODULE_FILE GOBIN GOPATH PERL5LIB PERL5OPT PERLPREFIX PERL_CORE PERL_MB_OPT PERL_MM_OPT XAUTHORITY XDG_CACHE_HOME XDG_CONFIG_HOME XDG_DATA_HOME XDG_RUNTIME_DIR XDG_STATE_HOME"
FCFLAGS="-march=native -O2 -pipe -fomit-frame-pointer"
FEATURES="assume-digests binpkg-docompress binpkg-dostrip binpkg-logs binpkg-multi-instance buildpkg-live ccache config-protect-if-modified distlocks ebuild-locks fixlafiles ipc-sandbox merge-sync merge-wait multilib-strict network-sandbox news parallel-fetch pid-sandbox pkgdir-index-trusted preserve-libs protect-owned qa-unresolved-soname-deps sandbox sfperms strict strict-keepdir unknown-features-warn unmerge-logs unmerge-orphans userfetch userpriv usersandbox usersync warn-on-large-env xattr"
FFLAGS="-march=native -O2 -pipe -fomit-frame-pointer"
GENTOO_MIRRORS="http://mirror.isoc.org.il/pub/gentoo/ https://mirror.eu.oneandone.net/linux/distributions/gentoo/gentoo/"
LANG="en_US.utf8"
LC_ALL="en_US.UTF-8"
LDFLAGS="-Wl,-O1 -Wl,--as-needed -Wl,-z,pack-relative-relocs"
LEX="flex"
MAKEOPTS="-j10"
PKGDIR="/var/cache/binpkgs"
PORTAGE_CONFIGROOT="/"
PORTAGE_RSYNC_OPTS="--recursive --links --safe-links --perms --times --omit-dir-times --compress --force --whole-file --delete --stats --human-readable --timeout=180 --exclude=/distfiles --exclude=/local --exclude=/packages --exclude=/.git"
PORTAGE_TMPDIR="/var/tmp"
SHELL="/bin/bash"
USE="X a52 aac accessibility acl acpi alsa amd64 audit bash-completion berkdb bidi bluetooth branding brotli btrfs bzip2 cairo cdda cdr cet cli colord crypt cryptsetup cuda cups curl dbus designer device-mapper doc dri drm dts dvd dvdr eds emacs encode evdev evo examples exif experimental ffmpeg flac fortran fuse gamepad gdbm gif git gmp gnome gnome-keyring gnome-online-accounts gnome-shell gnutls go gpg gpm gstreamer gtk gtk-doc gui hscolour html http iconv icu idn introspection iodbc ios ipv6 jack java jemalloc joystick jpeg json kde kerberos keyring lcms ldap libnotify libtirpc lm-sensors lua lvm lz4 lzma lzo mad man mbedtls mng mongodb mp3 mp4 mpeg mpi multilib multimedia mysql nas nautilus ncurses netlink network networkmanager nfs nls nss nvenc odbc offensive ogg opencl opengl openmp openssl pam pango pcap pcre pdf perl pkcs11 plasma plugins png policykit postgres ppds pulseaudio python qml qt5 qt6 readline redis samba sasl screencast sdl seccomp semantic-desktop snmp sound source speech spell sqlite ssl startup-notification svg symlink sysprof systemd tcl telemetry test-rust threads tiff tk tools tpm tracker truetype udev udisks unicode upower usb utils v4l vaapi vala vdpau vim-syntax vnc vorbis vulkan wayland webengine webkit webp wifi wxwidgets x264 xattr xcb xen xft xinerama xml xv xvid yaml zeroconf zip zlib zsh-completion zstd" ABI_X86="64 32" ADA_TARGET="gcc_12" APACHE2_MODULES="actions alias auth_basic auth_digest authn_anon authn_core authn_dbd authn_dbm authn_file authn_socache authz_core authz_dbd authz_dbm authz_groupfile authz_host authz_owner authz_user autoindex brotli cache cgi cgid charset_lite dav dav_fs dav_lock dbd deflate dir env expires ext_filter file_cache filter headers http2 ident imagemap include info log_config logio mime mime_magic negotiation ratelimit reqtimeout rewrite session session_cookie session_crypto session_dbd setenvif socache_shmcb speling status substitute tls unique_id unixd userdir usertrack version vhost_alias watchdog xml2enc" APACHE2_MPMS="worker" CALLIGRA_FEATURES="karbon sheets stage words" COLLECTD_PLUGINS="df interface irq load memory rrdtool swap syslog" CPU_FLAGS_X86="aes avx avx2 f16c fma3 mmx mmxext pclmul popcnt rdrand sha sse sse2 sse3 sse4_1 sse4_2 ssse3 vpclmulqdq" ELIBC="glibc" GPSD_PROTOCOLS="ashtech aivdm earthmate evermore fv18 garmin garmintxt gpsclock greis isync itrax mtk3301 ntrip navcom oceanserver oncore rtcm104v2 rtcm104v3 sirf skytraq superstar2 tsip tripmate tnt ublox" GRUB_PLATFORMS="efi-64" INPUT_DEVICES="evdev joystick libinput" KERNEL="linux" L10N="en en-US he ru" LCD_DEVICES="bayrad cfontz glk hd44780 lb216 lcdm001 mtxorb text" LIBREOFFICE_EXTENSIONS="nlpsolver scripting-beanshell scripting-javascript wiki-publisher" LUA_SINGLE_TARGET="lua5-1" LUA_TARGETS="lua5-1" NGINX_MODULES_HTTP="access addition auth_basic auth_ldap auth_pam auth_request autoindex brotli browser charset dav dav_ext echo empty_gif fancyindex fastcgi flv geo geoip geoip2 grpc gunzip gzip image_filter javascript limit_conn limit_req map memc memcached metrics mirror mp4 perl proxy push_stream referer rewrite scgi split_clients ssi stub_status upload_progress upstream_check upstream_hash upstream_ip_hash upstream_keepalive upstream_least_conn upstream_zone userid uwsgi vhost_traffic_status xslt" NGINX_MODULES_MAIL="imap pop3 smtp" NGINX_MODULES_STREAM="access" OFFICE_IMPLEMENTATION="libreoffice" PERL_FEATURES="ithreads quadmath" PHP_TARGETS="php8-1" POSTGRES_TARGETS="postgres15" PYTHON_SINGLE_TARGET="python3_12" PYTHON_TARGETS="python3_11 python3_12 python3_13" RUBY_TARGETS="ruby31 ruby32 ruby33" UWSGI_PLUGINS="alarm_curl cache carbon cheaper_busyness clock_monotonic clock_realtime corerouter curl_cron dumbloop echo emperor_amqp emperor_pg emperor_zeromq fastrouter forkptyrouter geoip graylog2 http ldap legion_cache_fetch logcrypto logfile logpipe logsocket mongodblog nagios notfound pam ping rados rawrouter redislog router_access router_basicauth router_cache router_expires router_hash router_http router_memcached router_metrics router_redirect router_redis router_rewrite router_spnego router_static router_uwsgi router_xmldir rpc rrdtool rsyslog signal spooler sqlite ssi sslrouter stats_pusher_statsd symcall syslog systemd_logger transformation_chunked transformation_gzip transformation_offload transformation_tofile transformation_toupper tuntap ugreen webdav xattr xslt zabbix zergpool" VIDEO_CARDS="intel fbdev vesa nvidia" XTABLES_ADDONS="quota2 psd pknock lscan length2 ipv4options ipp2p iface geoip fuzzy condition tarpit sysrq proto logmark ipmark dhcpmac delude chaos account"
Unset:  ADDR2LINE, AR, ARFLAGS, AS, ASFLAGS, CC, CCLD, CONFIG_SHELL, CPP, CPPFLAGS, CTARGET, CXX, CXXFILT, ELFEDIT, EMERGE_DEFAULT_OPTS, EXTRA_ECONF, F77FLAGS, FC, GCOV, GPROF, INSTALL_MASK, LD, LFLAGS, LIBTOOL, LINGUAS, MAKE, MAKEFLAGS, NM, OBJCOPY, OBJDUMP, PORTAGE_BINHOST, PORTAGE_BUNZIP2_COMMAND, PORTAGE_COMPRESS, PORTAGE_COMPRESS_FLAGS, PORTAGE_RSYNC_EXTRA_OPTS, PYTHONPATH, RANLIB, READELF, RUSTFLAGS, SIZE, STRINGS, STRIP, YACC, YFLAGS
Comment 1 Leonid Kopylov 2024-05-25 07:21:00 UTC
Created attachment 894324 [details]
build.log
Comment 2 Alfred Wingate 2024-07-20 17:21:49 UTC
*** Bug 936401 has been marked as a duplicate of this bug. ***
Comment 3 Richard Yao 2024-07-22 15:45:18 UTC
Created attachment 898117 [details]
Another build log

I have the same problem.
Comment 4 Richard Yao 2024-07-22 15:48:32 UTC
The issue is that numpy installs the headers to:

/usr/lib/python3.11/site-packages/numpy/_core/include/numpy/arrayobject.h
/usr/lib/python3.12/site-packages/numpy/_core/include/numpy/arrayobject.h

However, pycuda is passing -I/usr/lib/python3.11/site-packages/numpy/core/include to gcc. Someone changed core to _core and pycuda was not informed.
Comment 5 Richard Yao 2024-07-22 16:28:23 UTC
Disregard that last message. The real issue is that numpy 2 is not supported and the dependencies for this package do not disallow numpy 2. You can workaround this by doing `emerge -av numpy:0/0`. Then pycuda will build. However, updates will still want to install numpy 2.
Comment 6 Sam James archtester Gentoo Infrastructure gentoo-dev Security 2024-07-22 16:29:24 UTC
Yeah, the issue is well-understood already (hence blocking the tracker + see also'd upstream bug).
Comment 7 Richard Yao 2024-07-22 16:32:48 UTC
(In reply to Sam James from comment #6)
> Yeah, the issue is well-understood already (hence blocking the tracker + see
> also'd upstream bug).

Perhaps someone should update RDEPEND in dev-python/pycuda/pycuda-2024.1.ebuild to `<dev-python/numpy-2.0.0[${PYTHON_USEDEP}]`. Otherwise, `emerge --jobs --keep-going --with-bdeps=y -avDuN @world` will want to rebuild pycuda when updating older systems that have it and it will break.
Comment 8 Richard Yao 2024-07-22 16:36:32 UTC
(In reply to Richard Yao from comment #7)
> (In reply to Sam James from comment #6)
> > Yeah, the issue is well-understood already (hence blocking the tracker + see
> > also'd upstream bug).
> 
> Perhaps someone should update RDEPEND in
> dev-python/pycuda/pycuda-2024.1.ebuild to
> `<dev-python/numpy-2.0.0[${PYTHON_USEDEP}]`. Otherwise, `emerge --jobs
> --keep-going --with-bdeps=y -avDuN @world` will want to rebuild pycuda when
> updating older systems that have it and it will break.

Actually, it is not that it wants to rebuild it, but that it wants to update it, but it will have already updated numpy. In any case, I spent far too much time on this issue when updating an older machine this morning. :/
Comment 9 Harris Landgarten 2024-08-23 15:38:42 UTC
This bug is fixed in pycuda-2024.1.2

I cp pycuda-2024.1.ebuild to pycuda-2024.1.2.ebuild and it built to completion. I have not check functionality yet.