Bug 910738 – dev-python/numpy-1.24.4: test failures introduced by CPU_FLAGS_X86 changes

• Product: Gentoo Linux
• Status: RESOLVED FIXED

[Description Sam James 2023-07-23 17:20:30 UTC]

Created attachment 866017 [details]
build.log.xz

FAILED numpy/core/tests/test_multiarray.py::TestDot::test_huge_vectordot[float64] - ValueError: array is too big; `arr.size * arr.dtype.itemsize` is larger than the maximum possible size.
FAILED numpy/core/tests/test_multiarray.py::TestDot::test_huge_vectordot[complex128] - ValueError: array is too big; `arr.size * arr.dtype.itemsize` is larger than the maximum possible size.
FAILED numpy/distutils/tests/test_ccompiler_opt.py::TestCCompilerOpt_x86_gcc::test_flags - AssertionError: flags "-mGENTOO_DISABLE -mGENTOO_DISABLE" not match "-msse -msse2$"
FAILED numpy/distutils/tests/test_ccompiler_opt.py::TestCCompilerOpt_x86_clang::test_flags - AssertionError: flags "-mGENTOO_DISABLE -mGENTOO_DISABLE" not match "-msse -msse2$"
FAILED numpy/distutils/tests/test_ccompiler_opt.py::TestCCompilerOpt_x86_icc::test_flags - AssertionError: flags "-mGENTOO_DISABLE -mGENTOO_DISABLE" not match "-msse -msse2$"
FAILED numpy/distutils/tests/test_ccompiler_opt.py::TestCCompilerOpt_x64_gcc::test_flags - AssertionError: flags "-mGENTOO_DISABLE -mGENTOO_DISABLE" not match "-msse -msse2$"
FAILED numpy/distutils/tests/test_ccompiler_opt.py::TestCCompilerOpt_x64_clang::test_flags - AssertionError: flags "-mGENTOO_DISABLE -mGENTOO_DISABLE" not match "-msse -msse2$"
FAILED numpy/distutils/tests/test_ccompiler_opt.py::TestCCompilerOpt_x64_icc::test_flags - AssertionError: flags "-mGENTOO_DISABLE -mGENTOO_DISABLE" not match "-msse -msse2$"
FAILED numpy/distutils/tests/test_ccompiler_opt.py::TestCCompilerOpt_ppc64_gcc::test_flags - AssertionError: flags "-mGENTOO_DISABLE -mcpu=power8" not match "-mcpu=power8$"
FAILED numpy/distutils/tests/test_ccompiler_opt.py::TestCCompilerOpt_ppc64le_gcc::test_flags - AssertionError: flags "-mGENTOO_DISABLE -mcpu=power8" not match "-mcpu=power8$"

----

~/g/dev-python/numpy $ grep -rsin ENTOO_DISABLE
files/replace_cpuflags.awk:12:    if (!GENTOO_ENABLE) { sub(cflags[1], "-mGENTOO_DISABLE"); }

----

# emerge --info
Portage 3.0.49 (python 3.11.4-final-0, default/linux/ppc/17.0/systemd/merged-usr, gcc-13, glibc-2.37-r3, 6.1.27-gentoo-dist-hardened ppc)
=================================================================
System uname: Linux-6.1.27-gentoo-dist-hardened-ppc-POWER9_-architected-,_altivec_supported-with-glibc2.37
KiB Mem:    32847428 total,  13951016 free
KiB Swap:   67108860 total,  66885512 free
Timestamp of repository gentoo: Sun, 23 Jul 2023 16:46:51 +0000
sh bash 5.2_p15-r6
ld GNU ld (Gentoo 2.40 p5) 2.40.0
app-misc/pax-utils:        1.3.7::gentoo
app-shells/bash:           5.2_p15-r6::gentoo
dev-lang/perl:             5.38.0-r1::gentoo
dev-lang/python:           3.11.4::gentoo
dev-util/cmake:            3.26.4-r1::gentoo
dev-util/meson:            1.1.1::gentoo
sys-apps/baselayout:       2.14::gentoo
sys-apps/sandbox:          2.36::gentoo
sys-apps/systemd:          253.6::gentoo
sys-devel/autoconf:        2.71-r6::gentoo
sys-devel/automake:        1.16.5-r1::gentoo
sys-devel/binutils:        2.40-r5::gentoo
sys-devel/binutils-config: 5.5::gentoo
sys-devel/gcc:             10.5.0::gentoo, 11.4.1_p20230622::gentoo, 12.3.1_p20230623::gentoo, 13.1.1_p20230527::gentoo, 14.0.0_pre20230702::gentoo
sys-devel/gcc-config:      2.11::gentoo
sys-devel/libtool:         2.4.7-r1::gentoo
sys-devel/make:            4.4.1-r1::gentoo
sys-kernel/linux-headers:  6.4::gentoo (virtual/os-headers)
sys-libs/glibc:            2.37-r3::gentoo
Repositories:

gentoo
    location: /var/db/repos/gentoo
    sync-type: rsync
    sync-uri: rsync://rsync.gentoo.org/gentoo-portage
    priority: -1000
    volatile: False
    sync-rsync-extra-opts: 
    sync-rsync-verify-jobs: 1
    sync-rsync-verify-max-age: 24
    sync-rsync-verify-metamanifest: yes

ACCEPT_KEYWORDS="ppc ~ppc"
ACCEPT_LICENSE="*"
CBUILD="powerpc-unknown-linux-gnu"
CFLAGS="-O2 -mcpu=powerpc -mtune=powerpc -pipe"
CHOST="powerpc-unknown-linux-gnu"
CONFIG_PROTECT="/etc /usr/share/config /usr/share/gnupg/qualified.txt"
CONFIG_PROTECT_MASK="/etc/ca-certificates.conf /etc/env.d /etc/fonts/fonts.conf /etc/gconf /etc/gentoo-release /etc/revdep-rebuild /etc/sandbox.d"
CXXFLAGS="-O2 -mcpu=powerpc -mtune=powerpc -pipe"
DISTDIR="/var/cache/distfiles"
EMERGE_DEFAULT_OPTS="--nospinner --ask-enter-invalid --quiet-build --keep-going --complete-graph --with-bdeps=y --load-average 15 --deep --jobs=4"
ENV_UNSET="CARGO_HOME DBUS_SESSION_BUS_ADDRESS DISPLAY GDK_PIXBUF_MODULE_FILE GOBIN GOPATH PERL5LIB PERL5OPT PERLPREFIX PERL_CORE PERL_MB_OPT PERL_MM_OPT XAUTHORITY XDG_CACHE_HOME XDG_CONFIG_HOME XDG_DATA_HOME XDG_RUNTIME_DIR XDG_STATE_HOME"
FCFLAGS="-O2 -mcpu=powerpc -mtune=powerpc -pipe"
FEATURES="assume-digests binpkg-docompress binpkg-dostrip binpkg-logs binpkg-multi-instance buildpkg-live clean-logs config-protect-if-modified distlocks ebuild-locks fixlafiles ipc-sandbox merge-sync multilib-strict network-sandbox news parallel-fetch pid-sandbox preserve-libs protect-owned qa-unresolved-soname-deps sandbox sfperms split-elog split-log strict unknown-features-warn unmerge-logs unmerge-orphans userfetch userpriv usersandbox usersync xattr"
FFLAGS="-O2 -mcpu=powerpc -mtune=powerpc -pipe"
GENTOO_MIRRORS="https://gentoo.osuosl.org/"
LANG="C.UTF8"
LDFLAGS="-Wl,-O1 -Wl,--as-needed"
LEX="flex"
LINGUAS="en"
MAKEOPTS="-j16 -l15"
PKGDIR="/var/cache/binpkgs"
PORTAGE_CONFIGROOT="/"
PORTAGE_RSYNC_OPTS="--recursive --links --safe-links --perms --times --omit-dir-times --compress --force --whole-file --delete --stats --human-readable --timeout=180 --exclude=/distfiles --exclude=/local --exclude=/packages --exclude=/.git"
PORTAGE_TMPDIR="/var/tmp"
SHELL="/bin/bash"
USE="acl big-endian bzip2 cli crypt dri fortran gdbm iconv ipv6 ncurses nls nptl openmp pam pcre ppc readline seccomp ssl systemd test-rust udev unicode xattr zlib" ADA_TARGET="gnat_2021" APACHE2_MODULES="authn_core authz_core socache_shmcb unixd actions alias auth_basic authn_alias authn_anon authn_dbm authn_default authn_file authz_dbm authz_default authz_groupfile authz_host authz_owner authz_user autoindex cache cgi cgid dav dav_fs dav_lock deflate dir disk_cache env expires ext_filter file_cache filter headers include info log_config logio mem_cache mime mime_magic negotiation rewrite setenvif speling status unique_id userdir usertrack vhost_alias" CALLIGRA_FEATURES="karbon sheets words" COLLECTD_PLUGINS="df interface irq load memory rrdtool swap syslog" ELIBC="glibc" GPSD_PROTOCOLS="ashtech aivdm earthmate evermore fv18 garmin garmintxt gpsclock greis isync itrax mtk3301 nmea ntrip navcom oceanserver oldstyle oncore rtcm104v2 rtcm104v3 sirf skytraq superstar2 timing tsip tripmate tnt ublox ubx" INPUT_DEVICES="libinput" KERNEL="linux" L10N="en" LCD_DEVICES="bayrad cfontz cfontz633 glk hd44780 lb216 lcdm001 mtxorb ncurses text" LIBREOFFICE_EXTENSIONS="presenter-console presenter-minimizer" LUA_SINGLE_TARGET="lua5-1" LUA_TARGETS="lua5-1" OFFICE_IMPLEMENTATION="libreoffice" PHP_TARGETS="php8-1" POSTGRES_TARGETS="postgres15" PYTHON_SINGLE_TARGET="python3_11" PYTHON_TARGETS="python3_11" RUBY_TARGETS="ruby31" VIDEO_CARDS="fbdev mga r128 radeon dummy v4l" XTABLES_ADDONS="quota2 psd pknock lscan length2 ipv4options ipset ipp2p iface geoip fuzzy condition tee tarpit sysrq proto steal rawnat logmark ipmark dhcpmac delude chaos account"
Unset:  ADDR2LINE, AR, ARFLAGS, AS, ASFLAGS, CC, CCLD, CONFIG_SHELL, CPP, CPPFLAGS, CTARGET, CXX, CXXFILT, ELFEDIT, EXTRA_ECONF, F77FLAGS, FC, GCOV, GPROF, INSTALL_MASK, LC_ALL, LD, LFLAGS, LIBTOOL, MAKE, MAKEFLAGS, NM, OBJCOPY, OBJDUMP, PORTAGE_BINHOST, PORTAGE_BUNZIP2_COMMAND, PORTAGE_COMPRESS, PORTAGE_COMPRESS_FLAGS, PORTAGE_RSYNC_EXTRA_OPTS, RANLIB, READELF, RUSTFLAGS, SIZE, STRINGS, STRIP, YACC, YFLAGS

[Comment 1 Sam James 2023-08-01 07:33:16 UTC]

ping heroxbd

[Comment 2 Benda Xu 2023-08-01 09:31:05 UTC]

pong.  NumPy make CPU flags unconfigurable. We want the reverse.

Let's fix the test case.

[Comment 3 Benda Xu 2023-08-05 06:53:55 UTC]

I think we should disable the numpy/distutils/tests/test_ccompiler_opt.py , because portage should control all the CFLAGS, not letting NumPy build system do the cheap seconds guesses.

[Comment 4 Larry the Git Cow 2023-08-05 07:03:04 UTC]

The bug has been closed via the following commit(s):

https://gitweb.gentoo.org/repo/gentoo.git/commit/?id=a579f33eee1d71250cbb418c39ae0179449bd940

commit a579f33eee1d71250cbb418c39ae0179449bd940
Author:     Benda Xu <[e-mail]>
AuthorDate: 2023-08-05 07:00:03 +0000
Commit:     Benda Xu <[e-mail]>
CommitDate: 2023-08-05 07:02:03 +0000

    dev-python/numpy: drop numpy/distutils/tests/test_ccompiler_opt.py
    
    This test is useless to Gentoo.  Portage should control all the
    CFLAGS, not letting NumPy distutils do the guesses.
    
    Closes: https://bugs.gentoo.org/910738
    
    Signed-off-by: Benda Xu <[e-mail]>

 dev-python/numpy/numpy-1.24.4-r1.ebuild | 1 +
 1 file changed, 1 insertion(+)