Bug 750386 – dev-python/numpy-1.19.2 fails 139 tests under m68k chroot

• Product: Gentoo Linux
• Status: RESOLVED INVALID

[Description Kent Fredric (IRC: kent\n) (RETIRED) 2020-10-20 08:36:10 UTC]

Created attachment 667496 [details]
build.log.gz

Under qemu-m68k binfmt_misc driven chroot, failures occur in:

> core/tests/test_arrayprint.py          x  1
> core/tests/test_datetime.py            x  7
> core/tests/test_dtype.py               x  2
> core/tests/test_errstate.py            x  2
> core/tests/test_half.py                x  2
> core/tests/test_longdouble.py          x  1
> core/tests/test_multiarray.py          x  5
> core/tests/test_numeric.py             x  6
> core/tests/test_print.py               x 10
> core/tests/test_regression.py          x  1
> core/tests/test_scalarprint.py         x  1
> core/tests/test_ufunc.py               x  2
> core/tests/test_umath.py               x 10
> core/tests/test_umath_complex.py       x 10
> f2py/tests/test_return_character.py    x  8
> lib/tests/test_arraypad.py             x  5
> lib/tests/test_financial.py            x  4
> lib/tests/test_function_base.py        x 21
> lib/tests/test_histograms.py           x  4
> lib/tests/test_nanfunctions.py         x  1
> lib/tests/test_polynomial.py           x  2
> lib/tests/test_type_check.py           x  4
> lib/tests/test_ufunclike.py            x  2
> linalg/tests/test_linalg.py            x 23
> random/tests/test_generator_mt19937.py x  3
> tests/test_ctypeslib.py                x  1

First failure assertion:

E           Items are not equal:
E            ACTUAL: '[0.-0.j]'
E            DESIRED: '[0.+1.j]'

Which doesn't seem good.

Most of the failures seem to be around complex number/inf/nan handling, so maybe its easy to fix, or ... maybe its just something to expect to see numpy handle.

But I'll endeavour to run this under a more "system" level emulator and hope it gives better results (though I really doubt it will make a difference)

Portage 3.0.8 (python 3.7.9-final-0, default/linux/m68k/17.0, gcc-10.2.0, glibc-2.32-r2, 5.7.14-gentoo m68k)
=================================================================
                         System Settings
=================================================================
System uname: Linux-5.7.14-gentoo-m68k-with-gentoo-2.7
KiB Mem:     7987300 total,   1382608 free
KiB Swap:   20478972 total,  17814524 free
Timestamp of repository gentoo: Mon, 19 Oct 2020 10:05:18 +0000
sh bash 5.0_p18
ld GNU ld (Gentoo 2.35.1 p1) 2.35.1
app-shells/bash:          5.0_p18::gentoo
dev-lang/perl:            5.30.3-r1::gentoo
dev-lang/python:          3.7.9::gentoo
sys-apps/baselayout:      2.7::gentoo
sys-apps/openrc:          0.42.1::gentoo
sys-apps/sandbox:         2.20::gentoo
sys-devel/autoconf:       2.69-r5::gentoo
sys-devel/automake:       1.16.2::gentoo
sys-devel/binutils:       2.35.1::gentoo
sys-devel/gcc:            10.2.0-r2::gentoo
sys-devel/gcc-config:     2.3.2::gentoo
sys-devel/libtool:        2.4.6-r6::gentoo
sys-devel/make:           4.3::gentoo
sys-kernel/linux-headers: 5.9::gentoo (virtual/os-headers)
sys-libs/glibc:           2.32-r2::gentoo
Repositories:

gentoo
    location: /var/db/repos/gentoo
    sync-type: rsync
    sync-uri: rsync://rsync.gentoo.org/gentoo-portage
    priority: -1000
    sync-rsync-extra-opts: 
    sync-rsync-verify-jobs: 1
    sync-rsync-verify-max-age: 24
    sync-rsync-verify-metamanifest: yes

ACCEPT_KEYWORDS="m68k ~m68k"
ACCEPT_LICENSE="@FREE"
CBUILD="m68k-unknown-linux-gnu"
CFLAGS="-O2 -pipe -fomit-frame-pointer"
CHOST="m68k-unknown-linux-gnu"
CONFIG_PROTECT="/etc /usr/lib64/libreoffice/program/sofficerc /usr/share/config /usr/share/gnupg/qualified.txt"
CONFIG_PROTECT_MASK="/etc/ca-certificates.conf /etc/dconf /etc/env.d /etc/fonts/fonts.conf /etc/gconf /etc/gentoo-release /etc/php/apache2-php7.4/ext-active/ /etc/php/cgi-php7.4/ext-active/ /etc/php/cli-php7.4/ext-active/ /etc/revdep-rebuild /etc/sandbox.d /etc/terminfo /etc/texmf/language.dat.d /etc/texmf/language.def.d /etc/texmf/updmap.d /etc/texmf/web2c"
CXXFLAGS="-O2 -pipe -fomit-frame-pointer"
DISTDIR="/var/cache/distfiles"
EMERGE_DEFAULT_OPTS="--usepkg --binpkg-respect-use=n"
ENV_UNSET="CARGO_HOME DBUS_SESSION_BUS_ADDRESS DISPLAY GOBIN GOPATH PERL5LIB PERL5OPT PERLPREFIX PERL_CORE PERL_MB_OPT PERL_MM_OPT XAUTHORITY XDG_CACHE_HOME XDG_CONFIG_HOME XDG_DATA_HOME XDG_RUNTIME_DIR"
FCFLAGS="-O2 -pipe"
FEATURES="assume-digests binpkg-docompress binpkg-dostrip binpkg-logs buildpkg config-protect-if-modified distlocks ebuild-locks fixlafiles merge-sync multilib-strict news nodoc noinfo noman parallel-fetch preserve-libs protect-owned qa-unresolved-soname-deps sfperms strict unknown-features-warn unmerge-logs unmerge-orphans userfetch userpriv usersync xattr"
FFLAGS="-O2 -pipe"
GENTOO_MIRRORS="http://distfiles.gentoo.org"
LANG="en_NZ.UTF8"
LDFLAGS="-Wl,-O1 -Wl,--as-needed"
MAKEOPTS="-j1"
PKGDIR="/var/cache/binpkgs"
PORTAGE_CONFIGROOT="/"
PORTAGE_RSYNC_OPTS="--recursive --links --safe-links --perms --times --omit-dir-times --compress --force --whole-file --delete --stats --human-readable --timeout=180 --exclude=/distfiles --exclude=/local --exclude=/packages --exclude=/.git"
PORTAGE_TMPDIR="/var/tmp"
USE="acl berkdb big-endian bzip2 cli crypt dri fortran gdbm iconv ipv6 m68k ncurses nls nptl openmp pcre readline split-usr ssl tcpd unicode xattr zlib" ADA_TARGET="gnat_2018" APACHE2_MODULES="authn_core authz_core socache_shmcb unixd actions alias auth_basic authn_alias authn_anon authn_dbm authn_default authn_file authz_dbm authz_default authz_groupfile authz_host authz_owner authz_user autoindex cache cgi cgid dav dav_fs dav_lock deflate dir disk_cache env expires ext_filter file_cache filter headers include info log_config logio mem_cache mime mime_magic negotiation rewrite setenvif speling status unique_id userdir usertrack vhost_alias" CALLIGRA_FEATURES="karbon sheets words" COLLECTD_PLUGINS="df interface irq load memory rrdtool swap syslog" ELIBC="glibc" GPSD_PROTOCOLS="ashtech aivdm earthmate evermore fv18 garmin garmintxt gpsclock greis isync itrax mtk3301 nmea ntrip navcom oceanserver oldstyle oncore rtcm104v2 rtcm104v3 sirf skytraq superstar2 timing tsip tripmate tnt ublox ubx" INPUT_DEVICES="libinput" KERNEL="linux" LCD_DEVICES="bayrad cfontz cfontz633 glk hd44780 lb216 lcdm001 mtxorb ncurses text" LIBREOFFICE_EXTENSIONS="presenter-console presenter-minimizer" LUA_SINGLE_TARGET="lua5-1" LUA_TARGETS="lua5-1" OFFICE_IMPLEMENTATION="libreoffice" PHP_TARGETS="php7-2 php7-3 php7-4" POSTGRES_TARGETS="postgres10 postgres11" PYTHON_SINGLE_TARGET="python3_7" PYTHON_TARGETS="python2_7 python3_7" RUBY_TARGETS="ruby25 ruby26" USERLAND="GNU" VIDEO_CARDS="dummy fbdev v4l" XTABLES_ADDONS="quota2 psd pknock lscan length2 ipv4options ipset ipp2p iface geoip fuzzy condition tee tarpit sysrq steal rawnat logmark ipmark dhcpmac delude chaos account"
Unset:  CC, CPPFLAGS, CTARGET, CXX, INSTALL_MASK, LC_ALL, LINGUAS, PORTAGE_BINHOST, PORTAGE_BUNZIP2_COMMAND, PORTAGE_COMPRESS, PORTAGE_COMPRESS_FLAGS, PORTAGE_RSYNC_EXTRA_OPTS

=================================================================
                        Package Settings
=================================================================

dev-python/numpy-1.19.2::gentoo was built with the following:
USE="-doc -lapack -test" PYTHON_TARGETS="python3_7 -python3_6 -python3_8 -python3_9"
CFLAGS="-O2 -pipe -fomit-frame-pointer -fno-strict-aliasing"
CXXFLAGS="-O2 -pipe -fomit-frame-pointer -fno-strict-aliasing"
FEATURES="unmerge-logs binpkg-logs preserve-libs distlocks usersync nodoc userpriv binpkg-docompress unknown-features-warn news ebuild-locks noman unmerge-orphans userfetch binpkg-dostrip qa-unresolved-soname-deps parallel-fetch config-protect-if-modified assume-digests merge-sync noinfo sfperms xattr fixlafiles strict protect-owned multilib-strict buildpkg"
LDFLAGS="-Wl,-O1 -Wl,--as-needed -shared"

[Comment 1 Michał Górny 2020-10-22 06:15:45 UTC]

What are you asking me to do?  Are you asking me to report upstream that their tests *might* fail on a known-buggy emulator of a fringe arch?

If you wish to report bugs, then please use a proper environment in the first place.  Then, consider supplying patches because this is a exp arch for a reason.

[Comment 2 Kent Fredric (IRC: kent\n) (RETIRED) 2020-10-22 08:33:47 UTC]

(In reply to Michał Górny from comment #1)
> What are you asking me to do?  Are you asking me to report upstream that
> their tests *might* fail on a known-buggy emulator of a fringe arch?
> 
> If you wish to report bugs, then please use a proper environment in the
> first place.  Then, consider supplying patches because this is a exp arch
> for a reason.

Its hard to see, really, because there are too many goddamned open bugs on these things regarding test failures.

I can't answer any questions if these failures are unique to m68k, or if they're general failures that occur on multiple arches.

You, making that clarification would be helpful.

( However, I have uses for even closed bugs, if their purpose is simply to give m68k a finger as to "your arch can't be supported, we just can't, stop rubber stamping things as being OK with keywords when they don't fucking work" )

[Comment 3 Michał Górny 2020-10-22 08:58:06 UTC]

There are no test failures on amd64, that's for sure.  The recently stabilized arches are probably clean too.

[Comment 4 Kent Fredric (IRC: kent\n) (RETIRED) 2020-10-22 09:23:17 UTC]

(In reply to Michał Górny from comment #3)
> There are no test failures on amd64, that's for sure.  The recently
> stabilized arches are probably clean too.

I suspect something happening in cython is to blame, hard to say really.

> https://bugs.gentoo.org/737740#c4

^ this makes me suspicious.