Gentoo Websites Logo
Go to: Gentoo Home Documentation Forums Lists Bugs Planet Store Wiki Get Gentoo!
Bug 840770 - dev-python/statsmodels-0.13.2: failed (test phase) (x86)
Summary: dev-python/statsmodels-0.13.2: failed (test phase) (x86)
Status: CONFIRMED
Alias: None
Product: Gentoo Linux
Classification: Unclassified
Component: Current packages (show other bugs)
Hardware: x86 Linux
: Normal normal (vote)
Assignee: Python Gentoo Team
URL:
Whiteboard:
Keywords:
Depends on:
Blocks: 908367
  Show dependency tree
 
Reported: 2022-04-25 12:18 UTC by Joonas Niilola
Modified: 2023-12-25 07:59 UTC (History)
5 users (show)

See Also:
Package list:
Runtime testing required: ---


Attachments
build.log (statsmodels-0.13.2:20220425-090400.log.xz,203.39 KB, application/x-xz)
2022-04-25 12:18 UTC, Joonas Niilola
Details

Note You need to log in before you can comment on or make changes to this bug.
Description Joonas Niilola gentoo-dev 2022-04-25 12:18:03 UTC
Created attachment 774500 [details]
build.log

# emerge --info
Portage 3.0.30 (python 3.9.11-final-0, default/linux/x86/17.0, gcc-11.2.1, glibc-2.34-r10, 5.17.0-pf3 i686)
=================================================================
System uname: Linux-5.17.0-pf3-i686-AMD_Ryzen_7_3700X_8-Core_Processor-with-glibc2.34
KiB Mem:    32855304 total,  32791924 free
KiB Swap:          0 total,         0 free
Timestamp of repository gentoo: Mon, 25 Apr 2022 06:33:24 +0000
Head commit of repository gentoo: c81c2dc33199bbb43b78723b3049bff33b38ddd2

sh bash 5.1_p16
ld GNU ld (Gentoo 2.37_p1 p2) 2.37
app-misc/pax-utils:        1.3.3::gentoo
app-shells/bash:           5.1_p16::gentoo
dev-lang/python:           3.9.11::gentoo
dev-util/cmake:            3.22.2::gentoo
sys-apps/baselayout:       2.7-r3::gentoo
sys-apps/openrc:           0.44.10::gentoo
sys-apps/sandbox:          2.29::gentoo
sys-devel/binutils:        2.37_p1-r2::gentoo
sys-devel/binutils-config: 5.4.1::gentoo
sys-devel/gcc:             11.2.1_p20220115::gentoo
sys-devel/gcc-config:      2.5-r1::gentoo
sys-devel/make:            4.3::gentoo
sys-kernel/linux-headers:  5.15-r3::gentoo (virtual/os-headers)
sys-libs/glibc:            2.34-r10::gentoo
Repositories:

gentoo
    location: /var/db/repos/gentoo
    sync-type: git
    sync-uri: https://github.com/gentoo-mirror/gentoo
    priority: -1000

ACCEPT_KEYWORDS="x86"
ACCEPT_LICENSE="*"
CBUILD="i686-pc-linux-gnu"
CFLAGS="-march=native -O2 -pipe"
CHOST="i686-pc-linux-gnu"
CONFIG_PROTECT="/etc /usr/share/gnupg/qualified.txt"
CONFIG_PROTECT_MASK="/etc/ca-certificates.conf /etc/dconf /etc/env.d /etc/gconf /etc/gentoo-release /etc/revdep-rebuild /etc/sandbox.d /etc/terminfo"
CXXFLAGS="-march=native -O2 -pipe"
DISTDIR="/var/cache/distfiles"
EMERGE_DEFAULT_OPTS="--autounmask=y --autounmask-continue --autounmask-use=y --autounmask-write --binpkg-changed-deps=y --buildpkg-exclude virtual --buildpkg-exclude acct-* --buildpkg-exclude sys-kernel --nospinner --jobs=8 --usepkg"
ENV_UNSET="CARGO_HOME DBUS_SESSION_BUS_ADDRESS DISPLAY GOBIN GOPATH PERL5LIB PERL5OPT PERLPREFIX PERL_CORE PERL_MB_OPT PERL_MM_OPT XAUTHORITY XDG_CACHE_HOME XDG_CONFIG_HOME XDG_DATA_HOME XDG_RUNTIME_DIR"
FCFLAGS="-march=native -O2 -pipe"
FEATURES="assume-digests binpkg-docompress binpkg-dostrip binpkg-logs binpkg-multi-instance buildpkg buildpkg-live config-protect-if-modified distlocks ebuild-locks fixlafiles ipc-sandbox merge-sync multilib-strict network-sandbox news parallel-fetch parallel-install pid-sandbox preserve-libs protect-owned qa-unresolved-soname-deps sandbox sfperms strict strict-keepdir unknown-features-warn unmerge-logs unmerge-orphans userfetch userpriv usersandbox usersync xattr"
FFLAGS="-march=native -O2 -pipe"
GENTOO_MIRRORS="https://distfiles.gentoo.org"
LANG="C.UTF8"
LDFLAGS="-Wl,-O1 -Wl,--as-needed"
LINGUAS=" en en_US en-US fi sv "
MAKEOPTS="-j16"
PKGDIR="/var/cache/binpkgs"
PORTAGE_CONFIGROOT="/"
PORTAGE_RSYNC_OPTS="--recursive --links --safe-links --perms --times --omit-dir-times --compress --force --whole-file --delete --stats --human-readable --timeout=180 --exclude=/distfiles --exclude=/local --exclude=/packages --exclude=/.git"
PORTAGE_TMPDIR="/var/tmp"
USE="acl bzip2 cli crypt dbus dri elogind fortran gdbm iconv ipv6 libglvnd libtirpc ncurses nptl openmp openrc pam pcre readline seccomp split-usr ssl udev unicode x86 xattr zlib" ABI_X86="32" ADA_TARGET="gnat_2020" APACHE2_MODULES="authn_core authz_core socache_shmcb unixd actions alias auth_basic authn_alias authn_anon authn_dbm authn_default authn_file authz_dbm authz_default authz_groupfile authz_host authz_owner authz_user autoindex cache cgi cgid dav dav_fs dav_lock deflate dir disk_cache env expires ext_filter file_cache filter headers include info log_config logio mem_cache mime mime_magic negotiation rewrite setenvif speling status unique_id userdir usertrack vhost_alias" CALLIGRA_FEATURES="karbon sheets words" COLLECTD_PLUGINS="df interface irq load memory rrdtool swap syslog" CPU_FLAGS_X86="aes avx avx2 f16c fma3 mmx mmxext pclmul popcnt sha sse sse2 sse3 sse4_1 sse4_2 sse4a ssse3" ELIBC="glibc" GPSD_PROTOCOLS="ashtech aivdm earthmate evermore fv18 garmin garmintxt gpsclock greis isync itrax mtk3301 nmea ntrip navcom oceanserver oldstyle oncore rtcm104v2 rtcm104v3 sirf skytraq superstar2 timing tsip tripmate tnt ublox ubx" INPUT_DEVICES="evdev" KERNEL="linux" L10N="en en_US en-US fi sv" LCD_DEVICES="bayrad cfontz cfontz633 glk hd44780 lb216 lcdm001 mtxorb ncurses text" LIBREOFFICE_EXTENSIONS="presenter-console presenter-minimizer" LLVM_TARGETS="AMDGPU BPF" LUA_SINGLE_TARGET="lua5-1" LUA_TARGETS="lua5-1" OFFICE_IMPLEMENTATION="libreoffice" PHP_TARGETS="php7-4 php8-0" POSTGRES_TARGETS="postgres12 postgres13" PYTHON_SINGLE_TARGET="python3_9" PYTHON_TARGETS="python3_9" RUBY_TARGETS="ruby26 ruby27" USERLAND="GNU" VIDEO_CARDS="amdgpu radeonsi" XTABLES_ADDONS="quota2 psd pknock lscan length2 ipv4options ipset ipp2p iface geoip fuzzy condition tee tarpit sysrq proto steal rawnat logmark ipmark dhcpmac delude chaos account"
Unset:  ADDR2LINE, AR, ARFLAGS, AS, ASFLAGS, CC, CCLD, CONFIG_SHELL, CPP, CPPFLAGS, CTARGET, CXX, CXXFILT, ELFEDIT, EXTRA_ECONF, F77FLAGS, FC, GCOV, GPROF, INSTALL_MASK, LC_ALL, LD, LEX, LFLAGS, LIBTOOL, MAKE, MAKEFLAGS, NM, OBJCOPY, OBJDUMP, PORTAGE_BINHOST, PORTAGE_BUNZIP2_COMMAND, PORTAGE_COMPRESS, PORTAGE_COMPRESS_FLAGS, PORTAGE_RSYNC_EXTRA_OPTS, RANLIB, READELF, RUSTFLAGS, SHELL, SIZE, STRINGS, STRIP, YACC, YFLAGS
Comment 1 Michał Górny archtester Gentoo Infrastructure gentoo-dev Security 2022-04-25 14:07:19 UTC
Please expand -march=native.
Comment 2 Joonas Niilola gentoo-dev 2022-04-25 14:28:50 UTC
# gcc -march=native -E -v - </dev/null 2>&1 | grep cc1
 /usr/libexec/gcc/i686-pc-linux-gnu/11.2.1/cc1 -E -quiet -v - -march=znver2 -mmmx -mpopcnt -msse -msse2 -msse3 -mssse3 -msse4.1 -msse4.2 -mavx -mavx2 -msse4a -mno-fma4 -mno-xop -mfma -mno-avx512f -mbmi -mbmi2 -maes -mpclmul -mno-avx512vl -mno-avx512bw -mno-avx512dq -mno-avx512cd -mno-avx512er -mno-avx512pf -mno-avx512vbmi -mno-avx512ifma -mno-avx5124vnniw -mno-avx5124fmaps -mno-avx512vpopcntdq -mno-avx512vbmi2 -mno-gfni -mno-vpclmulqdq -mno-avx512vnni -mno-avx512bitalg -mno-avx512bf16 -mno-avx512vp2intersect -mno-3dnow -madx -mabm -mno-cldemote -mclflushopt -mclwb -mclzero -mcx16 -mno-enqcmd -mf16c -mfsgsbase -mfxsr -mno-hle -msahf -mno-lwp -mlzcnt -mmovbe -mno-movdir64b -mno-movdiri -mmwaitx -mno-pconfig -mno-pku -mno-prefetchwt1 -mprfchw -mno-ptwrite -mrdpid -mrdrnd -mrdseed -mno-rtm -mno-serialize -mno-sgx -msha -mno-shstk -mno-tbm -mno-tsxldtrk -mno-vaes -mno-waitpkg -mwbnoinvd -mxsave -mxsavec -mxsaveopt -mxsaves -mno-amx-tile -mno-amx-int8 -mno-amx-bf16 -mno-uintr -mno-hreset -mno-kl -mno-widekl -mno-avxvnni --param l1-cache-size=32 --param l1-cache-line-size=64 --param l2-cache-size=512 -mtune=znver2 -dumpbase -


-march=i686 seems to fail with same error. This is a container if that helps (so no virtualization).
Comment 3 Joonas Niilola gentoo-dev 2022-04-25 14:31:06 UTC
(^ that being said I have a feint feeling after enabling virtualization in my UEFI my x86's has been acting differently.)
Comment 4 Joonas Niilola gentoo-dev 2022-04-25 15:02:46 UTC
And just to confirm, tests pass on my stable-amd64 env:
============== 16046 passed, 715 skipped, 127 xfailed, 360 warnings in 174.23s (0:02:54) ==============
Comment 5 Michał Górny archtester Gentoo Infrastructure gentoo-dev Security 2022-04-25 15:35:52 UTC
Well, obviously it's a precision problem, though I was hoping it happens with some older hardware.  I'm not sure if upstream is really interested in test failures on 32-bit x86 though, especially given the number of issues open.

Could you please try the current stable and see whether this is a regression?
Comment 6 Joonas Niilola gentoo-dev 2022-04-25 15:57:59 UTC
0.13.1 has the same errors.

======== 42 failed, 15987 passed, 714 skipped, 127 xfailed, 4817 warnings in 233.44s (0:03:53) ========
 * ERROR: dev-python/statsmodels-0.13.1::gentoo failed (test phase):
 *   tests fail with python3.9

(now it's down to 42 from 43)


And to complete:
== 86 failed, 14079 passed, 688 skipped, 128 xfailed, 6752 warnings, 329 errors in 221.39s (0:03:41) ==
 * ERROR: dev-python/statsmodels-0.12.2-r1::gentoo failed (test phase):
 *   tests fail with python3.9


So I guess 0.13.2 is good to be stabilized?
Comment 7 Michał Górny archtester Gentoo Infrastructure gentoo-dev Security 2022-04-25 16:27:24 UTC
Could you also expand -march=native on amd64 on that machine?

Yes, please stabilize and I'll try to figure out x86 later.
Comment 8 Joonas Niilola gentoo-dev 2022-04-25 17:06:11 UTC
# gcc -march=native -E -v - </dev/null 2>&1 | grep cc1
 /usr/libexec/gcc/x86_64-pc-linux-gnu/11.2.1/cc1 -E -quiet -v - -march=znver2 -mmmx -mpopcnt -msse -msse2 -msse3 -mssse3 -msse4.1 -msse4.2 -mavx -mavx2 -msse4a -mno-fma4 -mno-xop -mfma -mno-avx512f -mbmi -mbmi2 -maes -mpclmul -mno-avx512vl -mno-avx512bw -mno-avx512dq -mno-avx512cd -mno-avx512er -mno-avx512pf -mno-avx512vbmi -mno-avx512ifma -mno-avx5124vnniw -mno-avx5124fmaps -mno-avx512vpopcntdq -mno-avx512vbmi2 -mno-gfni -mno-vpclmulqdq -mno-avx512vnni -mno-avx512bitalg -mno-avx512bf16 -mno-avx512vp2intersect -mno-3dnow -madx -mabm -mno-cldemote -mclflushopt -mclwb -mclzero -mcx16 -mno-enqcmd -mf16c -mfsgsbase -mfxsr -mno-hle -msahf -mno-lwp -mlzcnt -mmovbe -mno-movdir64b -mno-movdiri -mmwaitx -mno-pconfig -mno-pku -mno-prefetchwt1 -mprfchw -mno-ptwrite -mrdpid -mrdrnd -mrdseed -mno-rtm -mno-serialize -mno-sgx -msha -mno-shstk -mno-tbm -mno-tsxldtrk -mno-vaes -mno-waitpkg -mwbnoinvd -mxsave -mxsavec -mxsaveopt -mxsaves -mno-amx-tile -mno-amx-int8 -mno-amx-bf16 -mno-uintr -mno-hreset -mno-kl -mno-widekl -mno-avxvnni --param l1-cache-size=32 --param l1-cache-line-size=64 --param l2-cache-size=512 -mtune=znver2 -dumpbase -
Comment 9 Michał Górny archtester Gentoo Infrastructure gentoo-dev Security 2022-04-25 19:05:58 UTC
Could you try reporting this upstream?

https://github.com/statsmodels/statsmodels/issues

I suppose one option is to increase the tolerance, either unconditionally or conditionally to x86.
Comment 10 Michał Górny archtester Gentoo Infrastructure gentoo-dev Security 2022-04-25 20:38:01 UTC
One more idea: could you try if appending `-mfpmath=sse` to CFLAGS fixes the tests?
Comment 11 Joonas Niilola gentoo-dev 2022-04-26 05:20:05 UTC
Unfortunately it makes no difference. I've filed bug upstream.
Comment 12 matoro archtester 2023-12-07 05:30:46 UTC
0.14.0 continuing to get worse.

48 failed, 17561 passed, 296 skipped, 139 xfailed, 1021 warnings in 131.87s (0:02:11)
Comment 13 Larry the Git Cow gentoo-dev 2023-12-25 07:34:35 UTC
The bug has been referenced in the following commit(s):

https://gitweb.gentoo.org/repo/gentoo.git/commit/?id=830cd7719231b4c34d98a000035154e5d53d5d02

commit 830cd7719231b4c34d98a000035154e5d53d5d02
Author:     Sam James <sam@gentoo.org>
AuthorDate: 2023-12-25 07:33:20 +0000
Commit:     Sam James <sam@gentoo.org>
CommitDate: 2023-12-25 07:33:20 +0000

    dev-python/pandas: drop statsmodels dep on x86
    
    It's a test-only optional dep and statsmodels is busted on x86.
    
    Bug: https://bugs.gentoo.org/840770
    Bug: https://bugs.gentoo.org/905736
    Bug: https://bugs.gentoo.org/908367
    Signed-off-by: Sam James <sam@gentoo.org>

 dev-python/pandas/pandas-1.5.3.ebuild | 4 ++--
 dev-python/pandas/pandas-2.1.1.ebuild | 4 ++--
 dev-python/pandas/pandas-2.1.3.ebuild | 4 ++--
 dev-python/pandas/pandas-2.1.4.ebuild | 4 ++--
 4 files changed, 8 insertions(+), 8 deletions(-)