Created attachment 456898 [details] test-suite.log Find test-suit.log attached.
is that a regression?
Tobias, does it still fail for you on current sandbox/glibc? Looks like it works for me.
No, still the same failure, with both v0.10.0-r1 and -r2
Can you share your 'emerge --info'? I'd like to reproduce the failure locally.
Portage 2.3.6 (python 3.4.6-final-0, default/linux/amd64/13.0, gcc-6.3.0, glibc-2.24-r1, 4.11.2 x86_64) ================================================================= System uname: Linux-4.11.2-x86_64-AMD_Ryzen_7_1700X_Eight-Core_Processor-with-gentoo-2.3 KiB Mem: 32892700 total, 29550168 free KiB Swap: 0 total, 0 free Timestamp of repository gentoo: Wed, 31 May 2017 08:02:22 +0000 sh bash 4.4_p12 ld GNU ld (Gentoo 2.27 p1.0) 2.27 distcc 3.2rc1 x86_64-pc-linux-gnu [disabled] app-shells/bash: 4.4_p12::gentoo dev-lang/perl: 5.24.1-r1::gentoo dev-lang/python: 2.7.13::gentoo, 3.4.6::gentoo, 3.5.3::gentoo, 3.6.1-r1::gentoo dev-util/cmake: 3.8.1::gentoo dev-util/pkgconfig: 0.29.2::gentoo sys-apps/baselayout: 2.3::gentoo sys-apps/openrc: 0.26.3::gentoo sys-apps/sandbox: 2.10-r4::gentoo sys-devel/autoconf: 2.13::gentoo, 2.69-r3::gentoo sys-devel/automake: 1.11.6-r2::gentoo, 1.13.4-r1::gentoo, 1.15-r2::gentoo sys-devel/binutils: 2.27::gentoo sys-devel/gcc: 5.4.0-r3::gentoo, 6.3.0::gentoo sys-devel/gcc-config: 1.8-r1::gentoo sys-devel/libtool: 2.4.6-r4::gentoo sys-devel/make: 4.2.1-r1::gentoo sys-kernel/linux-headers: 4.10::gentoo (virtual/os-headers) sys-libs/glibc: 2.24-r1::gentoo Repositories: gentoo location: /usr/portage sync-type: git sync-uri: https://github.com/gentoo-mirror/gentoo priority: -1000 x-portage location: /usr/local/portage masters: gentoo priority: 0 klausman-prometheus location: /var/lib/layman/klausman-prometheus masters: gentoo priority: 50 ACCEPT_KEYWORDS="amd64 ~amd64" ACCEPT_LICENSE="*" CBUILD="x86_64-pc-linux-gnu" CFLAGS="-O2 -pipe -march=native" CHOST="x86_64-pc-linux-gnu" CONFIG_PROTECT="/etc /usr/share/config /usr/share/gnupg/qualified.txt" CONFIG_PROTECT_MASK="/etc/ca-certificates.conf /etc/dconf /etc/env.d /etc/fonts/fonts.conf /etc/gconf /etc/gentoo-release /etc/revdep-rebuild /etc/sandbox.d /etc/terminfo /etc/texmf/language.dat.d /etc/texmf/language.def.d /etc/texmf/updmap.d /etc/texmf/web2c" CXXFLAGS="-O2 -pipe -march=native" DISTDIR="/mnt/moep/distfiles" FCFLAGS="-O2 -pipe" FEATURES="assume-digests binpkg-logs config-protect-if-modified distlocks ebuild-locks fixlafiles merge-sync news parallel-fetch preserve-libs protect-owned sandbox sfperms strict unknown-features-warn unmerge-logs unmerge-orphans userfetch userpriv usersandbox usersync xattr" FFLAGS="-O2 -pipe" GENTOO_MIRRORS="http://ftp-stud.hs-esslingen.de/pub/Mirrors/gentoo/ http://gentoo.modulix.net/gentoo/ http://gentoo.supp.name/ http://gd.tuwien.ac.at/opsys/linux/gentoo/ http://ftp.romnet.org/gentoo/ http://tux.rainside.sk/gentoo/ http://mirrors.xservers.ro/gentoo/ http://mirror.eu.oneandone.net/linux/distributions/gentoo/gentoo/ http://mirror.switch.ch/ftp/mirror/gentoo/ http://mirrors.linuxant.fr/distfiles.gentoo.org/" LANG="en_US.utf8" LC_ALL="en_US.utf8" LDFLAGS="-Wl,-O1 -Wl,--as-needed" MAKEOPTS="-j8" PKGDIR="/usr/portage/packages" PORTAGE_CONFIGROOT="/" PORTAGE_RSYNC_EXTRA_OPTS="--exclude lost+found" PORTAGE_RSYNC_OPTS="--recursive --links --safe-links --perms --times --omit-dir-times --compress --force --whole-file --delete --stats --human-readable --timeout=180 --exclude=/distfiles --exclude=/local --exclude=/packages --exclude=/.git" PORTAGE_TMPDIR="/var/tmp" USE="X acl alsa amd64 audiofile bash-completion berkdb bmp bzip2 caps cdparanoia cdr cli cracklib crypt cxx dri encode exif ffmpeg fftw fortran gdbm gif glamor gtk iconv idn ipv6 jpeg lame lcms lua mad matroska mmap mng modules mp3 mpeg multilib ncurses nls nptl ogg opengl openmp pam pcre png ppds pulseaudio python qt4 qt5 readline recode seccomp session ssl svg tcpd theora unicode usb v4l vaapi vdpau vim vim-pager vim-syntax vlm vorbis wmf xattr xcb xosd xpm xscreensaver xvid xvmc zlib" ABI_X86="64" ALSA_CARDS="emu10k1 ice1724" APACHE2_MODULES="authn_core authz_core socache_shmcb unixd actions alias auth_basic authn_alias authn_anon authn_dbm authn_default authn_file authz_dbm authz_default authz_groupfile authz_host authz_owner authz_user autoindex cache cgi cgid dav dav_fs dav_lock deflate dir disk_cache env expires ext_filter file_cache filter headers include info log_config logio mem_cache mime mime_magic negotiation rewrite setenvif speling status unique_id userdir usertrack vhost_alias" CALLIGRA_FEATURES="kexi words flow plan sheets stage tables krita karbon braindump author" COLLECTD_PLUGINS="df interface irq load memory rrdtool swap syslog" CPU_FLAGS_X86="aes avx avx2 f16c fma3 mmx mmxext popcnt sse sse2 sse3 sse4_1 sse4_2 sse4a ssse3" ELIBC="glibc" GPSD_PROTOCOLS="ashtech aivdm earthmate evermore fv18 garmin garmintxt gpsclock isync itrax mtk3301 nmea ntrip navcom oceanserver oldstyle oncore rtcm104v2 rtcm104v3 sirf skytraq superstar2 timing tsip tripmate tnt ublox ubx" INPUT_DEVICES="evdev" KERNEL="linux" LCD_DEVICES="bayrad cfontz cfontz633 glk hd44780 lb216 lcdm001 mtxorb ncurses text" LIBREOFFICE_EXTENSIONS="presenter-console presenter-minimizer" OFFICE_IMPLEMENTATION="libreoffice" PHP_TARGETS="php5-6" PYTHON_SINGLE_TARGET="python3_4" PYTHON_TARGETS="python2_7 python3_4 python3_5 python3_6 pypy pypy3" QEMU_SOFTMMU_TARGETS="i386 x86_64 alpha aarch64" QEMU_USER_TARGETS="i386 x86_64 alpha aarch64" RUBY_TARGETS="ruby21 ruby22" SANE_BACKENDS="canon microtek microtek2 mustek mustek_usb nec plustek" USERLAND="GNU" VIDEO_CARDS="vesa radeon amdgpu" XTABLES_ADDONS="quota2 psd pknock lscan length2 ipv4options ipset ipp2p iface geoip fuzzy condition tee tarpit sysrq steal rawnat logmark ipmark dhcpmac delude chaos account" USE_PYTHON="2.7 3.4 3.5 3.6" Unset: CC, CPPFLAGS, CTARGET, CXX, EMERGE_DEFAULT_OPTS, INSTALL_MASK, PORTAGE_BUNZIP2_COMMAND, PORTAGE_COMPRESS, PORTAGE_COMPRESS_FLAGS
please recheck with 0.12
Created attachment 527312 [details] test-suite.log for 0.12.0 This still fails. AFAICT, there are now *more* failures. This was a quick test with portage-2.3.28 and sandbox-2.13 on an amd64 system. Test with stable chroot to follow.
Created attachment 527316 [details] test suite log for 0.12.0 in clean stable chroot emerge --info: Portage 2.3.24 (python 3.5.4-final-0, default/linux/amd64/17.0, gcc-6.4.0, glibc-2.25-r11, 4.15.17 x86_64) ================================================================= System uname: Linux-4.15.17-x86_64-AMD_Ryzen_7_1700X_Eight-Core_Processor-with-gentoo-2.4.1 KiB Mem: 32890320 total, 25711060 free KiB Swap: 0 total, 0 free Timestamp of repository gentoo: Sat, 14 Apr 2018 07:06:05 +0000 sh bash 4.4_p12 ld GNU ld (Gentoo 2.29.1 p3) 2.29.1 app-shells/bash: 4.4_p12::gentoo dev-lang/perl: 5.24.3-r1::gentoo dev-lang/python: 2.7.14-r1::gentoo, 3.5.4-r1::gentoo dev-util/pkgconfig: 0.29.2::gentoo sys-apps/baselayout: 2.4.1-r2::gentoo sys-apps/openrc: 0.34.11::gentoo sys-apps/sandbox: 2.13::gentoo sys-devel/autoconf: 2.69-r4::gentoo sys-devel/automake: 1.15.1-r2::gentoo sys-devel/binutils: 2.29.1-r1::gentoo sys-devel/gcc: 6.4.0-r1::gentoo sys-devel/gcc-config: 1.8-r1::gentoo sys-devel/libtool: 2.4.6-r3::gentoo sys-devel/make: 4.2.1::gentoo sys-kernel/linux-headers: 4.13::gentoo (virtual/os-headers) sys-libs/glibc: 2.25-r11::gentoo Repositories: gentoo location: /usr/portage sync-type: rsync sync-uri: rsync://rsync5.de.gentoo.org/gentoo-portage priority: -1000 sync-rsync-extra-opts: sync-rsync-verify-metamanifest: no x-portage location: /usr/local/portage masters: gentoo priority: 0 ACCEPT_KEYWORDS="amd64" ACCEPT_LICENSE="* -@EULA" CBUILD="x86_64-pc-linux-gnu" CFLAGS="-O2 -pipe -march=native" CHOST="x86_64-pc-linux-gnu" CONFIG_PROTECT="/etc" CONFIG_PROTECT_MASK="/etc/ca-certificates.conf /etc/env.d /etc/gconf /etc/gentoo-release /etc/revdep-rebuild /etc/sandbox.d /etc/terminfo" CXXFLAGS="-O2 -pipe -march=native" DISTDIR="/usr/portage/distfiles" FCFLAGS="-O2 -pipe" FEATURES="assume-digests binpkg-logs buildpkg config-protect-if-modified distlocks ebuild-locks fixlafiles merge-sync multilib-strict news parallel-fetch preserve-libs protect-owned sandbox sfperms strict unknown-features-warn unmerge-logs unmerge-orphans userfetch userpriv usersandbox usersync xattr" FFLAGS="-O2 -pipe" GENTOO_MIRRORS="http://distfiles.gentoo.org" LANG="en_US.utf8" LC_ALL="en_US.utf8" LDFLAGS="-Wl,-O1 -Wl,--as-needed" MAKEOPTS="-j8" PKGDIR="/usr/portage/packages" PORTAGE_CONFIGROOT="/" PORTAGE_RSYNC_OPTS="--recursive --links --safe-links --perms --times --omit-dir-times --compress --force --whole-file --delete --stats --human-readable --timeout=180 --exclude=/distfiles --exclude=/local --exclude=/packages --exclude=/.git" PORTAGE_TMPDIR="/var/tmp" USE="acl amd64 bash-completion berkdb bzip2 cli crypt cxx dri fortran ftp gdbm iconv ipv6 mmap modules multilib ncurses nls nptl nptlonly offensive pam pcre python readline recode seccomp sharedmem sockets ssl tcpd unicode vim vim-pager xattr zlib" ABI_X86="64" ALSA_CARDS="ali5451 als4000 atiixp atiixp-modem bt87x ca0106 cmipci emu10k1x ens1370 ens1371 es1938 es1968 fm801 hda-intel intel8x0 intel8x0m maestro3 trident usb-audio via82xx via82xx-modem ymfpci" APACHE2_MODULES="authn_core authz_core socache_shmcb unixd actions alias auth_basic authn_alias authn_anon authn_dbm authn_default authn_file authz_dbm authz_default authz_groupfile authz_host authz_owner authz_user autoindex cache cgi cgid dav dav_fs dav_lock deflate dir disk_cache env expires ext_filter file_cache filter headers include info log_config logio mem_cache mime mime_magic negotiation rewrite setenvif speling status unique_id userdir usertrack vhost_alias" CALLIGRA_FEATURES="kexi words flow plan sheets stage tables krita karbon braindump author" COLLECTD_PLUGINS="df interface irq load memory rrdtool swap syslog" CPU_FLAGS_X86="mmx mmxext sse sse2" ELIBC="glibc" GPSD_PROTOCOLS="ashtech aivdm earthmate evermore fv18 garmin garmintxt gpsclock isync itrax mtk3301 nmea ntrip navcom oceanserver oldstyle oncore rtcm104v2 rtcm104v3 sirf skytraq superstar2 timing tsip tripmate tnt ublox ubx" INPUT_DEVICES="evdev" KERNEL="linux" LCD_DEVICES="bayrad cfontz cfontz633 glk hd44780 lb216 lcdm001 mtxorb ncurses text" LIBREOFFICE_EXTENSIONS="presenter-console presenter-minimizer" OFFICE_IMPLEMENTATION="libreoffice" PHP_TARGETS="php5-6 php7-0" POSTGRES_TARGETS="postgres9_5" PYTHON_SINGLE_TARGET="python3_5" PYTHON_TARGETS="python2_7 python3_5" RUBY_TARGETS="ruby22 ruby23" USERLAND="GNU" VIDEO_CARDS="vesa" XTABLES_ADDONS="quota2 psd pknock lscan length2 ipv4options ipset ipp2p iface geoip fuzzy condition tee tarpit sysrq steal rawnat logmark ipmark dhcpmac delude chaos account" Unset: CC, CPPFLAGS, CTARGET, CXX, EMERGE_DEFAULT_OPTS, INSTALL_MASK, LINGUAS, PORTAGE_BUNZIP2_COMMAND, PORTAGE_COMPRESS, PORTAGE_COMPRESS_FLAGS, PORTAGE_RSYNC_EXTRA_OPTS
At systemd tinderbox images I to get this with FEATuRES=test: MiscXS.c: loadable library and perl binaries are mismatched (got handshake key 0xd880000, needed 0xc280000) during setup of a new image.
Well, at the tinderbox not related to systemd images only.
Looks like tests depend heavily on what extra tools are installed in system, if 32-bit ABI is enabled or not. For example on my real system all tests pass, but in a small chroot tests fail in a fun way: FAIL: test_output.sh ==================== Problem with ex_output CK_NORMAL STDOUT NORMAL Expected: Running suite(s): S1 S2 XML escape " ' < > & tests 37%: Checks: 8, Failures: 4, Errors: 1 /dev/shm/portage/dev-libs/check-0.12.0/work/check-0.12.0/tests/ex_output.c:37:F:Core:test_fail:0: Failure /dev/shm/portage/dev-libs/check-0.12.0/work/check-0.12.0/tests/ex_output.c:46:E:Core:test_exit:0: (after this point) Early exit with return val ue 1 /dev/shm/portage/dev-libs/check-0.12.0/work/check-0.12.0/tests/ex_output.c:72:F:Core:test_loop:0: Iteration 0 failed /dev/shm/portage/dev-libs/check-0.12.0/work/check-0.12.0/tests/ex_output.c:72:F:Core:test_loop:2: Iteration 2 failed /dev/shm/portage/dev-libs/check-0.12.0/work/check-0.12.0/tests/ex_output.c:78:F:description " ' < > & end:test_xml_esc_fail_msg:0: fail " ' < > & message Got: Running suite(s): S1 S2 XML escape " ' < > & tests 37%: Checks: 8, Failures: 4, Errors: 1 ../../check-0.12.0/tests/ex_output.c:37:F:Core:test_fail:0: Failure ../../check-0.12.0/tests/ex_output.c:46:E:Core:test_exit:0: (after this point) Early exit with return value 1 ../../check-0.12.0/tests/ex_output.c:72:F:Core:test_loop:0: Iteration 0 failed ../../check-0.12.0/tests/ex_output.c:72:F:Core:test_loop:2: Iteration 2 failed ../../check-0.12.0/tests/ex_output.c:78:F:description " ' < > & end:test_xml_esc_fail_msg:0: fail " ' < > & message FAIL test_output.sh (exit status: 1) The only wibble here is absolute vs. relative path to sources.
This seens to be enough to make some tests fixed: diff --git a/dev-libs/check/check-0.12.0.ebuild b/dev-libs/check/check-0.12.0.ebuild index 131ec484ae5..ea3a581c3d3 100644 --- a/dev-libs/check/check-0.12.0.ebuild +++ b/dev-libs/check/check-0.12.0.ebuild @@ -43,2 +43,5 @@ src_prepare() { eautoreconf + + # tests don't work on out-of tree ebuilds: #603234 + multilib_copy_sources } @@ -50,3 +53,3 @@ multilib_src_configure() { ) - ECONF_SOURCE="${S}" econf "${myeconfargs[@]}" + econf "${myeconfargs[@]}" } I see that 0.13 just disables tests but it's not clear why. Assigning to maintainer.
(In reply to Sergei Trofimovich from comment #12) > This seens to be enough to make some tests fixed: > > diff --git a/dev-libs/check/check-0.12.0.ebuild > b/dev-libs/check/check-0.12.0.ebuild > index 131ec484ae5..ea3a581c3d3 100644 > --- a/dev-libs/check/check-0.12.0.ebuild > +++ b/dev-libs/check/check-0.12.0.ebuild > @@ -43,2 +43,5 @@ src_prepare() { > eautoreconf > + > + # tests don't work on out-of tree ebuilds: #603234 > + multilib_copy_sources > } > @@ -50,3 +53,3 @@ multilib_src_configure() { > ) > - ECONF_SOURCE="${S}" econf "${myeconfargs[@]}" > + econf "${myeconfargs[@]}" > } > Unfortunately this was not enough to get them running on my system. They still fail, https://github.com/libcheck/check/issues/208 > I see that 0.13 just disables tests but it's not clear why. Assigning to > maintainer. First I thought they hung, but they just take a long time to complete. And finally fail anyway similarily to 0.12.0. You need to add this to actually be able to run the tests in the ebuild: ---------- --- /var/db/repos/gentoo/dev-libs/check/check-0.13.0.ebuild 2019-12-13 09:38:50.517041081 -0000 +++ ./check-0.13.0.ebuild 2019-12-30 13:51:16.079429735 -0000 @@ -14,9 +14,7 @@ KEYWORDS="~alpha ~amd64 ~arm ~arm64 ~hppa ~ia64 ~m68k ~mips ~ppc ~ppc64 ~riscv ~s390 ~sh ~sparc ~x86 ~amd64-linux ~x86-linux ~ppc-macos ~x64-macos ~x86-macos ~sparc-solaris ~x64-solaris ~x86-solaris" IUSE="doc static-libs subunit test" -# https://github.com/libcheck/check/issues/208 -RESTRICT="test" -#RESTRICT="!test? ( test )" +RESTRICT="!test? ( test )" RDEPEND="subunit? ( dev-python/subunit[${MULTILIB_USEDEP}] )" DEPEND="${RDEPEND} @@ -49,6 +47,10 @@ fi } +multilib_src_test() { + emake check +} + multilib_src_install_all() { use doc && local HTML_DOCS=( doc/html/. ) default ---------- I was quite hurried when bumping check and didn't have time to dig deeper into test failures. It's been in my TODO, not very high. I guess the failing tests could be removed/disabled or altered to pass.
> Unfortunately this was not enough to get them running on my system. They > still fail, > https://github.com/libcheck/check/issues/208 AFAIU that bug is about premature test failures. There is no specifics about actual test failures that need addressing. Or I'm misinterpreting it?
(In reply to Sergei Trofimovich from comment #14) > > https://github.com/libcheck/check/issues/208 > > AFAIU that bug is about premature test failures. There is no specifics about > actual test failures that need addressing. Or I'm misinterpreting it? As I said, I didn't have time to dig deeper into it. I'm having a lot of assertion errors on these tests so fast-glancing my test-suite.log through I instantly thought it's related. Upstream GH has more open issues about tests failing, I'll go through them at some point.
The bug has been closed via the following commit(s): https://gitweb.gentoo.org/repo/gentoo.git/commit/?id=37cad266778683a94016f0f77877464f248af6c4 commit 37cad266778683a94016f0f77877464f248af6c4 Author: Joonas Niilola <juippis@gentoo.org> AuthorDate: 2020-02-02 07:55:23 +0000 Commit: Joonas Niilola <juippis@gentoo.org> CommitDate: 2020-02-02 08:08:03 +0000 dev-libs/check: bump to 0.14.0 Closes: https://bugs.gentoo.org/603234 Signed-off-by: Joonas Niilola <juippis@gentoo.org> dev-libs/check/Manifest | 1 + dev-libs/check/check-0.14.0.ebuild | 66 +++++++++++++++++++++++ dev-libs/check/files/check-0.14-xfail-tests.patch | 13 +++++ 3 files changed, 80 insertions(+)
