Gentoo Websites Logo
Go to: Gentoo Home Documentation Forums Lists Bugs Planet Store Wiki Get Gentoo!
Bug 739884 - sys-devel/bison-3.7.1 has parallel build issues in tests
Summary: sys-devel/bison-3.7.1 has parallel build issues in tests
Status: RESOLVED INVALID
Alias: None
Product: Gentoo Linux
Classification: Unclassified
Component: Current packages (show other bugs)
Hardware: All Linux
: Normal normal (vote)
Assignee: Gentoo's Team for Core System packages
URL:
Whiteboard:
Keywords:
Depends on:
Blocks:
 
Reported: 2020-09-01 13:35 UTC by Paolo Pedroni
Modified: 2020-09-22 11:17 UTC (History)
1 user (show)

See Also:
Package list:
Runtime testing required: ---


Attachments
bison-3.7.1:20200901-113125.log.gz - example of failing tests (bison-3.7.1:20200901-113125.log.gz,38.16 KB, application/gzip)
2020-09-01 13:35 UTC, Paolo Pedroni
Details
bison-3.7.1:20200901-124609.log.gz - Successful tests (bison-3.7.1:20200901-124609.log.gz,42.02 KB, application/gzip)
2020-09-01 13:36 UTC, Paolo Pedroni
Details
Patch to ebuild to execute tests sequentially (file_739884.txt,355 bytes, patch)
2020-09-01 13:38 UTC, Paolo Pedroni
Details | Diff
testsuite.log of failing 268 test (testsuite.log,3.14 KB, text/x-log)
2020-09-03 15:34 UTC, Paolo Pedroni
Details

Note You need to log in before you can comment on or make changes to this bug.
Description Paolo Pedroni 2020-09-01 13:35:10 UTC
Created attachment 657738 [details]
bison-3.7.1:20200901-113125.log.gz - example of failing tests

In several attempts to build sys-devel/bison-3.7.1 I got test errors:
[...]
273: %printer syncline                               ok
270: Epilogue syncline                               FAILED (synclines.at:310)
272: %destructor syncline                            ok
[...]
## ------------- ##
## Test results. ##
## ------------- ##

ERROR: 648 tests were run,
1 failed unexpectedly.
12 tests were skipped.
## -------------------------- ##
## testsuite.log was created. ##
## -------------------------- ##

Please send `tests/testsuite.log' and all information you think might help:

   To: <bug-bison@gnu.org>
   Subject: [GNU Bison 3.7.1] testsuite: 270 failed

or:
[...]
267: %union name syncline                            skipped (synclines.at:254)
265: Prologue syncline                               FAILED (synclines.at:194)
269: Action syncline                                 skipped (synclines.at:291)
266: %union syncline                                 FAILED (synclines.at:214)
270: Epilogue syncline                               skipped (synclines.at:310)
268: Postprologue syncline                           FAILED (synclines.at:264)
272: %destructor syncline                            ok
271: %code top syncline                              ok
273: %printer syncline                               FAILED (synclines.at:370)
[...]
## ------------- ##
## Test results. ##
## ------------- ##

ERROR: 647 tests were run,
4 failed unexpectedly.
13 tests were skipped.
## -------------------------- ##
## testsuite.log was created. ##
## -------------------------- ##

Please send `tests/testsuite.log' and all information you think might help:

   To: <bug-bison@gnu.org>
   Subject: [GNU Bison 3.7.1] testsuite: 265 266 268 273 failed

or:
[...]
294: Sane headers: api.pure api.push-pull=both       ok
273: %printer syncline                               FAILED (synclines.at:370)
287: export YYLTYPE                                  ok
[...]
## ------------- ##
## Test results. ##
## ------------- ##

ERROR: 645 tests were run,
1 failed unexpectedly.
15 tests were skipped.
## -------------------------- ##
## testsuite.log was created. ##
## -------------------------- ##

Please send `tests/testsuite.log' and all information you think might help:

   To: <bug-bison@gnu.org>
   Subject: [GNU Bison 3.7.1] testsuite: 273 failed

All failures are in the "Sync Lines" section.

If I patch the ebuild to run tests sequentially tests succeed without problems:
## ------------- ##
## Test results. ##
## ------------- ##

650 tests were successful.
10 tests were skipped.
make[3]: Leaving directory '/var/tmp/portage/sys-devel/bison-3.7.1/work/bison-3.7.1'
make[2]: Leaving directory '/var/tmp/portage/sys-devel/bison-3.7.1/work/bison-3.7.1'
make[1]: Leaving directory '/var/tmp/portage/sys-devel/bison-3.7.1/work/bison-3.7.1'
>>> Completed testing sys-devel/bison-3.7.1

# emerge --info =sys-devel/bison-3.7.1
emerge --info =sys-devel/bison-3.7.1
Portage 3.0.4 (python 3.7.8-final-0, default/linux/amd64/17.1/desktop/plasma/systemd, gcc-9.3.0, glibc-2.31-r6, 5.4.60-gentoo x86_64)
=================================================================
                         System Settings
=================================================================
System uname: Linux-5.4.60-gentoo-x86_64-AMD_Phenom-tm-_II_X6_1100T_Processor-with-gentoo-2.7
KiB Mem:    16138328 total,   2457508 free
KiB Swap:   12550140 total,  12495356 free
Timestamp of repository gentoo: Tue, 01 Sep 2020 09:45:01 +0000
Head commit of repository gentoo: b22162fff1007bbf1063e60c360d0b0ca81ad127
sh dash 0.5.11.1
ld GNU gold (Gentoo 2.33.1 p2 2.33.1) 1.16
distcc 3.3.3 x86_64-pc-linux-gnu [enabled]
ccache version 3.7.11 [disabled]
app-shells/bash:          5.0_p18::gentoo
dev-java/java-config:     2.3.1::gentoo
dev-lang/perl:            5.30.3::gentoo
dev-lang/python:          2.7.18-r1::gentoo, 3.7.8-r2::gentoo, 3.8.5::gentoo
dev-util/ccache:          3.7.11::gentoo
dev-util/cmake:           3.16.5::gentoo
sys-apps/baselayout:      2.7::gentoo
sys-apps/sandbox:         2.18::gentoo
sys-devel/autoconf:       2.13-r1::gentoo, 2.69-r4::gentoo
sys-devel/automake:       1.16.1-r1::gentoo
sys-devel/binutils:       2.33.1-r1::gentoo
sys-devel/gcc:            9.3.0-r1::gentoo
sys-devel/gcc-config:     2.3.1::gentoo
sys-devel/libtool:        2.4.6-r6::gentoo
sys-devel/make:           4.2.1-r4::gentoo
sys-kernel/linux-headers: 5.4-r1::gentoo (virtual/os-headers)
sys-libs/glibc:           2.31-r6::gentoo
Repositories:

gentoo
    location: /usr/portage
    sync-type: rsync
    sync-uri: rsync://rsync.europe.gentoo.org/gentoo-portage
    priority: -1000
    sync-rsync-verify-max-age: 24
    sync-rsync-verify-metamanifest: yes
    sync-rsync-extra-opts: 
    sync-rsync-verify-jobs: 1

x-portage
    location: /usr/local/portage
    masters: gentoo
    priority: 0

ACCEPT_KEYWORDS="amd64"
ACCEPT_LICENSE="* -@EULA"
CBUILD="x86_64-pc-linux-gnu"
CFLAGS="-O2 -pipe -frecord-gcc-switches -march=amdfam10 -flto=7"
CHOST="x86_64-pc-linux-gnu"
CONFIG_PROTECT="/etc /usr/lib64/libreoffice/program/sofficerc /usr/share/config /usr/share/gnupg/qualified.txt"
CONFIG_PROTECT_MASK="/etc/ca-certificates.conf /etc/dconf /etc/env.d /etc/fonts/fonts.conf /etc/gconf /etc/gentoo-release /etc/revdep-rebuild /etc/sandbox.d /etc/terminfo"
CXXFLAGS="-O2 -pipe -frecord-gcc-switches -march=amdfam10 -flto=7"
DISTDIR="/usr/portage/distfiles"
EMERGE_DEFAULT_OPTS="--keep-going y --with-bdeps y"
ENV_UNSET="CARGO_HOME DBUS_SESSION_BUS_ADDRESS DISPLAY GOBIN GOPATH PERL5LIB PERL5OPT PERLPREFIX PERL_CORE PERL_MB_OPT PERL_MM_OPT XAUTHORITY XDG_CACHE_HOME XDG_CONFIG_HOME XDG_DATA_HOME XDG_RUNTIME_DIR"
FCFLAGS="-O2 -pipe -frecord-gcc-switches -march=amdfam10 -flto=7"
FEATURES="assume-digests binpkg-docompress binpkg-dostrip binpkg-logs cgroup compress-build-logs config-protect-if-modified distcc distlocks ebuild-locks ipc-sandbox merge-sync multilib-strict network-sandbox news parallel-fetch pid-sandbox preserve-libs protect-owned qa-unresolved-soname-deps sandbox sfperms split-elog split-log strict test unknown-features-warn unmerge-logs unmerge-orphans userfetch userpriv usersandbox usersync xattr"
FFLAGS="-O2 -pipe -frecord-gcc-switches -march=amdfam10 -flto=7"
GENTOO_MIRRORS="http://mirrors.soeasyto.com/distfiles.gentoo.org/ http://mirrors.evowise.com/gentoo/ http://gentoo.modulix.net/gentoo/ https://mirrors.soeasyto.com/distfiles.gentoo.org/ https://mirrors.evowise.com/gentoo/"
LANG="it_IT.UTF-8"
LDFLAGS="-Wl,-O1 -Wl,--as-needed -Wl,--hash-style=gnu -Wl,--sort-common -flto=7"
LINGUAS="it it_IT"
MAKEOPTS="-j12 -l6"
PKGDIR="/usr/portage/packages"
PORTAGE_CONFIGROOT="/"
PORTAGE_RSYNC_OPTS="--recursive --links --safe-links --perms --times --omit-dir-times --compress --force --whole-file --delete --stats --human-readable --timeout=180 --exclude=/distfiles --exclude=/local --exclude=/packages --exclude=/.git"
PORTAGE_TMPDIR="/var/tmp"
USE="X a52 aac aalib acl acpi activities adns alsa amd64 ao audiofile bash-completion bluetooth branding brotli bzip2 cairo caps cdda cddb cdparanoia cdr cli crypt css cups curl dbus declarative dga djvu dri dts dvd dvdr emboss encode exif expat fbcon ffmpeg fftw flac fontconfig fortran ftp gd gdbm geoip gif gimp gmp gnutls gphoto2 gpm graphviz gtk gui handbook iconv icu idn imagemagick imlib introspection ipv6 java javascript jbig jemalloc jpeg jpeg2k kde kipi kwallet lame lcms libass libglvnd libnotify libsamplerate libtirpc lm_sensors lua lzma lzo mad mmap mng mp3 mp4 mpeg mplayer multilib musicbrainz ncurses nls nptl nsplugin offensive ogg openal opengl openmp pam pango pcre pdf phonon plasma png policykit postscript ppds pulseaudio qml qt5 rdesktop readline recode samba sctp sdl seccomp sndfile sockets speex spell split-usr sqlite sqlite3 ssl startup-notification svg symlink syslog systemd sysvipc taglib telemetry test theora threads tidy tiff truetype udev udisks unicode upower usb vaapi vala vdpau vim-syntax vnc vorbis wavpack wayland widgets win32codecs wmf wxwidgets x264 xattr xcb xine xml xpm xscreensaver xv xvid yahoo zlib zstd" ABI_X86="64" ADA_TARGET="gnat_2018" ALSA_CARDS="hda-intel virmidi" APACHE2_MODULES="authn_core authz_core socache_shmcb unixd actions alias auth_basic authn_alias authn_anon authn_dbm authn_default authn_file authz_dbm authz_default authz_groupfile authz_host authz_owner authz_user autoindex cache cgi cgid dav dav_fs dav_lock deflate dir disk_cache env expires ext_filter file_cache filter headers include info log_config logio mem_cache mime mime_magic negotiation rewrite setenvif speling status unique_id userdir usertrack vhost_alias" CALLIGRA_FEATURES="karbon sheets words" CAMERAS="kodak ptp2" COLLECTD_PLUGINS="df interface irq load memory rrdtool swap syslog" CPU_FLAGS_X86="3dnow 3dnowext mmx mmxext popcnt sse sse2 sse3 sse4a" CURL_SSL="gnutls" ELIBC="glibc" GPSD_PROTOCOLS="ashtech aivdm earthmate evermore fv18 garmin garmintxt gpsclock greis isync itrax mtk3301 nmea ntrip navcom oceanserver oldstyle oncore rtcm104v2 rtcm104v3 sirf skytraq superstar2 timing tsip tripmate tnt ublox ubx" GRUB_PLATFORMS="pc" INPUT_DEVICES="libinput" KERNEL="linux" L10N="it en" LCD_DEVICES="bayrad cfontz cfontz633 glk hd44780 lb216 lcdm001 mtxorb ncurses text" LIBREOFFICE_EXTENSIONS="nlpsolver" OFFICE_IMPLEMENTATION="libreoffice" PHP_TARGETS="php7-2 php7-3" POSTGRES_TARGETS="postgres10 postgres11" PYTHON_SINGLE_TARGET="python3_7" PYTHON_TARGETS="python3_7" RUBY_TARGETS="ruby25" SANE_BACKENDS="epson epson2" USERLAND="GNU" VIDEO_CARDS="radeon r600" XTABLES_ADDONS="quota2 psd pknock lscan length2 ipv4options ipset ipp2p iface geoip fuzzy condition tee tarpit sysrq steal rawnat logmark ipmark dhcpmac delude chaos account"
Unset:  CC, CPPFLAGS, CTARGET, CXX, INSTALL_MASK, LC_ALL, PORTAGE_BINHOST, PORTAGE_BUNZIP2_COMMAND, PORTAGE_COMPRESS, PORTAGE_COMPRESS_FLAGS, PORTAGE_RSYNC_EXTRA_OPTS

# emerge -1pqv =sys-devel/bison-3.7.1
[ebuild     U ] sys-devel/bison-3.7.1 [3.1] USE="nls test -examples -static"
Comment 1 Paolo Pedroni 2020-09-01 13:36:26 UTC
Created attachment 657740 [details]
bison-3.7.1:20200901-124609.log.gz - Successful tests
Comment 2 Paolo Pedroni 2020-09-01 13:38:05 UTC
Created attachment 657742 [details, diff]
Patch to ebuild to execute tests sequentially
Comment 3 Thomas Deutschmann (RETIRED) gentoo-dev 2020-09-01 20:50:17 UTC
I cannot reproduce and I am not convinced that this is caused by parallel execution,

> 225: Syntax error in consistent error state: yacc.c  ok
> 242: %no-default-prec without %prec                  ok
> 266: %union syncline                                 ok
> 265: Prologue syncline                               ok
> 282: Output columns                                  ok
> 136: C++ Output File Prefix Mapping                  ok
> 268: Postprologue syncline                           ok
> 267: %union name syncline                            ok
> 270: Epilogue syncline                               ok
> 269: Action syncline                                 ok
> 271: %code top syncline                              ok
> 200: S/R in initial                                  ok
> 284: Invalid CPP guards:  --defines=9foo.h           ok
> 272: %destructor syncline                            ok
> 283: Invalid CPP guards:  --defines=input/input.h    ok
> 274: syncline escapes: yacc.c                        ok
> 273: %printer syncline                               ok
> 280: %no-lines: lalr1.cc                             ok
> 278: %no-lines: yacc.c                               ok
> 279: %no-lines: glr.c                                ok
> 226: Syntax error in consistent error state: glr.c   ok
> 281: %no-lines: glr.cc                               ok
> 286: Invalid CPP guards: %glr-parser --defines=9foo.h ok
> 285: Invalid CPP guards: %glr-parser --defines=input/input.h ok
> 305: Add missing %empty                              ok
> 288: Sane headers:                                   ok
> 227: Syntax error in consistent error state: lalr1.cc ok
> 292: Sane headers: api.pure                          ok
> 289: Sane headers: %locations %debug                 ok
> 303: Invalid uses of %empty                          ok
> 275: syncline escapes: glr.c                         ok
> 293: Sane headers: api.push-pull=both                ok
> 294: Sane headers: api.pure api.push-pull=both       ok
> 300: Midrule actions                                 ok
> 304: Valid uses of %empty                            ok
> 301: Typed midrule actions                           ok
> 308: Initial location: yacc.c api.pure %parse-param { int x } ok
> 306: Initial location: yacc.c                        ok
> 307: Initial location: yacc.c api.pure=full          ok
> 248: %expect-rr non GLR                              ok
> 245: Unreachable States After Conflict Resolution    ok
> 309: Initial location: yacc.c api.push-pull=both     ok
> 310: Initial location: yacc.c api.push-pull=both api.pure=full ok
> 228: Syntax error in consistent error state: glr.cc  ok
> 290: Sane headers: %glr-parser                       ok
> 315: Initial location: yacc.c api.pure=full          ok
> 316: Initial location: yacc.c api.pure=full          ok
> 312: Initial location: glr.c api.pure                ok
> 291: Sane headers: %locations %debug %glr-parser     ok
> 276: syncline escapes: lalr1.cc                      ok
> 311: Initial location: glr.c                         ok
> 317: Location print: yacc.c                          ok
> 287: export YYLTYPE                                  ok
> 277: syncline escapes: glr.cc                        ok
> 318: Location print: glr.c                           ok
> 336: @$ in %initial-action implies %locations        ok
> 337: @$ in %destructor implies %locations            ok
> 345: %union vs. api.value.type                       ok
> 338: @$ in %printer implies %locations               ok

Please show detailed log for failed test(s).
Comment 4 Paolo Pedroni 2020-09-03 15:34:23 UTC
Created attachment 658106 [details]
testsuite.log of failing 268 test

You're right, of course :-(

Looking at the extended logs it shows that compilation (with distcc) fails once on the remote host, and then on the local one, giving duplicate error messages on stdout.
Comment 5 Paolo Pedroni 2020-09-03 15:35:05 UTC
Running without distcc gives no errors, of course.
Comment 6 Chuckery Towers 2020-09-20 15:07:44 UTC
Perhaps there is a connection with https://bugs.gentoo.org/722126 - for me, compilation of 3.7.1-r1 did not succeed until "--jobs 1" was specified.
Comment 7 Paolo Pedroni 2020-09-22 11:17:27 UTC
(In reply to Chuckery Towers from comment #6)
> Perhaps there is a connection with https://bugs.gentoo.org/722126 - for me,
> compilation of 3.7.1-r1 did not succeed until "--jobs 1" was specified.

Nothing like it. Logs are quite clear: using distcc yields duplicate error messages that make the tests look like they're failing.

Closing as INVALID.