Gentoo Websites Logo
Go to: Gentoo Home Documentation Forums Lists Bugs Planet Store Wiki Get Gentoo!

Bug 337715 (PR46173)

Summary: [4.4] sys-devel/gcc-4.4.3-r2: rebuild fails gencheck.c:30:24: error: all-tree.def: No such file or directory
Product: Gentoo Linux Reporter: Jorge Manuel B. S. Vicetto (RETIRED) <jmbsvicetto>
Component: [OLD] Core systemAssignee: Gentoo Toolchain Maintainers <toolchain>
Status: RESOLVED FIXED    
Severity: normal CC: kanelxake, redhatter, releng
Priority: High Keywords: Inclusion
Version: autobuilds   
Hardware: All   
OS: Linux   
URL: http://gcc.gnu.org/PR46173
Whiteboard:
Package list:
Runtime testing required: ---
Attachments: Compressed log file for the 20100909 stage1 build
Compressed log file for the 20100916 stage3 build

Description Jorge Manuel B. S. Vicetto (RETIRED) Gentoo Infrastructure gentoo-dev 2010-09-16 23:01:45 UTC
For the past 2 weeks gcc has failed to build for the weekly stages for the amd64-dev/default target on poseidon.
On 201009007 it failed on stage1 for the amd64-dev/default target and this week on 20100916 it failed on stage3 for the amd64-dev/default target. On these 2 weeks the amd64-dev/hardened target didn't fail to build gcc.

The reported error on stage1 for 20100909 was:

/var/tmp/portage/sys-devel/gcc-4.4.3-r2/work/build/./prev-gcc/xgcc -B/var/tmp/portage/sys-devel/gcc-4.4.3-r2/work/build/./prev-gcc/ -B/usr/x86_
64-pc-linux-gnu/bin/ -c  -O2 -pipe -DIN_GCC   -W -Wall -Wwrite-strings -Wstrict-prototypes -Wmissing-prototypes -Wcast-qual -Wold-style-definit
ion -Wc++-compat -Wmissing-format-attribute -pedantic -Wno-long-long -Wno-variadic-macros -Wno-overlength-strings  -Wno-error -DHAVE_CONFIG_H -
DGENERATOR_FILE -I. -Ibuild -I/var/tmp/portage/sys-devel/gcc-4.4.3-r2/work/gcc-4.4.3/gcc -I/var/tmp/portage/sys-devel/gcc-4.4.3-r2/work/gcc-4.4
.3/gcc/build -I/var/tmp/portage/sys-devel/gcc-4.4.3-r2/work/gcc-4.4.3/gcc/../include -I/var/tmp/portage/sys-devel/gcc-4.4.3-r2/work/gcc-4.4.3/g
cc/../libcpp/include  -I/var/tmp/portage/sys-devel/gcc-4.4.3-r2/work/gcc-4.4.3/gcc/../libdecnumber -I/var/tmp/portage/sys-devel/gcc-4.4.3-r2/wo
rk/gcc-4.4.3/gcc/../libdecnumber/bid -I../libdecnumber    -o build/gengtype-lex.o /var/tmp/portage/sys-devel/gcc-4.4.3-r2/work/gcc-4.4.3/gcc/ge
ngtype-lex.c
/var/tmp/portage/sys-devel/gcc-4.4.3-r2/work/build/./prev-gcc/xgcc -B/var/tmp/portage/sys-devel/gcc-4.4.3-r2/work/build/./prev-gcc/ -B/usr/x86_
64-pc-linux-gnu/bin/ -c -O2 -pipe -DIN_GCC -W -Wall -Wwrite-strings -Wstrict-prototypes -Wmissing-prototypes -Wcast-qual -DHAVE_CONFIG_H -DGENE
RATOR_FILE -I. -Ibuild -I/var/tmp/portage/sys-devel/gcc-4.4.3-r2/work/gcc-4.4.3/gcc -I/var/tmp/portage/sys-devel/gcc-4.4.3-r2/work/gcc-4.4.3/gc
c/build -I/var/tmp/portage/sys-devel/gcc-4.4.3-r2/work/gcc-4.4.3/gcc/../include -I/var/tmp/portage/sys-devel/gcc-4.4.3-r2/work/gcc-4.4.3/gcc/..
/libcpp/include  -I/var/tmp/portage/sys-devel/gcc-4.4.3-r2/work/gcc-4.4.3/gcc/../libdecnumber -I/var/tmp/portage/sys-devel/gcc-4.4.3-r2/work/gc
c-4.4.3/gcc/../libdecnumber/bid -I../libdecnumber    -o build/gencheck.o /var/tmp/portage/sys-devel/gcc-4.4.3-r2/work/gcc-4.4.3/gcc/gencheck.c
/var/tmp/portage/sys-devel/gcc-4.4.3-r2/work/gcc-4.4.3/gcc/gencheck.c:30:24: error: all-tree.def: No such file or directory
make[3]: *** [build/gencheck.o] Error 1
rm gcc.pod
make[3]: Leaving directory `/var/tmp/portage/sys-devel/gcc-4.4.3-r2/work/build/gcc'
make[2]: *** [all-stage3-gcc] Error 2
make[2]: Leaving directory `/var/tmp/portage/sys-devel/gcc-4.4.3-r2/work/build'
make[1]: *** [stage3-bubble] Error 2
make[1]: Leaving directory `/var/tmp/portage/sys-devel/gcc-4.4.3-r2/work/build'
make: *** [bootstrap-lean] Error 2
make: INTERNAL: Exiting with 9 jobserver tokens available; should be 8!
 * ERROR: sys-devel/gcc-4.4.3-r2 failed:
 *   emake failed with bootstrap-lean

The reported error on stage3 for 20100916 was:

/var/tmp/portage/sys-devel/gcc-4.4.3-r2/work/build/./prev-gcc/xgcc -B/var/tmp/portage/sys-devel/gcc-4.4.3-r2/work/build/./prev-gcc/ -B/usr/x86_
64-pc-linux-gnu/bin/ -c  -O2 -pipe -DIN_GCC   -W -Wall -Wwrite-strings -Wstrict-prototypes -Wmissing-prototypes -Wcast-qual -Wold-style-definit
ion -Wc++-compat -Wmissing-format-attribute -pedantic -Wno-long-long -Wno-variadic-macros -Wno-overlength-strings   -DHAVE_CONFIG_H -DGENERATOR
_FILE -I. -Ibuild -I/var/tmp/portage/sys-devel/gcc-4.4.3-r2/work/gcc-4.4.3/gcc -I/var/tmp/portage/sys-devel/gcc-4.4.3-r2/work/gcc-4.4.3/gcc/bui
ld -I/var/tmp/portage/sys-devel/gcc-4.4.3-r2/work/gcc-4.4.3/gcc/../include -I/var/tmp/portage/sys-devel/gcc-4.4.3-r2/work/gcc-4.4.3/gcc/../libc
pp/include  -I/var/tmp/portage/sys-devel/gcc-4.4.3-r2/work/gcc-4.4.3/gcc/../libdecnumber -I/var/tmp/portage/sys-devel/gcc-4.4.3-r2/work/gcc-4.4
.3/gcc/../libdecnumber/bid -I../libdecnumber    -o build/genchecksum.o /var/tmp/portage/sys-devel/gcc-4.4.3-r2/work/gcc-4.4.3/gcc/genchecksum.c
/var/tmp/portage/sys-devel/gcc-4.4.3-r2/work/build/./prev-gcc/xgcc -B/var/tmp/portage/sys-devel/gcc-4.4.3-r2/work/build/./prev-gcc/ -B/usr/x86_
64-pc-linux-gnu/bin/  -O2 -pipe -DIN_GCC   -W -Wall -Wwrite-strings -Wstrict-prototypes -Wmissing-prototypes -Wcast-qual -Wold-style-definition
 -Wc++-compat -Wmissing-format-attribute -pedantic -Wno-long-long -Wno-variadic-macros -Wno-overlength-strings   -DHAVE_CONFIG_H -DGENERATOR_FI
LE  -o build/gengenrtl \
            build/gengenrtl.o build/errors.o .././libiberty/libiberty.a
/var/tmp/portage/sys-devel/gcc-4.4.3-r2/work/build/./prev-gcc/xgcc -B/var/tmp/portage/sys-devel/gcc-4.4.3-r2/work/build/./prev-gcc/ -B/usr/x86_
64-pc-linux-gnu/bin/  -O2 -pipe -DIN_GCC   -W -Wall -Wwrite-strings -Wstrict-prototypes -Wmissing-prototypes -Wcast-qual -Wold-style-definition
 -Wc++-compat -Wmissing-format-attribute -pedantic -Wno-long-long -Wno-variadic-macros -Wno-overlength-strings   -DHAVE_CONFIG_H -DGENERATOR_FI
LE  -o build/gengtype \
            build/gengtype.o build/gengtype-lex.o build/gengtype-parse.o build/errors.o .././libiberty/libiberty.a
/var/tmp/portage/sys-devel/gcc-4.4.3-r2/work/build/./prev-gcc/xgcc -B/var/tmp/portage/sys-devel/gcc-4.4.3-r2/work/build/./prev-gcc/ -B/usr/x86_
64-pc-linux-gnu/bin/ -c -O2 -pipe -DIN_GCC -W -Wall -Wwrite-strings -Wstrict-prototypes -Wmissing-prototypes -Wcast-qual -DHAVE_CONFIG_H -DGENE
RATOR_FILE -I. -Ibuild -I/var/tmp/portage/sys-devel/gcc-4.4.3-r2/work/gcc-4.4.3/gcc -I/var/tmp/portage/sys-devel/gcc-4.4.3-r2/work/gcc-4.4.3/gc
c/build -I/var/tmp/portage/sys-devel/gcc-4.4.3-r2/work/gcc-4.4.3/gcc/../include -I/var/tmp/portage/sys-devel/gcc-4.4.3-r2/work/gcc-4.4.3/gcc/..
/libcpp/include  -I/var/tmp/portage/sys-devel/gcc-4.4.3-r2/work/gcc-4.4.3/gcc/../libdecnumber -I/var/tmp/portage/sys-devel/gcc-4.4.3-r2/work/gc
c-4.4.3/gcc/../libdecnumber/bid -I../libdecnumber    -o build/gencheck.o /var/tmp/portage/sys-devel/gcc-4.4.3-r2/work/gcc-4.4.3/gcc/gencheck.c
/var/tmp/portage/sys-devel/gcc-4.4.3-r2/work/gcc-4.4.3/gcc/gencheck.c:30:24: error: all-tree.def: No such file or directory
make[3]: *** [build/gencheck.o] Error 1
rm gcc.pod gfortran.pod
make[3]: Leaving directory `/var/tmp/portage/sys-devel/gcc-4.4.3-r2/work/build/gcc'
make[2]: *** [all-stage2-gcc] Error 2
make[2]: Leaving directory `/var/tmp/portage/sys-devel/gcc-4.4.3-r2/work/build'
make[1]: *** [stage2-bubble] Error 2
make[1]: Leaving directory `/var/tmp/portage/sys-devel/gcc-4.4.3-r2/work/build'
make: *** [bootstrap-lean] Error 2
make: INTERNAL: Exiting with 9 jobserver tokens available; should be 8!
 * ERROR: sys-devel/gcc-4.4.3-r2 failed:
 *   emake failed with bootstrap-lean
Comment 1 Jorge Manuel B. S. Vicetto (RETIRED) Gentoo Infrastructure gentoo-dev 2010-09-16 23:07:23 UTC
Created attachment 247647 [details]
Compressed log file for the 20100909 stage1 build
Comment 2 Jorge Manuel B. S. Vicetto (RETIRED) Gentoo Infrastructure gentoo-dev 2010-09-16 23:08:15 UTC
Created attachment 247649 [details]
Compressed log file for the 20100916 stage3 build
Comment 3 Jorge Manuel B. S. Vicetto (RETIRED) Gentoo Infrastructure gentoo-dev 2010-09-16 23:10:07 UTC
emerge --info for the 20100909 stage1:

Portage 2.1.8.3 (unavailable, gcc-4.4.3, glibc-2.11.2-r0, 2.6.28-hardened-r9-infra14 x86_64)
=================================================================
System uname: Linux-2.6.28-hardened-r9-infra14-x86_64-with-gentoo-1.12.13
Timestamp of tree: Unknown
ccache version 2.4 [disabled]
dev-lang/python:     2.6.5-r2, 3.1.2-r3
sys-devel/autoconf:  2.65
sys-devel/automake:  1.11.1
sys-devel/binutils:  2.20.1-r1
sys-devel/libtool:   2.2.6b
virtual/os-headers:  2.6.30-r1
ACCEPT_LICENSE="* -@EULA"
CFLAGS="-O2 -pipe"
CHOST="x86_64-pc-linux-gnu"
CONFIG_PROTECT="/etc"
CONFIG_PROTECT_MASK="/etc/ca-certificates.conf /etc/env.d /etc/sandbox.d /etc/terminfo"
CXXFLAGS="-O2 -pipe"
DISTDIR="/usr/portage/distfiles"
FEATURES="assume-digests distlocks fixpackages news parallel-fetch protect-owned sandbox sfperms strict unmerge-logs unmerge-orphans userfetch"
GENTOO_MIRRORS="http://distfiles.gentoo.org"
PKGDIR="/usr/portage/packages"
PORTAGE_TMPDIR="/var/tmp"
PORTDIR="/usr/portage"
SYNC="rsync://rsync.gentoo.org/gentoo-portage"
USE="bindist build mmx multilib nptl nptlonly sse sse2 unicode" 
Unset:  ACCEPT_KEYWORDS, EMERGE_DEFAULT_OPTS, PORTDIR_OVERLAY
Comment 4 Jorge Manuel B. S. Vicetto (RETIRED) Gentoo Infrastructure gentoo-dev 2010-09-16 23:11:28 UTC
emerge --info for the 20100916 stage3:

Portage 2.1.8.3 (unavailable, gcc-4.4.3, glibc-2.11.2-r0, 2.6.28-hardened-r9-infra14 x86_64)
=================================================================
System uname: Linux-2.6.28-hardened-r9-infra14-x86_64-with-gentoo-1.12.13
Timestamp of tree: Unknown
ccache version 2.4 [disabled]
dev-lang/python:     2.6.5-r3, 3.1.2-r4
sys-devel/autoconf:  2.65-r1
sys-devel/automake:  1.11.1
sys-devel/binutils:  2.20.1-r1
sys-devel/libtool:   2.2.6b
virtual/os-headers:  2.6.30-r1
ACCEPT_LICENSE="* -@EULA"
CFLAGS="-O2 -pipe"
CHOST="x86_64-pc-linux-gnu"
CONFIG_PROTECT="/etc"
CONFIG_PROTECT_MASK="/etc/ca-certificates.conf /etc/env.d /etc/sandbox.d /etc/terminfo"
CXXFLAGS="-O2 -pipe"
DISTDIR="/usr/portage/distfiles"
FEATURES="assume-digests distlocks fixpackages news parallel-fetch protect-owned sandbox sfperms strict unmerge-logs unmerge-orphans userfetch"
GENTOO_MIRRORS="http://distfiles.gentoo.org"
PKGDIR="/usr/portage/packages"
PORTAGE_TMPDIR="/var/tmp"
PORTDIR="/usr/portage"
SYNC="rsync://rsync.gentoo.org/gentoo-portage"
USE="mmx sse sse2" 
Unset:  ACCEPT_KEYWORDS, EMERGE_DEFAULT_OPTS, PORTDIR_OVERLAY
Comment 5 Jorge Manuel B. S. Vicetto (RETIRED) Gentoo Infrastructure gentoo-dev 2010-09-16 23:13:32 UTC
Might this be a parallel build issue? Something else?
Is there any other info you require to debug this?
Comment 6 Xepher 2010-09-23 21:48:19 UTC
Definitely seems to be a jobs issue. I had gcc 4.4.4 and had the same issue trying to build both -r1 and -r2

make: INTERNAL: Exiting with 9 jobserver tokens available; should be 8!

I also had a high number of jobs going... -j10. I commented out my makeopts in make.conf and gcc built without issue (just slowly on a single core.)
Comment 7 Jorge Manuel B. S. Vicetto (RETIRED) Gentoo Infrastructure gentoo-dev 2010-10-14 11:23:47 UTC
The latest weekly run of catalyst for amd64 failed again due to this issue.
Is there anything we can do? If we can't be certain that a specific gcc version won't fail to build, because of parallel compilation?, should it be marked stable?
Comment 8 Xake 2010-10-18 10:03:11 UTC
I hit this too today with gcc-4.4.5.
It is a rather classic parallell build issue.

Looking into it i found this commit:
http://git.infradead.org/toolchain/gcc.git/commitdiff/ddf75885fb9f1054f136b86966c0822914afefa4
(I think you can find out from there what svn revision it was)

The problem is the following change:

--- a/gcc/gencheck.c
+++ b/gcc/gencheck.c
@@ -24,14 +24,16 @@ along with GCC; see the file COPYING3.  If not see
 #include "tm.h"
 
 #define DEFTREECODE(SYM, NAME, TYPE, LEN) #SYM,
+#define END_OF_BASE_TREE_CODES
 
 static const char *const tree_codes[] = {
-#include "tree.def"
-#include "c-common.def"
-#include "gencheck.h"
+#include "all-tree.def"
 (char*) 0
 };

As you see gencheck.c now needs all-tree.def, however they seems to fogotten to make appropriate changes to Makefile.in:

build/gencheck.o : gencheck.c tree.def $(BCONFIG_H) $(GTM_H)           \
        $(SYSTEM_H) coretypes.h $(lang_tree_files)

so make only looks for tree.def.

I cannot reliably reproduce this issue, however if I make gencheck.o depend on all-tree.def instead of tree.def in Makefile.in gcc still builds fine here, both with MAKEOPTS="-j1" and MAKEOPTS="-j10".


@toolchain does that change look innocent enough or should we take it upstream before adding a patch to our patchset?
Comment 9 Ryan Hill (RETIRED) gentoo-dev 2010-10-25 21:36:29 UTC
Thanks for investigating.  It was fixed w/ commit 147395 but never backported to the 4.4 branch.
Comment 11 Ryan Hill (RETIRED) gentoo-dev 2010-11-29 20:51:34 UTC
Fixed.