On two different amd64 systems, I have seen an initial build fail as described in the summary. Looking at the remains shows that in fact the file exists. This appears to be related to parallel builds. The first system to fail is a 4-processor amd64, and the build was with MAKEOPTS="-j5" --- a rebuild with MAKEOPTS="-j4" was successful (but note, I use ccache, so the timings were quite different). The second failure showed up on an amd64 dual processor, MAKEOPTS="-j2". I do not yet have results from a rebuild attempt (also with -j2, but ccached). I'll update when I know. For completeness, here is the first system: ====================================== fmccor@anaconda ~ [2]% cat /proc/cpuinfo processor : 0 vendor_id : AuthenticAMD cpu family : 15 model : 33 model name : Dual Core AMD Opteron(tm) Processor 270 stepping : 2 cpu MHz : 2000.038 cache size : 1024 KB physical id : 0 siblings : 2 core id : 0 cpu cores : 2 fpu : yes fpu_exception : yes cpuid level : 1 wp : yes flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext fxsr_opt lm 3dnowext 3dnow pni lahf_lm cmp_legacy bogomips : 4002.48 TLB size : 1024 4K pages clflush size : 64 cache_alignment : 64 address sizes : 40 bits physical, 48 bits virtual power management: ts fid vid ttp .... << three more just like it >>> ===================================== fmccor@anaconda ~ [3]% emerge --info Portage 2.2_pre5 (default-linux/amd64/2007.0, gcc-4.1.2, glibc-2.6.1-r0, 2.6.20-gentoo-r8 x86_64) ================================================================= System uname: 2.6.20-gentoo-r8 x86_64 Dual Core AMD Opteron(tm) Processor 270 Timestamp of tree: Thu, 27 Mar 2008 12:30:01 +0000 ccache version 2.4 [enabled] app-shells/bash: 3.2_p17-r1 dev-java/java-config: 1.3.7, 2.1.4 dev-lang/python: 2.4.4-r9 dev-python/pycrypto: 2.0.1-r6 dev-util/ccache: 2.4-r7 sys-apps/baselayout: 1.12.11.1 sys-apps/sandbox: 1.2.18.1-r2 sys-devel/autoconf: 2.13, 2.61-r1 sys-devel/automake: 1.4_p6, 1.5, 1.6.3, 1.7.9-r1, 1.8.5-r3, 1.9.6-r2, 1.10 sys-devel/binutils: 2.18-r1 sys-devel/gcc-config: 1.4.0-r4 sys-devel/libtool: 1.5.26 virtual/os-headers: 2.6.23-r3 ABI="amd64" ACCEPT_KEYWORDS="amd64" ALSA_CARDS="ca0106" ALSA_PCM_PLUGINS="adpcm alaw asym copy dmix dshare dsnoop empty extplug file hooks iec958 ioplug ladspa lfloat linear meter mulaw multi null plug rate route share shm softvol" ANT_HOME="/usr/share/ant-core" APACHE2_MODULES="actions alias auth_basic authn_alias authn_anon authn_dbm authn_default authn_file authz_dbm authz_default authz_groupfile authz_host authz_owner authz_user autoindex cache dav dav_fs dav_lock deflate dir disk_cache env expires ext_filter file_cache filter headers include info log_config logio mem_cache mime mime_magic negotiation rewrite setenvif speling status unique_id userdir usertrack vhost_alias" ARCH="amd64" ASFLAGS_x86="--32" AUTOCLEAN="yes" CBUILD="x86_64-pc-linux-gnu" CDEFINE_amd64="__x86_64__" CDEFINE_x86="__i386__" CFLAGS="-march=k8 -msse3 -O2 -pipe" CFLAGS_x86="-m32 -L/emul/linux/x86/lib -L/emul/linux/x86/usr/lib" CG_COMPILER_EXE="/usr/bin/cgc" CHOST="x86_64-pc-linux-gnu" CHOST_amd64="x86_64-pc-linux-gnu" CHOST_x86="i686-pc-linux-gnu" CLASSPATH="." CLEAN_DELAY="5" CONFIG_PROTECT="/etc /usr/kde/3.5/env /usr/kde/3.5/share/config /usr/kde/3.5/shutdown /usr/share/config /var/lib/hsqldb" CONFIG_PROTECT_MASK="/etc/env.d /etc/env.d/java/ /etc/fonts/fonts.conf /etc/gconf /etc/revdep-rebuild /etc/terminfo /etc/texmf/web2c /etc/udev/rules.d" CRYSTAL_CONFIG="/etc/crystalspace" CRYSTAL_PLUGIN="/usr/lib64/crystalspace" CVS_RSH="ssh" CXXFLAGS="-march=k8 -msse3 -O2 -pipe" DEFAULT_ABI="amd64" DISPLAY="terciopelo.krait.us:0.0" DISTDIR="/usr/portage/distfiles" EDITOR="/usr/bin/vim" ELIBC="glibc" EMERGE_DEFAULT_OPTS="--verbose" EMERGE_WARNING_DELAY="10" FEATURES="ccache collision-protect cvs distlocks metadata-transfer multilib-strict parallel-fetch preserve-libs sandbox sfperms strict unmerge-orphans userfetch" FETCHCOMMAND="/usr/bin/wget -t 5 -T 60 --passive-ftp -O "${DISTDIR}/${FILE}" "${URI}"" FFLAGS="-pipe -O2 -march=k8" FLTK_DOCDIR="/usr/share/doc/fltk-1.1.7-r2/html" GCC_SPECS=""GDK_USE_XFT="1" GENERATION="2" GENTOO_MIRRORS="ftp://gentoo.mirrors.pair.com/ ftp://ftp.ussg.iu.edu/pub/linux/gentoo ftp://gentoo.mirrors.tds.net/gentoo http://open-systems.ufl.edu/mirrors/gentoo http://mirror.fslutd.org/linux/distributions/gentoo/" GUILE_LOAD_PATH="/usr/share/guile/1.8" HOME="/homes/home0/ferris" INFOPATH="/usr/share/info:/usr/share/binutils-data/x86_64-pc-linux-gnu/2.18/info:/usr/share/gcc-data/x86_64-pc-linux-gnu/4.1.2/info:/usr/share/info/emacs-21" INPUT_DEVICES="keyboard mouse" JAVAC="/etc/java-config-2/current-system-vm/bin/javac" JAVA_HOME="/etc/java-config-2/current-system-vm" JDK_HOME="/etc/java-config-2/current-system-vm" KDEDIRS="/usr:/usr/local:/usr/kde/3.5" KERNEL="linux" LCD_DEVICES="" LC_ALL="en_US.utf8" LDFLAGS_x86="-m elf_i386 -L/emul/linux/x86/lib -L/emul/linux/x86/usr/lib" LESS="-R -M --shift 5" LESSCHARSET="utf-8" LESSOPEN="|lesspipe.sh %s" LIBDIR_amd64="lib64" LIBDIR_x86="lib32" LINGUAS="en en_US" LOGNAME="fmccor" LS_COLORS="no=00:fi=00:di=01;34:ln=01;36:pi=40;33:so=01;35:do=01;35:bd=40;33;01:cd=40;33;01:or=01;05;37;41:mi=01;05;37;41:su=37;41:sg=30;43:tw=30;42:ow=34;42:st=37;44:ex=01;32:*.tar=01;31:*.tgz=01;31:*.arj=01;31:*.taz=01;31:*.lzh=01;31:*.zip=01;31:*.z=01;31:*.Z=01;31:*.gz=01;31:*.bz2=01;31:*.bz=01;31:*.tbz2=01;31:*.tz=01;31:*.deb=01;31:*.rpm=01;31:*.jar=01;31:*.rar=01;31:*.ace=01;31:*.zoo=01;31:*.cpio=01;31:*.7z=01;31:*.rz=01;31:*.jpg=01;35:*.jpeg=01;35:*.gif=01;35:*.bmp=01;35:*.pbm=01;35:*.pgm=01;35:*.ppm=01;35:*.tga=01;35:*.xbm=01;35:*.xpm=01;35:*.tif=01;35:*.tiff=01;35:*.png=01;35:*.mng=01;35:*.pcx=01;35:*.mov=01;35:*.mpg=01;35:*.mpeg=01;35:*.m2v=01;35:*.mkv=01;35:*.ogm=01;35:*.mp4=01;35:*.m4v=01;35:*.mp4v=01;35:*.vob=01;35:*.qt=01;35:*.nuv=01;35:*.wmv=01;35:*.asf=01;35:*.rm=01;35:*.rmvb=01;35:*.flc=01;35:*.avi=01;35:*.fli=01;35:*.gl=01;35:*.dl=01;35:*.xcf=01;35:*.xwd=01;35:*.yuv=01;35:*.pdf=00;32:*.ps=00;32:*.txt=00;32:*.patch=00;32:*.diff=00;32:*.log=00;32:*.tex=00;32:*.doc=00;32:*.aac=00;36:*.au=00;36:*.flac=00;36:*.mid=00;36:*.midi=00;36:*.mka=00;36:*.mp3=00;36:*.mpc=00;36:*.ogg=00;36:*.ra=00;36:*.wav=00;36:" MAIL="/var/mail/fmccor" MAKEOPTS="-j5" MANPATH="/etc/java-config-2/current-system-vm/man:/usr/local/share/man:/usr/share/man:/usr/share/binutils-data/x86_64-pc-linux-gnu/2.18/man:/usr/share/gcc-data/x86_64-pc-linux-gnu/4.1.2/man:/opt/blackdown-jdk-1.4.2.03/man:/etc/java-config/system-vm/man/:/usr/kde/3.5/share/man:/usr/qt/3/doc/man:/opt/opera/share/man" MULTILIB_ABIS="amd64 x86" MULTILIB_STRICT_DENY="64-bit.*shared object" MULTILIB_STRICT_DIRS="/lib /usr/lib /usr/kde/*/lib /usr/qt/*/lib /usr/X11R6/lib" MULTILIB_STRICT_EXEMPT="(perl5|gcc|gcc-lib|binutils|eclipse-3|debug|portage)" OMNIORB_CONFIG="/etc/omniorb/omniORB.cfg" OPENGL_PROFILE="nvidia" PAGER="/usr/bin/less" PATH=".:/usr/local/bin:/usr/bin:/bin:/opt/bin:/usr/x86_64-pc-linux-gnu/gcc-bin/4.1.2:/opt/blackdown-jdk-1.4.2.03/bin:/opt/blackdown-jdk-1.4.2.03/jre/bin:/usr/kde/3.5/bin:/usr/qt/3/bin:/opt/firebird/bin:/usr/games/bin:/usr/share/omniORB/bin/scripts:/usr/sbin:/sbin" PKGDIR="/usr/portage/packages" PKG_CONFIG_PATH="/usr/qt/3/lib64/pkgconfig" PORTAGE_ARCHLIST="ppc s390 amd64 x86 ppc64 x86-fbsd m68k arm sparc sh mips ia64 alpha ppc-macos hppa sparc-fbsd" PORTAGE_BINHOST_CHUNKSIZE="3000" PORTAGE_BIN_PATH="/usr/lib/portage/bin" PORTAGE_CONFIGROOT="/" PORTAGE_DEBUG="0" PORTAGE_DEPCACHEDIR="/var/cache/edb/dep" PORTAGE_ELOG_CLASSES="warn error log" PORTAGE_ELOG_MAILFROM="portage@localhost" PORTAGE_ELOG_MAILSUBJECT="[portage] ebuild log for ${PACKAGE} on ${HOST}" PORTAGE_ELOG_MAILURI="root" PORTAGE_ELOG_SYSTEM="save" PORTAGE_FETCH_CHECKSUM_TRY_MIRRORS="5" PORTAGE_GID="250" PORTAGE_INST_GID="0" PORTAGE_INST_UID="0" PORTAGE_PYM_PATH="/usr/lib/portage/pym" PORTAGE_RSYNC_OPTS="--recursive --links --safe-links --perms --times --compress --force --whole-file --delete --stats --timeout=180 --exclude=/distfiles --exclude=/local --exclude=/packages" PORTAGE_RSYNC_RETRIES="3" PORTAGE_TMPDIR="/var/tmp" PORTAGE_TMPFS="/dev/shm" PORTAGE_WORKDIR_MODE="0700" PORTDIR="/usr/portage" PORTDIR_OVERLAY="/usr/local/portage" PRELINK_PATH_MASK="/usr/lib/gstreamer-0.10:/usr/lib/gstreamer-0.8" PS1="\[\033[01;32m\]\u@\h \[\033[01;31m\]\W [\#]% \[\033[00m\]" PS2="> " PWD="/homes/home0/ferris" QMAKESPEC="linux-g++" QTDIR="/usr/qt/3" REMOTEHOST="terciopelo.krait.us" RESUMECOMMAND="/usr/bin/wget -c -t 5 -T 60 --passive-ftp -O "${DISTDIR}/${FILE}" "${URI}"" ROOT="/" ROOTPATH="/opt/bin:/usr/x86_64-pc-linux-gnu/gcc-bin/4.1.2:/opt/blackdown-jdk-1.4.2.03/bin:/opt/blackdown-jdk-1.4.2.03/jre/bin:/usr/kde/3.5/sbin:/usr/kde/3.5/bin:/usr/qt/3/bin:/opt/firebird/bin" RPMDIR="/usr/portage/rpm" RUBYOPT="-rauto_gem" R_HOME="/usr/lib64/R" SHELL="/bin/bash" SHLVL="1" SSH_AGENT_PID="5972" SSH_AUTH_SOCK="/tmp/ssh-iRCPyI5971/agent.5971" SSH_CLIENT="192.168.8.15 36714 22" SSH_CONNECTION="192.168.8.15 36714 192.168.8.30 22" SSH_TTY="/dev/pts/12" STAGE1_USE="nptl nptlonly unicode" SYMLINK_LIB="yes" SYNC="rsync://rsync.gentoo.org/gentoo-portage" TERM="xterm" TEXINPUTS="/usr/lib64/ocaml/ocamldoc:" USE="3dnow 3dnowext X Xaw3d acl alsa amd64 arts bash-completion berkdb bzip2 cli cpudetection cracklib crypt cups dri emacs fortran gdbm gif glx gmp gpm gtk iconv isdnlog jpeg latex midi mmx mmxext motif mudflap mysql ncurses nls nptl nptlonly ogg opengl openmp pam pcre pdf perl png portaudio pppd python readline reflection ruby sdl session spell spl sqlite sse sse2 sse3 ssl tcl tcpd tetex tex tiff tk truetype unicode vim-syntax vorbis xorg zlib" ALSA_CARDS="ca0106" ALSA_PCM_PLUGINS="adpcm alaw asym copy dmix dshare dsnoop empty extplug file hooks iec958 ioplug ladspa lfloat linear meter mulaw multi null plug rate route share shm softvol" APACHE2_MODULES="actions alias auth_basic authn_alias authn_anon authn_dbm authn_default authn_file authz_dbm authz_default authz_groupfile authz_host authz_owner authz_user autoindex cache dav dav_fs dav_lock deflate dir disk_cache env expires ext_filter file_cache filter headers include info log_config logio mem_cache mime mime_magic negotiation rewrite setenvif speling status unique_id userdir usertrack vhost_alias" ELIBC="glibc" INPUT_DEVICES="keyboard mouse" KERNEL="linux" LINGUAS="en en_US" USERLAND="GNU" VIDEO_CARDS="nv nvidia" USER="fmccor" USERLAND="GNU" USE_EXPAND="ALSA_CARDS ALSA_PCM_PLUGINS APACHE2_MODULES APACHE2_MPMS CAMERAS CROSSCOMPILE_OPTS DVB_CARDS ELIBC FCDSL_CARDS FOO2ZJS_DEVICES FRITZCAPI_CARDS INPUT_DEVICES KERNEL LCD_DEVICES LINGUAS LIRC_DEVICES MISDN_CARDS USERLAND VIDEO_CARDS" USE_EXPAND_HIDDEN="CROSSCOMPILE_OPTS ELIBC KERNEL USERLAND" USE_ORDER="env:pkg:conf:defaults:pkginternal:env.d" VIDEO_CARDS="nv nvidia" VMHANDLE="blackdown-jdk-1.4.2" WANT_MP="true" WINDOWMANAGER="/usr/bin/fvwm" XDG_DATA_DIRS="/usr/share:/usr/kde/3.5/share:/usr/local/share" XERCESC_NLS_HOME="/usr/share/xerces-c/msg" XGUILOADPATH="/home1/ferris/Packages/SNNS/SNNSv4.2" _="/usr/bin/emerge" ====================================================
Second attempt on the second amd64 (with MAKEOPTS='-j2') was also successful. As mentioned before, with this build, everything was in ccache (except for the source file which did not compile the first time through). I have no further information on this problem, but I think my description is pretty clear.
Such things are exactly the reason why we still don't enable multi-process builds by default (and do not support it) ;) These just get broken too frequently. Basically whoever enables "WANT_MP=true" is on his own... btw: I would bet the reason why it works the second time is indeed ccache, I've seen this happen myself a few times.
(In reply to comment #2) > Such things are exactly the reason why we still don't enable multi-process > builds by default (and do not support it) ;) These just get broken too > frequently. Basically whoever enables "WANT_MP=true" is on his own... > > btw: I would bet the reason why it works the second time is indeed ccache, I've > seen this happen myself a few times. > A failing build with MAKEOPTS='-j5' followed by a successful build is still faster than using -j1. :) And sometimes it works, besides.
(In reply to comment #3) > A failing build with MAKEOPTS='-j5' followed by a successful build is still > faster than using -j1. :) And sometimes it works, besides. I know that it works sometimes but that's not good enough to support it obviously ;) So the thing is: If you build with multiple processes, and the build breaks because of this, you are on your own ;)
