During emerge -e system, after portage built binutils the portage build only one package at a time by ignoring --jobs=n. The strange thing is that it's happening ONLY during emerge -e --jobs=3 --load-average=4 system, during world build everything goes smoothly. Portage 2.2_rc33 (hardened/linux/x86/2008.0, gcc-4.4.1, glibc-2.10.1-r0, 2.6.30-reiser4-r3-costel x86_64) ================================================================= System uname: Linux-2.6.30-reiser4-r3-costel-x86_64-Intel-R-_Core-TM-2_Duo_CPU_E8400_@_3.00GHz-with-gentoo-2.0.1 Timestamp of tree: Sat, 25 Jul 2009 06:00:01 +0000 app-shells/bash: 4.0_p24 dev-lang/python: 2.6.2-r1 sys-apps/baselayout: 2.0.1 sys-apps/openrc: 0.4.3-r3 sys-apps/sandbox: 2.0 sys-devel/autoconf: 2.13, 2.63-r1 sys-devel/automake: 1.5, 1.7.9-r1, 1.8.5-r3, 1.9.6-r2, 1.10.2, 1.11 sys-devel/binutils: 2.19.51.0.14 sys-devel/gcc-config: 1.4.1 sys-devel/libtool: 2.2.6a virtual/os-headers: 2.6.30 ACCEPT_KEYWORDS="amd64 x86 ~amd64 ~x86" CBUILD="i686-pc-linux-gnu" CFLAGS="-O2 -pipe -fforce-addr -march=native -mtune=native -ftree-vectorize -ftracer -combine -floop-interchange -floop-strip-mine -floop-block -floop-strip-mine" CHOST="i686-pc-linux-gnu" CONFIG_PROTECT="/etc /usr/lib/fax /var/bind /var/spool/fax/etc" CONFIG_PROTECT_MASK="/etc/ca-certificates.conf /etc/env.d /etc/eselect/postgresql /etc/fonts/fonts.conf /etc/gconf /etc/gentoo-release /etc/php/apache2-php5/ext-active/ /etc/php/cgi-php5/ext-active/ /etc/php/cli-php5/ext-active/ /etc/revdep-rebuild /etc/sandbox.d /etc/terminfo /etc/udev/rules.d" CXXFLAGS="-O2 -pipe -fforce-addr -march=native -mtune=native -ftree-vectorize -ftracer -combine -floop-interchange -floop-strip-mine -floop-block -floop-strip-mine" DISTDIR="/usr/portage/distfiles" FEATURES="assume-digests candy distlocks fixpackages lmirror nodoc preserve-libs sfperms strict suidctl unmerge-orphans userfetch userpriv" GENTOO_MIRRORS="http://localhost http://www.ibiblio.org/pub/Linux/distributions/gentoo http://open-systems.ufl.edu/mirrors/gentoo http://gentoo.llarian.net http://distfiles.gentoo.org http://distro.ibiblio.org/pub/linux/distributions/gentoo" LANG="ro_RO.UTF-8" LC_ALL="ro_RO.UTF-8" LDFLAGS="-Wl,-O1 -Wl,--sort-common -Wl,--warn-once,--hash-style=gnu" LINGUAS="ro en en_GB" MAKEOPTS="-j2 --load-average=4" PKGDIR="/usr/portage/packages" PORTAGE_CONFIGROOT="/" PORTAGE_RSYNC_EXTRA_OPTS="--progress --delete-before --human-readable" PORTAGE_RSYNC_OPTS="--recursive --links --safe-links --perms --times --compress --force --whole-file --delete --stats --timeout=180 --exclude=/distfiles --exclude=/local --exclude=/packages" PORTAGE_TMPDIR="/var/tmp" PORTDIR="/usr/portage" PORTDIR_OVERLAY="/usr/portage/local/added /usr/portage/local/toolchain /usr/portage/local/perl-experimental /usr/portage/local/x11 /usr/portage/local/toolchain2" SYNC="rsync://127.0.0.1/gentoo-portage" USE="acl alsa amavis animgif apache2 audit authdaemond ban bgpclassless big-tables bindist bzip2 cairo caps cgi charconv chroot clamav cleartype cli courier cracklib crypt ctype cups curl curlwrappers custom-cflags daemon dba dbi device-mapper dhcp directfb discard-path diskio dlloader dovecot-sasl dri dynamicplugin elf encode erandom exif expat extras fam fastcgi fbcon flash flexresp flexresp2 fontconfig fontforge force-cgi-redirect gcrypt gd gdbm geoip geoipupdate gif glitz gmp gnutls gpm graphviz gre hal hardened hardenedphp hpn icap-client iconv idea idn imagemagick imap inline iproute2 ipv6 isdnlog ithreads jbig jpeg jpeg2k kerberos l7filter ldap libssh2 libwww lighttpd lm_sensors logrotate lua lzma maildir mailwrapper managesieve mbox memcache memlimit mgetty midi milter mktemp mmx mode-paranoid mudflap multipath mysql mysqli nagios-dns nagios-game nagios-ntp nagios-ping nagios-ssh nat ncurses nls notlsbeforeauth nptl nptlonly opengl openmp ospfapi pam pam_chroot pango pcre pear perl perlsuid pg-intdatetime php pic png pop3d posix postgres pppd prelude pwdb python qmail radius razor react readline realms reflection resolvconf rewrite rrdtool ruby samba sasl session sftplogging sguil sha512 shaper sharedext sieve sitemisc slang smi snmp snortsam sockets socks5 softquota spamassassin spell spl sql sse sse2 ssl subversion svg swat swig sxasl symlink sysfs sysvipc targrey tc tcl tcp-zebra tcpd tcpwrapper threads tiff timestats tk tokenizer tools trace truetype truetype-fonts underscores unicode ups urandom usb userlocales utils valias vchroot vda vhosts virtual-users webdav webdav-serf withsamplescripts wmf x86 xattr xml xml2 zlib" ALSA_CARDS="hda-intel" ALSA_PCM_PLUGINS="adpcm alaw asym copy dmix dshare dsnoop empty extplug file hooks iec958 ioplug ladspa lfloat linear meter mmap_emul mulaw multi null plug rate route share shm softvol" APACHE2_MODULES="authn_alias cern_meta charset_lite dumpio log_forensic proxy_ftp version actions alias auth_basic auth_digest authn_anon authn_dbd authn_dbm authn_default authn_file authz_dbm authz_default authz_groupfile authz_host authz_owner authz_user autoindex cache dav dav_fs dav_lock dbd deflate dir disk_cache env expires ext_filter file_cache filter headers ident imagemap include info log_config logio mem_cache mime mime_magic negotiation proxy proxy_ajp proxy_balancer proxy_connect proxy_http rewrite setenvif so speling status unique_id userdir usertrack vhost_alias" APACHE2_MPMS="worker" ELIBC="glibc" INPUT_DEVICES="keyboard mouse" KERNEL="linux" LCD_DEVICES="bayrad cfontz cfontz633 glk hd44780 lb216 lcdm001 mtxorb ncurses text" LINGUAS="ro en en_GB" LIRC_DEVICES="hauppauge" USERLAND="GNU" VIDEO_CARDS="nv v4l vesa nvidia" Unset: CPPFLAGS, CTARGET, EMERGE_DEFAULT_OPTS, FFLAGS, INSTALL_MASK, PORTAGE_COMPRESS, PORTAGE_COMPRESS_FLAGS
What is the list of packages that were emerged after binutils? Maybe there were too many interdependencies among that particular set of packages, and it was not able to parallelize well.
Created attachment 199277 [details] log of emerge --jobs=3 --load-average=4 --keep-going -e system
Created attachment 199279 [details] emerge --info for my desktop system
I'm unable to do another emerge system for my test server because it's busy for next days. But the error it's also reproductible on my desktop system, also, somehow, a test system. I attached emerge --info and log of emerge system for it. In desktop case lot of dependencies are plausible due to a long list of use flag. However there are ~400 packages built one at a time. Please ask for any supplementary info, if required.
Ok, time to turn this over to portage team. They may request more info, but I can't think of anything else for now. BTW removing you from cc list -- as reporter of bug, you'll get emails without being on cc.
As said in comment #1, the behavior you observe is probably due to interdependencies. It's possible that we could add an option to make it more aggressive, so that packages are built before their dependencies when possible. Also note that bug 256616 and bug 259954 also place limits on parallelization. This is mentioned in the faq: http://www.gentoo.org/proj/en/portage/doc/faq.xml
You are probably right. It's a little uncomfortable, but I can live with it. I suggest to close the bug if nobody observe this behavior during a week, this report proved to be an isolated case. Thank you.
I've filed bug 279623 for the aggressive --jobs parallelization idea mentioned in comment #6. *** This bug has been marked as a duplicate of bug 279623 ***
