Gentoo Websites Logo
Go to: Gentoo Home Documentation Forums Lists Bugs Planet Store Wiki Get Gentoo!

Bug 456798

Summary: www-client/firefox and mail-client/thunderbird 17 - parallel build issues
Product: Gentoo Linux Reporter: Joe Breuer <gentoo>
Component: Current packagesAssignee: Mozilla Gentoo Team <mozilla>
Status: RESOLVED FIXED    
Severity: normal CC: rossi.f
Priority: Normal    
Version: unspecified   
Hardware: All   
OS: Linux   
Whiteboard:
Package list:
Runtime testing required: ---
Attachments: mail-client:thunderbird-24.1.0-r2:20131116-164531.log.gz
mail-client\:thunderbird-24.1.0-r2\:20131116-164531.log.gz
emerge-info.txt.gz

Description Joe Breuer 2013-02-11 16:28:35 UTC
Current www-client/firefox-17.0.2 and mail-client/thunderbird-17.0.2 both appear to have problems with parallel builds.

I've seen this on multiple machines; and retrying with progressively lower '--jobs' or just retrying will resolve the issue eventually.


All following data is from one of the afflicted machines, and can be taken as an example for all others.

The common pattern revolves around header generation from IDLs.


Here is a failing build log execerpt for thunderbird:

/var/tmp/portage/mail-client/thunderbird-17.0.2/work/comm-esr17/tbird/mozilla/_virtualenv/bin/python /var
/tmp/portage/mail-client/thunderbird-17.0.2/work/comm-esr17/mozilla/config/pythonpath.py \
  -I/var/tmp/portage/mail-client/thunderbird-17.0.2/work/comm-esr17/mozilla/other-licenses/ply \
  /var/tmp/portage/mail-client/thunderbird-17.0.2/work/comm-esr17/tbird/mozilla/dist/sdk/bin/header.py -I
/var/tmp/portage/mail-client/thunderbird-17.0.2/work/comm-esr17/mozilla/dom/interfaces/html -I../../../di
st/idl -I/var/tmp/portage/mail-client/thunderbird-17.0.2/work/comm-esr17/mozilla/dom/interfaces/base -I/v
ar/tmp/portage/mail-client/thunderbird-17.0.2/work/comm-esr17/mozilla/dom/interfaces/core  /var/tmp/porta
ge/mail-client/thunderbird-17.0.2/work/comm-esr17/mozilla/dom/interfaces/html/nsIDOMHTMLButtonElement.idl
 -d .deps/nsIDOMHTMLButtonElement.h.pp -o _xpidlgen/nsIDOMHTMLButtonElement.h
nsIDOMHTMLCommandElement.idl
Traceback (most recent call last):
  File "/var/tmp/portage/mail-client/thunderbird-17.0.2/work/comm-esr17/mozilla/config/pythonpath.py", li
ne 56, in <module>
    main(sys.argv[1:])
  File "/var/tmp/portage/mail-client/thunderbird-17.0.2/work/comm-esr17/mozilla/config/pythonpath.py", li
ne 48, in main
    execfile(script, frozenglobals)
  File "/var/tmp/portage/mail-client/thunderbird-17.0.2/work/comm-esr17/tbird/mozilla/dist/sdk/bin/header
.py", line 513, in <module>
    idl.resolve(options.incdirs, p)
  File "/var/tmp/portage/mail-client/thunderbird-17.0.2/work/comm-esr17/tbird/mozilla/dist/sdk/bin/xpidl.
py", line 287, in resolve
    p.resolve(self)
  File "/var/tmp/portage/mail-client/thunderbird-17.0.2/work/comm-esr17/tbird/mozilla/dist/sdk/bin/xpidl.
py", line 251, in resolve
    self.IDL.resolve(parent.incdirs, parent.parser)
  File "/var/tmp/portage/mail-client/thunderbird-17.0.2/work/comm-esr17/tbird/mozilla/dist/sdk/bin/xpidl.
py", line 287, in resolve
    p.resolve(self)
  File "/var/tmp/portage/mail-client/thunderbird-17.0.2/work/comm-esr17/tbird/mozilla/dist/sdk/bin/xpidl.
py", line 253, in resolve
    parent.setName(type)
  File "/var/tmp/portage/mail-client/thunderbird-17.0.2/work/comm-esr17/tbird/mozilla/dist/sdk/bin/xpidl.
py", line 265, in setName
    self.namemap.set(object)
  File "/var/tmp/portage/mail-client/thunderbird-17.0.2/work/comm-esr17/tbird/mozilla/dist/sdk/bin/xpidl.
py", line 211, in set
    raise IDLError("name '%s' specified twice. Previous location: %s" % (object.name, self._d[object.name
].location), object.location)
xpidl.IDLError: error: name 'nsIDOMNode' specified twice. Previous location: /var/tmp/portage/mail-client
/thunderbird-17.0.2/work/comm-esr17/mozilla/dom/interfaces/core/nsIDOMNode.idl line 21:0
interface nsIDOMNode : nsISupports
^, ../../../dist/idl/nsIDOMNode.idl line 21:0
interface nsIDOMNode : nsISupports
^
make[6]: *** [_xpidlgen/nsIDOMXULButtonElement.h] Error 1


# emerge --info
Portage 2.1.11.50 (default/linux/amd64/13.0/desktop/kde, gcc-4.6.3, glibc-2.15-r3, 3.6.11-gentoo x86_64)
=================================================================
System uname: Linux-3.6.11-gentoo-x86_64-Intel-R-_Core-TM-2_Duo_CPU_E8600_@_3.33GHz-with-gentoo-2.1
KiB Mem:     8187736 total,   3740812 free
KiB Swap:    2096444 total,   1991636 free
Timestamp of tree: Mon, 11 Feb 2013 08:15:01 +0000
ld GNU ld (GNU Binutils) 2.22
distcc 3.1 x86_64-pc-linux-gnu [enabled]
app-shells/bash:          4.2_p37
dev-java/java-config:     2.1.12-r1
dev-lang/python:          2.7.3-r2, 3.2.3
dev-util/cmake:           2.8.9
dev-util/pkgconfig:       0.28
sys-apps/baselayout:      2.1-r1
sys-apps/openrc:          0.11.8
sys-apps/sandbox:         2.5
sys-devel/autoconf:       2.13, 2.69
sys-devel/automake:       1.9.6-r3, 1.10.3, 1.11.6
sys-devel/binutils:       2.22-r1
sys-devel/gcc:            4.5.4, 4.6.3
sys-devel/gcc-config:     1.7.3
sys-devel/libtool:        2.4-r1
sys-devel/make:           3.82-r4
sys-kernel/linux-headers: 3.6 (virtual/os-headers)
sys-libs/glibc:           2.15-r3
Repositories: gentoo LOCAL jmbreuer voip
ACCEPT_KEYWORDS="amd64"
ACCEPT_LICENSE="* -@EULA"
CBUILD="x86_64-pc-linux-gnu"
CFLAGS="-march=core2 -mtune=core2 -O2 -pipe -momit-leaf-frame-pointer"
CHOST="x86_64-pc-linux-gnu"
CONFIG_PROTECT="/etc /usr/share/config /usr/share/gnupg/qualified.txt /var/bind /var/spool/munin-async/.ssh /var/yp/Makefile"
CONFIG_PROTECT_MASK="${EPREFIX}/etc/gconf /etc/ca-certificates.conf /etc/env.d /etc/fonts/fonts.conf /etc/gconf /etc/gentoo-release /etc/php/apache2-php5.3/ext-active/ /etc/php/cgi-php5.3/ext-active/ /etc/php/cli-php5.3/ext-active/ /etc/revdep-rebuild /etc/sandbox.d /etc/terminfo /etc/texmf/language.dat.d /etc/texmf/language.def.d /etc/texmf/updmap.d /etc/texmf/web2c /usr/share/X11/xkb"
CXXFLAGS="-march=core2 -mtune=core2 -O2 -pipe -momit-leaf-frame-pointer"
DISTDIR="/export/portage/distfiles"
EMERGE_DEFAULT_OPTS="--with-bdeps y --jobs=16 --load-average=4"
FCFLAGS="-O2 -pipe"
FEATURES="assume-digests binpkg-logs buildpkg collision-protect config-protect-if-modified distcc distlocks ebuild-locks fixlafiles merge-sync news parallel-fetch protect-owned sandbox sfperms strict unknown-features-warn unmerge-logs unmerge-orphans userfetch userpriv usersandbox"
FFLAGS="-O2 -pipe"
GENTOO_MIRRORS="http://de-mirror.org/distro/gentoo/ http://gentoo.mneisen.org/ http://gentoo.wheel.sk/ http://gentoo.mirror.pw.edu.pl/"
LANG="en_US.UTF-8"
LDFLAGS="-Wl,-O1 -Wl,--as-needed"
MAKEOPTS="--jobs=24 --load-average=6"
PKGDIR="/export/portage/packages/x64cd"
PORTAGE_CONFIGROOT="/"
PORTAGE_RSYNC_OPTS="--recursive --links --safe-links --perms --times --compress --force --whole-file --delete --stats --human-readable --timeout=180 --exclude=/distfiles --exclude=/local --exclude=/packages"
PORTAGE_TMPDIR="/var/tmp"
PORTDIR="/usr/portage"
PORTDIR_OVERLAY="/usr/local/portage /var/lib/layman/jmbreuer /var/lib/layman/voip"
SYNC="rsync://rsync.europe.gentoo.org/gentoo-portage"
USE="X Xaw3d a52 aac acl acpi alsa amd64 apache2 berkdb bluetooth branding bzip2 cairo cdda cdr chardet cjk cli consolekit cracklib crypt css cups curl cxx dbus declarative dga dri dts dvb dvd dvdr emacs embedded emboss encode exif fam fame fastcgi ffmpeg firefox flac flash fluidsynth foomaticdb fortran gd gdbm gif gimp glitz glut gnutls gphoto2 gpm gtk gtkhtml iconv imap imlib innodb iphone ipod ipv6 java jce jpeg kde kerberos kipi kpathsea lame lcms ldap leim libgda libnotify libsamplerate lm_sensors lzo mad mailwrapper mbox mikmod mjpeg mmx mmxext mng modplug modules mono mp3 mp4 mpeg mtp mudflap mule multilib ncurses network network-cron nis nls nptl nsplugin nvidia ocamlopt offensive ogg opengl openmp pam pango pcap pch pcre pda pdf phonon plasma plotutils png policykit ppds qt3support qt4 razor rdesktop readline rtc samba sasl sdl semantic-desktop session shout slang slp sndfile sockets sound sox spamassassin spell sqlite sse sse2 ssl startup-notification suhosin svg tcpd threads threadsafe tiff truetype udev udisks unicode upower usb vdpau vhosts vim-syntax vorbis webdav wma wmf wxwidgets x264 xanim xcb xcomposite xfs xinetd xiph xml xscreensaver xv xvid xvmc zlib" ABI_X86="64" ALSA_CARDS="ali5451 als4000 atiixp atiixp-modem bt87x ca0106 cmipci emu10k1x ens1370 ens1371 es1938 es1968 fm801 hda-intel intel8x0 intel8x0m maestro3 trident usb-audio via82xx via82xx-modem ymfpci" ALSA_PCM_PLUGINS="adpcm alaw asym copy dmix dshare dsnoop empty extplug file hooks iec958 ioplug ladspa lfloat linear meter mmap_emul mulaw multi null plug rate route share shm softvol" APACHE2_MODULES="actions alias auth_basic auth_digest authn_anon authn_dbd authn_dbm authn_default authn_file authz_dbm authz_default authz_groupfile authz_host authz_owner authz_user autoindex cache cgi dav dav_fs dav_lock dbd deflate dir disk_cache env expires ext_filter file_cache filter headers ident imagemap include info log_config logio mem_cache mime mime_magic negotiation proxy proxy_ajp proxy_balancer proxy_connect proxy_http rewrite setenvif so speling status unique_id userdir usertrack vhost_alias" CALLIGRA_FEATURES="kexi words flow plan sheets stage tables krita karbon braindump" CAMERAS="ptp2" COLLECTD_PLUGINS="df interface irq load memory rrdtool swap syslog" ELIBC="glibc" GPSD_PROTOCOLS="ashtech aivdm earthmate evermore fv18 garmin garmintxt gpsclock itrax mtk3301 nmea ntrip navcom oceanserver oldstyle oncore rtcm104v2 rtcm104v3 sirf superstar2 timing tsip tripmate tnt ubx" INPUT_DEVICES="keyboard mouse evdev wacom" KERNEL="linux" LCD_DEVICES="bayrad cfontz cfontz633 glk hd44780 lb216 lcdm001 mtxorb ncurses text" LIBREOFFICE_EXTENSIONS="presenter-console presenter-minimizer" LINGUAS="en de" MISDN_CARDS="avmfritz" PHP_TARGETS="php5-3" PYTHON_SINGLE_TARGET="python2_7" PYTHON_TARGETS="python2_7 python3_2" RUBY_TARGETS="ruby18 ruby19" SANE_BACKENDS="net" USERLAND="GNU" VIDEO_CARDS="nvidia" XTABLES_ADDONS="quota2 psd pknock lscan length2 ipv4options ipset ipp2p iface geoip fuzzy condition tee tarpit sysrq steal rawnat logmark ipmark dhcpmac delude chaos account"
Unset:  CPPFLAGS, CTARGET, INSTALL_MASK, LC_ALL, PORTAGE_BUNZIP2_COMMAND, PORTAGE_COMPRESS, PORTAGE_COMPRESS_FLAGS, PORTAGE_RSYNC_EXTRA_OPTS, USE_PYTHON
Comment 1 Joe Breuer 2013-06-03 15:37:21 UTC
I'm still seeing the exact same thing with all versions I've installed up to currently www-client/firefox-17.0.6 and mail-client/thunderbird-17.0.6.
Comment 2 Jory A. Pratt gentoo-dev 2013-06-03 22:02:26 UTC
You have two options, you can either disable discc or set a different makeopts for mozilla products. Either way this is only way this will be resolved, I am not gonna force the ebuild to drop MAKEOPTS based on an unusuall amount of cores being used.
Comment 3 Fabio Rossi 2013-11-16 20:13:28 UTC
Found another parallel build problem, this time during enigmail extension compilation. I had to put MAKEOPTS=-j1 instead of -j8 to successfully compile the program (I don't use distcc).
Comment 4 Fabio Rossi 2013-11-16 20:14:30 UTC
Created attachment 363380 [details]
mail-client:thunderbird-24.1.0-r2:20131116-164531.log.gz

here is the log part with the failure
Comment 5 Jory A. Pratt gentoo-dev 2013-11-17 03:54:35 UTC
(In reply to Fabio Rossi from comment #4)
> Created attachment 363380 [details]
> mail-client:thunderbird-24.1.0-r2:20131116-164531.log.gz
> 
> here is the log part with the failure

Giving me a partial log does no good. We need to see how exactly you are trying to build it, what options are being passed ect.
Comment 6 Fabio Rossi 2013-11-18 21:00:19 UTC
Created attachment 363528 [details]
mail-client\:thunderbird-24.1.0-r2\:20131116-164531.log.gz

Here is the complete log.
Comment 7 Fabio Rossi 2013-11-18 21:01:44 UTC
Created attachment 363530 [details]
emerge-info.txt.gz

# emerge --info
Comment 8 Fabio Rossi 2013-11-25 13:34:41 UTC
(In reply to Jory A. Pratt from comment #5)

> Giving me a partial log does no good. We need to see how exactly you are
> trying to build it, what options are being passed ect.

Jory, I have created a patch which has been accepted upstream and it will be available with enigmail 1.6.1. You can find it at http://sourceforge.net/p/enigmail/bugs/214/
Comment 9 Jory A. Pratt gentoo-dev 2015-01-06 14:47:17 UTC
Was fixed some time ago, thanks for reporting.