Gentoo Websites Logo
Go to: Gentoo Home Documentation Forums Lists Bugs Planet Store Wiki Get Gentoo!

Bug 426444

Summary: app-editors/emacs-23.4-r3 fails to build in parallel (--jobs=64)
Product: Gentoo Linux Reporter: Joe Breuer <gentoo>
Component: Current packagesAssignee: Emacs project <emacs>
Severity: minor Keywords: NeedPatch
Priority: Normal    
Version: unspecified   
Hardware: All   
OS: Linux   
Package list:
Runtime testing required: ---
Attachments: build.log

Description Joe Breuer 2012-07-13 13:13:17 UTC
While updating my system, I stumbled over this issue:

When building emacs-23.4-r3 in parallel, a few of the lisp/<foo>.el files are not compiled to <foo>.elc before the .elc is required/used by another part of the build.

Reproducible: Sometimes

Steps to Reproduce:
[Happened in 3 out of 4 parallel build attempts.]

1. Have a parallel build configuration (see my emerge --info below)
2. emerge -bavt app-editors/emacs

Actual Results:  
The build fails.

At first I observed this problem on mwheel.el -> mwheel.elc, now when I reproduced it after verifying that emacs-23.4-r3 does, in fact, build fine with MAKEOPTS="-j1", I get the same problem on tooltip.el -> tooltip.elc.

The missing .elc causes two seperate errors in the build log:

1. ../lib-src/make-docfile <list of .elc>
../lisp/<foo>.elc: No such file or directory

2. `/bin/pwd`/temacs -batch -l loadup dump
Loading <foo>.el (source)...
Attempt to autoload define-minor-mode while preparing to dump
make[1]: *** [emacs] Error 255

I'll attach the full log of one failing build.

Expected Results:  
The package should build correctly using parallel make.

Portage (default/linux/amd64/10.0/desktop/kde, gcc-4.5.3, glibc-2.14.1-r3, 3.3.8-gentoo x86_64)
System uname: Linux-3.3.8-gentoo-x86_64-Intel-R-_Core-TM-_i7_CPU_970_@_3.20GHz-with-gentoo-2.1
Timestamp of tree: Fri, 13 Jul 2012 11:45:01 +0000
distcc 3.1 x86_64-pc-linux-gnu [disabled]
ccache version 3.1.7 [disabled]
app-shells/bash:          4.2_p20
dev-java/java-config:     2.1.11-r3
dev-lang/python:          2.7.3-r2, 3.2.3
dev-util/ccache:          3.1.7
dev-util/cmake:           2.8.7-r5
dev-util/pkgconfig:       0.26
sys-apps/baselayout:      2.1-r1
sys-apps/sandbox:         2.5
sys-devel/autoconf:       2.13, 2.68
sys-devel/automake:       1.9.6-r3, 1.10.3, 1.11.1
sys-devel/binutils:       2.21.1-r1
sys-devel/gcc:            4.5.3-r2
sys-devel/gcc-config:     1.6
sys-devel/libtool:        2.4-r1
sys-devel/make:           3.82-r1
sys-kernel/linux-headers: 3.4-r1 (virtual/os-headers)
sys-libs/glibc:           2.14.1-r3
Repositories: gentoo LOCAL jmbreuer
CFLAGS="-march=core2 -mtune=core2 -maes -mcx16 -msahf -mpclmul -mpopcnt -msse4.2 -O2 -pipe -momit-leaf-frame-pointer"
CONFIG_PROTECT="/etc /usr/share/config /usr/share/gnupg/qualified.txt /var/lib/hsqldb"
CONFIG_PROTECT_MASK="/etc/ca-certificates.conf /etc/env.d /etc/env.d/java/ /etc/fonts/fonts.conf /etc/gconf /etc/gentoo-release /etc/revdep-rebuild /etc/sandbox.d /etc/terminfo /etc/texmf/language.dat.d /etc/texmf/language.def.d /etc/texmf/updmap.d /etc/texmf/web2c /usr/share/X11/xkb"
CXXFLAGS="-march=core2 -mtune=core2 -maes -mcx16 -msahf -mpclmul -mpopcnt -msse4.2 -O2 -pipe -momit-leaf-frame-pointer"
EMERGE_DEFAULT_OPTS="--with-bdeps y --jobs=64 --load-average=16"
FCFLAGS="-O2 -pipe"
FEATURES="assume-digests binpkg-logs buildpkg collision-protect config-protect-if-modified distlocks ebuild-locks fixlafiles news parallel-fetch parse-eapi-ebuild-head protect-owned sandbox sfperms strict unknown-features-warn unmerge-logs unmerge-orphans userfetch userpriv usersandbox"
FFLAGS="-O2 -pipe"
LDFLAGS="-Wl,-O1 -Wl,--as-needed"
LINGUAS="en de"
MAKEOPTS="--jobs=64 --load-average=18"
PORTAGE_RSYNC_OPTS="--recursive --links --safe-links --perms --times --compress --force --whole-file --delete --stats --human-readable --timeout=180 --exclude=/distfiles --exclude=/local --exclude=/packages"
PORTDIR_OVERLAY="/usr/local/portage /var/lib/layman/jmbreuer"
USE="X Xaw3d a52 aac acl acpi alsa amd64 berkdb bluetooth branding bzip2 cairo cdda cdr chardet cjk cli consolekit cracklib crypt css cups curl cxx dbus declarative dga dri dts dv dvd dvdr embedded emboss encode exif fam fame fastcgi ffmpeg firefox flac flash fluidsynth fontconfig foomaticdb fortran gcj gd gdbm gif gimp glitz glut gnutls gphoto2 gpm gstreamer gtk iconv icu ieee1394 imap imlib innodb iphone ipod ipv6 java jce jpeg kde kerberos kipi kpathsea lame lastfm lcms ldap leim libgda libnotify libsamplerate lm_sensors lzo mad mbox mikmod mjpeg mmx mmxext mng modplug modules mono mp3 mp4 mpeg mtp mudflap mule multilib ncurses network network-cron nis nls nptl nsplugin nspluginwrapper nvidia offensive ogg openexr opengl openmp pam pango pcap pcre pda pdf phonon plasma plotutils png policykit ppds pppd qt3support qt4 rdesktop readline rtc samba sasl scanner sdk sdl semantic-desktop session shout slang slp smp sndfile socks5 sound sox spell sqlite sse sse2 ssl ssse3 startup-notification subversion svg tcpd theora threads tiff tk truetype trusted udev udisks unicode upower usb vdpau vim-syntax vnc vorbis webdav wma wmf wxwidgets x264 xanim xcb xcomposite xiph xml xorg xscreensaver xv xvid xvmc zlib" ALSA_CARDS="ali5451 als4000 atiixp atiixp-modem bt87x ca0106 cmipci emu10k1x ens1370 ens1371 es1938 es1968 fm801 hda-intel intel8x0 intel8x0m maestro3 trident usb-audio via82xx via82xx-modem ymfpci" ALSA_PCM_PLUGINS="adpcm alaw asym copy dmix dshare dsnoop empty extplug file hooks iec958 ioplug ladspa lfloat linear meter mmap_emul mulaw multi null plug rate route share shm softvol" APACHE2_MODULES="actions alias auth_basic authn_alias authn_anon authn_dbm authn_default authn_file authz_dbm authz_default authz_groupfile authz_host authz_owner authz_user autoindex cache cgi cgid dav dav_fs dav_lock deflate dir disk_cache env expires ext_filter file_cache filter headers include info log_config logio mem_cache mime mime_magic negotiation rewrite setenvif speling status unique_id userdir usertrack vhost_alias" CALLIGRA_FEATURES="kexi words flow plan sheets stage tables krita karbon braindump" CAMERAS="ptp2" COLLECTD_PLUGINS="df interface irq load memory rrdtool swap syslog" ELIBC="glibc" GPSD_PROTOCOLS="ashtech aivdm earthmate evermore fv18 garmin garmintxt gpsclock itrax mtk3301 nmea ntrip navcom oceanserver oldstyle oncore rtcm104v2 rtcm104v3 sirf superstar2 timing tsip tripmate tnt ubx" INPUT_DEVICES="keyboard mouse wacom evdev" KERNEL="linux" LCD_DEVICES="bayrad cfontz cfontz633 glk hd44780 lb216 lcdm001 mtxorb ncurses text" LIBREOFFICE_EXTENSIONS="presenter-console presenter-minimizer" LINGUAS="en de" PHP_TARGETS="php5-3" PYTHON_TARGETS="python3_2 python2_7" RUBY_TARGETS="ruby18 ruby19" SANE_BACKENDS="net" USERLAND="GNU" VIDEO_CARDS="nvidia" XTABLES_ADDONS="quota2 psd pknock lscan length2 ipv4options ipset ipp2p iface geoip fuzzy condition tee tarpit sysrq steal rawnat logmark ipmark dhcpmac delude chaos account"
Comment 1 Joe Breuer 2012-07-13 13:14:28 UTC
Created attachment 318090 [details]
Comment 2 Ulrich Müller gentoo-dev 2012-07-18 15:26:44 UTC
I'm a bit reluctant to add the usual emake -j1 workaround to the ebuild, because a) this affects only a previous slot and b) there were never any problems reported with less aggressive parallelisation flags (-j16 is known to work).

However, I would gladly accept a patch that fixes the issue in Emacs' build system.
Comment 3 Ulrich Müller gentoo-dev 2013-05-23 19:18:39 UTC
Is this still an issue with Emacs 24.3?
Comment 4 Ulrich Müller gentoo-dev 2013-08-13 08:56:13 UTC
(In reply to Ulrich Müller from comment #3)
> Is this still an issue with Emacs 24.3?

No answer. Closing.
Comment 5 Joe Breuer 2013-08-15 07:34:57 UTC
Sorry for the delay - your question in May has slipped past me.

I've just rebuilt app-editors/emacs-24.3-r2 five times on the originally affected machine (otherwise idle, cache hot).

I can no longer reproduce the issue.

So let's assume it is gone; and if it still isn't by any chance this should be plenty of documentation that MAKEOPTS="-j1" is a viable workaround. ;-)