Gentoo Websites Logo
Go to: Gentoo Home Documentation Forums Lists Bugs Planet Store Wiki Get Gentoo!
Bug 258291 - sys-apps/groff-1.20.1-r1 fails to build with parallel make
Summary: sys-apps/groff-1.20.1-r1 fails to build with parallel make
Status: RESOLVED OBSOLETE
Alias: None
Product: Gentoo Linux
Classification: Unclassified
Component: Current packages (show other bugs)
Hardware: x86 Linux
: Normal normal with 2 votes (vote)
Assignee: Gentoo's Team for Core System packages
URL:
Whiteboard:
Keywords:
: 362859 (view as bug list)
Depends on:
Blocks:
 
Reported: 2009-02-09 04:21 UTC by Nick Soveiko
Modified: 2019-01-08 18:41 UTC (History)
8 users (show)

See Also:
Package list:
Runtime testing required: ---


Attachments
build log (sys-apps:groff-1.20.1-r1:20090209-041347.log,96.62 KB, text/plain)
2009-02-09 04:22 UTC, Nick Soveiko
Details
Another case of fail (sys-apps:groff-1.20.1-r1:20090903-081258.log,114.50 KB, text/plain)
2009-09-03 20:47 UTC, Peter Alfredsen (RETIRED)
Details
Build log (build.log,96.71 KB, text/plain)
2010-04-10 08:07 UTC, Rabbe Fogelholm
Details

Note You need to log in before you can comment on or make changes to this bug.
Description Nick Soveiko 2009-02-09 04:21:51 UTC
sys-apps/groff-1.20.1-r1 fails to emerge with errors:
Making groff_www.n from groff_www.man
/tmp/portage/sys-apps/groff-1.20.1-r1/work/groff-1.20.1/src/roff/groff/groff: can't find `DESC' file
/tmp/portage/sys-apps/groff-1.20.1-r1/work/groff-1.20.1/src/roff/groff/groff:fatal error: invalid device `html'
make[2]: *** [pic.html] Error 3
make[2]: *** Waiting for unfinished jobs....

Reproducible: Always

Steps to Reproduce:
1. emerge -avuDtN system
Actual Results:  
see attached build log


Portage 2.1.6.4 (default/linux/x86/2008.0/desktop, gcc-4.1.2, glibc-2.6.1-r0, 2.6.28-gentoo-r1-ns i686)
=================================================================
System uname: Linux-2.6.28-gentoo-r1-ns-i686-AMD_Phenom-tm-_9550_Quad-Core_Processor-with-glibc2.0
Timestamp of tree: Mon, 09 Feb 2009 02:45:02 +0000
ccache version 2.4 [enabled]
app-shells/bash:     3.2_p39
dev-java/java-config: 1.3.7-r1, 2.1.6-r1
dev-lang/python:     2.5.2-r7
dev-util/ccache:     2.4-r7
dev-util/cmake:      2.4.6-r1
sys-apps/baselayout: 1.12.11.1
sys-apps/sandbox:    1.2.18.1-r2
sys-devel/autoconf:  2.13, 2.63
sys-devel/automake:  1.4_p6, 1.5, 1.7.9-r1, 1.8.5-r3, 1.9.6-r2, 1.10.2
sys-devel/binutils:  2.18-r3
sys-devel/gcc-config: 1.4.0-r4
sys-devel/libtool:   1.5.26
virtual/os-headers:  2.6.27-r2
ACCEPT_KEYWORDS="x86"
CBUILD="i686-pc-linux-gnu"
CFLAGS="-O2 -march=k8 -pipe -fomit-frame-pointer"
CHOST="i686-pc-linux-gnu"
CONFIG_PROTECT="/etc /usr/kde/3.5/env /usr/kde/3.5/share/config /usr/kde/3.5/shutdown /usr/share/config"
CONFIG_PROTECT_MASK="/etc/ca-certificates.conf /etc/env.d /etc/env.d/java/ /etc/fonts/fonts.conf /etc/gconf /etc/php/apache2-php5/ext-active/ /etc/php/cgi-php5/ext-active/ /etc/php/cli-php5/ext-active/ /etc/revdep-rebuild /etc/terminfo /etc/texmf/web2c /etc/udev/rules.d /usr/share/X11/xkb"
CXXFLAGS="-O2 -march=k8 -pipe -fomit-frame-pointer"
DISTDIR="/var/lib/portage/distfiles"
EMERGE_DEFAULT_OPTS="--jobs 4 --load-average 8"
FEATURES="ccache collision-protect distlocks fixpackages parallel-fetch protect-owned sandbox sfperms strict unmerge-orphans userfetch userpriv usersandbox"
GENTOO_MIRRORS="http://www.mirrorservice.org/sites/www.ibiblio.org/gentoo/ http://mirror.bytemark.co.uk/gentoo/ http://ftp.udc.es/gentoo/"
LANG="en_CA.utf8"
LDFLAGS="-Wl,-O1"
LINGUAS="en"
MAKEOPTS="-j -l 8"
PKGDIR="/var/lib/portage/packages"
PORTAGE_RSYNC_OPTS="--recursive --links --safe-links --perms --times --compress --force --whole-file --delete --stats --timeout=180 --exclude=/distfiles --exclude=/local --exclude=/packages"
PORTAGE_TMPDIR="/var/tmp"
PORTDIR="/var/lib/portage/tree"
PORTDIR_OVERLAY="/var/lib/portage/local"
SYNC="rsync://rsync.namerica.gentoo.org/gentoo-portage"
USE="3dnow 3dnowext X a52 aac aalib acl acpi alsa amarok amr apache2 arts artswrappersuid asf audiofile bash-completion berkdb blas bluetooth branding bzip2 cairo caps cddb cdparanoia cdr cdrom chardet cli colordiff cracklib crypt css cups curl dbus device-mapper dga directfb divx divx4linux djvu dri dts dv dvb dvd dvdnav dvdr dvdread eds emboss emovix enca encode exif exiv2 fam fbcon ffmpeg fftw firefox flac foomaticdb fortran ftp gd gdbm geoip gif gimp gimpprint ginac glibc-compat20 glut gnokii gphoto2 gpm gs gstreamer gtk gtk2 hal iconv id3 id3tag idn ieee1394 imagemagick imap imlib isdnlog ivtv java javascript jfs jpeg jpeg2k kde kdeenablefinal kdehiddenvisibility kipi lapack lash latex lcms lesstif libcaca libedit libnotify libwww lm_sensors logrotate logwatch lzo mad math matroska mbox md5sum memlimit midi mikmod mime mjpeg mmap mmx mmxext mng mozilla mozsvg mp2 mp3 mp4 mpeg mpeg2 mplayer mpm-prefork mudflap musepack musicbrainz mysql na_dd na_icons nas ncurses network nls nocd npp nptl nsplugin nvidia offensive ofx ogg openal opengl openmp osc pam pch pcre pdf perl png pnm posix ppds pppd print python qt3 qt3support qt4 quicktime radio rar readline reflection reiserfs rle rrdcgi scanner sdl session sharedmem shorten slang sndfile sockets sox speex spell spl srt sse sse2 ssl startup-notification svg svga sysfs tcpd tetex theora threads threadsafe tiff truetype tv_check unicode usb v4l v4l2 vcd vdr vidix vim vim-pager vim-syntax vim-with-x visualization vorbis win32codecs wma wmf wmp wordperfect x264 x86 xanim xcomposite xine xml xorg xosd xprint xscreensaver xulrunner xv xvid xvmc zlib" ALSA_CARDS="ali5451 als4000 atiixp atiixp-modem bt87x ca0106 cmipci emu10k1 emu10k1x ens1370 ens1371 es1938 es1968 fm801 hda-intel intel8x0 intel8x0m maestro3 trident usb-audio via82xx via82xx-modem ymfpci" ALSA_PCM_PLUGINS="adpcm alaw asym copy dmix dshare dsnoop empty extplug file hooks iec958 ioplug ladspa lfloat linear meter mmap_emul mulaw multi null plug rate route share shm softvol" APACHE2_MODULES="actions alias auth_basic auth_digest authn_anon authn_dbd authn_dbm authn_default authn_file authz_dbm authz_default authz_groupfile authz_host authz_owner authz_user autoindex cache dav dav_fs dav_lock dbd deflate dir disk_cache env expires ext_filter file_cache filter headers ident imagemap include info log_config logio mem_cache mime mime_magic negotiation proxy proxy_ajp proxy_balancer proxy_connect proxy_http rewrite setenvif so speling status unique_id userdir usertrack vhost_alias" CAMERAS="canon" ELIBC="glibc" INPUT_DEVICES="keyboard mouse" KERNEL="linux" LCD_DEVICES="bayrad cfontz cfontz633 glk hd44780 lb216 lcdm001 mtxorb ncurses text" LINGUAS="en" USERLAND="GNU" VIDEO_CARDS="vesa radeon nvidia"
Unset:  CPPFLAGS, CTARGET, FFLAGS, INSTALL_MASK, LC_ALL, PORTAGE_COMPRESS, PORTAGE_COMPRESS_FLAGS, PORTAGE_RSYNC_EXTRA_OPTS
Comment 1 Nick Soveiko 2009-02-09 04:22:26 UTC
Created attachment 181410 [details]
build log
Comment 2 Nick Soveiko 2009-02-10 04:02:35 UTC
update: it appears that the problem is in parallel make.
MAKEOPTS="-j 1" emerge sys-apps/groff
does the trick. my default is MAKEOPTS="-j -l 8". i think that incompatible MAKEOPTS should be sanitized in the ebuild.
Comment 3 Boian Berberov 2009-03-17 18:55:51 UTC
What happens when you try with MAKEOPTS="-j -l 4" and lower values for -l ?
Comment 4 Nick Soveiko 2009-03-17 20:27:25 UTC
(In reply to comment #3)
> What happens when you try with MAKEOPTS="-j -l 4" and lower values for -l ?

with "-l 8" 2 out of 4 emerges failed (both at the same point). with "-l 4" 6 out of 6 went through.

hope this helps.
Comment 5 Boian Berberov 2009-03-17 21:01:48 UTC
A dev should confirm this, but I do not think -l should be greater than the number of processors on the system that is running the emerge.  This should not affect distcc.  According to your emerge --info, you have a 9550 which should be recognized as 4 processors.
Comment 6 Nick Soveiko 2009-03-17 21:33:41 UTC
the common wisdom is that -l should be greater than the number of processors (anywhere from n+1 to 2n), up to the point where there is 0 idle cpu time. load average by definition includes number of jobs waiting not only for the cpu, but for i/o as well. 

that's besides that there could be lower priority jobs that may or may not be contending (depending on the kernel scheduler) with emerge for the cpu, but they still count towards load average.
Comment 7 Nick Soveiko 2009-03-17 21:46:41 UTC
(In reply to comment #6)
> load
> average by definition includes number of jobs waiting not only for the cpu, but
> for i/o as well.

from Debian's uptime(1):

System load averages is the average number of processes that are either
in a runnable or uninterruptable state.  A process in a runnable  state
is  either  using the CPU or waiting to use the CPU. A process in unin-
terruptable state is waiting for some I/O access, eg waiting for  disk.

for some reason, this paragraph is not in the man page on gentoo.
Comment 8 Peter Alfredsen (RETIRED) gentoo-dev 2009-09-03 20:47:24 UTC
Created attachment 203079 [details]
Another case of fail

Another instance.
Comment 9 Rabbe Fogelholm 2010-04-10 08:07:40 UTC
Created attachment 227209 [details]
Build log

This problem also occurs while bootstrapping Gentoo Prefix (http://www.gentoo.org/proj/en/gentoo-alt/prefix/index.xml). I was running the bootstrapping steps on a dual core machine with MAKEOPTS=-j3 in etc/make.conf. Build log attached.
Comment 10 SpanKY gentoo-dev 2011-04-11 00:09:39 UTC
*** Bug 362859 has been marked as a duplicate of this bug. ***
Comment 11 Richard Yao (RETIRED) gentoo-dev 2012-03-09 20:52:32 UTC
Is anyone working on this?
Comment 12 Richard Yao (RETIRED) gentoo-dev 2012-03-09 21:00:45 UTC
Would someone suffering from this test the following upstream patch?

http://cvs.savannah.gnu.org/viewvc/groff/Makefile.in?root=groff&r1=1.118&r2=1.119&view=patch

It looks like it resolves this problem.
Comment 13 Thomas Deutschmann (RETIRED) gentoo-dev 2019-01-08 18:41:01 UTC
Closing as obsolete because version bug was filed against is no longer available in Gentoo repository. Please re-open if you are still able to reproduce against latest available version.