Gentoo Websites Logo
Go to: Gentoo Home Documentation Forums Lists Bugs Planet Store Wiki Get Gentoo!
Bug 249033 - media-gfx/enblend-3.2 - compiler eats over 3GB memory and loops (20-40% CPU) forever when -j3
Summary: media-gfx/enblend-3.2 - compiler eats over 3GB memory and loops (20-40% CPU) ...
Status: RESOLVED FIXED
Alias: None
Product: Gentoo Linux
Classification: Unclassified
Component: New packages (show other bugs)
Hardware: AMD64 Linux
: High normal (vote)
Assignee: Gentoo Graphics Project
URL:
Whiteboard:
Keywords:
Depends on:
Blocks:
 
Reported: 2008-11-26 22:48 UTC by Maciej Józiewicz
Modified: 2008-11-28 18:42 UTC (History)
0 users

See Also:
Package list:
Runtime testing required: ---


Attachments
failed emerge output (failed emerge output.txt,22.61 KB, text/plain)
2008-11-26 22:49 UTC, Maciej Józiewicz
Details

Note You need to log in before you can comment on or make changes to this bug.
Description Maciej Józiewicz 2008-11-26 22:48:10 UTC
I tried several times. I left for over 2 hours (T2370 1.73GHz 1MB cache) and CPU load (measured with top) for each (of two) thread oscilated around 20% - 40%. The RAM consumption didn't really keep growing. I ate around 1.7GB ram and 1.6GB swap. With MAKEOPTS="-j1" it compiled quickly without a problem.

The machine was "usable" during this time - it didn't lock or become unstable in any way.

I'll attach the whole output.

Reproducible: Always

Steps to Reproduce:
1. set -j3
2. try to emerge enblend
Actual Results:  
Freezes.

Expected Results:  
Should finish.

Portage 2.1.6_rc1 (default/linux/amd64/2008.0/desktop, gcc-4.1.2, glibc-2.6.1-r0, 2.6.28-rc6 x86_64)
=================================================================
System uname: Linux-2.6.28-rc6-x86_64-Intel-R-_Pentium-R-_Dual_CPU_T2370_@_1.73GHz-with-glibc2.2.5
Timestamp of tree: Tue, 25 Nov 2008 21:45:01 +0000
app-shells/bash:     3.2_p33
dev-java/java-config: 1.3.7, 2.1.6
dev-lang/python:     2.5.2-r7
dev-util/cmake:      2.4.7-r1
sys-apps/baselayout: 1.12.11.1
sys-apps/sandbox:    1.2.18.1-r2
sys-devel/autoconf:  2.13, 2.61-r2
sys-devel/automake:  1.5, 1.7.9-r1, 1.8.5-r3, 1.9.6-r2, 1.10.1-r1
sys-devel/binutils:  2.18-r3
sys-devel/gcc-config: 1.4.0-r4
sys-devel/libtool:   1.5.26
virtual/os-headers:  2.6.23-r3
ACCEPT_KEYWORDS="amd64"
CBUILD="x86_64-pc-linux-gnu"
CFLAGS="-march=nocona -O2 -pipe"
CHOST="x86_64-pc-linux-gnu"
CONFIG_PROTECT="/etc /usr/kde/3.5/env /usr/kde/3.5/share/config /usr/kde/3.5/shutdown /usr/share/config /var/lib/hsqldb"
CONFIG_PROTECT_MASK="/etc/ca-certificates.conf /etc/env.d /etc/env.d/java/ /etc/fonts/fonts.conf /etc/gconf /etc/revdep-rebuild /etc/splash /etc/terminfo /etc/texmf/web2c /etc/udev/rules.d"
CXXFLAGS="-march=nocona -O2 -pipe"
DISTDIR="/usr/portage/distfiles"
EMERGE_DEFAULT_OPTS="--with-bdeps=y"
FEATURES="distlocks parallel-fetch protect-owned sandbox sfperms strict unmerge-orphans userfetch"
GENTOO_MIRRORS="http://ftp.vectranet.pl/gentoo/ ftp://ftp.vectranet.pl/gentoo/ http://gentoo.prz.rzeszow.pl http://gentoo.zie.pg.gda.pl http://gentoo.po.opole.pl ftp://gentoo.po.opole.pl ftp://mirror.icis.pcz.pl/gentoo/ http://gentoo.mirror.pw.edu.pl/ "
LANG="pl_PL.utf8"
LC_ALL="pl_PL.utf8"
LDFLAGS="-Wl,-O1"
LINGUAS="pl en"
MAKEOPTS="-j3"
PKGDIR="/usr/portage/packages"
PORTAGE_RSYNC_OPTS="--recursive --links --safe-links --perms --times --compress --force --whole-file --delete --stats --timeout=180 --exclude=/distfiles --exclude=/local --exclude=/packages"
PORTAGE_TMPDIR="/var/tmp"
PORTDIR="/usr/portage"
PORTDIR_OVERLAY="/usr/portage/local/layman/wschlich-testing /usr/portage/local/layman/x11 /usr/portage/local/layman/synce"
SYNC="rsync://rsync.europe.gentoo.org/gentoo-portage"
USE="X a52 aac aalib acl acpi alsa amd64 apm avahi bash-completion berkdb bluetooth branding bzip2 cairo caps cddb cdr cli cracklib crypt css cups curl cxx dbus dedicated dga djvu doc dri dts dvd dvdr dvdread eds emboss encode esd evo exif fbcon ffmpeg flac fltk fortran ftp gd gdbm gif gimp glut gnome gnome-keyring gnutls gphoto2 gpm gstreamer gtk gtkhtml guile hal hddtemp iconv idn ieee1394 imagemagick imlib ipv6 java javascript jbig joystick jpeg jpeg2k kerberos lame latex lcms ldap libcaca libgda libnotify lm_sensors lzo mad matroska midi mikmod mime mmx mng mono mp3 mpeg mplayer mudflap multilib musepack ncurses networkmanager nls nptl nptlonly nsplugin offensive ogg openal openexr opengl openmp pam pcmcia pcre pda pdf perl png portaudio ppds python qt3 qt3support qt4 quicktime rdesktop readline reflection samba scanner sdl session slang speex spell sse sse2 ssl startup-notification svg sysfs tcpd theora threads tiff tk truetype unicode usb vcd videos vim-syntax vorbis wavpack wifi wma wmf x264 xattr xcb xine xinerama xml xorg xosd xpm xulrunner xv xvid zlib" ALSA_CARDS="hda-intel" ALSA_PCM_PLUGINS="adpcm alaw asym copy dmix dshare dsnoop empty extplug file hooks iec958 ioplug ladspa lfloat linear meter mmap_emul mulaw multi null plug rate route share shm softvol" APACHE2_MODULES="actions alias auth_basic authn_alias authn_anon authn_dbm authn_default authn_file authz_dbm authz_default authz_groupfile authz_host authz_owner authz_user autoindex cache dav dav_fs dav_lock deflate dir disk_cache env expires ext_filter file_cache filter headers include info log_config logio mem_cache mime mime_magic negotiation rewrite setenvif speling status unique_id userdir usertrack vhost_alias" ELIBC="glibc" INPUT_DEVICES="evdev synaptics" KERNEL="linux" LCD_DEVICES="bayrad cfontz cfontz633 glk hd44780 lb216 lcdm001 mtxorb ncurses text" LINGUAS="pl en" USERLAND="GNU" VIDEO_CARDS="intel"
Unset:  CPPFLAGS, CTARGET, FFLAGS, INSTALL_MASK, PORTAGE_COMPRESS, PORTAGE_COMPRESS_FLAGS, PORTAGE_RSYNC_EXTRA_OPTS
Comment 1 Maciej Józiewicz 2008-11-26 22:49:55 UTC
Created attachment 173539 [details]
failed emerge output
Comment 2 Jeroen Roovers (RETIRED) gentoo-dev 2008-11-27 16:49:17 UTC
Does it behave properly when MAKEOPTS=-j1?
Comment 3 Markus Meier gentoo-dev 2008-11-27 18:00:05 UTC
(In reply to comment #2)
> Does it behave properly when MAKEOPTS=-j1?
> 

sure it does. It has a warning that it uses a lot of memory - maybe I should warn/error if -j is higher than 2 or so...
Comment 4 Maciej Józiewicz 2008-11-27 21:09:02 UTC
The ram actually wasn't the problem here - I had over 1GB swap left. So there clearly is a problem with -j3 (probably anything but 1).

I never wrote an ebuild, so this may be dumb, but isn't it possible to make it compile with -j1 no matter what the user has in make.conf?
Comment 5 Markus Meier gentoo-dev 2008-11-28 18:42:27 UTC
  28 Nov 2008; Markus Meier <maekke@gentoo.org> enblend-3.2.ebuild:
  force -j1 as this package needs about 1 GB RAM for every parallel compile
  instance, bug #249033