Bug 204194 – app-i18n/tomoe-0.6.0 compilation eats all memory and dies a horrible death :)

• Product: Gentoo Linux
• Status: RESOLVED TEST-REQUEST

[Description Evil Compile Person 2008-01-03 14:53:48 UTC]

during compilation ...

 x86_64-pc-linux-gnu-gcc -DHAVE_CONFIG_H -I. -I../.. -I../../bindings/ruby -I/usr/include/glib-2.0 -I/usr/lib64/glib-2.0/include -DCONFDIR=\"/etc/tomoe\" -DDATADIR=\"/usr/share/tomoe\" -DDICT_DATADIR=\"/usr/share/tomoe/dict\" -DRECOGNIZER_DATADIR=\"/usr/share/tomoe/recognizer\" -DDICT_MODULEDIR=\"/usr/lib64/tomoe/module/dict\" -DRECOGNIZER_MODULEDIR=\"/usr/lib64/tomoe/module/recognizer\" -I../../lib -DLINUX=2 -D_REENTRANT -D_GNU_SOURCE -pthread -I/usr/include/apr-1 -I/usr/include/subversion-1 -DG_LOG_DOMAIN=\"Tomoe/Dict:Unihan\" -DRUBY_EXTDIR=\"\" -DRUBY_LIBDIR=\"\" -O2 -march=k8 -pipe -ggdb -Wall -Wmissing-declarations -Wmissing-prototypes -Wpointer-arith -Wcast-align -MT unihan_la-tomoe-dict-unihan.lo -MD -MP -MF .deps/unihan_la-tomoe-dict-unihan.Tpo -c tomoe-dict-unihan.c  -fPIC -DPIC -o .libs/unihan_la-tomoe-dict-unihan.o
 x86_64-pc-linux-gnu-gcc -DHAVE_CONFIG_H -I. -I../.. -I../../bindings/ruby -I/usr/include/glib-2.0 -I/usr/lib64/glib-2.0/include -DCONFDIR=\"/etc/tomoe\" -DDATADIR=\"/usr/share/tomoe\" -DDICT_DATADIR=\"/usr/share/tomoe/dict\" -DRECOGNIZER_DATADIR=\"/usr/share/tomoe/recognizer\" -DDICT_MODULEDIR=\"/usr/lib64/tomoe/module/dict\" -DRECOGNIZER_MODULEDIR=\"/usr/lib64/tomoe/module/recognizer\" -I../../lib -DLINUX=2 -D_REENTRANT -D_GNU_SOURCE -pthread -I/usr/include/apr-1 -I/usr/include/subversion-1 -DG_LOG_DOMAIN=\"Tomoe/Dict:Unihan\" -DRUBY_EXTDIR=\"\" -DRUBY_LIBDIR=\"\" -O2 -march=k8 -pipe -ggdb -Wall -Wmissing-declarations -Wmissing-prototypes -Wpointer-arith -Wcast-align -MT unihan_la-tomoe-dict-unihan.lo -MD -MP -MF .deps/unihan_la-tomoe-dict-unihan.Tpo -c tomoe-dict-unihan.c -o unihan_la-tomoe-dict-unihan.o >/dev/null 2>&1
mv -f .deps/unihan_la-tomoe-dict-unihan.Tpo .deps/unihan_la-tomoe-dict-unihan.Plo
/bin/sh ../../libtool --tag=CC   --mode=compile x86_64-pc-linux-gnu-gcc -DHAVE_CONFIG_H -I. -I../.. -I../../bindings/ruby -I/usr/include/glib-2.0 -I/usr/lib64/glib-2.0/include   -DCONFDIR=\""/etc/tomoe"\" -DDATADIR=\""/usr/share/tomoe"\" -DDICT_DATADIR=\""/usr/share/tomoe/dict"\" -DRECOGNIZER_DATADIR=\""/usr/share/tomoe/recognizer"\" -DDICT_MODULEDIR=\""/usr/lib64/tomoe/module/dict"\" -DRECOGNIZER_MODULEDIR=\""/usr/lib64/tomoe/module/recognizer"\" -I../../lib  -DLINUX=2 -D_REENTRANT -D_GNU_SOURCE -pthread -I/usr/include/apr-1   -I/usr/include/subversion-1   -DG_LOG_DOMAIN=\"Tomoe/Dict:Unihan\" -DRUBY_EXTDIR=\"""\" -DRUBY_LIBDIR=\"""\"   -O2 -march=k8 -pipe -ggdb -Wall -Wmissing-declarations -Wmissing-prototypes -Wpointer-arith -Wcast-align -MT unihan_la-tomoe-unihan.lo -MD -MP -MF .deps/unihan_la-tomoe-unihan.Tpo -c -o unihan_la-tomoe-unihan.lo `test -f 'tomoe-unihan.c' || echo './'`tomoe-unihan.c
 x86_64-pc-linux-gnu-gcc -DHAVE_CONFIG_H -I. -I../.. -I../../bindings/ruby -I/usr/include/glib-2.0 -I/usr/lib64/glib-2.0/include -DCONFDIR=\"/etc/tomoe\" -DDATADIR=\"/usr/share/tomoe\" -DDICT_DATADIR=\"/usr/share/tomoe/dict\" -DRECOGNIZER_DATADIR=\"/usr/share/tomoe/recognizer\" -DDICT_MODULEDIR=\"/usr/lib64/tomoe/module/dict\" -DRECOGNIZER_MODULEDIR=\"/usr/lib64/tomoe/module/recognizer\" -I../../lib -DLINUX=2 -D_REENTRANT -D_GNU_SOURCE -pthread -I/usr/include/apr-1 -I/usr/include/subversion-1 -DG_LOG_DOMAIN=\"Tomoe/Dict:Unihan\" -DRUBY_EXTDIR=\"\" -DRUBY_LIBDIR=\"\" -O2 -march=k8 -pipe -ggdb -Wall -Wmissing-declarations -Wmissing-prototypes -Wpointer-arith -Wcast-align -MT unihan_la-tomoe-unihan.lo -MD -MP -MF .deps/unihan_la-tomoe-unihan.Tpo -c tomoe-unihan.c  -fPIC -DPIC -o .libs/unihan_la-tomoe-unihan.o

at this point it eats all available memory and swap (4G +3G in my case) and meets Mr.OutOfMemory-Killer.

Reproducible: Always

Steps to Reproduce:
1. buy lots of RAM
2. emerge tomoe
3. aaargh noooo help!

Actual Results:  
machine goes into a swapstorm and is unresponsive for ~10 minutes until all swap is filled


Portage 2.1.4_rc14 (default-linux/amd64/2007.0, gcc-4.2.2, glibc-2.7-r1, 2.6.23-gentoo-r1 x86_64)
=================================================================
System uname: 2.6.23-gentoo-r1 x86_64 AMD Athlon(tm) 64 X2 Dual Core Processor 3800+
Timestamp of tree: Thu, 03 Jan 2008 09:30:07 +0000
ccache version 2.4 [disabled]
app-shells/bash:     3.2_p33
dev-lang/python:     2.5.1-r4
dev-python/pycrypto: 2.0.1-r6
dev-util/ccache:     2.4-r7
sys-apps/baselayout: 1.12.10-r5
sys-apps/sandbox:    1.2.18.1-r2
sys-devel/autoconf:  2.13, 2.61-r1
sys-devel/automake:  1.7.9-r1, 1.9.6-r2, 1.10
sys-devel/binutils:  2.18-r1
sys-devel/gcc-config: 1.4.0-r4
sys-devel/libtool:   1.5.24
virtual/os-headers:  2.6.23-r3
ACCEPT_KEYWORDS="amd64 ~amd64"
CBUILD="x86_64-pc-linux-gnu"
CFLAGS="-O2 -march=k8 -pipe -ggdb"
CHOST="x86_64-pc-linux-gnu"
CONFIG_PROTECT="/etc /usr/kde/3.5/env /usr/kde/3.5/share/config /usr/kde/3.5/shutdown /usr/kde/svn/env /usr/kde/svn/share/config /usr/kde/svn/shutdown /usr/share/config"
CONFIG_PROTECT_MASK="/etc/env.d /etc/fonts/fonts.conf /etc/gconf /etc/revdep-rebuild /etc/terminfo /etc/texmf/web2c /etc/udev/rules.d"
CXXFLAGS="-O2 -march=k8 -pipe -ggdb"
DISTDIR="/usr/portage/distfiles"
FEATURES="buildpkg distlocks metadata-transfer sandbox sfperms splitdebug strict unmerge-orphans userfetch"
GENTOO_MIRRORS="ftp://sunsite.informatik.rwth-aachen.de/pub/Linux/gentoo http://ftp.club-internet.fr/pub/mirrors/gentoo ftp://gentoo.inode.at/source/"
MAKEOPTS="-j3"
PKGDIR="/usr/portage/packages"
PORTAGE_RSYNC_OPTS="--recursive --links --safe-links --perms --times --compress --force --whole-file --delete --delete-after --stats --timeout=180 --exclude=/distfiles --exclude=/local --exclude=/packages --filter=H_**/files/digest-*"
PORTAGE_TMPDIR="/var/tmp"
PORTDIR="/usr/portage"
SYNC="rsync://rsync.gentoo.org/gentoo-portage"
USE="3dnow 3dnowext X a52 aac acl alsa amd64 berkdb bitmap-fonts bzip2 cdio cdparanoia cli cracklib crypt cups dga dri dts dv dvd encode fam flac fortran ftp gdbm ggi gif gpm iconv ipv6 isdnlog jack jpeg jpeg2k kdeenablefinal ladspa lzo mad md5sum midi mmx mmxext mng mp2 mp3 mudflap musepack nas ncurses nls nptl nptlonly openal openmp pam pcre perl png pnm pppd python qt3 qt4 quicktime rar readline reflection rtc sdl session slang speex spl sqlite sse sse2 ssl tcpd tga theora tiff truetype truetype-fonts type1-fonts unicode vorbis x264 xorg xv xvid xvmc zlib" ALSA_CARDS="ali5451 als4000 atiixp atiixp-modem bt87x ca0106 cmipci emu10k1x ens1370 ens1371 es1938 es1968 fm801 hda-intel intel8x0 intel8x0m maestro3 trident usb-audio via82xx via82xx-modem ymfpci" ALSA_PCM_PLUGINS="adpcm alaw asym copy dmix dshare dsnoop empty extplug file hooks iec958 ioplug ladspa lfloat linear meter mulaw multi null plug rate route share shm softvol" APACHE2_MODULES="actions alias auth_basic authn_alias authn_anon authn_dbm authn_default authn_file authz_dbm authz_default authz_groupfile authz_host authz_owner authz_user autoindex cache dav dav_fs dav_lock deflate dir disk_cache env expires ext_filter file_cache filter headers include info log_config logio mem_cache mime mime_magic negotiation rewrite setenvif speling status unique_id userdir usertrack vhost_alias" ELIBC="glibc" INPUT_DEVICES="keyboard mouse evdev" KERNEL="linux" LCD_DEVICES="bayrad cfontz cfontz633 glk hd44780 lb216 lcdm001 mtxorb ncurses text" USERLAND="GNU" VIDEO_CARDS="vga vesa nv"
Unset:  CPPFLAGS, CTARGET, EMERGE_DEFAULT_OPTS, INSTALL_MASK, LANG, LC_ALL, LDFLAGS, LINGUAS, PORTAGE_COMPRESS, PORTAGE_COMPRESS_FLAGS, PORTAGE_RSYNC_EXTRA_OPTS, PORTDIR_OVERLAY

[Comment 1 Jakub Moc (RETIRED) 2008-01-03 19:19:43 UTC]

Tried without -pipe?

[Comment 2 Evil Compile Person 2008-01-03 20:53:56 UTC]

(In reply to comment #1)
> Tried without -pipe?
> 

killed at 2.5G mem use, no difference there

[Comment 3 Jakub Moc (RETIRED) 2008-01-03 21:00:55 UTC]

Looks like a quality code... :P

[Comment 4 srrijkers 2008-02-29 19:52:28 UTC]

It's a gcc-4.2 bug. See http://gcc.gnu.org/bugzilla/show_bug.cgi?id=32723.

Looks like it should be gone in gcc-4.3.

[Comment 5 [e-mail] 2008-06-12 01:10:03 UTC]

appears you were right, gcc 4.3.1 took care of the memory eating problem building this package for me.

[Comment 6 Jens Mueller 2008-10-05 20:14:01 UTC]

Same for me, in this compilation command:

 x86_64-pc-linux-gnu-gcc -DHAVE_CONFIG_H -I. -I../.. -I../../bindings/ruby -I/usr/include/glib-2.0 -I/usr/lib64/glib-2.0/include -DCONFDIR=\"/etc/tomoe\" -DDATADIR=\"/usr/share/tomoe\" -DDICT_DATADIR=\"/usr/share/tomoe/dict\" -DRECOGNIZER_DATADIR=\"/usr/share/tomoe/recognizer\" -DDICT_MODULEDIR=\"/usr/lib64/tomoe/module/dict\" -DRECOGNIZER_MODULEDIR=\"/usr/lib64/tomoe/module/recognizer\" -I../../lib -DLINUX=2 -D_REENTRANT -D_GNU_SOURCE -pthread -I/usr/include/apr-1 -I/usr/include/subversion-1 -I/usr/include/mysql -DHAVE_ERRNO_AS_DEFINE=1 -DG_LOG_DOMAIN=\"Tomoe/Dict:Unihan\" -DRUBY_EXTDIR=\"\" -DRUBY_LIBDIR=\"\" -march=k8 -O2 -Wall -Wmissing-declarations -Wmissing-prototypes -Wpointer-arith -Wcast-align -MT unihan_la-tomoe-unihan.lo -MD -MP -MF .deps/unihan_la-tomoe-unihan.Tpo -c tomoe-unihan.c  -fPIC -DPIC -o .libs/unihan_la-tomoe-unihan.o

OK, I'll try with another gcc ...

[Comment 7 Jens Mueller 2008-10-18 00:12:38 UTC]

... which at the moment I cannot install due to bug 216241 - hmpf ...

[Comment 8 Naohiro Aota 2011-12-07 14:04:04 UTC]

There's no problem now?

[Comment 9 Pacho Ramos 2012-04-14 10:58:40 UTC]

(In reply to comment #8)
> There's no problem now?