Portage 2.2.0_alpha112 (default/linux/amd64/10.0, gcc-4.7.1-asneeded, glibc-2.15-r2, 3.4.3-hardened x86_64) ================================================================= System uname: Linux-3.4.3-hardened-x86_64-AMD_Opteron-TM-_Processor_6272-with-gentoo-2.1 Timestamp of tree: Sun, 24 Jun 2012 17:30:02 +0000 ccache version 3.1.7 [disabled] app-shells/bash: 4.2_p29 dev-java/java-config: 2.1.12 dev-lang/python: 2.6.8, 2.7.3-r2, 3.2.3-r1 dev-util/ccache: 3.1.7 dev-util/cmake: 2.8.8-r3 dev-util/pkgconfig: 0.26 sys-apps/baselayout: 2.1-r1 sys-apps/openrc: 0.10.3 sys-apps/sandbox: 2.5 sys-devel/autoconf: 2.13, 2.69 sys-devel/automake: 1.4_p6-r1, 1.9.6-r3, 1.10.3, 1.11.5, 1.12.1 sys-devel/binutils: 2.22-r1 sys-devel/gcc: 4.5.3-r2, 4.7.1 sys-devel/gcc-config: 1.7.3 sys-devel/libtool: 2.4.2 sys-devel/make: 3.82-r3 sys-kernel/linux-headers: 3.4 (virtual/os-headers) sys-libs/glibc: 2.15-r2 Repositories: gentoo ACCEPT_KEYWORDS="amd64 ~amd64" ACCEPT_LICENSE="*" CBUILD="x86_64-pc-linux-gnu" CFLAGS="-O2 -pipe -ggdb -march=native -ftracer" CHOST="x86_64-pc-linux-gnu" CONFIG_PROTECT="/etc /etc/entropy /opt/openjms/config /usr/share/config /usr/share/gnupg/qualified.txt /usr/share/maven-bin-3.0/conf /usr/share/qpsmtpd/plugins /var/lib/hsqldb" CONFIG_PROTECT_MASK="/etc/ca-certificates.conf /etc/dconf /etc/env.d /etc/fonts/fonts.conf /etc/gconf /etc/gentoo-release /etc/php/apache2-php5.3/ext-active/ /etc/php/apache2-php5.4/ext-active/ /etc/php/cgi-php5.3/ext-active/ /etc/php/cgi-php5.4/ext-active/ /etc/php/cli-php5.3/ext-active/ /etc/php/cli-php5.4/ext-active/ /etc/revdep-rebuild /etc/sandbox.d /etc/splash /etc/terminfo /etc/texmf/language.dat.d /etc/texmf/language.def.d /etc/texmf/updmap.d /etc/texmf/web2c" CXXFLAGS="-O2 -pipe -ggdb -march=native -ftracer" DISTDIR="/var/cache/portage/distfiles" FCFLAGS="-O2 -pipe" FEATURES="assume-digests binpkg-logs config-protect-if-modified distlocks ebuild-locks fail-clean fixlafiles news parallel-fetch parse-eapi-ebuild-head protect-owned sandbox sfperms strict test test-fail-continue unknown-features-warn unmerge-orphans userfetch userpriv usersandbox" FFLAGS="-O2 -pipe" GENTOO_MIRRORS="http://distfiles.gentoo.org" LANG="en_US.utf8" LC_ALL="C" LDFLAGS="-Wl,-O1 -Wl,--as-needed" MAKEOPTS="-j24" PKGDIR="/usr/portage/packages" PORTAGE_CONFIGROOT="/" PORTAGE_RSYNC_OPTS="--recursive --links --safe-links --perms --times --compress --force --whole-file --delete --stats --human-readable --timeout=180 --exclude=/distfiles --exclude=/local --exclude=/packages" PORTAGE_TMPDIR="/tmp" PORTDIR="/var/cache/portage/tree" PORTDIR_OVERLAY="" SYNC="rsync://rsync.gentoo.org/gentoo-portage" USE="3dnow 3dnowex acl amd64 berkdb bzip2 cli cracklib crypt cups cxx dri ffmpeg fortran gdbm gnutls gpm iconv ipv6 mmx modules mudflap multilib ncurses nls nptl openmp pam pax_kernel pcre plasma pppd qt3support readline semantic-desktop session sse sse2 sse3 sse4 ssl ssse3 tcpd unicode vhosts xorg zlib" ALSA_CARDS="ali5451 als4000 atiixp atiixp-modem bt87x ca0106 cmipci emu10k1x ens1370 ens1371 es1938 es1968 fm801 hda-intel intel8x0 intel8x0m maestro3 trident usb-audio via82xx via82xx-modem ymfpci" ALSA_PCM_PLUGINS="adpcm alaw asym copy dmix dshare dsnoop empty extplug file hooks iec958 ioplug ladspa lfloat linear meter mmap_emul mulaw multi null plug rate route share shm softvol" APACHE2_MODULES="actions alias auth_basic authn_alias authn_anon authn_dbm authn_default authn_file authz_dbm authz_default authz_groupfile authz_host authz_owner authz_user autoindex cache cgi cgid dav dav_fs dav_lock deflate dir disk_cache env expires ext_filter file_cache filter headers include info log_config logio mem_cache mime mime_magic negotiation rewrite setenvif speling status unique_id userdir usertrack vhost_alias" CALLIGRA_FEATURES="kexi words flow plan sheets stage tables krita karbon braindump" CAMERAS="ptp2" COLLECTD_PLUGINS="df interface irq load memory rrdtool swap syslog" ELIBC="glibc" GPSD_PROTOCOLS="ashtech aivdm earthmate evermore fv18 garmin garmintxt gpsclock itrax mtk3301 nmea ntrip navcom oceanserver oldstyle oncore rtcm104v2 rtcm104v3 sirf superstar2 timing tsip tripmate tnt ubx" KERNEL="linux" LCD_DEVICES="bayrad cfontz cfontz633 glk hd44780 lb216 lcdm001 mtxorb ncurses text" LIBREOFFICE_EXTENSIONS="presenter-console presenter-minimizer" PHP_TARGETS="php5-3" PYTHON_TARGETS="python3_2 python2_7" RUBY_TARGETS="ruby18 ruby19 ree18" USERLAND="GNU" XTABLES_ADDONS="quota2 psd pknock lscan length2 ipv4options ipset ipp2p iface geoip fuzzy condition tee tarpit sysrq steal rawnat logmark ipmark dhcpmac delude chaos account" Unset: CPPFLAGS, CTARGET, EMERGE_DEFAULT_OPTS, INSTALL_MASK, LINGUAS, PORTAGE_BUNZIP2_COMMAND, PORTAGE_COMPRESS, PORTAGE_COMPRESS_FLAGS, PORTAGE_RSYNC_EXTRA_OPTS, USE_PYTHON
It seems that it runs out of memory for some reason.
Diego, could you try some saner job count like -j5?
There's no "saner" and there's no middleground -- either a package is parallel-safe or it isn't. The fact that with what you call "saner" (which is actually just "lower") it doesn't manifest doesn't tell you much. Please note that the box I'm running this on has 32 cores so it can easily do up to -j64 without a glitch by itself.
BTW the "out of memory" is wrong, as the system as 64GB of memory and did _not_ end up in an OOM panic.
Yes, the out of memory message is likely speaking about the self-imposed limit that racket enforces specifically to prevent system memory exhaustion. Maybe there is some correlation between the number of parallel jobs and the amount of memory it uses and they failed to account for that.
So Diego, you are confirming that with a lower job count the problem goes away? Any details that would help with reproducing this on lower-power machines?
Diego, could you please retest with racket-5.3.4?
Created attachment 350970 [details] build.log
I have the same problem with racket-5.3.4 and job count -j3. The output of emerge --info '=dev-scheme/racket-5.3.4' and the logfile are attached. Portage 2.1.12.2 (hardened/linux/amd64/selinux, gcc-4.6.3, glibc-2.15-r3, 3.8.6-hardened x86_64) ================================================================= System Settings ================================================================= System uname: Linux-3.8.6-hardened-x86_64-Pentium-R-_Dual-Core_CPU_T4200_@_2.00GHz-with-gentoo-2.2 KiB Mem: 3006700 total, 495020 free KiB Swap: 497660 total, 487336 free Timestamp of tree: Fri, 14 Jun 2013 00:45:01 +0000 ld GNU ld (GNU Binutils) 2.22 app-shells/bash: 4.2_p45 dev-lang/python: 2.7.3-r3, 3.2.3-r2 dev-util/cmake: 2.8.9 dev-util/pkgconfig: 0.28 sys-apps/baselayout: 2.2 sys-apps/openrc: 0.11.8 sys-apps/sandbox: 2.5 sys-devel/autoconf: 2.13, 2.69 sys-devel/automake: 1.11.6, 1.12.6 sys-devel/binutils: 2.22-r1 sys-devel/gcc: 4.6.3 sys-devel/gcc-config: 1.7.3 sys-devel/libtool: 2.4-r1 sys-devel/make: 3.82-r4 sys-kernel/linux-headers: 3.7 (virtual/os-headers) sys-libs/glibc: 2.15-r3 Repositories: gentoo ACCEPT_KEYWORDS="amd64" ACCEPT_LICENSE="@FREE" CBUILD="x86_64-pc-linux-gnu" CFLAGS="-march=native -O2 -pipe" CHOST="x86_64-pc-linux-gnu" CONFIG_PROTECT="/etc /usr/share/gnupg/qualified.txt" CONFIG_PROTECT_MASK="/etc/ca-certificates.conf /etc/env.d /etc/fonts/fonts.conf /etc/gconf /etc/gentoo-release /etc/revdep-rebuild /etc/sandbox.d /etc/terminfo" CXXFLAGS="-march=native -O2 -pipe" DISTDIR="/usr/portage/distfiles" FCFLAGS="-O2 -pipe" FEATURES="assume-digests binpkg-logs config-protect-if-modified distlocks ebuild-locks fixlafiles merge-sync news parallel-fetch preserve-libs protect-owned sandbox selinux sesandbox sfperms strict unknown-features-warn unmerge-logs unmerge-orphans userfetch webrsync-gpg xattr" FFLAGS="-O2 -pipe" GENTOO_MIRRORS="http://gentoo.bloodhost.ru/ http://mirror2.corbina.ru/gentoo-distfiles/ ftp://xeon.gentoo.ru/mirrors/gentoo/distfiles/ http://mirror.yandex.ru/gentoo-distfiles/ ftp://mirror.yandex.ru/gentoo-distfiles/" LANG="en_US.UTF-8" LDFLAGS="-Wl,-O1 -Wl,--as-needed" MAKEOPTS="-j3" PKGDIR="/usr/portage/packages" PORTAGE_CONFIGROOT="/" PORTAGE_RSYNC_OPTS="--recursive --links --safe-links --perms --times --compress --force --whole-file --delete --stats --human-readable --timeout=180 --exclude=/distfiles --exclude=/local --exclude=/packages" PORTAGE_TMPDIR="/var/tmp" PORTDIR="/usr/portage" PORTDIR_OVERLAY="" SYNC="" USE="alsa amd64 berkdb bindist bzip2 cdr cli cracklib crypt cxx dri dvd gdbm hardened iconv ipv6 justify mmx modules mudflap multilib ncurses nls nptl open_perms openmp pam pax_kernel pcre readline selinux session sse sse2 ssl tcpd unicode urandom zlib" ABI_X86="64" ALSA_CARDS="ali5451 als4000 atiixp atiixp-modem bt87x ca0106 cmipci emu10k1x ens1370 ens1371 es1938 es1968 fm801 hda-intel intel8x0 intel8x0m maestro3 trident usb-audio via82xx via82xx-modem ymfpci" APACHE2_MODULES="authn_core authz_core socache_shmcb unixd actions alias auth_basic authn_alias authn_anon authn_dbm authn_default authn_file authz_dbm authz_default authz_groupfile authz_host authz_owner authz_user autoindex cache cgi cgid dav dav_fs dav_lock deflate dir disk_cache env expires ext_filter file_cache filter headers include info log_config logio mem_cache mime mime_magic negotiation rewrite setenvif speling status unique_id userdir usertrack vhost_alias" CALLIGRA_FEATURES="kexi words flow plan sheets stage tables krita karbon braindump author" CAMERAS="ptp2" COLLECTD_PLUGINS="df interface irq load memory rrdtool swap syslog" ELIBC="glibc" GPSD_PROTOCOLS="ashtech aivdm earthmate evermore fv18 garmin garmintxt gpsclock itrax mtk3301 nmea ntrip navcom oceanserver oldstyle oncore rtcm104v2 rtcm104v3 sirf superstar2 timing tsip tripmate tnt ubx" INPUT_DEVICES="keyboard mouse evdev" KERNEL="linux" LCD_DEVICES="bayrad cfontz cfontz633 glk hd44780 lb216 lcdm001 mtxorb ncurses text" LIBREOFFICE_EXTENSIONS="presenter-console presenter-minimizer" OFFICE_IMPLEMENTATION="libreoffice" PHP_TARGETS="php5-3" PYTHON_SINGLE_TARGET="python2_7" PYTHON_TARGETS="python2_7 python3_2" RUBY_TARGETS="ruby19 ruby18" USERLAND="GNU" VIDEO_CARDS="intel" XTABLES_ADDONS="quota2 psd pknock lscan length2 ipv4options ipset ipp2p iface geoip fuzzy condition tee tarpit sysrq steal rawnat logmark ipmark dhcpmac delude chaos account" Unset: CPPFLAGS, CTARGET, EMERGE_DEFAULT_OPTS, INSTALL_MASK, LC_ALL, PORTAGE_BUNZIP2_COMMAND, PORTAGE_COMPRESS, PORTAGE_COMPRESS_FLAGS, PORTAGE_RSYNC_EXTRA_OPTS, USE_PYTHON
Created attachment 350972 [details] build.log.txt
It seems to fail for the first time somewhere at the middle of your log. The second half contains many more out of memory errors, but it just keeps going... raco setup: in db raco setup: in db/private/postgresql raco setup: in unstable raco setup: in file raco setup: in db/private/generic raco setup: in srfi raco setup: in srfi/19 raco setup: in srfi/29 raco setup: in db/util raco setup: in db/util/private raco setup: in db/private/sqlite3 raco setup: in db/private/odbc raco setup: in db/private/mysql raco setup: making: db/private raco setup: making: db/private/generic raco setup: in db/private/generic raco setup: making: db/private/mysql raco setup: making: db/private/odbc raco setup: making: db/private/postgresql raco setup: making: db/private/sqlite3 raco setup: making: db/scribblings raco setup: in db/scribblings raco setup: in unstable raco setup: making: db/util raco setup: in db/util raco setup: making: db/util/private raco setup: making: defaults raco setup: making: deinprogramm (DeinProgramm) raco setup: in deinprogramm raco setup: in deinprogramm/signature raco setup: in test-engine raco setup: in deinprogramm/DMdA/lang raco setup: in trace raco setup: in lang raco setup: making: deinprogramm/DMdA raco setup: making: deinprogramm/DMdA-advanced raco setup: making: deinprogramm/DMdA-advanced/lang raco setup: in deinprogramm/DMdA-advanced/lang raco setup: making: deinprogramm/DMdA-assignments raco setup: making: deinprogramm/DMdA-assignments/lang raco setup: in deinprogramm/DMdA-assignments/lang raco setup: making: deinprogramm/DMdA-beginner raco setup: making: deinprogramm/DMdA-beginner/lang raco setup: in deinprogramm/DMdA-beginner/lang raco setup: making: deinprogramm/DMdA-vanilla raco setup: making: deinprogramm/DMdA-vanilla/lang raco setup: in deinprogramm/DMdA-vanilla/lang raco setup: making: deinprogramm/DMdA/lang raco setup: making: deinprogramm/quickcheck (DeinProgramm - QuickCheck) raco setup: making: deinprogramm/scribblings raco setup: in deinprogramm/scribblings raco setup: in scribblings/htdp-langs raco setup: making: deinprogramm/signature (DeinProgramm - Signatures) raco setup: in deinprogramm/signature raco setup: making: drracket raco setup: in drracket raco setup: in drracket/private raco setup: in framework raco setup: in mrlib raco setup: in racket raco setup: in mzlib raco setup: in images out of memory raco setup: making: drracket/private raco setup: in drracket/private raco setup: in images out of memory
There seems to be something conflicting with PaX. If I put PaX in soft mode then it builds and runs fine. If PaX soft mode is off then I can start the command line 'racket' and evaluate simple expressions but attempting to do anything that requires a non-trivial amount of memory fails (see below). Of course, DrRacket won't load if PaX is enforcing. $ racket Welcome to Racket v5.3.4. > (require xrepl) ; Warning: no readline support (out of memory ) -> (require racket/gui) ; out of memory [,bt for context] -> $ emerge --info Portage 2.2.0_alpha188 (hardened/linux/amd64, gcc-4.6.3, glibc-2.15-r3, 3.9.5-hardened x86_64) ================================================================= System uname: Linux-3.9.5-hardened-x86_64-Intel-R-_Core-TM-_i5-3317U_CPU_@_1.70GHz-with-gentoo-2.2
I had to run this command first in order to reproduce the out of memory warnings (otherwise SELinux killed the application before anything happened) setsebool allow_execmem on When this boolean was set to off, I found this message in logs PAX: sizeoverflow detected in function vm_mmap_pgoff mm/util.c:377 cicus.118_34 min, count: 34 In order to start drracket I recompiled the kernel with this option disabled: Security options -> Grsecurity -> Customize Configuration -> PaX -> Miscellaneous hardening features -> Prevent various integer overflows in function size parameters After choosing the language drracket was able to load, even when all miscellaneous hardening features were enabled. However, dev-lang/racket still doesn't compile with PaX producing the same build logs.
*** Bug 534586 has been marked as a duplicate of this bug. ***
Version is not in tree any more. Amy
