Gentoo Websites Logo
Go to: Gentoo Home Documentation Forums Lists Bugs Planet Store Wiki Get Gentoo!
Bug 921831 - dev-lang/rust-1.74.1 fails to build with 16GB in /var/tmp/portage
Summary: dev-lang/rust-1.74.1 fails to build with 16GB in /var/tmp/portage
Status: UNCONFIRMED
Alias: None
Product: Gentoo Linux
Classification: Unclassified
Component: Current packages (show other bugs)
Hardware: All Linux
: Normal normal
Assignee: Gentoo Rust Project
URL:
Whiteboard:
Keywords:
Depends on:
Blocks:
 
Reported: 2024-01-11 19:06 UTC by nvaert1986
Modified: 2024-02-14 10:26 UTC (History)
5 users (show)

See Also:
Package list:
Runtime testing required: ---


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description nvaert1986 2024-01-11 19:06:48 UTC
I'm using make -j32 and have a 16GB /var/tmp/portage partition (in RAM). It was calculated that I would need somewhere around 14848MB of RAM, but the compilation failed. 

Umounting /var/tmp/portage so that the compilation process could use my SSD (which has a 300GB of space) the compilation process finished without a problem.

Reproducible: Always

Steps to Reproduce:
1. Compile dev-lang/rust-1.74.1 on a partition with 16GB with -j32

Actual Results:  
A failed compilation of dev-lang/rust-1.74.1

Expected Results:  
A compiled version of dev-lang/rust-1.74.1

If any additional information is required, then please let me know.
Comment 1 Mike Gilbert gentoo-dev 2024-01-11 20:33:00 UTC
How much total memory is in the system?

Please provide emerge --info.
Comment 2 Mike Gilbert gentoo-dev 2024-01-11 20:33:40 UTC
Also attach a build log, and check dmesg for out-of-memory errors.
Comment 3 nvaert1986 2024-01-11 20:43:05 UTC
emerge --info
Portage 3.0.59 (python 3.11.7-final-0, default/linux/amd64/17.1/systemd/merged-usr, gcc-13, glibc-2.38-r9, 6.6.9-gentoo x86_64)
=================================================================
System uname: Linux-6.6.9-gentoo-x86_64-AMD_Ryzen_9_7950X_16-Core_Processor-with-glibc2.38
KiB Mem:    65564268 total,  56417032 free
KiB Swap:    8388604 total,   8388604 free
Timestamp of repository gentoo: Thu, 11 Jan 2024 18:00:01 +0000
Head commit of repository gentoo: f591da722da994c5bbc9ae3431bfffbfa65b7fe1
sh bash 5.1_p16-r6
ld GNU ld (Gentoo 2.41 p4) 2.41.0
app-misc/pax-utils:        1.3.5::gentoo
app-shells/bash:           5.1_p16-r6::gentoo
dev-lang/perl:             5.38.2-r1::gentoo
dev-lang/python:           3.11.7::gentoo, 3.12.1::gentoo
dev-lang/rust:             1.74.1::gentoo
dev-util/cmake:            3.27.9::gentoo
dev-util/meson:            1.3.0-r2::gentoo
sys-apps/baselayout:       2.14-r1::gentoo
sys-apps/sandbox:          2.38::gentoo
sys-apps/systemd:          254.7::gentoo
sys-devel/autoconf:        2.13-r7::gentoo, 2.71-r6::gentoo
sys-devel/automake:        1.16.5-r1::gentoo
sys-devel/binutils:        2.41-r3::gentoo
sys-devel/binutils-config: 5.5::gentoo
sys-devel/clang:           15.0.7-r3::gentoo, 16.0.6::gentoo
sys-devel/gcc:             13.2.1_p20230826::gentoo
sys-devel/gcc-config:      2.11::gentoo
sys-devel/libtool:         2.4.7-r1::gentoo
sys-devel/lld:             16.0.6::gentoo
sys-devel/llvm:            15.0.7-r3::gentoo, 16.0.6::gentoo
sys-devel/make:            4.4.1-r1::gentoo
sys-kernel/linux-headers:  6.6::gentoo (virtual/os-headers)
sys-libs/glibc:            2.38-r9::gentoo
Repositories:

gentoo
    location: /var/db/repos/gentoo
    sync-type: rsync
    sync-uri: rsync://rsync.gentoo.org/gentoo-portage
    priority: -1000
    volatile: False
    sync-rsync-verify-metamanifest: yes
    sync-rsync-verify-max-age: 3
    sync-rsync-verify-jobs: 1
    sync-rsync-extra-opts: 

Binary Repositories:

gentoobinhost
    priority: 1
    sync-uri: https://gentoo.osuosl.org/releases/amd64/binpackages/17.1/x86-64

ACCEPT_KEYWORDS="amd64"
ACCEPT_LICENSE="@FREE"
CBUILD="x86_64-pc-linux-gnu"
CFLAGS="-march=native -O2 -pipe"
CHOST="x86_64-pc-linux-gnu"
CONFIG_PROTECT="/etc /usr/lib64/libreoffice/program/sofficerc /usr/share/config /usr/share/gnupg/qualified.txt"
CONFIG_PROTECT_MASK="/etc/ca-certificates.conf /etc/dconf /etc/env.d /etc/fonts/fonts.conf /etc/gconf /etc/gentoo-release /etc/revdep-rebuild /etc/sandbox.d"
CXXFLAGS="-march=native -O2 -pipe"
DISTDIR="/var/cache/distfiles"
ENV_UNSET="CARGO_HOME DBUS_SESSION_BUS_ADDRESS DISPLAY GDK_PIXBUF_MODULE_FILE GOBIN GOPATH PERL5LIB PERL5OPT PERLPREFIX PERL_CORE PERL_MB_OPT PERL_MM_OPT XAUTHORITY XDG_CACHE_HOME XDG_CONFIG_HOME XDG_DATA_HOME XDG_RUNTIME_DIR XDG_STATE_HOME"
FCFLAGS="-march=native -O2 -pipe"
FEATURES="assume-digests binpkg-docompress binpkg-dostrip binpkg-logs binpkg-multi-instance buildpkg-live config-protect-if-modified distlocks ebuild-locks fixlafiles ipc-sandbox merge-sync multilib-strict network-sandbox news parallel-fetch pid-sandbox pkgdir-index-trusted preserve-libs protect-owned qa-unresolved-soname-deps sandbox sfperms strict unknown-features-warn unmerge-logs unmerge-orphans userfetch userpriv usersandbox usersync xattr"
FFLAGS="-march=native -O2 -pipe"
GENTOO_MIRRORS="https://ftp.belnet.be/pub/rsync.gentoo.org/gentoo/     rsync://ftp.belnet.be/gentoo/gentoo/     https://mirror.eu.oneandone.net/linux/distributions/gentoo/gentoo/     http://mirror.eu.oneandone.net/linux/distributions/gentoo/gentoo/     rsync://mirror.eu.oneandone.net/gentoo/     https://mirror.dogado.de/gentoo     http://ftp.agdsn.de/gentoo     https://ftp.agdsn.de/gentoo     rsync://ftp.agdsn.de/gentoo     https://ftp.spline.inf.fu-berlin.de/mirrors/gentoo/     http://ftp.spline.inf.fu-berlin.de/mirrors/gentoo/     rsync://ftp.spline.inf.fu-berlin.de/gentoo-distfiles/     https://ftp.gwdg.de/pub/linux/gentoo/     http://ftp.gwdg.de/pub/linux/gentoo/     ftp://ftp.gwdg.de/pub/linux/gentoo/     rsync://ftp.gwdg.de/gentoo/     https://ftp.uni-hannover.de/gentoo/     http://ftp.uni-hannover.de/gentoo/     ftp://ftp.uni-hannover.de/gentoo/     ftp://mirror.netcologne.de/gentoo/     https://mirror.netcologne.de/gentoo/     http://mirror.netcologne.de/gentoo/     rsync://mirror.netcologne.de/gentoo/     https://mirror.netzwerge.de/gentoo/     http://mirror.netzwerge.de/gentoo/     rsync://mirror.netzwerge.de/gentoo     https://packages.hs-regensburg.de/gentoo-distfiles/     https://linux.rz.ruhr-uni-bochum.de/download/gentoo-mirror/     http://linux.rz.ruhr-uni-bochum.de/download/gentoo-mirror/     ftp://linux.rz.ruhr-uni-bochum.de/gentoo-mirror/     rsync://linux.rz.ruhr-uni-bochum.de/gentoo     https://ftp.halifax.rwth-aachen.de/gentoo/     http://ftp.halifax.rwth-aachen.de/gentoo/     ftp://ftp.halifax.rwth-aachen.de/gentoo/     rsync://ftp.halifax.rwth-aachen.de/gentoo/     https://ftp.tu-ilmenau.de/mirror/gentoo/     http://ftp.tu-ilmenau.de/mirror/gentoo/     rsync://ftp.tu-ilmenau.de/gentoo/     https://ftp.fau.de/gentoo     http://ftp.fau.de/gentoo     ftp://ftp.fau.de/gentoo     rsync://ftp.fau.de/gentoo     https://ftp-stud.hs-esslingen.de/pub/Mirrors/gentoo/     http://ftp-stud.hs-esslingen.de/pub/Mirrors/gentoo/     ftp://ftp-stud.hs-esslingen.de/pub/Mirrors/gentoo/     rsync://ftp-stud.hs-esslingen.de/gentoo/     https://ftp.uni-stuttgart.de/gentoo-distfiles/     http://ftp.uni-stuttgart.de/gentoo-distfiles/     ftp://ftp.uni-stuttgart.de/gentoo-distfiles/     http://gentoo.mirror.root.lu/     https://mirrors.evoluso.com/gentoo/     http://mirrors.evoluso.com/gentoo/     https://mirror.leaseweb.com/gentoo/     http://mirror.leaseweb.com/gentoo/     rsync://mirror.leaseweb.com/gentoo/     https://ftp.snt.utwente.nl/pub/os/linux/gentoo     http://ftp.snt.utwente.nl/pub/os/linux/gentoo     ftp://ftp.snt.utwente.nl/pub/os/linux/gentoo     rsync://ftp.snt.utwente.nl/gentoo"
LANG="en_US.utf8"
LDFLAGS="-Wl,-O1 -Wl,--as-needed"
LEX="flex"
MAKEOPTS="-j32"
PKGDIR="/var/cache/binpkgs"
PORTAGE_CONFIGROOT="/"
PORTAGE_RSYNC_OPTS="--recursive --links --safe-links --perms --times --omit-dir-times --compress --force --whole-file --delete --stats --human-readable --timeout=180 --exclude=/distfiles --exclude=/local --exclude=/packages --exclude=/.git"
PORTAGE_TMPDIR="/var/tmp"
SHELL="/bin/bash"
USE="7zip X a52 aac accessibility acl activities alsa amd64 avif bluetooth boost branding brotli bzip2 cairo caps cli colord crypt cups curl dav1d dbus designer device-mapper djvu dri dts dvd eps epub exif ffmpeg flac fontconfig fontforge fortran freetype gdbm gdk-pixbuf geoclue geolocation gif gles2 gstreamer gtk gtk3 gtk4 harfbuzz ibus iconv icu idn introspection ipv6 jbig jpeg jpegxl kde kdesu kerberos keyring lame lcms libnotify libtirpc libvisual lrz lto lvm lz4 lzma markdown mbim mng mobi modemmanager mp3 mpeg multilib ncurses networkmanager nls nptl numpy ogg openal opencl opengl openmp opus pam pclm pcre pdf perl pgo pipewire plasma png policykit pulseaudio python qml qt5 rar raw readline samba screencast sdl seccomp share sndfile ssl svg systemd taglib tcl tdb test-rust theora tiff tpm truetype udev unicode usb v4l vaapi vala vcd vorbis vpx vulkan wavpack wayland webengine webp widgets x264 xattr xinerama xml xvfb zip zlib zstd" ABI_X86="32 64" ADA_TARGET="gnat_2021" APACHE2_MODULES="authn_core authz_core socache_shmcb unixd actions alias auth_basic authn_anon authn_dbm authn_file authz_dbm authz_groupfile authz_host authz_owner authz_user autoindex cache cgi cgid dav dav_fs dav_lock deflate dir env expires ext_filter file_cache filter headers include info log_config logio mime mime_magic negotiation rewrite setenvif speling status unique_id userdir usertrack vhost_alias" CALLIGRA_FEATURES="karbon sheets words" CAMERAS="ptp ptp2" COLLECTD_PLUGINS="df interface irq load memory rrdtool swap syslog" CPU_FLAGS_X86="aes avx avx2 avx512f avx512dq avx512cd avx512bw avx512vl avx512vbmi f16c fma3 mmx mmxext pclmul popcnt rdrand sha sse sse2 sse3 sse4_1 sse4_2 sse4a ssse3" ELIBC="glibc" GPSD_PROTOCOLS="ashtech aivdm earthmate evermore fv18 garmin garmintxt gpsclock greis isync itrax mtk3301 ntrip navcom oceanserver oncore rtcm104v2 rtcm104v3 sirf skytraq superstar2 tsip tripmate tnt ublox" GRUB_PLATFORMS="efi-64" INPUT_DEVICES="evdev libinput" KERNEL="linux" L10N="en en-GB en-US nl" LCD_DEVICES="bayrad cfontz glk hd44780 lb216 lcdm001 mtxorb text" LLVM_TARGETS="AMDGPU X86" LUA_SINGLE_TARGET="lua5-1" LUA_TARGETS="lua5-1" OFFICE_IMPLEMENTATION="libreoffice" PHP_TARGETS="php8-1" POSTGRES_TARGETS="postgres15" PYTHON_SINGLE_TARGET="python3_11" PYTHON_TARGETS="python3_11" RUBY_TARGETS="ruby31" SANE_BACKENDS="escl" VIDEO_CARDS="amdgpu radeonsi" XTABLES_ADDONS="quota2 psd pknock lscan length2 ipv4options ipp2p iface geoip fuzzy condition tarpit sysrq proto logmark ipmark dhcpmac delude chaos account"
Unset:  ADDR2LINE, AR, ARFLAGS, AS, ASFLAGS, CC, CCLD, CONFIG_SHELL, CPP, CPPFLAGS, CTARGET, CXX, CXXFILT, ELFEDIT, EMERGE_DEFAULT_OPTS, EXTRA_ECONF, F77FLAGS, FC, GCOV, GPROF, INSTALL_MASK, LC_ALL, LD, LFLAGS, LIBTOOL, LINGUAS, MAKE, MAKEFLAGS, NM, OBJCOPY, OBJDUMP, PORTAGE_BINHOST, PORTAGE_BUNZIP2_COMMAND, PORTAGE_COMPRESS, PORTAGE_COMPRESS_FLAGS, PORTAGE_RSYNC_EXTRA_OPTS, PYTHONPATH, RANLIB, READELF, RUSTFLAGS, SIZE, STRINGS, STRIP, YACC, YFLAGS
Comment 4 nvaert1986 2024-01-11 20:46:57 UTC
The system has a total of 64GB of memory. I don't have a build log anymore unfortunately as I umounted the partition and emerged it using my / disk for /var/tmp/portage and then simply mounted the memory disk again, but I figured I'd report it in case someone else encounters the issue.
Comment 5 nvaert1986 2024-01-11 20:48:15 UTC
P.S.: The error was related to not having enough space and when I ran df -aH the usage was 100%.
Comment 6 Mike Auty 2024-01-29 18:50:31 UTC
I ran into the same on a hard disk with 57Gb free and it ran out.  My cflags include "-ggdb" which I'm guessing it what causes it consume so much disk space.