Summary: | dev-qt/qtwebengine-5.11.1 fails to build with insufficient memory | ||
---|---|---|---|
Product: | Gentoo Linux | Reporter: | Guy <defuebr> |
Component: | Current packages | Assignee: | Qt Bug Alias <qt> |
Status: | RESOLVED CANTFIX | ||
Severity: | normal | CC: | alexandrpaliy, danielittlewood, jstein, kroemmelbein, leonchik1976, mattsch, peter, silvio.gerli |
Priority: | Normal | ||
Version: | unspecified | ||
Hardware: | All | ||
OS: | Linux | ||
See Also: |
https://bugs.gentoo.org/show_bug.cgi?id=570534 https://bugs.gentoo.org/show_bug.cgi?id=828428 |
||
Whiteboard: | |||
Package list: | Runtime testing required: | --- | |
Attachments: | failed build log |
Description
Guy
2018-08-16 10:58:43 UTC
It's definitely no surprise, that the build fails at such low RAM amounts. :] I think the most I've seen dipping into swap is over 8 GiB, with 16 GiB of RAM and MAKEOPTS="-j16" (yeah, I should lower that). I have been planning on adding a USE="jumbo-build", which, when enabled, does increase the amount of memory required while speeding up the build (enabled by default). That's probably most we can do about this, in addition to perhaps adding a warning (or a restriction even). I'm hitting this very same issue in a 16G laptop with 10G swap: # free -h total used free shared buff/cache available Mem: 15Gi 5.7Gi 8.1Gi 279Mi 1.6Gi 9.1Gi Swap: 9Gi 0B 9Gi # emerge --info Portage 2.3.51 (python 3.6.5-final-0, default/linux/amd64/17.0/desktop/plasma, gcc-7.3.0, glibc-2.27-r6, 4.18.16 x86_64) ================================================================= System uname: Linux-4.18.16-x86_64-Intel-R-_Core-TM-_i7-7500U_CPU_@_2.70GHz-with-gentoo-2.4.1 KiB Mem: 16043772 total, 8372832 free KiB Swap: 10485756 total, 10485756 free Timestamp of repository gentoo: Mon, 05 Nov 2018 08:00:01 +0000 Head commit of repository gentoo: 1dbd46d1641947919326bb7f29bcd2fff423e20c sh bash 4.4_p12 ld GNU ld (Gentoo 2.30 p5) 2.30.0 distcc 3.2rc1 x86_64-pc-linux-gnu [disabled] app-shells/bash: 4.4_p12::gentoo dev-java/java-config: 2.2.0-r4::gentoo dev-lang/perl: 5.24.3-r1::gentoo dev-lang/python: 2.7.15::gentoo, 3.5.5-r1::gentoo, 3.6.5::gentoo dev-util/cmake: 3.9.6::gentoo dev-util/pkgconfig: 0.29.2::gentoo sys-apps/baselayout: 2.4.1-r2::gentoo sys-apps/openrc: 0.38.3::gentoo sys-apps/sandbox: 2.13::gentoo sys-devel/autoconf: 2.13::gentoo, 2.69-r4::gentoo sys-devel/automake: 1.11.6-r3::gentoo, 1.13.4-r2::gentoo, 1.15.1-r2::gentoo sys-devel/binutils: 2.30-r4::gentoo sys-devel/gcc: 6.4.0-r1::gentoo, 7.3.0-r6::gentoo sys-devel/gcc-config: 1.8-r1::gentoo sys-devel/libtool: 2.4.6-r3::gentoo sys-devel/make: 4.2.1-r4::gentoo sys-kernel/linux-headers: 4.13::gentoo (virtual/os-headers) sys-libs/glibc: 2.27-r6::gentoo Repositories: gentoo location: /usr/portage sync-type: rsync sync-uri: rsync://rsync.gentoo.org/gentoo-portage priority: -1000 sync-rsync-verify-metamanifest: yes sync-rsync-verify-max-age: 24 sync-rsync-verify-jobs: 1 sync-rsync-extra-opts: foxiverlay location: /home/pekkari/foxiverlay masters: gentoo priority: 50 steam-overlay location: /var/lib/layman/steam-overlay masters: gentoo priority: 50 ACCEPT_KEYWORDS="amd64" ACCEPT_LICENSE="* -@EULA" CBUILD="x86_64-pc-linux-gnu" CFLAGS="-O2 -march=broadwell -mtune=broadwell -fomit-frame-pointer -pipe" CHOST="x86_64-pc-linux-gnu" CONFIG_PROTECT="/etc /usr/lib64/libreoffice/program/sofficerc /usr/share/config /usr/share/gnupg/qualified.txt" CONFIG_PROTECT_MASK="/etc/ca-certificates.conf /etc/dconf /etc/env.d /etc/fonts/fonts.conf /etc/gconf /etc/gentoo-release /etc/php/apache2-php5.6/ext-active/ /etc/php/apache2-php7.2/ext-active/ /etc/php/cgi-php5.6/ext-active/ /etc/php/cgi-php7.2/ext-active/ /etc/php/cli-php5.6/ext-active/ /etc/php/cli-php7.2/ext-active/ /etc/revdep-rebuild /etc/sandbox.d /etc/terminfo" CXXFLAGS="-O2 -march=broadwell -mtune=broadwell -fomit-frame-pointer -pipe" DISTDIR="/usr/portage/distfiles" ENV_UNSET="DBUS_SESSION_BUS_ADDRESS DISPLAY GOBIN PERL5LIB PERL5OPT PERLPREFIX PERL_CORE PERL_MB_OPT PERL_MM_OPT XAUTHORITY XDG_CACHE_HOME XDG_CONFIG_HOME XDG_DATA_HOME XDG_RUNTIME_DIR" FCFLAGS="-O2 -pipe" FEATURES="assume-digests binpkg-logs config-protect-if-modified distlocks ebuild-locks fixlafiles merge-sync multilib-strict news parallel-fetch preserve-libs protect-owned sandbox sfperms strict unknown-features-warn unmerge-logs unmerge-orphans userfetch userpriv usersandbox usersync xattr" FFLAGS="-O2 -pipe" GENTOO_MIRRORS="rsync://trumpetti.atm.tut.fi/gentoo/ rsync://gentoo.bloodhost.ru/gentoo-distfiles" LANG="en_GB.utf8" LDFLAGS="-Wl,-O1 -Wl,--as-needed" MAKEOPTS="-j53 -l5" PKGDIR="/usr/portage/packages" PORTAGE_CONFIGROOT="/" PORTAGE_RSYNC_OPTS="--recursive --links --safe-links --perms --times --omit-dir-times --compress --force --whole-file --delete --stats --human-readable --timeout=180 --exclude=/distfiles --exclude=/local --exclude=/packages --exclude=/.git" PORTAGE_TMPDIR="/var/tmp" USE="X a52 aac acl acpi activities alsa amd64 berkdb bluetooth branding bzip2 cairo cdda cdr cli crypt cups cxx dbus declarative dri dts dvd dvdr egl emboss encode exif fam flac fortran gdbm gif glamor gles2 gpm iconv icu ipv6 jack jpeg kde kipi kwallet lcms ldap libnotify libtirpc lm_sensors mad mng mp3 mp4 mpeg multilib ncurses nls nptl ogg opencl opengl openmp pam pango pcre pcsc-lite pdf phonon php pkcs11 plasma png policykit ppds qml qt5 readline sdl seccomp semantic-desktop smartcard spell ssl startup-notification svg tcpd tiff truetype udev udisks unicode upower usb vdpau vhost-net vorbis vulkan wayland wayland-compositor widgets wxwidgets x264 xattr xcb xcomposite xml xv xvid zlib" ABI_X86="64" ALSA_CARDS="ali5451 als4000 atiixp atiixp-modem bt87x ca0106 cmipci emu10k1x ens1370 ens1371 es1938 es1968 fm801 hda-intel intel8x0 intel8x0m maestro3 trident usb-audio via82xx via82xx-modem ymfpci" APACHE2_MODULES="authn_core authz_core socache_shmcb unixd actions alias auth_basic authn_alias authn_anon authn_dbm authn_default authn_file authz_dbm authz_default authz_groupfile authz_host authz_owner authz_user autoindex cache cgi cgid dav dav_fs dav_lock deflate dir disk_cache env expires ext_filter file_cache filter headers include info log_config logio mem_cache mime mime_magic negotiation rewrite setenvif speling status unique_id userdir usertrack vhost_alias" CALLIGRA_FEATURES="karbon plan sheets stage words" COLLECTD_PLUGINS="df interface irq load memory rrdtool swap syslog" CPU_FLAGS_X86="aes avx avx2 fma3 mmx mmxext pclmul popcnt sse sse2 sse3 sse4_1 sse4_2 ssse3" ELIBC="glibc" GPSD_PROTOCOLS="ashtech aivdm earthmate evermore fv18 garmin garmintxt gpsclock isync itrax mtk3301 nmea ntrip navcom oceanserver oldstyle oncore rtcm104v2 rtcm104v3 sirf skytraq superstar2 timing tsip tripmate tnt ublox ubx" GRUB_PLATFORMS="efi-64" INPUT_DEVICES="libinput" KERNEL="linux" L10N="en-GB fi es" LCD_DEVICES="bayrad cfontz cfontz633 glk hd44780 lb216 lcdm001 mtxorb ncurses text" LIBREOFFICE_EXTENSIONS="presenter-console presenter-minimizer" LLVM_TARGETS="X86" OFFICE_IMPLEMENTATION="libreoffice" PHP_TARGETS="php5-6 php7-0" POSTGRES_TARGETS="postgres9_5 postgres10" PYTHON_SINGLE_TARGET="python3_6" PYTHON_TARGETS="python2_7 python3_6" QEMU_SOFTMMU_TARGETS="i386 x86_64" QEMU_USER_TARGETS="i386 x86_64" RUBY_TARGETS="ruby23" USERLAND="GNU" VIDEO_CARDS="intel i965 radeonsi amdgpu" XTABLES_ADDONS="quota2 psd pknock lscan length2 ipv4options ipset ipp2p iface geoip fuzzy condition tee tarpit sysrq steal rawnat logmark ipmark dhcpmac delude chaos account" Unset: CC, CPPFLAGS, CTARGET, CXX, EMERGE_DEFAULT_OPTS, INSTALL_MASK, LC_ALL, LINGUAS, PORTAGE_BINHOST, PORTAGE_BUNZIP2_COMMAND, PORTAGE_COMPRESS, PORTAGE_COMPRESS_FLAGS, PORTAGE_RSYNC_EXTRA_OPTS So far I cannot upgrade to this version, and I'm not sure what is it wrong. Around 12500 it simply tells it cannot allocate more memory and bails out. Thanks! José. Somewhat to my surprise I hit a variety of versions of this on a machine with 64G of memory, but it was a 6-core Intel box with a raid NVMe 'disk' drive, and I do enable full debug (so I get the "please try removing -g/-ggdb before reporting a bug" warning.) One of the symptoms was a complete machine hang (kernel 4.19.1)! In my case I worked round the problem by using --oneshot to build qtwebengine alone and reducing my make -j12 option to -j8 (I tried -j1 initially but got bored...) I normally 'emerge --jobs'; it makes KDE minor releases bearable. I suggest emerge --oneshot and make --jobs=1 (-j1) and if that isn't enough kill any -g options. It will take a very long time but I would be surprised if there is something in there which is running out of memory in a single process. In the past when building on Raspberry Pi machines I had to do a variety of things to stop the qt-webkit (not webengine) build from OOM in while *linking* but I saw this problem much earlier in the process - the link step was always single-threaded. *** Bug 671162 has been marked as a duplicate of this bug. *** It's a well-known fact that qtwebengine requires a lot of memory to build. There's nothing we can do about it. (In reply to Davide Pesavento from comment #5) > It's a well-known fact that qtwebengine requires a lot of memory to build. > There's nothing we can do about it. How about the ebuild emits a warning or stops completely if there isn't enough memory to build it in the first place? (In reply to Matthew Schultz from comment #6) > How about the ebuild emits a warning or stops completely if there isn't > enough memory to build it in the first place? Bug 570534 *** Bug 741192 has been marked as a duplicate of this bug. *** *** Bug 753392 has been marked as a duplicate of this bug. *** *** Bug 757129 has been marked as a duplicate of this bug. *** *** Bug 757132 has been marked as a duplicate of this bug. *** *** Bug 757132 has been marked as a duplicate of this bug. *** *** Bug 790494 has been marked as a duplicate of this bug. *** |