KSysguard showed about 8-10 "cc1plus" instances, don't know if it is true, depending how fast KSysguard refreshes, but at very least my 4c/4t Intel 3570k CPU was fully loaded. Also my machine has 8 GB RAM and still swapping around additional 6 GB (at some point, not in the beginning though). as it seen in ebuild current qtwebengine-5.15.5_p20220618.ebuild I had to replace the 243th line: export NINJAFLAGS="${NINJAFLAGS:--j$(makeopts_jobs "${MAKEOPTS}" 999) -l$(makeopts_loadavg "${MAKEOPTS}" 0) -v}" with something like this: export NINJAFLAGS="-j 2 -l 2" That way I was able to compile it with 2 jobs and without swapping. P.S.: With that change, python3.10 was found also, without it pointed somewhere in temp/work-directory. Reproducible: Always Actual Results: at some point over 6 GB used on SWAP and 100% CPU usage with MAKEOPTS="-j2" on 4c/4t CPU Expected Results: no swap usage with 8 GB RAM nuclear /var/lib/portage # emerge --info Portage 3.0.30 (python 3.9.13-final-0, default/linux/amd64/17.1/desktop/plasma, gcc-11.3.0, glibc-2.34-r13, 5.15.48-gentoo-dist x86_64) ================================================================= System uname: Linux-5.15.48-gentoo-dist-x86_64-Intel-R-_Core-TM-_i5-3570K_CPU_@_3.40GHz-with-glibc2.34 KiB Mem: 7594768 total, 2161468 free KiB Swap: 10489852 total, 9703524 free Timestamp of repository gentoo: Mon, 04 Jul 2022 01:00:01 +0000 Head commit of repository gentoo: 9f39f305a5e3ace79efb86f41638070f9c97fae5 sh bash 5.1_p16 ld GNU ld (Gentoo 2.37_p1 p2) 2.37 app-misc/pax-utils: 1.3.4::gentoo app-shells/bash: 5.1_p16::gentoo dev-java/java-config: 2.3.1::gentoo dev-lang/perl: 5.34.1-r3::gentoo dev-lang/python: 2.7.18_p13::gentoo, 3.8.12_p1-r1::gentoo, 3.9.13::gentoo, 3.10.5::gentoo dev-lang/rust: 1.60.0::gentoo dev-util/cmake: 3.22.4::gentoo dev-util/meson: 0.61.4-r2::gentoo sys-apps/baselayout: 2.8::gentoo sys-apps/openrc: 0.44.10::gentoo sys-apps/sandbox: 2.29::gentoo sys-devel/autoconf: 2.13-r2::gentoo, 2.71-r1::gentoo sys-devel/automake: 1.16.5::gentoo sys-devel/binutils: 2.37_p1-r2::gentoo sys-devel/binutils-config: 5.4.1::gentoo sys-devel/clang: 13.0.0::gentoo, 14.0.4::gentoo sys-devel/gcc: 11.3.0::gentoo sys-devel/gcc-config: 2.5-r1::gentoo sys-devel/libtool: 2.4.7::gentoo sys-devel/lld: 14.0.4::gentoo sys-devel/llvm: 13.0.0::gentoo, 14.0.4::gentoo sys-devel/make: 4.3::gentoo sys-kernel/linux-headers: 5.15-r3::gentoo (virtual/os-headers) sys-libs/glibc: 2.34-r13::gentoo Repositories: gentoo location: /usr/portage sync-type: rsync sync-uri: rsync://rsync.gentoo.org/gentoo-portage priority: -1000 sync-rsync-verify-max-age: 24 sync-rsync-verify-jobs: 1 sync-rsync-extra-opts: sync-rsync-verify-metamanifest: yes science location: /var/lib/layman/science masters: gentoo priority: 50 waebbl location: /var/lib/layman/waebbl masters: gentoo priority: 50 ACCEPT_KEYWORDS="amd64" ACCEPT_LICENSE="@FREE" CBUILD="x86_64-pc-linux-gnu" CFLAGS="-march=ivybridge -O2 -pipe" CHOST="x86_64-pc-linux-gnu" CONFIG_PROTECT="/etc /usr/lib64/libreoffice/program/sofficerc /usr/share/config /usr/share/gnupg/qualified.txt /usr/share/themes/oxygen-gtk/gtk-2.0" CONFIG_PROTECT_MASK="/etc/ca-certificates.conf /etc/dconf /etc/env.d /etc/fonts/fonts.conf /etc/gconf /etc/gentoo-release /etc/revdep-rebuild /etc/sandbox.d /etc/terminfo /etc/texmf/language.dat.d /etc/texmf/language.def.d /etc/texmf/updmap.d /etc/texmf/web2c" CXXFLAGS="-march=ivybridge -O2 -pipe" DISTDIR="/usr/portage/distfiles" ENV_UNSET="CARGO_HOME DBUS_SESSION_BUS_ADDRESS DISPLAY GOBIN GOPATH PERL5LIB PERL5OPT PERLPREFIX PERL_CORE PERL_MB_OPT PERL_MM_OPT XAUTHORITY XDG_CACHE_HOME XDG_CONFIG_HOME XDG_DATA_HOME XDG_RUNTIME_DIR" FCFLAGS="-O2 -pipe" FEATURES="assume-digests binpkg-docompress binpkg-dostrip binpkg-logs buildpkg-live config-protect-if-modified distlocks ebuild-locks fixlafiles ipc-sandbox merge-sync multilib-strict network-sandbox news parallel-fetch pid-sandbox preserve-libs protect-owned qa-unresolved-soname-deps sandbox sfperms strict unknown-features-warn unmerge-logs unmerge-orphans userfetch userpriv usersandbox usersync xattr" FFLAGS="-O2 -pipe" GENTOO_MIRRORS="rsync://ftp.halifax.rwth-aachen.de/gentoo/" LANG="en_US.utf8" LDFLAGS="-Wl,-O1 -Wl,--as-needed" MAKEOPTS="-j3" PKGDIR="/usr/portage/packages" PORTAGE_CONFIGROOT="/" PORTAGE_RSYNC_OPTS="--recursive --links --safe-links --perms --times --omit-dir-times --compress --force --whole-file --delete --stats --human-readable --timeout=180 --exclude=/distfiles --exclude=/local --exclude=/packages --exclude=/.git" PORTAGE_TMPDIR="/var/tmp" SHELL="/bin/bash" USE="X a52 aac acl acpi activities alisp alsa amd64 avx bluetooth branding bzip2 cairo caps cdda cdr cleartype cli corefonts crypt cups dbus declarative dist-kernel djvu dri dts dvd dvdr elogind encode epub exif ffmpeg flac fortran gbm gdbm gif gnome gpm gtk gui iconv icu introspection ipv6 jpeg kde kerberos kwallet lcms libglvnd libkms libnotify libtirpc mad mmx mng mp3 mp4 mpeg multilib nautilus ncurses nls nptl nvidia ogg openal opencl opengl openmp orc pam pango pcre pdf plasma png policykit ppds qml qt5 readline sdl seccomp semantic-desktop soprano spell split-usr sse sse2 sse3 sse4_1 ssl ssse3 startup-notification svg threads tiff truetype udev udisks unicode upower usb vdpau vorbis wavpack widgets wxwidgets x264 xa xattr xcb xml xorg xv xvid xvmc zlib" ABI_X86="64 32" ADA_TARGET="gnat_2020" APACHE2_MODULES="authn_core authz_core socache_shmcb unixd actions alias auth_basic authn_alias authn_anon authn_dbm authn_default authn_file authz_dbm authz_default authz_groupfile authz_host authz_owner authz_user autoindex cache cgi cgid dav dav_fs dav_lock deflate dir disk_cache env expires ext_filter file_cache filter headers include info log_config logio mem_cache mime mime_magic negotiation rewrite setenvif speling status unique_id userdir usertrack vhost_alias" CALLIGRA_FEATURES="karbon sheets words" COLLECTD_PLUGINS="df interface irq load memory rrdtool swap syslog" CPU_FLAGS_X86="aes avx mmx mmxext popcnt sse sse2 sse3 sse4_1 sse4_2 ssse3" ELIBC="glibc" GPSD_PROTOCOLS="ashtech aivdm earthmate evermore fv18 garmin garmintxt gpsclock greis isync itrax mtk3301 nmea ntrip navcom oceanserver oldstyle oncore rtcm104v2 rtcm104v3 sirf skytraq superstar2 timing tsip tripmate tnt ublox ubx" INPUT_DEVICES="libinput" KERNEL="linux" LCD_DEVICES="bayrad cfontz cfontz633 glk hd44780 lb216 lcdm001 mtxorb ncurses text" LIBREOFFICE_EXTENSIONS="presenter-console presenter-minimizer" LUA_SINGLE_TARGET="lua5-1" LUA_TARGETS="lua5-1" OFFICE_IMPLEMENTATION="libreoffice" PHP_TARGETS="php7-4 php8-0" POSTGRES_TARGETS="postgres12 postgres13" PYTHON_SINGLE_TARGET="python3_10" PYTHON_TARGETS="python3_10" RUBY_TARGETS="ruby27" SANE_BACKENDS="hp" USERLAND="GNU" VIDEO_CARDS="nvidia" XTABLES_ADDONS="quota2 psd pknock lscan length2 ipv4options ipset ipp2p iface geoip fuzzy condition tee tarpit sysrq proto steal rawnat logmark ipmark dhcpmac delude chaos account" Unset: ADDR2LINE, AR, ARFLAGS, AS, ASFLAGS, CC, CCLD, CONFIG_SHELL, CPP, CPPFLAGS, CTARGET, CXX, CXXFILT, ELFEDIT, EMERGE_DEFAULT_OPTS, EXTRA_ECONF, F77FLAGS, FC, GCOV, GPROF, INSTALL_MASK, LC_ALL, LD, LEX, LFLAGS, LIBTOOL, LINGUAS, MAKE, MAKEFLAGS, NM, OBJCOPY, OBJDUMP, PORTAGE_BINHOST, PORTAGE_BUNZIP2_COMMAND, PORTAGE_COMPRESS, PORTAGE_COMPRESS_FLAGS, PORTAGE_RSYNC_EXTRA_OPTS, RANLIB, READELF, RUSTFLAGS, SIZE, STRINGS, STRIP, YACC, YFLAGS
1. Could you grab `ps aux` output when it's acting badly (without your change)? 2. What is NINJAFLAGS when it's acting badly? 3. I wonder if it's just wrong as-is, given: ``` commit a00223eb88742885325b8863ba080e7d94202d8f Author: Michał Górny <mgorny@gentoo.org> Date: Thu Apr 28 12:44:02 2022 +0200 multiprocessing.eclass: Default makeopts_jobs to inf=nproc+1 Change the default value for 'inf' argument to makeopts_jobs from 999 to $(get_nproc) + 1. This means that if MAKEOPTS specifies a `-j` argument without a specific value, nproc will be used rather than infinity-ish number of jobs. The old default made sense for ebuilds using both makeopts_jobs and makeopts_loadavg. However, these are very rare — only 4 packages and 3 eclass at this time. For the remaining ebuilds, they meant uncontrollably using up to 999 jobs. The new default is both safer and more correct for the vast majority of Gentoo packages, removing the necessity of repeating: $(makeopts_jobs "${MAKEOPTS}" "$(get_nproc)") The ebuilds and eclasses using makeopts_loadavg have been updated to pass the old default. Signed-off-by: Michał Górny <mgorny@gentoo.org> ``` but I thought we'd cleaned up all the ebuild uses of this.
Created attachment 791339 [details] failing to compile after resuming with FEATURE="keepwork"
Well my bad, the issues appears only if I continue to compile with FEATURE="keepwork". As I previously mentioned, python command points to "/var/tmp/portage/dev-qt/qtwebengine-5.15.5_p20220618/temp/python3.10/bin/python" instead something like "/usr/bin/python3.10" After I have changed this in these files: /var/tmp/portage/dev-qt/qtwebengine-5.15.5_p20220618/work/qtwebengine-5.15.5_p20220618_build/src/core/release/host/toolchain.ninja /var/tmp/portage/dev-qt/qtwebengine-5.15.5_p20220618/work/qtwebengine-5.15.5_p20220618_build/src/core/release/build.ninja /var/tmp/portage/dev-qt/qtwebengine-5.15.5_p20220618/work/qtwebengine-5.15.5_p20220618_build/src/buildtools/qtbuildtools-config.pri I was able to continue to compile. And at this stage, MAKEOPTS are ignored. Also I don't know how to display NINJAFLAGS when resuming compilation. I tried "echo" it in section "pkg_setup()" in this ebuild, but it seems it's never called. P.S.: Chromium itself compiles fine with FEATURE="keepwork", though probably even longer than qtwebengine
Created attachment 791342 [details] "ps aux" when resuming compiling qtwebengine with FEATURE="keepwork". In this case MAKEOPTS are ignored
You're saying "ignored". Do you mean you change them mid compile then resume with keepwork? That won't work as it's saved in the environment file.
(In reply to Sam James from comment #5) > You're saying "ignored". Do you mean you change them mid compile then resume > with keepwork? That won't work as it's saved in the environment file. I suppose in this case it gets forgotten. Because I did start compiling with 2 jobs, but when I resume (with keepwork) it's not 2 anymore.
