[ebuild U ] dev-qt/qtwebengine-5.15.12_p20240122:5/5.15::gentoo [5.15.12_p20240112:5/5.15::gentoo] USE="alsa geolocation jumbo-build pulseaudio screencast system-icu widgets -bindist -debug -designer -kerberos -test" 0 KiB After starting compilation, it quickly hangs and whole notebook seems to freeze. I waited for about 12 hours. No progress. Load went up to 32, cpu usage at maximum all time. I am even unable to terminate emerge here. No output after: make[3]: Verzeichnis „/var/tmp/portage/dev-qt/qtwebengine-5.15.12_p20240122/work/qtwebengine-5.15.12_p20240122_build/src/core“ wird verlassen ( test -e Makefile.gn_run || /usr/lib64/qt5/bin/qmake -o Makefile.gn_run /var/tmp/portage/dev-qt/qtwebengine-5.15.12_p20240122/work/qtwebengine-5.15.12_p20240122/src/core/gn_run.pro CONFIG+=release CONFIG-=debug 'QMAKE_AR=x86_64-pc-linux-gnu-ar cqs' QMAKE_CC=x86_64-pc-linux-gnu-gcc QMAKE_LINK_C=x86_64-pc-linux-gnu-gcc QMAKE_LINK_C_SHLIB=x86_64-pc-linux-gnu-gcc QMAKE_CXX=x86_64-pc-linux-gnu-g++ QMAKE_LINK=x86_64-pc-linux-gnu-g++ QMAKE_LINK_SHLIB=x86_64-pc-linux-gnu-g++ QMAKE_OBJCOPY=x86_64-pc-linux-gnu-objcopy QMAKE_RANLIB= QMAKE_STRIP=x86_64-pc-linux-gnu-strip 'QMAKE_CFLAGS=-march=native -mfpmath=sse,387 -O3 -frecord-gcc-switches -fomit-frame-pointer -malign-data=abi -mtls-dialect=gnu2 -pipe' QMAKE_CFLAGS_RELEASE= QMAKE_CFLAGS_DEBUG= 'QMAKE_CXXFLAGS=-march=native -mfpmath=sse,387 -O3 -frecord-gcc-switches -fomit-frame-pointer -malign-data=abi -mtls-dialect=gnu2 -pipe -fvisibility-inlines-hidden' QMAKE_CXXFLAGS_RELEASE= QMAKE_CXXFLAGS_DEBUG= 'QMAKE_LFLAGS=-Wl,--as-needed -Wl,--defsym=__gentoo_check_ldflags__=0 -Wl,-O1 -Wl,--sort-common -Wl,-z,now -Wl,--undefined-version' QMAKE_LFLAGS_RELEASE= QMAKE_LFLAGS_DEBUG= ) && make -f Makefile.gn_run Project MESSAGE: Running: /var/tmp/portage/dev-qt/qtwebengine-5.15.12_p20240122/work/qtwebengine-5.15.12_p20240122_build/src/3rdparty/gn/out/Release/gn gen /var/tmp/portage/dev-qt/qtwebengine-5.15.12_p20240122/work/qtwebengine-5.15.12_p20240122_build/src/core/release --script-executable=/var/tmp/portage/dev-qt/qtwebengine-5.15.12_p20240122/temp/python3.11/bin/python --args='use_qt=true init_stack_vars=false is_component_build=false is_shared=true enable_debugallocation=false enable_media_remoting=false enable_message_center=false enable_nacl=false enable_remoting=false enable_reporting=false enable_resource_allowlist_generation=false enable_swiftshader=false enable_swiftshader_vulkan=false angle_enable_swiftshader=false enable_web_speech=false enable_widevine=true forbid_non_component_debug_builds=false has_native_accessibility=false safe_browsing_mode=0 skia_use_dawn=false toolkit_views=false treat_warnings_as_errors=false fatal_linker_warnings=false use_allocator_shim=false use_allocator="none" use_custom_libcxx=false chrome_pgo_phase=0 enable_hangout_services_extension=true optimize_webui=false enable_js_type_check=false v8_use_external_startup_data=false strip_absolute_paths_from_debug_symbols=false use_jumbo_build=true jumbo_file_merge_limit=8 jumbo_build_excluded=["browser"] enable_precompiled_headers=false is_official_build=true is_debug=false symbol_level=0 blink_symbol_level=0 remove_v8base_debug_symbols=true use_cups=false use_gio=false use_gnome_keyring=false use_udev=true use_bundled_fontconfig=false use_sysroot=false enable_session_service=false is_cfi=false use_ozone=true use_x11=false ozone_auto_platforms=false ozone_platform_headless=false ozone_platform_external=true ozone_platform="qt" ozone_extra_path="/var/tmp/portage/dev-qt/qtwebengine-5.15.12_p20240122/work/qtwebengine-5.15.12_p20240122/src/core/ozone/ozone_extra.gni" use_gold=false use_lld=false is_clang=false custom_toolchain="/var/tmp/portage/dev-qt/qtwebengine-5.15.12_p20240122/work/qtwebengine-5.15.12_p20240122_build/src/toolchain:target" host_toolchain="/var/tmp/portage/dev-qt/qtwebengine-5.15.12_p20240122/work/qtwebengine-5.15.12_p20240122_build/src/toolchain:host" host_cpu="x64" pkg_config="pkg-config" host_pkg_config="/usr/bin/pkg-config" use_system_zlib=true use_system_minizip=true pdfium_use_system_zlib=true use_system_libpng=true pdfium_use_system_libpng=true use_system_libjpeg=true use_system_freetype=true use_system_harfbuzz=true use_glib=false enable_basic_printing=true enable_print_preview=true enable_pdf=true enable_plugins=true enable_spellcheck=true enable_webrtc=true proprietary_codecs=true ffmpeg_branding="Chrome" rtc_use_h264=true enable_extensions=true use_kerberos=false enable_ipc_logging=false use_pulseaudio=true use_alsa=true ozone_platform_x11=true use_xkbcommon=true use_xscrnsaver=true rtc_use_x11=true rtc_use_pipewire=true use_system_libevent=true use_system_libwebp=true use_system_libxml=true use_system_libxslt=true use_system_opus=true use_system_snappy=true use_system_libvpx=true use_system_icu=true icu_use_data_file=false use_system_re2=true use_system_lcms2=true qtwebengine_target="/var/tmp/portage/dev-qt/qtwebengine-5.15.12_p20240122/work/qtwebengine-5.15.12_p20240122_build/src/core/release:QtWebEngineCore"' --root=/var/tmp/portage/dev-qt/qtwebengine-5.15.12_p20240122/work/qtwebengine-5.15.12_p20240122/src/3rdparty/chromium
Created attachment 883060 [details] build.log
Portage 3.0.61 (python 3.11.7-final-0, default/linux/amd64/17.1/desktop, gcc-13, glibc-2.38-r9, 6.7.1-gentoo-r1 x86_64) ================================================================= System uname: Linux-6.7.1-gentoo-r1-x86_64-Intel-R-_Core-TM-_i7-6600U_CPU_@_2.60GHz-with-glibc2.38 KiB Mem: 32580924 total, 30912128 free KiB Swap: 34078716 total, 34078716 free Timestamp of repository gentoo: Mon, 22 Jan 2024 22:15:01 +0000 Head commit of repository gentoo: 1c0e6b3a8d3b8691ee1873b34788d8b44e4b5708 Timestamp of repository guru: Mon, 22 Jan 2024 17:35:12 +0000 Head commit of repository guru: cdad4c7b392e13622e10f68e81bb3fdf61872b99 sh bash 5.2_p26 ld GNU ld (Gentoo 2.41 p4) 2.41.0 ccache version 4.9 [enabled] app-misc/pax-utils: 1.3.7::gentoo app-shells/bash: 5.2_p26::gentoo dev-build/autoconf: 2.13-r8::gentoo, 2.72-r1::gentoo dev-build/automake: 1.16.5-r1::gentoo dev-build/cmake: 3.28.1-r1::gentoo dev-build/libtool: 2.4.7-r2::gentoo dev-build/make: 4.4.1-r1::gentoo dev-build/meson: 1.3.1-r1::gentoo dev-java/java-config: 2.3.3-r1::gentoo dev-lang/perl: 5.38.2-r1::gentoo dev-lang/python: 3.11.7::gentoo, 3.12.1_p1::gentoo dev-lang/rust-bin: 1.74.1::gentoo dev-util/ccache: 4.9::gentoo sys-apps/baselayout: 2.14-r1::gentoo sys-apps/openrc: 0.53::gentoo sys-apps/sandbox: 2.38::gentoo sys-devel/binutils: 2.41-r4::gentoo sys-devel/binutils-config: 5.5::gentoo sys-devel/clang: 15.0.7-r3::gentoo, 17.0.6::gentoo sys-devel/gcc: 13.2.1_p20240113-r1::gentoo sys-devel/gcc-config: 2.11::gentoo sys-devel/lld: 15.0.7::gentoo, 17.0.6::gentoo sys-devel/llvm: 15.0.7-r3::gentoo, 17.0.6::gentoo sys-kernel/linux-headers: 6.7::gentoo (virtual/os-headers) sys-libs/glibc: 2.38-r9::gentoo Repositories: gentoo location: /var/db/repos/gentoo sync-type: rsync sync-uri: rsync://rsync.de.gentoo.org/gentoo-portage priority: -1000 volatile: False sync-rsync-verify-metamanifest: yes sync-rsync-extra-opts: --compress --exclude-from=/etc/portage/rsync_excludes --new-compress sync-rsync-verify-max-age: 24 sync-rsync-verify-jobs: 1 guru location: /var/db/repos/guru sync-type: git sync-uri: https://github.com/gentoo-mirror/guru.git masters: gentoo volatile: False serenity location: /usr/local/portage masters: gentoo volatile: True ACCEPT_KEYWORDS="amd64 ~amd64" ACCEPT_LICENSE="*" CBUILD="x86_64-pc-linux-gnu" CFLAGS="-march=native -mfpmath=sse,387 -O3 -frecord-gcc-switches -fomit-frame-pointer -malign-data=abi -mtls-dialect=gnu2 -pipe" CHOST="x86_64-pc-linux-gnu" CONFIG_PROTECT="/etc /usr/share/config /usr/share/gnupg/qualified.txt" CONFIG_PROTECT_MASK="/etc/ca-certificates.conf /etc/dconf /etc/env.d /etc/fonts/fonts.conf /etc/gconf /etc/gentoo-release /etc/revdep-rebuild /etc/sandbox.d /etc/terminfo /etc/texmf/language.dat.d /etc/texmf/language.def.d /etc/texmf/updmap.d /etc/texmf/web2c" CXXFLAGS="-march=native -mfpmath=sse,387 -O3 -frecord-gcc-switches -fomit-frame-pointer -malign-data=abi -mtls-dialect=gnu2 -pipe -fvisibility-inlines-hidden" DISTDIR="/var/cache/distfiles" EMERGE_DEFAULT_OPTS="--autounmask=y --quiet-build=n --with-bdeps=y" ENV_UNSET="CARGO_HOME DBUS_SESSION_BUS_ADDRESS DISPLAY GDK_PIXBUF_MODULE_FILE GOBIN GOPATH PERL5LIB PERL5OPT PERLPREFIX PERL_CORE PERL_MB_OPT PERL_MM_OPT XAUTHORITY XDG_CACHE_HOME XDG_CONFIG_HOME XDG_DATA_HOME XDG_RUNTIME_DIR XDG_STATE_HOME" FCFLAGS="-march=native -mfpmath=sse,387 -O3 -frecord-gcc-switches -fomit-frame-pointer -malign-data=abi -mtls-dialect=gnu2 -pipe" FEATURES="assume-digests binpkg-docompress binpkg-dostrip binpkg-logs binpkg-multi-instance buildpkg-live ccache config-protect-if-modified distlocks ebuild-locks fixlafiles ipc-sandbox merge-sync multilib-strict network-sandbox news parallel-fetch pid-sandbox pkgdir-index-trusted preserve-libs protect-owned qa-unresolved-soname-deps sandbox sfperms sign strict strict-keepdir unknown-features-warn unmerge-logs unmerge-orphans userfetch userpriv usersandbox usersync warn-on-large-env xattr" FFLAGS="-march=native -mfpmath=sse,387 -O3 -frecord-gcc-switches -fomit-frame-pointer -malign-data=abi -mtls-dialect=gnu2 -pipe" GENTOO_MIRRORS="https://packages.hetzner.com/gentoo/" INSTALL_MASK="/etc/systemd/* /etc/xinetd.d/* /usr/lib/systemd/*" LANG="de_DE.UTF-8" LC_ALL="de_DE.UTF-8" LDFLAGS="-Wl,--as-needed -Wl,--defsym=__gentoo_check_ldflags__=0 -Wl,-O1 -Wl,--sort-common -Wl,-z,now" LEX="flex" LINGUAS="de de_DE" MAKEOPTS="-j5 -l4" PKGDIR="/var/cache/binpkgs" PORTAGE_BUNZIP2_COMMAND="pbunzip2" PORTAGE_BZIP2_COMMAND="pbzip2" PORTAGE_COMPRESS="xz" PORTAGE_COMPRESS_FLAGS="-9e" PORTAGE_CONFIGROOT="/" PORTAGE_RSYNC_EXTRA_OPTS="--compress --exclude-from=/etc/portage/rsync_excludes --new-compress" PORTAGE_RSYNC_OPTS="--recursive --links --safe-links --perms --times --omit-dir-times --compress --force --whole-file --delete --stats --human-readable --timeout=180 --exclude=/distfiles --exclude=/local --exclude=/packages --exclude=/.git" PORTAGE_TMPDIR="/var/tmp" SHELL="/bin/zsh" USE="X aalib accessibility acl alsa amd64 ao appindicator asm avif bash-completion berkdb bluetooth brotli bzip2 cairo caps cdda cddb cjk colord crypt cups curl cvs cxx dbus dga djvu dri dvb egl elogind encode exif expat fbcon ffmpeg fftw filecaps flac fontconfig fortran ftp fttw gd gdbm geolocation gif git gles2 gmp gnome-keyring gnutls gphoto2 gpm graphviz gsm gstreamer gtk gui iconv icu idn ieee1394 imap imlib inotify introspection ios ipv6 java javascript jbig jemalloc jit joystick jpeg jpeg2k keyring latex lcms ldap libass libcaca libnotify libsamplerate lm-sensors lto lua luajit lz4 lzma lzo mad magic maildir mbox mhash mikmod milter mng modplug modules-compress modules-sign mp3 mtp ncurses networkmanager nls nntp offensive ogg openal opencl openexr opengl openmp opus orc oss pam pcre pdf perl pie png policykit postscript pulseaudio python qt5 qt6 raw readline rtmp samba sasl scanner screencast sctp sdl seccomp slang smartcard sndfile snmp socks5 sound sox speech speex spell split-usr sqlite ssl startup-notification strip subversion suid svg symlink syslog tcl test-rust theora threads tiff truetype udev udisks unicode upnp usb v4l vaapi vdpau verify-sig vim-syntax vnc vorbis vulkan wavpack wayland webkit webp wifi wmf x264 xattr xface xft xinetd xml xpm xscreensaver xv xvid zeroconf zip zlib zstd" ABI_X86="32 64" COLLECTD_PLUGINS="apcups battery buddyinfo capabilities cgroups check_uptime connectivity conntrack contextswitch cpu cpufreq cpusleep df disk dns entropy ethstat exec fhcount filecount hddtemp hugepages interface ipc ipmi iptables irq load java mcelog md memory mysql netlink nfs nginx ntpd openldap openvpn pcie_errors ping postgresql processes procevent protocols rrdcached sensors serial smart snmp swap syslog tcpconns thermal turbostat unixsock uptime users wireless" CPU_FLAGS_X86="aes avx avx2 f16c rdrand mmx mmxext sse sse2 sse3 sse4_1 sse4_2 ssse3" CURL_SSL="openssl" ELIBC="glibc" GPSD_PROTOCOLS="garmin garmintxt nmea0183" GRUB_PLATFORMS="pc" INPUT_DEVICES="libinput synaptics" KERNEL="linux" L10N="de de_DE" LCD_DEVICES="cfontzpacket crystalfontz glcd2usb hd44780 lcd2usb" LUA_SINGLE_TARGET="lua5-3" LUA_TARGETS="lua5-3 lua5-4" NGINX_MODULES_HTTP="access addition auth_basic autoindex brotli browser charset fancyindex fastcgi geo geoip geoip2 gunzip gzip gzip_static headers_more image_filter javascript limit_conn limit_req map metrics proxy realip referer rewrite secure_link sticky stub_status upload_progress upstream_keepalive vhost_traffic_status xslt" NGINX_MODULES_MAIL="imap pop3 smtp" NGINX_MODULES_STREAM="access geo geoip geoip2 javascript limit_conn map realip return ssl_preread" PHP_TARGETS="php8-3" PYTHON_SINGLE_TARGET="python3_11" PYTHON_TARGETS="python3_11 python3_12" RUBY_TARGETS="ruby32 ruby33" SANE_BACKENDS="hp net" VIDEO_CARDS="intel" Unset: ADDR2LINE, AR, ARFLAGS, AS, ASFLAGS, CC, CCLD, CONFIG_SHELL, CPP, CPPFLAGS, CTARGET, CXX, CXXFILT, ELFEDIT, EXTRA_ECONF, F77FLAGS, FC, GCOV, GPROF, LD, LFLAGS, LIBTOOL, MAKE, MAKEFLAGS, NM, OBJCOPY, OBJDUMP, PORTAGE_BINHOST, PYTHONPATH, RANLIB, READELF, RUSTFLAGS, SIZE, STRINGS, STRIP, YACC, YFLAGS
build.log basically contains nothing. Reproducible at all?
Yes, I can reproduce it on every emerge run.
Well, if the whole machine freeze and not just the build itself hanging, then that doesn't sound like a qtwebengine issue. Don't see what we can do here.
I'd normally suspect heavy swapping+i/o pressure that make everything unresponsive but with -j5 and 32GB that sound quite unlikely unless the threads went unhinged or some memory leak is happening.
(In reply to Ionen Wolkens from comment #5) > Well, if the whole machine freeze and not just the build itself hanging, > then that doesn't sound like a qtwebengine issue. Don't see what we can do > here. Well, I am not sure, if it's a real freeze, since the load is so high, it may just be extremly slow.
Interestingly re-emerging dev-qt/qtwebengine-5.15.12_p20240112 also now causes the issue. But this version is also installed. I do wonder, if there could be some faulty dependency causing this?
All package updates after last sucessfull build of qtwebengine: Sun Jan 21 05:43:14 2024 >>> dev-qt/qtwebengine-5.15.12_p20240112 Sun Jan 21 12:35:05 2024 >>> media-video/ffmpeg-6.1.1-r1 Sun Jan 21 13:07:24 2024 >>> sys-power/acpi_call-1.2.2-r1 Sun Jan 21 14:27:13 2024 >>> sys-power/acpi_call-1.2.2-r1 Sun Jan 21 14:27:52 2024 >>> sys-power/acpi_call-1.2.2-r1 Sun Jan 21 17:20:25 2024 >>> net-libs/webkit-gtk-2.42.4 Sun Jan 21 20:10:23 2024 >>> net-libs/webkit-gtk-2.42.4-r410 Sun Jan 21 22:58:06 2024 >>> net-libs/webkit-gtk-2.42.4-r600 Sun Jan 21 23:43:41 2024 >>> net-wireless/wireless-regdb-20230503-r2 Sun Jan 21 23:43:51 2024 >>> dev-util/glib-utils-2.78.4 Sun Jan 21 23:44:02 2024 >>> dev-util/gdbus-codegen-2.78.4 Mon Jan 22 00:57:34 2024 >>> net-libs/nodejs-20.11.0 Mon Jan 22 01:01:05 2024 >>> dev-libs/glib-2.78.4 Mon Jan 22 01:03:41 2024 >>> dev-util/spirv-llvm-translator-17.0.0-r2 Mon Jan 22 01:03:54 2024 >>> dev-util/gtk-update-icon-cache-3.24.40 Mon Jan 22 01:13:01 2024 >>> x11-libs/gtk+-3.24.40 Mon Jan 22 01:18:59 2024 >>> gui-libs/gtk-4.12.5 Mon Jan 22 01:34:28 2024 >>> sys-auth/AusweisApp2-2.0.3 Mon Jan 22 22:13:23 2024 >>> sys-power/acpi_call-1.2.2-r1 Mon Jan 22 22:21:04 2024 >>> sys-power/acpi_call-1.2.2-r1 Mon Jan 22 22:27:28 2024 >>> sys-power/acpi_call-1.2.2-r1 Mon Jan 22 23:48:41 2024 >>> dev-util/pkgconf-2.1.0-r1 Mon Jan 22 23:48:52 2024 >>> dev-libs/wayland-protocols-1.33 Mon Jan 22 23:49:55 2024 >>> dev-libs/glib-2.78.4-r1 Mon Jan 22 23:50:04 2024 >>> sys-auth/pambase-20240119 Mon Jan 22 23:50:59 2024 >>> media-libs/libplacebo-6.338.2 Mon Jan 22 23:55:07 2024 >>> x11-misc/colord-1.4.7 Mon Jan 22 23:55:19 2024 >>> dev-util/gdbus-codegen-2.78.4-r1 Mon Jan 22 23:55:39 2024 >>> media-fonts/iosevka-28.0.6 Tue Jan 23 19:39:12 2024 >>> sys-power/acpi_call-1.2.2-r1 Tue Jan 23 19:39:49 2024 >>> sys-power/acpi_call-1.2.2-r1 Tue Jan 23 19:44:32 2024 >>> sys-power/acpi_call-1.2.2-r1 Tue Jan 23 19:44:54 2024 >>> sys-power/acpi_call-1.2.2-r1 Tue Jan 23 19:50:12 2024 >>> sys-power/acpi_call-1.2.2-r1 Tue Jan 23 19:50:44 2024 >>> sys-power/acpi_call-1.2.2-r1 Tue Jan 23 19:58:17 2024 >>> sys-power/acpi_call-1.2.2-r1 Tue Jan 23 19:58:54 2024 >>> sys-power/acpi_call-1.2.2-r1 Tue Jan 23 20:15:25 2024 >>> sys-power/acpi_call-1.2.2-r1 Tue Jan 23 20:17:31 2024 >>> sys-power/acpi_call-1.2.2-r1 Tue Jan 23 20:28:30 2024 >>> sys-kernel/gentoo-sources-6.7.1-r1 Tue Jan 23 20:54:31 2024 >>> sys-power/acpi_call-1.2.2-r1 Tue Jan 23 21:04:16 2024 >>> sys-power/acpi_call-1.2.2-r1 Wed Jan 24 21:34:08 2024 >>> sec-keys/openpgp-keys-apache-ant-20230104 Wed Jan 24 21:34:27 2024 >>> dev-libs/serd-0.32.2 Wed Jan 24 21:34:46 2024 >>> media-libs/lilv-0.24.24 Wed Jan 24 21:35:16 2024 >>> sys-apps/acl-2.3.2 Wed Jan 24 21:35:50 2024 >>> sys-libs/zlib-1.3.1 Wed Jan 24 21:54:15 2024 >>> dev-libs/boost-1.84.0-r2 Wed Jan 24 21:59:19 2024 >>> media-video/ffmpeg-6.1.1-r2 Wed Jan 24 22:02:23 2024 >>> dev-libs/nss-3.97 Wed Jan 24 22:05:07 2024 >>> sys-libs/binutils-libs-2.41-r5 Wed Jan 24 22:06:27 2024 >>> mail-mta/postfix-3.8.5 Wed Jan 24 22:06:40 2024 >>> x11-apps/xbiff-1.0.5 Wed Jan 24 22:06:54 2024 >>> dev-python/mako-1.3.1 Wed Jan 24 22:07:07 2024 >>> dev-python/pluggy-1.4.0
I was expecting to see a gcc upgrade in the list, but no. We have seen GCC regressions in the past (bug 905634) where memory usage balloons and we can get that fixed if we can identify the bad command then can work on reducing the bad file. Does it happen with -j1? We really need to try figure out which command is going nuts here. `ps faux` when stuck too would be good. Maybe try figure out how far into it that it goes crazy, then use `timeout ...` so it gets killed?
wrt memory, may want to try disabling swap -- if something does balloon up it'll get killed by the OOM killer rather than partially fill that 32GB of swap and potentially hang the system due to poor i/o scheduling.
> (In reply to Sam James from comment #10) > I was expecting to see a gcc upgrade in the list, but no. We have seen GCC > regressions in the past (bug 905634) where memory usage balloons and we can > get that fixed if we can identify the bad command then can work on reducing > the bad file. There was 1 day _before_ successfull emerge of older qtwebengine an update: Sat Jan 20 22:50:37 2024 >>> sys-devel/gcc-13.2.1_p20240113-r1 > Does it happen with -j1? We really need to try figure out which command is > going nuts here. `ps faux` when stuck too would be good. Maybe try figure > out how far into it that it goes crazy, then use `timeout ...` so it gets > killed? Yes, it happens with -j1 too. My problem is, how can I debug something here. The main challenge here is, that immediately after the output of my initial comment, cpu runs at 100% and everything hangs. It does _not_ freeze, but I am not able to execute any command. I can still type it in my second opened terminal, but it does not finish. I waited about for an hour for some simple "ls" command. Eben spawning a new terminal does not work. The windows shows up, but the loaded shell interpeter seems also stuck at load. It's like the whole system runs at 150% load. I can hear fans running at maximum. Even aborting with "CTRL+C2 does not work. I get the message "Exiting on signal 2", but that's all. It does not come back to a shell. Only turning off and on the whole system helps. I did a small script and logged every 0.1 second the outpot of "ps faux". It stopped logging after the system started to hang again. Can you see something interesting in the output? (In reply to Ionen Wolkens from comment #11) > wrt memory, may want to try disabling swap -- if something does balloon up > it'll get killed by the OOM killer rather than partially fill that 32GB of > swap and potentially hang the system due to poor i/o scheduling. I did a try and disabled with "swapoff /dev/gentoo/swap" and it still hangs. I waited about 20 minutes, but no OOM.
Created attachment 883134 [details] ps.log
oh, interesting: """ portage 6640 200 0.0 12240 7592 pts/4 R+ 22:28 0:00 \_ /usr/lib64/qt5/bin/qmake -o Makefile.core_generator /var/tmp/portage/dev-qt/qtwebengine-5.15.12_p20240122/work/qtwebengine-5.15.12_p20240122/src/core/core_generator.pro CONFIG+=release CONFIG-=debug QMAKE_AR=x86_64-pc-linux-gnu-ar cqs QMAKE_CC=x86_64-pc-linux-gnu-gcc QMAKE_LINK_C=x86_64-pc-linux-gnu-gcc QMAKE_LINK_C_SHLIB=x86_64-pc-linux-gnu-gcc QMAKE_CXX=x86_64-pc-linux-gnu-g++ QMAKE_LINK=x86_64-pc-linux-gnu-g++ QMAKE_LINK_SHLIB=x86_64-pc-linux-gnu-g++ QMAKE_OBJCOPY=x86_64-pc-linux-gnu-objcopy QMAKE_RANLIB= QMAKE_STRIP=x86_64-pc-linux-gnu-strip QMAKE_CFLAGS=-march=native -mfpmath=sse,387 -O3 -frecord-gcc-switches -fomit-frame-pointer -malign-data=abi -mtls-dialect=gnu2 -pipe QMAKE_CFLAGS_RELEASE= QMAKE_CFLAGS_DEBUG= QMAKE_CXXFLAGS=-march=native -mfpmath=sse,387 -O3 -frecord-gcc-switches -fomit-frame-pointer -malign-data=abi -mtls-dialect=gnu2 -pipe -fvisibility-inlines-hidden QMAKE_CXXFLAGS_RELEASE= QMAKE_CXXFLAGS_DEBUG= QMAKE_LFLAGS=-Wl,--as-needed -Wl,--defsym=__gentoo_check_ldflags__=0 -Wl,-O1 -Wl,--sort-common -Wl,-z,now -Wl,--undefined-version QMAKE_LFLAGS_RELEASE= QMAKE_LFLAGS_DEBUG= """ It's curious if qmake is really the thing guzzling resources rather than gcc spawned by it. Can you try this in make.conf to see if it helps at least a bit wrt interactivity when the bug happens? ``` PORTAGE_NICENESS="19" PORTAGE_IONICE_COMMAND="ionice -c 3 -p \${PID} PORTAGE_SCHEDULING_POLICY="idle" ```
(In reply to Sam James from comment #14) > [...] > PORTAGE_IONICE_COMMAND="ionice -c 3 -p \${PID} "
(but maybe that's just an artefact from qmake not yet spawning gcc and you got unlucky)
Created attachment 883643 [details] ps.log.gz Here we go. I did run "ps faux" every 0.1 seconds from start of emerge.
At least, I was now able to cancle portage with ctrl+c. It took about 2 minutes until I was back at prompt.
Can you do it with MAKEOPTS="-j1" please? There's a few processes but it's hard to see which one is problematic.
(In reply to Sam James from comment #19) > Can you do it with MAKEOPTS="-j1" please? There's a few processes but it's > hard to see which one is problematic. Whoops, sorry.
Created attachment 884243 [details] ps.log.gz Compiled with MAKEOPTS="-j1"
huh, so it's gn going nuts? portage 7182 369 0.3 608116 128604 pts/4 SNl+ 22:03 3:47 \_ /var/tmp/portage/dev-qt/qtwebengine-5.15.12_p20240122/work/qtwebengine-5.15.12_p20240122_build/src/3rdparty/gn/out/Release/gn gen [...]
What does it do?
Now I am totally confused. I wanted to try to reproduce it again and now unable to do so. Emerging did now worked without any problems? Do you have any explanationfor that? This are all packages updated after my last unsuccessfull try. I don't see any connection here? Sun Feb 4 22:33:14 2024 >>> sys-libs/glibc-2.38-r10 Sun Feb 4 22:33:48 2024 >>> app-text/libpaper-2.1.3 Sun Feb 4 22:34:03 2024 >>> sys-libs/timezone-data-2024a Sun Feb 4 22:35:17 2024 >>> media-libs/openh264-2.4.1 Sun Feb 4 22:35:48 2024 >>> media-libs/libpng-1.6.42 Sun Feb 4 22:37:04 2024 >>> net-dns/c-ares-1.26.0 Sun Feb 4 22:38:14 2024 >>> sys-libs/libxcrypt-4.4.36-r2 Sun Feb 4 22:38:31 2024 >>> dev-build/automake-1.16.5-r2 Sun Feb 4 22:41:38 2024 >>> dev-db/sqlite-3.45.1 Sun Feb 4 22:53:37 2024 >>> dev-libs/openssl-3.2.1-r1 Sun Feb 4 22:53:52 2024 >>> app-misc/ca-certificates-20230311.3.97 Sun Feb 4 22:54:03 2024 >>> dev-python/platformdirs-4.2.0 Sun Feb 4 22:56:54 2024 >>> net-misc/curl-8.6.0 Sun Feb 4 22:59:50 2024 >>> media-libs/libvpx-1.14.0 Sun Feb 4 23:02:19 2024 >>> sys-apps/coreutils-9.4-r1 Sun Feb 4 23:02:30 2024 >>> dev-python/hyperframe-6.0.1-r1 Sun Feb 4 23:02:41 2024 >>> dev-python/hpack-4.0.0-r1 Sun Feb 4 23:03:09 2024 >>> dev-libs/libusb-1.0.27 Sun Feb 4 23:03:23 2024 >>> dev-python/markupsafe-2.1.5 Sun Feb 4 23:03:35 2024 >>> dev-python/trove-classifiers-2024.1.31 Sun Feb 4 23:03:47 2024 >>> dev-python/pytz-2024.1 Sun Feb 4 23:05:33 2024 >>> dev-debug/strace-6.7 Sun Feb 4 23:05:48 2024 >>> net-misc/iputils-20240117 Sun Feb 4 23:05:59 2024 >>> dev-python/h2-4.1.0-r1 Sun Feb 4 23:06:14 2024 >>> dev-python/poetry-core-1.9.0 Sun Feb 4 23:06:28 2024 >>> dev-python/mako-1.3.2 Sun Feb 4 23:06:39 2024 >>> sys-apps/ed-1.20 Sun Feb 4 23:06:51 2024 >>> app-portage/gpyutils-0.13 Sun Feb 4 23:32:48 2024 >>> dev-python/urllib3-2.2.0 Sun Feb 4 23:36:21 2024 >>> dev-util/intel_clc-24.0.0 Mon Feb 5 00:00:04 2024 >>> media-libs/mesa-24.0.0 Mon Feb 5 00:04:27 2024 >>> media-video/rav1e-0.7.1 Mon Feb 5 00:04:40 2024 >>> x11-misc/xdg-utils-1.2.0 Mon Feb 5 00:05:38 2024 >>> media-libs/libpulse-17.0 Mon Feb 5 00:14:09 2024 >>> dev-build/cmake-3.28.2 Mon Feb 5 00:15:37 2024 >>> media-libs/libjpeg-turbo-3.0.2 Mon Feb 5 00:22:07 2024 >>> media-libs/libaom-3.8.1 Mon Feb 5 00:25:31 2024 >>> media-video/ffmpeg-6.1.1-r2 Mon Feb 5 00:31:57 2024 >>> media-video/pipewire-1.0.3 Mon Feb 5 00:33:13 2024 >>> media-libs/libheif-1.15.2 Mon Feb 5 00:33:57 2024 >>> net-firewall/iptables-1.8.10 Mon Feb 5 00:46:25 2024 >>> dev-libs/protobuf-23.3-r2 Mon Feb 5 00:46:40 2024 >>> media-sound/ncpamixer-1.3.7 Mon Feb 5 00:46:59 2024 >>> www-client/google-chrome-121.0.6167.139 Mon Feb 5 00:47:14 2024 >>> www-client/opera-106.0.4998.70 Mon Feb 5 00:50:12 2024 >>> app-text/poppler-24.02.0 Mon Feb 5 00:50:33 2024 >>> media-fonts/iosevka-28.1.0 Mon Feb 5 00:52:19 2024 >>> sys-kernel/gentoo-sources-6.7.3 Mon Feb 5 06:22:04 2024 >>> dev-qt/qtwebengine-5.15.12_p20240122
Only thing in there that I can think "could" have some impact is nodejs. Does use some other things like libvpx, libpng, and libpulse, but all it does is link with them. Maybe it could still be (wrongly) picking up things from protobuf too. Not that any of these would affect Gn directly if it's what was causing issues. Gn itself has no dependencies beside a libc, but I don't see how the glibc-2.38-r10 update could remotely be related. Maybe it could be some odd hardware bug of some kind that only trigger when the stars align (like the znver1 cpu bug). That nobody else seem to be hitting this makes it curious. With some luck maybe it'll never come back.
Well, if booted that new kernel from -sources I guess it could have something to do with it too. Maybe there was some nasty kernel bug only hitting your hardware.
