Compiling with Clang and USE flag h=www-client/firefox-68.11.0 build hangs; see build.log Reaches the endpoint of build.log and stops using CPU, portage still shows process in ps aux. Similarly, this also occurs for me in v. 79.0-r2, just at a different point. I can follow up with a build.log for 79.0-r2, trying to give my CPU a break after 4 failed emerges :) emerge -pqv [ebuild N ] www-client/firefox-68.11.0 USE="clang dbus eme-free gmp-autoupdate hwaccel lto openh264 pgo pulseaudio screenshot startup-notification system-av1 system-harfbuzz system-icu system-jpeg system-libevent system-libvpx system-sqlite system-webp wifi -bindist -custom-cflags -custom-optimization -debug -geckodriver -hardened -jack (-selinux) -test -wayland" CPU_FLAGS_X86="-avx2" L10N="-ach -af -an -ar -ast -az -be -bg -bn -br -bs -ca -cak -cs -cy -da -de -dsb -el -en-CA -en-GB -eo -es-AR -es-CL -es-ES -es-MX -et -eu -fa -ff -fi -fr -fy -ga -gd -gl -gn -gu -he -hi -hr -hsb -hu -hy -ia -id -is -it -ja -ka -kab -kk -km -kn -ko -lij -lt -lv -mk -mr -ms -my -nb -nl -nn -oc -pa -pl -pt-BR -pt-PT -rm -ro -ru -si -sk -sl -son -sq -sr -sv -ta -te -th -tr -uk -ur -uz -vi -xh -zh-CN -zh-TW" emerge --info Portage 3.0.2 (python 3.7.8-final-0, default/linux/amd64/17.1/desktop, gcc-9.3.0, glibc-2.31-r6, 5.8.0-x86_64+ x86_64) ================================================================= System uname: Linux-5.8.0-x86_64+-x86_64-Intel-R-_Core-TM-_i7-9750H_CPU_@_2.60GHz-with-gentoo-2.7 KiB Mem: 14007324 total, 10472408 free KiB Swap: 16777212 total, 16777212 free Timestamp of repository gentoo: Mon, 10 Aug 2020 22:05:01 +0000 Head commit of repository gentoo: ee1fe67c7a6787db20b3fac5c6cc34b44db20fa0 sh bash 5.0_p18 ld GNU ld (Gentoo 2.33.1 p2) 2.33.1 app-shells/bash: 5.0_p18::gentoo dev-lang/perl: 5.30.3-r1::gentoo dev-lang/python: 2.7.18-r1::gentoo, 3.7.8-r2::gentoo, 3.8.5::gentoo, 3.9.0_beta5::gentoo dev-util/cmake: 3.18.1::gentoo sys-apps/baselayout: 2.7::gentoo sys-apps/openrc: 0.42.1::gentoo sys-apps/sandbox: 2.20::gentoo sys-devel/autoconf: 2.13-r1::gentoo, 2.69-r5::gentoo sys-devel/automake: 1.16.2::gentoo sys-devel/binutils: 2.33.1-r1::gentoo, 2.34-r2::gentoo sys-devel/gcc: 9.3.0-r1::gentoo, 10.2.0::gentoo sys-devel/gcc-config: 2.3.1::gentoo sys-devel/libtool: 2.4.6-r6::gentoo sys-devel/make: 4.3::gentoo sys-kernel/linux-headers: 5.8::gentoo (virtual/os-headers) sys-libs/glibc: 2.31-r6::gentoo Repositories: gentoo location: /var/db/repos/gentoo sync-type: rsync sync-uri: rsync://rsync.gentoo.org/gentoo-portage priority: -1000 sync-rsync-verify-metamanifest: yes sync-rsync-verify-max-age: 24 sync-rsync-verify-jobs: 1 sync-rsync-extra-opts: matrix location: /var/lib/layman/matrix masters: gentoo priority: 50 ACCEPT_KEYWORDS="amd64 ~amd64" ACCEPT_LICENSE="@FREE" CBUILD="x86_64-pc-linux-gnu" CFLAGS="-march=native -O2 -Wall" CHOST="x86_64-pc-linux-gnu" CONFIG_PROTECT="/etc /usr/share/gnupg/qualified.txt" CONFIG_PROTECT_MASK="/etc/ca-certificates.conf /etc/dconf /etc/env.d /etc/fonts/fonts.conf /etc/gconf /etc/gentoo-release /etc/revdep-rebuild /etc/sandbox.d /etc/terminfo" CXXFLAGS="-march=native -O2 -Wall" DISTDIR="/var/cache/distfiles" ENV_UNSET="DBUS_SESSION_BUS_ADDRESS DISPLAY GOBIN GOPATH PERL5LIB PERL5OPT PERLPREFIX PERL_CORE PERL_MB_OPT PERL_MM_OPT XAUTHORITY XDG_CACHE_HOME XDG_CONFIG_HOME XDG_DATA_HOME XDG_RUNTIME_DIR" FCFLAGS="-march=native -O2 -Wall" FEATURES="assume-digests binpkg-docompress binpkg-dostrip binpkg-logs config-protect-if-modified distlocks ebuild-locks fixlafiles ipc-sandbox merge-sync multilib-strict network-sandbox news parallel-fetch pid-sandbox preserve-libs protect-owned qa-unresolved-soname-deps sandbox sfperms strict unknown-features-warn unmerge-logs unmerge-orphans userfetch userpriv usersandbox usersync xattr" FFLAGS="-march=native -O2 -Wall" GENTOO_MIRRORS="ftp://mirror.csclub.uwaterloo.ca/gentoo-distfiles/ https://mirror.csclub.uwaterloo.ca/gentoo-distfiles/ http://mirror.csclub.uwaterloo.ca/gentoo-distfiles/ http://www.gtlib.gatech.edu/pub/gentoo rsync://rsync.gtlib.gatech.edu/gentoo https://gentoo.osuosl.org/ http://gentoo.osuosl.org/ https://mirrors.rit.edu/gentoo/ http://mirrors.rit.edu/gentoo/ ftp://mirrors.rit.edu/gentoo/ rsync://mirrors.rit.edu/gentoo/" LANG="en_US.utf8" LDFLAGS="-Wl,-O1 -Wl,--as-needed" MAKEOPTS="-j8" PKGDIR="/var/cache/binpkgs" PORTAGE_CONFIGROOT="/" PORTAGE_RSYNC_OPTS="--recursive --links --safe-links --perms --times --omit-dir-times --compress --force --whole-file --delete --stats --human-readable --timeout=180 --exclude=/distfiles --exclude=/local --exclude=/packages --exclude=/.git" PORTAGE_TMPDIR="/var/tmp" USE="X a52 aac aalib acl acpi alsa amd64 berkdb bluetooth branding bzip2 cairo cdda cdr cjk cli crypt cups dbus djvu dri dts dvd dvdr elogind emboss encode exif fcitx4 ffmpeg flac fontconfig fortran ftp gdbm gif git gpm gtk hddtemp iconv icu imagemagick imap ipv6 jpeg lcms ldap libnotify libtirpc lm-sensors mad matroska mbox mng mp3 mp4 mpeg mplayer mtp multilib musepack ncurses nls nptl offensive ogg opengl openmp opus pam pango pcre pdf pmcia png policykit ppds pulseaudio qt5 raw readline sdl seccomp sound spell split-usr ssl startup-notification svg tcpd theora threads tiff truetype udev udisks unicode upower usb vaapi vnc vorbis vulkan webp wifi wxwidgets x264 xattr xcb xml xv xvid zlib" ABI_X86="64" ADA_TARGET="gnat_2018" ALSA_CARDS="ali5451 als4000 atiixp atiixp-modem bt87x ca0106 cmipci emu10k1x ens1370 ens1371 es1938 es1968 fm801 hda-intel intel8x0 intel8x0m maestro3 trident usb-audio via82xx via82xx-modem ymfpci" APACHE2_MODULES="authn_core authz_core socache_shmcb unixd actions alias auth_basic authn_alias authn_anon authn_dbm authn_default authn_file authz_dbm authz_default authz_groupfile authz_host authz_owner authz_user autoindex cache cgi cgid dav dav_fs dav_lock deflate dir disk_cache env expires ext_filter file_cache filter headers include info log_config logio mem_cache mime mime_magic negotiation rewrite setenvif speling status unique_id userdir usertrack vhost_alias" CALLIGRA_FEATURES="karbon sheets words" COLLECTD_PLUGINS="df interface irq load memory rrdtool swap syslog" CPU_FLAGS_X86="mmx mmxext sse sse2" ELIBC="glibc" GPSD_PROTOCOLS="ashtech aivdm earthmate evermore fv18 garmin garmintxt gpsclock greis isync itrax mtk3301 nmea ntrip navcom oceanserver oldstyle oncore rtcm104v2 rtcm104v3 sirf skytraq superstar2 timing tsip tripmate tnt ublox ubx" GRUB_PLATFORMS="efi-64" INPUT_DEVICES="libinput keyboard mouse" KERNEL="linux" LCD_DEVICES="bayrad cfontz cfontz633 glk hd44780 lb216 lcdm001 mtxorb ncurses text" LIBREOFFICE_EXTENSIONS="presenter-console presenter-minimizer" OFFICE_IMPLEMENTATION="libreoffice" PHP_TARGETS="php7-2 php7-3" POSTGRES_TARGETS="postgres10 postgres11" PYTHON_SINGLE_TARGET="python3_7" PYTHON_TARGETS="python3_7" RUBY_TARGETS="ruby25" USERLAND="GNU" VIDEO_CARDS="intel i965" XTABLES_ADDONS="quota2 psd pknock lscan length2 ipv4options ipset ipp2p iface geoip fuzzy condition tee tarpit sysrq steal rawnat logmark ipmark dhcpmac delude chaos account" Unset: CC, CPPFLAGS, CTARGET, CXX, EMERGE_DEFAULT_OPTS, INSTALL_MASK, LC_ALL, LINGUAS, PORTAGE_BINHOST, PORTAGE_BUNZIP2_COMMAND, PORTAGE_COMPRESS, PORTAGE_COMPRESS_FLAGS, PORTAGE_RSYNC_EXTRA_OPTS
-"with Clang and USE flag h", oops
build.log https://gist.githubusercontent.com/bxb5544/fec2885cf40d7b75fd21464379530181/raw/7ffb1aa1bcf924b8db14c2d5d1fcc55e8ef75088/build.log
(In reply to brookebasile from comment #2) > build.log > https://gist.githubusercontent.com/bxb5544/fec2885cf40d7b75fd21464379530181/ > raw/7ffb1aa1bcf924b8db14c2d5d1fcc55e8ef75088/build.log Please upload the (compressed if needed) full build.log via Bugzilla for posterity.
Created attachment 654085 [details] 68.11.0 failed build.log
is this your full build log, or is it cut off? 36:02.46 /var/tmp/portage/www-client/firefox-68.11.0/work/firefox-68.11.0/ff/_virtualenvs/init/bin/python -m mozbuild.action.zip -C ../../dist/xpi-stage/locale-en-US -x **/*.manifest -x **/*.js -x **/*.ini /var/tmp/portage/www-client/firefox-68.11.0/work/firefox-68.11.0/ff/dist/linux-x86_64/xpi/firefox-68.11.0.en-US.langpack.xpi chrome localization browser manifest.json 36:02.46 gmake[6]: Leaving directory '/var/tmp/portage/www-client/firefox-68.11.0/work/firefox-68.11.0/ff/browser/locales' 36:02.46 gmake[4]: Nothing to be done for 'tools'. 8 I do have a similar problem on arm, where emerge hangs infinitivly while consuming a whole core doing something python related with ./mach, but that is with sys-libs/musl as the systems libc which is why I never posted the issue. But this isn't the case for you, emerge hangs but it's not consuming any cpu, right?
(In reply to tt_1 from comment #5) > is this your full build log, or is it cut off? > > 36:02.46 > /var/tmp/portage/www-client/firefox-68.11.0/work/firefox-68.11.0/ff/ > _virtualenvs/init/bin/python -m mozbuild.action.zip -C > ../../dist/xpi-stage/locale-en-US -x **/*.manifest -x **/*.js -x **/*.ini > /var/tmp/portage/www-client/firefox-68.11.0/work/firefox-68.11.0/ff/dist/ > linux-x86_64/xpi/firefox-68.11.0.en-US.langpack.xpi chrome localization > browser manifest.json > 36:02.46 gmake[6]: Leaving directory > '/var/tmp/portage/www-client/firefox-68.11.0/work/firefox-68.11.0/ff/browser/ > locales' > 36:02.46 gmake[4]: Nothing to be done for 'tools'. > 8 > > > I do have a similar problem on arm, where emerge hangs infinitivly while > consuming a whole core doing something python related with ./mach, but that > is with sys-libs/musl as the systems libc which is why I never posted the > issue. > > But this isn't the case for you, emerge hangs but it's not consuming any > cpu, right? Yes, that's where it hangs, and stops using CPU; no errors or anything. It does show some portage processes in ps aux though, I can follow up with the specifics there (I didn't copy them before, woops.) I actually left my initial emerge going and stepped away from my machine for some time, came back to see that it was hanging and ran genlop to see that it had been hanging for 4+ hours. I don't think RAM is the issue, I have 16gb+16gb of swap.
Here's the running processes after the hang + genlop: sleepy@seraph ~/firefox79 $ ps aux | grep portage portage 6356 2.2 0.2 362280 30640 pts/2 Sl+ 02:08 1:19 /var/tmp/portage/www-client/firefox-68.11.0/work/firefox-68.11.0/ff/_virtualenvs/init/bin/python /var/tmp/portage/www-client/firefox-68.11.0/work/firefox-68.11.0/build/pgo/profileserver.py portage 6535 0.0 0.1 362280 22640 pts/2 S 02:08 0:00 /var/tmp/portage/www-client/firefox-68.11.0/work/firefox-68.11.0/ff/_virtualenvs/init/bin/python /var/tmp/portage/www-client/firefox-68.11.0/work/firefox-68.11.0/build/pgo/profileserver.py portage 6536 0.2 2.9 3129916 411508 pts/2 Sl 02:08 0:07 /var/tmp/portage/www-client/firefox-68.11.0/work/firefox-68.11.0/ff/dist/firefox/firefox http://localhost:8888/index.html -profile /var/tmp/portage/www-client/firefox-68.11.0/temp/tmpUZWTm1 sleepy 6830 0.0 0.0 7852 564 pts/1 S+ 03:08 0:00 grep --colour=auto portage root 28175 0.0 0.0 15676 9368 pts/0 S+ 01:31 0:00 /usr/bin/python3.7m /usr/lib/portage/python3.7/pid-ns-init 28176 root 28176 0.0 0.0 15680 9632 pts/2 Ss+ 01:31 0:00 /usr/bin/python3.7m /usr/lib/portage/python3.7/pid-ns-init 250 250 250 18 0,1,2 /usr/bin/sandbox [www-client/firefox-68.11.0] sandbox /usr/lib/portage/python3.7/ebuild.sh compile portage 28179 0.0 0.0 2312 1584 pts/2 S+ 01:31 0:00 [www-client/firefox-68.11.0] sandbox /usr/lib/portage/python3.7/ebuild.sh compile portage 28180 0.0 0.0 14644 9148 pts/2 S+ 01:31 0:00 /bin/bash /usr/lib/portage/python3.7/ebuild.sh compile portage 28201 0.0 0.0 14820 8240 pts/2 S+ 01:31 0:00 /bin/bash /usr/lib/portage/python3.7/ebuild.sh compile portage 28224 0.0 0.4 1910252 56656 pts/2 Sl+ 01:31 0:00 /usr/bin/Xvfb :1 -screen 0 1280x1024x24 +extension RANDR portage 28257 3.0 0.2 185412 38432 pts/2 Sl+ 01:31 2:56 python2.7 ./mach build --verbose portage 28278 0.0 0.0 3276 2312 pts/2 S+ 01:31 0:00 /usr/bin/gmake -f client.mk portage 28281 0.0 0.0 3944 2940 pts/2 S+ 01:31 0:00 /usr/bin/gmake -j8 -O -C /var/tmp/portage/www-client/firefox-68.11.0/work/firefox-68.11.0/ff sleepy@seraph ~/firefox79 $ genlop -c Currently merging 2 out of 2 * www-client/firefox-68.11.0 current merge time: 1 hour, 39 minutes and 17 seconds. ETA: unknown.
Created attachment 654332 [details] 79.0-r2 failed build.log
Created attachment 654334 [details] 79.0-r2 - different machine, same flags - successful build.log
I've attached the failed build.log for 79.0-r2 as well. I can open up a separate bug if that is more appropriate. Here the emerge hangs as well, same behavior, just at a different location. On another machine I was able to emerge 79.0-r2 just fine, but I noticed that the build encountered the same error, just didn't hang. Again here's the leftover processes in ps aux after the hang: sleepy@seraph ~ $ ps aux | grep portage portage 13832 0.8 0.2 365444 33656 pts/2 Sl+ Aug11 3:49 /var/tmp/portage/www-client/firefox-79.0-r2/work/firefox-79.0/ff/instrumented/_virtualenvs/init_py3/bin/python /var/tmp/portage/www-client/firefox-79.0-r2/work/firefox-79.0/build/pgo/profileserver.py portage 14134 0.0 0.1 365188 23884 pts/2 S Aug11 0:00 /var/tmp/portage/www-client/firefox-79.0-r2/work/firefox-79.0/ff/instrumented/_virtualenvs/init_py3/bin/python /var/tmp/portage/www-client/firefox-79.0-r2/work/firefox-79.0/build/pgo/profileserver.py portage 14135 0.0 2.3 3020940 330920 pts/2 Sl Aug11 0:19 /var/tmp/portage/www-client/firefox-79.0-r2/work/firefox-79.0/ff/instrumented/dist/firefox/firefox http://localhost:8888/index.html -profile /var/tmp/portage/www-client/firefox-79.0-r2/temp/tmpg4z68gpr portage 14262 0.0 1.2 2507308 177524 pts/2 Sl Aug11 0:04 /var/tmp/portage/www-client/firefox-79.0-r2/work/firefox-79.0/ff/instrumented/dist/firefox/firefox -contentproc -childID 1 -isForBrowser -prefsLen 1 -prefMapSize 222186 -parentBuildID 20200811165411 -appdir /var/tmp/portage/www-client/firefox-79.0-r2/work/firefox-79.0/ff/instrumented/dist/firefox/browser 18904 tab portage 14311 0.0 1.1 2502312 160356 pts/2 Sl Aug11 0:14 /var/tmp/portage/www-client/firefox-79.0-r2/work/firefox-79.0/ff/instrumented/dist/firefox/firefox -contentproc -childID 2 -isForBrowser -prefsLen 6965 -prefMapSize 222186 -parentBuildID 20200811165411 -appdir /var/tmp/portage/www-client/firefox-79.0-r2/work/firefox-79.0/ff/instrumented/dist/firefox/browser 18904 tab portage 14362 0.0 1.4 2530728 197012 pts/2 Sl Aug11 0:01 /var/tmp/portage/www-client/firefox-79.0-r2/work/firefox-79.0/ff/instrumented/dist/firefox/firefox -contentproc -childID 3 -isForBrowser -prefsLen 7737 -prefMapSize 222186 -parentBuildID 20200811165411 -appdir /var/tmp/portage/www-client/firefox-79.0-r2/work/firefox-79.0/ff/instrumented/dist/firefox/browser 18904 tab portage 14398 0.0 0.8 2481760 120936 pts/2 Sl Aug11 0:00 /var/tmp/portage/www-client/firefox-79.0-r2/work/firefox-79.0/ff/instrumented/dist/firefox/firefox -contentproc -childID 4 -isForBrowser -prefsLen 7813 -prefMapSize 222186 -parentBuildID 20200811165411 -appdir /var/tmp/portage/www-client/firefox-79.0-r2/work/firefox-79.0/ff/instrumented/dist/firefox/browser 18904 tab sleepy 15711 0.0 0.0 7980 2140 pts/1 S+ 01:25 0:00 grep --colour=auto portage root 27547 0.0 0.0 15676 9328 pts/0 S+ Aug11 0:00 /usr/bin/python3.7m /usr/lib/portage/python3.7/pid-ns-init 27548 root 27548 0.0 0.0 15680 9680 pts/2 Ss+ Aug11 0:00 /usr/bin/python3.7m /usr/lib/portage/python3.7/pid-ns-init 250 250 250 18 0,1,2 /usr/bin/sandbox [www-client/firefox-79.0-r2] sandbox /usr/lib/portage/python3.7/ebuild.sh compile portage 27551 0.0 0.0 2312 1656 pts/2 S+ Aug11 0:00 [www-client/firefox-79.0-r2] sandbox /usr/lib/portage/python3.7/ebuild.sh compile portage 27552 0.0 0.0 14644 9092 pts/2 S+ Aug11 0:00 /bin/bash /usr/lib/portage/python3.7/ebuild.sh compile portage 27573 0.0 0.0 14808 8260 pts/2 S+ Aug11 0:00 /bin/bash /usr/lib/portage/python3.7/ebuild.sh compile portage 27596 0.0 0.4 1910280 57068 pts/2 Sl+ Aug11 0:01 /usr/bin/Xvfb :1 -screen 0 1280x1024x24 +extension RANDR portage 27629 0.0 0.4 242696 59352 pts/2 S+ Aug11 0:24 /usr/bin/python3.8 ./mach build --verbose sleepy@seraph ~ $ genlop -c Currently merging 2 out of 2 * www-client/firefox-79.0-r2 current merge time: 8 hours, 34 minutes and 5 seconds. ETA: unknown. sleepy@seraph ~ $ I took a nap while I let this emerge so that's why it says 8 hours.. :)
I'm sorry, but I can't help you that much with this. Things you can try are: sort out your mix of binutils/gcc, try to flip the avx2 useflag, and see wether it makes any differences if you use dev-lang/rust or rust-bin instead of. But first of all, get rid of the pgo useflag, it's got a bad reputation for being unstable. Maybe it's +pgo and -avx2? Do you use a stable nodejs? Any superfancy cflags that override the defaults?
Is this still a problem with >=firefox-88?
