Fails to build.
Created attachment 557550 [details] build.log (xzipped)
Created attachment 557552 [details] output of emerge --info firefox
Compiles successfully with MAKEOPTS="-j8", breaks with MAKEOPTS="-j20", also reported in #gentoo-dev that MAKEOPTS="-j13" breaks. firefox-63.0.3 works fine.
MAKEOPTS=-j10 breaks, MAKEOPTS=-j9 works fine.
Also found anything over MAKEOPTS=-j9 fails. My normal setting is 16.
I have found that MAKEOPTS="-j12" will break, but only if I enable the geckodriver, hwaccel, or lto USE flags. By which I mean enabling any of those, or any combination of them (the power set of them) causes it to break. Will attempt to emerge with different makeopts.
The log says "configure:9799:23: error: #error "Insufficient libpng version (10635 required)."" I'll try with that dep version media-libs/libpng-1.6.35-r1
builds fine with-j64 for me emerge --info firefox Portage 2.3.52 (python 3.6.6-final-0, default/linux/amd64/17.1/no-multilib/hardened, gcc-8.2.0, glibc-2.28-r2, 4.19.8-gentoo x86_64) ================================================================= System Settings ================================================================= System uname: Linux-4.19.8-gentoo-x86_64-AMD_Ryzen_Threadripper_2990WX_32-Core_Processor-with-gentoo-2.6 KiB Mem: 130817032 total, 112285528 free KiB Swap: 0 total, 0 free Timestamp of repository gentoo: Tue, 11 Dec 2018 03:24:19 +0000 Head commit of repository gentoo: 59d1ae20e09b8d989c49471a3b86df9c093acec6 Timestamp of repository rust: Fri, 07 Dec 2018 13:26:29 +0000 Head commit of repository rust: 7c5c4e5ee1b0bfb1f13b174dbe8e29975367a477 sh bash 4.4_p23 ld GNU ld (Gentoo 2.31.1 p4) 2.31.1 distcc[56093] (dcc_mkdir) ERROR: mkdir '/tmp/portage/.distcc/state' failed: No such file or directory [disabled] app-shells/bash: 4.4_p23::gentoo dev-java/java-config: 2.2.0-r4::gentoo dev-lang/perl: 5.26.2::gentoo dev-lang/python: 2.7.15::gentoo, 3.6.6::gentoo dev-util/cmake: 3.13.1::gentoo dev-util/pkgconfig: 0.29.2::gentoo sys-apps/baselayout: 2.6-r1::gentoo sys-apps/openrc: 0.40.2::gentoo sys-apps/sandbox: 2.14::gentoo sys-devel/autoconf: 2.13::gentoo, 2.69-r4::gentoo sys-devel/automake: 1.16.1-r1::gentoo sys-devel/binutils: 2.31.1-r2::gentoo sys-devel/gcc: 8.2.0-r5::gentoo sys-devel/gcc-config: 2.0::gentoo sys-devel/libtool: 2.4.6-r5::gentoo sys-devel/make: 4.2.1-r4::gentoo sys-kernel/linux-headers: 4.19::gentoo (virtual/os-headers) sys-libs/glibc: 2.28-r2::gentoo Repositories: gentoo location: /var/db/repos/gentoo sync-type: git sync-uri: https://github.com/gentoo-mirror/gentoo.git priority: -1000 sync-git-verify-commit-signature: true sync-git-clone-extra-opts: -b master gyakovlev location: /var/db/repos/gyakovlev masters: gentoo rust location: /var/db/repos/rust sync-type: git sync-uri: https://github.com/gentoo-mirror/rust.git masters: gentoo Installed sets: @myfonts ACCEPT_KEYWORDS="amd64 ~amd64" ACCEPT_LICENSE="* -@EULA" CBUILD="x86_64-pc-linux-gnu" CFLAGS="-march=native -O2 -pipe -frecord-gcc-switches" CHOST="x86_64-pc-linux-gnu" CONFIG_PROTECT="/etc /usr/share/config /usr/share/gnupg/qualified.txt" CONFIG_PROTECT_MASK="/etc/ca-certificates.conf /etc/dconf /etc/env.d /etc/fonts/fonts.conf /etc/gconf /etc/gentoo-release /etc/revdep-rebuild /etc/sandbox.d /etc/terminfo" CXXFLAGS="-march=native -O2 -pipe -frecord-gcc-switches" DISTDIR="/var/cache/distfiles" EMERGE_DEFAULT_OPTS="--ask-enter-invalid --jobs=32 --load-average 63 --quiet-build" ENV_UNSET="DBUS_SESSION_BUS_ADDRESS DISPLAY GOBIN PERL5LIB PERL5OPT PERLPREFIX PERL_CORE PERL_MB_OPT PERL_MM_OPT XAUTHORITY XDG_CACHE_HOME XDG_CONFIG_HOME XDG_DATA_HOME XDG_RUNTIME_DIR" FCFLAGS="-march=native -O2 -pipe -frecord-gcc-switches" FEATURES="assume-digests binpkg-docompress binpkg-dostrip binpkg-logs buildpkg cgroup collision-protect compressdebug config-protect-if-modified distlocks ebuild-locks fixlafiles ipc-sandbox merge-sync multilib-strict network-sandbox news parallel-fetch parallel-install preserve-libs protect-owned sandbox sfperms sign splitdebug strict strict-keepdir unknown-features-warn unmerge-logs unmerge-orphans userfetch userpriv usersandbox usersync xattr" FFLAGS="-march=native -O2 -pipe -frecord-gcc-switches" GENTOO_MIRRORS="https://gentoo.osuosl.org/" LANG="en_US.utf8" LDFLAGS="-Wl,-O1 -Wl,--as-needed -Wl,--defsym=__gentoo_check_ldflags__=0" LINGUAS="en" MAKEOPTS="--jobs=64 --load-average=63 --output-sync=recurse --print-directory" PKGDIR="/var/cache/binpkgs" PORTAGE_CONFIGROOT="/" PORTAGE_RSYNC_OPTS="--recursive --links --safe-links --perms --times --omit-dir-times --compress --force --whole-file --delete --stats --human-readable --timeout=180 --exclude=/distfiles --exclude=/local --exclude=/packages --exclude=/.git" PORTAGE_TMPDIR="/tmp" USE="X a52 aac acl acpi activities alsa amd64 ayatana bash-completion bluetooth bluray branding bzip2 cairo crypt css cups cxx dbus dri dvd elogind exif flac fontconfig gif gpm gtk hardened iconv icu introspection ios ipv6 jpeg kde kipi kwallet libass libnotify libtirpc lm_sensors lz4 lzma lzo mp3 mp4 ncurses nptl numa ogg opengl openmp pam pcre pdf phonon pie plasma png policykit qml qt5 readline seccomp semantic-desktop ssl ssp startup-notification svg tiff truetype udev udisks unicode usb vaapi vdpau vim-syntax vorbis vulkan wayland webp widgets x264 x265 xattr xcb xcomposite xinerama xml xscreensaver xtpax zlib zsh-completion" ABI_X86="64" ALSA_CARDS="ali5451 als4000 atiixp atiixp-modem bt87x ca0106 cmipci emu10k1x ens1370 ens1371 es1938 es1968 fm801 hda-intel intel8x0 intel8x0m maestro3 trident usb-audio via82xx via82xx-modem ymfpci" APACHE2_MODULES="authn_core authz_core socache_shmcb unixd actions alias auth_basic authn_alias authn_anon authn_dbm authn_default authn_file authz_dbm authz_default authz_groupfile authz_host authz_owner authz_user autoindex cache cgi cgid dav dav_fs dav_lock deflate dir disk_cache env expires ext_filter file_cache filter headers include info log_config logio mem_cache mime mime_magic negotiation rewrite setenvif speling status unique_id userdir usertrack vhost_alias" CALLIGRA_FEATURES="karbon plan sheets stage words" CAMERAS="ptp2 fuji" COLLECTD_PLUGINS="df interface irq load memory rrdtool swap syslog" CPU_FLAGS_X86="aes avx avx2 f16c fma3 mmx mmxext pclmul popcnt sse sse2 sse3 sse4_1 sse4_2 sse4a ssse3" ELIBC="glibc" GPSD_PROTOCOLS="ashtech aivdm earthmate evermore fv18 garmin garmintxt gpsclock isync itrax mtk3301 nmea ntrip navcom oceanserver oldstyle oncore rtcm104v2 rtcm104v3 sirf skytraq superstar2 timing tsip tripmate tnt ublox ubx" GRUB_PLATFORMS="efi-64" INPUT_DEVICES="libinput" KERNEL="linux" L10N="en" LCD_DEVICES="bayrad cfontz cfontz633 glk hd44780 lb216 lcdm001 mtxorb ncurses text" LIBREOFFICE_EXTENSIONS="presenter-console presenter-minimizer" OFFICE_IMPLEMENTATION="libreoffice" PHP_TARGETS="php5-6 php7-1" POSTGRES_TARGETS="postgres9_5 postgres10" PYTHON_SINGLE_TARGET="python3_6" PYTHON_TARGETS="python2_7 python3_6" RUBY_TARGETS="ruby25" USERLAND="GNU" VIDEO_CARDS="amdgpu radeon radeonsi" XTABLES_ADDONS="quota2 psd pknock lscan length2 ipv4options ipset ipp2p iface geoip fuzzy condition tee tarpit sysrq steal rawnat logmark ipmark dhcpmac delude chaos account" Unset: CC, CPPFLAGS, CTARGET, CXX, INSTALL_MASK, LC_ALL, PORTAGE_BINHOST, PORTAGE_BUNZIP2_COMMAND, PORTAGE_COMPRESS, PORTAGE_COMPRESS_FLAGS, PORTAGE_RSYNC_EXTRA_OPTS ================================================================= Package Settings ================================================================= www-client/firefox-64.0::gentoo was built with the following: USE="custom-cflags custom-optimization dbus hardened hwaccel lto screenshot startup-notification system-harfbuzz system-icu system-jpeg system-libevent system-libvpx -bindist -clang -debug -eme-free -geckodriver (-gmp-autoupdate) -jack (-neon) -pulseaudio (-selinux) -system-sqlite -test -wifi" L10N="-ach -af -an -ar -as -ast -az -bg -bn-BD -bn-IN -br -bs -ca -cak -cs -cy -da -de -dsb -el -en-GB -en-ZA -eo -es-AR -es-CL -es-ES -es-MX -et -eu -fa -ff -fi -fr -fy -ga -gd -gl -gn -gu -he -hi -hr -hsb -hu -hy -id -is -it -ja -ka -kab -kk -km -kn -ko -lij -lt -lv -mai -mk -ml -mr -ms -nb -nl -nn -or -pa -pl -pt-BR -pt-PT -rm -ro -ru -si -sk -sl -son -sq -sr -sv -ta -te -th -tr -uk -uz -vi -xh -zh-CN -zh-TW" CFLAGS="-march=native -pipe -frecord-gcc-switches" CXXFLAGS="-march=native -pipe -frecord-gcc-switches -fno-delete-null-pointer-checks -fno-lifetime-dse -fno-schedule-insns -fno-schedule-insns2" LDFLAGS="-Wl,-O1 -Wl,--as-needed -Wl,--defsym=__gentoo_check_ldflags__=0 -Wl,-rpath=/usr/lib64/firefox,--enable-new-dtags -Wl,-z,relro,-z,now"
(In reply to Adios Kid from comment #7) > The log says > > "configure:9799:23: error: #error "Insufficient libpng version (10635 > required)."" > > I'll try with that dep version > > media-libs/libpng-1.6.35-r1 Thanks, fixed via https://gitweb.gentoo.org/repo/gentoo.git/commit/?id=cfff9994f715e8815df8d105d9c4a92d3f17db9b but you experienced at least a different problem. In the logs from comment #0 there's no reason listed. Looks like a parallel build issue at moment.
(In reply to Thomas Deutschmann from comment #9) > (In reply to Adios Kid from comment #7) > Looks like a parallel build issue at moment. Here I get " 0:30.81 gmake[5]: write error: stdout" with -j24. Compiling now with -j8 and it's passed that point in the process.
Could someone please spice up the summary line with some more details? There is also bug #672918 about a different Firefox 64 build failure and this could become confusing.
When you are posting in this bug, please show the 4th line from build.log, e.g. the line showing your USE flags.
(In reply to peter@prh.myzen.co.uk from comment #10) > Here I get " 0:30.81 gmake[5]: write error: stdout" with -j24. Compiling now > with -j8 and it's passed that point in the process. I spoke too soon. Now I get the same error, but later. In fact, $ grep "Error " /var/log/portage/www-client:firefox-64.0:20181211-093410.log 0:03.67 Error processing command. Ignoring because optional. (optional:packages.txt:comm/build/virtualenv_packages.txt) 0:22.49 gmake[3]: *** [/var/tmp/portage/www-client/firefox-64.0/work/firefox-64.0/config/recurse.mk:101: xpcom/build/export] Error 1 0:30.81 gmake[4]: *** [Makefile:15: export] Error 1 0:30.81 gmake[3]: *** [/var/tmp/portage/www-client/firefox-64.0/work/firefox-64.0/config/recurse.mk:101: xpcom/xpidl/export] Error 2 0:45.98 gmake[2]: *** [/var/tmp/portage/www-client/firefox-64.0/work/firefox-64.0/config/recurse.mk:34: export] Error 2 0:45.98 gmake[1]: *** [/var/tmp/portage/www-client/firefox-64.0/work/firefox-64.0/config/rules.mk:431: default] Error 2 0:45.98 gmake: *** [client.mk:125: build] Error 2 This is the fourth line, as requested: USE: abi_x86_64 amd64 dbus elibc_glibc gmp-autoupdate kernel_linux l10n_en-GB screenshot startup-notification userland_GNU
Created attachment 557588 [details] firefox emerge --info
Created attachment 557590 [details] firefox emerge -pqv
Also had same failure at -j12, can confirm -j9 builds fine.
I was getting the same gmake: write error: stdout with 64.0_beta versions. My solution was to remove "--verbose" from src_compile phase.
found another adding -O to MAKEOPTS fixes build. I can reliably reproduce the build with USE="-*" MAKEOPTS="-j16", but as soon as I add -O, it'll build -O is -output-sync=target
Created attachment 557602 [details, diff] firefox-64.0-add-O-to-MOZ_MAKE_FLAGS.patch This ebuild patch fixes the issue for me, though the race condition still exists somewhere in the upstream build system.
The bug has been referenced in the following commit(s): https://gitweb.gentoo.org/repo/gentoo.git/commit/?id=e3df3f47eba9c4236d3c364eaed4b8a7e87ed1a9 commit e3df3f47eba9c4236d3c364eaed4b8a7e87ed1a9 Author: Thomas Deutschmann <whissi@gentoo.org> AuthorDate: 2018-12-11 22:46:09 +0000 Commit: Thomas Deutschmann <whissi@gentoo.org> CommitDate: 2018-12-11 22:46:28 +0000 www-client/firefox: add workaround for parallel make issue Bug: https://bugs.gentoo.org/672906 Package-Manager: Portage-2.3.52, Repoman-2.3.12 Signed-off-by: Thomas Deutschmann <whissi@gentoo.org> www-client/firefox/firefox-64.0.ebuild | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-)
there is a minor problem with that patch. it adds -O *after* user's MAKEOPTS and it'll override any --output-sync user may have set. for example I set --output-sync=recurse globally and that -O will override it. but yeah, it's just a temporary hack to get it building, underlying output-dependent race is still there. looks something relies on getting make output ordered. -O does not change compilation order, it just changes output order.
(In reply to cyrillic from comment #17) > I was getting the same gmake: write error: stdout with 64.0_beta versions. > My solution was to remove "--verbose" from src_compile phase. Same error and same solution here with www-client/firefox-65.0.2. I got the error although I compiled with `MAKEOPTS="-j1"`.
Still able to reproduce with 78.3.1+?
