Gentoo Websites Logo
Go to: Gentoo Home Documentation Forums Lists Bugs Planet Store Wiki Get Gentoo!
Bug 709594 - www-client/firefox-73.0 - Could not find profraw files in the current directory: .../work/firefox-73.0/ff/instrumented
Summary: www-client/firefox-73.0 - Could not find profraw files in the current directo...
Status: RESOLVED DUPLICATE of bug 709654
Alias: None
Product: Gentoo Linux
Classification: Unclassified
Component: Current packages (show other bugs)
Hardware: AMD64 Linux
: Normal normal with 1 vote (vote)
Assignee: Mozilla Gentoo Team
URL:
Whiteboard:
Keywords:
: 710674 (view as bug list)
Depends on:
Blocks:
 
Reported: 2020-02-14 11:02 UTC by Gunnar Eggen
Modified: 2020-02-24 23:27 UTC (History)
1 user (show)

See Also:
Package list:
Runtime testing required: ---


Attachments
Full log of failed build with applied firefox-73.0_fix_lto_pgo_builds.patch (firefox_buildlog.bz2,670.30 KB, application/x-bzip)
2020-02-14 18:45 UTC, Gunnar Eggen
Details
Environment from failed build (environment,225.62 KB, text/plain)
2020-02-14 18:50 UTC, Gunnar Eggen
Details

Note You need to log in before you can comment on or make changes to this bug.
Description Gunnar Eggen 2020-02-14 11:02:09 UTC
Recent stable firefox-73 fails to build and gives the errors below. I see some discussions on XDG_CACHE_HOME variable being the cause, but I get the same problem wether this variable is set or not.

Errors:

11:50.69 gmake: Leaving directory '/var/tmp/portage/portage/www-client/firefox-73.0/work/firefox-73.0/ff/instrumented'
1581672999761   addons.webextension.doh-rollout@mozilla.org     WARN    Loading extension 'doh-rollout@mozilla.org': Reading manifest: Invalid extension permission: networkStatus
1581672999806   addons.webextension.screenshots@mozilla.org     WARN    Loading extension 'screenshots@mozilla.org': Reading manifest: Invalid extension permission: mozillaAddons
1581672999806   addons.webextension.screenshots@mozilla.org     WARN    Loading extension 'screenshots@mozilla.org': Reading manifest: Invalid extension permission: telemetry
1581672999806   addons.webextension.screenshots@mozilla.org     WARN    Loading extension 'screenshots@mozilla.org': Reading manifest: Invalid extension permission: resource://pdf.js/
1581672999806   addons.webextension.screenshots@mozilla.org     WARN    Loading extension 'screenshots@mozilla.org': Reading manifest: Invalid extension permission: about:reader*

###!!! [Parent][RunMessage] Error: Channel closing: too late to send/recv, messages will be lost


###!!! [Parent][RunMessage] Error: Channel closing: too late to send/recv, messages will be lost


###!!! [Parent][RunMessage] Error: Channel closing: too late to send/recv, messages will be lost

jarlog: /var/tmp/portage/portage/www-client/firefox-73.0/work/firefox-73.0/ff/jarlog/en-US.log

###!!! [Parent][RunMessage] Error: Channel closing: too late to send/recv, messages will be lost


###!!! [Parent][RunMessage] Error: Channel closing: too late to send/recv, messages will be lost

Could not find profraw files in the current directory: /var/tmp/portage/portage/www-client/firefox-73.0/work/firefox-73.0/ff/instrumented

Reproducible: Always

Steps to Reproduce:
1. Emerge firefox with GCC, LTO and PGO

Actual Results:  
Build fails


emerge --info:
Portage 2.3.84 (python 3.6.9-final-0, default/linux/amd64/17.1/desktop/plasma, gcc-9.2.0, glibc-2.29-r7, 5.5.3-gentoo x86_64)
=================================================================
System uname: Linux-5.5.3-gentoo-x86_64-AMD_Ryzen_9_3950X_16-Core_Processor-with-gentoo-2.6
KiB Mem:    32824756 total,  23386780 free
KiB Swap:     524284 total,    523516 free
Timestamp of repository gentoo: Fri, 14 Feb 2020 08:00:01 +0000
Head commit of repository gentoo: b874bcd2d812eca72729978b20a778b6d7e20738
sh bash 4.4_p23-r1
ld GNU ld (Gentoo 2.32 p2) 2.32.0
app-shells/bash:          4.4_p23-r1::gentoo
dev-lang/perl:            5.30.1::gentoo
dev-lang/python:          2.7.17::gentoo, 3.6.9::gentoo, 3.7.5-r1::gentoo
dev-util/cmake:           3.14.6::gentoo
sys-apps/baselayout:      2.6-r1::gentoo
sys-apps/openrc:          0.42.1::gentoo
sys-apps/sandbox:         2.13::gentoo
sys-devel/autoconf:       2.13-r1::gentoo, 2.69-r4::gentoo
sys-devel/automake:       1.11.6-r3::gentoo, 1.16.1-r1::gentoo
sys-devel/binutils:       2.32-r1::gentoo
sys-devel/gcc:            9.2.0-r2::gentoo
sys-devel/gcc-config:     2.2::gentoo
sys-devel/libtool:        2.4.6-r6::gentoo
sys-devel/make:           4.2.1-r4::gentoo
sys-kernel/linux-headers: 5.5::gentoo (virtual/os-headers)
sys-libs/glibc:           2.29-r7::gentoo
Repositories:

gentoo
    location: /usr/portage
    sync-type: rsync
    sync-uri: rsync://rsync.gentoo.org/gentoo-portage
    priority: -1000
    sync-rsync-verify-metamanifest: yes
    sync-rsync-verify-max-age: 24
    sync-rsync-verify-jobs: 1
    sync-rsync-extra-opts: 

ACCEPT_KEYWORDS="amd64"
ACCEPT_LICENSE="*"
CBUILD="x86_64-pc-linux-gnu"
CFLAGS="-march=native -O2 -pipe -fomit-frame-pointer -ftree-vectorize -flto=16 -fuse-linker-plugin -fuse-ld=bfd -fdevirtualize-at-ltrans"
CHOST="x86_64-pc-linux-gnu"
CONFIG_PROTECT="/etc /usr/lib64/libreoffice/program/sofficerc /usr/share/config /usr/share/gnupg/qualified.txt"
CONFIG_PROTECT_MASK="/etc/ca-certificates.conf /etc/dconf /etc/env.d /etc/fonts/fonts.conf /etc/gconf /etc/gentoo-release /etc/revdep-rebuild /etc/sandbox.d /etc/terminfo"
CXXFLAGS="-march=native -O2 -pipe -fomit-frame-pointer -ftree-vectorize -flto=16 -fuse-linker-plugin -fuse-ld=bfd -fdevirtualize-at-ltrans"
DISTDIR="/usr/portage/distfiles"
EMERGE_DEFAULT_OPTS="--with-bdeps=y"
ENV_UNSET="DBUS_SESSION_BUS_ADDRESS DISPLAY GOBIN PERL5LIB PERL5OPT PERLPREFIX PERL_CORE PERL_MB_OPT PERL_MM_OPT XAUTHORITY XDG_CACHE_HOME XDG_CONFIG_HOME XDG_DATA_HOME XDG_RUNTIME_DIR"
FCFLAGS="-O2 -pipe"
FEATURES="assume-digests binpkg-docompress binpkg-dostrip binpkg-logs config-protect-if-modified distlocks ebuild-locks fixlafiles ipc-sandbox merge-sync multilib-strict network-sandbox news parallel-fetch pid-sandbox preserve-libs protect-owned sandbox sfperms strict unknown-features-warn unmerge-logs unmerge-orphans userfetch userpriv usersandbox usersync xattr"
FFLAGS="-O2 -pipe"
GENTOO_MIRRORS="https://mirror.netcologne.de/gentoo/ https://ftp.snt.utwente.nl/pub/os/linux/gentoo rsync://ftp.snt.utwente.nl/gentoo rsync://ftp-stud.hs-esslingen.de/gentoo/"
LANG="en_US.utf8"
LDFLAGS="-Wl,-O1 -Wl,--as-needed -march=native -O2 -pipe -fomit-frame-pointer -ftree-vectorize -flto=16 -fuse-linker-plugin -fuse-ld=bfd -fdevirtualize-at-ltrans"
LINGUAS="en"
MAKEOPTS="-j32"
PKGDIR="/usr/portage/packages"
PORTAGE_CONFIGROOT="/"
PORTAGE_RSYNC_OPTS="--recursive --links --safe-links --perms --times --omit-dir-times --compress --force --whole-file --delete --stats --human-readable --timeout=180 --exclude=/distfiles --exclude=/local --exclude=/packages --exclude=/.git"
PORTAGE_TMPDIR="/var/tmp/portage"
USE="X a52 aac acl acpi activities aes alsa amd64 avx avx2 berkdb branding bzip2 cairo cdda cdr cli conntrack crypt cups cxx dbus declarative dri dts dvd dvdr elogind emboss encode exif f16c flac fma3 fortran gdbm gif gpm grub iconv icu infinality jpeg kde kipi kwallet lcms libnotify libtirpc lto mad mmx mmxext mng mp3 mp4 mpeg multilib ncurses nls nptl ogg opengl openmp pam pango pclmul pcre pdf pgo phonon plasma png policykit popcnt ppds qml qt5 readline rsync-verify sdl seccomp semantic-desktop sha spell split-usr sse sse2 sse3 sse4_1 sse4_2 sse4a ssl ssse3 startup-notification svg tcpd tiff truetype udev udisks unicode upower usb vdpau vorbis widgets wxwidgets x264 xattr xcb xcomposite xml xv xvid zlib" ABI_X86="64" ADA_TARGET="gnat_2018" ALSA_CARDS="hda-intel" APACHE2_MODULES="authn_core authz_core socache_shmcb unixd actions alias auth_basic authn_alias authn_anon authn_dbm authn_default authn_file authz_dbm authz_default authz_groupfile authz_host authz_owner authz_user autoindex cache cgi cgid dav dav_fs dav_lock deflate dir disk_cache env expires ext_filter file_cache filter headers include info log_config logio mem_cache mime mime_magic negotiation rewrite setenvif speling status unique_id userdir usertrack vhost_alias" CALLIGRA_FEATURES="karbon sheets words" COLLECTD_PLUGINS="df interface irq load memory rrdtool swap syslog" CPU_FLAGS_X86="aes avx avx2 f16c fma3 mmx mmxext pclmul popcnt sha sse sse2 sse3 sse4_1 sse4_2 sse4a ssse3" ELIBC="glibc" GPSD_PROTOCOLS="ashtech aivdm earthmate evermore fv18 garmin garmintxt gpsclock greis isync itrax mtk3301 nmea ntrip navcom oceanserver oldstyle oncore rtcm104v2 rtcm104v3 sirf skytraq superstar2 timing tsip tripmate tnt ublox ubx" GRUB_PLATFORMS="efi-64" INPUT_DEVICES="evdev" KERNEL="linux" L10N="en" LCD_DEVICES="bayrad cfontz cfontz633 glk hd44780 lb216 lcdm001 mtxorb ncurses text" LIBREOFFICE_EXTENSIONS="presenter-console presenter-minimizer" OFFICE_IMPLEMENTATION="libreoffice" PHP_TARGETS="php7-2" POSTGRES_TARGETS="postgres10 postgres11" PYTHON_SINGLE_TARGET="python3_6" PYTHON_TARGETS="python2_7 python3_6" RUBY_TARGETS="ruby24 ruby25" SANE_BACKENDS="pixma" USERLAND="GNU" VIDEO_CARDS="amdgpu radeonsi" XTABLES_ADDONS="quota2 psd pknock lscan length2 ipv4options ipset ipp2p iface geoip fuzzy condition tee tarpit sysrq steal rawnat logmark ipmark dhcpmac delude chaos account"
Unset:  CC, CPPFLAGS, CTARGET, CXX, INSTALL_MASK, LC_ALL, PORTAGE_BINHOST, PORTAGE_BUNZIP2_COMMAND, PORTAGE_COMPRESS, PORTAGE_COMPRESS_FLAGS, PORTAGE_RSYNC_EXTRA_OPTS
Comment 1 Jeroen Roovers (RETIRED) gentoo-dev 2020-02-14 11:04:17 UTC
Please attach the entire build log to this bug report.
Comment 2 Jeroen Roovers (RETIRED) gentoo-dev 2020-02-14 11:06:28 UTC
Looks like it is trying to break through FEATURES=network-sandbox
Comment 3 Larry the Git Cow gentoo-dev 2020-02-14 13:09:34 UTC
The bug has been closed via the following commit(s):

https://gitweb.gentoo.org/repo/gentoo.git/commit/?id=2f2ceab0a79e973d3e1e70dc4cf201bd09c5154b

commit 2f2ceab0a79e973d3e1e70dc4cf201bd09c5154b
Author:     Jory Pratt <anarchy@gentoo.org>
AuthorDate: 2020-02-14 13:09:14 +0000
Commit:     Jory Pratt <anarchy@gentoo.org>
CommitDate: 2020-02-14 13:09:29 +0000

    www-client/firefox: Fix pgo/lto builds
    
    Closes: https://bugs.gentoo.org/709440
    Closes: https://bugs.gentoo.org/706772
    Closes: https://bugs.gentoo.org/709594
    Package-Manager: Portage-2.3.88, Repoman-2.3.20
    Signed-off-by: Jory Pratt <anarchy@gentoo.org>

 .../firefox/files/firefox-69.0-lto-gcc-fix.patch   | 26 -----------
 .../files/firefox-73.0_fix_lto_pgo_builds.patch    | 51 ++++++++++++++++++++++
 www-client/firefox/firefox-73.0.ebuild             |  2 +
 3 files changed, 53 insertions(+), 26 deletions(-)
Comment 4 Gunnar Eggen 2020-02-14 18:45:10 UTC
Created attachment 613838 [details]
Full log of failed build with applied firefox-73.0_fix_lto_pgo_builds.patch

Full log of failed build with applied firefox-73.0_fix_lto_pgo_builds.patch
Comment 5 Gunnar Eggen 2020-02-14 18:46:12 UTC
Build still fails with firefox-73.0_fix_lto_pgo_builds.patch
Attached is full buildlog
Comment 6 Gunnar Eggen 2020-02-14 18:50:23 UTC
Created attachment 613840 [details]
Environment from failed build

Environment from failed build
Comment 7 Abulhair Saparov 2020-02-15 22:36:22 UTC
I have the same problem, the patch doesn't fix it for me either.
Comment 8 Mihai Moldovan 2020-02-16 11:00:26 UTC
The build seems to profile and install correctly when using clang, but there seems to be no dice with gcc.

The actual error messages differ - for instance, I'm seeing the ones last attached to bug 709272 , while Gunnars log doesn't contain messages like these for some reason:

>JavaScript error: resource://activity-stream/lib/ActivityStreamPrefs.jsm, line 27: NS_ERROR_ILLEGAL_VALUE: Component returned failure code: 0x80070057 (NS_ERROR_ILLEGAL_VALUE) [nsIPrefBranch.removeObserver]
>JavaScript error: resource://services-settings/RemoteSettingsClient.jsm, line 144: Error: Unknown callback
>
>###!!! [Parent][RunMessage] Error: Channel closing: too late to send/recv, messages will be lost
>
>
>###!!! [Parent][RunMessage] Error: Channel closing: too late to send/recv, messages will be lost
>
>
>###!!! [Parent][DispatchAsyncMessage] Error: >PBackgroundIDBFactory::Msg_PBackgroundIDBFactoryRequestConstructor Value error: message was deserialized, but contained an illegal value
>
>JavaScript error: resource://services-common/kinto-offline-client.js, line 603: Error: IndexedDB getLastModified() The operation failed for reasons unrelated to the database itself and not covered by any other error code.

No idea how, but I guess we can conclude that +pgo+lto-clang is currently broken.
Comment 9 Mihai Moldovan 2020-02-18 18:47:42 UTC
This is very likely a dupe of bug 709654.
Comment 10 Brian Evans (RETIRED) gentoo-dev 2020-02-24 16:23:03 UTC
*** Bug 710674 has been marked as a duplicate of this bug. ***
Comment 11 Larry the Git Cow gentoo-dev 2020-02-24 16:52:57 UTC
The bug has been referenced in the following commit(s):

https://gitweb.gentoo.org/repo/gentoo.git/commit/?id=3755724da101dd492d6a2a61083945ad92933666

commit 3755724da101dd492d6a2a61083945ad92933666
Author:     Thomas Deutschmann <whissi@gentoo.org>
AuthorDate: 2020-02-24 16:38:40 +0000
Commit:     Thomas Deutschmann <whissi@gentoo.org>
CommitDate: 2020-02-24 16:52:46 +0000

    profiles: p.use.mask >=www-client/firefox-72[pgo]
    
    USE=pgo is broken since firefox-72.
    
    Bug: https://bugs.gentoo.org/709594
    Bug: https://bugs.gentoo.org/709654
    Signed-off-by: Thomas Deutschmann <whissi@gentoo.org>

 profiles/arch/amd64/package.use.mask              | 4 ++--
 profiles/arch/powerpc/ppc64/64le/package.use.mask | 4 ++--
 2 files changed, 4 insertions(+), 4 deletions(-)
Comment 12 Larry the Git Cow gentoo-dev 2020-02-24 22:35:53 UTC
The bug has been referenced in the following commit(s):

https://gitweb.gentoo.org/repo/gentoo.git/commit/?id=0658199715254b723aefcdea8641ccde7d316a36

commit 0658199715254b723aefcdea8641ccde7d316a36
Author:     Thomas Deutschmann <whissi@gentoo.org>
AuthorDate: 2020-02-24 22:33:45 +0000
Commit:     Thomas Deutschmann <whissi@gentoo.org>
CommitDate: 2020-02-24 22:35:19 +0000

    profiles: Revert "profiles: p.use.mask >=www-client/firefox-72[pgo]"
    
    This reverts commit 3755724da101dd492d6a2a61083945ad92933666.
    
    p.use.mask was too strict because USE=pgo works when using USE=clang.
    
    Bug: https://bugs.gentoo.org/709594
    Bug: https://bugs.gentoo.org/709654
    Signed-off-by: Thomas Deutschmann <whissi@gentoo.org>

 profiles/arch/amd64/package.use.mask              | 4 ++--
 profiles/arch/powerpc/ppc64/64le/package.use.mask | 4 ++--
 2 files changed, 4 insertions(+), 4 deletions(-)

https://gitweb.gentoo.org/repo/gentoo.git/commit/?id=5059bb531cc73e428042a83fe07191b2d98d40c4

commit 5059bb531cc73e428042a83fe07191b2d98d40c4
Author:     Thomas Deutschmann <whissi@gentoo.org>
AuthorDate: 2020-02-24 22:31:24 +0000
Commit:     Thomas Deutschmann <whissi@gentoo.org>
CommitDate: 2020-02-24 22:35:18 +0000

    www-client/firefox: block USE=pgo when USE=-clang
    
    USE=pgo is currently known to be broken when using GCC.
    
    Instead of silently ignoring USE=pgo when using GCC, we are
    forcing a user decision so user has the chance to enable USE=clang
    in case PGO is important for user without wasting 2+ hours
    commpiling firefox just to find out that PGO which was requested
    was ignored.
    
    Bug: https://bugs.gentoo.org/709594
    Bug: https://bugs.gentoo.org/709654
    Package-Manager: Portage-2.3.89, Repoman-2.3.20
    Signed-off-by: Thomas Deutschmann <whissi@gentoo.org>

 www-client/firefox/firefox-73.0.1.ebuild | 8 ++++++++
 1 file changed, 8 insertions(+)
Comment 13 Thomas Deutschmann (RETIRED) gentoo-dev 2020-02-24 23:27:15 UTC
I am going to combine USE=pgo failures in bug 709654.

*** This bug has been marked as a duplicate of bug 709654 ***