Gentoo Websites Logo
Go to: Gentoo Home Documentation Forums Lists Bugs Planet Store Wiki Get Gentoo!
Bug 388585 - www-client/firefox-7.0.1-r1 fails to build (with USE=pgo?)
Summary: www-client/firefox-7.0.1-r1 fails to build (with USE=pgo?)
Status: RESOLVED FIXED
Alias: None
Product: Gentoo Linux
Classification: Unclassified
Component: Current packages (show other bugs)
Hardware: AMD64 Linux
: Normal major with 1 vote (vote)
Assignee: Mozilla Gentoo Team
URL:
Whiteboard:
Keywords: PATCH
: 402265 407043 409253 480258 499650 (view as bug list)
Depends on:
Blocks:
 
Reported: 2011-10-26 17:47 UTC by JMW
Modified: 2016-08-16 10:01 UTC (History)
9 users (show)

See Also:
Package list:
Runtime testing required: ---


Attachments
ebuild environment file (environment,283.05 KB, text/plain)
2011-10-26 18:11 UTC, JMW
Details
build.log.gz (build.log.gz,350.78 KB, application/x-gzip)
2011-10-27 00:14 UTC, JMW
Details
Output of dmesg >> ~/dmesg.log (dmesg.log,119.94 KB, text/plain)
2011-10-30 19:53 UTC, JMW
Details
Latest build.log.gz. (build.log.gz,352.34 KB, text/plain)
2011-10-30 22:55 UTC, JMW
Details
firefox-48.0-pgo.patch (firefox-48.0-pgo.patch,312 bytes, patch)
2016-08-08 18:53 UTC, Andrew Savchenko
Details | Diff
firefox-48.0.ebuild.patch (firefox-48.0.ebuild.patch,808 bytes, patch)
2016-08-08 18:53 UTC, Andrew Savchenko
Details | Diff

Note You need to log in before you can comment on or make changes to this bug.
Description JMW 2011-10-26 17:47:42 UTC
Firefox 7.0.1-r1 fails to build on my system. I don't know if this is the same issue as Bug 387505 because I could not read the build.log attached to that bug. I had PGO enabled, so it may be related, but it looked to me like it was failing while unpacking the XPI file. 

Reproducible: Always

Steps to Reproduce:
1.emerge firefox
2.
3.
Actual Results:  
emerge failed

Expected Results:  
emerge should have succeeded

emerge --info =firefox-7.0.1-r1
Portage 2.1.10.11 (default/linux/amd64/10.0, gcc-4.5.3, glibc-2.12.2-r0, 2.6.39-gentoo-r3 x86_64)
=================================================================
                        System Settings
=================================================================
System uname: Linux-2.6.39-gentoo-r3-x86_64-AMD_Phenom-tm-_II_X6_1055T_Processor-with-gentoo-2.0.3
Timestamp of tree: Mon, 24 Oct 2011 20:15:01 +0000
app-shells/bash:          4.1_p9
dev-java/java-config:     2.1.11-r3
dev-lang/python:          2.6.6-r2, 2.7.1-r1, 3.1.2-r4
dev-util/cmake:           2.8.4-r1
dev-util/pkgconfig:       0.25-r2
sys-apps/baselayout:      2.0.3
sys-apps/openrc:          0.8.2-r1
sys-apps/sandbox:         2.4
sys-devel/autoconf:       2.13, 2.68
sys-devel/automake:       1.7.9-r2, 1.8.5-r4, 1.9.6-r3, 1.10.3, 1.11.1
sys-devel/binutils:       2.21.1-r1
sys-devel/gcc:            4.4.5, 4.5.3-r1
sys-devel/gcc-config:     1.4.1-r1
sys-devel/libtool:        2.2.10
sys-devel/make:           3.82-r1
sys-kernel/linux-headers: 2.6.30-r1 (virtual/os-headers)
sys-libs/glibc:           2.12.2
Repositories: gentoo sunrise cj-overlay dustin flow my_local_overlay
ACCEPT_KEYWORDS="amd64"
ACCEPT_LICENSE="*"
CBUILD="x86_64-pc-linux-gnu"
CFLAGS="-O2 -pipe"
CHOST="x86_64-pc-linux-gnu"
CONFIG_PROTECT="/etc /usr/share/X11/xkb /var/bind /var/lib/hsqldb"
CONFIG_PROTECT_MASK="/etc/ca-certificates.conf /etc/env.d /etc/env.d/java/ /etc/eselect/postgresql /etc/fonts/fonts.conf /etc/gconf /etc/gentoo-release /etc/php/apache2-php5/ext-active/ /etc/php/cgi-php5/ext-active/ /etc/php/cli-php5/ext-active/ /etc/revdep-rebuild /etc/sandbox.d /etc/terminfo /etc/texmf/language.dat.d /etc/texmf/language.def.d /etc/texmf/updmap.d /etc/texmf/web2c"
CXXFLAGS="-O2 -pipe"
DISTDIR="/usr/portage/distfiles"
FEATURES="assume-digests binpkg-logs distlocks ebuild-locks fixlafiles fixpackages news parallel-fetch protect-owned sandbox sfperms strict unknown-features-warn unmerge-logs unmerge-orphans userfetch"
FFLAGS=""
GENTOO_MIRRORS="http://distfiles.gentoo.org"
LANG="en_US.UTF-8"
LDFLAGS="-Wl,-O1 -Wl,--as-needed"
LINGUAS="af ar as_IN be be_BY bg bn br brx bs ca cs cy da de dgo dz el en en_GB en_US en_ZA eo es et eu fa fi fo fr ga gl gu he hi hi_IN hr hu id is it ja ka kk km kn_IN ko kok ks ku la lt mai mk ml_IN mn mni mr_IN nb ne nl nn no nr ns oc or_IN pa_IN pl pt pt_BR ro ru rw sa_IN sat sd sh sk sl sr ss st sv sw_TZ ta ta_IN te_IN tg th ti_ER tn ts tr uk ur_IN uz ve vi xh zh_CN zh_TW zu"
PKGDIR="/usr/portage/packages"
PORTAGE_CONFIGROOT="/"
PORTAGE_RSYNC_OPTS="--recursive --links --safe-links --perms --times --compress --force --whole-file --delete --stats --timeout=180 --exclude=/distfiles --exclude=/local --exclude=/packages"
PORTAGE_TMPDIR="/var/tmp"
PORTDIR="/usr/portage"
PORTDIR_OVERLAY="/var/lib/layman/sunrise /var/lib/layman/cj-overlay /var/lib/layman/dustin /var/lib/layman/flow /usr/local/portage"
SYNC="rsync://rsync.us.gentoo.org/gentoo-portage"
USE="3dnowext 64bit X a52 aac aalib acl acpi aio alsa amd64 apng aspell assistant asyncns autotrace bash-completion berkdb binfilter blas bluetooth bugzilla bzip2 cairo caps catalogs cblas-external ccache cdr cdt cjk classic cli collab compat consolekit contrast cracklib crypt css ctypes-python cups curl cxx dbus declarative development directfb djvu dlz doc double-precision dri dv dvd eap-sim editor eds egl emf examples exif expat extras fasteap fbcon ffmpeg fftw flac fontconfig fontforge fortran fping fpx freemail freetds gcj gd gdbm geoip gif gimp gmplayer gnutls gpg gphoto2 gpm grammar graphite graphviz gs gsm gssapi gstreamer gtkstyle hdri hfs hotpixels hpcups hvm i18n iconv icu idn imagemagick ipv6 irda jadetex java javacomm jbig joystick jpeg jpeg2k lame lapack latex lcms ldap lensfun libffi libgda libnl libnotify libsamplerate lqr lzma lzo madwifi maps math mdb mdnsresponder-compat mikmod mjpeg mmx mmxext mng modules mono moonlight mp3 mpeg mpi mplayer mudflap multilib multimedia musepack music mysql mythtv ncurses nls nodrm nokia nptl nptlonly nuv objc objc++ objc-gc ocr odbc odbcmanual odk ogg old-daemons openal openexr opengl openmp openntpd openvg openxml optimization optimized-qmake ots pam pch pcre pdf perl-geoipupdate pgo phonon plotutils plugins png policykit postgres postproc pppd private-headers profile4 pulseaudio q32 qt3support qt4 quicktime raw readline realtime resolvconf romio samba scanner script sdb-ldap sdl secure-delete session slang smp snmp soundex spell sqlite sqlite3 sse sse2 ssh ssl startup-notification strong-optimization subtitles svg sysfs syslog system-sqlite t1lib taglib tcpd templates textures theora thesaurus threads tiff timezone timidity tools tordns truetype unicode unlock-notify usb utils v4l v4l2 vcd vdpau video vim-syntax vorbis wavpack wcwidth webdav-serf webkit wifi wmf wordperfect wps x264 xbase xcb xcomposite xine xml xmlpatterns xnest xorg xterm-color xv xvfb xvid zemberek zeroconf zippy zlib zsh-completion" ALSA_CARDS="ali5451 als4000 atiixp atiixp-modem bt87x ca0106 cmipci emu10k1x ens1370 ens1371 es1938 es1968 fm801 hda-intel intel8x0 intel8x0m maestro3 trident usb-audio via82xx via82xx-modem ymfpci" ALSA_PCM_PLUGINS="adpcm alaw asym copy dmix dshare dsnoop empty extplug file hooks iec958 ioplug ladspa lfloat linear meter mmap_emul mulaw multi null plug rate route share shm softvol" APACHE2_MODULES="actions alias auth_basic authn_alias authn_anon authn_dbm authn_default authn_file authz_dbm authz_default authz_groupfile authz_host authz_owner authz_user autoindex cache cgi cgid dav dav_fs dav_lock deflate dir disk_cache env expires ext_filter file_cache filter headers include info log_config logio mem_cache mime mime_magic negotiation rewrite setenvif speling status unique_id userdir usertrack vhost_alias" CALLIGRA_FEATURES="kexi words flow plan stage tables krita karbon braindump" CAMERAS="ptp2" COLLECTD_PLUGINS="df interface irq load memory rrdtool swap syslog" ELIBC="glibc" GPSD_PROTOCOLS="ashtech aivdm earthmate evermore fv18 garmin garmintxt gpsclock itrax mtk3301 nmea ntrip navcom oceanserver oldstyle oncore rtcm104v2 rtcm104v3 sirf superstar2 timing tsip tripmate tnt ubx" INPUT_DEVICES="evdev joystick keyboard mouse ps2mouse" KERNEL="linux" LCD_DEVICES="bayrad cfontz cfontz633 glk hd44780 lb216 lcdm001 mtxorb ncurses text" LINGUAS="af ar as_IN be be_BY bg bn br brx bs ca cs cy da de dgo dz el en en_GB en_US en_ZA eo es et eu fa fi fo fr ga gl gu he hi hi_IN hr hu id is it ja ka kk km kn_IN ko kok ks ku la lt mai mk ml_IN mn mni mr_IN nb ne nl nn no nr ns oc or_IN pa_IN pl pt pt_BR ro ru rw sa_IN sat sd sh sk sl sr ss st sv sw_TZ ta ta_IN te_IN tg th ti_ER tn ts tr uk ur_IN uz ve vi xh zh_CN zh_TW zu" PHP_TARGETS="php5-3" RUBY_TARGETS="ruby18" USERLAND="GNU" VIDEO_CARDS="nvidia" XTABLES_ADDONS="quota2 psd pknock lscan length2 ipv4options ipset ipp2p iface geoip fuzzy condition tee tarpit sysrq steal rawnat logmark ipmark dhcpmac delude chaos account"
Unset:  CPPFLAGS, CTARGET, EMERGE_DEFAULT_OPTS, INSTALL_MASK, LC_ALL, MAKEOPTS, PORTAGE_BUNZIP2_COMMAND, PORTAGE_COMPRESS, PORTAGE_COMPRESS_FLAGS, PORTAGE_RSYNC_EXTRA_OPTS
Comment 1 JMW 2011-10-26 18:08:04 UTC
URL for build.log (8MB):

http://www.2shared.com/file/tGaCALqw/build.html
Comment 2 JMW 2011-10-26 18:11:56 UTC
Created attachment 290917 [details]
ebuild environment file

Environment file.
Comment 3 JMW 2011-10-26 18:57:25 UTC
Update: It works if I emerge it with pgo disabled, so this is definitely a pgo issue.
Comment 4 Mike Gilbert gentoo-dev 2011-10-27 00:10:05 UTC
Do not use third party hosting sites for bug reports.

Please post your build log as an attachment. You can use gzip to compress it first if necessary.
Comment 5 JMW 2011-10-27 00:14:28 UTC
Created attachment 290951 [details]
build.log.gz
Comment 6 JMW 2011-10-27 00:17:25 UTC
Sorry, when I tried to post it originally B.G.O complained about the 1000kb limit, and said I could either compress it OR host it on a different server. I wasn't aware that 8000kb would compress to under 1000kb, so I assumed the proper thing to do would be to have it hosted elsewhere.
Comment 7 Mike Gilbert gentoo-dev 2011-10-27 01:05:34 UTC
I don't actually see an error message in that build log. It just stops after zipping up a bunch of files. Are you sure you attached the right one?
Comment 8 JMW 2011-10-27 01:08:01 UTC
100%. I was equally confused.
Comment 9 Mike Gilbert gentoo-dev 2011-10-27 01:18:53 UTC
Okay then. Maybe it will make sense to the Mozilla team. :)
Comment 10 JMW 2011-10-27 02:03:16 UTC
Just let me know if you need me to try something out and post the results. I'm anxious to get pgo enabled firefox working.
Comment 11 Jory A. Pratt gentoo-dev 2011-10-27 23:43:53 UTC
(In reply to comment #10)
> Just let me know if you need me to try something out and post the results. I'm
> anxious to get pgo enabled firefox working.

Unless you can show where the error is, we are not gonna be able to do anything for you. Check dmesg for failure message related to build. Something has to be segfaulting somehwere.
Comment 12 JMW 2011-10-30 19:49:31 UTC
Casually browsing dmesg output, I did see one segfault, relating to libflashplayer.so. I suppose it's possible firefox includes flash performance in its PGO, so this might be it, although it's weird that I'm not seeing (or maybe just don't notice) flash segfaulting normally. More info, when I try the PGO build from my xsession, it fails because no usable screens are found or something. So this is me emerging PGO firefox from the console and failing without useful error message. My xsessions (multiple) are started by Qingy if that helps anything. I'm attaching the dmesg.log resulting from dmesg >> ~/dmesg.log. While you look at that, I'll be trying to rebuild libflashplayer.so and then reemerge firefox. I will be changing locations tomorrow and may not have my computer setup for a bit, so hopefully we will get some good info from this. If not, I'll continue to help solve this bug as soon as I'm able.
Comment 13 JMW 2011-10-30 19:53:03 UTC
Created attachment 291265 [details]
Output of dmesg >> ~/dmesg.log

All I saw was the libflashplayer error, but that was from a very cursory glance. You may well see more.
Comment 14 JMW 2011-10-30 22:51:24 UTC
Upgrading to the latest unstable flashplayer (which either doesn't require, or else incorrectly doesn't depend on nspluginwrapper) I was able to get a more useful error message. I'm attaching the latest build.log.gz. After this, I will try emerging firefox with PGO, but without flashplayer on my system at all. I'm starting to suspect we might have this bug licked pretty soon...
Comment 15 JMW 2011-10-30 22:55:41 UTC
Created attachment 291321 [details]
Latest build.log.gz.

This is the build.log.gz from emerging firefox with USE=pgo after having emerged the latest (unstable) flashplayer without nspluginwrapper on my system. This is with 64bit and -32bit useflags set on flashplayer.
Comment 16 JMW 2011-10-31 04:12:59 UTC
That last error was unrelated to the original issue. It had to do with a service running on the same port as the EasyServer python function that PGO makes use of. I've killed the server, and I'm now attempting an emerge of Firefox WITH the latest flashplayer.
Comment 17 JMW 2011-10-31 06:37:54 UTC
It worked! A possible resolution for this could be to make the latest Firefox with PGO enabled depend on the latest adobe-flash (11.0.1.152), although I suspect this will not be the way to go. Probably just a simple elog message, something to the effect of: "Adobe-Flash versions <11.0.1.152 may make PGO enabled Firefox fail to build. If you think this is the case, confirm by checking dmesg output for an error involving libflashplayer.so and then emerge >=adobe-flash-11.0.1.152". I'm not filing a separate bug report on the issue regarding conflicting services running because I have a lot of things to do right now, but if anyone cares, an appropriate ewarn could be placed in the ebuild regarding any services running on port 8888 preventing the PGO build from completing. If you need to confirm that it is port 8888 just look in the source tree under mozilla-release/obj-x86_64-unknown-linux-gnu/_profile/pgo/profileserver.py. Not far down in the file it will tell you which port it uses. You could even make the ebuild check that file for the actual port number and warn appropriately, or if you wanted to get sophisticated, just have the ebuild make the appropriate sed's and allow the user to pass a custom port number to the PGO build in an environment variable. I'm marking these two bugs "worksforme" in my own personal bugzilla, so I hope other users will be able to benefit from this bug report somehow.
Comment 18 coran.fisher@gmail.com 2012-02-06 01:44:48 UTC
I see this with firefox 10 with pgo and had freenet running.  Thanks for the port 8888 tip as I knew it was freenet on my system stopping that got me past that.
Comment 19 Jory A. Pratt gentoo-dev 2012-02-06 03:19:19 UTC
*** Bug 402265 has been marked as a duplicate of this bug. ***
Comment 20 Jory A. Pratt gentoo-dev 2012-03-06 00:20:45 UTC
*** Bug 407043 has been marked as a duplicate of this bug. ***
Comment 21 Jory A. Pratt gentoo-dev 2012-03-22 03:23:34 UTC
*** Bug 409253 has been marked as a duplicate of this bug. ***
Comment 22 Alexander Bezrukov 2012-03-22 22:42:28 UTC
I am facing a very similar problem except that I am building with -pgo.

By the very similar problem I mean that the build stops with:

run-mozilla.sh: Cannot execute /tmp/portage/www-client/firefox-10.0.3/work/mozilla-esr10/obj-x86_64-unknown-linux-gnu/browser/installer/../../dist/bin/shlibsign.
Comment 23 Fabian Köster 2012-03-23 10:54:26 UTC
(In reply to comment #22)
> I am facing a very similar problem except that I am building with -pgo.
> 
> By the very similar problem I mean that the build stops with:
> 
> run-mozilla.sh: Cannot execute
> /tmp/portage/www-client/firefox-10.0.3/work/mozilla-esr10/obj-x86_64-unknown-
> linux-gnu/browser/installer/../../dist/bin/shlibsign.

Same here, building with -pgo.

In which way is this bug related to bug 409331 ?
Comment 24 Duncan Exon Smith 2012-03-23 17:52:16 UTC
(In reply to comment #23)
> (In reply to comment #22)
> > I am facing a very similar problem except that I am building with -pgo.
> > 
> 
> Same here, building with -pgo.
> 
> In which way is this bug related to bug 409331 ?

Same here, building with -pgo.  Getting the same error as bug 409253... not sure why it's listed as a dup of this.
Comment 25 Jory A. Pratt gentoo-dev 2012-12-15 19:14:59 UTC
PGO useflag has been masked until such a time we can properly support it in gentoo. Soon as we can we will unmask and support pgo builds for all users. At this time even upstream is having problems supporting pgo builds in Linux. I will continue to track there upstream to determine when best we can come back and review all pgo build failures. Please ignore resolution we no longer have an option for later.
Comment 26 Jeroen Roovers (RETIRED) gentoo-dev 2014-01-29 10:30:51 UTC
*** Bug 499650 has been marked as a duplicate of this bug. ***
Comment 27 Andrew Savchenko gentoo-dev 2016-08-08 18:52:14 UTC
@mozilla team, I understand that pgo is PITA and you can't fully support it right now. But please, at least accept provided patches, at least if they don't affect non-pgo builds: this way you will keep users willing to use pgo happy and will not hurt others. This will also make pgo more tested and may result in its unmasking in future.

I ported patches provided by Daniel Rammelt in bug 499650 for firefox-48, see below. Works fine for me on ~amd64 (both build and run-time).
Comment 28 Andrew Savchenko gentoo-dev 2016-08-08 18:53:22 UTC
Created attachment 442808 [details, diff]
firefox-48.0-pgo.patch

Adds pgo run target.
Comment 29 Andrew Savchenko gentoo-dev 2016-08-08 18:53:57 UTC
Created attachment 442810 [details, diff]
firefox-48.0.ebuild.patch
Comment 30 Ian Stakenvicius (RETIRED) gentoo-dev 2016-08-08 18:55:01 UTC
(In reply to Andrew Savchenko from comment #27)
> @mozilla team, I understand that pgo is PITA and you can't fully support it
> right now. But please, at least accept provided patches, at least if they
> don't affect non-pgo builds: this way you will keep users willing to use pgo
> happy and will not hurt others. This will also make pgo more tested and may
> result in its unmasking in future.
> 
> I ported patches provided by Daniel Rammelt in bug 499650 for firefox-48,
> see below. Works fine for me on ~amd64 (both build and run-time).


You know, since you're a dev, you're welcome to join the mozilla team and manage the PGO patches directly.. :)
Comment 31 Andrew Savchenko gentoo-dev 2016-08-11 07:33:57 UTC
(In reply to Ian Stakenvicius from comment #30)
> You know, since you're a dev, you're welcome to join the mozilla team and
> manage the PGO patches directly.. :)

Thank you for the invitation, I'm joining you to maintain the PGO stuff :)

I'm going to apply mentioned patches and unmask pgo on amd64 starting from 48.0. I have troubles on ~x86 (segfaults) and I can't test other arches, so it will be kept masked there.
Comment 32 Siim Ainsaar 2016-08-12 03:24:28 UTC
*** Bug 480258 has been marked as a duplicate of this bug. ***
Comment 33 Siim Ainsaar 2016-08-12 03:35:26 UTC
Nice work! However, I think my patch from bug 480258 comment 18 would be easier to maintain in the future.
Comment 34 Andrew Savchenko gentoo-dev 2016-08-12 09:57:21 UTC
Upstream requires tests to be enabled for PGO builds [1]. I'll see what are implications of this. 

[1] https://developer.mozilla.org/en-US/docs/Mozilla/Developer_guide/Build_Instructions/Building_with_Profile-Guided_Optimization#Getting_Started
Comment 35 Dmitry Safonov 2016-08-16 10:01:18 UTC
@Andrew Savchenko Please, see bug 590658. Normal build with pax is fixed now, but pgo build is failing as described there.