[ First off: setting Component to "GNOME" simply because webkit-gtk is the only package that really suffers here, and there could be a workaround just for that package. If you feel like this does not fit I am happy with reassigning to whatever Component sandbox fits in :) ] This caused me quite some time to track down. webkit-gtk takes its time to build. Since the switch to cmake it adds quite some additional time. It hangs for ~20 minutes in "Scanning dependencies of target WebCore", and another 10 minutes in dependency scanning for "WebKit2". When building by hand as user WebCore deps are calculated in ~3 minutes. This is due to bad write performance of the sandbox. I get in average ~300kB/s, without sandbox it's ~2.2 MB/s. (simply determined by watching iotop) Is it possible to speed up sandbox writes? Is there an option I just can't see to get better performance WITHOUT disabling (user)sandbox? (because that just feels really, really bad...) My system is not the fastest, I have just a 5200 RPM HDD, PORTAGE_TMPDIR is on that disk (4GB RAM are in my experience not enough for building in a tmpfs). emerge --info: Portage 3.2.18 (python 3.4.1-final-0, default/linux/amd64/13.0/desktop, gcc-4.9.2, glibc-2.20-r2, 3.19.3-gentoo x86_64) ================================================================= System uname: Linux-3.19.3-gentoo-x86_64-Intel-R-_Core-TM-_i3-2350M_CPU_@_2.30GHz-with-gentoo-2.2 KiB Mem: 3889824 total, 85600 free KiB Swap: 5242876 total, 4951472 free Timestamp of repository gentoo: Wed, 08 Apr 2015 06:30:01 +0000 sh dash 0.5.7.4 ld GNU gold (Gentoo 2.25 p1.0 2.25) 1.11 distcc 3.1 x86_64-pc-linux-gnu [enabled] app-shells/bash: 4.3_p33-r2::gentoo dev-java/java-config: 2.2.0::gentoo dev-lang/perl: 5.20.2::gentoo dev-lang/python: 2.7.9-r1::gentoo, 3.3.5-r1::gentoo, 3.4.1::gentoo dev-util/cmake: 3.1.0::gentoo dev-util/pkgconfig: 0.28-r2::gentoo sys-apps/baselayout: 2.2::gentoo sys-apps/openrc: 0.13.11::gentoo sys-apps/sandbox: 2.6-r1::gentoo sys-devel/autoconf: 2.69::gentoo sys-devel/automake: 1.11.6-r1::gentoo, 1.12.6::gentoo, 1.13.4::gentoo sys-devel/binutils: 2.25::gentoo sys-devel/gcc: 4.9.2::gentoo sys-devel/gcc-config: 1.7.3::gentoo sys-devel/libtool: 2.4.6::gentoo sys-devel/make: 4.1-r1::gentoo sys-kernel/linux-headers: 3.18::gentoo (virtual/os-headers) sys-libs/glibc: 2.20-r2::gentoo Repositories: gentoo location: /var/repositories/gentoo sync-type: rsync sync-uri: rsync://rsync.gentoo.org/gentoo-portage priority: -1000 aidecoe location: /var/repositories/aidecoe sync-type: git sync-uri: git://github.com/aidecoe/aidecoe-overlay.git masters: gentoo dlang location: /var/repositories/dlang sync-type: git sync-uri: https://github.com/gentoo/dlang.git masters: gentoo ff2000 location: /var/repositories/ff2000 masters: gentoo eclass-overrides: qt kde kde location: /var/repositories/kde sync-type: git sync-uri: git://git.overlays.gentoo.org/proj/kde.git masters: gentoo local location: /var/repositories/local masters: gentoo eclass-overrides: qt mv location: /var/repositories/mv sync-type: git sync-uri: git://git.overlays.gentoo.org/user/mv.git masters: gentoo qt location: /var/repositories/qt masters: gentoo qutebrowser location: /var/repositories/qutebrowser masters: gentoo sage-on-gentoo location: /var/repositories/sagemath sync-type: git sync-uri: https://github.com/cschwan/sage-on-gentoo.git masters: gentoo science location: /var/repositories/science masters: gentoo yngwin location: /var/repositories/yngwin sync-type: git sync-uri: git://git.overlays.gentoo.org/dev/yngwin.git masters: gentoo ACCEPT_KEYWORDS="amd64" ACCEPT_LICENSE="*" CBUILD="x86_64-pc-linux-gnu" CFLAGS="-march=corei7-avx -O2 -pipe -ggdb" CHOST="x86_64-pc-linux-gnu" CONFIG_PROTECT="/etc /usr/share/config /usr/share/gnupg/qualified.txt" CONFIG_PROTECT_MASK="/etc/ca-certificates.conf /etc/dconf /etc/env.d /etc/fonts/fonts.conf /etc/gconf /etc/gentoo-release /etc/revdep-rebuild /etc/sandbox.d /etc/terminfo /etc/texmf/language.dat.d /etc/texmf/language.def.d /etc/texmf/updmap.d /etc/texmf/web2c" CXXFLAGS="-march=corei7-avx -O2 -pipe -ggdb" DISTDIR="/var/distfiles" FCFLAGS="-O2 -pipe" FEATURES="assume-digests binpkg-logs config-protect-if-modified distcc distlocks ebuild-locks fixlafiles merge-sync news parallel-fetch preserve-libs protect-owned sandbox sfperms splitdebug strict unknown-features-warn unmerge-logs unmerge-orphans userfetch userpriv usersandbox usersync" FFLAGS="-O2 -pipe" GENTOO_MIRRORS="http://distfiles.gentoo.org" LANG="de_DE.UTF-8" LDFLAGS="-Wl,-O1 -Wl,--as-needed" MAKEOPTS="-j11" PKGDIR="/usr/portage/packages" PORTAGE_CONFIGROOT="/" PORTAGE_RSYNC_OPTS="--recursive --links --safe-links --perms --times --omit-dir-times --compress --force --whole-file --delete --stats --human-readable --timeout=180 --exclude=/distfiles --exclude=/local --exclude=/packages" PORTAGE_TMPDIR="/var/tmp" USE="X a52 aac acl acpi alsa amd64 apm berkdb branding bzip2 cairo cdda cdr cli cracklib crypt cups cxx dbus directfb dri dts dvd dvdr emboss encode exif fam ffmpeg firefox flac fortran gdbm gif glamor gpm iconv infinality introspection ipv6 jpeg jpeg2k kipi lcdfilter lcms mad mmx mmxext mng modules mp3 mp4 mpeg multilib ncurses nls nptl ogg opengl openmp openrc pam pango pcre pdf png policykit ppds pulse pulseaudio readline sdl session spell sse sse2 sse3 sse4 sse4_1 ssl ssse3 svg systemd tcpd theora threads tiff truetype udev udisks unicode upower usb vaapi vorbis vpx x264 xcb xcomposite xml xscreensaver xv xvid zlib zsh-completion" ABI_X86="64" ALSA_CARDS="ali5451 als4000 atiixp atiixp-modem bt87x ca0106 cmipci emu10k1x ens1370 ens1371 es1938 es1968 fm801 hda-intel intel8x0 intel8x0m maestro3 trident usb-audio via82xx via82xx-modem ymfpci" APACHE2_MODULES="authn_core authz_core socache_shmcb unixd actions alias auth_basic authn_alias authn_anon authn_dbm authn_default authn_file authz_dbm authz_default authz_groupfile authz_host authz_owner authz_user autoindex cache cgi cgid dav dav_fs dav_lock deflate dir disk_cache env expires ext_filter file_cache filter headers include info log_config logio mem_cache mime mime_magic negotiation rewrite setenvif speling status unique_id userdir usertrack vhost_alias" CALLIGRA_FEATURES="krita sheets stage words" CAMERAS="ptp2" COLLECTD_PLUGINS="df interface irq load memory rrdtool swap syslog" CPU_FLAGS_X86="avx mmx mmxext popcnt sse sse2 sse3 sse4_1 sse4_2 ssse3" ELIBC="glibc" GPSD_PROTOCOLS="ashtech aivdm earthmate evermore fv18 garmin garmintxt gpsclock itrax mtk3301 nmea ntrip navcom oceanserver oldstyle oncore rtcm104v2 rtcm104v3 sirf superstar2 timing tsip tripmate tnt ublox ubx" INPUT_DEVICES="evdev wacom" KERNEL="linux" LCD_DEVICES="bayrad cfontz cfontz633 glk hd44780 lb216 lcdm001 mtxorb ncurses text" LIBREOFFICE_EXTENSIONS="presenter-console presenter-minimizer" LINGUAS="de de_DE" OFFICE_IMPLEMENTATION="libreoffice" PHP_TARGETS="php5-5" PYTHON_SINGLE_TARGET="python2_7" PYTHON_TARGETS="python2_7 python3_3 python3_4" RUBY_TARGETS="ruby21 ruby22" SANE_BACKENDS="epson epson2" USERLAND="GNU" VIDEO_CARDS="intel i965" XTABLES_ADDONS="quota2 psd pknock lscan length2 ipv4options ipset ipp2p iface geoip fuzzy condition tee tarpit sysrq steal rawnat logmark ipmark dhcpmac delude chaos account" Unset: CPPFLAGS, CTARGET, EMERGE_DEFAULT_OPTS, INSTALL_MASK, LC_ALL, PORTAGE_BUNZIP2_COMMAND, PORTAGE_COMPRESS, PORTAGE_COMPRESS_FLAGS, PORTAGE_RSYNC_EXTRA_OPTS, USE_PYTHON
Will CC sandbox people then to try to know what information they will need to improve this :/
This can be solved by moving from Unix Makefile Generator to ninja. Didn't believe it, but it cut off all the 30 extra minutes! It is as simple as putting CMAKE_MAKEFILE_GENERATOR="ninja" in the ebuild. I then enabled it globally in the cmake-utils.eclass (just to see how it behaves) and did the kde-frameworks update from 5.8.0 to 5.9.0, and everything went fine. So this might really be an option to enable by default...
Yes, ninja is absolutely amazing, 40 minutes (30%) shorter build time for webkit-2.8.3 on my machine. Unfortunately, we can't switch to it at the moment because it's not yet keyworded on ia64 and ppc :(
i'm not sure there is much here. every time a path access is made, we stat the whole filesystem path component to make sure things point where they say they should. sandbox is known to be slow if you do a lot of filesystem accesses.
+ 31 Jul 2015; Alexandre Rostovtsev <tetromino@gentoo.org> + -webkit-gtk-2.4.8.ebuild, -webkit-gtk-2.4.8-r200.ebuild, + -webkit-gtk-2.6.5.ebuild, webkit-gtk-2.6.6.ebuild, webkit-gtk-2.8.3.ebuild, + -files/webkit-gtk-2.4.7-disable-accelerated-compositing.patch, + -files/webkit-gtk-2.4.8-wayland-webkit2.patch: + Switch to ninja to significantly reduce build time (bug #546336, thanks to + Franz Fellner). Clean out old ebuilds.
