Gentoo Websites Logo
Go to: Gentoo Home Documentation Forums Lists Bugs Planet Store Wiki Get Gentoo!
Bug 123843 - emerging gtk+ takes forever due to xslt processing
Summary: emerging gtk+ takes forever due to xslt processing
Status: RESOLVED INVALID
Alias: None
Product: Gentoo Linux
Classification: Unclassified
Component: [OLD] GNOME (show other bugs)
Hardware: All Linux
: High normal (vote)
Assignee: Gentoo Linux Gnome Desktop Team
URL:
Whiteboard:
Keywords:
: 123857 123860 127873 (view as bug list)
Depends on:
Blocks:
 
Reported: 2006-02-23 12:03 UTC by Blu3
Modified: 2006-11-09 09:00 UTC (History)
2 users (show)

See Also:
Package list:
Runtime testing required: ---


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Blu3 2006-02-23 12:03:40 UTC
*  dev-libs/libxslt
      Latest version available: 1.1.15
      Latest version installed: 1.1.15

*  x11-libs/gtk+
      Latest version available: 2.8.12
      Latest version installed: 2.8.6


when emerging gtk+, xlstproc consumes large amounts of ram and cpu while appearing to accomplish very little.

Jaymale mail # ps auxww|grep xslt
root     28321 96.0 22.8 184900 125016 pts/4   RN+  13:08  72:55 /usr/bin/xsltproc --nonet --xinclude --stringparam gtkdoc.bookname gtk --stringparam gtkdoc.version 1.4 /usr/share/gtk-doc/data/gtk-doc.xsl ../gtk-docs.sgml

after an hour and a half of running, xslt has gotten a few dozen documents accomplished.  after 8 minutes of standstill, strace shows this:

Jaymale mail # date
Thu Feb 23 14:48:05 EST 2006

Jaymale mail # strace -t -f -p 28321
Process 28321 attached - interrupt to quit
14:56:17 mremap(0xb7703000, 999424, 999424, MREMAP_MAYMOVE) = 0xb7703000
14:56:40 mremap(0xb7703000, 999424, 1003520, MREMAP_MAYMOVE) = 0xb7703000
14:57:02 mremap(0xb7703000, 1003520, 1003520, MREMAP_MAYMOVE) = 0xb7703000
14:57:24 mremap(0xb7703000, 1003520, 1003520, MREMAP_MAYMOVE) = 0xb7703000
14:57:48 mremap(0xb7703000, 1003520, 1007616, MREMAP_MAYMOVE) = 0xb7703000


Jaymale mail # emerge info
Portage 2.1_pre4-r1 (default-linux/x86/2005.0, gcc-3.4.5-vanilla, glibc-2.3.6-r3, 2.6.13-rc6 i686)
=================================================================
System uname: 2.6.13-rc6 i686 Pentium III (Katmai)
Gentoo Base System version 1.12.0_pre16
dev-lang/python:     2.2.3-r5, 2.3.5, 2.4.2-r1
sys-apps/sandbox:    1.2.17
sys-devel/autoconf:  2.13, 2.59-r7
sys-devel/automake:  1.4_p6, 1.5, 1.6.3, 1.7.9-r1, 1.8.5-r3, 1.9.6-r1
sys-devel/binutils:  2.16.1-r1
sys-devel/libtool:   1.5.22
virtual/os-headers:  2.4.19-r1, 2.4.21, 2.6.11-r3
ACCEPT_KEYWORDS="x86 ~x86"
AUTOCLEAN="yes"
CBUILD="i686-pc-linux-gnu"
CFLAGS="-march=pentium3 -O3 -pipe -fomit-frame-pointer"
CHOST="i686-pc-linux-gnu"
CONFIG_PROTECT="/etc /usr/kde/2/share/config /usr/kde/3.1/share/config /usr/kde/3/share/config /usr/lib/X11/xkb /usr/share/config /var/bind /var/qmail/control"
CONFIG_PROTECT_MASK="/etc/gconf /etc/terminfo /etc/env.d"
CXXFLAGS="-march=pentium3 -O3 -pipe -fomit-frame-pointer"
DISTDIR="/usr/portage/distfiles"
FEATURES="autoconfig distlocks fixpackages sandbox sfperms strict"
GENTOO_MIRRORS="http://mirror.datapipe.net/gentoo"
MAKEOPTS="-j2"
PKGDIR="/usr/portage/packages"
PORTAGE_TMPDIR="/var/tmp"
PORTDIR="/usr/portage"
PORTDIR_OVERLAY="/usr/local/portage"
SYNC="rsync://rsync.gentoo.org/gentoo-portage"
USE="x86 3dnow X acpi acpi4linux alsa apache2 async bashlogger bcmath bitmap-fonts bzlib calendar cgi clamav cli crypt cups curlwrappers dba discard-path doc eds emboss erandom exif extensions flexresp flood foomaticdb force-cgi-redirect fortran ftp gdbm geoip gif gstreamer gtk gtk2 hardened hardenedphp imap inline iproute2 ipv6 jpeg libclamav libg++ libwww mad mbox md5sum memlimit milter mime mimencode mp3 mpm-prefork ncurses nls nptl oav ogg opengl openssh pam pcap pcapnav pcntl pdflib pear perl pg-vacuumdelay png posix postgres prelude python quicktime readline sasl sendfile session sguil shaper sharedext sharedmem simplexml smp smpgsql snortsam soap sockets softquota spell spl sql sse ssl swat sysfs syslog sysvipc tidy tokenizer truetype truetype-fonts type1-fonts vhosts vorbis xml xml2 xmlrpc xmms xpm xsl xslt xv zip zlib elibc_glibc kernel_linux userland_GNU"
Unset:  ASFLAGS, CTARGET, EMERGE_DEFAULT_OPTS, LANG, LC_ALL, LDFLAGS, LINGUAS


Yes I was told to try -doc, but the point isn't to ignore/hide bugs, but to get them fixed.
Comment 1 Jakub Moc (RETIRED) gentoo-dev 2006-02-23 12:20:17 UTC
Not sure what kind of fix are you expecting here... So don't do USE=doc when it sucks.
Comment 2 Jakub Moc (RETIRED) gentoo-dev 2006-02-23 14:02:48 UTC
*** Bug 123857 has been marked as a duplicate of this bug. ***
Comment 3 Jakub Moc (RETIRED) gentoo-dev 2006-02-23 14:03:33 UTC
*** Bug 123860 has been marked as a duplicate of this bug. ***
Comment 4 Blu3 2006-02-23 15:09:34 UTC
sorry.  ff was crashing and i have session saver loaded. :-/
Comment 5 Saleem Abdulrasool (RETIRED) gentoo-dev 2006-03-04 11:14:02 UTC
How much RAM do you have on your machine?
Comment 6 Blu3 2006-03-04 11:22:55 UTC
Jaymale ~ # free
             total       used       free     shared    buffers     cached
Mem:        546604     521772      24832          0      81824     181288
-/+ buffers/cache:     258660     287944
Swap:       498004      35052     462952

Jaymale ~ # uptime
 14:19:17 up 5 days,  1:44,  7 users,  load average: 0.09, 0.07, 0.09

it's hardly ever used.  i get the same results on all my machines, from 512M up to 1G of ram, from dual PIII/512 to opteron 148/3200.


as to comment #1, i'm kinda expecting someone such as the author/package mntr, to fix it so it doesn't take hours to install/update with USE=doc.
Comment 7 John N. Laliberte (RETIRED) gentoo-dev 2006-03-29 05:09:16 UTC
*** Bug 127873 has been marked as a duplicate of this bug. ***
Comment 8 Tanktalus 2006-03-29 07:48:33 UTC
If "memory" is a problem, I am getting the same problem:

$ free
             total       used       free     shared    buffers     cached
Mem:       3763512    3586236     177276          0     153544    2674304
-/+ buffers/cache:     758388    3005124
Swap:      7823644        384    7823260

I really don't think lack of memory is a problem.

I suppose that if doc doesn't work, that USE flag probably should be removed?  Or, better yet, something gets fixed so that the docs work - there's a reason why I asked for the docs!  Unfortunately, I have no idea whether this is a gentoo-specific issue, or if it's a gtk+ issue - I'm guessing the latter.  If so, then I suppose that a new bug needs to be opened with the gtk+ project?
Comment 9 Gilles Dartiguelongue (RETIRED) gentoo-dev 2006-06-28 19:57:02 UTC
I suggest trying to contact gtk dev on irc first and maybe point them to this bug report.
Comment 10 Leonardo Boshell (RETIRED) gentoo-dev 2006-11-09 09:00:46 UTC
This doesn't constitute a valid bug report. Please notice that processing the Gtk+ manual, which is a relatively big document, with various crossed-references for its indices is inherently a complex task that simply requires a good amount of processing power and memory.

If you do however want to improve things in this area, the way to do it would be contacting xsltproc's maintainers and providing patches upstream.

If you're concerned with the fact that gtk+'s ebuild re-builds the manual with USE=doc, or something else other than "it takes too long", please search bugzilla for the relevant bugs, and add your comments to those.

Thanks.