Bugzilla Bug 212784

I was doing a fresh install of gentoo 2007.0 amd64. When it reached libxslt I
got the following error:

mkdir: cannot create directory
`/var/tmp/portage/dev-libs/libxslt-1.1.22/image//usr/lib64/python2.4/site-packages':
File exists.

and the build fails.

Reproducible: Always

Steps to Reproduce:
1. Install fresh copy of Gentoo 2007.0 on amd64, desktop profile
2. Install kde, libxslt is a dependancy
3. Watch it fail

Portage 2.1.4.4 (default-linux/amd64/2007.0/desktop, gcc-4.1.2, glibc-2.6.1-r0,
2.6.24.3 x86_64)
=================================================================
System uname: 2.6.24.3 x86_64 AMD Athlon(tm) 64 X2 Dual Core Processor 4600+
Timestamp of tree: Sat, 08 Mar 2008 21:17:01 +0000
app-shells/bash:     3.2_p17-r1
dev-lang/python:     2.4.4-r9
dev-python/pycrypto: 2.0.1-r6
sys-apps/baselayout: 1.12.11.1
sys-apps/sandbox:    1.2.18.1-r2
sys-devel/autoconf:  2.61-r1
sys-devel/automake:  1.9.6-r2, 1.10
sys-devel/binutils:  2.18-r1
sys-devel/gcc-config: 1.4.0-r4
sys-devel/libtool:   1.5.26
virtual/os-headers:  2.6.23-r3
ACCEPT_KEYWORDS="amd64"
CBUILD="x86_64-pc-linux-gnu"
CFLAGS="-O2 -pipe -march=athlon64 -m3dnow -mmmx -msse -msse2 -msse3"
CHOST="x86_64-pc-linux-gnu"
CONFIG_PROTECT="/etc /usr/share/X11/xkb"
CONFIG_PROTECT_MASK="/etc/env.d /etc/fonts/fonts.conf /etc/gconf /etc/terminfo
/etc/udev/rules.d"
CXXFLAGS="-O2 -pipe -march=athlon64 -m3dnow -mmmx -msse -msse2 -msse3"
DISTDIR="/usr/portage/distfiles"
FEATURES="ccache distlocks metadata-transfer parallel-fetch sandbox sfperms
strict unmerge-orphans userfetch"
GENTOO_MIRRORS="ftp://mirrors.blueyonder.co.uk/mirrors/gentoo "
LINGUAS="es_ES es"
MAKEOPTS="-j3"
PKGDIR="/usr/portage/packages"
PORTAGE_RSYNC_OPTS="--recursive --links --safe-links --perms --times --compress
--force --whole-file --delete --stats --timeout=180 --exclude=/distfiles
--exclude=/local --exclude=/packages"
PORTAGE_TMPDIR="/var/tmp"
PORTDIR="/usr/portage"
SYNC="rsync://rsync.europe.gentoo.org/gentoo-portage"
USE="3dnow 3dnowext X a52 aac acl acpi alsa amd64 amr apache2 bash-completition
berkdb cairo cdr cli cracklib crypt css cups dbus dri dv dvd dvdr dvdread eds
emboss encode esd evo extrafilters fam fame ffmpeg firefox flac gif glitz gpm
gstreamer hal iconv imagemagick ipv6 isdnlog jack jingle jpeg jpeg2k kde
kerberos ldap lzo mad midi mikmod mjpeg mmx mmxext mp3 mp3rtp mp4 mpeg mudflap
ncurses network nls nptl nptlonly ogg opengl openmp oss pam pcre pdf perl png
pppd python qt3 qt3support qt4 quicktime readline reflection sdl session speex
spell spl sse sse2 sse3 ssl svg tcpd theora threads tiff truetype unicode
userlocales utempter v4l v4l2 vcd vorbis vorbis-psy wifi xcomposite xinerama
xml xorg xscreensaver xv xvid zlib" ALSA_CARDS="intel8x0"
ALSA_PCM_PLUGINS="adpcm alaw asym copy dmix dshare dsnoop empty extplug file
hooks iec958 ioplug ladspa lfloat linear meter mulaw multi null plug rate route
share shm softvol" APACHE2_MODULES="actions alias auth_basic authn_alias
authn_anon authn_dbm authn_default authn_file authz_dbm authz_default
authz_groupfile authz_host authz_owner authz_user autoindex cache dav dav_fs
dav_lock deflate dir disk_cache env expires ext_filter file_cache filter
headers include info log_config logio mem_cache mime mime_magic negotiation
rewrite setenvif speling status unique_id userdir usertrack vhost_alias"
ELIBC="glibc" INPUT_DEVICES="evdev keyboard mouse" KERNEL="linux"
LCD_DEVICES="bayrad cfontz cfontz633 glk hd44780 lb216 lcdm001 mtxorb ncurses
text" LINGUAS="es_ES es" USERLAND="GNU" VIDEO_CARDS="nvidia"
Unset:  CPPFLAGS, CTARGET, EMERGE_DEFAULT_OPTS, INSTALL_MASK, LANG, LC_ALL,
LDFLAGS, PORTAGE_COMPRESS, PORTAGE_COMPRESS_FLAGS, PORTAGE_RSYNC_EXTRA_OPTS,
PORTDIR_OVERLAY

Created an attachment (id=145620) [details]
Build log

What does the following command report to you after it fails and therefore the
build dir isn't cleaned up:

file
/var/tmp/portage/dev-libs/libxslt-1.1.22/image//usr/lib64/python2.4/site-packages

I think this is a parallel build failure very much in the same way gedit did.
I'll have a look at http://bugzilla.gnome.org/show_bug.cgi?id=508512 (too lazy
to find the gentoo bug now).

At least there are no instances of install-exec-local in libxslt Makefiles, so
not so sure about that... I agree that it is very likely a parallel build issue

file says:
/var/tmp/portage/dev-libs/libxslt-1.1.22/image/usr/lib64/python2.4/site-packages/:
directory

ls says: libxsltmod.a  libxsltmod.la  libxsltmod.so

Well, I just tried to install it again and this time it finished correctly.
I have made no changes to the system, just a reboot.

(In reply to comment #7)
> Well, I just tried to install it again and this time it finished correctly.
> I have made no changes to the system, just a reboot.
> 

yeah definitely sounds like a parallel install problem. You might try
rebuilding it in a loop to check and I'm pretty sure it'll fail at some point.

So it is already a directory, so mkdir -p isn't supposed to fail at that point:

  -p, --parents     no error if existing, make parent directories as needed

So not sure what failed. I can't reproduce with MAKEOPTS="-j" either (running
rm .../.installed;ebuild ... install in a loop) in 15 tries or so...

It took 6 attempts to make it fail. Without changing my env variables( still
running with MAKEOPTS="-j3") I ran the following in a loop:

ebuild /usr/portage/dev-libs/libxslt/libxslt-1.1.22.ebuild clean
ebuild /usr/portage/dev-libs/libxslt/libxslt-1.1.22.ebuild install

Just hit this on a rebuild.  Running emerge again fixed it, definantly a
parellel failure.

Created an attachment (id=147691) [details]
libxslt-1.1.22-parallel-install.patch

Could you guys please try this patch. It seems to fix it for me.

(In reply to comment #12)
> Created an attachment (id=147691) [edit] [details]
> libxslt-1.1.22-parallel-install.patch
> 
> Could you guys please try this patch. It seems to fix it for me.

It's still seems to be reproducible here, but it took 5 builds. Will give it
another spin-in-a-loop.

Still happens here after patching(In reply to comment #12)
> Created an attachment (id=147691) [edit] [details]
> libxslt-1.1.22-parallel-install.patch
> 
> Could you guys please try this patch. It seems to fix it for me.
> 

Still happening here

Same / very similar thing happend on my i386 (1 core p4). Running emerge once
more solved the problem.

the fix should be in 1.1.23 that I just commited to the tree. Please reopen if
it's not the case.