Gentoo Websites Logo
Go to: Gentoo Home Documentation Forums Lists Bugs Planet Store Wiki Get Gentoo!
Bug 187759 - sci-libs/netcdf-3.6.2 parallel make fails
Summary: sci-libs/netcdf-3.6.2 parallel make fails
Status: RESOLVED FIXED
Alias: None
Product: Gentoo Linux
Classification: Unclassified
Component: Current packages (show other bugs)
Hardware: All Linux
: High normal (vote)
Assignee: Gentoo Science Related Packages
URL:
Whiteboard:
Keywords:
: 193300 323015 (view as bug list)
Depends on:
Blocks:
 
Reported: 2007-08-04 22:02 UTC by Ed Catmur
Modified: 2010-06-22 14:25 UTC (History)
2 users (show)

See Also:
Package list:
Runtime testing required: ---


Attachments
typesizes.mod-parallel-make.patch (typesizes.mod-parallel-make.patch,475 bytes, patch)
2007-08-04 22:15 UTC, Ed Catmur
Details | Diff

Note You need to log in before you can comment on or make changes to this bug.
Description Ed Catmur 2007-08-04 22:02:43 UTC
config.status: executing libtool commands
make  all-recursive
make[1]: Entering directory `/var/tmp/portage/sci-libs/netcdf-3.6.2/work/netcdf-3.6.2'
Making all in f90
make[2]: Entering directory `/var/tmp/portage/sci-libs/netcdf-3.6.2/work/netcdf-3.6.2/f90'
/bin/sh ../libtool --mode=compile gfortran -I../libsrc -I.  -g -O2 -c -o typeSizes.lo typeSizes.f90
/bin/sh ../libtool --mode=compile gfortran -I../libsrc -I.  -g -O2 -c -o netcdf.lo netcdf.f90
libtool: compile:  gfortran -I../libsrc -I. -g -O2 -c netcdf.f90  -fPIC -o .libs/netcdf.o
 In file netcdf.f90:38

                       FourByteReal, EightByteReal
                                                 1
Fatal Error: Can't open module file 'typesizes.mod' for reading at (1): No such file or directory
make[2]: *** [netcdf.lo] Error 1
make[2]: *** Waiting for unfinished jobs....
libtool: compile:  gfortran -I../libsrc -I. -g -O2 -c typeSizes.f90  -fPIC -o .libs/typeSizes.o
libtool: compile:  gfortran -I../libsrc -I. -g -O2 -c typeSizes.f90 -o typeSizes.o >/dev/null 2>&1
make[2]: Leaving directory `/var/tmp/portage/sci-libs/netcdf-3.6.2/work/netcdf-3.6.2/f90'
make[1]: *** [all-recursive] Error 1
make[1]: Leaving directory `/var/tmp/portage/sci-libs/netcdf-3.6.2/work/netcdf-3.6.2'
make: *** [all] Error 2


Looks like a parallel make error.
Comment 1 Ed Catmur 2007-08-04 22:15:27 UTC
Created attachment 126885 [details, diff]
typesizes.mod-parallel-make.patch

Patch.
Comment 2 Sébastien Fabbro (RETIRED) gentoo-dev 2007-08-05 12:08:16 UTC
Fixed. Thanks.
Comment 3 Jakub Moc (RETIRED) gentoo-dev 2007-09-21 09:02:16 UTC
*** Bug 193300 has been marked as a duplicate of this bug. ***
Comment 4 Jakub Moc (RETIRED) gentoo-dev 2007-09-21 09:02:28 UTC
That didn't work, Bug 193300
Comment 5 Sébastien Fabbro (RETIRED) gentoo-dev 2007-09-28 11:25:51 UTC
Hi

I could not reproduce the failure with -j3, but with -j2 I could. I commited a new patch which I think should take care of it. Please re-sync, re-emerge and let me know.

Sebastien
Comment 6 Sébastien Fabbro (RETIRED) gentoo-dev 2008-01-06 15:56:49 UTC
Was fixed a while ago.
Comment 7 Dustin J. Mitchell 2009-12-07 00:48:04 UTC
I'm still seeing this today.  Ed's patch is included, but I'm not sure what Sebastien did to try to fix this.

The error is identical to comment #0.

Portage 2.1.6.13 (default/linux/amd64/10.0, gcc-4.1.2, glibc-2.9_p20081201-r2, 2.6.23-gentoo-r3-2007122801 x86_64)
=================================================================
System uname: Linux-2.6.23-gentoo-r3-2007122801-x86_64-AMD_Athlon-tm-_64_Processor_3700+-with-glibc2.2.5
Timestamp of tree: Sun, 06 Dec 2009 06:15:01 +0000
ccache version 2.4 [disabled]
app-shells/bash:     4.0_p28
dev-lang/python:     2.4.4-r13, 2.5.4-r3
dev-python/pycrypto: 2.0.1-r8
dev-util/ccache:     2.4-r7
dev-util/cmake:      2.4.6-r1
sys-apps/baselayout: 1.12.11.1
sys-apps/sandbox:    1.6-r2
sys-devel/autoconf:  2.13, 2.63-r1
sys-devel/automake:  1.4_p6, 1.5, 1.6.3, 1.7.9-r1, 1.8.5-r3, 1.9.6-r2, 1.10.2
sys-devel/binutils:  2.18-r3
sys-devel/gcc-config: 1.4.1
sys-devel/libtool:   2.2.6a
virtual/os-headers:  2.6.27-r2
ACCEPT_KEYWORDS="amd64"
CBUILD="x86_64-pc-linux-gnu"
CFLAGS="-O2 -pipe -march=k8 -msse3 -Os -pipe"
CHOST="x86_64-pc-linux-gnu"
CONFIG_PROTECT="/etc"
CONFIG_PROTECT_MASK="/etc/ca-certificates.conf /etc/env.d /etc/fonts/fonts.conf /etc/gconf /etc/php/apache2-php5/ext-active/ /etc/php/cgi-php5/ext-active/ /etc/php/cli-php5/ext-active/ /etc/revdep-rebuild /etc/sandbox.d /etc/terminfo /etc/udev/rules.d"
CXXFLAGS="-O2 -pipe -march=k8 -msse3 -Os -pipe"
DISTDIR="/usr/portage/distfiles"
FEATURES="autoconfig distlocks fixpackages parallel-fetch protect-owned sandbox sfperms strict unmerge-orphans userfetch"
GENTOO_MIRRORS="http://mirror.mcs.anl.gov/pub/gentoo/"
LDFLAGS="-Wl,-O1"
MAKEOPTS="-j2"
PKGDIR="/usr/portage/packages"
PORTAGE_CONFIGROOT="/"
PORTAGE_RSYNC_OPTS="--recursive --links --safe-links --perms --times --compress --force --whole-file --delete --stats --timeout=180 --exclude=/distfiles --exclude=/local --exclude=/packages"
PORTAGE_TMPDIR="/var/tmp"
PORTDIR="/usr/portage"
PORTDIR_OVERLAY="/usr/local/portage"
SYNC="rsync://rsync.us.gentoo.org/gentoo-portage"
USE="acl amd64 apache2 berkdb bzip2 cli cracklib crypt cups cxx dri fortran gdbm gpm iconv ipv6 jpeg mmx modules mudflap multilib ncurses nls nptl nptlonly openmp pam pcre perl png pppd python readline reflection session spl sse sse2 ssl sysfs tcpd threads unicode vhosts xml xml2 xorg zlib" ALSA_CARDS="ali5451 als4000 atiixp atiixp-modem bt87x ca0106 cmipci emu10k1x ens1370 ens1371 es1938 es1968 fm801 hda-intel intel8x0 intel8x0m maestro3 trident usb-audio via82xx via82xx-modem ymfpci" ALSA_PCM_PLUGINS="adpcm alaw asym copy dmix dshare dsnoop empty extplug file hooks iec958 ioplug ladspa lfloat linear meter mmap_emul mulaw multi null plug rate route share shm softvol" APACHE2_MODULES="access auth auth_basic authn_file auth_dbm auth_anon auth_digest authz_host authz_user alias file-cache filter echo charset-lite cache disk-cache mem-cache ext-filter case_filter case-filter-in deflate mime-magic cern-meta expires headers unique-id proxy proxy_http proxy_connect  info include cgi cgid dav dav-fs vhost-alias rewrite log_config logio env setenvif mime status autoindex asis negotiation dir imap actions userdir so" ELIBC="glibc" INPUT_DEVICES="keyboard mouse evdev" KERNEL="linux" LCD_DEVICES="bayrad cfontz cfontz633 glk hd44780 lb216 lcdm001 mtxorb ncurses text" RUBY_TARGETS="ruby18" USERLAND="GNU" VIDEO_CARDS="fbdev glint intel mach64 mga neomagic nv r128 radeon savage sis tdfx trident vesa vga via vmware voodoo"
Unset:  CPPFLAGS, CTARGET, EMERGE_DEFAULT_OPTS, FFLAGS, INSTALL_MASK, LANG, LC_ALL, LINGUAS, PORTAGE_COMPRESS, PORTAGE_COMPRESS_FLAGS, PORTAGE_RSYNC_EXTRA_OPTS
Comment 8 Michael Weber (RETIRED) gentoo-dev 2010-06-07 03:25:48 UTC
Reopen, bug 323015 still reports this issue.
Comment 9 Michael Weber (RETIRED) gentoo-dev 2010-06-07 03:26:23 UTC
*** Bug 323015 has been marked as a duplicate of this bug. ***
Comment 10 Sébastien Fabbro (RETIRED) gentoo-dev 2010-06-07 16:32:14 UTC
netcdf-3.6.2 is not in the tree anymore. Could you try with 3.6.3, and if it does fail, try with unmasked 4.1.1?

Thanks.
Comment 11 Dustin J. Mitchell 2010-06-07 17:37:05 UTC
Still fails, although note that as a race condition this only fails *sometimes* - I had to run 'emerge' in a loop for a half-hour or so to replicate.

make[2]: Entering directory `/var/tmp/portage/sci-libs/netcdf-3.6.3/work/netcdf-3.6.3/f90'
/bin/sh ../libtool   --mode=compile gfortran -I../libsrc -I.  -O2 -c -o typeSizes.lo typeSizes.f90
/bin/sh ../libtool   --mode=compile gfortran -I../libsrc -I.  -O2 -c -o netcdf.lo netcdf.f90
gfortran -I../libsrc -I.  -O2 -c -o typeSizes.o typeSizes.f90
gfortran -I../libsrc -I.  -O2 -c -o netcdf.o netcdf.f90
 In file netcdf.f90:38 

                       FourByteReal, EightByteReal
                                                 1
Fatal Error: Can't open module file 'typesizes.mod' for reading at (1): No such file or directory
make[2]: *** [netcdf.o] Error 1
make[2]: *** Waiting for unfinished jobs....
libtool: compile:  gfortran -I../libsrc -I. -O2 -c typeSizes.f90  -fPIC -o .libs/typeSizes.o
libtool: compile:  gfortran -I../libsrc -I. -O2 -c netcdf.f90  -fPIC -o .libs/netcdf.o
libtool: compile:  gfortran -I../libsrc -I. -O2 -c typeSizes.f90 -o typeSizes.o >/dev/null 2>&1
libtool: compile:  gfortran -I../libsrc -I. -O2 -c netcdf.f90 -o netcdf.o >/dev/null 2>&1
make[2]: Leaving directory `/var/tmp/portage/sci-libs/netcdf-3.6.3/work/netcdf-3.6.3/f90'
make[1]: *** [all-recursive] Error 1
make[1]: Leaving directory `/var/tmp/portage/sci-libs/netcdf-3.6.3/work/netcdf-3.6.3'
make: *** [all] Error 2

I can't change the bug topic, but it should be updated.
Comment 12 Sébastien Fabbro (RETIRED) gentoo-dev 2010-06-15 18:38:23 UTC
I have tried various combinations of -j<N> and still can not reproduce your failure. 

Have you also tried netcdf-4.1.1?

Comment 13 Dustin J. Mitchell 2010-06-15 20:49:20 UTC
4.1.1 is working fine so far - I've probably done ~100 iterations, which was enough to trigger the failure in previous versions.  I'll leave it running and report back if it does eventually fail.
Comment 14 Justin Lecher (RETIRED) gentoo-dev 2010-06-22 14:25:21 UTC
I included upstreams version off the patch. Thanks for your contribution.