'MAKEOPTS=-j1 emerge -v1 vtk' fails with: ... -- Downloaded object: "/var/tmp/portage/sci-libs/vtk-6.1.0/work/vtk-6.1.0_build/ExternalData/Objects/MD5/057e6f518ff039b41c2bb8858e198e48" [1307/20373] cd /var/tmp/portage/sci-libs/vtk-6.1.0/work/vtk-6.1.0_build && /usr/bin/cmake -Drelative_top=/var/tmp/portage/sci-libs/vtk-6.1.0/work/vtk-6.1.0_build -Dfile=/var/tmp/portage/sci-libs/vtk-6.1.0/work/vtk-6.1.0_build/ExternalData/Testing/Data/WindBladeReader/field/comp.out.10 -Dname=/var/tmp/portage/sci-libs/vtk-6.1.0/work/VTK-6.1.0/Testing/Data/WindBladeReader/field/comp.out.10 -Dext=.md5 -DExternalData_ACTION=fetch -DExternalData_CONFIG=/var/tmp/portage/sci-libs/vtk-6.1.0/work/vtk-6.1.0_build/VTKData_config.cmake -P /var/tmp/portage/sci-libs/vtk-6.1.0/work/VTK-6.1.0/CMake/ExternalData.cmake FAILED: cd /var/tmp/portage/sci-libs/vtk-6.1.0/work/vtk-6.1.0_build && /usr/bin/cmake -Drelative_top=/var/tmp/portage/sci-libs/vtk-6.1.0/work/vtk-6.1.0_build -Dfile=/var/tmp/portage/sci-libs/vtk-6.1.0/work/vtk-6.1.0_build/ExternalData/Testing/Data/WindBladeReader/field/comp.out.10 -Dname=/var/tmp/portage/sci-libs/vtk-6.1.0/work/VTK-6.1.0/Testing/Data/WindBladeReader/field/comp.out.10 -Dext=.md5 -DExternalData_ACTION=fetch -DExternalData_CONFIG=/var/tmp/portage/sci-libs/vtk-6.1.0/work/vtk-6.1.0_build/VTKData_config.cmake -P /var/tmp/portage/sci-libs/vtk-6.1.0/work/VTK-6.1.0/CMake/ExternalData.cmake -- Fetching "http://midas3.kitware.com/midas/api/rest?method=midas.bitstream.download&checksum=e1bc2bf8f0e85161cfab9440d20c93b9&algorithm=MD5" -- [download 0% complete] -- [download 1% complete] -- [download 2% complete] ... -- [download 64% complete] -- [download 65% complete] CMake Error at /var/tmp/portage/sci-libs/vtk-6.1.0/work/VTK-6.1.0/CMake/ExternalData.cmake:735 (message): Object MD5=e1bc2bf8f0e85161cfab9440d20c93b9 not found at: http://midas3.kitware.com/midas/api/rest?method=midas.bitstream.download&checksum=e1bc2bf8f0e85161cfab9440d20c93b9&algorithm=MD5 ("Timeout was reached") http://www.vtk.org/files/ExternalData/MD5/e1bc2bf8f0e85161cfab9440d20c93b9 ("Timeout was reached") Call Stack (most recent call first): /var/tmp/portage/sci-libs/vtk-6.1.0/work/VTK-6.1.0/CMake/ExternalData.cmake:757 (_ExternalData_download_object) ninja: build stopped: subcommand failed. * ERROR: sci-libs/vtk-6.1.0::gentoo failed (compile phase): ... root@impala:/usr/local/portage/net-irc(169)# emerge --info '=sci-libs/vtk-6.1.0::gentoo' Portage 2.2.15 (python 2.7.9-final-0, default/linux/amd64/13.0, gcc-4.8.4, glibc-2.20, 3.18.1-gentoo x86_64) ================================================================= System Settings ================================================================= System uname: Linux-3.18.1-gentoo-x86_64-AMD_Phenom-tm-_II_X4_965_Processor-with-gentoo-2.2 KiB Mem: 8164068 total, 822796 free KiB Swap: 50331640 total, 49845780 free Timestamp of tree: Sun, 28 Dec 2014 06:00:01 +0000 sh bash 4.3_p30-r1 ld GNU ld (GNU Binutils) 2.24 app-shells/bash: 4.3_p30-r1 dev-java/java-config: 2.2.0 dev-lang/perl: 5.20.1-r4 dev-lang/python: 2.7.9-r1, 3.3.5-r1, 3.4.2 dev-util/cmake: 3.0.2 dev-util/pkgconfig: 0.28-r2 sys-apps/baselayout: 2.2 sys-apps/openrc: 0.13.6 sys-apps/sandbox: 2.6-r1 sys-devel/autoconf: 2.13, 2.69 sys-devel/automake: 1.10.3-r1, 1.11.6-r1, 1.12.6, 1.14.1 sys-devel/binutils: 2.24-r3 sys-devel/gcc: 4.8.4 sys-devel/gcc-config: 1.8 sys-devel/libtool: 2.4.4 sys-devel/make: 4.1-r1 sys-kernel/linux-headers: 3.17-r1 (virtual/os-headers) sys-libs/glibc: 2.20 Repositories: gentoo science sunrise sage-on-gentoo x11 x-portage g-cpan g-octave ACCEPT_KEYWORDS="amd64 ~amd64" ACCEPT_LICENSE="* -@EULA PUEL Intel-SDP dlj-1.1 skype-eula skype-4.0.0.7-copyright googleearth AdobeFlash-11.x cadsoft Oracle-BCLA-JavaSE MakeMKV-EULA NVIDIA-CUDA Nero-AAC-EULA GIMPS" CBUILD="x86_64-pc-linux-gnu" CFLAGS="-march=amdfam10 -O2 -pipe" CHOST="x86_64-pc-linux-gnu" CONFIG_PROTECT="/etc /usr/share/config /usr/share/gnupg/qualified.txt /var/lib/hsqldb" CONFIG_PROTECT_MASK="/etc/ca-certificates.conf /etc/dconf /etc/env.d /etc/fonts/fonts.conf /etc/gconf /etc/gentoo-release /etc/php/apache2-php5.6/ext-active/ /etc/php/cgi-php5.6/ext-active/ /etc/php/cli-php5.6/ext-active/ /etc/revdep-rebuild /etc/sandbox.d /etc/terminfo /etc/texmf/language.dat.d /etc/texmf/language.def.d /etc/texmf/updmap.d /etc/texmf/web2c" CXXFLAGS="-march=amdfam10 -O2 -pipe" DISTDIR="/usr/portage/distfiles" FCFLAGS="-O2 -pipe" FEATURES="assume-digests binpkg-logs config-protect-if-modified distlocks ebuild-locks fixlafiles merge-sync news parallel-fetch preserve-libs protect-owned sandbox sfperms strict unknown-features-warn unmerge-logs unmerge-orphans userfetch userpriv usersandbox usersync xattr" FFLAGS="-O2 -pipe" GENTOO_MIRRORS="http://distfiles.gentoo.org" LANG="en_US.UTF-8" LDFLAGS="-Wl,-O1 -Wl,--as-needed" MAKEOPTS="-j5" PKGDIR="/usr/portage/packages" PORTAGE_CONFIGROOT="/" PORTAGE_RSYNC_OPTS="--recursive --links --safe-links --perms --times --omit-dir-times --compress --force --whole-file --delete --stats --human-readable --timeout=180 --exclude=/distfiles --exclude=/local --exclude=/packages" PORTAGE_TMPDIR="/var/tmp" PORTDIR="/usr/portage_impala" PORTDIR_OVERLAY="/var/lib/layman/science /var/lib/layman/sunrise /var/lib/layman/sage-on-gentoo /var/lib/layman/x11 /usr/local/portage /var/lib/cpan /var/lib/g-octave" USE="3dnow 3dnowext 64bit R X Xaw3d a52 aac accessibility acl acpi admin afs alsa amd64 ao apache2 apng applet archive armadillo arpack asf aspell atlas audacious audiofile automap automount bash-completion berkdb blas blast bluetooth bluray boost bzip2 cairo cdda cddb cdf cdio cdparanoia cdr cg cgi chm cli cmake cracklib crypt css cups curl cxx daap db dbi dbm dbus declarative designer devhelp device-mapper dga dia dirac djvu doc dot dri ds2490 ds9097 ds9097u dts dv dvb dvd dvdr dvi dynamicplugin eds egl elf emacs emboss emf encode epiphany evo examples exif expat extensions extra extras faac faad fam ffmpeg fftw firefox fits flac fltk fontconfig foomaticdb fortran fortran95 fpm fpx fuse g3dvl gcj gd gdal gdbm gdu gedit geoip geolocation geos gfortran gif gimp git glade glib glpk gml gmp gnome gnome-keyring gnome-print gnuplot gnutls gold gphoto2 gpm grammar graphics graphtft graphviz grass gsl gsm gstreamer gtk gtk3 gudev guile hddtemp hdf hdf5 hdri html http httpd hvm hwdb iconv icq icu id3tag ide imagemagick imap inotify introspection ipod ipv6 ithreads jabber jadetex java java6 jbig jit john jpeg jpeg2k kate kde kdepim kdrive kerberos keymap kpathsea kvm ladspa lame lapack latex lcms ldap lensfun libffi libkms libnotify libsamplerate live lm_sensors lua lzma lzo mad mail maildir mapnik math matroska media-library mercurial mikmod mkl mmx mmxext mng mod modules mono motif mozilla mp3 mp4 mpeg mpi mplayer mtp multilib multimedia musepack musicbrainz mysql mysqli nautilus ncurses netcdf netpbm network networking nfs nls nntp nptl nsplugin ntfs ntp numpy obex objc ocaml ocr octave odbc ofa ogdi ogg openexr opengl openmp openvg pam pango pcre pda pdf pdl2 perl plasma plotutils plugins png podcast policykit portaudio posix postgres postscript ppds preview-latex proj projectm pstricks pulseaudio python python-bindings q16 q32 qemu qhull qt3support qt4 quicktime raw readline reiserfs reports rle romio rpc rrdcgi rrdtool sage samba sasl schroedinger science sdk sdl secure-delete semantic-desktop server session shout sip slang slp smart smbclient smp sms sndfile snmp soap sockets sound soup sox speex spell sql sqlite sse sse2 sse4 sse4a ssl stlport subtitles subversion sudo suexec svg svm swig systemd szip t1lib tcl tcpd tex tex4ht texmacs theora thesaurus threads thunderbird tidy tiff tk tools truetype udev udisks unicode usb utempter v4l vaapi vala valgrind vdpau video virt-network virtualbox visio vorbis vpx vtk wav webdav webdav-serf webkit wmf wxwidgets x264 xa xattr xcb xetex xext xft xine xml xmlreader xmlrpc xpm xv xvid xvmc yaml youtube zlib zvbi" ABI_X86="64" ALSA_CARDS="ali5451 als4000 atiixp atiixp-modem bt87x ca0106 cmipci emu10k1x ens1370 ens1371 es1938 es1968 fm801 hda-intel intel8x0 intel8x0m maestro3 trident usb-audio via82xx via82xx-modem ymfpci" APACHE2_MODULES="actions alias auth_basic auth_digest authn_anon authn_dbd authn_core authn_dbm authn_default authn_file authz_core authz_dbm authz_default authz_groupfile authz_host authz_owner authz_user autoindex cache cgid dav dav_fs dav_lock dbd deflate dir disk_cache env expires ext_filter file_cache filter headers ident imagemap include info lbmethod_byrequests log_config logio mem_cache mime mime_magic negotiation proxy proxy_ajp proxy_balancer proxy_connect proxy_http rewrite setenvif slotmem_shm so socache_shmcb speling status unique_id unixd userdir usertrack vhost_alias" CALLIGRA_FEATURES="kexi words flow plan sheets stage tables krita karbon braindump author" CAMERAS="canon fuji ptp2" COLLECTD_PLUGINS="df interface irq load memory rrdtool swap syslog" CURL_SSL="nss" DRACUT_MODULES="caps lvm mdraid syslog" ELIBC="glibc" GPSD_PROTOCOLS="ashtech aivdm earthmate evermore fv18 garmin garmintxt gpsclock itrax mtk3301 nmea ntrip navcom oceanserver oldstyle oncore rtcm104v2 rtcm104v3 sirf superstar2 timing tsip tripmate tnt ublox ubx" INPUT_DEVICES="keyboard mouse evdev void" KERNEL="linux" LCD_DEVICES="cfontz hd44780 mtxorb ncurses X lcd2usb lcdlinux png usblcd" LIBREOFFICE_EXTENSIONS="presenter-console presenter-minimizer" LINGUAS="de fr ru" NETBEANS_MODULES="apisupport cnd dlight enterprise ergonomics groovy gsf harness ide identity j2ee java mobility nb php profiler websvccommon xml" OFFICE_IMPLEMENTATION="libreoffice" PYTHON_SINGLE_TARGET="python2_7" PYTHON_TARGETS="python2_7 python3_3" QEMU_SOFTMMU_TARGETS="arm i386 x86_64" QEMU_USER_TARGETS="arm i386 x86_64" RUBY_TARGETS="ruby19 ruby20" USERLAND="GNU" VIDEO_CARDS="nouveau displaylink" XTABLES_ADDONS="quota2 psd pknock lscan length2 ipv4options ipset ipp2p iface geoip fuzzy condition tee tarpit sysrq steal rawnat logmark ipmark dhcpmac delude chaos account" Unset: CPPFLAGS, CTARGET, EMERGE_DEFAULT_OPTS, INSTALL_MASK, LC_ALL, PORTAGE_BUNZIP2_COMMAND, PORTAGE_COMPRESS, PORTAGE_COMPRESS_FLAGS, PORTAGE_RSYNC_EXTRA_OPTS, SYNC, USE_PYTHON root@impala:/usr/local/portage/net-irc(170)# emerge -pqv '=sci-libs/vtk-6.1.0::gentoo' [ebuild U ] sci-libs/vtk-6.1.0 [6.0.0] USE="R X boost cg doc examples ffmpeg gdal%* java mpi mysql odbc postgres python qt4 rendering smp%* tbb%* tcl theora tk -all-modules% (-aqua) -imaging -json% -kaapi% -offscreen {-test} -views -web% -xdmf2%" PYTHON_TARGETS="python2_7" VIDEO_CARDS="-nvidia"
Created attachment 392608 [details] build.log.bz2
Manual downloading of http://midas3.kitware.com/midas/api/rest?method=midas.bitstream.download&checksum=e1bc2bf8f0e85161cfab9440d20c93b9&algorithm=MD5 works: rose@impala:/home/rose(116)$ wget "http://midas3.kitware.com/midas/api/rest?method=midas.bitstream.download&checksum=e1bc2bf8f0e85161cfab9440d20c93b9&algorithm=MD5" --2014-12-29 12:11:21-- http://midas3.kitware.com/midas/api/rest?method=midas.bitstream.download&checksum=e1bc2bf8f0e85161cfab9440d20c93b9&algorithm=MD5 Auflösen des Hostnamen »midas3.kitware.com (midas3.kitware.com)«... 50.58.123.181 Verbindungsaufbau zu midas3.kitware.com (midas3.kitware.com)|50.58.123.181|:80... verbunden. HTTP-Anforderung gesendet, warte auf Antwort... 302 Found Platz: /midas/download/?bitstream=326514&offset=0&name=comp.out.10[folge] --2014-12-29 12:11:22-- http://midas3.kitware.com/midas/download/?bitstream=326514&offset=0&name=comp.out.10 Wiederverwendung der bestehenden Verbindung zu midas3.kitware.com:80. HTTP-Anforderung gesendet, warte auf Antwort... 200 OK Länge: 64512144 (62M) [application/octet-stream] In »»rest?method=midas.bitstream.download&checksum=e1bc2bf8f0e85161cfab9440d20c93b9&algorithm=MD5«« speichern. rest?method=midas.bitstream.down 100%[============================================================>] 61.52M 153KB/s in 7m 20s s 2014-12-29 12:18:43 (143 KB/s) - »»rest?method=midas.bitstream.download&checksum=e1bc2bf8f0e85161cfab9440d20c93b9&algorithm=MD5«« gespeichert [64512144/64512144] ose@impala:/home/rose(117)$ ll -t | head insgesamt 10762864 -rw-r----- 1 rose rose 64512144 29. Dez 12:11 rest?method=midas.bitstream.download&checksum=e1bc2bf8f0e85161cfab9440d20c93b9&algorithm=MD5 But I do not know, what can I do with the saved file. Copy to /usr/portage/distfiles/e1bc2bf8f0e85161cfab9440d20c93b9 ?
BTW., on the next systems fails downloading of "http://midas3.kitware.com/midas/api/rest?method=midas.bitstream.download&checksum=c1a9211df9a954272161f80626583733&algorithm=MD5".
I tried several times on seven computers in my home network 'MAKEOPTS=-j1 emerge -v1 vtk'. It fails at every attempt on every machine mostly after 46-56 min and downloading about 83% of http://midas3.kitware.com/midas/api/rest?method=midas.bitstream.download&checksum=e1bc2bf8f0e85161cfab9440d20c93b9&algorithm=MD5 . If I try to emerge vtk-6.1.0 at machines in the university, it works like a charm (at least using the ebuild of Comment 13 of https://bugs.gentoo.org/show_bug.cgi?id=533606), even with the notebook on which it failed in the homenet. I have a download rate of 180 KB/s and a upload rate of 23 KB/s here in the home network. So I suppose the slow internet connection is anyway responsible for the issue. (It is a pity, but German Telekom is not able or not willing to install a better connection in our street in the center of Berlin.) But nevertheless it should be possible to install vtk also with a slow internet connection. It would be really nice, if I could prefetch these components for vtk and store them under /usr/portage/distfiles, which is on a nfs share. So it would not be necessary to download them seven times for my seven machines. Any hint is appreciated.
Try FEATURES=network-sandbox. I will look into all vtk issues next week.
(In reply to Justin Lecher from comment #5) > Try FEATURES=network-sandbox. I will look into all vtk issues next week. I tried. But not very succesful. Now 'MAKEOPTS=-j1 emerge -v1 vtk' fails after 2 minutes with: ... -- Fetching "http://midas3.kitware.com/midas/api/rest?method=midas.bitstream.download&checksum=9efa4ed5e756af1d5bf8eab2d5edb660&algorithm=MD5" -- Fetching "http://www.vtk.org/files/ExternalData/MD5/9efa4ed5e756af1d5bf8eab2d5edb660" CMake Error at /var/tmp/portage/sci-libs/vtk-6.1.0/work/VTK-6.1.0/CMake/ExternalData.cmake:735 (message): Object MD5=9efa4ed5e756af1d5bf8eab2d5edb660 not found at: http://midas3.kitware.com/midas/api/rest?method=midas.bitstream.download&checksum=9efa4ed5e756af1d5bf8eab2d5edb660&algorithm=MD5 ("Couldn't resolve host name") http://www.vtk.org/files/ExternalData/MD5/9efa4ed5e756af1d5bf8eab2d5edb660 ("Couldn't resolve host name") Call Stack (most recent call first): /var/tmp/portage/sci-libs/vtk-6.1.0/work/VTK-6.1.0/CMake/ExternalData.cmake:757 (_ExternalData_download_object) ninja: build stopped: subcommand failed. * ERROR: sci-libs/vtk-6.1.0::gentoo failed (compile phase):
I tried once more with FEATURES=network-sandbox. Again it fails after about two minutes. Now with: FAILED: cd /var/tmp/portage/sci-libs/vtk-6.1.0/work/vtk-6.1.0_build && /usr/bin/cmake -Drelative_top=/var/tmp/portage/sci-libs/vtk-6.1.0/work/vtk-6.1.0_build -Dfile=/var/tmp/portage/sci-libs/vtk-6.1.0/work/vtk-6.1.0_build/ExternalData/Testing/Data/earth.ppm -Dname=/var/tmp/portage/sci-libs/vtk-6.1.0/work/VTK-6.1.0/Testing/Data/earth.ppm -Dext=.md5 -DExternalData_ACTION=fetch -DExternalData_CONFIG=/var/tmp/portage/sci-libs/vtk-6.1.0/work/vtk-6.1.0_build/VTKData_config.cmake -P /var/tmp/portage/sci-libs/vtk-6.1.0/work/VTK-6.1.0/CMake/ExternalData.cmake -- Fetching "http://midas3.kitware.com/midas/api/rest?method=midas.bitstream.download&checksum=fb9d2fa4bb81f483a8c7a1e746194cfc&algorithm=MD5" -- Fetching "http://www.vtk.org/files/ExternalData/MD5/fb9d2fa4bb81f483a8c7a1e746194cfc" CMake Error at /var/tmp/portage/sci-libs/vtk-6.1.0/work/VTK-6.1.0/CMake/ExternalData.cmake:735 (message): Object MD5=fb9d2fa4bb81f483a8c7a1e746194cfc not found at: http://midas3.kitware.com/midas/api/rest?method=midas.bitstream.download&checksum=fb9d2fa4bb81f483a8c7a1e746194cfc&algorithm=MD5 ("Couldn't resolve host name") http://www.vtk.org/files/ExternalData/MD5/fb9d2fa4bb81f483a8c7a1e746194cfc ("Couldn't resolve host name") Call Stack (most recent call first): /var/tmp/portage/sci-libs/vtk-6.1.0/work/VTK-6.1.0/CMake/ExternalData.cmake:757 (_ExternalData_download_object)
Bringing a further notebook to faster internet provider solve the issue for this system too.
'emerge vtk' fails for sci-libs/vtk-6.1.0-r1 with the same issue.
(In reply to Juergen Rose from comment #9) > 'emerge vtk' fails for sci-libs/vtk-6.1.0-r1 with the same issue. Could you please see if USE=-mpi helps? It is not reproducible here.
(In reply to Justin Lecher from comment #10) > (In reply to Juergen Rose from comment #9) > > 'emerge vtk' fails for sci-libs/vtk-6.1.0-r1 with the same issue. > > Could you please see if USE=-mpi helps? It is not reproducible here. I can not image that a Timeout error during source download is based on a wrong USE flag. Nevertheless I am just checking if USE=-mpi helps.
(In reply to Juergen Rose from comment #11) > (In reply to Justin Lecher from comment #10) > > (In reply to Juergen Rose from comment #9) > > > 'emerge vtk' fails for sci-libs/vtk-6.1.0-r1 with the same issue. > > > > Could you please see if USE=-mpi helps? It is not reproducible here. > > > I can not image that a Timeout error during source download is based on a > wrong USE flag. Nevertheless I am just checking if USE=-mpi helps. We need to find the reason of the download in first place. an ebuild should always work in an offline mode.
On the system with FEATURES=network-sandbox 'MAKEOPTS=-j1 USE=-mpi emerge -v1 vtk' fails after two minutes with: root@caiman:/root(40)# time MAKEOPTS=-j1 USE=-mpi emerge -v1 vtk >>> Source configured. >>> Compiling source in /var/tmp/portage/sci-libs/vtk-6.1.0-r1/work/VTK-6.1.0 ... >>> Working in BUILD_DIR: "/var/tmp/portage/sci-libs/vtk-6.1.0-r1/work/vtk-6.1.0_build" ninja -j1 -v [1/20157] cd /var/tmp/portage/sci-libs/vtk-6.1.0-r1/work/vtk-6.1.0_build && /usr/bin/cmake -Drelative_top=/var/tmp/portage/sci-libs/vtk-6.1.0-r1/work/vtk-6.1.0_build -Dfile=/var/tmp/portage/sci-libs/vtk-6.1.0-r1/work/vtk-6.1.0_build/ExternalData/Testing/Data/delimited2.txt -Dname=/var/tmp/portage/sci-libs/vtk-6.1.0-r1/work/VTK-6.1.0/Testing/Data/delimited2.txt -Dext=.md5 -DExternalData_ACTION=fetch -DExternalData_CONFIG=/var/tmp/portage/sci-libs/vtk-6.1.0-r1/work/vtk-6.1.0_build/VTKData_config.cmake -P /var/tmp/portage/sci-libs/vtk-6.1.0-r1/work/VTK-6.1.0/CMake/ExternalData.cmake FAILED: cd /var/tmp/portage/sci-libs/vtk-6.1.0-r1/work/vtk-6.1.0_build && /usr/bin/cmake -Drelative_top=/var/tmp/portage/sci-libs/vtk-6.1.0-r1/work/vtk-6.1.0_build -Dfile=/var/tmp/portage/sci-libs/vtk-6.1.0-r1/work/vtk-6.1.0_build/ExternalData/Testing/Data/delimited2.txt -Dname=/var/tmp/portage/sci-libs/vtk-6.1.0-r1/work/VTK-6.1.0/Testing/Data/delimited2.txt -Dext=.md5 -DExternalData_ACTION=fetch -DExternalData_CONFIG=/var/tmp/portage/sci-libs/vtk-6.1.0-r1/work/vtk-6.1.0_build/VTKData_config.cmake -P /var/tmp/portage/sci-libs/vtk-6.1.0-r1/work/VTK-6.1.0/CMake/ExternalData.cmake -- Fetching "http://midas3.kitware.com/midas/api/rest?method=midas.bitstream.download&checksum=2348d135d21a6ed54882fa22e358f60d&algorithm=MD5" -- Fetching "http://www.vtk.org/files/ExternalData/MD5/2348d135d21a6ed54882fa22e358f60d" CMake Error at /var/tmp/portage/sci-libs/vtk-6.1.0-r1/work/VTKroot@caiman:/root(42)# time MAKEOPTS=-j1 USE=-mpi emerge -v1 vtk-6.1.0/CMake/ExternalData.cmake:735 (message): Object MD5=2348d135d21a6ed54882fa22e358f60d not found at: http://midas3.kitware.com/midas/api/rest?method=midas.bitstream.download&checksum=2348d135d21a6ed54882fa22e358f60d&algorithm=MD5 ("Couldn't resolve host name") http://www.vtk.org/files/ExternalData/MD5/2348d135d21a6ed54882fa22e358f60d ("Couldn't resolve host name") Call Stack (most recent call first): /var/tmp/portage/sci-libs/vtk-6.1.0-r1/work/VTK-6.1.0/CMake/ExternalData.cmake:757 (_ExternalData_download_object) ninja: build stopped: subcommand failed. * ERROR: sci-libs/vtk-6.1.0-r1::gentoo failed (compile phase): At a second with standard make.conf (empty FEATURES) 'MAKEOPTS=-j1 USE=-mpi emerge -v1 vtk' fails as before after 47 minutes fetching 83% of http://midas3.kitware.com/midas/api/rest?method=midas.bitstream.download&checksum=e1bc2bf8f0e85161cfab9440d20c93b9&algorithm=MD5 with timeout: root@impala:/root(34)# time MAKEOPTS=-j1 USE=-mpi emerge -v1 vtk ... -- [download 100% complete] -- Downloaded object: "/var/tmp/portage/sci-libs/vtk-6.1.0-r1/work/vtk-6.1.0_build/ExternalData/Objects/MD5/057e6f518ff039b41c2bb8858e198e48" [1309/20157] cd /var/tmp/portage/sci-libs/vtk-6.1.0-r1/work/vtk-6.1.0_build && /usr/bin/cmake -Drelative_top=/var/tmp/portage/sci-libs/vtk-6.1.0-r1/work/vtk-6.1.0_build -Dfile=/var/tmp/portage/sci-libs/vtk-6.1.0-r1/work/vtk-6.1.0_build/ExternalData/Testing/Data/WindBladeReader/field/comp.out.10 -Dname=/var/tmp/portage/sci-libs/vtk-6.1.0-r1/work/VTK-6.1.0/Testing/Data/WindBladeReader/field/comp.out.10 -Dext=.md5 -DExternalData_ACTION=fetch -DExternalData_CONFIG=/var/tmp/portage/sci-libs/vtk-6.1.0-r1/work/vtk-6.1.0_build/VTKData_config.cmake -P /var/tmp/portage/sci-libs/vtk-6.1.0-r1/work/VTK-6.1.0/CMake/ExternalData.cmake FAILED: cd /var/tmp/portage/sci-libs/vtk-6.1.0-r1/work/vtk-6.1.0_build && /usr/bin/cmake -Drelative_top=/var/tmp/portage/sci-libs/vtk-6.1.0-r1/work/vtk-6.1.0_build -Dfile=/var/tmp/portage/sci-libs/vtk-6.1.0-r1/work/vtk-6.1.0_build/ExternalData/Testing/Data/WindBladeReader/field/comp.out.10 -Dname=/var/tmp/portage/sci-libs/vtk-6.1.0-r1/work/VTK-6.1.0/Testing/Data/WindBladeReader/field/comp.out.10 -Dext=.md5 -DExternalData_ACTION=fetch -DExternalData_CONFIG=/var/tmp/portage/sci-libs/vtk-6.1.0-r1/work/vtk-6.1.0_build/VTKData_config.cmake -P /var/tmp/portage/sci-libs/vtk-6.1.0-r1/work/VTK-6.1.0/CMake/ExternalData.cmake -- Fetching "http://midas3.kitware.com/midas/api/rest?method=midas.bitstream.download&checksum=e1bc2bf8f0e85161cfab9440d20c93b9&algorithm=MD5" -- [download 0% complete] ... -- [download 82% complete] -- Fetching "http://www.vtk.org/files/ExternalData/MD5/e1bc2bf8f0e85161cfab9440d20c93b9" -- [download 0% complete] ... -- [download 83% complete] CMake Error at /var/tmp/portage/sci-libs/vtk-6.1.0-r1/work/VTK-6.1.0/CMake/ExternalData.cmake:735 (message): Object MD5=e1bc2bf8f0e85161cfab9440d20c93b9 not found at: http://midas3.kitware.com/midas/api/rest?method=midas.bitstream.download&checksum=e1bc2bf8f0e85161cfab9440d20c93b9&algorithm=MD5 ("Timeout was reached") http://www.vtk.org/files/ExternalData/MD5/e1bc2bf8f0e85161cfab9440d20c93b9 ("Timeout was reached")
(In reply to Justin Lecher from comment #12) > (In reply to Juergen Rose from comment #11) > > (In reply to Justin Lecher from comment #10) > > > (In reply to Juergen Rose from comment #9) > > > > 'emerge vtk' fails for sci-libs/vtk-6.1.0-r1 with the same issue. > > > > > > Could you please see if USE=-mpi helps? It is not reproducible here. > > > > > > I can not image that a Timeout error during source download is based on a > > wrong USE flag. Nevertheless I am just checking if USE=-mpi helps. > > We need to find the reason of the download in first place. an ebuild should > always work in an offline mode. I think the reason for the download at build time is /var/tmp/portage/sci-libs/vtk-6.1.0-r1/work/VTK-6.1.0/CMake/ExternalData.cmake: root@condor:/usr/src/linux(16)# head /var/tmp/portage/sci-libs/vtk-6.1.0-r1/work/VTK-6.1.0/CMake/ExternalData.cmake # - Manage data files stored outside source tree # Use this module to unambiguously reference data files stored outside the # source tree and fetch them at build time from arbitrary local and remote # content-addressed locations. Functions provided by this module recognize # arguments with the syntax "DATA{<name>}" as references to external data, # replace them with full paths to local copies of those data, and create build # rules to fetch and update the local copies. # # The DATA{} syntax is literal and the <name> is a full or relative path # within the source tree. The source tree must contain either a real data I suppose it is not so easy to modify the build rules, that the external reference data files are fetched before the build process starts. But maybe it is possible to increase the TIMEOUT values, that the fetch process also works with a slow internet connection. I just found: root@impala:/usr/src/linux(43)# grep timeout /var/tmp/portage/sci-libs/vtk-6.1.0-r1/work/VTK-6.1.0/CMake/ExternalData.cmake # set the download inactivity and absolute timeouts, in seconds. The defaults # are 60 seconds and 300 seconds, respectively. Set either timeout to 0 set(inactivity_timeout INACTIVITY_TIMEOUT ${ExternalData_TIMEOUT_INACTIVITY}) set(inactivity_timeout INACTIVITY_TIMEOUT 60) set(inactivity_timeout "") set(absolute_timeout TIMEOUT ${ExternalData_TIMEOUT_ABSOLUTE}) set(absolute_timeout TIMEOUT 300) set(absolute_timeout "") file(DOWNLOAD "${url}" "${file}" STATUS status LOG log ${inactivity_timeout} ${absolute_timeout} SHOW_PROGRESS) if(NOT err OR NOT "${msg}" MATCHES "partial|timeout|temporarily") I set the two evnvironmental variables ExternalData_TIMEOUT_INACTIVITY and ExternalData_TIMEOUT_ABSOLUTE to 0 and did again 'emerge -v1 vtk' and wait for the result.
Wiath this seettings und also with export ExternalData_TIMEOUT_INACTIVITY=300 export ExternalData_TIMEOUT_ABSOLUTE=1500 after 45 min i GET ... -- [download 82% complete] -- [download 83% complete] CMake Error at /var/tmp/portage/sci-libs/vtk-6.1.0-r1/work/VTK-6.1.0/CMake/ExternalData.cmake:735 (message): Object MD5=e1bc2bf8f0e85161cfab9440d20c93b9 not found at: http://midas3.kitware.com/midas/api/rest?method=midas.bitstream.download&checksum=e1bc2bf8f0e85161cfab9440d20c93b9&algorithm=MD5 ("Timeout was reached") http://www.vtk.org/files/ExternalData/MD5/e1bc2bf8f0e85161cfab9440d20c93b9 ("Timeout was reached")
Downloads during a build need to be avoided at all costs. But I cannot see, why vtk is downloading something. I tested all possible USE combinations but never hit this.
(In reply to Justin Lecher from comment #16) > Downloads during a build need to be avoided at all costs. > > But I cannot see, why vtk is downloading something. I tested all possible > USE combinations but never hit this. There is a "/var/tmp/portage/sci-libs/vtk-6.1.0-r1/work/vtk-6.1.0_build/VTKData_config.cmake" file defining ExternalData_OBJECT_STORES: root@impala:/usr/src(42)# grep ExternalData_OBJECT_STORES /var/tmp/portage/sci-libs/vtk-6.1.0-r1/work/vtk-6.1.0_build/VTKData_config.cmake set(ExternalData_OBJECT_STORES "/var/tmp/portage/sci-libs/vtk-6.1.0-r1/work/vtk-6.1.0_build/ExternalData/Objects;/var/tmp/portage/sci-libs/vtk-6.1.0-r1/work/VTK-6.1.0/.ExternalData") Then I suppose, cmake is calling ninja creating a build.ninja file. This build.ninja is a giant file containing 7884 lines with ExternalData targets: root@impala:/usr/src(29)# ll /var/tmp/portage/sci-libs/vtk-6.1.0-r1/work/vtk-6.1.0_build/build.ninja -rw-r--r-- 1 portage portage 89308044 Jan 10 16:31 /var/tmp/portage/sci-libs/vtk-6.1.0-r1/work/vtk-6.1.0_build/build.ninja root@impala:/usr/src(31)# grep ExternalData /var/tmp/portage/sci-libs/vtk-6.1.0-r1/work/vtk-6.1.0_build/build.ninja | wc 7884 63363 2929150 I think the ExternalData targets are then handled by /var/tmp/portage/sci-libs/vtk-6.1.0-r1/work/VTK-6.1.0/CMake/ExternalData.cmake. Justin, do you see something similar on your system?
If I run 'MAKEOPTS=-j1 USE=-examples emerge -v1 vtk', I find only two lines containing ExternalData in /var/tmp/portage/sci-libs/vtk-6.1.0-r1/work//vtk-6.1.0_build/build.ninja and these lines does not define targes, as I understand. root@condor:/root(8)# grep ExternalData /var/tmp/portage/sci-libs/vtk-6.1.0-r1/work//vtk-6.1.0_build/build.ninja |wc 2 1884 128888 The both lines starts with: build build.ninja: RERUN_CMAKE | /usr/share/cmake/Modules/CMakeCCompiler.cmake.in /usr/share/cmake/Modules/CMakeCCompilerABI.c /usr/share/cmake/Modules/CMakeCInformation.cmake /usr/share/cmake/Modules/CMakeCXXCompiler.cmake.in /usr/share/cmake/Modules/CMakeCXXCompilerABI.cpp /usr/share/cmake/Modules/CMakeCXXInformation.cmake /usr/share/cmake/Modules/CMakeCheckCompilerFlagCommonPatterns.cmake /usr/share/cmake/Modules/CMakeCommonLanguageInclude.cmake /usr/share/cmake/Modules/CMakeConfigurableFile.in /usr/share/cmake/Modules/CMakeDependentOption.cmake /usr/share/cmake/Modules/CMakeDetermineCCompiler.cmake ,,, build /usr/share/cmake/Modules/CMakeCCompiler.cmake.in /usr/share/cmake/Modules/CMakeCCompilerABI.c /usr/share/cmake/Modules/CMakeCInformation.cmake /usr/share/cmake/Modules/CMakeCXXCompiler.cmake.in /usr/share/cmake/Modules/CMakeCXXCompilerABI.cpp /usr/share/cmake/Modules/CMakeCXXInformation.cmake /usr/share/cmake/Modules/CMakeCheckCompilerFlagCommonPatterns.cmake /usr/share/cmake/Modules/CMakeCommonLanguageInclude.cmake /usr/share/cmake/Modules/CMakeConfigurableFile.in /usr/share/cmake/Modules/CMakeDependentOption.cmake /usr/share/cmake/Modules/CMakeDetermineCCompiler.cmake /usr/share/cmake/Modules/CMakeDetermineCXXCompiler.cmake /usr/share/cmake/Modules/CMakeDetermineCompiler.cmake /usr/share/cmake/Modules/CMakeDetermineCompilerABI.cmake /usr/share/cmake/Modules ... I am still observing the output of make and I can not see any output of fetching files to /var/tmp/portage/sci-libs/vtk-6.1.0-r1/work/vtk-6.1.0_build/ExternalData/.
This (emerge with USE=-examples) worked now at two systems. But of course the /usr/share/vtk/examples directory is now missing.
'emerge vtk' with examples USE flag and vtk-6.1.0-r1 still fails to emerge due to Timeout fetching http://midas3.kitware.com/midas/api/rest?method=midas.bitstream.download&checksum=e1bc2bf8f0e85161cfab9440d20c93b9&algorithm=MD5 in my slow home net.
I still have this issue. If the examples USE flag is set and if I have a slow internet connection (ca. 180KB/s download): root@lynx:/root(46)# emerge -pv1 vtk These are the packages that would be merged, in order: Calculating dependencies... done! [ebuild R ] sci-libs/vtk-6.1.0-r1::gentoo USE="R X boost cg doc examples ffmpeg java mpi mysql odbc postgres python qt4 rendering smp tbb tcl theora tk -all-modules (-aqua) -gdal* -imaging -json -kaapi -offscreen {-test} -views -web -xdmf2" PYTHON_TARGETS="python2_7" VIDEO_CARDS="-nvidia" 0 KiB , 'MAKEOPTS=-j1 emerge -v1 vtk' tries to download several packages (objects) after the configure phase. It then fails after more than 95 minutes of downloading and cmaking of 1317 from 20347 objects with TIMEOUT. This happens also with vtk-6.1.0-r1: root@lynx:/root(47)# MAKEOPTS=-j1 emerge -v1 vtk These are the packages that would be merged, in order: Calculating dependencies... done! [ebuild R ] sci-libs/vtk-6.1.0-r1::gentoo USE="R X boost cg doc examples ffmpeg java mpi mysql odbc postgres python qt4 rendering smp tbb tcl theora tk -all-modules (-aqua) -gdal* -imaging -json -kaapi -offscreen {-test} -views -web -xdmf2" PYTHON_TARGETS="python2_7" VIDEO_CARDS="-nvidia" 0 KiB Total: 1 package (1 reinstall), Size of downloads: 0 KiB >>> Verifying ebuild manifests >>> Emerging (1 of 1) sci-libs/vtk-6.1.0-r1::gentoo * VTK-6.1.0.tar.gz SHA256 SHA512 WHIRLPOOL size ;-) ... [ ok ] * vtkDocHtml-6.1.0.tar.gz SHA256 SHA512 WHIRLPOOL size ;-) ... [ ok ] * Using: icedtea-7 >>> Unpacking source... >>> Unpacking VTK-6.1.0.tar.gz to /var/tmp/portage/sci-libs/vtk-6.1.0-r1/work >>> Unpacking vtkDocHtml-6.1.0.tar.gz to /var/tmp/portage/sci-libs/vtk-6.1.0-r1/work >>> Source unpacked in /var/tmp/portage/sci-libs/vtk-6.1.0-r1/work >>> Preparing source in /var/tmp/portage/sci-libs/vtk-6.1.0-r1/work/VTK-6.1.0 ... * Dropping bundled expat ... [ ok ] ... >>> Working in BUILD_DIR: "/var/tmp/portage/sci-libs/vtk-6.1.0-r1/work/vtk-6.1.0_build" ninja -j1 -v [1/20347] cd /var/tmp/portage/sci-libs/vtk-6.1.0-r1/work/vtk-6.1.0_build && /usr/bin/cmake -Drelative_top=/var/tmp/portage/sci-libs/vtk-6.1.0-r1/work/vtk-6.1.0_build -Dfile=/var/tmp/portage/sci-libs/vtk-6.1.0-r1/work/vtk-6.1.0_build/ExternalData/Testing/Data/mni-surface-mesh.obj -Dname=/var/tmp/portage/sci-libs/vtk-6.1.0-r1/work/VTK-6.1.0/Testing/Data/mni-surface-mesh.obj -Dext=.md5 -DExternalData_ACTION=fetch -DExternalData_CONFIG=/var/tmp/portage/sci-libs/vtk-6.1.0-r1/work/vtk-6.1.0_build/VTKData_config.cmake -P /var/tmp/portage/sci-libs/vtk-6.1.0-r1/work/VTK-6.1.0/CMake/ExternalData.cmake -- Fetching "http://midas3.kitware.com/midas/api/rest?method=midas.bitstream.download&checksum=db732e122d32d15d4610175e75162b39&algorithm=MD5" -- [download 1% complete] -- [download 2% complete] -- [download 3% complete] ... -- [download 100% complete] -- Downloaded object: "/var/tmp/portage/sci-libs/vtk-6.1.0-r1/work/vtk-6.1.0_build/ExternalData/Objects/MD5/db732e122d32d15d4610175e75162b39" [2/20347] cd /var/tmp/portage/sci-libs/vtk-6.1.0-r1/work/vtk-6.1.0_build && /usr/bin/cmake -Drelative_top=/var/tmp/portage/sci-libs/vtk-6.1.0-r1/work/vtk-6.1.0_build -Dfile=/var/tmp/portage/sci-libs/vtk-6.1.0-r1/work/vtk-6.1.0_build/ExternalData/Testing/Data/flow.tec -Dname=/var/tmp/portage/sci-libs/vtk-6.1.0-r1/work/VTK-6.1.0/Testing/Data/flow.tec -Dext=.md5 -DExternalData_ACTION=fetch -DExternalData_CONFIG=/var/tmp/portage/sci-libs/vtk-6.1.0-r1/work/vtk-6.1.0_build/VTKData_config.cmake -P /var/tmp/portage/sci-libs/vtk-6.1.0-r1/work/VTK-6.1.0/CMake/ExternalData.cmake ... -- [download 100% complete] -- Downloaded object: "/var/tmp/portage/sci-libs/vtk-6.1.0-r1/work/vtk-6.1.0_build/ExternalData/Objects/MD5/057e6f518ff039b41c2bb8858e198e48" [1317/20347] cd /var/tmp/portage/sci-libs/vtk-6.1.0-r1/work/vtk-6.1.0_build && /usr/bin/cmake -Drelative_top=/var/tmp/portage/sci-libs/vtk-6.1.0-r1/work/vtk-6.1.0_build -Dfile=/var/tmp/portage/sci-libs/vtk-6.1.0-r1/work/vtk-6.1.0_build/ExternalData/Testing/Data/WindBladeReader/field/comp.out.5500 -Dname=/var/tmp/portage/sci-libs/vtk-6.1.0-r1/work/VTK-6.1.0/Testing/Data/WindBladeReader/field/comp.out.5500 -Dext=.md5 -DExternalData_ACTION=fetch -DExternalData_CONFIG=/var/tmp/portage/sci-libs/vtk-6.1.0-r1/work/vtk-6.1.0_build/VTKData_config.cmake -P /var/tmp/portage/sci-libs/vtk-6.1.0-r1/work/VTK-6.1.0/CMake/ExternalData.cmake FAILED: cd /var/tmp/portage/sci-libs/vtk-6.1.0-r1/work/vtk-6.1.0_build && /usr/bin/cmake -Drelative_top=/var/tmp/portage/sci-libs/vtk-6.1.0-r1/work/vtk-6.1.0_build -Dfile=/var/tmp/portage/sci-libs/vtk-6.1.0-r1/work/vtk-6.1.0_build/ExternalData/Testing/Data/WindBladeReader/field/comp.out.5500 -Dname=/var/tmp/portage/sci-libs/vtk-6.1.0-r1/work/VTK-6.1.0/Testing/Data/WindBladeReader/field/comp.out.5500 -Dext=.md5 -DExternalData_ACTION=fetch -DExternalData_CONFIG=/var/tmp/portage/sci-libs/vtk-6.1.0-r1/work/vtk-6.1.0_build/VTKData_config.cmake -P /var/tmp/portage/sci-libs/vtk-6.1.0-r1/work/VTK-6.1.0/CMake/ExternalData.cmake -- Fetching "http://midas3.kitware.com/midas/api/rest?method=midas.bitstream.download&checksum=c1a9211df9a954272161f80626583733&algorithm=MD5" -- [download 0% complete] -- [download 1% complete] ... -- [download 45% complete] -- [download 46% complete] -- [download 47% complete] -- [download 48% complete] -- [download 49% complete] -- [download 50% complete] -- Fetching "http://www.vtk.org/files/ExternalData/MD5/c1a9211df9a954272161f80626583733" -- [download 0% complete] -- [download 1% complete] ... -- [download 57% complete] -- [download 58% complete] CMake Error at /var/tmp/portage/sci-libs/vtk-6.1.0-r1/work/VTK-6.1.0/CMake/ExternalData.cmake:735 (message): Object MD5=c1a9211df9a954272161f80626583733 not found at: http://midas3.kitware.com/midas/api/rest?method=midas.bitstream.download&checksum=c1a9211df9a954272161f80626583733&algorithm=MD5 ("Timeout was reached") http://www.vtk.org/files/ExternalData/MD5/c1a9211df9a954272161f80626583733 ("Timeout was reached") Call Stack (most recent call first): /var/tmp/portage/sci-libs/vtk-6.1.0-r1/work/VTK-6.1.0/CMake/ExternalData.cmake:757 (_ExternalData_download_object) ninja: build stopped: subcommand failed. * ERROR: sci-libs/vtk-6.1.0-r1::gentoo failed (compile phase): Is there not any possibility to download these ExternalData packages initially
(In reply to Justin Lecher from comment #16) > Downloads during a build need to be avoided at all costs. > > But I cannot see, why vtk is downloading something. I tested all possible > USE combinations but never hit this. Did you really don't see the download if you set the examples USE flag?
commit fa486dc9439b42aba4aeb6bab6b0934d2cd96219 Author: Justin Lecher <jlec@gentoo.org> Date: Tue Sep 22 12:51:07 2015 +0200 profiles: mask USE=examples for sci-libs/vtk https://bugs.gentoo.org/show_bug.cgi?id=533876 Signed-off-by: Justin Lecher <jlec@gentoo.org> https://gitweb.gentoo.org/repo/gentoo.git/commit/?id=fa486dc9439b42aba4aeb6bab6b0934d2cd96219
The bug has been referenced in the following commit(s): https://gitweb.gentoo.org/repo/gentoo.git/commit/?id=04de2898e81463f48faba415b80f359c1d0e1cb4 commit 04de2898e81463f48faba415b80f359c1d0e1cb4 Author: Sam James <sam@gentoo.org> AuthorDate: 2022-04-29 01:28:09 +0000 Commit: Sam James <sam@gentoo.org> CommitDate: 2022-04-29 01:28:09 +0000 profiles/base: cleanup obsolete vtk mask Bug: https://bugs.gentoo.org/533876 Signed-off-by: Sam James <sam@gentoo.org> profiles/base/package.use.mask | 7 ------- 1 file changed, 7 deletions(-)
