I've hit upon this recently, but this is the first time I've actually recorded it: asara root # emerge openssh -uv Calculating dependencies ...done! >>> emerge (1 of 1) net-misc/openssh-3.7.1_p1 to / *** Adjusting cvs-src permissions for portage user... >>> Downloading ftp://ftp.is.co.za/mirror/gentoo.org//distfiles/openssh-3.7.1p1.tar.gz --07:38:10-- ftp://ftp.is.co.za/mirror/gentoo.org/distfiles/openssh-3.7.1p1.tar.gz => `/mnt/test/distfiles/openssh-3.7.1p1.tar.gz' Resolving ftp.is.co.za... done. Connecting to ftp.is.co.za[196.4.160.12]:21... connected. Logging in as anonymous ... Logged in! ==> SYST ... done. ==> PWD ... done. ==> TYPE I ... done. ==> CWD /mirror/gentoo.org/distfiles ... done. ==> PASV ... done. ==> RETR openssh-3.7.1p1.tar.gz ... No such file `openssh-3.7.1p1.tar.gz'. >>> Downloading http://ftp.easynet.nl/mirror/gentoo//distfiles/openssh-3.7.1p1.tar.gz --07:38:11-- http://ftp.easynet.nl/mirror/gentoo/distfiles/openssh-3.7.1p1.tar.gz => `/mnt/test/distfiles/openssh-3.7.1p1.tar.gz' Resolving ftp.easynet.nl... failed: Host not found. >>> Downloading http://ftp.snt.utwente.nl/pub/os/linux/gentoo/distfiles/openssh-3.7.1p1.tar.gz --07:38:12-- http://ftp.snt.utwente.nl/pub/os/linux/gentoo/distfiles/openssh-3.7.1p1.tar.gz => `/mnt/test/distfiles/openssh-3.7.1p1.tar.gz' Resolving ftp.snt.utwente.nl... failed: Host not found. >>> Downloading ftp://ftp.openbsd.org/pub/unix/OpenBSD/OpenSSH/portable/openssh-3.7.1p1.tar.gz --07:38:12-- ftp://ftp.openbsd.org/pub/unix/OpenBSD/OpenSSH/portable/openssh-3.7.1p1.tar.gz => `/mnt/test/distfiles/openssh-3.7.1p1.tar.gz' Resolving ftp.openbsd.org... done. Connecting to ftp.openbsd.org[129.128.5.191]:21... connected. Logging in as anonymous ... Logged in! ==> SYST ... done. ==> PWD ... done. ==> TYPE I ... done. ==> CWD /pub/unix/OpenBSD/OpenSSH/portable ... done. ==> PASV ... done. ==> RETR openssh-3.7.1p1.tar.gz ... done. Length: 791,161 (unauthoritative) 100%[===========================================================>] 791,161 15.48K/s ETA 00:00 07:39:13 (15.48 KB/s) - `/mnt/test/distfiles/openssh-3.7.1p1.tar.gz' saved [791161] !!! Couldn't download openssh-3.7.1p1.tar.gz. Aborting. asara root # And then, if I repeat the command, it works: asara root # emerge openssh -uv Calculating dependencies ...done! >>> emerge (1 of 1) net-misc/openssh-3.7.1_p1 to / *** Adjusting cvs-src permissions for portage user... >>> md5 src_uri ;-) openssh-3.7.1p1.tar.gz >>> Unpacking source... ......et cetera...... $ emerge info Portage 2.0.49-r4 (default-x86-1.4, gcc-3.3.1, glibc-2.3.2-r1, 2.6.0-test5-mm1) ================================================================= System uname: 2.6.0-test5-mm1 i686 AMD Duron(tm) Processor ACCEPT_KEYWORDS="x86 ~x86" AUTOCLEAN="yes" CFLAGS="-march=athlon-tbird -O2 -pipe -fomit-frame-pointer" CHOST="i686-pc-linux-gnu" COMPILER="gcc3" CONFIG_PROTECT="/etc /var/qmail/control /usr/kde/2/share/config /usr/kde/3/share/config /etc/env.d /usr/X11R6/lib/X11/xkb /usr/kde/3.1/share/config /usr/share/texmf/tex/generic/config/ /usr/share/texmf/tex/platex/config/ /usr/share/config" CONFIG_PROTECT_MASK="/etc/init.d /etc/X11/xkb /etc/X11/xdm /etc/X11/xserver /etc/X11/xsm /etc/X11/xinit /etc/env.d /etc/gconf /etc/env.d" CXXFLAGS="-march=athlon-tbird -O2 -pipe -fomit-frame-pointer" DISTDIR="/mnt/test/distfiles" FEATURES="ccache autoaddcvs sandbox distcc prelink" GENTOO_MIRRORS="ftp://ftp.is.co.za/mirror/gentoo.org/ http://ftp.easynet.nl/mirror/gentoo/ http://ftp.snt.utwente.nl/pub/os/linux/gentoo" MAKEOPTS="-j2" PKGDIR="/usr/portage/packages" PORTAGE_TMPDIR="/mp3/portage" PORTDIR="/usr/portage" PORTDIR_OVERLAY="/usr/local/portage" SYNC="rsync://rsync.nl.gentoo.org/gentoo-portage" USE="x86 oss avi crypt cups encode foomaticdb gif jpeg libg++ mad mmx mpeg ncurses nls pdflib png quicktime spell truetype xml2 xmms xv zlib gtkhtml alsa gdbm berkdb slang readline arts tetex aalib nas bonobo svga ggi tcltk java guile ruby mysql postgres X sdl gpm tcpd pam libwww ssl perl python esd imlib oggvorbis gnome gtk qt kde opengl mozilla gphoto2 ldap snmp cdr scanner acl acpi apache2 artswrappersuid curl dga dvd flash gd gtk2 imap innodb mbox pda S3TC samba tiff usb wmf xinerama xml -apm -mikmod -motif"
Created attachment 19082 [details] Shell session showing the bug and wget exit status checked to see if perhaps 'wget' was exiting with an incorrect exit status, but this is not the case, It correctly exits with status 0. I had modified the fetch line in /etc/make.conf to the following: FETCHCOMMAND="/usr/bin/wget -t 5 --passive-ftp \${URI} -P \${DISTDIR};echo exit status \$?" I can replicate the issue with "emerge -u dclib" if i delete /usr/portage/distfiles/dclib-0.2.20.tar.bz2 after download. Attached is a text file containing the shell output i got.
Confirmed here as well: asara root # emerge dcgui-qt Calculating dependencies ...done! >>> emerge (1 of 2) net-p2p/dclib-0.2.20 to / *** Adjusting cvs-src permissions for portage user... >>> Downloading http://ftp.easynet.nl/mirror/gentoo//distfiles/dclib-0.2.20.tar.bz2 --10:55:54-- http://ftp.easynet.nl/mirror/gentoo/distfiles/dclib-0.2.20.tar.bz2 => `/mnt/test/distfiles/dclib-0.2.20.tar.bz2' Resolving ftp.easynet.nl... done. Connecting to ftp.easynet.nl[195.86.128.57]:80... connected. HTTP request sent, awaiting response... 404 Not Found 10:55:56 ERROR 404: Not Found. >>> Downloading http://ftp.snt.utwente.nl/pub/os/linux/gentoo/distfiles/dclib-0.2.20.tar.bz2 --10:55:56-- http://ftp.snt.utwente.nl/pub/os/linux/gentoo/distfiles/dclib-0.2.20.tar.bz2 => `/mnt/test/distfiles/dclib-0.2.20.tar.bz2' Resolving ftp.snt.utwente.nl... done. Connecting to ftp.snt.utwente.nl[130.89.175.1]:80... connected. HTTP request sent, awaiting response... 404 Not Found 10:55:58 ERROR 404: Not Found. >>> Downloading http://download.berlios.de/dcgui/dclib-0.2.20.tar.bz2 --10:55:58-- http://download.berlios.de/dcgui/dclib-0.2.20.tar.bz2 => `/mnt/test/distfiles/dclib-0.2.20.tar.bz2' Resolving download.berlios.de... done. Connecting to download.berlios.de[195.37.77.141]:80... connected. HTTP request sent, awaiting response... 200 OK Length: 523,544 [application/x-bzip2] 100%[===========================================================================================>] 523,544 13.75K/s ETA 00:00 10:56:37 (13.75 KB/s) - `/mnt/test/distfiles/dclib-0.2.20.tar.bz2' saved [523544/523544] !!! Couldn't download dclib-0.2.20.tar.bz2. Aborting. asara root # emerge dcgui-qt Calculating dependencies ...done! >>> emerge (1 of 2) net-p2p/dclib-0.2.20 to / *** Adjusting cvs-src permissions for portage user... >>> md5 src_uri ;-) dclib-0.2.20.tar.bz2 >>> Unpacking source... >>> Unpacking dclib-0.2.20.tar.bz2 to /mp3/portage/portage/dclib-0.2.20/work [...etc...]
Please reopen if this can be duplicated.
I still hit this a few days ago while I was still running portage-2.0.50_pre3. I've updated to pre7 now, and will report it if it happens again.
I am still getting this bug, its replicatable, so please reopened it. I'm using portage 2.0.50_pre16. I must say that the frequency of this happening has reduced. Console log showing bug/replicability follows: jub0 root # emerge realone Calculating dependencies ...done! >>> emerge (1 of 1) media-video/realone-1 to / *** Adjusting cvs-src permissions for portage user... >>> Downloading http://docs.real.com/docs/playerpatch/unix/rv9_libc6_i386_cs2.tgz --14:55:32-- http://docs.real.com/docs/playerpatch/unix/rv9_libc6_i386_cs2.tgz => `/usr/portage/distfiles/rv9_libc6_i386_cs2.tgz' Resolving docs.real.com... 207.188.7.197 Connecting to docs.real.com[207.188.7.197]:80... connected. HTTP request sent, awaiting response... 200 OK Length: 814,305 [application/unix-tar] 100%[=========================================================================================================================>] 814,305 15.34K/s ETA 00:00 14:56:24 (15.66 KB/s) - `/usr/portage/distfiles/rv9_libc6_i386_cs2.tgz' saved [814305/814305] !!! Couldn't download rv9_libc6_i386_cs2.tgz. Aborting. jub0 root # rm /usr/portage/distfiles/rv9_libc6_i386_cs2.tgz jub0 root # emerge realone Calculating dependencies ...done! >>> emerge (1 of 1) media-video/realone-1 to / *** Adjusting cvs-src permissions for portage user... >>> Downloading http://docs.real.com/docs/playerpatch/unix/rv9_libc6_i386_cs2.tgz --15:18:02-- http://docs.real.com/docs/playerpatch/unix/rv9_libc6_i386_cs2.tgz => `/usr/portage/distfiles/rv9_libc6_i386_cs2.tgz' Resolving docs.real.com... 207.188.7.197 Connecting to docs.real.com[207.188.7.197]:80... connected. HTTP request sent, awaiting response... 200 OK Length: 814,305 [application/unix-tar] 100%[=========================================================================================================================>] 814,305 15.30K/s ETA 00:00 15:18:54 (15.63 KB/s) - `/usr/portage/distfiles/rv9_libc6_i386_cs2.tgz' saved [814305/814305] !!! Couldn't download rv9_libc6_i386_cs2.tgz. Aborting.
reopening as requested
I'm getting this with 2.0.50; I can reproduce it with sys-apps/help2man-1.33.1.
This is very annoying and I can't reproduce it reliably. The only reason for this should be a non-zero return by wget or an exception. Added more debug for 2.0.50-r2 so I cna get this tracked down.
Getting it again... root@deusexmachina:richard$ emerge -d -u americas-army Calculating dependencies Parent: None Depstring: games-fps/americas-army Candidates: ['games-fps/americas-army'] ebuild: games-fps/americas-army-200a-r1 binpkg: None \ Parent: ebuild / games-fps/americas-army-200a-r1 merge Depstring: virtual/glibc app-arch/unzip !bootstrap? ( sys-devel/patch ) virtual/glibc opengl? ( virtual/opengl ) Candidates: ['sys-libs/glibc', 'app-arch/unzip', 'media-video/nvidia-glx', 'sys-devel/patch'] ebuild: sys-libs/glibc-2.3.3_pre20040207 binpkg: None |ebuild: app-arch/unzip-5.50-r2 binpkg: None /ebuild: media-video/nvidia-glx-1.0.5336-r1 binpkg: None -ebuild: sys-devel/patch-2.5.9 binpkg: None \Exiting... ebuild / games-fps/americas-army-200a-r1 merge Exiting... None ...done! >>> emerge (1 of 1) games-fps/americas-army-200a-r1 to / + /usr/sbin/ebuild.sh clean + dyn_clean + rm -rf /var/tmp/portage/americas-army-200a-r1/image + rm -rf /var/tmp/portage/americas-army-200a-r1/build-info + has keeptemp autoaddcvs ccache nostrip sandbox + hasq keeptemp autoaddcvs ccache nostrip sandbox + local x + local me=keeptemp + shift + '[' autoaddcvs == keeptemp ']' + '[' ccache == keeptemp ']' + '[' nostrip == keeptemp ']' + '[' sandbox == keeptemp ']' + return 1 + return 1 + rm -rf /var/tmp/portage/americas-army-200a-r1/temp/eclass-debug.log + has keepwork autoaddcvs ccache nostrip sandbox + hasq keepwork autoaddcvs ccache nostrip sandbox + local x + local me=keepwork + shift + '[' autoaddcvs == keepwork ']' + '[' ccache == keepwork ']' + '[' nostrip == keepwork ']' + '[' sandbox == keepwork ']' + return 1 + return 1 + rm -rf /var/tmp/portage/americas-army-200a-r1/.compiled + rm -rf /var/tmp/portage/americas-army-200a-r1/.unpacked + rm -rf /var/tmp/portage/americas-army-200a-r1/work + '[' -f /var/tmp/portage/americas-army-200a-r1/.unpacked ']' + true + set +x >>> Downloading http://download.factoryunreal.com/mirror/UT2003CrashFix.zip --20:29:24-- http://download.factoryunreal.com/mirror/UT2003CrashFix.zip => `/usr/portage/distfiles/UT2003CrashFix.zip' Resolving download.factoryunreal.com... 216.151.80.35 Connecting to download.factoryunreal.com[216.151.80.35]:80... connected. HTTP request sent, awaiting response... 200 OK Length: 2,764 [application/x-zip-compressed] 100%[===========================================================>] 2,764 --.--K/s 20:29:25 (22.59 KB/s) - `/usr/portage/distfiles/UT2003CrashFix.zip' saved [2764/2764] !!! Couldn't download UT2003CrashFix.zip. Aborting. Let me know if there's any other options I can use to get more info.
If this is still an issue, please speak up- I can split a patch to help track down why it's bailing.
It still happens all the time.
What portage version?
All Portage versions since ages ago, currently 2.0.50-r9. I've had this phenomenon on a daily basis for a year now. It may well be a conincidence, but I never had this problem while on a DSL connection in Japan before, but since I'm on ISDN dial-up in Germany (April 2003), this happens all the time, regardless of the Portage version. It's the reason why I systematically run `emerge -f world` before `emerge world`. All files are being downloaded just fine, if you run a checksum manually or restart emerge, everything is ok, but immediately after a (successful) download wget reports an error ("Couldn't download..."), and emerge declares to have failed. It'll be difficult to hunt this bug down, since it doesn't occur with all packages, just e.g. three out of eight downloads in an emerge run, sometimes less, sometimes more. Almost never happens for very small packages, by the way, < 100 KB.
I can also confirm I'm still seeing this from time to time, although not with the frequency Ulrich is... I'm also running it off DSL (ie., ppp and PPPoE), although I'd be hard-pressed to accept that as the reason. I'm on portage-2.0.50-r9 at the moment.
Well that's fricking weird. NEED-INFO'ing this in the interim (6 months). If you're still experiencing it (expecting so), pop your head into freenode's #gentoo-portage and specifically reference this bug please.
Well, good news, at least from me. I think we can resolve this permanently, since I haven't seen this at all recently. Maybe I'll just reopen it if I see it again. I wonder what the other reporters' experiences have been in the past 6 months? Dewet
I was one of the reporters of the bug, however, I have since upgraded my system and dont see this issue within the new install (from scratch) of gentoo!
This hasn't happened for so long that I had plenty of time to completely forget about this bug... Sorry. I can't totally exclude it's still happening from time to time, but I haven't seen this for many moons now.
Closing due to old age
