Gentoo Websites Logo
Go to: Gentoo Home Documentation Forums Lists Bugs Planet Store Wiki Get Gentoo!

Bug 28936

Summary: portage (incorrectly) aborting after download
Product: Portage Development Reporter: Dewet Diener <gentoobugzilla>
Component: UnclassifiedAssignee: Portage team <dev-portage>
Status: VERIFIED NEEDINFO    
Severity: normal CC: jubal
Priority: High    
Version: unspecified   
Hardware: All   
OS: Linux   
Whiteboard:
Package list:
Runtime testing required: ---
Attachments: Shell session showing the bug and wget exit status

Description Dewet Diener 2003-09-16 22:42:17 UTC
I've hit upon this recently, but this is the first time I've actually recorded it:

asara root # emerge openssh -uv
Calculating dependencies ...done!
>>> emerge (1 of 1) net-misc/openssh-3.7.1_p1 to /
*** Adjusting cvs-src permissions for portage user...
>>> Downloading
ftp://ftp.is.co.za/mirror/gentoo.org//distfiles/openssh-3.7.1p1.tar.gz
--07:38:10--  ftp://ftp.is.co.za/mirror/gentoo.org/distfiles/openssh-3.7.1p1.tar.gz
           => `/mnt/test/distfiles/openssh-3.7.1p1.tar.gz'
Resolving ftp.is.co.za... done.
Connecting to ftp.is.co.za[196.4.160.12]:21... connected.
Logging in as anonymous ... Logged in!
==> SYST ... done.    ==> PWD ... done.
==> TYPE I ... done.  ==> CWD /mirror/gentoo.org/distfiles ... done.
==> PASV ... done.    ==> RETR openssh-3.7.1p1.tar.gz ...
No such file `openssh-3.7.1p1.tar.gz'.
 
>>> Downloading
http://ftp.easynet.nl/mirror/gentoo//distfiles/openssh-3.7.1p1.tar.gz
--07:38:11--  http://ftp.easynet.nl/mirror/gentoo/distfiles/openssh-3.7.1p1.tar.gz
           => `/mnt/test/distfiles/openssh-3.7.1p1.tar.gz'
Resolving ftp.easynet.nl... failed: Host not found.
>>> Downloading
http://ftp.snt.utwente.nl/pub/os/linux/gentoo/distfiles/openssh-3.7.1p1.tar.gz
--07:38:12-- 
http://ftp.snt.utwente.nl/pub/os/linux/gentoo/distfiles/openssh-3.7.1p1.tar.gz
           => `/mnt/test/distfiles/openssh-3.7.1p1.tar.gz'
Resolving ftp.snt.utwente.nl... failed: Host not found.
>>> Downloading
ftp://ftp.openbsd.org/pub/unix/OpenBSD/OpenSSH/portable/openssh-3.7.1p1.tar.gz
--07:38:12-- 
ftp://ftp.openbsd.org/pub/unix/OpenBSD/OpenSSH/portable/openssh-3.7.1p1.tar.gz
           => `/mnt/test/distfiles/openssh-3.7.1p1.tar.gz'
Resolving ftp.openbsd.org... done.
Connecting to ftp.openbsd.org[129.128.5.191]:21... connected.
Logging in as anonymous ... Logged in!
==> SYST ... done.    ==> PWD ... done.
==> TYPE I ... done.  ==> CWD /pub/unix/OpenBSD/OpenSSH/portable ... done.
==> PASV ... done.    ==> RETR openssh-3.7.1p1.tar.gz ... done.
Length: 791,161 (unauthoritative)
 
100%[===========================================================>] 791,161     
 15.48K/s    ETA 00:00
 
07:39:13 (15.48 KB/s) - `/mnt/test/distfiles/openssh-3.7.1p1.tar.gz' saved [791161]
 
!!! Couldn't download openssh-3.7.1p1.tar.gz. Aborting.
asara root # 

And then, if I repeat the command, it works:

asara root # emerge openssh -uv
Calculating dependencies ...done!
>>> emerge (1 of 1) net-misc/openssh-3.7.1_p1 to /
*** Adjusting cvs-src permissions for portage user...
>>> md5 src_uri ;-) openssh-3.7.1p1.tar.gz
>>> Unpacking source...
......et cetera......


$ emerge info
Portage 2.0.49-r4 (default-x86-1.4, gcc-3.3.1, glibc-2.3.2-r1, 2.6.0-test5-mm1)
=================================================================
System uname: 2.6.0-test5-mm1 i686 AMD Duron(tm) Processor
ACCEPT_KEYWORDS="x86 ~x86"
AUTOCLEAN="yes"
CFLAGS="-march=athlon-tbird -O2 -pipe -fomit-frame-pointer"
CHOST="i686-pc-linux-gnu"
COMPILER="gcc3"
CONFIG_PROTECT="/etc /var/qmail/control /usr/kde/2/share/config
/usr/kde/3/share/config /etc/env.d /usr/X11R6/lib/X11/xkb
/usr/kde/3.1/share/config /usr/share/texmf/tex/generic/config/
/usr/share/texmf/tex/platex/config/ /usr/share/config"
CONFIG_PROTECT_MASK="/etc/init.d /etc/X11/xkb /etc/X11/xdm /etc/X11/xserver
/etc/X11/xsm /etc/X11/xinit /etc/env.d /etc/gconf /etc/env.d"
CXXFLAGS="-march=athlon-tbird -O2 -pipe -fomit-frame-pointer"
DISTDIR="/mnt/test/distfiles"
FEATURES="ccache autoaddcvs sandbox distcc prelink"
GENTOO_MIRRORS="ftp://ftp.is.co.za/mirror/gentoo.org/
http://ftp.easynet.nl/mirror/gentoo/ http://ftp.snt.utwente.nl/pub/os/linux/gentoo"
MAKEOPTS="-j2"
PKGDIR="/usr/portage/packages"
PORTAGE_TMPDIR="/mp3/portage"
PORTDIR="/usr/portage"
PORTDIR_OVERLAY="/usr/local/portage"
SYNC="rsync://rsync.nl.gentoo.org/gentoo-portage"
USE="x86 oss avi crypt cups encode foomaticdb gif jpeg libg++ mad mmx mpeg
ncurses nls pdflib png quicktime spell truetype xml2 xmms xv zlib gtkhtml alsa
gdbm berkdb slang readline arts tetex aalib nas bonobo svga ggi tcltk java guile
ruby mysql postgres X sdl gpm tcpd pam libwww ssl perl python esd imlib
oggvorbis gnome gtk qt kde opengl mozilla gphoto2 ldap snmp cdr scanner acl acpi
apache2 artswrappersuid curl dga dvd flash gd gtk2 imap innodb mbox pda S3TC
samba tiff usb wmf xinerama xml -apm -mikmod -motif"
Comment 1 Jubal John 2003-10-10 20:14:34 UTC
Created attachment 19082 [details]
Shell session showing the bug and wget exit status

checked to see if perhaps 'wget' was exiting with an incorrect exit status,
but
this is not the case, It correctly exits with status 0.

I had modified the fetch line in /etc/make.conf to the following:
FETCHCOMMAND="/usr/bin/wget -t 5 --passive-ftp \${URI} -P \${DISTDIR};echo
exit
status \$?"

I can replicate the issue with "emerge -u dclib" if i delete
/usr/portage/distfiles/dclib-0.2.20.tar.bz2 after download.

Attached is a text file containing the shell output i got.
Comment 2 Dewet Diener 2003-10-13 02:00:11 UTC
Confirmed here as well:

asara root # emerge dcgui-qt
Calculating dependencies ...done!
>>> emerge (1 of 2) net-p2p/dclib-0.2.20 to /
*** Adjusting cvs-src permissions for portage user...
>>> Downloading http://ftp.easynet.nl/mirror/gentoo//distfiles/dclib-0.2.20.tar.bz2
--10:55:54--  http://ftp.easynet.nl/mirror/gentoo/distfiles/dclib-0.2.20.tar.bz2
           => `/mnt/test/distfiles/dclib-0.2.20.tar.bz2'
Resolving ftp.easynet.nl... done.
Connecting to ftp.easynet.nl[195.86.128.57]:80... connected.
HTTP request sent, awaiting response... 404 Not Found
10:55:56 ERROR 404: Not Found.

>>> Downloading
http://ftp.snt.utwente.nl/pub/os/linux/gentoo/distfiles/dclib-0.2.20.tar.bz2
--10:55:56-- 
http://ftp.snt.utwente.nl/pub/os/linux/gentoo/distfiles/dclib-0.2.20.tar.bz2
           => `/mnt/test/distfiles/dclib-0.2.20.tar.bz2'
Resolving ftp.snt.utwente.nl... done.
Connecting to ftp.snt.utwente.nl[130.89.175.1]:80... connected.
HTTP request sent, awaiting response... 404 Not Found
10:55:58 ERROR 404: Not Found.

>>> Downloading http://download.berlios.de/dcgui/dclib-0.2.20.tar.bz2
--10:55:58--  http://download.berlios.de/dcgui/dclib-0.2.20.tar.bz2
           => `/mnt/test/distfiles/dclib-0.2.20.tar.bz2'
Resolving download.berlios.de... done.
Connecting to download.berlios.de[195.37.77.141]:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 523,544 [application/x-bzip2]

100%[===========================================================================================>]
523,544       13.75K/s    ETA 00:00

10:56:37 (13.75 KB/s) - `/mnt/test/distfiles/dclib-0.2.20.tar.bz2' saved
[523544/523544]

!!! Couldn't download dclib-0.2.20.tar.bz2. Aborting.
asara root # emerge dcgui-qt
Calculating dependencies ...done!
>>> emerge (1 of 2) net-p2p/dclib-0.2.20 to /
*** Adjusting cvs-src permissions for portage user...
>>> md5 src_uri ;-) dclib-0.2.20.tar.bz2
>>> Unpacking source...
>>> Unpacking dclib-0.2.20.tar.bz2 to /mp3/portage/portage/dclib-0.2.20/work
[...etc...]
Comment 3 Nicholas Jones (RETIRED) gentoo-dev 2003-12-24 16:33:18 UTC
Please reopen if this can be duplicated.
Comment 4 Dewet Diener 2003-12-24 23:06:57 UTC
I still hit this a few days ago while I was still running portage-2.0.50_pre3.  I've updated to pre7 now, and will report it if it happens again.
Comment 5 Jubal John 2004-01-23 18:24:25 UTC
I am still getting this bug, its replicatable, so please reopened it. I'm using portage 2.0.50_pre16. I must say that the frequency of this happening has reduced. Console log showing bug/replicability follows:

jub0 root # emerge realone
Calculating dependencies ...done!
>>> emerge (1 of 1) media-video/realone-1 to /
*** Adjusting cvs-src permissions for portage user...
>>> Downloading http://docs.real.com/docs/playerpatch/unix/rv9_libc6_i386_cs2.tgz
--14:55:32--  http://docs.real.com/docs/playerpatch/unix/rv9_libc6_i386_cs2.tgz
           => `/usr/portage/distfiles/rv9_libc6_i386_cs2.tgz'
Resolving docs.real.com... 207.188.7.197
Connecting to docs.real.com[207.188.7.197]:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 814,305 [application/unix-tar]

100%[=========================================================================================================================>] 814,305       15.34K/s    ETA 00:00

14:56:24 (15.66 KB/s) - `/usr/portage/distfiles/rv9_libc6_i386_cs2.tgz' saved [814305/814305]

!!! Couldn't download rv9_libc6_i386_cs2.tgz. Aborting.

jub0 root # rm /usr/portage/distfiles/rv9_libc6_i386_cs2.tgz

jub0 root # emerge realone
Calculating dependencies ...done!
>>> emerge (1 of 1) media-video/realone-1 to /
*** Adjusting cvs-src permissions for portage user...
>>> Downloading http://docs.real.com/docs/playerpatch/unix/rv9_libc6_i386_cs2.tgz
--15:18:02--  http://docs.real.com/docs/playerpatch/unix/rv9_libc6_i386_cs2.tgz
           => `/usr/portage/distfiles/rv9_libc6_i386_cs2.tgz'
Resolving docs.real.com... 207.188.7.197
Connecting to docs.real.com[207.188.7.197]:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 814,305 [application/unix-tar]

100%[=========================================================================================================================>] 814,305       15.30K/s    ETA 00:00

15:18:54 (15.63 KB/s) - `/usr/portage/distfiles/rv9_libc6_i386_cs2.tgz' saved [814305/814305]

!!! Couldn't download rv9_libc6_i386_cs2.tgz. Aborting.
Comment 6 Marius Mauch (RETIRED) gentoo-dev 2004-01-25 09:33:15 UTC
reopening as requested
Comment 7 Richard Garand 2004-02-08 15:43:33 UTC
I'm getting this with 2.0.50; I can reproduce it with sys-apps/help2man-1.33.1.
Comment 8 Nicholas Jones (RETIRED) gentoo-dev 2004-03-20 15:22:10 UTC
This is very annoying and I can't reproduce it reliably. The only
reason for this should be a non-zero return by wget or an exception.

Added more debug for 2.0.50-r2 so I cna get this tracked down.
Comment 9 Richard Garand 2004-04-05 19:30:26 UTC
Getting it again...

root@deusexmachina:richard$ emerge -d -u americas-army
Calculating dependencies
Parent:    None
Depstring: games-fps/americas-army
Candidates: ['games-fps/americas-army']
ebuild: games-fps/americas-army-200a-r1
binpkg: None
\
Parent:    ebuild / games-fps/americas-army-200a-r1 merge
Depstring: virtual/glibc app-arch/unzip !bootstrap? ( sys-devel/patch ) virtual/glibc opengl? ( virtual/opengl )
Candidates: ['sys-libs/glibc', 'app-arch/unzip', 'media-video/nvidia-glx', 'sys-devel/patch']
ebuild: sys-libs/glibc-2.3.3_pre20040207
binpkg: None
|ebuild: app-arch/unzip-5.50-r2
binpkg: None
/ebuild: media-video/nvidia-glx-1.0.5336-r1
binpkg: None
-ebuild: sys-devel/patch-2.5.9
binpkg: None
\Exiting... ebuild / games-fps/americas-army-200a-r1 merge
Exiting... None
 ...done!
>>> emerge (1 of 1) games-fps/americas-army-200a-r1 to /
+ /usr/sbin/ebuild.sh clean
+ dyn_clean
+ rm -rf /var/tmp/portage/americas-army-200a-r1/image
+ rm -rf /var/tmp/portage/americas-army-200a-r1/build-info
+ has keeptemp autoaddcvs ccache nostrip sandbox
+ hasq keeptemp autoaddcvs ccache nostrip sandbox
+ local x
+ local me=keeptemp
+ shift
+ '[' autoaddcvs == keeptemp ']'
+ '[' ccache == keeptemp ']'
+ '[' nostrip == keeptemp ']'
+ '[' sandbox == keeptemp ']'
+ return 1
+ return 1
+ rm -rf /var/tmp/portage/americas-army-200a-r1/temp/eclass-debug.log
+ has keepwork autoaddcvs ccache nostrip sandbox
+ hasq keepwork autoaddcvs ccache nostrip sandbox
+ local x
+ local me=keepwork
+ shift
+ '[' autoaddcvs == keepwork ']'
+ '[' ccache == keepwork ']'
+ '[' nostrip == keepwork ']'
+ '[' sandbox == keepwork ']'
+ return 1
+ return 1
+ rm -rf /var/tmp/portage/americas-army-200a-r1/.compiled
+ rm -rf /var/tmp/portage/americas-army-200a-r1/.unpacked
+ rm -rf /var/tmp/portage/americas-army-200a-r1/work
+ '[' -f /var/tmp/portage/americas-army-200a-r1/.unpacked ']'
+ true
+ set +x
>>> Downloading http://download.factoryunreal.com/mirror/UT2003CrashFix.zip
--20:29:24--  http://download.factoryunreal.com/mirror/UT2003CrashFix.zip
           => `/usr/portage/distfiles/UT2003CrashFix.zip'
Resolving download.factoryunreal.com... 216.151.80.35
Connecting to download.factoryunreal.com[216.151.80.35]:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 2,764 [application/x-zip-compressed]

100%[===========================================================>] 2,764         --.--K/s

20:29:25 (22.59 KB/s) - `/usr/portage/distfiles/UT2003CrashFix.zip' saved [2764/2764]

!!! Couldn't download UT2003CrashFix.zip. Aborting.


Let me know if there's any other options I can use to get more info.
Comment 10 Brian Harring (RETIRED) gentoo-dev 2004-08-02 04:13:54 UTC
If this is still an issue, please speak up- I can split a patch to help track down why it's bailing.
Comment 11 Richard Garand 2004-08-02 11:55:39 UTC
It still happens all the time.
Comment 12 Brian Harring (RETIRED) gentoo-dev 2004-08-17 01:09:08 UTC
What portage version?
Comment 13 Ulrich Plate (RETIRED) gentoo-dev 2004-08-17 01:59:37 UTC
All Portage versions since ages ago, currently 2.0.50-r9. I've had this phenomenon on a daily basis for a year now. It may well be a conincidence, but I never had this problem while on a DSL connection in Japan before, but since I'm on ISDN dial-up in Germany (April 2003), this happens all the time, regardless of the Portage version. It's the reason why I systematically run `emerge -f world` before `emerge world`. All files are being downloaded just fine, if you run a checksum manually or restart emerge, everything is ok, but immediately after a (successful) download wget reports an error ("Couldn't download..."), and emerge declares to have failed. It'll be difficult to hunt this bug down, since it doesn't occur with all packages, just e.g. three out of eight downloads in an emerge run, sometimes less, sometimes more. Almost never happens for very small packages, by the way, < 100 KB.
Comment 14 Dewet Diener 2004-08-17 02:08:23 UTC
I can also confirm I'm still seeing this from time to time, although not with the frequency Ulrich is...  I'm also running it off DSL (ie., ppp and PPPoE), although I'd be hard-pressed to accept that as the reason.  I'm on portage-2.0.50-r9 at the moment.
Comment 15 Brian Harring (RETIRED) gentoo-dev 2005-02-27 23:24:07 UTC
Well that's fricking weird.  NEED-INFO'ing this in the interim (6 months).  If you're still experiencing it (expecting so), pop your head into freenode's #gentoo-portage and specifically reference this bug please.
Comment 16 Dewet Diener 2005-02-28 02:38:59 UTC
Well, good news, at least from me.  I think we can resolve this permanently, since I haven't seen this at all recently.  Maybe I'll just reopen it if I see it again.  I wonder what the other reporters' experiences have been in the past 6 months?

Dewet
Comment 17 Jubal John 2005-03-01 16:53:57 UTC
I was one of the reporters of the bug, however, I have since upgraded my system and dont see this issue within the new install (from scratch) of gentoo!
Comment 18 Ulrich Plate (RETIRED) gentoo-dev 2005-03-08 07:52:58 UTC
This hasn't happened for so long that I had plenty of time to completely forget about this bug... Sorry. I can't totally exclude it's still happening from time to time, but I haven't seen this for many moons now.
Comment 19 Marius Mauch (RETIRED) gentoo-dev 2007-01-11 11:00:54 UTC
Closing due to old age