Bug 96170 – net-misc/wget-1.9.1-r5 cannot download chunked encoding correctly

• Product: Gentoo Linux
• Status: RESOLVED NEEDINFO

[Description Honza 2005-06-15 04:47:09 UTC]

File downloaded by wget is corrupted, different from file downloaded by mozilla
and seem to have additional lines containing numbers.

Most downloaded files is OK, so I assume it have something common with fact
server is sending that file in chunked encoding.

Reproducible: Always
Steps to Reproduce:
1. wget http://private address
2. tar -tf ...
3. mcview ...

Actual Results:  
tar: This does not look like a tar archive
mcview: additional lines with number not present in mozilla-donwloaded version

Expected Results:  
wget should save same file as mozilla.

Portage 2.0.51.19 (default-linux/x86/2005.0, gcc-3.3.5-20050130,
glibc-2.3.4.20041102-r1, 2.6.
11-gentoo-r6 i686)
=================================================================
System uname: 2.6.11-gentoo-r6 i686 Intel(R) Celeron(R) CPU 2.40GHz
Gentoo Base System version 1.4.16
Python:              dev-lang/python-2.3.5 [2.3.5 (#1, May  9 2005, 22:55:50)]
dev-lang/python:     2.3.5
sys-apps/sandbox:    [Not Present]
sys-devel/autoconf:  2.13, 2.59-r6
sys-devel/automake:  1.5, 1.8.5-r3, 1.7.9-r1, 1.6.3, 1.4_p6, 1.9.5
sys-devel/binutils:  2.15.92.0.2-r7
sys-devel/libtool:   1.5.16
virtual/os-headers:  2.6.8.1-r2
ACCEPT_KEYWORDS="x86"
AUTOCLEAN="yes"
CFLAGS="-O2 -march=i686 -mcpu=pentium4 -mmmx -msse -msse2 -mfpmath=sse
-fomit-frame-pointer -p
ipe"
CHOST="i686-pc-linux-gnu"
CONFIG_PROTECT="/etc /usr/kde/2/share/config /usr/kde/3.3/env
/usr/kde/3.3/share/config /usr/k
de/3.3/shutdown /usr/kde/3/share/config /usr/lib/X11/xkb /usr/share/config
/usr/share/texmf/dv
ipdfm/config/ /usr/share/texmf/dvips/config/
/usr/share/texmf/tex/generic/config/ /usr/share/t
exmf/tex/platex/config/ /usr/share/texmf/xdvi/ /var/qmail/control"
CONFIG_PROTECT_MASK="/etc/gconf /etc/terminfo /etc/env.d"
CXXFLAGS="-O2 -march=i686 -mcpu=pentium4 -mmmx -msse -msse2 -mfpmath=sse
-fomit-frame-pointer 
-pipe"
DISTDIR="/usr/portage/distfiles"
FEATURES="autoaddcvs autoconfig ccache distlocks sandbox sfperms strict"
GENTOO_MIRRORS="ftp://ftp.sh.cvut.cz/MIRRORS/gentoo/gentoo
ftp://ftp.belnet.be/mirror/rsync.ge
ntoo.org/gentoo http://distfiles.gentoo.org
http://www.ibiblio.org/pub/Linux/distributions/gen
too"
MAKEOPTS="-j2"
PKGDIR="/usr/portage/packages"
PORTAGE_TMPDIR="/var/tmp"
PORTDIR="/usr/portage"
SYNC="rsync://rsync.europe.gentoo.org/gentoo-portage"
USE="x86 X Xaw3d aalib alsa apache2 apm arts avi berkdb bitmap-fonts bzip2 caps
cdr crypt cups
 curl dga divx4linux doc emboss encode erandom esd flac foomaticdb fortran fpx
gcj gd gdbm gif
 gpm graphviz gtk gtk2 imagemagick imlib innodb ipv6 java jbig jpeg lcms lesstif
libcaca libg+
+ libwww live lzo mad mailwrapper mbox mcal memlimit mikmod mmx mng motif
mozilla mp3 mpeg mul
tislot mysql ncurses network nls ogg oggvorbis opengl oss pam pdflib perl pic
png python qt qu
icktime readline real samba sdl slang snmp spell sqlite sse ssl svga tcpd tetex
theora tiff tr
uetype truetype-fonts type1-fonts unicode usb userlocales vhosts videos vorbis
wmf xml xml2 xm
ms xosd xv xvid zlib userland_GNU kernel_linux elibc_glibc"
Unset:  ASFLAGS, CBUILD, CTARGET, LANG, LC_ALL, LDFLAGS, LINGUAS, PORTDIR_OVERLAY

[Comment 1 Honza 2005-06-15 04:51:52 UTC]

Note: header is:
HTTP/1.0 200 OK
Server: HTTP-Storage/1.0
Content-Type: application/x-tar
X-Storage-Version: 1.0
X-Storage-Status: 200:OK
Transfer-Encoding: chunked

200
.....

Hmmm ... isn't chunked supported from HTTP/1.1+ ?

[Comment 2 Seemant Kulleen (RETIRED) 2005-09-12 14:21:40 UTC]

Honza, any further info on this?

[Comment 3 Seemant Kulleen (RETIRED) 2005-09-12 14:24:43 UTC]

Honza, also, do you have a publicly available example so we can duplicate this
issue?

[Comment 4 Honza 2005-09-12 16:02:51 UTC]

Created attachment 68304 [details]
Program for convert file to normal

I have a little program (in php) which convert that corrupted file to normal.
It worked on all examples I have. I think you can see what structure that data
have from it.<BR><BR>
I have no public example. It was an intranet application where I noticed it
last time and I don't remember what it was first time - I know it was another
case because that program I found in my misc programs directory was old :-).

[Comment 5 Jakub Moc (RETIRED) 2007-06-30 23:03:40 UTC]

Pretty hard to reproduce without any file to reproduce. Closing this bug.