Gentoo Websites Logo
Go to: Gentoo Home Documentation Forums Lists Bugs Planet Store Wiki Get Gentoo!
Bug 393149 - www-plugins/adobe-flash - adobe-flash-11.1.102.55.x86_64.tar.gz VERIFY FAILED!
Summary: www-plugins/adobe-flash - adobe-flash-11.1.102.55.x86_64.tar.gz VERIFY FAILED!
Status: RESOLVED CANTFIX
Alias: None
Product: Gentoo Linux
Classification: Unclassified
Component: Current packages (show other bugs)
Hardware: AMD64 Linux
: Normal normal (vote)
Assignee: Jim Ramsay (lack) (RETIRED)
URL:
Whiteboard:
Keywords:
Depends on:
Blocks:
 
Reported: 2011-12-04 16:32 UTC by far jump
Modified: 2011-12-15 14:53 UTC (History)
2 users (show)

See Also:
Package list:
Runtime testing required: ---


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description far jump 2011-12-04 16:32:43 UTC
>>> Fetching (10 of 10) www-plugins/adobe-flash-11.1.102.55
>>> Downloading 'http://fpdownload.macromedia.com/get/flashplayer/pdc/11.1.102.55/install_flash_player_11_linux.x86_64.tar.gz'
--2011-12-04 11:27:37--  http://fpdownload.macromedia.com/get/flashplayer/pdc/11.1.102.55/install_flash_player_11_linux.x86_64.tar.gz
Resolving barad-dur... 192.168.1.106
Connecting to barad-dur|192.168.1.106|:8080... connected.
Proxy request sent, awaiting response... 200 OK
Length: 7042512 (6.7M)
Saving to: `/usr/portage/distfiles/adobe-flash-11.1.102.55.x86_64.tar.gz'

100%[=====================================================================================>] 7,042,512   11.2M/s   in 0.6s    

2011-12-04 11:27:38 (11.2 MB/s) - `/usr/portage/distfiles/adobe-flash-11.1.102.55.x86_64.tar.gz' saved [7042512/7042512]

('Filesize does not match recorded size', 7042512, 7043207)
!!! Fetched file: adobe-flash-11.1.102.55.x86_64.tar.gz VERIFY FAILED!
!!! Reason: Filesize does not match recorded size
!!! Got:      7042512
!!! Expected: 7043207
Refetching... File renamed to '/usr/portage/distfiles/adobe-flash-11.1.102.55.x86_64.tar.gz._checksum_failure_.FjQqx5'

!!! Couldn't download 'adobe-flash-11.1.102.55.x86_64.tar.gz'. Aborting.
 * Fetch failed for 'www-plugins/adobe-flash-11.1.102.55'

>>> Failed to emerge www-plugins/adobe-flash-11.1.102.55
Comment 1 François Bissey 2011-12-05 03:20:37 UTC
got same error here.
Comment 2 Jeroen Roovers (RETIRED) gentoo-dev 2011-12-05 12:56:53 UTC
Can't reproduce it.

jer@wieneke /newaches/gentoo/cvs/gentoo-x86/www-plugins/adobe-flash $ mv /world/distfiles/adobe-flash-11.* /world/downloads/
jer@wieneke /newaches/gentoo/cvs/gentoo-x86/www-plugins/adobe-flash $ rm Manifest
jer@wieneke /newaches/gentoo/cvs/gentoo-x86/www-plugins/adobe-flash $ ebuild adobe-flash-11.1.102.55.ebuild manifest
Appending /newaches/gentoo/cvs/gentoo-x86 to PORTDIR_OVERLAY...
>>> Downloading 'http://fpdownload.macromedia.com/get/flashplayer/pdc/11.1.102.55/install_flash_player_11_linux.i386.tar.gz'
--2011-12-05 13:54:30--  http://fpdownload.macromedia.com/get/flashplayer/pdc/11.1.102.55/install_flash_player_11_linux.i386.tar.gz
Resolving fpdownload.macromedia.com (fpdownload.macromedia.com)... 2.18.178.70
Connecting to fpdownload.macromedia.com (fpdownload.macromedia.com)|2.18.178.70|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 6748255 (6.4M) [application/x-gzip]
Saving to: `/world/distfiles/adobe-flash-11.1.102.55.i386.tar.gz'

100%[==========================================================================================>] 6,748,255   5.65M/s   in 1.1s

2011-12-05 13:54:31 (5.65 MB/s) - `/world/distfiles/adobe-flash-11.1.102.55.i386.tar.gz' saved [6748255/6748255]

>>> Downloading 'http://fpdownload.macromedia.com/get/flashplayer/pdc/11.0.1.152/install_flash_player_11_linux.i386.tar.gz'
--2011-12-05 13:54:31--  http://fpdownload.macromedia.com/get/flashplayer/pdc/11.0.1.152/install_flash_player_11_linux.i386.tar.gz
Resolving fpdownload.macromedia.com (fpdownload.macromedia.com)... 2.18.178.70
Connecting to fpdownload.macromedia.com (fpdownload.macromedia.com)|2.18.178.70|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 6742944 (6.4M) [application/x-gzip]
Saving to: `/world/distfiles/adobe-flash-11.0.1.152.i386.tar.gz'

100%[==========================================================================================>] 6,742,944   4.15M/s   in 1.5s

2011-12-05 13:54:33 (4.15 MB/s) - `/world/distfiles/adobe-flash-11.0.1.152.i386.tar.gz' saved [6742944/6742944]

>>> Downloading 'http://fpdownload.macromedia.com/get/flashplayer/pdc/11.0.1.152/install_flash_player_11_linux.x86_64.tar.gz'
--2011-12-05 13:54:33--  http://fpdownload.macromedia.com/get/flashplayer/pdc/11.0.1.152/install_flash_player_11_linux.x86_64.tar.gz
Resolving fpdownload.macromedia.com (fpdownload.macromedia.com)... 2.18.178.70
Connecting to fpdownload.macromedia.com (fpdownload.macromedia.com)|2.18.178.70|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 7042512 (6.7M) [application/x-gzip]
Saving to: `/world/distfiles/adobe-flash-11.0.1.152.x86_64.tar.gz'

100%[==========================================================================================>] 7,042,512   6.05M/s   in 1.1s

2011-12-05 13:54:34 (6.05 MB/s) - `/world/distfiles/adobe-flash-11.0.1.152.x86_64.tar.gz' saved [7042512/7042512]

>>> Downloading 'http://fpdownload.macromedia.com/get/flashplayer/pdc/11.1.102.55/install_flash_player_11_linux.x86_64.tar.gz'
--2011-12-05 13:54:34--  http://fpdownload.macromedia.com/get/flashplayer/pdc/11.1.102.55/install_flash_player_11_linux.x86_64.tar.gz
Resolving fpdownload.macromedia.com (fpdownload.macromedia.com)... 2.18.178.70
Connecting to fpdownload.macromedia.com (fpdownload.macromedia.com)|2.18.178.70|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 7043207 (6.7M) [application/x-gzip]
Saving to: `/world/distfiles/adobe-flash-11.1.102.55.x86_64.tar.gz'

100%[==========================================================================================>] 7,043,207   5.94M/s   in 1.1s

2011-12-05 13:54:35 (5.94 MB/s) - `/world/distfiles/adobe-flash-11.1.102.55.x86_64.tar.gz' saved [7043207/7043207]

>>> Creating Manifest for /newaches/gentoo/cvs/gentoo-x86/www-plugins/adobe-flash
jer@wieneke /newaches/gentoo/cvs/gentoo-x86/www-plugins/adobe-flash $ cvs diff
jer@wieneke /newaches/gentoo/cvs/gentoo-x86/www-plugins/adobe-flash $ [blink]

So no change to the Manifest presents itself, and the download sizes wget displays match those in the original Manifest.
Comment 3 François Bissey 2011-12-05 18:26:21 UTC
That's very strange. I'd say that's something I have seen before with the beta but didn't really bother. Now something strange both the original reporter and I get "Length: 7042512" for adobe-flash-11.1.102.55.x86_64.tar.gz when it is actually the expected length of adobe-flash-11.0.1.152.x86_64.tar.gz could we have some problem fetching the right version?
Comment 4 François Bissey 2011-12-05 18:40:19 UTC
Actually it is becoming worse I tried a manual fetch:
wget http://fpdownload.macromedia.com/get/flashplayer/pdc/11.1.102.55/install_flash_player_11_linux.x86_64.tar.gz
--2011-12-06 07:29:37--  http://fpdownload.macromedia.com/get/flashplayer/pdc/11.1.102.55/install_flash_player_11_linux.x86_64.tar.gz
Resolving fpdownload.macromedia.com (fpdownload.macromedia.com)... 184.85.66.70
Connecting to fpdownload.macromedia.com (fpdownload.macromedia.com)|184.85.66.70|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 19855360 (19M) [application/x-gzip]
Saving to: `install_flash_player_11_linux.x86_64.tar.gz'

100%[====================================================================================================>] 19,855,360   686K/s   in 28s     

2011-12-06 07:30:06 (682 KB/s) - `install_flash_player_11_linux.x86_64.tar.gz' saved [19855360/19855360]

And the file is not a gzipped tarball at all:
file install_flash_player_11_linux.x86_64.tar.gz 
install_flash_player_11_linux.x86_64.tar.gz: POSIX tar archive (GNU)

How can I find the version of the flashplayer included in this archive?
Comment 5 Jim Ramsay (lack) (RETIRED) gentoo-dev 2011-12-05 18:53:10 UTC
Like Jeroen, I just re-checked the download and everything looks fine from
here.  

From my location the host fpdownload.macromedia.com resolves to 84.84.66.70

@far jump:  You are apparently using a proxy server - I would check that it's
not somehow mangling the file.  Try downloading again on a system that's not
behind that proxy and compare the results.

@Francois: That is very disturbing - Your request even resolved fpdownload.macromedia.com to the same IP as me, but got different data.  Even when manually fetching I consistently get the correct tarball.  I'll contact you outside this bug to get a copy of the tarball you downloaded.
Comment 6 Jim Ramsay (lack) (RETIRED) gentoo-dev 2011-12-05 18:59:15 UTC
(In reply to comment #4)
> 2011-12-06 07:30:06 (682 KB/s) - `install_flash_player_11_linux.x86_64.tar.gz'
> saved [19855360/19855360]
> 
> And the file is not a gzipped tarball at all:
> file install_flash_player_11_linux.x86_64.tar.gz 
> install_flash_player_11_linux.x86_64.tar.gz: POSIX tar archive (GNU)
> 
> How can I find the version of the flashplayer included in this archive?

Wait a sec... This is interesting!

When I take the gzipped file I get from the same URL and 'gunzip' it, I get an uncompressed tarball of exactly the same size as the file you fetched: 19855360

Could you have some sort of option on in your wget that is automatically decompressing the file, or requesting a decompressed file from Adobe's server?
Comment 7 François Bissey 2011-12-05 19:02:11 UTC
(In reply to comment #6)
> (In reply to comment #4)
> > 2011-12-06 07:30:06 (682 KB/s) - `install_flash_player_11_linux.x86_64.tar.gz'
> > saved [19855360/19855360]
> > 
> > And the file is not a gzipped tarball at all:
> > file install_flash_player_11_linux.x86_64.tar.gz 
> > install_flash_player_11_linux.x86_64.tar.gz: POSIX tar archive (GNU)
> > 
> > How can I find the version of the flashplayer included in this archive?
> 
> Wait a sec... This is interesting!
> 
> When I take the gzipped file I get from the same URL and 'gunzip' it, I get an
> uncompressed tarball of exactly the same size as the file you fetched: 19855360
> 
> Could you have some sort of option on in your wget that is automatically
> decompressing the file, or requesting a decompressed file from Adobe's server?

I don't think so. Actually I just tried curl:
curl -O http://fpdownload.macromedia.com/get/flashplayer/pdc/11.1.102.55/install_flash_player_11_linux.x86_64.tar.gz
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100 18.9M  100 18.9M    0     0   376k      0  0:00:51  0:00:51 --:--:--  403k

And again I get something uncompressed. I will try to see what happens as root.
Comment 8 François Bissey 2011-12-05 19:05:06 UTC
Same thing as root. Are there default options for wget in portage? I have nothing suspicious in make.conf.
Comment 9 Jim Ramsay (lack) (RETIRED) gentoo-dev 2011-12-05 19:26:53 UTC
(In reply to comment #8)
> Same thing as root. Are there default options for wget in portage? I have
> nothing suspicious in make.conf.

You should check if either ~/.wgetrc and /etc/wgetrc exist.

In make.conf I believe the only thing you'd look for there is if you have manually set FETCHCOMMAND

I'd be curious to see the output of 'wget -S <url>' as well as what happens when you run 'curl' instead of 'wget' to fetch the file:
  curl -v http://fpdownload.macromedia.com/get/flashplayer/pdc/11.1.102.55/install_flash_player_11_linux.x86_64.tar.gz -o install_flash_player_11_linux.x86_64.tar.gz
Comment 10 Jeroen Roovers (RETIRED) gentoo-dev 2011-12-05 19:58:43 UTC
I guess if your download client sets Accept-Encoding: gzip in the HTTP headers it sends off, then the Adobe servers should in this case not comply, since it's not a normal download to a web browser in any useful way, so I guess Adobe's servers must have changed recently. What version of wget do you have?
Comment 11 François Bissey 2011-12-05 20:09:44 UTC
Just various things I just tried:

francois@melenkurion ~/Downloads $ ebuild /usr/portage/www-plugins/adobe-flash/adobe-flash-11.0.1.152.ebuild fetch
>>> Downloading 'http://fpdownload.macromedia.com/get/flashplayer/pdc/11.0.1.152/install_flash_player_11_linux.x86_64.tar.gz'
--2011-12-06 09:01:46--  http://fpdownload.macromedia.com/get/flashplayer/pdc/11.0.1.152/install_flash_player_11_linux.x86_64.tar.gz
Resolving fpdownload.macromedia.com (fpdownload.macromedia.com)... 184.85.66.70
Connecting to fpdownload.macromedia.com (fpdownload.macromedia.com)|184.85.66.70|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 7042512 (6.7M) [application/x-gzip]
Saving to: `/usr/portage/distfiles/adobe-flash-11.0.1.152.x86_64.tar.gz'

100%[====================================================================================================>] 7,042,512    506K/s   in 22s     

2011-12-06 09:02:08 (312 KB/s) - `/usr/portage/distfiles/adobe-flash-11.0.1.152.x86_64.tar.gz' saved [7042512/7042512]

 * adobe-flash-11.0.1.152.x86_64.tar.gz RMD160 SHA1 SHA256 size ;-) ...                                                                [ ok ]
 * checking ebuild checksums ;-) ...                                                                                                   [ ok ]
 * checking auxfile checksums ;-) ...                                                                                                  [ ok ]
 * checking miscfile checksums ;-) ...                                                                                                 [ ok ]
francois@melenkurion ~/Downloads $ ebuild /usr/portage/www-plugins/adobe-flash/adobe-flash-11.1.102.55.ebuild fetch
>>> Downloading 'http://fpdownload.macromedia.com/get/flashplayer/pdc/11.1.102.55/install_flash_player_11_linux.x86_64.tar.gz'
--2011-12-06 09:03:22--  http://fpdownload.macromedia.com/get/flashplayer/pdc/11.1.102.55/install_flash_player_11_linux.x86_64.tar.gz
Resolving fpdownload.macromedia.com (fpdownload.macromedia.com)... 184.85.66.70
Connecting to fpdownload.macromedia.com (fpdownload.macromedia.com)|184.85.66.70|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 19855360 (19M) [application/x-gzip]
Saving to: `/usr/portage/distfiles/adobe-flash-11.1.102.55.x86_64.tar.gz'

100%[====================================================================================================>] 19,855,360   691K/s   in 40s     

2011-12-06 09:04:02 (482 KB/s) - `/usr/portage/distfiles/adobe-flash-11.1.102.55.x86_64.tar.gz' saved [19855360/19855360]

!!! Fetched file: adobe-flash-11.1.102.55.x86_64.tar.gz VERIFY FAILED!
!!! Reason: Filesize does not match recorded size
!!! Got:      19855360
!!! Expected: 7043207
Refetching... File renamed to '/usr/portage/distfiles/adobe-flash-11.1.102.55.x86_64.tar.gz._checksum_failure_._Iet51'

!!! Couldn't download 'adobe-flash-11.1.102.55.x86_64.tar.gz'. Aborting.

I have wget-1.12-r3, /etc/wgetrc is still at its default (everything is commented), ~/.wgetrc doesn't exist. Also:

francois@melenkurion ~/Downloads $ wget -S http://fpdownload.macromedia.com/get/flashplayer/pdc/11.1.102.55/install_flash_player_11_linux.x86_64.tar.gz
--2011-12-06 09:07:53--  http://fpdownload.macromedia.com/get/flashplayer/pdc/11.1.102.55/install_flash_player_11_linux.x86_64.tar.gz
Resolving fpdownload.macromedia.com (fpdownload.macromedia.com)... 184.85.66.70
Connecting to fpdownload.macromedia.com (fpdownload.macromedia.com)|184.85.66.70|:80... connected.
HTTP request sent, awaiting response... 
  HTTP/1.1 200 OK
  Server: Apache
  Last-Modified: Thu, 03 Nov 2011 23:49:49 GMT
  ETag: "261ddc-6b7887-3e75a140"
  Accept-Ranges: bytes
  Content-Type: application/x-gzip
  Date: Mon, 05 Dec 2011 20:03:22 GMT
  Content-Length: 19855360
  Connection: Keep-Alive
  Age: 271
Length: 19855360 (19M) [application/x-gzip]
Saving to: `install_flash_player_11_linux.x86_64.tar.gz'

100%[====================================================================================================>] 19,855,360   684K/s   in 34s     

2011-12-06 09:08:27 (574 KB/s) - `install_flash_player_11_linux.x86_64.tar.gz' saved [19855360/19855360]

francois@melenkurion ~/Downloads $ rm install_flash_player_11_linux.x86_64.tar.gz 
francois@melenkurion ~/Downloads $ curl -v -O http://fpdownload.macromedia.com/get/flashplayer/pdc/11.1.102.55/install_flash_player_11_linux.x86_64.tar.gz
* About to connect() to fpdownload.macromedia.com port 80 (#0)
*   Trying 184.85.66.70...   % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0connected
* Connected to fpdownload.macromedia.com (184.85.66.70) port 80 (#0)
> GET /get/flashplayer/pdc/11.1.102.55/install_flash_player_11_linux.x86_64.tar.gz HTTP/1.1
> User-Agent: curl/7.21.4 (x86_64-pc-linux-gnu) libcurl/7.21.4 GnuTLS/2.10.5 zlib/1.2.5 libidn/1.22
> Host: fpdownload.macromedia.com
> Accept: */*
> 
< HTTP/1.1 200 OK
< Server: Apache
< Last-Modified: Thu, 03 Nov 2011 23:49:49 GMT
< ETag: "261ddc-6b7887-3e75a140"
< Accept-Ranges: bytes
< Content-Type: application/x-gzip
< Date: Mon, 05 Dec 2011 20:08:53 GMT
< Content-Length: 19855360
< Connection: Keep-Alive
< Age: 0
< 
{ [data not shown]
100 18.9M  100 18.9M    0     0   675k      0  0:00:28  0:00:28 --:--:--  694k* Connection #0 to host fpdownload.macromedia.com left intact

* Closing connection #0
Comment 12 François Bissey 2011-12-05 21:06:04 UTC
Fetching it manually from my browser (chromium) and moving it in place in distfiles worked but this is weird.
Comment 13 far jump 2011-12-06 03:59:27 UTC
(In reply to comment #5)
> Like Jeroen, I just re-checked the download and everything looks fine from
> here.  
> 
> From my location the host fpdownload.macromedia.com resolves to 84.84.66.70
> 
> @far jump:  You are apparently using a proxy server - I would check that it's
> not somehow mangling the file.  Try downloading again on a system that's not
> behind that proxy and compare the results.
> 

Yes, I am using a proxy server.  Here what happens when I download directly:
>emerge -f adobe-flash                                                                                                         
Calculating dependencies... done!

>>> Fetching (1 of 1) www-plugins/adobe-flash-11.1.102.55
>>> Downloading 'http://fpdownload.macromedia.com/get/flashplayer/pdc/11.1.102.55/install_flash_player_11_linux.x86_64.tar.gz'
--2011-12-05 22:36:36--  http://fpdownload.macromedia.com/get/flashplayer/pdc/11.1.102.55/install_flash_player_11_linux.x86_64.tar.gz
Resolving fpdownload.macromedia.com... 184.31.114.70
Connecting to fpdownload.macromedia.com|184.31.114.70|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 7043207 (6.7M) [application/x-gzip]
Saving to: `/usr/portage/distfiles/adobe-flash-11.1.102.55.x86_64.tar.gz'

100%[=================================================================================================>] 7,043,207    349K/s   in 20s     

2011-12-05 22:36:55 (348 KB/s) - `/usr/portage/distfiles/adobe-flash-11.1.102.55.x86_64.tar.gz' saved [7043207/7043207]

no problems
Comment 14 far jump 2011-12-06 04:37:18 UTC
proxy:
http://fpdownload.macromedia.com/get/flashplayer/pdc/11.0.1.152/install_flash_player_11_linux.x86_64.tar.gz 

direct:
http://fpdownload.macromedia.com/get/flashplayer/pdc/11.1.102.55/install_flash_player_11_linux.x86_64.tar.gz

When using proxy server it resolves to 11.0.1.152

When downloading directly it resolves to 11.1.102.22

how do we find out why?
Comment 16 far jump 2011-12-06 05:11:08 UTC
ok, here is a clue:
the proxy server:
100%[=====================================================================================>]
7,042,512   --.-K/s   in 0.009s     

direct emerge:
100%[=================================================================================================>]
7,043,207    349K/s   in 20s     


the clue is the download speed.  The 2nd is correct, the 1st is far too fast.  So for some reason this file must be cached somewhere on the proxy server, but where??? (don't say /var/cache/http-replicator/)
Comment 17 Jim Ramsay (lack) (RETIRED) gentoo-dev 2011-12-14 02:32:34 UTC
(In reply to comment #11)
Your curl example is interesting... Compare your useragent string:

> > User-Agent: curl/7.21.4 (x86_64-pc-linux-gnu) libcurl/7.21.4 GnuTLS/2.10.5 zlib/1.2.5 libidn/1.22

To mine (I get the proper file, plus an extra 'Content-Encoding: x-gzip' in the response headers that you do not get):

> User-Agent: curl/7.23.1 (x86_64-pc-linux-gnu) libcurl/7.23.1 OpenSSL/1.0.0e zlib/1.2.5.1

Our requests are basically identical except that I built curl with OpenSSL whereas you have GnuTLS, and you have libidn whereas I do not.

Could Adobe's server be confused by something in your useragent header?

Can you please:
 - Check if you also have wget built with gnutls support
 - Try turning gnutls support off in both wget and curl and see if they suddenly start fetching the proper file
Comment 18 far jump 2011-12-14 02:56:09 UTC
wget does not seem to have gnutls:
>emerge -pv wget

These are the packages that would be merged, in order:

Calculating dependencies... done!
[ebuild   R    ] net-misc/wget-1.12-r3  USE="ipv6 nls ssl -debug -idn -ntlm -static" 1,572 kB

in addition:
>emerge -pv curl

These are the packages that would be merged, in order:

Calculating dependencies... done!
[ebuild   R    ] net-misc/curl-7.21.4  USE="ipv6 ldap ssl static-libs -ares -gnutls -idn -kerberos -nss -ssh -test -threads" 2,204 kB


curl is built with ssl and not with gnutls

so what do you suggest?
Comment 19 far jump 2011-12-14 03:15:45 UTC
upgraded curl to 7.23.1, still the same problem

>emerge -pv curl

These are the packages that would be merged, in order:

Calculating dependencies... done!
[ebuild   R   ~] net-misc/curl-7.23.1  USE="ipv6 ldap ssl static-libs -ares -gnutls -idn -kerberos -nss -ssh -test -threads" 0 kB
Comment 20 far jump 2011-12-14 03:35:05 UTC
ok I solved my problem  I deleted these 2 files:
>dir /var/cache/http-replicator/install_flash_player_11_linux.*                                                                                   
-rw-r--r-- 1 portage portage 6.5M Oct  8 01:10 /var/cache/http-replicator/install_flash_player_11_linux.i386.tar.gz
-rw-r--r-- 1 portage portage 6.8M Oct  8 01:10 /var/cache/http-replicator/install_flash_player_11_linux.x86_64.tar.gz

now emerge downloads the correct file.  somehow the proxy server using these files as a source?  Is this part of its function?
Comment 21 François Bissey 2011-12-14 11:44:39 UTC
I guess the whole curl thing was for me (although that wouldn't explain wget's behavior, wait it may). That's how it was emerged:

[I] net-misc/curl
     Available versions:  7.21.4 ~7.21.6 ~7.21.7 ~7.21.7-r2 ~7.22.0 ~7.23.1 {ares gnutls idn ipv6 kerberos ldap nss ssh ssl static-libs test threads}
     Installed versions:  7.21.4(14:11:20 11/12/11)(gnutls idn ipv6 ldap ssl -ares -kerberos -nss -ssh -static-libs -test -threads)

I have gnutls in there because of libcaldav:
dev-libs/libcaldav-0.6.2 (net-misc/curl[ssl,gnutls])
in turn needed by kcaldav. I am not sure why I have idn in make.conf but both curl and wget are using it so it may be the culprit:

equery h idn                                                                                                         
 * Searching for USE flag idn ...                                                                                                             
[IP-] [  ] app-text/ghostscript-gpl-9.04-r4:0                                                                                                 
[IP-] [  ] dev-perl/IO-Socket-SSL-1.440.0:0
[IP-] [  ] net-misc/curl-7.21.4:0
[IP-] [  ] net-misc/iputils-20100418-r1:0
[IP-] [  ] net-misc/wget-1.12-r3:0

I will do a few tests and report again.
Comment 22 Jim Ramsay (lack) (RETIRED) gentoo-dev 2011-12-14 18:23:25 UTC
(In reply to comment #20)
> ok I solved my problem  I deleted these 2 files:
> >dir /var/cache/http-replicator/install_flash_player_11_linux.*                                                                                   
> -rw-r--r-- 1 portage portage 6.5M Oct  8 01:10
> /var/cache/http-replicator/install_flash_player_11_linux.i386.tar.gz
> -rw-r--r-- 1 portage portage 6.8M Oct  8 01:10
> /var/cache/http-replicator/install_flash_player_11_linux.x86_64.tar.gz
> 
> now emerge downloads the correct file.  somehow the proxy server using these
> files as a source?  Is this part of its function?

AHA.  So it was your proxy serving you a stale file.  Sorry about the noise regarding GnuTLS: that's for Francois who is having a different problem than you are.

I suspect that your problem may have something to do with the fact that due to the way Adobe distributes their code, the file has exactly the same name (install_flash_player_11_linux.x86_64.tar.gz) for different versions of flash player, but each one exists in different *directories* in the URL.  This is apparently confusing to the proxy server.

So this points at a bug in the http-replicator proxy system.  If it can't tell that the URL or the file contents is different and are serving you a stale file, that's a *big* problem!

I would suggest opening a separate bug about this against net-proxy/http-replicator, since this is not strictly related to flash itself, but can be replicated by using the SRC_URI from a couple different versions of the adobe-flash ebuild, such as these two:
  http://fpdownload.macromedia.com/get/flashplayer/pdc/11.1.102.55/install_flash_player_11_linux.x86_64.tar.gz
  http://fpdownload.macromedia.com/get/flashplayer/pdc/11.0.1.152/install_flash_player_11_linux.x86_64.tar.gz
Comment 23 Jim Ramsay (lack) (RETIRED) gentoo-dev 2011-12-14 18:44:17 UTC
(In reply to comment #21)
> I guess the whole curl thing was for me (although that wouldn't explain wget's
> behavior, wait it may).

I've done some testing on my end, and I'm now thinking that your USE flags for curl/wget have nothing at all to do with what you're seeing.

To test this theory, I told curl to set my USER-AGENT string to exactly what your curl is using, expecting that if it were something in your USER-AGENT header that was making Adobe's servers misbehave, I would get the same bad result as you are getting.  But I *still* get the properly compressed file:

> GET /get/flashplayer/pdc/11.1.102.55/install_flash_player_11_linux.x86_64.tar.gz HTTP/1.1
> User-Agent: curl/7.21.4 (x86_64-pc-linux-gnu) libcurl/7.21.4 GnuTLS/2.10.5 zlib/1.2.5 libidn/1.22
> Host: fpdownload.macromedia.com
> Accept: */*
> 
< HTTP/1.1 200 OK
< Server: Apache
< Last-Modified: Thu, 03 Nov 2011 23:49:49 GMT
< ETag: "261ddc-6b7887-3e75a140"
< Accept-Ranges: bytes
< Content-Length: 7043207
< Content-Type: application/x-gzip
< Content-Encoding: x-gzip
< Date: Wed, 14 Dec 2011 18:25:54 GMT
< Connection: keep-alive
< 

So now the request I sent to their server was exactly identical to the request you posted earlier, but the response we get back is different.  Other than the order of the headers (which is interesting in and of itself), mine has 'Content-Encoding: x-gzip' (yours does not), and yours has 'Age: 0' (mine does not).

Doing a quick google on the "Age" header found http://www.w3.org/Protocols/rfc2616/rfc2616-sec14.html, where it says:

  An HTTP/1.1 server that includes a cache MUST
  include an Age header field in every response
  generated from its own cache.

So the only likely solution I can come up with is that you are behind some sort of transparent proxy that's mistakenly uncompressing the file for you.  This could be something you set up, or maybe something your ISP does for you without your knowledge.

The bad news is that I'm not sure what to tell you to do about this!
Comment 24 François Bissey 2011-12-14 21:18:12 UTC
Thanks for your investigation. I know for a fact that my ISP has a transparent proxy. Fetching the file with a web browser worked and there is presumably nothing I can do about it apart may be complaining to my ISP.
I'll make a mental note for next time this happens to check if I am getting uncompressed stuff.
Comment 25 Jim Ramsay (lack) (RETIRED) gentoo-dev 2011-12-15 14:53:19 UTC
I'm glad we tracked down the errors you both were having, but I'm sad to say I can't fix the proxy issues you are seeing.

@far jump: I'd still recommend you report this as a bug against http-replicator

@Francois: Complain away, but good luck getting someone at your ISP that actually understands what you mean ;)

Closing as CANTFIX.