Gentoo Websites Logo
Go to: Gentoo Home Documentation Forums Lists Bugs Planet Store Wiki Get Gentoo!
Bug 258433 - x11-misc/googleearth-5.0.11337.1968_beta and media-gfx/picasa-3.0.0.57.4402.0_beta fetch fails with custom FETCHCOMMAND
Summary: x11-misc/googleearth-5.0.11337.1968_beta and media-gfx/picasa-3.0.0.57.4402.0...
Status: RESOLVED FIXED
Alias: None
Product: Gentoo Linux
Classification: Unclassified
Component: Current packages (show other bugs)
Hardware: AMD64 Linux
: High normal (vote)
Assignee: Portage team
URL:
Whiteboard:
Keywords: InVCS
: 258477 258624 259457 329595 (view as bug list)
Depends on:
Blocks: 210077 261959
  Show dependency tree
 
Reported: 2009-02-10 12:31 UTC by Volker Hemmann
Modified: 2010-07-26 00:54 UTC (History)
7 users (show)

See Also:
Package list:
Runtime testing required: ---


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Volker Hemmann 2009-02-10 12:31:22 UTC
see:
>>> Emerging (1 of 6) x11-misc/googleearth-5.0.11337.1968_beta
>>> Downloading 'http://dl.google.com/earth/client/current/GoogleEarthLinux.bin'
--2009-02-10 13:29:26--  http://dl.google.com/earth/client/current/GoogleEarthLinux.bin
Auflösen des Hostnamen »dl.google.com«.... 66.249.93.91, 66.249.93.91, 66.249.93.91, ...
Verbindungsaufbau zu dl.google.com|66.249.93.91|:80... verbunden.
HTTP Anforderung gesendet, warte auf Antwort... 200 OK
Länge: 25338751 (24M) [application/octet-stream]
In »/var/portage/distfiles/GoogleEarthLinux.bin« speichern.

100%[============================================================================================================================================================================>] 25.338.751  8,43M/s   in 2,9s

2009-02-10 13:29:29 (8,43 MB/s) - »/var/portage/distfiles/GoogleEarthLinux.bin« gespeichert [25338751/25338751]

!!! Couldn't download 'GoogleEarthLinux-5.0.11337.1968_beta.bin'. Aborting.
 * Fetch failed for 'x11-misc/googleearth-5.0.11337.1968_beta', Log file:
 *  '/var/tmp/portage/x11-misc/googleearth-5.0.11337.1968_beta/temp/build.log'

>>> Failed to emerge x11-misc/googleearth-5.0.11337.1968_beta, Log file:

>>>  '/var/tmp/portage/x11-misc/googleearth-5.0.11337.1968_beta/temp/build.log'


Reproducible: Always
Comment 1 Vlastimil Babka (Caster) (RETIRED) gentoo-dev 2009-02-10 13:23:19 UTC
Please post emerge --info
anything like FETCHCOMMAND set in make.conf?

Because here it should say GoogleEarthLinux-5.0.11337.1968_beta.bin
"In »/var/portage/distfiles/GoogleEarthLinux.bin« speichern."
Comment 2 Volker Hemmann 2009-02-10 16:36:21 UTC
emerge --info
WARNING: One or more repositories have missing repo_name entries:

        /usr/local/portage/profiles/repo_name

NOTE: Each repo_name entry should be a plain text file containing a
unique name for the repository on the first line.                  
Portage 2.2_rc23 (default/linux/amd64/2008.0/desktop, gcc-4.3.3, glibc-2.9_p20081201-r1, 2.6.27.15r4 x86_64)
=================================================================                                           
System uname: Linux-2.6.27.15r4-x86_64-AMD_Athlon-tm-_64_X2_Dual_Core_Processor_6000+-with-glibc2.2.5       
Timestamp of tree: Tue, 10 Feb 2009 10:30:01 +0000                                                          
ccache version 2.4 [enabled]                                                                                
app-shells/bash:     3.2_p48-r1                                                                             
dev-java/java-config: 1.3.7-r1, 2.1.7                                                                       
dev-lang/python:     2.5.4-r2                                                                               
dev-util/ccache:     2.4-r8                                                                                 
dev-util/cmake:      2.6.2-r1                                                                               
sys-apps/baselayout: 2.0.0                                                                                  
sys-apps/openrc:     0.4.2                                                                                  
sys-apps/sandbox:    1.3.5                                                                                  
sys-devel/autoconf:  2.13, 2.63                                                                             
sys-devel/automake:  1.5, 1.7.9-r1, 1.8.5-r3, 1.9.6-r2, 1.10.2                                              
sys-devel/binutils:  2.19.1                                                                                 
sys-devel/gcc-config: 1.4.1                                                                                 
sys-devel/libtool:   2.2.6a                                                                                 
virtual/os-headers:  2.6.28-r1                                                                              
ACCEPT_KEYWORDS="amd64 ~amd64"                                                                              
CBUILD="x86_64-pc-linux-gnu"                                                                                
CFLAGS="-march=k8-sse3 -O2 -msse3 -pipe"
CHOST="x86_64-pc-linux-gnu"
CONFIG_PROTECT="/etc /usr/kde/3.5/env /usr/kde/3.5/share/config /usr/kde/3.5/shutdown /usr/kde/4.1/env /usr/kde/4.1/share/config /usr/kde/4.1/shutdown /usr/kde/4.2/env /usr/kde/4.2/share/config /usr/kde/4.2/shutdown /usr/share/config"
CONFIG_PROTECT_MASK="/etc/ca-certificates.conf /etc/env.d /etc/env.d/java/ /etc/fonts/fonts.conf /etc/gconf /etc/gentoo-release /etc/php/apache2-php5/ext-active/ /etc/php/cgi-php5/ext-active/ /etc/php/cli-php5/ext-active/ /etc/revdep-rebuild /etc/sandbox.d /etc/terminfo /etc/udev/rules.d"
CXXFLAGS="-march=k8-sse3 -O2 -msse3 -pipe"
DISTDIR="/var/portage/distfiles"
FEATURES="autoconfig buildpkg candy ccache collision-protect distlocks fixpackages metadata-transfer parallel-fetch protect-owned sandbox sfperms strict unmerge-orphans userfetch"
GENTOO_MIRRORS="ftp://ftp.tu-clausthal.de/pub/linux/gentoo/"
LANG="de_DE@euro"
LC_ALL="de_DE@euro"
LDFLAGS="-Wl,-O1"
LINGUAS="de"
MAKEOPTS="-j3"
PKGDIR="/usr/packages"
PORTAGE_RSYNC_OPTS="--recursive --links --safe-links --perms --times --compress --force --whole-file --delete --stats --timeout=180 --exclude=/distfiles --exclude=/local --exclude=/packages"
PORTAGE_TMPDIR="/var/tmp"
PORTDIR="/var/portage"
PORTDIR_OVERLAY="/usr/local/portage/layman/games /usr/local/portage/layman/qting-edge /usr/local/portage/layman/kde-testing /usr/local/portage"
SYNC="rsync://rsync.gentoo.org/gentoo-portage"
USE="3dnow 3dnowext 7zip S3TC X Xaw3d a52 aac acpi addbookmarks aiglx aim aio akode alias alsa altenburgcards amarok amd64 amr amrnb amrwb aotuv aqua_theme archive asf athena audiofile autoreplace avahi bash-completion berkdb binary-drivers bluetooth boost branding bzip2 cairo captury cdaudio cdda cddb cdinstall cdparanoia cdr cdrom cdsound cegui clamav cli connectionstatus consolekit contactnotes cracklib crypt css cups curl dbus depth32 dhcp dio divx dnd double-precision dpms dri dts dv dvb dvbplayer dvbsetup dvd dvdr dvdread eds emboss emerald emovix emul-linux-x86 encode evo exif exiv2 expat exscalibar extra-cardsets fame fasttrack ffmpeg fftw file filter_default filter_legacy filter_light firefox fits flac fontconfig foomaticdb fortran ftp gadu gammu gd gdbm gif gimp gimpprint glitz glut glx gnokii gnutella gpgme gpm hal hddtemp highlighthistory iconv icq icu id3 id3tag ieee1394 imagemagick inotify ipv6 irc irmc isdnlog jabber java javascript jce joystick jpeg jpeg2k kate kcal kde kdecards kdeenablefinal kdehiddenvisibility kdepim kdeprefix kdm kexi kipi lame lapack lcms lesstif libnotify libsamplerate libssh2 libwww lirc lm_sensors logitech-mouse lzo lzw mad magic mailbox maildir maps matroska mbox mdnsresponder-compat metric midi mikmod mime mixer mjpeg mmap mmx mmxext mng mp3 mp4 mpeg mpeg2 mplayer msn mtp mudflap mule multilib musepack music nano-syntax ncurses neXt nepomuk net network newspr ngui nls no-old-linux nocd nosendmail nova nowin nowlistening npp nptl nptlonly nsplugin ntfs obex offensive ogg ogg123 ogm openexr opengl openmp oscar otr pam paste64 pch pcre pda pdf perl physfs pixmaps plasma player plugins png pnm posix ppds pppd python qt3 qt3support qt4 quicktime rar readline recode reflection reiser4 reiserfs remix resolvconf rogue rtc samba sametime sasl scanner scenarios schedule scsi sdl sdl-image sdl-sound sdlaudio sendfile server session slp smp sms sndfile sockets sounds spell spl sqlite sqlite3 srt sse sse-filters sse2 sse3 ssh ssl ssse3 startup-notification statistics stats stencil-buffer stroke subp subtitles svg sysfs sysvipc szip tcpd texteffect textures tga theora threads threadsafe tiff timidity tk tomsfastmath toolbar tools transcode translator truetype tv tv_check tv_combiner tv_pick_cgi tvtime type1 unicode unzip usb userlocales utempter v4l v4l2 vcd videos visualization vorbis webdav webkit webpresence wifi wireshark wmf wmp wxwindows x264 xanim xcb xcomposite xemacs xext xface xft xine xml xorg xosd xpm xrandr xrender xscreensaver xskatcards xulrunner xv xvid xvmc yahoo yiff yv12 zip zlib zsh-completion zvbi" ALSA_CARDS="emu10k1" ALSA_PCM_PLUGINS="adpcm alaw asym copy dmix dshare dsnoop empty extplug file hooks iec958 ioplug ladspa lfloat linear meter mmap_emul mulaw multi null plug rate route share shm softvol" APACHE2_MODULES="actions alias auth_basic authn_alias authn_anon authn_dbm authn_default authn_file authz_dbm authz_default authz_groupfile authz_host authz_owner authz_user autoindex cache davdav_fs dav_lock deflate dir disk_cache env expires ext_filter file_cache filter headers include info log_config logio mem_cache mime mime_magic negotiation rewrite setenvif speling status unique_id userdir usertrack vhost_alias" ELIBC="glibc" INPUT_DEVICES="keyboard mouse evdev" KERNEL="linux" LCD_DEVICES="bayrad cfontz cfontz633 glk hd44780 lb216 lcdm001 mtxorb ncurses text" LINGUAS="de" LIRC_DEVICES="devinput" USERLAND="GNU" VIDEO_CARDS="vesa v4l fglrx radeon radeonhd"
Unset:  CPPFLAGS, CTARGET, EMERGE_DEFAULT_OPTS, FFLAGS, INSTALL_MASK, PORTAGE_COMPRESS, PORTAGE_COMPRESS_FLAGS, PORTAGE_RSYNC_EXTRA_OPTS

well, it does download from google - and 
FETCHCOMMAND="/usr/bin/wget -t 5 -T 60 --no-passive-ftp \${URI} -P \${DISTDIR}"
Comment 3 Patrizio Bassi 2009-02-10 17:45:51 UTC
same here 

>>> Emerging (1 of 1) x11-misc/googleearth-5.0.11337.1968_beta
>>> Downloading 'http://dl.google.com/earth/client/current/GoogleEarthLinux.bin'
--2009-02-10 18:41:07--  http://dl.google.com/earth/client/current/GoogleEarthLinux.bin
Risoluzione di dl.google.com... 66.249.93.93, 66.249.93.91, 66.249.93.136, ...         
Connessione a dl.google.com|66.249.93.93|:80... connesso.                              
HTTP richiesta inviata, in attesa di risposta... 200 OK                                
Lunghezza: 25338751 (24M) [application/octet-stream]                                   
Salvataggio in: "/mnt/Dati/Gentoo/portage/distfiles/GoogleEarthLinux.bin.3"            

100%[==============================================================================================================================================>] 25.338.751   526K/s   in 47s     

2009-02-10 18:41:54 (522 KB/s) - "/mnt/Dati/Gentoo/portage/distfiles/GoogleEarthLinux.bin.3" salvato [25338751/25338751]

!!! Couldn't download 'GoogleEarthLinux-5.0.11337.1968_beta.bin'. Aborting.
 * Fetch failed for 'x11-misc/googleearth-5.0.11337.1968_beta', Log file:  
 *  '/mnt/Dati/Gentoo/tmp/portage/x11-misc/googleearth-5.0.11337.1968_beta/temp/build.log'

>>> Failed to emerge x11-misc/googleearth-5.0.11337.1968_beta, Log file:

>>>  '/mnt/Dati/Gentoo/tmp/portage/x11-misc/googleearth-5.0.11337.1968_beta/temp/build.log'

 * Messages for package x11-misc/googleearth-5.0.11337.1968_beta:

 * Fetch failed for 'x11-misc/googleearth-5.0.11337.1968_beta', Log file:
 *  '/mnt/Dati/Gentoo/tmp/portage/x11-misc/googleearth-5.0.11337.1968_beta/temp/build.log'
Comment 4 Vlastimil Babka (Caster) (RETIRED) gentoo-dev 2009-02-10 19:09:22 UTC
(In reply to comment #2)
> FETCHCOMMAND="/usr/bin/wget -t 5 -T 60 --no-passive-ftp \${URI} -P \${DISTDIR}"
 
Yeah you need to change it to take output file name (${FILE}) into account, according to /usr/share/portage/config/make.conf.example:

#FETCHCOMMAND="/usr/bin/wget -t 5 -T 60 --passive-ftp -O \"\${DISTDIR}/\${FILE}\" \"\${URI}\""

(In reply to comment #3)
> same here 

How bout your emerge --info and FETCHCOMMAND setting?
 
> >>> Emerging (1 of 1) x11-misc/googleearth-5.0.11337.1968_beta
> >>> Downloading 'http://dl.google.com/earth/client/current/GoogleEarthLinux.bin'
> --2009-02-10 18:41:07-- 
> http://dl.google.com/earth/client/current/GoogleEarthLinux.bin
> Risoluzione di dl.google.com... 66.249.93.93, 66.249.93.91, 66.249.93.136, ...  
> Connessione a dl.google.com|66.249.93.93|:80... connesso.                       
> HTTP richiesta inviata, in attesa di risposta... 200 OK                         
> Lunghezza: 25338751 (24M) [application/octet-stream]                            
> Salvataggio in: "/mnt/Dati/Gentoo/portage/distfiles/GoogleEarthLinux.bin.3"     

I wonder how did the ".3" get appended...
Comment 5 Volker Hemmann 2009-02-10 19:19:02 UTC
a) when did that change
b) was there any information of that change anywhere outside of example?
c) why is ge the only package affected?
d) the .3 comes from the fact that it is the third time he downloaded the package. I ended with .10 when i opened this bug.
Comment 6 Vlastimil Babka (Caster) (RETIRED) gentoo-dev 2009-02-10 19:39:57 UTC
(In reply to comment #5)
> a) when did that change

When EAPI=2 was adopted, SRC_URI arrows were added that allow renaming the upstream distfiles as part of its fetch. Packages using it thus need to pass the new filename to the FETCHCOMMAND. Others still work with old syntax as well.

> b) was there any information of that change anywhere outside of example?

I think EAPI=2 was announced, I guess it did not include warning about implications for the FETCHCOMMAND :/

> c) why is ge the only package affected?

Any EAPI=2 ebuild using SRC_URI arrows is affected, there just aren't many packages, most upstreams are sane and version their distfiles :)

> d) the .3 comes from the fact that it is the third time he downloaded the
> package. I ended with .10 when i opened this bug.

Thanks for the info.

I'm CCing portage, we discussed adding a check and/or more descriptive error message with Zac.

Comment 7 Patrizio Bassi 2009-02-10 20:02:16 UTC
FETCHCOMMAND="/usr/bin/wget -t 3 -T 25 --passive-ftp -P \${DISTDIR} \${URI}"
RESUMECOMMAND="/usr/bin/wget -c -t 3 -T 25 --passive-ftp -P \${DISTDIR} \${URI}"

.3 got appened because previous 3 tries failed..

same problem with picasa.

it happenes only on google servers...i've been running this command since years!
Comment 8 Patrizio Bassi 2009-02-10 20:13:16 UTC
however commenting the FETCHCOMMAND it works flawlessy.
Comment 9 Patrizio Bassi 2009-02-10 20:14:38 UTC
*** Bug 258477 has been marked as a duplicate of this bug. ***
Comment 10 Zac Medico gentoo-dev 2009-02-10 20:42:39 UTC
As documented in `man make.conf` and /usr/share/portage/config/make.conf.example, you need to write the FETCHCOMMAND such that the downloaded file will be placed at \"\${DISTDIR}/\${FILE}\".

I'll make portage generate a warning message in cases when the FETCHCOMMAND does not contain the necessary ${FILE} variable.
Comment 11 Volker Hemmann 2009-02-10 20:48:53 UTC
such documentation is simply not enough when behaviour changes after YEARS of useage.
At least some fat elog warning should be there.
Comment 12 Sergiy Borodych 2009-02-11 08:15:53 UTC
I agree, some warning should be there
Comment 13 Zac Medico gentoo-dev 2009-02-11 08:38:59 UTC
I've added an ewarn message to the portage-2.1.6.4 and portage-2.1.6.7 ebuilds in cvs:

  http://sources.gentoo.org/viewcvs.py/gentoo-x86/sys-apps/portage/portage-2.1.6.4.ebuild?r1=1.11&r2=1.12
Comment 14 Volker Hemmann 2009-02-11 15:05:29 UTC
thanks Zac, but IMHO 2.2_rcXY need the same warning.
Comment 15 Vlastimil Babka (Caster) (RETIRED) gentoo-dev 2009-02-11 17:36:39 UTC
*** Bug 258624 has been marked as a duplicate of this bug. ***
Comment 16 Carsten Lohrke (RETIRED) gentoo-dev 2009-02-11 21:24:53 UTC
(In reply to comment #10)
> As documented in `man make.conf` and
> /usr/share/portage/config/make.conf.example, you need to write the FETCHCOMMAND
> such that the downloaded file will be placed at \"\${DISTDIR}/\${FILE}\".

Just did so, missing to replace -P with -O. My bad, but Portage could use a safety check here.

!!! Fetched file: GoogleEarthLinux-5.0.11337.1968_beta.bin VERIFY FAILED!
!!! Reason: Filesize does not match recorded size
!!! Got:      88
!!! Expected: 25338751
('Filesize does not match recorded size', 88L, 25338751)
Traceback (most recent call last):
  File "/usr/lib/portage/bin/ebuild", line 234, in <module>
    debug=debug, tree=mytree)
  File "//usr/lib/portage/pym/portage/__init__.py", line 5792, in doebuild
    fetchme, mysettings, listonly=listonly, fetchonly=fetchonly):
  File "//usr/lib/portage/pym/portage/__init__.py", line 4075, in fetch
    mysettings["DISTDIR"], myfile)
  File "//usr/lib/portage/pym/portage/__init__.py", line 3295, in _checksum_failure_temp_file
    os.rename(filename, temp_filename)
OSError: [Errno 20] Not a directory

Comment 17 Zac Medico gentoo-dev 2009-02-12 04:01:37 UTC
In svn r12600 there's a check for the ${FILE} parameter and in r12601 there's a check for the case where FETCHCOMMAND has created a directory as shown in comment #16.

(In reply to comment #14)
> thanks Zac, but IMHO 2.2_rcXY need the same warning.

Well, I think it's a little late to showing a warning for 2.2 (and it's in package.mask now anyway). The message is much most relevant for stable users who are upgrading to portage-2.1.6.x from an earlier version.
Comment 18 Volker Hemmann 2009-02-12 04:05:24 UTC
but people using 2.2_rcXY are hitting this problem too. And at the end it is the same problem:
after years suddenly and without warning, behaviour changes.

A warning should be there.
Comment 19 Carsten Lohrke (RETIRED) gentoo-dev 2009-02-12 22:44:22 UTC
(In reply to comment #18)
> but people using 2.2_rcXY are hitting this problem too. And at the end it is
> the same problem:
> after years suddenly and without warning, behaviour changes.

When you cannot live with it, don't use masked packages. You should always expect them to be broken, killing your whole system in the worst case.
Comment 20 Zac Medico gentoo-dev 2009-02-18 20:00:49 UTC
*** Bug 259457 has been marked as a duplicate of this bug. ***
Comment 21 Zac Medico gentoo-dev 2009-03-10 09:28:41 UTC
This is fixed in 2.2_rc24 which is in package.mask. I'll close this bug when it's also released in 2.1.6.8.
Comment 22 Zac Medico gentoo-dev 2009-03-13 20:42:29 UTC
This is released in 2.1.6.8.
Comment 23 Jerome Potts 2009-04-20 03:47:40 UTC
I upgraded Portage because the install of a pkg was complaining about my system not being EAPI2-ready. Installing the new Portage (2.1.6.7), i got an elog msg about the new requirements for FETCHCOMMAND and RESUMECOMMAND in case of EAPI-2 compatibility. I had to conduct a bunch of research in the man pages and online, and the discussion in this bug is what finally got me going again. The elog msgs might have reassured me that having neither command explicitly specified in /etc/make.conf is just fine, that the defaults are all ready-to-wear.

My /etc/make.conf.examples remains an old file (2007-07-04) which shows the old commands for the variables. I can't figure out which pkg that file belongs to. So, if it is orphan, perhaps sys-apps/portage could install a new version of it?
Comment 24 Zac Medico gentoo-dev 2009-04-20 05:04:08 UTC
(In reply to comment #23)
> I upgraded Portage because the install of a pkg was complaining about my system
> not being EAPI2-ready. Installing the new Portage (2.1.6.7), i got an elog msg
> about the new requirements for FETCHCOMMAND and RESUMECOMMAND in case of EAPI-2
> compatibility. I had to conduct a bunch of research in the man pages and
> online, and the discussion in this bug is what finally got me going again. The
> elog msgs might have reassured me that having neither command explicitly
> specified in /etc/make.conf is just fine, that the defaults are all
> ready-to-wear.

I'll make it grep make.conf and only produce the warning if FETCHCOMMAND/RESUMECOMMAND appears to be incorrectly defined.

> My /etc/make.conf.examples remains an old file (2007-07-04) which shows the old
> commands for the variables. I can't figure out which pkg that file belongs to.
> So, if it is orphan, perhaps sys-apps/portage could install a new version of
> it?

That file is an orphan, so you can safely removed it. The current version is located at /usr/share/portage/config/make.conf.example. BTW, you can query the owner of if like this:

  portageq owners / /etc/make.conf.example
Comment 25 Jeroen Roovers (RETIRED) gentoo-dev 2010-07-26 00:54:39 UTC
*** Bug 329595 has been marked as a duplicate of this bug. ***