Bug 617096

Summary:	x11-drivers/nvidia-drivers - fetch from ftp://download.nvidia.com fails
Product:	Gentoo Linux	Reporter:	Fin Christensen <fin.christensen>
Component:	Current packages	Assignee:	Jeroen Roovers (RETIRED) <jer>
Status:	RESOLVED FIXED
Severity:	normal	CC:	hardened, jgeboski, jstein, ted.d.rodgers
Priority:	Normal
Version:	unspecified
Hardware:	All
OS:	Linux
Whiteboard:
Package list:		Runtime testing required:	---
Attachments:	x11-drivers:nvidia-drivers-381.09:20170430-115833.log

Description Fin Christensen 2017-04-30 12:21:33 UTC

Created attachment 471374 [details]
x11-drivers:nvidia-drivers-381.09:20170430-115833.log

nvidia-drivers-381.09 failed to install as the fetch of the tarball failed.

emerge --info:
Portage 2.3.5 (python 3.5.3-final-0, default/linux/amd64/13.0/desktop/gnome/systemd, gcc-5.4.0, glibc-2.24-r1, 4.9.0 x86_64)
=================================================================
System uname: Linux-4.9.0-x86_64-Intel-R-_Core-TM-_i7-6700HQ_CPU_@_2.60GHz-with-gentoo-2.3
KiB Mem:    16451784 total,   4610148 free
KiB Swap:   25165820 total,  24861632 free
Timestamp of repository gentoo: Thu, 27 Apr 2017 13:00:01 +0000
sh bash 4.4_p12
ld GNU ld (Gentoo 2.27 p1.0) 2.27
app-shells/bash:          4.4_p12::gentoo
dev-java/java-config:     2.2.0-r3::gentoo
dev-lang/perl:            5.24.1-r1::gentoo
dev-lang/python:          2.7.13::gentoo, 3.4.6::gentoo, 3.5.3::gentoo, 3.6.1-r1::gentoo
dev-util/cmake:           3.8.0::gentoo
dev-util/pkgconfig:       0.29.2::gentoo
sys-apps/baselayout:      2.3::gentoo
sys-apps/openrc:          0.25::gentoo
sys-apps/sandbox:         2.10-r4::gentoo
sys-devel/autoconf:       2.13::gentoo, 2.69-r2::gentoo
sys-devel/automake:       1.11.6-r2::gentoo, 1.12.6-r1::gentoo, 1.13.4-r1::gentoo, 1.14.1-r1::gentoo, 1.15-r2::gentoo
sys-devel/binutils:       2.27::gentoo
sys-devel/gcc:            5.4.0-r3::gentoo
sys-devel/gcc-config:     1.8-r1::gentoo
sys-devel/libtool:        2.4.6-r4::gentoo
sys-devel/make:           4.2.1-r1::gentoo
sys-kernel/linux-headers: 4.10::gentoo (virtual/os-headers)
sys-libs/glibc:           2.24-r1::gentoo
Repositories:

gentoo
    location: /usr/portage
    sync-type: rsync
    sync-uri: rsync://rsync.gentoo.org/gentoo-portage
    priority: -1000

Fin
    location: /usr/local/portage/Fin
    masters: gentoo
    priority: 0

bumblebee
    location: /var/lib/layman/bumblebee
    sync-type: laymansync
    sync-uri: git://github.com/Bumblebee-Project/bumblebee-gentoo
    masters: gentoo
    priority: 50

gentoo-gpu
    location: /var/lib/layman/gentoo-gpu
    sync-type: laymansync
    sync-uri: https://github.com/sjnewbury/gentoo-gpu.git
    masters: gentoo
    priority: 50

gnome
    location: /var/lib/layman/gnome
    sync-type: laymansync
    sync-uri: git://anongit.gentoo.org/proj/gnome.git
    masters: gentoo
    priority: 50

haskell
    location: /var/lib/layman/haskell
    sync-type: laymansync
    sync-uri: git://github.com/gentoo-haskell/gentoo-haskell.git
    masters: gentoo
    priority: 50

Installed sets: @steam
ACCEPT_KEYWORDS="amd64 ~amd64"
ACCEPT_LICENSE="* -@EULA"
CBUILD="x86_64-pc-linux-gnu"
CFLAGS="-O2 -pipe -march=native -fomit-frame-pointer"
CHOST="x86_64-pc-linux-gnu"
CONFIG_PROTECT="/etc /usr/lib64/libreoffice/program/sofficerc /usr/share/config /usr/share/gnupg/qualified.txt"
CONFIG_PROTECT_MASK="/etc/ca-certificates.conf /etc/chromium/policies/managed/chrome-gnome-shell.json /etc/dconf /etc/env.d /etc/fonts/fonts.conf /etc/gconf /etc/gentoo-release /etc/opt/chrome/policies/managed/chrome-gnome-shell.json /etc/revdep-rebuild /etc/sandbox.d /etc/terminfo /etc/texmf/language.dat.d /etc/texmf/language.def.d /etc/texmf/updmap.d /etc/texmf/web2c"
CXXFLAGS="-O2 -pipe -march=native -fomit-frame-pointer"
DISTDIR="/usr/portage/distfiles"
EMERGE_DEFAULT_OPTS="--jobs 12 --load-average 8 --keep-going"
FCFLAGS="-O2 -pipe"
FEATURES="assume-digests binpkg-logs config-protect-if-modified distlocks ebuild-locks fixlafiles merge-sync news parallel-fetch protect-owned sandbox sfperms strict unknown-features-warn unmerge-logs unmerge-orphans userfetch userpriv usersandbox usersync xattr"
FFLAGS="-O2 -pipe"
GENTOO_MIRRORS="http://de-mirror.org/distro/gentoo/ http://ftp.uni-erlangen.de/pub/mirrors/gentoo http://mirror.ovh.net/gentoo-distfiles/"
LANG="en_US.UTF-8"
LDFLAGS="-Wl,-O1 -Wl,--as-needed"
MAKEOPTS="-j12 -l8"
PKGDIR="/usr/portage/packages"
PORTAGE_CONFIGROOT="/"
PORTAGE_RSYNC_OPTS="--recursive --links --safe-links --perms --times --omit-dir-times --compress --force --whole-file --delete --stats --human-readable --timeout=180 --exclude=/distfiles --exclude=/local --exclude=/packages --exclude=/.git"
PORTAGE_TMPDIR="/var/tmp"
USE="X a52 aac acpi aes alsa amd64 avahi avx avx2 bash-completion berkdb bluetooth bluray branding bzip2 cairo cdda cddb cdparanoia cdr cli colord cracklib crypt css cups cxx dbus device-mapper dga dri dts dvd dvdr dvdread eds emacs emboss encode evo exif faac fam ffmpeg firefox flac fma3 foomaticdb fortran gdbm gif gimp git glamor gnome gnome-keyring gnome-online-accounts gphoto gpm gstreamer gtk gtk3 gzip iconv icu id3tag imap imlib introspection ipv6 java joystick jpeg lame laptop lcms ldap libnotify libsamplerate libsecret lm_sensors mad matroska mmx mmxext mng modules mp3 mp4 mpeg mplayer multilib nautilus ncurses networkmanager nls nptl ogg openal opencl opengl openmp pam pango pcre pdf png policykit popcnt ppds pulseaudio python qt3support qt4 qt5 rdesktop readline real samba sdl seccomp session spell sse sse2 sse3 sse4_1 sse4_2 ssl ssse3 startup-notification svg systemd tcpd theora tiff tracker truetype twolame udev udisks unicode upnp upower usb v4l v4l2 vaapi vcd vdpau vorbis win32codecs wmf wxwidgets x264 x265 xattr xcb xml xpm xv xvid zeroconf zlib zsh-completion" ABI_X86="64" ALSA_CARDS="ali5451 als4000 atiixp atiixp-modem bt87x ca0106 cmipci emu10k1x ens1370 ens1371 es1938 es1968 fm801 hda-intel intel8x0 intel8x0m maestro3 trident usb-audio via82xx via82xx-modem ymfpci" APACHE2_MODULES="authn_core authz_core socache_shmcb unixd actions alias auth_basic authn_alias authn_anon authn_dbm authn_default authn_file authz_dbm authz_default authz_groupfile authz_host authz_owner authz_user autoindex cache cgi cgid dav dav_fs dav_lock deflate dir disk_cache env expires ext_filter file_cache filter headers include info log_config logio mem_cache mime mime_magic negotiation rewrite setenvif speling status unique_id userdir usertrack vhost_alias" CALLIGRA_FEATURES="kexi words flow plan sheets stage tables krita karbon braindump author" COLLECTD_PLUGINS="df interface irq load memory rrdtool swap syslog" CPU_FLAGS_X86="aes avx avx2 fma3 mmx mmxext popcnt sse sse2 sse3 sse4_1 sse4_2 ssse3" ELIBC="glibc" GPSD_PROTOCOLS="ashtech aivdm earthmate evermore fv18 garmin garmintxt gpsclock isync itrax mtk3301 nmea ntrip navcom oceanserver oldstyle oncore rtcm104v2 rtcm104v3 sirf skytraq superstar2 timing tsip tripmate tnt ublox ubx" GRUB_PLATFORMS="efi-64" INPUT_DEVICES="libinput" KERNEL="linux" L10N="en" LCD_DEVICES="bayrad cfontz cfontz633 glk hd44780 lb216 lcdm001 mtxorb ncurses text" LIBREOFFICE_EXTENSIONS="presenter-console presenter-minimizer" LINGUAS="en" OFFICE_IMPLEMENTATION="libreoffice" PHP_TARGETS="php5-6" PYTHON_SINGLE_TARGET="python3_5" PYTHON_TARGETS="python2_7 python3_5" RUBY_TARGETS="ruby21 ruby22" USERLAND="GNU" VIDEO_CARDS="intel i965 nvidia" XTABLES_ADDONS="quota2 psd pknock lscan length2 ipv4options ipset ipp2p iface geoip fuzzy condition tee tarpit sysrq steal rawnat logmark ipmark dhcpmac delude chaos account"
USE_PYTHON="3.5 2.7"
Unset:  CC, CPPFLAGS, CTARGET, CXX, INSTALL_MASK, LC_ALL, PORTAGE_BUNZIP2_COMMAND, PORTAGE_COMPRESS, PORTAGE_COMPRESS_FLAGS, PORTAGE_RSYNC_EXTRA_OPTS

Comment 1 Fin Christensen 2017-04-30 14:51:35 UTC

I figured out that this issue is the result of 

ftp://download.nvidia.com/XFree86/nvidia-settings/

being unavailable. I solved this by downloading the archive from

http://http.download.nvidia.com/XFree86/nvidia-settings/

and placing it manually in /usr/portage/distfiles.

This archive is also available on github (https://github.com/NVIDIA/nvidia-settings/archive/381.09.tar.gz).

Maybe multiple sources for this tarball can be added to avoid a fetch failure when the ftp is unavailable?

Comment 2 Jonas Stein gentoo-dev

2017-04-30 17:27:13 UTC

works for me.
Please test again and reopen, if I missed the point.

/usr/portage/x11-drivers/nvidia-drivers$ ebuild nvidia-drivers-381.09.ebuild fetch

>>> Downloading 'http://us.download.nvidia.com/XFree86/Linux-x86_64/381.09/NVIDIA-Linux-x86_64-381.09.run'
--2017-04-30 19:25:04--  http://us.download.nvidia.com/XFree86/Linux-x86_64/381.09/NVIDIA-Linux-x86_64-381.09.run
Resolving us.download.nvidia.com... 192.229.221.58
Connecting to us.download.nvidia.com|192.229.221.58|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 78235493 (75M) [application/octet-stream]
Saving to: ‘/usr/portage/distfiles/NVIDIA-Linux-x86_64-381.09.run’

r/portage/distfiles  81%[===============>    ]  60.70M  1.93MB/s    eta 8s

Comment 3 Fin Christensen 2017-05-01 06:33:14 UTC

The download of the run file is working. What is failing is the download of the nvidia-settings tarball. I am located in Germany (Europe).

# ebuild nvidia-drivers-381.09.ebuild fetch
>>> Downloading 'http://us.download.nvidia.com/XFree86/Linux-x86_64/381.09/NVIDIA-Linux-x86_64-381.09.run'
--2017-05-01 08:29:18--  http://us.download.nvidia.com/XFree86/Linux-x86_64/381.09/NVIDIA-Linux-x86_64-381.09.run
Resolving us.download.nvidia.com... 192.229.221.58
Connecting to us.download.nvidia.com|192.229.221.58|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 78235493 (75M) [application/octet-stream]
Saving to: ‘/usr/portage/distfiles/NVIDIA-Linux-x86_64-381.09.run’

/usr/portage/distfiles/NVIDIA-Linux 100%[=================================================================>]  74.61M  4.45MB/s    in 22s     

2017-05-01 08:29:42 (3.34 MB/s) - ‘/usr/portage/distfiles/NVIDIA-Linux-x86_64-381.09.run’ saved [78235493/78235493]

 * NVIDIA-Linux-x86_64-381.09.run SHA256 SHA512 WHIRLPOOL size ;-) ...                                                                 [ ok ]
>>> Downloading 'ftp://download.nvidia.com/XFree86/nvidia-settings/nvidia-settings-381.09.tar.bz2'
--2017-05-01 08:29:42--  ftp://download.nvidia.com/XFree86/nvidia-settings/nvidia-settings-381.09.tar.bz2
           => ‘/usr/portage/distfiles/nvidia-settings-381.09.tar.bz2’
Resolving download.nvidia.com... 192.229.220.191
Connecting to download.nvidia.com|192.229.220.191|:21... failed: Connection timed out.
Retrying.

--2017-05-01 08:30:43--  ftp://download.nvidia.com/XFree86/nvidia-settings/nvidia-settings-381.09.tar.bz2
  (try: 2) => ‘/usr/portage/distfiles/nvidia-settings-381.09.tar.bz2’
Connecting to download.nvidia.com|192.229.220.191|:21... failed: Connection timed out.
Retrying.

--2017-05-01 08:31:45--  ftp://download.nvidia.com/XFree86/nvidia-settings/nvidia-settings-381.09.tar.bz2
  (try: 3) => ‘/usr/portage/distfiles/nvidia-settings-381.09.tar.bz2’
Connecting to download.nvidia.com|192.229.220.191|:21... failed: Connection timed out.
Giving up.

!!! Couldn't download 'nvidia-settings-381.09.tar.bz2'. Aborting.

Comment 4 Jeroen Roovers (RETIRED) gentoo-dev

2017-05-01 07:46:44 UTC

Please try again after syncing your tree. I have switched the nvidia-settings downloads to [1] which _should_ be available.


[1] http://us.download.nvidia.com/XFree86/nvidia-settings/ , e.g. http://us.download.nvidia.com/XFree86/nvidia-settings/nvidia-settings-381.09.tar.bz2

Comment 5 Fin Christensen 2017-05-01 12:10:57 UTC

(In reply to Jeroen Roovers from comment #4)
> Please try again after syncing your tree. I have switched the
> nvidia-settings downloads to [1] which _should_ be available.
> 
> 
> [1] http://us.download.nvidia.com/XFree86/nvidia-settings/ , e.g.
> http://us.download.nvidia.com/XFree86/nvidia-settings/nvidia-settings-381.09.
> tar.bz2

Now i get

# ebuild nvidia-drivers-381.09.ebuild fetch
 * NVIDIA-Linux-x86_64-381.09.run SHA256 SHA512 WHIRLPOOL size ;-) ...   [ ok ]
>>> Downloading 'http://us.download.nvidia.com/XFree86/nvidia-settings/nvidia-settings-381.09.tar.bz2'
--2017-05-01 14:09:01--  http://us.download.nvidia.com/XFree86/nvidia-settings/nvidia-settings-381.09.tar.bz2
Resolving us.download.nvidia.com... 192.229.221.58
Connecting to us.download.nvidia.com|192.229.221.58|:80... connected.
HTTP request sent, awaiting response... 404 Not Found
2017-05-01 14:09:02 ERROR 404: Not Found.

!!! Couldn't download 'nvidia-settings-381.09.tar.bz2'. Aborting.

Maybe the us.download.nvidia.com subdomain is not working in Europe...

For me http://http.download.nvidia.com/XFree86/nvidia-settings/nvidia-settings-381.09.tar.bz2 is working.

Comment 6 Sven 2017-05-01 22:31:50 UTC

Yeah, the new http-address for the nvidia-settings tarball is not working. Same problem here. After syncing, fetch fails with HTTP 404.

Comment 7 John Merchant 2017-05-02 01:42:12 UTC

(In reply to Jeroen Roovers from comment #4)
> Please try again after syncing your tree. I have switched the
> nvidia-settings downloads to [1] which _should_ be available.
> 
> 
> [1] http://us.download.nvidia.com/XFree86/nvidia-settings/ , e.g.
> http://us.download.nvidia.com/XFree86/nvidia-settings/nvidia-settings-381.09.
> tar.bz2

Attempting to fetch [1] fails for me, though I succeeded at fetching nvidia-settings from "http://http.download.nvidia.com/XFree86/nvidia-settings/nvidia-settings-381.09.tar.bz2" a moment ago.

Comment 8 Jeroen Roovers (RETIRED) gentoo-dev

2017-05-03 07:48:30 UTC

(In reply to Fin Christensen from comment #5)
> (In reply to Jeroen Roovers from comment #4)
> > Please try again after syncing your tree. I have switched the
> > nvidia-settings downloads to [1] which _should_ be available.
> > 
> > 
> > [1] http://us.download.nvidia.com/XFree86/nvidia-settings/ , e.g.
> > http://us.download.nvidia.com/XFree86/nvidia-settings/nvidia-settings-381.09.
> > tar.bz2
> 
> Now i get
> 
> # ebuild nvidia-drivers-381.09.ebuild fetch
>  * NVIDIA-Linux-x86_64-381.09.run SHA256 SHA512 WHIRLPOOL size ;-) ...   [
> ok ]
> >>> Downloading 'http://us.download.nvidia.com/XFree86/nvidia-settings/nvidia-settings-381.09.tar.bz2'
> --2017-05-01 14:09:01-- 
> http://us.download.nvidia.com/XFree86/nvidia-settings/nvidia-settings-381.09.
> tar.bz2
> Resolving us.download.nvidia.com... 192.229.221.58
> Connecting to us.download.nvidia.com|192.229.221.58|:80... connected.
> HTTP request sent, awaiting response... 404 Not Found
> 2017-05-01 14:09:02 ERROR 404: Not Found.
> 
> !!! Couldn't download 'nvidia-settings-381.09.tar.bz2'. Aborting.
> 
> Maybe the us.download.nvidia.com subdomain is not working in Europe...

I am in Europe.

Maybe it was working when I changed from FTP to HTTP, but it isn't now.

Comment 9 Jeroen Roovers (RETIRED) gentoo-dev

2017-05-03 07:56:21 UTC

commit f41d9628eae446301363c2ec84fc9c495d6ff4b6
Author: Jeroen Roovers <jer@gentoo.org>
Date:   Wed May 3 09:55:02 2017 +0200

    x11-drivers/nvidia-drivers: us.download.nvidia.com => http.download.nvidia.com (bug #617096 by Fin Christensen).

    Package-Manager: Portage-2.3.5, Repoman-2.3.2


Please try again.

Comment 10 kybi 2017-05-03 08:47:54 UTC

cd /usr/portage/distfiles

wget http://http.download.nvidia.com/XFree86/nvidia-settings/nvidia-settings-378.13.tar.bz2

Comment 11 Fin Christensen 2017-05-03 15:21:18 UTC

(In reply to Jeroen Roovers from comment #9)
> commit f41d9628eae446301363c2ec84fc9c495d6ff4b6
> Author: Jeroen Roovers <jer@gentoo.org>
> Date:   Wed May 3 09:55:02 2017 +0200
> 
>     x11-drivers/nvidia-drivers: us.download.nvidia.com =>
> http.download.nvidia.com (bug #617096 by Fin Christensen).
> 
>     Package-Manager: Portage-2.3.5, Repoman-2.3.2
> 
> 
> Please try again.

# ebuild nvidia-drivers-381.09.ebuild fetch
 * NVIDIA-Linux-x86_64-381.09.run SHA256 SHA512 WHIRLPOOL size ;-) ...   [ ok ]
>>> Downloading 'http://http.download.nvidia.com/XFree86/nvidia-settings/nvidia-settings-381.09.tar.bz2'
--2017-05-03 17:20:23--  http://http.download.nvidia.com/XFree86/nvidia-settings/nvidia-settings-381.09.tar.bz2
Resolving http.download.nvidia.com... 192.229.221.58, 2606:2800:233:ef6:15dd:1ece:1d50:1e1
Connecting to http.download.nvidia.com|192.229.221.58|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 1629331 (1.6M) [application/x-bzip]
Saving to: ‘/usr/portage/distfiles/nvidia-settings-381.09.tar.bz2’

/usr/portage/distfi 100%[===================>]   1.55M  2.88MB/s    in 0.5s    

2017-05-03 17:20:24 (2.88 MB/s) - ‘/usr/portage/distfiles/nvidia-settings-381.09.tar.bz2’ saved [1629331/1629331]

 * nvidia-settings-381.09.tar.bz2 SHA256 SHA512 WHIRLPOOL size ;-) ...   [ ok ]


It's working now. Thanks!

Comment 12 Coacher 2017-05-04 11:09:41 UTC

*** Bug 617270 has been marked as a duplicate of this bug. ***

Comment 13 Thomas Kemmer 2017-05-11 13:55:42 UTC

The same problem reappeared in the new ebuild for 381.22 (downloading from Europe):

Downloading 'http://us.download.nvidia.com/XFree86/nvidia-settings/nvidia-settings-381.22.tar.bz2'
--2017-05-11 11:14:31--  http://us.download.nvidia.com/XFree86/nvidia-settings/nvidia-settings-381.22.tar.bz2
Resolving us.download.nvidia.com... 192.229.221.58, 2606:2800:233:ef6:15dd:1ece:1d50:1e1
Connecting to us.download.nvidia.com|192.229.221.58|:80... connected.
HTTP request sent, awaiting response... 404 Not Found
2017-05-11 11:14:31 ERROR 404: Not Found.

PR: https://github.com/gentoo/gentoo/pull/4605

Comment 14 Jeroen Roovers (RETIRED) gentoo-dev

2017-05-11 14:01:13 UTC

(In reply to niniel from comment #13)
> The same problem reappeared in the new ebuild for 381.22 (downloading from
> Europe):

File a new bug report.