dev-libs/openssl-1.0.0a-r3 (that is going stable right now) currently fails fetch step, as the URL http://cvs.pld-linux.org/cgi-bin/cvsweb.cgi/~checkout~/packages/openssl/openssl-c_rehash.sh?rev=1.7 is not reachable. I've tried to reach it via different network paths, and I'm always getting one of these errors: Connecting to cvs.pld-linux.org|217.73.31.16|:80... failed: Connection timed out. Connecting to cvs.pld-linux.org|217.73.31.16|:80... failed: Network is unreachable. It seems that the web server failed (heavy traffic?). The server will eventually come back up, but I suggest putting that file (versioned someway?) in $FILESDIR instead.
emerge --info, please. Specifically, GENTOO_MIRRORS
$ emerge --info | grep GENTOO_MIRRORS GENTOO_MIRRORS="http://mirror.ovh.net/gentoo-distfiles/" But I've tried on other mirrors and the file is not available as well.
Looks there to me! http://mirror.ovh.net/gentoo-distfiles/distfiles/openssl-c_rehash.sh%3frev=1.7 http://mirrors.kernel.org/gentoo/distfiles/openssl-c_rehash.sh%3frev=1.7 and etc. So, is the "?" mark making life difficult here?
Hmm... interesting. Maybe different Portage versions escape '?' differently (mine does not). Attaching whole emerge --info now.
(forgot it, sorry for the spam :) ) $ emerge --info Portage 2.2_rc88 (default/linux/amd64/10.0/desktop, gcc-4.4.3, glibc-2.11.2-r0, 2.6.34-gentoo-r10 x86_64) ================================================================= System uname: Linux-2.6.34-gentoo-r10-x86_64-Intel-R-_Core-TM-2_Duo_CPU_T7700_@_2.40GHz-with-gentoo-1.12.13 Timestamp of tree: Tue, 28 Sep 2010 11:45:01 +0000 app-shells/bash: 4.0_p37 dev-java/java-config: 2.1.11 dev-lang/python: 2.6.5-r3, 3.1.2-r4 dev-util/cmake: 2.8.1-r2 sys-apps/baselayout: 1.12.13 sys-apps/sandbox: 2.3-r1 sys-devel/autoconf: 2.65-r1 sys-devel/automake: 1.9.6-r3, 1.10.3, 1.11.1 sys-devel/binutils: 2.20.1-r1 sys-devel/gcc: 4.4.3-r2 sys-devel/gcc-config: 1.4.1 sys-devel/libtool: 2.2.10 sys-devel/make: 3.81-r2 virtual/os-headers: 2.6.30-r1 (sys-kernel/linux-headers) ACCEPT_KEYWORDS="amd64" ACCEPT_LICENSE="* -@EULA dlj-1.1 skype-eula PUEL AdobeFlash-10.1" CBUILD="x86_64-pc-linux-gnu" CFLAGS="-O2 -pipe -march=native" CHOST="x86_64-pc-linux-gnu" CONFIG_PROTECT="/etc /usr/share/X11/xkb" CONFIG_PROTECT_MASK="/etc/ca-certificates.conf /etc/env.d /etc/env.d/java/ /etc/fonts/fonts.conf /etc/gconf /etc/revdep-rebuild /etc/sandbox.d /etc/terminfo /etc/texmf/language.dat.d /etc/texmf/language.def.d /etc/texmf/updmap.d /etc/texmf/web2c" CXXFLAGS="-O2 -pipe -march=native" DISTDIR="/usr/portage/distfiles" EMERGE_DEFAULT_OPTS="--tree --keep-going --ask-enter-invalid" FEATURES="assume-digests binpkg-logs candy distlocks fixlafiles fixpackages news parallel-fetch preserve-libs protect-owned sandbox sfperms strict unknown-features-warn unmerge-logs unmerge-orphans userfetch userpriv usersandbox" GENTOO_MIRRORS="http://mirror.ovh.net/gentoo-distfiles/" LANG="it_IT.UTF-8" LC_ALL="it_IT.UTF-8" LDFLAGS="-Wl,-O1 -Wl,--as-needed" LINGUAS="it en" MAKEOPTS="-j3" PKGDIR="/usr/portage/packages" PORTAGE_CONFIGROOT="/" PORTAGE_RSYNC_OPTS="--recursive --links --safe-links --perms --times --compress --force --whole-file --delete --stats --timeout=180 --exclude=/distfiles --exclude=/local --exclude=/packages" PORTAGE_TMPDIR="/var/tmp" PORTDIR="/usr/portage" PORTDIR_OVERLAY="/usr/local/portage/layman/sunrise /usr/local/portage/dark" SYNC="rsync://rsync.europe.gentoo.org/gentoo-portage" USE="X a52 aac acpi alsa amd64 bash-completion bluetooth branding bzip2 cairo cdr cli cracklib crypt cups cxx dbus dell dri dts dvd dvdr emacs encode exif flac fortran fortune gdbm gif git gpm gtk hal iconv ipv6 java jpeg laptop lcms ldap libnotify mad mikmod mmx mng modules mp3 mp4 mpeg mudflap multilib ncurses nfs nls nptl nptlonly ntp ogg opengl openmp pam pango pcre pdf perl png ppds python qt3support qt4 readline samba sdl session smp spell sse sse2 ssl startup-notification subversion svg sysfs tcpd threads thunar tiff truetype unicode usb vdpau vorbis x264 xcb xml xorg xv xvid zlib" ALSA_CARDS="intel8x0" ALSA_PCM_PLUGINS="adpcm alaw asym copy dmix dshare dsnoop empty extplug file hooks iec958 ioplug ladspa lfloat linear meter mmap_emul mulaw multi null plug rate route share shm softvol" APACHE2_MODULES="actions alias auth_basic authn_alias authn_anon authn_dbm authn_default authn_file authz_dbm authz_default authz_groupfile authz_host authz_owner authz_user autoindex cache cgi cgid dav dav_fs dav_lock deflate dir disk_cache env expires ext_filter file_cache filter headers include info log_config logio mem_cache mime mime_magic negotiation rewrite setenvif speling status unique_id userdir usertrack vhost_alias" ELIBC="glibc" GPSD_PROTOCOLS="ashtech aivdm earthmate evermore fv18 garmin garmintxt gpsclock itrax mtk3301 nmea ntrip navcom oceanserver oldstyle oncore rtcm104v2 rtcm104v3 sirf superstar2 timing tsip tripmate tnt ubx" INPUT_DEVICES="keyboard mouse synaptics evdev" KERNEL="linux" LCD_DEVICES="bayrad cfontz cfontz633 glk hd44780 lb216 lcdm001 mtxorb ncurses text" LINGUAS="it en" RUBY_TARGETS="ruby18" USERLAND="GNU" VIDEO_CARDS="nvidia vesa fbdev" XTABLES_ADDONS="quota2 psd pknock lscan length2 ipv4options ipset ipp2p iface geoip fuzzy condition tee tarpit sysrq steal rawnat logmark ipmark dhcpmac delude chaos account" Unset: CPPFLAGS, CTARGET, FFLAGS, INSTALL_MASK, PORTAGE_BUNZIP2_COMMAND, PORTAGE_COMPRESS, PORTAGE_COMPRESS_FLAGS, PORTAGE_RSYNC_EXTRA_OPTS
Nah, it is more of a http protocol issue than a portage issue. I suspect. I'll mark this as a blocker to the stablereq and the base-system team will have to change the SRC_URI to a "src_uri arrow" or something else.
Same problem here. Seems cvs.pld-linux.org is down at this time. I'm curious why a copy of this file is not put on distfiles.gentoo.org, but we're downloading from a server belonging to another distro?
Fixed, based on chatting with Samuli. + 28 Sep 2010; Jeremy Olexa <darkside@gentoo.org> openssl-1.0.0a-r3.ebuild, + +files/openssl-c_rehash.sh-rev-1.7: + QA: Fix SRC_URI of c_rehash and move it to FILESDIR, bug 339027
uhh, no. if there is a problem with SRC_URI parsing, then the PM needs to be fixed and/or the spec updated. simply ignoring the problem fixes nothing.
(In reply to comment #9) > uhh, no. if there is a problem with SRC_URI parsing, then the PM needs to be > fixed and/or the spec updated. simply ignoring the problem fixes nothing. > Sure, ok. The problem was rather urgent as it was broken in stable. Fix as you wish, but please make sure the stable version of portage can handle "?" when http returns %3f instead, or whatever the specific problem may be. Thanks.
(In reply to comment #8) > Fixed, based on chatting with Samuli. > > + 28 Sep 2010; Jeremy Olexa <darkside@gentoo.org> openssl-1.0.0a-r3.ebuild, > + +files/openssl-c_rehash.sh-rev-1.7: > + QA: Fix SRC_URI of c_rehash and move it to FILESDIR, bug 339027 > An alternative "hotfix" would have been to s/?/%3f/ in SRC_URI of openssl-1.0.0a-r3.ebuild.
changing the SRC_URI from "?" to "%3f" is a better workaround. please revert your earlier changes and use that. back to the original report ... i think you're reading it incorrectly. stable portage has no problem fetching files with "?" in their file names. i know because ive done it already on my stable systems. the problem is that some websites return 404 when given characters that have not be encoded into their %XX equivalents. so the question comes back to who is responsible for the encoding: the PM or the developer. in the latter case, repoman would need updating to catch this, but that sounds like a long term bandaid. it would make more sense imo to have the PMS specify that the PM is responsible for encoding the URLs in SRC_URI such that it conforms to RFC 1738.
(In reply to comment #12) > changing the SRC_URI from "?" to "%3f" is a better workaround. please revert > your earlier changes and use that. done. > back to the original report ... i think you're reading it incorrectly. stable > portage has no problem fetching files with "?" in their file names. i know > because ive done it already on my stable systems. the problem is that some > websites return 404 when given characters that have not be encoded into their > %XX equivalents. Nah, I was reading it correctly but incorrectly assumed that *all* httpd's returned 404 for non converted chars. I see that is incorrect now. > so the question comes back to who is responsible for the encoding: the PM or > the developer. in the latter case, repoman would need updating to catch this, > but that sounds like a long term bandaid. it would make more sense imo to have > the PMS specify that the PM is responsible for encoding the URLs in SRC_URI > such that it conforms to RFC 1738. I agree here. I think the "easiest" or best would be for PMS to specify that the PM must convert any non-converted char before making the fetch request. But there may be edge cases that I am not thinking of. My theory is that we should take the human-error out of the system.
ok, ill close this in favor of the new PMS bug 339051
I was going to comment here, but I'll move my words in the newly opened bug :)
*** Bug 339131 has been marked as a duplicate of this bug. ***
*** Bug 339170 has been marked as a duplicate of this bug. ***
Not fixed (as of 30/09/2010 15:33cest). This is the last ChangeLog entry here: 28 Sep 2010; Jeremy Olexa <darkside@gentoo.org> openssl-1.0.0a-r3.ebuild, -files/openssl-c_rehash.sh-rev-1.7: Revert revision 1.8 and just modify the SRC_URI to the converted character instead for bug 339027 >>> Emerging (7 of 11) dev-libs/openssl-1.0.0a-r3 * openssl-1.0.0a.tar.gz RMD160 SHA1 SHA256 size ;-) ... [ ok ] >>> Downloading 'http://distfiles.gentoo.org/distfiles/openssl-c_rehash.sh%3frev=1.7' --2010-09-30 15:03:58-- http://distfiles.gentoo.org/distfiles/openssl-c_rehash.sh%3frev=1.7 Auflösen des Hostnamen »distfiles.gentoo.org«.... 130.239.17.6, 140.211.166.134, 149.20.20.135, ... Verbindungsaufbau zu distfiles.gentoo.org|130.239.17.6|:80... verbunden. HTTP Anforderung gesendet, warte auf Antwort... 302 Found Platz: http://mirrors.kernel.org/gentoo/distfiles/openssl-c_rehash.sh?rev=1.7[folge] --2010-09-30 15:03:58-- http://mirrors.kernel.org/gentoo/distfiles/openssl-c_rehash.sh?rev=1.7 Auflösen des Hostnamen »mirrors.kernel.org«.... 130.239.17.6, 199.6.1.174 Wiederverwendung der bestehenden Verbindung zu distfiles.gentoo.org:80. HTTP Anforderung gesendet, warte auf Antwort... 404 Not Found 2010-09-30 15:03:58 FEHLER 404: Not Found. >>> Downloading 'http://cvs.pld-linux.org/cgi-bin/cvsweb.cgi/~checkout~/packages/openssl/openssl-c_rehash.sh%3frev=1.7' --2010-09-30 15:03:58-- http://cvs.pld-linux.org/cgi-bin/cvsweb.cgi/~checkout~/packages/openssl/openssl-c_rehash.sh%3frev=1.7 Auflösen des Hostnamen »cvs.pld-linux.org«.... 217.73.31.16, 2a01:390:a:0:216:3eff:fe00:1909 Verbindungsaufbau zu cvs.pld-linux.org|217.73.31.16|:80... verbunden. HTTP Anforderung gesendet, warte auf Antwort... 404 Not Found 2010-09-30 15:03:59 FEHLER 404: Not Found. !!! Couldn't download 'openssl-c_rehash.sh%3frev=1.7'. Aborting. * Fetch failed for 'dev-libs/openssl-1.0.0a-r3', Log file: * '/opt/virtual/tmp-portage/portage/dev-libs/openssl-1.0.0a-r3/temp/build.log' grenadine ~ # emerge --info Portage 2.1.9.12 (default/linux/amd64/10.0/desktop/kde, gcc-4.4.3, glibc-2.11.2-r0, 2.6.34-gentoo-r10 x86_64) ================================================================= System uname: Linux-2.6.34-gentoo-r10-x86_64-Intel-R-_Core-TM-2_Duo_CPU_E8400_@_3.00GHz-with-gentoo-1.12.13 Timestamp of tree: Thu, 30 Sep 2010 12:30:01 +0000 app-shells/bash: 4.0_p37 dev-java/java-config: 2.1.11 dev-lang/python: 2.6.5-r3, 3.1.2-r4 dev-util/cmake: 2.8.1-r2 sys-apps/baselayout: 1.12.13 sys-apps/sandbox: 2.3-r1 sys-devel/autoconf: 2.13, 2.65-r1 sys-devel/automake: 1.9.6-r3, 1.10.3, 1.11.1 sys-devel/binutils: 2.20.1-r1 sys-devel/gcc: 4.4.3-r2 sys-devel/gcc-config: 1.4.1 sys-devel/libtool: 2.2.10 sys-devel/make: 3.81-r2 virtual/os-headers: 2.6.30-r1 (sys-kernel/linux-headers) ACCEPT_KEYWORDS="amd64" ACCEPT_LICENSE="*" CBUILD="x86_64-pc-linux-gnu" CFLAGS="-march=native -O2 -pipe -ggdb" CHOST="x86_64-pc-linux-gnu" CONFIG_PROTECT="/etc /usr/share/X11/xkb /usr/share/config /var/lib/hsqldb" CONFIG_PROTECT_MASK="/etc/ca-certificates.conf /etc/env.d /etc/env.d/java/ /etc/fonts/fonts.conf /etc/gconf /etc/php/apache2-php5/ext-active/ /etc/php/cgi-php5/ext-active/ /etc/php/cli-php5/ext-active/ /etc/revdep-rebuild /etc/sandbox.d /etc/terminfo /etc/texmf/language.dat.d /etc/texmf/language.def.d /etc/texmf/updmap.d /etc/texmf/web2c" CXXFLAGS="-march=native -O2 -pipe -ggdb" DISTDIR="/usr/portage/distfiles" FEATURES="assume-digests binpkg-logs distlocks fixlafiles fixpackages news parallel-fetch protect-owned sandbox sfperms splitdebug strict unknown-features-warn unmerge-logs unmerge-orphans userfetch userpriv usersandbox" GENTOO_MIRRORS="http://distfiles.gentoo.org" LANG="de_DE.UTF-8" LDFLAGS="-Wl,-O1 -Wl,--as-needed" LINGUAS="de en" MAKEOPTS="-j3" PKGDIR="/usr/portage/packages" PORTAGE_CONFIGROOT="/" PORTAGE_RSYNC_OPTS="--recursive --links --safe-links --perms --times --compress --force --whole-file --delete --stats --timeout=180 --exclude=/distfiles --exclude=/local --exclude=/packages" PORTAGE_TMPDIR="/opt/virtual/tmp-portage" PORTDIR="/usr/portage" PORTDIR_OVERLAY="/usr/portage/local/layman/n4g /usr/local/portage/dilfridge-private /usr/local/portage/dilfridge /usr/local/portage/kde /usr/local/portage/sci /usr/local/portage/vmware" SYNC="rsync://rsync.gentoo.org/gentoo-portage" USE="64bit X a52 aac accessibility acpi akonadi alsa amd64 animgif apache2 audiofile bash-completion berkdb binfilter boost branding bzip2 cairo cdaudio cdda cddax cddb cdparanoia cdr chm cisco cli cmake consolekit corefonts cracklib crypt css cups cupsddk curl cvs cxx dbus detex djvu dnotify dri dts dvd dvdr dvipdfm embedded emboss emf encode enscript exif expat extra fam ffmpeg firefox flac foomatic foomaticdb fortran gcj gd gdbm gif git glitz gnuplot gpm gps graphics groupwise gstreamer gtk hal hpcups hpijs hybrid-auth iconv id3 id3tag imagemagick imap inotify ipv6 jadetex java java6 jpeg jpeg2k kde kontact kpathsea lame lasi latex lcms ldap libnotify lm_sensors lzma mad math mbox mikmod mime mmx mng modules mp3 mp4 mpeg mplayer mudflap multilib mysql ncurses networking nls nptl nptlonly nsplugin ogg opengl openmp pam pango pcre pdf perl phonon php player plotutils pmount png policykit postscript povray ppds pppd ps pstoedit publishers pulseaudio python qt3support qt4 quicktime rdesktop readline reflection rss ruby samba sasl science sdl semantic-desktop session sftp skype smp spell sql sqlite sse sse2 ssl ssse3 startup-notification subtitles subversion svg sysfs syslog tcpd theora tiff tk truetype unicode usb vnc vorbis webdav webdav-neon webkit wmf wpd wv2 x264 xcb xcomposite xetex xine xml xmp xorg xpm xscreensaver xulrunner xv xvid xvmc zip zlib" ALSA_CARDS="ali5451 als4000 atiixp atiixp-modem bt87x ca0106 cmipci emu10k1x ens1370 ens1371 es1938 es1968 fm801 hda-intel intel8x0 intel8x0m maestro3 trident usb-audio via82xx via82xx-modem ymfpci" ALSA_PCM_PLUGINS="adpcm alaw asym copy dmix dshare dsnoop empty extplug file hooks iec958 ioplug ladspa lfloat linear meter mmap_emul mulaw multi null plug rate route share shm softvol" APACHE2_MODULES="actions alias auth_basic authn_alias authn_anon authn_dbm authn_default authn_file authz_dbm authz_default authz_groupfile authz_host authz_owner authz_user autoindex cache cgi cgid dav dav_fs dav_lock deflate dir disk_cache env expires ext_filter file_cache filter headers include info log_config logio mem_cache mime mime_magic negotiation rewrite setenvif speling status unique_id userdir usertrack vhost_alias" COLLECTD_PLUGINS="cpu df fscache hddtemp interface iptables irq load memory network ntpd processes rrdcached rrdtool sensors swap syslog thermal uptime users apache" ELIBC="glibc" GPSD_PROTOCOLS="ashtech aivdm earthmate evermore fv18 garmin garmintxt gpsclock itrax mtk3301 nmea ntrip navcom oceanserver oldstyle oncore rtcm104v2 rtcm104v3 sirf superstar2 timing tsip tripmate tnt ubx" INPUT_DEVICES="keyboard mouse evdev" KERNEL="linux" LCD_DEVICES="bayrad cfontz cfontz633 glk hd44780 lb216 lcdm001 mtxorb ncurses text" LINGUAS="de en" RUBY_TARGETS="ruby18" USERLAND="GNU" VIDEO_CARDS="ati radeon vesa radeonhd" XTABLES_ADDONS="quota2 psd pknock lscan length2 ipv4options ipset ipp2p iface geoip fuzzy condition tee tarpit sysrq steal rawnat logmark ipmark dhcpmac delude chaos account" Unset: CPPFLAGS, CTARGET, EMERGE_DEFAULT_OPTS, FFLAGS, INSTALL_MASK, LC_ALL, PORTAGE_BUNZIP2_COMMAND, PORTAGE_COMPRESS, PORTAGE_COMPRESS_FLAGS, PORTAGE_RSYNC_EXTRA_OPTS grenadine ~ #
http://gentoo.osuosl.org/distfiles/ has the file, but mirrors.kernel.org doesn't. I'm not sure why this is happening now.
Again, mirrors.kernel.org has it: http://mirrors.kernel.org/gentoo/distfiles/openssl-c_rehash.sh%3frev=1.7 The problem lies in the HTTP "302 Found" redirection, that unescapes the '?' character (at least in that implementation, I don't know what the RFC says :) ).
Created attachment 249098 [details, diff] EAPI2 Convert to EAPI2 and use arrows for sane filename. I'll attach a patch too. This is full ebuild for users or whatnot.
Created attachment 249099 [details, diff] EAPI2 Patch from current.
I would have expected base-system to act on this showstopper by now. At any case, since cvs.pld-linux.org is back up...I've reverted back to the *original* SRC_URI value. It won't be proper until the ebuild is changed to EAPI2 or the file is moved to FILESDIR. Lesson learned: Don't use '?' in the filename to be mirrored. + 02 Oct 2010; Jeremy Olexa <darkside@gentoo.org> openssl-1.0.0a-r3.ebuild: + Silly issue, revert to original SRC_URI so users can fetch the file. bug + 339027
> cp "${DISTDIR}"/openssl-c_rehash.sh* "${WORKDIR}"/c_rehash || die This change broke paludis package managed (it does not symlink $A to separate dir and exports ${DISTDIR}). I have such things in $DISTDIR: $ ls /mnt/archive/distfiles/*c_rehash* /mnt/archive/distfiles/openssl-c_rehash.sh%3frev=1.7 /mnt/archive/distfiles/openssl-c_rehash.sh?rev=1.7 and get the breakage: >>> Unpacking openssl-1.0.0a.tar.gz to /var/tmp/paludis/dev-libs-openssl-1.0.0a-r3/work tar zxf /mnt/archive/distfiles/openssl-1.0.0a.tar.gz --no-same-owner Error: * In program cave perform install --hooks --managed-output --output-exclusivity with-others =dev-libs/openssl-1.0.0a-r3:0::gentoo --destination installed --replacing =dev-libs/openssl-0.9.8o:0::installed --x-of-y 1 of 1: * When installing 'dev-libs/openssl-1.0.0a-r3:0::gentoo' replacing { 'dev-libs/openssl-0.9.8o:0::installed' }: * When running an ebuild command on 'dev-libs/openssl-1.0.0a-r3:0::gentoo': * Install failed for 'dev-libs/openssl-1.0.0a-r3:0::gentoo' (paludis::ActionFailedError) cp: target `/var/tmp/paludis/dev-libs-openssl-1.0.0a-r3/work/c_rehash' is not a directory
I can confirm the Paludis breakage. Thanks, Jason
the change really isnt the cause of the breakage ive tweaked Samuli's change and merged it
