Currently my workstation has web access via proxy server (squid) with basic auth. Using emerge-webrsync fails without any error message info. At the time, where it should be. Overwriting in /etc/make.conf default values of FETCHCOMMAND and RESUMECOMMAND variables adding --proxy-user and --proxy-password options make emerge-webrsync operates normally. Reproducible: Always Steps to Reproduce: 1. Set up web access via proxy-server using basic auth mech; 2. Try to sync portage tree over proxy using emerge-webrsync utility. Actual Results: # emerge-webrsync Fetching most recent snapshot ... Trying to retrieve 20110426 snapshot from http://mirror.yandex.ru/gentoo-distfiles/ ... Fetching file portage-20110426.tar.xz.md5sum ... Fetching file portage-20110426.tar.lzma.md5sum ... Fetching file portage-20110426.tar.bz2.md5sum ... Fetching file portage-20110426.tar.gz.md5sum ... Trying to retrieve 20110426 snapshot from ftp://mirror.yandex.ru/gentoo-distfiles/ ... Fetching file portage-20110426.tar.xz.md5sum ... Fetching file portage-20110426.tar.lzma.md5sum ... Fetching file portage-20110426.tar.bz2.md5sum ... Fetching file portage-20110426.tar.gz.md5sum ... Trying to retrieve 20110426 snapshot from http://ftp.chg.ru/pub/Linux/distributions/gentoo/ ... Fetching file portage-20110426.tar.xz.md5sum ... Fetching file portage-20110426.tar.lzma.md5sum ... Fetching file portage-20110426.tar.bz2.md5sum ... Fetching file portage-20110426.tar.gz.md5sum ... Trying to retrieve 20110426 snapshot from ftp://ftp.chg.ru/pub/Linux/distributions/gentoo/ ... Fetching file portage-20110426.tar.xz.md5sum ... Fetching file portage-20110426.tar.lzma.md5sum ... Fetching file portage-20110426.tar.bz2.md5sum ... Fetching file portage-20110426.tar.gz.md5sum ... Trying to retrieve 20110426 snapshot from http://ftp.corbina.net/pub/Linux/gentoo/ ... Fetching file portage-20110426.tar.xz.md5sum ... Fetching file portage-20110426.tar.lzma.md5sum ... Fetching file portage-20110426.tar.bz2.md5sum ... Fetching file portage-20110426.tar.gz.md5sum ... Trying to retrieve 20110426 snapshot from ftp://ftp.corbina.net/pub/Linux/gentoo/ ... Fetching file portage-20110426.tar.xz.md5sum ... Fetching file portage-20110426.tar.lzma.md5sum ... Fetching file portage-20110426.tar.bz2.md5sum ... Fetching file portage-20110426.tar.gz.md5sum ... 20110426 snapshot was not found * Latest snapshot date: 20110425 * * Approximate snapshot timestamp: 1303782300 * Current local timestamp: 1303778101 * * The current local timestamp is possibly identical to the * timestamp of the latest snapshot. In order to force sync, use * the --revert option or remove the timestamp file located at * '/usr/portage/metadata/timestamp.x'. Expected Results: # emerge-webrsync Fetching most recent snapshot ... Trying to retrieve 20110426 snapshot from http://mirror.yandex.ru/gentoo-distfiles/ ... Fetching file portage-20110426.tar.xz.md5sum ... Устанавливается соединение с proxy.mydomain.ru:8080... соединение установлено. Запрос Proxy послан, ожидается ответ... 407 Proxy Authentication Required 2011-04-27 09:46:46 ОШИБКА 407: Proxy Authentication Required. * Fetch failed (and perhaps some other additional info) # equery b `which emerge-webrsync` [ Searching for file(s) /usr/sbin/emerge-webrsync in *... ] sys-apps/portage-2.1.9.42 (/usr/sbin/emerge-webrsync -> ../lib/portage/bin/emerge-webrsync) # emerge --info Portage 2.1.9.42 (default/linux/x86/10.0, gcc-4.4.5, libc-0-r0, 2.6.36-gentoo-r5 i686) ================================================================= System uname: Linux-2.6.36-gentoo-r5-i686-Intel-R-_Pentium-R-_4_CPU_3.00GHz-with-gentoo-1.12.14 Timestamp of tree: Tue, 26 Apr 2011 00:45:01 +0000 app-shells/bash: 4.1_p9 dev-java/java-config: 2.1.11-r3 dev-lang/python: 2.7.1-r1, 3.1.3-r1 dev-util/cmake: 2.8.1-r2 sys-apps/baselayout: 1.12.14-r1 sys-apps/sandbox: 2.4 sys-devel/autoconf: 2.13, 2.65-r1 sys-devel/automake: 1.10.3, 1.11.1 sys-devel/binutils: 2.20.1-r1 sys-devel/gcc: 4.4.5 sys-devel/gcc-config: 1.4.1 sys-devel/libtool: 2.2.10 sys-devel/make: 3.81-r2 sys-kernel/linux-headers: 2.6.36.1 virtual/os-headers: 0 ACCEPT_KEYWORDS="x86" ACCEPT_LICENSE="* -@EULA" CBUILD="i686-pc-linux-gnu" CFLAGS="-O2 -march=native -pipe" CHOST="i686-pc-linux-gnu" CONFIG_PROTECT="/etc /etc/env.d/50glib2 /usr/share/gnupg/qualified.txt /var/bind" CONFIG_PROTECT_MASK="/etc/ca-certificates.conf /etc/env.d /etc/env.d/java/ /etc/fonts/fonts.conf /etc/gconf /etc/php/apache2-php5.2/ext-active/ /etc/php/cgi-php5.2/ext-active/ /etc/php/cli-php5.2/ext-active/ /etc/revdep-rebuild /etc/sandbox.d /etc/terminfo /etc/texmf/language.dat.d /etc/texmf/language.def.d /etc/texmf/updmap.d /etc/texmf/web2c" CXXFLAGS="-O2 -march=native -pipe" DISTDIR="/usr/portage/distfiles" FEATURES="assume-digests binpkg-logs buildsyspkg collision-protect distlocks fixlafiles fixpackages news parallel-fetch protect-owned sandbox sfperms strict unknown-features-warn unmerge-logs unmerge-orphans userfetch" FFLAGS="" GENTOO_MIRRORS="http://mirror.yandex.ru/gentoo-distfiles/ ftp://mirror.yandex.ru/gentoo-distfiles/ http://ftp.chg.ru/pub/Linux/distributions/gentoo/ ftp://ftp.chg.ru/pub/Linux/distributions/gentoo/ http://ftp.corbina.net/pub/Linux/gentoo/ ftp://ftp.corbina.net/pub/Linux/gentoo/" LANG="ru_RU.KOI8-R" LC_ALL="" LDFLAGS="-Wl,-O1 -Wl,--as-needed" LINGUAS="ru en" MAKEOPTS="-j2" PKGDIR="/usr/portage/packages" PORTAGE_CONFIGROOT="/" PORTAGE_RSYNC_OPTS="--recursive --links --safe-links --perms --times --compress --force --whole-file --delete --stats --timeout=180 --exclude=/distfiles --exclude=/local --exclude=/packages" PORTAGE_TMPDIR="/var/tmp" PORTDIR="/usr/portage" PORTDIR_OVERLAY="/var/lib/layman/rion /usr/local/portage" SYNC="rsync://rsync.gentoo.org/gentoo-portage" USE="X a52 ac3 acl alsa avi berkdb bold bzip2 cdr cli cracklib crypt cups cxx dbus djvu dri dvd flac fortran gdbm gif gtk iconv jpeg jpeg2k modules mp3 mudflap ncurses nls nptl nptlonly ogg openmp pam pcre pdf perl png pppd python qt3support readline session ssl sysfs tcpd tiff unicode utf8 vorbis x86 xcb xorg xulrunner zlib" ALSA_CARDS="intel8x0" ALSA_PCM_PLUGINS="adpcm alaw asym copy dmix dshare dsnoop empty extplug file hooks iec958 ioplug ladspa lfloat linear meter mmap_emul mulaw multi null plug rate route share shm softvol" APACHE2_MODULES="actions alias auth_basic authn_alias authn_anon authn_dbm authn_default authn_file authz_dbm authz_default authz_groupfile authz_host authz_owner authz_user autoindex cache cgi cgid dav dav_fs dav_lock deflate dir disk_cache env expires ext_filter file_cache filter headers include info log_config logio mem_cache mime mime_magic negotiation rewrite setenvif speling status unique_id userdir usertrack vhost_alias" CAMERAS="ptp2" COLLECTD_PLUGINS="df interface irq load memory rrdtool swap syslog" ELIBC="glibc" GPSD_PROTOCOLS="ashtech aivdm earthmate evermore fv18 garmin garmintxt gpsclock itrax mtk3301 nmea ntrip navcom oceanserver oldstyle oncore rtcm104v2 rtcm104v3 sirf superstar2 timing tsip tripmate tnt ubx" INPUT_DEVICES="keyboard mouse" KERNEL="linux" LCD_DEVICES="bayrad cfontz cfontz633 glk hd44780 lb216 lcdm001 mtxorb ncurses text" LINGUAS="ru en" PHP_TARGETS="php5-3" RUBY_TARGETS="ruby18" USERLAND="GNU" VIDEO_CARDS="sis" XTABLES_ADDONS="quota2 psd pknock lscan length2 ipv4options ipset ipp2p iface geoip fuzzy condition tee tarpit sysrq steal rawnat logmark ipmark dhcpmac delude chaos account" Unset: CPPFLAGS, CTARGET, EMERGE_DEFAULT_OPTS, INSTALL_MASK, PORTAGE_BUNZIP2_COMMAND, PORTAGE_COMPRESS, PORTAGE_COMPRESS_FLAGS, PORTAGE_RSYNC_EXTRA_OPTS
You could ask to get bug #104547 reopened. *** This bug has been marked as a duplicate of bug 104547 ***
I disagree with marking this bug as duplicate of 104547. 104547 is enchancement request for proxy in general. This bug is about that emerge-webrsync fetch portage archive function (unlike distfiles fetch) incorrectly handles proxy error codes (or doesn't handle them at all) in the case with usind squid proxy server with authorized (basic mech is used) web access. This bug is not enchancement request, it's the issue report!
(In reply to comment #0) > Overwriting in /etc/make.conf default values of FETCHCOMMAND and RESUMECOMMAND > variables adding --proxy-user and --proxy-password options make emerge-webrsync > operates normally. That seems like a reasonable solution. So, doesn't that solve your problem?
(In reply to comment #3) > (In reply to comment #0) > > Overwriting in /etc/make.conf default values of FETCHCOMMAND and RESUMECOMMAND > > variables adding --proxy-user and --proxy-password options make emerge-webrsync > > operates normally. > > That seems like a reasonable solution. So, doesn't that solve your problem? It not seems, it is the solution of the issue in the part of _operability_. :) But the bug is not about portage operability (it works fine ;) ), it's about handling and reporting errors (I've rememebered that it's a time to redefine FETCHCOMMAND and RESUMECOMMAND variables only after reading emerge error while trying to install app-portage/emerge-delta-webrsync, not error message of emerge-webrsync). Normally emerge-webrsync should provide error message similiar with emerge.
The thing is, in order for FETCHCOMMAND and RESUMECOMMAND to be useful, portage needs to make as little assumptions about them as possible. It's not really feasible to make assumptions about error codes, since we don't want to assume that FETCHCOMMAND calls wget rather than curl or whatnot. So, I think the best that we can do allow the message from FETCHCOMMAND to pass through. Looking at the code, the fetch_file() function doesn't seem to redirect output, so I don't understand why you didn't see any output from FETCHCOMMAND.
(In reply to comment #5) > So, I think the best that we can do allow the message from FETCHCOMMAND to pass > through. Looking at the code, the fetch_file() function doesn't seem to > redirect output, so I don't understand why you didn't see any output from > FETCHCOMMAND. emerge fetch function checks result and normally translates FETCHCOMMAND messages. emerge-webrsync fetch function doesn't check the result (were queried files fetched or not) and all errors (including proxy authentification errors) interpreters as file, not present on a mirror (at the time, where emerge fetch function translates proxy error message).
