Gentoo Websites Logo
Go to: Gentoo Home Documentation Forums Lists Bugs Planet Store Wiki Get Gentoo!
Bug 219837 - emerge-webrsync strange issues
Summary: emerge-webrsync strange issues
Status: RESOLVED FIXED
Alias: None
Product: Portage Development
Classification: Unclassified
Component: Core - Interface (emerge) (show other bugs)
Hardware: x86 Linux
: High normal (vote)
Assignee: Portage team
URL:
Whiteboard:
Keywords: InVCS, REGRESSION
Depends on:
Blocks: 216231
  Show dependency tree
 
Reported: 2008-04-30 13:25 UTC by David Schulman
Modified: 2008-05-06 08:40 UTC (History)
0 users

See Also:
Package list:
Runtime testing required: ---


Attachments
adjust date calculations (webrsync_date.patch,1.21 KB, patch)
2008-04-30 18:31 UTC, Zac Medico
Details | Diff

Note You need to log in before you can comment on or make changes to this bug.
Description David Schulman 2008-04-30 13:25:22 UTC
there appears to be a problem with the emerge-webrsync command on 2 different computers I am getting: 

~ # emerge-webrsync
Fetching most recent snapshot ...
Trying to retrieve 20080430 snapshot from http://distfiles.gentoo.org ...
Fetching file portage-20080430.tar.lzma.md5sum ...
Fetching file portage-20080430.tar.bz2.md5sum ...
Fetching file portage-20080430.tar.gz.md5sum ...
Trying to retrieve 20080430 snapshot from http://distro.ibiblio.org/pub/linux/distributions/gentoo ...
Fetching file portage-20080430.tar.lzma.md5sum ...
Fetching file portage-20080430.tar.bz2.md5sum ...
Fetching file portage-20080430.tar.gz.md5sum ...
20080430 snapshot was not found
/usr/sbin/emerge-webrsync: warning: portage content is newer than available snapshots (use --revert option to overide)



One was build a year ago with the 2007 install cd and has had no problems till I noticed this. the other was built with the 2008 cd but as both are having this issue there needs to be something done. not everyone can do the emerge --sync  some have to resort to the emerge-webrsync 



Reproducible: Always

Steps to Reproduce:
1.emerge-webrsync
2.
3.

Actual Results:  
~ # emerge-webrsync
Fetching most recent snapshot ...
Trying to retrieve 20080430 snapshot from http://distfiles.gentoo.org ...
Fetching file portage-20080430.tar.lzma.md5sum ...
Fetching file portage-20080430.tar.bz2.md5sum ...
Fetching file portage-20080430.tar.gz.md5sum ...
Trying to retrieve 20080430 snapshot from http://distro.ibiblio.org/pub/linux/distributions/gentoo ...
Fetching file portage-20080430.tar.lzma.md5sum ...
Fetching file portage-20080430.tar.bz2.md5sum ...
Fetching file portage-20080430.tar.gz.md5sum ...
20080430 snapshot was not found
/usr/sbin/emerge-webrsync: warning: portage content is newer than available snapshots (use --revert option to overide)


Expected Results:  
current fix was to emerge and run emerge-delta-webrsync
Comment 1 Zac Medico gentoo-dev 2008-04-30 16:45:57 UTC
(In reply to comment #0)
> 20080430 snapshot was not found
> /usr/sbin/emerge-webrsync: warning: portage content is newer than available
> snapshots (use --revert option to overide)

Please post emerge --info output. It should include a "Timestamp of tree" field which corresponds to the value contained in the /usr/portage/metadata/timestamp.chk file. The message that you got implies that downloading the snapshot would be pointless. It's possible that there is a bug in the way that this calculation is done.
Comment 2 David Schulman 2008-04-30 16:51:38 UTC
on a side note I removed the timestamp files and it will sync the one time giving the error for the first 2 times and then go back to the previous date and then it will want the current dates portage..  it is a strange issue to be doing on 2 different systems. 



( Computer intalled with 2007 cd )


emerge --info
Portage 2.1.5_rc6 (default-linux/x86/2006.1/desktop, gcc-4.2.3, glibc-2.7-r2, 2.6.24-gentoo-r2 i686)
=================================================================
System uname: 2.6.24-gentoo-r2 i686 Intel(R) Pentium(R) 4 CPU 1.60GHz
Timestamp of tree: Wed, 30 Apr 2008 01:45:01 +0000
distcc 2.18.3 i686-pc-linux-gnu (protocols 1 and 2) (default port 3632) [disabled]
app-shells/bash:     3.2_p33
dev-lang/python:     2.5.2-r2
sys-apps/baselayout: 2.0.0
sys-apps/openrc:     0.2.3
sys-apps/sandbox:    1.2.18.1-r2
sys-devel/autoconf:  2.13, 2.62
sys-devel/automake:  1.5, 1.7.9-r1, 1.8.5-r3, 1.9.6-r2, 1.10.1
sys-devel/binutils:  2.18-r1
sys-devel/gcc-config: 1.4.0-r4
sys-devel/libtool:   1.5.26
virtual/os-headers:  2.6.25-r1
ACCEPT_KEYWORDS="x86 ~x86"
CBUILD="i686-pc-linux-gnu"
CFLAGS="-march=pentium4 -O2 -pipe"
CHOST="i686-pc-linux-gnu"
CONFIG_PROTECT="/etc /usr/kde/3.5/env /usr/kde/3.5/share/config /usr/kde/3.5/shutdown /usr/share/config"
CONFIG_PROTECT_MASK="/etc/env.d /etc/fonts/fonts.conf /etc/gconf /etc/gentoo-release /etc/revdep-rebuild /etc/terminfo /etc/udev/rules.d"
CXXFLAGS="-march=pentium4 -O2 -pipe"
DISTDIR="/usr/portage/distfiles"
FEATURES="distlocks parallel-fetch sandbox sfperms strict unmerge-orphans userfetch"
GENTOO_MIRRORS="http://distfiles.gentoo.org http://distro.ibiblio.org/pub/linux/distributions/gentoo"
LDFLAGS=""
MAKEOPTS="-j5"
PKGDIR="/usr/portage/packages"
PORTAGE_RSYNC_OPTS="--recursive --links --safe-links --perms --times --compress --force --whole-file --delete --stats --timeout=180 --exclude=/distfiles --exclude=/local --exclude=/packages"
PORTAGE_TMPDIR="/var/tmp"
PORTDIR="/usr/portage"
SYNC="rsync://rsync.gentoo.org/gentoo-portage"
USE="X alsa arts avi berkdb bitmap-fonts cairo cdr cli cracklib crypt cups dbus dlloader dri dvd dvdr eds emboss encode esd fam firefox fortran gdbm gif gnome gpm gstreamer gtk hal iconv ipv6 isdnlog jpeg kde ldap libg++ mad midi mikmod mp3 mpeg mudflap ncurses nls nptl nptlonly ogg opengl openmp oss pam pcre pdflib perl png ppds pppd python qt3 qt3support qt4 quicktime readline reflection sdl session spell spl ssl symlink tcpd truetype truetype-fonts type1-fonts udev unicode vorbis win32codecs x86 xml xorg xv zlib" ALSA_CARDS="ali5451 als4000 atiixp atiixp-modem bt87x ca0106 cmipci emu10k1     emu10k1x ens1370 ens1371 es1938 es1968 fm801 hda-intel intel8x0 intel8x0m     maestro3 trident usb-audio via82xx via82xx-modem ymfpci" ALSA_PCM_PLUGINS="adpcm alaw asym copy dmix dshare dsnoop empty extplug file hooks iec958 ioplug ladspa lfloat linear meter mulaw multi null plug rate route share shm softvol" APACHE2_MODULES="actions alias auth_basic authn_alias authn_anon authn_dbm authn_default authn_file authz_dbm authz_default authz_groupfile authz_host authz_owner authz_user autoindex cache dav dav_fs dav_lock deflate dir disk_cache env expires ext_filter file_cache filter headers include info log_config logio mem_cache mime mime_magic negotiation rewrite setenvif speling status unique_id userdir usertrack vhost_alias" ELIBC="glibc" INPUT_DEVICES="keyboard mouse evdev" KERNEL="linux" LCD_DEVICES="bayrad cfontz cfontz633 glk hd44780 lb216 lcdm001 mtxorb ncurses text" USERLAND="GNU" VIDEO_CARDS="nv vesa fbdev"
Unset:  CPPFLAGS, CTARGET, EMERGE_DEFAULT_OPTS, INSTALL_MASK, LANG, LC_ALL, LINGUAS, PORTAGE_COMPRESS, PORTAGE_COMPRESS_FLAGS, PORTAGE_RSYNC_EXTRA_OPTS, PORTDIR_OVERLAY


( computer installed with 2008 cd )
~ # emerge --info
Portage 2.1.5_rc6 (default/linux/x86/2008.0/desktop, gcc-4.1.2, glibc-2.7-r2, 2.6.25-gentoo-r1 i686)
=================================================================
System uname: 2.6.25-gentoo-r1 i686 Mobile Intel(R) Pentium(R) 4 CPU 2.80GHz
Timestamp of tree: Wed, 30 Apr 2008 01:45:01 +0000
distcc 2.18.3 i686-pc-linux-gnu (protocols 1 and 2) (default port 3632) [enabled]
app-shells/bash:     3.2_p33
dev-lang/python:     2.4.4-r9, 2.5.2-r2
dev-python/pycrypto: 2.0.1-r6
sys-apps/baselayout: 2.0.0
sys-apps/openrc:     0.2.3
sys-apps/sandbox:    1.2.18.1-r2
sys-devel/autoconf:  2.13, 2.61-r1
sys-devel/automake:  1.5, 1.7.9-r1, 1.8.5-r3, 1.9.6-r2, 1.10.1
sys-devel/binutils:  2.18-r1
sys-devel/gcc-config: 1.4.0-r4
sys-devel/libtool:   1.5.26
virtual/os-headers:  2.6.25-r1
ACCEPT_KEYWORDS="x86 ~x86"
CBUILD="i686-pc-linux-gnu"
CFLAGS="-O2 -march=i686 -pipe"
CHOST="i686-pc-linux-gnu"
CONFIG_PROTECT="/etc"
CONFIG_PROTECT_MASK="/etc/env.d /etc/fonts/fonts.conf /etc/gconf /etc/gentoo-release /etc/revdep-rebuild /etc/terminfo /etc/udev/rules.d"
CXXFLAGS="-O2 -march=i686 -pipe"
DISTDIR="/usr/portage/distfiles"
FEATURES="distcc distlocks metadata-transfer parallel-fetch sandbox sfperms strict unmerge-orphans userfetch"
GENTOO_MIRRORS="http://distfiles.gentoo.org http://gentoo.osuosl.org/ http://gentoo.mirrors.tds.net/gentoo/"
LDFLAGS=""
MAKEOPTS="-j5"
PKGDIR="/usr/portage/packages"
PORTAGE_RSYNC_OPTS="--recursive --links --safe-links --perms --times --compress --force --whole-file --delete --stats --timeout=180 --exclude=/distfiles --exclude=/local --exclude=/packages"
PORTAGE_TMPDIR="/var/tmp"
PORTDIR="/usr/portage"
SYNC="rsync://rsync.gentoo.org/gentoo-portage"
USE="X acl acpi alsa arts avi berkdb bitmap-fonts bluetooth branding bzip2 cairo cdr cli cracklib crypt cups dbus dlloader dri dvd dvdr dvdread eds emboss encode esd evo fam firefox fortran gdbm gif gnome gpm gstreamer gtk hal iconv ipv6 isdnlog jpeg kde kerberos ldap libg++ libnotify mad midi mikmod mp3 mpeg mudflap ncurses nls nptl nptlonly ogg opengl openmp pam pcre pdf pdflib perl png ppds pppd python qt3 qt3support qt4 quicktime readline reflection sdl session spell spl ssl startup-notification svg symlink tcpd tiff truetype truetype-fonts type1-fonts udev unicode vorbis win32codecs x86 xml xorg xv zlib" ALSA_CARDS="ali5451 als4000 atiixp atiixp-modem bt87x ca0106 cmipci emu10k1 emu10k1x ens1370 ens1371 es1938 es1968 fm801 hda-intel intel8x0 intel8x0m maestro3 trident usb-audio via82xx via82xx-modem ymfpci" ALSA_PCM_PLUGINS="adpcm alaw asym copy dmix dshare dsnoop empty extplug file hooks iec958 ioplug ladspa lfloat linear meter mulaw multi null plug rate route share shm softvol" APACHE2_MODULES="actions alias auth_basic authn_alias authn_anon authn_dbm authn_default authn_file authz_dbm authz_default authz_groupfile authz_host authz_owner authz_user autoindex cache dav dav_fs dav_lock deflate dir disk_cache env expires ext_filter file_cache filter headers include info log_config logio mem_cache mime mime_magic negotiation rewrite setenvif speling status unique_id userdir usertrack vhost_alias" ELIBC="glibc" INPUT_DEVICES="keyboard mouse evdev" KERNEL="linux" LCD_DEVICES="bayrad cfontz cfontz633 glk hd44780 lb216 lcdm001 mtxorb ncurses text" USERLAND="GNU" VIDEO_CARDS="radeon ati vesa fbdev fglrx"
Unset:  CPPFLAGS, CTARGET, EMERGE_DEFAULT_OPTS, INSTALL_MASK, LANG, LC_ALL, LINGUAS, PORTAGE_COMPRESS, PORTAGE_COMPRESS_FLAGS, PORTAGE_RSYNC_EXTRA_OPTS, PORTDIR_OVERLAY

Comment 3 Zac Medico gentoo-dev 2008-04-30 18:31:50 UTC
Created attachment 151449 [details, diff]
adjust date calculations

If this patch is saved as /tmp/webrsync_date.patch then it can be applied as follows:

patch /usr/lib/portage/bin/emerge-webrsync /tmp/webrsync_date.patch
Comment 4 David Schulman 2008-04-30 19:13:17 UTC
well that does no good on the patch that is supplied. it does not go through and give the errors before but still says my portage is newer. I deleted all the timestamp files and did an emerge-webrsycn and it did this then re did it to verify and still gives the error portage content is newer than available snapshot. 


so what is the real fix here.. 




metadata # emerge-webrsync
Fetching most recent snapshot ...
Trying to retrieve 20080429 snapshot from http://distfiles.gentoo.org ...
Fetching file portage-20080429.tar.lzma.md5sum ...
Fetching file portage-20080429.tar.lzma.gpgsig ...
Fetching file portage-20080429.tar.lzma ...
Checking digest ...
portage-20080429.tar.lzma: OK
Getting snapshot timestamp ...
Syncing local tree ...
building file list ...
124663 files to consider
metadata/
metadata/timestamp
          29 100%    0.00kB/s    0:00:00 (xfer#1, to-check=61105/124663)
metadata/timestamp.chk
          32 100%   31.25kB/s    0:00:00 (xfer#2, to-check=61104/124663)
metadata/timestamp.x
          40 100%   39.06kB/s    0:00:00 (xfer#3, to-check=61103/124663)

Number of files: 124663
Number of files transferred: 3
Total file size: 156491241 bytes
Total transferred file size: 101 bytes
Literal data: 101 bytes
Matched data: 0 bytes
File list size: 3077124
File list generation time: 1.685 seconds
File list transfer time: 0.000 seconds
Total bytes sent: 3077368
Total bytes received: 76

sent 3077368 bytes  received 76 bytes  267603.83 bytes/sec
total size is 156491241  speedup is 50.85
Cleaning up ...
Updating cache ...

>>> Updating Portage cache:  100%
metadata # emerge-webrsync
Fetching most recent snapshot ...
/usr/sbin/emerge-webrsync: warning: portage content is newer than available snapshots (use --revert option to overide)
metadata #
Comment 5 David Schulman 2008-04-30 19:15:51 UTC
and fyi.  after emerge portage .. 

back to normal. 


metadata # emerge-webrsync
Fetching most recent snapshot ...
Trying to retrieve 20080430 snapshot from http://distfiles.gentoo.org ...
Fetching file portage-20080430.tar.lzma.md5sum ...
Fetching file portage-20080430.tar.bz2.md5sum ...
Fetching file portage-20080430.tar.gz.md5sum ...
Trying to retrieve 20080430 snapshot from http://gentoo.osuosl.org/ ...
Fetching file portage-20080430.tar.lzma.md5sum ...
Fetching file portage-20080430.tar.bz2.md5sum ...
Fetching file portage-20080430.tar.gz.md5sum ...
Trying to retrieve 20080430 snapshot from http://gentoo.mirrors.tds.net/gentoo/ ...
Fetching file portage-20080430.tar.lzma.md5sum ...
Fetching file portage-20080430.tar.bz2.md5sum ...
Fetching file portage-20080430.tar.gz.md5sum ...
20080430 snapshot was not found
/usr/sbin/emerge-webrsync: warning: portage content is newer than available snapshots (use --revert option to overide)
Comment 6 David Schulman 2008-05-01 13:08:09 UTC
well looks like this gets bumped to the curb.   the fix/patch you supplied lasted one day..  after the emerge of the latest portage and emerge -uDv world it is back to normal..as i said before.. 

Comment 7 David Schulman 2008-05-05 20:34:30 UTC
Bump.. 


Come on... fix the portage. every time you emerge the latest portage it puts the emerge-webrsync back to the orginal..  and the fix supplied does nothing but remove the echos of it not being able to locate the latest portage by the date. 
Comment 8 Zac Medico gentoo-dev 2008-05-05 21:32:45 UTC
It will be released in portage-2.1.5_rc7 later today. You can get it from viewcvs if you want to test it:

http://sources.gentoo.org/viewcvs.py/*checkout*/portage/main/branches/2.1.2/bin/emerge-webrsync?rev=10129
Comment 9 David Schulman 2008-05-05 21:40:29 UTC
Thanks looks like that did the trick.  Keep up the good work. 



Comment 10 Zac Medico gentoo-dev 2008-05-06 08:40:04 UTC
This is fixed in 2.1.5_rc7.