Gentoo Websites Logo
Go to: Gentoo Home Documentation Forums Lists Bugs Planet Store Wiki Get Gentoo!
Bug 128397 - emerge --sync claims missing files
Summary: emerge --sync claims missing files
Status: RESOLVED INVALID
Alias: None
Product: Portage Development
Classification: Unclassified
Component: Unclassified (show other bugs)
Hardware: All Linux
: High normal
Assignee: Portage team
URL:
Whiteboard:
Keywords:
Depends on:
Blocks:
 
Reported: 2006-04-01 08:59 UTC by Juan
Modified: 2006-04-04 11:26 UTC (History)
0 users

See Also:
Package list:
Runtime testing required: ---


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Juan 2006-04-01 08:59:47 UTC
Beginning with portage-2.1_pre7, I am unable to emerge sync. If I downgrade to pre6-r7, everything is fine... Here is the message from an emerge --sync attempt with 2.1_pre7-r3:

Using PORTAGE_RSYNC_OPTS instead of hardcoded defaults
>>> Starting rsync with rsync://192.168.4.240/gentoo-portage...
>>> Checking server timestamp ...
building file list ...
rsync: link_stat "/home/dracco/rsync://192.168.4.240/gentoo-portage/metadata/timestamp.chk" failed: No such file or directory (2)
1 file to consider

Number of files: 1
Number of files transferred: 0
Total file size: 124 bytes
Total transferred file size: 0 bytes
Literal data: 0 bytes
Matched data: 0 bytes
File list size: 32
File list generation time: 0.001 seconds
File list transfer time: 0.000 seconds
Total bytes sent: 48
Total bytes received: 20

sent 48 bytes  received 20 bytes  136.00 bytes/sec
total size is 124  speedup is 1.82
rsync error: some files could not be transferred (code 23) at main.c(892) [sender]
>>> Retrying...

It does not pass this point.

Here is my emerge info:

black dracco # emerge --info
Portage 2.1_pre7-r3 (default-linux/x86/2006.0, gcc-3.4.6, glibc-2.4-r1, 2.6.15-suspend2-r8 i686)
=================================================================
System uname: 2.6.15-suspend2-r8 i686 Intel(R) Pentium(R) M processor 1.73GHz
Gentoo Base System version 1.12.0_pre16
dev-lang/python:     2.4.2-r1
sys-apps/sandbox:    1.2.17
sys-devel/autoconf:  2.13, 2.59-r7
sys-devel/automake:  1.4_p6, 1.5, 1.6.3, 1.7.9-r1, 1.8.5-r3, 1.9.6-r2
sys-devel/binutils:  2.16.1-r2
sys-devel/libtool:   1.5.22
virtual/os-headers:  2.6.11-r3
ACCEPT_KEYWORDS="x86 ~x86"
AUTOCLEAN="yes"
CBUILD="i686-pc-linux-gnu"
CFLAGS="-march=pentium-m -O2 -pipe -fomit-frame-pointer"
CHOST="i686-pc-linux-gnu"
CONFIG_PROTECT="/etc /usr/kde/2/share/config /usr/kde/3.5/env /usr/kde/3.5/share/config /usr/kde/3.5/shutdown /usr/kde/3/share/config /usr/share/X11/xkb /usr/share/config /var/qmail/control"
CONFIG_PROTECT_MASK="/etc/gconf /etc/revdep-rebuild /etc/splash /etc/terminfo /etc/env.d"
CXXFLAGS="-march=pentium-m -O2 -pipe -fomit-frame-pointer"
DISTDIR="/usr/portage/distfiles"
EMERGE_DEFAULT_OPTS="--alphabetical"
FEATURES="autoconfig distlocks metadata-transfer sandbox sfperms strict"
GENTOO_MIRRORS="http://gentoo.xdracco.net http://gentoo.oregonstate.edu http://gentoo.osuosl.org"
LINGUAS="en es"
MAKEOPTS="-j2"
PKGDIR="/usr/portage/packages"
PORTAGE_TMPDIR="/tmp"
PORTDIR="/usr/portage"
PORTDIR_OVERLAY="/usr/local/portage"
SYNC="rsync://gentoo.xdracco.net/gentoo-portage"
USE="x86 X alsa apache2 apm avi berkdb bitmap-fonts bzip2 cli crypt ctype cups dba eds emboss encode expat fastbuild flac foomaticdb force-cgi-redirect fortran ftp gd gif gpm gtk2 hal ieee1394 imlib ipod isdnlog java jpeg kde libg++ libwww logitech-mouse mad memlimit mikmod motif mp3 mpeg nas ncurses nls nptl ogg oggvorbis opengl oss pam pcmcia pcre pdflib perl png posix pppd python qt quicktime readline samba sdl session simplexml soap sockets spell spl ssl tcpd tidy tokenizer truetype truetype-fonts type1-fonts udev unicode usb vorbis xine xml xprint xscreensaver xsl xv zlib elibc_glibc input_devices_evdev input_devices_keyboard input_devices_mouse input_devices_synaptics kernel_linux linguas_en linguas_es userland_GNU video_cards_fbdev video_cards_nvidia video_cards_v4l video_cards_vesa video_cards_vga"
Unset:  ASFLAGS, CTARGET, LANG, LC_ALL, LDFLAGS
Comment 1 Marius Mauch (RETIRED) gentoo-dev 2006-04-03 12:33:12 UTC
Please provide the output of `emerge --info -v | grep SYNC` as well as the output of `emerge --debug --sync`
Comment 2 Juan 2006-04-03 14:02:40 UTC
FYI, issue still persists with my upgrade to portage-2.1_pre7-r4

black dracco # emerge --info -v | grep SYNC
PORTAGE_RSYNC_EXTRA_OPTS="/etc/portage/rsync_exclude"
PORTAGE_RSYNC_OPTS="--recursive --links --safe-links --perms --times --compress --force --whole-file --delete --delete-after --stats --timeout=180 --exclude='/distfiles' --exclude='/local' --exclude='/packages'"
PORTAGE_RSYNC_RETRIES="3"
SYNC="rsync://rsync.gentoo.org/gentoo-portage"

black dracco # emerge --debug --sync
myaction sync
myopts ['--debug', '--alphabetical']
Using PORTAGE_RSYNC_OPTS instead of hardcoded defaults
>>> Starting rsync with rsync://64.127.121.98/gentoo-portage...
>>> Checking server timestamp ...
/usr/bin/rsync /etc/portage/rsync_exclude --recursive --links --safe-links --perms --times --compress --force --whole-file --delete --delete-after --stats --timeout=180 --exclude='/distfiles' --exclude='/local' --exclude='/packages' --progress --checksum
building file list ...
rsync: link_stat "/home/dracco/rsync://64.127.121.98/gentoo-portage/metadata/timestamp.chk" failed: No such file or directory (2)
1 file to consider

Number of files: 1
Number of files transferred: 0
Total file size: 124 bytes
Total transferred file size: 0 bytes
Literal data: 0 bytes
Matched data: 0 bytes
File list size: 48
File list generation time: 0.001 seconds
File list transfer time: 0.000 seconds
Total bytes sent: 64
Total bytes received: 20

sent 64 bytes  received 20 bytes  168.00 bytes/sec
total size is 124  speedup is 1.48
rsync error: some files could not be transferred (code 23) at main.c(892) [sender]
>>> Retrying...


>>> Starting retry 1 of 3 with rsync://134.68.220.73/gentoo-portage
>>> Checking server timestamp ...
/usr/bin/rsync /etc/portage/rsync_exclude --recursive --links --safe-links --perms --times --compress --force --whole-file --delete --delete-after --stats --timeout=180 --exclude='/distfiles' --exclude='/local' --exclude='/packages' --progress --checksum
building file list ...
rsync: link_stat "/home/dracco/rsync://134.68.220.73/gentoo-portage/metadata/timestamp.chk" failed: No such file or directory (2)
1 file to consider

Number of files: 1
Number of files transferred: 0
Total file size: 124 bytes
Total transferred file size: 0 bytes
Literal data: 0 bytes
Matched data: 0 bytes
File list size: 48
File list generation time: 0.001 seconds
File list transfer time: 0.000 seconds
Total bytes sent: 64
Total bytes received: 20

sent 64 bytes  received 20 bytes  168.00 bytes/sec
total size is 124  speedup is 1.48
rsync error: some files could not be transferred (code 23) at main.c(892) [sender]
>>> Retrying...
Comment 3 Juan 2006-04-03 14:16:11 UTC
emerge-websync functioned and forced me to downgrade to 2.1_pre7-r3.

I then run emerge --debug --sync again and receive the same messages ending with ...

!!! Rsync has not successfully finished. It is recommended that you keep
!!! trying or that you use the 'emerge-webrsync' option if you are unable
!!! to use rsync due to firewall or other restrictions. This should be a
!!! temporary problem unless complications exist with your network
!!! (and possibly your system's filesystem) configuration.
Comment 4 Marius Mauch (RETIRED) gentoo-dev 2006-04-03 15:18:42 UTC
Ok, the problem is your PORTAGE_RSYNC_EXTRA_OPTS setting, that should probably be PORTAGE_RSYNC_EXTRA_OPTS="--exclude-from=/etc/portage/rsync_exclude".
I'll see to improve the docs regarding the syntax for the new variables.
Zac, what do you think about adding some conversion code in the ebuild (so people see the changes with etc-update)?
Comment 5 Juan 2006-04-03 15:46:15 UTC
If I recollect correctly, the upgrade did notify me of some variable name changes, which I modified. PORTAGE_RSYNC_EXTRA_OPTS was one of them but I honestly can't remember if --exclude-from= was part of the variable....

Either way, thanks.
Comment 6 Zac Medico gentoo-dev 2006-04-04 11:26:57 UTC
(In reply to comment #4)
> Zac, what do you think about adding some conversion code in the ebuild (so
> people see the changes with etc-update)?

Offhand, the conversion seems like it would be more robust if implemented in python.  Also, the ebuild could get really bloated with conversions like that.