Gentoo Websites Logo
Go to: Gentoo Home Documentation Forums Lists Bugs Planet Store Wiki Get Gentoo!
Bug 316371 - emerge-webrsync fials
Summary: emerge-webrsync fials
Status: RESOLVED CANTFIX
Alias: None
Product: Gentoo Linux
Classification: Unclassified
Component: [OLD] Unspecified (show other bugs)
Hardware: AMD64 Linux
: High major (vote)
Assignee: Portage team
URL:
Whiteboard:
Keywords:
Depends on:
Blocks:
 
Reported: 2010-04-20 15:47 UTC by Marcin Szamotulski
Modified: 2010-04-24 18:39 UTC (History)
1 user (show)

See Also:
Package list:
Runtime testing required: ---


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Marcin Szamotulski 2010-04-20 15:47:38 UTC
emerge-webrsync (or emerge --sync) can not download all the files.



Reproducible: Always

Steps to Reproduce:
1. emerge-webrsync
2. rsync error: some fiels/attrs were not transferred 
3.

Actual Results:  
The result of the command emerge-webrsync:

sent 5717286 bytes  received 68435 bytes  146473.95 bytes/sec
total size is 186461955  speedup is 32.23
rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1039) [sender=3.0.6]
cd: error retrieving current directory: getcwd: cannot access parent directories: No such file or directory
Cleaning up ...
shell-init: error retrieving current directory: getcwd: cannot access parent directories: No such file or directory

If I try emerge -DuN world afterwards it usually sais that some digest is missing, for example:

Missing digest for '/dane/portage/sys-kernel/gentoo-sources/gentoo-sources-2.6.31-r6.ebuild'



emerge --info
Portage 2.1.7.17 (hardened/linux/amd64/10.0, gcc-4.3.4, glibc-2.10.1-r1, 2.6.28-hardened-r9-h3.6 x86_64)
=================================================================
System uname: Linux-2.6.28-hardened-r9-h3.6-x86_64-AMD_Turion-tm-_64_X2_Mobile_Technology_TL-58-with-gentoo-2.0.1
Timestamp of tree: Tue, 20 Apr 2010 01:45:01 +0000
app-shells/bash:     4.0_p37
dev-java/java-config: 2.1.10
dev-lang/python:     2.6.4-r1
dev-util/cmake:      2.6.4-r3
sys-apps/baselayout: 2.0.1
sys-apps/openrc:     0.6.0-r1
sys-apps/sandbox:    1.6-r2
sys-devel/autoconf:  2.13, 2.63-r1
sys-devel/automake:  1.8.5-r3, 1.9.6-r3, 1.10.3
sys-devel/binutils:  2.18-r3
sys-devel/gcc:       4.3.4
sys-devel/gcc-config: 1.4.1
sys-devel/libtool:   2.2.6b
virtual/os-headers:  2.6.30-r1
ACCEPT_KEYWORDS="amd64"
ACCEPT_LICENSE="* -@EULA dlj-1.1 skype-eula"
CBUILD="x86_64-pc-linux-gnu"
CFLAGS="-march=k8-sse3 -O2 -pipe -fmerge-all-constants -finline-limit=1200 -msse -msse2 -msse3 -m3dnow -mfpmath=sse"
CHOST="x86_64-pc-linux-gnu"
CONFIG_PROTECT="/etc /usr/share/X11/xkb /usr/share/config /var/lib/hsqldb"
CONFIG_PROTECT_MASK="/etc/ca-certificates.conf /etc/env.d /etc/env.d/java/ /etc/fonts/fonts.conf /etc/gconf /etc/gentoo-release /etc/rc.d /etc/revdep-rebuild /etc/sandbox.d /etc/splash /etc/terminfo /etc/texmf/language.dat.d /etc/texmf/language.def.d /etc/texmf/updmap.d /etc/texmf/web2c /etc/wget"
CXXFLAGS="-march=k8-sse3 -O2 -pipe -fmerge-all-constants -finline-limit=1200 -msse -msse2 -msse3 -m3dnow -mfpmath=sse"
DISTDIR="/dane/portage/distfiles"
FEATURES="assume-digests distlocks fixpackages news parallel-fetch protect-owned sandbox sfperms strict unmerge-logs unmerge-orphans userfetch"
GENTOO_MIRRORS="http://distfiles.gentoo.org"
LANG="en_GB.utf8"
LC_ALL=""
LDFLAGS="-Wl,-O1"
LINGUAS="en"
MAKEOPTS="-j3"
PKGDIR="/dane/portage/packages"
PORTAGE_CONFIGROOT="/"
PORTAGE_RSYNC_EXTRA_OPTS="--bwlimit=1000"
PORTAGE_RSYNC_OPTS="--recursive --links --safe-links --perms --times --compress --force --whole-file --delete --stats --timeout=180 --exclude=/distfiles --exclude=/local --exclude=/packages"
PORTAGE_TMPDIR="/dane/portage/tmp"
PORTDIR="/dane/portage"
PORTDIR_OVERLAY="/usr/local/portage /usr/local/portage/layman/soor-overlay"
SYNC="rsync://rsync.gentoo.org/gentoo-portage"
USE="64bit 7zip X aac aalib abook acl acpi alsa amarok amazon amd64 apm archive ares aspell attachment audio bash-completion battery berkdb bittorrent bookmarks bzip2 cairo calendar cdaudio cdda cdio chroot cisco clamav clamd clamdtop cli clipboard clock-screen color-console colordiff config-log consolekit cpufreq cpulimit cracklib crypt csv cups cvs cxx dbus dhcp dhcpcd dialup dict disk-partition divx djvu dns dolby-record-switch dolbyinrec dri dvd dvi embedded enca excel fat firefox firefox3 flac font-server ftp fuse gcj gdbm gimp gimpprint glib gmail gpg gpm gtk hal hardened hifieq hpn html http icons iconv image imagemagick imap int64 ipfilter iproute2 jack jack-tmpfs java java6 jpeg jpeg2k jpgraph justify kde kpathsea kvm lame laptop latex lm_sensors logitech-mouse maildrop mbox md5sum messages mime mmx modules mouse mozilla mp3 mp3rtp mp4 mp4live mpd mpeg mpeg2 mplayer msn mudflap multilib multiuser music nat ncurses network networking nforce2 nls nocman nodot nodpkg nogg nojoystick nomotif noopcode nptl nptlonly nsplugin ntfs opengl openmp openntpd openssh openssl opera pam pcre pdf perl pgf pic plugins pmu png pnm pop pop3d postscript ppds pppd print procmail profile ps pstricks qemu qt3support qt4 rar raw-mode readline reflection regex sasl scanner science scp screen session sftp smime smtp sndfile spell spl sse sse2 ssl subversion symlink sysfs syslog t1lib tcpd tk trash-plugin truetype unicode unzip urandom usb video videos vim vim-pager vim-syntax vim-with-x vorbis wifi wma wma-fixed xine xinetd xorg xsettings yahoo zip zlib" ALSA_CARDS="ali5451 als4000 atiixp atiixp-modem bt87x ca0106 cmipci emu10k1x ens1370 ens1371 es1938 es1968 fm801 hda-intel intel8x0 intel8x0m maestro3 trident usb-audio via82xx via82xx-modem ymfpci" ALSA_PCM_PLUGINS="adpcm alaw asym copy dmix dshare dsnoop empty extplug file hooks iec958 ioplug ladspa lfloat linear meter mmap_emul mulaw multi null plug rate route share shm softvol" APACHE2_MODULES="actions alias auth_basic authn_alias authn_anon authn_dbm authn_default authn_file authz_dbm authz_default authz_groupfile authz_host authz_owner authz_user autoindex cache dav dav_fs dav_lock deflate dir disk_cache env expires ext_filter file_cache filter headers include info log_config logio mem_cache mime mime_magic negotiation rewrite setenvif speling status unique_id userdir usertrack vhost_alias" ELIBC="glibc" INPUT_DEVICES="evdev" KERNEL="linux" LCD_DEVICES="bayrad cfontz cfontz633 glk hd44780 lb216 lcdm001 mtxorb ncurses text" LINGUAS="en" RUBY_TARGETS="ruby18" USERLAND="GNU" VIDEO_CARDS="radeon vmware" 
Unset:  CPPFLAGS, CTARGET, EMERGE_DEFAULT_OPTS, FFLAGS, INSTALL_MASK, PORTAGE_COMPRESS, PORTAGE_COMPRESS_FLAGS
Comment 1 Zac Medico gentoo-dev 2010-04-22 18:43:47 UTC
Did you post the entire output or was there anything else?
Comment 2 Marcin Szamotulski 2010-04-24 14:36:15 UTC
(In reply to comment #1)
> Did you post the entire output or was there anything else?
> 

When I try to do emerge --sync I get the following output (with errors :(
>>> Starting retry 1 of 3 with rsync://209.177.148.226/gentoo-portage
>>> Checking server timestamp ...
Welcome to magpie.gentoo.org / rsync.gentoo.org, rsync.ipv6.gentoo.org
 
Server Address : 209.177.148.226, 2607:f740:0:29:230:48ff:fef8:a064
Contact Name   : mirror-admin@gentoo.org
Hardware       : 4 x Intel(R) Xeon(R) CPU           X3330  @ 2.66GHz, 3961MB RAM
 
Please note: common gentoo-netiquette says you should not sync more
than once a day.  Users who abuse the rsync.gentoo.org rotation
may be added to a temporary ban list.

MOTD autogenerated by update-rsync-motd on Wed Apr 14 04:03:51 UTC 2010

receiving incremental file list
timestamp.chk

Number of files: 1
Number of files transferred: 1
Total file size: 32 bytes
Total transferred file size: 32 bytes
Literal data: 32 bytes
Matched data: 0 bytes
File list size: 27
File list generation time: 0.001 seconds
File list transfer time: 0.000 seconds
Total bytes sent: 98
Total bytes received: 648

sent 98 bytes  received 648 bytes  213.14 bytes/sec
total size is 32  speedup is 0.04
Welcome to magpie.gentoo.org / rsync.gentoo.org, rsync.ipv6.gentoo.org
 
Server Address : 209.177.148.226, 2607:f740:0:29:230:48ff:fef8:a064
Contact Name   : mirror-admin@gentoo.org
Hardware       : 4 x Intel(R) Xeon(R) CPU           X3330  @ 2.66GHz, 3961MB RAM
 
Please note: common gentoo-netiquette says you should not sync more
than once a day.  Users who abuse the rsync.gentoo.org rotation
may be added to a temporary ban list.

MOTD autogenerated by update-rsync-motd on Wed Apr 14 04:03:51 UTC 2010

receiving incremental file list
deleting tmp/
./
rsync: readdir("/dane/portage/profiles/default/linux/amd64/dev"): Input/output error (5)
rsync: recv_generator: mkdir "/dane/portage/profiles/default/linux/amd64/dev/32bit-userland" failed: Input/output error (5)
*** Skipping any contents from this failed directory ***
IO error encountered -- skipping file deletion
rsync: mkstemp "/dane/portage/profiles/default/linux/amd64/dev/.parent.YAaCDD" failed: Input/output error (5)
profiles/default/linux/amd64/dev/32bit-userland/
Number of files: 137829
Number of files transferred: 1
Total file size: 186498914 bytes
Total transferred file size: 3 bytes
Literal data: 3 bytes
Matched data: 0 bytes
File list size: 3273360
File list generation time: 0.001 seconds
File list transfer time: 0.000 seconds
Total bytes sent: 21049
Total bytes received: 3363035

sent 21049 bytes  received 3363035 bytes  28800.71 bytes/sec
total size is 186498914  speedup is 55.11
rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1505) [generator=3.0.6]
>>> Retrying...


>>> Starting retry 2 of 3 with rsync://91.186.30.235/gentoo-portage
>>> Checking server timestamp ...
Welcome to boobie.gentoo.org / rsync.gentoo.org
 
Server Address : 91.186.30.235
Contact Name   : mirror-admin@gentoo.org
Hardware       : 2 x Intel(R) Xeon(R) CPU            3050  @ 2.13GHz, 3963MB RAM
 
Please note: common gentoo-netiquette says you should not sync more
than once a day.  Users who abuse the rsync.gentoo.org rotation
may be added to a temporary ban list.
MOTD autogenerated by update-rsync-motd on Mon Apr  5 14:34:56 UTC 2010

receiving incremental file list
timestamp.chk

Number of files: 1
Number of files transferred: 1
Total file size: 32 bytes
Total transferred file size: 32 bytes
Literal data: 32 bytes
Matched data: 0 bytes
File list size: 27
File list generation time: 0.001 seconds
File list transfer time: 0.000 seconds
Total bytes sent: 98
Total bytes received: 588

sent 98 bytes  received 588 bytes  274.40 bytes/sec
total size is 32  speedup is 0.05
Welcome to boobie.gentoo.org / rsync.gentoo.org
 
Server Address : 91.186.30.235
Contact Name   : mirror-admin@gentoo.org
Hardware       : 2 x Intel(R) Xeon(R) CPU            3050  @ 2.13GHz, 3963MB RAM
 
Please note: common gentoo-netiquette says you should not sync more
than once a day.  Users who abuse the rsync.gentoo.org rotation
may be added to a temporary ban list.

MOTD autogenerated by update-rsync-motd on Mon Apr  5 14:34:56 UTC 2010

receiving incremental file list
deleting tmp/
./
rsync: readdir("/dane/portage/profiles/default/linux/amd64/dev"): Input/output error (5)
rsync: recv_generator: mkdir "/dane/portage/profiles/default/linux/amd64/dev/32bit-userland" failed: Input/output error (5)
*** Skipping any contents from this failed directory ***
IO error encountered -- skipping file deletion
rsync: mkstemp "/dane/portage/profiles/default/linux/amd64/dev/.parent.lB6dMB" failed: Input/output error (5)
profiles/default/linux/amd64/dev/32bit-userland/

Number of files: 137829
Number of files transferred: 1
Total file size: 186498914 bytes
Total transferred file size: 3 bytes
Literal data: 3 bytes
Matched data: 0 bytes
File list size: 3273360
File list generation time: 0.001 seconds
File list transfer time: 0.000 seconds
Total bytes sent: 21049
Total bytes received: 3362975

sent 21049 bytes  received 3362975 bytes  44235.61 bytes/sec
total size is 186498914  speedup is 55.11
rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1505) [generator=3.0.6]
>>> Retrying...


>>> Starting retry 3 of 3 with rsync://134.68.240.62/gentoo-portage
>>> Checking server timestamp ...
rsync: failed to connect to 134.68.240.62: Connection refused (111)
rsync error: error in socket IO (code 10) at clientserver.c(124) [receiver=3.0.6]
>>> Exceeded PORTAGE_RSYNC_RETRIES: 3
Comment 3 Zac Medico gentoo-dev 2010-04-24 14:44:07 UTC
(In reply to comment #2)
> receiving incremental file list
> deleting tmp/
> ./
> rsync: readdir("/dane/portage/profiles/default/linux/amd64/dev"): Input/output
> error (5)
> rsync: recv_generator: mkdir
> "/dane/portage/profiles/default/linux/amd64/dev/32bit-userland" failed:
> Input/output error (5)
> *** Skipping any contents from this failed directory ***
> IO error encountered -- skipping file deletion
> rsync: mkstemp "/dane/portage/profiles/default/linux/amd64/dev/.parent.lB6dMB"
> failed: Input/output error (5)
> profiles/default/linux/amd64/dev/32bit-userland/

All those "Input/output error" messages indicate that there's something wrong with your filesystem and/or disk.
Comment 4 Marcin Szamotulski 2010-04-24 18:39:59 UTC
Thanks, that's actually true.  After fsck the partition which stores the portage tree, everything back to order.

Thanks a lot, best.