# with all rsync mirrors, i get: # emerge --sync ... io timeout after 180 seconds - exiting rsync error: timeout in data send/receive (code 30) at io.c(109) # using rsync.gentoo.org, i get: # emerge --sync ... @ERROR: Unknown module 'metadata' rsync: connection unexpectedly closed (438 bytes read so far) rsync error: error in rsync protocol data stream (code 12) at io.c(189) am i on the ban list? i doubt it because this happens to me from several sites and several gentoo boxen. at this point, my only solution for upgrades is to rm -rf /usr/portage and this install the latest portage snapshot. what's crazy is i search this on the net and i find nothing. just a handful of people talking about this but from about 6 months ago and beyond. there is a related bug in bugzilla, but no solution. i'm really surprised because in my experience gentoo is very quick to resolve issues and i'd think something like this would be very important. # emerge --info Portage 2.0.54 (default-linux/x86/2006.0, gcc-3.3.6, glibc-2.3.5-r2, 2.6.12-gentoo-r10 i686) ================================================================= System uname: 2.6.12-gentoo-r10 i686 Pentium III (Coppermine) Gentoo Base System version 1.6.14 distcc 2.18.3 i686-pc-linux-gnu (protocols 1 and 2) (default port 3632) [enabled] ccache version 2.3 [enabled] dev-lang/python: 2.3.5-r2, 2.4.2 sys-apps/sandbox: 1.2.12 sys-devel/autoconf: 2.13, 2.59-r6 sys-devel/automake: 1.4_p6, 1.5, 1.6.3, 1.7.9-r1, 1.8.5-r3, 1.9.6-r1 sys-devel/binutils: 2.16.1 sys-devel/libtool: 1.4.3-r3, 1.5.22 virtual/os-headers: 2.6.11-r2 ACCEPT_KEYWORDS="x86" AUTOCLEAN="yes" CBUILD="i686-pc-linux-gnu" CFLAGS="-O2 -march=pentium3 -fomit-frame-pointer" CHOST="i686-pc-linux-gnu" CONFIG_PROTECT="/etc /usr/kde/2/share/config /usr/kde/3/share/config /usr/share/config /var/bind /var/qmail/alias /var/qmail/control" CONFIG_PROTECT_MASK="/etc/gconf /etc/terminfo /etc/env.d" CXXFLAGS="-O2 -march=pentium3 -fomit-frame-pointer" DISTDIR="/usr/portage/distfiles" FEATURES="autoconfig ccache distcc distlocks sandbox sfperms strict" GENTOO_MIRRORS="http://distfiles.gentoo.org http://distro.ibiblio.org/pub/linux/distributions/gentoo" MAKEOPTS="-j3" PKGDIR="/usr/portage/packages" PORTAGE_TMPDIR="/var/tmp" PORTDIR="/usr/portage" SYNC="rsync://rsync.gentoo.org" USE="x86 acl alsa apache2 apm arts avi berkdb bitmap-fonts bzip2 crypt eds emboss encode esd expat foomaticdb gdbm gif gpm gstreamer gtk2 idn imap imlib innodb ipv6 jpeg libg++ libwww mad mikmod mmx motif mp3 mpeg mysql ncurses nls nptl ogg opengl oss pam pdflib perl png python qt quicktime readline samba sdl spell sse ssl tcpd truetype truetype-fonts type1-fonts udev vorbis xml xml2 xmms xv zlib userland_GNU kernel_linux elibc_glibc" Unset: ASFLAGS, CTARGET, LANG, LC_ALL, LDFLAGS, LINGUAS, PORTDIR_OVERLAY
Maybe just look into /etc/make.conf.example next time to learn how to setup rsync mirrors properly... SYNC="rsync://rsync.gentoo.org/gentoo-portage"
although there was a temporary error in my make.conf which has created some confusion, this bug is still alive. the temporary error was caused by me trying different rsync servers while exploring this bug. the real bug is send/receive timeouts in io.c for the rsync program. and i'm finding very odd results on the net when i search for others with this problem: it's old and infrequent. but in my case it's effecting 3 servers. is this possibly a ban list problem? this is what happens: # emerge --sync >>> starting rsync with rsync://134.68.220.97/gentoo-portage... >>> checking server timestamp ... Welcome to hawk.gentoo.org Server Address : 134.68.220.97 Contact Name : mirror-admin@gentoo.org Hardware : 1 x Intel(R) Pentium(R) 4 CPU 2.40GHz, 2176MB RAM Please note: common gentoo-netiquette says you should not sync more than once a day. Users who abuse the rsync.gentoo.org rotation may be added to a temporary ban list. MOTD brought to you by motd-o-matic, version 0.3 io timeout after 180 seconds - exiting rsync error: timeout in data send/receive (code 30) at io.c(109) >>> retry ... >>> Starting retry 1 of 3 with rsync://140.211.166.165/gentoo-portage >>> checking server timestamp ... Welcome to raptor.gentoo.org Server Address : 140.211.166.165 Contact Name : mirror-admin@gentoo.org Hardware : 2 x Pentium III (Katmai), 2432MB RAM Please note: common gentoo-netiquette says you should not sync more than once a day. Users who abuse the rsync.gentoo.org rotation may be added to a temporary ban list. MOTD brought to you by motd-o-matic, version 0.3 io timeout after 180 seconds - exiting rsync error: timeout in data send/receive (code 30) at io.c(109) >>> retry ... >>> Starting retry 2 of 3 with rsync://38.99.64.200/gentoo-portage >>> checking server timestamp ... Welcome to cockatoo.gentoo.org Server Address : 65.19.163.230 Contact Name : mirror-admin@gentoo.org Hardware : 2 x Intel(R) Pentium(R) 4 CPU 2.80GHz, 1024MB RAM Please note: common gentoo-netiquette says you should not sync more than once a day. Users who abuse the rsync.gentoo.org rotation may be added to a temporary ban list. MOTD brought to you by motd-o-matic, version 0.3 io timeout after 180 seconds - exiting rsync error: timeout in data send/receive (code 30) at io.c(109) >>> retry ... >>> Starting retry 3 of 3 with rsync://64.127.121.98/gentoo-portage >>> checking server timestamp ... Welcome to owl.gentoo.org Server Address : 64.127.121.98 Contact Name : mirror-admin@gentoo.org Hardware : 4 x Intel(R) Xeon(TM) CPU 2.40GHz, 1024MB RAM Please note: common gentoo-netiquette says you should not sync more than once a day. Users who abuse the rsync.gentoo.org rotation may be added to a temporary ban list. MOTD brought to you by motd-o-matic, version 0.3 io timeout after 180 seconds - exiting rsync error: timeout in data send/receive (code 30) at io.c(109) !!! Rsync has not successfully finished. It is recommended that you keep !!! trying or that you use the 'emerge-webrsync' option if you are unable !!! to use rsync due to firewall or other restrictions. This should be a !!! temporary problem unless complications exist with your network !!! (and possibly your system's filesystem) configuration.
I'm sorry, fix your rsync client/your firewall/your network/change your ISP or whatever else you have broken on *your* side. Don't you just think that if NONE of the Gentoo mirrors was working, there'd about about *zillion* users reporting such issue, and NOT just you?! INVALID.
Closed.
no, i'm sorry, but there's a problem. this issue happens at 2 different sites. both sites have different firewall setups and different ISPs. both sites worked for over 1 year and both sites failed with this issue during the same time. unfortunately i can't pin point exactly which emerge -uvD world triggered this. so i'd say that rules out firewall/network/ISP and leaves only the rsync package itself. and i'm not the only one with this problem, it's seems to be a rare condition but i'm not the only one, search google with the following keywords: gentoo rsync io.c i think the result titled "will broken rsync be the demise of Gentoo?" is funny. what i don't think is funny is my 3 broken servers and the fact that when i come here with a bug i get an attitude. i'm sorry that you see so many false bugs that your first two reactions are to think i'm some kind of idiot. so moving forward, the only thing i can come up with is the so called temporary ban list. i can't find anything about it on the gentoo site. how do i find out if i'm on the list?
Yeah, if you have been hammering mirrors because of your completely invalid configuration on multiple boxes, you can be on ban list. Contact the admins of those mirrors to find out or switch to different mirros...
.
well the thing is that i run my own gentoo rsync mirror just so that i don't hammer the mirrors and my little set up has been working for over 1 year. this problem just started "out of the blue" and of course i did not have invalid configurations UNLESS the configuration spec changed without my knowledge. while trying to explore this problem, i've tried several configurations, and i apologize if i've been hitting the mirrors too much this week. i emailed mirror-admin@gentoo.org, to see if i'm on the ban list and i pray that i am because if not, we're gonna hash this out on bugzilla.
FINALLY i'm 98% sure i was on the ban list for rsync.gentoo.org. i switched to rsync://rsync.us.gentoo.org and they seem to like me thanks for your time
I also have this problem, and I have tried all these rsync servers, no one can succeed, all failed with timeouts, my gentoo box was installed on this October, and since then just very few times emerge --sync succeeded, but till today it seems never succeed, just failed for at least 10 days, I don't know why; my internet seems good, I can rsync from other internet sites, from /usr/share/portage/config/make.conf.example # Default: "rsync://rsync.gentoo.org/gentoo-portage" # North America: "rsync://rsync.namerica.gentoo.org/gentoo-portage" # South America: "rsync://rsync.samerica.gentoo.org/gentoo-portage" # Europe: "rsync://rsync.europe.gentoo.org/gentoo-portage" # Asia: "rsync://rsync.asia.gentoo.org/gentoo-portage" # Australia: "rsync://rsync.au.gentoo.org/gentoo-portage"
