On Wed, Jul 29, 2009 at 11:58:56AM +0200, Adrian Reber wrote: > I have trouble with a few portage master mirrors I am connecting > to.I am syncing my mirror from rsync.gentoo.org and most of the time > it works... But not always, it looks like I am added to some temporary > blacklist. Yes, you're ending up on the abuse detection blacklist. > Here is an overview of my rsync attempts: > http://ftp-stud.hs-esslingen.d/info/status.php4?details=47 > I am mirroring gentoo-portage every 30 minutes. Is this still the > right interval? It's the use of the wrong tier. The rsync.g.o rotation is intended for users that don't want to fetch from a community-provided mirror. You should be syncing against rsync1.gentoo.org. I don't see your IP on the whitelist, so please file a bug for mirror-admins to get you on there. -- Robin Hugh Johnson Reproducible: Always Steps to Reproduce: Please add my mirror (129.143.116.10) to the whitelist of rsync1.gentoo.org
Hi, sorry for the delay. The mirror-admin team has been understaffed. I don't understand this request. Are you a new gentoo-portage mirror or an existing mirror that moved?
Thanks for the reply. I am long time gentoo mirror but my portage mirror has the wrong setup for all the years I am running it. I always run rsync against rsync.gentoo.org which seems to be the wrong 'host' for mirrors to sync from. If you look at the logs at http://ftp-stud.hs-esslingen.d/info/status.php4?details=47 you can see that some of my syncs are not successful because some mirrors ban me if I am syncing more than once per day. As it is required for mirrors to sync every 30 minutes some mirrors ban me. That is the reason why I am asking to sync directly from rsync1.gentoo.org (assuming that is the right master mirror for portage).
(In reply to comment #2) > Thanks for the reply. I am long time gentoo mirror but my portage mirror has > the wrong setup for all the years I am running it. I always run rsync against > rsync.gentoo.org which seems to be the wrong 'host' for mirrors to sync from. Yea, that is incorrect. Please sync from rsync.de.gentoo.org until you are official. The rsync.gentoo.org rotation will ban you if you sync too often. > > If you look at the logs at > http://ftp-stud.hs-esslingen.d/info/status.php4?details=47 > you can see that some of my syncs are not successful because some mirrors ban > me if I am syncing more than once per day. As it is required for mirrors to > sync every 30 minutes some mirrors ban me. That is the reason why I am asking > to sync directly from rsync1.gentoo.org (assuming that is the right master > mirror for portage). It is actually rsync1.us.gentoo.org as the master mirror. But you need to be on the ACL for that. Once you complete the testing process, you will be an official gentoo-portage rsync mirror. I'm assuming you *DO* want official status? Please provide the following info for our records: * Official mirror name * Mirror type: distfiles/releases, gentoo-portage. NOTE: gentoo-portage is always rsync only. * URLs: full protocol and path for release/distfile mirrors, hostname or IP for gentoo-portage mirrors * Hardware specifications * Bandwidth specifications * Location * Intended concurrent users (for each protocol, mirror type) * Admin contact I added your mirror to the testing system now.
(In reply to comment #3) > (In reply to comment #2) > > Thanks for the reply. I am long time gentoo mirror but my portage mirror has > > the wrong setup for all the years I am running it. I always run rsync against > > rsync.gentoo.org which seems to be the wrong 'host' for mirrors to sync from. > > Yea, that is incorrect. Please sync from rsync.de.gentoo.org until you are > official. The rsync.gentoo.org rotation will ban you if you sync too often. Okay, I switched to rsync.de.gentoo.org for now. > > If you look at the logs at > > http://ftp-stud.hs-esslingen.d/info/status.php4?details=47 > > you can see that some of my syncs are not successful because some mirrors ban > > me if I am syncing more than once per day. As it is required for mirrors to > > sync every 30 minutes some mirrors ban me. That is the reason why I am asking > > to sync directly from rsync1.gentoo.org (assuming that is the right master > > mirror for portage). > > It is actually rsync1.us.gentoo.org as the master mirror. But you need to be on > the ACL for that. Once you complete the testing process, you will be an > official gentoo-portage rsync mirror. I'm assuming you *DO* want official > status? Yes, official status is intended. > Please provide the following info for our records: > > * Official mirror name ftp-stud.hs-esslingen.de > * Mirror type: distfiles/releases, gentoo-portage. NOTE: gentoo-portage is > always rsync only. distfiles/releases, gentoo-portage > * URLs: full protocol and path for release/distfile mirrors, hostname or IP > for gentoo-portage mirrors distfiles/releases: http://ftp-stud.hs-esslingen.de/pub/Mirrors/gentoo/ ftp://ftp-stud.hs-esslingen.de/pub/Mirrors/gentoo/ rsync://ftp-stud.hs-esslingen.de/gentoo/ gentoo-portage: ftp-stud.hs-esslingen.de > * Hardware specifications quad dual core opteron, 44GB RAM, 12TB storage http://ftp-stud.hs-esslingen.de/info/system.php4 > * Bandwidth specifications 2 GBit/s > * Location Esslingen, Germany > * Intended concurrent users (for each protocol, mirror type) rsync: 40 ftp: 250 http: 1024 > * Admin contact Adrian Reber <adrian@lisas.de> > I added your mirror to the testing system now. Thanks. I have already access to masterdistfiles.gentoo.org and I am listed at http://www.gentoo.org/main/en/mirrors2.xml. Maybe the URL there could also be changed from ftp-stud.fht-esslingen.de to ftp-stud.hs-esslingen.de.
Thanks for the info. (In reply to comment #4) > > I added your mirror to the testing system now. > > Thanks. I have already access to masterdistfiles.gentoo.org and I am listed at > http://www.gentoo.org/main/en/mirrors2.xml. Maybe the URL there could also be > changed from ftp-stud.fht-esslingen.de to ftp-stud.hs-esslingen.de. Ok, changed.
Quite often your mirror is lagging by an hour. Are you still having issues with rsync.de.gentoo.org rotation?
(In reply to comment #6) > Quite often your mirror is lagging by an hour. Are you still having issues with > rsync.de.gentoo.org rotation? No, there are no more errors. I am syncing every 30 minutes and it works every time. You can see the results of my last 100 syncs always at: http://ftp-stud.hs-esslingen.de/info/status.php4?details=47 Clicking the "log" link will show you the rsync output.
Ok, good. Sometimes the mirror you hit in the rotation might be lagging alittle. Once you get access to the master mirror, it shouldn't be a problem.
Thanks for helping out Gentoo. I have added the IP you specified in the bug to our access database, please start syncing to rsync1.us.gentoo.org per our rsync document at http://www.gentoo.org/doc/en/rsync.xml. We would like you to subscribe to the gentoo-mirrors Mailing List by sending an email to gentoo-mirrors+subscribe@lists.gentoo.org, as we send our notifications of updates, releases, and changes in policy to the mirrors. Once again, thanks for the hardware and bandwidth! You are mirror rsync9.de.gentoo.org in the rsync.de.gentoo.org rotation and have been added to the rsync.europe.gentoo.org rotation as well. Feel free to let us know if you have any other questions.
