Gentoo Websites Logo
Go to: Gentoo Home Documentation Forums Lists Bugs Planet Store Wiki Get Gentoo!
Bug 278403 - [rsync] New UK mirror (rsync3.uk.gentoo.org)
Summary: [rsync] New UK mirror (rsync3.uk.gentoo.org)
Status: RESOLVED FIXED
Alias: None
Product: Mirrors
Classification: Unclassified
Component: New Server (show other bugs)
Hardware: x86 Linux
: High normal (vote)
Assignee: Mirror Admins
URL:
Whiteboard: due:2009/10/19;dist:||;portage:rsync....
Keywords:
Depends on:
Blocks:
 
Reported: 2009-07-20 10:14 UTC by Jon Starling
Modified: 2009-10-27 19:26 UTC (History)
0 users

See Also:
Package list:
Runtime testing required: ---


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Jon Starling 2009-07-20 10:14:17 UTC
New UK rsync mirror:

rsync://rsync.star.net.uk/gentoo-portage/

Location: Gloucester, UK
Host: rsync.star.net.uk / 89.206.169.171 / 2a00:ed0:1::873
Hardware: VMWARE ESX VM (Currently allocated 1 core @ Intel(R) Xeon(TM) CPU 3.06GHz and 1GB RAM)
Bandwidth: 1Gbps
Max Connections: 50
Contact: rsync@star.net.uk

Currently syncing @ 03:00 UTC with rsync.de.gentoo.org pending permission to sync with rsync1.us.gentoo.org on a twice hourly basis.

Reproducible: Always
Comment 1 Jeremy Olexa (darkside) (RETIRED) archtester gentoo-dev Security 2009-10-01 05:13:49 UTC
Hello, the mirror-admin team has been understaffed. I see your mirror is still up to date. I will add it to the test system soon. We could use a new mirror added to the uk rotation! :)
Comment 2 Jeremy Olexa (darkside) (RETIRED) archtester gentoo-dev Security 2009-10-05 02:59:53 UTC
You are in our testing system now.
Comment 3 Jeremy Olexa (darkside) (RETIRED) archtester gentoo-dev Security 2009-10-13 04:33:37 UTC
Your mirror generally looks fine. A few times it is lagging by an hour or so.
Comment 4 Jon Starling 2009-10-14 11:06:51 UTC
Odd, The server only syncs with rsync.de.gentoo.org only once every 24 hours @ 03:00 (UTC).

The rsync-gentoo-portage.sh.log is showing that the sync with rsync.de.gentoo.org takes anything upto a minute to complete:

Started update at Mon Oct 5 03:00:01 UTC 2009
End: Mon Oct 5 03:00:16 UTC 2009
Started update at Tue Oct 6 03:00:01 UTC 2009
End: Tue Oct 6 03:01:05 UTC 2009
Started update at Wed Oct 7 03:00:01 UTC 2009
End: Wed Oct 7 03:00:40 UTC 2009
Started update at Thu Oct 8 03:00:01 UTC 2009
End: Thu Oct 8 03:00:28 UTC 2009
Started update at Fri Oct 9 03:00:01 UTC 2009
End: Fri Oct 9 03:00:38 UTC 2009
Started update at Sat Oct 10 03:00:02 UTC 2009
End: Sat Oct 10 03:01:24 UTC 2009
Started update at Sun Oct 11 03:00:01 UTC 2009
End: Sun Oct 11 03:00:32 UTC 2009
Started update at Mon Oct 12 03:00:02 UTC 2009
End: Mon Oct 12 03:00:28 UTC 2009
Started update at Tue Oct 13 03:00:02 UTC 2009
End: Tue Oct 13 03:00:57 UTC 2009
Started update at Wed Oct 14 03:00:01 UTC 2009
End: Wed Oct 14 03:00:23 UTC 2009

I can see what I assume is the testing system connecting in the rsync logs at ~03:11 (UTC) every day since 2009/10/05.

Given these timings, I'd assume that if I was going to be out of date at all that it would be by more than a few hours?  Is it possible that rsync.de.gentoo.org is introducing the lag?  I can configure an alternative source if recommended.
Comment 5 Robin Johnson archtester Gentoo Infrastructure gentoo-dev Security 2009-10-14 17:55:53 UTC
Err, it should be syncing every 30 minutes.

darkside: maybe time to get mirrormon going better again... as GARD missed this.
Comment 6 Jon Starling 2009-10-14 22:47:15 UTC
Not wanting to appear dumb, but I just want to clarify your response...  Are you saying that I should be syncing every 30 mins with rsync.de.gentoo.org on a twice hourly basis?  Or should I now be syncing with rsync1.us.gentoo.org.
Comment 7 Jeremy Olexa (darkside) (RETIRED) archtester gentoo-dev Security 2009-10-15 00:23:21 UTC
(In reply to comment #6)
> Not wanting to appear dumb, but I just want to clarify your response...  Are
> you saying that I should be syncing every 30 mins with rsync.de.gentoo.org on a
> twice hourly basis?  Or should I now be syncing with rsync1.us.gentoo.org.
> 

Hi, 
Robin was pointing out that your mirror should be syncing every 30 minutes to rsync.de.gentoo.org and our current testing system does not catch such cases. Procedure is documented here: http://www.gentoo.org/doc/en/rsync.xml but I do know that it can be better. I'll work on that.

Feel free to ask any other questions.
Comment 8 Jon Starling 2009-10-20 09:47:02 UTC
Okay,

I've been syncing with rsync.de.gentoo.org every 30 minutes since 09:00 UTC on 2009-10-15.  Are you seeing any improvement in the lag?
Comment 9 Jeremy Olexa (darkside) (RETIRED) archtester gentoo-dev Security 2009-10-24 01:59:20 UTC
huh, it has gotten worse.

278403  rsync   ERROR   Portage at rsync://rsync.star.net.uk is lagging (delta is 00d 15h 42m 19s)

but another mirror had a very similar lag time. There must be a mirror in the de rotation that is lagging. I'll check again on another time/day.
Comment 10 Jeremy Olexa (darkside) (RETIRED) archtester gentoo-dev Security 2009-10-27 19:10:30 UTC
Thanks for helping out Gentoo. I have added the IP you specified in the bug to our access database, please start syncing to rsync1.us.gentoo.org per our rsync document at http://www.gentoo.org/doc/en/rsync.xml. We would like you to subscribe to the gentoo-mirrors Mailing List by sending an email to gentoo-mirrors+subscribe@lists.gentoo.org, as we send our notifications of updates, releases, and changes in policy to the mirrors. Once again, thanks for the hardware and bandwidth! You are mirror rsync3.uk.gentoo.org in the rsync.uk.gentoo.org rotation and have been added to the rsync.europe.gentoo.org rotation as well.