Bug 22777 – Automatic distfiles mirror redirector

• Product: Portage Development
• Status: RESOLVED FIXED

[Description bdonlan 2003-06-13 13:19:31 UTC]

There should be a script at gentoo.org (or some other server) that will expand
some URL, e.g. http://gentoo.org/distfiles/foobar.tgz into a full distfiles
mirror URL, via a 3xx redirect, e.g. to
http://gentoo.oregonstate.edu/distfiles/foobar.tgz

This would allow one distfile URL to be included in the defaults that will
automatically select a random mirror.

[Comment 1 Nicholas Jones (RETIRED) 2003-06-14 10:58:36 UTC]

Opinions?

[Comment 2 Kurt Lieber (RETIRED) 2003-06-15 08:09:06 UTC]

Personally, I would rather implement a DNS-based round-robin solution, similar to what we do for rsync.  I'm actually already working with OSU and Indiana University to set up a proof-of-concept of this idea.

The end result from a user's POV would be the same -- one URL would be entered as the GENTOO_MIRRORS variable (http://master.gentoo.org or something similar) and DNS would handle the rest.

This would allow us to maintain server-side control over mirrors to easily yank problematic ones out of the rotation and we can also take advantage of some of the  advanced features of UltraDNS.

My $.02.

--kurt

[Comment 3 Marius Mauch (RETIRED) 2003-10-11 01:36:03 UTC]

Any progress on this ?

[Comment 4 Kurt Lieber (RETIRED) 2003-10-11 04:02:10 UTC]

http://distfiles.gentoo.org/ is a proof-of-concept of the DNS solution I
was talking about.  Currently, it has two mirrors: OSU and IU.

[Comment 5 Kurt Lieber (RETIRED) 2003-10-12 10:03:07 UTC]

reassigning since this doesn't directly involve portage

[Comment 6 Kurt Lieber (RETIRED) 2003-10-12 10:05:18 UTC]

corey -- think we can work on getting a few other mirrors involved in the
distfiles.g.o round robin?  Maybe gatech?  (and I think kveton knows a guy
at UCSB)

[Comment 7 Lance Albertson (RETIRED) 2005-01-31 08:04:10 UTC]

Hasn't this been resolved recently, or is it still being tested?

[Comment 8 Kurt Lieber (RETIRED) 2005-05-17 13:45:56 UTC]

Corey has something up and working in beta right now.  Not yet ready for public
consumption.

[Comment 9 Marius Mauch (RETIRED) 2006-02-16 15:21:11 UTC]

Using distfiles.gentoo.org now for some time.