Gentoo Websites Logo
Go to: Gentoo Home Documentation Forums Lists Bugs Planet Store Wiki Get Gentoo!
Bug 22777 - Automatic distfiles mirror redirector
Summary: Automatic distfiles mirror redirector
Status: RESOLVED FIXED
Alias: None
Product: Portage Development
Classification: Unclassified
Component: Enhancement/Feature Requests (show other bugs)
Hardware: All Linux
: High enhancement (vote)
Assignee: Kurt Lieber (RETIRED)
URL:
Whiteboard:
Keywords:
Depends on:
Blocks:
 
Reported: 2003-06-13 13:19 UTC by bdonlan
Modified: 2011-10-30 22:35 UTC (History)
6 users (show)

See Also:
Package list:
Runtime testing required: ---


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description bdonlan 2003-06-13 13:19:31 UTC
There should be a script at gentoo.org (or some other server) that will expand
some URL, e.g. http://gentoo.org/distfiles/foobar.tgz into a full distfiles
mirror URL, via a 3xx redirect, e.g. to
http://gentoo.oregonstate.edu/distfiles/foobar.tgz

This would allow one distfile URL to be included in the defaults that will
automatically select a random mirror.
Comment 1 Nicholas Jones (RETIRED) gentoo-dev 2003-06-14 10:58:36 UTC
Opinions?
Comment 2 Kurt Lieber (RETIRED) gentoo-dev 2003-06-15 08:09:06 UTC
Personally, I would rather implement a DNS-based round-robin solution, similar to what we do for rsync.  I'm actually already working with OSU and Indiana University to set up a proof-of-concept of this idea.

The end result from a user's POV would be the same -- one URL would be entered as the GENTOO_MIRRORS variable (http://master.gentoo.org or something similar) and DNS would handle the rest.

This would allow us to maintain server-side control over mirrors to easily yank problematic ones out of the rotation and we can also take advantage of some of the  advanced features of UltraDNS.

My $.02.

--kurt
Comment 3 Marius Mauch (RETIRED) gentoo-dev 2003-10-11 01:36:03 UTC
Any progress on this ?
Comment 4 Kurt Lieber (RETIRED) gentoo-dev 2003-10-11 04:02:10 UTC
http://distfiles.gentoo.org/ is a proof-of-concept of the DNS solution I
was talking about.  Currently, it has two mirrors: OSU and IU.
Comment 5 Kurt Lieber (RETIRED) gentoo-dev 2003-10-12 10:03:07 UTC
reassigning since this doesn't directly involve portage
Comment 6 Kurt Lieber (RETIRED) gentoo-dev 2003-10-12 10:05:18 UTC
corey -- think we can work on getting a few other mirrors involved in the
distfiles.g.o round robin?  Maybe gatech?  (and I think kveton knows a guy
at UCSB)
Comment 7 Lance Albertson (RETIRED) gentoo-dev 2005-01-31 08:04:10 UTC
Hasn't this been resolved recently, or is it still being tested?
Comment 8 Kurt Lieber (RETIRED) gentoo-dev 2005-05-17 13:45:56 UTC
Corey has something up and working in beta right now.  Not yet ready for public
consumption.
Comment 9 Marius Mauch (RETIRED) gentoo-dev 2006-02-16 15:21:11 UTC
Using distfiles.gentoo.org now for some time.