Gentoo Websites Logo
Go to: Gentoo Home Documentation Forums Lists Bugs Planet Store Wiki Get Gentoo!
Bug 62331 - p2p distfiles mirror
Summary: p2p distfiles mirror
Status: RESOLVED LATER
Alias: None
Product: Gentoo Linux
Classification: Unclassified
Component: Current packages (show other bugs)
Hardware: All All
: High normal (vote)
Assignee: Jon Hood (RETIRED)
URL:
Whiteboard:
Keywords:
Depends on:
Blocks:
 
Reported: 2004-08-30 19:59 UTC by Jon Hood (RETIRED)
Modified: 2005-07-27 07:04 UTC (History)
4 users (show)

See Also:
Package list:
Runtime testing required: ---


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Jon Hood (RETIRED) gentoo-dev 2004-08-30 19:59:28 UTC
This bug is to track progress on the p2p distfiles mirror. Here are my ideas:
1) People have been concentrating on bittorrent for this kind of mirror- this is not the way to go. A custom-configured giftd would be easiest.
2) This mirror method would not be available by default, it would be mergeable by app-portage/p2pmirror or something like that, then the FETCH_COMMAND would be changed in make.conf.
3) The FETCH_COMMAND would be a simple script that checked all existing giftd processes for the one with the gentoo configuration, and if this one could not be found, a new giftd process would be started with said configuration.
4) If after a set time period the download does not commence, a simple wget from the SRC_URI would be used.

I will work on the code as I have time, but I wanted to throw the ideas I had out there in case anyone else had something interesting to add.
Comment 1 Jon Hood (RETIRED) gentoo-dev 2004-09-02 11:26:14 UTC
Work has started, but the problem I am having is that the file the script is going to need to download must check the file before downloading it to make sure it is the right one. I recommend doing this by sending the download script the size of the file. I could make the script read from the digest in the /files directory of the package; any suggestions on this?
As of right now, all the script does is search for the file from the gift daemon and return the URL in a format that can be sent right back to the gift daemon to download the file: http://portage.squinky.gotdns.com/projects/p2phportage.phps note that this script is VERY incomplete and only meant to be a proof of concept.
e.x.:
<start giftd>
$ ./p2phportage.php monkeys a

That second parameter will be either the file size or the path to the ebuild so that the script can read the digest file to get the filesize from there- whichever is easier to implement.
Comment 2 Brian Harring (RETIRED) gentoo-dev 2005-02-28 01:02:00 UTC
This is external from portage, portage integration pretty much comes down to a custom FETCHCOMMAND, or a sync module for cvs head... so, yanking portage from cc.

Poke us if this gets going.
Comment 3 Jakub Moc (RETIRED) gentoo-dev 2005-07-27 07:04:59 UTC
wrt Bug 45935, probably not going to happen, unless someone takes over this
idea... Marking LATER.