Gentoo Websites Logo
Go to: Gentoo Home Documentation Forums Lists Bugs Planet Store Wiki Get Gentoo!
Bug 149156 - aria2c as downloadmanager for portage (use multible mirrors at once)
Summary: aria2c as downloadmanager for portage (use multible mirrors at once)
Status: RESOLVED WONTFIX
Alias: None
Product: Portage Development
Classification: Unclassified
Component: Enhancement/Feature Requests (show other bugs)
Hardware: All Linux
: High enhancement (vote)
Assignee: Portage team
URL: http://packages.gentoo.org/package/ap...
Whiteboard:
Keywords:
Depends on:
Blocks:
 
Reported: 2006-09-26 03:07 UTC by Bjoern Olausson
Modified: 2010-10-28 00:25 UTC (History)
4 users (show)

See Also:
Package list:
Runtime testing required: ---


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Bjoern Olausson 2006-09-26 03:07:56 UTC
Hi all,

wouldn't it be a great idea to implement aria2c as download manager for the distfiles? (http://aria2.sourceforge.net/) (http://bugs.gentoo.org/show_bug.cgi?id=134540)

In former times there was prozilla in make.conf, but dueto security issues prozilla has been dropped (good!)

But a real alternative would be aria2c it runs solid on my amd64 and P4 and Thunderbird, it could connect to multible sources at once and helps in this way to distribute load over several mirrors.

IMHO currently it is not possible to specify more than one source with the FETCHCOMMAND like

FETCHCOMMAND /usr/bin/aria2c --max-tries=5 --timeout=10 --dir=\${DISTDIR} \${URI_1} \${URI_2} \${URI_3}

or maybe \${URI_all}

in the future aria2c may act like getright and look up alternate sources on its own..... but I guess not in the next veiw releases...

best regards
Bjoern
Comment 1 Azamat H. Hackimov 2006-12-02 08:18:32 UTC
Hello, I've found script, that can realize this:

http://master.polad.ru/files/fetchscript

from there:
http://gentoo.ru/node/3629 (sorry, only on russian)

Maybe it can help.
Comment 2 UncleOwen 2006-12-02 08:42:16 UTC
Please, don't. Since the total upload of all mirrors stays the same, the only thing you're doing is taking away bandwith from other users. This hurts everyone else.

Oh, and as soon as everyone uses such a tool (or it gets implemented in portage), we'd be back to square one, and it wouldn't benefit anyone anymore. Oh, except that Gentoo users would download faster than users of other distributions... But we don't want that kind of image, do we?
Comment 3 Marius Mauch (RETIRED) gentoo-dev 2006-12-02 12:46:15 UTC
Nothing to do here IMO.
Comment 4 Norman Jonas 2008-02-12 06:02:54 UTC
Never read so many undeliberate answers.

1. People dont emerge more because of a different - [b]faster, more equally distributed, more reliable[/b] -  way of downloading
( if you emerge enemy-territory - which is a 300MB download - the download size is 300 MB no matter how and how fast you download it - its ridiculous that I have to mention it at all )

2. As a conclusion of 1.) the bandwith usage on the servers stays the same

3. There are sometimes servers that are very slow ( up to sticking with almost no download ) and if you catch such a slow server, distributed downloading will not slow down the download despite bad / missing mirrors.

4. bandwith is distributed over servers more fair than with different mirrors only.

5. People with a higher download bandwidth can download files faster 
( Again : A faster download doesnt increase the amount of data downloaded )

I still wait for someone with a true counterargument - right now theres only technical ignorance and prejudices.

Too bad that such people are responsible for develeopment and / or evaluating bugs and closing them.
Comment 5 Norman Jonas 2008-02-12 06:07:15 UTC
In worst case we have to be patiened - I remember when I asked for bzip2 support in manpage compression every gentoo dev jelled at me how useless it is - today its the default because technically its better.
Comment 6 Bjoern Olausson 2008-02-15 07:02:29 UTC
Nice to see that someone agrees with my suggestion.

But lets see what happens.... looks like the decission is made elsewhere.

Regards
Bjoern
Comment 7 Sebastian Pipping gentoo-dev 2010-10-27 21:19:55 UTC
FYI app-portage/fetchcommandwrapper has just been added to the tree.
It uses aria2c to downloads parts from several mirrors.