Bug 300615

Summary:	mirror gentoo.mneisen.org does not work with the axel (net-misc/axel) download accelerator
Product:	Mirrors	Reporter:	Fitzgerald Krudde <gentoo>
Component:	Server Problem	Assignee:	Mirror Admins <mirror-admin>
Status:	RESOLVED INVALID
Severity:	minor
Priority:	High
Version:	unspecified
Hardware:	All
OS:	Linux
Whiteboard:
Package list:		Runtime testing required:	---

Description Fitzgerald Krudde 2010-01-11 18:44:56 UTC

The mirror gentoo.mneisen.org does not work with the axel (net-misc/axel) download accelerator. 

I use 4 connections. Only one is succesfull. The others receive a http 503 response code repeatedly.

As Axel is pretty persistent I have just issued 18725 requests to http://gentoo.mneisen.org/distfiles/mpfr-2.4.2.tar.bz2 before the request were processed succesfully by mneisen.org.

As I have this problem only with the mneisen.org mirror I suspect the problem is there.

I could remove the mirror gentoo.mneisen.org from my /etc/make.conf but I have mirrorselect in my crontab so this only works temporarily.

Reproducible: Always

Steps to Reproduce:
1. setup the mirror gentoo.mneisen.org in /etc/make.conf
2. use axel as accelerator (net-misc/axel)
3. perform an emerge 

Actual Results:  
4 succesfull http requests

Expected Results:  
18725 http requests

Comment 1 Jeremy Olexa (darkside) (RETIRED) archtester

2010-02-18 21:31:34 UTC

Thanks for the notice, I'll have to see what our policy is but I'm pretty sure we don't care about the connection limit dictated by community mirrors. Afterall, THEY are the ones graciously providing hardware and bandwidth. :)

Comment 2 Robin Johnson archtester

2010-02-26 22:24:39 UTC

1. I'm not sure that abusing mirrors w/ axel is a good idea.
2. We don't require that mirrors support HTTP continuation, so axel is overkill, limit yourself to concurrent connection per mirror per file.