Gentoo Websites Logo
Go to: Gentoo Home Documentation Forums Lists Bugs Planet Store Wiki Get Gentoo!
Bug 494858 - profile/thirdpartymirrors - obsolete/dead mirrors in openbsd mirror group
Summary: profile/thirdpartymirrors - obsolete/dead mirrors in openbsd mirror group
Status: RESOLVED FIXED
Alias: None
Product: Gentoo Linux
Classification: Unclassified
Component: Eclasses (show other bugs)
Hardware: All Linux
: Normal normal
Assignee: Gentoo Quality Assurance Team
URL:
Whiteboard:
Keywords:
Depends on:
Blocks: thirdpartymirrors-13
  Show dependency tree
 
Reported: 2013-12-20 16:41 UTC by Ben Kohler
Modified: 2017-06-13 13:19 UTC (History)
4 users (show)

See Also:
Package list:
Runtime testing required: ---


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Ben Kohler gentoo-dev 2013-12-20 16:41:11 UTC
Hello,

63 of 67 mirrors in the 'openbsd' mirror group in profiles/thirdpartymirrors file appear to be dead.  These were checked as part of an analysis of all third party mirror lists.  The dead mirrors should probably be removed, and there may be a more up to date mirror list upstream that can be used.  Here is a status of all 'openbsd' mirrors:

good: ftp://ftp.openbsd.org/pub/OpenBSD
bad:  ftp://ftp.it.net.au/mirrors/OpenBSD
bad:  ftp://openbsd.wiretapped.net/pub/OpenBSD
bad:  ftp://gd.tuwien.ac.at/opsys/OpenBSD
bad:  ftp://playboy.wu-wien.ac.at/pub/OpenBSD
good: ftp://ftp.ca.openbsd.org/pub/OpenBSD
bad:  ftp://ftp.shellhung.org/pub/OpenBSD
bad:  ftp://ftp.jaquet.dk/pub/openSSH/portable
bad:  ftp://ftp.fi.debian.org/pub/OpenBSD
bad:  ftp://ftp.ac-creteil.fr/OpenBSD
good: ftp://ftp.fr.openbsd.org/pub/OpenBSD
bad:  ftp://ftp.club-internet.fr/pub/OpenBSD
bad:  ftp://ftp.de.openbsd.org/pub/OpenBSD
bad:  ftp://ftp.tu-clausthal.de/pub/OpenBSD
bad:  ftp://ftp.freenet.de/pub/ftp.openbsd.org/pub/OpenBSD
bad:  ftp://ftp-stud.fht-esslingen.de/pub/OpenBSD
bad:  ftp://pandemonium.tiscali.de/pub/OpenBSD
bad:  ftp://ftp.taubenschlag.uni-frankfurt.de/pub/mirror/ftp.openssh.com/portable
bad:  ftp://openbsd.bay13.net/pub/OpenBSD
bad:  ftp://ftp.uni-stuttgart.de/pub/OpenBSD
bad:  ftp://ftp.fh-wolfenbuettel.de/pub/os/openbsd
bad:  ftp://filoktitis.noc.uoa.gr/pub/OpenBSD
bad:  ftp://ftp.physics.auth.gr/pub/mirrors/OpenBSD/OpenBSD
bad:  ftp://ftp.duth.gr/pub/OpenBSD
bad:  ftp://ftp.fsn.hu/pub/OpenBSD
bad:  ftp://ftp.esat.net/pub/OpenBSD
bad:  ftp://ftp.netlab.is.tsukuba.ac.jp/pub/os/OpenBSD
bad:  ftp://ftp.iij.ad.jp/pub/OpenBSD
bad:  ftp://ftp.jp.openbsd.org/pub/OpenBSD
bad:  ftp://ftp.kddlabs.co.jp/OpenBSD
bad:  ftp://ftp.nl.uu.net/pub/OpenBSD
bad:  ftp://ftp.calyx.nl/pub/OpenBSD
bad:  ftp://ftp.nluug.nl/pub/OpenBSD
bad:  ftp://mirror.widexs.nl/pub
bad:  ftp://ftp.inet.no/pub/OpenBSD
bad:  ftp://ftp.uninett.no/pub/OpenBSD
bad:  ftp://sunsite.icm.edu.pl/pub/OpenBSD
bad:  ftp://ftp.task.gda.pl/pub/OpenBSD
bad:  ftp://ftp.physics.uvt.ro/pub/OpenBSD
bad:  ftp://ftp.gamma.ru/pub/OpenBSD
bad:  ftp://ftp.radio-msu.net/pub/OpenBSD
bad:  ftp://ftp.isu.net.sa/pub/ftp.openbsd.org/OpenBSD
bad:  ftp://ftp.rediris.es/mirror/OpenBSD
bad:  ftp://ftp.stacken.kth.se/pub/OpenBSD
bad:  ftp://ftp.sunet.se/pub/OpenBSD
bad:  ftp://mirror.pudas.net/OpenBSD
bad:  ftp://ftp.solnet.ch/mirror/OpenBSD
bad:  ftp://sunsite.cnlab-switch.ch/pub/OpenBSD
bad:  ftp://openbsd.csie.nctu.edu.tw/pub/OpenBSD
bad:  ftp://openbsd.nsysu.edu.tw/pub/OpenBSD
bad:  ftp://ftp.tku.edu.tw/pub/OpenBSD
bad:  ftp://ftp.linux.org.tr/OpenBSD
bad:  ftp://ftp.openbsd.org.ua/pub/OpenBSD
bad:  ftp://ftp.plig.org/pub/OpenBSD
good: ftp://ftp3.usa.openbsd.org/pub/OpenBSD
bad:  ftp://mirror.csit.fsu.edu/pub/OpenBSD
bad:  ftp://reflection.ncsa.uiuc.edu/pub/OpenBSD
bad:  ftp://ftp.src.uchicago.edu/pub/OpenBSD
bad:  ftp://rt.fm/pub/OpenBSD
bad:  ftp://ftp.cse.buffalo.edu/pub/OpenBSD
bad:  ftp://ftp.stealth.net/pub/mirrors/ftp.openssh.com/pub/OpenBSD
bad:  ftp://openbsd.mirrors.pair.com
bad:  ftp://carroll.cac.psu.edu/pub/OpenBSD
bad:  ftp://mirrors.rcn.net/pub/OpenBSD
bad:  ftp://openbsd.secsup.org/pub/openbsd
bad:  ftp://ftp.tux.org/bsd/openbsd
bad:  ftp://mirror.cs.wisc.edu/pub/mirrors/OpenBSD

Thanks!
Comment 1 Ben Kohler gentoo-dev 2014-01-06 20:58:46 UTC
My previous test was on an older distfile that many mirrors seem to have pruned.  I've redone the test against the very recent openssh-6.4p1.tar.gz, with somewhat better results: only 48 of 67 mirrors fail.

To rework this list, I started with the upstream mirror list here:
http://www.openbsd.org/ftp.html

From this list, the following mirrors failed my test:

http://mirror.steadynet.cz/pub/OpenBSD/
http://www.ftp.ne.jp/OpenBSD/
http://mirror.corbina.net/pub/OpenBSD/
ftp://mirror.steadynet.cz/pub/OpenBSD/

The following mirrors passed the test:

http://openbsd.org.ar/pub/OpenBSD/
http://mirror.internode.on.net/pub/OpenBSD/
http://mirror.aarnet.edu.au/pub/OpenBSD/
http://ftp.iinet.net.au/pub/OpenBSD/
http://ftp5.eu.openbsd.org/ftp/pub/OpenBSD/
http://ftp2.eu.openbsd.org/pub/OpenBSD/
http://ftp.belnet.be/pub/OpenBSD/
http://openbsd.locaweb.com.br/pub/OpenBSD/
http://mirror.telepoint.bg/OpenBSD/
http://ftp.OpenBSD.org/pub/OpenBSD/
http://athena.caslab.queensu.ca/pub/OpenBSD/
http://mirrors.ucr.ac.cr/OpenBSD/
http://ftp.openbsd.dk/pub/OpenBSD/
http://ftp.aso.ee/pub/OpenBSD/
http://ftp.estpak.ee/pub/OpenBSD/
http://ftp.fr.openbsd.org/pub/OpenBSD/
http://ftp2.fr.openbsd.org/pub/OpenBSD/
http://mirrors.ircam.fr/pub/OpenBSD/
http://openbsd.cs.fau.de/pub/OpenBSD/
http://ftp.spline.de/pub/OpenBSD/
http://ftp.bytemine.net/pub/OpenBSD/
http://ftp.halifax.rwth-aachen.de/openbsd/
http://artfiles.org/openbsd/
http://ftp.cc.uoc.gr/mirrors/OpenBSD/
http://ftp.fsn.hu/pub/OpenBSD/
http://kartolo.sby.datautama.net.id/pub/OpenBSD/
http://ftp.heanet.ie/pub/OpenBSD/
http://ftp.jaist.ac.jp/pub/OpenBSD/
http://ftp.nluug.nl/pub/OpenBSD/
http://ftp.bit.nl/pub/OpenBSD/
http://stingray.cyber.net.pk/pub/OpenBSD/
http://piotrkosoft.net/pub/OpenBSD/
http://ftp.icm.edu.pl/pub/OpenBSD/
http://mirror.yandex.ru/pub/OpenBSD/
http://mirrors.isu.net.sa/pub/ftp.openbsd.org/
http://www.obsd.si/pub/OpenBSD/
http://mirror.is.co.za/mirror/ftp.openbsd.org/
http://ftp.eu.openbsd.org/pub/OpenBSD/
http://mirror.switch.ch/ftp/pub/OpenBSD/
http://ftp.ch.openbsd.org/pub/OpenBSD/
http://www.mirrorservice.org/pub/OpenBSD/
http://mirror.bytemark.co.uk/OpenBSD/
http://mirror.ox.ac.uk/pub/OpenBSD/
http://ftp5.usa.openbsd.org/pub/OpenBSD/
http://ftp3.usa.openbsd.org/pub/OpenBSD/
http://mirror.team-cymru.org/pub/OpenBSD/
http://mirror.planetunix.net/pub/OpenBSD/
http://filedump.se.rit.edu/pub/OpenBSD/
http://openbsd.mirrors.hoobly.com/
http://mirror.ece.vt.edu/pub/OpenBSD/
http://openbsd.mirrors.pair.com/
http://mirrors.gigenet.com/pub/OpenBSD/
http://mirror.esc7.net/pub/OpenBSD/
http://openbsd.mirrorcatalogs.com/pub/OpenBSD/
http://mirrors.nycbug.org/pub/OpenBSD/
http://mirrors.syringanetworks.net/pub/OpenBSD/
http://mirror.jmu.edu/pub/OpenBSD/
http://openbsd.mirror.frontiernet.net/pub/OpenBSD/
ftp://ftp.openbsd.org.ar/pub/OpenBSD/
ftp://mirror.internode.on.net/pub/OpenBSD/
ftp://mirror.aarnet.edu.au/pub/OpenBSD/
ftp://ftp.iinet.net.au/pub/OpenBSD/
ftp://ftp5.eu.openbsd.org/pub/OpenBSD/
ftp://ftp2.eu.openbsd.org/pub/OpenBSD/
ftp://ftp.belnet.be/pub/OpenBSD/
ftp://openbsd.locaweb.com.br/pub/OpenBSD/
ftp://ftp.OpenBSD.org/pub/OpenBSD/
ftp://athena.caslab.queensu.ca/pub/OpenBSD/
ftp://mirrors.ucr.ac.cr/OpenBSD/
ftp://mirror.steadynet.cz/pub/OpenBSD/
ftp://ftp.openbsd.dk/pub/OpenBSD/
ftp://ftp.aso.ee/pub/OpenBSD/
ftp://ftp.estpak.ee/pub/OpenBSD/
ftp://ftp.fr.openbsd.org/pub/OpenBSD/
ftp://ftp2.fr.openbsd.org/pub/OpenBSD/
ftp://mirrors.ircam.fr/pub/OpenBSD/
ftp://ftp.irisa.fr/pub/OpenBSD/
ftp://openbsd.cs.fau.de/pub/OpenBSD/
ftp://ftp.spline.de/pub/OpenBSD/
ftp://ftp-stud.fht-esslingen.de/pub/OpenBSD/
ftp://ftp.bytemine.net/pub/OpenBSD/
ftp://ftp.halifax.rwth-aachen.de/pub/OpenBSD/
ftp://ftp.cc.uoc.gr/mirrors/OpenBSD/
ftp://ftp.fsn.hu/pub/OpenBSD/
ftp://ftp.heanet.ie/pub/OpenBSD/
ftp://ftp.jaist.ac.jp/pub/OpenBSD/
ftp://ftp.nluug.nl/pub/OpenBSD/
ftp://ftp.bit.nl/pub/OpenBSD/
ftp://stingray.cyber.net.pk/OpenBSD/
ftp://ftp.piotrkosoft.net/pub/OpenBSD/
ftp://ftp.icm.edu.pl/pub/OpenBSD/
ftp://mirror.yandex.ru/pub/OpenBSD/
ftp://mirrors.isu.net.sa/pub/ftp.openbsd.org/
ftp://ftp.obsd.si/pub/OpenBSD/
ftp://ftp.is.co.za/mirror/ftp.openbsd.org/
ftp://ftp.eu.openbsd.org/pub/OpenBSD/
ftp://mirror.switch.ch/pub/OpenBSD/
ftp://ftp.ch.openbsd.org/pub/OpenBSD/
ftp://ftp.ulak.net.tr/pub/OpenBSD/
ftp://ftp.mirrorservice.org/pub/OpenBSD/
ftp://mirror.bytemark.co.uk/OpenBSD/
ftp://mirror.ox.ac.uk/pub/OpenBSD/
ftp://ftp5.usa.openbsd.org/pub/OpenBSD/
ftp://ftp3.usa.openbsd.org/pub/OpenBSD/
ftp://mirror.team-cymru.org/pub/OpenBSD/
ftp://mirror.planetunix.net/pub/OpenBSD/
ftp://filedump.se.rit.edu/pub/OpenBSD/
ftp://openbsd.mirrors.pair.com/
ftp://mirror.esc7.net/pub/OpenBSD/
ftp://mirrors.nycbug.org/pub/OpenBSD/
ftp://mirrors.syringanetworks.net/pub/OpenBSD/
ftp://mirror.jmu.edu/pub/OpenBSD/
ftp://openbsd.mirror.frontiernet.net/pub/OpenBSD/


The order of the above lists is just based on the original upstream list, I made no changes there.  The "good" list above should be a good basis for the new openbsd mirror list.
Comment 2 Ben Kohler gentoo-dev 2015-10-21 21:00:15 UTC
This mirror group needs to die.  It's still got way more bad servers than good servers, and it's only used by:

8 net-misc/openssh ebuilds
1 net-misc/openntpd ebuild
1 net-ftp/ncftp ebuild

If we'd like to avoid modifying these ebuilds, a good compromise would be to just reduce the list to a single entry:
openbsd ftp://ftp.openbsd.org/pub/OpenBSD

None of these ebuilds are mirror restricted so I don't think there's any real reason we need to have and maintain a list of several dozen upstream mirrors.

CC'ing openssh maintainers since it's mostly their mirror group
Comment 3 SpanKY gentoo-dev 2015-10-27 04:19:10 UTC
should be simple to just pull the latest list:
http://www.openssh.com/ftp.html
Comment 4 Ben Kohler gentoo-dev 2015-10-27 15:48:26 UTC
But what is the benefit to that?  The vast majority of our users will pull it from gentoo mirrors already.  

I'm not trying to be argumentative, I just think we should step back and consider whether this huge mirror list actually is providing any benefit which would offset the maintenance burden it imposes.
Comment 5 SpanKY gentoo-dev 2015-10-27 16:39:24 UTC
(In reply to Ben Kohler from comment #4)

... except on early/initial releases for the project when the file isn't on our mirrors yet
Comment 6 Ben Kohler gentoo-dev 2015-10-27 17:05:21 UTC
Fair enough.  I'd like to attach a patch with a more current mirror list-- would you prefer that I take the list from upstream as-is, or prune the mirrors that don't appear to be working at this moment?  For example http://ftp.iinet.net.au/pub/OpenBSD/OpenSSH seems to be giving a 403 forbidden error.
Comment 7 Ben Kohler gentoo-dev 2017-06-09 17:18:27 UTC
Ping, any thoughts on this? Are we really sure it's worth maintaining this list just so that in the hour or 2 between a new ebuild and gentoo's mirrors picking it up, there are a few less fetches from upstream's direct source?
Comment 8 Michael Palimaka (kensington) gentoo-dev 2017-06-10 04:49:28 UTC
I don't think there's any point maintaining a mirror group that's used by only three packages.