Hello, 63 of 67 mirrors in the 'openbsd' mirror group in profiles/thirdpartymirrors file appear to be dead. These were checked as part of an analysis of all third party mirror lists. The dead mirrors should probably be removed, and there may be a more up to date mirror list upstream that can be used. Here is a status of all 'openbsd' mirrors: good: ftp://ftp.openbsd.org/pub/OpenBSD bad: ftp://ftp.it.net.au/mirrors/OpenBSD bad: ftp://openbsd.wiretapped.net/pub/OpenBSD bad: ftp://gd.tuwien.ac.at/opsys/OpenBSD bad: ftp://playboy.wu-wien.ac.at/pub/OpenBSD good: ftp://ftp.ca.openbsd.org/pub/OpenBSD bad: ftp://ftp.shellhung.org/pub/OpenBSD bad: ftp://ftp.jaquet.dk/pub/openSSH/portable bad: ftp://ftp.fi.debian.org/pub/OpenBSD bad: ftp://ftp.ac-creteil.fr/OpenBSD good: ftp://ftp.fr.openbsd.org/pub/OpenBSD bad: ftp://ftp.club-internet.fr/pub/OpenBSD bad: ftp://ftp.de.openbsd.org/pub/OpenBSD bad: ftp://ftp.tu-clausthal.de/pub/OpenBSD bad: ftp://ftp.freenet.de/pub/ftp.openbsd.org/pub/OpenBSD bad: ftp://ftp-stud.fht-esslingen.de/pub/OpenBSD bad: ftp://pandemonium.tiscali.de/pub/OpenBSD bad: ftp://ftp.taubenschlag.uni-frankfurt.de/pub/mirror/ftp.openssh.com/portable bad: ftp://openbsd.bay13.net/pub/OpenBSD bad: ftp://ftp.uni-stuttgart.de/pub/OpenBSD bad: ftp://ftp.fh-wolfenbuettel.de/pub/os/openbsd bad: ftp://filoktitis.noc.uoa.gr/pub/OpenBSD bad: ftp://ftp.physics.auth.gr/pub/mirrors/OpenBSD/OpenBSD bad: ftp://ftp.duth.gr/pub/OpenBSD bad: ftp://ftp.fsn.hu/pub/OpenBSD bad: ftp://ftp.esat.net/pub/OpenBSD bad: ftp://ftp.netlab.is.tsukuba.ac.jp/pub/os/OpenBSD bad: ftp://ftp.iij.ad.jp/pub/OpenBSD bad: ftp://ftp.jp.openbsd.org/pub/OpenBSD bad: ftp://ftp.kddlabs.co.jp/OpenBSD bad: ftp://ftp.nl.uu.net/pub/OpenBSD bad: ftp://ftp.calyx.nl/pub/OpenBSD bad: ftp://ftp.nluug.nl/pub/OpenBSD bad: ftp://mirror.widexs.nl/pub bad: ftp://ftp.inet.no/pub/OpenBSD bad: ftp://ftp.uninett.no/pub/OpenBSD bad: ftp://sunsite.icm.edu.pl/pub/OpenBSD bad: ftp://ftp.task.gda.pl/pub/OpenBSD bad: ftp://ftp.physics.uvt.ro/pub/OpenBSD bad: ftp://ftp.gamma.ru/pub/OpenBSD bad: ftp://ftp.radio-msu.net/pub/OpenBSD bad: ftp://ftp.isu.net.sa/pub/ftp.openbsd.org/OpenBSD bad: ftp://ftp.rediris.es/mirror/OpenBSD bad: ftp://ftp.stacken.kth.se/pub/OpenBSD bad: ftp://ftp.sunet.se/pub/OpenBSD bad: ftp://mirror.pudas.net/OpenBSD bad: ftp://ftp.solnet.ch/mirror/OpenBSD bad: ftp://sunsite.cnlab-switch.ch/pub/OpenBSD bad: ftp://openbsd.csie.nctu.edu.tw/pub/OpenBSD bad: ftp://openbsd.nsysu.edu.tw/pub/OpenBSD bad: ftp://ftp.tku.edu.tw/pub/OpenBSD bad: ftp://ftp.linux.org.tr/OpenBSD bad: ftp://ftp.openbsd.org.ua/pub/OpenBSD bad: ftp://ftp.plig.org/pub/OpenBSD good: ftp://ftp3.usa.openbsd.org/pub/OpenBSD bad: ftp://mirror.csit.fsu.edu/pub/OpenBSD bad: ftp://reflection.ncsa.uiuc.edu/pub/OpenBSD bad: ftp://ftp.src.uchicago.edu/pub/OpenBSD bad: ftp://rt.fm/pub/OpenBSD bad: ftp://ftp.cse.buffalo.edu/pub/OpenBSD bad: ftp://ftp.stealth.net/pub/mirrors/ftp.openssh.com/pub/OpenBSD bad: ftp://openbsd.mirrors.pair.com bad: ftp://carroll.cac.psu.edu/pub/OpenBSD bad: ftp://mirrors.rcn.net/pub/OpenBSD bad: ftp://openbsd.secsup.org/pub/openbsd bad: ftp://ftp.tux.org/bsd/openbsd bad: ftp://mirror.cs.wisc.edu/pub/mirrors/OpenBSD Thanks!
My previous test was on an older distfile that many mirrors seem to have pruned. I've redone the test against the very recent openssh-6.4p1.tar.gz, with somewhat better results: only 48 of 67 mirrors fail. To rework this list, I started with the upstream mirror list here: http://www.openbsd.org/ftp.html From this list, the following mirrors failed my test: http://mirror.steadynet.cz/pub/OpenBSD/ http://www.ftp.ne.jp/OpenBSD/ http://mirror.corbina.net/pub/OpenBSD/ ftp://mirror.steadynet.cz/pub/OpenBSD/ The following mirrors passed the test: http://openbsd.org.ar/pub/OpenBSD/ http://mirror.internode.on.net/pub/OpenBSD/ http://mirror.aarnet.edu.au/pub/OpenBSD/ http://ftp.iinet.net.au/pub/OpenBSD/ http://ftp5.eu.openbsd.org/ftp/pub/OpenBSD/ http://ftp2.eu.openbsd.org/pub/OpenBSD/ http://ftp.belnet.be/pub/OpenBSD/ http://openbsd.locaweb.com.br/pub/OpenBSD/ http://mirror.telepoint.bg/OpenBSD/ http://ftp.OpenBSD.org/pub/OpenBSD/ http://athena.caslab.queensu.ca/pub/OpenBSD/ http://mirrors.ucr.ac.cr/OpenBSD/ http://ftp.openbsd.dk/pub/OpenBSD/ http://ftp.aso.ee/pub/OpenBSD/ http://ftp.estpak.ee/pub/OpenBSD/ http://ftp.fr.openbsd.org/pub/OpenBSD/ http://ftp2.fr.openbsd.org/pub/OpenBSD/ http://mirrors.ircam.fr/pub/OpenBSD/ http://openbsd.cs.fau.de/pub/OpenBSD/ http://ftp.spline.de/pub/OpenBSD/ http://ftp.bytemine.net/pub/OpenBSD/ http://ftp.halifax.rwth-aachen.de/openbsd/ http://artfiles.org/openbsd/ http://ftp.cc.uoc.gr/mirrors/OpenBSD/ http://ftp.fsn.hu/pub/OpenBSD/ http://kartolo.sby.datautama.net.id/pub/OpenBSD/ http://ftp.heanet.ie/pub/OpenBSD/ http://ftp.jaist.ac.jp/pub/OpenBSD/ http://ftp.nluug.nl/pub/OpenBSD/ http://ftp.bit.nl/pub/OpenBSD/ http://stingray.cyber.net.pk/pub/OpenBSD/ http://piotrkosoft.net/pub/OpenBSD/ http://ftp.icm.edu.pl/pub/OpenBSD/ http://mirror.yandex.ru/pub/OpenBSD/ http://mirrors.isu.net.sa/pub/ftp.openbsd.org/ http://www.obsd.si/pub/OpenBSD/ http://mirror.is.co.za/mirror/ftp.openbsd.org/ http://ftp.eu.openbsd.org/pub/OpenBSD/ http://mirror.switch.ch/ftp/pub/OpenBSD/ http://ftp.ch.openbsd.org/pub/OpenBSD/ http://www.mirrorservice.org/pub/OpenBSD/ http://mirror.bytemark.co.uk/OpenBSD/ http://mirror.ox.ac.uk/pub/OpenBSD/ http://ftp5.usa.openbsd.org/pub/OpenBSD/ http://ftp3.usa.openbsd.org/pub/OpenBSD/ http://mirror.team-cymru.org/pub/OpenBSD/ http://mirror.planetunix.net/pub/OpenBSD/ http://filedump.se.rit.edu/pub/OpenBSD/ http://openbsd.mirrors.hoobly.com/ http://mirror.ece.vt.edu/pub/OpenBSD/ http://openbsd.mirrors.pair.com/ http://mirrors.gigenet.com/pub/OpenBSD/ http://mirror.esc7.net/pub/OpenBSD/ http://openbsd.mirrorcatalogs.com/pub/OpenBSD/ http://mirrors.nycbug.org/pub/OpenBSD/ http://mirrors.syringanetworks.net/pub/OpenBSD/ http://mirror.jmu.edu/pub/OpenBSD/ http://openbsd.mirror.frontiernet.net/pub/OpenBSD/ ftp://ftp.openbsd.org.ar/pub/OpenBSD/ ftp://mirror.internode.on.net/pub/OpenBSD/ ftp://mirror.aarnet.edu.au/pub/OpenBSD/ ftp://ftp.iinet.net.au/pub/OpenBSD/ ftp://ftp5.eu.openbsd.org/pub/OpenBSD/ ftp://ftp2.eu.openbsd.org/pub/OpenBSD/ ftp://ftp.belnet.be/pub/OpenBSD/ ftp://openbsd.locaweb.com.br/pub/OpenBSD/ ftp://ftp.OpenBSD.org/pub/OpenBSD/ ftp://athena.caslab.queensu.ca/pub/OpenBSD/ ftp://mirrors.ucr.ac.cr/OpenBSD/ ftp://mirror.steadynet.cz/pub/OpenBSD/ ftp://ftp.openbsd.dk/pub/OpenBSD/ ftp://ftp.aso.ee/pub/OpenBSD/ ftp://ftp.estpak.ee/pub/OpenBSD/ ftp://ftp.fr.openbsd.org/pub/OpenBSD/ ftp://ftp2.fr.openbsd.org/pub/OpenBSD/ ftp://mirrors.ircam.fr/pub/OpenBSD/ ftp://ftp.irisa.fr/pub/OpenBSD/ ftp://openbsd.cs.fau.de/pub/OpenBSD/ ftp://ftp.spline.de/pub/OpenBSD/ ftp://ftp-stud.fht-esslingen.de/pub/OpenBSD/ ftp://ftp.bytemine.net/pub/OpenBSD/ ftp://ftp.halifax.rwth-aachen.de/pub/OpenBSD/ ftp://ftp.cc.uoc.gr/mirrors/OpenBSD/ ftp://ftp.fsn.hu/pub/OpenBSD/ ftp://ftp.heanet.ie/pub/OpenBSD/ ftp://ftp.jaist.ac.jp/pub/OpenBSD/ ftp://ftp.nluug.nl/pub/OpenBSD/ ftp://ftp.bit.nl/pub/OpenBSD/ ftp://stingray.cyber.net.pk/OpenBSD/ ftp://ftp.piotrkosoft.net/pub/OpenBSD/ ftp://ftp.icm.edu.pl/pub/OpenBSD/ ftp://mirror.yandex.ru/pub/OpenBSD/ ftp://mirrors.isu.net.sa/pub/ftp.openbsd.org/ ftp://ftp.obsd.si/pub/OpenBSD/ ftp://ftp.is.co.za/mirror/ftp.openbsd.org/ ftp://ftp.eu.openbsd.org/pub/OpenBSD/ ftp://mirror.switch.ch/pub/OpenBSD/ ftp://ftp.ch.openbsd.org/pub/OpenBSD/ ftp://ftp.ulak.net.tr/pub/OpenBSD/ ftp://ftp.mirrorservice.org/pub/OpenBSD/ ftp://mirror.bytemark.co.uk/OpenBSD/ ftp://mirror.ox.ac.uk/pub/OpenBSD/ ftp://ftp5.usa.openbsd.org/pub/OpenBSD/ ftp://ftp3.usa.openbsd.org/pub/OpenBSD/ ftp://mirror.team-cymru.org/pub/OpenBSD/ ftp://mirror.planetunix.net/pub/OpenBSD/ ftp://filedump.se.rit.edu/pub/OpenBSD/ ftp://openbsd.mirrors.pair.com/ ftp://mirror.esc7.net/pub/OpenBSD/ ftp://mirrors.nycbug.org/pub/OpenBSD/ ftp://mirrors.syringanetworks.net/pub/OpenBSD/ ftp://mirror.jmu.edu/pub/OpenBSD/ ftp://openbsd.mirror.frontiernet.net/pub/OpenBSD/ The order of the above lists is just based on the original upstream list, I made no changes there. The "good" list above should be a good basis for the new openbsd mirror list.
This mirror group needs to die. It's still got way more bad servers than good servers, and it's only used by: 8 net-misc/openssh ebuilds 1 net-misc/openntpd ebuild 1 net-ftp/ncftp ebuild If we'd like to avoid modifying these ebuilds, a good compromise would be to just reduce the list to a single entry: openbsd ftp://ftp.openbsd.org/pub/OpenBSD None of these ebuilds are mirror restricted so I don't think there's any real reason we need to have and maintain a list of several dozen upstream mirrors. CC'ing openssh maintainers since it's mostly their mirror group
should be simple to just pull the latest list: http://www.openssh.com/ftp.html
But what is the benefit to that? The vast majority of our users will pull it from gentoo mirrors already. I'm not trying to be argumentative, I just think we should step back and consider whether this huge mirror list actually is providing any benefit which would offset the maintenance burden it imposes.
(In reply to Ben Kohler from comment #4) ... except on early/initial releases for the project when the file isn't on our mirrors yet
Fair enough. I'd like to attach a patch with a more current mirror list-- would you prefer that I take the list from upstream as-is, or prune the mirrors that don't appear to be working at this moment? For example http://ftp.iinet.net.au/pub/OpenBSD/OpenSSH seems to be giving a 403 forbidden error.
Ping, any thoughts on this? Are we really sure it's worth maintaining this list just so that in the hour or 2 between a new ebuild and gentoo's mirrors picking it up, there are a few less fetches from upstream's direct source?
I don't think there's any point maintaining a mirror group that's used by only three packages.
Fixed here https://gitweb.gentoo.org/repo/gentoo.git/commit/profiles/thirdpartymirrors?id=3a0f002e60985f59c364f1d849383b2114fbf119