Gentoo Websites Logo
Go to: Gentoo Home Documentation Forums Lists Bugs Planet Store Wiki Get Gentoo!
Bug 635646 - Document the thirdpartymirrors file and the "mirror://" pseudo-procotol
Summary: Document the thirdpartymirrors file and the "mirror://" pseudo-procotol
Status: RESOLVED FIXED
Alias: None
Product: Documentation
Classification: Unclassified
Component: Devmanual (show other bugs)
Hardware: All Linux
: Normal normal
Assignee: Gentoo Devmanual Team
URL:
Whiteboard:
Keywords: PATCH
Depends on:
Blocks:
 
Reported: 2017-10-28 01:50 UTC by Michael Orlitzky
Modified: 2019-03-19 17:11 UTC (History)
1 user (show)

See Also:
Package list:
Runtime testing required: ---


Attachments
0001-ebuild-writing-variables-document-the-mirror-pseudo-.patch (0001-ebuild-writing-variables-document-the-mirror-pseudo-.patch,2.53 KB, patch)
2017-10-28 02:02 UTC, Michael Orlitzky
Details | Diff
0002-general-concepts-mirrors-link-to-the-third-party-mir.patch (0002-general-concepts-mirrors-link-to-the-third-party-mir.patch,1.16 KB, patch)
2017-10-28 02:03 UTC, Michael Orlitzky
Details | Diff
0003-ebuild-writing-variables-weaken-the-warning-against-.patch (0003-ebuild-writing-variables-weaken-the-warning-against-.patch,2.04 KB, patch)
2017-11-06 13:25 UTC, Michael Orlitzky
Details | Diff
0001-ebuild-writing-variables-document-the-mirror-pseudo-.patch (0001-ebuild-writing-variables-document-the-mirror-pseudo-.patch,2.53 KB, patch)
2019-03-19 13:08 UTC, Michael Orlitzky
Details | Diff
0002-general-concepts-mirrors-link-to-the-third-party-mir.patch (0002-general-concepts-mirrors-link-to-the-third-party-mir.patch,1.21 KB, patch)
2019-03-19 13:09 UTC, Michael Orlitzky
Details | Diff
0003-ebuild-writing-variables-weaken-the-warning-against-.patch (0003-ebuild-writing-variables-weaken-the-warning-against-.patch,2.12 KB, patch)
2019-03-19 13:10 UTC, Michael Orlitzky
Details | Diff
0001-ebuild-writing-variables-document-the-mirror-pseudo-.patch (0001-ebuild-writing-variables-document-the-mirror-pseudo-.patch,2.53 KB, patch)
2019-03-19 16:12 UTC, Michael Orlitzky
Details | Diff

Note You need to log in before you can comment on or make changes to this bug.
Description Michael Orlitzky gentoo-dev 2017-10-28 01:50:20 UTC
The thirdpartymirrors file is covered by the PMS, but unless you know where to look, it's not easy to figure out exactly what "mirror://" does in SRC_URI. I think a short subsection under "SRC_URI" on the variables page is a good place for a mention.
Comment 1 Michael Orlitzky gentoo-dev 2017-10-28 02:02:36 UTC
Created attachment 500478 [details, diff]
0001-ebuild-writing-variables-document-the-mirror-pseudo-.patch
Comment 2 Michael Orlitzky gentoo-dev 2017-10-28 02:03:04 UTC
Created attachment 500480 [details, diff]
0002-general-concepts-mirrors-link-to-the-third-party-mir.patch
Comment 3 Michael Palimaka (kensington) gentoo-dev 2017-10-28 03:20:15 UTC
The warning against using thirdpartymirrors is not consistent with our current usage.
Comment 4 Michael Orlitzky gentoo-dev 2017-10-28 11:41:12 UTC
(In reply to Michael Palimaka (kensington) from comment #3)
> The warning against using thirdpartymirrors is not consistent with our
> current usage.

I took Ben's advice from bug 563716 there. It sounds wise enough to me, but we can try to get a consensus first (cc: QA?).
Comment 5 Michael Orlitzky gentoo-dev 2017-10-28 23:40:48 UTC
Some of these are false positives (the "Not Found" all need to be manually checked), but there are still a large number of dead mirrors in the file. To me that indicates two things,

  a) by and large, we don't need these mirrors in the first place (users get
     the sources from gentoo mirrors)

  b) trying to maintain our own copy of someone else's mirror list should
     be a last resort, when it's truly necessary (fetch-restricted stuff) 


Some dead mirrors:

ftp://ftp.planetmirror.com/pub/3dgamers/games/ ([Errno -2] Name or service not known)
http://apache.ip-guide.com/ ([Errno -5] No address associated with hostname)
http://mirror.nexcess.net/apache/ (Not Found)
http://www.webhostingreviewjam.com/mirror/apache/ (Forbidden)
https://github.com/downloads (Not Found)
ftp://ftp.idsoftware.com/idstuff (ftp error: TimeoutError(110, 'Connection timed out'))
ftp://ftp.kddlabs.co.jp/graphics/ImageMagick/ (ftp error: TimeoutError(110, 'Connection timed out'))
ftp://gd.tuwien.ac.at/db/mysql/ (ftp error: TimeoutError(110, 'Connection timed out'))
ftp://mysql.mirror.kangaroot.net/pub/mysql/ (ftp error: TimeoutError(110, 'Connection timed out'))
http://mysql.blic.net/ ([Errno -2] Name or service not known)
http://mysql.online.bg/ ([Errno -2] Name or service not known)
ftp://mysql.online.bg/ ([Errno -2] Name or service not known)
ftp://mysql.mirrors.ovh.net/ftp.mysql.com/ (ftp error: ConnectionRefusedError(111, 'Connection refused'))
ftp://ftp.crysys.hu/pub/mysql/ (ftp error: error_perm('550 pub/mysql: No such file or directory',))
ftp://na.mirror.garr.it/mirrors/MySQL/ (ftp error: ConnectionRefusedError(111, 'Connection refused'))
ftp://sunsite.icm.edu.pl/pub/unix/mysql/ (ftp error: error_perm('550 Failed to change directory.',))
http://mysql.nfsi.pt/ ([Errno -2] Name or service not known)
ftp://ftp.nfsi.pt/pub/mysql/ ([Errno -2] Name or service not known)
http://mirrors.xservers.ro/mysql/ (Not Found)
http://ftp.sunet.se/pub/unix/databases/relational/mysql/ (Not Found)
ftp://ftp.sunet.se/pub/unix/databases/relational/mysql/ (ftp error: error_perm('550 Failed to change directory.',))
http://ftp.itu.edu.tr/Mirror/Mysql/ (Not Found)
ftp://ftp.itu.edu.tr/Mirror/Mysql/ (ftp error: error_perm('550 Failed to change directory.',))
http://mirrors.dedipower.com/www.mysql.com/ ([Errno -5] No address associated with hostname)
http://mysql.mirror.rafal.ca/ ([Errno 111] Connection refused)
ftp://mysql.mirror.rafal.ca/pub/mysql/ (ftp error: ConnectionRefusedError(111, 'Connection refused'))
http://opensource.become.com/mysql/ ([Errno 113] No route to host)
http://mysql.he.net/ (Forbidden)
http://mirror.trouble-free.net/mysql_mirror/ (Not Found)
http://mysql.llarian.net/ ([Errno -2] Name or service not known)
ftp://mysql.llarian.net/pub/mysql ([Errno -2] Name or service not known)
ftp://mirror.anl.gov/pub/mysql/ ([Errno -2] Name or service not known)
ftp://ftp.linorg.usp.br/mysql/ ([Errno -2] Name or service not known)
http://mysql.mirrors.arminco.com/ (Forbidden)
http://mysql.cdpa.nsysu.edu.tw/ (Forbidden)
http://mysql.mirrors.ilisys.com.au/ ([Errno -2] Name or service not known)
http://ftp.twaren.net/Unix/NonGNU/ (Forbidden)
https://pypi.python.org/packages/source (Not Found)
https://files.pythonhosted.org/packages/source (Not Found)
http://qmail.geto.net/ (Forbidden)
http://qmail.ii.net/ (Internal Server Error)
http://qmail.yongbok.net/ (Forbidden)
http://qmail.europnews.de/ (Forbidden)
http://qmail.kendzorra.org/ ([SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed (_ssl.c:600))
http://qmail.mirror.rise.ph/ (Forbidden)
ftp://ftp.samba.gr.jp/pub/samba (ftp error: ConnectionRefusedError(111, 'Connection refused'))
http://globalbase.dl.sourceforge.jp ([Errno 113] No route to host)
http://mirror.network32.net/ubuntu/ (Forbidden)
http://projects.vdr-developer.org/attachments/download (Not Found)
http://gentoo.fh-luh.de/files ([Errno -2] Name or service not known)
Comment 6 Michael Palimaka (kensington) gentoo-dev 2017-10-30 10:58:46 UTC
(In reply to Michael Orlitzky from comment #5)
> Some of these are false positives (the "Not Found" all need to be manually
> checked), but there are still a large number of dead mirrors in the file. To
> me that indicates two things,
> 
>   a) by and large, we don't need these mirrors in the first place (users get
>      the sources from gentoo mirrors)
> 
>   b) trying to maintain our own copy of someone else's mirror list should
>      be a last resort, when it's truly necessary (fetch-restricted stuff) 

I don't disagree, I just don't think that this is the best platform to try and introduce a policy change (if that is indeed the intent of the patch).
Comment 7 Michael Orlitzky gentoo-dev 2017-11-06 13:25:10 UTC
Created attachment 502794 [details, diff]
0003-ebuild-writing-variables-weaken-the-warning-against-.patch

Better? I can change it from "Warning" to "Note" if that makes it any more palatable.
Comment 8 Michael Orlitzky gentoo-dev 2019-03-19 13:08:52 UTC
Created attachment 569760 [details, diff]
0001-ebuild-writing-variables-document-the-mirror-pseudo-.patch
Comment 9 Michael Orlitzky gentoo-dev 2019-03-19 13:09:15 UTC
Created attachment 569762 [details, diff]
0002-general-concepts-mirrors-link-to-the-third-party-mir.patch
Comment 10 Michael Orlitzky gentoo-dev 2019-03-19 13:10:03 UTC
Created attachment 569764 [details, diff]
0003-ebuild-writing-variables-weaken-the-warning-against-.patch

Ping: new patches add my Signed-off-by line.
Comment 11 Michael Orlitzky gentoo-dev 2019-03-19 16:12:37 UTC
Created attachment 569778 [details, diff]
0001-ebuild-writing-variables-document-the-mirror-pseudo-.patch

Ulm noticed that the first patch in the series contained a reference to the EAPI=6 version of this PMS. This new patch uses the EAPI=7 link. (While I would prefer to omit the EAPI entirely, it still needs to be hard-coded in the URL, so nothing is saved by omitting it from the text.)
Comment 12 Larry the Git Cow gentoo-dev 2019-03-19 17:11:18 UTC
The bug has been closed via the following commit(s):

https://gitweb.gentoo.org/proj/devmanual.git/commit/?id=e4a6e552a4b2386893fca4d2834e0a38f89a5802

commit e4a6e552a4b2386893fca4d2834e0a38f89a5802
Author:     Michael Orlitzky <mjo@gentoo.org>
AuthorDate: 2017-11-06 13:08:11 +0000
Commit:     Brian Evans <grknight@gentoo.org>
CommitDate: 2019-03-19 17:02:04 +0000

    ebuild-writing/variables: weaken the warning against third-party mirrors.
    
    The warning against using third-party mirrors used to say that "the
    mere existence of a third-party mirror list is not a good enough
    reason to use it." That goes against a few existing uses of the
    feature in the ::gentoo repository, so the wording is too strong. This
    revision changes the warning, leaving the decision up to the
    maintainer after alerting him to the potential maintenance burden.
    
    Closes: https://bugs.gentoo.org/635646
    Suggested-by: Michael Palimaka <kensington@gentoo.org>
    Signed-off-by: Michael Orlitzky <mjo@gentoo.org>
    Signed-off-by: Brian Evans <grknight@gentoo.org>

 ebuild-writing/variables/text.xml | 14 ++++++++------
 1 file changed, 8 insertions(+), 6 deletions(-)