Gentoo Websites Logo
Go to: Gentoo Home Documentation Forums Lists Bugs Planet Store Wiki Get Gentoo!
Bug 672402 - rsync mirror rotation rsync.europe.gentoo.org needs cleanup
Summary: rsync mirror rotation rsync.europe.gentoo.org needs cleanup
Status: RESOLVED FIXED
Alias: None
Product: Mirrors
Classification: Unclassified
Component: Server Problem (show other bugs)
Hardware: All All
: Normal normal
Assignee: Mirror Admins
URL:
Whiteboard:
Keywords:
Depends on:
Blocks:
 
Reported: 2018-12-02 14:04 UTC by P. Roth
Modified: 2023-09-06 15:37 UTC (History)
2 users (show)

See Also:
Package list:
Runtime testing required: ---


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description P. Roth 2018-12-02 14:04:10 UTC
rsync.europe.gentoo.org currently resolves to 19 IPv4 addresses, I tried getting the Manifest file today multiple times with the following result:

* 8 ok
* 1 max connections reached (multiple times)
* 1 unreachable (no route to host)
* 7 timeout
* 1 slightly outdated
* 1 seriously outdated (see bug 669782)

It seems clear that some cleanup is required.

Some side notes:

* Why no IPv6 addresses?
* What about monitoring? If this is not fixed for (at least) weeks, there seems to be more fundamental problems...

Reproducible: Always
Comment 1 Alec Warner (RETIRED) archtester gentoo-dev Security 2018-12-02 16:01:15 UTC
(In reply to proth+gentoobugs from comment #0)
> rsync.europe.gentoo.org currently resolves to 19 IPv4 addresses, I tried
> getting the Manifest file today multiple times with the following result:
> 

Hi

> * 8 ok
> * 1 max connections reached (multiple times)
> * 1 unreachable (no route to host)
> * 7 timeout
> * 1 slightly outdated
> * 1 seriously outdated (see bug 669782)
> 
> It seems clear that some cleanup is required.
> 
> Some side notes:
> 
> * Why no IPv6 addresses?
> * What about monitoring? If this is not fixed for (at least) weeks, there
> seems to be more fundamental problems...
> 
> Reproducible: Always

I readily admit our current mirror setup is pretty crap. We have 3-4 places to maintain mirrors. An XML file, DNS, our mirror monitoring setup, and ACLs. I have an in-progress plan to remove the duplication and generate everything from a master file; but its not complete yet.

I've removed 6 bad mirrors from rsync.europe in the meantime.

-A
Comment 2 P. Roth 2020-04-24 11:51:52 UTC
Update: rsync.europe.gentoo.org currently resolves to 12 IPv4 addresses, checking the Manifest age over the last 24h gave the following result:

* 8 ok
* 1 unreachable (no route to host)
* 2 timeout
* 1 outdated (see bug 719214)

New side note:

* The way emerge --sync handles outdated rsync mirrors seems not good, it checks the TIMESTAMP from the Manifest file, but then only emits a warning if it's older than sync-rsync-verify-max-age (24 days by default). That's not quite suited for running it as a cronjob, what I assume most users do.
Comment 3 Sam James archtester Gentoo Infrastructure gentoo-dev Security 2023-09-06 15:37:25 UTC
I've done a big cleanup per grobian's look in bug 889664.