Gentoo Websites Logo
Go to: Gentoo Home Documentation Forums Lists Bugs Planet Store Wiki Get Gentoo!
Bug 254955 - Full distfiles mirror in Brazil
Summary: Full distfiles mirror in Brazil
Status: RESOLVED FIXED
Alias: None
Product: Mirrors
Classification: Unclassified
Component: New Server (show other bugs)
Hardware: All Linux
: High normal
Assignee: Mirror Admins
URL: http://gentoo.c3sl.ufpr.br
Whiteboard: due:2009/04/28;dist:http://gentoo.c3s...
Keywords:
Depends on:
Blocks:
 
Reported: 2009-01-14 13:00 UTC by carlos
Modified: 2009-05-11 19:06 UTC (History)
0 users

See Also:
Package list:
Runtime testing required: ---


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description carlos 2009-01-14 13:00:34 UTC
We have set up a full public gentoo mirror. It's available at

rsync://gentoo.c3sl.ufpr.br/gentoo/
ftp://gentoo.c3sl.ufpr.br/gentoo
http://gentoo.c3sl.ufpr.br

Please register us as a main rotation mirror for Brazil and South America and give us access to the master server. Our access to the Oregon giga-pop is very good. We're already official mirrors for several other software distributions.

Please also confirm that we should update every 4 hours.
Comment 1 Shyam Mani (RETIRED) gentoo-dev 2009-02-28 13:46:57 UTC
Thanks for helping with a Gentoo mirror. I'm adding this mirror to our test
system - please make sure the mirror is syncing once every 4 hours as mentioned
at http://www.gentoo.org/doc/en/source_mirrors.xml

We will keep you posted on the status of testing. In the mean time, could you
please post the hardware specs of the server, intended number of concurrent
users for each protocol and the administrative contact?
Comment 2 carlos 2009-03-04 21:58:16 UTC
Administrative contact: root@c3sl.ufpr.br

Number of concurrent users:
http: unlimited
rsync: unlimited
ftp: unlimited in practice (normally about 15% of maximum, can be raised at will)

Hardware specs:
4 opteron processors
32GB ram
2Gb/s connection
Comment 3 Arun Raghavan (RETIRED) gentoo-dev 2009-04-18 05:38:31 UTC
We can't seem to access ftp://gentoo.c3sl.ufpr.br/gentoo/releases/.test in order to verify that the FTP mirror is in sync (no perms). Could you please fix this?
Comment 4 carlos 2009-04-18 20:09:46 UTC
Now dot files and directories are accessible to anon users.
Comment 5 Arun Raghavan (RETIRED) gentoo-dev 2009-04-19 18:00:38 UTC
Missed this earlier - the server seems to be slightly flaky. Looking at logs for the last 2 weeks, distfiles was out-of-sync (about 6 hours lag) on April 8th, 12th and 13th. Could you please check on this, Carlos?

Updating the due date to April 28th, so that we can be sure things are stable.
Comment 6 carlos 2009-04-19 20:14:18 UTC
The sync logs show no problems. What are your probe times and protocol?

Anyway, 6h is not too much for an update period of 4h. I've reduced it to 2h now. Also, it could be that the site we sync from was not up-to-date. Currently I have to update from ftp.ussg.iu.edu. It'd be better to have access to the master.

Finally, why does this error happen at every sync:

rsync: send_files failed to open /releases/.test/THIS-FILE-SHOULD-NOT-BE-PUBLIC.txt"

It just clutters the logs.
Comment 7 Arun Raghavan (RETIRED) gentoo-dev 2009-04-22 17:02:14 UTC
(In reply to comment #6)
> The sync logs show no problems. What are your probe times and protocol?
> 
> Anyway, 6h is not too much for an update period of 4h. I've reduced it to 2h
> now. Also, it could be that the site we sync from was not up-to-date. 

We do give some lee-way, but 6 hours' lag is a bit on the higher side for a 4 hour sync period. However, things look fine now.

The lag was seen on April 8th, at around 0300 UTC. Subsequently, I saw some error while trying to fetch releases/test/timestamp.x - this went away from April 19th. Did something change then?

> Finally, why does this error happen at every sync:
> 
> rsync: send_files failed to open
> /releases/.test/THIS-FILE-SHOULD-NOT-BE-PUBLIC.txt"
> 
> It just clutters the logs.

Check the permissions on the file. That file exists with the permissions that it has so we can verify that the permissions after sync'ing are correct. My guess would be that the uid of the files in the mirror is not the same as the uid of the rsync process.
Comment 8 Arun Raghavan (RETIRED) gentoo-dev 2009-04-27 04:27:26 UTC
Were you able to find the problem with sync'ing /releases/.test/THIS-FILE-SHOULD-NOT-BE-PUBLIC.txt ?
Comment 9 carlos 2009-04-27 23:15:49 UTC
> Were you able to find the problem with sync'ing
> /releases/.test/THIS-FILE-SHOULD-NOT-BE-PUBLIC.txt ?

I think it isn't a problem. I don't have this file because upstream doesn't let me get it, which seems to be what you want. Remember that I'm using a public access because I don't have access to the master.

About being not up-to-date:

 >The lag was seen on April 8th, at around 0300 UTC. Subsequently, I saw some
 >error while trying to fetch releases/test/timestamp.x - this went away from
 >April 19th. Did something change then?

No. Our logs for this period are uneventful.

You may notice a delay on Thursday 23, because of the combined mozilla and ubuntu releases. All our updates got stuck because of the flood everywhere. Things got back to normal on the 24th. Further, we had a power outage that lasted about 11h30 on Sunday 26. We resisted for 4h but then went offline. Our generator will only arrive in about 2 months...
Comment 10 Arun Raghavan (RETIRED) gentoo-dev 2009-05-11 19:06:25 UTC
Thanks for helping out Gentoo. I have added your mirror to our list at http://www.gentoo.org/main/en/mirrors.xml. Please start syncing from masterdistfiles.gentoo.org as the email I have sent to you instructs.

We would like you to subscribe to the gentoo-mirrors mailing List by sending an email to gentoo-mirrors-subscribe@lists.gentoo.org, as we send out notifications of updates, releases, and changes in policy to the mirrors.

Please also monitor http://mirrorstats.gentoo.org as this application is used to keep track of the up-to-date nature of our mirrors. Thanks for the hardware and bandwidth!