Gentoo Websites Logo
Go to: Gentoo Home Documentation Forums Lists Bugs Planet Store Wiki Get Gentoo!
Bug 308775 - New rsync mirror @ gentoo.cs.uni.edu ( rsync6.us.gentoo.org)
Summary: New rsync mirror @ gentoo.cs.uni.edu ( rsync6.us.gentoo.org)
Status: RESOLVED FIXED
Alias: None
Product: Mirrors
Classification: Unclassified
Component: New Server (show other bugs)
Hardware: All Linux
: High enhancement (vote)
Assignee: Mirror Admins
URL: http://gentoo.cs.uni.edu
Whiteboard: due:2009/03/25;dist:http://gentoo.cs....
Keywords:
Depends on:
Blocks:
 
Reported: 2010-03-10 02:15 UTC by Paul Gray
Modified: 2010-03-27 02:15 UTC (History)
0 users

See Also:
Package list:
Runtime testing required: ---


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Paul Gray 2010-03-10 02:15:43 UTC
New rsync mirror available at gentoo.cs.uni.edu in case you open up the US mirrors listings again.

Reproducible: Always




It's a Debian box running on an XServe (PPC) platform.  At the very least, it offers academic bandwidth and a little variety in the hardware/platform mix.
Comment 1 Paul Gray 2010-03-10 14:29:15 UTC
(In reply to comment #0)
> New rsync mirror available at gentoo.cs.uni.edu in case you open up the US
> mirrors listings again.
> 
> Reproducible: Always
> 
> 
> 
> 
> It's a Debian box running on an XServe (PPC) platform.  At the very least, it
> offers academic bandwidth and a little variety in the hardware/platform mix.
> 


Follow-up to clarify that this is a full  mirror request
Comment 2 Jeremy Olexa (darkside) (RETIRED) archtester gentoo-dev Security 2010-03-10 15:30:45 UTC
Yes, we can use another US mirror that has good bandwidth (univ). Thanks in advance.

Can we get the following info for the records?

    *  Official mirror name
    * Mirror type: distfiles/releases, gentoo-portage. NOTE: gentoo-portage is always rsync only. Some mirrors may have rsync for distfiles as well. Do not be confused by the difference!
    * URLs: full protocol and path for release/distfile mirrors, hostname or IP for gentoo-portage mirrors
    * Hardware specifications
    * Bandwidth specifications
    * Location
    * Intended concurrent users (for each protocol, mirror type)
    * Admin contact name and email address (This address should be registered in bugzilla so we can CC you to any bug reports)

Also, please make sure the your source mirror is syncing every 4 hours starting at midnight local time and your gentoo-portage mirror is syning every 30 mins.

Thanks.
Comment 3 Paul Gray 2010-03-11 15:42:41 UTC
*  Official mirror name  
 gentoo.cs.uni.edu

* Mirror type: distfiles, gentoo-portage. 
 full mirror: distfiles/releases, gentoo-portage.

* URLs: full protocol and path for release/distfile mirrors, hostname or IP
for gentoo-portage mirrors

  gentoo-portage and gentoo-distfiles are available via rsync:

   rsync gentoo.cs.uni.edu::gentoo-portage
   rsync gentoo.cs.uni.edu::gentoo-distfiles

 top-level content is also browse-able via http - http://gentoo.cs.uni.edu

* Hardware specifications
 Architecture: PPC (Xserve)
 OS: Debian Squeeze

* Bandwidth specifications
  1Gbps feed to the community (egress), and Internet2 support.

* Location
 The University of Northern Iowa, Cedar Falls, IA

* Intended concurrent users (for each protocol, mirror type)
 30 per each rsync module.

* Admin contact name and email address (This address should be registered in bugzilla so we can CC you to any bug reports)

Paul Gray, gray@cs.uni.edu
Comment 4 Mark Loeser (RETIRED) gentoo-dev 2010-03-11 21:58:45 UTC
I have put your mirror into our testing system and we will monitor it for the next 2 weeks to ensure everything looks stable.

Please make sure your review our policy documents to ensure everything is set up correctly:

http://www.gentoo.org/doc/en/source_mirrors.xml
http://www.gentoo.org/doc/en/rsync.xml 
Comment 5 Mark Loeser (RETIRED) gentoo-dev 2010-03-12 04:38:49 UTC
Portage at rsync://gentoo.cs.uni.edu is lagging (delta is 51d 08h 26m 08s)

You are lagging quite bad for the gentoo-portage mirror.  Could you please look into that for us?

Thanks
Comment 6 Paul Gray 2010-03-12 13:54:28 UTC
sync script fixed. gentoo-portage module for rsync should now be updated (and updating).
Comment 7 Mark Loeser (RETIRED) gentoo-dev 2010-03-12 21:52:36 UTC
Portage at rsync://gentoo.cs.uni.edu is lagging (delta is 00d 01h 37m 03s)

Still lagging.  What mirror are you syncing against and how often?
Comment 8 Paul Gray 2010-03-12 22:55:04 UTC
Scripts are set to sync with:
 rsync://ftp.ussg.iu.edu/gentoo-distfiles/
and
 rsync://ftp.ussg.iu.edu/gentoo-portage/

(ftp.ussg.iu.edu A.K.A.rsync25.us.gentoo.org)

crontab entry is every 3 minutes and 33 minutes past the hour:
# m   h  dom mon dow   command
3,33  *   *   *   *   /usr/local/bin/gentoo-sync.sh

...will check to make sure it's actually sync'ing.
Comment 9 Robin Johnson archtester Gentoo Infrastructure gentoo-dev Security 2010-03-12 22:58:17 UTC
Is that cronjob for the portage mirror or the sources mirror side?
You should have separate crontab entries for them.
Comment 10 Paul Gray 2010-03-12 23:29:49 UTC
distfiles is set to sync every 4 hours in cron.hourly
portage is set to sync at 3 minutes and 33 minutes after the hour.

I hopped on irc and made some adjustments based on the dialog.  

The main adjustment is that it's now sync'ing to rsync.us.gentoo.org instead of
rsync25.us.gentoo.org.

I watched the 3-after-the-hour update take place on time...and will make sure
that the 33-after-the-hour kicks off on time as well.
Comment 11 Mark Loeser (RETIRED) gentoo-dev 2010-03-23 23:56:49 UTC
Your mirror is inaccessible to us now it seems:

rsync: failed to connect to gentoo.cs.uni.edu: Connection refused (111)
Comment 12 Paul Gray 2010-03-24 01:03:00 UTC
(In reply to comment #11)
> Your mirror is inaccessible to us now it seems:
> 
> rsync: failed to connect to gentoo.cs.uni.edu: Connection refused (111)
> 


Firewall acl's were tweaked yesterday.  External access has been reopened to allow rsync to the box.
Comment 13 Mark Loeser (RETIRED) gentoo-dev 2010-03-26 19:45:07 UTC
Thanks for helping out Gentoo. I have added your mirror to our list at http://www.gentoo.org/main/en/mirrors2.xml. Please start syncing from masterdistfiles.gentoo.org as the email I have sent to you instructs. We would like you to subscribe to the gentoo-mirrors Mailing List by sending an email to gentoo-mirrors+subscribe@lists.gentoo.org, as we send out notifications of updates, releases, and changes in policy to the mirrors. Please also monitor http://mirrorstats.gentoo.org as this application is used to keep track of the up-to-date nature of our mirrors. Thanks for the hardware and bandwidth!

Thanks for helping out Gentoo. I have added the IP you specified in the bug to our access database, please start syncing to rsync1.us.gentoo.org per our rsync document at http://www.gentoo.org/doc/en/rsync.xml. We would like you to subscribe to the gentoo-mirrors Mailing List by sending an email to gentoo-mirrors+subscribe@lists.gentoo.org, as we send our notifications of updates, releases, and changes in policy to the mirrors. Once again, thanks for the hardware and bandwidth! Please also monitor http://mirrorstats.gentoo.org/rsync as this application is used to keep track of the up-to-date nature of our mirrors. You are mirror rsync6.us.gentoo.org in the rsync.us.gentoo.org rotation and have been added to the rsync.namerica.gentoo.org rotation as well.
Comment 14 Paul Gray 2010-03-27 01:20:16 UTC
(In reply to comment #13)
> Thanks for helping out Gentoo. I have added your mirror to our list at
> http://www.gentoo.org/main/en/mirrors2.xml. Please start syncing from

...
> the rsync.us.gentoo.org rotation and have been added to the
> rsync.namerica.gentoo.org rotation as well.
> 

On the mirrors link (http), we're listed with Brazil under the South America mirrors.  Could we be moved North?
Comment 15 Jeremy Olexa (darkside) (RETIRED) archtester gentoo-dev Security 2010-03-27 02:13:24 UTC
(In reply to comment #14)

> On the mirrors link (http), we're listed with Brazil under the South America
> mirrors.  Could we be moved North?

fixed :)