Gentoo Websites Logo
Go to: Gentoo Home Documentation Forums Lists Bugs Planet Store Wiki Get Gentoo!
Bug 26456 - New rsync server @ rsync.bluedevil.ca
Summary: New rsync server @ rsync.bluedevil.ca
Status: RESOLVED FIXED
Alias: None
Product: Mirrors
Classification: Unclassified
Component: New Server (show other bugs)
Hardware: x86 Linux
: High normal (vote)
Assignee: Mirror Admins
URL: http://rsync.bluedevil.ca
Whiteboard:
Keywords:
Depends on:
Blocks:
 
Reported: 2003-08-11 22:44 UTC by Robert Baxter
Modified: 2003-09-13 03:55 UTC (History)
0 users

See Also:
Package list:
Runtime testing required: ---


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Robert Baxter 2003-08-11 22:44:53 UTC
rsync.bluedevil.ca
216.194.67.33
gentoo@euphoric.ca
I would like to become an offical rsync mirror. 
Located in Edmonton, Alberta, Canada.

Reproducible: Always
Steps to Reproduce:
1.
2.
3.
Comment 1 Peter Penkala gentoo-dev 2003-08-12 16:12:38 UTC
What does the server have for CPU and RAM?  Also, what kind of bandwidth 
does it have available and what is the max user limit?

Thanks.
Comment 2 Robert Baxter 2003-08-12 21:24:27 UTC
As stated in the rsync motd, dual p3-1ghz w/ 2GB ram. 
10mbit connection, 20 user limit for the moment, may raise or lower slightly depending on bandwidth usage/server load.
Comment 3 Robert Baxter 2003-08-12 21:29:14 UTC
Also, if I'm finding 10mbit is not enough, I may change the port to 100, depending again on how much monthly bandwidth there is due to the rsyncd.

Thanks :]
Comment 4 Peter Penkala gentoo-dev 2003-08-17 11:36:42 UTC
OK, I've added 216.194.67.33 to the access list for rsync1.us.gentoo.org. 
Please update your rsync cron jobs to point to rsync1.us.gentoo.org and 
post back here when you've done so.  We'll monitor the server for a couple 
days to make sure things are working fine. 

Thanks.
Comment 5 Robert Baxter 2003-08-18 01:43:36 UTC
rsync cron jobs changed to rsync1.us.gentoo.org @ 2:30am MST 8/18/03
Seems to be working well so far, let me you know if you see any problems.
Comment 6 Peter Penkala gentoo-dev 2003-08-20 16:27:59 UTC
The server was going along for quite some time without problems.  Unfortunately, 
it seems to have died with "Wed, 20 Aug 2003 20:16:00 +0000" (date -uR format)
being the last sync.

Is the cron job still running OK.  Anything else out of the ordinary?  A sync 
completing at :16 is very unusual.  
Comment 7 Robert Baxter 2003-08-20 16:45:50 UTC
Everything seems to be functioning normally, and the logs report that the sync has been successful ever since. Here are the logs created for that time according the time zone, (-uR)

Started update at Wed Aug 20 12:30:00 MDT 2003
End: Wed Aug 20 12:30:58 MDT 2003
Started update at Wed Aug 20 13:00:00 MDT 2003
End: Wed Aug 20 13:01:04 MDT 2003
Started update at Wed Aug 20 13:30:00 MDT 2003
End: Wed Aug 20 13:31:19 MDT 2003
Started update at Wed Aug 20 14:00:00 MDT 2003
End: Wed Aug 20 14:01:45 MDT 2003
Started update at Wed Aug 20 14:30:00 MDT 2003
End: Wed Aug 20 14:31:03 MDT 2003
Started update at Wed Aug 20 15:00:00 MDT 2003
End: Wed Aug 20 15:00:59 MDT 2003
Started update at Wed Aug 20 15:30:00 MDT 2003
End: Wed Aug 20 15:31:08 MDT 2003
Started update at Wed Aug 20 16:00:00 MDT 2003

everything seems to have synced fine on my end, after going through the more detailed logs, all cron jobs were completed properly. Do you have any idea how I may find what happened here? I am at a loss at the moment.
Comment 8 Robert Baxter 2003-08-20 17:31:54 UTC
For some reason I can still sync properly to other sites, but not rsync1.us.gentoo.org anymore. I get no response from the server at all at this address. That address is resolving to 128.193.0.34 for me, is this correct?
Comment 9 Robert Baxter 2003-08-20 17:55:26 UTC
seems to be working now, i performed a manual sync and this was the result.

rsync --recursive --verbose --links --perms --times --devices --delete --timeout=600 rsync://rsync1.us.gentoo.org/gentoo-portage /opt/gentoo-rsync/portage/

cat portage/metadata/timestamp.chk
Thu, 21 Aug 2003 00:53:01 +0000
Comment 10 Peter Penkala gentoo-dev 2003-08-20 21:19:54 UTC
Very strange.  I'm not too familiar with rsync troubleshooting, so I have no 
idea what might have happened.  I'll see if anyone else has any insights.

In the meantime, I'll keep watching the syncs.
Comment 11 Robert Baxter 2003-08-21 09:18:46 UTC
It seems to be working now, those logs I posted are there only because it timed out after 600s. I have switched on verbose logging so I can make sure data is coming in from the master server as well. Thanks :]
Comment 12 Peter Penkala gentoo-dev 2003-08-26 20:55:51 UTC
I'm mainly posting this information for reference.  There are still some 
problems, but I'm not familiar enough with rsync to suggest any options.
I'll see if I can get someone to take a look.


"..." indicates successful syncs.
Checked (UTC)   Timestamp
================================================
     03:50:02   Thu, 21 Aug 2003 03:30:01 +0000
         ...
     13:20:02   timestamp missing
     22:20:02   Sat, 23 Aug 2003 21:57:00 +0000 ?
     22:50:03   Sat, 23 Aug 2003 21:57:00 +0000 ?
     23:20:02   Sat, 23 Aug 2003 21:57:00 +0000 ?
         ...
     01:50:03   Tue, 26 Aug 2003 01:31:05 +0000
     02:23:10   timestamp missing
     02:50:04   timestamp missing
     22:50:02   Tue, 26 Aug 2003 22:31:03 +0000
Comment 13 Robert Baxter 2003-08-27 01:58:09 UTC
I've gone through the logs and as far as I can tell I did not receive the time stamp from the server, all other files were updated at the correct time.
Same thing happened at the other times mentioned. I will try and see what is going on as much as i can from here, any help anyone could offer would be appreciated.


Started update at Sat Aug 23 17:30:00 MDT 2003 (13:30 UTC)

receiving file list ... done
metadata/timestamp.chk
metadata/timestamp.x
wrote 150 bytes  read 1330127 bytes  22357.60 bytes/sec
total size is 46215374  speedup is 34.74
End: Sat Aug 23 17:30:59 MDT 2003
Comment 14 Peter Penkala gentoo-dev 2003-09-09 17:51:14 UTC
There's a good chance this server has fallen victim to rsync1.us being overloaded.
As a result, some servers aren't syncing properly.

I'm going to monitor the server again for a couple of days to see if the problem 
is still there.  If it is, we'll have to put this on hold until we're able to 
resolve the problem.

Will update in a couple of days.
Comment 15 Peter Penkala gentoo-dev 2003-09-11 18:27:09 UTC
Looking good so far.  If problems don't show up, I'll be make this a mirror 
on Friday or Saturday.
Comment 16 Peter Penkala gentoo-dev 2003-09-12 21:37:04 UTC
This server is now rsync4.ca.gentoo.org.  Please update the motd file to 
include that information.

I've subscribed <gentoo@euphoric.ca> to our gentoo-mirrors mailing 
list (low volume).  This list is used to discuss mirror-related issues.

Thanks for supporting Gentoo.
Comment 17 Robert Baxter 2003-09-13 03:55:55 UTC
Thanks, glad I could help =)