Hi, I have built a full Gentoo mirror server(IPv4 available now - IPv6 in the next few days, small problem being fixed). We are located in a large data center in London, U.K. and the machine is monitored 24/7. It is serving via HTTP, FTP and RSYNC (50 slots available). Full server/network details can be seen by running: rsync rsync.qubenet.net:: Cheers, Andy. QUBE
Thank you for wanting to help out Gentoo with a mirror. I ran a check and it looks okay : Distfiles : * Timestamp on mirror.qubenet.net is Sun, 07 Jan 2007 06:07:58 +0000 * Current time in UTC is Sun Jan 7 08:38:50 UTC 2007 rsync : IP: mirror.qubenet.net Checked at (UTC) Timestamp ================================================ 08:41:37 Sun, 07 Jan 2007 00:20:01 +0000 Seems there's a lag on rsync. You would want to be syncing the rsync mirror twice on the hour as mentioned in http://www.gentoo.org/doc/en/rsync.xml
Hi, I have adjusted the crontab so that rsync for gentoo-portage will sync every 30 minutes starting @ 00:00. I have left the sync of the file mirror at every 4 hours starting @ 00:00. Let me know if this has fixed it. Thanks. Regards, Andy. QUBE (In reply to comment #1) > Thank you for wanting to help out Gentoo with a mirror. > > I ran a check and it looks okay : > > Distfiles : > > * Timestamp on mirror.qubenet.net is Sun, 07 Jan 2007 06:07:58 +0000 > * Current time in UTC is Sun Jan 7 08:38:50 UTC 2007 > > rsync : > > IP: mirror.qubenet.net > Checked at (UTC) Timestamp > ================================================ > 08:41:37 Sun, 07 Jan 2007 00:20:01 +0000 > > Seems there's a lag on rsync. You would want to be syncing the rsync mirror > twice on the hour as mentioned in http://www.gentoo.org/doc/en/rsync.xml >
Distfiles is good : * Timestamp on mirror.qubenet.net is Sat, 03 Feb 2007 18:08:02 +0000 * Current time in UTC is Sat Feb 3 21:20:27 UTC 2007 rsync still has an hour lag : IP: mirror.qubenet.net Checked at (UTC) Timestamp ================================================ 21:20:57 Sat, 03 Feb 2007 20:20:01 +0000
Hi, That’s odd. Does this look right: qube-ext-rsy01 ~ # crontab -l # minute (0-59), # | hour (0-23), # | | day of the month (1-31), # | | | month of the year (1-12), # | | | | day of the week (0-6 with 0=Sunday). # | | | | | commands #frequent */30 * * * * sh /etc/rsync/rsyncd-gentoo-portage.sh > /dev/null 2>&1 0 */4 * * * sh /etc/rsync/rsyncd-gentoo.org.sh > /dev/null 2>&1 qube-ext-rsy01 ~ # tail -f /var/log/rsyncd-gentoo-portage.sh.log End: Sat Feb 3 19:02:09 GMT 2007 Started update at Sat Feb 3 19:30:01 GMT 2007 End: Sat Feb 3 19:30:33 GMT 2007 Started update at Sat Feb 3 20:00:02 GMT 2007 End: Sat Feb 3 20:02:17 GMT 2007 Started update at Sat Feb 3 20:30:01 GMT 2007 End: Sat Feb 3 20:30:34 GMT 2007 Started update at Sat Feb 3 21:00:01 GMT 2007 End: Sat Feb 3 21:01:40 GMT 2007 Started update at Sat Feb 3 21:30:01 GMT 2007 Started update at Sat Feb 3 21:30:01 GMT 2007 End: Sat Feb 3 21:30:36 GMT 2007 qube-ext-rsy01 ~ # date Sat Feb 3 21:34:24 GMT 2007 Looks like it is actually syncing every 30 minutes. Its pulling data from the German rsync.de.gentoo.org mirror. Any suggestions? Im not sure what to suggest.. Regards, Andy QUBE (In reply to comment #3) > Distfiles is good : > > * Timestamp on mirror.qubenet.net is Sat, 03 Feb 2007 18:08:02 +0000 > * Current time in UTC is Sat Feb 3 21:20:27 UTC 2007 > > rsync still has an hour lag : > > IP: mirror.qubenet.net > Checked at (UTC) Timestamp > ================================================ > 21:20:57 Sat, 03 Feb 2007 20:20:01 +0000 >
(In reply to comment #4) > Looks like it is actually syncing every 30 minutes. Its pulling data from the > German rsync.de.gentoo.org mirror. > Any suggestions? Im not sure what to suggest.. Can you trying syncing from rsync.us.gentoo.org? Also, it could be possible that you have a DNS cache somewhere, which is returning a single IP for rsync.de.gentoo.org (which may be stale), hence you're lagging too.
(In reply to comment #5) Hi, I have adjusted the sync to pull from the US mirror. The machine has no resolver cache and afaict it seems to return a different IP on lookups: qube-ext-rsy01 ~ # host rsync.de.gentoo.org rsync.de.gentoo.org has address 62.75.252.130 rsync.de.gentoo.org has address 80.237.153.116 rsync.de.gentoo.org has address 81.169.182.53 rsync.de.gentoo.org has address 88.198.224.205 rsync.de.gentoo.org has address 128.176.191.21 rsync.de.gentoo.org has address 130.133.110.66 rsync.de.gentoo.org has address 134.106.11.88 rsync.de.gentoo.org has address 134.147.32.114 rsync.de.gentoo.org has address 137.226.34.228 rsync.de.gentoo.org has address 193.16.112.87 rsync.de.gentoo.org has address 193.218.127.252 rsync.de.gentoo.org has address 194.97.4.250 rsync.de.gentoo.org has address 217.69.169.223 qube-ext-rsy01 ~ # ping rsync.de.gentoo.org PING rsync.de.gentoo.org (217.69.169.223) 56(84) bytes of data. 64 bytes from rsync1.de.gentoo.org (217.69.169.223): icmp_seq=1 ttl=54 time=21.1 ms --- rsync.de.gentoo.org ping statistics --- 1 packets transmitted, 1 received, 0% packet loss, time 0ms rtt min/avg/max/mdev = 21.127/21.127/21.127/0.000 ms qube-ext-rsy01 ~ # ping rsync.de.gentoo.org PING rsync.de.gentoo.org (194.97.4.250) 56(84) bytes of data. 64 bytes from eric.schwarzvogel.de (194.97.4.250): icmp_seq=1 ttl=59 time=22.3 ms 64 bytes from eric.schwarzvogel.de (194.97.4.250): icmp_seq=2 ttl=59 time=22.8 ms --- rsync.de.gentoo.org ping statistics --- 2 packets transmitted, 2 received, 0% packet loss, time 1004ms rtt min/avg/max/mdev = 22.326/22.611/22.896/0.285 ms qube-ext-rsy01 ~ # ping rsync.de.gentoo.org PING rsync.de.gentoo.org (193.218.127.252) 56(84) bytes of data. --- rsync.de.gentoo.org ping statistics --- 3 packets transmitted, 0 received, 100% packet loss, time 2006ms qube-ext-rsy01 ~ # ping rsync.de.gentoo.org PING rsync.de.gentoo.org (193.16.112.87) 56(84) bytes of data. --- rsync.de.gentoo.org ping statistics --- 3 packets transmitted, 0 received, 100% packet loss, time 2005ms qube-ext-rsy01 ~ # ping rsync.de.gentoo.org PING rsync.de.gentoo.org (137.226.34.228) 56(84) bytes of data. 64 bytes from rsync.informatik.RWTH-Aachen.DE (137.226.34.228): icmp_seq=1 ttl=238 time=37.4 ms 64 bytes from rsync.informatik.RWTH-Aachen.DE (137.226.34.228): icmp_seq=2 ttl=238 time=39.1 ms --- rsync.de.gentoo.org ping statistics --- 2 packets transmitted, 2 received, 0% packet loss, time 1006ms rtt min/avg/max/mdev = 37.474/38.329/39.184/0.855 ms Regards, Andy QUBE > (In reply to comment #4) > > > Looks like it is actually syncing every 30 minutes. Its pulling data from the > > German rsync.de.gentoo.org mirror. > > Any suggestions? Im not sure what to suggest.. > > Can you trying syncing from rsync.us.gentoo.org? Also, it could be possible > that you have a DNS cache somewhere, which is returning a single IP for > rsync.de.gentoo.org (which may be stale), hence you're lagging too. >
16:12:42 (3.34 MB/s) - `install-x86-minimal-2007.0-r1.iso.2' saved [59940864/59940864] to western Canada, server looks good... Add it.
Looks great. Apologies for the delay, adding you in :) * Timestamp on mirror.qubenet.net is Mon, 02 Jul 2007 09:08:05 +0000 * Current time in UTC is Mon Jul 2 13:36:31 UTC 2007 Can you change the rsync module name to gentoo from gentoo-full-mirror? I have added your mirror to our list at http://www.gentoo.org/main/en/mirrors.xml. Please start syncing from masterdistfiles.gentoo.org as the email I have sent to you instructs. Please also monitor http://mirrorstats.gentoo.org as this application is used to keep track of the up-to-date nature of our mirrors. Once again, thanks for the hardware and bandwidth! In case you'd like to have an rsync mirror as well, let me know, since the current /mirror/gentoo-portage/ won't work for us.
Re-open when ready for rsync.
(In reply to comment #9) > Re-open when ready for rsync. > Hi, Sure, I have adjusted the rsync path to 'gentoo' from 'gentoo-full-mirror'. Can you let me know how to fix the rsync mirror path too? Also, the machine is IPv6 enabled so you might want to add the address: 2a01:90::2120 To the list. I have not received any mail other than this one, could you resend the instructions to sync from masterdistfiles.gentoo.org? Thanks. Regards, Andy.
Andy, I've re-sent the email, please let me know when you've gotten in and syncing from the master distfiles mirror successfully. The gentoo-portage rsync mirror on the server is still lagging, I'm going to add your IP to the access list and want you to sync gentoo-portage from rsync1.us.gentoo.org, twice an hour. If it looks good, I'll add the DNS entries, since we can't quite figure out why the public syncs don't work.
Hi, OK, I changed the fill gentoo mirror sync source over to the official master and the box has done a full sync in over an hour and a bit(60-70Mbit/s, not bad!!). I have also adjusted gentoo-portage to sync from rsync1.us.gentoo.org. hopefully this will sync properly now.. Regards, Andy QUBE
Andy, Don't think the sync from rsync1.us is working, the timestamp is the same. If you're trying to access rsync1.us from a different IP, you need to let me know, so I can add it to the access list.
Hi, I have adjusted the script for the gentoo-portage sync. It was failing for some reason but seems to be working now(timestamp seems to be up to date). Can you test please? Regards, Andy QUBE
Andy, looks good. IP: mirror.qubenet.net Checked at (UTC) Timestamp ================================================ 08:34:43 Thu, 05 Jul 2007 08:20:01 +0000 I'll add you into DNS. You're the only rsync mirror in the UK, the other one we had just pulled out a while back :) So you'll be rsync1.uk.gentoo.org in the rsync.uk.gentoo.org rotation. Thanks for the hardware and bandwidth!
OK cool. Can you add an IPv6 indicator too?
