Hi, since now this full gentoo mirror is run every whole 30 minutes from ftp.ibiblio.org. We have 1Gbps to the norwegian accademic backbone and we're located right next to the commercial peering-point where all commercial ISPs in .no connect to Uninett. We allow at least ftp 50 users (at redhat release times we lower it to something like that) and at most times 150 users. There is currently no user limit on the rsync service. I will get the root user to add gentoo-portage and gentoo modules in the morning. As far as I can see this satisfies your mirror policy. Regards, Nicolai Reproducible: Always Steps to Reproduce: 1. 2. 3.
Hi again, I didn't realize that there is a difference between a "rsync" mirror and a "source" mirror. I've added a rsync mirror, it will be in rsync-able from ftp.uninett.no::gentoo-portage sometime in the morning. Both mirrors run every 30 minutes. at ::gentoo I have a full "source" mirror. The ftp paths are /pub/linux/Gentoo/rsync and /pub/linux/Gentoo respectively. Nicolai
Could you please add ::gentoo-x86-portage for legacy support? A symlink to gentoo-portage is fine. 158.36.2.10 has been added to the access list for rsync1.us.gentoo.org. Please update your rsync cron jobs to point to that server and post back here when you've done so. We'll monitor the server for a couple days to make sure things are working fine and then add it to the main rotation.
Hi again, I finaly caught up with my private e-mail. I've requested adding gentoo-x86-portage as a rsync module, and changed my portage mirroring source as requested. I've had to change the directory layout since I was obviously stupid when I set up the first one. /pub/linux/Gentoo for sources/distfiles /pub/linux/Gentoo-portage for the portage/rsync mirror The rsync modules remains the same of course - but gentoo-portage will be broken for a few hours until a root-user reads his mail and fixes rsyncd.conf Also, I know I saw a sources/distfiles mirroring doc, but now I can't find it again. So I'll keep mirroring the sources from ibiblio. Regards, Nicolai
the source mirroring doc is at <http://www.gentoo.org/doc/en/source_mirrors.xml> ... i don't know why it's not on the doc list, but i'll add it. thanks for the mirror!
I've noticed some spots where the timestamp seems to be off. Have you noticed any errors? Also, are you running ntp? When the syncs do occur, they seem to be a little late. It could just be the time the syncs are taking. Here's what I've logged so far (both times in UTC). ? indicates when a timestamp wasn't accurate. Time Checked Timestamp ------- ------------------------------- 17:48 Fri, 11 Apr 2003 16:03:00 +0000 ? 18:17 Fri, 11 Apr 2003 16:03:00 +0000 ? 18:35 Fri, 11 Apr 2003 18:33:00 +0000 19:17 Fri, 11 Apr 2003 18:33:00 +0000 ? 20:17 Fri, 11 Apr 2003 19:33:00 +0000 ? 00:22 Fri, 11 Apr 2003 19:33:00 +0000 ? 16:52 Sat, 12 Apr 2003 16:31:00 +0000 18:16 Sat, 12 Apr 2003 17:33:00 +0000 ? 18:39 Sat, 12 Apr 2003 18:31:00 +0000 19:09 Sat, 12 Apr 2003 18:31:00 +0000 ? 15:48 Sun, 13 Apr 2003 15:32:00 +0000 16:22 Sun, 13 Apr 2003 16:03:00 +0000 16:40 Sun, 13 Apr 2003 16:33:00 +0000 20:16 Sun, 13 Apr 2003 20:03:00 +0000 00:46 Mon, 14 Apr 2003 00:31:06 +0000 02:23 Mon, 14 Apr 2003 02:03:00 +0000 02:49 Mon, 14 Apr 2003 02:31:00 +0000 03:25 Mon, 14 Apr 2003 02:31:00 +0000 ? 03:31 Mon, 14 Apr 2003 03:31:00 +0000 13:42 Mon, 14 Apr 2003 12:02:00 +0000 ? 14:16 Mon, 14 Apr 2003 12:02:00 +0000 ? 14:39 Mon, 14 Apr 2003 12:02:00 +0000 ? 20:14 Mon, 14 Apr 2003 20:03:00 +0000 20:49 Mon, 14 Apr 2003 20:32:00 +0000 21:06 Mon, 14 Apr 2003 21:03:00 +0000
We have been NTPified for 10 years or so. So too for ftp.uninett.no: nil@spheniscus ~ $ ntptrace localhost.localdomain: stratum 4, offset 0.000001, synch distance 0.07495 pierot.uio.no: stratum 3, offset 0.000098, synch distance 0.06474 fartein.ifi.uio.no: stratum 2, offset -0.000077, synch distance 0.05392 chronos.cru.fr: stratum 1, offset -0.000054, synch distance 0.00000, refid 'GPS' nil@spheniscus ~ $ crontab -l | grep gentoo 0,30 * * * * /hom/nil/mirror/bin/nil/gentoo-rsync 0 */4 * * * /hom/nil/mirror/bin/nil/gentoo-source Of course the load has been above 10 since the release of redhat 9. But the total runtime of the script is on the order of .50 seconds when there is nothing to mirror. Checked our cron logs, they are below for the 14th, timestamps are in GMT+2 (CET DST alias CEST). The timestamp is by syslogd. One thing I notice is that the offset is almost always whole minutes, to your timing mechanism only have whole minute resolution or is that the time to the second? But this does not match well with unset times at all. The other thing is that your timestamp log seems to show the same timestamp several times in row. Why is that? Apr 14 00:00:00 spheniscus CROND[17143]: (nil) CMD (/hom/nil/mirror/bin/nil/gentoo-source) Apr 14 00:00:00 spheniscus CROND[17144]: (nil) CMD (/hom/nil/mirror/bin/nil/gentoo-rsync) Apr 14 00:30:00 spheniscus CROND[12741]: (nil) CMD (/hom/nil/mirror/bin/nil/gentoo-rsync) Apr 14 01:00:00 spheniscus CROND[18428]: (nil) CMD (/hom/nil/mirror/bin/nil/gentoo-rsync) Apr 14 01:30:00 spheniscus CROND[25104]: (nil) CMD (/hom/nil/mirror/bin/nil/gentoo-rsync) Apr 14 02:00:00 spheniscus CROND[25790]: (nil) CMD (/hom/nil/mirror/bin/nil/gentoo-rsync) Apr 14 02:30:00 spheniscus CROND[3808]: (nil) CMD (/hom/nil/mirror/bin/nil/gentoo-rsync) Apr 14 03:00:00 spheniscus CROND[21949]: (nil) CMD (/hom/nil/mirror/bin/nil/gentoo-rsync) Apr 14 03:30:00 spheniscus CROND[14908]: (nil) CMD (/hom/nil/mirror/bin/nil/gentoo-rsync) Apr 14 04:00:00 spheniscus CROND[24171]: (nil) CMD (/hom/nil/mirror/bin/nil/gentoo-source) Apr 14 04:00:00 spheniscus CROND[24172]: (nil) CMD (/hom/nil/mirror/bin/nil/gentoo-rsync) Apr 14 04:30:00 spheniscus CROND[26418]: (nil) CMD (/hom/nil/mirror/bin/nil/gentoo-rsync) Apr 14 05:00:00 spheniscus CROND[29910]: (nil) CMD (/hom/nil/mirror/bin/nil/gentoo-rsync) Apr 14 05:30:00 spheniscus CROND[10661]: (nil) CMD (/hom/nil/mirror/bin/nil/gentoo-rsync) Apr 14 06:00:00 spheniscus CROND[9969]: (nil) CMD (/hom/nil/mirror/bin/nil/gentoo-rsync) Apr 14 06:30:00 spheniscus CROND[3077]: (nil) CMD (/hom/nil/mirror/bin/nil/gentoo-rsync) Apr 14 07:00:00 spheniscus CROND[23254]: (nil) CMD (/hom/nil/mirror/bin/nil/gentoo-rsync) Apr 14 07:30:00 spheniscus CROND[24607]: (nil) CMD (/hom/nil/mirror/bin/nil/gentoo-rsync) Apr 14 08:00:00 spheniscus CROND[25248]: (nil) CMD (/hom/nil/mirror/bin/nil/gentoo-source) Apr 14 08:00:00 spheniscus CROND[25249]: (nil) CMD (/hom/nil/mirror/bin/nil/gentoo-rsync) Apr 14 08:30:00 spheniscus CROND[3733]: (nil) CMD (/hom/nil/mirror/bin/nil/gentoo-rsync) Apr 14 09:00:00 spheniscus CROND[32647]: (nil) CMD (/hom/nil/mirror/bin/nil/gentoo-rsync) Apr 14 09:30:00 spheniscus CROND[12236]: (nil) CMD (/hom/nil/mirror/bin/nil/gentoo-rsync) Apr 14 10:00:00 spheniscus CROND[6759]: (nil) CMD (/hom/nil/mirror/bin/nil/gentoo-rsync) Apr 14 10:30:00 spheniscus CROND[25765]: (nil) CMD (/hom/nil/mirror/bin/nil/gentoo-rsync) Apr 14 11:00:00 spheniscus CROND[5126]: (nil) CMD (/hom/nil/mirror/bin/nil/gentoo-rsync) Apr 14 11:30:00 spheniscus CROND[7651]: (nil) CMD (/hom/nil/mirror/bin/nil/gentoo-rsync) Apr 14 12:00:00 spheniscus CROND[17644]: (nil) CMD (/hom/nil/mirror/bin/nil/gentoo-source) Apr 14 12:00:00 spheniscus CROND[17645]: (nil) CMD (/hom/nil/mirror/bin/nil/gentoo-rsync) Apr 14 12:30:00 spheniscus CROND[21143]: (nil) CMD (/hom/nil/mirror/bin/nil/gentoo-rsync) Apr 14 13:00:00 spheniscus CROND[6773]: (nil) CMD (/hom/nil/mirror/bin/nil/gentoo-rsync) Apr 14 13:30:01 spheniscus CROND[20110]: (nil) CMD (/hom/nil/mirror/bin/nil/gentoo-rsync) Apr 14 14:00:00 spheniscus CROND[5554]: (nil) CMD (/hom/nil/mirror/bin/nil/gentoo-rsync) Apr 14 14:30:00 spheniscus CROND[7714]: (nil) CMD (/hom/nil/mirror/bin/nil/gentoo-rsync) Apr 14 15:00:00 spheniscus CROND[31435]: (nil) CMD (/hom/nil/mirror/bin/nil/gentoo-rsync) Apr 14 15:30:00 spheniscus CROND[10515]: (nil) CMD (/hom/nil/mirror/bin/nil/gentoo-rsync) Apr 14 16:00:00 spheniscus CROND[4642]: (nil) CMD (/hom/nil/mirror/bin/nil/gentoo-source) Apr 14 16:00:00 spheniscus CROND[4643]: (nil) CMD (/hom/nil/mirror/bin/nil/gentoo-rsync) Apr 14 16:30:00 spheniscus CROND[26364]: (nil) CMD (/hom/nil/mirror/bin/nil/gentoo-rsync) Apr 14 17:00:00 spheniscus CROND[11460]: (nil) CMD (/hom/nil/mirror/bin/nil/gentoo-rsync) Apr 14 17:30:00 spheniscus CROND[13232]: (nil) CMD (/hom/nil/mirror/bin/nil/gentoo-rsync) Apr 14 18:00:01 spheniscus CROND[9675]: (nil) CMD (/hom/nil/mirror/bin/nil/gentoo-rsync) Apr 14 18:30:00 spheniscus CROND[11666]: (nil) CMD (/hom/nil/mirror/bin/nil/gentoo-rsync) Apr 14 19:00:00 spheniscus CROND[12742]: (nil) CMD (/hom/nil/mirror/bin/nil/gentoo-rsync) Apr 14 19:30:00 spheniscus CROND[17147]: (nil) CMD (/hom/nil/mirror/bin/nil/gentoo-rsync) Apr 14 20:00:00 spheniscus CROND[26198]: (nil) CMD (/hom/nil/mirror/bin/nil/gentoo-source) Apr 14 20:00:00 spheniscus CROND[26199]: (nil) CMD (/hom/nil/mirror/bin/nil/gentoo-rsync) Apr 14 20:30:00 spheniscus CROND[28868]: (nil) CMD (/hom/nil/mirror/bin/nil/gentoo-rsync) Apr 14 21:00:00 spheniscus CROND[29160]: (nil) CMD (/hom/nil/mirror/bin/nil/gentoo-rsync) Apr 14 21:30:00 spheniscus CROND[10342]: (nil) CMD (/hom/nil/mirror/bin/nil/gentoo-rsync) Apr 14 22:00:00 spheniscus CROND[7195]: (nil) CMD (/hom/nil/mirror/bin/nil/gentoo-rsync) Apr 14 22:30:00 spheniscus CROND[23969]: (nil) CMD (/hom/nil/mirror/bin/nil/gentoo-rsync) Apr 14 23:00:01 spheniscus CROND[25688]: (nil) CMD (/hom/nil/mirror/bin/nil/gentoo-rsync) Apr 14 23:30:00 spheniscus CROND[4330]: (nil) CMD (/hom/nil/mirror/bin/nil/gentoo-rsync) Apr 15 00:00:00 spheniscus CROND[20666]: (nil) CMD (/hom/nil/mirror/bin/nil/gentoo-source) Apr 15 00:00:00 spheniscus CROND[20667]: (nil) CMD (/hom/nil/mirror/bin/nil/gentoo-rsync) Is your server ntp synced right now? :-) Nicolai
Last timestamp is from "Thu, 29 May 2003 09:32:00 +0000". Is the server still scheduled for syncing?
Hi, I've had a "date" and "ntptrace" in the top of my mirroring scripts for a while now. ftp.uninett.no is very reliably ntp synced at stratum 4. I would like you to check your logs again. Here are some recent log entries - can you please compare the times with your own? Tue Jun 17 22:30:00 CEST 2003 localhost.localdomain: stratum 4, offset 0.000006, synch distance 0.07300 Tue Jun 17 22:00:01 CEST 2003 localhost.localdomain: stratum 4, offset 0.000009, synch distance 0.07199 Tue Jun 17 21:30:01 CEST 2003 localhost.localdomain: stratum 4, offset 0.000006, synch distance 0.07492 Tue Jun 17 21:00:01 CEST 2003 localhost.localdomain: stratum 4, offset -0.000081, synch distance 0.07922 Tue Jun 17 20:30:01 CEST 2003 localhost.localdomain: stratum 4, offset 0.000019, synch distance 0.07529 Tue Jun 17 20:00:01 CEST 2003 localhost.localdomain: stratum 4, offset 0.000014, synch distance 0.07307 Tue Jun 17 19:30:00 CEST 2003 localhost.localdomain: stratum 4, offset 0.000001, synch distance 0.06830 Tue Jun 17 19:00:01 CEST 2003 localhost.localdomain: stratum 4, offset 0.000014, synch distance 0.06567 ... Fri Jun 13 02:30:00 CEST 2003 localhost.localdomain: stratum 4, offset -0.000060, synch distance 0.07213 Fri Jun 13 02:00:01 CEST 2003 localhost.localdomain: stratum 4, offset 0.000011, synch distance 0.07619 Fri Jun 13 01:30:01 CEST 2003 localhost.localdomain: stratum 4, offset 0.000013, synch distance 0.07881 Fri Jun 13 01:00:00 CEST 2003 localhost.localdomain: stratum 4, offset 0.000007, synch distance 0.06953 Fri Jun 13 00:30:00 CEST 2003 localhost.localdomain: stratum 4, offset 0.000008, synch distance 0.07274 Fri Jun 13 00:00:01 CEST 2003 localhost.localdomain: stratum 4, offset -0.000180, synch distance 0.07524 Thu Jun 12 23:30:00 CEST 2003 localhost.localdomain: stratum 4, offset 0.000002, synch distance 0.07358 Thu Jun 12 23:00:00 CEST 2003 localhost.localdomain: stratum 4, offset -0.000475, synch distance 0.06688 ... Wed Jun 11 13:30:00 CEST 2003 localhost.localdomain: stratum 4, offset -0.000211, synch distance 0.07227
I will be watching this again (on the rsync side) and see if we can't get this mirror rolling in the next couple of days. Cheers!
First off, my apologies for taking so long to get to this bug. I've added the source mirror to: http://www.gentoo.org/main/en/mirrors.xml It should show up on the site within 4 hours. I've also sent instructions on accessing our private distfile mirror at OSU to janl@linpro.no. Please change your scripts to sync against this mirror. It has restricted access, so you should always be able to obtain the latest and greatest source files from there. Thank you for helping to support gentoo linux. --kurt
Also, I've subscribed janl@linpro.no to our gentoo-mirrors mailing list which is a low-volume mailing list that we use to discuss and announce items related to the Gentoo system of mirrors.
The rsync side looks good, so I've setup this mirror as rsync2.no.gentoo.org and is also in the rsync.europe.gentoo.org and rsync.no.gentoo.org sets. Thanks for your time and resources. Cheers! (leaving this bug open for klieber to finish up the source side)
OK. Rsync is now running through a -c on the ::gentoo module - for the sake of my paranoia. Will I also get access to the portage master? Or is sync1.us.gentoo.org::gentoo-portage/ the master? Or am I dim? Regards, Nicolai
The portage master is rsync1.us.gentoo.org, which you have been pulling from. Cheers!
closing this bug..
