Gentoo Websites Logo
Go to: Gentoo Home Documentation Forums Lists Bugs Planet Store Wiki Get Gentoo!
Bug 57296 - Public Linux Source Mirror hosted at Case Western Reserve University
Summary: Public Linux Source Mirror hosted at Case Western Reserve University
Status: RESOLVED FIXED
Alias: None
Product: Mirrors
Classification: Unclassified
Component: New Server (show other bugs)
Hardware: x86 Linux
: High normal (vote)
Assignee: Mirror Admins
URL:
Whiteboard:
Keywords:
Depends on:
Blocks:
 
Reported: 2004-07-16 08:23 UTC by Benjamin Chodroff
Modified: 2004-11-03 05:32 UTC (History)
0 users

See Also:
Package list:
Runtime testing required: ---


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Benjamin Chodroff 2004-07-16 08:23:24 UTC
The box is a 2 Ghz AMD with 1 GB of ram and 500 GB of IDE storage.
The network is fiber optic gigabit with an unrestricted I2 uplink. The school has a 45 MB uplink to the internet.
The server name is chod.cwru.edu

Reproducible: Always
Steps to Reproduce:
1. Turn on computer
2. 
3. Prosper
Comment 1 Jeffrey Forman (RETIRED) gentoo-dev 2004-07-17 07:40:45 UTC
Benjamin,

I cant find the Gentoo source directories on your mirror. Neither ftp nor http shows anything. {ftp,http}://chod.crwu.edu/gentoo doesnt exist. Get that working and I'd be happy to add your mirror to our listing. Thanks!

-Jeffrey
Comment 2 Benjamin Chodroff 2004-07-18 08:59:01 UTC
OK, got all the files...except I didn't see the experimental folder when I rsync-d from ibiblio...but the core stuff is there and up on ftp://chod.cwru.edu/gentoo and http://chod.cwru.edu/gentoo.

I'm also running an rsync of the packages at rsync://chod.cwru.edu.
The ftp and http should be updating every 4 hours...I'm using this command:
0 0,4,8,12,16,20 * * * /usr/bin/rsync -qrulHpogt www.ibiblio.org::gentoo/* /mnt/hdb1/mirror/gentoo >/dev/null 2>&1

Let me know if there is anything wrong with that. I will check to make sure it keeps updating. Hope all goes well!
Comment 3 Jeffrey Forman (RETIRED) gentoo-dev 2004-07-18 14:02:26 UTC
Benjamin,

It seems your http might be misconfigured, I am getting permission denied errors on that. But the ftp looks fine. Get that http working and I can add you to the listing.

-Jeffrey
Comment 4 Benjamin Chodroff 2004-07-18 15:11:19 UTC
Well, I fixed it, but it's not eloquent.

I now am doing a chmod -R 755 /mnt/hdb1/mirror/gentoo each time after I update.
This means that in the highly rare event that someone requests a file in the millisecond after an update comes out before it chmod's it to be http accessible (and who uses http anyways- i guess people who have admins that disabled outgoing ftp??), they won't be able to.

Is there a way to tell rsync to set a specific umask? I am using the "p" option...should I not be?

Yep, otherwise, looks good to me.
Comment 5 Jeffrey Forman (RETIRED) gentoo-dev 2004-07-29 06:30:10 UTC
I'd like to add you as a mirror but dont see any files. I apologize for the late respond on this bug.

-Jeffrey
Comment 6 Benjamin Chodroff 2004-07-29 08:33:49 UTC
Ah, fixed a problem with a mount. Should be up and stable now.

I still was wondering what I should be using for my rsync options?
I am currently using rsync -au --force --delete-after server

Is this correct? Is there something better? Will this remove old files that are no longer present on the server?

Thanks!
Comment 7 Jeffrey Forman (RETIRED) gentoo-dev 2004-08-19 04:15:41 UTC
Thanks for helping out Gentoo. I have added your mirror to our list at http://www.gentoo.org/main/en/mirrors.xml. Please start synching from masterdistfiles.gentoo.org as the email I have sent to you instructs. We would like you to subscribe to the gentoo-mirrors Mailing List by sending an email to gentoo-mirrors-subscribe@lists.gentoo.org, as we send out notifications of updates, releases, and changes in policy to the mirrors.  Once again, thanks for the hardware and bandwidth!

For Infrastructure,
Jeffrey
Comment 8 Jeffrey Forman (RETIRED) gentoo-dev 2004-10-22 06:01:43 UTC
Benjamin,

I'm getting access denied on the http section of the mirror:
http://chod.cwru.edu/gentoo

Please get that fixed before I have to remove it from the mirror list. 

Thanks,
Jeffrey
Comment 9 Benjamin Chodroff 2004-10-22 07:36:07 UTC
That is odd...everything looks correct? See the outputs below...but perhaps is it a specific file(s) that are not syncing?

I will try to get some other people off the network to test it out...but the apache logs show many recent successful non-intranet requests.

Ben Chodroff


Emerge Output on emerge -av karamba-test
>>> Downloading http://chod.cwru.edu/gentoo/distfiles/karamba-0.17.tar.gz
--10:30:18--  http://chod.cwru.edu/gentoo/distfiles/karamba-0.17.tar.gz
           => `/usr/portage/distfiles/karamba-0.17.tar.gz'
Resolving chod.cwru.edu... 129.22.21.15
Connecting to chod.cwru.edu[129.22.21.15]:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 592,274 [application/x-tar]

100%[====================================>] 592,274       --.--K/s             

10:30:18 (13.58 MB/s) - `/usr/portage/distfiles/karamba-0.17.tar.gz' saved [592274/592274]
-------------------------------------------------------------------------------------------------------------------------

I would say it's possibly a network issue, but my apache logs are showing many connects from other places:

---excerpt from tail -n 40 var/log/apache2/access_log------------------
68.50.76.69 - - [22/Oct/2004:10:10:37 -0400] "GET /gentoo/distfiles/bluefish-0.1                          
3.tar.bz2 HTTP/1.0" 404 337 "-" "Wget/1.9"
217.40.136.185 - - [22/Oct/2004:10:10:50 -0400] "GET /gentoo/distfiles/mirrorsel                          
ect-test HTTP/1.0" 200 102403 "-" "Wget/1.9"
82.37.149.29 - - [22/Oct/2004:10:13:43 -0400] "GET /gentoo/distfiles/mirrorselec                          
t-test HTTP/1.0" 200 102403 "-" "Wget/1.9"
66.191.148.226 - - [22/Oct/2004:10:15:44 -0400] "GET /gentoo/distfiles/URI-1.34.                          
tar.gz HTTP/1.0" 404 331 "-" "Wget/1.9.1"
80.136.251.162 - - [22/Oct/2004:10:15:47 -0400] "GET /gentoo/distfiles/mirrorsel                          
ect-test HTTP/1.0" 200 102403 "-" "Wget/1.9"
213.112.87.46 - - [22/Oct/2004:10:15:48 -0400] "GET /gentoo/distfiles/mirrorsele                          
ct-test HTTP/1.0" 200 102403 "-" "Wget/1.9"
207.46.98.47 - - [22/Oct/2004:10:16:13 -0400] "GET /robots.txt HTTP/1.0" 404 309                          
 "-" "msnbot/0.3 (+http://search.msn.com/msnbot.htm)"
207.46.98.47 - - [22/Oct/2004:10:16:13 -0400] "GET /forum HTTP/1.0" 404 304 "-"                           
"msnbot/0.3 (+http://search.msn.com/msnbot.htm)"
213.132.207.195 - - [22/Oct/2004:10:19:25 -0400] "GET /gentoo/distfiles/mirrorse                          
lect-test HTTP/1.0" 200 102403 "-" "Wget/1.9"
81.17.197.113 - - [22/Oct/2004:10:19:56 -0400] "GET /gentoo/distfiles/mirrorsele                          
ct-test HTTP/1.0" 200 102403 "-" "Wget/1.9"
84.133.125.80 - - [22/Oct/2004:10:22:23 -0400] "GET /gentoo/distfiles/mirrorsele                          
ct-test HTTP/1.0" 200 102403 "-" "Wget/1.9"
80.81.61.226 - - [22/Oct/2004:10:23:23 -0400] "GET /gentoo/distfiles/mirrorselec                          
t-test HTTP/1.0" 200 102403 "-" "Wget/1.9"
80.142.250.32 - - [22/Oct/2004:10:23:37 -0400] "GET /gentoo/distfiles/mirrorsele                          
ct-test HTTP/1.0" 200 102403 "-" "Wget/1.9"
69.106.245.125 - - [22/Oct/2004:10:26:24 -0400] "GET /gentoo/distfiles/mirrorsel                          
ect-test HTTP/1.0" 200 102403 "-" "Wget/1.9"
192.117.97.200 - - [22/Oct/2004:10:26:52 -0400] "GET /gentoo/distfiles/mirrorsel                          
ect-test HTTP/1.0" 200 102403 "-" "Wget/1.9"
213.64.178.200 - - [22/Oct/2004:10:27:51 -0400] "GET /gentoo/distfiles/mirrorsel                          
ect-test HTTP/1.0" 200 102403 "-" "Wget/1.9"
207.46.98.134 - - [22/Oct/2004:10:28:05 -0400] "GET /gentoo/releases/historical/                          
x86/2004.0/livecd/i686/?C=M;O=D HTTP/1.0" 403 353 "-" "msnbot/0.3 (+http://searc                          
h.msn.com/msnbot.htm)"
Comment 10 Benjamin Chodroff 2004-10-22 07:46:59 UTC
Nevermind, my bad :)

Indexes got turned off on the gentoo directory -- sorry!
I think I've got that fixed now, please check and close the bug.

Benjamin Chodroff
Comment 11 Jeffrey Forman (RETIRED) gentoo-dev 2004-11-03 05:32:34 UTC
Looks good, thanks for fixing that up!

-Jeffrey