url: http://mirrors.sohu.com/gentoo/ sponsor: sohu.inc,beijing,china bandwidth: more than 100M update frenquency: rsync,and four times per day update from: rsync://mirrors.kernel.org/gentoo/ email alaleiwang@sohu-inc.com zhedou@sohu-inc.com Reproducible: Always
at the same time,we provide: ftp and rsync service, that is: ftp://mirrors.sohu.com/gentoo/ rsync://mirrors.sohu.com/gentoo/ hope to cc to mirror@sohu-inc.com for any related mirror info
Hello alaleiwang, Thanks for being patient and I am able to work through the backlog of requests. Please provide the following info for the record: * Official mirror name * Mirror type: distfiles/releases, gentoo-portage. NOTE: gentoo-portage is always rsync only. Some mirrors may have rsync for distfiles as well. Do not be confused by the difference! * URLs: full protocol and path for release/distfile mirrors, hostname or IP for gentoo-portage mirrors * Hardware specifications * Bandwidth specifications * Location * Intended concurrent users (for each protocol, mirror type) * Admin contact name and email address (This address should be registered in bugzilla so we can CC you to any bug reports) You are now in the testing system.
Fixing due date
Hello alaleiwang, Your mirrors seem to be lagging in their updates. When are you doing your syncs? http INFO mirrors.sohu.com wants to be source mirror and is being checked as per Bug #298614 over http http ERROR Distfiles at http://mirrors.sohu.com/gentoo is lagging (delta is 00d 14h 09m 22s) http INFO mirrors.sohu.com is out of sync http INFO Bug URL : https://bugs.gentoo.org/298614 , due:2010/03/04 http INFO ftp INFO mirrors.sohu.com wants to be a source mirror and is being checked as per Bug #298614 over ftp ftp ERROR Distfiles at ftp://mirrors.sohu.com/gentoo is lagging (delta is 00d 14h 09m 26s) ftp INFO mirrors.sohu.com is out of sync ftp INFO Bug URL : https://bugs.gentoo.org/298614 , due:2010/03/04
reply for Jeremy Olexa (darkside) * Official mirror name ----sohu mirror * Mirror type: distfiles/releases * URLs: http://mirrors.sohu.com ftp://mirrors.sohu.com rsync://mirrors.sohu.com * Hardware specifications mem:12G,disk:1T,cpu:2.27x16 * Bandwidth specifications 1G * Location beijing,china * Intended concurrent users (for each protocol, mirror type) * Admin contact name and email address alaleiwang@sohu-inc.com mirror@sohu-inc.com You are now in the testing system.
(In reply to comment #4) hi: we now set the update frequency to be two day.so please check it again to verify the data . then another question: our mirror is still in the test system? how long will us be passed and to be one of the formal public mirrors?
(In reply to comment #6) > (In reply to comment #4) > hi: > we now set the update frequency to be two day.so please check it again to > verify the data . The frequency should be every 4 hours, not every 12. This info is available here: http://www.gentoo.org/doc/en/source_mirrors.xml 298614 http INFO mirrors.sohu.com wants to be source mirror and is being checked as per Bug #298614 over http 298614 http ERROR Distfiles at http://mirrors.sohu.com/gentoo is lagging (delta is 00d 18h 37m 18s) 298614 http INFO mirrors.sohu.com is out of sync 298614 http INFO Bug URL : https://bugs.gentoo.org/298614 , due:2010/03/04 (same for ftp) > > then another question: our mirror is still in the test system? how long will > us be passed and to be one of the formal public mirrors? Yes, for 2 weeks total, if everything looks fine. Please be patient, there is no need to mail us directly. We are monitoring your mirror. Thanks ;)
They still seem to be lagging: Distfiles at http://mirrors.sohu.com/gentoo is lagging (delta is 00d 20h 10m 32s)
(In reply to comment #8) > They still seem to be lagging: > > Distfiles at http://mirrors.sohu.com/gentoo is lagging (delta is 00d 20h 10m > 32s) > hi: I check our mirror,the newest file is updated last night(23:00),below is some data from our mirror: Name Last modified Size [DIR] Parent Directory - [ ] timestamp.mirmon 09-Mar-2010 23:00 11 [ ] timestamp.chk 09-Mar-2010 23:00 32 [ ] timestamp.x 09-Mar-2010 23:00 40 [ ] timestamp.dev 09-Mar-2010 23:00 42 [ ] chromium-4.0.251.0.tar.bz2 09-Mar-2010 23:00 127M I donot why there is still lagging.... can you tell me how to check whether is lagging?
(In reply to comment #9) > I check our mirror,the newest file is updated last night(23:00),below is some > data from our mirror: > Name Last modified Size [DIR] > Parent Directory - > [ ] timestamp.mirmon 09-Mar-2010 23:00 11 > [ ] timestamp.chk 09-Mar-2010 23:00 32 > [ ] timestamp.x 09-Mar-2010 23:00 40 > [ ] timestamp.dev 09-Mar-2010 23:00 42 > [ ] chromium-4.0.251.0.tar.bz2 09-Mar-2010 23:00 127M > > I donot why there is still lagging.... > can you tell me how to check whether is lagging? > When is your server syncing? It should be every 4 hours as per http://www.gentoo.org/doc/en/source_mirrors.xml
(In reply to comment #10) > (In reply to comment #9) > > I check our mirror,the newest file is updated last night(23:00),below is some > > data from our mirror: > > Name Last modified Size [DIR] > > Parent Directory - > > [ ] timestamp.mirmon 09-Mar-2010 23:00 11 > > [ ] timestamp.chk 09-Mar-2010 23:00 32 > > [ ] timestamp.x 09-Mar-2010 23:00 40 > > [ ] timestamp.dev 09-Mar-2010 23:00 42 > > [ ] chromium-4.0.251.0.tar.bz2 09-Mar-2010 23:00 127M > > > > I donot why there is still lagging.... > > can you tell me how to check whether is lagging? > > > > When is your server syncing? It should be every 4 hours as per > http://www.gentoo.org/doc/en/source_mirrors.xml > yes,we do rsync every 4 fours,as showed below in crontab: 00 */4 * * * (/bin/sh/ /opt/gentoo.sh) our rsync command is : RSYNC='/usr/bin/rsync -rptlv --progress --delete --delete-after --exclude .~tmp~/ --exclude ppc* --exclude debug* --exclude robots.txt --exclude .htaccess' $RSYNC --exclude alpha --exclude arm --exclude hppa --exclude ia64 --exclude mips --exclude s390 --exclude sh --exclude sparc rsync://rsync.us.gentoo.org/gentoo-distfiles/ /opt/web/mirrors.sohu.com/gentoo/ > /opt/logs/gentoo_$(date +%Y%m%d-%H).log 2>&1
(In reply to comment #11) > rsync://rsync.us.gentoo.org/gentoo-distfiles/ /opt/web/mirrors.sohu.com/gentoo/ Ok, that is why. The instructions document say to sync from ftp.ussg.iu.edu::gentoo-distfiles - rsync.us.gentoo.org is the wrong rotation, that one is serving the gentoo-portage tree, not distfiles. Also, you are excluding many directories, this will mean that you will be marked as a "partial mirror" - This is not a problem, just letting you know.
(In reply to comment #12) > (In reply to comment #11) > > > rsync://rsync.us.gentoo.org/gentoo-distfiles/ /opt/web/mirrors.sohu.com/gentoo/ > > Ok, that is why. The instructions document say to sync from > ftp.ussg.iu.edu::gentoo-distfiles - rsync.us.gentoo.org is the wrong rotation, > that one is serving the gentoo-portage tree, not distfiles. > > Also, you are excluding many directories, this will mean that you will be > marked as a "partial mirror" - This is not a problem, just letting you know. > hi we have changed into: RSYNC='/usr/bin/rsync -rptlv --progress --delete --delete-after --exclude .~tmp~/ --exclude ppc* --exclude debug* --exclude robots.txt --exclude .htaccess' $RSYNC --exclude alpha --exclude arm --exclude hppa --exclude ia64 --exclude mips --exclude s390 --exclude sh --exclude sparc ftp.ussg.iu.edu::gentoo-distfiles /opt/web/mirrors.sohu.com/gentoo/ > /opt/logs/gentoo_$(date +%Y%m%d-%H).log 2>&1 please check it again to see everything is ok thanks a lot
Distfiles at ftp://mirrors.sohu.com/gentoo is lagging (delta is 00d 16h 40m 10s) Are all of your syncs completing successfully when they should?
(In reply to comment #14) > Distfiles at ftp://mirrors.sohu.com/gentoo is lagging (delta is 00d 16h 40m > 10s) > > Are all of your syncs completing successfully when they should? > hi: i check rsync log,every file ended with: releases/x86/autobuilds/latest-stage3.txt 139 100% 0.47kB/s 0:00:00 (xfer#75, to-check=693/45845) snapshots/ snapshots/.timestamp-snapshots.x 43 100% 0.14kB/s 0:00:00 (xfer#76, to-check=605/45845) deleting distfiles/windowmaker-0.92.0-patchset-2.tar.bz2 deleting distfiles/warsow_0.42_unified.zip deleting distfiles/warsow_0.42_sdk.zip deleting distfiles/udav-0.5.2.tgz deleting distfiles/proftpd-mod-deflate-0.5.tar.gz deleting distfiles/proftpd-1.3.3rc4.tar.bz2 deleting distfiles/proftpd-1.3.3rc3.tar.bz2 deleting distfiles/gnome-power-manager-2.28.2.tar.bz2 deleting distfiles/gnome-power-manager-2.28.1.tar.bz2 deleting distfiles/gnome-panel-2.24.3.tar.bz2 deleting distfiles/gedit-plugins-2.26.2.tar.bz2 deleting distfiles/bluez-4.61.tar.gz deleting distfiles/Graph-0.92.tar.gz deleting distfiles/.GraphicsMagick-1.3.12.tar.bz2.wDwyPK sent 860042 bytes received 75767257 bytes 248386.71 bytes/sec total size is 147325424535 speedup is 1922.62 rsync error: some files could not be transferred (code 23) at main.c(1298) [generator=2.6.8] what is wrong?
No one else has had issues, so it must be something with this specific server. Where are you storing the files? On a NAS, local disk? There's enough space and nothing else wrong on that machine? Could you run the sync again and add "-vv" to the command, and supply us with that log?
(In reply to comment #16) > No one else has had issues, so it must be something with this specific server. > Where are you storing the files? On a NAS, local disk? There's enough space > and nothing else wrong on that machine? Could you run the sync again and add > "-vv" to the command, and supply us with that log? > hi: i think should not be no problem with our machine,for there are also other rsync instances on the same machine.and our disk is large enough(now still have 1.7T free disk space) i ran the rsync with the "-vv" option,but the file is too large to upload(about 1.5M when tar zipped),how can i give you the log files? my full rsync script is : #!/bin/sh if [ -f "/var/run/gentoo.pid" ]; then RUNPID=`cat /var/run/gentoo.pid` if ps -p $RUNPID; then echo "Mirror is already running..." echo "/var/run/gentoo.pid" exit 1 else echo "Mirror pid found but process dead, cleaning up" rm -f /var/run/gentoo.pid fi else echo "No Mirror Process Detected" fi echo $$ > /var/run/gentoo.pid dodo () { [ $? -eq 0 ] && echo $(date '+%F %H:%M') >/opt/index_info/$1_lu || echo -n "" rm -f /opt/logs/$1_$(date -d '-3 day' +%Y%m%d)-* chown -R apache:apache /opt/web/mirrors.sohu.com/$1 chmod -R 755 /opt/web/mirrors.sohu.com/$1 } RSYNC='/usr/bin/rsync -rptlvvv --progress --delete --delete-after --exclude .~tmp~/ --exclude ppc* --exclude debug* --exclude robots.txt --exclude .htaccess' $RSYNC --exclude alpha --exclude arm --exclude hppa --exclude ia64 --exclude mips --exclude s390 --exclude sh --exclude sparc ftp.ussg.iu.edu::gentoo-distfiles /opt/web/mirrors.sohu.com/gentoo/ > /opt/logs/gentoo_$(date +%Y%m%d-%H).log 2>&1 dodo "gentoo" rm -f /var/run/gentoo.pid
Okay. Looking at the log you sent us, the only file that failed to be sent was: rsync: send_files failed to open "/releases/.test/THIS-FILE-SHOULD-NOT-BE-PUBLIC.txt" (in gentoo-distfiles): Permission denied (13) That isn't going to cause any problems, so we are still left trying to figure out what is happening. Do you see any cases of your syncs timing out, or any other network problems? Could you send us over some of your most recent logs as well? It looks like one of the timestamps is correct (releases/.test/timestamp.x), but distfiles/timestamp.chk is showing that you are lagging.
(In reply to comment #18) > Okay. Looking at the log you sent us, the only file that failed to be sent > was: > > rsync: send_files failed to open > "/releases/.test/THIS-FILE-SHOULD-NOT-BE-PUBLIC.txt" (in gentoo-distfiles): > Permission denied (13) > > That isn't going to cause any problems, so we are still left trying to figure > out what is happening. Do you see any cases of your syncs timing out, or any > other network problems? Could you send us over some of your most recent logs > as well? It looks like one of the timestamps is correct > (releases/.test/timestamp.x), but distfiles/timestamp.chk is showing that you > are lagging. > hi: i believe that our network is fine and fast.... i'll send you the recent logs by mail
(In reply to comment #19) > (In reply to comment #18) > > Okay. Looking at the log you sent us, the only file that failed to be sent > > was: > > > > rsync: send_files failed to open > > "/releases/.test/THIS-FILE-SHOULD-NOT-BE-PUBLIC.txt" (in gentoo-distfiles): > > Permission denied (13) > > > > That isn't going to cause any problems, so we are still left trying to figure > > out what is happening. Do you see any cases of your syncs timing out, or any > > other network problems? Could you send us over some of your most recent logs > > as well? It looks like one of the timestamps is correct > > (releases/.test/timestamp.x), but distfiles/timestamp.chk is showing that you > > are lagging. > > > > hi: > i believe that our network is fine and fast.... > i'll send you the recent logs by mail > any result for this ? is our mirror still lagging?
Its looked alright for the past few days, but I want to monitor it for a little longer to make sure everything is fine before we put it into official rotation.
For some reason our daily checks haven't been able to hit your ftp server for the last 2 nights. Your HTTP mirror is accessible and has been fine, as is your ftp now. I just wanted to make a note of it. Thanks for helping out Gentoo. I have added your mirror to our list at http://www.gentoo.org/main/en/mirrors2.xml. Please start syncing from masterdistfiles.gentoo.org as the email I have sent to you instructs. We would like you to subscribe to the gentoo-mirrors Mailing List by sending an email to gentoo-mirrors+subscribe@lists.gentoo.org, as we send out notifications of updates, releases, and changes in policy to the mirrors. Please also monitor http://mirrorstats.gentoo.org as this application is used to keep track of the up-to-date nature of our mirrors. Thanks for the hardware and bandwidth!
