PlanetMirror's rsync service has been unavailable for weeks. Reproducible: Always Steps to Reproduce: 1. 2. 3. Expected Results: If they are no longer providing rsync service, they should be removed from the available rsync server list. bash-2.05b# emerge sync >>> starting rsync with rsync://rsync.asia.gentoo.org/gentoo-portage... Welcome to PlanetMirror's rsync service for Gentoo Linux You can find a web front end to this archive at: http://planetmirror.com You can also access this service via FTP at ftp://ftp.planetmirror.com !!! --- !!! If you are a regular Gentoo or PM user, please consider supporting your distribution and PlanetMirror by subscribing to a Premium account via the web front end. !!! --- !!! @ERROR: Unknown module 'gentoo-portage' rsync: connection unexpectedly closed (481 bytes read so far) rsync error: error in rsync protocol data stream (code 12) at io.c(165)
I've temporarily removed the following from DNS: A (IPv4 Host) rsync.au.gentoo.org CNAME (Alias) rsync1.au.gentoo.org -> rsync-gentoo.planetmirror.com Since this was the only rsync.au.gentoo.org I've added a CNAME alias from rsync.au.gentoo.org to rsync.gentoo.org to prevent anyone from having problems with rsync.au.gentoo.org. This will need to be reverted when planetmirror comes back. Have sent an e-mail to gentoo-mirror@planetmirror.com about this. -Corey
E-mail from the admin: Hi Corey, On 16 Jul 2003, Corey Shields wrote: > We got a report that users were no longer able to get the portage tree > updates from your server. We have rsync-gentoo.planetmirror.com as the > mirror for portage updates. On that system there is only one module, > gentoo. We need both the gentoo-portage modules and the > gentoo-x86-portage modules. Setup for these are documented at: > http://www.gentoo.org/doc/en/rsync.xml Okay no worries. I've re-added these packages to the rsync list and tested that they work fine. If you notice a problem let me know and i'll fix it immediately. > Also, we need to ask that you update this tree every 30 minutes on the > hour and the half hour. From our logs, your machine is updating every 2 > hours at :34 after the hour. Okay, i've changed this back. A little bit of history here: we were originally mirroring this every 30 mins per the requirements, however we were finding that the rsync process was taking longer that 30 minutes to complete, resulting in several overlapping rsync processes. We raised this with gentoo but to my knowledge nothing was done. That said, I've set up a locking mechanism now so that if an old process is still running, the new one wont start. -- Regards, Dan Goodes : Systems Programmer : dang@planetmirror.com Help support PlanetMirror - Australia's largest Internet archive by signing up for PlanetMirror Premium : http://planetmirror.com My response: Thanks for getting to this so quickly! As for the long rsync process, this should be better now as OSU (host of rsync1.us.gentoo.org) has recently upgraded their network. Also, the 30 minute interval is for the portage mirror only. The source mirror needs to be updated every 4 hours. If you are trying to update the source mirror every 30 minutes that may be causing problems as well. Cheers! I will begin monitoring the mirror today and hopefully add it later on today.
bash-2.05b$ rsync rsync-gentoo.planetmirror.com::gentoo-portage Welcome to PlanetMirror's rsync service for Gentoo Linux You can find a web front end to this archive at: http://planetmirror.com You can also access this service via FTP at ftp://ftp.planetmirror.com !!! --- !!! If you are a regular Gentoo or PM user, please consider supporting your distribution and PlanetMirror by subscribing to a Premium account via the web front end. !!! --- !!! drwxr-xr-x 4096 2003/09/30 20:37:10 . drwxr-xr-x 4096 2003/09/30 20:38:01 app-admin drwxr-xr-x 4096 2003/09/30 20:38:01 app-arch drwxr-xr-x 4096 2003/09/30 20:38:01 app-benchmarks drwxr-xr-x 4096 2003/09/30 20:38:01 app-cdr drwxr-xr-x 4096 2003/09/30 20:38:01 app-crypt drwxr-xr-x 4096 2003/09/30 20:38:01 app-dicts drwxr-xr-x 4096 2003/09/30 20:38:01 app-doc drwxr-xr-x 4096 2003/09/30 20:38:01 app-editors drwxr-xr-x 4096 2003/09/30 20:38:01 app-emacs drwxr-xr-x 4096 2003/09/30 20:38:01 app-emulation drwxr-xr-x 4096 2003/09/30 20:38:01 app-gnustep drwxr-xr-x 4096 2003/09/30 20:38:01 app-i18n drwxr-xr-x 4096 2003/09/30 20:38:01 app-misc drwxr-xr-x 4096 2003/09/30 20:38:01 app-office drwxr-xr-x 4096 2003/09/30 20:38:01 app-pda drwxr-xr-x 4096 2003/09/30 20:38:01 app-portage drwxr-xr-x 4096 2003/09/30 20:38:01 app-sci drwxr-xr-x 4096 2003/09/30 20:38:01 app-shells drwxr-xr-x 4096 2003/09/30 20:38:01 app-text drwxr-xr-x 4096 2003/09/30 20:38:01 app-vim ..... bash-2.05b$ dig rsync.au.gentoo.org ; <<>> DiG 9.2.2 <<>> rsync.au.gentoo.org ;; global options: printcmd ;; Got answer: ;; ->>HEADER<<- opcode: QUERY, status: NOERROR, id: 63077 ;; flags: qr rd ra; QUERY: 1, ANSWER: 12, AUTHORITY: 2, ADDITIONAL: 2 ;; QUESTION SECTION: ;rsync.au.gentoo.org. IN A ;; ANSWER SECTION: rsync.au.gentoo.org. 46325 IN CNAME rsync.gentoo.org. rsync.gentoo.org. 1145 IN A 168.215.173.144 rsync.gentoo.org. 1145 IN A 206.167.194.132 rsync.gentoo.org. 1145 IN A 206.169.166.57 rsync.gentoo.org. 1145 IN A 216.176.132.235 rsync.gentoo.org. 1145 IN A 64.113.39.7 rsync.gentoo.org. 1145 IN A 64.246.0.222 rsync.gentoo.org. 1145 IN A 66.132.32.20 rsync.gentoo.org. 1145 IN A 128.227.212.225 rsync.gentoo.org. 1145 IN A 130.207.108.134 rsync.gentoo.org. 1145 IN A 132.207.4.160 rsync.gentoo.org. 1145 IN A 146.186.218.75 ;; AUTHORITY SECTION: rsync.gentoo.org. 37634 IN NS udns1.ultradns.net. rsync.gentoo.org. 37634 IN NS udns2.ultradns.net. ;; ADDITIONAL SECTION: udns1.ultradns.net. 28153 IN A 204.69.234.1 udns2.ultradns.net. 28153 IN A 204.74.101.1 ;; Query time: 6 msec ;; SERVER: 127.0.0.1#53(127.0.0.1) ;; WHEN: Tue Sep 30 21:15:44 2003 ;; MSG SIZE rcvd: 336 bash-2.05b$ dig rsync-gentoo.planetmirror.com ; <<>> DiG 9.2.2 <<>> rsync-gentoo.planetmirror.com ;; global options: printcmd ;; Got answer: ;; ->>HEADER<<- opcode: QUERY, status: NOERROR, id: 11729 ;; flags: qr rd ra; QUERY: 1, ANSWER: 2, AUTHORITY: 0, ADDITIONAL: 0 ;; QUESTION SECTION: ;rsync-gentoo.planetmirror.com. IN A ;; ANSWER SECTION: rsync-gentoo.planetmirror.com. 3323 IN CNAME gentoo.planetmirror.com. gentoo.planetmirror.com. 3324 IN A 203.16.234.26 bash-2.05b# emerge sync >>> starting rsync with rsync://rsync-gentoo.planetmirror.com/gentoo-portage... Welcome to PlanetMirror's rsync service for Gentoo Linux .......... receiving file list ... 57429 files to consider (NOTE - I have some package classifications omitted so this may not be the full normal amount) app-admin/ app-admin/amanda/ ..... deleting x11-wm/ion-devel/files/digest-ion-devel-20030814-r1 deleting x11-wm/ion-devel/files/digest-ion-devel-20030814 deleting x11-wm/ion-devel/files/digest-ion-devel-20030327 deleting x11-wm/ion-devel/files/digest-ion-devel-20030131 rsync[7788] (receiver) heap statistics: arena: 8094392 (bytes from sbrk) ordblks: 799 (chunks not in use) smblks: 2 hblks: 1 (chunks from mmap) hblkhd: 258048 (bytes from mmap) usmblks: 0 fsmblks: 40 uordblks: 7142456 (bytes used) fordblks: 951936 (bytes free) keepcost: 89504 (bytes in releasable chunk) Number of files: 57429 Number of files transferred: 970 Total file size: 46531424 bytes Total transferred file size: 1333839 bytes Literal data: 629928 bytes Matched data: 703923 bytes File list size: 1245253 Total bytes written: 28057 Total bytes read: 1915525 wrote 28057 bytes read 1915525 bytes 2552.31 bytes/sec total size is 46531424 speedup is 23.94 >>> Updating Portage cache... \ They seem to be working now. Time to change the dns back?
Probably should of been more specific. The DNS entry for rsync.au.gentoo.org does not contain 203.16.234.26 (aka gentoo.planetmirror.com and rsync-gentoo.planetmirror.com) as Corey changed in comment 1.
My apologies. I've added you back in as rsync1.au.gentoo.org, also rsync.au.gentoo.org This should appear as soon as dns propogates. Cheers! -Corey
