Official mirror name: Indian Institute of Technology Kanpur (IITK) Mirror type: distfiles/releases, gentoo-portage URLs: http://mirror.cse.iitk.ac.in/gentoo/ ftp://mirror.cse.iitk.ac.in/gentoo/ rsync://mirror.cse.iitk.ac.in/gentoo-portage/ Hardware specifications: Intel(R) Xeon(R) CPU E5405 @ 2.00GHz, 16 GiB, 8TiB Bandwidth specifications: 1Gbps Location: Kanpur, India Intended concurrent users: rsync is limited to 10 Admin: vikraman[at]{gentoo.org,cse.iitk.ac.in}, mirror[at]cse.iitk.ac.in This would be the first official mirror for India!
Hello, thanks for bearing with us during our freeze on mirror additions. Could you quickly confirm that your request to become a community mirror is still current. We expect to begin testing new mirrors soon. As your mirror is located in a sparsely-covered region, you'd be among the first ones to be added. Thanks!
Yes, please go ahead with the tests.
Your mirror is now being actively tested. This period will initially last two weeks. We will inform you about any issues we find with your mirror. Please be responsive and resolve them at your earliest convenience. If the testing completes successfully, your mirror will be added to the appropriate rotations.
Issues: - No FTP service running - HTTP sync interval seems to be 5 hours, spec requires "every 4 starting midnight local time" - RSYNC is also not in sync as per spec "every 30 minutes, once in :00-:10 and once in :30-:40)
(In reply to Alex Legler from comment #4) > Issues: > - No FTP service running Negative, request to test again or share the diagnosis. I could connect over ftp from a remote server. here's the transcript - ``` ftp mirror.cse.iitk.ac.in Connected to mirror.cse.iitk.ac.in. 220 Welcome to blah FTP service. Name (mirror.cse.iitk.ac.in:user): anonymous 331 Please specify the password. Password: 230 Login successful. Remote system type is UNIX. Using binary mode to transfer files. ftp> ls 200 PORT command successful. Consider using PASV. 150 Here comes the directory listing. drwxr-xr-x 16 1006 1006 4096 Jan 04 10:22 archlinux drwxrwxr-x 42 1015 1014 4096 Dec 14 12:35 centos drwxr-xr-x 8 1005 1005 4096 Jan 04 13:26 debian drwxr-xr-x 9 1005 1005 4096 Jan 04 04:40 debian-archive drwxrwsr-x 6 1005 1005 4096 Jan 04 10:32 debian-backports drwxrwxr-x 6 1005 1005 103 Jan 04 04:41 debian-security drwxr-xr-x 3 1003 1003 26 Jun 24 2015 fedora drwxr-xr-x 5 1003 1003 86 Oct 26 2010 fedora-archive drwxr-xr-x 6 1011 1011 92 Mar 28 2011 gentoo drwxr-xr-x 170 1011 1011 8192 Jan 01 02:31 gentoo-portage drwxr-xr-x 10 1014 1013 4096 Nov 24 14:37 linuxmint drwxr-xr-x 3 1014 1013 34 Aug 02 21:33 linuxmint-iso drwxr-xr-x 4 1003 1003 43 Jul 15 2014 rpmfusion drwxrwsr-x 15 1007 1007 4096 Dec 31 17:24 toc drwxr-xr-x 6 1004 1004 4096 Jan 04 00:24 ubuntu 226 Directory send OK. ftp> cd gentoo 250 Directory successfully changed. ftp> ls 200 PORT command successful. Consider using PASV. 150 Here comes the directory listing. drwxr-xr-x 2 1011 1011 3321856 Jan 04 09:52 distfiles drwxr-xr-x 18 1011 1011 4096 Jan 04 03:45 experimental drwxr-xr-x 15 1011 1011 4096 Dec 21 16:52 releases drwxrwxr-x 3 1011 1011 8192 Jan 04 01:00 snapshots 226 Directory send OK. ``` > - HTTP sync interval seems to be 5 hours, spec requires "every 4 starting > midnight local time" > - RSYNC is also not in sync as per spec "every 30 minutes, once in :00-:10 > and once in :30-:40) The `crontab -l` on server has these - ``` 21 */4 * * * /home/gentoo/sync/sync-source.sh 7,37 * * * * /home/gentoo/sync/sync-portage.sh ``` `sync-source.sh` does HTTP sync and `sycn-portage.sh` does RSYNC. May be the sync process is running for too long? But, even then those instances should be sporadic, may be you can perform tests at different times in the day and check? Let me know if we can fix these in a better way?
(In reply to Adarsh J from comment #5) > (In reply to Alex Legler from comment #4) > > Issues: > > - No FTP service running > > Negative, request to test again or share the diagnosis. I could connect over > ftp from a remote server. here's the transcript - I am unable to retrieve files. `curl -v ftp://mirror.cse.iitk.ac.in/gentoo/distfiles/timestamp.mirmon' hangs after RETR. > > > - HTTP sync interval seems to be 5 hours, spec requires "every 4 starting > > midnight local time" > > - RSYNC is also not in sync as per spec "every 30 minutes, once in :00-:10 > > and once in :30-:40) > > The `crontab -l` on server has these - > ``` > 21 */4 * * * /home/gentoo/sync/sync-source.sh > 7,37 * * * * /home/gentoo/sync/sync-portage.sh > ``` > > `sync-source.sh` does HTTP sync and `sycn-portage.sh` does RSYNC. > > May be the sync process is running for too long? But, even then those > instances should be sporadic, may be you can perform tests at different > times in the day and check? Where are you syncing from right now?
(In reply to Alex Legler from comment #6) > (In reply to Adarsh J from comment #5) > > (In reply to Alex Legler from comment #4) > > > Issues: > > > - No FTP service running > > > > Negative, request to test again or share the diagnosis. I could connect over > > ftp from a remote server. here's the transcript - > > I am unable to retrieve files. > `curl -v ftp://mirror.cse.iitk.ac.in/gentoo/distfiles/timestamp.mirmon' > hangs after RETR. > Okay, this is reproducible on my end. On closer inspection this seems to be related to FTP over NFS configuration on server. We might need to finetune the internal NFS server and the client settings, the huge number of files (74440) in `distfiles` directory is somehow causing timeout. Do you have a good recommendation on this kind of config? (I've started diagnosing, but might need some time to come up with optimal config) > > > > > - HTTP sync interval seems to be 5 hours, spec requires "every 4 starting > > > midnight local time" > > > - RSYNC is also not in sync as per spec "every 30 minutes, once in :00-:10 > > > and once in :30-:40) > > > > The `crontab -l` on server has these - > > ``` > > 21 */4 * * * /home/gentoo/sync/sync-source.sh > > 7,37 * * * * /home/gentoo/sync/sync-portage.sh > > ``` > > > > `sync-source.sh` does HTTP sync and `sycn-portage.sh` does RSYNC. > > > > May be the sync process is running for too long? But, even then those > > instances should be sporadic, may be you can perform tests at different > > times in the day and check? > > Where are you syncing from right now? The current server is set as "rsync://ftp.ussg.iu.edu/gentoo-distfiles/" for sync-source and "rsync://rsync.de.gentoo.org/gentoo-portage" for sync-portage.
(In reply to Adarsh J from comment #7) > Okay, this is reproducible on my end. On closer inspection this seems to be > related to FTP over NFS configuration on server. We might need to finetune > the internal NFS server and the client settings, the huge number of files > (74440) in `distfiles` directory is somehow causing timeout. Do you have a > good recommendation on this kind of config? (I've started diagnosing, but > might need some time to come up with optimal config) Sadly I have advice for you. As HTTP seems to work we can also skip adding FTP if diagnosis is too time-consuming. > […] > > The current server is set as "rsync://ftp.ussg.iu.edu/gentoo-distfiles/" for > sync-source and "rsync://rsync.de.gentoo.org/gentoo-portage" for > sync-portage. Might be unfavorable timing. The lag does exceed limits slightly, but always decreases steadily, so I'm fine with it. We'll see how things look when syncing from the masters.
(In reply to Alex Legler from comment #8) > Sadly I have advice for you. > As HTTP seems to work we can also skip adding FTP if diagnosis is too > time-consuming. > Sure, that works for us. I did preliminary checks and couldn't find any obvious settings that could be tweaked to get it to work properly with FTP. We shall send a new request for FTP if and when we fix the issue. > > […] > > > > The current server is set as "rsync://ftp.ussg.iu.edu/gentoo-distfiles/" for > > sync-source and "rsync://rsync.de.gentoo.org/gentoo-portage" for > > sync-portage. > > Might be unfavorable timing. The lag does exceed limits slightly, but always > decreases steadily, so I'm fine with it. We'll see how things look when > syncing from the masters. Cool! Let me know once we are granted access to master. thanks,
Tests looking good now. One more thing: We have very recently updated the rsync update procedure: Please include '--checksum' in the update job for the rsync mirror (cf. https://archives.gentoo.org/gentoo-mirrors/message/01de7f043018783072fd8834ef99576f) and let us know on this bug when you have enabled it. Thanks!
(In reply to Alex Legler from comment #10) > Tests looking good now. yay! > One more thing: > We have very recently updated the rsync update procedure: Please include > '--checksum' in the update job for the rsync mirror (cf. > https://archives.gentoo.org/gentoo-mirrors/message/ > 01de7f043018783072fd8834ef99576f) and let us know on this bug when you have > enabled it. Thanks! Updated. I've enabled `--checksum` in both portage and source sync. thanks,
bump!
We recently upgraded hard disks, which has resulted in significant improvement in latency (time-to-first-byte) and overall throughput. Request to kindly check if we meet the quality standard and include us into official mirror list. Thanks,
Demand for mirrors is not large, so we do not need additional mirrors at this time. Thank you for your consideration. -A
Adarsh J, we'd love to have an Indian mirror. http://mirror.cse.iitk.ac.in/gentoo/ looks stuck in 2020 to me. Is there any way it could be revived?
(In reply to Sam James from comment #15) > Adarsh J, we'd love to have an Indian mirror. > > http://mirror.cse.iitk.ac.in/gentoo/ looks stuck in 2020 to me. Is there any > way it could be revived? I've sent an email too.
