| Summary: | [full+rsync] New mirror: University of Utah (US) | ||
|---|---|---|---|
| Product: | Mirrors | Reporter: | Chad Lake <clake> |
| Component: | New Server | Assignee: | Shyam Mani (RETIRED) <fox2mike> |
| Status: | RESOLVED LATER | ||
| Severity: | normal | CC: | mirror-admin |
| Priority: | High | ||
| Version: | unspecified | ||
| Hardware: | All | ||
| OS: | Linux | ||
| URL: | http://gentoo.cs.utah.edu | ||
| Whiteboard: | |||
| Package list: | Runtime testing required: | --- | |
|
Description
Chad Lake
2006-08-23 10:31:57 UTC
Thanks for your interest in providing Gentoo with a mirror. I just ran a couple of checks, distfiles (http) seem to be fine : * Timestamp on gentoo.cs.utah.edu is Tue, 05 Sep 2006 16:08:05 +0000 * Current time in UTC is Tue Sep 5 19:59:59 UTC 2006 I have issues reach the ftp mirror though : --01:30:04-- ftp://gentoo.cs.utah.edu/pub/gentoo/distfiles/timestamp.chk => `/tmp/timestamp.chk' Resolving gentoo.cs.utah.edu... 155.98.64.80 Connecting to gentoo.cs.utah.edu|155.98.64.80|:21... connected. Logging in as anonymous ... Logged in! ==> SYST ... done. ==> PWD ... done. ==> TYPE I ... done. ==> CWD /pub/gentoo/distfiles ... done. ==> PASV ... And it just stays there. No luck via the browser either. I get a 425 error after 5 mins. Please do check Also, I'm unable to reach your rsync server from India but have no issues from the US. Here are the traces : From India : ]$ tracepath gentoo.cs.utah.edu 1: 192.168.45.12 (192.168.45.12) 0.351ms pmtu 1500 1: airwolf (192.168.45.11) 0.544ms 2: 59.92.204.7 (59.92.204.7) asymm 1 0.534ms pmtu 1492 3: 218.248.249.10 (218.248.249.10) asymm 5 108.587ms 4: 218.248.255.25 (218.248.255.25) asymm 5 102.658ms 5: 218.248.255.14 (218.248.255.14) 102.075ms 6: sl-st21-la-5-0.sprintlink.net (144.223.44.1) asymm 5 342.116ms 7: sl-bb24-ana-9-0.sprintlink.net (144.232.20.68) asymm 5 350.435ms 8: sl-bb22-ana-13-0.sprintlink.net (144.232.1.149) asymm 5 350.948ms 9: sl-st25-la-0-0-0.sprintlink.net (144.232.9.20) asymm 5 346.803ms 10: leg-208-30-223-62-CHE.sprinthome.com (208.30.223.62) asymm 5 356.379ms 11: 65.90.50.2 (65.90.50.2) asymm 5 363.303ms 12: 204.113.215.42 (204.113.215.42) asymm 5 390.355ms 13: 205.124.239.1 (205.124.239.1) asymm 5 426.454ms 14: 205.124.244.2 (205.124.244.2) asymm 5 386.726ms 15: 205.124.249.118 (205.124.249.118) asymm 5 392.528ms 16: crebc-wr1ebc.net.utah.edu (155.99.132.98) asymm 5 390.194ms 17: r1eng-crebc.net.utah.edu (155.99.132.49) asymm 5 391.892ms 18: no reply 19: no reply 20: no reply From the US : # tracepath gentoo.cs.utah.edu 1: i2.gentoo.osuosl.org (140.211.166.190) 0.201ms pmtu 1500 1: corv-car1-gw.nero.net (140.211.166.161) asymm 2 0.544ms 2: ptck-core1-gw.nero.net (207.98.64.179) asymm 3 2.377ms 3: ptck-car1-gw.nero.net (207.98.64.139) asymm 4 2.444ms 4: prs1-pdx-fe-5-0.pnw-gigapop.net (209.124.179.9) 2.708ms 5: core1-pdx-fe-0-3-0-0.pnw-gigapop.net (209.124.179.17) asymm 6 3.013ms 6: core1-wes-so-0-2-1-0.pnw-gigapop.net (209.124.179.13) asymm 7 10.214ms 7: ccar3-wes-ge-0-0-0-0.pnw-gigapop.net (209.124.176.34) asymm 8 7.460ms 8: no reply 9: 192.43.217.157 (192.43.217.157) 56.839ms 10: 205.124.244.177 (205.124.244.177) asymm 8 46.605ms 11: 205.124.244.2 (205.124.244.2) asymm 9 46.833ms 12: 205.124.249.118 (205.124.249.118) asymm 10 49.215ms 13: crebc-wr1ebc.net.utah.edu (155.99.132.98) asymm 11 47.528ms 14: r2eng-crebc.net.utah.edu (155.99.132.57) asymm 12 54.782ms 15: 155.98.127.22 (155.98.127.22) asymm 13 47.749ms 16: covet.cs.utah.edu (155.98.64.80) asymm 14 47.699ms reached Resume: pmtu 1500 hops 16 back 14 Can you please check/verify what the issue is? Thanks! (In reply to comment #1) > > I have issues reach the ftp mirror though : > > --01:30:04-- ftp://gentoo.cs.utah.edu/pub/gentoo/distfiles/timestamp.chk > => `/tmp/timestamp.chk' > Resolving gentoo.cs.utah.edu... 155.98.64.80 > Connecting to gentoo.cs.utah.edu|155.98.64.80|:21... connected. > Logging in as anonymous ... Logged in! > ==> SYST ... done. ==> PWD ... done. > ==> TYPE I ... done. ==> CWD /pub/gentoo/distfiles ... done. > ==> PASV ... > > And it just stays there. No luck via the browser either. I get a 425 error > after 5 mins. Please do check > Hmmm, I am able to get through from both of my external accounts. ??? That's both here in Utah, and elsewhere in the USA. > Also, I'm unable to reach your rsync server from India but have no issues from > the US. Here are the traces : > > Can you please check/verify what the issue is? Thanks! > That's on the core router before it hits our nets; I'll look into it now. Also, I'll be out of town starting Tuesday through Oct 7th, so if you don't hear back from me for a while, that's why. ;) I'll try to get this resolved before then though. -c Any update? Time-out, please update the bug when you're ready/have an update. Hey, I never did hear back on this. I did respond via email back in October, but it looks like it didn't make it into the ticket. I just tried responding to the ticket via email again and got it bounced: <bugzilla-daemon@gentoo.org>: cannot append message to destination file /dev/null: destination file is executable Hmmm, I wonder if my email has gone to /dev/null in the past? ;) Anyway, here's what I said last back in October. Could you please re-open this ticket and let me know what's going on? Thanks! -c ---- October's email ---- No problem- everything looks good from our end. I had some issue with the portage syncs. but I upped the timeout to a time sufficient enough to make sure that things go through without failing. I've also not been able to get FTP to not go through from off-site. I've tried local and out-of-state accounts, and they've all gone through just fine. I haven't been able to verify that things work from India (the most distant account I have is in Indiana, funnily enough). However, I noticed that the IP address you were coming from (in India) was 192.168.45.12, which is defined a private-only address space by RFC 1918 (which we block). Anyway, in the meantime I've added a CPU and some memory to the machine, and would like to upgrade the kernel- I figured I'd wait until the downtimes were over before responding. I hope to do the upgrade either over the weekend, or perhaps late one night next week. But, if you'd like to hit our site again to see if there are any problems, that'd be cool. Cheers, -c Chad, You can't reply to bugzilla via email, yet :) So you'll have to post your replies here. Ran a check, distfiles : * Timestamp on gentoo.cs.utah.edu is Sun, 05 Aug 2007 04:09:04 +0000 * Current time in UTC is Sun Aug 5 08:39:44 UTC 2007 FTP hangs though : Resolving gentoo.cs.utah.edu... 155.98.64.86 Connecting to gentoo.cs.utah.edu|155.98.64.86|:21... connected. Logging in as anonymous ... Logged in! ==> SYST ... done. ==> PWD ... done. ==> TYPE I ... done. ==> CWD /pub/gentoo/distfiles ... done. ==> PASV ... couldn't connect to 155.98.64.86 port 5687: Connection timed out Retrying. rsync : rsync: failed to connect to gentoo.cs.utah.edu: Connection timed out (110) rsync error: error in socket IO (code 10) at clientserver.c(104) [receiver=2.6.9] Can you please fix these ASAP *** Bug 164895 has been marked as a duplicate of this bug. *** (In reply to comment #6) > Chad, > > You can't reply to bugzilla via email, yet :) So you'll have to post your > replies here. > Well, I suppose you learn something every day. :) > Ran a check, > > distfiles : > > * Timestamp on gentoo.cs.utah.edu is Sun, 05 Aug 2007 04:09:04 +0000 > * Current time in UTC is Sun Aug 5 08:39:44 UTC 2007 > > FTP hangs though : > > Resolving gentoo.cs.utah.edu... 155.98.64.86 > Connecting to gentoo.cs.utah.edu|155.98.64.86|:21... connected. > Logging in as anonymous ... Logged in! > ==> SYST ... done. ==> PWD ... done. > ==> TYPE I ... done. ==> CWD /pub/gentoo/distfiles ... done. > ==> PASV ... couldn't connect to 155.98.64.86 port 5687: Connection timed out > Retrying. > > > rsync : > > rsync: failed to connect to gentoo.cs.utah.edu: Connection timed out (110) > rsync error: error in socket IO (code 10) at clientserver.c(104) > [receiver=2.6.9] > > Can you please fix these ASAP > Can you let me know what IP address you are coming from, and what you are actually doing to test like this? I have tried from both and and off campus, using HTTP, FTP (using PASV) and RSYNC and have no problems (and I just reverified this). Likely this is something not to do with the mirror, but with the connection between the two. Thanks! -c Chad, How do you black requests coming from NAT'ed machines? I think the problem is this : You're seeing my Private internal IP (should be 192.168.99.something) instead of my public IP. None of the other mirrors do this, and we have a lot of users that will try to sync this way. Other public servers, like Apache for instance, see my public IP and not an internal LAN IP, so it's not an issue with anything on my side. Let's investigate this further. Well, we shouldn't be blocking NAT'd machines at all- the only reason I referenced the private IP addr was that back in October, when I first opened this ticket, I saw our router dropping private a private IP addr at about the same time as when you were testing....dunno know if that is what is going on here, and given that you get *some* connectivity (http, at least starting the FTP conversation) I doubt that's the case. Could you please try the tests again, and let me know time you tried, and what IP (public) you are coming from? This box is a primary mirror for SuSE, Apache, Mozilla and Slackware, so we get a *lot* of traffic, so knowing the time/IP would help me pull out your connection from the logs. Thanks! -c Public IP : 218.212.16.134 OR 202.156.14.10 Tried just now, bw 1510-1525 CDT. --04:17:39-- ftp://gentoo.cs.utah.edu/pub/gentoo/distfiles/timestamp.chk => `/tmp/timestamp.chk' Resolving gentoo.cs.utah.edu... 155.98.64.86 Connecting to gentoo.cs.utah.edu|155.98.64.86|:21... connected. Logging in as anonymous ... Logged in! ==> SYST ... done. ==> PWD ... done. ==> TYPE I ... done. ==> CWD /pub/gentoo/distfiles ... done. ==> PASV ... couldn't connect to 155.98.64.86 port 30321: Connection timed out Retrying. Weird. I see wget logging in from your machine, and then that's it. Nothing in our firewall logs, just silence. Hmmm, I wonder if campus is doing something really weird, although I doubt it as I can do an ftp transfer from that box off site no problem: [229] xmission:~:> wget ftp://gentoo.cs.utah.edu/pub/gentoo/distfiles/timestamp.chk --14:28:35-- ftp://gentoo.cs.utah.edu/pub/gentoo/distfiles/timestamp.chk => `timestamp.chk' Resolving gentoo.cs.utah.edu... 155.98.64.86 Connecting to gentoo.cs.utah.edu|155.98.64.86|:21... connected. Logging in as anonymous ... Logged in! ==> SYST ... done. ==> PWD ... done. ==> TYPE I ... done. ==> CWD /pub/gentoo/distfiles ... done. ==> PASV ... done. ==> RETR timestamp.chk ... done. Length: 32 (unauthoritative) 100%[=====================================================================================================>] 32 --.--K/s 14:28:35 (1.29 KB/s) - `timestamp.chk' saved [32] [230] xmission:~:> I'll ask the guys who run the campus firewall if they see anything going on in their flows, and I'll let you know. But it is weird, as I do this kind of thing all the time.... Thanks, -c Oh, and I assume it doesn't matter what interface you're hitting...but could you try this: wget ftp://mirror.cs.utah.edu/pub/apache.org/DATE just to make sure. Thanks! -c Same with DATE. Ok, the campus firewall have adjusted some things (they didn't tell me exactly what....I've asked for specifics). But, I was wondering if you could try it now to see if there is any change in behavior. Thanks! -c No change from here. Still the same. Grr. I have since tried this from 4 other off-site sites with no problems whatsoever. Can you try to ftp this from one of our other machines, to help figure out if this is a networking or machine issue: ftp://ftp.cs.utah.edu/users/clake/motd Thanks, -c (In reply to comment #17) > Grr. > > I have since tried this from 4 other off-site sites with no problems > whatsoever. Can you try to ftp this from one of our other machines, to help > figure out if this is a networking or machine issue: > > ftp://ftp.cs.utah.edu/users/clake/motd > Hello? Anybody there? -c I can see the MOTD just fine, but I'm not in India! I'll try to get some movement on this by poking fox2mike next time he's available - since it'd be nice to get this *long* open bug resolved and you added to the mirrors list! :) Cheers, Alex (In reply to comment #19) > I can see the MOTD just fine, but I'm not in India! I'll try to get some > movement on this by poking fox2mike next time he's available - since it'd be > nice to get this *long* open bug resolved and you added to the mirrors list! :) > Awesome- thanks for looking into this. I have had several people try to download stuff from off-site, including in Europe, and having seen any issues to date (I don't know anybody in Asia to check). Thanks, -c (In reply to comment #20) > > Awesome- thanks for looking into this. I have had several people try to > download stuff from off-site, including in Europe, and having seen any issues > to date (I don't know anybody in Asia to check). > s/having/haven't/ Sorry. ;) -c Chad, I'm sorry, but there still seems to be an issue here. To be honest, I've tested a ton of mirrors (almost everything that's on http://www.gentoo.org/main/en/mirrors2.xml) and not one of them have an issue from where I am now, Singapore. When I test your mirror, while the HTTP works fine, the FTP doesn't. * Checking ftp mirror : gentoo.cs.utah.edu --2008-03-03 00:45:07-- ftp://gentoo.cs.utah.edu/pub/gentoo/distfiles/timestamp.chk => `/tmp/timestamp.chk' Resolving gentoo.cs.utah.edu... 155.98.64.86 Connecting to gentoo.cs.utah.edu|155.98.64.86|:21... connected. Logging in as anonymous ... Logged in! ==> SYST ... done. ==> PWD ... done. ==> TYPE I ... done. ==> CWD /pub/gentoo/distfiles ... done. ==> SIZE timestamp.chk ... 32 ==> PASV ... couldn't connect to 155.98.64.86 port 47454: Connection timed out Retrying. At this point, I'm not inclined to add your FTP mirror. The HTTP mirror looks okay, and I have no issue with adding that alone. * Timestamp on gentoo.cs.utah.edu is Sun, 02 Mar 2008 13:08:03 +0000 * Current time in UTC is Sun Mar 2 16:44:53 UTC 2008 Let me know if that's okay and I'll add you in. This bug's been open long enough with the same issue :) (In reply to comment #22) > Chad, > > I'm sorry, but there still seems to be an issue here. To be honest, I've tested > a ton of mirrors (almost everything that's on > http://www.gentoo.org/main/en/mirrors2.xml) and not one of them have an issue > from where I am now, Singapore. When I test your mirror, while the HTTP works > fine, the FTP doesn't. > And for all the off-campus sites I have access to, I can't get this to error. ;) Can you log in anonymously to ftp.cs.utah.edu and ftp.csbs.utah.edu? These are two other FTP servers on campus...hopefully this will help determine if the problem is in the campus network, or just our network. Thanks, -c (In reply to comment #23) > Can you log in anonymously to ftp.cs.utah.edu and ftp.csbs.utah.edu? These are > two other FTP servers on campus...hopefully this will help determine if the > problem is in the campus network, or just our network. Here goes : $ ftp ftp.cs.utah.edu Connected to ftp.cs.utah.edu (155.98.65.24). 220 "SoC Anonymous FTP server" Name (ftp.cs.utah.edu:shyam): anonymous 530 Please login with USER and PASS. SSL not available 230- 230- 230- Welcome to the anonymous ftp server for the University of Utah 230- School of Computing. This is intended for academic use only, 230- and all transactions are logged. 230- 230- * To access individual user's ftp files, go to 230- /users/<username>. 230- 230- * To access research-group related files, go to 230- /research/<research-group>. 230- 230- * To access sites that we mirror, please ftp to 230- mirror.cs.utah.edu. 230- 230- * To submit files, please upload them to the /incoming 230- directory. Note that you will not be able to overwrite, 230- remove or download files from this directory. 230- 230- If you have any questions, comments, or difficulties, please 230- send email to support@cs.utah.edu. Thanks, and enjoy your stay. 230- 230 Login successful. Remote system type is UNIX. Using binary mode to transfer files. ftp> $ ftp ftp.csbs.utah.edu Connected to ftp.csbs.utah.edu (155.97.81.44). 220-ftp.csbs.utah.edu NcFTPd Server (free educational license) ready. 220-!--------------------------------------------------------------! 220-! Welcome to the CSBS ftp gateway. ! 220-! ! 220-! All connections AND commands are logged, if you ! 220-! disagree with this policy, LOG OFF NOW. ! 220-! ! 220-! INFO: ! 220-!--------------------------------------------------------------! 220-! * Public users may login as anonymous. ! 220-! ! 220-! * CSBS users may login using their CSBS ftp account. ! 220-! Accounts created upon request. ! 220-! ! 220-! POLICY: ! 220-!--------------------------------------------------------------! 220-! ! 220-! * Files stored in the anonymous ftp space are not backed ! 220-! up and are not private in any way ! 220-! ! 220-! * /incoming is for upload and download of temporary files ! 220-! The server will remove files from /incoming after 7 ! 220-! days AUTOMATICALLY. ! 220-! ! 220-! * If you need /pub storage for longer distribution, please ! 220-! contact the helpdesk listed below. ! 220-! ! 220-! * CSBS Computing is not responsible for the content on ! 220-! this server in any way. ! 220-! ! 220-! PROBLEMS: ! 220-!--------------------------------------------------------------! 220-! Submit a helpdesk request at: ! 220-! http://support.csbs.utah.edu ! 220-!--------------------------------------------------------------! 220- 220 Name (ftp.csbs.utah.edu:shyam): anonymous 502 Unimplemented command. SSL not available 331 Guest login ok, send your complete e-mail address as password. Password: 230-You are user #1 of 50 simultaneous users allowed. 230- 230 Logged in anonymously. Remote system type is UNIX. Using binary mode to transfer files. ftp> If you notice carefully, it's not the login that's the issue..but the PASV mode connection to a different port that is. I'm not sure if that's a hint. (In reply to comment #24) > > If you notice carefully, it's not the login that's the issue..but the PASV mode > connection to a different port that is. I'm not sure if that's a hint. > Exactly- but like I said, I can't see this problem on any of the external machines I have access to either. Now that I can verify that you can log into ftp.cs.utah.edu, can you fetch these files: ftp://ftp.cs.utah.edu/users/clake/gentoo_test ftp://ftp.csbs.utah.edu/pub/ssh/README Again, I can use PASV ftp from off-campus and out of state just fine, so my guess is that something really subtle is going on with a firewall somewhere in between our two servers. The two servers I'm asking for you to try exist within our network (cs.utah.edu) and another network on campus (csbs.utah.edu). Both are used all the time from off campus, including APNIC and NAT'd addresses, and I've never heard of a complaint for either server. That doesn't mean the issue isn't somewhere on campus though, and if it is, I would like to find out who's firewall is creating the problem. Thanks for your help! -c Ok, another 6 weeks go by without a response. You know this ticket is over 1.5 years old now. Never mind- it's obvious you guys aren't interested in having us help you out with having a mirror site set up. I'll just remove the files, tear down the mirror, and be done with it. -c Chad, Sorry, here are your results : $ wget ftp://ftp.cs.utah.edu/users/clake/gentoo_test --2008-05-13 16:24:04-- ftp://ftp.cs.utah.edu/users/clake/gentoo_test => `gentoo_test' Resolving ftp.cs.utah.edu... 155.98.65.24 Connecting to ftp.cs.utah.edu|155.98.65.24|:21... connected. Logging in as anonymous ... Logged in! ==> SYST ... done. ==> PWD ... done. ==> TYPE I ... done. ==> CWD /users/clake ... done. ==> SIZE gentoo_test ... 54 ==> PASV ... couldn't connect to 155.98.65.24 port 54353: Connection timed out Retrying. $ wget ftp://ftp.csbs.utah.edu/pub/ssh/README --2008-05-13 16:30:42-- ftp://ftp.csbs.utah.edu/pub/ssh/README => `README' Resolving ftp.csbs.utah.edu... 155.97.81.44 Connecting to ftp.csbs.utah.edu|155.97.81.44|:21... connected. Logging in as anonymous ... Logged in! ==> SYST ... done. ==> PWD ... done. ==> TYPE I ... done. ==> CWD /pub/ssh ... done. ==> SIZE README ... 1317 ==> PASV ... done. ==> RETR README ... done. Length: 1317 (1.3K) 100%[============================================================================================================================================>] 1,317 --.-K/s in 0.006s 2008-05-13 16:30:53 (210 KB/s) - `README' saved [1317] Since I see the mirror is still up, I hope this will give you an idea of what's wrong. Closing. Re-open if you'd like to help out again. |
