Gentoo Websites Logo
Go to: Gentoo Home Documentation Forums Lists Bugs Planet Store Wiki Get Gentoo!

Bug 417373

Summary: Can't no more copy large files with scp (openssh-6.0_p1) or rsync (rsync-3.0.9-r2)
Product: Gentoo Linux Reporter: Juergen Rose <rose>
Component: Current packagesAssignee: Gentoo Linux bug wranglers <bug-wranglers>
Severity: normal    
Priority: Normal    
Version: unspecified   
Hardware: All   
OS: Linux   
Package list:
Runtime testing required: ---

Description Juergen Rose 2012-05-24 13:46:54 UTC
I want to copy some files from "lynx" to "moose". At "moose" there is 6% or 16GB free in the target partition. And I can login from "lynx" into "moose" without entering a password, because the ssh-agent or gnome-keyring-daemon (?) manage my ssh-key:

rose@lynx:/home/rose(5)$ ssh moose df /home
Filesystem          1K-blocks      Used Available Use% Mounted on
/dev/mapper/vg-home 268127560 238219268  16486520  94% /home_moose

The size of the files I want to copy is smaller than 30MB:

rose@lynx:/home/rose(6)$ du -s Txt/Hardware_test/Cameras/Canon/utsira.*
5412    Txt/Hardware_test/Cameras/Canon/utsira.crw
18628   Txt/Hardware_test/Cameras/Canon/utsira.ppm

'rsync' hangs with:

rose@lynx:/home/rose(7)$ rsync -vvvv Txt/Hardware_test/Cameras/Canon/utsira.* moose:/home_moose/rose/Txt/Hardware_test/Cameras/Canon/
cmd=<NULL> machine=moose user=<NULL> path=/home_moose/rose/Txt/Hardware_test/Cameras/Canon/
cmd[0]=ssh cmd[1]=moose cmd[2]=rsync cmd[3]=--server cmd[4]=-vvvve.Lsf cmd[5]=. cmd[6]=/home_moose/rose/Txt/Hardware_test/Cameras/Canon/ 
opening connection using: ssh moose rsync --server -vvvve.Lsf . /home_moose/rose/Txt/Hardware_test/Cameras/Canon/ 
note: iconv_open("UTF-8", "UTF-8") succeeded.
(Server) Protocol versions: remote=30, negotiated=30
(Client) Protocol versions: remote=30, negotiated=30
[sender] make_file(utsira.crw,*,0)
[sender] make_file(utsira.ppm,*,0)
[sender] flist start=0, used=2, low=0, high=1
[sender] i=0 Txt/Hardware_test/Cameras/Canon utsira.crw mode=0100640 len=5528964 flags=0
[sender] i=1 Txt/Hardware_test/Cameras/Canon utsira.ppm mode=0100640 len=19046801 flags=0
send_file_list done
file list sent
send_files starting
server_recv(2) starting pid=11114
received 2 names
[Receiver] flist start=0, used=2, low=0, high=1
[Receiver] i=0 1 utsira.crw mode=0100640 len=5528964 flags=0
[Receiver] i=1 1 utsira.ppm mode=0100640 len=19046801 flags=0
recv_file_list done
get_local_name count=2 /home_moose/rose/Txt/Hardware_test/Cameras/Canon/
generator starting pid=11114
delta-transmission enabled
send_files(0, Txt/Hardware_test/Cameras/Canon/utsira.crw)
count=0 n=0 rem=0
send_files mapped Txt/Hardware_test/Cameras/Canon/utsira.crw of size 5528964
calling match_sums Txt/Hardware_test/Cameras/Canon/utsira.crw

At the target computer I can see, that about 3.3MB are arrived:

root@moose:/root(4)# du -s /home_moose/rose/Txt/Hardware_test/Cameras/Canon/.??* /home_moose/rose/Txt/Hardware_test/Cameras/Canon/*
3328    /home_moose/rose/Txt/Hardware_test/Cameras/Canon/.utsira.crw.aCSOXv
12920   /home_moose/rose/Txt/Hardware_test/Cameras/Canon/IMG_8787.CR2
13440   /home_moose/rose/Txt/Hardware_test/Cameras/Canon/IMG_8791.CR2
14092   /home_moose/rose/Txt/Hardware_test/Cameras/Canon/IMG_8792.CR2
4       /home_moose/rose/Txt/Hardware_test/Cameras/Canon/Readme.txt

I can copy small files with scp without problems:

rose@lynx:/home/rose(34)$ scp -rp workflow.pdf rose@moose:/home/rose/
workflow.pdf                                                                                                                          100%  126KB 126.2KB/s 126.2KB/s   00:00    
rose@lynx:/home/rose(35)$ scp -rp saved_etc__wireless/  rose@moose:/home/rose/
_wireless.Home_WLAN                                                                                                                   100%   12KB  12.0KB/s  12.0KB/s   00:00    
_wireless.BIPdm                                                                                                                       100%   12KB  12.0KB/s  12.0KB/s   00:00    
_wireless.MDC                                                                                                                         100%   12KB  12.0KB/s  12.0KB/s   00:00    
_wireless.TFH_WLAN                                                                                                                    100%   12KB  12.0KB/s  12.0KB/s   00:00    
_wireless.Home                                                                                                                        100%   12KB  12.0KB/s  12.0KB/s   00:00    
_wireless.TFH                                                                                                                         100%   12KB  12.0KB/s  12.0KB/s   00:00    

But if I want to copy larger files (all together about 29 MB), 'scp' failes after about 1MB:

rose@lynx:/home/rose(1)$ du -s Txt/Pictures/Travelling/IBMT_Spreewald_Trip_2012/
28624	Txt/Pictures/Travelling/IBMT_Spreewald_Trip_2012/

rose@lynx:/home/rose(5)$ scp -rp Txt/Pictures/Travelling/IBMT_Spreewald_Trip_2012/ moose:/home/rose/
DSCF1108.JPG                   20%  992KB   0.0KB/s   0.1KB/s - stalled -^CKilled by signal 2.

rose@lynx:/home/rose(6)$ scp Txt/Hardware_test/Cameras/Canon/utsira.* moose:/home_moose/rose/Txt/Hardware_test/Cameras/Canon/
utsira.crw                     21% 1184KB   0.0KB/s   0.0KB/s - stalled -^CKilled by signal 2.

If I try to copy the same files via NFS, there is no problem:

rose@lynx:/home/rose(8)$ ssh moose  du -s /home/rose/IBMT_Spreewald_Trip_2012/
du: cannot access '/home/rose/IBMT_Spreewald_Trip_2012/': No such file or directory
rose@lynx:/home/rose(9)$ cp -a Txt/Pictures/Travelling/IBMT_Spreewald_Trip_2012/ /net/moose/home_moose/rose/
rose@lynx:/home/rose(10)$ ssh moose  du -s /home/rose/IBMT_Spreewald_Trip_2012/
28552	/home/rose/IBMT_Spreewald_Trip_2012/

The next attempt with an other computer ("leopard", about 300 GB free in home partion):

rose@lynx:/home/rose(15)$ ssh leopard "df /home_leopard/"
Filesystem           1K-blocks     Used Available Use% Mounted on
/dev/mapper/vg0-home 326785744 10627656 299800304   4% /home_leopard

rose@lynx:/home/rose(16)$  scp Txt/Hardware_test/Cameras/Canon/utsira.* leopard:/home_leopard/rose/
utsira.crw                                                                           24% 1296KB   0.0KB/s   0.1KB/s - stalled -^CKilled by signal 2.
rose@lynx:/home/rose(17)$  scp .bash_profile leopard:/home_leopard/rose/
.bash_profile                                                                       100%   66KB  65.8KB/s  65.8KB/s   00:00    

Some weeks ago I did not see such a kind of problems, I also checked now the filessystem of the home partion at moose and no error was detected.

Any hint is appreciated.
Comment 1 Michael Weber (RETIRED) gentoo-dev 2012-05-24 13:56:40 UTC

*** This bug has been marked as a duplicate of bug 414401 ***