Gentoo Websites Logo
Go to: Gentoo Home Documentation Forums Lists Bugs Planet Store Wiki Get Gentoo!
Bug 26636 - emerge rsync: "too many open files" error
Summary: emerge rsync: "too many open files" error
Status: VERIFIED NEEDINFO
Alias: None
Product: Portage Development
Classification: Unclassified
Component: Unclassified (show other bugs)
Hardware: x86 Linux
: High normal (vote)
Assignee: Portage team
URL: http://forums.gentoo.org/viewtopic.ph...
Whiteboard:
Keywords:
Depends on:
Blocks:
 
Reported: 2003-08-14 11:15 UTC by Robert Nagle
Modified: 2011-10-30 22:18 UTC (History)
0 users

See Also:
Package list:
Runtime testing required: ---


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Robert Nagle 2003-08-14 11:15:52 UTC
Every time I run emerge rsync I get a failure. 

It happens for every rsync server I connect to. What the heck is happening? 
(posted on forum) http://forums.gentoo.org/viewtopic.php?t=75041&highlight=

wrote 3910 bytes read 1426765 bytes 81752.86 bytes/sec 
total size is 45050485 speedup is 31.49 
rsync error: some files could not be transferred (code 23) at main.c(1045) 


>>> Starting retry 1 of 3 


You are using the SBBSNet Gentoo RSync Mirror 
dedicated to Gentoo rsync updates. 

* rsync10.us.gentoo.org 
* 64.113.39.7 
* Located in Saginaw, Michigan USA 

For problems or questions contact: 
support@pathworx.com 


More info: It seems to run the normal steps of rysnc, but right at the end it 
gives this problem. 

4736 100% 0.00kB/s 0:00:00 
opendir(net-mail/teapop/files): Too many open files 
rsync[10565] (receiver) heap statistics: 
arena: 8041144 (bytes from sbrk) 
ordblks: 791 (chunks not in use) 
smblks: 2 
hblks: 1 (chunks from mmap) 
hblkhd: 258048 (bytes from mmap) 
usmblks: 0 
fsmblks: 40 
uordblks: 7197160 (bytes used) 
fordblks: 843984 (bytes free) 
keepcost: 1872 (bytes in releasable chunk) 

Number of files: 57578 
Number of files transferred: 6 
Total file size: 45050483 bytes 
Total transferred file size: 6281 bytes 
Literal data: 2749 bytes 
Matched data: 3532 bytes 
File list size: 1283972 
Total bytes written: 338 
Total bytes read: 1286056 

wrote 338 bytes read 1286056 bytes 77963.27 bytes/sec 
total size is 45050483 speedup is 35.02 
rsync error: some files could not be transferred (code 23) at main.c(1045) 

Ok, the problem still exists. It happens even when emerge rysnc goes to 
different mirrors. 

I can emerge packages ok. However, I can't update my rsync 

The only other information I've been able to find on this kind of error: 
http://groups.google.com/groups?hl=en&lr=lang_en&ie=UTF-8&oe=UTF-
8&threadm=3DFF1595.9040600%40cvzoom.net&rnum=2&prev=/groups%3Fq%3D%2522too%
2Bmany%2Bopen%2Bfiles%2522%2Bgentoo%26ie%3DUTF-8%26oe%3DUTF-8%26hl%3Den 

Reproducible: Always
Steps to Reproduce:
1. whenever I do emerge rsync (regardless of which mirror it sends me to) 
2.
3.




bash-2.05b# emerge info 
emerge info 
Portage 2.0.48-r5 (default-x86-1.4, gcc-3.2.3, glibc-2.3.2-r1) 
================================================================= 
System uname: 2.4.19-gentoo-r10 i686 AMD Athlon(tm) Processor 
GENTOO_MIRRORS="http://gentoo.oregonstate.edu 
http://distro.ibiblio.org/pub/Linux/distributions/gentoo" 
CONFIG_PROTECT="/etc /var/qmail/control /usr/kde/2/share/config /usr/kde/3/shar
e/config /usr/X11R6/lib/X11/xkb /opt/tomcat/conf /usr/kde/3.1/share/config /usr
/share/config" 
CONFIG_PROTECT_MASK="/etc/gconf /etc/env.d" 
PORTDIR="/usr/portage" 
DISTDIR="/usr/portage/distfiles" 
PKGDIR="/usr/portage/packages" 
PORTAGE_TMPDIR="/var/tmp" 
PORTDIR_OVERLAY="" 
USE="oss 3dnow apm avi foomaticdb mad mikmod nls pdflib xv slang guile sdl gpm 
pam esd opengl acpi -apache apache berkdb cdr crypt cups encode evo flash gb 
gdbm gif -gnome -gtk gtkhtml imap imlib innodb ipv6 java jikes jpeg kde 
kerberos lcms ldap libg++ libgda libwww mbox mmx motif mozilla mpeg mule mysql 
ncurses odbc oggvorbis pda perl pic png python postgres qt qtmt quicktime 
readline ruby samba scanner spell ssl svga tcltk tcpd truetype X xml xml2 xmms 
zeo x86 zlib arts" 
COMPILER="gcc3" 
CHOST="i686-pc-linux-gnu" 
CFLAGS="-O2 -mcpu=i686 -pipe" 
CXXFLAGS="-O2 -mcpu=i686 -pipe" 
ACCEPT_KEYWORDS="x86" 
MAKEOPTS="-j2" 
AUTOCLEAN="yes" 
SYNC="rsync://rsync.gentoo.org/gentoo-portage" 
FEATURES="sandbox ccache"
Comment 1 SpanKY gentoo-dev 2003-08-14 16:35:39 UTC
that google link is completely unrelated 
Comment 2 Brian Harring (RETIRED) gentoo-dev 2004-08-17 01:01:38 UTC
Offhand, unless there are massive amounts of open files portage is leaving open (possible via anydbm/eclass cache), this sounds like it isn't portage's fault.
I'd be curious about your user limits you established?  Reopen w/ the info if this is still persisting.
Comment 3 Marius Mauch (RETIRED) gentoo-dev 2007-01-11 11:00:51 UTC
Closing due to old age