On my gentoo diskless nfs as root client, I have noticed that the wrong file sizes are being reported for large files (typically gigabyte size files). Examples: On Client: 1604642844 bytes On Server: 5899610140 bytes On Client: 3741085696 bytes On Server: 8036052992 bytes I think that this might be a regression because the same problem was described in a previous version of nfs-utils: http://forums.fedoraforum.org/showthread.php?t=137225 Reproducible: Always Steps to Reproduce: 1. Setup a diskless nfs as root client 2. Compare large files (multiple gigabytes) on client and server. Actual Results: Large file sizes are reported incorrectly on the nfs client. Expected Results: Large file sizes should reported correctly on the nfs client. nfs client emerge --info: Portage 2.1.9.25 (default/linux/amd64/10.0, gcc-4.4.4, glibc-2.11.2-r3, 2.6.36-gentoo-r5 x86_64) ================================================================= System uname: Linux-2.6.36-gentoo-r5-x86_64-AMD_Athlon-tm-_II_X2_235e_Processor-with-gentoo-2.0.1 Timestamp of tree: Tue, 21 Dec 2010 17:45:01 +0000 app-shells/bash: 4.1_p7 dev-java/java-config: 2.1.11-r1 dev-lang/python: 2.6.5-r3, 3.1.2-r4 dev-util/cmake: 2.8.1-r2 sys-apps/baselayout: 2.0.1-r1 sys-apps/openrc: 0.6.8 sys-apps/sandbox: 2.4 sys-devel/autoconf: 2.13, 2.65-r1 sys-devel/automake: 1.9.6-r3, 1.10.3, 1.11.1 sys-devel/binutils: 2.20.1-r1 sys-devel/gcc: 4.4.4-r2 sys-devel/gcc-config: 1.4.1 sys-devel/libtool: 2.2.10 sys-devel/make: 3.81-r2 virtual/os-headers: 2.6.36.1 (sys-kernel/linux-headers) ACCEPT_KEYWORDS="amd64" ACCEPT_LICENSE="*" CBUILD="x86_64-pc-linux-gnu" CFLAGS="-march=amdfam10 -O2 -pipe -fomit-frame-pointer" CHOST="x86_64-pc-linux-gnu" CONFIG_PROTECT="/etc /usr/share/X11/xkb" CONFIG_PROTECT_MASK="/etc/ca-certificates.conf /etc/env.d /etc/env.d/java/ /etc/fonts/fonts.conf /etc/gconf /etc/gentoo-release /etc/revdep-rebuild /etc/sandbox.d /etc/terminfo" CXXFLAGS="-march=amdfam10 -O2 -pipe -fomit-frame-pointer" DISTDIR="/usr/portage/distfiles" FEATURES="assume-digests binpkg-logs distlocks fixlafiles fixpackages metadata-transfer news parallel-fetch protect-owned sandbox sfperms strict unknown-features-warn unmerge-logs unmerge-orphans userfetch" GENTOO_MIRRORS="http://gentoo.mirrors.easynews.com/linux/gentoo/ http://mirror.phy.olemiss.edu/mirror/gentoo http://mirror.espri.arizona.edu/gentoo/ " LDFLAGS="-Wl,-O1 -Wl,--as-needed" LINGUAS="en ru" MAKEOPTS="-j6" PKGDIR="/usr/portage/packages" PORTAGE_CONFIGROOT="/" PORTAGE_RSYNC_OPTS="--recursive --links --safe-links --perms --times --compress --force --whole-file --delete --stats --timeout=180 --exclude=/distfiles --exclude=/local --exclude=/packages" PORTAGE_TMPDIR="/var/tmp" PORTDIR="/usr/portage" PORTDIR_OVERLAY="/usr/local/portage" SYNC="rsync://rsync.namerica.gentoo.org/gentoo-portage" USE="3dnow 3dnowext X a52 aac accessibility acl acpi alsa amd64 apm async audiofile avi bcmath berkdb bluetooth bzip2 cairo calendar caps cddb cjk clamav cli consolekit cracklib crypt ctype curl curlwrappers cxx dbus deflate dga dio directfb dri dts dvb dvd dvdread emu-linux-x86 enca encode exif fbcon ffmpeg fftw flac fortran ftp gd gdbm gif gimp gmp gnutls gpm gstreamer gzip hal hash iconv id3 ieee1394 imagemagick imlib innodb ithreads java javascript jpeg jpeg2k json kipi lcms libcaca live logrotate lzo mad matroska mcal mhash mime mjpeg mmx mmxext mng modules mp3 mp4 mpeg mplayer msession mudflap multilib mysql mythtv ncurses network nls nptl nptlonly nsplugin nvidia ogg openal opengl openmp opensslcrypt oss pam pcntl pcre pdf pdo pear perl png posix ppds pppd pvr python qt qt3 qt3support qt4 quicktime readline reflection sasl sdl session simplexml soap sockets spell spl sse sse2 ssl subversion suhosin svg sysfs syslog tcpd theora threads thumbnail tidy tiff tokenizer transcode truetype udev unicode urandom usb utempter v4l v4l2 vcd vdpau vorbis wddx webkit wxwindows x264 xcb xforms xine xinetd xml xml2 xorg xpm xprint xv xvid xvmc zip zlib" ALSA_CARDS="intel8x0" ALSA_PCM_PLUGINS="adpcm alaw asym copy dmix dshare dsnoop empty extplug file hooks iec958 ioplug ladspa lfloat linear meter mmap_emul mulaw multi null plug rate route share shm softvol" APACHE2_MODULES="actions alias auth_basic authn_alias authn_anon authn_dbm authn_default authn_file authz_dbm authz_default authz_groupfile authz_host authz_owner authz_user autoindex cache cgi cgid dav dav_fs dav_lock deflate dir disk_cache env expires ext_filter file_cache filter headers include info log_config logio mem_cache mime mime_magic negotiation rewrite setenvif speling status unique_id userdir usertrack vhost_alias" COLLECTD_PLUGINS="df interface irq load memory rrdtool swap syslog" ELIBC="glibc" GPSD_PROTOCOLS="ashtech aivdm earthmate evermore fv18 garmin garmintxt gpsclock itrax mtk3301 nmea ntrip navcom oceanserver oldstyle oncore rtcm104v2 rtcm104v3 sirf superstar2 timing tsip tripmate tnt ubx" INPUT_DEVICES="evdev keyboard mouse" KERNEL="linux" LCD_DEVICES="bayrad cfontz cfontz633 glk hd44780 lb216 lcdm001 mtxorb ncurses text" LINGUAS="en ru" PHP_TARGETS="php5-2" RUBY_TARGETS="ruby18" USERLAND="GNU" VIDEO_CARDS="nvidia" XTABLES_ADDONS="quota2 psd pknock lscan length2 ipv4options ipset ipp2p iface geoip fuzzy condition tee tarpit sysrq steal rawnat logmark ipmark dhcpmac delude chaos account" Unset: CPPFLAGS, CTARGET, EMERGE_DEFAULT_OPTS, FFLAGS, INSTALL_MASK, LANG, LC_ALL, PORTAGE_BUNZIP2_COMMAND, PORTAGE_COMPRESS, PORTAGE_COMPRESS_FLAGS, PORTAGE_RSYNC_EXTRA_OPTS nfs server emerge --info: Portage 2.1.9.25 (default/linux/amd64/10.0, gcc-4.4.4, glibc-2.11.2-r3, 2.6.36-gentoo-r5 x86_64) ================================================================= System uname: Linux-2.6.36-gentoo-r5-x86_64-AMD_Opteron-tm-_Processor_144-with-gentoo-2.0.1 Timestamp of tree: Tue, 21 Dec 2010 17:45:01 +0000 app-shells/bash: 4.1_p7 dev-java/java-config: 1.3.7-r1, 2.1.11-r1 dev-lang/python: 2.4.4-r14, 2.5.4-r3, 2.6.5-r3, 3.1.2-r4 dev-util/cmake: 2.8.1-r2 sys-apps/baselayout: 2.0.1-r1 sys-apps/openrc: 0.6.8 sys-apps/sandbox: 2.4 sys-devel/autoconf: 2.13, 2.65-r1 sys-devel/automake: 1.4_p6::<unknown repository>, 1.5, 1.6.3::<unknown repository>, 1.7.9-r1, 1.8.5-r4, 1.9.6-r3, 1.10.3, 1.11.1 sys-devel/binutils: 2.20.1-r1 sys-devel/gcc: 4.4.4-r2 sys-devel/gcc-config: 1.4.1 sys-devel/libtool: 2.2.10 sys-devel/make: 3.81-r2 virtual/os-headers: 2.6.36.1 (sys-kernel/linux-headers) ACCEPT_KEYWORDS="amd64" ACCEPT_LICENSE="*" CBUILD="x86_64-pc-linux-gnu" CFLAGS="-march=athlon64 -O2 -pipe -fomit-frame-pointer" CHOST="x86_64-pc-linux-gnu" CONFIG_PROTECT="/etc /usr/share/X11/xkb /usr/share/config /var/bind" CONFIG_PROTECT_MASK="/etc/ca-certificates.conf /etc/env.d /etc/env.d/java/ /etc/fonts/fonts.conf /etc/gconf /etc/gentoo-release /etc/php/apache2-php5.3/ext-active/ /etc/php/cgi-php5.3/ext-active/ /etc/php/cli-php5.3/ext-active/ /etc/revdep-rebuild /etc/sandbox.d /etc/terminfo" CXXFLAGS="-march=athlon64 -O2 -pipe -fomit-frame-pointer" DISTDIR="/usr/portage/distfiles" FEATURES="assume-digests binpkg-logs distlocks fixlafiles fixpackages metadata-transfer news parallel-fetch protect-owned sandbox sfperms strict unknown-features-warn unmerge-logs unmerge-orphans userfetch" GENTOO_MIRRORS="http://gentoo.cites.uiuc.edu/pub/gentoo/ http://gentoo.mirrors.easynews.com/linux/gentoo/ http://mirror.phy.olemiss.edu/mirror/gentoo " LANG="en_US.utf8" LC_ALL="en_US.utf8" LDFLAGS="-Wl,-O1 -Wl,--as-needed" LINGUAS="en ru" MAKEOPTS="-j3" PKGDIR="/usr/portage/packages" PORTAGE_CONFIGROOT="/" PORTAGE_RSYNC_OPTS="--recursive --links --safe-links --perms --times --compress --force --whole-file --delete --stats --timeout=180 --exclude=/distfiles --exclude=/local --exclude=/packages" PORTAGE_TMPDIR="/var/tmp" PORTDIR="/usr/portage" PORTDIR_OVERLAY="/usr/local/portage /var/lib/layman/sunrise" SYNC="rsync://rsync.namerica.gentoo.org/gentoo-portage" USE="3dnow 3dnowext X a52 aac acl acpi alsa amd64 apache2 async audiofile avi bcmath berkdb bluetooth bzip2 cairo calendar caps cddb cjk clamav cli cracklib crypt css ctype cups curl curlwrappers cxx dbus deflate dga dio directfb dri dts dvb dvd dvdread emu-linux-x86 enca encode exif fbcon ffmpeg fftw flac fortran ftp gd gdbm gif gimp gmp gnutls gpm gstreamer gtk gtk2 gzip hal hash hbci iconv id3 ieee1394 imagemagick imlib innodb ipv6 ithreads java javascript jpeg jpeg2k json kde kipi lcms ldap ldap-sasl libcaca live logrotate lzo mad matroska mcal mhash mime mjpeg mmx mmxext mng modules mp3 mp4 mpeg mplayer msession mssql mudflap multilib mysql mysqli mythtv ncurses network nls nptl nptlonly nsplugin nvidia offensive ofx ogg openal opengl openmp opensslcrypt oss pam pcntl pcre pdf pdo pear perl png posix ppds pppd pvr python qt qt3 qt3support qt4 quicktime readline reflection samba sasl sdl seamonkey semantic-desktop session simplexml smtp soap sockets spell spl sql sqlite sse sse2 ssl subversion suhosin svg sysfs syslog tcpd theora threads thumbnail tidy tiff tokenizer transcode truetype udev unicode urandom usb utempter v4l v4l2 vaapi vcd vhosts vorbis vpx wddx webkit wxwindows x264 xattr xcb xforms xine xinetd xml xml2 xorg xpm xprint xv xvid xvmc zip zlib" ALSA_CARDS="via82xx" ALSA_PCM_PLUGINS="adpcm alaw asym copy dmix dshare dsnoop empty extplug file hooks iec958 ioplug ladspa lfloat linear meter mmap_emul mulaw multi null plug rate route share shm softvol" APACHE2_MODULES="actions alias auth_basic auth_digest authn_anon authn_dbd authn_dbm authn_default authn_file authz_dbm authz_default authz_groupfile authz_host authz_owner authz_user autoindex cache dav dav_fs dav_lock dbd deflate dir disk_cache env expires ext_filter file_cache filter headers ident imagemap include info log_config logio mem_cache mime mime_magic negotiation proxy proxy_ajp proxy_balancer proxy_connect proxy_http rewrite setenvif so speling status unique_id userdir usertrack vhost_alias" COLLECTD_PLUGINS="df interface irq load memory rrdtool swap syslog" ELIBC="glibc" GPSD_PROTOCOLS="ashtech aivdm earthmate evermore fv18 garmin garmintxt gpsclock itrax mtk3301 nmea ntrip navcom oceanserver oldstyle oncore rtcm104v2 rtcm104v3 sirf superstar2 timing tsip tripmate tnt ubx" INPUT_DEVICES="evdev keyboard mouse" KERNEL="linux" LCD_DEVICES="bayrad cfontz cfontz633 glk hd44780 lb216 lcdm001 mtxorb ncurses text" LINGUAS="en ru" PHP_TARGETS="php5-3" RUBY_TARGETS="ruby18" USERLAND="GNU" VIDEO_CARDS="nvidia nv vesa fbdev v4l" XTABLES_ADDONS="quota2 psd pknock lscan length2 ipv4options ipset ipp2p iface geoip fuzzy condition tee tarpit sysrq steal rawnat logmark ipmark dhcpmac delude chaos account" Unset: CPPFLAGS, CTARGET, EMERGE_DEFAULT_OPTS, FFLAGS, INSTALL_MASK, PORTAGE_BUNZIP2_COMMAND, PORTAGE_COMPRESS, PORTAGE_COMPRESS_FLAGS, PORTAGE_RSYNC_EXTRA_OPTS
I should add that I am using nfs4.
On nfs server: nfsstat Server rpc stats: calls badcalls badauth badclnt xdrcall 2155623 0 0 0 0 Server nfs v2: null getattr setattr root lookup readlink 6 0% 1807408 83% 7276 0% 0 0% 149216 6% 2827 0% read wrcache write create remove rename 154021 7% 0 0% 15828 0% 6192 0% 2710 0% 4294 0% link symlink mkdir rmdir readdir fsstat 214 0% 146 0% 160 0% 239 0% 4596 0% 490 0% Client rpc stats: calls retrans authrefrsh 0 0 0 On nfs as root client: nfsstat Client rpc stats: calls retrans authrefrsh 107781 53 107782 Client nfs v2: null getattr setattr root lookup readlink 0 0% 47741 44% 81 0% 0 0% 34351 31% 229 0% read wrcache write create remove rename 24268 22% 0 0% 260 0% 93 0% 101 0% 51 0% link symlink mkdir rmdir readdir fsstat 19 0% 17 0% 0 0% 0 0% 513 0% 57 0%
Created attachment 257819 [details] server.config kernel config for nfs server
Created attachment 257821 [details] client.config kernel config for nfs as root client
on server: rpcinfo -p program vers proto port 100000 4 tcp 111 portmapper 100000 3 tcp 111 portmapper 100000 2 tcp 111 portmapper 100000 4 udp 111 portmapper 100000 3 udp 111 portmapper 100000 2 udp 111 portmapper 100024 1 udp 54118 status 100024 1 tcp 34909 status 100005 1 udp 45061 mountd 100005 1 tcp 42057 mountd 100005 2 udp 45061 mountd 100005 2 tcp 42057 mountd 100005 3 udp 45061 mountd 100005 3 tcp 42057 mountd 100003 2 udp 2049 nfs 100003 3 udp 2049 nfs 100003 4 udp 2049 nfs 100003 2 tcp 2049 nfs 100003 3 tcp 2049 nfs 100003 4 tcp 2049 nfs 100021 1 udp 48464 nlockmgr 100021 3 udp 48464 nlockmgr 100021 4 udp 48464 nlockmgr 100021 1 tcp 45661 nlockmgr 100021 3 tcp 45661 nlockmgr 100021 4 tcp 45661 nlockmgr on client: rpcinfo -p rpcinfo: can't contact portmapper: RPC: Remote system error - Connection refused
re-open if things still fail with recent kernels (>=linux-3.6) and latest stable nfs-utils (>=1.2.6)
