Gentoo Websites Logo
Go to: Gentoo Home Documentation Forums Lists Bugs Planet Store Wiki Get Gentoo!
Bug 328475 - 2.6.34 & 2.6.35 hang when used with NFS home directories
Summary: 2.6.34 & 2.6.35 hang when used with NFS home directories
Status: RESOLVED UPSTREAM
Alias: None
Product: Gentoo Linux
Classification: Unclassified
Component: [OLD] Core system (show other bugs)
Hardware: AMD64 Linux
: High normal (vote)
Assignee: Gentoo Kernel Bug Wranglers and Kernel Maintainers
URL:
Whiteboard:
Keywords:
: 328591 (view as bug list)
Depends on:
Blocks:
 
Reported: 2010-07-15 20:59 UTC by Andrew John Hughes
Modified: 2011-02-17 23:41 UTC (History)
2 users (show)

See Also:
Package list:
Runtime testing required: ---


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Andrew John Hughes 2010-07-15 20:59:51 UTC
Jul  9 09:21:55 rivendell kernel: INFO: task icecat:4452 blocked for more than 120 seconds.
Jul  9 09:21:55 rivendell kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Jul  9 09:21:55 rivendell kernel: icecat        D 000000010cd5edd9     0  4452   4409 0x00000080
Jul  9 09:21:55 rivendell kernel: ffff8802669fbb68 0000000000000082 0000000000000400 ffff8802669fbb18
Jul  9 09:21:55 rivendell kernel: 0000000000000000 0000000000004000 0000000000013a80 ffff8802669fbfd8
Jul  9 09:21:55 rivendell kernel: ffff8802669fbfd8 ffff88026e427700 0000000000013a80 ffff8802669fbfd8
Jul  9 09:21:55 rivendell kernel: Call Trace:
Jul  9 09:21:55 rivendell kernel: [<ffffffff810c2ac0>] ? sync_page+0x0/0x50
Jul  9 09:21:55 rivendell kernel: [<ffffffff81588452>] io_schedule+0x42/0x60
Jul  9 09:21:55 rivendell kernel: [<ffffffff810c2af8>] sync_page+0x38/0x50
Jul  9 09:21:55 rivendell kernel: [<ffffffff81588b62>] __wait_on_bit_lock+0x52/0xb0
Jul  9 09:21:55 rivendell kernel: [<ffffffff810c2aa2>] __lock_page+0x62/0x70
Jul  9 09:21:55 rivendell kernel: [<ffffffff8105ea90>] ? wake_bit_function+0x0/0x40
Jul  9 09:21:55 rivendell kernel: [<ffffffff810cb920>] ? pagevec_lookup_tag+0x20/0x30
Jul  9 09:21:55 rivendell kernel: [<ffffffff810ca057>] write_cache_pages+0x367/0x3f0
Jul  9 09:21:55 rivendell kernel: [<ffffffff81216770>] ? nfs_writepages_callback+0x0/0x40
Jul  9 09:21:55 rivendell kernel: [<ffffffff812174c5>] nfs_writepages+0x95/0x120
Jul  9 09:21:55 rivendell kernel: [<ffffffff81216d70>] ? nfs_flush_one+0x0/0xf0
Jul  9 09:21:55 rivendell kernel: [<ffffffff8105ea90>] ? wake_bit_function+0x0/0x40
Jul  9 09:21:55 rivendell kernel: [<ffffffff810cad8c>] do_writepages+0x1c/0x30
Jul  9 09:21:55 rivendell kernel: [<ffffffff8111e972>] writeback_single_inode+0xd2/0x320
Jul  9 09:21:55 rivendell kernel: [<ffffffff8111ebee>] sync_inode+0x2e/0x40
Jul  9 09:21:55 rivendell kernel: [<ffffffff81217abe>] nfs_wb_all+0x3e/0x40
Jul  9 09:21:55 rivendell kernel: [<ffffffff81207845>] nfs_do_fsync+0x25/0x50
Jul  9 09:21:55 rivendell kernel: [<ffffffff81207a6d>] nfs_file_flush+0x5d/0x90
Jul  9 09:21:55 rivendell kernel: [<ffffffff810fc93a>] filp_close+0x3a/0x80
Jul  9 09:21:55 rivendell kernel: [<ffffffff810fca15>] sys_close+0x95/0xf0
Jul  9 09:21:55 rivendell kernel: [<ffffffff81002dab>] system_call_fastpath+0x16/0x1b


Reproducible: Always




Portage 2.2_rc67 (default/linux/amd64/10.0/desktop, gcc-4.5.0, glibc-2.11.2-r0, 2.6.33-gentoo-r2.rivendell x86_64)
=================================================================
System uname: Linux-2.6.33-gentoo-r2.rivendell-x86_64-Intel-R-_Xeon-R-_CPU_X5482_@_3.20GHz-with-gentoo-2.0.1
Timestamp of tree: Thu, 15 Jul 2010 01:15:03 +0000
ccache version 2.4 [enabled]
app-shells/bash:     4.1_p7
dev-java/java-config: 2.1.11
dev-lang/python:     2.6.5-r3, 3.1.2-r4
dev-util/ccache:     2.4-r8
dev-util/cmake:      2.8.1-r2
sys-apps/baselayout: 2.0.1
sys-apps/openrc:     0.6.1-r1
sys-apps/sandbox:    2.2
sys-devel/autoconf:  2.13, 2.65-r1
sys-devel/automake:  1.7.9-r1, 1.9.6-r3, 1.10.3, 1.11.1
sys-devel/binutils:  2.20.1-r1
sys-devel/gcc:       4.5.0
sys-devel/gcc-config: 1.4.1
sys-devel/libtool:   2.2.10
virtual/os-headers:  2.6.34
ACCEPT_KEYWORDS="amd64 ~amd64"
ACCEPT_LICENSE="@FSF-APPROVED-EXT @X11-LICENSES @PRESUMED-FOSS @CREATIVE-COMMONS TeX MOTIF popt unRAR"
CBUILD="x86_64-pc-linux-gnu"
CFLAGS="-O2 -pipe -march=core2 -ggdb -mno-tls-direct-seg-refs"
CHOST="x86_64-pc-linux-gnu"
CONFIG_PROTECT="/etc /usr/kde/3.5/env /usr/kde/3.5/share/config /usr/kde/3.5/shutdown /usr/share/X11/xkb /usr/share/config /var/yp/Makefile"
CONFIG_PROTECT_MASK="/etc/ca-certificates.conf /etc/env.d /etc/env.d/java/ /etc/eselect/postgresql /etc/fonts/fonts.conf /etc/gconf /etc/gentoo-release /etc/revdep-rebuild /etc/sandbox.d /etc/terminfo /etc/texmf/language.dat.d /etc/texmf/language.def.d /etc/texmf/updmap.d /etc/texmf/web2c"
CXXFLAGS="-O2 -pipe -march=core2 -ggdb -mno-tls-direct-seg-refs"
DISTDIR="/usr/portage/distfiles"
FEATURES="assume-digests ccache distlocks fixpackages news parallel-fetch preserve-libs protect-owned sandbox sfperms splitdebug strict unmerge-logs unmerge-orphans userfetch"
GENTOO_MIRRORS="http://mirror.bytemark.co.uk/gentoo/ ftp://mirror.bytemark.co.uk/gentoo/ http://www.mirrorservice.org/sites/www.ibiblio.org/gentoo/ ftp://ftp.mirrorservice.org/sites/www.ibiblio.org/gentoo/ http://mirror.qubenet.net/mirror/gentoo/ ftp://mirror.qubenet.net/mirror/gentoo/ http://gentoo.virginmedia.com/ ftp://gentoo.virginmedia.com/sites/gentoo "
LANG="en_GB.UTF-8"
LDFLAGS="-Wl,-O1"
LINGUAS="en en_GB"
MAKEOPTS="-j9"
PKGDIR="/usr/portage/packages"
PORTAGE_CONFIGROOT="/"
PORTAGE_RSYNC_OPTS="--recursive --links --safe-links --perms --times --compress --force --whole-file --delete --stats --timeout=180 --exclude=/distfiles --exclude=/local --exclude=/packages"
PORTAGE_TMPDIR="/var/tmp"
PORTDIR="/usr/portage"
PORTDIR_OVERLAY="/usr/local/gentoo/xmmsroot2-overlay /usr/local/gentoo/java-overlay /usr/local/gentoo/fixes-overlay /var/lib/layman/kde-sunset"
SYNC="rsync://rsync.europe.gentoo.org/gentoo-portage"
USE="X a52 aac acl acpi alsa amd64 avahi bash-completion berkdb bindist bluetooth branding bzip2 cairo cdda cddb cdparanoia cdr cli consolekit cracklib crypt cups curl cvs cxx dbus dga dirac djvu doc dri dts dv dvb dvd dvdr eds emacs emboss encode evo exif fam ffmpeg fftw firefox flac fontconfig fortran ftp fuse gcj gdbm gif gimp gmp gnome gnome-keyring gnutls gpm graphviz gstreamer gtk gtkhtml hal iconv idn ieee1394 imagemagick imap ipv6 java java5 java6 javascript jbig jpeg jpeg2k kde kerberos ladspa lame latex lcms libass libcaca libnotify libsamplerate lm_sensors lzma lzo mad mbox mikmod mmap mmx mng modules mp3 mp4 mpeg mudflap multilib musepack musicbrainz ncurses nis nls nntp nptl nptlonly ntp ogg openexr opengl openmp pam pango pch pcre pdf perl png policykit postgres ppds pppd pulseaudio python qt3 qt3support qt4 readline reflection sasl schroedinger sdl session sndfile sox speex spell spl sqlite sse sse2 ssl ssse3 startup-notification subversion svg sysfs taglib tcpd tga theora threads tiff truetype unicode urandom usb vorbis wavpack wmf x264 xattr xcb xcomposite xft xml xmmsroot2 xorg xosd xprint xscreensaver xulrunner xv xvid zeroconf zlib" ALSA_CARDS="ali5451 als4000 atiixp atiixp-modem bt87x ca0106 cmipci emu10k1x ens1370 ens1371 es1938 es1968 fm801 hda-intel intel8x0 intel8x0m maestro3 trident usb-audio via82xx via82xx-modem ymfpci" ALSA_PCM_PLUGINS="adpcm alaw asym copy dmix dshare dsnoop empty extplug file hooks iec958 ioplug ladspa lfloat linear meter mmap_emul mulaw multi null plug rate route share shm softvol" APACHE2_MODULES="actions alias auth_basic authn_alias authn_anon authn_dbm authn_default authn_file authz_dbm authz_default authz_groupfile authz_host authz_owner authz_user autoindex cache cgi cgid dav dav_fs dav_lock deflate dir disk_cache env expires ext_filter file_cache filter headers include info log_config logio mem_cache mime mime_magic negotiation rewrite setenvif speling status unique_id userdir usertrack vhost_alias" ELIBC="glibc" INPUT_DEVICES="keyboard mouse evdev" KERNEL="linux" LCD_DEVICES="bayrad cfontz cfontz633 glk hd44780 lb216 lcdm001 mtxorb ncurses text" LINGUAS="en en_GB" RUBY_TARGETS="ruby18" USERLAND="GNU" VIDEO_CARDS="radeonhd" XTABLES_ADDONS="quota2 psd pknock lscan length2 ipv4options ipset ipp2p iface geoip fuzzy condition tee tarpit sysrq steal rawnat logmark ipmark dhcpmac delude chaos account" 
Unset:  CPPFLAGS, CTARGET, EMERGE_DEFAULT_OPTS, FFLAGS, INSTALL_MASK, LC_ALL, PORTAGE_COMPRESS, PORTAGE_COMPRESS_FLAGS, PORTAGE_RSYNC_EXTRA_OPTS
Comment 1 Jory A. Pratt gentoo-dev 2010-07-18 14:48:21 UTC
*** Bug 328591 has been marked as a duplicate of this bug. ***
Comment 2 Andrew John Hughes 2010-07-25 20:18:15 UTC
I don't see how this relates to Bug 328591.  There's no problem running Firefox or Icecat and I could equally give kernel logs for other processes including bash and the kernel process sync.
Comment 3 Mike Pagano gentoo-dev 2010-07-30 12:12:54 UTC
I see some patches about fixing nfs deadlocks that are now in kernel version 2.6.34.

Can you test with the latest gentoo-sources, which is gentoo-sources-2.6.34-r2 at this time and let me know the outcome?
Comment 4 Richard Connon 2010-08-03 11:00:08 UTC
Is this fix also in gentoo-sources-2.6.35 ?
Comment 5 Mike Pagano gentoo-dev 2010-08-03 16:23:43 UTC
Yes
Comment 6 Richard Connon 2010-08-09 09:09:45 UTC
Using gentoo-sources-2.6.35 doesn't fix my issue...
(original Bug 328591)
Comment 7 Andrew John Hughes 2010-09-06 13:20:53 UTC
Still happening with 2.6.35-r5.  workrave seems to be a common culprit:

INFO: task workrave:25778 blocked for more than 120 seconds.
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
workrave      D 000000000dfc805c     0 25778      1 0x00008010
Call Trace:
[c00000003dabf4e0] [c00000000000f954] .__switch_to+0xc0/0x100
[c00000003dabf570] [c0000000005565bc] .schedule+0x46c/0x5d8
[c00000003dabf680] [c00000000055677c] .io_schedule+0x54/0x94
[c00000003dabf710] [c000000000097214] .sync_page+0x78/0x94
[c00000003dabf790] [c000000000556e20] .__wait_on_bit+0x90/0x104
[c00000003dabf840] [c000000000097510] .wait_on_page_bit+0xa4/0xcc
[c00000003dabf920] [c0000000000981dc] .filemap_fdatawait_range+0x98/0x1b8
[c00000003dabfa80] [c0000000000fecac] .writeback_single_inode+0x120/0x38c
[c00000003dabfb20] [c0000000000fef50] .sync_inode+0x38/0x78
[c00000003dabfbb0] [c000000000208034] .nfs_wb_all+0x54/0x70
[c00000003dabfc80] [c0000000001f7a50] .nfs_do_fsync+0x44/0xa0
[c00000003dabfd10] [c0000000000d7be4] .filp_close+0x78/0xd8
[c00000003dabfda0] [c0000000000d7d14] .SyS_close+0xd0/0x138
[c00000003dabfe30] [c000000000007588] syscall_exit+0x0/0x40
Comment 8 Andrew John Hughes 2010-09-06 13:21:25 UTC
On both ppc64 (32-bit userland) & x86_64.
Comment 9 Andrew John Hughes 2010-09-07 09:59:13 UTC
workrave writes to $HOME/.workrave by default and doesn't seem to do any locking.  So this may be a result of $HOME being shared and two machines racing over the same files.
Comment 10 Richard Connon 2010-10-05 12:41:24 UTC
I still get this every time I run firefox or thunderbird.
The app fails to get a lock on something and hangs.
Comment 11 Mike Pagano gentoo-dev 2010-10-24 23:11:18 UTC
Can you please test with gentoo-sources-2.6.36
Comment 12 Richard Connon 2010-11-03 14:37:19 UTC
Still problematic on 2.6.36 for me.
Comment 13 Mike Pagano gentoo-dev 2010-11-03 15:03:28 UTC
Please submit this upstream at http://bugzilla.kernel.org and post the URL back here.
Comment 14 Richard Connon 2010-11-15 13:17:17 UTC
https://bugzilla.kernel.org/show_bug.cgi?id=14891

Probably a good idea of others who have similar issues give some more debug information (strace output or the like)
Comment 15 Richard Connon 2010-11-16 13:33:20 UTC
Sorry. I meant to link this bug.

https://bugzilla.kernel.org/show_bug.cgi?id=22992
Comment 16 Mike Pagano gentoo-dev 2010-12-17 13:38:37 UTC
If you think that bug is a accurate representation of your issue, we will watch that bug.
Comment 17 Dan Zoltak 2011-02-17 23:41:48 UTC
I am also seeing this on 2.6.32-gentoo-r24.

The last know good version of the kernel was 2.6.31-gentoo-r6.