Attachment 137635 Details for Bug 198215 – dmesg with sysreq-t

dmesg with sysreq-t

dmesg.log (text/plain), 96.44 KB, created by Andrej Filipcic on 2007-12-03 17:38:18 UTC

(hide)

Description:

Filename:

MIME Type:

Creator: Andrej Filipcic

Created: 2007-12-03 17:38:18 UTC

Size: 96.44 KB

patch

obsolete

>Linux version 2.6.23-gentoo-r3 (root@f9pc18) (gcc version 4.2.2 (Gentoo 4.2.2 p1.0)) #1 SMP Mon Dec 3 12:46:41 CET 2007
>BIOS-provided physical RAM map:
> BIOS-e820: 0000000000000000 - 000000000009e800 (usable)
> BIOS-e820: 000000000009e800 - 00000000000a0000 (reserved)
> BIOS-e820: 00000000000ce000 - 0000000000100000 (reserved)
> BIOS-e820: 0000000000100000 - 000000007fef0000 (usable)
> BIOS-e820: 000000007fef0000 - 000000007feff000 (ACPI data)
> BIOS-e820: 000000007feff000 - 000000007ff00000 (ACPI NVS)
> BIOS-e820: 000000007ff00000 - 0000000080000000 (usable)
> BIOS-e820: 00000000fec00000 - 00000000fec08000 (reserved)
> BIOS-e820: 00000000fee00000 - 00000000fee01000 (reserved)
> BIOS-e820: 00000000fff80000 - 0000000100000000 (reserved)
>1152MB HIGHMEM available.
>896MB LOWMEM available.
>found SMP MP-table at 000f71a0
>Entering add_active_range(0, 0, 524288) 0 entries of 256 used
>Zone PFN ranges:
>  DMA             0 ->     4096
>  Normal       4096 ->   229376
>  HighMem    229376 ->   524288
>Movable zone start PFN for each node
>early_node_map[1] active PFN ranges
>    0:        0 ->   524288
>On node 0 totalpages: 524288
>  DMA zone: 56 pages used for memmap
>  DMA zone: 0 pages reserved
>  DMA zone: 4040 pages, LIFO batch:0
>  Normal zone: 3080 pages used for memmap
>  Normal zone: 222200 pages, LIFO batch:31
>  HighMem zone: 4032 pages used for memmap
>  HighMem zone: 290880 pages, LIFO batch:31
>  Movable zone: 0 pages used for memmap
>DMI 2.3 present.
>ACPI: RSDP 000F7130, 0014 (r0 PTLTD )
>ACPI: RSDT 7FEFD139, 002C (r1 PTLTD    RSDT    6040000  LTP        0)
>ACPI: FACP 7FEFEF2E, 0074 (r1 AMD    TECATE    6040000 PTL     F4240)
>ACPI: DSDT 7FEFD165, 1DC9 (r1    AMD  AMDACPI  6040000 MSFT  100000D)
>ACPI: FACS 7FEFFFC0, 0040
>ACPI: APIC 7FEFEFA2, 005E (r1 PTLTD  	 APIC    6040000  LTP        0)
>ACPI: PM-Timer IO Port: 0x8008
>ACPI: Local APIC address 0xfee00000
>ACPI: LAPIC (acpi_id[0x00] lapic_id[0x01] enabled)
>Processor #1 6:6 APIC version 16
>ACPI: LAPIC (acpi_id[0x01] lapic_id[0x00] enabled)
>Processor #0 6:6 APIC version 16
>ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1])
>ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1])
>ACPI: IOAPIC (id[0x02] address[0xfec00000] gsi_base[0])
>IOAPIC[0]: apic_id 2, version 17, address 0xfec00000, GSI 0-23
>ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 high edge)
>ACPI: IRQ0 used by override.
>ACPI: IRQ2 used by override.
>ACPI: IRQ9 used by override.
>Enabling APIC mode:  Flat.  Using 1 I/O APICs
>Using ACPI (MADT) for SMP configuration information
>Allocating PCI resources starting at 88000000 (gap: 80000000:7ec00000)
>swsusp: Registered nosave memory region: 000000000009e000 - 000000000009f000
>swsusp: Registered nosave memory region: 000000000009f000 - 00000000000a0000
>swsusp: Registered nosave memory region: 00000000000a0000 - 00000000000ce000
>swsusp: Registered nosave memory region: 00000000000ce000 - 0000000000100000
>Built 1 zonelists in Zone order.  Total pages: 517120
>Kernel command line: ro root=/dev/hda3 selinux=0
>mapped APIC to ffffb000 (fee00000)
>mapped IOAPIC to ffffa000 (fec00000)
>Enabling fast FPU save and restore... done.
>Enabling unmasked SIMD FPU exception support... done.
>Initializing CPU#0
>CPU 0 irqstacks, hard=c0566000 soft=c055e000
>PID hash table entries: 4096 (order: 12, 16384 bytes)
>Detected 1600.106 MHz processor.
>Console: colour VGA+ 80x25
>console [tty0] enabled
>Lock dependency validator: Copyright (c) 2006 Red Hat, Inc., Ingo Molnar
>... MAX_LOCKDEP_SUBCLASSES:    8
>... MAX_LOCK_DEPTH:          30
>... MAX_LOCKDEP_KEYS:        2048
>... CLASSHASH_SIZE:           1024
>... MAX_LOCKDEP_ENTRIES:     8192
>... MAX_LOCKDEP_CHAINS:      16384
>... CHAINHASH_SIZE:          8192
> memory used by lock dependency info: 1024 kB
> per task-struct memory footprint: 1680 bytes
>Dentry cache hash table entries: 131072 (order: 7, 524288 bytes)
>Inode-cache hash table entries: 65536 (order: 6, 262144 bytes)
>Memory: 2058912k/2097152k available (2664k kernel code, 37036k reserved, 1265k data, 508k init, 1179584k highmem)
>virtual kernel memory layout:
>    fixmap  : 0xfff4d000 - 0xfffff000   ( 712 kB)
>    pkmap   : 0xff800000 - 0xffc00000   (4096 kB)
>    vmalloc : 0xf8800000 - 0xff7fe000   ( 111 MB)
>    lowmem  : 0xc0000000 - 0xf8000000   ( 896 MB)
>      .init : 0xc04dc000 - 0xc055b000   ( 508 kB)
>      .data : 0xc039a2e0 - 0xc04d671c   (1265 kB)
>      .text : 0xc0100000 - 0xc039a2e0   (2664 kB)
>Checking if this processor honours the WP bit even in supervisor mode... Ok.
>Calibrating delay using timer specific routine.. 3204.81 BogoMIPS (lpj=6409630)
>Security Framework v1.0.0 initialized
>SELinux:  Disabled at boot.
>Capability LSM initialized
>Mount-cache hash table entries: 512
>CPU: After generic identify, caps: 0383fbff c1cbfbff 00000000 00000000 00000000 00000000 00000000 00000000
>CPU: L1 I Cache: 64K (64 bytes/line), D cache 64K (64 bytes/line)
>CPU: L2 Cache: 256K (64 bytes/line)
>CPU: After all inits, caps: 0383fbff c1cbfbff 00000000 00000420 00000000 00000000 00000000 00000000
>Intel machine check architecture supported.
>Intel machine check reporting enabled on CPU#0.
>Compat vDSO mapped to ffffe000.
>Checking 'hlt' instruction... OK.
>lockdep: not fixing up alternatives.
>ACPI: Core revision 20070126
>CPU0: AMD Athlon(tm) MP 1900+ stepping 02
>lockdep: not fixing up alternatives.
>Booting processor 1/0 eip 3000
>CPU 1 irqstacks, hard=c0567000 soft=c055f000
>Initializing CPU#1
>Calibrating delay using timer specific routine.. 3200.42 BogoMIPS (lpj=6400850)
>CPU: After generic identify, caps: 0383fbff c1cbfbff 00000000 00000000 00000000 00000000 00000000 00000000
>CPU: L1 I Cache: 64K (64 bytes/line), D cache 64K (64 bytes/line)
>CPU: L2 Cache: 256K (64 bytes/line)
>CPU: After all inits, caps: 0383fbff c1cbfbff 00000000 00000420 00000000 00000000 00000000 00000000
>Intel machine check architecture supported.
>Intel machine check reporting enabled on CPU#1.
>CPU1: AMD Athlon(tm) Processor stepping 02
>Total of 2 processors activated (6405.24 BogoMIPS).
>ENABLING IO-APIC IRQs
>..TIMER: vector=0x31 apic1=0 pin1=2 apic2=-1 pin2=-1
>Brought up 2 CPUs
>NET: Registered protocol family 16
>ACPI: bus type pci registered
>PCI: PCI BIOS revision 2.10 entry at 0xfd770, last bus=2
>PCI: Using configuration type 1
>Setting up standard PCI resources
>mtrr: your CPUs had inconsistent fixed MTRR settings
>mtrr: probably your BIOS does not setup all CPUs.
>mtrr: corrected configuration.
>ACPI: EC: Look up EC in DSDT
>ACPI: Interpreter enabled
>ACPI: (supports S0 S1 S4 S5)
>ACPI: Using IOAPIC for interrupt routing
>ACPI: PCI Root Bridge [PCI0] (0000:00)
>ACPI: PCI Interrupt Routing Table [\_SB_.PCI0._PRT]
>ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.AGP_._PRT]
>ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.OP2P._PRT]
>ACPI: PCI Interrupt Link [LNKA] (IRQs 3 5 10 11) *0, disabled.
>ACPI: PCI Interrupt Link [LNKB] (IRQs 3 5 10 *11)
>ACPI: PCI Interrupt Link [LNKC] (IRQs 3 5 *10 11)
>ACPI: PCI Interrupt Link [LNKD] (IRQs 3 *5 10 11)
>Linux Plug and Play Support v0.97 (c) Adam Belay
>pnp: PnP ACPI init
>ACPI: bus type pnp registered
>pnp: PnP ACPI: found 12 devices
>ACPI: ACPI bus type pnp unregistered
>SCSI subsystem initialized
>usbcore: registered new interface driver usbfs
>usbcore: registered new interface driver hub
>usbcore: registered new device driver usb
>PCI: Using ACPI for IRQ routing
>PCI: If a device doesn't work, try "pci=routeirq".  If it helps, post a report
>pnp: 00:00: iomem range 0xfffc0000-0xffffffff could not be reserved
>pnp: 00:00: iomem range 0xffc00000-0xfff7ffff has been reserved
>pnp: 00:00: iomem range 0x0-0x9ffff could not be reserved
>pnp: 00:00: iomem range 0x100000-0x7fffffff could not be reserved
>pnp: 00:06: ioport range 0x4d0-0x4d1 has been reserved
>PCI: Failed to allocate mem resource #6:10000@f8000000 for 0000:01:05.0
>PCI: Bridge: 0000:00:01.0
>  IO window: disabled.
>  MEM window: e9000000-e9ffffff
>  PREFETCH window: f0000000-f7ffffff
>PCI: Bridge: 0000:00:10.0
>  IO window: 2000-2fff
>  MEM window: ea000000-ea0fffff
>  PREFETCH window: 88000000-880fffff
>NET: Registered protocol family 2
>Time: acpi_pm clocksource has been installed.
>IP route cache hash table entries: 32768 (order: 5, 131072 bytes)
>TCP established hash table entries: 65536 (order: 9, 2621440 bytes)
>TCP bind hash table entries: 65536 (order: 9, 2359296 bytes)
>TCP: Hash tables configured (established 65536 bind 65536)
>TCP reno registered
>Machine check exception polling timer started.
>audit: initializing netlink socket (disabled)
>audit(1196682928.396:1): initialized
>highmem bounce pool size: 64 pages
>Total HugeTLB memory allocated, 0
>VFS: Disk quotas dquot_6.5.1
>Dquot-cache hash table entries: 1024 (order 0, 4096 bytes)
>SGI XFS with ACLs, security attributes, large block numbers, no debug enabled
>SGI XFS Quota Management subsystem
>Block layer SCSI generic (bsg) driver version 0.4 loaded (major 254)
>io scheduler noop registered
>io scheduler anticipatory registered (default)
>io scheduler deadline registered
>io scheduler cfq registered
>BIOS failed to enable PCI standards compliance, fixing this error.
>Boot video device is 0000:01:05.0
>pci_hotplug: PCI Hot Plug PCI Core version: 0.5
>Real Time Clock Driver v1.12ac
>Linux agpgart interface v0.102
>[drm] Initialized drm 1.1.0 20060810
>Serial: 8250/16550 driver $Revision: 1.90 $ 4 ports, IRQ sharing enabled
>serial8250: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
>serial8250: ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A
>00:09: ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A
>RAMDISK driver initialized: 16 RAM disks of 16384K size 1024 blocksize
>loop: module loaded
>usbcore: registered new interface driver ub
>Uniform Multi-Platform E-IDE driver Revision: 7.00alpha2
>ide: Assuming 33MHz system bus speed for PIO modes; override with idebus=xx
>AMD7441: IDE controller at PCI slot 0000:00:07.1
>AMD7441: chipset revision 4
>AMD7441: not 100% native mode: will probe irqs later
>AMD7441: 0000:00:07.1 (rev 04) UDMA100 controller
>    ide0: BM-DMA at 0xf000-0xf007, BIOS settings: hda:DMA, hdb:pio
>    ide1: BM-DMA at 0xf008-0xf00f, BIOS settings: hdc:DMA, hdd:DMA
>Probing IDE interface ide0...
>hda: WDC WD1600AAJB-00PVA0, ATA DISK drive
>hda: selected mode 0x45
>ide0 at 0x1f0-0x1f7,0x3f6 on irq 14
>Probing IDE interface ide1...
>hdc: ST3750640A, ATA DISK drive
>hdd: ST3750640A, ATA DISK drive
>hdc: selected mode 0x45
>hdd: selected mode 0x45
>ide1 at 0x170-0x177,0x376 on irq 15
>hda: max request size: 512KiB
>hda: 312581808 sectors (160041 MB) w/8192KiB Cache, CHS=19457/255/63, UDMA(100)
>hda: cache flushes supported
> hda: hda1 hda2 hda3
>hdc: max request size: 512KiB
>hdc: 1465149168 sectors (750156 MB) w/16384KiB Cache, CHS=65535/255/63, UDMA(100)
>hdc: cache flushes supported
> hdc: hdc1
>hdd: max request size: 512KiB
>hdd: 1465149168 sectors (750156 MB) w/16384KiB Cache, CHS=65535/255/63, UDMA(100)
>hdd: cache flushes supported
> hdd: hdd1
>ide-floppy driver 0.99.newide
>usbcore: registered new interface driver libusual
>PNP: PS/2 Controller [PNP0303:PS2K,PNP0f13:PS2M] at 0x60,0x64 irq 1,12
>serio: i8042 KBD port at 0x60,0x64 irq 1
>serio: i8042 AUX port at 0x60,0x64 irq 12
>mice: PS/2 mouse device common for all mice
>input: AT Translated Set 2 keyboard as /class/input/input0
>usbcore: registered new interface driver hiddev
>usbcore: registered new interface driver usbhid
>drivers/hid/usbhid/hid-core.c: v2.6:USB HID core driver
>TCP cubic registered
>Initializing XFRM netlink socket
>NET: Registered protocol family 1
>NET: Registered protocol family 17
>powernow-k8: Processor cpuid 662 not supported
>powernow-k8: Processor cpuid 662 not supported
>Starting balanced_irq
>Using IPI No-Shortcut mode
>input: ImPS/2 Generic Wheel Mouse as /class/input/input1
>md: Autodetecting RAID arrays.
>md: autorun ...
>md: considering hdd1 ...
>md:  adding hdd1 ...
>md:  adding hdc1 ...
>md: created md0
>md: bind<hdc1>
>md: bind<hdd1>
>md: running: <hdd1><hdc1>
>md: personality for level 5 is not loaded!
>md: do_md_run() returned -22
>md: md0 stopped.
>md: unbind<hdd1>
>md: export_rdev(hdd1)
>md: unbind<hdc1>
>md: export_rdev(hdc1)
>md: ... autorun DONE.
>XFS mounting filesystem hda3
>Ending clean XFS mount for filesystem: hda3
>VFS: Mounted root (xfs filesystem) readonly.
>Freeing unused kernel memory: 508k freed
>input: PC Speaker as /class/input/input2
>3ware Storage Controller device driver for Linux v1.26.02.002.
>ACPI: PCI Interrupt 0000:00:09.0[A] -> GSI 21 (level, low) -> IRQ 16
>Floppy drive(s): fd0 is 1.44M
>FDC 0 is a post-1991 82077
>input: Power Button (FF) as /class/input/input3
>ACPI: Power Button (FF) [PWRF]
>input: Sleep Button (FF) as /class/input/input4
>ACPI: Sleep Button (FF) [SLPF]
>input: Power Button (CM) as /class/input/input5
>ACPI: Power Button (CM) [PWRB]
>parport_pc 00:0a: reported by Plug and Play ACPI
>parport0: PC-style at 0x378 (0x778), irq 7 [PCSPP,TRISTATE,EPP]
>scsi0 : 3ware Storage Controller
>3w-xxxx: scsi0: Found a 3ware Storage Controller at 0x1010, IRQ: 16.
>scsi 0:0:0:0: Direct-Access     3ware    Logical Disk 0   1.2  PQ: 0 ANSI: 0
>sd 0:0:0:0: [sda] 1465149168 512-byte hardware sectors (750156 MB)
>sd 0:0:0:0: [sda] Write Protect is off
>sd 0:0:0:0: [sda] Mode Sense: 00 00 00 00
>sd 0:0:0:0: [sda] Write cache: disabled, read cache: disabled, supports DPO and FUA
>sd 0:0:0:0: [sda] 1465149168 512-byte hardware sectors (750156 MB)
>sd 0:0:0:0: [sda] Write Protect is off
>sd 0:0:0:0: [sda] Mode Sense: 00 00 00 00
>sd 0:0:0:0: [sda] Write cache: disabled, read cache: disabled, supports DPO and FUA
> sda: sda1
>sd 0:0:0:0: [sda] Attached SCSI disk
>sd 0:0:0:0: Attached scsi generic sg0 type 0
>scsi 0:0:1:0: Direct-Access     3ware    Logical Disk 1   1.2  PQ: 0 ANSI: 0
>sd 0:0:1:0: [sdb] 1465149168 512-byte hardware sectors (750156 MB)
>sd 0:0:1:0: [sdb] Write Protect is off
>sd 0:0:1:0: [sdb] Mode Sense: 00 00 00 00
>sd 0:0:1:0: [sdb] Write cache: disabled, read cache: disabled, supports DPO and FUA
>sd 0:0:1:0: [sdb] 1465149168 512-byte hardware sectors (750156 MB)
>sd 0:0:1:0: [sdb] Write Protect is off
>sd 0:0:1:0: [sdb] Mode Sense: 00 00 00 00
>sd 0:0:1:0: [sdb] Write cache: disabled, read cache: disabled, supports DPO and FUA
> sdb: sdb1
>sd 0:0:1:0: [sdb] Attached SCSI disk
>sd 0:0:1:0: Attached scsi generic sg1 type 0
>scsi 0:0:2:0: Direct-Access     3ware    Logical Disk 2   1.2  PQ: 0 ANSI: 0
>sd 0:0:2:0: [sdc] 1465149168 512-byte hardware sectors (750156 MB)
>sd 0:0:2:0: [sdc] Write Protect is off
>sd 0:0:2:0: [sdc] Mode Sense: 00 00 00 00
>sd 0:0:2:0: [sdc] Write cache: disabled, read cache: disabled, supports DPO and FUA
>sd 0:0:2:0: [sdc] 1465149168 512-byte hardware sectors (750156 MB)
>sd 0:0:2:0: [sdc] Write Protect is off
>sd 0:0:2:0: [sdc] Mode Sense: 00 00 00 00
>sd 0:0:2:0: [sdc] Write cache: disabled, read cache: disabled, supports DPO and FUA
> sdc: sdc1
>sd 0:0:2:0: [sdc] Attached SCSI disk
>sd 0:0:2:0: Attached scsi generic sg2 type 0
>scsi 0:0:3:0: Direct-Access     3ware    Logical Disk 3   1.2  PQ: 0 ANSI: 0
>sd 0:0:3:0: [sdd] 1465149168 512-byte hardware sectors (750156 MB)
>sd 0:0:3:0: [sdd] Write Protect is off
>sd 0:0:3:0: [sdd] Mode Sense: 00 00 00 00
>sd 0:0:3:0: [sdd] Write cache: disabled, read cache: disabled, supports DPO and FUA
>sd 0:0:3:0: [sdd] 1465149168 512-byte hardware sectors (750156 MB)
>sd 0:0:3:0: [sdd] Write Protect is off
>sd 0:0:3:0: [sdd] Mode Sense: 00 00 00 00
>sd 0:0:3:0: [sdd] Write cache: disabled, read cache: disabled, supports DPO and FUA
> sdd: sdd1
>sd 0:0:3:0: [sdd] Attached SCSI disk
>sd 0:0:3:0: Attached scsi generic sg3 type 0
>agpgart: Detected AMD 760MP chipset
>agpgart: AGP aperture is 64M @ 0xec000000
>shpchp: HPC vendor_id 1022 device_id 700d ss_vid 0 ss_did 0
>shpchp: shpc_init: cannot reserve MMIO region
>shpchp: HPC vendor_id 1022 device_id 7448 ss_vid 0 ss_did 0
>shpchp: shpc_init: cannot reserve MMIO region
>shpchp: Standard Hot Plug PCI Controller Driver version: 0.4
>AMD768 RNG detected
>ACPI: PCI Interrupt 0000:02:08.0[A] -> GSI 19 (level, low) -> IRQ 17
>3c59x: Donald Becker and others.
>0000:02:08.0: 3Com PCI 3c905C Tornado at f892c000.
>ACPI: PCI Interrupt 0000:01:05.0[A] -> GSI 18 (level, low) -> IRQ 18
>rivafb: nVidia device/chipset 10DE0111
>rivafb: Detected CRTC controller 0 being used
>rivafb: RIVA MTRR set to ON
>rivafb: setting virtual Y resolution to 52428
>net eth1: device_rename: sysfs_create_symlink failed (-17)
>udev: renamed network interface eth0 to eth1
>Console: switching to colour frame buffer device 80x30
>rivafb: PCI nVidia NV11 framebuffer ver 0.9.5b (32MB @ 0xF0000000)
>Intel(R) PRO/1000 Network Driver - version 7.3.20-k2-NAPI
>Copyright (c) 1999-2006 Intel Corporation.
>ACPI: PCI Interrupt 0000:02:07.0[A] -> GSI 19 (level, low) -> IRQ 17
>e1000: 0000:02:07.0: e1000_probe: (PCI:33MHz:32-bit) 00:04:23:b9:b0:f5
>e1000: eth0: e1000_probe: Intel(R) PRO/1000 Network Connection
>xor: automatically using best checksumming function: pIII_sse
>   pIII_sse  :  4541.000 MB/sec
>xor: using function: pIII_sse (4541.000 MB/sec)
>async_tx: api initialized (sync-only)
>raid6: int32x1    579 MB/s
>raid6: int32x2    612 MB/s
>raid6: int32x4    570 MB/s
>raid6: int32x8    542 MB/s
>raid6: mmxx1     1291 MB/s
>raid6: mmxx2     2015 MB/s
>raid6: sse1x1    1125 MB/s
>raid6: sse1x2    1771 MB/s
>raid6: using algorithm sse1x2 (1771 MB/s)
>md: raid6 personality registered for level 6
>md: raid5 personality registered for level 5
>md: raid4 personality registered for level 4
>XFS: SB read failed
>Adding 2096472k swap on /dev/hda2.  Priority:-1 extents:1 across:2096472k
>e1000: eth0: e1000_watchdog: NIC Link is Up 100 Mbps Full Duplex, Flow Control: RX
>Installing knfsd (copyright (C) 1996 okir@monad.swb.de).
>NFSD: Using /var/lib/nfs/v4recovery as the NFSv4 state recovery directory
>NFSD: starting 90-second grace period
>NET: Registered protocol family 10
>lo: Disabled Privacy Extensions
>svc: unknown version (0 for prog 100003, nfsd)
>md: md0 stopped.
>md: bind<hdd1>
>md: bind<sda1>
>md: bind<sdb1>
>md: bind<sdc1>
>md: bind<sdd1>
>md: bind<hdc1>
>raid5: device hdc1 operational as raid disk 0
>raid5: device sdd1 operational as raid disk 5
>raid5: device sdc1 operational as raid disk 4
>raid5: device sdb1 operational as raid disk 3
>raid5: device sda1 operational as raid disk 2
>raid5: device hdd1 operational as raid disk 1
>raid5: allocated 6300kB for md0
>raid5: raid level 5 set md0 active with 6 out of 6 devices, algorithm 2
>RAID5 conf printout:
> --- rd:6 wd:6
> disk 0, o:1, dev:hdc1
> disk 1, o:1, dev:hdd1
> disk 2, o:1, dev:sda1
> disk 3, o:1, dev:sdb1
> disk 4, o:1, dev:sdc1
> disk 5, o:1, dev:sdd1
>Filesystem "md0": Disabling barriers, not supported by the underlying device
>XFS mounting filesystem md0
>Ending clean XFS mount for filesystem: md0
>svc: unknown version (0 for prog 100003, nfsd)
>svc: unknown version (0 for prog 100003, nfsd)
>svc: unknown version (0 for prog 100003, nfsd)
>svc: unknown version (0 for prog 100003, nfsd)
>svc: unknown version (0 for prog 100003, nfsd)
>svc: unknown version (0 for prog 100003, nfsd)
>svc: unknown version (0 for prog 100003, nfsd)
>svc: unknown version (0 for prog 100003, nfsd)
>svc: unknown version (0 for prog 100003, nfsd)
>svc: unknown version (0 for prog 100003, nfsd)
>svc: unknown version (0 for prog 100003, nfsd)
>SysRq : Show State
>  task                PC stack   pid father
>init          S c2dd4b4c     0     1      0
>       c2dd4b60 00000086 00000002 c2dd4b4c c2dd4b44 00000000 c050eddc c0559e80 
>       c0559e80 c2ddec60 c2ddeda8 c2c6de80 00000000 00000046 c059cd00 00000292 
>       c059cd00 f7a9dc20 00000292 004b3659 000000ff 00000000 00000000 00000000 
>Call Trace:
> [<c039749f>] schedule_timeout+0x70/0x8d
> [<c012c597>] process_timeout+0x0/0x5
> [<c017aa7f>] do_select+0x346/0x39a
> [<c017af86>] __pollwait+0x0/0xac
> [<c011f99b>] default_wake_function+0x0/0xc
> [<c0247d3c>] mmx_clear_page+0x24/0x60
> [<f893b643>] rivafb_cursor+0x3b/0x32a [rivafb]
> [<c013b68a>] lock_release_holdtime+0x25/0x43
> [<c013c012>] __lock_acquire+0x3a6/0x609
> [<c013c012>] __lock_acquire+0x3a6/0x609
> [<c013c012>] __lock_acquire+0x3a6/0x609
> [<c013c012>] __lock_acquire+0x3a6/0x609
> [<c013b68a>] lock_release_holdtime+0x25/0x43
> [<c013995a>] clocksource_get_next+0x39/0x3f
> [<c011e22d>] enqueue_entity+0x1d2/0x1f3
> [<c0151abc>] handle_fasteoi_irq+0x0/0xad
> [<c010655e>] do_IRQ+0x9f/0xb9
> [<c013c012>] __lock_acquire+0x3a6/0x609
> [<c013c012>] __lock_acquire+0x3a6/0x609
> [<c013c012>] __lock_acquire+0x3a6/0x609
> [<c013b68a>] lock_release_holdtime+0x25/0x43
> [<c017e3d6>] __d_lookup+0xb3/0xe7
> [<c0398ded>] _spin_unlock+0x14/0x1c
> [<c017e3d6>] __d_lookup+0xb3/0xe7
> [<c0175a41>] do_lookup+0x4f/0x143
> [<c017e8cd>] dput+0x2c/0xff
> [<c0177c29>] __link_path_walk+0xa93/0xbaf
> [<c017acaa>] core_sys_select+0x1d7/0x2b2
> [<c024855b>] copy_to_user+0x2f/0x44
> [<c0172159>] cp_new_stat64+0xf9/0x10b
> [<c017b0d2>] sys_select+0xa0/0x166
> [<c0103e3e>] sysenter_past_esp+0x5f/0x85
> =======================
>kthreadd      S c2dd7fbc     0     2      0
>       c2dd7fd0 00000082 00000002 c2dd7fbc c2dd7fb4 00000000 c050eddc c0559e80 
>       c0559e80 c2dde030 c2dde178 c2c6de80 00000000 c2dde030 c04a1164 c0134e51 
>       00000246 f7ee2540 c2dde030 003fe027 000000ff 00000000 00000000 00000000 
>Call Trace:
> [<c0134e51>] kthreadd+0xff/0x104
> [<c0134db3>] kthreadd+0x61/0x104
> [<c0134d52>] kthreadd+0x0/0x104
> [<c0104a5f>] kernel_thread_helper+0x7/0x10
> =======================
>migration/0   S 00000070     0     3      2
>       c2ddaf90 00000086 00000000 00000070 00015cb9 00000000 c050eddc c0559e80 
>       c0559e80 c2de2050 c2de2198 c2c6de80 00000000 c2de2050 c2c6de90 c0121fd9 
>       00000046 f7ae8060 c2de2050 c2c6de90 00000046 00000046 c2c6de80 c2c739a4 
>Call Trace:
> [<c0121fd9>] migration_thread+0x15f/0x1e2
> [<c0121fde>] migration_thread+0x164/0x1e2
> [<c0121e7a>] migration_thread+0x0/0x1e2
> [<c0134f41>] kthread+0x38/0x5f
> [<c0134f09>] kthread+0x0/0x5f
> [<c0104a5f>] kernel_thread_helper+0x7/0x10
> =======================
>ksoftirqd/0   S c2ddbfac     0     4      2
>       c2ddbfc0 00000086 00000002 c2ddbfac c2ddbfa4 00000000 c050eddc c0559e80 
>       c0559e80 c2de4ca0 c2de4de8 c2c6de80 00000000 c049a3d0 c010484f c0559e00 
>       0000011f f75f61a0 c0559e00 004b1467 000000ff 00000000 00000000 00000000 
>Call Trace:
> [<c010484f>] common_interrupt+0x23/0x28
> [<c012960e>] ksoftirqd+0x38/0xbc
> [<c01295d6>] ksoftirqd+0x0/0xbc
> [<c0134f41>] kthread+0x38/0x5f
> [<c0134f09>] kthread+0x0/0x5f
> [<c0104a5f>] kernel_thread_helper+0x7/0x10
> =======================
>watchdog/0    S c2ddcfb8     0     5      2
>       c2ddcfcc 00000082 00000002 c2ddcfb8 c2ddcfb0 00000000 c050eddc c0559e80 
>       c0559e80 c2de4070 c2de41b8 c2c6de80 00000000 0000123c c02cafe2 00001234 
>       c2c6de80 f74a7d20 00000000 004b366b 000000ff 00000000 00000000 00000000 
>Call Trace:
> [<c02cafe2>] ide_intr+0xcf/0x1ba
> [<c01508b7>] watchdog+0x0/0x49
> [<c01508f2>] watchdog+0x3b/0x49
> [<c0134f41>] kthread+0x38/0x5f
> [<c0134f09>] kthread+0x0/0x5f
> [<c0104a5f>] kernel_thread_helper+0x7/0x10
> =======================
>migration/1   S 00000070     0     6      2
>       c2dddf90 00000086 00000001 00000070 00015cb9 00000000 c050eddc c0559e80 
>       c0559e80 c2de6cc0 c2de6e08 c2cbee80 00000001 c2de6cc0 c2cbee90 c0121fd9 
>       00000046 f7ae89e0 c2de6cc0 c2cbee90 00000046 00000046 c2cbee80 c2c229a4 
>Call Trace:
> [<c0121fd9>] migration_thread+0x15f/0x1e2
> [<c0121fde>] migration_thread+0x164/0x1e2
> [<c0121e7a>] migration_thread+0x0/0x1e2
> [<c0134f41>] kthread+0x38/0x5f
> [<c0134f09>] kthread+0x0/0x5f
> [<c0104a5f>] kernel_thread_helper+0x7/0x10
> =======================
>ksoftirqd/1   S c2df5fac     0     7      2
>       c2df5fc0 00000086 00000002 c2df5fac c2df5fa4 00000000 c050eddc c0559e80 
>       c0559e80 c2de6090 c2de61d8 c2cbee80 00000001 c2de2c80 c010484f c0559e00 
>       00000000 f74405c0 c0559e00 004b038f 000000ff 00000000 00000000 00000000 
>Call Trace:
> [<c010484f>] common_interrupt+0x23/0x28
> [<c012960e>] ksoftirqd+0x38/0xbc
> [<c01295d6>] ksoftirqd+0x0/0xbc
> [<c0134f41>] kthread+0x38/0x5f
> [<c0134f09>] kthread+0x0/0x5f
> [<c0104a5f>] kernel_thread_helper+0x7/0x10
> =======================
>watchdog/1    S c2df6fb8     0     8      2
>       c2df6fcc 00000082 00000002 c2df6fb8 c2df6fb0 00000000 c050eddc c0559e80 
>       c0559e80 c2e0cce0 c2e0ce28 c2cbee80 00000001 0000123c 40082dc4 00001233 
>       c2cbee80 f7ee2a00 00000000 004b37ba 000000ff 00000000 00000000 00000000 
>Call Trace:
> [<c01508b7>] watchdog+0x0/0x49
> [<c01508f2>] watchdog+0x3b/0x49
> [<c0134f41>] kthread+0x38/0x5f
> [<c0134f09>] kthread+0x0/0x5f
> [<c0104a5f>] kernel_thread_helper+0x7/0x10
> =======================
>events/0      S c2df8f9c     0     9      2
>       c2df8fb0 00000082 00000002 c2df8f9c c2df8f94 00000000 c050eddc c0559e80 
>       c0559e80 c2e0c0b0 c2e0c1f8 c2c6de80 00000000 c2dc32d8 c01329ad 00000046 
>       00000000 f761fc20 00000000 004b37dd 000000ff 00000000 00000000 00000000 
>Call Trace:
> [<c01329ad>] worker_thread+0x62/0xc9
> [<c013294b>] worker_thread+0x0/0xc9
> [<c01329d6>] worker_thread+0x8b/0xc9
> [<c0134ff9>] autoremove_wake_function+0x0/0x33
> [<c013294b>] worker_thread+0x0/0xc9
> [<c0134f41>] kthread+0x38/0x5f
> [<c0134f09>] kthread+0x0/0x5f
> [<c0104a5f>] kernel_thread_helper+0x7/0x10
> =======================
>events/1      S c2dfaf9c     0    10      2
>       c2dfafb0 00000082 00000002 c2dfaf9c c2dfaf94 00000000 c050eddc c0559e80 
>       c0559e80 c2e0ed00 c2e0ee48 c2cbee80 00000001 c2dc3258 c01329ad 00000046 
>       00000000 f7ee2a00 00000000 004b37da 000000ff 00000000 00000000 00000000 
>Call Trace:
> [<c01329ad>] worker_thread+0x62/0xc9
> [<c013294b>] worker_thread+0x0/0xc9
> [<c01329d6>] worker_thread+0x8b/0xc9
> [<c0134ff9>] autoremove_wake_function+0x0/0x33
> [<c013294b>] worker_thread+0x0/0xc9
> [<c0134f41>] kthread+0x38/0x5f
> [<c0134f09>] kthread+0x0/0x5f
> [<c0104a5f>] kernel_thread_helper+0x7/0x10
> =======================
>khelper       S c2dc31d8     0    11      2
>       c2dfbfb0 00000082 00000046 c2dc31d8 00000000 c2e0e0d0 c050eddc c0559e80 
>       c0559e80 c2e0e0d0 c2e0e218 c2c6de80 00000000 c2dc31d8 c01329ad 00000046 
>       00000000 f74405c0 00000000 00000001 00000046 c2dc31c8 00000292 c2dc31c8 
>Call Trace:
> [<c01329ad>] worker_thread+0x62/0xc9
> [<c013294b>] worker_thread+0x0/0xc9
> [<c01329d6>] worker_thread+0x8b/0xc9
> [<c0134ff9>] autoremove_wake_function+0x0/0x33
> [<c013294b>] worker_thread+0x0/0xc9
> [<c0134f41>] kthread+0x38/0x5f
> [<c0134f09>] kthread+0x0/0x5f
> [<c0104a5f>] kernel_thread_helper+0x7/0x10
> =======================
>kblockd/0     S c2e86f9c     0    59      2
>       c2e86fb0 00000082 00000002 c2e86f9c c2e86f94 00000000 c050eddc c0559e80 
>       c0559e80 c2e7e3d0 c2e7e518 c2c6de80 00000000 c2e62658 c01329ad 00000046 
>       00000000 f75f61a0 00000000 004b1467 000000ff 00000000 00000000 00000000 
>Call Trace:
> [<c01329ad>] worker_thread+0x62/0xc9
> [<c013294b>] worker_thread+0x0/0xc9
> [<c01329d6>] worker_thread+0x8b/0xc9
> [<c0134ff9>] autoremove_wake_function+0x0/0x33
> [<c013294b>] worker_thread+0x0/0xc9
> [<c0134f41>] kthread+0x38/0x5f
> [<c0134f09>] kthread+0x0/0x5f
> [<c0104a5f>] kernel_thread_helper+0x7/0x10
> =======================
>kblockd/1     S c2e625d8     0    60      2
>       c2e87fb0 00000082 00000046 c2e625d8 00000000 c2ea3020 c050eddc c0559e80 
>       c0559e80 c2ea3020 c2ea3168 c2cbee80 00000001 c2e625d8 c01329ad 00000046 
>       00000000 f7a9d2a0 00000000 00000001 00000046 c2e625c8 00000292 c2e625c8 
>Call Trace:
> [<c01329ad>] worker_thread+0x62/0xc9
> [<c013294b>] worker_thread+0x0/0xc9
> [<c01329d6>] worker_thread+0x8b/0xc9
> [<c0134ff9>] autoremove_wake_function+0x0/0x33
> [<c013294b>] worker_thread+0x0/0xc9
> [<c0134f41>] kthread+0x38/0x5f
> [<c0134f09>] kthread+0x0/0x5f
> [<c0104a5f>] kernel_thread_helper+0x7/0x10
> =======================
>kacpid        S c2e620d8     0    64      2
>       c2e90fb0 00000082 00000046 c2e620d8 00000000 c2ea7060 c050eddc c0559e80 
>       c0559e80 c2ea7060 c2ea71a8 c2c6de80 00000000 c2e620d8 c01329ad 00000046 
>       00000000 c049a180 00000000 00000001 00000046 c2e620c8 00000292 c2e620c8 
>Call Trace:
> [<c01329ad>] worker_thread+0x62/0xc9
> [<c013294b>] worker_thread+0x0/0xc9
> [<c01329d6>] worker_thread+0x8b/0xc9
> [<c0134ff9>] autoremove_wake_function+0x0/0x33
> [<c013294b>] worker_thread+0x0/0xc9
> [<c0134f41>] kthread+0x38/0x5f
> [<c0134f09>] kthread+0x0/0x5f
> [<c0104a5f>] kernel_thread_helper+0x7/0x10
> =======================
>kacpi_notify  S c2e8fef8     0    65      2
>       c2e91fb0 00000082 00000046 c2e8fef8 00000000 c2ea6430 c050eddc c0559e80 
>       c0559e80 c2ea6430 c2ea6578 c2c6de80 00000000 c2e8fef8 c01329ad 00000046 
>       00000000 c049a180 00000000 00000001 00000046 c2e8fee8 00000292 c2e8fee8 
>Call Trace:
> [<c01329ad>] worker_thread+0x62/0xc9
> [<c013294b>] worker_thread+0x0/0xc9
> [<c01329d6>] worker_thread+0x8b/0xc9
> [<c0134ff9>] autoremove_wake_function+0x0/0x33
> [<c013294b>] worker_thread+0x0/0xc9
> [<c0134f41>] kthread+0x38/0x5f
> [<c0134f09>] kthread+0x0/0x5f
> [<c0104a5f>] kernel_thread_helper+0x7/0x10
> =======================
>ksuspend_usbd S c2e8f1f8     0   135      2
>       c2e9dfb0 00000082 00000046 c2e8f1f8 00000000 c2ed8530 c050eddc c0559e80 
>       c0559e80 c2ed8530 c2ed8678 c2c6de80 00000000 c2e8f1f8 c01329ad 00000046 
>       00000000 c049a180 00000000 00000001 00000046 c2e8f1e8 00000292 c2e8f1e8 
>Call Trace:
> [<c01329ad>] worker_thread+0x62/0xc9
> [<c013294b>] worker_thread+0x0/0xc9
> [<c01329d6>] worker_thread+0x8b/0xc9
> [<c0134ff9>] autoremove_wake_function+0x0/0x33
> [<c013294b>] worker_thread+0x0/0xc9
> [<c0134f41>] kthread+0x38/0x5f
> [<c0134f09>] kthread+0x0/0x5f
> [<c0104a5f>] kernel_thread_helper+0x7/0x10
> =======================
>khubd         S c04bc5cc     0   141      2
>       c2dfcf40 00000082 00000046 c04bc5cc 00000000 c2ed24d0 c050eddc c0559e80 
>       c0559e80 c2ed24d0 c2ed2618 c2c6de80 00000000 c04bc5cc c02f15f9 00000046 
>       00000000 c049a180 00000000 00000001 00000046 c04bc5bc 00000292 c2dfcfbc 
>Call Trace:
> [<c02f15f9>] hub_thread+0xa35/0xac2
> [<c02f0bc4>] hub_thread+0x0/0xac2
> [<c02f1623>] hub_thread+0xa5f/0xac2
> [<c0399276>] _spin_unlock_irq+0x1b/0x1e
> [<c0396d3b>] __sched_text_start+0x59b/0x623
> [<c0396ca2>] __sched_text_start+0x502/0x623
> [<c0134f25>] kthread+0x1c/0x5f
> [<c0134ff9>] autoremove_wake_function+0x0/0x33
> [<c02f0bc4>] hub_thread+0x0/0xac2
> [<c0134f41>] kthread+0x38/0x5f
> [<c0134f09>] kthread+0x0/0x5f
> [<c0104a5f>] kernel_thread_helper+0x7/0x10
> =======================
>kseriod       S c2e19f84     0   144      2
>       c2e19f98 00000092 00000002 c2e19f84 c2e19f7c 00000000 c050eddc c0559e80 
>       c0559e80 c2ed10e0 c2ed1228 c2c6de80 00000000 c04beb28 c0300f33 00000046 
>       00000296 c049a180 00000000 fffede27 000000ff 00000000 00000000 00000000 
>Call Trace:
> [<c0300f33>] serio_thread+0x25e/0x2d3
> [<c0300f5d>] serio_thread+0x288/0x2d3
> [<c0134f25>] kthread+0x1c/0x5f
> [<c0134ff9>] autoremove_wake_function+0x0/0x33
> [<c0300cd5>] serio_thread+0x0/0x2d3
> [<c0134f41>] kthread+0x38/0x5f
> [<c0134f09>] kthread+0x0/0x5f
> [<c0104a5f>] kernel_thread_helper+0x7/0x10
> =======================
>kswapd0       S c2c229a4     0   188      2
>       f7bd9f48 00000092 00000c31 c2c229a4 00000002 f7bd9f30 c050eddc c0559e80 
>       c0559e80 c2e76f80 c2e770c8 c2c6de80 00000000 c04a3f8c c015b931 00000046 
>       c04a2500 f7a9dc20 00000000 004b19ec 000000ff 00000000 00000000 00000c31 
>Call Trace:
> [<c015b931>] kswapd+0x97/0x401
> [<c015b965>] kswapd+0xcb/0x401
> [<c0134ff9>] autoremove_wake_function+0x0/0x33
> [<c015b89a>] kswapd+0x0/0x401
> [<c0134f41>] kthread+0x38/0x5f
> [<c0134f09>] kthread+0x0/0x5f
> [<c0104a5f>] kernel_thread_helper+0x7/0x10
> =======================
>aio/0         S c2e27e18     0   189      2
>       f7bd8fb0 00000082 00000046 c2e27e18 00000000 c2e76350 c050eddc c0559e80 
>       c0559e80 c2e76350 c2e76498 c2c6de80 00000000 c2e27e18 c01329ad 00000046 
>       00000000 c049a180 00000000 00000001 00000046 c2e27e08 00000292 c2e27e08 
>Call Trace:
> [<c01329ad>] worker_thread+0x62/0xc9
> [<c013294b>] worker_thread+0x0/0xc9
> [<c01329d6>] worker_thread+0x8b/0xc9
> [<c0134ff9>] autoremove_wake_function+0x0/0x33
> [<c013294b>] worker_thread+0x0/0xc9
> [<c0134f41>] kthread+0x38/0x5f
> [<c0134f09>] kthread+0x0/0x5f
> [<c0104a5f>] kernel_thread_helper+0x7/0x10
> =======================
>aio/1         S f7bd7f9c     0   190      2
>       f7bd7fb0 00000082 00000002 f7bd7f9c f7bd7f94 00000000 c050eddc c0559e80 
>       c0559e80 c2e78fa0 c2e790e8 c2cbee80 00000001 c2e27d98 c01329ad 00000046 
>       00000000 c049a180 00000000 fffedb6d 000000ff 00000000 00000000 00000000 
>Call Trace:
> [<c01329ad>] worker_thread+0x62/0xc9
> [<c013294b>] worker_thread+0x0/0xc9
> [<c01329d6>] worker_thread+0x8b/0xc9
> [<c0134ff9>] autoremove_wake_function+0x0/0x33
> [<c013294b>] worker_thread+0x0/0xc9
> [<c0134f41>] kthread+0x38/0x5f
> [<c0134f09>] kthread+0x0/0x5f
> [<c0104a5f>] kernel_thread_helper+0x7/0x10
> =======================
>xfslogd/0     S f7b32d58     0   191      2
>       f7bd6fb0 00000082 00000046 f7b32d58 00000000 c2e78370 c050eddc c0559e80 
>       c0559e80 c2e78370 c2e784b8 c2c6de80 00000000 f7b32d58 c01329ad 00000046 
>       00000000 f7440100 00000000 00000001 00000046 f7b32d48 00000292 f7b32d48 
>Call Trace:
> [<c01329ad>] worker_thread+0x62/0xc9
> [<c013294b>] worker_thread+0x0/0xc9
> [<c01329d6>] worker_thread+0x8b/0xc9
> [<c0134ff9>] autoremove_wake_function+0x0/0x33
> [<c013294b>] worker_thread+0x0/0xc9
> [<c0134f41>] kthread+0x38/0x5f
> [<c0134f09>] kthread+0x0/0x5f
> [<c0104a5f>] kernel_thread_helper+0x7/0x10
> =======================
>xfslogd/1     S f7bd5f9c     0   192      2
>       f7bd5fb0 00000082 00000002 f7bd5f9c f7bd5f94 00000000 c050eddc c0559e80 
>       c0559e80 c2e7afc0 c2e7b108 c2cbee80 00000001 f7b32cd8 c01329ad 00000046 
>       00000000 f7587640 00000000 00435a09 000000ff 00000000 00000000 00000000 
>Call Trace:
> [<c01329ad>] worker_thread+0x62/0xc9
> [<c013294b>] worker_thread+0x0/0xc9
> [<c01329d6>] worker_thread+0x8b/0xc9
> [<c0134ff9>] autoremove_wake_function+0x0/0x33
> [<c013294b>] worker_thread+0x0/0xc9
> [<c0134f41>] kthread+0x38/0x5f
> [<c0134f09>] kthread+0x0/0x5f
> [<c0104a5f>] kernel_thread_helper+0x7/0x10
> =======================
>xfsdatad/0    S f7bd4f9c     0   193      2
>       f7bd4fb0 00000082 00000002 f7bd4f9c f7bd4f94 00000000 c050eddc c0559e80 
>       c0559e80 c2e7a390 c2e7a4d8 c2c6de80 00000000 f7b32c58 c01329ad 00000046 
>       00000000 f7ae82c0 00000000 004359af 000000ff 00000000 00000000 00000000 
>Call Trace:
> [<c01329ad>] worker_thread+0x62/0xc9
> [<c013294b>] worker_thread+0x0/0xc9
> [<c01329d6>] worker_thread+0x8b/0xc9
> [<c0134ff9>] autoremove_wake_function+0x0/0x33
> [<c013294b>] worker_thread+0x0/0xc9
> [<c0134f41>] kthread+0x38/0x5f
> [<c0134f09>] kthread+0x0/0x5f
> [<c0104a5f>] kernel_thread_helper+0x7/0x10
> =======================
>xfsdatad/1    S c2c739a4     0   194      2
>       f7bd3fb0 00000082 00000400 c2c739a4 00000002 f7bd3f98 c050eddc c0559e80 
>       c0559e80 c2e7cfe0 c2e7d128 c2cbee80 00000001 f7b32bd8 c01329ad 00000046 
>       00000000 f7587640 00000000 004359d8 000000ff 00000000 00000000 00000400 
>Call Trace:
> [<c01329ad>] worker_thread+0x62/0xc9
> [<c013294b>] worker_thread+0x0/0xc9
> [<c01329d6>] worker_thread+0x8b/0xc9
> [<c0134ff9>] autoremove_wake_function+0x0/0x33
> [<c013294b>] worker_thread+0x0/0xc9
> [<c0134f41>] kthread+0x38/0x5f
> [<c0134f09>] kthread+0x0/0x5f
> [<c0104a5f>] kernel_thread_helper+0x7/0x10
> =======================
>xfs_mru_cache S f7bd1f9c     0   195      2
>       f7bd1fb0 00000082 00000002 f7bd1f9c f7bd1f94 00000000 c050eddc c0559e80 
>       c0559e80 c2e7c3b0 c2e7c4f8 c2c6de80 00000000 f7b32758 c01329ad 00000046 
>       00000000 c049a180 00000000 fffedb54 000000ff 00000000 00000000 00000000 
>Call Trace:
> [<c01329ad>] worker_thread+0x62/0xc9
> [<c013294b>] worker_thread+0x0/0xc9
> [<c01329d6>] worker_thread+0x8b/0xc9
> [<c0134ff9>] autoremove_wake_function+0x0/0x33
> [<c013294b>] worker_thread+0x0/0xc9
> [<c0134f41>] kthread+0x38/0x5f
> [<c0134f09>] kthread+0x0/0x5f
> [<c0104a5f>] kernel_thread_helper+0x7/0x10
> =======================
>kpsmoused     S f7bfc778     0   369      2
>       f7b97fb0 00000082 00000046 f7bfc778 00000000 c2f4b3a0 c050eddc c0559e80 
>       c0559e80 c2f4b3a0 c2f4b4e8 c2c6de80 00000000 f7bfc778 c01329ad 00000046 
>       00000000 c049a180 00000000 00000001 00000046 f7bfc768 00000292 f7bfc768 
>Call Trace:
> [<c01329ad>] worker_thread+0x62/0xc9
> [<c013294b>] worker_thread+0x0/0xc9
> [<c01329d6>] worker_thread+0x8b/0xc9
> [<c0134ff9>] autoremove_wake_function+0x0/0x33
> [<c013294b>] worker_thread+0x0/0xc9
> [<c0134f41>] kthread+0x38/0x5f
> [<c0134f09>] kthread+0x0/0x5f
> [<c0104a5f>] kernel_thread_helper+0x7/0x10
> =======================
>kirqd         S f7bdcf48     0   375      2
>       f7bdcf5c 00000086 00000002 f7bdcf48 f7bdcf40 00000000 c050eddc c0559e80 
>       c0559e80 c2e72f40 c2e73088 c2cbee80 00000001 00000046 c2dea000 00000296 
>       c2dea000 f7ee2540 00000296 004b35fe 000000ff 00000000 00000000 00000000 
>Call Trace:
> [<c039749f>] schedule_timeout+0x70/0x8d
> [<c0152536>] set_pending_irq+0x1b/0x35
> [<c012c597>] process_timeout+0x0/0x5
> [<c01176d4>] balanced_irq+0x55/0x4b5
> [<c011767f>] balanced_irq+0x0/0x4b5
> [<c0134f41>] kthread+0x38/0x5f
> [<c0134f09>] kthread+0x0/0x5f
> [<c0104a5f>] kernel_thread_helper+0x7/0x10
> =======================
>xfsbufd       S f7ba9f78     0   382      2
>       f7ba9f8c 00000086 00000002 f7ba9f78 f7ba9f70 00000000 c050eddc c0559e80 
>       c0559e80 c2f4a770 c2f4a8b8 c2c6de80 00000000 00000046 c059cd00 00000296 
>       c059cd00 f74a7d20 00000296 004b3739 000000ff 00000000 00000000 00000000 
>Call Trace:
> [<c039749f>] schedule_timeout+0x70/0x8d
> [<c0211e70>] xfs_buf_delwri_split+0xc5/0xcf
> [<c012c597>] process_timeout+0x0/0x5
> [<c0212018>] xfsbufd+0x58/0xec
> [<c0211fc0>] xfsbufd+0x0/0xec
> [<c0134f41>] kthread+0x38/0x5f
> [<c0134f09>] kthread+0x0/0x5f
> [<c0104a5f>] kernel_thread_helper+0x7/0x10
> =======================
>xfssyncd      S f7b4af68     0   383      2
>       f7b4af7c 00000082 00000002 f7b4af68 f7b4af60 00000000 c050eddc c0559e80 
>       c0559e80 c2f4cc60 c2f4cda8 c2c6de80 00000000 00000046 c059cd00 00000292 
>       c059cd00 f74a7d20 00000292 004b1706 000000ff 00000000 00000000 00000000 
>Call Trace:
> [<c039749f>] schedule_timeout+0x70/0x8d
> [<c012c597>] process_timeout+0x0/0x5
> [<c0216bc4>] xfssyncd+0x4c/0x158
> [<c0216b78>] xfssyncd+0x0/0x158
> [<c0134f41>] kthread+0x38/0x5f
> [<c0134f09>] kthread+0x0/0x5f
> [<c0104a5f>] kernel_thread_helper+0x7/0x10
> =======================
>udevd         S c2fc7b4c     0   475      1
>       c2fc7b60 00000086 00000002 c2fc7b4c c2fc7b44 00000000 c050eddc c0559e80 
>       c0559e80 c2efe5b0 c2efe6f8 c2c6de80 00000000 00000046 c2efe5b0 c2efe5b0 
>       f7be1410 f7a9d040 c2efe5b0 ffff1c12 000000ff 00000000 00000000 00000000 
>Call Trace:
> [<c0397442>] schedule_timeout+0x13/0x8d
> [<c017452c>] pipe_poll+0x24/0x7f
> [<c017aa7f>] do_select+0x346/0x39a
> [<c017af86>] __pollwait+0x0/0xac
> [<c011f99b>] default_wake_function+0x0/0xc
> [<c011f99b>] default_wake_function+0x0/0xc
> [<c011f99b>] default_wake_function+0x0/0xc
> [<c011f99b>] default_wake_function+0x0/0xc
> [<c0137be3>] up_read+0x14/0x29
> [<c011ba3f>] do_page_fault+0x272/0x597
> [<c013c012>] __lock_acquire+0x3a6/0x609
> [<c013c012>] __lock_acquire+0x3a6/0x609
> [<c013c012>] __lock_acquire+0x3a6/0x609
> [<c013b68a>] lock_release_holdtime+0x25/0x43
> [<c013c012>] __lock_acquire+0x3a6/0x609
> [<c013c012>] __lock_acquire+0x3a6/0x609
> [<c0246c94>] number+0x147/0x219
> [<c013b68a>] lock_release_holdtime+0x25/0x43
> [<c013b68a>] lock_release_holdtime+0x25/0x43
> [<c0175aae>] do_lookup+0xbc/0x143
> [<c0247587>] vsnprintf+0x415/0x451
> [<c0247d3c>] mmx_clear_page+0x24/0x60
> [<c0157aed>] get_page_from_freelist+0x232/0x29c
> [<c013c012>] __lock_acquire+0x3a6/0x609
> [<c013c012>] __lock_acquire+0x3a6/0x609
> [<c013b68a>] lock_release_holdtime+0x25/0x43
> [<c0183466>] lookup_mnt+0x32/0x37
> [<c017acaa>] core_sys_select+0x1d7/0x2b2
> [<c0175974>] __follow_mount+0x1e/0x60
> [<c01820f4>] mntput_no_expire+0x13/0x70
> [<c0177c90>] __link_path_walk+0xafa/0xbaf
> [<c013c012>] __lock_acquire+0x3a6/0x609
> [<c013c012>] __lock_acquire+0x3a6/0x609
> [<c013c012>] __lock_acquire+0x3a6/0x609
> [<c013b68a>] lock_release_holdtime+0x25/0x43
> [<c0127857>] do_wait+0x99b/0xa05
> [<c03992eb>] _spin_lock_irqsave+0x54/0x5d
> [<c0127857>] do_wait+0x99b/0xa05
> [<c017b0d2>] sys_select+0xa0/0x166
> [<c01278f2>] sys_wait4+0x31/0x34
> [<c0103e3e>] sysenter_past_esp+0x5f/0x85
> =======================
>scsi_eh_0     S c2c6de90     0   746      2
>       f757bf74 00000086 00000046 c2c6de90 c013c012 c2e44230 c050eddc c0559e80 
>       c0559e80 c2e44230 c2e44378 c2c6de80 00000000 00000046 00000046 c2c6de90 
>       00000002 f7fa87c0 00000046 c2c6de80 c2c6de80 00000002 c2c6de80 c0399276 
>Call Trace:
> [<c013c012>] __lock_acquire+0x3a6/0x609
> [<c0399276>] _spin_unlock_irq+0x1b/0x1e
> [<c02dd1f1>] scsi_error_handler+0x6a/0x48b
> [<c0134f25>] kthread+0x1c/0x5f
> [<c02dd187>] scsi_error_handler+0x0/0x48b
> [<c0134f41>] kthread+0x38/0x5f
> [<c0134f09>] kthread+0x0/0x5f
> [<c0104a5f>] kernel_thread_helper+0x7/0x10
> =======================
>syslog-ng     S c013c012     0  2686      1
>       00000046 f70fe9ac c013c012 c013c012 00000246 c2db1744 c013c012 00000000 
>       00000046 f70fe9ac 00000000 c2eda550 00000046 c2eda550 c2eda550 f70fe9ac 
>       c013b68a c2eda550 f70fe9ac c017a3ae 00000046 00000292 00000000 c03992eb 
>Call Trace:
> [<c013c012>] __lock_acquire+0x3a6/0x609
> [<c013c012>] __lock_acquire+0x3a6/0x609
> [<c013c012>] __lock_acquire+0x3a6/0x609
> [<c013b68a>] lock_release_holdtime+0x25/0x43
> [<c017a3ae>] free_poll_entry+0xe/0x16
> [<c03992eb>] _spin_lock_irqsave+0x54/0x5d
> [<c017a3ae>] free_poll_entry+0xe/0x16
> [<c017a3cf>] poll_freewait+0x19/0x49
> [<c017a6f5>] do_sys_poll+0x2f6/0x303
> [<c017af86>] __pollwait+0x0/0xac
> [<c011f99b>] default_wake_function+0x0/0xc
> [<c011f99b>] default_wake_function+0x0/0xc
> [<c011f99b>] default_wake_function+0x0/0xc
> [<c011f99b>] default_wake_function+0x0/0xc
> [<c011f99b>] default_wake_function+0x0/0xc
> [<c011f99b>] default_wake_function+0x0/0xc
> [<c011f99b>] default_wake_function+0x0/0xc
> [<c011f99b>] default_wake_function+0x0/0xc
> [<c011f99b>] default_wake_function+0x0/0xc
> [<c011f99b>] default_wake_function+0x0/0xc
> [<c013b68a>] lock_release_holdtime+0x25/0x43
> [<c017e3d6>] __d_lookup+0xb3/0xe7
> [<c0398ded>] _spin_unlock+0x14/0x1c
> [<c013c012>] __lock_acquire+0x3a6/0x609
> [<c013c012>] __lock_acquire+0x3a6/0x609
> [<c013ce5f>] lock_acquire+0x5f/0x77
> [<c012526f>] release_console_sem+0x17d/0x196
> [<c02677d7>] do_con_write+0x7b/0x1753
> [<c0268e63>] do_con_write+0x1707/0x1753
> [<c013c012>] __lock_acquire+0x3a6/0x609
> [<c012526f>] release_console_sem+0x17d/0x196
> [<c0268ed6>] con_put_char+0x27/0x2a
> [<c0125137>] release_console_sem+0x45/0x196
> [<c0268ee2>] con_write+0x9/0x17
> [<c025e746>] write_chan+0x1ef/0x2ab
> [<c011f99b>] default_wake_function+0x0/0xc
> [<c025c405>] tty_write+0x141/0x1bd
> [<c025e557>] write_chan+0x0/0x2ab
> [<c025c2c4>] tty_write+0x0/0x1bd
> [<c016fc4c>] vfs_write+0xa8/0x12a
> [<c01701bf>] sys_write+0x41/0x67
> [<c0103e3e>] sysenter_past_esp+0x5f/0x85
> =======================
>portmap       S 00000001     0  3166      1
>       f70c7c00 00000086 00000000 00000001 c0396ca2 00000000 c050eddc c0559e80 
>       c0559e80 f76e8ce0 f76e8e28 c2c6de80 00000000 c049a3d0 f76e8ce0 c2e4e308 
>       c036078d f7fdc880 00000296 004a560f 000000ff 00000000 00000000 00000000 
>Call Trace:
> [<c0396ca2>] __sched_text_start+0x502/0x623
> [<c036078d>] tcp_poll+0x1c/0x12a
> [<c0397442>] schedule_timeout+0x13/0x8d
> [<c0372d5a>] udp_poll+0x10/0xe7
> [<c017a64f>] do_sys_poll+0x250/0x303
> [<c017af86>] __pollwait+0x0/0xac
> [<c011f99b>] default_wake_function+0x0/0xc
> [<c011f99b>] default_wake_function+0x0/0xc
> [<c0398dcf>] _spin_unlock_bh+0x1b/0x25
> [<c0374299>] udp_sendmsg+0x4dd/0x5dc
> [<c0379155>] inet_sendmsg+0x3b/0x45
> [<c0330f24>] sock_sendmsg+0xd0/0xeb
> [<c0134ff9>] autoremove_wake_function+0x0/0x33
> [<c0177d2c>] __link_path_walk+0xb96/0xbaf
> [<c035bacd>] ip_queue_xmit+0x358/0x39a
> [<c010655e>] do_IRQ+0x9f/0xb9
> [<c03623ac>] tcp_recvmsg+0x659/0x75f
> [<c0248335>] copy_from_user+0x2d/0x59
> [<c03310d1>] sys_sendmsg+0x192/0x1f7
> [<c0178088>] do_path_lookup+0x16a/0x1cf
> [<c0178a80>] path_lookup_open+0x20/0x25
> [<c0178b68>] open_namei+0x72/0x598
> [<c013c012>] __lock_acquire+0x3a6/0x609
> [<c013c012>] __lock_acquire+0x3a6/0x609
> [<c033235b>] sys_socketcall+0x240/0x261
> [<c016e2b9>] do_sys_open+0xba/0xc4
> [<c017a736>] sys_poll+0x34/0x37
> [<c0103e3e>] sysenter_past_esp+0x5f/0x85
> =======================
>rpciod/0      S f7094858     0  3226      2
>       f7226fb0 00000082 00000046 f7094858 00000000 c2e48ea0 c050eddc c0559e80 
>       c0559e80 c2e48ea0 c2e48fe8 c2c6de80 00000000 f7094858 c01329ad 00000046 
>       00000000 f7653060 00000000 00000001 00000046 f7094848 00000292 f7094848 
>Call Trace:
> [<c01329ad>] worker_thread+0x62/0xc9
> [<c013294b>] worker_thread+0x0/0xc9
> [<c01329d6>] worker_thread+0x8b/0xc9
> [<c0134ff9>] autoremove_wake_function+0x0/0x33
> [<c013294b>] worker_thread+0x0/0xc9
> [<c0134f41>] kthread+0x38/0x5f
> [<c0134f09>] kthread+0x0/0x5f
> [<c0104a5f>] kernel_thread_helper+0x7/0x10
> =======================
>rpciod/1      S f7094458     0  3227      2
>       f7227fb0 00000082 00000046 f7094458 00000000 c2efa570 c050eddc c0559e80 
>       c0559e80 c2efa570 c2efa6b8 c2cbee80 00000001 f7094458 c01329ad 00000046 
>       00000000 f761f040 00000000 00000001 00000046 f7094448 00000292 f7094448 
>Call Trace:
> [<c01329ad>] worker_thread+0x62/0xc9
> [<c013294b>] worker_thread+0x0/0xc9
> [<c01329d6>] worker_thread+0x8b/0xc9
> [<c0134ff9>] autoremove_wake_function+0x0/0x33
> [<c013294b>] worker_thread+0x0/0xc9
> [<c0134f41>] kthread+0x38/0x5f
> [<c0134f09>] kthread+0x0/0x5f
> [<c0104a5f>] kernel_thread_helper+0x7/0x10
> =======================
>rpc.statd     S f7125308     0  3250      1
>       f723bb60 00000086 00000046 f7125308 00000000 00000046 c050eddc c0559e80 
>       c0559e80 f7a725f0 f7a72738 c2c6de80 00000000 c013b68a f7a725f0 f71255a8 
>       c036078d f75f6d80 00000296 f723bf4c c03992eb 00000000 00000046 f7125598 
>Call Trace:
> [<c013b68a>] lock_release_holdtime+0x25/0x43
> [<c036078d>] tcp_poll+0x1c/0x12a
> [<c03992eb>] _spin_lock_irqsave+0x54/0x5d
> [<c0397442>] schedule_timeout+0x13/0x8d
> [<c036078d>] tcp_poll+0x1c/0x12a
> [<c017aa7f>] do_select+0x346/0x39a
> [<c017af86>] __pollwait+0x0/0xac
> [<c011f99b>] default_wake_function+0x0/0xc
> [<c011f99b>] default_wake_function+0x0/0xc
> [<c011f99b>] default_wake_function+0x0/0xc
> [<c0398ded>] _spin_unlock+0x14/0x1c
> [<c013c012>] __lock_acquire+0x3a6/0x609
> [<c0398ded>] _spin_unlock+0x14/0x1c
> [<c013c012>] __lock_acquire+0x3a6/0x609
> [<c013c012>] __lock_acquire+0x3a6/0x609
> [<c013b68a>] lock_release_holdtime+0x25/0x43
> [<c01f712d>] xlog_state_release_iclog+0x84/0x9c
> [<c0398ded>] _spin_unlock+0x14/0x1c
> [<c01f712d>] xlog_state_release_iclog+0x84/0x9c
> [<c01f798d>] xfs_log_release_iclog+0x11/0x3a
> [<c02039ab>] _xfs_trans_commit+0x27b/0x2e4
> [<c013c012>] __lock_acquire+0x3a6/0x609
> [<c01f7b9a>] xlog_grant_log_space+0x1e4/0x21c
> [<c013b68a>] lock_release_holdtime+0x25/0x43
> [<c01ebed3>] xfs_iunlock+0x56/0x79
> [<c013c012>] __lock_acquire+0x3a6/0x609
> [<c017acaa>] core_sys_select+0x1d7/0x2b2
> [<c0153e1d>] find_lock_page+0x86/0x8e
> [<c013b68a>] lock_release_holdtime+0x25/0x43
> [<c015dd2e>] __do_fault+0x2da/0x314
> [<c015dd37>] __do_fault+0x2e3/0x314
> [<c013c012>] __lock_acquire+0x3a6/0x609
> [<c013b68a>] lock_release_holdtime+0x25/0x43
> [<c012cb11>] alloc_uid+0x51/0x14c
> [<c017b0d2>] sys_select+0xa0/0x166
> [<c012fc70>] set_user+0x81/0x93
> [<c0131514>] sys_setuid+0xf7/0x102
> [<c0103e3e>] sysenter_past_esp+0x5f/0x85
> =======================
>rpc.mountd    S f70cdd88     0  3314      1
>       f7292b60 00000086 00000046 f70cdd88 00000000 00000046 c050eddc c0559e80 
>       c0559e80 c2edb180 c2edb2c8 c2c6de80 00000000 c013b68a c2edb180 f7125068 
>       c036078d f75f68c0 00000296 f7292f4c c03992eb 00000000 00000046 f7125058 
>Call Trace:
> [<c013b68a>] lock_release_holdtime+0x25/0x43
> [<c036078d>] tcp_poll+0x1c/0x12a
> [<c03992eb>] _spin_lock_irqsave+0x54/0x5d
> [<c0397442>] schedule_timeout+0x13/0x8d
> [<c036078d>] tcp_poll+0x1c/0x12a
> [<c0398ded>] _spin_unlock+0x14/0x1c
> [<c017aa7f>] do_select+0x346/0x39a
> [<c017af86>] __pollwait+0x0/0xac
> [<c011f99b>] default_wake_function+0x0/0xc
> [<c011f99b>] default_wake_function+0x0/0xc
> [<c011f99b>] default_wake_function+0x0/0xc
> [<c011f99b>] default_wake_function+0x0/0xc
> [<c011f99b>] default_wake_function+0x0/0xc
> [<f9984d07>] e1000_xmit_frame+0x97f/0x9c2 [e1000]
> [<f9984d07>] e1000_xmit_frame+0x97f/0x9c2 [e1000]
> [<c01ff1de>] xfs_mod_incore_sb_batch+0x141/0x14b
> [<c013c012>] __lock_acquire+0x3a6/0x609
> [<c013b68a>] lock_release_holdtime+0x25/0x43
> [<c033cb5b>] dev_queue_xmit+0x191/0x2ba
> [<c0398ded>] _spin_unlock+0x14/0x1c
> [<c033cc5c>] dev_queue_xmit+0x292/0x2ba
> [<c035c429>] ip_output+0x29d/0x2d8
> [<c013b68a>] lock_release_holdtime+0x25/0x43
> [<c03623ac>] tcp_recvmsg+0x659/0x75f
> [<c035bacd>] ip_queue_xmit+0x358/0x39a
> [<c0398dcf>] _spin_unlock_bh+0x1b/0x25
> [<c03623ac>] tcp_recvmsg+0x659/0x75f
> [<c013c012>] __lock_acquire+0x3a6/0x609
> [<c017acaa>] core_sys_select+0x1d7/0x2b2
> [<c012c672>] lock_timer_base+0x19/0x35
> [<c013c012>] __lock_acquire+0x3a6/0x609
> [<c013c012>] __lock_acquire+0x3a6/0x609
> [<c013c012>] __lock_acquire+0x3a6/0x609
> [<c01805ff>] generic_drop_inode+0xfd/0x12b
> [<c017b0d2>] sys_select+0xa0/0x166
> [<c01820f4>] mntput_no_expire+0x13/0x70
> [<c016deec>] filp_close+0x51/0x58
> [<c0103e3e>] sysenter_past_esp+0x5f/0x85
> =======================
>nfsd4         S f7289f9c     0  3316      2
>       f7289fb0 00000082 00000002 f7289f9c f7289f94 00000000 c050eddc c0559e80 
>       c0559e80 c2efd1c0 c2efd308 c2c6de80 00000000 f7af9ef8 c01329ad 00000046 
>       00000000 f7a9dc20 00000000 004b2d18 000000ff 00000000 00000000 00000000 
>Call Trace:
> [<c01329ad>] worker_thread+0x62/0xc9
> [<c013294b>] worker_thread+0x0/0xc9
> [<c01329d6>] worker_thread+0x8b/0xc9
> [<c0134ff9>] autoremove_wake_function+0x0/0x33
> [<c013294b>] worker_thread+0x0/0xc9
> [<c0134f41>] kthread+0x38/0x5f
> [<c0134f09>] kthread+0x0/0x5f
> [<c0104a5f>] kernel_thread_helper+0x7/0x10
> =======================
>lockd         S 00000001     0  3317      2
>       f725bf14 00000086 00000000 00000001 c0396ca2 f71dad60 c050eddc c0559e80 
>       c0559e80 f7a7e6b0 f7a7e7f8 c2cbee80 00000001 00000000 00000046 f7195d94 
>       00000001 f761f040 00000046 f7a7e6e8 f7a7e6b0 f7a7e6b0 f759b654 c013b68a 
>Call Trace:
> [<c0396ca2>] __sched_text_start+0x502/0x623
> [<c013b68a>] lock_release_holdtime+0x25/0x43
> [<c0397442>] schedule_timeout+0x13/0x8d
> [<c03992eb>] _spin_lock_irqsave+0x54/0x5d
> [<fbd2394e>] svc_recv+0x243/0x3b5 [sunrpc]
> [<c0128469>] allow_signal+0x6d/0x78
> [<c011f99b>] default_wake_function+0x0/0xc
> [<f99e33bd>] lockd+0x116/0x225 [lockd]
> [<c0121c8b>] schedule_tail+0x0/0xbd
> [<c0103d8a>] ret_from_fork+0x6/0x1c
> [<f99e32a7>] lockd+0x0/0x225 [lockd]
> [<f99e32a7>] lockd+0x0/0x225 [lockd]
> [<c0104a5f>] kernel_thread_helper+0x7/0x10
> =======================
>nfsd          S c2dea010     0  3318      2
>       f72bef40 00000082 c2e401f0 c2dea010 c013b68a c2e401f0 c050eddc c0559e80 
>       c0559e80 c2e401f0 c2e40338 c2cbee80 00000001 00000046 c2dea000 00000296 
>       c2dea000 f7ee2540 00000296 f72bef50 c2dea000 c012c77e 00000000 00000296 
>Call Trace:
> [<c013b68a>] lock_release_holdtime+0x25/0x43
> [<c012c77e>] __mod_timer+0x92/0x9c
> [<c039749f>] schedule_timeout+0x70/0x8d
> [<c03992eb>] _spin_lock_irqsave+0x54/0x5d
> [<c012c597>] process_timeout+0x0/0x5
> [<fbd2394e>] svc_recv+0x243/0x3b5 [sunrpc]
> [<c012ce4d>] sigprocmask+0xb9/0xbf
> [<c011f99b>] default_wake_function+0x0/0xc
> [<fbb026e6>] nfsd+0xdd/0x28b [nfsd]
> [<fbb02609>] nfsd+0x0/0x28b [nfsd]
> [<c0104a5f>] kernel_thread_helper+0x7/0x10
> =======================
>nfsd          S f7303f2c     0  3319      2
>       f7303f40 00000082 00000002 f7303f2c f7303f24 00000000 c050eddc c0559e80 
>       c0559e80 c2e40e20 c2e40f68 c2c6de80 00000000 00000046 c059cd00 00000296 
>       c059cd00 f7ae8520 00000296 004380d8 000000ff 00000000 00000000 00000000 
>Call Trace:
> [<c039749f>] schedule_timeout+0x70/0x8d
> [<c03992eb>] _spin_lock_irqsave+0x54/0x5d
> [<c012c597>] process_timeout+0x0/0x5
> [<fbd2394e>] svc_recv+0x243/0x3b5 [sunrpc]
> [<c012ce4d>] sigprocmask+0xb9/0xbf
> [<c011f99b>] default_wake_function+0x0/0xc
> [<fbb026e6>] nfsd+0xdd/0x28b [nfsd]
> [<fbb02609>] nfsd+0x0/0x28b [nfsd]
> [<c0104a5f>] kernel_thread_helper+0x7/0x10
> =======================
>nfsd          S f7348f2c     0  3320      2
>       f7348f40 00000082 00000002 f7348f2c f7348f24 00000000 c050eddc c0559e80 
>       c0559e80 c2ea23f0 c2ea2538 c2c6de80 00000000 00000046 c059cd00 00000296 
>       c059cd00 f7fdc880 00000296 004a560f 000000ff 00000000 00000000 00000000 
>Call Trace:
> [<c039749f>] schedule_timeout+0x70/0x8d
> [<c03992eb>] _spin_lock_irqsave+0x54/0x5d
> [<c012c597>] process_timeout+0x0/0x5
> [<fbd2394e>] svc_recv+0x243/0x3b5 [sunrpc]
> [<c012ce4d>] sigprocmask+0xb9/0xbf
> [<c011f99b>] default_wake_function+0x0/0xc
> [<fbb026e6>] nfsd+0xdd/0x28b [nfsd]
> [<fbb02609>] nfsd+0x0/0x28b [nfsd]
> [<c0104a5f>] kernel_thread_helper+0x7/0x10
> =======================
>nfsd          S f738df2c     0  3321      2
>       f738df40 00000082 00000002 f738df2c f738df24 00000000 c050eddc c0559e80 
>       c0559e80 c2e3adc0 c2e3af08 c2cbee80 00000001 00000046 c2dea000 00000296 
>       c2dea000 f7440360 00000296 004a560f 000000ff 00000000 00000000 00000000 
>Call Trace:
> [<c039749f>] schedule_timeout+0x70/0x8d
> [<c03992eb>] _spin_lock_irqsave+0x54/0x5d
> [<c012c597>] process_timeout+0x0/0x5
> [<fbd2394e>] svc_recv+0x243/0x3b5 [sunrpc]
> [<c012ce4d>] sigprocmask+0xb9/0xbf
> [<c011f99b>] default_wake_function+0x0/0xc
> [<fbb026e6>] nfsd+0xdd/0x28b [nfsd]
> [<fbb02609>] nfsd+0x0/0x28b [nfsd]
> [<c0104a5f>] kernel_thread_helper+0x7/0x10
> =======================
>nfsd          S c2c739a4     0  3322      2
>       f73d2f40 00000082 00000400 c2c739a4 00000002 f73d2f28 c050eddc c0559e80 
>       c0559e80 f7a77260 f7a773a8 c2cbee80 00000001 00000046 c2dea000 00000296 
>       c2dea000 f7fdc880 00000296 004378cb 000000ff 00000000 00000000 00000400 
>Call Trace:
> [<c039749f>] schedule_timeout+0x70/0x8d
> [<c03992eb>] _spin_lock_irqsave+0x54/0x5d
> [<c012c597>] process_timeout+0x0/0x5
> [<fbd2394e>] svc_recv+0x243/0x3b5 [sunrpc]
> [<c012ce4d>] sigprocmask+0xb9/0xbf
> [<c011f99b>] default_wake_function+0x0/0xc
> [<fbb026e6>] nfsd+0xdd/0x28b [nfsd]
> [<fbb02609>] nfsd+0x0/0x28b [nfsd]
> [<c0104a5f>] kernel_thread_helper+0x7/0x10
> =======================
>nfsd          S f6c17f2c     0  3323      2
>       f6c17f40 00000082 00000002 f6c17f2c f6c17f24 00000000 c050eddc c0559e80 
>       c0559e80 c2ecf0c0 c2ecf208 c2c6de80 00000000 00000046 c059cd00 00000296 
>       c059cd00 f7fdc880 00000296 004378cb 000000ff 00000000 00000000 00000000 
>Call Trace:
> [<c039749f>] schedule_timeout+0x70/0x8d
> [<c03992eb>] _spin_lock_irqsave+0x54/0x5d
> [<c012c597>] process_timeout+0x0/0x5
> [<fbd2394e>] svc_recv+0x243/0x3b5 [sunrpc]
> [<c012ce4d>] sigprocmask+0xb9/0xbf
> [<c011f99b>] default_wake_function+0x0/0xc
> [<fbb026e6>] nfsd+0xdd/0x28b [nfsd]
> [<fbb02609>] nfsd+0x0/0x28b [nfsd]
> [<c0104a5f>] kernel_thread_helper+0x7/0x10
> =======================
>nfsd          S f6c5cf2c     0  3324      2
>       f6c5cf40 00000082 00000002 f6c5cf2c f6c5cf24 00000000 c050eddc c0559e80 
>       c0559e80 c2f49380 c2f494c8 c2cbee80 00000001 00000046 c2dea000 00000296 
>       c2dea000 f7ee2540 00000296 004380d8 000000ff 00000000 00000000 00000000 
>Call Trace:
> [<c039749f>] schedule_timeout+0x70/0x8d
> [<c03992eb>] _spin_lock_irqsave+0x54/0x5d
> [<c012c597>] process_timeout+0x0/0x5
> [<fbd2394e>] svc_recv+0x243/0x3b5 [sunrpc]
> [<c012ce4d>] sigprocmask+0xb9/0xbf
> [<c011f99b>] default_wake_function+0x0/0xc
> [<fbb026e6>] nfsd+0xdd/0x28b [nfsd]
> [<fbb02609>] nfsd+0x0/0x28b [nfsd]
> [<c0104a5f>] kernel_thread_helper+0x7/0x10
> =======================
>nfsd          S f6ca1f2c     0  3325      2
>       f6ca1f40 00000082 00000002 f6ca1f2c f6ca1f24 00000000 c050eddc c0559e80 
>       c0559e80 c2ed7140 c2ed7288 c2cbee80 00000001 00000046 c2dea000 00000296 
>       c2dea000 f7ee2540 00000296 004387db 000000ff 00000000 00000000 00000000 
>Call Trace:
> [<c039749f>] schedule_timeout+0x70/0x8d
> [<c03992eb>] _spin_lock_irqsave+0x54/0x5d
> [<c012c597>] process_timeout+0x0/0x5
> [<fbd2394e>] svc_recv+0x243/0x3b5 [sunrpc]
> [<c012ce4d>] sigprocmask+0xb9/0xbf
> [<c011f99b>] default_wake_function+0x0/0xc
> [<fbb026e6>] nfsd+0xdd/0x28b [nfsd]
> [<fbb02609>] nfsd+0x0/0x28b [nfsd]
> [<c0104a5f>] kernel_thread_helper+0x7/0x10
> =======================
>automount     S f6cf8bec     0  3402      1
>       f6cf8c00 00200086 00000002 f6cf8bec f6cf8be4 00000000 c050eddc c0559e80 
>       c0559e80 f7a7c690 f7a7c7d8 c2cbee80 00000001 00200046 f7a7c690 f7a7c690 
>       c2f84a10 f7ee2a00 f7a7c690 004b3739 000000ff 00000000 00000000 00000000 
>Call Trace:
> [<c0397442>] schedule_timeout+0x13/0x8d
> [<c017452c>] pipe_poll+0x24/0x7f
> [<c017a64f>] do_sys_poll+0x250/0x303
> [<c017af86>] __pollwait+0x0/0xac
> [<c011f99b>] default_wake_function+0x0/0xc
> [<c011f99b>] default_wake_function+0x0/0xc
> [<c013c012>] __lock_acquire+0x3a6/0x609
> [<c013b68a>] lock_release_holdtime+0x25/0x43
> [<c013995a>] clocksource_get_next+0x39/0x3f
> [<c013c012>] __lock_acquire+0x3a6/0x609
> [<c013b68a>] lock_release_holdtime+0x25/0x43
> [<c013995a>] clocksource_get_next+0x39/0x3f
> [<c011df34>] update_curr+0x102/0x12c
> [<c0245bd4>] rb_insert_color+0x8c/0xad
> [<c011e22d>] enqueue_entity+0x1d2/0x1f3
> [<c013c012>] __lock_acquire+0x3a6/0x609
> [<c0151abc>] handle_fasteoi_irq+0x0/0xad
> [<c010655e>] do_IRQ+0x9f/0xb9
> [<c013b68a>] lock_release_holdtime+0x25/0x43
> [<c013c012>] __lock_acquire+0x3a6/0x609
> [<c013c012>] __lock_acquire+0x3a6/0x609
> [<c013c012>] __lock_acquire+0x3a6/0x609
> [<c013c012>] __lock_acquire+0x3a6/0x609
> [<c013b68a>] lock_release_holdtime+0x25/0x43
> [<c01753aa>] pipe_read+0x2ec/0x328
> [<c0128dce>] current_fs_time+0x13/0x15
> [<c0180c41>] touch_atime+0x8b/0xae
> [<c01753da>] pipe_read+0x31c/0x328
> [<c016f4a8>] do_sync_read+0x0/0x10a
> [<c016f56f>] do_sync_read+0xc7/0x10a
> [<c013c012>] __lock_acquire+0x3a6/0x609
> [<c013c012>] __lock_acquire+0x3a6/0x609
> [<c013b68a>] lock_release_holdtime+0x25/0x43
> [<c012ce4d>] sigprocmask+0xb9/0xbf
> [<c0399276>] _spin_unlock_irq+0x1b/0x1e
> [<c012ce4d>] sigprocmask+0xb9/0xbf
> [<c017a736>] sys_poll+0x34/0x37
> [<c0103e3e>] sysenter_past_esp+0x5f/0x85
> =======================
>nscd          S f6d5cf24     0  3571      1
>       f6d5cf38 00000096 00000002 f6d5cf24 f6d5cf1c 00000000 c050eddc c0559e80 
>       c0559e80 f7a7f2e0 f7a7f428 c2c6de80 00000000 00000046 c059cd00 00000292 
>       c059cd00 f761fc20 00000292 004b1b36 000000ff 00000000 00000000 00000000 
>Call Trace:
> [<c039749f>] schedule_timeout+0x70/0x8d
> [<c012c597>] process_timeout+0x0/0x5
> [<c0193f56>] sys_epoll_wait+0x164/0x3e0
> [<c011f99b>] default_wake_function+0x0/0xc
> [<c0103e3e>] sysenter_past_esp+0x5f/0x85
> =======================
>nscd          S f6d70e1c     0  3575      1
>       f6d70e30 00000086 00000002 f6d70e1c f6d70e14 00000000 c050eddc c0559e80 
>       c0559e80 c2ece490 c2ece5d8 c2cbee80 00000001 c2c73e68 00000282 c2c73eb8 
>       f6d70ea0 f761fc20 c03992eb 004b29f8 000000ff 00000000 00000000 00000000 
>Call Trace:
> [<c03992eb>] _spin_lock_irqsave+0x54/0x5d
> [<c013ef66>] futex_wait+0x203/0x2b3
> [<c01373d8>] hrtimer_wakeup+0x0/0x18
> [<c011f99b>] default_wake_function+0x0/0xc
> [<c013f35f>] do_futex+0x6c/0x973
> [<c0138c47>] getnstimeofday+0x30/0xbc
> [<c01378a4>] ktime_get_ts+0x16/0x44
> [<c01378e1>] ktime_get+0xf/0x2e
> [<c013fd4a>] sys_futex+0xe4/0xf6
> [<c0103e3e>] sysenter_past_esp+0x5f/0x85
> =======================
>nscd          S f6d71e1c     0  3576      1
>       f6d71e30 00000086 00000002 f6d71e1c f6d71e14 00000000 c050eddc c0559e80 
>       c0559e80 f7a74610 f7a74758 c2c6de80 00000000 c2c22e68 00000282 c2c22eb8 
>       f6d71ea0 f761fc20 c03992eb 004b37b1 000000ff 00000000 00000000 00000000 
>Call Trace:
> [<c03992eb>] _spin_lock_irqsave+0x54/0x5d
> [<c013ef66>] futex_wait+0x203/0x2b3
> [<c01373d8>] hrtimer_wakeup+0x0/0x18
> [<c011f99b>] default_wake_function+0x0/0xc
> [<c013f35f>] do_futex+0x6c/0x973
> [<c0138c47>] getnstimeofday+0x30/0xbc
> [<c01378a4>] ktime_get_ts+0x16/0x44
> [<c01378e1>] ktime_get+0xf/0x2e
> [<c013fd4a>] sys_futex+0xe4/0xf6
> [<c0103e3e>] sysenter_past_esp+0x5f/0x85
> =======================
>nscd          S f6d73e1c     0  3577      1
>       f6d73e30 00000086 00000002 f6d73e1c f6d73e14 00000000 c050eddc c0559e80 
>       c0559e80 c2f406d0 c2f40818 c2c6de80 00000000 c2c22e68 00000282 c2c22eb8 
>       f6d73ea0 f761fc20 c03992eb 004b29c2 000000ff 00000000 00000000 00000000 
>Call Trace:
> [<c03992eb>] _spin_lock_irqsave+0x54/0x5d
> [<c013ef66>] futex_wait+0x203/0x2b3
> [<c01373d8>] hrtimer_wakeup+0x0/0x18
> [<c011f99b>] default_wake_function+0x0/0xc
> [<c013f35f>] do_futex+0x6c/0x973
> [<c0138c47>] getnstimeofday+0x30/0xbc
> [<c01378a4>] ktime_get_ts+0x16/0x44
> [<c01378e1>] ktime_get+0xf/0x2e
> [<c013fd4a>] sys_futex+0xe4/0xf6
> [<c0103e3e>] sysenter_past_esp+0x5f/0x85
> =======================
>nscd          S 00000046     0  3578      1
>       f6d74e30 00000086 00000000 00000046 f6d74e68 00000000 c050eddc c0559e80 
>       c0559e80 c2f4c030 c2f4c178 c2c6de80 00000000 f6d74e68 c013eefe 00000046 
>       00000282 f761fc20 c03992eb 00000000 00000046 f6d74e58 00000282 00000000 
>Call Trace:
> [<c013eefe>] futex_wait+0x19b/0x2b3
> [<c03992eb>] _spin_lock_irqsave+0x54/0x5d
> [<c013ef13>] futex_wait+0x1b0/0x2b3
> [<c013c012>] __lock_acquire+0x3a6/0x609
> [<c013c012>] __lock_acquire+0x3a6/0x609
> [<c011f99b>] default_wake_function+0x0/0xc
> [<c013f35f>] do_futex+0x6c/0x973
> [<c01805ff>] generic_drop_inode+0xfd/0x12b
> [<c017e8cd>] dput+0x2c/0xff
> [<c013fd4a>] sys_futex+0xe4/0xf6
> [<c016deec>] filp_close+0x51/0x58
> [<c016ef99>] sys_close+0x70/0xa7
> [<c0103e3e>] sysenter_past_esp+0x5f/0x85
> =======================
>nscd          S 00000046     0  3579      1
>       f6d75e30 00000086 00000000 00000046 f6d75e68 00000000 c050eddc c0559e80 
>       c0559e80 c2f005d0 c2f00718 c2c6de80 00000000 f6d75e68 c013eefe 00000046 
>       00000282 f761fc20 c03992eb 00000000 00000046 f6d75e58 00000282 00000000 
>Call Trace:
> [<c013eefe>] futex_wait+0x19b/0x2b3
> [<c03992eb>] _spin_lock_irqsave+0x54/0x5d
> [<c013ef13>] futex_wait+0x1b0/0x2b3
> [<c013c012>] __lock_acquire+0x3a6/0x609
> [<c013c012>] __lock_acquire+0x3a6/0x609
> [<c011f99b>] default_wake_function+0x0/0xc
> [<c013f35f>] do_futex+0x6c/0x973
> [<c01805ff>] generic_drop_inode+0xfd/0x12b
> [<c017e8cd>] dput+0x2c/0xff
> [<c013fd4a>] sys_futex+0xe4/0xf6
> [<c016deec>] filp_close+0x51/0x58
> [<c016ef99>] sys_close+0x70/0xa7
> [<c0103e3e>] sysenter_past_esp+0x5f/0x85
> =======================
>nscd          S 00000046     0  3580      1
>       f6d76e30 00000086 00000000 00000046 f6d76e68 00000000 c050eddc c0559e80 
>       c0559e80 f7a79280 f7a793c8 c2c6de80 00000000 f6d76e68 c013eefe 00000046 
>       00000282 f761fc20 c03992eb 00000000 00000046 f6d76e58 00000282 00000000 
>Call Trace:
> [<c013eefe>] futex_wait+0x19b/0x2b3
> [<c03992eb>] _spin_lock_irqsave+0x54/0x5d
> [<c013ef13>] futex_wait+0x1b0/0x2b3
> [<c013c012>] __lock_acquire+0x3a6/0x609
> [<c013c012>] __lock_acquire+0x3a6/0x609
> [<c011f99b>] default_wake_function+0x0/0xc
> [<c013f35f>] do_futex+0x6c/0x973
> [<c01805ff>] generic_drop_inode+0xfd/0x12b
> [<c017e8cd>] dput+0x2c/0xff
> [<c013fd4a>] sys_futex+0xe4/0xf6
> [<c016deec>] filp_close+0x51/0x58
> [<c016ef99>] sys_close+0x70/0xa7
> [<c0103e3e>] sysenter_past_esp+0x5f/0x85
> =======================
>nscd          S 00000046     0  3581      1
>       f6d78e30 00000086 00000000 00000046 f6d78e68 00000000 c050eddc c0559e80 
>       c0559e80 c2e46250 c2e46398 c2c6de80 00000000 f6d78e68 c013eefe 00000046 
>       00000282 f761fc20 c03992eb 00000000 00000046 f6d78e58 00000282 00000000 
>Call Trace:
> [<c013eefe>] futex_wait+0x19b/0x2b3
> [<c03992eb>] _spin_lock_irqsave+0x54/0x5d
> [<c013ef13>] futex_wait+0x1b0/0x2b3
> [<c013c012>] __lock_acquire+0x3a6/0x609
> [<c013c012>] __lock_acquire+0x3a6/0x609
> [<c011f99b>] default_wake_function+0x0/0xc
> [<c013f35f>] do_futex+0x6c/0x973
> [<c01805ff>] generic_drop_inode+0xfd/0x12b
> [<c017e8cd>] dput+0x2c/0xff
> [<c013fd4a>] sys_futex+0xe4/0xf6
> [<c016deec>] filp_close+0x51/0x58
> [<c016ef99>] sys_close+0x70/0xa7
> [<c0103e3e>] sysenter_past_esp+0x5f/0x85
> =======================
>nscd          S 00000046     0  3582      1
>       f6d79e30 00000086 00000000 00000046 f6d79e68 00000000 c050eddc c0559e80 
>       c0559e80 c2e6c2b0 c2e6c3f8 c2c6de80 00000000 f6d79e68 c013eefe 00000046 
>       00000282 f761fc20 c03992eb 00000000 00000046 f6d79e58 00000282 00000000 
>Call Trace:
> [<c013eefe>] futex_wait+0x19b/0x2b3
> [<c03992eb>] _spin_lock_irqsave+0x54/0x5d
> [<c013ef13>] futex_wait+0x1b0/0x2b3
> [<c013c012>] __lock_acquire+0x3a6/0x609
> [<c013c012>] __lock_acquire+0x3a6/0x609
> [<c011f99b>] default_wake_function+0x0/0xc
> [<c013f35f>] do_futex+0x6c/0x973
> [<c01805ff>] generic_drop_inode+0xfd/0x12b
> [<c017e8cd>] dput+0x2c/0xff
> [<c013fd4a>] sys_futex+0xe4/0xf6
> [<c016deec>] filp_close+0x51/0x58
> [<c016ef99>] sys_close+0x70/0xa7
> [<c0103e3e>] sysenter_past_esp+0x5f/0x85
> =======================
>ntpd          S f6d6db4c     0  3636      1
>       f6d6db60 00200086 00000002 f6d6db4c f6d6db44 00000000 c050eddc c0559e80 
>       c0559e80 f770a0d0 f770a218 c2cbee80 00000001 c0337fe9 00200046 00200296 
>       f6d6df4c f7ee2540 00000000 004b36f3 000000ff 00000000 00000000 00000000 
>Call Trace:
> [<c0337fe9>] datagram_poll+0x17/0xc2
> [<c0397442>] schedule_timeout+0x13/0x8d
> [<c0372d5a>] udp_poll+0x10/0xe7
> [<c017aa7f>] do_select+0x346/0x39a
> [<c017af86>] __pollwait+0x0/0xac
> [<c011f99b>] default_wake_function+0x0/0xc
> [<c011f99b>] default_wake_function+0x0/0xc
> [<c011f99b>] default_wake_function+0x0/0xc
> [<c011f99b>] default_wake_function+0x0/0xc
> [<c011f99b>] default_wake_function+0x0/0xc
> [<c011f99b>] default_wake_function+0x0/0xc
> [<c011f99b>] default_wake_function+0x0/0xc
> [<c013b68a>] lock_release_holdtime+0x25/0x43
> [<c0335a92>] skb_dequeue+0x39/0x3f
> [<c0335a92>] skb_dequeue+0x39/0x3f
> [<c0338118>] skb_recv_datagram+0x84/0x19c
> [<c0374678>] udp_recvmsg+0x57/0x1c4
> [<c0332595>] sock_common_recvmsg+0x3e/0x54
> [<c0330e39>] sock_recvmsg+0xec/0x107
> [<c0134ff9>] autoremove_wake_function+0x0/0x33
> [<c013c012>] __lock_acquire+0x3a6/0x609
> [<c013c012>] __lock_acquire+0x3a6/0x609
> [<c017acaa>] core_sys_select+0x1d7/0x2b2
> [<c010894b>] save_i387+0xcd/0x17b
> [<c013c012>] __lock_acquire+0x3a6/0x609
> [<c010315f>] setup_sigcontext+0x10b/0x18b
> [<c012ec76>] get_signal_to_deliver+0x40e/0x418
> [<c013b68a>] lock_release_holdtime+0x25/0x43
> [<c0103b07>] do_notify_resume+0x597/0x621
> [<c0108607>] convert_fxsr_from_user+0x26/0xe9
> [<c0108a85>] restore_i387+0x8c/0xfe
> [<c0103353>] restore_sigcontext+0x162/0x1b3
> [<c017b0d2>] sys_select+0xa0/0x166
> [<c024855b>] copy_to_user+0x2f/0x44
> [<c0103e3e>] sysenter_past_esp+0x5f/0x85
> =======================
>master        S c059cd10     0  3793      1
>       f71fcf38 00000096 c2ed9160 c059cd10 c013b68a c2ed9160 c050eddc c0559e80 
>       c0559e80 c2ed9160 c2ed92a8 c2c6de80 00000000 00000046 c059cd00 00000292 
>       c059cd00 f7ae8c40 00000292 f71fcf48 c059cd00 c012c77e 00000000 00000292 
>Call Trace:
> [<c013b68a>] lock_release_holdtime+0x25/0x43
> [<c012c77e>] __mod_timer+0x92/0x9c
> [<c039749f>] schedule_timeout+0x70/0x8d
> [<c012c597>] process_timeout+0x0/0x5
> [<c0193f56>] sys_epoll_wait+0x164/0x3e0
> [<c011f99b>] default_wake_function+0x0/0xc
> [<c0103e3e>] sysenter_past_esp+0x5f/0x85
> =======================
>qmgr          S f6caef24     0  3846   3793
>       f6caef38 00200096 00000002 f6caef24 f6caef1c 00000000 c050eddc c0559e80 
>       c0559e80 c2e72310 c2e72458 c2c6de80 00000000 00200046 c059cd00 00200292 
>       c059cd00 f74a7140 00200292 004a5acd 000000ff 00000000 00000000 00000000 
>Call Trace:
> [<c039749f>] schedule_timeout+0x70/0x8d
> [<c012c597>] process_timeout+0x0/0x5
> [<c0193f56>] sys_epoll_wait+0x164/0x3e0
> [<c011f99b>] default_wake_function+0x0/0xc
> [<c0103e3e>] sysenter_past_esp+0x5f/0x85
> =======================
>smartd        S f6e92f30     0  3848      1
>       f6e92f44 00000086 00000002 f6e92f30 f6e92f28 00000000 c050eddc c0559e80 
>       c0559e80 c2e6ef00 c2e6f048 c2c6de80 00000000 c2c22e68 00000292 c2c22eb8 
>       f6e92f64 f7464d00 c2e6ef00 004a57b0 000000ff 00000000 00000000 00000000 
>Call Trace:
> [<c039827a>] do_nanosleep+0x41/0x6c
> [<c0137769>] hrtimer_nanosleep+0x50/0xf1
> [<c01373d8>] hrtimer_wakeup+0x0/0x18
> [<c0137853>] sys_nanosleep+0x49/0x59
> [<c0103e3e>] sysenter_past_esp+0x5f/0x85
> =======================
>snmpd         S f6ec0b4c     0  3906      1
>       f6ec0b60 00200086 00000002 f6ec0b4c f6ec0b44 00000000 c050eddc c0559e80 
>       c0559e80 f6da0d20 f6da0e68 c2c6de80 00000000 00200046 c059cd00 00200292 
>       c059cd00 f7ae8520 00200292 004b3757 000000ff 00000000 00000000 00000000 
>Call Trace:
> [<c039749f>] schedule_timeout+0x70/0x8d
> [<c0372d5a>] udp_poll+0x10/0xe7
> [<c012c597>] process_timeout+0x0/0x5
> [<c017aa7f>] do_select+0x346/0x39a
> [<c017af86>] __pollwait+0x0/0xac
> [<c011f99b>] default_wake_function+0x0/0xc
> [<c011f99b>] default_wake_function+0x0/0xc
> [<c013c012>] __lock_acquire+0x3a6/0x609
> [<c013c012>] __lock_acquire+0x3a6/0x609
> [<c013c012>] __lock_acquire+0x3a6/0x609
> [<c013b68a>] lock_release_holdtime+0x25/0x43
> [<c016c7f0>] cache_alloc_refill+0x1fe/0x4c1
> [<c013c012>] __lock_acquire+0x3a6/0x609
> [<c013c012>] __lock_acquire+0x3a6/0x609
> [<c013c012>] __lock_acquire+0x3a6/0x609
> [<c013b68a>] lock_release_holdtime+0x25/0x43
> [<c013b68a>] lock_release_holdtime+0x25/0x43
> [<c0175aae>] do_lookup+0xbc/0x143
> [<c0175a41>] do_lookup+0x4f/0x143
> [<c017e8cd>] dput+0x2c/0xff
> [<c0177c29>] __link_path_walk+0xa93/0xbaf
> [<c017acaa>] core_sys_select+0x1d7/0x2b2
> [<c013c012>] __lock_acquire+0x3a6/0x609
> [<c013b814>] lockdep_init_map+0x91/0x391
> [<c013c012>] __lock_acquire+0x3a6/0x609
> [<c0247587>] vsnprintf+0x415/0x451
> [<c013c012>] __lock_acquire+0x3a6/0x609
> [<c013b68a>] lock_release_holdtime+0x25/0x43
> [<c01804e5>] generic_delete_inode+0xee/0x10b
> [<c017fec9>] destroy_inode+0x32/0x41
> [<c017b0d2>] sys_select+0xa0/0x166
> [<c024855b>] copy_to_user+0x2f/0x44
> [<c0103e3e>] sysenter_past_esp+0x5f/0x85
> =======================
>sshd          S f6f0bb4c     0  3964      1
>       f6f0bb60 00200086 00000002 f6f0bb4c f6f0bb44 00000000 c050eddc c0559e80 
>       c0559e80 c2e44e60 c2e44fa8 c2c6de80 00000000 c013b68a c2e44e60 f6cfb068 
>       c036078d f7a9d500 00200296 004a1160 000000ff 00000000 00000000 00000000 
>Call Trace:
> [<c013b68a>] lock_release_holdtime+0x25/0x43
> [<c036078d>] tcp_poll+0x1c/0x12a
> [<c0397442>] schedule_timeout+0x13/0x8d
> [<c036078d>] tcp_poll+0x1c/0x12a
> [<c017aa7f>] do_select+0x346/0x39a
> [<c017af86>] __pollwait+0x0/0xac
> [<c011f99b>] default_wake_function+0x0/0xc
> [<c011f99b>] default_wake_function+0x0/0xc
> [<c011f99b>] default_wake_function+0x0/0xc
> [<c013b68a>] lock_release_holdtime+0x25/0x43
> [<c0153c6b>] find_get_page+0x41/0x47
> [<c013c012>] __lock_acquire+0x3a6/0x609
> [<c013c012>] __lock_acquire+0x3a6/0x609
> [<c013b68a>] lock_release_holdtime+0x25/0x43
> [<c013b68a>] lock_release_holdtime+0x25/0x43
> [<c01f779e>] xlog_write+0x4bc/0x4f2
> [<c013c012>] __lock_acquire+0x3a6/0x609
> [<c013c012>] __lock_acquire+0x3a6/0x609
> [<c013b68a>] lock_release_holdtime+0x25/0x43
> [<c016c7f0>] cache_alloc_refill+0x1fe/0x4c1
> [<c0398ded>] _spin_unlock+0x14/0x1c
> [<c016c7f0>] cache_alloc_refill+0x1fe/0x4c1
> [<c013c012>] __lock_acquire+0x3a6/0x609
> [<c013b68a>] lock_release_holdtime+0x25/0x43
> [<c0391b5e>] unix_stream_sendmsg+0x251/0x310
> [<c013c012>] __lock_acquire+0x3a6/0x609
> [<c017acaa>] core_sys_select+0x1d7/0x2b2
> [<c013b68a>] lock_release_holdtime+0x25/0x43
> [<c01804e5>] generic_delete_inode+0xee/0x10b
> [<c013c012>] __lock_acquire+0x3a6/0x609
> [<c013c012>] __lock_acquire+0x3a6/0x609
> [<c0108607>] convert_fxsr_from_user+0x26/0xe9
> [<c0108a85>] restore_i387+0x8c/0xfe
> [<c0103353>] restore_sigcontext+0x162/0x1b3
> [<c017b0d2>] sys_select+0xa0/0x166
> [<c01278f2>] sys_wait4+0x31/0x34
> [<c0103e3e>] sysenter_past_esp+0x5f/0x85
> =======================
>cron          S f6f5cf30     0  4021      1
>       f6f5cf44 00000086 00000002 f6f5cf30 f6f5cf28 00000000 c050eddc c0559e80 
>       c0559e80 f7a7a670 f7a7a7b8 c2cbee80 00000001 c2c73e68 00000292 c2c73eb8 
>       f6f5cf64 f7a9d760 f7a7a670 004b0753 000000ff 00000000 00000000 00000000 
>Call Trace:
> [<c039827a>] do_nanosleep+0x41/0x6c
> [<c0137769>] hrtimer_nanosleep+0x50/0xf1
> [<c01373d8>] hrtimer_wakeup+0x0/0x18
> [<c0137853>] sys_nanosleep+0x49/0x59
> [<c0103e3e>] sysenter_past_esp+0x5f/0x85
> =======================
>agetty        S f6f29eb8     0  4087      1
>       f6f29ecc 00000082 00000002 f6f29eb8 f6f29eb0 00000000 c050eddc c0559e80 
>       c0559e80 f6e5e130 f6e5e278 c2cbee80 00000001 00000000 00000046 f75a19d4 
>       00000001 f7fdcae0 00000046 fffefdba 000000ff 00000000 00000000 00000000 
>Call Trace:
> [<c025f66e>] read_chan+0x0/0x5ae
> [<c0397442>] schedule_timeout+0x13/0x8d
> [<c03992eb>] _spin_lock_irqsave+0x54/0x5d
> [<c025f66e>] read_chan+0x0/0x5ae
> [<c025f9bc>] read_chan+0x34e/0x5ae
> [<c011f99b>] default_wake_function+0x0/0xc
> [<c025cbbb>] tty_read+0x0/0xb0
> [<c025f66e>] read_chan+0x0/0x5ae
> [<c025cc2d>] tty_read+0x72/0xb0
> [<c025cbbb>] tty_read+0x0/0xb0
> [<c016fd74>] vfs_read+0xa6/0x128
> [<c0170158>] sys_read+0x41/0x67
> [<c0103e3e>] sysenter_past_esp+0x5f/0x85
> =======================
>agetty        S c013c012     0  4088      1
>       f6f57ecc 00000082 f6cd2490 c013c012 f6f55e7c c01ebeda c050eddc c0559e80 
>       c0559e80 c2e4aec0 c2e4b008 c2c6de80 00000000 00000000 00000046 f6cd21d4 
>       00000001 f7fd7320 00000046 c2e4aef8 c2e4aec0 f6cd21d4 c013b68a c2e4aec0 
>Call Trace:
> [<c013c012>] __lock_acquire+0x3a6/0x609
> [<c01ebeda>] xfs_iunlock+0x5d/0x79
> [<c013b68a>] lock_release_holdtime+0x25/0x43
> [<c025f66e>] read_chan+0x0/0x5ae
> [<c0397442>] schedule_timeout+0x13/0x8d
> [<c03992eb>] _spin_lock_irqsave+0x54/0x5d
> [<c025f66e>] read_chan+0x0/0x5ae
> [<c025f9bc>] read_chan+0x34e/0x5ae
> [<c011f99b>] default_wake_function+0x0/0xc
> [<c025cbbb>] tty_read+0x0/0xb0
> [<c025f66e>] read_chan+0x0/0x5ae
> [<c025cc2d>] tty_read+0x72/0xb0
> [<c025cbbb>] tty_read+0x0/0xb0
> [<c016fd74>] vfs_read+0xa6/0x128
> [<c0170158>] sys_read+0x41/0x67
> [<c0103e3e>] sysenter_past_esp+0x5f/0x85
> =======================
>agetty        S c2c739a4     0  4089      1
>       f6f7becc 00000082 00000400 c2c739a4 00000002 f6f7beb4 c050eddc c0559e80 
>       c0559e80 c2efc590 c2efc6d8 c2cbee80 00000001 00000000 00000046 f6d371d4 
>       00000001 f7fd77e0 00000046 fffefdba 000000ff 00000000 00000000 00000400 
>Call Trace:
> [<c025f66e>] read_chan+0x0/0x5ae
> [<c0397442>] schedule_timeout+0x13/0x8d
> [<c03992eb>] _spin_lock_irqsave+0x54/0x5d
> [<c025f66e>] read_chan+0x0/0x5ae
> [<c025f9bc>] read_chan+0x34e/0x5ae
> [<c011f99b>] default_wake_function+0x0/0xc
> [<c025cbbb>] tty_read+0x0/0xb0
> [<c025f66e>] read_chan+0x0/0x5ae
> [<c025cc2d>] tty_read+0x72/0xb0
> [<c025cbbb>] tty_read+0x0/0xb0
> [<c016fd74>] vfs_read+0xa6/0x128
> [<c0170158>] sys_read+0x41/0x67
> [<c0103e3e>] sysenter_past_esp+0x5f/0x85
> =======================
>agetty        S c013c012     0  4090      1
>       f6f80ecc 00000082 f6f23c90 c013c012 f6f55e7c c01ebeda c050eddc c0559e80 
>       c0559e80 f770ad00 f770ae48 c2cbee80 00000001 00000000 00000046 f6f239d4 
>       00000001 f74a7600 00000046 f770ad38 f770ad00 f6f239d4 c013b68a f770ad00 
>Call Trace:
> [<c013c012>] __lock_acquire+0x3a6/0x609
> [<c01ebeda>] xfs_iunlock+0x5d/0x79
> [<c013b68a>] lock_release_holdtime+0x25/0x43
> [<c025f66e>] read_chan+0x0/0x5ae
> [<c0397442>] schedule_timeout+0x13/0x8d
> [<c03992eb>] _spin_lock_irqsave+0x54/0x5d
> [<c025f66e>] read_chan+0x0/0x5ae
> [<c025f9bc>] read_chan+0x34e/0x5ae
> [<c011f99b>] default_wake_function+0x0/0xc
> [<c025cbbb>] tty_read+0x0/0xb0
> [<c025f66e>] read_chan+0x0/0x5ae
> [<c025cc2d>] tty_read+0x72/0xb0
> [<c025cbbb>] tty_read+0x0/0xb0
> [<c016fd74>] vfs_read+0xa6/0x128
> [<c0170158>] sys_read+0x41/0x67
> [<c0103e3e>] sysenter_past_esp+0x5f/0x85
> =======================
>agetty        S f6f85eb8     0  4091      1
>       f6f85ecc 00000082 00000002 f6f85eb8 f6f85eb0 00000000 c050eddc c0559e80 
>       c0559e80 f76e80b0 f76e81f8 c2c6de80 00000000 00000000 00000046 f6cd29d4 
>       00000001 f7fdc160 00000046 fffefdba 000000ff 00000000 00000000 00000000 
>Call Trace:
> [<c025f66e>] read_chan+0x0/0x5ae
> [<c0397442>] schedule_timeout+0x13/0x8d
> [<c03992eb>] _spin_lock_irqsave+0x54/0x5d
> [<c025f66e>] read_chan+0x0/0x5ae
> [<c025f9bc>] read_chan+0x34e/0x5ae
> [<c011f99b>] default_wake_function+0x0/0xc
> [<c025cbbb>] tty_read+0x0/0xb0
> [<c025f66e>] read_chan+0x0/0x5ae
> [<c025cc2d>] tty_read+0x72/0xb0
> [<c025cbbb>] tty_read+0x0/0xb0
> [<c016fd74>] vfs_read+0xa6/0x128
> [<c0170158>] sys_read+0x41/0x67
> [<c0103e3e>] sysenter_past_esp+0x5f/0x85
> =======================
>agetty        S c2c229a4     0  4092      1
>       f77a8ecc 00000082 00000600 c2c229a4 00000002 f77a8eb4 c050eddc c0559e80 
>       c0559e80 f6da00f0 f6da0238 c2c6de80 00000000 00000000 00000046 f6f231d4 
>       00000001 f75873e0 00000046 fffefdba 000000ff 00000000 00000000 00000600 
>Call Trace:
> [<c025f66e>] read_chan+0x0/0x5ae
> [<c0397442>] schedule_timeout+0x13/0x8d
> [<c03992eb>] _spin_lock_irqsave+0x54/0x5d
> [<c025f66e>] read_chan+0x0/0x5ae
> [<c025f9bc>] read_chan+0x34e/0x5ae
> [<c011f99b>] default_wake_function+0x0/0xc
> [<c025cbbb>] tty_read+0x0/0xb0
> [<c025f66e>] read_chan+0x0/0x5ae
> [<c025cc2d>] tty_read+0x72/0xb0
> [<c025cbbb>] tty_read+0x0/0xb0
> [<c016fd74>] vfs_read+0xa6/0x128
> [<c0170158>] sys_read+0x41/0x67
> [<c0103e3e>] sysenter_past_esp+0x5f/0x85
> =======================
>md0_raid5     S c2e36f6c     0  4119      2
>       c2e36f80 00000082 00000002 c2e36f6c c2e36f64 00000000 c050eddc c0559e80 
>       c0559e80 c2efb1a0 c2efb2e8 c2cbee80 00000001 00000046 f7247338 00000000 
>       c2efb1a0 f7587180 c2efb1a0 00436b44 000000ff 00000000 00000000 00000000 
>Call Trace:
> [<c0397442>] schedule_timeout+0x13/0x8d
> [<c0315285>] md_thread+0xa4/0xd6
> [<c0134ff9>] autoremove_wake_function+0x0/0x33
> [<c03151e1>] md_thread+0x0/0xd6
> [<c0134f41>] kthread+0x38/0x5f
> [<c0134f09>] kthread+0x0/0x5f
> [<c0104a5f>] kernel_thread_helper+0x7/0x10
> =======================
>xfsbufd       S c2dea010     0  4132      2
>       f65faf8c 00000086 c2e4a290 c2dea010 c013b68a c2e4a290 c050eddc c0559e80 
>       c0559e80 c2e4a290 c2e4a3d8 c2cbee80 00000001 00000046 c2dea000 00000296 
>       c2dea000 f7ee2a00 00000296 f65faf9c c2dea000 c012c77e 00000000 00000296 
>Call Trace:
> [<c013b68a>] lock_release_holdtime+0x25/0x43
> [<c012c77e>] __mod_timer+0x92/0x9c
> [<c039749f>] schedule_timeout+0x70/0x8d
> [<c0211e70>] xfs_buf_delwri_split+0xc5/0xcf
> [<c012c597>] process_timeout+0x0/0x5
> [<c0212018>] xfsbufd+0x58/0xec
> [<c0211fc0>] xfsbufd+0x0/0xec
> [<c0134f41>] kthread+0x38/0x5f
> [<c0134f09>] kthread+0x0/0x5f
> [<c0104a5f>] kernel_thread_helper+0x7/0x10
> =======================
>xfssyncd      S f6798f68     0  4133      2
>       f6798f7c 00000082 00000002 f6798f68 f6798f60 00000000 c050eddc c0559e80 
>       c0559e80 c2e46e80 c2e46fc8 c2cbee80 00000001 00000046 c2dea000 00000292 
>       c2dea000 f7ee2540 00000292 004b23c9 000000ff 00000000 00000000 00000000 
>Call Trace:
> [<c039749f>] schedule_timeout+0x70/0x8d
> [<c012c597>] process_timeout+0x0/0x5
> [<c0216bc4>] xfssyncd+0x4c/0x158
> [<c0216b78>] xfssyncd+0x0/0x158
> [<c0134f41>] kthread+0x38/0x5f
> [<c0134f09>] kthread+0x0/0x5f
> [<c0104a5f>] kernel_thread_helper+0x7/0x10
> =======================
>screen        S c04ab4c4     0  4142      1
>       f6794b60 00000086 c2e6e308 c04ab4c4 00000046 00000000 c050eddc c0559e80 
>       c0559e80 c2e6e2d0 c2e6e418 c2c6de80 00000000 c2e6e2d0 c04ab4ec c013b68a 
>       c2e6e2d0 f7587640 c025b667 00000046 00000046 c04ab4b4 00000096 f6ff86e0 
>Call Trace:
> [<c013b68a>] lock_release_holdtime+0x25/0x43
> [<c025b667>] tty_poll+0x56/0x63
> [<c0397442>] schedule_timeout+0x13/0x8d
> [<c025e802>] normal_poll+0x0/0x123
> [<c025b667>] tty_poll+0x56/0x63
> [<c017aa7f>] do_select+0x346/0x39a
> [<c017af86>] __pollwait+0x0/0xac
> [<c011f99b>] default_wake_function+0x0/0xc
> [<c011f99b>] default_wake_function+0x0/0xc
> [<c011f99b>] default_wake_function+0x0/0xc
> [<c013c012>] __lock_acquire+0x3a6/0x609
> [<c013b68a>] lock_release_holdtime+0x25/0x43
> [<c01f712d>] xlog_state_release_iclog+0x84/0x9c
> [<c0398ded>] _spin_unlock+0x14/0x1c
> [<c01f712d>] xlog_state_release_iclog+0x84/0x9c
> [<c01f798d>] xfs_log_release_iclog+0x11/0x3a
> [<c02039ab>] _xfs_trans_commit+0x27b/0x2e4
> [<c013c012>] __lock_acquire+0x3a6/0x609
> [<c013c012>] __lock_acquire+0x3a6/0x609
> [<c013b68a>] lock_release_holdtime+0x25/0x43
> [<c01ebed3>] xfs_iunlock+0x56/0x79
> [<c013c012>] __lock_acquire+0x3a6/0x609
> [<c01379ca>] up_write+0x14/0x28
> [<c01ebed3>] xfs_iunlock+0x56/0x79
> [<c013c012>] __lock_acquire+0x3a6/0x609
> [<c01ebeda>] xfs_iunlock+0x5d/0x79
> [<c013c012>] __lock_acquire+0x3a6/0x609
> [<c0217853>] __vn_revalidate+0x47/0x51
> [<c017acaa>] core_sys_select+0x1d7/0x2b2
> [<c011f991>] try_to_wake_up+0x235/0x23f
> [<c013b68a>] lock_release_holdtime+0x25/0x43
> [<c012dee6>] group_send_sig_info+0x4e/0x56
> [<c013c012>] __lock_acquire+0x3a6/0x609
> [<c012dee6>] group_send_sig_info+0x4e/0x56
> [<c013b68a>] lock_release_holdtime+0x25/0x43
> [<c012e3ee>] do_sigaction+0x13c/0x14c
> [<c017b0d2>] sys_select+0xa0/0x166
> [<c0103e3e>] sysenter_past_esp+0x5f/0x85
> =======================
>bash          S f6782f14     0  4143   4142
>       f6782f28 00000092 00000002 f6782f14 f6782f0c 00000000 c050eddc c0559e80 
>       c0559e80 f6e5ed60 f6e5eea8 c2c6de80 00000000 f6e5ed60 c04cd210 c01277ec 
>       00000246 f75878a0 f6e5ed60 ffff5db5 000000ff 00000000 00000000 00000000 
>Call Trace:
> [<c01277ec>] do_wait+0x930/0xa05
> [<c0127817>] do_wait+0x95b/0xa05
> [<c011f99b>] default_wake_function+0x0/0xc
> [<c01278f2>] sys_wait4+0x31/0x34
> [<c012791c>] sys_waitpid+0x27/0x2b
> [<c0103e3e>] sysenter_past_esp+0x5f/0x85
> =======================
>rsync         D c2e48270     0  4150   4143
>       f65ffb7c 00000082 00000003 c2e48270 00000046 00000000 c050eddc c0559e80 
>       c0559e80 c2e48270 c2e483b8 c2cbee80 00000001 f028f3f8 c0398c67 00000046 
>       f028f3f8 f7587180 f028f3e8 00000292 00000046 f028f3e8 00000292 00000292 
>Call Trace:
> [<c0398c67>] __down+0xbe/0xd5
> [<c0398c6c>] __down+0xc3/0xd5
> [<c011f99b>] default_wake_function+0x0/0xc
> [<c0398a1f>] __down_failed+0x7/0xc
> [<c021079d>] xfs_buf_lock+0x43/0x45
> [<c0211632>] _xfs_buf_find+0x147/0x1ac
> [<c020e66d>] kmem_zone_alloc+0x49/0x93
> [<c02116f2>] xfs_buf_get_flags+0x5b/0x126
> [<c0211cea>] xfs_buf_read_flags+0x1c/0x7b
> [<c020450b>] xfs_trans_read_buf+0x1ed/0x2fc
> [<c01e7c49>] xfs_ialloc_read_agi+0x8a/0x12a
> [<c01e8ef2>] xfs_ialloc_ag_select+0x1e5/0x273
> [<c01e8fc1>] xfs_dialloc+0x41/0x884
> [<c013b68a>] lock_release_holdtime+0x25/0x43
> [<c016c7f0>] cache_alloc_refill+0x1fe/0x4c1
> [<c013c012>] __lock_acquire+0x3a6/0x609
> [<c013c012>] __lock_acquire+0x3a6/0x609
> [<c013c012>] __lock_acquire+0x3a6/0x609
> [<c013b68a>] lock_release_holdtime+0x25/0x43
> [<c01f0574>] xfs_ialloc+0x5d/0x535
> [<c013c012>] __lock_acquire+0x3a6/0x609
> [<c0205257>] xfs_dir_ialloc+0x7b/0x294
> [<c020b1ed>] xfs_mkdir+0x2ff/0x5fe
> [<c01be1c8>] xfs_acl_get_attr+0x47/0x67
> [<c01be2d3>] xfs_acl_vhasacl_default+0x36/0x47
> [<c0214d09>] xfs_vn_mknod+0x19e/0x2cf
> [<c0214e4c>] xfs_vn_mkdir+0x12/0x14
> [<c01761b8>] vfs_mkdir+0xbd/0x127
> [<c0178636>] sys_mkdirat+0x88/0xbc
> [<c016fcbe>] vfs_write+0x11a/0x12a
> [<c0138c47>] getnstimeofday+0x30/0xbc
> [<c0178689>] sys_mkdir+0x1f/0x23
> [<c0103e3e>] sysenter_past_esp+0x5f/0x85
> =======================
>ssh           S f6778b4c     0  4151   4150
>       f6778b60 00200086 00000002 f6778b4c f6778b44 00000000 c050eddc c0559e80 
>       c0559e80 c2ed3100 c2ed3248 c2c6de80 00000000 c2ed3100 c2ed3100 f6d88848 
>       c013b68a f7ae82c0 f6d88848 00436c2f 000000ff 00000000 00000000 00000000 
>Call Trace:
> [<c013b68a>] lock_release_holdtime+0x25/0x43
> [<c0397442>] schedule_timeout+0x13/0x8d
> [<c038fa5e>] unix_poll+0x1a/0x9b
> [<c017aa7f>] do_select+0x346/0x39a
> [<c017af86>] __pollwait+0x0/0xac
> [<c011f99b>] default_wake_function+0x0/0xc
> [<c011f99b>] default_wake_function+0x0/0xc
> [<c011f99b>] default_wake_function+0x0/0xc
> [<c013b68a>] lock_release_holdtime+0x25/0x43
> [<c033cb5b>] dev_queue_xmit+0x191/0x2ba
> [<c0398ded>] _spin_unlock+0x14/0x1c
> [<c033cc5c>] dev_queue_xmit+0x292/0x2ba
> [<c035c429>] ip_output+0x29d/0x2d8
> [<c035bacd>] ip_queue_xmit+0x358/0x39a
> [<c0398ded>] _spin_unlock+0x14/0x1c
> [<c01217c0>] scheduler_tick+0x199/0x1c5
> [<c015081c>] softlockup_tick+0x7e/0x119
> [<c013c012>] __lock_acquire+0x3a6/0x609
> [<c013c012>] __lock_acquire+0x3a6/0x609
> [<c036e6ff>] tcp_v4_send_check+0x86/0xbc
> [<c013b68a>] lock_release_holdtime+0x25/0x43
> [<c03623ac>] tcp_recvmsg+0x659/0x75f
> [<c0398dcf>] _spin_unlock_bh+0x1b/0x25
> [<c03623ac>] tcp_recvmsg+0x659/0x75f
> [<c013c012>] __lock_acquire+0x3a6/0x609
> [<c017acaa>] core_sys_select+0x1d7/0x2b2
> [<c03305c0>] sock_aio_read+0xf8/0x100
> [<c013b68a>] lock_release_holdtime+0x25/0x43
> [<c016f56f>] do_sync_read+0xc7/0x10a
> [<c013c012>] __lock_acquire+0x3a6/0x609
> [<c013b68a>] lock_release_holdtime+0x25/0x43
> [<c016fdbb>] vfs_read+0xed/0x128
> [<c017b0d2>] sys_select+0xa0/0x166
> [<c0170158>] sys_read+0x41/0x67
> [<c0103e3e>] sysenter_past_esp+0x5f/0x85
> =======================
>rsync         D f6212994     0  4197   4150
>       f62129a8 00000096 00000002 f6212994 f621298c 00000000 c050eddc c0559e80 
>       c0559e80 f7a78650 f7a78798 c2cbee80 00000001 00000086 00000001 f7a78650 
>       00000046 f7a9d2a0 c2f70400 00435a09 000000ff 00000000 00000000 00000000 
>Call Trace:
> [<f999efee>] get_active_stripe+0x1e6/0x432 [raid456]
> [<c013b68a>] lock_release_holdtime+0x25/0x43
> [<c03992eb>] _spin_lock_irqsave+0x54/0x5d
> [<c011f99b>] default_wake_function+0x0/0xc
> [<f99a45f7>] make_request+0x473/0x646 [raid456]
> [<c013c012>] __lock_acquire+0x3a6/0x609
> [<c0134ff9>] autoremove_wake_function+0x0/0x33
> [<c0238593>] generic_make_request+0x3b3/0x3e1
> [<c01cb299>] xfs_bmap_search_extents+0x62/0x110
> [<c013b68a>] lock_release_holdtime+0x25/0x43
> [<c021160c>] _xfs_buf_find+0x121/0x1ac
> [<c023a432>] submit_bio+0xb4/0xbb
> [<f999e146>] raid5_mergeable_bvec+0x0/0xab [raid456]
> [<c018e7f4>] __bio_add_page+0xf5/0x172
> [<c018f0ca>] bio_add_page+0x34/0x3a
> [<c0211bc3>] _xfs_buf_ioapply+0x291/0x2b6
> [<c0211c20>] xfs_buf_iorequest+0x38/0x63
> [<c01f6338>] xlog_bdstrat_cb+0x16/0x3d
> [<c01f6ebc>] xlog_sync+0x28e/0x47b
> [<c01f7685>] xlog_write+0x3a3/0x4f2
> [<c01f7952>] xfs_log_write+0x41/0x6b
> [<c02038b0>] _xfs_trans_commit+0x180/0x2e4
> [<c013c012>] __lock_acquire+0x3a6/0x609
> [<c013c012>] __lock_acquire+0x3a6/0x609
> [<c01dddfb>] xfs_dir_removename+0xb6/0xe5
> [<c013b68a>] lock_release_holdtime+0x25/0x43
> [<c0217807>] vn_hold+0x36/0x3b
> [<c0398ded>] _spin_unlock+0x14/0x1c
> [<c020144b>] xfs_rename+0x7a3/0x904
> [<c02143b1>] xfs_vn_rename+0x30/0x70
> [<c01ebeda>] xfs_iunlock+0x5d/0x79
> [<c015c41d>] kstrdup+0x23/0x63
> [<c01769a4>] vfs_rename+0x294/0x469
> [<c0178247>] sys_renameat+0x15a/0x1b4
> [<c01756c4>] path_release+0xa/0x20
> [<c01782c8>] sys_rename+0x27/0x2b
> [<c0103e3e>] sysenter_past_esp+0x5f/0x85
> =======================
>sshd          S dcabfb4c     0  4782   3964
>       dcabfb60 00000086 00000002 dcabfb4c dcabfb44 00000000 c050eddc c0559e80 
>       c0559e80 c2e3a190 c2e3a2d8 c2c6de80 00000000 c2e3a190 c04ab4ec c013b68a 
>       c2e3a190 f7ee22e0 c025b667 002511af 000000ff 00000000 00000000 00000000 
>Call Trace:
> [<c013b68a>] lock_release_holdtime+0x25/0x43
> [<c025b667>] tty_poll+0x56/0x63
> [<c0397442>] schedule_timeout+0x13/0x8d
> [<c025e802>] normal_poll+0x0/0x123
> [<c025b667>] tty_poll+0x56/0x63
> [<c017aa7f>] do_select+0x346/0x39a
> [<c017af86>] __pollwait+0x0/0xac
> [<c011f99b>] default_wake_function+0x0/0xc
> [<c011f99b>] default_wake_function+0x0/0xc
> [<c011f99b>] default_wake_function+0x0/0xc
> [<c011f99b>] default_wake_function+0x0/0xc
> [<c0398ded>] _spin_unlock+0x14/0x1c
> [<c033cc5c>] dev_queue_xmit+0x292/0x2ba
> [<c035c429>] ip_output+0x29d/0x2d8
> [<c013b68a>] lock_release_holdtime+0x25/0x43
> [<c035bacd>] ip_queue_xmit+0x358/0x39a
> [<c0151abc>] handle_fasteoi_irq+0x0/0xad
> [<c010655e>] do_IRQ+0x9f/0xb9
> [<c010484f>] common_interrupt+0x23/0x28
> [<c0369b54>] tcp_transmit_skb+0x621/0x65b
> [<c013c012>] __lock_acquire+0x3a6/0x609
> [<c013c012>] __lock_acquire+0x3a6/0x609
> [<c013b68a>] lock_release_holdtime+0x25/0x43
> [<c0361b14>] tcp_sendmsg+0x955/0xa23
> [<c0398dcf>] _spin_unlock_bh+0x1b/0x25
> [<c0361b14>] tcp_sendmsg+0x955/0xa23
> [<c013b68a>] lock_release_holdtime+0x25/0x43
> [<c017acaa>] core_sys_select+0x1d7/0x2b2
> [<c03304c0>] sock_aio_write+0xea/0xf2
> [<c013c012>] __lock_acquire+0x3a6/0x609
> [<c016f465>] do_sync_write+0xc7/0x10a
> [<c013c012>] __lock_acquire+0x3a6/0x609
> [<c013b68a>] lock_release_holdtime+0x25/0x43
> [<c013b68a>] lock_release_holdtime+0x25/0x43
> [<c016fc93>] vfs_write+0xef/0x12a
> [<c017b0d2>] sys_select+0xa0/0x166
> [<c01701bf>] sys_write+0x41/0x67
> [<c0103e3e>] sysenter_past_esp+0x5f/0x85
> =======================
>bash          S c013c012     0  4784   4782
>       dcf4eecc 00000082 e0ac2490 c013c012 00000286 00005403 c050eddc c0559e80 
>       c0559e80 e2533080 e25331c8 c2c6de80 00000000 00000000 00000046 e0ac21d4 
>       00000001 f74645e0 00000046 e25330b8 e2533080 e0ac21d4 c013b68a e2533080 
>Call Trace:
> [<c013c012>] __lock_acquire+0x3a6/0x609
> [<c013b68a>] lock_release_holdtime+0x25/0x43
> [<c025f66e>] read_chan+0x0/0x5ae
> [<c0397442>] schedule_timeout+0x13/0x8d
> [<c03992eb>] _spin_lock_irqsave+0x54/0x5d
> [<c025f66e>] read_chan+0x0/0x5ae
> [<c025f9bc>] read_chan+0x34e/0x5ae
> [<c011f99b>] default_wake_function+0x0/0xc
> [<c025cbbb>] tty_read+0x0/0xb0
> [<c025f66e>] read_chan+0x0/0x5ae
> [<c025cc2d>] tty_read+0x72/0xb0
> [<c025cbbb>] tty_read+0x0/0xb0
> [<c016fd74>] vfs_read+0xa6/0x128
> [<c0170158>] sys_read+0x41/0x67
> [<c0103e3e>] sysenter_past_esp+0x5f/0x85
> =======================
>pdflush       S c04a4034     0  5735      2
>       e2a45fb0 00000082 00000292 c04a4034 c059cd00 c012c77e c050eddc c0559e80 
>       c0559e80 c2f48750 c2f48898 c2c6de80 00000000 c2f48750 c04a4084 c0159138 
>       00000046 f7ae82c0 c2f48750 c04a4084 00000046 00000046 c04a4074 c0159086 
>Call Trace:
> [<c012c77e>] __mod_timer+0x92/0x9c
> [<c0159138>] pdflush+0xb2/0x1a9
> [<c0159086>] pdflush+0x0/0x1a9
> [<c0159086>] pdflush+0x0/0x1a9
> [<c015913d>] pdflush+0xb7/0x1a9
> [<c0134f41>] kthread+0x38/0x5f
> [<c0134f09>] kthread+0x0/0x5f
> [<c0104a5f>] kernel_thread_helper+0x7/0x10
> =======================
>pdflush       D ee729ec8     0  5856      2
>       ee729edc 00000082 00000002 ee729ec8 ee729ec0 00000000 c050eddc c0559e80 
>       c0559e80 f399eec0 f399f008 c2cbee80 00000001 f764e0e8 c0210f70 00000046 
>       00000292 f7a9d2a0 c03992eb 00435ab0 000000ff 00000000 00000000 00000000 
>Call Trace:
> [<c0210f70>] xfs_buf_wait_unpin+0x38/0x92
> [<c03992eb>] _spin_lock_irqsave+0x54/0x5d
> [<c0210fae>] xfs_buf_wait_unpin+0x76/0x92
> [<c011f99b>] default_wake_function+0x0/0xc
> [<c0211c0b>] xfs_buf_iorequest+0x23/0x63
> [<c0214fdd>] xfs_bdstrat_cb+0x40/0x44
> [<c020df45>] xfs_bwrite+0x51/0xa8
> [<c0206a47>] xfs_syncsub+0x139/0x263
> [<c020708d>] xfs_sync+0x0/0x1f
> [<c02174c0>] vfs_sync+0x17/0x1a
> [<c02166c8>] xfs_fs_write_super+0x1d/0x23
> [<c01713dd>] sync_supers+0x55/0x94
> [<c0159086>] pdflush+0x0/0x1a9
> [<c0158d87>] wb_kupdate+0x26/0xde
> [<c0159086>] pdflush+0x0/0x1a9
> [<c0159199>] pdflush+0x113/0x1a9
> [<c0158d61>] wb_kupdate+0x0/0xde
> [<c0134f41>] kthread+0x38/0x5f
> [<c0134f09>] kthread+0x0/0x5f
> [<c0104a5f>] kernel_thread_helper+0x7/0x10
> =======================
>sshd          S c04ab4c4     0  5932   3964
>       d9372b60 00000086 f7a75278 c04ab4c4 00000046 00000000 c050eddc c0559e80 
>       c0559e80 f7a75240 f7a75388 c2c6de80 00000000 f7a75240 c04ab4ec c013b68a 
>       f7a75240 f74a7d20 c025b667 00000046 00000046 c04ab4b4 00000096 c2e2e2e0 
>Call Trace:
> [<c013b68a>] lock_release_holdtime+0x25/0x43
> [<c025b667>] tty_poll+0x56/0x63
> [<c0397442>] schedule_timeout+0x13/0x8d
> [<c025e802>] normal_poll+0x0/0x123
> [<c025b667>] tty_poll+0x56/0x63
> [<c017aa7f>] do_select+0x346/0x39a
> [<c017af86>] __pollwait+0x0/0xac
> [<c011f99b>] default_wake_function+0x0/0xc
> [<c011f99b>] default_wake_function+0x0/0xc
> [<c011f99b>] default_wake_function+0x0/0xc
> [<c011f99b>] default_wake_function+0x0/0xc
> [<c0398ded>] _spin_unlock+0x14/0x1c
> [<c033cc5c>] dev_queue_xmit+0x292/0x2ba
> [<c035c429>] ip_output+0x29d/0x2d8
> [<c0398ded>] _spin_unlock+0x14/0x1c
> [<c033cc5c>] dev_queue_xmit+0x292/0x2ba
> [<c035bacd>] ip_queue_xmit+0x358/0x39a
> [<c013c012>] __lock_acquire+0x3a6/0x609
> [<c013b68a>] lock_release_holdtime+0x25/0x43
> [<c012c77e>] __mod_timer+0x92/0x9c
> [<c03992eb>] _spin_lock_irqsave+0x54/0x5d
> [<c012c672>] lock_timer_base+0x19/0x35
> [<c013c012>] __lock_acquire+0x3a6/0x609
> [<c013b68a>] lock_release_holdtime+0x25/0x43
> [<c0361b14>] tcp_sendmsg+0x955/0xa23
> [<c0398dcf>] _spin_unlock_bh+0x1b/0x25
> [<c0361b14>] tcp_sendmsg+0x955/0xa23
> [<c013b68a>] lock_release_holdtime+0x25/0x43
> [<c017acaa>] core_sys_select+0x1d7/0x2b2
> [<c03304c0>] sock_aio_write+0xea/0xf2
> [<c013c012>] __lock_acquire+0x3a6/0x609
> [<c016f465>] do_sync_write+0xc7/0x10a
> [<c013c012>] __lock_acquire+0x3a6/0x609
> [<c013b68a>] lock_release_holdtime+0x25/0x43
> [<c013b68a>] lock_release_holdtime+0x25/0x43
> [<c016fc93>] vfs_write+0xef/0x12a
> [<c017b0d2>] sys_select+0xa0/0x166
> [<c01701bf>] sys_write+0x41/0x67
> [<c0103e3e>] sysenter_past_esp+0x5f/0x85
> =======================
>bash          R running      0  5934   5932
>pickup        S df72bf24     0  6173   3793
>       df72bf38 00200096 00000002 df72bf24 df72bf1c 00000000 c050eddc c0559e80 
>       c0559e80 e2532450 e2532598 c2c6de80 00000000 00200046 c059cd00 00200292 
>       c059cd00 f7fdc620 00200292 004b2dbd 000000ff 00000000 00000000 00000000 
>Call Trace:
> [<c039749f>] schedule_timeout+0x70/0x8d
> [<c012c597>] process_timeout+0x0/0x5
> [<c0193f56>] sys_epoll_wait+0x164/0x3e0
> [<c011f99b>] default_wake_function+0x0/0xc
> [<c0103e3e>] sysenter_past_esp+0x5f/0x85
> =======================
>sshd          S d6038b4c     0  6314   3964
>       d6038b60 00000086 00000002 d6038b4c d6038b44 00000000 c050eddc c0559e80 
>       c0559e80 c2e6cee0 c2e6d028 c2c6de80 00000000 c013b68a c2e6cee0 f6253848 
>       c036078d f7464840 00000296 004b0c3f 000000ff 00000000 00000000 00000000 
>Call Trace:
> [<c013b68a>] lock_release_holdtime+0x25/0x43
> [<c036078d>] tcp_poll+0x1c/0x12a
> [<c0397442>] schedule_timeout+0x13/0x8d
> [<c036078d>] tcp_poll+0x1c/0x12a
> [<c017aa7f>] do_select+0x346/0x39a
> [<c017af86>] __pollwait+0x0/0xac
> [<c011f99b>] default_wake_function+0x0/0xc
> [<c011f99b>] default_wake_function+0x0/0xc
> [<c011f99b>] default_wake_function+0x0/0xc
> [<c011f99b>] default_wake_function+0x0/0xc
> [<c035c437>] ip_output+0x2ab/0x2d8
> [<c03545e8>] ip_route_output_flow+0x68/0x1e3
> [<c0334767>] __sk_dst_check+0x20/0x71
> [<c035bacd>] ip_queue_xmit+0x358/0x39a
> [<c013c012>] __lock_acquire+0x3a6/0x609
> [<c013c012>] __lock_acquire+0x3a6/0x609
> [<c013b68a>] lock_release_holdtime+0x25/0x43
> [<c012c77e>] __mod_timer+0x92/0x9c
> [<c013c012>] __lock_acquire+0x3a6/0x609
> [<c013b68a>] lock_release_holdtime+0x25/0x43
> [<c0361b14>] tcp_sendmsg+0x955/0xa23
> [<c0398dcf>] _spin_unlock_bh+0x1b/0x25
> [<c0361b14>] tcp_sendmsg+0x955/0xa23
> [<c013c012>] __lock_acquire+0x3a6/0x609
> [<c0246c94>] number+0x147/0x219
> [<c017acaa>] core_sys_select+0x1d7/0x2b2
> [<c03304c0>] sock_aio_write+0xea/0xf2
> [<c016f465>] do_sync_write+0xc7/0x10a
> [<c013c012>] __lock_acquire+0x3a6/0x609
> [<c013b68a>] lock_release_holdtime+0x25/0x43
> [<c016fc93>] vfs_write+0xef/0x12a
> [<c017b0d2>] sys_select+0xa0/0x166
> [<c01701bf>] sys_write+0x41/0x67
> [<c0103e3e>] sysenter_past_esp+0x5f/0x85
> =======================
>Sched Debug Version: v0.05-v20, 2.6.23-gentoo-r3 #1
>now at 20062207837314 nsecs
>
>cpu#0, 1600.106 MHz
>  .nr_running                    : 1
>  .load                          : 1024
>  .ls.delta_fair                 : 1676185144
>  .ls.delta_exec                 : 427054025
>  .nr_switches                   : 26694398
>  .nr_load_updates               : 5004504
>  .nr_uninterruptible            : 4294961110
>  .jiffies                       : 4929504
>  .next_balance                  : 4929505
>  .curr->pid                     : 5934
>  .clock                         : 20019271846257
>  .idle_clock                    : 0
>  .prev_clock_raw                : 20051719400352
>  .clock_warps                   : 0
>  .clock_overflows               : 1551749
>  .clock_deep_idle_events        : 0
>  .clock_max_delta               : 4000250
>  .cpu_load[0]                   : 0
>  .cpu_load[1]                   : 0
>  .cpu_load[2]                   : 0
>  .cpu_load[3]                   : 0
>  .cpu_load[4]                   : 0
>
>cfs_rq
>  .fair_clock                    : 4137601944622
>  .exec_clock                    : 6258880945218
>  .wait_runtime                  : 0
>  .wait_runtime_overruns         : 0
>  .wait_runtime_underruns        : 0
>  .sleeper_bonus                 : 39401449
>  .wait_runtime_rq_sum           : 40000000
>
>runnable tasks:
>            task   PID        tree-key         delta       waiting  switches  prio        sum-exec        sum-wait       sum-sleep    wait-overrun   wait-underrun
>------------------------------------------------------------------------------------------------------------------------------------------------------------------
>R           bash  5934   4137561935832     -40008790      40000000       389   120               0               0               0               0               0
>
>cpu#1, 1600.106 MHz
>  .nr_running                    : 1
>  .load                          : 1024
>  .ls.delta_fair                 : 2672329870
>  .ls.delta_exec                 : 1202174193
>  .nr_switches                   : 52012881
>  .nr_load_updates               : 5002565
>  .nr_uninterruptible            : 6189
>  .jiffies                       : 4929505
>  .next_balance                  : 4929505
>  .curr->pid                     : 2686
>  .clock                         : 20011510918444
>  .idle_clock                    : 0
>  .prev_clock_raw                : 20051717048874
>  .clock_warps                   : 0
>  .clock_overflows               : 581618
>  .clock_deep_idle_events        : 0
>  .clock_max_delta               : 4000250
>  .cpu_load[0]                   : 1024
>  .cpu_load[1]                   : 1016
>  .cpu_load[2]                   : 886
>  .cpu_load[3]                   : 666
>  .cpu_load[4]                   : 935
>
>cfs_rq
>  .fair_clock                    : 6204555333336
>  .exec_clock                    : 8619530129679
>  .wait_runtime                  : 0
>  .wait_runtime_overruns         : 0
>  .wait_runtime_underruns        : 0
>  .sleeper_bonus                 : 68108540
>  .wait_runtime_rq_sum           : 40000000
>
>runnable tasks:
>            task   PID        tree-key         delta       waiting  switches  prio        sum-exec        sum-wait       sum-sleep    wait-overrun   wait-underrun
>------------------------------------------------------------------------------------------------------------------------------------------------------------------
>R      syslog-ng  2686   6204515333336     -40000000      40000000       696   120               0               0               0               0               0
>

Actions: View

Attachments on bug 198215: 135286 | 135287 | 135373 | 135375 | 135535 | 137635 | 141735