Excerpt from kernel.log during system slowdown

kernel.log (text/plain), 14.28 KB, created by Neil Walker on 2007-07-11 04:56:15 UTC

Jul 11 04:46:50 zeus hald-addon-stor invoked oom-killer: gfp_mask=0x201d2, order=0, oomkilladj=0
Jul 11 04:46:50 zeus 
Jul 11 04:46:50 zeus Call Trace:
Jul 11 04:46:50 zeus [<ffffffff80261177>] out_of_memory+0x277/0x2f0
Jul 11 04:46:50 zeus [<ffffffff802632a8>] __alloc_pages+0x2d8/0x330
Jul 11 04:46:50 zeus [<ffffffff80264d77>] __do_page_cache_readahead+0x107/0x290
Jul 11 04:46:50 zeus [<ffffffff80511398>] io_schedule+0x28/0x40
Jul 11 04:46:50 zeus [<ffffffff8025dc40>] sync_page+0x0/0x50
Jul 11 04:46:50 zeus [<ffffffff80511665>] __wait_on_bit_lock+0x65/0x80
Jul 11 04:46:50 zeus [<ffffffff8025dc1f>] __lock_page+0x5f/0x70
Jul 11 04:46:50 zeus [<ffffffff80260306>] filemap_nopage+0x236/0x2f0
Jul 11 04:46:50 zeus [<ffffffff8026c444>] __handle_mm_fault+0x1d4/0xb80
Jul 11 04:46:50 zeus [<ffffffff80291c9d>] may_open+0x7d/0x240
Jul 11 04:46:50 zeus [<ffffffff80514cfb>] do_page_fault+0x1fb/0x8e0
Jul 11 04:46:50 zeus [<ffffffff80287151>] __dentry_open+0x1a1/0x220
Jul 11 04:46:50 zeus [<ffffffff8029d1f2>] iput+0x42/0x80
Jul 11 04:46:50 zeus [<ffffffff802b0ee9>] __blkdev_put+0x129/0x1a0
Jul 11 04:46:50 zeus [<ffffffff8029b9d5>] dput+0xa5/0x140
Jul 11 04:46:50 zeus [<ffffffff805130bd>] error_exit+0x0/0x84
Jul 11 04:46:50 zeus 
Jul 11 04:46:50 zeus Mem-info:
Jul 11 04:46:50 zeus Node 0 DMA per-cpu:
Jul 11 04:46:50 zeus CPU    0: Hot: hi:    0, btch:   1 usd:   0   Cold: hi:    0, btch:   1 usd:   0
Jul 11 04:46:50 zeus CPU    1: Hot: hi:    0, btch:   1 usd:   0   Cold: hi:    0, btch:   1 usd:   0
Jul 11 04:46:50 zeus Node 0 DMA32 per-cpu:
Jul 11 04:46:50 zeus CPU    0: Hot: hi:  186, btch:  31 usd:  10   Cold: hi:   62, btch:  15 usd:  47
Jul 11 04:46:50 zeus CPU    1: Hot: hi:  186, btch:  31 usd:  11   Cold: hi:   62, btch:  15 usd:  14
Jul 11 04:46:50 zeus Active:247937 inactive:247410 dirty:0 writeback:0 unstable:0
Jul 11 04:46:50 zeus free:3435 slab:4071 mapped:1668 pagetables:3436 bounce:0
Jul 11 04:46:50 zeus Node 0 DMA free:8028kB min:24kB low:28kB high:36kB active:952kB inactive:1344kB present:9824kB pages_scanned:3974 all_unreclaimable? yes
Jul 11 04:46:50 zeus lowmem_reserve[]: 0 2004 2004
Jul 11 04:46:50 zeus Node 0 DMA32 free:5712kB min:5712kB low:7140kB high:8568kB active:990796kB inactive:988408kB present:2052260kB pages_scanned:3193145 all_unreclaimable? yes
Jul 11 04:46:50 zeus lowmem_reserve[]: 0 0 0
Jul 11 04:46:50 zeus Node 0 DMA: 1*4kB 1*8kB 1*16kB 0*32kB 1*64kB 0*128kB 1*256kB 1*512kB 1*1024kB 1*2048kB 1*4096kB = 8028kB
Jul 11 04:46:50 zeus Node 0 DMA32: 24*4kB 7*8kB 2*16kB 0*32kB 0*64kB 1*128kB 1*256kB 0*512kB 1*1024kB 0*2048kB 1*4096kB = 5688kB
Jul 11 04:46:50 zeus Swap cache: add 553570, delete 553570, find 12637/17352, race 0+1
Jul 11 04:46:50 zeus Free swap  = 0kB
Jul 11 04:46:50 zeus Total swap = 2000084kB
Jul 11 04:46:50 zeus Free swap:            0kB
Jul 11 04:46:50 zeus 524272 pages of RAM
Jul 11 04:46:50 zeus 10405 reserved pages
Jul 11 04:46:50 zeus 2511 pages shared
Jul 11 04:46:50 zeus 0 pages swap cached
Jul 11 04:46:50 zeus Out of memory: kill process 11141 (gnash) score 492857 or a child
Jul 11 04:46:50 zeus Killed process 11141 (gnash)
Jul 11 04:46:50 zeus syslog-ng invoked oom-killer: gfp_mask=0x201d2, order=0, oomkilladj=0
Jul 11 04:46:50 zeus 
Jul 11 04:46:50 zeus Call Trace:
Jul 11 04:46:50 zeus [<ffffffff80261177>] out_of_memory+0x277/0x2f0
Jul 11 04:46:50 zeus [<ffffffff802632a8>] __alloc_pages+0x2d8/0x330
Jul 11 04:46:50 zeus [<ffffffff80264d77>] __do_page_cache_readahead+0x107/0x290
Jul 11 04:46:50 zeus [<ffffffff8022e390>] default_wake_function+0x0/0x10
Jul 11 04:46:50 zeus [<ffffffff8022e390>] default_wake_function+0x0/0x10
Jul 11 04:46:50 zeus [<ffffffff8022e390>] default_wake_function+0x0/0x10
Jul 11 04:46:50 zeus [<ffffffff8022e390>] default_wake_function+0x0/0x10
Jul 11 04:46:50 zeus [<ffffffff80260306>] filemap_nopage+0x236/0x2f0
Jul 11 04:46:50 zeus [<ffffffff8026c444>] __handle_mm_fault+0x1d4/0xb80
Jul 11 04:46:50 zeus [<ffffffff80234bfe>] release_console_sem+0x20e/0x230
Jul 11 04:46:50 zeus [<ffffffff80514cfb>] do_page_fault+0x1fb/0x8e0
Jul 11 04:46:50 zeus [<ffffffff80381505>] tty_write+0x1f5/0x240
Jul 11 04:46:50 zeus [<ffffffff805130bd>] error_exit+0x0/0x84
Jul 11 04:46:50 zeus 
Jul 11 04:46:50 zeus Mem-info:
Jul 11 04:46:50 zeus Node 0 DMA per-cpu:
Jul 11 04:46:50 zeus CPU    0: Hot: hi:    0, btch:   1 usd:   0   Cold: hi:    0, btch:   1 usd:   0
Jul 11 04:46:50 zeus CPU    1: Hot: hi:    0, btch:   1 usd:   0   Cold: hi:    0, btch:   1 usd:   0
Jul 11 04:46:50 zeus Node 0 DMA32 per-cpu:
Jul 11 04:46:50 zeus CPU    0: Hot: hi:  186, btch:  31 usd:  10   Cold: hi:   62, btch:  15 usd:  47
Jul 11 04:46:50 zeus CPU    1: Hot: hi:  186, btch:  31 usd:  11   Cold: hi:   62, btch:  15 usd:  14
Jul 11 04:46:50 zeus Active:247941 inactive:247409 dirty:0 writeback:0 unstable:0
Jul 11 04:46:50 zeus free:3435 slab:4071 mapped:1668 pagetables:3436 bounce:0
Jul 11 04:46:50 zeus Node 0 DMA free:8028kB min:24kB low:28kB high:36kB active:952kB inactive:1344kB present:9824kB pages_scanned:3974 all_unreclaimable? yes
Jul 11 04:46:50 zeus lowmem_reserve[]: 0 2004 2004
Jul 11 04:46:50 zeus Node 0 DMA32 free:5712kB min:5712kB low:7140kB high:8568kB active:990812kB inactive:988292kB present:2052260kB pages_scanned:3235030 all_unreclaimable? yes
Jul 11 04:46:50 zeus lowmem_reserve[]: 0 0 0
Jul 11 04:46:50 zeus Node 0 DMA: 1*4kB 1*8kB 1*16kB 0*32kB 1*64kB 0*128kB 1*256kB 1*512kB 1*1024kB 1*2048kB 1*4096kB = 8028kB
Jul 11 04:46:50 zeus Node 0 DMA32: 24*4kB 7*8kB 2*16kB 0*32kB 0*64kB 1*128kB 1*256kB 0*512kB 1*1024kB 0*2048kB 1*4096kB = 5688kB
Jul 11 04:46:50 zeus Swap cache: add 553570, delete 553570, find 12637/17352, race 0+1
Jul 11 04:46:50 zeus Free swap  = 0kB
Jul 11 04:46:50 zeus Total swap = 2000084kB
Jul 11 04:46:50 zeus Free swap:            0kB
Jul 11 04:46:50 zeus 524272 pages of RAM
Jul 11 04:46:50 zeus 10405 reserved pages
Jul 11 04:46:50 zeus 2511 pages shared
Jul 11 04:46:50 zeus 0 pages swap cached
Jul 11 04:46:50 zeus hald-addon-stor invoked oom-killer: gfp_mask=0x201d2, order=0, oomkilladj=0
Jul 11 04:46:50 zeus 
Jul 11 04:46:50 zeus Call Trace:
Jul 11 04:46:50 zeus [<ffffffff80261177>] out_of_memory+0x277/0x2f0
Jul 11 04:46:50 zeus [<ffffffff802632a8>] __alloc_pages+0x2d8/0x330
Jul 11 04:46:50 zeus [<ffffffff80264d77>] __do_page_cache_readahead+0x107/0x290
Jul 11 04:46:50 zeus [<ffffffff80511398>] io_schedule+0x28/0x40
Jul 11 04:46:50 zeus [<ffffffff8025dc40>] sync_page+0x0/0x50
Jul 11 04:46:50 zeus [<ffffffff80511665>] __wait_on_bit_lock+0x65/0x80
Jul 11 04:46:50 zeus [<ffffffff8025dc1f>] __lock_page+0x5f/0x70
Jul 11 04:46:50 zeus [<ffffffff80260306>] filemap_nopage+0x236/0x2f0
Jul 11 04:46:50 zeus [<ffffffff8026c444>] __handle_mm_fault+0x1d4/0xb80
Jul 11 04:46:50 zeus [<ffffffff80291c9d>] may_open+0x7d/0x240
Jul 11 04:46:50 zeus [<ffffffff80514cfb>] do_page_fault+0x1fb/0x8e0
Jul 11 04:46:50 zeus [<ffffffff80287151>] __dentry_open+0x1a1/0x220
Jul 11 04:46:50 zeus [<ffffffff8029d1f2>] iput+0x42/0x80
Jul 11 04:46:50 zeus [<ffffffff802b0ee9>] __blkdev_put+0x129/0x1a0
Jul 11 04:46:50 zeus [<ffffffff8029b9d5>] dput+0xa5/0x140
Jul 11 04:46:50 zeus [<ffffffff805130bd>] error_exit+0x0/0x84
Jul 11 04:46:50 zeus 
Jul 11 04:46:50 zeus Mem-info:
Jul 11 04:46:50 zeus Node 0 DMA per-cpu:
Jul 11 04:46:50 zeus CPU    0: Hot: hi:    0, btch:   1 usd:   0   Cold: hi:    0, btch:   1 usd:   0
Jul 11 04:46:50 zeus CPU    1: Hot: hi:    0, btch:   1 usd:   0   Cold: hi:    0, btch:   1 usd:   0
Jul 11 04:46:50 zeus Node 0 DMA32 per-cpu:
Jul 11 04:46:50 zeus CPU    0: Hot: hi:  186, btch:  31 usd:  10   Cold: hi:   62, btch:  15 usd:  47
Jul 11 04:46:50 zeus CPU    1: Hot: hi:  186, btch:  31 usd:  11   Cold: hi:   62, btch:  15 usd:  14
Jul 11 04:46:50 zeus Active:247949 inactive:247381 dirty:0 writeback:0 unstable:0
Jul 11 04:46:50 zeus free:3435 slab:4071 mapped:1668 pagetables:3436 bounce:0
Jul 11 04:46:50 zeus Node 0 DMA free:8028kB min:24kB low:28kB high:36kB active:952kB inactive:1344kB present:9824kB pages_scanned:3974 all_unreclaimable? yes
Jul 11 04:46:50 zeus lowmem_reserve[]: 0 2004 2004
Jul 11 04:46:50 zeus Node 0 DMA32 free:5712kB min:5712kB low:7140kB high:8568kB active:990844kB inactive:988180kB present:2052260kB pages_scanned:3338323 all_unreclaimable? yes
Jul 11 04:46:50 zeus lowmem_reserve[]: 0 0 0
Jul 11 04:46:50 zeus Node 0 DMA: 1*4kB 1*8kB 1*16kB 0*32kB 1*64kB 0*128kB 1*256kB 1*512kB 1*1024kB 1*2048kB 1*4096kB = 8028kB
Jul 11 04:46:50 zeus Node 0 DMA32: 24*4kB 7*8kB 2*16kB 0*32kB 0*64kB 1*128kB 1*256kB 0*512kB 1*1024kB 0*2048kB 1*4096kB = 5688kB
Jul 11 04:46:50 zeus Swap cache: add 553570, delete 553570, find 12637/17352, race 0+1
Jul 11 04:46:50 zeus Free swap  = 0kB
Jul 11 04:46:50 zeus Total swap = 2000084kB
Jul 11 04:46:50 zeus Free swap:            0kB
Jul 11 04:46:50 zeus 524272 pages of RAM
Jul 11 04:46:50 zeus 10405 reserved pages
Jul 11 04:46:50 zeus 2497 pages shared
Jul 11 04:46:50 zeus 0 pages swap cached
Jul 11 04:46:50 zeus kdesktop invoked oom-killer: gfp_mask=0x201d2, order=0, oomkilladj=0
Jul 11 04:46:50 zeus 
Jul 11 04:46:50 zeus Call Trace:
Jul 11 04:46:50 zeus [<ffffffff80261177>] out_of_memory+0x277/0x2f0
Jul 11 04:46:50 zeus [<ffffffff802632a8>] __alloc_pages+0x2d8/0x330
Jul 11 04:46:50 zeus [<ffffffff80264d77>] __do_page_cache_readahead+0x107/0x290
Jul 11 04:46:50 zeus [<ffffffff80511398>] io_schedule+0x28/0x40
Jul 11 04:46:50 zeus [<ffffffff8025dc40>] sync_page+0x0/0x50
Jul 11 04:46:50 zeus [<ffffffff80511665>] __wait_on_bit_lock+0x65/0x80
Jul 11 04:46:50 zeus [<ffffffff8025dc1f>] __lock_page+0x5f/0x70
Jul 11 04:46:50 zeus [<ffffffff80260306>] filemap_nopage+0x236/0x2f0
Jul 11 04:46:50 zeus [<ffffffff8026c444>] __handle_mm_fault+0x1d4/0xb80
Jul 11 04:46:50 zeus [<ffffffff80514cfb>] do_page_fault+0x1fb/0x8e0
Jul 11 04:46:50 zeus [<ffffffff80289149>] do_readv_writev+0x169/0x210
Jul 11 04:46:50 zeus [<ffffffff804f190b>] unix_ioctl+0xcb/0x100
Jul 11 04:46:50 zeus [<ffffffff80497674>] sock_ioctl+0x54/0x230
Jul 11 04:46:50 zeus [<ffffffff805130bd>] error_exit+0x0/0x84
Jul 11 04:46:50 zeus 
Jul 11 04:46:50 zeus Mem-info:
Jul 11 04:46:50 zeus Node 0 DMA per-cpu:
Jul 11 04:46:50 zeus CPU    0: Hot: hi:    0, btch:   1 usd:   0   Cold: hi:    0, btch:   1 usd:   0
Jul 11 04:46:50 zeus CPU    1: Hot: hi:    0, btch:   1 usd:   0   Cold: hi:    0, btch:   1 usd:   0
Jul 11 04:46:50 zeus Node 0 DMA32 per-cpu:
Jul 11 04:46:50 zeus CPU    0: Hot: hi:  186, btch:  31 usd:  10   Cold: hi:   62, btch:  15 usd:  47
Jul 11 04:46:50 zeus CPU    1: Hot: hi:  186, btch:  31 usd:  11   Cold: hi:   62, btch:  15 usd:  14
Jul 11 04:46:50 zeus Active:247954 inactive:247376 dirty:0 writeback:0 unstable:0
Jul 11 04:46:50 zeus free:3435 slab:4071 mapped:1668 pagetables:3436 bounce:0
Jul 11 04:46:50 zeus Node 0 DMA free:8028kB min:24kB low:28kB high:36kB active:952kB inactive:1344kB present:9824kB pages_scanned:3974 all_unreclaimable? yes
Jul 11 04:46:50 zeus lowmem_reserve[]: 0 2004 2004
Jul 11 04:46:50 zeus Node 0 DMA32 free:5712kB min:5712kB low:7140kB high:8568kB active:990864kB inactive:988160kB present:2052260kB pages_scanned:3378544 all_unreclaimable? yes
Jul 11 04:46:50 zeus lowmem_reserve[]: 0 0 0
Jul 11 04:46:50 zeus Node 0 DMA: 1*4kB 1*8kB 1*16kB 0*32kB 1*64kB 0*128kB 1*256kB 1*512kB 1*1024kB 1*2048kB 1*4096kB = 8028kB
Jul 11 04:46:50 zeus Node 0 DMA32: 24*4kB 7*8kB 2*16kB 0*32kB 0*64kB 1*128kB 1*256kB 0*512kB 1*1024kB 0*2048kB 1*4096kB = 5688kB
Jul 11 04:46:50 zeus Swap cache: add 553570, delete 553570, find 12637/17352, race 0+1
Jul 11 04:46:50 zeus Free swap  = 0kB
Jul 11 04:46:50 zeus Total swap = 2000084kB
Jul 11 04:46:50 zeus Free swap:            0kB
Jul 11 04:46:50 zeus 524272 pages of RAM
Jul 11 04:46:50 zeus 10405 reserved pages
Jul 11 04:46:50 zeus 2510 pages shared
Jul 11 04:46:50 zeus 0 pages swap cached
Jul 11 04:46:50 zeus syslog-ng invoked oom-killer: gfp_mask=0x201d2, order=0, oomkilladj=0
Jul 11 04:46:50 zeus 
Jul 11 04:46:50 zeus Call Trace:
Jul 11 04:46:50 zeus [<ffffffff80261177>] out_of_memory+0x277/0x2f0
Jul 11 04:46:50 zeus [<ffffffff802632a8>] __alloc_pages+0x2d8/0x330
Jul 11 04:46:50 zeus [<ffffffff80264d77>] __do_page_cache_readahead+0x107/0x290
Jul 11 04:46:50 zeus [<ffffffff8022e390>] default_wake_function+0x0/0x10
Jul 11 04:46:50 zeus [<ffffffff8022e390>] default_wake_function+0x0/0x10
Jul 11 04:46:50 zeus [<ffffffff8022e390>] default_wake_function+0x0/0x10
Jul 11 04:46:50 zeus [<ffffffff8022e390>] default_wake_function+0x0/0x10
Jul 11 04:46:50 zeus [<ffffffff80260306>] filemap_nopage+0x236/0x2f0
Jul 11 04:46:50 zeus [<ffffffff8026c444>] __handle_mm_fault+0x1d4/0xb80
Jul 11 04:46:50 zeus [<ffffffff80234bfe>] release_console_sem+0x20e/0x230
Jul 11 04:46:50 zeus [<ffffffff80514cfb>] do_page_fault+0x1fb/0x8e0
Jul 11 04:46:50 zeus [<ffffffff80381505>] tty_write+0x1f5/0x240
Jul 11 04:46:50 zeus [<ffffffff805130bd>] error_exit+0x0/0x84
Jul 11 04:46:50 zeus 
Jul 11 04:46:50 zeus Mem-info:
Jul 11 04:46:50 zeus Node 0 DMA per-cpu:
Jul 11 04:46:50 zeus CPU    0: Hot: hi:    0, btch:   1 usd:   0   Cold: hi:    0, btch:   1 usd:   0
Jul 11 04:46:50 zeus CPU    1: Hot: hi:    0, btch:   1 usd:   0   Cold: hi:    0, btch:   1 usd:   0
Jul 11 04:46:50 zeus Node 0 DMA32 per-cpu:
Jul 11 04:46:50 zeus CPU    0: Hot: hi:  186, btch:  31 usd:  10   Cold: hi:   62, btch:  15 usd:  47
Jul 11 04:46:50 zeus CPU    1: Hot: hi:  186, btch:  31 usd:  11   Cold: hi:   62, btch:  15 usd:  14
Jul 11 04:46:50 zeus Active:247965 inactive:247365 dirty:0 writeback:0 unstable:0
Jul 11 04:46:50 zeus free:3435 slab:4071 mapped:1668 pagetables:3436 bounce:0
Jul 11 04:46:50 zeus Node 0 DMA free:8028kB min:24kB low:28kB high:36kB active:952kB inactive:1344kB present:9824kB pages_scanned:3974 all_unreclaimable? yes
Jul 11 04:46:50 zeus lowmem_reserve[]: 0 2004 2004
Jul 11 04:46:50 zeus Node 0 DMA32 free:5712kB min:5712kB low:7140kB high:8568kB active:991032kB inactive:988116kB present:2052260kB pages_scanned:3417767 all_unreclaimable? yes
Jul 11 04:46:50 zeus lowmem_reserve[]: 0 0 0
Jul 11 04:46:50 zeus Node 0 DMA: 1*4kB 1*8kB 1*16kB 0*32kB 1*64kB 0*128kB 1*256kB 1*512kB 1*1024kB 1*2048kB 1*4096kB = 8028kB
Jul 11 04:46:50 zeus Node 0 DMA32: 24*4kB 7*8kB 2*16kB 0*32kB 0*64kB 1*128kB 1*256kB 0*512kB 1*1024kB 0*2048kB 1*4096kB = 5688kB
Jul 11 04:46:50 zeus Swap cache: add 553570, delete 553570, find 12637/17352, race 0+1
Jul 11 04:46:50 zeus Free swap  = 0kB
Jul 11 04:46:50 zeus Total swap = 2000084kB
Jul 11 04:46:50 zeus Free swap:            0kB
Jul 11 04:46:50 zeus 524272 pages of RAM
Jul 11 04:46:50 zeus 10405 reserved pages
Jul 11 04:46:50 zeus 2490 pages shared
Jul 11 04:46:50 zeus 0 pages swap cached