| Summary: | =sys-kernel/gentoo-sources-[3.7.10,3.10.6] in a xen domU crashes - xen_hypercall_sched_op+0xa/0x20 | ||
|---|---|---|---|
| Product: | Gentoo Linux | Reporter: | Konstantin Agouros <elwood> |
| Component: | [OLD] Core system | Assignee: | Gentoo Kernel Bug Wranglers and Kernel Maintainers <kernel> |
| Status: | RESOLVED DUPLICATE | ||
| Severity: | normal | CC: | bgo, kripton |
| Priority: | Normal | ||
| Version: | unspecified | ||
| Hardware: | AMD64 | ||
| OS: | Linux | ||
| Whiteboard: | linux-3.7-regression | ||
| Package list: | Runtime testing required: | --- | |
| Attachments: |
Crash-Dump on the console
Kernel .config |
||
Created attachment 345746 [details]
Kernel .config
This is the config for this kernel
Could you check with a newer version if this is still present? Xen has seen a lot of commits. If it then still happens I'll take a look at it or if it's too low level we'll have to report this upstream. [48238.328594] <EOI> [48238.328594] [<ffffffff810013aa>] ? xen_hypercall_sched_op+0xa/0x20 The EOI indicates that the last instruction before the IRQ callback happens there. Searching for "xen_hypercall_sched_op kernel BUG" on Google I see some reports that are also in the 3.7 branch at the exact same place in "xen_hypercall_sched_op+0xa/0x20". This is a very rudimentary check, because we aren't sure yet whether xen is scheduling an operation wrong or whether the peration itself does something wrong. So, since there is an absence of other branches mentioned, I think it may have been fixed in more recent kernel versions. (In reply to Tom Wijsman (TomWij) from comment #2) > Could you check with a newer version if this is still present? 3.8.13 crashed two times on me so it seems yes it is. Shall I try 3.10? (In reply to Konstantin Agouros from comment #4) > 3.8.13 crashed two times on me so it seems yes it is. > Shall I try 3.10? Yes, please do. :) First boot of 3.10: [ 35.626753] ------------[ cut here ]------------ [ 35.626767] kernel BUG at net/core/skbuff.c:1069! [ 35.626773] invalid opcode: 0000 [#1] SMP [ 35.626782] Modules linked in: nfnetlink_log nfnetlink nfsd auth_rpcgss exportfs nfs_acl tun af_packet xt_TCPMSS xt_mark xt_connmark iptable_mangle xt_limit xt_policy ipt_REJECT iptable_filter ipt_MASQUERADE xt_nat iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_raw ip_tables xt_LOG ip6t_REJECT xt_tcpudp nf_conntrack_ipv6 nf_defrag_ipv6 xt_conntrack ip6table_filter ip6_tables x_tables nf_conntrack_tftp nf_conntrack_ftp nf_conntrack_sip nf_conntrack ipv6 dm_zero dm_round_robin dm_multipath dm_flakey dm_bufio xts gf128mul aes_x86_64 cbc sha256_generic scsi_transport_iscsi fuse nfs fscache lockd sunrpc reiserfs btrfs libcrc32c zlib_deflate ext2 multipath linear raid0 dm_raid raid10 raid1 raid456 md_mod async_pq async_xor xor async_memcpy async_raid6_recov raid6_pq async_tx dm_snapshot dm_crypt dm_mirror dm_region_hash dm_log dm_mod [ 35.626998] CPU: 0 PID: 7488 Comm: ntop Not tainted 3.10.5-gentoo-r1domU #1 [ 35.627004] task: ffff880038ca43c0 ti: ffff88003a866000 task.ti: ffff88003a866000 [ 35.627011] RIP: e030:[<ffffffff812e298b>] [<ffffffff812e298b>] pskb_expand_head+0x30/0x21e [ 35.627023] RSP: e02b:ffff88003f8036b8 EFLAGS: 00010202 [ 35.627029] RAX: 0000000000000002 RBX: ffff88003d41e9c0 RCX: 0000000000000020 [ 35.627037] RDX: 00000000000003d4 RSI: 0000000000000000 RDI: 00000000000002c0 [ 35.627043] RBP: ffff88003f803708 R08: 0000000000000000 R09: ffff8800395a7800 [ 35.627049] R10: 000000000000ffff R11: 00000000ffff0000 R12: 0000000000000000 [ 35.627054] R13: 0000000000000020 R14: ffff88003d6f1800 R15: ffff8800394e0000 [ 35.627063] FS: 00007f6ce0867700(0000) GS:ffff88003f800000(0000) knlGS:0000000000000000 [ 35.627069] CS: e033 DS: 0000 ES: 0000 CR0: 000000008005003b [ 35.627074] CR2: 00007f6ce53e3810 CR3: 000000003a298000 CR4: 0000000000000660 [ 35.627080] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 35.627086] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 [ 35.627091] Stack: [ 35.627095] 0000000000000014 ffffffff81725f00 ffff88003f8036f8 ffffffff8103e37e [ 35.627109] ffff88003f8036f8 ffff88003d41e9c0 00000000000004d4 ffff8800394e0000 [ 35.627123] ffff88003d6f1800 ffff8800394e0000 ffff88003f803758 ffffffff812e2c0b [ 35.627137] Call Trace: [ 35.627148] <IRQ> [ 35.627159] [<ffffffff8103e37e>] ? lock_timer_base.isra.28+0x26/0x4b [ 35.627175] [<ffffffff812e2c0b>] __pskb_pull_tail+0x59/0x28d [ 35.627186] [<ffffffff812ee383>] dev_hard_start_xmit+0x26d/0x3d8 [ 35.627195] [<ffffffff810083b4>] ? xen_spin_lock+0xc3/0xd6 [ 35.627205] [<ffffffff813047ce>] sch_direct_xmit+0x72/0x1a1 [ 35.627213] [<ffffffff812ee70b>] dev_queue_xmit+0x21d/0x41e [ 35.627230] [<ffffffffa02c4b63>] ip6_finish_output2+0x334/0x3e3 [ipv6] [ 35.627243] [<ffffffffa02c64ae>] ? ip6_fragment+0x93a/0x93a [ipv6] [ 35.627256] [<ffffffffa02c6543>] ip6_finish_output+0x95/0x9a [ipv6] [ 35.627269] [<ffffffffa02c65b3>] ip6_output+0x6b/0x9c [ipv6] [ 35.627281] [<ffffffffa02c5ae5>] ip6_forward+0x60b/0x69a [ipv6] [ 35.627281] [<ffffffffa02c5ae5>] ip6_forward+0x60b/0x69a [ipv6] [ 35.627295] [<ffffffffa02d0425>] ? ip6_route_input+0x92/0xb1 [ipv6] [ 35.627310] [<ffffffffa02c698d>] ? ip6_input_finish+0x3a9/0x3a9 [ipv6] [ 35.627323] [<ffffffffa02c69f2>] ip6_rcv_finish+0x65/0x69 [ipv6] [ 35.627333] [<ffffffffa0339736>] __ipv6_conntrack_in+0xee/0x141 [nf_conntrack_ipv6] [ 35.627343] [<ffffffffa03397a9>] ipv6_conntrack_in+0x20/0x22 [nf_conntrack_ipv6] [ 35.627353] [<ffffffff8131070f>] nf_iterate+0x44/0x9e [ 35.627365] [<ffffffffa02c698d>] ? ip6_input_finish+0x3a9/0x3a9 [ipv6] [ 35.627374] [<ffffffff813107d8>] nf_hook_slow+0x6f/0x107 [ 35.627386] [<ffffffffa02c698d>] ? ip6_input_finish+0x3a9/0x3a9 [ipv6] [ 35.627399] [<ffffffffa02c698d>] ? ip6_input_finish+0x3a9/0x3a9 [ipv6] [ 35.627409] [<ffffffffa0330c7c>] nf_ct_frag6_output+0x9e/0xdf [nf_defrag_ipv6] [ 35.627418] [<ffffffffa03300d0>] ipv6_defrag+0xca/0xda [nf_defrag_ipv6] [ 35.627431] [<ffffffffa02c698d>] ? ip6_input_finish+0x3a9/0x3a9 [ipv6] [ 35.627440] [<ffffffff8131070f>] nf_iterate+0x44/0x9e [ 35.627452] [<ffffffffa02c698d>] ? ip6_input_finish+0x3a9/0x3a9 [ipv6] [ 35.627461] [<ffffffff813107d8>] nf_hook_slow+0x6f/0x107 [ 35.630588] [<ffffffffa02c698d>] ? ip6_input_finish+0x3a9/0x3a9 [ipv6] [ 35.630588] [<ffffffffa02c6d0c>] ipv6_rcv+0x316/0x31d [ipv6] [ 35.630588] [<ffffffff812ec317>] __netif_receive_skb_core+0x5d3/0x623 [ 35.630588] [<ffffffff812ec3b0>] __netif_receive_skb+0x49/0x59 [ 35.630588] [<ffffffff812ec577>] netif_receive_skb+0x46/0x76 [ 35.630588] [<ffffffff812a723c>] xennet_poll+0x9c8/0xb02 [ 35.630588] [<ffffffff812ec798>] net_rx_action+0x9f/0x1b1 [ 35.630588] [<ffffffff8103997a>] __do_softirq+0xbc/0x17c [ 35.630588] [<ffffffff81039b26>] irq_exit+0x46/0x8d [ 35.630588] [<ffffffff8127e95c>] xen_evtchn_do_upcall+0x2c/0x39 [ 35.630588] [<ffffffff8138863e>] xen_do_hypervisor_callback+0x1e/0x30 [ 35.630588] <EOI> [ 35.630588] [<ffffffff81152062>] ? __ext3_journal_stop+0x9/0x47 [ 35.630588] [<ffffffff8114ad6f>] ? ext3_writeback_write_end+0x9c/0xd7 [ 35.630588] [<ffffffff81003809>] ? __raw_callee_save_xen_pte_val+0x11/0x1e [ 35.630588] [<ffffffff810a8641>] ? generic_file_buffered_write+0x186/0x253 [ 35.630588] [<ffffffff810a9338>] ? __generic_file_aio_write+0x2a7/0x2d7 [ 35.630588] [<ffffffff810a93be>] ? generic_file_aio_write+0x56/0xa4 [ 35.630588] [<ffffffff810ea27b>] ? do_sync_write+0x74/0x9c [ 35.630588] [<ffffffff810ead65>] ? vfs_write+0xd8/0x18a [ 35.630588] [<ffffffff810eb122>] ? SyS_write+0x4b/0x73 [ 35.630588] [<ffffffff813870ad>] ? system_call_fastpath+0x1a/0x1f [ 35.630588] Code: 57 41 56 41 55 41 89 cd 41 54 41 89 f4 53 48 89 fb 48 83 ec 28 85 f6 8b bf d8 00 00 00 79 02 0f 0b 8b 83 f4 00 00 00 ff c8 74 02 <0f> 0b 01 f7 89 c8 8d 54 3a 3f 80 cc 20 83 e2 c0 f6 83 b2 00 00 [ 35.630588] RIP [<ffffffff812e298b>] pskb_expand_head+0x30/0x21e [ 35.630588] RSP <ffff88003f8036b8> [ 35.827102] ---[ end trace 28f17ebf2bae92d5 ]--- [ 35.827112] Kernel panic - not syncing: Fatal exception in interrupt 2nd Time it booted 3.10 just crashed again 2 times: [77891.118978] ------------[ cut here ]------------ [77891.118991] kernel BUG at net/core/skbuff.c:1069! [77891.118997] invalid opcode: 0000 [#1] SMP [77891.119005] Modules linked in: nfnetlink_log nfnetlink nfsd auth_rpcgss exportfs nfs_acl tun af_packet xt_TCPMSS xt_mark xt_connmark iptable_mangle xt_limit xt_policy ipt_REJECT iptable_filter ipt_MASQUERADE xt_nat iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_raw ip_tables xt_LOG ip6t_REJECT xt_tcpudp nf_conntrack_ipv6 nf_defrag_ipv6 xt_conntrack ip6table_filter ip6_tables x_tables nf_conntrack_tftp nf_conntrack_ftp nf_conntrack_sip nf_conntrack ipv6 dm_zero dm_round_robin dm_multipath dm_flakey dm_bufio xts gf128mul aes_x86_64 cbc sha256_generic scsi_transport_iscsi fuse nfs fscache lockd sunrpc reiserfs btrfs libcrc32c zlib_deflate ext2 multipath linear raid0 dm_raid raid10 raid1 raid456 md_mod async_pq async_xor xor async_memcpy async_raid6_recov raid6_pq async_tx dm_snapshot dm_crypt dm_mirror dm_region_hash dm_log dm_mod [77891.119214] CPU: 0 PID: 0 Comm: swapper/0 Not tainted 3.10.5-gentoo-r1domU #1 [77891.119220] task: ffffffff8155e400 ti: ffffffff8154a000 task.ti: ffffffff8154a000 [77891.119226] RIP: e030:[<ffffffff812e298b>] [<ffffffff812e298b>] pskb_expand_head+0x30/0x21e [77891.119239] RSP: e02b:ffff88003f8036b8 EFLAGS: 00010202 [77891.119243] RAX: 0000000000000002 RBX: ffff8800396b4980 RCX: 0000000000000020 [77891.119249] RDX: 00000000000003d4 RSI: 0000000000000000 RDI: 00000000000002c0 [77891.119255] RBP: ffff88003f803708 R08: 0000000000000000 R09: ffff880039a44c00 [77891.119260] R10: 000000000000ffff R11: 00000000ffff0000 R12: 0000000000000000 [77891.119266] R13: 0000000000000020 R14: ffff8800394e9c00 R15: ffff880039508000 [77891.119274] FS: 00007fbd927fc700(0000) GS:ffff88003f800000(0000) knlGS:0000000000000000 [77891.119280] CS: e033 DS: 0000 ES: 0000 CR0: 000000008005003b [77891.119285] CR2: 00007f2069d8c000 CR3: 0000000039a41000 CR4: 0000000000000660 [77891.119291] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [77891.122897] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 [77891.122897] Stack: [77891.122897] 0000000000000013 ffffffff81725f00 ffff88003f8036f8 ffffffff8103e37e [77891.122897] ffff88003f8036f8 ffff8800396b4980 00000000000004d4 ffff880039508000 [77891.122897] ffff8800394e9c00 ffff880039508000 ffff88003f803758 ffffffff812e2c0b [77891.122897] Call Trace: [77891.122897] <IRQ> [77891.122897] [<ffffffff8103e37e>] ? lock_timer_base.isra.28+0x26/0x4b [77891.122897] [<ffffffff812e2c0b>] __pskb_pull_tail+0x59/0x28d [77891.122897] [<ffffffff812ee383>] dev_hard_start_xmit+0x26d/0x3d8 [77891.122897] [<ffffffff810083b4>] ? xen_spin_lock+0xc3/0xd6 [77891.122897] [<ffffffff813047ce>] sch_direct_xmit+0x72/0x1a1 [77891.122897] [<ffffffff812ee70b>] dev_queue_xmit+0x21d/0x41e [77891.122897] [<ffffffffa02c4b63>] ip6_finish_output2+0x334/0x3e3 [ipv6] [77891.122897] [<ffffffffa02c64ae>] ? ip6_fragment+0x93a/0x93a [ipv6] [77891.122897] [<ffffffffa02c6543>] ip6_finish_output+0x95/0x9a [ipv6] [77891.122897] [<ffffffffa02c65b3>] ip6_output+0x6b/0x9c [ipv6] [77891.122897] [<ffffffffa02c5ae5>] ip6_forward+0x60b/0x69a [ipv6] [77891.122897] [<ffffffffa02d0425>] ? ip6_route_input+0x92/0xb1 [ipv6] [77891.122897] [<ffffffffa02c698d>] ? ip6_input_finish+0x3a9/0x3a9 [ipv6] [77891.122897] [<ffffffffa02c69f2>] ip6_rcv_finish+0x65/0x69 [ipv6] [77891.122897] [<ffffffffa0339736>] __ipv6_conntrack_in+0xee/0x141 [nf_conntrack_ipv6] [77891.122897] [<ffffffffa03397a9>] ipv6_conntrack_in+0x20/0x22 [nf_conntrack_ipv6] [77891.122897] [<ffffffff8131070f>] nf_iterate+0x44/0x9e [77891.122897] [<ffffffffa02c698d>] ? ip6_input_finish+0x3a9/0x3a9 [ipv6] [77891.122897] [<ffffffff813107d8>] nf_hook_slow+0x6f/0x107 [77891.122897] [<ffffffffa02c698d>] ? ip6_input_finish+0x3a9/0x3a9 [ipv6] [77891.122897] [<ffffffffa02c698d>] ? ip6_input_finish+0x3a9/0x3a9 [ipv6] [77891.122897] [<ffffffffa0330c7c>] nf_ct_frag6_output+0x9e/0xdf [nf_defrag_ipv6] [77891.122897] [<ffffffffa03300d0>] ipv6_defrag+0xca/0xda [nf_defrag_ipv6] [77891.122897] [<ffffffffa02c698d>] ? ip6_input_finish+0x3a9/0x3a9 [ipv6] [77891.122897] [<ffffffff8131070f>] nf_iterate+0x44/0x9e [77891.122897] [<ffffffff81386447>] ? _raw_spin_unlock_irqrestore+0x19/0x1c [77891.122897] [<ffffffffa02c698d>] ? ip6_input_finish+0x3a9/0x3a9 [ipv6] [77891.122897] [<ffffffff813107d8>] nf_hook_slow+0x6f/0x107 [77891.122897] [<ffffffffa02c698d>] ? ip6_input_finish+0x3a9/0x3a9 [ipv6] [77891.122897] [<ffffffffa02c6d0c>] ipv6_rcv+0x316/0x31d [ipv6] [77891.122897] [<ffffffff812ec317>] __netif_receive_skb_core+0x5d3/0x623 [77891.122897] [<ffffffff812ec3b0>] __netif_receive_skb+0x49/0x59 [77891.122897] [<ffffffff812ec577>] netif_receive_skb+0x46/0x76 [77891.122897] [<ffffffff812a723c>] xennet_poll+0x9c8/0xb02 [77891.122897] [<ffffffff812ec798>] net_rx_action+0x9f/0x1b1 [77891.122897] [<ffffffff8103997a>] __do_softirq+0xbc/0x17c [77891.122897] [<ffffffff81039b26>] irq_exit+0x46/0x8d [77891.122897] [<ffffffff8127e95c>] xen_evtchn_do_upcall+0x2c/0x39 [77891.122897] [<ffffffff8138863e>] xen_do_hypervisor_callback+0x1e/0x30 [77891.122897] <EOI> [77891.122897] [<ffffffff810013aa>] ? xen_hypercall_sched_op+0xa/0x20 [77891.122897] [<ffffffff810013aa>] ? xen_hypercall_sched_op+0xa/0x20 [77891.122897] [<ffffffff81006498>] ? xen_safe_halt+0x10/0x18 [77891.122897] [<ffffffff81010dbf>] ? default_idle+0x9/0xd [77891.122897] [<ffffffff810113f0>] ? arch_cpu_idle+0x13/0x1e [77891.122897] [<ffffffff8106d05b>] ? cpu_startup_entry+0xfa/0x163 [77891.122897] [<ffffffff8136c6de>] ? rest_init+0x72/0x74 [77891.122897] [<ffffffff815ccda3>] ? start_kernel+0x3f7/0x404 [77891.122897] [<ffffffff815cc7b5>] ? repair_env_string+0x56/0x56 [77891.122897] [<ffffffff810347b7>] ? __add_preferred_console.constprop.13+0x94/0xa6 [77891.122897] [<ffffffff815cc4bd>] ? x86_64_start_reservations+0x2a/0x2c [77891.122897] [<ffffffff815cebb4>] ? xen_start_kernel+0x4ef/0x4f9 [77891.122897] Code: 57 41 56 41 55 41 89 cd 41 54 41 89 f4 53 48 89 fb 48 83 ec 28 85 f6 8b bf d8 00 00 00 79 02 0f 0b 8b 83 f4 00 00 00 ff c8 74 02 <0f> 0b 01 f7 89 c8 8d 54 3a 3f 80 cc 20 83 e2 c0 f6 83 b2 00 00 [77891.122897] RIP [<ffffffff812e298b>] pskb_expand_head+0x30/0x21e [77891.122897] RSP <ffff88003f8036b8> [77891.122897] ---[ end trace 4c616d563ae5e947 ]--- [77891.122897] Kernel panic - not syncing: Fatal exception in interrupt 2nd time while still booting : [ 49.466427] kernel BUG at net/core/skbuff.c:1069! [ 49.466432] invalid opcode: 0000 [#1] SMP [ 49.466441] Modules linked in: nfnetlink_log nfnetlink nfsd auth_rpcgss exportfs nfs_acl tun af_packet xt_TCPMSS xt_mark xt_connmark iptable_mangle xt_limit xt_policy ipt_REJECT iptable_filter ipt_MASQUERADE xt_nat iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_raw ip_tables xt_LOG ip6t_REJECT xt_tcpudp nf_conntrack_ipv6 nf_defrag_ipv6 xt_conntrack ip6table_filter ip6_tables x_tables nf_conntrack_tftp nf_conntrack_ftp nf_conntrack_sip nf_conntrack ipv6 dm_zero dm_round_robin dm_multipath dm_flakey dm_bufio xts gf128mul aes_x86_64 cbc sha256_generic scsi_transport_iscsi fuse nfs fscache lockd sunrpc reiserfs btrfs libcrc32c zlib_deflate ext2 multipath linear raid0 dm_raid raid10 raid1 raid456 md_mod async_pq async_xor xor async_memcpy async_raid6_recov raid6_pq async_tx dm_snapshot dm_crypt dm_mirror dm_region_hash dm_log dm_mod [ 49.466656] CPU: 0 PID: 0 Comm: swapper/0 Not tainted 3.10.5-gentoo-r1domU #1 [ 49.466663] task: ffffffff8155e400 ti: ffffffff8154a000 task.ti: ffffffff8154a000 [ 49.466669] RIP: e030:[<ffffffff812e298b>] [<ffffffff812e298b>] pskb_expand_head+0x30/0x21e [ 49.466681] RSP: e02b:ffff88003f803668 EFLAGS: 00010202 [ 49.466687] RAX: 0000000000000002 RBX: ffff880039ecad80 RCX: 0000000000000020 [ 49.466693] RDX: 00000000000003d4 RSI: 0000000000000000 RDI: 00000000000002c0 [ 49.466698] RBP: ffff88003f8036b8 R08: 0000000000000000 R09: ffff880022c82400 [ 49.466704] R10: 000000000000ffff R11: 00000000ffff0000 R12: 0000000000000000 [ 49.466710] R13: 0000000000000020 R14: ffff880039411800 R15: ffff880038e78000 [ 49.466718] FS: 00007fe724829700(0000) GS:ffff88003f800000(0000) knlGS:0000000000000000 [ 49.466725] CS: e033 DS: 0000 ES: 0000 CR0: 000000008005003b [ 49.466730] CR2: 00007f8a08628710 CR3: 00000000396c4000 CR4: 0000000000000660 [ 49.466736] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 49.466743] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 [ 49.466748] Stack: [ 49.466752] 0000000000000041 00022dd50eb947fa ffff880022cbfe20 0000000000000214 [ 49.466766] ffff88003a13bf40 ffff880039ecad80 00000000000004d4 ffff880038e78000 [ 49.466780] ffff880039411800 ffff880038e78000 ffff88003f803708 ffffffff812e2c0b [ 49.466798] Call Trace: [ 49.466802] <IRQ> [ 49.466806] [<ffffffff812e2c0b>] __pskb_pull_tail+0x59/0x28d [ 49.466820] [<ffffffff8103e37e>] ? lock_timer_base.isra.28+0x26/0x4b [ 49.466829] [<ffffffff812ee383>] dev_hard_start_xmit+0x26d/0x3d8 Hmm, unfortunate; one last kernel to try to ensure it hasn't been fixed by upstream development efforts is =sys-kernel/git-sources-3.11_rc5. After that, we can look for other occurrences, bugs and mailing list discussions on the internet to see if they experience the same and have a possible fix; if not, we'll have to go through with a kernel bisect... So, when you have the time, please try =sys-kernel/git-sources-3.11_rc5 3.11_rc5 now up and running for 3 days and 9 hours. But 3.8 gave me one run of about 4 days. I don't know what kind of packet triggers the panic. If it holds until tomorrow this time I would believe it to be working. OK that was too early 3.11 crashed: [366805.495660] ------------[ cut here ]------------ [366805.495673] kernel BUG at net/core/skbuff.c:1059! [366805.495687] invalid opcode: 0000 [#1] SMP [366805.495697] Modules linked in: rpcsec_gss_krb5 nfsv4 nfnetlink_log nfnetlink n fsd auth_rpcgss exportfs nfs_acl tun af_packet iptable_raw ipt_MASQUERADE xt_nat i ptable_nat nf_nat_ipv4 nf_nat xt_limit xt_policy ipt_REJECT iptable_filter xt_TCPM SS nf_conntrack_ipv4 nf_defrag_ipv4 xt_mark xt_connmark iptable_mangle ip_tables x t_LOG ip6t_REJECT xt_tcpudp nf_conntrack_ipv6 nf_defrag_ipv6 xt_conntrack ip6table _filter ip6_tables x_tables nf_conntrack_tftp nf_conntrack_ftp nf_conntrack_sip nf _conntrack ipv6 dm_zero dm_round_robin dm_multipath dm_flakey dm_bufio xts gf128mu l aes_x86_64 cbc sha256_generic scsi_transport_iscsi fuse nfs fscache lockd sunrpc reiserfs btrfs libcrc32c zlib_deflate ext2 multipath linear raid0 dm_raid raid10 raid1 raid456 md_mod async_pq async_xor xor async_memcpy async_raid6_recov raid6_p q async_tx dm_snapshot dm_crypt dm_mirror dm_region_hash dm_log dm_mod [366805.495934] CPU: 0 PID: 0 Comm: swapper/0 Not tainted 3.11.0-rc5domU #1 [366805.495941] task: ffffffff81572400 ti: ffffffff8155e000 task.ti: ffffffff8155e 000 [366805.495948] RIP: e030:[<ffffffff812f71ca>] [<ffffffff812f71ca>] pskb_expand_h ead+0x30/0x226 [366805.495961] RSP: e02b:ffff88003f803668 EFLAGS: 00010202 [366805.495967] RAX: 0000000000000002 RBX: ffff880039faf280 RCX: 0000000000000020 [366805.495973] RDX: 00000000000003d4 RSI: 0000000000000000 RDI: 00000000000002c0 [366805.495980] RBP: ffff88003f8036b8 R08: 0000000000000000 R09: ffff88002298e400 [366805.495986] R10: 000000000000ffff R11: 00000000ffff0000 R12: 0000000000000000 [366805.495992] R13: 0000000000000020 R14: ffff88003950fa00 R15: ffff88003d608000 [366805.496011] FS: 00007f69e77fe700(0000) GS:ffff88003f800000(0000) knlGS:0000000000000000 [366805.496017] CS: e033 DS: 0000 ES: 0000 CR0: 000000008005003b [366805.496022] CR2: 00007fab1ae54b60 CR3: 0000000024d2e000 CR4: 0000000000000660 [366805.496028] Stack: [366805.499466] 0000000000000002 ffff88003f803680 ffffffff8139336e ffff88003f8036c0 [366805.499466] ffffffff8109af98 ffff880039faf280 00000000000004d4 ffff88003d608000 [366805.499466] ffff88003950fa00 ffff88003d608000 ffff88003f803708 ffffffff812f7452 [366805.499466] Call Trace: [366805.499466] <IRQ> [366805.499466] [<ffffffff8139336e>] ? _raw_spin_lock+0x9/0xd [366805.499466] [<ffffffff8109af98>] ? handle_irq_event+0x49/0x61 [366805.499466] [<ffffffff812f7452>] __pskb_pull_tail+0x59/0x28d [366805.499466] [<ffffffff81303207>] dev_hard_start_xmit+0x26e/0x3db [366805.499466] [<ffffffff810091f0>] ? xen_spin_lock+0xc3/0xd6 [366805.499466] [<ffffffff813195ae>] sch_direct_xmit+0x72/0x1a1 [366805.499466] [<ffffffff81303597>] dev_queue_xmit+0x223/0x424 [366805.499466] [<ffffffff81318d20>] ? eth_header+0x28/0xb4 [366805.499466] [<ffffffff81309b77>] neigh_resolve_output+0x165/0x183 [366805.499466] [<ffffffffa02cab7d>] ip6_finish_output2+0x34a/0x3eb [ipv6] [366805.499466] [<ffffffffa02cc4df>] ? ip6_fragment+0x948/0x948 [ipv6] [366805.499466] [<ffffffffa02cc574>] ip6_finish_output+0x95/0x9a [ipv6] [366805.499466] [<ffffffffa02cc5e4>] ip6_output+0x6b/0x9b [ipv6] [366805.499466] [<ffffffffa02cbb08>] ip6_forward+0x612/0x6a1 [ipv6] [366805.499466] [<ffffffffa02d682c>] ? ip6_route_input+0x93/0xb2 [ipv6] [366805.499466] [<ffffffffa02cc9d8>] ? ip6_input_finish+0x3c4/0x3c4 [ipv6] [366805.499466] [<ffffffffa02cca3e>] ip6_rcv_finish+0x66/0x6a [ipv6] [366805.499466] [<ffffffffa0349738>] __ipv6_conntrack_in+0xee/0x141 [nf_conntrack_ipv6] [366805.499466] [<ffffffffa03497ab>] ipv6_conntrack_in+0x20/0x22 [nf_conntrack_ipv6] [366805.499466] [<ffffffff81325877>] nf_iterate+0x44/0x9e [366805.499466] [<ffffffffa02cc9d8>] ? ip6_input_finish+0x3c4/0x3c4 [ipv6] [366805.499466] [<ffffffff81325940>] nf_hook_slow+0x6f/0x107 [366805.499466] [<ffffffffa02cc9d8>] ? ip6_input_finish+0x3c4/0x3c4 [ipv6] [366805.499466] [<ffffffffa02cc9d8>] ? ip6_input_finish+0x3c4/0x3c4 [ipv6] [366805.499466] [<ffffffffa0340c95>] nf_ct_frag6_output+0x9e/0xdf [nf_defrag_ipv6] [366805.499466] [<ffffffffa03400d0>] ipv6_defrag+0xca/0xda [nf_defrag_ipv6] [366805.499466] [<ffffffffa02cc9d8>] ? ip6_input_finish+0x3c4/0x3c4 [ipv6] [366805.499466] [<ffffffff81325877>] nf_iterate+0x44/0x9e [366805.499466] [<ffffffff813933c7>] ? _raw_spin_unlock_irqrestore+0x19/0x1c [366805.499466] [<ffffffffa02cc9d8>] ? ip6_input_finish+0x3c4/0x3c4 [ipv6] [366805.499466] [<ffffffff81325940>] nf_hook_slow+0x6f/0x107 [366805.499466] [<ffffffffa02cc9d8>] ? ip6_input_finish+0x3c4/0x3c4 [ipv6] [366805.499466] [<ffffffffa02ccd60>] ipv6_rcv+0x31e/0x325 [ipv6] [366805.499466] [<ffffffff81300fc6>] __netif_receive_skb_core+0x5d6/0x626 [366805.499466] [<ffffffff8130105f>] __netif_receive_skb+0x49/0x59 [366805.499466] [<ffffffff81301226>] netif_receive_skb+0x46/0x76 [366805.499466] [<ffffffff812bb033>] xennet_poll+0x9e7/0xb38 [366805.499466] [<ffffffff81301448>] net_rx_action+0x9f/0x1b1 [366805.499466] [<ffffffff8103ea27>] __do_softirq+0xbc/0x17c [366805.499466] [<ffffffff8103ebd3>] irq_exit+0x46/0x8d [366805.499466] [<ffffffff81271816>] xen_evtchn_do_upcall+0x2c/0x39 [366805.499466] [<ffffffff813954be>] xen_do_hypervisor_callback+0x1e/0x30 [366805.499466] <EOI> [366805.499466] [<ffffffff810013aa>] ? xen_hypercall_sched_op+0xa/0x20 [366805.499466] [<ffffffff810013aa>] ? xen_hypercall_sched_op+0xa/0x20 [366805.499466] [<ffffffff81006a94>] ? xen_safe_halt+0x10/0x18 [366805.499466] [<ffffffff81012063>] ? default_idle+0x9/0xd [366805.499466] [<ffffffff81012694>] ? arch_cpu_idle+0x13/0x1e [366805.499466] [<ffffffff81075aa3>] ? cpu_startup_entry+0xfa/0x163 [366805.499466] [<ffffffff8138245e>] ? rest_init+0x72/0x74 [366805.499466] [<ffffffff815e1da3>] ? start_kernel+0x3f7/0x404 [366805.499466] [<ffffffff815e17b5>] ? repair_env_string+0x56/0x56 [366805.499466] [<ffffffff810740fa>] ? __add_preferred_console.constprop.17+0x7f/0x8b [366805.499466] [<ffffffff815e14bd>] ? x86_64_start_reservations+0x2a/0x2c [366805.499466] [<ffffffff815e3b37>] ? xen_start_kernel+0x4fa/0x504 [366805.499466] Code: 57 41 56 41 55 41 89 cd 41 54 41 89 f4 53 48 89 fb 48 83 ec 28 85 f6 8b bf d4 00 00 00 79 02 0f 0b 8b 83 ec 00 00 00 ff c8 74 02 <0f> 0b 01 f7 89 c8 8d 54 3a 3f 80 cc 20 83 e2 c0 f6 83 b2 00 00 [366805.499466] RIP [<ffffffff812f71ca>] pskb_expand_head+0x30/0x226 [366805.499466] RSP <ffff88003f803668> [366805.540502] ---[ end trace 4fba201c9941e3c5 ]--- [366805.540509] Kernel panic - not syncing: Fatal exception in interrupt *** This bug has been marked as a duplicate of bug 480722 *** |
Created attachment 345744 [details] Crash-Dump on the console Kernel in domU runs for a while. It has a few interfaces and acts as a firewall. After about half a day it panics. It seems to be v6 related (see attached file).