I had a system running xen 3.4.2. After the upgrade to 4.1.1 Dom0 boots but as soon as I try to start one of the guests (in this case pv gentoo guests) the host ie the Dom0 resets. No errormessage is visible /var/log/xen/* also gives no clue. Reproducible: Always Steps to Reproduce: 1. boot the system with xen 4.1.1 xen-sources-2.6.34 or .38 as dom0 kernel 2. xm create <guest that worked before> 3. Actual Results: reboot of the system Expected Results: guest starting Portage 2.1.10.11 (default/linux/amd64/10.0, gcc-4.5.3, glibc-2.12.2-r0, 2.6.38-xen x86_64) ================================================================= System uname: Linux-2.6.38-xen-x86_64-AMD_Athlon-tm-_64_X2_Dual_Core_Processor_6000+-with-gentoo-2.0.3 Timestamp of tree: Sat, 05 Nov 2011 17:30:01 +0000 distcc 3.1 x86_64-pc-linux-gnu [disabled] app-shells/bash: 4.1_p9 dev-java/java-config: 2.1.11-r1 dev-lang/python: 2.6.6-r2, 2.7.2-r3, 3.1.4-r3 dev-util/cmake: 2.8.4-r1 dev-util/pkgconfig: 0.26 sys-apps/baselayout: 2.0.3 sys-apps/openrc: 0.8.3-r1 sys-apps/sandbox: 2.4 sys-devel/autoconf: 2.68 sys-devel/automake: 1.9.6-r3, 1.11.1 sys-devel/binutils: 2.21.1-r1 sys-devel/gcc: 4.4.5, 4.5.3-r1 sys-devel/gcc-config: 1.4.1-r1 sys-devel/libtool: 2.4-r1 sys-devel/make: 3.82-r1 sys-kernel/linux-headers: 2.6.39 (virtual/os-headers) sys-libs/glibc: 2.12.2 Repositories: gentoo ACCEPT_KEYWORDS="amd64" ACCEPT_LICENSE="* -@EULA" CBUILD="x86_64-pc-linux-gnu" CFLAGS="-O3 -march=athlon64 -mtune=athlon64" CHOST="x86_64-pc-linux-gnu" CONFIG_PROTECT="/etc" CONFIG_PROTECT_MASK="/etc/ca-certificates.conf /etc/env.d /etc/env.d/java/ /etc/eselect/postgresql /etc/fonts/fonts.conf /etc/gconf /etc/gentoo-release /etc/revdep-rebuild /etc/sandbox.d /etc/terminfo" CXXFLAGS="-O3 -march=athlon64 -mtune=athlon64" DISTDIR="/usr/portage/distfiles" FEATURES="assume-digests binpkg-logs distlocks ebuild-locks fixlafiles fixpackages news parallel-fetch protect-owned sandbox sfperms strict unknown-features-warn unmerge-logs unmerge-orphans userfetch" FFLAGS="" GENTOO_MIRRORS="http://distfiles.gentoo.org" LDFLAGS="-Wl,-O1 -Wl,--as-needed" MAKEOPTS="-j2" PKGDIR="/usr/portage/packages" PORTAGE_CONFIGROOT="/" PORTAGE_RSYNC_OPTS="--recursive --links --safe-links --perms --times --compress --force --whole-file --delete --stats --timeout=180 --exclude=/distfiles --exclude=/local --exclude=/packages" PORTAGE_TMPDIR="/var/tmp" PORTDIR="/usr/portage" PORTDIR_OVERLAY="" SYNC="rsync://rsync.gentoo.org/gentoo-portage" USE="X acl alsa amd64 berkdb bzip2 cli cracklib crypt cups cxx dri fortran gcj gdbm gnome gpm gtk2 hbci iconv ipv6 mmx modules mudflap multilib ncurses nls nptl nptlonly openmp pam pcre pppd readline session sse sse2 ssl sysfs tcpd unicode xorg zlib" ALSA_CARDS="ali5451 als4000 atiixp atiixp-modem bt87x ca0106 cmipci emu10k1x ens1370 ens1371 es1938 es1968 fm801 hda-intel intel8x0 intel8x0m maestro3 trident usb-audio via82xx via82xx-modem ymfpci" ALSA_PCM_PLUGINS="adpcm alaw asym copy dmix dshare dsnoop empty extplug file hooks iec958 ioplug ladspa lfloat linear meter mmap_emul mulaw multi null plug rate route share shm softvol" APACHE2_MODULES="actions alias auth_basic authn_alias authn_anon authn_dbm authn_default authn_file authz_dbm authz_default authz_groupfile authz_host authz_owner authz_user autoindex cache cgi cgid dav dav_fs dav_lock deflate dir disk_cache env expires ext_filter file_cache filter headers include info log_config logio mem_cache mime mime_magic negotiation rewrite setenvif speling status unique_id userdir usertrack vhost_alias" CALLIGRA_FEATURES="kexi words flow plan stage tables krita karbon braindump" CAMERAS="ptp2" COLLECTD_PLUGINS="df interface irq load memory rrdtool swap syslog" ELIBC="glibc" GPSD_PROTOCOLS="ashtech aivdm earthmate evermore fv18 garmin garmintxt gpsclock itrax mtk3301 nmea ntrip navcom oceanserver oldstyle oncore rtcm104v2 rtcm104v3 sirf superstar2 timing tsip tripmate tnt ubx" INPUT_DEVICES="evdev" KERNEL="linux" LCD_DEVICES="bayrad cfontz cfontz633 glk hd44780 lb216 lcdm001 mtxorb ncurses text" PHP_TARGETS="php5-3" RUBY_TARGETS="ruby18" USERLAND="GNU" VIDEO_CARDS="nv vesa" XTABLES_ADDONS="quota2 psd pknock lscan length2 ipv4options ipset ipp2p iface geoip fuzzy condition tee tarpit sysrq steal rawnat logmark ipmark dhcpmac delude chaos account" Unset: CPPFLAGS, CTARGET, EMERGE_DEFAULT_OPTS, INSTALL_MASK, LANG, LC_ALL, LINGUAS, PORTAGE_BUNZIP2_COMMAND, PORTAGE_COMPRESS, PORTAGE_COMPRESS_FLAGS, PORTAGE_RSYNC_EXTRA_OPTS Useflags for xen: app-emulation/xen-tools qemu xend screen hvm -flask app-emulation/xen pae xsm
hmm -flask in xen -tools mean you have no security option compiled in xen-tools. This once occurred from use = acm, but it's no longer present. Retry with use api && flask and repost
Build both xen and xen tools with these flags?
you'll notice the use flags aren't all the same for the two. Mine are; xen Installed versions: 4.1.1-r2!t(14:54:38 08/11/11)(flask pae xsm -custom-cflags -debug) xen-tools; Installed versions: 4.1.1-r6(23:06:36 08/11/11)(api flask hvm pygrub qemu screen xend -custom-cflags -debug -doc) It may well be the kernel ltting you down. Read about the current kernel-3 which has xen support incorporated now. In time, the gentoo xen kernels and xen-3.4 will be dropped. xen-4 is now designed more with kernel-3 in mind.
Shall I try gentoo-sources-3.0.6 for dom0 and domU? I would like that if that works!
OK i rebuilt with the flags suggested no more instant reboot. Dom0 now is gentoo-sources-3.0.6 I try to start a DomU thats xen-sources-2.6.38 that starts to boot but when it gets to the disk devices I get a XENBus waiting to initialize that counts down and doesn't get a result. I had this before and a restart of xend helped but not here. Next I will build a gentoo-sources-3.0.6 kernel with DomU config.
Created attachment 292011 [details] kernel config to build the kernel that panics the guest See comment in bug
Booting the guest I get: [ 0.000000] Initializing cgroup subsys cpu [ 0.000000] Linux version 3.0.6-gentoodomU (root@jive) (gcc version 4.5.3 (Gentoo 4.5.3-r1 p1.0, pie-0.4.5) ) #1 SMP Wed Nov 9 13:55:05 CET 2011 [ 0.000000] Command line: root=/dev/xvda1 ro xencons=tty console=tty1 dolvm [ 0.000000] released 0 pages of unused memory [ 0.000000] Set 0 page(s) to 1-1 mapping. [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] Xen: 0000000000000000 - 00000000000a0000 (usable) [ 0.000000] Xen: 00000000000a0000 - 0000000000100000 (reserved) [ 0.000000] Xen: 0000000000100000 - 0000000020000000 (usable) [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] DMI not present or invalid. [ 0.000000] last_pfn = 0x20000 max_arch_pfn = 0x400000000 [ 0.000000] init_memory_mapping: 0000000000000000-0000000020000000 [ 0.000000] RAMDISK: 0173d000 - 01ccf000 [ 0.000000] No NUMA configuration found [ 0.000000] Faking a node at 0000000000000000-0000000020000000 [ 0.000000] Initmem setup node 0 0000000000000000-0000000020000000 [ 0.000000] NODE_DATA [000000001fffb000 - 000000001fffffff] [ 0.000000] Zone PFN ranges: [ 0.000000] DMA 0x00000010 -> 0x00001000 [ 0.000000] DMA32 0x00001000 -> 0x00100000 [ 0.000000] Normal empty [ 0.000000] Movable zone start PFN for each node [ 0.000000] early_node_map[2] active PFN ranges [ 0.000000] 0: 0x00000010 -> 0x000000a0 [ 0.000000] 0: 0x00000100 -> 0x00020000 [ 0.000000] SMP: Allowing 1 CPUs, 0 hotplug CPUs [ 0.000000] No local APIC present [ 0.000000] APIC: disable apic facility [ 0.000000] APIC: switched to apic NOOP [ 0.000000] Allocating PCI resources starting at 20000000 (gap: 20000000:e0000000) [ 0.000000] Booting paravirtualized kernel on Xen [ 0.000000] Xen version: 4.1.1 (preserve-AD) [ 0.000000] setup_percpu: NR_CPUS:16 nr_cpumask_bits:16 nr_cpu_ids:1 nr_node_ids:1 [ 0.000000] PERCPU: Embedded 26 pages/cpu @ffff88001fee4000 s74176 r8192 d24128 u106496 [ 0.000000] Built 1 zonelists in Node order, mobility grouping on. Total pages: 129166 [ 0.000000] Policy zone: DMA32 [ 0.000000] Kernel command line: root=/dev/xvda1 ro xencons=tty console=tty1 dolvm [ 0.000000] PID hash table entries: 2048 (order: 2, 16384 bytes) [ 0.000000] Memory: 502468k/524288k available (2961k kernel code, 448k absent, 21372k reserved, 1895k data, 640k init) [ 0.000000] Hierarchical RCU implementation. [ 0.000000] NR_IRQS:768 [ 0.000000] Console: colour dummy device 80x25 [ 0.000000] console [tty0] enabled [ 0.000000] console [hvc0] enabled [ 0.000000] kmemleak: Early log buffer exceeded, please increase DEBUG_KMEMLEAK_EARLY_LOG_SIZE [ 0.000000] kmemleak: Kernel memory leak detector disabled [ 0.000000] allocated 4194304 bytes of page_cgroup [ 0.000000] please try 'cgroup_disable=memory' option if you don't want memory cgroups [ 0.000000] installing Xen timer for CPU 0 [ 0.000000] Detected 3000.190 MHz processor. [ 0.004000] Calibrating delay loop (skipped), value calculated using timer frequency.. 6000.38 BogoMIPS (lpj=12000760) [ 0.004000] pid_max: default: 32768 minimum: 301 [ 0.004000] Security Framework initialized [ 0.004000] Smack: Initializing. [ 0.004000] AppArmor: AppArmor disabled by boot time parameter [ 0.004000] Dentry cache hash table entries: 65536 (order: 7, 524288 bytes) [ 0.004000] Inode-cache hash table entries: 32768 (order: 6, 262144 bytes) [ 0.004000] Mount-cache hash table entries: 256 [ 0.004000] Initializing cgroup subsys cpuacct [ 0.004000] Initializing cgroup subsys memory [ 0.004000] Initializing cgroup subsys devices [ 0.004000] Initializing cgroup subsys freezer [ 0.004000] Initializing cgroup subsys net_cls [ 0.004000] Initializing cgroup subsys blkio [ 0.004000] CPU: Physical Processor ID: 0 [ 0.004000] CPU: Processor Core ID: 1 [ 0.004000] SMP alternatives: switching to UP code [ 0.004050] Freeing SMP alternatives: 16k freed [ 0.004263] cpu 0 spinlock event irq 17 [ 0.004331] Performance Events: [ 0.004341] no APIC, boot with the "lapic" boot parameter to force-enable it. [ 0.004353] no hardware sampling interrupt available. [ 0.004380] Broken PMU hardware detected, using software events only. [ 0.004859] Brought up 1 CPUs [ 0.005627] kworker/u:0 used greatest stack depth: 6048 bytes left [ 0.006715] Grant table initialized [ 0.006908] NET: Registered protocol family 16 [ 0.008706] kworker/u:0 used greatest stack depth: 5664 bytes left [ 0.019827] bio: create slab <bio-0> at 0 [ 0.020543] xen/balloon: Initialising balloon driver. [ 0.020543] last_pfn = 0x20000 max_arch_pfn = 0x400000000 [ 0.024314] xen-balloon: Initialising balloon driver. [ 0.024848] SCSI subsystem initialized [ 0.026157] NetLabel: Initializing [ 0.026169] NetLabel: domain hash size = 128 [ 0.026179] NetLabel: protocols = UNLABELED CIPSOv4 [ 0.026275] NetLabel: unlabeled traffic allowed by default [ 0.026855] Switching to clocksource xen [ 0.032043] Switched to NOHz mode on CPU #0 [ 0.044571] NET: Registered protocol family 2 [ 0.045087] IP route cache hash table entries: 4096 (order: 3, 32768 bytes) [ 0.046948] TCP established hash table entries: 16384 (order: 6, 262144 bytes) [ 0.047148] TCP bind hash table entries: 16384 (order: 6, 262144 bytes) [ 0.047302] TCP: Hash tables configured (established 16384 bind 16384) [ 0.047316] TCP reno registered [ 0.047332] UDP hash table entries: 256 (order: 1, 8192 bytes) [ 0.047354] UDP-Lite hash table entries: 256 (order: 1, 8192 bytes) [ 0.047768] NET: Registered protocol family 1 [ 0.048227] Unpacking initramfs... [ 0.203584] Freeing initrd memory: 5704k freed [ 0.207726] platform rtc_cmos: registered platform RTC device (no PNP device found) [ 0.209900] audit: initializing netlink socket (disabled) [ 0.210364] type=2000 audit(1320844156.535:1): initialized [ 0.213907] VFS: Disk quotas dquot_6.5.2 [ 0.214354] Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 0.215524] msgmni has been set to 992 [ 0.216921] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 254) [ 0.217696] io scheduler noop registered [ 0.217969] io scheduler deadline registered [ 0.218151] io scheduler cfq registered (default) [ 0.335389] Hangcheck: starting hangcheck timer 0.9.1 (tick is 180 seconds, margin is 60 seconds). [ 0.335411] Hangcheck: Using getrawmonotonic(). [ 0.336220] ------------[ cut here ]------------ [ 0.336236] WARNING: at arch/x86/xen/mmu.c:486 xen_make_pte_debug+0xa0/0xfa() [ 0.336248] 0xfed40000 is using VM_IO, but it is 0xfffffffffffff000! [ 0.336259] Modules linked in: [ 0.336278] Pid: 1, comm: swapper Not tainted 3.0.6-gentoodomU #1 [ 0.336289] Call Trace: [ 0.336309] [<ffffffff8103bc74>] warn_slowpath_common+0x80/0x98 [ 0.336327] [<ffffffff8103bd20>] warn_slowpath_fmt+0x41/0x43 [ 0.336344] [<ffffffff81005999>] xen_make_pte_debug+0xa0/0xfa [ 0.336366] [<ffffffff81003987>] __raw_callee_save_xen_make_pte_debug+0x11/0x1e [ 0.336386] [<ffffffff811b5b69>] ? ioremap_page_range+0x261/0x2e8 [ 0.336406] [<ffffffff810226be>] __ioremap_caller+0x273/0x318 [ 0.336423] [<ffffffff81022798>] ioremap_nocache+0x12/0x14 [ 0.336442] [<ffffffff814f6846>] init_tis+0x8d/0x494 [ 0.336459] [<ffffffff814f67b9>] ? hangcheck_init+0x96/0x96 [ 0.336476] [<ffffffff81002155>] do_one_initcall+0x7a/0x14d [ 0.336494] [<ffffffff814d3caf>] kernel_init+0x98/0x118 [ 0.336511] [<ffffffff81033aa6>] ? schedule_tail+0x22/0x94 [ 0.336529] [<ffffffff812e1d84>] kernel_thread_helper+0x4/0x10 [ 0.336547] [<ffffffff812e10b3>] ? int_ret_from_sys_call+0x7/0x1b [ 0.336566] [<ffffffff812e07e1>] ? retint_restore_args+0x5/0x6 [ 0.336584] [<ffffffff812e1d80>] ? gs_change+0x13/0x13 [ 0.336605] ---[ end trace 75290dbc3078e583 ]--- [ 0.336647] BUG: unable to handle kernel paging request at ffff88001f89e700 [ 0.336673] IP: [<ffffffff81004ef5>] xen_set_pte+0xd3/0xdf [ 0.336692] PGD 1478067 PUD 147c067 PMD 1ffe6067 PTE 801000001f89e065 [ 0.336732] Oops: 0003 [#1] SMP [ 0.336756] CPU 0 [ 0.336764] Modules linked in: [ 0.336782] [ 0.336792] Pid: 1, comm: swapper Tainted: G W 3.0.6-gentoodomU #1 [ 0.340065] RIP: e030:[<ffffffff81004ef5>] [<ffffffff81004ef5>] xen_set_pte+0xd3/0xdf [ 0.340065] RSP: e02b:ffff88001e90fd20 EFLAGS: 00010296 [ 0.340065] RAX: 00000000ffffffff RBX: 80000000fed40463 RCX: 80000000fed40463 [ 0.340065] RDX: 0000000000000000 RSI: 80000000fed40463 RDI: ffff88001f89e700 [ 0.340065] RBP: ffff88001e90fd50 R08: 00000000ffffffff R09: 0000000000000000 [ 0.340065] R10: 000000000000003d R11: 0000000000000000 R12: ffffc900000e5000 [ 0.340065] R13: ffffc900000e0000 R14: ffff88001f89d000 R15: ffffffff81477c90 [ 0.340065] FS: 0000000000000000(0000) GS:ffff88001fee4000(0000) knlGS:0000000000000000 [ 0.340065] CS: e033 DS: 0000 ES: 0000 CR0: 000000008005003b [ 0.340065] CR2: ffff88001f89e700 CR3: 0000000001477000 CR4: 0000000000000660 [ 0.340065] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 0.340065] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 [ 0.340065] Process swapper (pid: 1, threadinfo ffff88001e90e000, task ffff88001e90c040) [ 0.340065] Stack: [ 0.340065] ffffffff81003987 ffff88001f89e700 000000000000003d 0000000000000000 [ 0.340065] ffffc900000e5000 ffffc900000e5000 ffff88001e90fd60 ffffffff81004f10 [ 0.340065] ffff88001e90fe20 ffffffff811b5b8b ffff88001e90fdb0 ffff88001ea7f8c0 [ 0.340065] Call Trace: [ 0.340065] [<ffffffff81003987>] ? __raw_callee_save_xen_make_pte_debug+0x11/0x1e [ 0.340065] [<ffffffff81004f10>] xen_set_pte_at+0xf/0x11 [ 0.340065] [<ffffffff811b5b8b>] ioremap_page_range+0x283/0x2e8 [ 0.340065] [<ffffffff810226be>] __ioremap_caller+0x273/0x318 [ 0.340065] [<ffffffff81022798>] ioremap_nocache+0x12/0x14 [ 0.340065] [<ffffffff814f6846>] init_tis+0x8d/0x494 [ 0.340065] [<ffffffff814f67b9>] ? hangcheck_init+0x96/0x96 [ 0.340065] [<ffffffff81002155>] do_one_initcall+0x7a/0x14d [ 0.340065] [<ffffffff814d3caf>] kernel_init+0x98/0x118 [ 0.340065] [<ffffffff81033aa6>] ? schedule_tail+0x22/0x94 [ 0.340065] [<ffffffff812e1d84>] kernel_thread_helper+0x4/0x10 [ 0.340065] [<ffffffff812e10b3>] ? int_ret_from_sys_call+0x7/0x1b [ 0.340065] [<ffffffff812e07e1>] ? retint_restore_args+0x5/0x6 [ 0.340065] [<ffffffff812e1d80>] ? gs_change+0x13/0x13 [ 0.340065] Code: 74 b2 01 00 a8 01 75 05 e8 85 e6 ff ff 65 48 8b 3c 25 f0 b0 00 00 48 83 3d 50 f3 47 00 00 75 02 0f 0b ff 14 25 38 42 48 81 eb 03 [ 0.340065] 89 1f 48 83 c4 20 5b 41 5c c9 c3 55 48 89 ce 48 89 d7 48 89 [ 0.340065] RIP [<ffffffff81004ef5>] xen_set_pte+0xd3/0xdf [ 0.340065] RSP <ffff88001e90fd20> [ 0.340065] CR2: ffff88001f89e700 [ 0.340065] ---[ end trace 75290dbc3078e584 ]--- [ 0.567096] swapper used greatest stack depth: 4776 bytes left [ 0.567581] Kernel panic - not syncing: Attempted to kill init! [ 0.568133] Pid: 1, comm: swapper Tainted: G D W 3.0.6-gentoodomU #1 [ 0.568660] Call Trace: [ 0.568907] [<ffffffff812dd437>] panic+0x8c/0x19a [ 0.568994] [<ffffffff810302 A bit further but not yet there
OK i rebuilt with the flags suggested no more instant reboot. That means your kernel config in the xen kernel 2.6.38 has a flaw. Seeing your kernel -3 works properly, it means you are up and running. xen-4 and the kernel-3 are the recommended duo now. The input to set your 2.6.38 is not now warranted since kernel-3 does the job.
Hello, the host works. But if I can not start a guest as neither DomU with 2.6.38-xen nor 3.0.6-xen will get past this initializing stage or panic 3.0.6 as Dom0 still has a problem.
Konstantin, this is formerly resolved, the flaw is a setup in the kernel. Rather than ignore you, see http://bugzilla.xensource.com/bugzilla/show_bug.cgi?id=1773, a bug I filed for my first attempt at thye xen-3 kernel. It has my kernel config in it, short of the one missing kernel setting. You can grab grab that and tweak your kernel, otherwise this is a forum type post, not a bug.
Just to be clear? The config You mention is for the 3.0 Dom0 not 3.0 DomU?
yes
