[Fedora-xen] FC10 domu FC8 x86_64 with/without HVM support (possible bug)

[Phillip Bertolus]

Hi list,

Just finished confirming that a PV FC10 domu won't run on FC8 without VT
support.

Background:

Create FC8 domu x86_64. Yum upgrade to FC10 x86_64.
FC8 domu runs on both hosts.
FC10 domu runs only on host with VT support.
FC10 runs on both with the old FC8 kernel.

Both hosts indicate they are running pvm images:
xc_dom_compat_check: supported guest type: xen-3.0-x86_64 <= matches

however (and this may have nothing to do with anything):
elf_xen_parse_note: HV_START_LOW = 0xffff800000000000

Any help most appreciated.

We have lots of 64 bit servers without hardware virtualization support.

Cheers
Phill

Machine host 1) Doesn't work (no VT in this processor).
Linux office64 2.6.21.7-5.fc8xen #1 SMP Thu Aug 7 12:44:22 EDT 2008 x86_64 x86_64 x86_64 GNU/Linux
processor       : 1
vendor_id       : GenuineIntel
cpu family      : 15
model           : 4
model name      :                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping        : 3
cpu MHz         : 3000.106
cache size      : 2048 KB
physical id     : 1
siblings        : 1
core id         : 0
cpu cores       : 1
fpu             : yes
fpu_exception   : yes
cpuid level     : 5
wp              : yes
flags           : fpu tsc msr pae mce cx8 apic mtrr mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall lm constant_tsc up pni monitor ds_cpl cid cx16 xtpr
bogomips        : 6007.27
clflush size    : 64
cache_alignment : 128
address sizes   : 36 bits physical, 48 bits virtual
power management:

[ root at office64 xen ]# rpm -qa | grep xen
kernel-xen-devel-2.6.21.7-5.fc8
xen-libs-3.1.2-5.fc8
kernel-xen-2.6.21.7-5.fc8
xen-3.1.2-5.fc8

Some lines from the domain-builder-ng.log:
arch_setup_bootearly: doing nothing
xc_dom_compat_check: supported guest type: xen-3.0-x86_64 <= matches
xc_dom_compat_check: supported guest type: xen-3.0-x86_32p
xc_dom_update_guest_p2m: dst 64bit, pages 0x40000

xend.log
[2009-01-16 17:55:53 30586] DEBUG (XendDomainInfo:2116) Storing VM details: {'on_xend_stop': 'ignore', 'shadow_memory': '0',
 'uuid': '839a0c0f-a332-f38c-63ef-834563cde36a', 'on_reboot': 'restart', 'start_time': '1232088953.4', 'on_poweroff': 'destr
oy', 'on_xend_start': 'ignore', 'on_crash': 'restart', 'vcpus': '1', 'vcpu_avail': '1', 'image': "(linux (kernel ) (notes (H
V_START_LOW 18446603336221196288) (FEATURES '!writable_page_tables|pae_pgdir_above_4gb') (VIRT_BASE 18446744071562067968) (G
UEST_VERSION 2.6) (PADDR_OFFSET 0) (GUEST_OS linux) (HYPERCALL_PAGE 18446744071578882048) (LOADER generic) (SUSPEND_CANCEL 1
) (PAE_MODE yes) (ENTRY 18446744071584739840) (XEN_VERSION xen-3.0)))", 'name': 'f10.reference'}
[2009-01-16 17:55:53 30586] DEBUG (XendDomainInfo:956) Storing domain details: {'console/ring-ref': '1347740', 'image/entry'
: '18446744071584739840', 'console/port': '2', 'store/ring-ref': '1347741', 'image/loader': 'generic', 'vm': '/vm/839a0c0f-a
332-f38c-63ef-834563cde36a', 'control/platform-feature-multiprocessor-suspend': '1', 'image/hv-start-low': '1844660333622119
6288', 'image/guest-os': 'linux', 'image/virt-base': '18446744071562067968', 'memory/target': '1048576', 'image/guest-versio
n': '2.6', 'image/pae-mode': 'yes', 'console/limit': '1048576', 'image/paddr-offset': '0', 'image/hypercall-page': '18446744
071578882048', 'image/suspend-cancel': '1', 'cpu/0/availability': 'online', 'image/features/pae-pgdir-above-4gb': '1', 'imag
e/features/writable-page-tables': '0', 'name': 'f10.reference', 'domid': '110', 'image/xen-version': 'xen-3.0', 'store/port'
: '1'}
[2009-01-16 17:55:53 30586] WARNING (XendDomainInfo:1203) Domain has crashed: name=f10.reference id=110.
[2009-01-16 17:55:53 30586] ERROR (XendDomainInfo:1317) Xend failed during restart of domain 110.  Refusing to restart to av
oid loops.
[2009-01-16 17:55:53 30586] DEBUG (XendDomainInfo:1802) XendDomainInfo.destroy: domid=110
[2009-01-16 17:55:53 30586] DEBUG (XendDomainInfo:1040) XendDomainInfo.handleShutdownWatch

===========================

Machine host 2) Does work.
Linux seanl64 2.6.21.7-5.fc8xen #1 SMP Thu Aug 7 12:44:22 EDT 2008 x86_64 x86_64 x86_64 GNU/Linux
processor       : 0
vendor_id       : AuthenticAMD
cpu family      : 15
model           : 107
model name      : AMD Athlon(tm) 64 X2 Dual Core Processor 3600+
stepping        : 1
cpu MHz         : 1908.705
cache size      : 512 KB
physical id     : 0
siblings        : 1
core id         : 0
cpu cores       : 1
fpu             : yes
fpu_exception   : yes
cpuid level     : 1
wp              : yes
flags           : fpu tsc msr pae mce cx8 apic mtrr mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext fxsr_opt lm 3dnowext 3dnow pni cx16 lahf_lm cmp_legacy svm extapic cr8_legacy misalignsse
bogomips        : 3819.31
TLB size        : 1024 4K pages
clflush size    : 64
cache_alignment : 64
address sizes   : 40 bits physical, 48 bits virtual
power management: ts fid vid ttp tm stc 100mhzsteps

[root at seanl64 ~]# rpm -qa | grep xen
kernel-xen-2.6.21.7-3.fc8
xen-libs-3.1.2-5.fc8
xen-3.1.2-5.fc8
kernel-xen-2.6.21.7-5.fc8

Some lines from the domain-builder-ng.log:
arch_setup_bootearly: doing nothing
xc_dom_compat_check: supported guest type: xen-3.0-x86_64 <= matches
xc_dom_compat_check: supported guest type: xen-3.0-x86_32p
xc_dom_compat_check: supported guest type: hvm-3.0-x86_32
xc_dom_compat_check: supported guest type: hvm-3.0-x86_32p
xc_dom_compat_check: supported guest type: hvm-3.0-x86_64
xc_dom_update_guest_p2m: dst 64bit, pages 0x40000

>From the domu:
Fedora release 10 (Cambridge)
Kernel 2.6.27.9-159.fc10.x86_64 on an x86_64 (/dev/hvc0)

localhost.localdomain login: