[Fedora-xen] Re: Xen issues, was Re: FC6 is frozen

Paul Wouters paul at xelerance.com
Wed Oct 4 20:55:56 UTC 2006


On Tue, 3 Oct 2006, Paul Wouters wrote:

> On Tue, 3 Oct 2006, Jesse Keating wrote:
>
> > We're now into deep freeze state for FC6.  Any new packages brought in will
> > need two nods from Bill Nottingham, Jeremy Katz, and Myself.  The only things
> > that should be coming in now will be critical crasher bugs, multilib
> > conflicts, or installation blockers.
>
> hmm. I have an FC 5.92 + yum updates running 2.6.18-1.2724.fc6xen with
> xen that is completely unusable and gives me non-fatal kernel panics
> and non-working networking (compared to 2.6.18-1.2724.fc6 not giving
> panics and a working networking). xenguest-install.py also fails, and
> the resulting kernels for xenu's hang on boot.

I upgraded to 2.6.18-1.2726.fc6xen. I found out the two ethernet cards
got swapped, explaining the "broken" network connectivity.

I still get the

Oct  4 15:56:02 echelon kernel: BUG: warning at kernel/lockdep.c:1814/trace_hardirqs_on() (Not tainted)
Oct  4 15:56:02 echelon kernel:  [<c040567e>] show_trace_log_lvl+0x58/0x177
Oct  4 15:56:02 echelon kernel:  [<c0405c83>] show_trace+0xd/0x10
Oct  4 15:56:02 echelon kernel:  [<c0405cc1>] dump_stack+0x19/0x1b
Oct  4 15:56:02 echelon kernel:  [<c043638f>] trace_hardirqs_on+0xa4/0x120
Oct  4 15:56:02 echelon kernel:  [<c0404e77>] restore_all+0x37/0x3a
Oct  4 15:56:02 echelon kernel: DWARF2 unwinder stuck at restore_all+0x37/0x3a
Oct  4 15:56:02 echelon kernel: Leftover inexact backtrace:
Oct  4 15:56:02 echelon kernel: Inexact backtrace:
Oct  4 15:56:02 echelon kernel:  [<c0405c83>] show_trace+0xd/0x10
Oct  4 15:56:02 echelon kernel:  [<c0405cc1>] dump_stack+0x19/0x1b
Oct  4 15:56:02 echelon kernel:  [<c043638f>] trace_hardirqs_on+0xa4/0x120
Oct  4 15:56:02 echelon kernel:  [<c0404e77>] restore_all+0x37/0x3a

But it seems non-fatal. I also get the warning:

Oct  2 17:54:25 echelon kernel: PCI: If a device doesn't work, try "pci=routeirq".  If it helps, post a report

But it seems to make no difference wether or not I do that.

The xenU kernel panic'ed, but continued and finished the install. and
works on reboot, wit the same issue as the host kernel. Logs of everything
follows.

Part of the kernel panics in the xen guest might have been because
"exportfs 0.0.0.0:/xen/nfs -o ro" did not give world read acecss to the
FC6test3 DVD contents, so once the guest DHCP'ed, I added a specific
export for it.

Not sure if it matters, but SElinux was disabled on the host.

Paul


[root at echelon log]# xenguest-install
What is the name of your virtual machine? test
 How much RAM should be allocated (in megabytes)? 256
 What would you like to use as the disk (path)? /xen/test.img
 How large would you like the disk to be (in gigabytes)? 4
 Would you like to enable graphics support? (yes or no) no
 What is the install location? nfs:193.110.157.23:/xen/nfs



Starting install...
libvir: Xen Daemon error : GET operation failed: No such domain test
Linux version 2.6.17-1.2630.fc6xen (brewbuilder at hs20-bc1-7.build.redhat.com) (gcc version 4.1.1 20060828 (Red Hat 4.1.1-20)) #1 SMP Wed Sep 6 17:22:21 EDT 2006
BIOS-provided physical RAM map:
 Xen: 0000000000000000 - 0000000010800000 (usable)
0MB HIGHMEM available.
264MB LOWMEM available.
Using x86 segment limits to approximate NX protection
ACPI in unprivileged domain disabled
Built 1 zonelists.  Total pages: 67584
Kernel command line:   method=nfs:193.110.157.23:/xen/nfs
Enabling fast FPU save and restore... done.
Enabling unmasked SIMD FPU exception support... done.
Initializing CPU#0
CPU 0 irqstacks, hard=c07f7000 soft=c07d7000
PID hash table entries: 2048 (order: 11, 8192 bytes)
Xen reported: 3000.350 MHz processor.
Console: colour dummy device 80x25
Lock dependency validator: Copyright (c) 2006 Red Hat, Inc., Ingo Molnar
... MAX_LOCKDEP_SUBCLASSES:    8
... MAX_LOCK_DEPTH:          30
... MAX_LOCKDEP_KEYS:        2048
... CLASSHASH_SIZE:           1024
... MAX_LOCKDEP_ENTRIES:     8192
... MAX_LOCKDEP_CHAINS:      8192
... CHAINHASH_SIZE:          4096
 memory used by lock dependency info: 696 kB
 per task-struct memory footprint: 1200 bytes
Dentry cache hash table entries: 65536 (order: 6, 262144 bytes)
Inode-cache hash table entries: 32768 (order: 5, 131072 bytes)
Software IO TLB disabled
vmalloc area: d1000000-f4ffe000, maxmem 2d7fe000
Memory: 245120k/270336k available (2117k kernel code, 16736k reserved, 1116k data, 184k init, 0k highmem)
Checking if this processor honours the WP bit even in supervisor mode... Ok.
Calibrating delay using timer specific routine.. 7508.40 BogoMIPS (lpj=15016800)
Security Framework v1.0.0 initialized
SELinux:  Initializing.
SELinux:  Starting in permissive mode
selinux_register_security:  Registering secondary module capability
Capability LSM initialized as secondary
Mount-cache hash table entries: 512
CPU: Trace cache: 12K uops, L1 D cache: 16K
CPU: L2 cache: 2048K
Checking 'hlt' instruction... OK.
SMP alternatives: switching to UP code
Freeing SMP alternatives: 12k freed
Brought up 1 CPUs
checking if image is initramfs... it is
Freeing initrd memory: 7522k freed
Grant table initialized
NET: Registered protocol family 16
Brought up 1 CPUs
PCI: setting up Xen PCI frontend stub
ACPI: Interpreter disabled.
Linux Plug and Play Support v0.97 (c) Adam Belay
pnp: PnP ACPI: disabled
xen_mem: Initialising balloon driver.
usbcore: registered new driver usbfs
usbcore: registered new driver hub
PCI: System does not support PCI
PCI: System does not support PCI
NetLabel: Initializing
NetLabel:  domain hash size = 128
NetLabel:  protocols = UNLABELED CIPSOv4
NetLabel:  unlabeled traffic allowed by default
NET: Registered protocol family 2
IP route cache hash table entries: 4096 (order: 2, 16384 bytes)
TCP established hash table entries: 16384 (order: 7, 524288 bytes)
TCP bind hash table entries: 8192 (order: 6, 262144 bytes)
TCP: Hash tables configured (established 16384 bind 8192)
TCP reno registered
IA-32 Microcode Update Driver: v1.14-xen <tigran at veritas.com>
audit: initializing netlink socket (disabled)
audit(1159993901.518:1): initialized
VFS: Disk quotas dquot_6.5.1
Dquot-cache hash table entries: 1024 (order 0, 4096 bytes)
SELinux:  Registering netfilter hooks
Initializing Cryptographic API
ksign: Installing public key data
Loading keyring
- Added public key 5777688813E6B79A
- User ID: Red Hat, Inc. (Kernel Module GPG key)
io scheduler noop registered
io scheduler anticipatory registered
io scheduler deadline registered
io scheduler cfq registered (default)
pci_hotplug: PCI Hot Plug PCI Core version: 0.5
rtc: IRQ 8 is not free.
Non-volatile memory driver v1.2
Linux agpgart interface v0.101 (c) Dave Jones
RAMDISK driver initialized: 16 RAM disks of 16384K size 4096 blocksize
Xen virtual console successfully installed as xvc0
Linux version 2.6.17-1.2630.fc6xen (brewbuilder at hs20-bc1-7.build.redhat.com) (gcc version 4.1.1 20060828 (Red Hat 4.1.1-20)) #1 SMP Wed Sep 6 17:22:21 EDT 2006
BIOS-provided physical RAM map:
 Xen: 0000000000000000 - 0000000010800000 (usable)
0MB HIGHMEM available.
264MB LOWMEM available.
Using x86 segment limits to approximate NX protection
ACPI in unprivileged domain disabled
Built 1 zonelists.  Total pages: 67584
Kernel command line:   method=nfs:193.110.157.23:/xen/nfs
Enabling fast FPU save and restore... done.
Enabling unmasked SIMD FPU exception support... done.
Initializing CPU#0
CPU 0 irqstacks, hard=c07f7000 soft=c07d7000
PID hash table entries: 2048 (order: 11, 8192 bytes)
Xen reported: 3000.350 MHz processor.
Console: colour dummy device 80x25
Lock dependency validator: Copyright (c) 2006 Red Hat, Inc., Ingo Molnar
... MAX_LOCKDEP_SUBCLASSES:    8
... MAX_LOCK_DEPTH:          30
... MAX_LOCKDEP_KEYS:        2048
... CLASSHASH_SIZE:           1024
... MAX_LOCKDEP_ENTRIES:     8192
... MAX_LOCKDEP_CHAINS:      8192
... CHAINHASH_SIZE:          4096
 memory used by lock dependency info: 696 kB
 per task-struct memory footprint: 1200 bytes
Dentry cache hash table entries: 65536 (order: 6, 262144 bytes)
Inode-cache hash table entries: 32768 (order: 5, 131072 bytes)
Software IO TLB disabled
vmalloc area: d1000000-f4ffe000, maxmem 2d7fe000
Memory: 245120k/270336k available (2117k kernel code, 16736k reserved, 1116k data, 184k init, 0k highmem)
Checking if this processor honours the WP bit even in supervisor mode... Ok.
Calibrating delay using timer specific routine.. 7508.40 BogoMIPS (lpj=15016800)
Security Framework v1.0.0 initialized
SELinux:  Initializing.
SELinux:  Starting in permissive mode
selinux_register_security:  Registering secondary module capability
Capability LSM initialized as secondary
Mount-cache hash table entries: 512
CPU: Trace cache: 12K uops, L1 D cache: 16K
CPU: L2 cache: 2048K
Checking 'hlt' instruction... OK.
SMP alternatives: switching to UP code
Freeing SMP alternatives: 12k freed
Brought up 1 CPUs
checking if image is initramfs... it is
Freeing initrd memory: 7522k freed
Grant table initialized
NET: Registered protocol family 16
Brought up 1 CPUs
PCI: setting up Xen PCI frontend stub
ACPI: Interpreter disabled.
Linux Plug and Play Support v0.97 (c) Adam Belay
pnp: PnP ACPI: disabled
xen_mem: Initialising balloon driver.
usbcore: registered new driver usbfs
usbcore: registered new driver hub
PCI: System does not support PCI
PCI: System does not support PCI
NetLabel: Initializing
NetLabel:  domain hash size = 128
NetLabel:  protocols = UNLABELED CIPSOv4
NetLabel:  unlabeled traffic allowed by default
NET: Registered protocol family 2
IP route cache hash table entries: 4096 (order: 2, 16384 bytes)
TCP established hash table entries: 16384 (order: 7, 524288 bytes)
TCP bind hash table entries: 8192 (order: 6, 262144 bytes)
TCP: Hash tables configured (established 16384 bind 8192)
TCP reno registered
IA-32 Microcode Update Driver: v1.14-xen <tigran at veritas.com>
audit: initializing netlink socket (disabled)
audit(1159993901.518:1): initialized
VFS: Disk quotas dquot_6.5.1
Dquot-cache hash table entries: 1024 (order 0, 4096 bytes)
SELinux:  Registering netfilter hooks
Initializing Cryptographic API
ksign: Installing public key data
Loading keyring
- Added public key 5777688813E6B79A
- User ID: Red Hat, Inc. (Kernel Module GPG key)
io scheduler noop registered
io scheduler anticipatory registered
io scheduler deadline registered
io scheduler cfq registered (default)
pci_hotplug: PCI Hot Plug PCI Core version: 0.5
rtc: IRQ 8 is not free.
Non-volatile memory driver v1.2
Linux agpgart interface v0.101 (c) Dave Jones
RAMDISK driver initialized: 16 RAM disks of 16384K size 4096 blocksize
Xen virtual console successfully installed as xvc0
Event-channel device installed.
Uniform Multi-Platform E-IDE driver Revision: 7.00alpha2
ide: Assuming 50MHz system bus speed for PIO modes; override with idebus=xx
ide-floppy driver 0.99.newide
usbcore: registered new driver libusual
usbcore: registered new driver hiddev
usbcore: registered new driver usbhid
drivers/usb/input/hid-core.c: v2.6:USB HID core driver
PNP: No PS/2 controller found. Probing ports directly.
i8042.c: No controller found.
Welcome to Fedora Core





                  ┌──────────┤ Configure TCP/IP ├───────────┐
                  │                                         │
                  │ [*] Use dynamic IP configuration (DHCP) │
           ┌────────────────────┤ Dynamic IP ├─────────────────────┐
           │                                                       │
           │ Sending request for IP information for eth0...        │
=========================================================          │
[ INFO: possible irq lock inversion dependency detected ]──────────┘
2.6.17-1.2630.fc6xen #1
---------------------------------------------------------   │
loader/230 just changed the state of lock:                  │
 (&np->rx_lock){-...}, at: [<d1160d9f>] network_open+0x28/0x83 [xennet]
but this lock was taken by another, hard-irq-safe lock in the past:
 (&np->tx_lock){+...}

and interrupts could create inverse lock ordering between them.

  <Tab>/<Alt-Tab> between elements  | <Space> selects | <F12> next screen
other info that might help us debug this:
1 lock held by loader/230:
 #0:  (rtnl_mutex){--..}, at: [<c060c8ee>] mutex_lock+0x21/0x24

the first lock's dependencies:
-> (&np->rx_lock){-...} ops: 0 {
   initial-use  at:
                        [<c043788a>] lock_acquire+0x59/0x7f
                        [<c060da1d>] _spin_lock+0x19/0x28
                        [<d115fe49>] backend_changed+0x87/0x1da [xennet]
                        [<c0551cf5>] otherend_changed+0x5a/0x60
                        [<c0550488>] xenwatch_handle_callback+0x15/0x48
                        [<c0550ee4>] xenwatch_thread+0xfe/0x114
                        [<c0431b5d>] kthread+0xc3/0xf2
                        [<c04029a5>] kernel_thread_helper+0x5/0xb
   hardirq-on-W at:
                        [<c043788a>] lock_acquire+0x59/0x7f
                        [<c060da1d>] _spin_lock+0x19/0x28
                        [<d1160d9f>] network_open+0x28/0x83 [xennet]
                        [<c05b404b>] dev_open+0x2e/0x66
                        [<c05b292a>] dev_change_flags+0x51/0xf1
                        [<c05bae54>] do_setlink+0x73/0x383
                        [<c05ba887>] rtnetlink_rcv_msg+0x1b3/0x1d6
                        [<c05c619b>] netlink_run_queue+0x69/0xfe
                        [<c05ba68a>] rtnetlink_rcv+0x29/0x42
                        [<c05c6628>] netlink_data_ready+0x12/0x50
                        [<c05c5690>] netlink_sendskb+0x1f/0x37
                        [<c05c5f69>] netlink_unicast+0x1a1/0x1bb
                        [<c05c6609>] netlink_sendmsg+0x275/0x282
                        [<c05a9a7a>] sock_sendmsg+0xe8/0x103
                        [<c05aa289>] sys_sendmsg+0x14d/0x1a8
                        [<c05ab473>] sys_socketcall+0x16b/0x186
                        [<c0404dfb>] syscall_call+0x7/0xb
 }
 ... key      at: [<d1166780>] __key.28899+0x0/0xffffb22b [xennet]
 -> (lweventlist_lock){....} ops: 0 {
    initial-use  at:
                          [<c043788a>] lock_acquire+0x59/0x7f
                          [<c060db6e>] _spin_lock_irqsave+0x26/0x36
                          [<c05bb4da>] linkwatch_fire_event+0x5c/0xbe
                          [<c05c1aaf>] netif_carrier_off+0x18/0x1a
                          [<d116011d>] netfront_probe+0x93/0x31f [xennet]
                          [<c0551d46>] xenbus_dev_probe+0x4b/0x9f
                          [<c054730e>] driver_probe_device+0x45/0x92
                          [<c054743b>] __driver_attach+0x68/0x93
                          [<c0546d87>] bus_for_each_dev+0x3a/0x5f
                          [<c0547269>] driver_attach+0x14/0x17
                          [<c0546a5e>] bus_add_driver+0x68/0x106
                          [<c05476e4>] driver_register+0x78/0x7d
                          [<c055178e>] xenbus_register_driver_common+0x2e/0x3f
                          [<c05517d3>] xenbus_register_frontend+0x1b/0x2e
                          [<d102402e>] 0xd102402e
                          [<c043dc5e>] sys_init_module+0x16ad/0x1856
                          [<c0404dfb>] syscall_call+0x7/0xb
  }
  ... key      at: [<c06a2fd0>] lweventlist_lock+0x10/0x1c
 ... acquired at:
   [<c043788a>] lock_acquire+0x59/0x7f
   [<c060db6e>] _spin_lock_irqsave+0x26/0x36
   [<c05bb4da>] linkwatch_fire_event+0x5c/0xbe
   [<c05c1aca>] netif_carrier_on+0x19/0x2a
   [<d115ff43>] backend_changed+0x181/0x1da [xennet]
   [<c0551cf5>] otherend_changed+0x5a/0x60
   [<c0550488>] xenwatch_handle_callback+0x15/0x48
   [<c0550ee4>] xenwatch_thread+0xfe/0x114
   [<c0431b5d>] kthread+0xc3/0xf2
   [<c04029a5>] kernel_thread_helper+0x5/0xb

 -> (base_lock_keys + cpu){++..} ops: 0 {
    initial-use  at:
                          [<c043788a>] lock_acquire+0x59/0x7f
                          [<c060db6e>] _spin_lock_irqsave+0x26/0x36
                          [<c0428fb7>] lock_timer_base+0x18/0x33
                          [<c042905f>] __mod_timer+0x26/0xad
                          [<c042967b>] mod_timer+0x25/0x2b
                          [<c07ba7e6>] con_init+0xb5/0x1ec
                          [<c07ba2d5>] console_init+0x1e/0x2c
                          [<c07a5634>] start_kernel+0x1c5/0x3b4
                          [<c040006f>] 0xc040006f
    in-hardirq-W at:
                          [<c043788a>] lock_acquire+0x59/0x7f
                          [<c060db6e>] _spin_lock_irqsave+0x26/0x36
                          [<c0428fb7>] lock_timer_base+0x18/0x33
                          [<c042905f>] __mod_timer+0x26/0xad
                          [<c042f1b1>] queue_delayed_work+0x66/0x72
                          [<c042f1ce>] schedule_delayed_work+0x11/0x13
                          [<c05296f2>] tty_flip_buffer_push+0x4f/0x53
                          [<c054e7ec>] xencons_rx+0x11a/0x12e
                          [<c054eae9>] handle_input+0x82/0xee
                          [<c0448dc8>] handle_IRQ_event+0x20/0x51
                          [<c0448e8d>] __do_IRQ+0x94/0xef
                          [<c0406aa7>] do_IRQ+0x9e/0xbf
    in-softirq-W at:
                          [<c043788a>] lock_acquire+0x59/0x7f
                          [<c060db03>] _spin_lock_irq+0x23/0x32
                          [<c042939b>] run_timer_softirq+0x3d/0x167
                          [<c0424c22>] __do_softirq+0x7c/0xfe
                          [<c040699f>] do_softirq+0x5e/0xc8
  }
  ... key      at: [<c0848e60>] base_lock_keys+0x0/0x100
 ... acquired at:
   [<c043788a>] lock_acquire+0x59/0x7f
   [<c060db6e>] _spin_lock_irqsave+0x26/0x36
   [<c0428fb7>] lock_timer_base+0x18/0x33
   [<c042905f>] __mod_timer+0x26/0xad
   [<c042f1b1>] queue_delayed_work+0x66/0x72
   [<c042f1ce>] schedule_delayed_work+0x11/0x13
   [<c05bb536>] linkwatch_fire_event+0xb8/0xbe
   [<c05c1aca>] netif_carrier_on+0x19/0x2a
   [<d115ff43>] backend_changed+0x181/0x1da [xennet]
   [<c0551cf5>] otherend_changed+0x5a/0x60
   [<c0550488>] xenwatch_handle_callback+0x15/0x48
   [<c0550ee4>] xenwatch_thread+0xfe/0x114
   [<c0431b5d>] kthread+0xc3/0xf2
   [<c04029a5>] kernel_thread_helper+0x5/0xb

 -> (&parent->list_lock){++..} ops: 0 {
    initial-use  at:
                          [<c043788a>] lock_acquire+0x59/0x7f
                          [<c060da1d>] _spin_lock+0x19/0x28
                          [<c0468c39>] cache_alloc_refill+0x64/0x480
                          [<c0469167>] kmem_cache_zalloc+0x5c/0xa9
                          [<c0469878>] kmem_cache_create+0x163/0x464
                          [<c07b4d93>] kmem_cache_init+0x152/0x397
                          [<c07a569a>] start_kernel+0x22b/0x3b4
                          [<c040006f>] 0xc040006f
    in-hardirq-W at:
                          [<c043788a>] lock_acquire+0x59/0x7f
                          [<c060da1d>] _spin_lock+0x19/0x28
                          [<c0468c39>] cache_alloc_refill+0x64/0x480
                          [<c04690dc>] __kmalloc+0x87/0xb6
                          [<c0529887>] tty_buffer_request_room+0xb5/0x122
                          [<c052b404>] tty_insert_flip_string_flags+0x26/0x85
                          [<c054e7d2>] xencons_rx+0x100/0x12e
                          [<c054eae9>] handle_input+0x82/0xee
                          [<c0448dc8>] handle_IRQ_event+0x20/0x51
                          [<c0448e8d>] __do_IRQ+0x94/0xef
                          [<c0406aa7>] do_IRQ+0x9e/0xbf
    in-softirq-W at:
                          [<c043788a>] lock_acquire+0x59/0x7f
                          [<c060da1d>] _spin_lock+0x19/0x28
                          [<c0468628>] cache_flusharray+0x25/0xa4
                          [<c04687f7>] kmem_cache_free+0x6e/0x9e
                          [<c041dbbc>] free_task+0x21/0x24
                          [<c041f195>] __put_task_struct+0xf2/0xf7
                          [<c0421411>] delayed_put_task_struct+0x1e/0x20
                          [<c042fd0f>] __rcu_process_callbacks+0x106/0x165
                          [<c0430078>] rcu_process_callbacks+0x23/0x45
                          [<c0424d11>] tasklet_action+0x6d/0xda
                          [<c0424c22>] __do_softirq+0x7c/0xfe
                          [<c040699f>] do_softirq+0x5e/0xc8
  }
  ... key      at: [<c098182c>] __key.17185+0x0/0x8
  -> (&zone->lock){....} ops: 0 {
     initial-use  at:
                            [<c043788a>] lock_acquire+0x59/0x7f
                            [<c060da1d>] _spin_lock+0x19/0x28
                            [<c04520a0>] free_pages_bulk+0x1c/0x1d4
                            [<c0452687>] __free_pages_ok+0x159/0x183
                            [<c04526e4>] __free_pages+0x33/0x35
                            [<c07b490d>] __free_pages_bootmem+0xae/0xb2
                            [<c07b3b15>] free_all_bootmem_core+0xb3/0x153
                            [<c07b3bc2>] free_all_bootmem+0xd/0xf
                            [<c07b12f4>] mem_init+0x17d/0x393
                            [<c07a5695>] start_kernel+0x226/0x3b4
                            [<c040006f>] 0xc040006f
   }
   ... key      at: [<c097a5b0>] __key.21423+0x0/0x10
  ... acquired at:
   [<c043788a>] lock_acquire+0x59/0x7f
   [<c060da1d>] _spin_lock+0x19/0x28
   [<c04520a0>] free_pages_bulk+0x1c/0x1d4
   [<c0452687>] __free_pages_ok+0x159/0x183
   [<c04526e4>] __free_pages+0x33/0x35
   [<c0452713>] free_pages+0x2d/0x2f
   [<c04684c4>] kmem_freepages+0x8b/0xae
   [<c0468897>] slab_destroy+0x70/0x8c
   [<c046895a>] free_block+0xa7/0xdc
   [<c0468a04>] drain_array+0x75/0x99
   [<c0469e7f>] cache_reap+0x71/0x108
   [<c042ec96>] run_workqueue+0x7a/0xbb
   [<c042f5cb>] worker_thread+0xd2/0x107
   [<c0431b5d>] kthread+0xc3/0xf2
   [<c04029a5>] kernel_thread_helper+0x5/0xb

 ... acquired at:
   [<c043788a>] lock_acquire+0x59/0x7f
   [<c060da1d>] _spin_lock+0x19/0x28
   [<c0468c39>] cache_alloc_refill+0x64/0x480
   [<c0468baa>] kmem_cache_alloc+0x5c/0x87
   [<c05af59e>] alloc_skb_from_cache+0x46/0x111
   [<c054d5f4>] __alloc_skb+0x6f/0x77
   [<d115f951>] network_alloc_rx_buffers+0x58/0x3a0 [xennet]
   [<d115ff5c>] backend_changed+0x19a/0x1da [xennet]
   [<c0551cf5>] otherend_changed+0x5a/0x60
   [<c0550488>] xenwatch_handle_callback+0x15/0x48
   [<c0550ee4>] xenwatch_thread+0xfe/0x114
   [<c0431b5d>] kthread+0xc3/0xf2
   [<c04029a5>] kernel_thread_helper+0x5/0xb

 -> (&zone->lock){....} ops: 0 {
    initial-use  at:
                          [<c043788a>] lock_acquire+0x59/0x7f
                          [<c060da1d>] _spin_lock+0x19/0x28
                          [<c04520a0>] free_pages_bulk+0x1c/0x1d4
                          [<c0452687>] __free_pages_ok+0x159/0x183
                          [<c04526e4>] __free_pages+0x33/0x35
                          [<c07b490d>] __free_pages_bootmem+0xae/0xb2
                          [<c07b3b15>] free_all_bootmem_core+0xb3/0x153
                          [<c07b3bc2>] free_all_bootmem+0xd/0xf
                          [<c07b12f4>] mem_init+0x17d/0x393
                          [<c07a5695>] start_kernel+0x226/0x3b4
                          [<c040006f>] 0xc040006f
  }
  ... key      at: [<c097a5b0>] __key.21423+0x0/0x10
 ... acquired at:
   [<c043788a>] lock_acquire+0x59/0x7f
   [<c060da1d>] _spin_lock+0x19/0x28
   [<c0452817>] get_page_from_freelist+0xf5/0x35a
   [<c0452ae3>] __alloc_pages+0x67/0x287
   [<d115f968>] network_alloc_rx_buffers+0x6f/0x3a0 [xennet]
   [<d115ff5c>] backend_changed+0x19a/0x1da [xennet]
   [<c0551cf5>] otherend_changed+0x5a/0x60
   [<c0550488>] xenwatch_handle_callback+0x15/0x48
   [<c0550ee4>] xenwatch_thread+0xfe/0x114
   [<c0431b5d>] kthread+0xc3/0xf2
   [<c04029a5>] kernel_thread_helper+0x5/0xb

 -> (balloon_lock){....} ops: 0 {
    initial-use  at:
                          [<c043788a>] lock_acquire+0x59/0x7f
                          [<c060db6e>] _spin_lock_irqsave+0x26/0x36
                          [<c055297a>] balloon_update_driver_allowance+0x10/0x25
                          [<d115fbbe>] network_alloc_rx_buffers+0x2c5/0x3a0 [xennet]
                          [<d115ff5c>] backend_changed+0x19a/0x1da [xennet]
                          [<c0551cf5>] otherend_changed+0x5a/0x60
                          [<c0550488>] xenwatch_handle_callback+0x15/0x48
                          [<c0550ee4>] xenwatch_thread+0xfe/0x114
                          [<c0431b5d>] kthread+0xc3/0xf2
                          [<c04029a5>] kernel_thread_helper+0x5/0xb
  }
  ... key      at: [<c0694f30>] balloon_lock+0x10/0x1c
 ... acquired at:
   [<c043788a>] lock_acquire+0x59/0x7f
   [<c060db6e>] _spin_lock_irqsave+0x26/0x36
   [<c055297a>] balloon_update_driver_allowance+0x10/0x25
   [<d115fbbe>] network_alloc_rx_buffers+0x2c5/0x3a0 [xennet]
   [<d115ff5c>] backend_changed+0x19a/0x1da [xennet]
   [<c0551cf5>] otherend_changed+0x5a/0x60
   [<c0550488>] xenwatch_handle_callback+0x15/0x48
   [<c0550ee4>] xenwatch_thread+0xfe/0x114
   [<c0431b5d>] kthread+0xc3/0xf2
   [<c04029a5>] kernel_thread_helper+0x5/0xb


the second lock's dependencies:
-> (&np->tx_lock){+...} ops: 0 {
   initial-use  at:
                        [<c043788a>] lock_acquire+0x59/0x7f
                        [<c060db03>] _spin_lock_irq+0x23/0x32
                        [<d115fe39>] backend_changed+0x77/0x1da [xennet]
                        [<c0551cf5>] otherend_changed+0x5a/0x60
                        [<c0550488>] xenwatch_handle_callback+0x15/0x48
                        [<c0550ee4>] xenwatch_thread+0xfe/0x114
                        [<c0431b5d>] kthread+0xc3/0xf2
                        [<c04029a5>] kernel_thread_helper+0x5/0xb
   in-hardirq-W at:
                        [<c043788a>] lock_acquire+0x59/0x7f
                        [<c060db6e>] _spin_lock_irqsave+0x26/0x36
                        [<d1160871>] netif_int+0x19/0x68 [xennet]
                        [<c0448dc8>] handle_IRQ_event+0x20/0x51
                        [<c0448e8d>] __do_IRQ+0x94/0xef
                        [<c0406aa7>] do_IRQ+0x9e/0xbf
 }
 ... key      at: [<d1166788>] __key.28898+0x0/0xffffb223 [xennet]
 -> (&np->rx_lock){-...} ops: 0 {
    initial-use  at:
                          [<c043788a>] lock_acquire+0x59/0x7f
                          [<c060da1d>] _spin_lock+0x19/0x28
                          [<d115fe49>] backend_changed+0x87/0x1da [xennet]
                          [<c0551cf5>] otherend_changed+0x5a/0x60
                          [<c0550488>] xenwatch_handle_callback+0x15/0x48
                          [<c0550ee4>] xenwatch_thread+0xfe/0x114
                          [<c0431b5d>] kthread+0xc3/0xf2
                          [<c04029a5>] kernel_thread_helper+0x5/0xb
    hardirq-on-W at:
                          [<c043788a>] lock_acquire+0x59/0x7f
                          [<c060da1d>] _spin_lock+0x19/0x28
                          [<d1160d9f>] network_open+0x28/0x83 [xennet]
                          [<c05b404b>] dev_open+0x2e/0x66
                          [<c05b292a>] dev_change_flags+0x51/0xf1
                          [<c05bae54>] do_setlink+0x73/0x383
                          [<c05ba887>] rtnetlink_rcv_msg+0x1b3/0x1d6
                          [<c05c619b>] netlink_run_queue+0x69/0xfe
                          [<c05ba68a>] rtnetlink_rcv+0x29/0x42
                          [<c05c6628>] netlink_data_ready+0x12/0x50
                          [<c05c5690>] netlink_sendskb+0x1f/0x37
                          [<c05c5f69>] netlink_unicast+0x1a1/0x1bb
                          [<c05c6609>] netlink_sendmsg+0x275/0x282
                          [<c05a9a7a>] sock_sendmsg+0xe8/0x103
                          [<c05aa289>] sys_sendmsg+0x14d/0x1a8
                          [<c05ab473>] sys_socketcall+0x16b/0x186
                          [<c0404dfb>] syscall_call+0x7/0xb
  }
  ... key      at: [<d1166780>] __key.28899+0x0/0xffffb22b [xennet]
  -> (lweventlist_lock){....} ops: 0 {
     initial-use  at:
                            [<c043788a>] lock_acquire+0x59/0x7f
                            [<c060db6e>] _spin_lock_irqsave+0x26/0x36
                            [<c05bb4da>] linkwatch_fire_event+0x5c/0xbe
                            [<c05c1aaf>] netif_carrier_off+0x18/0x1a
                            [<d116011d>] netfront_probe+0x93/0x31f [xennet]
                            [<c0551d46>] xenbus_dev_probe+0x4b/0x9f
                            [<c054730e>] driver_probe_device+0x45/0x92
                            [<c054743b>] __driver_attach+0x68/0x93
                            [<c0546d87>] bus_for_each_dev+0x3a/0x5f
                            [<c0547269>] driver_attach+0x14/0x17
                            [<c0546a5e>] bus_add_driver+0x68/0x106
                            [<c05476e4>] driver_register+0x78/0x7d
                            [<c055178e>] xenbus_register_driver_common+0x2e/0x3f
                            [<c05517d3>] xenbus_register_frontend+0x1b/0x2e
                            [<d102402e>] 0xd102402e
                            [<c043dc5e>] sys_init_module+0x16ad/0x1856
                            [<c0404dfb>] syscall_call+0x7/0xb
   }
   ... key      at: [<c06a2fd0>] lweventlist_lock+0x10/0x1c
  ... acquired at:
   [<c043788a>] lock_acquire+0x59/0x7f
   [<c060db6e>] _spin_lock_irqsave+0x26/0x36
   [<c05bb4da>] linkwatch_fire_event+0x5c/0xbe
   [<c05c1aca>] netif_carrier_on+0x19/0x2a
   [<d115ff43>] backend_changed+0x181/0x1da [xennet]
   [<c0551cf5>] otherend_changed+0x5a/0x60
   [<c0550488>] xenwatch_handle_callback+0x15/0x48
   [<c0550ee4>] xenwatch_thread+0xfe/0x114
   [<c0431b5d>] kthread+0xc3/0xf2
   [<c04029a5>] kernel_thread_helper+0x5/0xb

  -> (base_lock_keys + cpu){++..} ops: 0 {
     initial-use  at:
                            [<c043788a>] lock_acquire+0x59/0x7f
                            [<c060db6e>] _spin_lock_irqsave+0x26/0x36
                            [<c0428fb7>] lock_timer_base+0x18/0x33
                            [<c042905f>] __mod_timer+0x26/0xad
                            [<c042967b>] mod_timer+0x25/0x2b
                            [<c07ba7e6>] con_init+0xb5/0x1ec
                            [<c07ba2d5>] console_init+0x1e/0x2c
                            [<c07a5634>] start_kernel+0x1c5/0x3b4
                            [<c040006f>] 0xc040006f
     in-hardirq-W at:
                            [<c043788a>] lock_acquire+0x59/0x7f
                            [<c060db6e>] _spin_lock_irqsave+0x26/0x36
                            [<c0428fb7>] lock_timer_base+0x18/0x33
                            [<c042905f>] __mod_timer+0x26/0xad
                            [<c042f1b1>] queue_delayed_work+0x66/0x72
                            [<c042f1ce>] schedule_delayed_work+0x11/0x13
                            [<c05296f2>] tty_flip_buffer_push+0x4f/0x53
                            [<c054e7ec>] xencons_rx+0x11a/0x12e
                            [<c054eae9>] handle_input+0x82/0xee
                            [<c0448dc8>] handle_IRQ_event+0x20/0x51
                            [<c0448e8d>] __do_IRQ+0x94/0xef
                            [<c0406aa7>] do_IRQ+0x9e/0xbf
     in-softirq-W at:
                            [<c043788a>] lock_acquire+0x59/0x7f
                            [<c060db03>] _spin_lock_irq+0x23/0x32
                            [<c042939b>] run_timer_softirq+0x3d/0x167
                            [<c0424c22>] __do_softirq+0x7c/0xfe
                            [<c040699f>] do_softirq+0x5e/0xc8
   }
   ... key      at: [<c0848e60>] base_lock_keys+0x0/0x100
  ... acquired at:
   [<c043788a>] lock_acquire+0x59/0x7f
   [<c060db6e>] _spin_lock_irqsave+0x26/0x36
   [<c0428fb7>] lock_timer_base+0x18/0x33
   [<c042905f>] __mod_timer+0x26/0xad
   [<c042f1b1>] queue_delayed_work+0x66/0x72
   [<c042f1ce>] schedule_delayed_work+0x11/0x13
   [<c05bb536>] linkwatch_fire_event+0xb8/0xbe
   [<c05c1aca>] netif_carrier_on+0x19/0x2a
   [<d115ff43>] backend_changed+0x181/0x1da [xennet]
   [<c0551cf5>] otherend_changed+0x5a/0x60
   [<c0550488>] xenwatch_handle_callback+0x15/0x48
   [<c0550ee4>] xenwatch_thread+0xfe/0x114
   [<c0431b5d>] kthread+0xc3/0xf2
   [<c04029a5>] kernel_thread_helper+0x5/0xb

  -> (&parent->list_lock){++..} ops: 0 {
     initial-use  at:
                            [<c043788a>] lock_acquire+0x59/0x7f
                            [<c060da1d>] _spin_lock+0x19/0x28
                            [<c0468c39>] cache_alloc_refill+0x64/0x480
                            [<c0469167>] kmem_cache_zalloc+0x5c/0xa9
                            [<c0469878>] kmem_cache_create+0x163/0x464
                            [<c07b4d93>] kmem_cache_init+0x152/0x397
                            [<c07a569a>] start_kernel+0x22b/0x3b4
                            [<c040006f>] 0xc040006f
     in-hardirq-W at:
                            [<c043788a>] lock_acquire+0x59/0x7f
                            [<c060da1d>] _spin_lock+0x19/0x28
                            [<c0468c39>] cache_alloc_refill+0x64/0x480
                            [<c04690dc>] __kmalloc+0x87/0xb6
                            [<c0529887>] tty_buffer_request_room+0xb5/0x122
                            [<c052b404>] tty_insert_flip_string_flags+0x26/0x85
                            [<c054e7d2>] xencons_rx+0x100/0x12e
                            [<c054eae9>] handle_input+0x82/0xee
                            [<c0448dc8>] handle_IRQ_event+0x20/0x51
                            [<c0448e8d>] __do_IRQ+0x94/0xef
                            [<c0406aa7>] do_IRQ+0x9e/0xbf
     in-softirq-W at:
                            [<c043788a>] lock_acquire+0x59/0x7f
                            [<c060da1d>] _spin_lock+0x19/0x28
                            [<c0468628>] cache_flusharray+0x25/0xa4
                            [<c04687f7>] kmem_cache_free+0x6e/0x9e
                            [<c041dbbc>] free_task+0x21/0x24
                            [<c041f195>] __put_task_struct+0xf2/0xf7
                            [<c0421411>] delayed_put_task_struct+0x1e/0x20
                            [<c042fd0f>] __rcu_process_callbacks+0x106/0x165
                            [<c0430078>] rcu_process_callbacks+0x23/0x45
                            [<c0424d11>] tasklet_action+0x6d/0xda
                            [<c0424c22>] __do_softirq+0x7c/0xfe
                            [<c040699f>] do_softirq+0x5e/0xc8
   }
   ... key      at: [<c098182c>] __key.17185+0x0/0x8
   -> (&zone->lock){....} ops: 0 {
      initial-use  at:
                              [<c043788a>] lock_acquire+0x59/0x7f
                              [<c060da1d>] _spin_lock+0x19/0x28
                              [<c04520a0>] free_pages_bulk+0x1c/0x1d4
                              [<c0452687>] __free_pages_ok+0x159/0x183
                              [<c04526e4>] __free_pages+0x33/0x35
                              [<c07b490d>] __free_pages_bootmem+0xae/0xb2
                              [<c07b3b15>] free_all_bootmem_core+0xb3/0x153
                              [<c07b3bc2>] free_all_bootmem+0xd/0xf
                              [<c07b12f4>] mem_init+0x17d/0x393
                              [<c07a5695>] start_kernel+0x226/0x3b4
                              [<c040006f>] 0xc040006f
    }
    ... key      at: [<c097a5b0>] __key.21423+0x0/0x10
   ... acquired at:
   [<c043788a>] lock_acquire+0x59/0x7f
   [<c060da1d>] _spin_lock+0x19/0x28
   [<c04520a0>] free_pages_bulk+0x1c/0x1d4
   [<c0452687>] __free_pages_ok+0x159/0x183
   [<c04526e4>] __free_pages+0x33/0x35
   [<c0452713>] free_pages+0x2d/0x2f
   [<c04684c4>] kmem_freepages+0x8b/0xae
   [<c0468897>] slab_destroy+0x70/0x8c
   [<c046895a>] free_block+0xa7/0xdc
   [<c0468a04>] drain_array+0x75/0x99
   [<c0469e7f>] cache_reap+0x71/0x108
   [<c042ec96>] run_workqueue+0x7a/0xbb
   [<c042f5cb>] worker_thread+0xd2/0x107
   [<c0431b5d>] kthread+0xc3/0xf2
   [<c04029a5>] kernel_thread_helper+0x5/0xb

  ... acquired at:
   [<c043788a>] lock_acquire+0x59/0x7f
   [<c060da1d>] _spin_lock+0x19/0x28
   [<c0468c39>] cache_alloc_refill+0x64/0x480
   [<c0468baa>] kmem_cache_alloc+0x5c/0x87
   [<c05af59e>] alloc_skb_from_cache+0x46/0x111
   [<c054d5f4>] __alloc_skb+0x6f/0x77
   [<d115f951>] network_alloc_rx_buffers+0x58/0x3a0 [xennet]
   [<d115ff5c>] backend_changed+0x19a/0x1da [xennet]
   [<c0551cf5>] otherend_changed+0x5a/0x60
   [<c0550488>] xenwatch_handle_callback+0x15/0x48
   [<c0550ee4>] xenwatch_thread+0xfe/0x114
   [<c0431b5d>] kthread+0xc3/0xf2
   [<c04029a5>] kernel_thread_helper+0x5/0xb

  -> (&zone->lock){....} ops: 0 {
     initial-use  at:
                            [<c043788a>] lock_acquire+0x59/0x7f
                            [<c060da1d>] _spin_lock+0x19/0x28
                            [<c04520a0>] free_pages_bulk+0x1c/0x1d4
                            [<c0452687>] __free_pages_ok+0x159/0x183
                            [<c04526e4>] __free_pages+0x33/0x35
                            [<c07b490d>] __free_pages_bootmem+0xae/0xb2
                            [<c07b3b15>] free_all_bootmem_core+0xb3/0x153
                            [<c07b3bc2>] free_all_bootmem+0xd/0xf
                            [<c07b12f4>] mem_init+0x17d/0x393
                            [<c07a5695>] start_kernel+0x226/0x3b4
                            [<c040006f>] 0xc040006f
   }
   ... key      at: [<c097a5b0>] __key.21423+0x0/0x10
  ... acquired at:
   [<c043788a>] lock_acquire+0x59/0x7f
   [<c060da1d>] _spin_lock+0x19/0x28
   [<c0452817>] get_page_from_freelist+0xf5/0x35a
   [<c0452ae3>] __alloc_pages+0x67/0x287
   [<d115f968>] network_alloc_rx_buffers+0x6f/0x3a0 [xennet]
   [<d115ff5c>] backend_changed+0x19a/0x1da [xennet]
   [<c0551cf5>] otherend_changed+0x5a/0x60
   [<c0550488>] xenwatch_handle_callback+0x15/0x48
   [<c0550ee4>] xenwatch_thread+0xfe/0x114
   [<c0431b5d>] kthread+0xc3/0xf2
   [<c04029a5>] kernel_thread_helper+0x5/0xb

  -> (balloon_lock){....} ops: 0 {
     initial-use  at:
                            [<c043788a>] lock_acquire+0x59/0x7f
                            [<c060db6e>] _spin_lock_irqsave+0x26/0x36
                            [<c055297a>] balloon_update_driver_allowance+0x10/0x25
                            [<d115fbbe>] network_alloc_rx_buffers+0x2c5/0x3a0 [xennet]
                            [<d115ff5c>] backend_changed+0x19a/0x1da [xennet]
                            [<c0551cf5>] otherend_changed+0x5a/0x60
                            [<c0550488>] xenwatch_handle_callback+0x15/0x48
                            [<c0550ee4>] xenwatch_thread+0xfe/0x114
                            [<c0431b5d>] kthread+0xc3/0xf2
                            [<c04029a5>] kernel_thread_helper+0x5/0xb
   }
   ... key      at: [<c0694f30>] balloon_lock+0x10/0x1c
  ... acquired at:
   [<c043788a>] lock_acquire+0x59/0x7f
   [<c060db6e>] _spin_lock_irqsave+0x26/0x36
   [<c055297a>] balloon_update_driver_allowance+0x10/0x25
   [<d115fbbe>] network_alloc_rx_buffers+0x2c5/0x3a0 [xennet]
   [<d115ff5c>] backend_changed+0x19a/0x1da [xennet]
   [<c0551cf5>] otherend_changed+0x5a/0x60
   [<c0550488>] xenwatch_handle_callback+0x15/0x48
   [<c0550ee4>] xenwatch_thread+0xfe/0x114
   [<c0431b5d>] kthread+0xc3/0xf2
   [<c04029a5>] kernel_thread_helper+0x5/0xb

 ... acquired at:
   [<c043788a>] lock_acquire+0x59/0x7f
   [<c060da1d>] _spin_lock+0x19/0x28
   [<d115fe49>] backend_changed+0x87/0x1da [xennet]
   [<c0551cf5>] otherend_changed+0x5a/0x60
   [<c0550488>] xenwatch_handle_callback+0x15/0x48
   [<c0550ee4>] xenwatch_thread+0xfe/0x114
   [<c0431b5d>] kthread+0xc3/0xf2
   [<c04029a5>] kernel_thread_helper+0x5/0xb


stack backtrace:
 [<c0405666>] show_trace_log_lvl+0x58/0x177
 [<c0405c6b>] show_trace+0xd/0x10
 [<c0405ca9>] dump_stack+0x19/0x1b
 [<c0435d60>] print_irq_inversion_bug+0xe6/0xf3
 [<c0435e5e>] check_usage_backwards+0x32/0x3b
 [<c043612d>] mark_lock+0x20b/0x353
 [<c0436d6e>] __lock_acquire+0x433/0x9a0
 [<c043788a>] lock_acquire+0x59/0x7f
 [<c060da1d>] _spin_lock+0x19/0x28
 [<d1160d9f>] network_open+0x28/0x83 [xennet]
 [<c05b404b>] dev_open+0x2e/0x66
 [<c05b292a>] dev_change_flags+0x51/0xf1
 [<c05bae54>] do_setlink+0x73/0x383
 [<c05ba887>] rtnetlink_rcv_msg+0x1b3/0x1d6
 [<c05c619b>] netlink_run_queue+0x69/0xfe
 [<c05ba68a>] rtnetlink_rcv+0x29/0x42
 [<c05c6628>] netlink_data_ready+0x12/0x50
 [<c05c5690>] netlink_sendskb+0x1f/0x37
 [<c05c5f69>] netlink_unicast+0x1a1/0x1bb
 [<c05c6609>] netlink_sendmsg+0x275/0x282
 [<c05a9a7a>] sock_sendmsg+0xe8/0x103
 [<c05aa289>] sys_sendmsg+0x14d/0x1a8
 [<c05ab473>] sys_socketcall+0x16b/0x186
 [<c0404dfb>] syscall_call+0x7/0xb
DWARF2 unwinder stuck at syscall_call+0x7/0xb
Leftover inexact backtrace:
Inexact backtrace:
 [<c0405c6b>] show_trace+0xd/0x10
 [<c0405ca9>] dump_stack+0x19/0x1b
 [<c0435d60>] print_irq_inversion_bug+0xe6/0xf3
 [<c0435e5e>] check_usage_backwards+0x32/0x3b
 [<c043612d>] mark_lock+0x20b/0x353
 [<c0436d6e>] __lock_acquire+0x433/0x9a0
 [<c043788a>] lock     ┌───────────┤ Error ├────────────┐
 [<c060da1d>] _spi     │                                │
 [<d1160d9f>] netw     │ That directory could not be    │
 [<c05b404b            │ mounted from the server.       │
 [<c05b292a            │                                │
 [<c05bae54            │            ┌────┐              │
 [<c05ba887            │            │ OK eth0: no IPv6 routers present
 [<c05c619b            │            └────┘              │
 [<c05ba68a>           │                                │
 [<c05c6628>] netl     │                                │
 [<c05c5690>] netl     └────────────────────────────────┘
 [<c05c5f69>] netl
 [<c05c6609>] netli
 [<c05a9a7a>] sock_sendmsg+0xe8/0x103
 [<c05aa289>] sys_sendmsg+0x14d/0x1a8
 [<c05ab473>] sys_socketcall+0x16b/0x186
 [<c0404dfb>] syscall_call+0x7/0xb

sending termination signals...done
sending kill signals...done
disabling swap...
        /dev/mapper/VolGroup00-LogVol01
unmounting filesystems...
        /mnt/runtime done
        disabling /dev/loop0
        /proc done
        /dev/pts done
        /sys done
        /tmp/ramfs done
        /mnt/source done
        /selinux done
        /mnt/sysimage/boot done
        /mnt/sysimage/proc done
        /mnt/sysimage/sys done
        /mnt/sysimage/selinux done
        /mnt/sysimage/dev done
        /mnt/sysimage done
rebooting system
Restarting system.
libvir: Xen Daemon error : GET operation failed: No such domain test
Guest installation complete... restarting guest.
libvir: Xen Daemon error : GET operation failed: No such domain test
Linux version 2.6.17-1.2630.fc6xen (brewbuilder at hs20-bc1-7.build.redhat.com) (gcc version 4.1.1 20060828 (Red Hat 4.1.1-20)) #1 SMP Wed Sep 6 17:22:21 EDT 2006
BIOS-provided physical RAM map:
 Xen: 0000000000000000 - 0000000010800000 (usable)
0MB HIGHMEM available.
264MB LOWMEM available.
Using x86 segment limits to approximate NX protection
ACPI in unprivileged domain disabled
Built 1 zonelists.  Total pages: 67584
Kernel command line:  ro root=/dev/VolGroup00/LogVol00 console=xvc0
Enabling fast FPU save and restore... done.
Enabling unmasked SIMD FPU exception support... done.
Initializing CPU#0
CPU 0 irqstacks, hard=c07f7000 soft=c07d7000
PID hash table entries: 2048 (order: 11, 8192 bytes)
Xen reported: 3000.350 MHz processor.
Console: colour dummy device 80x25
Lock dependency validator: Copyright (c) 2006 Red Hat, Inc., Ingo Molnar
... MAX_LOCKDEP_SUBCLASSES:    8
... MAX_LOCK_DEPTH:          30
... MAX_LOCKDEP_KEYS:        2048
... CLASSHASH_SIZE:           1024
... MAX_LOCKDEP_ENTRIES:     8192
... MAX_LOCKDEP_CHAINS:      8192
... CHAINHASH_SIZE:          4096
 memory used by lock dependency info: 696 kB
 per task-struct memory footprint: 1200 bytes
Dentry cache hash table entries: 65536 (order: 6, 262144 bytes)
Inode-cache hash table entries: 32768 (order: 5, 131072 bytes)
Software IO TLB disabled
vmalloc area: d1000000-f4ffe000, maxmem 2d7fe000
Memory: 247928k/270336k available (2117k kernel code, 13908k reserved, 1116k data, 184k init, 0k highmem)
Checking if this processor honours the WP bit even in supervisor mode... Ok.
Calibrating delay using timer specific routine.. 7515.44 BogoMIPS (lpj=15030892)
Security Framework v1.0.0 initialized
SELinux:  Initializing.
SELinux:  Starting in permissive mode
selinux_register_security:  Registering secondary module capability
Capability LSM initialized as secondary
Mount-cache hash table entries: 512
CPU: Trace cache: 12K uops, L1 D cache: 16K
CPU: L2 cache: 2048K
Checking 'hlt' instruction... OK.
SMP alternatives: switching to UP code
Freeing SMP alternatives: 12k freed
Brought up 1 CPUs
checking if image is initramfs... it is
Freeing initrd memory: 4694k freed
Grant table initialized
NET: Registered protocol family 16
Brought up 1 CPUs
PCI: setting up Xen PCI frontend stub
ACPI: Interpreter disabled.
Linux Plug and Play Support v0.97 (c) Adam Belay
pnp: PnP ACPI: disabled
xen_mem: Initialising balloon driver.
usbcore: registered new driver usbfs
usbcore: registered new driver hub
PCI: System does not support PCI
PCI: System does not support PCI
NetLabel: Initializing
NetLabel:  domain hash size = 128
NetLabel:  protocols = UNLABELED CIPSOv4
NetLabel:  unlabeled traffic allowed by default
NET: Registered protocol family 2
IP route cache hash table entries: 4096 (order: 2, 16384 bytes)
TCP established hash table entries: 16384 (order: 7, 524288 bytes)
TCP bind hash table entries: 8192 (order: 6, 262144 bytes)
TCP: Hash tables configured (established 16384 bind 8192)
TCP reno registered
IA-32 Microcode Update Driver: v1.14-xen <tigran at veritas.com>
audit: initializing netlink socket (disabled)
audit(1159994758.219:1): initialized
VFS: Disk quotas dquot_6.5.1
Dquot-cache hash table entries: 1024 (order 0, 4096 bytes)
SELinux:  Registering netfilter hooks
Initializing Cryptographic API
ksign: Installing public key data
Loading keyring
- Added public key 5777688813E6B79A
- User ID: Red Hat, Inc. (Kernel Module GPG key)
io scheduler noop registered
io scheduler anticipatory registered
io scheduler deadline registered
io scheduler cfq registered (default)
pci_hotplug: PCI Hot Plug PCI Core version: 0.5
rtc: IRQ 8 is not free.
Non-volatile memory driver v1.2
Linux agpgart interface v0.101 (c) Dave Jones
RAMDISK driver initialized: 16 RAM disks of 16384K size 4096 blocksize
Xen virtual console successfully installed as xvc0
Linux version 2.6.17-1.2630.fc6xen (brewbuilder at hs20-bc1-7.build.redhat.com) (gcc version 4.1.1 20060828 (Red Hat 4.1.1-20)) #1 SMP Wed Sep 6 17:22:21 EDT 2006
BIOS-provided physical RAM map:
 Xen: 0000000000000000 - 0000000010800000 (usable)
0MB HIGHMEM available.
264MB LOWMEM available.
Using x86 segment limits to approximate NX protection
ACPI in unprivileged domain disabled
Built 1 zonelists.  Total pages: 67584
Kernel command line:  ro root=/dev/VolGroup00/LogVol00 console=xvc0
Enabling fast FPU save and restore... done.
Enabling unmasked SIMD FPU exception support... done.
Initializing CPU#0
CPU 0 irqstacks, hard=c07f7000 soft=c07d7000
PID hash table entries: 2048 (order: 11, 8192 bytes)
Xen reported: 3000.350 MHz processor.
Console: colour dummy device 80x25
Lock dependency validator: Copyright (c) 2006 Red Hat, Inc., Ingo Molnar
... MAX_LOCKDEP_SUBCLASSES:    8
... MAX_LOCK_DEPTH:          30
... MAX_LOCKDEP_KEYS:        2048
... CLASSHASH_SIZE:           1024
... MAX_LOCKDEP_ENTRIES:     8192
... MAX_LOCKDEP_CHAINS:      8192
... CHAINHASH_SIZE:          4096
 memory used by lock dependency info: 696 kB
 per task-struct memory footprint: 1200 bytes
Dentry cache hash table entries: 65536 (order: 6, 262144 bytes)
Inode-cache hash table entries: 32768 (order: 5, 131072 bytes)
Software IO TLB disabled
vmalloc area: d1000000-f4ffe000, maxmem 2d7fe000
Memory: 247928k/270336k available (2117k kernel code, 13908k reserved, 1116k data, 184k init, 0k highmem)
Checking if this processor honours the WP bit even in supervisor mode... Ok.
Calibrating delay using timer specific routine.. 7515.44 BogoMIPS (lpj=15030892)
Security Framework v1.0.0 initialized
SELinux:  Initializing.
SELinux:  Starting in permissive mode
selinux_register_security:  Registering secondary module capability
Capability LSM initialized as secondary
Mount-cache hash table entries: 512
CPU: Trace cache: 12K uops, L1 D cache: 16K
CPU: L2 cache: 2048K
Checking 'hlt' instruction... OK.
SMP alternatives: switching to UP code
Freeing SMP alternatives: 12k freed
Brought up 1 CPUs
checking if image is initramfs... it is
Freeing initrd memory: 4694k freed
Grant table initialized
NET: Registered protocol family 16
Brought up 1 CPUs
PCI: setting up Xen PCI frontend stub
ACPI: Interpreter disabled.
Linux Plug and Play Support v0.97 (c) Adam Belay
pnp: PnP ACPI: disabled
xen_mem: Initialising balloon driver.
usbcore: registered new driver usbfs
usbcore: registered new driver hub
PCI: System does not support PCI
PCI: System does not support PCI
NetLabel: Initializing
NetLabel:  domain hash size = 128
NetLabel:  protocols = UNLABELED CIPSOv4
NetLabel:  unlabeled traffic allowed by default
NET: Registered protocol family 2
IP route cache hash table entries: 4096 (order: 2, 16384 bytes)
TCP established hash table entries: 16384 (order: 7, 524288 bytes)
TCP bind hash table entries: 8192 (order: 6, 262144 bytes)
TCP: Hash tables configured (established 16384 bind 8192)
TCP reno registered
IA-32 Microcode Update Driver: v1.14-xen <tigran at veritas.com>
audit: initializing netlink socket (disabled)
audit(1159994758.219:1): initialized
VFS: Disk quotas dquot_6.5.1
Dquot-cache hash table entries: 1024 (order 0, 4096 bytes)
SELinux:  Registering netfilter hooks
Initializing Cryptographic API
ksign: Installing public key data
Loading keyring
- Added public key 5777688813E6B79A
- User ID: Red Hat, Inc. (Kernel Module GPG key)
io scheduler noop registered
io scheduler anticipatory registered
io scheduler deadline registered
io scheduler cfq registered (default)
pci_hotplug: PCI Hot Plug PCI Core version: 0.5
rtc: IRQ 8 is not free.
Non-volatile memory driver v1.2
Linux agpgart interface v0.101 (c) Dave Jones
RAMDISK driver initialized: 16 RAM disks of 16384K size 4096 blocksize
Xen virtual console successfully installed as xvc0
Event-channel device installed.
Uniform Multi-Platform E-IDE driver Revision: 7.00alpha2
ide: Assuming 50MHz system bus speed for PIO modes; override with idebus=xx
ide-floppy driver 0.99.newide
usbcore: registered new driver libusual
usbcore: registered new driver hiddev
usbcore: registered new driver usbhid
drivers/usb/input/hid-core.c: v2.6:USB HID core driver
PNP: No PS/2 controller found. Probing ports directly.
i8042.c: No controller found.
mice: PS/2 mouse device common for all mice
md: md driver 0.90.3 MAX_MD_DEVS=256, MD_SB_DISKS=27
md: bitmap version 4.39
TCP bic registered
Initializing IPsec netlink socket
NET: Registered protocol family 1
NET: Registered protocol family 17
Using IPI No-Shortcut mode
XENBUS: Device with no driver: device/vbd/51712
XENBUS: Device with no driver: device/vif/0
Freeing unused kernel memory: 184k freed
Write protecting the kernel read-only data: 383k
Red Hat nash version 5.1.15 starting
Mounting proc filesystem
Mounting sysfs filesystem
Creating /dev
Creating initial device nodes
Setting up hotplug.
Creating block device nodes.
Loading uhci-hcd.ko module
USB Universal Host Controller Interface driver v3.0
Loading ohci-hcd.ko module
Loading ehci-hcd.ko module
Loading jbd.ko module
Loading ext3.ko module
Loading xenblk.ko module
Registering block device major 202
 xvda: xvda1 xvda2
Loading dm-mod.ko module
device-mapper: ioctl: 4.7.0-ioctl (2006-06-24) initialised: dm-devel at redhat.com
Loading dm-mirror.ko module
Loading dm-zero.ko module
Loading dm-snapshot.ko module
Making device-mapper control node
Scanning logical volumes
  Reading all physical volumes.  This may take a while...
  Found volume group "VolGroup00" using metadata type lvm2
Activating logical volumes
  2 logical volume(s) in volume group "VolGroup00" now active
Creating root device.
BUG: warning at kernel/lockdep.c:1814/trace_hardirqs_on() (Not tainted)
 [<c0405666>] show_trace_log_lvl+0x58/0x177
 [<c0405c6b>] show_trace+0xd/0x10
 [<c0405ca9>] dump_stack+0x19/0x1b
 [<c043637e>] trace_hardirqs_on+0xa4/0x120
 [<c0404e5f>] restore_all+0x37/0x3a
DWARF2 unwinder stuck at restore_all+0x37/0x3a
Leftover inexact backtrace:
Inexact backtrace:
 [<c0405c6b>] show_trace+0xd/0x10
 [<c0405ca9>] dump_stack+0x19/0x1b
 [<c043637e>] trace_hardirqs_on+0xa4/0x120
 [<c0404e5f>] restore_all+0x37/0x3a
Mounting root filesystem.
kjournald starting.  Commit interval 5 seconds
EXT3-fs: mounted filesystem with ordered data mode.
Setting up other filesystems.
Setting up new root fs
no fstab.sys, mounting internal defaults
Switching to new root and running init.
unmounting old /dev
unmounting old /proc
unmounting old /sys
audit(1159994774.028:2): enforcing=1 old_enforcing=0 auid=4294967295
security:  3 users, 6 roles, 1532 types, 159 bools, 1 sens, 256 cats
security:  58 classes, 47255 rules
SELinux:  Completing initialization.
SELinux:  Setting up existing superblocks.
SELinux: initialized (dev dm-0, type ext3), uses xattr
SELinux: initialized (dev tmpfs, type tmpfs), uses transition SIDs
SELinux: initialized (dev debugfs, type debugfs), uses genfs_contexts
SELinux: initialized (dev selinuxfs, type selinuxfs), uses genfs_contexts
SELinux: initialized (dev mqueue, type mqueue), uses transition SIDs
SELinux: initialized (dev devpts, type devpts), uses transition SIDs
SELinux: initialized (dev eventpollfs, type eventpollfs), uses task SIDs
SELinux: initialized (dev inotifyfs, type inotifyfs), uses genfs_contexts
SELinux: initialized (dev tmpfs, type tmpfs), uses transition SIDs
SELinux: initialized (dev futexfs, type futexfs), uses genfs_contexts
SELinux: initialized (dev pipefs, type pipefs), uses task SIDs
SELinux: initialized (dev sockfs, type sockfs), uses task SIDs
SELinux: initialized (dev cpuset, type cpuset), not configured for labeling
SELinux: initialized (dev proc, type proc), uses genfs_contexts
SELinux: initialized (dev bdev, type bdev), uses genfs_contexts
SELinux: initialized (dev rootfs, type rootfs), uses genfs_contexts
SELinux: initialized (dev sysfs, type sysfs), uses genfs_contexts
audit(1159994782.581:3): policy loaded auid=4294967295
INIT: version 2.86 booting
SELinux: initialized (dev usbfs, type usbfs), uses genfs_contexts
                Welcome to Fedora Core
                Press 'I' to enter interactive startup.
Setting clock  (utc): Wed Oct  4 16:46:41 EDT 2006 [  OK  ]
Starting udev: [  OK  ]
Setting hostname test.xelerance.com:  [  OK  ]
Setting up Logical Volume Management:   2 logical volume(s) in volume group "VolGroup00" now active
[  OK  ]
Checking filesystems
Checking all file systems.
[/sbin/fsck.ext3 (1) -- /] fsck.ext3 -a /dev/VolGroup00/LogVol00
/dev/VolGroup00/LogVol00: clean, 29364/869184 files, 218313/868352 blocks
[/sbin/fsck.ext3 (1) -- /boot] fsck.ext3 -a /dev/xvda1
/boot: clean, 36/26104 files, 15167/104388 blocks
[  OK  ]
Remounting root filesystem in read-write mode:  [  OK  ]
Mounting local filesystems:  [  OK  ]
Enabling local filesystem quotas:  [  OK  ]
Enabling /etc/fstab swaps:  [  OK  ]
INIT: Entering runlevel: 3

[etc]


More information about the Fedora-xen mailing list