[Date Prev][Date Next]   [Thread Prev][Thread Next]   [Thread Index] [Date Index] [Author Index]

Re: Intel Woodcrest Crash under heavy load with FC5 and MySql



Here is some sample crash output, please bear in mind that 3ware claim no problem on their driver and have confirmed that I am using the correct versions of BIOS and 3ware drivers.

Also, remember there is no crash when dual core disabled ?


These are the only messages on the serial console server from the mentioned crash.

 BUG: spinlock wrong CPU on CPU#-135120464, kjournald/529 (Not tainted)
 lock: f7e28034, .magic: dead4ead, .owner: kjournald/529, .owner_cpu: 3
 <c04ea6a6> spin_bug+0xaa/0x122  <c04ea775> _raw_spin_unlock+0x57/0x6c
 <c0618142> _spin_unlock_irqrestore+0x8/0xc  <f887ebfd>
scsi_dispatch_cmd+0x247/0x2bb [scsi_mod]
 <f8883b28> scsi_request_fn+0x2ce/0x38b [scsi_mod]  <c042d9df>
del_timer+0x41/0x4a
 <c04db1ef> __generic_unplug_device+0x1d/0x1f  <f88830c0>
scsi_queue_insert+0x84/0xa2 [scsi_mod]
 <f88814df> scsi_delete_timer+0xf/0x50 [scsi_mod]  <f887ec2f>
scsi_dispatch_cmd+0x279/0x2bb [scsi_mod]
 <f8883b28> scsi_request_fn+0x2ce/0x38b [scsi_mod]  <c042d9df>
del_timer+0x41/0x4a
 <c04db1ef> __generic_unplug_device+0x1d/0x1f  <f88830c0>
scsi_queue_insert+0x84/0xa2 [scsi_mod]
 <f88814df> scsi_delete_timer+0xf/0x50 [scsi_mod]  <f887ec2f>
scsi_dispatch_cmd+0x279/0x2bb [scsi_mod]
 <f8883b28> scsi_request_fn+0x2ce/0x38b [scsi_mod]  <c042d9df>
del_timer+0x41/0x4a
 <c04db1ef> __generic_unplug_device+0x1d/0x1f  <f88830c0>
scsi_queue_insert+0x84/0xa2 [scsi_mod]
 <f88814df> scsi_delete_timer+0xf/0x50 [scsi_mod]  <f887ec2f>
scsi_dispatch_cmd+0x279/0x2bb [scsi_mod]
 <f8883b28> scsi_request_fn+0x2ce/0x38b [scsi_mod]  <c042d9df>
del_timer+0x41/0x4a
 <c04db1ef> __generic_unplug_device+0x1d/0x1f  <f88830c0>
scsi_queue_insert+0x84/0xa2 [scsi_mod]
 <f88814df> scsi_delete_timer+0xf/0x50 [scsi_mod]  <f887ec2f>
scsi_dispatch_cmd+0x279/0x2bb [scsi_mod]
 <f8883b28> scsi_request_fn+0x2ce/0x38b [scsi_mod]  <c042d9df>
del_timer+0x41/0x4a
 <c04db1ef> __generic_unplug_device+0x1d/0x1f  <f88830c0>
scsi_queue_insert+0x84/0xa2 [scsi_mod]
 <f88814df> scsi_delete_timer+0xf/0x50 [scsi_mod]  <f887ec2f>
scsi_dispatch_cmd+0x279/0x2bb [scsi_mod]
 <f8883b28> scsi_request_fn+0x2ce/0x38b [scsi_mod]  <c042d9df>
del_timer+0x41/0x4a
 <c04db1ef> __generic_unplug_device+0x1d/0x1f  <f88830c0>
scsi_queue_insert+0x84/0xa2 [scsi_mod]
 <f88814df> scsi_delete_timer+0xf/0x50 [scsi_mod]  <f887ec2f>
scsi_dispatch_cmd+0x279/0x2bb [scsi_mod]
 <f8883b28> scsi_request_fn+0x2ce/0x38b [scsi_mod]  <c042d9df>
del_timer+0x41/0x4a
 <c04db1ef> __generic_unplug_device+0x1d/0x1f  <f88830c0>
scsi_queue_insert+0x84/0xa2 [scsi_mod]
 <f88814df> scsi_delete_timer+0xf/0x50 [scsi_mod]  <f887ec2f>
scsi_dispatch_cmd+0x279/0x2bb [scsi_mod]
 <f8883b28> scsi_request_fn+0x2ce/0x38b [scsi_mod]  <c042d9df>
del_timer+0x41/0x4a
 <c04db1ef> __generic_unplug_device+0x1d/0x1f  <f88830c0>
scsi_queue_insert+0x84/0xa2 [scsi_mod]
 <f88814df> scsi_delete_timer+0xf/0x50 [scsi_mod]  <f887ec2f>
scsi_dispatch_cmd+0x279/0x2bb [scsi_mod]
 <f8883b28> scsi_request_fn+0x2ce/0x38b [scsi_mod]  <c042d9df>
del_timer+0x41/0x4a
 <c04db1ef> __generic_unplug_device+0x1d/0x1f  <f88830c0>
scsi_queue_insert+0x84/0xa2 [scsi_mod]
 <f88814df> scsi_delete_timer+0xf/0x50 [scsi_mod]  <f887ec2f>
scsi_dispatch_cmd+0x279/0x2bb [scsi_mod]
 <f8883b28> scsi_request_fn+0x2ce/0x38b [scsi_mod]  <c042d9df>
del_timer+0x41/0x4a
 <c04db1ef> __generic_unplug_device+0x1d/0x1f  <f88830c0>
scsi_queue_insert+0x84/0xa2 [scsi_mod]
 <f88814df> scsi_delete_timer+0xf/0x50 [scsi_mod]  <f887ec2f>
scsi_dispatch_cmd+0x279/0x2bb [scsi_mod]
 <f8883b28> scsi_request_fn+0x2ce/0x38b [scsi_mod]  <c042d9df>
del_timer+0x41/0x4a
 <c04db1ef> __generic_unplug_device+0x1d/0x1f  <f88830c0>
scsi_queue_insert+0x84/0xa2 [scsi_mod]
 <f88814df> scsi_delete_timer+0xf/0x50 [scsi_mod]  <f887ec2f>
scsi_dispatch_cmd+0x279/0x2bb [scsi_mod]
 <f8883b28> scsi_request_fn+0x2ce/0x38b [scsi_mod]  <c042d9df>
del_timer+0x41/0x4a
 <c04db1ef> __generic_unplug_device+0x1d/0x1f  <f88830c0>
scsi_queue_insert+0x84/0xa2 [scsi_mod]
 <f88814df> scsi_delete_timer+0xf/0x50 [scsi_mod]  <f887ec2f>
scsi_dispatch_cmd+0x279/0x2bb [scsi_mod]
 <f8883b28> scsi_request_fn+0x2ce/0x38b [scsi_mod]  <c042d9df>
del_timer+0x41/0x4a
 <c04db1ef> __generic_unplug_device+0x1d/0x1f  <f88830c0> scsi_q



NEXT
====


BUG: spinlock wrong CPU on CPU#-136275792, kjournald/426 (Not tainted)
BUG: unable to handle kernel paging request<0>BUG: spinlock lockup on CPU#2, swapper/0, c9b98034 (Not tainted)
BUG: spinlock lockup on CPU#-134583280, _L08|?/6, c06d58d4 (Not tainted)
BUG: spinlock lockup on CPU#2, swapper/0, c06d58d4 (Not tainted)
BUG: spinlock lockup on CPU#0, swapper/0, c06d58d4 (Not tainted)
BUG: spinlock lockup on CPU#-134583280, _L08|?/6, c06d58d4 (Not tainted)
BUG: spinlock lockup on CPU#0, swapper/0, c06d58d4 (Not tainted)
BUG: spinlock lockup on CPU#-134583280, _L08|?/6, c06d58d4 (Not tainted)
BUG: spinlock lockup on CPU#2, swapper/0, c06d58d4 (Not tainted)
BUG: spinlock lockup on CPU#0, swapper/0, c06d58d4 (Not tainted)


NEXT
====

isg-prod-mysql3 login: BUG: unable to handle kernel paging request at
virtual address 69c92050
 printing eip:
c042d60b
*pde = 00000000
Oops: 0000 [#1]
SMP
last sysfs file: /block/hdb/removable
Modules linked in: ipv6 bonding arpt_mangle arptable_filter arp_tables
x_tables dm_mirror dm_multipath dm_mod lp parport_pc parport floppy
uhci_hcd ehci_hcd sg e1000 serio_raw i2c_i801 i2c_core ext3 jbd 3w_9xxx
sata_mv libata sd_mod scsi_mod
CPU:    72
EIP:    0060:[<c042d60b>]    Not tainted VLI
EFLAGS: 00210096   (2.6.17-1.2174_FC5smp #1)
EIP is at __mod_timer+0x59/0xa7
eax: ea553034   ebx: c9962558   ecx: f883c689   edx: c0788238
esi: c9b659a0   edi: c9940000   ebp: 00245ecd   esp: ea553030
ds: 007b   es: 007b   ss: 0068
Process ) (pid: 40, threadinfo=ea552000 task=ea554000)
Stack: 00000000 00200286 c9962500 c9b659a0 c9b44000 c9b44000 f8839aec
00000000
       00200082 c9b65a34 ea553078 ea8c2cd4 c9962500 c9b659a0 c9ae5400
c9b44000
       f883eb28 c042d9df 00200082 c9b659a0 c9b659a0 c9ae54a0 c9b44000
ea8c2cd4
Call Trace:
 <f8839aec> scsi_dispatch_cmd+0x136/0x2bb [scsi_mod]  <f883eb28>
scsi_request_fn+0x2ce/0x38b [scsi_mod]
 <c042d9df> del_timer+0x41/0x4a  <c04db1ef>
__generic_unplug_device+0x1d/0x1f
 <f883e0c0> scsi_queue_insert+0x84/0xa2 [scsi_mod]  <f883c4df>
scsi_delete_timer+0xf/0x50 [scsi_mod]
 <f8839c2f> scsi_dispatch_cmd+0x279/0x2bb [scsi_mod]  <f883eb28>
scsi_request_fn+0x2ce/0x38b [scsi_mod]
 <c042d9df> del_timer+0x41/0x4a  <c04db1ef>
__generic_unplug_device+0x1d/0x1f
 <f883e0c0> scsi_queue_insert+0x84/0xa2 [scsi_mod]  <f883c4df>
scsi_delete_timer+0xf/0x50 [scsi_mod]
 <f8839c2f> scsi_dispatch_cmd+0x279/0x2bb [scsi_mod]  <f883eb28>
scsi_request_fn+0x2ce/0x38b [scsi_mod]
 <c042d9df> del_timer+0x41/0x4a  <c04db1ef>
__generic_unplug_device+0x1d/0x1f
 <f883e0c0> scsi_queue_insert+0x84/0xa2 [scsi_mod]  <f883c4df>
scsi_delete_timer+0xf/0x50 [scsi_mod]
 <f8839c2f> scsi_dispatch_cmd+0x279/0x2bb [scsi_mod]  <f883eb28>
scsi_request_fn+0x2ce/0x38b [scsi_mod]
 <c042d9df> del_timer+0x41/0x4a  <c04db1ef>
__generic_unplug_device+0x1d/0x1f
 <f883e0c0> scsi_queue_insert+0x84/0xa2 [scsi_mod]  <f883c4df>
scsi_delete_timer+0xf/0x50 [scsi_mod]
 <f8839c2f> scsi_dispatch_cmd+0x279/0x2bb [scsi_mod]  <f883eb28>
scsi_request_fn+0x2ce/0x38b [scsi_mod]
 <c042d9df> del_timer+0x41/0x4a  <c04db1ef>
__generic_unplug_device+0x1d/0x1f
 <f883e0c0> scsi_queue_insert+0x84/0xa2 [scsi_mod]  <f883c4df>
scsi_delete_timer+0xf/0x50 [scsi_mod]
 <f8839c2f> scsi_dispatch_cmd+0x279/0x2bb [scsi_mod]  <f883eb28>
scsi_request_fn+0x2ce/0x38b [scsi_mod]
 <c042d9df> del_timer+0x41/0x4a  <c04db1ef>
__generic_unplug_device+0x1d/0x1f
 <f883e0c0> scsi_queue_insert+0x84/0xa2 [scsi_mod]  <f883c4df>
scsi_delete_timer+0xf/0x50 [scsi_mod]
 <f8839c2f> scsi_dispatch_cmd+0x279/0x2bb [scsi_mod]  <f883eb28>
scsi_request_fn+0x2ce/0x38b [scsi_mod]
 <c042d9df> del_timer+0x41/0x4a  <c04db1ef>
__generic_unplug_device+0x1d/0x1f
 <f883e0c0> scsi_queue_insert+0x84/0xa2 [scsi_mod]  <f883c4df>
scsi_delete_timer+0xf/0x50 [scsi_mod]
 <f8839c2f> scsi_dispatch_cmd+0x279/0x2bb [scsi_mod]  <f883eb28>
scsi_request_fn+0x2ce/0x38b [scsi_mod]
 <c042d9df> del_timer+0x41/0x4a  <c04db1ef>
__generic_unplug_device+0x1d/0x1f
 <f883e0c0> scsi_queue_insert+0x84/0xa2 [scsi_mod]  <f883c4df>
scsi_delete_timer+0xf/0x50 [scsi_mod]
 <f8839c2f> scsi_dispatch_cmd+0x279/0x2bb [scsi_mod]  <f883eb28>
scsi_request_fn+0x2ce/0x38b [scsi_mod]
 <c042d9df> del_timer+0x41/0x4a  <c04db1ef>
__generic_unplug_device+0x1d/0x1f
 <f883e0c0> scsi_queue_insert+0x84/0xa2 [scsi_mod]  <f883c4df>
scsi_delete_timer+0xf/0x50 [scsi_mod]
 <f8839c2f> scsi_dispatch_cmd+0x279/0x2bb [scsi_mod]  <f883eb28>
scsi_request_fn+0x2ce/0x38b [scsi_mod]
 <c042d9df> del_timer+0x41/0x4a  <c04db1ef>
__generic_unplug_device+0x1d/0x1f
 <f883e0c0> scsi_queue_insert+0x84/0xa2 [scsi_mod]  <f883c4df>
scsi_delete_timer+0xf/0x50 [scsi_mod]
 <f8839c2f> scsi_dispatch_cmd+0x279/0x2bb [scsi_mod]  <f883eb28>
scsi_request_fn+0x2ce/0x38b [scsi_mod]


DMESG
=====

Linux version 2.6.17-1.2174_FC5smp (isg isg-prod-mysql3) (gcc version 4.1.1 20060525 (Red Hat 4.1.1-1)) #1 SMP Fri Sep 1 16:52:37 BST 2006
BIOS-provided physical RAM map:
BIOS-e820: 0000000000000000 - 000000000009d800 (usable)
BIOS-e820: 000000000009d800 - 00000000000a0000 (reserved)
BIOS-e820: 00000000000ce000 - 00000000000d0000 (reserved)
BIOS-e820: 00000000000e4000 - 0000000000100000 (reserved)
BIOS-e820: 0000000000100000 - 00000000bff60000 (usable)
BIOS-e820: 00000000bff60000 - 00000000bff69000 (ACPI data)
BIOS-e820: 00000000bff69000 - 00000000bff80000 (ACPI NVS)
BIOS-e820: 00000000bff80000 - 00000000c0000000 (reserved)
BIOS-e820: 00000000e0000000 - 00000000f0000000 (reserved)
BIOS-e820: 00000000fec00000 - 00000000fec10000 (reserved)
BIOS-e820: 00000000fee00000 - 00000000fee01000 (reserved)
BIOS-e820: 00000000ff000000 - 0000000100000000 (reserved)
BIOS-e820: 0000000100000000 - 0000000440000000 (usable)
16512MB HIGHMEM available.
895MB LOWMEM available.
found SMP MP-table at 000f59d0
Using x86 segment limits to approximate NX protection
On node 0 totalpages: 4456448
 DMA zone: 4096 pages, LIFO batch:0
 Normal zone: 225279 pages, LIFO batch:31
 HighMem zone: 4227073 pages, LIFO batch:31
DMI present.
Using APIC driver default
Intel MultiProcessor Specification v1.4
   Virtual Wire compatibility mode.
OEM ID: INTEL    Product ID: Bridge CRB   APIC at: 0xFEE00000
Processor #0 6:15 APIC version 20
Processor #6 6:15 APIC version 20
Processor #1 6:15 APIC version 20
Processor #7 6:15 APIC version 20
I/O APIC #2 Version 32 at 0xFEC00000.
I/O APIC #3 Version 32 at 0xFEC80000.
Enabling APIC mode:  Flat.  Using 2 I/O APICs
Processors: 4
Allocating PCI resources starting at c2000000 (gap: c0000000:20000000)
Built 1 zonelists
Kernel command line: ro root=LABEL=/root boot=LABEL=/boot selinux=0 console=ttyS0,115200 noacpi acpi=off noapic hostname=isg-prod-mysql3
mapped APIC to ffffd000 (fee00000)
mapped IOAPIC to ffffc000 (fec00000)
mapped IOAPIC to ffffb000 (fec80000)
Enabling fast FPU save and restore... done.
Enabling unmasked SIMD FPU exception support... done.
Initializing CPU#0
CPU 0 irqstacks, hard=c07ae000 soft=c078e000
PID hash table entries: 4096 (order: 12, 16384 bytes)
Detected 3000.561 MHz processor.
Using tsc for high-res timesource
Console: colour VGA+ 80x25
Dentry cache hash table entries: 131072 (order: 7, 524288 bytes)
Inode-cache hash table entries: 65536 (order: 6, 262144 bytes)
Memory: 16629584k/17825792k available (2154k kernel code, 145696k reserved, 1200k data, 244k init, 15859076k highmem)
Checking if this processor honours the WP bit even in supervisor mode... Ok.
Calibrating delay using timer specific routine.. 6009.75 BogoMIPS (lpj=12019511)
Security Framework v1.0.0 initialized
SELinux:  Disabled at boot.
Capability LSM initialized
Mount-cache hash table entries: 512
CPU: After generic identify, caps: bfebfbff 20000000 00000000 00000000 0004e3bd 00000000 00000001 CPU: After vendor identify, caps: bfebfbff 20000000 00000000 00000000 0004e3bd 00000000 00000001
monitor/mwait feature present.
using mwait in idle threads.
CPU: L1 I cache: 32K, L1 D cache: 32K
CPU: L2 cache: 4096K
CPU: Physical Processor ID: 0
CPU: Processor Core ID: 0
CPU: After all inits, caps: bfebf3ff 20000000 00000000 00000140 0004e3bd 00000000 00000001
Intel machine check architecture supported.
Intel machine check reporting enabled on CPU#0.
Checking 'hlt' instruction... OK.
SMP alternatives: switching to UP code
CPU0: Intel(R) Xeon(R) CPU            5160  @ 3.00GHz stepping 06
SMP alternatives: switching to SMP code
Booting processor 1/1 eip 3000
CPU 1 irqstacks, hard=c07af000 soft=c078f000
Initializing CPU#1
Calibrating delay using timer specific routine.. 6000.59 BogoMIPS (lpj=12001183) CPU: After generic identify, caps: bfebfbff 20000000 00000000 00000000 0004e3bd 00000000 00000001 CPU: After vendor identify, caps: bfebfbff 20000000 00000000 00000000 0004e3bd 00000000 00000001
monitor/mwait feature present.
CPU: L1 I cache: 32K, L1 D cache: 32K
CPU: L2 cache: 4096K
CPU: Physical Processor ID: 0
CPU: Processor Core ID: 1
CPU: After all inits, caps: bfebf3ff 20000000 00000000 00000140 0004e3bd 00000000 00000001
Intel machine check architecture supported.
Intel machine check reporting enabled on CPU#1.
CPU1: Intel(R) Xeon(R) CPU            5160  @ 3.00GHz stepping 06
SMP alternatives: switching to SMP code
Booting processor 2/6 eip 3000
CPU 2 irqstacks, hard=c07b0000 soft=c0790000
Initializing CPU#2
Calibrating delay using timer specific routine.. 6000.70 BogoMIPS (lpj=12001413) CPU: After generic identify, caps: bfebfbff 20000000 00000000 00000000 0004e3bd 00000000 00000001 CPU: After vendor identify, caps: bfebfbff 20000000 00000000 00000000 0004e3bd 00000000 00000001
monitor/mwait feature present.
CPU: L1 I cache: 32K, L1 D cache: 32K
CPU: L2 cache: 4096K
CPU: Physical Processor ID: 3
CPU: Processor Core ID: 0
CPU: After all inits, caps: bfebf3ff 20000000 00000000 00000140 0004e3bd 00000000 00000001
Intel machine check architecture supported.
Intel machine check reporting enabled on CPU#2.
CPU2: Intel(R) Xeon(R) CPU            5160  @ 3.00GHz stepping 06
SMP alternatives: switching to SMP code
Booting processor 3/7 eip 3000
CPU 3 irqstacks, hard=c07b1000 soft=c0791000
Initializing CPU#3
Calibrating delay using timer specific routine.. 6000.70 BogoMIPS (lpj=12001411) CPU: After generic identify, caps: bfebfbff 20000000 00000000 00000000 0004e3bd 00000000 00000001 CPU: After vendor identify, caps: bfebfbff 20000000 00000000 00000000 0004e3bd 00000000 00000001
monitor/mwait feature present.
CPU: L1 I cache: 32K, L1 D cache: 32K
CPU: L2 cache: 4096K
CPU: Physical Processor ID: 3
CPU: Processor Core ID: 1
CPU: After all inits, caps: bfebf3ff 20000000 00000000 00000140 0004e3bd 00000000 00000001
Intel machine check architecture supported.
Intel machine check reporting enabled on CPU#3.
CPU3: Intel(R) Xeon(R) CPU            5160  @ 3.00GHz stepping 06
Total of 4 processors activated (24011.75 BogoMIPS).
checking TSC synchronization across 4 CPUs: passed.
Brought up 4 CPUs
migration_cost=32,8842
checking if image is initramfs... it is
Freeing initrd memory: 1000k freed
NET: Registered protocol family 16
PCI: PCI BIOS revision 2.10 entry at 0xfd767, last bus=9
Setting up standard PCI resources
ACPI: Subsystem revision 20060127
ACPI: Interpreter disabled.
Linux Plug and Play Support v0.97 (c) Adam Belay
pnp: PnP ACPI: disabled
usbcore: registered new driver usbfs
usbcore: registered new driver hub
PCI: Probing PCI hardware
PCI: Probing PCI hardware (bus 00)
PCI: PXH quirk detected, disabling MSI for SHPC device
Boot video device is 0000:09:01.0
PCI: Transparent bridge - 0000:00:1e.0
PCI: Using IRQ router PIIX/ICH [8086/2670] at 0000:00:1f.0
PCI: Found IRQ 11 for device 0000:00:00.0
PCI: Sharing IRQ 11 with 0000:00:02.0
PCI: Sharing IRQ 11 with 0000:00:04.0
PCI: Sharing IRQ 11 with 0000:00:06.0
PCI: Sharing IRQ 11 with 0000:00:08.0
PCI: Sharing IRQ 11 with 0000:01:00.0
PCI: Sharing IRQ 11 with 0000:02:00.0
PCI: Sharing IRQ 11 with 0000:04:01.0
PCI: Bridge: 0000:03:00.0
 IO window: 2000-2fff
 MEM window: c8100000-c81fffff
 PREFETCH window: ca000000-cbffffff
PCI: Bridge: 0000:02:00.0
 IO window: 2000-2fff
 MEM window: c8100000-c81fffff
 PREFETCH window: ca000000-cbffffff
PCI: Bridge: 0000:02:02.0
 IO window: 3000-3fff
 MEM window: c8200000-c82fffff
 PREFETCH window: disabled.
PCI: Bridge: 0000:01:00.0
 IO window: 2000-3fff
 MEM window: c8100000-c82fffff
 PREFETCH window: ca000000-cbffffff
PCI: Bridge: 0000:01:00.3
 IO window: disabled.
 MEM window: disabled.
 PREFETCH window: disabled.
PCI: Bridge: 0000:00:02.0
 IO window: 2000-3fff
 MEM window: c8000000-c82fffff
 PREFETCH window: ca000000-cbffffff
PCI: Bridge: 0000:00:04.0
 IO window: disabled.
 MEM window: disabled.
 PREFETCH window: disabled.
PCI: Bridge: 0000:00:06.0
 IO window: disabled.
 MEM window: disabled.
 PREFETCH window: disabled.
PCI: Bridge: 0000:00:1e.0
 IO window: 4000-4fff
 MEM window: c8300000-c83fffff
 PREFETCH window: d0000000-d7ffffff
PCI: Found IRQ 11 for device 0000:00:02.0
PCI: Sharing IRQ 11 with 0000:00:00.0
PCI: Sharing IRQ 11 with 0000:00:04.0
PCI: Sharing IRQ 11 with 0000:00:06.0
PCI: Sharing IRQ 11 with 0000:00:08.0
PCI: Sharing IRQ 11 with 0000:01:00.0
PCI: Sharing IRQ 11 with 0000:02:00.0
PCI: Sharing IRQ 11 with 0000:04:01.0
PCI: Setting latency timer of device 0000:00:02.0 to 64
PCI: Found IRQ 11 for device 0000:01:00.0
PCI: Sharing IRQ 11 with 0000:00:00.0
PCI: Sharing IRQ 11 with 0000:00:02.0
PCI: Sharing IRQ 11 with 0000:00:04.0
PCI: Sharing IRQ 11 with 0000:00:06.0
PCI: Sharing IRQ 11 with 0000:00:08.0
PCI: Sharing IRQ 11 with 0000:02:00.0
PCI: Sharing IRQ 11 with 0000:04:01.0
PCI: Setting latency timer of device 0000:01:00.0 to 64
PCI: Found IRQ 11 for device 0000:02:00.0
PCI: Sharing IRQ 11 with 0000:00:00.0
PCI: Sharing IRQ 11 with 0000:00:02.0
PCI: Sharing IRQ 11 with 0000:00:04.0
PCI: Sharing IRQ 11 with 0000:00:06.0
PCI: Sharing IRQ 11 with 0000:00:08.0
PCI: Sharing IRQ 11 with 0000:01:00.0
PCI: Sharing IRQ 11 with 0000:04:01.0
PCI: Setting latency timer of device 0000:02:00.0 to 64
PCI: Setting latency timer of device 0000:03:00.0 to 64
PCI: Found IRQ 5 for device 0000:02:02.0
PCI: Sharing IRQ 5 with 0000:05:00.0
PCI: Sharing IRQ 5 with 0000:09:01.0
PCI: Setting latency timer of device 0000:02:02.0 to 64
PCI: Setting latency timer of device 0000:01:00.3 to 64
PCI: Found IRQ 11 for device 0000:00:04.0
PCI: Sharing IRQ 11 with 0000:00:00.0
PCI: Sharing IRQ 11 with 0000:00:02.0
PCI: Sharing IRQ 11 with 0000:00:06.0
PCI: Sharing IRQ 11 with 0000:00:08.0
PCI: Sharing IRQ 11 with 0000:01:00.0
PCI: Sharing IRQ 11 with 0000:02:00.0
PCI: Sharing IRQ 11 with 0000:04:01.0
PCI: Setting latency timer of device 0000:00:04.0 to 64
PCI: Found IRQ 11 for device 0000:00:06.0
PCI: Sharing IRQ 11 with 0000:00:00.0
PCI: Sharing IRQ 11 with 0000:00:02.0
PCI: Sharing IRQ 11 with 0000:00:04.0
PCI: Sharing IRQ 11 with 0000:00:08.0
PCI: Sharing IRQ 11 with 0000:01:00.0
PCI: Sharing IRQ 11 with 0000:02:00.0
PCI: Sharing IRQ 11 with 0000:04:01.0
PCI: Setting latency timer of device 0000:00:06.0 to 64
PCI: Setting latency timer of device 0000:00:1e.0 to 64
NET: Registered protocol family 2
IP route cache hash table entries: 1048576 (order: 10, 4194304 bytes)
TCP established hash table entries: 131072 (order: 9, 2621440 bytes)
TCP bind hash table entries: 65536 (order: 8, 1310720 bytes)
TCP: Hash tables configured (established 131072 bind 65536)
TCP reno registered
apm: BIOS not found.
audit: initializing netlink socket (disabled)
audit(1157150806.392:1): initialized
highmem bounce pool size: 64 pages
Total HugeTLB memory allocated, 0
VFS: Disk quotas dquot_6.5.1
Dquot-cache hash table entries: 1024 (order 0, 4096 bytes)
Initializing Cryptographic API
ksign: Installing public key data
Loading keyring
- Added public key 910AD7F929B4C848
- User ID: Red Hat, Inc. (Kernel Module GPG key)
io scheduler noop registered
io scheduler anticipatory registered
io scheduler deadline registered
io scheduler cfq registered (default)
PCI: Found IRQ 11 for device 0000:00:02.0
PCI: Sharing IRQ 11 with 0000:00:00.0
PCI: Sharing IRQ 11 with 0000:00:04.0
PCI: Sharing IRQ 11 with 0000:00:06.0
PCI: Sharing IRQ 11 with 0000:00:08.0
PCI: Sharing IRQ 11 with 0000:01:00.0
PCI: Sharing IRQ 11 with 0000:02:00.0
PCI: Sharing IRQ 11 with 0000:04:01.0
PCI: Setting latency timer of device 0000:00:02.0 to 64
assign_interrupt_mode Found MSI capability
Allocate Port Service[0000:00:02.0:pcie00]
PCI: Found IRQ 11 for device 0000:00:04.0
PCI: Sharing IRQ 11 with 0000:00:00.0
PCI: Sharing IRQ 11 with 0000:00:06.0
PCI: Sharing IRQ 11 with 0000:00:08.0
PCI: Sharing IRQ 11 with 0000:01:00.0
PCI: Sharing IRQ 11 with 0000:02:00.0
PCI: Sharing IRQ 11 with 0000:04:01.0
PCI: Setting latency timer of device 0000:00:04.0 to 64
assign_interrupt_mode Found MSI capability
Allocate Port Service[0000:00:04.0:pcie00]
PCI: Found IRQ 11 for device 0000:00:06.0
PCI: Sharing IRQ 11 with 0000:00:00.0
PCI: Sharing IRQ 11 with 0000:00:08.0
PCI: Sharing IRQ 11 with 0000:01:00.0
PCI: Sharing IRQ 11 with 0000:02:00.0
PCI: Sharing IRQ 11 with 0000:04:01.0
PCI: Setting latency timer of device 0000:00:06.0 to 64
assign_interrupt_mode Found MSI capability
Allocate Port Service[0000:00:06.0:pcie00]
PCI: Found IRQ 11 for device 0000:01:00.0
PCI: Sharing IRQ 11 with 0000:00:00.0
PCI: Sharing IRQ 11 with 0000:00:08.0
PCI: Sharing IRQ 11 with 0000:02:00.0
PCI: Sharing IRQ 11 with 0000:04:01.0
PCI: Setting latency timer of device 0000:01:00.0 to 64
Allocate Port Service[0000:01:00.0:pcie10]
PCI: Found IRQ 11 for device 0000:02:00.0
PCI: Sharing IRQ 11 with 0000:00:00.0
PCI: Sharing IRQ 11 with 0000:00:08.0
PCI: Sharing IRQ 11 with 0000:01:00.0
PCI: Sharing IRQ 11 with 0000:04:01.0
PCI: Setting latency timer of device 0000:02:00.0 to 64
assign_interrupt_mode Found MSI capability
Allocate Port Service[0000:02:00.0:pcie20]
PCI: Found IRQ 5 for device 0000:02:02.0
PCI: Sharing IRQ 5 with 0000:05:00.0
PCI: Sharing IRQ 5 with 0000:09:01.0
PCI: Setting latency timer of device 0000:02:02.0 to 64
assign_interrupt_mode Found MSI capability
Allocate Port Service[0000:02:02.0:pcie20]
pci_hotplug: PCI Hot Plug PCI Core version: 0.5
isapnp: Scanning for PnP cards...
isapnp: No Plug & Play device found
Real Time Clock Driver v1.12ac
Non-volatile memory driver v1.2
Linux agpgart interface v0.101 (c) Dave Jones
Serial: 8250/16550 driver $Revision: 1.90 $ 4 ports, IRQ sharing enabled
serial8250: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
RAMDISK driver initialized: 16 RAM disks of 16384K size 1024 blocksize
Uniform Multi-Platform E-IDE driver Revision: 7.00alpha2
ide: Assuming 33MHz system bus speed for PIO modes; override with idebus=xx
Probing IDE interface ide0...
Probing IDE interface ide1...
ide-floppy driver 0.99.newide
usbcore: registered new driver libusual
usbcore: registered new driver hiddev
usbcore: registered new driver usbhid
drivers/usb/input/hid-core.c: v2.6:USB HID core driver
PNP: No PS/2 controller found. Probing ports directly.
serio: i8042 AUX port at 0x60,0x64 irq 12
serio: i8042 KBD port at 0x60,0x64 irq 1
mice: PS/2 mouse device common for all mice
md: md driver 0.90.3 MAX_MD_DEVS=256, MD_SB_DISKS=27
md: bitmap version 4.39
TCP bic registered
Initializing IPsec netlink socket
NET: Registered protocol family 1
NET: Registered protocol family 17
Using IPI No-Shortcut mode
Freeing unused kernel memory: 244k freed
Write protecting the kernel read-only data: 723k
SCSI subsystem initialized
3ware 9000 Storage Controller device driver for Linux v2.26.02.007.
PCI: Found IRQ 11 for device 0000:04:01.0
PCI: Sharing IRQ 11 with 0000:00:00.0
PCI: Sharing IRQ 11 with 0000:00:08.0
PCI: Sharing IRQ 11 with 0000:01:00.0
3w-9xxx: scsi0: AEN: WARNING (0x04:0x0008): Unclean shutdown detected:unit=0.
scsi0 : 3ware 9000 Storage Controller
3w-9xxx: scsi0: Found a 3ware 9000 Storage Controller at 0xc8100000, IRQ: 11.
3w-9xxx: scsi0: Firmware FE9X 3.04.00.005, BIOS BE9X 3.04.00.002, Ports: 4.
 Vendor: AMCC      Model: 9550SX-4LP DISK   Rev: 3.04
 Type:   Direct-Access                      ANSI SCSI revision: 03
SCSI device sda: 976541696 512-byte hdwr sectors (499989 MB)
sda: Write Protect is off
sda: Mode Sense: 23 00 00 00
SCSI device sda: drive cache: write back, no read (daft)
SCSI device sda: 976541696 512-byte hdwr sectors (499989 MB)
sda: Write Protect is off
sda: Mode Sense: 23 00 00 00
SCSI device sda: drive cache: write back, no read (daft)
sda: sda1 sda2 sda3 sda4
sd 0:0:0:0: Attached scsi disk sda
 Vendor: AMCC      Model: 9550SX-4LP DISK   Rev: 3.04
 Type:   Direct-Access                      ANSI SCSI revision: 03
SCSI device sdb: 1953083392 512-byte hdwr sectors (999979 MB)
sdb: Write Protect is off
sdb: Mode Sense: 23 00 00 00
SCSI device sdb: drive cache: write back, no read (daft)
SCSI device sdb: 1953083392 512-byte hdwr sectors (999979 MB)
sdb: Write Protect is off
sdb: Mode Sense: 23 00 00 00
SCSI device sdb: drive cache: write back, no read (daft)
sdb: sdb1
sd 0:0:1:0: Attached scsi disk sdb
EXT3-fs: INFO: recovery required on readonly filesystem.
EXT3-fs: write access will be enabled during recovery.
kjournald starting.  Commit interval 5 seconds
EXT3-fs: recovery complete.
EXT3-fs: mounted filesystem with ordered data mode.
hw_random: RNG not detected
Intel(R) PRO/1000 Network Driver - version 7.0.33-k2-NAPI
Copyright (c) 1999-2005 Intel Corporation.
PCI: Found IRQ 5 for device 0000:05:00.0
PCI: Sharing IRQ 5 with 0000:09:01.0
PCI: Setting latency timer of device 0000:05:00.0 to 64
e1000: 0000:05:00.0: e1000_probe: (PCI Express:2.5Gb/s:Width x4) 00:30:48:78:5a:12
sd 0:0:0:0: Attached scsi generic sg0 type 0
sd 0:0:1:0: Attached scsi generic sg1 type 0
e1000: eth0: e1000_probe: Intel(R) PRO/1000 Network Connection
PCI: Found IRQ 10 for device 0000:05:00.1
PCI: Sharing IRQ 10 with 0000:00:1f.3
PCI: Setting latency timer of device 0000:05:00.1 to 64
e1000: 0000:05:00.1: e1000_probe: (PCI Express:2.5Gb/s:Width x4) 00:30:48:78:5a:13
e1000: eth1: e1000_probe: Intel(R) PRO/1000 Network Connection
floppy0: no floppy controllers found
lp: driver loaded but no devices found
md: Autodetecting RAID arrays.
md: autorun ...
md: ... autorun DONE.
device-mapper: 4.6.0-ioctl (2006-02-17) initialised: dm-devel redhat com
device-mapper: dm-multipath version 1.0.4 loaded
EXT3 FS on sda3, internal journal
kjournald starting.  Commit interval 5 seconds
EXT3 FS on sda1, internal journal
EXT3-fs: mounted filesystem with ordered data mode.
kjournald starting.  Commit interval 5 seconds
EXT3 FS on sda4, internal journal
EXT3-fs: recovery complete.
EXT3-fs: mounted filesystem with ordered data mode.
kjournald starting.  Commit interval 5 seconds
EXT3-fs warning: maximal mount count reached, running e2fsck is recommended
EXT3 FS on sdb1, internal journal
EXT3-fs: recovery complete.
EXT3-fs: mounted filesystem with ordered data mode.
Adding 1959920k swap on /dev/sda2.  Priority:-1 extents:1 across:1959920k
arp_tables: (C) 2002 David S. Miller
Ethernet Channel Bonding Driver: v3.0.3 (March 23, 2006)
bonding: MII link monitoring set to 100 ms
e1000: eth0: e1000_watchdog_task: NIC Link is Up 1000 Mbps Full Duplex
bonding: bond0: making interface eth0 the new active one 0 ms earlier.
bonding: bond0: first active interface up!
bonding: bond0: enslaving eth0 as an active interface with an up link.
e1000: eth1: e1000_watchdog_task: NIC Link is Up 1000 Mbps Full Duplex
bonding: bond0: enslaving eth1 as a backup interface with an up link.
bonding: bond0: link status definitely up for interface eth1.
NET: Registered protocol family 10
lo: Disabled Privacy Extensions
IPv6 over IPv4 tunneling driver
bond0: duplicate address detected!
eth0: no IPv6 routers present
eth1: no IPv6 routers present
device-mapper: cleaned up

These are the only messages on the serial console server from the mentioned crash.

  BUG: spinlock wrong CPU on CPU#-135120464, kjournald/529 (Not tainted)
  lock: f7e28034, .magic: dead4ead, .owner: kjournald/529, .owner_cpu: 3
  <c04ea6a6> spin_bug+0xaa/0x122  <c04ea775> _raw_spin_unlock+0x57/0x6c
  <c0618142> _spin_unlock_irqrestore+0x8/0xc  <f887ebfd>
scsi_dispatch_cmd+0x247/0x2bb [scsi_mod]
  <f8883b28> scsi_request_fn+0x2ce/0x38b [scsi_mod]  <c042d9df>
del_timer+0x41/0x4a
  <c04db1ef> __generic_unplug_device+0x1d/0x1f  <f88830c0>
scsi_queue_insert+0x84/0xa2 [scsi_mod]
  <f88814df> scsi_delete_timer+0xf/0x50 [scsi_mod]  <f887ec2f>
scsi_dispatch_cmd+0x279/0x2bb [scsi_mod]
  <f8883b28> scsi_request_fn+0x2ce/0x38b [scsi_mod]  <c042d9df>
del_timer+0x41/0x4a
  <c04db1ef> __generic_unplug_device+0x1d/0x1f  <f88830c0>
scsi_queue_insert+0x84/0xa2 [scsi_mod]
  <f88814df> scsi_delete_timer+0xf/0x50 [scsi_mod]  <f887ec2f>
scsi_dispatch_cmd+0x279/0x2bb [scsi_mod]
  <f8883b28> scsi_request_fn+0x2ce/0x38b [scsi_mod]  <c042d9df>
del_timer+0x41/0x4a
  <c04db1ef> __generic_unplug_device+0x1d/0x1f  <f88830c0>
scsi_queue_insert+0x84/0xa2 [scsi_mod]
  <f88814df> scsi_delete_timer+0xf/0x50 [scsi_mod]  <f887ec2f>
scsi_dispatch_cmd+0x279/0x2bb [scsi_mod]
  <f8883b28> scsi_request_fn+0x2ce/0x38b [scsi_mod]  <c042d9df>
del_timer+0x41/0x4a
  <c04db1ef> __generic_unplug_device+0x1d/0x1f  <f88830c0>
scsi_queue_insert+0x84/0xa2 [scsi_mod]
  <f88814df> scsi_delete_timer+0xf/0x50 [scsi_mod]  <f887ec2f>
scsi_dispatch_cmd+0x279/0x2bb [scsi_mod]
  <f8883b28> scsi_request_fn+0x2ce/0x38b [scsi_mod]  <c042d9df>
del_timer+0x41/0x4a
  <c04db1ef> __generic_unplug_device+0x1d/0x1f  <f88830c0>
scsi_queue_insert+0x84/0xa2 [scsi_mod]
  <f88814df> scsi_delete_timer+0xf/0x50 [scsi_mod]  <f887ec2f>
scsi_dispatch_cmd+0x279/0x2bb [scsi_mod]
  <f8883b28> scsi_request_fn+0x2ce/0x38b [scsi_mod]  <c042d9df>
del_timer+0x41/0x4a
  <c04db1ef> __generic_unplug_device+0x1d/0x1f  <f88830c0>
scsi_queue_insert+0x84/0xa2 [scsi_mod]
  <f88814df> scsi_delete_timer+0xf/0x50 [scsi_mod]  <f887ec2f>
scsi_dispatch_cmd+0x279/0x2bb [scsi_mod]
  <f8883b28> scsi_request_fn+0x2ce/0x38b [scsi_mod]  <c042d9df>
del_timer+0x41/0x4a
  <c04db1ef> __generic_unplug_device+0x1d/0x1f  <f88830c0>
scsi_queue_insert+0x84/0xa2 [scsi_mod]
  <f88814df> scsi_delete_timer+0xf/0x50 [scsi_mod]  <f887ec2f>
scsi_dispatch_cmd+0x279/0x2bb [scsi_mod]
  <f8883b28> scsi_request_fn+0x2ce/0x38b [scsi_mod]  <c042d9df>
del_timer+0x41/0x4a
  <c04db1ef> __generic_unplug_device+0x1d/0x1f  <f88830c0>
scsi_queue_insert+0x84/0xa2 [scsi_mod]
  <f88814df> scsi_delete_timer+0xf/0x50 [scsi_mod]  <f887ec2f>
scsi_dispatch_cmd+0x279/0x2bb [scsi_mod]
  <f8883b28> scsi_request_fn+0x2ce/0x38b [scsi_mod]  <c042d9df>
del_timer+0x41/0x4a
  <c04db1ef> __generic_unplug_device+0x1d/0x1f  <f88830c0>
scsi_queue_insert+0x84/0xa2 [scsi_mod]
  <f88814df> scsi_delete_timer+0xf/0x50 [scsi_mod]  <f887ec2f>
scsi_dispatch_cmd+0x279/0x2bb [scsi_mod]
  <f8883b28> scsi_request_fn+0x2ce/0x38b [scsi_mod]  <c042d9df>
del_timer+0x41/0x4a
  <c04db1ef> __generic_unplug_device+0x1d/0x1f  <f88830c0>
scsi_queue_insert+0x84/0xa2 [scsi_mod]
  <f88814df> scsi_delete_timer+0xf/0x50 [scsi_mod]  <f887ec2f>
scsi_dispatch_cmd+0x279/0x2bb [scsi_mod]
  <f8883b28> scsi_request_fn+0x2ce/0x38b [scsi_mod]  <c042d9df>
del_timer+0x41/0x4a
  <c04db1ef> __generic_unplug_device+0x1d/0x1f  <f88830c0>
scsi_queue_insert+0x84/0xa2 [scsi_mod]
  <f88814df> scsi_delete_timer+0xf/0x50 [scsi_mod]  <f887ec2f>
scsi_dispatch_cmd+0x279/0x2bb [scsi_mod]
  <f8883b28> scsi_request_fn+0x2ce/0x38b [scsi_mod]  <c042d9df>
del_timer+0x41/0x4a
  <c04db1ef> __generic_unplug_device+0x1d/0x1f  <f88830c0>
scsi_queue_insert+0x84/0xa2 [scsi_mod]
  <f88814df> scsi_delete_timer+0xf/0x50 [scsi_mod]  <f887ec2f>
scsi_dispatch_cmd+0x279/0x2bb [scsi_mod]
  <f8883b28> scsi_request_fn+0x2ce/0x38b [scsi_mod]  <c042d9df>
del_timer+0x41/0x4a
  <c04db1ef> __generic_unplug_device+0x1d/0x1f  <f88830c0> scsi_q



NEXT
====


BUG: spinlock wrong CPU on CPU#-136275792, kjournald/426 (Not tainted)
BUG: unable to handle kernel paging request<0>BUG: spinlock lockup on CPU#2, swapper/0, c9b98034 (Not tainted)
BUG: spinlock lockup on CPU#-134583280, _L08|?/6, c06d58d4 (Not tainted)
BUG: spinlock lockup on CPU#2, swapper/0, c06d58d4 (Not tainted)
BUG: spinlock lockup on CPU#0, swapper/0, c06d58d4 (Not tainted)
BUG: spinlock lockup on CPU#-134583280, _L08|?/6, c06d58d4 (Not tainted)
BUG: spinlock lockup on CPU#0, swapper/0, c06d58d4 (Not tainted)
BUG: spinlock lockup on CPU#-134583280, _L08|?/6, c06d58d4 (Not tainted)
BUG: spinlock lockup on CPU#2, swapper/0, c06d58d4 (Not tainted)
BUG: spinlock lockup on CPU#0, swapper/0, c06d58d4 (Not tainted)


NEXT
====

isg-prod-mysql3 login: BUG: unable to handle kernel paging request at
virtual address 69c92050
  printing eip:
c042d60b
*pde = 00000000
Oops: 0000 [#1]
SMP
last sysfs file: /block/hdb/removable
Modules linked in: ipv6 bonding arpt_mangle arptable_filter arp_tables
x_tables dm_mirror dm_multipath dm_mod lp parport_pc parport floppy
uhci_hcd ehci_hcd sg e1000 serio_raw i2c_i801 i2c_core ext3 jbd 3w_9xxx
sata_mv libata sd_mod scsi_mod
CPU:    72
EIP:    0060:[<c042d60b>]    Not tainted VLI
EFLAGS: 00210096   (2.6.17-1.2174_FC5smp #1)
EIP is at __mod_timer+0x59/0xa7
eax: ea553034   ebx: c9962558   ecx: f883c689   edx: c0788238
esi: c9b659a0   edi: c9940000   ebp: 00245ecd   esp: ea553030
ds: 007b   es: 007b   ss: 0068
Process ) (pid: 40, threadinfo=ea552000 task=ea554000)
Stack: 00000000 00200286 c9962500 c9b659a0 c9b44000 c9b44000 f8839aec
00000000
        00200082 c9b65a34 ea553078 ea8c2cd4 c9962500 c9b659a0 c9ae5400
c9b44000
        f883eb28 c042d9df 00200082 c9b659a0 c9b659a0 c9ae54a0 c9b44000
ea8c2cd4
Call Trace:
  <f8839aec> scsi_dispatch_cmd+0x136/0x2bb [scsi_mod]  <f883eb28>
scsi_request_fn+0x2ce/0x38b [scsi_mod]
  <c042d9df> del_timer+0x41/0x4a  <c04db1ef>
__generic_unplug_device+0x1d/0x1f
  <f883e0c0> scsi_queue_insert+0x84/0xa2 [scsi_mod]  <f883c4df>
scsi_delete_timer+0xf/0x50 [scsi_mod]
  <f8839c2f> scsi_dispatch_cmd+0x279/0x2bb [scsi_mod]  <f883eb28>
scsi_request_fn+0x2ce/0x38b [scsi_mod]
  <c042d9df> del_timer+0x41/0x4a  <c04db1ef>
__generic_unplug_device+0x1d/0x1f
  <f883e0c0> scsi_queue_insert+0x84/0xa2 [scsi_mod]  <f883c4df>
scsi_delete_timer+0xf/0x50 [scsi_mod]
  <f8839c2f> scsi_dispatch_cmd+0x279/0x2bb [scsi_mod]  <f883eb28>
scsi_request_fn+0x2ce/0x38b [scsi_mod]
  <c042d9df> del_timer+0x41/0x4a  <c04db1ef>
__generic_unplug_device+0x1d/0x1f
  <f883e0c0> scsi_queue_insert+0x84/0xa2 [scsi_mod]  <f883c4df>
scsi_delete_timer+0xf/0x50 [scsi_mod]
  <f8839c2f> scsi_dispatch_cmd+0x279/0x2bb [scsi_mod]  <f883eb28>
scsi_request_fn+0x2ce/0x38b [scsi_mod]
  <c042d9df> del_timer+0x41/0x4a  <c04db1ef>
__generic_unplug_device+0x1d/0x1f
  <f883e0c0> scsi_queue_insert+0x84/0xa2 [scsi_mod]  <f883c4df>
scsi_delete_timer+0xf/0x50 [scsi_mod]
  <f8839c2f> scsi_dispatch_cmd+0x279/0x2bb [scsi_mod]  <f883eb28>
scsi_request_fn+0x2ce/0x38b [scsi_mod]
  <c042d9df> del_timer+0x41/0x4a  <c04db1ef>
__generic_unplug_device+0x1d/0x1f
  <f883e0c0> scsi_queue_insert+0x84/0xa2 [scsi_mod]  <f883c4df>
scsi_delete_timer+0xf/0x50 [scsi_mod]
  <f8839c2f> scsi_dispatch_cmd+0x279/0x2bb [scsi_mod]  <f883eb28>
scsi_request_fn+0x2ce/0x38b [scsi_mod]
  <c042d9df> del_timer+0x41/0x4a  <c04db1ef>
__generic_unplug_device+0x1d/0x1f
  <f883e0c0> scsi_queue_insert+0x84/0xa2 [scsi_mod]  <f883c4df>
scsi_delete_timer+0xf/0x50 [scsi_mod]
  <f8839c2f> scsi_dispatch_cmd+0x279/0x2bb [scsi_mod]  <f883eb28>
scsi_request_fn+0x2ce/0x38b [scsi_mod]
  <c042d9df> del_timer+0x41/0x4a  <c04db1ef>
__generic_unplug_device+0x1d/0x1f
  <f883e0c0> scsi_queue_insert+0x84/0xa2 [scsi_mod]  <f883c4df>
scsi_delete_timer+0xf/0x50 [scsi_mod]
  <f8839c2f> scsi_dispatch_cmd+0x279/0x2bb [scsi_mod]  <f883eb28>
scsi_request_fn+0x2ce/0x38b [scsi_mod]
  <c042d9df> del_timer+0x41/0x4a  <c04db1ef>
__generic_unplug_device+0x1d/0x1f
  <f883e0c0> scsi_queue_insert+0x84/0xa2 [scsi_mod]  <f883c4df>
scsi_delete_timer+0xf/0x50 [scsi_mod]
  <f8839c2f> scsi_dispatch_cmd+0x279/0x2bb [scsi_mod]  <f883eb28>
scsi_request_fn+0x2ce/0x38b [scsi_mod]
  <c042d9df> del_timer+0x41/0x4a  <c04db1ef>
__generic_unplug_device+0x1d/0x1f
  <f883e0c0> scsi_queue_insert+0x84/0xa2 [scsi_mod]  <f883c4df>
scsi_delete_timer+0xf/0x50 [scsi_mod]
  <f8839c2f> scsi_dispatch_cmd+0x279/0x2bb [scsi_mod]  <f883eb28>
scsi_request_fn+0x2ce/0x38b [scsi_mod]
  <c042d9df> del_timer+0x41/0x4a  <c04db1ef>
__generic_unplug_device+0x1d/0x1f
  <f883e0c0> scsi_queue_insert+0x84/0xa2 [scsi_mod]  <f883c4df>
scsi_delete_timer+0xf/0x50 [scsi_mod]
  <f8839c2f> scsi_dispatch_cmd+0x279/0x2bb [scsi_mod]  <f883eb28>
scsi_request_fn+0x2ce/0x38b [scsi_mod] 


DMESG
=====

Linux version 2.6.17-1.2174_FC5smp (isg isg-prod-mysql3) (gcc version 4.1.1 20060525 (Red Hat 4.1.1-1)) #1 SMP Fri Sep 1 16:52:37 BST 2006
BIOS-provided physical RAM map:
 BIOS-e820: 0000000000000000 - 000000000009d800 (usable)
 BIOS-e820: 000000000009d800 - 00000000000a0000 (reserved)
 BIOS-e820: 00000000000ce000 - 00000000000d0000 (reserved)
 BIOS-e820: 00000000000e4000 - 0000000000100000 (reserved)
 BIOS-e820: 0000000000100000 - 00000000bff60000 (usable)
 BIOS-e820: 00000000bff60000 - 00000000bff69000 (ACPI data)
 BIOS-e820: 00000000bff69000 - 00000000bff80000 (ACPI NVS)
 BIOS-e820: 00000000bff80000 - 00000000c0000000 (reserved)
 BIOS-e820: 00000000e0000000 - 00000000f0000000 (reserved)
 BIOS-e820: 00000000fec00000 - 00000000fec10000 (reserved)
 BIOS-e820: 00000000fee00000 - 00000000fee01000 (reserved)
 BIOS-e820: 00000000ff000000 - 0000000100000000 (reserved)
 BIOS-e820: 0000000100000000 - 0000000440000000 (usable)
16512MB HIGHMEM available.
895MB LOWMEM available.
found SMP MP-table at 000f59d0
Using x86 segment limits to approximate NX protection
On node 0 totalpages: 4456448
  DMA zone: 4096 pages, LIFO batch:0
  Normal zone: 225279 pages, LIFO batch:31
  HighMem zone: 4227073 pages, LIFO batch:31
DMI present.
Using APIC driver default
Intel MultiProcessor Specification v1.4
    Virtual Wire compatibility mode.
OEM ID: INTEL    Product ID: Bridge CRB   APIC at: 0xFEE00000
Processor #0 6:15 APIC version 20
Processor #6 6:15 APIC version 20
Processor #1 6:15 APIC version 20
Processor #7 6:15 APIC version 20
I/O APIC #2 Version 32 at 0xFEC00000.
I/O APIC #3 Version 32 at 0xFEC80000.
Enabling APIC mode:  Flat.  Using 2 I/O APICs
Processors: 4
Allocating PCI resources starting at c2000000 (gap: c0000000:20000000)
Built 1 zonelists
Kernel command line: ro root=LABEL=/root boot=LABEL=/boot selinux=0 console=ttyS0,115200  noacpi acpi=off noapic hostname=isg-prod-mysql3
mapped APIC to ffffd000 (fee00000)
mapped IOAPIC to ffffc000 (fec00000)
mapped IOAPIC to ffffb000 (fec80000)
Enabling fast FPU save and restore... done.
Enabling unmasked SIMD FPU exception support... done.
Initializing CPU#0
CPU 0 irqstacks, hard=c07ae000 soft=c078e000
PID hash table entries: 4096 (order: 12, 16384 bytes)
Detected 3000.561 MHz processor.
Using tsc for high-res timesource
Console: colour VGA+ 80x25
Dentry cache hash table entries: 131072 (order: 7, 524288 bytes)
Inode-cache hash table entries: 65536 (order: 6, 262144 bytes)
Memory: 16629584k/17825792k available (2154k kernel code, 145696k reserved, 1200k data, 244k init, 15859076k highmem)
Checking if this processor honours the WP bit even in supervisor mode... Ok.
Calibrating delay using timer specific routine.. 6009.75 BogoMIPS (lpj=12019511)
Security Framework v1.0.0 initialized
SELinux:  Disabled at boot.
Capability LSM initialized
Mount-cache hash table entries: 512
CPU: After generic identify, caps: bfebfbff 20000000 00000000 00000000 0004e3bd 00000000 00000001
CPU: After vendor identify, caps: bfebfbff 20000000 00000000 00000000 0004e3bd 00000000 00000001
monitor/mwait feature present.
using mwait in idle threads.
CPU: L1 I cache: 32K, L1 D cache: 32K
CPU: L2 cache: 4096K
CPU: Physical Processor ID: 0
CPU: Processor Core ID: 0
CPU: After all inits, caps: bfebf3ff 20000000 00000000 00000140 0004e3bd 00000000 00000001
Intel machine check architecture supported.
Intel machine check reporting enabled on CPU#0.
Checking 'hlt' instruction... OK.
SMP alternatives: switching to UP code
CPU0: Intel(R) Xeon(R) CPU            5160  @ 3.00GHz stepping 06
SMP alternatives: switching to SMP code
Booting processor 1/1 eip 3000
CPU 1 irqstacks, hard=c07af000 soft=c078f000
Initializing CPU#1
Calibrating delay using timer specific routine.. 6000.59 BogoMIPS (lpj=12001183)
CPU: After generic identify, caps: bfebfbff 20000000 00000000 00000000 0004e3bd 00000000 00000001
CPU: After vendor identify, caps: bfebfbff 20000000 00000000 00000000 0004e3bd 00000000 00000001
monitor/mwait feature present.
CPU: L1 I cache: 32K, L1 D cache: 32K
CPU: L2 cache: 4096K
CPU: Physical Processor ID: 0
CPU: Processor Core ID: 1
CPU: After all inits, caps: bfebf3ff 20000000 00000000 00000140 0004e3bd 00000000 00000001
Intel machine check architecture supported.
Intel machine check reporting enabled on CPU#1.
CPU1: Intel(R) Xeon(R) CPU            5160  @ 3.00GHz stepping 06
SMP alternatives: switching to SMP code
Booting processor 2/6 eip 3000
CPU 2 irqstacks, hard=c07b0000 soft=c0790000
Initializing CPU#2
Calibrating delay using timer specific routine.. 6000.70 BogoMIPS (lpj=12001413)
CPU: After generic identify, caps: bfebfbff 20000000 00000000 00000000 0004e3bd 00000000 00000001
CPU: After vendor identify, caps: bfebfbff 20000000 00000000 00000000 0004e3bd 00000000 00000001
monitor/mwait feature present.
CPU: L1 I cache: 32K, L1 D cache: 32K
CPU: L2 cache: 4096K
CPU: Physical Processor ID: 3
CPU: Processor Core ID: 0
CPU: After all inits, caps: bfebf3ff 20000000 00000000 00000140 0004e3bd 00000000 00000001
Intel machine check architecture supported.
Intel machine check reporting enabled on CPU#2.
CPU2: Intel(R) Xeon(R) CPU            5160  @ 3.00GHz stepping 06
SMP alternatives: switching to SMP code
Booting processor 3/7 eip 3000
CPU 3 irqstacks, hard=c07b1000 soft=c0791000
Initializing CPU#3
Calibrating delay using timer specific routine.. 6000.70 BogoMIPS (lpj=12001411)
CPU: After generic identify, caps: bfebfbff 20000000 00000000 00000000 0004e3bd 00000000 00000001
CPU: After vendor identify, caps: bfebfbff 20000000 00000000 00000000 0004e3bd 00000000 00000001
monitor/mwait feature present.
CPU: L1 I cache: 32K, L1 D cache: 32K
CPU: L2 cache: 4096K
CPU: Physical Processor ID: 3
CPU: Processor Core ID: 1
CPU: After all inits, caps: bfebf3ff 20000000 00000000 00000140 0004e3bd 00000000 00000001
Intel machine check architecture supported.
Intel machine check reporting enabled on CPU#3.
CPU3: Intel(R) Xeon(R) CPU            5160  @ 3.00GHz stepping 06
Total of 4 processors activated (24011.75 BogoMIPS).
checking TSC synchronization across 4 CPUs: passed.
Brought up 4 CPUs
migration_cost=32,8842
checking if image is initramfs... it is
Freeing initrd memory: 1000k freed
NET: Registered protocol family 16
PCI: PCI BIOS revision 2.10 entry at 0xfd767, last bus=9
Setting up standard PCI resources
ACPI: Subsystem revision 20060127
ACPI: Interpreter disabled.
Linux Plug and Play Support v0.97 (c) Adam Belay
pnp: PnP ACPI: disabled
usbcore: registered new driver usbfs
usbcore: registered new driver hub
PCI: Probing PCI hardware
PCI: Probing PCI hardware (bus 00)
PCI: PXH quirk detected, disabling MSI for SHPC device
Boot video device is 0000:09:01.0
PCI: Transparent bridge - 0000:00:1e.0
PCI: Using IRQ router PIIX/ICH [8086/2670] at 0000:00:1f.0
PCI: Found IRQ 11 for device 0000:00:00.0
PCI: Sharing IRQ 11 with 0000:00:02.0
PCI: Sharing IRQ 11 with 0000:00:04.0
PCI: Sharing IRQ 11 with 0000:00:06.0
PCI: Sharing IRQ 11 with 0000:00:08.0
PCI: Sharing IRQ 11 with 0000:01:00.0
PCI: Sharing IRQ 11 with 0000:02:00.0
PCI: Sharing IRQ 11 with 0000:04:01.0
PCI: Bridge: 0000:03:00.0
  IO window: 2000-2fff
  MEM window: c8100000-c81fffff
  PREFETCH window: ca000000-cbffffff
PCI: Bridge: 0000:02:00.0
  IO window: 2000-2fff
  MEM window: c8100000-c81fffff
  PREFETCH window: ca000000-cbffffff
PCI: Bridge: 0000:02:02.0
  IO window: 3000-3fff
  MEM window: c8200000-c82fffff
  PREFETCH window: disabled.
PCI: Bridge: 0000:01:00.0
  IO window: 2000-3fff
  MEM window: c8100000-c82fffff
  PREFETCH window: ca000000-cbffffff
PCI: Bridge: 0000:01:00.3
  IO window: disabled.
  MEM window: disabled.
  PREFETCH window: disabled.
PCI: Bridge: 0000:00:02.0
  IO window: 2000-3fff
  MEM window: c8000000-c82fffff
  PREFETCH window: ca000000-cbffffff
PCI: Bridge: 0000:00:04.0
  IO window: disabled.
  MEM window: disabled.
  PREFETCH window: disabled.
PCI: Bridge: 0000:00:06.0
  IO window: disabled.
  MEM window: disabled.
  PREFETCH window: disabled.
PCI: Bridge: 0000:00:1e.0
  IO window: 4000-4fff
  MEM window: c8300000-c83fffff
  PREFETCH window: d0000000-d7ffffff
PCI: Found IRQ 11 for device 0000:00:02.0
PCI: Sharing IRQ 11 with 0000:00:00.0
PCI: Sharing IRQ 11 with 0000:00:04.0
PCI: Sharing IRQ 11 with 0000:00:06.0
PCI: Sharing IRQ 11 with 0000:00:08.0
PCI: Sharing IRQ 11 with 0000:01:00.0
PCI: Sharing IRQ 11 with 0000:02:00.0
PCI: Sharing IRQ 11 with 0000:04:01.0
PCI: Setting latency timer of device 0000:00:02.0 to 64
PCI: Found IRQ 11 for device 0000:01:00.0
PCI: Sharing IRQ 11 with 0000:00:00.0
PCI: Sharing IRQ 11 with 0000:00:02.0
PCI: Sharing IRQ 11 with 0000:00:04.0
PCI: Sharing IRQ 11 with 0000:00:06.0
PCI: Sharing IRQ 11 with 0000:00:08.0
PCI: Sharing IRQ 11 with 0000:02:00.0
PCI: Sharing IRQ 11 with 0000:04:01.0
PCI: Setting latency timer of device 0000:01:00.0 to 64
PCI: Found IRQ 11 for device 0000:02:00.0
PCI: Sharing IRQ 11 with 0000:00:00.0
PCI: Sharing IRQ 11 with 0000:00:02.0
PCI: Sharing IRQ 11 with 0000:00:04.0
PCI: Sharing IRQ 11 with 0000:00:06.0
PCI: Sharing IRQ 11 with 0000:00:08.0
PCI: Sharing IRQ 11 with 0000:01:00.0
PCI: Sharing IRQ 11 with 0000:04:01.0
PCI: Setting latency timer of device 0000:02:00.0 to 64
PCI: Setting latency timer of device 0000:03:00.0 to 64
PCI: Found IRQ 5 for device 0000:02:02.0
PCI: Sharing IRQ 5 with 0000:05:00.0
PCI: Sharing IRQ 5 with 0000:09:01.0
PCI: Setting latency timer of device 0000:02:02.0 to 64
PCI: Setting latency timer of device 0000:01:00.3 to 64
PCI: Found IRQ 11 for device 0000:00:04.0
PCI: Sharing IRQ 11 with 0000:00:00.0
PCI: Sharing IRQ 11 with 0000:00:02.0
PCI: Sharing IRQ 11 with 0000:00:06.0
PCI: Sharing IRQ 11 with 0000:00:08.0
PCI: Sharing IRQ 11 with 0000:01:00.0
PCI: Sharing IRQ 11 with 0000:02:00.0
PCI: Sharing IRQ 11 with 0000:04:01.0
PCI: Setting latency timer of device 0000:00:04.0 to 64
PCI: Found IRQ 11 for device 0000:00:06.0
PCI: Sharing IRQ 11 with 0000:00:00.0
PCI: Sharing IRQ 11 with 0000:00:02.0
PCI: Sharing IRQ 11 with 0000:00:04.0
PCI: Sharing IRQ 11 with 0000:00:08.0
PCI: Sharing IRQ 11 with 0000:01:00.0
PCI: Sharing IRQ 11 with 0000:02:00.0
PCI: Sharing IRQ 11 with 0000:04:01.0
PCI: Setting latency timer of device 0000:00:06.0 to 64
PCI: Setting latency timer of device 0000:00:1e.0 to 64
NET: Registered protocol family 2
IP route cache hash table entries: 1048576 (order: 10, 4194304 bytes)
TCP established hash table entries: 131072 (order: 9, 2621440 bytes)
TCP bind hash table entries: 65536 (order: 8, 1310720 bytes)
TCP: Hash tables configured (established 131072 bind 65536)
TCP reno registered
apm: BIOS not found.
audit: initializing netlink socket (disabled)
audit(1157150806.392:1): initialized
highmem bounce pool size: 64 pages
Total HugeTLB memory allocated, 0
VFS: Disk quotas dquot_6.5.1
Dquot-cache hash table entries: 1024 (order 0, 4096 bytes)
Initializing Cryptographic API
ksign: Installing public key data
Loading keyring
- Added public key 910AD7F929B4C848
- User ID: Red Hat, Inc. (Kernel Module GPG key)
io scheduler noop registered
io scheduler anticipatory registered
io scheduler deadline registered
io scheduler cfq registered (default)
PCI: Found IRQ 11 for device 0000:00:02.0
PCI: Sharing IRQ 11 with 0000:00:00.0
PCI: Sharing IRQ 11 with 0000:00:04.0
PCI: Sharing IRQ 11 with 0000:00:06.0
PCI: Sharing IRQ 11 with 0000:00:08.0
PCI: Sharing IRQ 11 with 0000:01:00.0
PCI: Sharing IRQ 11 with 0000:02:00.0
PCI: Sharing IRQ 11 with 0000:04:01.0
PCI: Setting latency timer of device 0000:00:02.0 to 64
assign_interrupt_mode Found MSI capability
Allocate Port Service[0000:00:02.0:pcie00]
PCI: Found IRQ 11 for device 0000:00:04.0
PCI: Sharing IRQ 11 with 0000:00:00.0
PCI: Sharing IRQ 11 with 0000:00:06.0
PCI: Sharing IRQ 11 with 0000:00:08.0
PCI: Sharing IRQ 11 with 0000:01:00.0
PCI: Sharing IRQ 11 with 0000:02:00.0
PCI: Sharing IRQ 11 with 0000:04:01.0
PCI: Setting latency timer of device 0000:00:04.0 to 64
assign_interrupt_mode Found MSI capability
Allocate Port Service[0000:00:04.0:pcie00]
PCI: Found IRQ 11 for device 0000:00:06.0
PCI: Sharing IRQ 11 with 0000:00:00.0
PCI: Sharing IRQ 11 with 0000:00:08.0
PCI: Sharing IRQ 11 with 0000:01:00.0
PCI: Sharing IRQ 11 with 0000:02:00.0
PCI: Sharing IRQ 11 with 0000:04:01.0
PCI: Setting latency timer of device 0000:00:06.0 to 64
assign_interrupt_mode Found MSI capability
Allocate Port Service[0000:00:06.0:pcie00]
PCI: Found IRQ 11 for device 0000:01:00.0
PCI: Sharing IRQ 11 with 0000:00:00.0
PCI: Sharing IRQ 11 with 0000:00:08.0
PCI: Sharing IRQ 11 with 0000:02:00.0
PCI: Sharing IRQ 11 with 0000:04:01.0
PCI: Setting latency timer of device 0000:01:00.0 to 64
Allocate Port Service[0000:01:00.0:pcie10]
PCI: Found IRQ 11 for device 0000:02:00.0
PCI: Sharing IRQ 11 with 0000:00:00.0
PCI: Sharing IRQ 11 with 0000:00:08.0
PCI: Sharing IRQ 11 with 0000:01:00.0
PCI: Sharing IRQ 11 with 0000:04:01.0
PCI: Setting latency timer of device 0000:02:00.0 to 64
assign_interrupt_mode Found MSI capability
Allocate Port Service[0000:02:00.0:pcie20]
PCI: Found IRQ 5 for device 0000:02:02.0
PCI: Sharing IRQ 5 with 0000:05:00.0
PCI: Sharing IRQ 5 with 0000:09:01.0
PCI: Setting latency timer of device 0000:02:02.0 to 64
assign_interrupt_mode Found MSI capability
Allocate Port Service[0000:02:02.0:pcie20]
pci_hotplug: PCI Hot Plug PCI Core version: 0.5
isapnp: Scanning for PnP cards...
isapnp: No Plug & Play device found
Real Time Clock Driver v1.12ac
Non-volatile memory driver v1.2
Linux agpgart interface v0.101 (c) Dave Jones
Serial: 8250/16550 driver $Revision: 1.90 $ 4 ports, IRQ sharing enabled
serial8250: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
RAMDISK driver initialized: 16 RAM disks of 16384K size 1024 blocksize
Uniform Multi-Platform E-IDE driver Revision: 7.00alpha2
ide: Assuming 33MHz system bus speed for PIO modes; override with idebus=xx
Probing IDE interface ide0...
Probing IDE interface ide1...
ide-floppy driver 0.99.newide
usbcore: registered new driver libusual
usbcore: registered new driver hiddev
usbcore: registered new driver usbhid
drivers/usb/input/hid-core.c: v2.6:USB HID core driver
PNP: No PS/2 controller found. Probing ports directly.
serio: i8042 AUX port at 0x60,0x64 irq 12
serio: i8042 KBD port at 0x60,0x64 irq 1
mice: PS/2 mouse device common for all mice
md: md driver 0.90.3 MAX_MD_DEVS=256, MD_SB_DISKS=27
md: bitmap version 4.39
TCP bic registered
Initializing IPsec netlink socket
NET: Registered protocol family 1
NET: Registered protocol family 17
Using IPI No-Shortcut mode
Freeing unused kernel memory: 244k freed
Write protecting the kernel read-only data: 723k
SCSI subsystem initialized
3ware 9000 Storage Controller device driver for Linux v2.26.02.007.
PCI: Found IRQ 11 for device 0000:04:01.0
PCI: Sharing IRQ 11 with 0000:00:00.0
PCI: Sharing IRQ 11 with 0000:00:08.0
PCI: Sharing IRQ 11 with 0000:01:00.0
3w-9xxx: scsi0: AEN: WARNING (0x04:0x0008): Unclean shutdown detected:unit=0.
scsi0 : 3ware 9000 Storage Controller
3w-9xxx: scsi0: Found a 3ware 9000 Storage Controller at 0xc8100000, IRQ: 11.
3w-9xxx: scsi0: Firmware FE9X 3.04.00.005, BIOS BE9X 3.04.00.002, Ports: 4.
  Vendor: AMCC      Model: 9550SX-4LP DISK   Rev: 3.04
  Type:   Direct-Access                      ANSI SCSI revision: 03
SCSI device sda: 976541696 512-byte hdwr sectors (499989 MB)
sda: Write Protect is off
sda: Mode Sense: 23 00 00 00
SCSI device sda: drive cache: write back, no read (daft)
SCSI device sda: 976541696 512-byte hdwr sectors (499989 MB)
sda: Write Protect is off
sda: Mode Sense: 23 00 00 00
SCSI device sda: drive cache: write back, no read (daft)
 sda: sda1 sda2 sda3 sda4
sd 0:0:0:0: Attached scsi disk sda
  Vendor: AMCC      Model: 9550SX-4LP DISK   Rev: 3.04
  Type:   Direct-Access                      ANSI SCSI revision: 03
SCSI device sdb: 1953083392 512-byte hdwr sectors (999979 MB)
sdb: Write Protect is off
sdb: Mode Sense: 23 00 00 00
SCSI device sdb: drive cache: write back, no read (daft)
SCSI device sdb: 1953083392 512-byte hdwr sectors (999979 MB)
sdb: Write Protect is off
sdb: Mode Sense: 23 00 00 00
SCSI device sdb: drive cache: write back, no read (daft)
 sdb: sdb1
sd 0:0:1:0: Attached scsi disk sdb
EXT3-fs: INFO: recovery required on readonly filesystem.
EXT3-fs: write access will be enabled during recovery.
kjournald starting.  Commit interval 5 seconds
EXT3-fs: recovery complete.
EXT3-fs: mounted filesystem with ordered data mode.
hw_random: RNG not detected
Intel(R) PRO/1000 Network Driver - version 7.0.33-k2-NAPI
Copyright (c) 1999-2005 Intel Corporation.
PCI: Found IRQ 5 for device 0000:05:00.0
PCI: Sharing IRQ 5 with 0000:09:01.0
PCI: Setting latency timer of device 0000:05:00.0 to 64
e1000: 0000:05:00.0: e1000_probe: (PCI Express:2.5Gb/s:Width x4) 00:30:48:78:5a:12
sd 0:0:0:0: Attached scsi generic sg0 type 0
sd 0:0:1:0: Attached scsi generic sg1 type 0
e1000: eth0: e1000_probe: Intel(R) PRO/1000 Network Connection
PCI: Found IRQ 10 for device 0000:05:00.1
PCI: Sharing IRQ 10 with 0000:00:1f.3
PCI: Setting latency timer of device 0000:05:00.1 to 64
e1000: 0000:05:00.1: e1000_probe: (PCI Express:2.5Gb/s:Width x4) 00:30:48:78:5a:13
e1000: eth1: e1000_probe: Intel(R) PRO/1000 Network Connection
floppy0: no floppy controllers found
lp: driver loaded but no devices found
md: Autodetecting RAID arrays.
md: autorun ...
md: ... autorun DONE.
device-mapper: 4.6.0-ioctl (2006-02-17) initialised: dm-devel redhat com
device-mapper: dm-multipath version 1.0.4 loaded
EXT3 FS on sda3, internal journal
kjournald starting.  Commit interval 5 seconds
EXT3 FS on sda1, internal journal
EXT3-fs: mounted filesystem with ordered data mode.
kjournald starting.  Commit interval 5 seconds
EXT3 FS on sda4, internal journal
EXT3-fs: recovery complete.
EXT3-fs: mounted filesystem with ordered data mode.
kjournald starting.  Commit interval 5 seconds
EXT3-fs warning: maximal mount count reached, running e2fsck is recommended
EXT3 FS on sdb1, internal journal
EXT3-fs: recovery complete.
EXT3-fs: mounted filesystem with ordered data mode.
Adding 1959920k swap on /dev/sda2.  Priority:-1 extents:1 across:1959920k
arp_tables: (C) 2002 David S. Miller
Ethernet Channel Bonding Driver: v3.0.3 (March 23, 2006)
bonding: MII link monitoring set to 100 ms
e1000: eth0: e1000_watchdog_task: NIC Link is Up 1000 Mbps Full Duplex
bonding: bond0: making interface eth0 the new active one 0 ms earlier.
bonding: bond0: first active interface up!
bonding: bond0: enslaving eth0 as an active interface with an up link.
e1000: eth1: e1000_watchdog_task: NIC Link is Up 1000 Mbps Full Duplex
bonding: bond0: enslaving eth1 as a backup interface with an up link.
bonding: bond0: link status definitely up for interface eth1.
NET: Registered protocol family 10
lo: Disabled Privacy Extensions
IPv6 over IPv4 tunneling driver
bond0: duplicate address detected!
eth0: no IPv6 routers present
eth1: no IPv6 routers present
device-mapper: cleaned up

[Date Prev][Date Next]   [Thread Prev][Thread Next]   [Thread Index] [Date Index] [Author Index]