[Fedora-xen] [BUG] [x86-32/PAE] modular netbk causes panic

Tue Aug 8 06:20:12 UTC 2006

Hi All

I'm not sure if this is related to the IA64 netbk kernel panic that was 
just reported, but on my x86-32/PAE system, I'm seeing a crash as soon as 
netbk is loaded in Dom0. I'm using a fresh FC5 system with all updates 
merged. Specifically, the kernel is kernel-xen-2.6.17-1.2157_FC5 and xen 
is xen-3.0.2-3.FC5.

If I flip back to the kernel-xen0-2.6.17-1.2157_FC5 kernel (and non-PAE 
domU kernel, of course), the network works perfectly all the way from domU 
to the LAN.

The hardware is a 2p Opteron system with 16GB of RAM. The NICs are 
broadcom BCM5702s using the tg3 driver, for what it's worth.

I have a machine dedicated to this testing, so I'm happy to test any other 
kernels, configs, whatever else helps. I can throw this in bugzilla as 
well if it'd be helpful, let me know.

Thanks!

-Matt

Gory details below...

-bash-3.1# modprobe netbk
printk: 27 messages suppressed.
modprobe: page allocation failure. order:8, mode:0xd0
  <c044844a> __alloc_pages+0x298/0x2ac  <c0448483> 
__get_free_pages+0x25/0x34
  <c0549ebe> balloon_alloc_empty_page_range+0x34/0x167  <c902c05b> 
netback_init+0x5b/0x16d [netbk]
  <c902c0b1> netback_init+0xb1/0x16d [netbk]  <c042b092> 
blocking_notifier_call_chain+0x31/0x48
  <c0438def> sys_init_module+0x15df/0x178a  <c05b115a> 
register_netdevice+0x0/0x31a
  <c0404bff> syscall_call+0x7/0xb
Mem-info:
DMA per-cpu:
cpu 0 hot: high 42, batch 7 used:2
cpu 0 cold: high 14, batch 3 used:0
cpu 1 hot: high 42, batch 7 used:8
cpu 1 cold: high 14, batch 3 used:11
DMA32 per-cpu: empty
Normal per-cpu: empty
HighMem per-cpu: empty
Free pages:        6504kB (0kB HighMem)
Active:7358 inactive:2693 dirty:34 writeback:0 unstable:0 free:1626 
slab:2194 mapped:5098 pagetables:331
DMA free:6504kB min:1492kB low:1864kB high:2236kB active:29432kB 
inactive:10772kB present:139264kB pages_scanned:0 all_unreclaimable? no
lowmem_reserve[]: 0 0 0 0
DMA32 free:0kB min:0kB low:0kB high:0kB active:0kB inactive:0kB 
present:0kB pages_scanned:0 all_unreclaimable? no
lowmem_reserve[]: 0 0 0 0
Normal free:0kB min:0kB low:0kB high:0kB active:0kB inactive:0kB 
present:0kB pages_scanned:0 all_unreclaimable? no
lowmem_reserve[]: 0 0 0 0
HighMem free:0kB min:128kB low:128kB high:128kB active:0kB inactive:0kB 
present:0kB pages_scanned:0 all_unreclaimable? no
lowmem_reserve[]: 0 0 0 0
DMA: 293*4kB 205*8kB 49*16kB 16*32kB 3*64kB 3*128kB 3*256kB 0*512kB 
1*1024kB 0*2048kB 0*4096kB = 6476kB
DMA32: empty
Normal: empty
HighMem: empty
Swap cache: add 0, delete 0, find 0/0, race 0+0
Free swap  = 1052248kB
Total swap = 1052248kB
Free swap:       1052248kB
34816 pages of RAM
0 pages of HIGHMEM
17798 reserved pages
8132 pages shared
0 pages swap cached
34 pages dirty
0 pages writeback
5093 pages mapped
2195 pages slab
321 pages pagetables
------------[ cut here ]------------
kernel BUG at drivers/xen/netback/netback.c:1073!
invalid opcode: 0000 [#1]
SMP
Modules linked in: netbk ipv6 eeprom adm1026 hwmon_vid hwmon hidp l2cap 
bluetooth dm_mirror dm_mod video button battery ac parport_pc lp parport 
i2c_amd756 i2c_core sg hw_random tg3 ext3 jbd 3w_9xxx sd_mod scsi_mod
CPU:    1
EIP:    0061:[<c902c0b8>]    Not tainted VLI
EFLAGS: 00010246   (2.6.17-1.2157_FC5xen #1)
EIP is at netback_init+0xb8/0x16d [netbk]
eax: 00000000   ebx: c658fed0   ecx: c0622b14   edx: ffffff29
esi: c91f6000   edi: c5c7fff8   ebp: c5c7ffc0   esp: c658feb0
ds: 007b   es: 007b   ss: 0069
Process modprobe (pid: 1722, threadinfo=c658e000 task=c08130d0)
Stack: <0>c066c3e0 c91f6000 c5c7fff8 c042b092 00000001 dead4ead ffffffff 
ffffffff
        00000001 dead4ead ffffffff ffffffff c5c7ffe0 c0438def 00000017 
00000398
        00007354 00000ae0 c9203f80 00000000 00000000 00000000 00000000 
00000000
Call Trace:
  <c042b092> blocking_notifier_call_chain+0x31/0x48  <c0438def> 
sys_init_module+0x15df/0x178a
  <c05b115a> register_netdevice+0x0/0x31a  <c0404bff> syscall_call+0x7/0xb
Code: 00 e8 61 b0 3f f7 c7 05 14 51 20 c9 00 00 00 00 c7 05 10 51 20 c9 b7 
f3 1f c9 68 00 01 00 00 e8 d9 dd 51 f7 83 c4 10 85 c0 75 08 <0f> 0b 31 04 
28 13 20 c9 89 c2 31 c9 2b 15 10 7a 74 c0 c1 fa 05
EIP: [<c902c0b8>] netback_init+0xb8/0x16d [netbk] SS:ESP 0069:c658feb0
  Segmentation fault
-bash-3.1#

# /usr/sbin/xm info
host                   : linux-test-108.phlinux.com
release                : 2.6.17-1.2157_FC5xen
version                : #1 SMP Tue Jul 11 23:55:13 EDT 2006
machine                : i686
nr_cpus                : 2
nr_nodes               : 1
sockets_per_node       : 2
cores_per_socket       : 1
threads_per_core       : 1
cpu_mhz                : 2405
hw_caps                : 
00000000:00000000:078bfbff:e1d3fbff:00000000:00000010
total_memory           : 16255
free_memory            : 16004
xen_major              : 3
xen_minor              : 0
xen_extra              : -unstable
xen_caps               : xen-3.0-x86_32p
platform_params        : virt_start=0xf5800000
xen_changeset          : unavailable
cc_compiler            : gcc version 4.1.1 20060525 (Red Hat 4.1.1-1)
cc_compile_by          : brewbuilder
cc_compile_domain      : build.redhat.com
cc_compile_date        : Tue Jul 11 22:50:14 EDT 2006

# /usr/sbin/xm dmesg
  __  __            _____  ___                     _        _     _
  \ \/ /___ _ __   |___ / / _ \    _   _ _ __  ___| |_ __ _| |__ | | ___
   \  // _ \ '_ \    |_ \| | | |__| | | | '_ \/ __| __/ _` | '_ \| |/ _ \
   /  \  __/ | | |  ___) | |_| |__| |_| | | | \__ \ || (_| | |_) | |  __/
  /_/\_\___|_| |_| |____(_)___/    \__,_|_| |_|___/\__\__,_|_.__/|_|\___|

  http://www.cl.cam.ac.uk/netos/xen
  University of Cambridge Computer Laboratory

  Xen version 3.0-unstable (brewbuilder at build.redhat.com) (gcc version 
4.1.1 20060525 (Red Hat 4.1.1-1)) Tue Jul 11 22:50:14 EDT 2006
  Latest ChangeSet: unavailable

(XEN) Command line: /xen.gz-2.6.17-1.2157_FC5-PAE console=com2,vga 
nmi=dom0 dom0_mem=131072 com1=9600,8n1 com2=9600,8n1
(XEN) Physical RAM map:
(XEN)  0000000000000000 - 000000000009a800 (usable)
(XEN)  000000000009a800 - 00000000000a0000 (reserved)
(XEN)  00000000000ce000 - 0000000000100000 (reserved)
(XEN)  0000000000100000 - 00000000f7f60000 (usable)
(XEN)  00000000f7f60000 - 00000000f7f72000 (ACPI data)
(XEN)  00000000f7f72000 - 00000000f7f80000 (ACPI NVS)
(XEN)  00000000f7f80000 - 00000000f8000000 (reserved)
(XEN)  00000000fec00000 - 00000000fec00400 (reserved)
(XEN)  00000000fee00000 - 00000000fee01000 (reserved)
(XEN)  00000000fff80000 - 0000000100000000 (reserved)
(XEN)  0000000100000000 - 0000000400000000 (usable)
(XEN) System RAM: 16254MB (16645096kB)
(XEN) Xen heap: 9MB (9472kB)
(XEN) Using scheduler: SMP Credit Scheduler (credit)
(XEN) PAE enabled, limit: 16 GB
(XEN) found SMP MP-table at 000f77f0
(XEN) DMI present.
(XEN) Using APIC driver default
(XEN) ACPI: RSDP (v002 PTLTD                                 ) @ 
0x000f7790
(XEN) ACPI: XSDT (v001 PTLTD     XSDT   0x06040000  LTP 0x00000000) @ 
0xf7f6f1aa(XEN) ACPI: FADT (v003 AMD    HAMMER   0x06040000 PTEC 
0x000f4240) @ 0xf7f71b4a
(XEN) ACPI: SSDT (v001 PTLTD  POWERNOW 0x06040000  LTP 0x00000001) @ 
0xf7f71c3e
(XEN) ACPI: SRAT (v001 AMD    HAMMER   0x06040000 AMD  0x00000001) @ 
0xf7f71e4a
(XEN) ACPI: MADT (v001 PTLTD     APIC   0x06040000  LTP 0x00000000) @ 
0xf7f71f3a(XEN) ACPI: SPCR (v001 PTLTD  $UCRTBL$ 0x06040000 PTL 
0x00000001) @ 0xf7f71fb0
(XEN) ACPI: DSDT (v001 AMD-K8  AMDACPI 0x06040000 MSFT 0x0100000e) @ 
0x00000000
(XEN) ACPI: Local APIC address 0xfee00000
(XEN) ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled)
(XEN) Processor #0 15:5 APIC version 16
(XEN) ACPI: LAPIC (acpi_id[0x01] lapic_id[0x01] enabled)
(XEN) Processor #1 15:5 APIC version 16
(XEN) ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1])
(XEN) ACPI: IOAPIC (id[0x02] address[0xfec00000] gsi_base[0])
(XEN) IOAPIC[0]: apic_id 2, version 17, address 0xfec00000, GSI 0-23
(XEN) ACPI: IOAPIC (id[0x03] address[0xfb000000] gsi_base[24])
(XEN) IOAPIC[1]: apic_id 3, version 17, address 0xfb000000, GSI 24-27
(XEN) ACPI: IOAPIC (id[0x04] address[0xfb001000] gsi_base[28])
(XEN) IOAPIC[2]: apic_id 4, version 17, address 0xfb001000, GSI 28-31
(XEN) ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 high edge)
(XEN) ACPI: IRQ0 used by override.
(XEN) ACPI: IRQ2 used by override.
(XEN) Enabling APIC mode:  Flat.  Using 3 I/O APICs
(XEN) Using ACPI (MADT) for SMP configuration information
(XEN) Initializing CPU#0
(XEN) Detected 2405.466 MHz processor.
(XEN) CPU0: AMD Flush Filter disabled
(XEN) CPU: L1 I Cache: 64K (64 bytes/line), D cache 64K (64 bytes/line)
(XEN) CPU: L2 Cache: 1024K (64 bytes/line)
(XEN) Intel machine check architecture supported.
(XEN) Intel machine check reporting enabled on CPU#0.
(XEN) CPU0: AMD Opteron(tm) Processor 250 stepping 0a
(XEN) Booting processor 1/1 eip 90000
(XEN) Initializing CPU#1
(XEN) CPU1: AMD Flush Filter disabled
(XEN) CPU: L1 I Cache: 64K (64 bytes/line), D cache 64K (64 bytes/line)
(XEN) CPU: L2 Cache: 1024K (64 bytes/line)
(XEN) AMD: Disabling C1 Clock Ramping Node #0
(XEN) AMD: Disabling C1 Clock Ramping Node #1
(XEN) Intel machine check architecture supported.
(XEN) Intel machine check reporting enabled on CPU#1.
(XEN) CPU1: AMD Opteron(tm) Processor 250 stepping 0a
(XEN) Total of 2 processors activated.
(XEN) ENABLING IO-APIC IRQs
(XEN)  -> Using new ACK method
(XEN) ..TIMER: vector=0xF0 apic1=0 pin1=2 apic2=0 pin2=0
(XEN) checking TSC synchronization across 2 CPUs: passed.
(XEN) Platform timer is 1.193MHz PIT
(XEN) Brought up 2 CPUs
(XEN) Machine check exception polling timer started.
(XEN) *** LOADING DOMAIN 0 ***
(XEN) Domain 0 kernel supports features = { 0000001f }.
(XEN) Domain 0 kernel requires features = { 00000000 }.
(XEN) PHYSICAL MEMORY ARRANGEMENT:
(XEN)  Dom0 alloc.:   000000000f000000->0000000010000000 (28672 pages to 
be allocated)
(XEN) VIRTUAL MEMORY ARRANGEMENT:
(XEN)  Loaded kernel: c0400000->c076a9fc
(XEN)  Init. ramdisk: c076b000->c0990e00
(XEN)  Phys-Mach map: c0991000->c09b1000
(XEN)  Start info:    c09b1000->c09b2000
(XEN)  Page tables:   c09b2000->c09bd000
(XEN)  Boot stack:    c09bd000->c09be000
(XEN)  TOTAL:         c0000000->c0c00000
(XEN)  ENTRY ADDRESS: c0400000
(XEN) Dom0 has maximum 2 VCPUs
(XEN) Initrd len 0x225e00, start at 0xc076b000
(XEN) Scrubbing Free RAM: 
....................................................................................................................................................................done.
(XEN) Xen trace buffers: disabled
(XEN) Xen is relinquishing VGA console.
(XEN) *** Serial input -> DOM0 (type 'CTRL-a' three times to switch input 
to Xen).
(XEN) (file=io_apic.c, line=2061)
(XEN) ioapic_guest_write: apic=0, pin=4, old_irq=4, new_irq=4
(XEN) ioapic_guest_write: old_entry=000009f1, new_entry=000109f1
(XEN) ioapic_guest_write: Attempt to modify IO-APIC pin for in-use IRQ!
(XEN) (file=io_apic.c, line=2061)
(XEN) ioapic_guest_write: apic=0, pin=3, old_irq=3, new_irq=3
(XEN) ioapic_guest_write: old_entry=000009f2, new_entry=000109f2
(XEN) ioapic_guest_write: Attempt to modify IO-APIC pin for in-use IRQ!
(XEN) (file=dom0_ops.c, line=396) Domain 0 says that IO-APIC REGSEL is 
good