[vfio-users] Issues with multiple AMD R9 GPUs

sago at tutanota.com sago at tutanota.com
Fri Jan 1 22:59:55 UTC 2016


Hello, I wish you all a happy new year :)

I have been struggling with getting VFIO passthrough working for some months 
now and I am about to move on to docker/lxc/containers, although I'd rather 
not. "awilliams" suggested that I post my issue to this list so here goes:

I have two *indentical* physical hosts, both have Asus Z87-A MBs and i7-4771 
CPUs. One of these has three AMD HD6950 GPUs which I have *successfully* 
passed through using pci-stub and vfio-pci. The other box has two AMD R9 290x 
GPUs which I find myself unable to successfully pass through to a single VM 
(separate VMs work just fine). I can also pass through two 6950s and a single 
R9 to a single VM, just not multiple R9s to a single VM.

I am sorry about huuuge pastes downstream, my intention is simply to provide 
as much information as I can.

OS: Ubuntu 14.04.3 running vivid-lts-kernel 3.19
SW: libvirtd (libvirt) 1.2.2, QEMU emulator version 2.0.0 (Debian 
2.0.0+dfsg-2ubuntu1.21)

GRUB_CMDLINE_LINUX="ipv6.disable=1 intel_iommu=on 
pcie_acs_override=downstream" (ACS override required to make the third PCIe 
x16 lane fall into its own vfio group, but that is on the box with three 
6950s (which is working fine), the i915 arbiter patch does not seem to have 
any affect so I have stopped using it).

Libvirt VM config-xml on the host with two R9s: (I am using Q35 as I was 
never able to get i440 working at all on kernel 3.13):

<domain type='kvm' id='3' 
xmlns:qemu='http://libvirt.org/schemas/domain/qemu/1.0'>
  <name>name</name>
  <uuid></uuid>
  <memory unit='KiB'>8388608</memory>
  <currentMemory unit='KiB'>8388608</currentMemory>
  <vcpu placement='static'>4</vcpu>
  <resource>
    <partition>/machine</partition>
  </resource>
  <os>
    <type arch='x86_64' machine='pc-q35-2.0'>hvm</type>
    <boot dev='hd'/>
  </os>
  <features>
    <acpi/>
    <apic/>
    <pae/>
  </features>
  <cpu mode='custom' match='exact'>
    <model fallback='allow'>Haswell</model>
    <vendor>Intel</vendor>
    <feature policy='require' name='tm2'/>
    <feature policy='require' name='est'/>
    <feature policy='require' name='vmx'/>
    <feature policy='require' name='osxsave'/>
    <feature policy='require' name='smx'/>
    <feature policy='require' name='ss'/>
    <feature policy='require' name='ds'/>
    <feature policy='require' name='vme'/>
    <feature policy='require' name='dtes64'/>
    <feature policy='require' name='abm'/>
    <feature policy='require' name='ht'/>
    <feature policy='require' name='acpi'/>
    <feature policy='require' name='pbe'/>
    <feature policy='require' name='tm'/>
    <feature policy='require' name='pdcm'/>
    <feature policy='require' name='pdpe1gb'/>
    <feature policy='require' name='ds_cpl'/>
    <feature policy='require' name='rdrand'/>
    <feature policy='require' name='f16c'/>
    <feature policy='require' name='xtpr'/>
    <feature policy='require' name='monitor'/>
  </cpu>
  <clock offset='utc'/>
  <on_poweroff>destroy</on_poweroff>
  <on_reboot>restart</on_reboot>
  <on_crash>restart</on_crash>
  <devices>
    <emulator>/usr/bin/kvm-spice</emulator>
    <disk type='file' device='disk'>
      <driver name='qemu' type='qcow2'/>
      <source file='/srv/libvirt/Pool1/name.img'/>
      <target dev='vda' bus='virtio'/>
      <alias name='virtio-disk0'/>
      <address type='pci' domain='0x0000' bus='0x02' slot='0x02' 
function='0x0'/>
    </disk>
    <disk type='file' device='cdrom'>
      <driver name='qemu' type='raw'/>
      <target dev='sda' bus='sata'/>
      <readonly/>
      <alias name='sata0-0-0'/>
      <address type='drive' controller='0' bus='0' target='0' unit='0'/>
    </disk>
    <controller type='sata' index='0'>
      <alias name='sata0'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x1f' 
function='0x2'/>
    </controller>
    <controller type='pci' index='0' model='pcie-root'>
      <alias name='pcie.0'/>
    </controller>
    <controller type='pci' index='1' model='dmi-to-pci-bridge'>
      <alias name='pci.1'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x02' 
function='0x0'/>
    </controller>
    <controller type='pci' index='2' model='pci-bridge'>
      <alias name='pci.2'/>
      <address type='pci' domain='0x0000' bus='0x01' slot='0x01' 
function='0x0'/>
    </controller>
    <controller type='usb' index='0' model='ich9-ehci1'>
      <alias name='usb0'/>
      <address type='pci' domain='0x0000' bus='0x02' slot='0x01' 
function='0x1'/>
    </controller>
    <controller type='usb' index='0' model='ich9-uhci1'>
      <alias name='usb0'/>
      <master startport='0'/>
      <address type='pci' domain='0x0000' bus='0x02' slot='0x01' 
function='0x0' multifunction='on'/>
    </controller>
    <controller type='ide' index='0'>
      <alias name='ide0'/>
    </controller>
    <interface type='bridge'>
      <mac address=''/>
      <source bridge='br-mgmt'/>
      <target dev='vnet1'/>
      <model type='virtio'/>
      <alias name='net0'/>
      <address type='pci' domain='0x0000' bus='0x02' slot='0x03' 
function='0x0'/>
    </interface>
    <memballoon model='virtio'>
      <alias name='balloon0'/>
      <address type='pci' domain='0x0000' bus='0x02' slot='0x04' 
function='0x0'/>
    </memballoon>
  </devices>
  <seclabel type='none' model='apparmor'/>
  <qemu:commandline>
    <qemu:arg value='-device'/>
    <qemu:arg 
value='ioh3420,bus=pcie.0,addr=1a.0,multifunction=on,port=1,chassis=1,id=root.1'/>
    <qemu:arg value='-device'/>
    <qemu:arg 
value='ioh3420,bus=pcie.0,addr=1b.0,multifunction=on,port=2,chassis=2,id=root.2'/>
    <qemu:arg value='-device'/>
    <qemu:arg 
value='vfio-pci,host=01:00.0,bus=root.1,addr=00.0,multifunction=on,x-vga=on,romfile=/srv/bios/R9290X.ROM'/>
    <qemu:arg value='-device'/>
    <qemu:arg value='vfio-pci,host=01:00.1,bus=root.1,addr=00.1'/>
    <qemu:arg value='-device'/>
    <qemu:arg 
value='vfio-pci,host=02:00.0,bus=root.2,addr=00.0,multifunction=on,x-vga=on,romfile=/srv/bios/R9290X.ROM'/>
    <qemu:arg value='-device'/>
    <qemu:arg value='vfio-pci,host=02:00.1,bus=root.2,addr=00.1'/>
    <qemu:arg value='-bios'/>
    <qemu:arg value='/srv/bios/seabios.bin'/>
  </qemu:commandline>
</domain>

------------------------------------------------------------------------------

Libvirt VM config-xml on the host with three 6950s:

<domain type='kvm' id='4' 
xmlns:qemu='http://libvirt.org/schemas/domain/qemu/1.0'>
  <name>name</name>
  <uuid></uuid>
  <memory unit='KiB'>8388608</memory>
  <currentMemory unit='KiB'>8388608</currentMemory>
  <vcpu placement='static'>4</vcpu>
  <resource>
    <partition>/machine</partition>
  </resource>
  <os>
    <type arch='x86_64' machine='pc-q35-2.0'>hvm</type>
    <boot dev='hd'/>
  </os>
  <features>
    <acpi/>
    <apic/>
    <pae/>
  </features>
  <cpu mode='custom' match='exact'>
    <model fallback='allow'>Haswell</model>
    <vendor>Intel</vendor>
    <feature policy='require' name='tm2'/>
    <feature policy='require' name='est'/>
    <feature policy='require' name='vmx'/>
    <feature policy='require' name='osxsave'/>
    <feature policy='require' name='smx'/>
    <feature policy='require' name='ss'/>
    <feature policy='require' name='ds'/>
    <feature policy='require' name='vme'/>
    <feature policy='require' name='dtes64'/>
    <feature policy='require' name='abm'/>
    <feature policy='require' name='ht'/>
    <feature policy='require' name='acpi'/>
    <feature policy='require' name='pbe'/>
    <feature policy='require' name='tm'/>
    <feature policy='require' name='pdcm'/>
    <feature policy='require' name='pdpe1gb'/>
    <feature policy='require' name='ds_cpl'/>
    <feature policy='require' name='rdrand'/>
    <feature policy='require' name='f16c'/>
    <feature policy='require' name='xtpr'/>
    <feature policy='require' name='monitor'/>
  </cpu>
  <clock offset='utc'/>
  <on_poweroff>destroy</on_poweroff>
  <on_reboot>restart</on_reboot>
  <on_crash>restart</on_crash>
  <devices>
    <emulator>/usr/bin/kvm-spice</emulator>
    <disk type='file' device='disk'>
      <driver name='qemu' type='qcow2'/>
      <source file='/srv/libvirt/Pool1/name.img'/>
      <target dev='vda' bus='virtio'/>
      <alias name='virtio-disk0'/>
      <address type='pci' domain='0x0000' bus='0x02' slot='0x02' 
function='0x0'/>
    </disk>
    <disk type='file' device='cdrom'>
      <driver name='qemu' type='raw'/>
      <target dev='sda' bus='sata'/>
      <readonly/>
      <alias name='sata0-0-0'/>
      <address type='drive' controller='0' bus='0' target='0' unit='0'/>
    </disk>
    <controller type='sata' index='0'>
      <alias name='sata0'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x1f' 
function='0x2'/>
    </controller>
    <controller type='pci' index='0' model='pcie-root'>
      <alias name='pcie.0'/>
    </controller>
    <controller type='pci' index='1' model='dmi-to-pci-bridge'>
      <alias name='pci.1'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x02' 
function='0x0'/>
    </controller>
    <controller type='pci' index='2' model='pci-bridge'>
      <alias name='pci.2'/>
      <address type='pci' domain='0x0000' bus='0x01' slot='0x01' 
function='0x0'/>
    </controller>
    <controller type='usb' index='0' model='ich9-ehci1'>
      <alias name='usb0'/>
      <address type='pci' domain='0x0000' bus='0x02' slot='0x01' 
function='0x1'/>
    </controller>
    <controller type='usb' index='0' model='ich9-uhci1'>
      <alias name='usb0'/>
      <master startport='0'/>
      <address type='pci' domain='0x0000' bus='0x02' slot='0x01' 
function='0x0' multifunction='on'/>
    </controller>
    <controller type='ide' index='0'>
      <alias name='ide0'/>
    </controller>
    <interface type='bridge'>
      <mac address=''/>
      <source bridge='br-mgmt'/>
      <target dev='vnet2'/>
      <model type='virtio'/>
      <alias name='net0'/>
      <address type='pci' domain='0x0000' bus='0x02' slot='0x03' 
function='0x0'/>
    </interface>
    <memballoon model='virtio'>
      <alias name='balloon0'/>
      <address type='pci' domain='0x0000' bus='0x02' slot='0x04' 
function='0x0'/>
    </memballoon>
  </devices>
  <seclabel type='none' model='apparmor'/>
  <qemu:commandline>
    <qemu:arg value='-device'/>
    <qemu:arg 
value='ioh3420,bus=pcie.0,addr=1a.0,multifunction=on,port=1,chassis=1,id=root.1'/>
    <qemu:arg value='-device'/>
    <qemu:arg 
value='ioh3420,bus=pcie.0,addr=1b.0,multifunction=on,port=2,chassis=2,id=root.2'/>
    <qemu:arg value='-device'/>
    <qemu:arg 
value='ioh3420,bus=pcie.0,addr=1c.0,multifunction=on,port=3,chassis=3,id=root.3'/>
    <qemu:arg value='-device'/>
    <qemu:arg 
value='vfio-pci,host=01:00.0,bus=root.1,addr=00.0,multifunction=on,x-vga=on,romfile=/srv/bios/6950OCU.ROM'/>
    <qemu:arg value='-device'/>
    <qemu:arg value='vfio-pci,host=01:00.1,bus=root.1,addr=00.1'/>
    <qemu:arg value='-device'/>
    <qemu:arg 
value='vfio-pci,host=02:00.0,bus=root.2,addr=00.0,multifunction=on,x-vga=on,romfile=/srv/bios/6950OCU.ROM'/>
    <qemu:arg value='-device'/>
    <qemu:arg value='vfio-pci,host=02:00.1,bus=root.2,addr=00.1'/>
    <qemu:arg value='-device'/>
    <qemu:arg 
value='vfio-pci,host=06:00.0,bus=root.3,addr=00.0,multifunction=on,x-vga=on,romfile=/srv/bios/6950D3OC.ROM'/>
    <qemu:arg value='-device'/>
    <qemu:arg value='vfio-pci,host=06:00.1,bus=root.3,addr=00.1'/>
    <qemu:arg value='-bios'/>
    <qemu:arg value='/srv/bios/seabios.bin'/>
  </qemu:commandline>
</domain>

------------------------------------------------------------------------------

I have tried both with and without x-vga on either device on both hosts, no 
difference.

lspci -vnn on the host with two R9s:

00:01.0 PCI bridge [0604]: Intel Corporation Xeon E3-1200 v3/4th Gen Core 
Processor PCI Express x16 Controller [8086:0c01] (rev 06) (prog-if 00 [Normal 
decode])
    Flags: bus master, fast devsel, latency 0
    Bus: primary=00, secondary=01, subordinate=01, sec-latency=0
    I/O behind bridge: 0000e000-0000efff
    Memory behind bridge: efb00000-efbfffff
    Prefetchable memory behind bridge: 00000000d0000000-00000000e07fffff
    Capabilities: [88] Subsystem: ASUSTeK Computer Inc. Device [1043:8534]
    Capabilities: [80] Power Management version 3
    Capabilities: [90] MSI: Enable+ Count=1/1 Maskable- 64bit-
    Capabilities: [a0] Express Root Port (Slot+), MSI 00
    Capabilities: [100] Virtual Channel
    Capabilities: [140] Root Complex Link
    Capabilities: [d94] #19
    Kernel driver in use: pcieport

00:01.1 PCI bridge [0604]: Intel Corporation Xeon E3-1200 v3/4th Gen Core 
Processor PCI Express x8 Controller [8086:0c05] (rev 06) (prog-if 00 [Normal 
decode])
    Flags: bus master, fast devsel, latency 0
    Bus: primary=00, secondary=02, subordinate=02, sec-latency=0
    I/O behind bridge: 0000d000-0000dfff
    Memory behind bridge: efa00000-efafffff
    Prefetchable memory behind bridge: 00000000b0000000-00000000c07fffff
    Capabilities: [88] Subsystem: ASUSTeK Computer Inc. Device [1043:8534]
    Capabilities: [80] Power Management version 3
    Capabilities: [90] MSI: Enable+ Count=1/1 Maskable- 64bit-
    Capabilities: [a0] Express Root Port (Slot+), MSI 00
    Capabilities: [100] Virtual Channel
    Capabilities: [140] Root Complex Link
    Capabilities: [d94] #19
    Kernel driver in use: pcieport

00:1c.0 PCI bridge [0604]: Intel Corporation 8 Series/C220 Series Chipset 
Family PCI Express Root Port #1 [8086:8c10] (rev d5) (prog-if 00 [Normal 
decode])
    Flags: bus master, fast devsel, latency 0
    Bus: primary=00, secondary=03, subordinate=03, sec-latency=0
    Capabilities: [40] Express Root Port (Slot-), MSI 00
    Capabilities: [80] MSI: Enable- Count=1/1 Maskable- 64bit-
    Capabilities: [90] Subsystem: ASUSTeK Computer Inc. Device [1043:8534]
    Capabilities: [a0] Power Management version 3
    Kernel driver in use: pcieport

00:1c.2 PCI bridge [0604]: Intel Corporation 8 Series/C220 Series Chipset 
Family PCI Express Root Port #3 [8086:8c14] (rev d5) (prog-if 00 [Normal 
decode])
    Flags: bus master, fast devsel, latency 0
    Bus: primary=00, secondary=04, subordinate=04, sec-latency=0
    I/O behind bridge: 0000c000-0000cfff
    Memory behind bridge: ef900000-ef9fffff
    Prefetchable memory behind bridge: 00000000e0900000-00000000e09fffff
    Capabilities: [40] Express Root Port (Slot+), MSI 00
    Capabilities: [80] MSI: Enable- Count=1/1 Maskable- 64bit-
    Capabilities: [90] Subsystem: ASUSTeK Computer Inc. Device [1043:8534]
    Capabilities: [a0] Power Management version 3
    Kernel driver in use: pcieport

00:1c.3 PCI bridge [0604]: Intel Corporation 8 Series/C220 Series Chipset 
Family PCI Express Root Port #4 [8086:8c16] (rev d5) (prog-if 00 [Normal 
decode])
    Flags: bus master, fast devsel, latency 0
    Bus: primary=00, secondary=05, subordinate=05, sec-latency=0
    I/O behind bridge: 0000b000-0000bfff
    Memory behind bridge: ef800000-ef8fffff
    Capabilities: [40] Express Root Port (Slot+), MSI 00
    Capabilities: [80] MSI: Enable- Count=1/1 Maskable- 64bit-
    Capabilities: [90] Subsystem: ASUSTeK Computer Inc. Device [1043:8534]
    Capabilities: [a0] Power Management version 3
    Kernel driver in use: pcieport

00:1c.6 PCI bridge [0604]: Intel Corporation 82801 PCI Bridge [8086:244e] 
(rev d5) (prog-if 01 [Subtractive decode])
    Flags: bus master, fast devsel, latency 0
    Bus: primary=00, secondary=06, subordinate=07, sec-latency=0
    Capabilities: [40] Express Root Port (Slot+), MSI 00
    Capabilities: [80] MSI: Enable- Count=1/1 Maskable- 64bit-
    Capabilities: [90] Subsystem: ASUSTeK Computer Inc. Device [1043:8534]
    Capabilities: [a0] Power Management version 3

01:00.0 VGA compatible controller [0300]: Advanced Micro Devices, Inc. 
[AMD/ATI] Hawaii XT [Radeon R9 290X] [1002:67b0] (prog-if 00 [VGA 
controller])
    Subsystem: ASUSTeK Computer Inc. Device [1043:046c]
    Flags: bus master, fast devsel, latency 0, IRQ 37
    Memory at d0000000 (64-bit, prefetchable) [size=256M]
    Memory at e0000000 (64-bit, prefetchable) [size=8M]
    I/O ports at e000 [size=256]
    Memory at efb00000 (32-bit, non-prefetchable) [size=256K]
    Expansion ROM at efb40000 [disabled] [size=128K]
    Capabilities: [48] Vendor Specific Information: Len=08 <?>
    Capabilities: [50] Power Management version 3
    Capabilities: [58] Express Legacy Endpoint, MSI 00
    Capabilities: [a0] MSI: Enable+ Count=1/1 Maskable- 64bit+
    Capabilities: [100] Vendor Specific Information: ID=0001 Rev=1 Len=010 
<?>
    Capabilities: [150] Advanced Error Reporting
    Capabilities: [270] #19
    Capabilities: [2b0] Address Translation Service (ATS)
    Capabilities: [2c0] #13
    Capabilities: [2d0] #1b
    Kernel driver in use: vfio-pci

01:00.1 Audio device [0403]: Advanced Micro Devices, Inc. [AMD/ATI] Device 
[1002:aac8]
    Subsystem: ASUSTeK Computer Inc. Device [1043:aac8]
    Flags: bus master, fast devsel, latency 0, IRQ 35
    Memory at efb60000 (64-bit, non-prefetchable) [size=16K]
    Capabilities: [48] Vendor Specific Information: Len=08 <?>
    Capabilities: [50] Power Management version 3
    Capabilities: [58] Express Legacy Endpoint, MSI 00
    Capabilities: [a0] MSI: Enable+ Count=1/1 Maskable- 64bit+
    Capabilities: [100] Vendor Specific Information: ID=0001 Rev=1 Len=010 
<?>
    Capabilities: [150] Advanced Error Reporting
    Kernel driver in use: vfio-pci

02:00.0 VGA compatible controller [0300]: Advanced Micro Devices, Inc. 
[AMD/ATI] Hawaii XT [Radeon R9 290X] [1002:67b0] (prog-if 00 [VGA 
controller])
    Subsystem: ASUSTeK Computer Inc. Device [1043:046c]
    Flags: bus master, fast devsel, latency 0, IRQ 17
    Memory at b0000000 (64-bit, prefetchable) [size=256M]
    Memory at c0000000 (64-bit, prefetchable) [size=8M]
    I/O ports at d000 [size=256]
    Memory at efa00000 (32-bit, non-prefetchable) [size=256K]
    Expansion ROM at efa40000 [disabled] [size=128K]
    Capabilities: [48] Vendor Specific Information: Len=08 <?>
    Capabilities: [50] Power Management version 3
    Capabilities: [58] Express Legacy Endpoint, MSI 00
    Capabilities: [a0] MSI: Enable- Count=1/1 Maskable- 64bit+
    Capabilities: [100] Vendor Specific Information: ID=0001 Rev=1 Len=010 
<?>
    Capabilities: [150] Advanced Error Reporting
    Capabilities: [270] #19
    Capabilities: [2b0] Address Translation Service (ATS)
    Capabilities: [2c0] #13
    Capabilities: [2d0] #1b
    Kernel driver in use: vfio-pci

02:00.1 Audio device [0403]: Advanced Micro Devices, Inc. [AMD/ATI] Device 
[1002:aac8]
    Subsystem: ASUSTeK Computer Inc. Device [1043:aac8]
    Flags: bus master, fast devsel, latency 0, IRQ 36
    Memory at efa60000 (64-bit, non-prefetchable) [size=16K]
    Capabilities: [48] Vendor Specific Information: Len=08 <?>
    Capabilities: [50] Power Management version 3
    Capabilities: [58] Express Legacy Endpoint, MSI 00
    Capabilities: [a0] MSI: Enable+ Count=1/1 Maskable- 64bit+
    Capabilities: [100] Vendor Specific Information: ID=0001 Rev=1 Len=010 
<?>
    Capabilities: [150] Advanced Error Reporting
    Kernel driver in use: vfio-pci

------------------------------------------------------------------------------

lspci -vnn on the host with three 6950s:

00:01.0 PCI bridge [0604]: Intel Corporation Xeon E3-1200 v3/4th Gen Core 
Processor PCI Express x16 Controller [8086:0c01] (rev 06) (prog-if 00 [Normal 
decode])
    Flags: bus master, fast devsel, latency 0
    Bus: primary=00, secondary=01, subordinate=01, sec-latency=0
    I/O behind bridge: 0000e000-0000efff
    Memory behind bridge: efc00000-efcfffff
    Prefetchable memory behind bridge: 00000000d0000000-00000000dfffffff
    Capabilities: [88] Subsystem: ASUSTeK Computer Inc. Device [1043:8534]
    Capabilities: [80] Power Management version 3
    Capabilities: [90] MSI: Enable+ Count=1/1 Maskable- 64bit-
    Capabilities: [a0] Express Root Port (Slot+), MSI 00
    Capabilities: [100] Virtual Channel
    Capabilities: [140] Root Complex Link
    Capabilities: [d94] #19
    Kernel driver in use: pcieport

00:01.1 PCI bridge [0604]: Intel Corporation Xeon E3-1200 v3/4th Gen Core 
Processor PCI Express x8 Controller [8086:0c05] (rev 06) (prog-if 00 [Normal 
decode])
    Flags: bus master, fast devsel, latency 0
    Bus: primary=00, secondary=02, subordinate=02, sec-latency=0
    I/O behind bridge: 0000d000-0000dfff
    Memory behind bridge: efb00000-efbfffff
    Prefetchable memory behind bridge: 00000000c0000000-00000000cfffffff
    Capabilities: [88] Subsystem: ASUSTeK Computer Inc. Device [1043:8534]
    Capabilities: [80] Power Management version 3
    Capabilities: [90] MSI: Enable+ Count=1/1 Maskable- 64bit-
    Capabilities: [a0] Express Root Port (Slot+), MSI 00
    Capabilities: [100] Virtual Channel
    Capabilities: [140] Root Complex Link
    Capabilities: [d94] #19
    Kernel driver in use: pcieport

00:1c.0 PCI bridge [0604]: Intel Corporation 8 Series/C220 Series Chipset 
Family PCI Express Root Port #1 [8086:8c10] (rev d4) (prog-if 00 [Normal 
decode])
    Flags: bus master, fast devsel, latency 0
    Bus: primary=00, secondary=03, subordinate=03, sec-latency=0
    Capabilities: [40] Express Root Port (Slot-), MSI 00
    Capabilities: [80] MSI: Enable- Count=1/1 Maskable- 64bit-
    Capabilities: [90] Subsystem: ASUSTeK Computer Inc. Device [1043:8534]
    Capabilities: [a0] Power Management version 3
    Kernel driver in use: pcieport

00:1c.2 PCI bridge [0604]: Intel Corporation 8 Series/C220 Series Chipset 
Family PCI Express Root Port #3 [8086:8c14] (rev d4) (prog-if 00 [Normal 
decode])
    Flags: bus master, fast devsel, latency 0
    Bus: primary=00, secondary=04, subordinate=04, sec-latency=0
    I/O behind bridge: 0000c000-0000cfff
    Memory behind bridge: efa00000-efafffff
    Prefetchable memory behind bridge: 00000000e0000000-00000000e00fffff
    Capabilities: [40] Express Root Port (Slot+), MSI 00
    Capabilities: [80] MSI: Enable- Count=1/1 Maskable- 64bit-
    Capabilities: [90] Subsystem: ASUSTeK Computer Inc. Device [1043:8534]
    Capabilities: [a0] Power Management version 3
    Kernel driver in use: pcieport

00:1c.3 PCI bridge [0604]: Intel Corporation 8 Series/C220 Series Chipset 
Family PCI Express Root Port #4 [8086:8c16] (rev d4) (prog-if 00 [Normal 
decode])
    Flags: bus master, fast devsel, latency 0
    Bus: primary=00, secondary=05, subordinate=05, sec-latency=0
    I/O behind bridge: 0000b000-0000bfff
    Memory behind bridge: ef900000-ef9fffff
    Capabilities: [40] Express Root Port (Slot+), MSI 00
    Capabilities: [80] MSI: Enable- Count=1/1 Maskable- 64bit-
    Capabilities: [90] Subsystem: ASUSTeK Computer Inc. Device [1043:8534]
    Capabilities: [a0] Power Management version 3
    Kernel driver in use: pcieport

00:1c.4 PCI bridge [0604]: Intel Corporation 8 Series/C220 Series Chipset 
Family PCI Express Root Port #5 [8086:8c18] (rev d4) (prog-if 00 [Normal 
decode])
    Flags: bus master, fast devsel, latency 0
    Bus: primary=00, secondary=06, subordinate=06, sec-latency=0
    I/O behind bridge: 0000a000-0000afff
    Memory behind bridge: ef800000-ef8fffff
    Prefetchable memory behind bridge: 00000000b0000000-00000000bfffffff
    Capabilities: [40] Express Root Port (Slot+), MSI 00
    Capabilities: [80] MSI: Enable- Count=1/1 Maskable- 64bit-
    Capabilities: [90] Subsystem: ASUSTeK Computer Inc. Device [1043:8534]
    Capabilities: [a0] Power Management version 3
    Kernel driver in use: pcieport

00:1c.6 PCI bridge [0604]: Intel Corporation 82801 PCI Bridge [8086:244e] 
(rev d4) (prog-if 01 [Subtractive decode])
    Flags: bus master, fast devsel, latency 0
    Bus: primary=00, secondary=07, subordinate=08, sec-latency=0
    Capabilities: [40] Express Root Port (Slot+), MSI 00
    Capabilities: [80] MSI: Enable- Count=1/1 Maskable- 64bit-
    Capabilities: [90] Subsystem: ASUSTeK Computer Inc. Device [1043:8534]
    Capabilities: [a0] Power Management version 3

01:00.0 VGA compatible controller [0300]: Advanced Micro Devices, Inc. 
[AMD/ATI] Cayman PRO [Radeon HD 6950] [1002:6719] (prog-if 00 [VGA 
controller])
    Subsystem: Advanced Micro Devices, Inc. [AMD/ATI] Device [1002:0b00]
    Flags: bus master, fast devsel, latency 0, IRQ 38
    Memory at d0000000 (64-bit, prefetchable) [size=256M]
    Memory at efc20000 (64-bit, non-prefetchable) [size=128K]
    I/O ports at e000 [size=256]
    Expansion ROM at efc00000 [disabled] [size=128K]
    Capabilities: [50] Power Management version 3
    Capabilities: [58] Express Legacy Endpoint, MSI 00
    Capabilities: [a0] MSI: Enable+ Count=1/1 Maskable- 64bit+
    Capabilities: [100] Vendor Specific Information: ID=0001 Rev=1 Len=010 
<?>
    Capabilities: [150] Advanced Error Reporting
    Kernel driver in use: vfio-pci

01:00.1 Audio device [0403]: Advanced Micro Devices, Inc. [AMD/ATI] 
Cayman/Antilles HDMI Audio [Radeon HD 6900 Series] [1002:aa80]
    Subsystem: Advanced Micro Devices, Inc. [AMD/ATI] Cayman/Antilles HDMI 
Audio [Radeon HD 6900 Series] [1002:aa80]
    Flags: bus master, fast devsel, latency 0, IRQ 35
    Memory at efc40000 (64-bit, non-prefetchable) [size=16K]
    Capabilities: [50] Power Management version 3
    Capabilities: [58] Express Legacy Endpoint, MSI 00
    Capabilities: [a0] MSI: Enable+ Count=1/1 Maskable- 64bit+
    Capabilities: [100] Vendor Specific Information: ID=0001 Rev=1 Len=010 
<?>
    Capabilities: [150] Advanced Error Reporting
    Kernel driver in use: vfio-pci

02:00.0 VGA compatible controller [0300]: Advanced Micro Devices, Inc. 
[AMD/ATI] Cayman PRO [Radeon HD 6950] [1002:6719] (prog-if 00 [VGA 
controller])
    Subsystem: Advanced Micro Devices, Inc. [AMD/ATI] Device [1002:0b00]
    Flags: bus master, fast devsel, latency 0, IRQ 39
    Memory at c0000000 (64-bit, prefetchable) [size=256M]
    Memory at efb20000 (64-bit, non-prefetchable) [size=128K]
    I/O ports at d000 [size=256]
    Expansion ROM at efb00000 [disabled] [size=128K]
    Capabilities: [50] Power Management version 3
    Capabilities: [58] Express Legacy Endpoint, MSI 00
    Capabilities: [a0] MSI: Enable+ Count=1/1 Maskable- 64bit+
    Capabilities: [100] Vendor Specific Information: ID=0001 Rev=1 Len=010 
<?>
    Capabilities: [150] Advanced Error Reporting
    Kernel driver in use: vfio-pci

02:00.1 Audio device [0403]: Advanced Micro Devices, Inc. [AMD/ATI] 
Cayman/Antilles HDMI Audio [Radeon HD 6900 Series] [1002:aa80]
    Subsystem: Advanced Micro Devices, Inc. [AMD/ATI] Cayman/Antilles HDMI 
Audio [Radeon HD 6900 Series] [1002:aa80]
    Flags: bus master, fast devsel, latency 0, IRQ 36
    Memory at efb40000 (64-bit, non-prefetchable) [size=16K]
    Capabilities: [50] Power Management version 3
    Capabilities: [58] Express Legacy Endpoint, MSI 00
    Capabilities: [a0] MSI: Enable+ Count=1/1 Maskable- 64bit+
    Capabilities: [100] Vendor Specific Information: ID=0001 Rev=1 Len=010 
<?>
    Capabilities: [150] Advanced Error Reporting
    Kernel driver in use: vfio-pci

06:00.0 VGA compatible controller [0300]: Advanced Micro Devices, Inc. 
[AMD/ATI] Antilles [Radeon HD 6990] [1002:671d] (prog-if 00 [VGA controller])
    Subsystem: PC Partner Limited / Sapphire Technology Device [174b:3000]
    Flags: bus master, fast devsel, latency 0, IRQ 40
    Memory at b0000000 (64-bit, prefetchable) [size=256M]
    Memory at ef820000 (64-bit, non-prefetchable) [size=128K]
    I/O ports at a000 [size=256]
    Expansion ROM at ef800000 [disabled] [size=128K]
    Capabilities: [50] Power Management version 3
    Capabilities: [58] Express Legacy Endpoint, MSI 00
    Capabilities: [a0] MSI: Enable+ Count=1/1 Maskable- 64bit+
    Capabilities: [100] Vendor Specific Information: ID=0001 Rev=1 Len=010 
<?>
    Capabilities: [150] Advanced Error Reporting
    Kernel driver in use: vfio-pci

06:00.1 Audio device [0403]: Advanced Micro Devices, Inc. [AMD/ATI] 
Cayman/Antilles HDMI Audio [Radeon HD 6900 Series] [1002:aa80]
    Subsystem: PC Partner Limited / Sapphire Technology Device [174b:aa80]
    Flags: bus master, fast devsel, latency 0, IRQ 37
    Memory at ef840000 (64-bit, non-prefetchable) [size=16K]
    Capabilities: [50] Power Management version 3
    Capabilities: [58] Express Legacy Endpoint, MSI 00
    Capabilities: [a0] MSI: Enable+ Count=1/1 Maskable- 64bit+
    Capabilities: [100] Vendor Specific Information: ID=0001 Rev=1 Len=010 
<?>
    Capabilities: [150] Advanced Error Reporting
    Kernel driver in use: vfio-pci

------------------------------------------------------------------------------

dmesg | grep vfio on the host with two R9s:
[  236.196729] vfio_ecap_init: 0000:01:00.0 hiding ecap 0x19 at 0x270
[  236.196735] vfio_ecap_init: 0000:01:00.0 hiding ecap 0x1b at 0x2d0
[  236.200340] vfio-pci 0000:01:00.1: enabling device (0000 -> 0002)
[  236.201322] vfio_ecap_init: 0000:02:00.0 hiding ecap 0x19 at 0x270
[  236.201327] vfio_ecap_init: 0000:02:00.0 hiding ecap 0x1b at 0x2d0
[  236.203078] vfio-pci 0000:02:00.1: enabling device (0000 -> 0002)

dmesg | grep vgaarb
[    0.232241] vgaarb: setting as boot device: PCI:0000:00:02.0
[    0.232243] vgaarb: device added: 
PCI:0000:00:02.0,decodes=io+mem,owns=io+mem,locks=none
[    0.232246] vgaarb: device added: 
PCI:0000:01:00.0,decodes=io+mem,owns=io+mem,locks=none
[    0.232249] vgaarb: device added: 
PCI:0000:02:00.0,decodes=io+mem,owns=none,locks=none
[    0.232250] vgaarb: loaded
[    0.232251] vgaarb: bridge control possible 0000:02:00.0
[    0.232252] vgaarb: bridge control possible 0000:01:00.0
[    0.232253] vgaarb: no bridge control possible 0000:00:02.0

------------------------------------------------------------------------------

dmesg | grep vfio on the host with three 6950s:
[  870.189038] vfio-pci 0000:01:00.0: enabling device (0400 -> 0403)
[  870.222789] vfio-pci 0000:01:00.1: enabling device (0400 -> 0402)
[  870.253642] vfio-pci 0000:02:00.0: enabling device (0400 -> 0403)
[  870.286963] vfio-pci 0000:02:00.1: enabling device (0400 -> 0402)
[  870.317909] vfio-pci 0000:06:00.0: enabling device (0400 -> 0403)
[  870.351545] vfio-pci 0000:06:00.1: enabling device (0400 -> 0402)

dmesg | grep vgaarb
[    0.240383] vgaarb: setting as boot device: PCI:0000:00:02.0
[    0.240385] vgaarb: device added: 
PCI:0000:00:02.0,decodes=io+mem,owns=io+mem,locks=none
[    0.240388] vgaarb: device added: 
PCI:0000:01:00.0,decodes=io+mem,owns=none,locks=none
[    0.240391] vgaarb: device added: 
PCI:0000:02:00.0,decodes=io+mem,owns=none,locks=none
[    0.240395] vgaarb: device added: 
PCI:0000:06:00.0,decodes=io+mem,owns=none,locks=none
[    0.240396] vgaarb: loaded
[    0.240397] vgaarb: bridge control possible 0000:06:00.0
[    0.240398] vgaarb: bridge control possible 0000:02:00.0
[    0.240399] vgaarb: bridge control possible 0000:01:00.0
[    0.240400] vgaarb: no bridge control possible 0000:00:02.0

------------------------------------------------------------------------------

dmesg output on the VM with two R9s:

[    0.000000] Initializing cgroup subsys cpuset
[    0.000000] Initializing cgroup subsys cpu
[    0.000000] Initializing cgroup subsys cpuacct
[    0.000000] Linux version 3.19.0-42-generic (buildd at lgw01-24) (gcc version 
4.8.2 (Ubuntu 4.8.2-19ubuntu1) ) #48~14.04.1-Ubuntu SMP Fri Dec 18 10:24:49 
UTC 2015 (Ubuntu 3.19.0-42.48~14.04.1-generic 3.19.8-ckt10)
[    0.000000] Command line: BOOT_IMAGE=/boot/vmlinuz-3.19.0-42-generic 
root=UUID=1e153495-22c3-41e8-99be-734777b0f4bc ro
[    0.000000] KERNEL supported cpus:
[    0.000000]   Intel GenuineIntel
[    0.000000]   AMD AuthenticAMD
[    0.000000]   Centaur CentaurHauls
[    0.000000] e820: BIOS-provided physical RAM map:
[    0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable
[    0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] 
reserved
[    0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] 
reserved
[    0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000007fffafff] usable
[    0.000000] BIOS-e820: [mem 0x000000007fffb000-0x000000007fffffff] 
reserved
[    0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] 
reserved
[    0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] 
reserved
[    0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] 
reserved
[    0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000027fffffff] usable
[    0.000000] NX (Execute Disable) protection: active
[    0.000000] SMBIOS 2.4 present.
[    0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS Bochs 
01/01/2011
[    0.000000] Hypervisor detected: KVM
[    0.000000] e820: update [mem 0x00000000-0x00000fff] usable ==> reserved
[    0.000000] e820: remove [mem 0x000a0000-0x000fffff] usable
[    0.000000] AGP: No AGP bridge found
[    0.000000] e820: last_pfn = 0x280000 max_arch_pfn = 0x400000000
[    0.000000] MTRR default type: write-back
[    0.000000] MTRR fixed ranges enabled:
[    0.000000]   00000-9FFFF write-back
[    0.000000]   A0000-BFFFF uncachable
[    0.000000]   C0000-FFFFF write-protect
[    0.000000] MTRR variable ranges enabled:
[    0.000000]   0 base 00C0000000 mask FFC0000000 uncachable
[    0.000000]   1 disabled
[    0.000000]   2 disabled
[    0.000000]   3 disabled
[    0.000000]   4 disabled
[    0.000000]   5 disabled
[    0.000000]   6 disabled
[    0.000000]   7 disabled
[    0.000000] PAT configuration [0-7]: WB  WC  UC- UC  WB  WC  UC- UC 
[    0.000000] e820: last_pfn = 0x7fffb max_arch_pfn = 0x400000000
[    0.000000] found SMP MP-table at [mem 0x000f0ae0-0x000f0aef] mapped at 
[ffff8800000f0ae0]
[    0.000000] Scanning 1 areas for low memory corruption
[    0.000000] Base memory trampoline at [ffff880000099000] 99000 size 24576
[    0.000000] Using GB pages for direct mapping
[    0.000000] init_memory_mapping: [mem 0x00000000-0x000fffff]
[    0.000000]  [mem 0x00000000-0x000fffff] page 4k
[    0.000000] BRK [0x01fd4000, 0x01fd4fff] PGTABLE
[    0.000000] BRK [0x01fd5000, 0x01fd5fff] PGTABLE
[    0.000000] BRK [0x01fd6000, 0x01fd6fff] PGTABLE
[    0.000000] init_memory_mapping: [mem 0x27fe00000-0x27fffffff]
[    0.000000]  [mem 0x27fe00000-0x27fffffff] page 1G
[    0.000000] init_memory_mapping: [mem 0x260000000-0x27fdfffff]
[    0.000000]  [mem 0x260000000-0x27fdfffff] page 1G
[    0.000000] init_memory_mapping: [mem 0x00100000-0x7fffafff]
[    0.000000]  [mem 0x00100000-0x001fffff] page 4k
[    0.000000]  [mem 0x00200000-0x7fdfffff] page 2M
[    0.000000]  [mem 0x7fe00000-0x7fffafff] page 4k
[    0.000000] init_memory_mapping: [mem 0x100000000-0x25fffffff]
[    0.000000]  [mem 0x100000000-0x25fffffff] page 1G
[    0.000000] RAMDISK: [mem 0x359e8000-0x36cebfff]
[    0.000000] ACPI: Early table checksum verification disabled
[    0.000000] ACPI: RSDP 0x00000000000F08B0 000014 (v00 BOCHS )
[    0.000000] ACPI: RSDT 0x000000007FFFF1A6 000038 (v01 BOCHS  BXPCRSDT 
00000001 BXPC 00000001)
[    0.000000] ACPI: FACP 0x000000007FFFED12 000074 (v01 BOCHS  BXPCFACP 
00000001 BXPC 00000001)
[    0.000000] ACPI: DSDT 0x000000007FFFD040 001CD2 (v01 BOCHS  BXPCDSDT 
00000001 BXPC 00000001)
[    0.000000] ACPI: FACS 0x000000007FFFD000 000040
[    0.000000] ACPI: SSDT 0x000000007FFFED86 00031C (v01 BOCHS  BXPCSSDT 
00000001 BXPC 00000001)
[    0.000000] ACPI: APIC 0x000000007FFFF0A2 000090 (v01 BOCHS  BXPCAPIC 
00000001 BXPC 00000001)
[    0.000000] ACPI: HPET 0x000000007FFFF132 000038 (v01 BOCHS  BXPCHPET 
00000001 BXPC 00000001)
[    0.000000] ACPI: MCFG 0x000000007FFFF16A 00003C (v01 BOCHS  BXPCMCFG 
00000001 BXPC 00000001)
[    0.000000] ACPI: Local APIC address 0xfee00000
[    0.000000] No NUMA configuration found
[    0.000000] Faking a node at [mem 0x0000000000000000-0x000000027fffffff]
[    0.000000] NODE_DATA(0) allocated [mem 0x27fff9000-0x27fffdfff]
[    0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00
[    0.000000] kvm-clock: cpu 0, msr 2:7fff5001, primary cpu clock
[    0.000000]  [ffffea0000000000-ffffea0009ffffff] PMD -> 
[ffff880277600000-ffff88027f5fffff] on node 0
[    0.000000] Zone ranges:
[    0.000000]   DMA      [mem 0x00001000-0x00ffffff]
[    0.000000]   DMA32    [mem 0x01000000-0xffffffff]
[    0.000000]   Normal   [mem 0x100000000-0x27fffffff]
[    0.000000] Movable zone start for each node
[    0.000000] Early memory node ranges
[    0.000000]   node   0: [mem 0x00001000-0x0009efff]
[    0.000000]   node   0: [mem 0x00100000-0x7fffafff]
[    0.000000]   node   0: [mem 0x100000000-0x27fffffff]
[    0.000000] Initmem setup node 0 [mem 0x00001000-0x27fffffff]
[    0.000000] On node 0 totalpages: 2097049
[    0.000000]   DMA zone: 64 pages used for memmap
[    0.000000]   DMA zone: 21 pages reserved
[    0.000000]   DMA zone: 3998 pages, LIFO batch:0
[    0.000000]   DMA32 zone: 8128 pages used for memmap
[    0.000000]   DMA32 zone: 520187 pages, LIFO batch:31
[    0.000000]   Normal zone: 24576 pages used for memmap
[    0.000000]   Normal zone: 1572864 pages, LIFO batch:31
[    0.000000] ACPI: PM-Timer IO Port: 0xb008
[    0.000000] ACPI: Local APIC address 0xfee00000
[    0.000000] ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x01] lapic_id[0x01] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x02] lapic_id[0x02] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x03] lapic_id[0x03] enabled)
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])
[    0.000000] ACPI: IOAPIC (id[0x00] address[0xfec00000] gsi_base[0])
[    0.000000] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)
[    0.000000] ACPI: IRQ0 used by override.
[    0.000000] ACPI: IRQ5 used by override.
[    0.000000] ACPI: IRQ9 used by override.
[    0.000000] ACPI: IRQ10 used by override.
[    0.000000] ACPI: IRQ11 used by override.
[    0.000000] Using ACPI (MADT) for SMP configuration information
[    0.000000] ACPI: HPET id: 0x8086a201 base: 0xfed00000
[    0.000000] smpboot: Allowing 4 CPUs, 0 hotplug CPUs
[    0.000000] PM: Registered nosave memory: [mem 0x00000000-0x00000fff]
[    0.000000] PM: Registered nosave memory: [mem 0x0009f000-0x0009ffff]
[    0.000000] PM: Registered nosave memory: [mem 0x000a0000-0x000effff]
[    0.000000] PM: Registered nosave memory: [mem 0x000f0000-0x000fffff]
[    0.000000] PM: Registered nosave memory: [mem 0x7fffb000-0x7fffffff]
[    0.000000] PM: Registered nosave memory: [mem 0x80000000-0xafffffff]
[    0.000000] PM: Registered nosave memory: [mem 0xb0000000-0xbfffffff]
[    0.000000] PM: Registered nosave memory: [mem 0xc0000000-0xfeffbfff]
[    0.000000] PM: Registered nosave memory: [mem 0xfeffc000-0xfeffffff]
[    0.000000] PM: Registered nosave memory: [mem 0xff000000-0xfffbffff]
[    0.000000] PM: Registered nosave memory: [mem 0xfffc0000-0xffffffff]
[    0.000000] e820: [mem 0xc0000000-0xfeffbfff] available for PCI devices
[    0.000000] Booting paravirtualized kernel on KVM
[    0.000000] setup_percpu: NR_CPUS:256 nr_cpumask_bits:256 nr_cpu_ids:4 
nr_node_ids:1
[    0.000000] PERCPU: Embedded 31 pages/cpu @ffff88027fc00000 s86144 r8192 
d32640 u524288
[    0.000000] pcpu-alloc: s86144 r8192 d32640 u524288 alloc=1*2097152
[    0.000000] pcpu-alloc: [0] 0 1 2 3
[    0.000000] KVM setup async PF for cpu 0
[    0.000000] kvm-stealtime: cpu 0, msr 27fc0e100
[    0.000000] Built 1 zonelists in Node order, mobility grouping on.  Total 
pages: 2064260
[    0.000000] Policy zone: Normal
[    0.000000] Kernel command line: 
BOOT_IMAGE=/boot/vmlinuz-3.19.0-42-generic 
root=UUID=1e153495-22c3-41e8-99be-734777b0f4bc ro
[    0.000000] PID hash table entries: 4096 (order: 3, 32768 bytes)
[    0.000000] xsave: enabled xstate_bv 0x7, cntxt size 0x340 using standard 
form
[    0.000000] AGP: Checking aperture...
[    0.000000] AGP: No AGP bridge found
[    0.000000] Calgary: detecting Calgary via BIOS EBDA area
[    0.000000] Calgary: Unable to locate Rio Grande table in EBDA - bailing!
[    0.000000] Memory: 8154492K/8388196K available (7922K kernel code, 1174K 
rwdata, 3756K rodata, 1408K init, 1292K bss, 233704K reserved, 0K 
cma-reserved)
[    0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1
[    0.000000] Hierarchical RCU implementation.
[    0.000000]     RCU dyntick-idle grace-period acceleration is enabled.
[    0.000000]     RCU restricting CPUs from NR_CPUS=256 to nr_cpu_ids=4.
[    0.000000] RCU: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4
[    0.000000] NR_IRQS:16640 nr_irqs:456 16
[    0.000000]     Offload RCU callbacks from all CPUs
[    0.000000]     Offload RCU callbacks from CPUs: 0-3.
[    0.000000] Console: colour dummy device 80x25
[    0.000000] console [tty0] enabled
[    0.000000] hpet clockevent registered
[    0.000000] tsc: Detected 3499.996 MHz processor
[    0.008000] Calibrating delay loop (skipped) preset value.. 6999.99 
BogoMIPS (lpj=13999984)
[    0.008000] pid_max: default: 32768 minimum: 301
[    0.008000] ACPI: Core revision 20141107
[    0.008000] ACPI: All ACPI Tables successfully acquired
[    0.008000] Security Framework initialized
[    0.008000] AppArmor: AppArmor initialized
[    0.008000] Yama: becoming mindful.
[    0.008000] Dentry cache hash table entries: 1048576 (order: 11, 8388608 
bytes)
[    0.008000] Inode-cache hash table entries: 524288 (order: 10, 4194304 
bytes)
[    0.008000] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes)
[    0.008000] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 
bytes)
[    0.008000] Initializing cgroup subsys memory
[    0.008000] Initializing cgroup subsys devices
[    0.008000] Initializing cgroup subsys freezer
[    0.008000] Initializing cgroup subsys net_cls
[    0.008000] Initializing cgroup subsys blkio
[    0.008000] Initializing cgroup subsys perf_event
[    0.008000] Initializing cgroup subsys net_prio
[    0.008000] Initializing cgroup subsys hugetlb
[    0.008689] mce: CPU supports 10 MCE banks
[    0.008713] Last level iTLB entries: 4KB 0, 2MB 0, 4MB 0
[    0.008713] Last level dTLB entries: 4KB 0, 2MB 0, 4MB 0, 1GB 0
[    0.008901] Freeing SMP alternatives memory: 32K (ffffffff81e87000 - 
ffffffff81e8f000)
[    0.010969] ftrace: allocating 30027 entries in 118 pages
[    0.016195] Enabling x2apic
[    0.016199] Enabled x2apic
[    0.016326] Switched APIC routing to physical x2apic.
[    0.016966] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1
[    0.016977] smpboot: CPU0: Intel Core Processor (Haswell) (fam: 06, model: 
3c, stepping: 01)
[    0.016992] TSC deadline timer enabled
[    0.017022] Performance Events: unsupported p6 CPU model 60 no PMU driver, 
software events only.
[    0.017624] NMI watchdog: disabled (cpu0): hardware events not enabled
[    0.017705] x86: Booting SMP configuration:
[    0.017707] .... node  #0, CPUs:      #1
[    0.008000] kvm-clock: cpu 1, msr 2:7fff5041, secondary cpu clock
[    0.032009] KVM setup async PF for cpu 1
[    0.032016] kvm-stealtime: cpu 1, msr 27fc8e100
[    0.032138]  #2
[    0.008000] kvm-clock: cpu 2, msr 2:7fff5081, secondary cpu clock
[    0.044017] KVM setup async PF for cpu 2
[    0.044017] kvm-stealtime: cpu 2, msr 27fd0e100
[    0.044120]  #3
[    0.008000] kvm-clock: cpu 3, msr 2:7fff50c1, secondary cpu clock
[    0.060015] x86: Booted up 1 node, 4 CPUs
[    0.060006] KVM setup async PF for cpu 3
[    0.060009] kvm-stealtime: cpu 3, msr 27fd8e100
[    0.060022] smpboot: Total of 4 processors activated (27999.96 BogoMIPS)
[    0.060350] devtmpfs: initialized
[    0.061354] evm: security.selinux
[    0.061355] evm: security.SMACK64
[    0.061356] evm: security.SMACK64EXEC
[    0.061357] evm: security.SMACK64TRANSMUTE
[    0.061358] evm: security.SMACK64MMAP
[    0.061358] evm: security.ima
[    0.061359] evm: security.capability
[    0.061382] pinctrl core: initialized pinctrl subsystem
[    0.061382] RTC time: 22:31:10, date: 12/31/15
[    0.061382] NET: Registered protocol family 16
[    0.068009] cpuidle: using governor ladder
[    0.072010] cpuidle: using governor menu
[    0.072143] ACPI: bus type PCI registered
[    0.072145] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5
[    0.072244] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 
0xb0000000-0xbfffffff] (base 0xb0000000)
[    0.072247] PCI: MMCONFIG at [mem 0xb0000000-0xbfffffff] reserved in E820
[    0.072569] PCI: Using configuration type 1 for base access
[    0.076083] ACPI: Added _OSI(Module Device)
[    0.076086] ACPI: Added _OSI(Processor Device)
[    0.076087] ACPI: Added _OSI(3.0 _SCP Extensions)
[    0.076088] ACPI: Added _OSI(Processor Aggregator Device)
[    0.077538] ACPI: Interpreter enabled
[    0.077543] ACPI Exception: AE_NOT_FOUND, While evaluating Sleep State 
[\_S1_] (20141107/hwxface-580)
[    0.077546] ACPI Exception: AE_NOT_FOUND, While evaluating Sleep State 
[\_S2_] (20141107/hwxface-580)
[    0.077553] ACPI: (supports S0 S3 S4 S5)
[    0.077554] ACPI: Using IOAPIC for interrupt routing
[    0.077572] PCI: Using host bridge windows from ACPI; if necessary, use 
"pci=nocrs" and report a bug
[    0.078580] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])
[    0.078584] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM 
ClockPM Segments MSI]
[    0.078640] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME AER 
PCIeCapability]
[    0.078728] PCI host bridge to bus 0000:00
[    0.078730] pci_bus 0000:00: root bus resource [bus 00-ff]
[    0.078731] pci_bus 0000:00: root bus resource [io  0x0000-0x0cd7]
[    0.078733] pci_bus 0000:00: root bus resource [io  0x0d00-0xffff]
[    0.078734] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff]
[    0.078735] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff]
[    0.078737] pci_bus 0000:00: root bus resource [mem 
0x280000000-0x2bfffffff]
[    0.078752] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000
[    0.078914] pci 0000:00:02.0: [8086:244e] type 01 class 0x060401
[    0.081841] pci 0000:00:1a.0: [8086:3420] type 01 class 0x060400
[    0.104402] pci 0000:00:1b.0: [8086:3420] type 01 class 0x060400
[    0.128375] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100
[    0.128536] pci 0000:00:1f.0: quirk: [io  0xb000-0xb07f] claimed by ICH6 
ACPI/GPIO/TCO
[    0.128640] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601
[    0.136856] pci 0000:00:1f.2: reg 0x20: [io  0xf040-0xf05f]
[    0.138577] pci 0000:00:1f.2: reg 0x24: [mem 0xfea00000-0xfea00fff]
[    0.140156] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500
[    0.144442] pci 0000:00:1f.3: reg 0x20: [io  0xb100-0xb13f]
[    0.146828] pci 0000:01:01.0: [1b36:0001] type 01 class 0x060400
[    0.148004] pci 0000:01:01.0: reg 0x10: [mem 0xfe400000-0xfe4000ff 64bit]
[    0.149878] pci 0000:00:02.0: PCI bridge to [bus 01-02] (subtractive 
decode)
[    0.149887] pci 0000:00:02.0:   bridge window [io  0xe000-0xefff]
[    0.149894] pci 0000:00:02.0:   bridge window [mem 0xfe200000-0xfe5fffff]
[    0.149907] pci 0000:00:02.0:   bridge window [io  0x0000-0x0cd7] 
(subtractive decode)
[    0.149908] pci 0000:00:02.0:   bridge window [io  0x0d00-0xffff] 
(subtractive decode)
[    0.149908] pci 0000:00:02.0:   bridge window [mem 0x000a0000-0x000bffff] 
(subtractive decode)
[    0.149910] pci 0000:00:02.0:   bridge window [mem 0xc0000000-0xfebfffff] 
(subtractive decode)
[    0.149911] pci 0000:00:02.0:   bridge window [mem 
0x280000000-0x2bfffffff] (subtractive decode)
[    0.150482] pci 0000:02:01.0: [8086:2934] type 00 class 0x0c0300
[    0.154658] pci 0000:02:01.0: reg 0x20: [io  0xe040-0xe05f]
[    0.156063] pci 0000:02:01.1: [8086:293a] type 00 class 0x0c0320
[    0.156947] pci 0000:02:01.1: reg 0x10: [mem 0xfe240000-0xfe240fff]
[    0.162257] pci 0000:02:02.0: [1af4:1001] type 00 class 0x010000
[    0.164003] pci 0000:02:02.0: reg 0x10: [io  0xe000-0xe03f]
[    0.165729] pci 0000:02:02.0: reg 0x14: [mem 0xfe241000-0xfe241fff]
[    0.173835] pci 0000:02:03.0: [1af4:1000] type 00 class 0x020000
[    0.175606] pci 0000:02:03.0: reg 0x10: [io  0xe060-0xe07f]
[    0.176853] pci 0000:02:03.0: reg 0x14: [mem 0xfe242000-0xfe242fff]
[    0.184869] pci 0000:02:03.0: reg 0x30: [mem 0xfe200000-0xfe23ffff pref]
[    0.184986] pci 0000:02:04.0: [1af4:1002] type 00 class 0x00ff00
[    0.185925] pci 0000:02:04.0: reg 0x10: [io  0xe080-0xe09f]
[    0.191262] pci 0000:01:01.0: PCI bridge to [bus 02]
[    0.191271] pci 0000:01:01.0:   bridge window [io  0xe000-0xefff]
[    0.191278] pci 0000:01:01.0:   bridge window [mem 0xfe200000-0xfe3fffff]
[    0.193462] pci 0000:03:00.0: [1002:67b0] type 00 class 0x030000
[    0.200035] pci 0000:03:00.0: reg 0x10: [mem 0x2a0000000-0x2afffffff 64bit 
pref]
[    0.208039] pci 0000:03:00.0: reg 0x18: [mem 0x2b0000000-0x2b07fffff 64bit 
pref]
[    0.216039] pci 0000:03:00.0: reg 0x20: [io  0xd000-0xd0ff]
[    0.224039] pci 0000:03:00.0: reg 0x24: [mem 0xfe800000-0xfe83ffff]
[    0.232041] pci 0000:03:00.0: reg 0x30: [mem 0xfe840000-0xfe87ffff pref]
[    0.232305] pci 0000:03:00.0: supports D1 D2
[    0.232309] pci 0000:03:00.0: PME# supported from D1 D2 D3hot
[    0.232508] pci 0000:03:00.1: [1002:aac8] type 00 class 0x040300
[    0.233631] pci 0000:03:00.1: reg 0x10: [mem 0xfe880000-0xfe883fff 64bit]
[    0.238798] pci 0000:03:00.1: supports D1 D2
[    0.239021] pci 0000:00:1a.0: PCI bridge to [bus 03]
[    0.239037] pci 0000:00:1a.0:   bridge window [io  0xd000-0xdfff]
[    0.239044] pci 0000:00:1a.0:   bridge window [mem 0xfe800000-0xfe9fffff]
[    0.239058] pci 0000:00:1a.0:   bridge window [mem 0x2a0000000-0x2bfffffff 
64bit pref]
[    0.240144] pci 0000:04:00.0: [1002:67b0] type 00 class 0x030000
[    0.248030] pci 0000:04:00.0: reg 0x10: [mem 0x280000000-0x28fffffff 64bit 
pref]
[    0.256030] pci 0000:04:00.0: reg 0x18: [mem 0x290000000-0x2907fffff 64bit 
pref]
[    0.264028] pci 0000:04:00.0: reg 0x20: [io  0xc000-0xc0ff]
[    0.272029] pci 0000:04:00.0: reg 0x24: [mem 0xfe600000-0xfe63ffff]
[    0.280028] pci 0000:04:00.0: reg 0x30: [mem 0xfe640000-0xfe67ffff pref]
[    0.280269] pci 0000:04:00.0: supports D1 D2
[    0.280272] pci 0000:04:00.0: PME# supported from D1 D2 D3hot
[    0.280465] pci 0000:04:00.1: [1002:aac8] type 00 class 0x040300
[    0.281542] pci 0000:04:00.1: reg 0x10: [mem 0xfe680000-0xfe683fff 64bit]
[    0.286694] pci 0000:04:00.1: supports D1 D2
[    0.286907] pci 0000:00:1b.0: PCI bridge to [bus 04]
[    0.286922] pci 0000:00:1b.0:   bridge window [io  0xc000-0xcfff]
[    0.286929] pci 0000:00:1b.0:   bridge window [mem 0xfe600000-0xfe7fffff]
[    0.286941] pci 0000:00:1b.0:   bridge window [mem 0x280000000-0x29fffffff 
64bit pref]
[    0.290034] ACPI: PCI Interrupt Link [LNKA] (IRQs 5 *10 11)
[    0.290194] ACPI: PCI Interrupt Link [LNKB] (IRQs 5 *10 11)
[    0.290319] ACPI: PCI Interrupt Link [LNKC] (IRQs 5 10 *11)
[    0.290368] ACPI: PCI Interrupt Link [LNKD] (IRQs 5 10 *11)
[    0.290404] ACPI: PCI Interrupt Link [LNKE] (IRQs 5 *10 11)
[    0.290441] ACPI: PCI Interrupt Link [LNKF] (IRQs 5 *10 11)
[    0.290477] ACPI: PCI Interrupt Link [LNKG] (IRQs 5 10 *11)
[    0.290513] ACPI: PCI Interrupt Link [LNKH] (IRQs 5 10 *11)
[    0.290529] ACPI: PCI Interrupt Link [GSIA] (IRQs *16)
[    0.290535] ACPI: PCI Interrupt Link [GSIB] (IRQs *17)
[    0.290538] ACPI: PCI Interrupt Link [GSIC] (IRQs *18)
[    0.290543] ACPI: PCI Interrupt Link [GSID] (IRQs *19)
[    0.290549] ACPI: PCI Interrupt Link [GSIE] (IRQs *20)
[    0.290553] ACPI: PCI Interrupt Link [GSIF] (IRQs *21)
[    0.290557] ACPI: PCI Interrupt Link [GSIG] (IRQs *22)
[    0.290561] ACPI: PCI Interrupt Link [GSIH] (IRQs *23)
[    0.290793] ACPI: Enabled 16 GPEs in block 00 to 3F
[    0.290965] vgaarb: setting as boot device: PCI:0000:03:00.0
[    0.290965] vgaarb: device added: 
PCI:0000:03:00.0,decodes=io+mem,owns=io+mem,locks=none
[    0.290965] vgaarb: device added: 
PCI:0000:04:00.0,decodes=io+mem,owns=none,locks=none
[    0.290965] vgaarb: loaded
[    0.290965] vgaarb: bridge control possible 0000:04:00.0
[    0.290965] vgaarb: bridge control possible 0000:03:00.0
[    0.290965] SCSI subsystem initialized
[    0.290965] libata version 3.00 loaded.
[    0.290965] ACPI: bus type USB registered
[    0.290965] usbcore: registered new interface driver usbfs
[    0.290965] usbcore: registered new interface driver hub
[    0.290965] usbcore: registered new device driver usb
[    0.290965] PCI: Using ACPI for IRQ routing
[    0.314340] PCI: pci_cache_line_size set to 64 bytes
[    0.314460] e820: reserve RAM buffer [mem 0x0009fc00-0x0009ffff]
[    0.314463] e820: reserve RAM buffer [mem 0x7fffb000-0x7fffffff]
[    0.314571] NetLabel: Initializing
[    0.314574] NetLabel:  domain hash size = 128
[    0.314574] NetLabel:  protocols = UNLABELED CIPSOv4
[    0.314585] NetLabel:  unlabeled traffic allowed by default
[    0.314601] HPET: 3 timers in total, 0 timers will be used for per-cpu 
timer
[    0.314601] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0
[    0.314601] hpet0: 3 comparators, 64-bit 100.000000 MHz counter
[    0.316078] Switched to clocksource kvm-clock
[    0.320224] AppArmor: AppArmor Filesystem Enabled
[    0.320275] pnp: PnP ACPI init
[    0.320341] pnp 00:00: Plug and Play ACPI device, IDs PNP0b00 (active)
[    0.320371] pnp 00:01: Plug and Play ACPI device, IDs PNP0303 (active)
[    0.320393] pnp 00:02: Plug and Play ACPI device, IDs PNP0f13 (active)
[    0.320552] pnp: PnP ACPI: found 3 devices
[    0.492713] pci 0000:01:01.0: PCI bridge to [bus 02]
[    0.492733] pci 0000:01:01.0:   bridge window [io  0xe000-0xefff]
[    0.494147] pci 0000:01:01.0:   bridge window [mem 0xfe200000-0xfe3fffff]
[    0.496890] pci 0000:00:02.0: PCI bridge to [bus 01-02]
[    0.496897] pci 0000:00:02.0:   bridge window [io  0xe000-0xefff]
[    0.498274] pci 0000:00:02.0:   bridge window [mem 0xfe200000-0xfe5fffff]
[    0.500979] pci 0000:00:1a.0: PCI bridge to [bus 03]
[    0.500986] pci 0000:00:1a.0:   bridge window [io  0xd000-0xdfff]
[    0.502343] pci 0000:00:1a.0:   bridge window [mem 0xfe800000-0xfe9fffff]
[    0.566102] pci 0000:00:1a.0:   bridge window [mem 0x2a0000000-0x2bfffffff 
64bit pref]
[    0.585876] pci 0000:00:1b.0: PCI bridge to [bus 04]
[    0.585884] pci 0000:00:1b.0:   bridge window [io  0xc000-0xcfff]
[    0.587207] pci 0000:00:1b.0:   bridge window [mem 0xfe600000-0xfe7fffff]
[    0.650758] pci 0000:00:1b.0:   bridge window [mem 0x280000000-0x29fffffff 
64bit pref]
[    0.670504] pci_bus 0000:00: resource 4 [io  0x0000-0x0cd7]
[    0.670505] pci_bus 0000:00: resource 5 [io  0x0d00-0xffff]
[    0.670506] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff]
[    0.670507] pci_bus 0000:00: resource 7 [mem 0xc0000000-0xfebfffff]
[    0.670508] pci_bus 0000:00: resource 8 [mem 0x280000000-0x2bfffffff]
[    0.670510] pci_bus 0000:01: resource 0 [io  0xe000-0xefff]
[    0.670510] pci_bus 0000:01: resource 1 [mem 0xfe200000-0xfe5fffff]
[    0.670511] pci_bus 0000:01: resource 4 [io  0x0000-0x0cd7]
[    0.670512] pci_bus 0000:01: resource 5 [io  0x0d00-0xffff]
[    0.670513] pci_bus 0000:01: resource 6 [mem 0x000a0000-0x000bffff]
[    0.670514] pci_bus 0000:01: resource 7 [mem 0xc0000000-0xfebfffff]
[    0.670515] pci_bus 0000:01: resource 8 [mem 0x280000000-0x2bfffffff]
[    0.670516] pci_bus 0000:02: resource 0 [io  0xe000-0xefff]
[    0.670517] pci_bus 0000:02: resource 1 [mem 0xfe200000-0xfe3fffff]
[    0.670522] pci_bus 0000:03: resource 0 [io  0xd000-0xdfff]
[    0.670523] pci_bus 0000:03: resource 1 [mem 0xfe800000-0xfe9fffff]
[    0.670523] pci_bus 0000:03: resource 2 [mem 0x2a0000000-0x2bfffffff 64bit 
pref]
[    0.670526] pci_bus 0000:04: resource 0 [io  0xc000-0xcfff]
[    0.670527] pci_bus 0000:04: resource 1 [mem 0xfe600000-0xfe7fffff]
[    0.670527] pci_bus 0000:04: resource 2 [mem 0x280000000-0x29fffffff 64bit 
pref]
[    0.670642] NET: Registered protocol family 2
[    0.670980] TCP established hash table entries: 65536 (order: 7, 524288 
bytes)
[    0.671171] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes)
[    0.671420] TCP: Hash tables configured (established 65536 bind 65536)
[    0.671469] TCP: reno registered
[    0.671480] UDP hash table entries: 4096 (order: 5, 131072 bytes)
[    0.671519] UDP-Lite hash table entries: 4096 (order: 5, 131072 bytes)
[    0.671587] NET: Registered protocol family 1
[    0.673061] ACPI: PCI Interrupt Link [GSIH] enabled at IRQ 23
[    0.674691] ACPI: PCI Interrupt Link [GSIE] enabled at IRQ 20
[    0.675813] pci 0000:03:00.0: Video device with shadowed ROM
[    0.675839] PCI: CLS 64 bytes, default 64
[    0.675938] Trying to unpack rootfs image as initramfs...
[    0.872457] Freeing initrd memory: 19472K (ffff8800359e8000 - 
ffff880036cec000)
[    0.872510] PCI-DMA: Using software bounce buffering for IO (SWIOTLB)
[    0.872513] software IO TLB [mem 0x7bffb000-0x7fffb000] (64MB) mapped at 
[ffff88007bffb000-ffff88007fffafff]
[    0.872868] microcode: CPU0 sig=0x306c1, pf=0x1, revision=0x1
[    0.872899] microcode: CPU1 sig=0x306c1, pf=0x1, revision=0x1
[    0.872913] microcode: CPU2 sig=0x306c1, pf=0x1, revision=0x1
[    0.872957] microcode: CPU3 sig=0x306c1, pf=0x1, revision=0x1
[    0.873076] microcode: Microcode Update Driver: v2.00 
<tigran at aivazian.fsnet.co.uk>, Peter Oruba
[    0.873123] Scanning for low memory corruption every 60 seconds
[    0.873498] futex hash table entries: 1024 (order: 4, 65536 bytes)
[    0.873538] Initialise system trusted keyring
[    0.873560] audit: initializing netlink subsys (disabled)
[    0.873584] audit: type=2000 audit(1451601071.549:1): initialized
[    0.873899] HugeTLB registered 2 MB page size, pre-allocated 0 pages
[    0.874843] zpool: loaded
[    0.874846] zbud: loaded
[    0.875010] VFS: Disk quotas dquot_6.5.2
[    0.875035] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
[    0.875381] fuse init (API version 7.23)
[    0.875486] Key type big_key registered
[    0.876143] Key type asymmetric registered
[    0.876148] Asymmetric key parser 'x509' registered
[    0.876171] Block layer SCSI generic (bsg) driver version 0.4 loaded 
(major 252)
[    0.876223] io scheduler noop registered
[    0.876225] io scheduler deadline registered (default)
[    0.876245] io scheduler cfq registered
[    0.882182] aer 0000:00:1a.0:pcie02: service driver aer loaded
[    0.882242] aer 0000:00:1b.0:pcie02: service driver aer loaded
[    0.882266] pcieport 0000:00:1a.0: Signaling PME through PCIe PME 
interrupt
[    0.882268] pci 0000:03:00.0: Signaling PME through PCIe PME interrupt
[    0.882270] pci 0000:03:00.1: Signaling PME through PCIe PME interrupt
[    0.882277] pcie_pme 0000:00:1a.0:pcie01: service driver pcie_pme loaded
[    0.882293] pcieport 0000:00:1b.0: Signaling PME through PCIe PME 
interrupt
[    0.882294] pci 0000:04:00.0: Signaling PME through PCIe PME interrupt
[    0.882295] pci 0000:04:00.1: Signaling PME through PCIe PME interrupt
[    0.882303] pcie_pme 0000:00:1b.0:pcie01: service driver pcie_pme loaded
[    0.882307] pci_hotplug: PCI Hot Plug PCI Core version: 0.5
[    0.882341] pciehp 0000:00:1a.0:pcie04: Slot #0 AttnBtn+ AttnInd+ PwrInd+ 
PwrCtrl- MRL- Interlock+ NoCompl- LLActRep-
[    0.882392] pciehp 0000:00:1a.0:pcie04: service driver pciehp loaded
[    0.882417] pciehp 0000:00:1b.0:pcie04: Slot #0 AttnBtn+ AttnInd+ PwrInd+ 
PwrCtrl- MRL- Interlock+ NoCompl- LLActRep-
[    0.882461] pciehp 0000:00:1b.0:pcie04: service driver pciehp loaded
[    0.882466] pciehp: PCI Express Hot Plug Controller Driver version: 0.4
[    0.882500] efifb: probing for efifb
[    0.882506] efifb: framebuffer at 0xa0000, mapped to 0xffff8800000a0000, 
using 64k, total 64k
[    0.882507] efifb: mode is 640x480x1, linelength=80, pages=1
[    0.882508] efifb: scrolling: redraw
[    0.882510] efifb: Truecolor: size=8:8:8:8, shift=24:16:8:0
[    0.903777] Console: switching to colour frame buffer device 80x30
[    0.925882] fb0: EFI VGA frame buffer device
[    0.926493] intel_idle: does not run on family 6 model 60
[    0.926551] input: Power Button as 
/devices/LNXSYSTM:00/LNXPWRBN:00/input/input0
[    0.927473] ACPI: Power Button [PWRF]
[    0.928164] GHES: HEST is not enabled!
[    0.956892] ACPI: PCI Interrupt Link [GSIF] enabled at IRQ 21
[    0.987634] ACPI: PCI Interrupt Link [GSIG] enabled at IRQ 22
[    1.017722] Serial: 8250/16550 driver, 32 ports, IRQ sharing enabled
[    1.046205] Linux agpgart interface v0.103
[    1.074429] brd: module loaded
[    1.102291] loop: module loaded
[    1.130669]  vda: vda1
[    1.156414] libphy: Fixed MDIO Bus: probed
[    1.182997] tun: Universal TUN/TAP device driver, 1.6
[    1.208876] tun: (C) 1999-2004 Max Krasnyansky <maxk at qualcomm.com>
[    1.237476] PPP generic driver version 2.4.2
[    1.264077] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
[    1.290812] ehci-pci: EHCI PCI platform driver
[    1.318654] ehci-pci 0000:02:01.1: EHCI Host Controller
[    1.344796] ehci-pci 0000:02:01.1: new USB bus registered, assigned bus 
number 1
[    1.396761] ehci-pci 0000:02:01.1: irq 23, io mem 0xfe240000
[    1.432016] ehci-pci 0000:02:01.1: USB 2.0 started, EHCI 1.00
[    1.458191] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002
[    1.484248] usb usb1: New USB device strings: Mfr=3, Product=2, 
SerialNumber=1
[    1.534014] usb usb1: Product: EHCI Host Controller
[    1.559788] usb usb1: Manufacturer: Linux 3.19.0-42-generic ehci_hcd
[    1.585890] usb usb1: SerialNumber: 0000:02:01.1
[    1.611907] hub 1-0:1.0: USB hub found
[    1.637789] hub 1-0:1.0: 6 ports detected
[    1.663225] ehci-platform: EHCI generic platform driver
[    1.688110] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver
[    1.713294] ohci-pci: OHCI PCI platform driver
[    1.738939] ohci-platform: OHCI generic platform driver
[    1.763893] uhci_hcd: USB Universal Host Controller Interface driver
[    1.791488] uhci_hcd 0000:02:01.0: UHCI Host Controller
[    1.817054] uhci_hcd 0000:02:01.0: new USB bus registered, assigned bus 
number 2
[    1.869796] uhci_hcd 0000:02:01.0: detected 2 ports
[    1.872049] tsc: Refined TSC clocksource calibration: 3499.997 MHz
[    1.926128] uhci_hcd 0000:02:01.0: irq 20, io base 0x0000e040
[    1.954794] usb usb2: New USB device found, idVendor=1d6b, idProduct=0001
[    1.954795] usb usb2: New USB device strings: Mfr=3, Product=2, 
SerialNumber=1
[    1.954795] usb usb2: Product: UHCI Host Controller
[    1.954796] usb usb2: Manufacturer: Linux 3.19.0-42-generic uhci_hcd
[    1.954796] usb usb2: SerialNumber: 0000:02:01.0
[    1.954858] hub 2-0:1.0: USB hub found
[    1.954860] hub 2-0:1.0: 2 ports detected
[    1.954952] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 
0x60,0x64 irq 1,12
[    1.984534] serio: i8042 KBD port at 0x60,0x64 irq 1
[    1.984537] serio: i8042 AUX port at 0x60,0x64 irq 12
[    1.984610] mousedev: PS/2 mouse device common for all mice
[    1.984704] rtc_cmos 00:00: RTC can wake from S4
[    1.984856] rtc_cmos 00:00: rtc core: registered rtc_cmos as rtc0
[    1.984959] rtc_cmos 00:00: alarms up to one day, 114 bytes nvram, hpet 
irqs
[    1.984965] i2c /dev entries driver
[    1.985016] device-mapper: uevent: version 1.0.3
[    1.985053] device-mapper: ioctl: 4.29.0-ioctl (2014-10-28) initialised: 
dm-devel at redhat.com
[    1.985067] ledtrig-cpu: registered to indicate activity on CPUs
[    1.985203] PCCT header not found.
[    1.985203] ACPI PCC probe failed.
[    1.985267] TCP: cubic registered
[    1.985324] NET: Registered protocol family 10
[    1.985556] NET: Registered protocol family 17
[    1.985567] Key type dns_resolver registered
[    1.985837] Loading compiled-in X.509 certificates
[    1.986290] Loaded X.509 cert 'Magrathea: Glacier signing key: 
759bcd6455a9dfaba6111485d04eded53ab83150'
[    1.986301] registered taskstats version 1
[    2.042568] hpet1: lost 2 rtc interrupts
[    2.043963] Key type trusted registered
[    2.046121] Key type encrypted registered
[    2.046125] AppArmor: AppArmor sha1 policy hashing enabled
[    2.046129] ima: No TPM chip found, activating TPM-bypass!
[    2.046155] evm: HMAC attrs: 0x1
[    2.046893]   Magic number: 11:181:554
[    2.046915] aer 0000:00:1b.0:pcie02: hash matches
[    2.046934] acpi PNP0C0F:05: hash matches
[    2.072669] rtc_cmos 00:00: setting system clock to 2015-12-31 22:31:13 
UTC (1451601073)
[    2.072764] BIOS EDD facility v0.16 2004-Jun-25, 0 devices found
[    2.072764] EDD information not available.
[    2.072797] PM: Hibernation image not present or could not be loaded.
[    2.236731] input: AT Translated Set 2 keyboard as 
/devices/platform/i8042/serio0/input/input1
[    3.179647] Freeing unused kernel memory: 1408K (ffffffff81d27000 - 
ffffffff81e87000)
[    3.233784] Write protecting the kernel read-only data: 12288k
[    3.261944] Freeing unused kernel memory: 256K (ffff8800017c0000 - 
ffff880001800000)
[    3.316558] Freeing unused kernel memory: 340K (ffff880001bab000 - 
ffff880001c00000)
[    3.411605] systemd-udevd[122]: starting version 204
[    3.446790] ahci 0000:00:1f.2: version 3.0
[    3.446994] ACPI: PCI Interrupt Link [GSIA] enabled at IRQ 16
[    3.447399] ahci 0000:00:1f.2: AHCI 0001.0000 32 slots 6 ports 1.5 Gbps 
0x3f impl SATA mode
[    3.447400] ahci 0000:00:1f.2: flags: ncq only
[    3.450625] scsi host0: ahci
[    3.452274] scsi host1: ahci
[    3.452364] scsi host2: ahci
[    3.452794] scsi host3: ahci
[    3.452916] scsi host4: ahci
[    3.453028] scsi host5: ahci
[    3.453062] ata1: SATA max UDMA/133 abar m4096 at 0xfea00000 port 0xfea00100 
irq 31
[    3.453071] ata2: SATA max UDMA/133 abar m4096 at 0xfea00000 port 0xfea00180 
irq 31
[    3.453096] ata3: SATA max UDMA/133 abar m4096 at 0xfea00000 port 0xfea00200 
irq 31
[    3.453099] ata4: SATA max UDMA/133 abar m4096 at 0xfea00000 port 0xfea00280 
irq 31
[    3.453101] ata5: SATA max UDMA/133 abar m4096 at 0xfea00000 port 0xfea00300 
irq 31
[    3.453104] ata6: SATA max UDMA/133 abar m4096 at 0xfea00000 port 0xfea00380 
irq 31
[    3.468338] FDC 0 is a S82078B
[    3.772100] ata2: SATA link down (SStatus 0 SControl 300)
[    3.772177] ata5: SATA link down (SStatus 0 SControl 300)
[    3.772268] ata1: SATA link up 1.5 Gbps (SStatus 113 SControl 300)
[    3.776063] ata3: SATA link down (SStatus 0 SControl 300)
[    3.776152] ata4: SATA link down (SStatus 0 SControl 300)
[    3.776231] ata6: SATA link down (SStatus 0 SControl 300)
[    3.781858] ata1.00: ATAPI: QEMU DVD-ROM, 2.0.0, max UDMA/100
[    3.781859] ata1.00: applying bridge limits
[    3.899246] ata1.00: configured for UDMA/100
[    4.020658] scsi 0:0:0:0: CD-ROM            QEMU     QEMU DVD-ROM     2.0. 
PQ: 0 ANSI: 5
[    4.299971] sr 0:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray
[    4.299977] cdrom: Uniform CD-ROM driver Revision: 3.20
[    4.300096] sr 0:0:0:0: Attached scsi CD-ROM sr0
[    4.300168] sr 0:0:0:0: Attached scsi generic sg0 type 5
[    4.703617] EXT4-fs (vda1): INFO: recovery required on readonly filesystem
[    4.735577] EXT4-fs (vda1): write access will be enabled during recovery
[    4.776031] EXT4-fs (vda1): recovery complete
[    4.808626] EXT4-fs (vda1): mounted filesystem with ordered data mode. 
Opts: (null)
[    5.021580] random: init urandom read with 23 bits of entropy available
[    5.061886] init: plymouth-upstart-bridge main process (195) terminated 
with status 1
[    5.112671] init: plymouth-upstart-bridge main process ended, respawning
[    5.144964] init: plymouth-upstart-bridge main process (205) terminated 
with status 1
[    5.217068] input: ImExPS/2 Generic Explorer Mouse as 
/devices/platform/i8042/serio1/input/input3
[    5.278117] init: plymouth-upstart-bridge main process ended, respawning
[    5.345220] EXT4-fs (vda1): re-mounted. Opts: errors=remount-ro
[    5.477845] systemd-udevd[404]: starting version 204
[    5.500830] lp: driver loaded but no devices found
[    5.539125] lpc_ich 0000:00:1f.0: RCBA is disabled by hardware/BIOS, 
device disabled
[    5.539147] lpc_ich 0000:00:1f.0: I/O space for GPIO uninitialized
[    5.539148] lpc_ich 0000:00:1f.0: No MFD cells added
[    5.539199] acpi PNP0A08:00: _OSC: platform does not support [SHPCHotplug]
[    5.539221] acpi PNP0A08:00: _OSC: not requesting control; platform does 
not support [SHPCHotplug]
[    5.539233] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4
[    5.558861] AMD IOMMUv2 driver by Joerg Roedel <joerg.roedel at amd.com>
[    5.558863] AMD IOMMUv2 functionality not available on this system
[    5.574375] fglrx: module license 'Proprietary. (C) 2002 - ATI 
Technologies, Starnberg, GERMANY' taints kernel.
[    5.574378] Disabling lock debugging due to kernel taint
[    5.578372] ACPI: PCI Interrupt Link [GSIB] enabled at IRQ 17
[    5.578412] snd_hda_intel 0000:03:00.1: Handle VGA-switcheroo audio client
[    5.578414] snd_hda_intel 0000:03:00.1: Force to non-snoop mode
[    5.581581] fglrx: module verification failed: signature and/or  required 
key missing - tainting kernel
[    5.583613] snd_hda_intel 0000:04:00.1: Handle VGA-switcheroo audio client
[    5.583617] snd_hda_intel 0000:04:00.1: Force to non-snoop mode
[    5.591974] audit: type=1400 audit(1451601077.038:2): apparmor="STATUS" 
operation="profile_load" profile="unconfined" name="/sbin/dhclient" pid=483 
comm="apparmor_parser"
[    5.591978] audit: type=1400 audit(1451601077.038:3): apparmor="STATUS" 
operation="profile_load" profile="unconfined" 
name="/usr/lib/NetworkManager/nm-dhcp-client.action" pid=483 
comm="apparmor_parser"
[    5.591988] audit: type=1400 audit(1451601077.038:4): apparmor="STATUS" 
operation="profile_load" profile="unconfined" 
name="/usr/lib/connman/scripts/dhclient-script" pid=483 
comm="apparmor_parser"
[    5.592325] audit: type=1400 audit(1451601077.042:5): apparmor="STATUS" 
operation="profile_replace" profile="unconfined" 
name="/usr/lib/NetworkManager/nm-dhcp-client.action" pid=483 
comm="apparmor_parser"
[    5.592329] audit: type=1400 audit(1451601077.042:6): apparmor="STATUS" 
operation="profile_replace" profile="unconfined" 
name="/usr/lib/connman/scripts/dhclient-script" pid=483 
comm="apparmor_parser"
[    5.592455] audit: type=1400 audit(1451601077.042:7): apparmor="STATUS" 
operation="profile_replace" profile="unconfined" 
name="/usr/lib/connman/scripts/dhclient-script" pid=483 
comm="apparmor_parser"
[    5.592675] input: HDA ATI HDMI HDMI/DP,pcm=3 as 
/devices/pci0000:00/0000:00:1a.0/0000:03:00.1/sound/card0/input4
[    5.592710] input: HDA ATI HDMI HDMI/DP,pcm=7 as 
/devices/pci0000:00/0000:00:1a.0/0000:03:00.1/sound/card0/input5
[    5.592741] input: HDA ATI HDMI HDMI/DP,pcm=8 as 
/devices/pci0000:00/0000:00:1a.0/0000:03:00.1/sound/card0/input6
[    5.592771] input: HDA ATI HDMI HDMI/DP,pcm=9 as 
/devices/pci0000:00/0000:00:1a.0/0000:03:00.1/sound/card0/input7
[    5.592799] input: HDA ATI HDMI HDMI/DP,pcm=10 as 
/devices/pci0000:00/0000:00:1a.0/0000:03:00.1/sound/card0/input8
[    5.592828] input: HDA ATI HDMI HDMI/DP,pcm=11 as 
/devices/pci0000:00/0000:00:1a.0/0000:03:00.1/sound/card0/input9
[    5.594789] input: HDA ATI HDMI HDMI/DP,pcm=3 as 
/devices/pci0000:00/0000:00:1b.0/0000:04:00.1/sound/card1/input10
[    5.594824] input: HDA ATI HDMI HDMI/DP,pcm=7 as 
/devices/pci0000:00/0000:00:1b.0/0000:04:00.1/sound/card1/input11
[    5.594854] input: HDA ATI HDMI HDMI/DP,pcm=8 as 
/devices/pci0000:00/0000:00:1b.0/0000:04:00.1/sound/card1/input12
[    5.594885] input: HDA ATI HDMI HDMI/DP,pcm=9 as 
/devices/pci0000:00/0000:00:1b.0/0000:04:00.1/sound/card1/input13
[    5.594918] input: HDA ATI HDMI HDMI/DP,pcm=10 as 
/devices/pci0000:00/0000:00:1b.0/0000:04:00.1/sound/card1/input14
[    5.594949] input: HDA ATI HDMI HDMI/DP,pcm=11 as 
/devices/pci0000:00/0000:00:1b.0/0000:04:00.1/sound/card1/input15
[    5.611680] AVX2 version of gcm_enc/dec engaged.
[    5.611682] AES CTR mode by8 optimization enabled
[    5.612167] <6>[fglrx] Maximum main memory to use for locked dma buffers: 
7751 MBytes.
[    5.612500] <6>[fglrx]   vendor: 1002 device: 67b0 revision: 0 count: 1
[    5.612502] <6>[fglrx]   vendor: 1002 device: 67b0 revision: 0 count: 2
[    5.612752] <6>[fglrx] ioport: bar 4, base 0xd000, size: 0x100
[    5.615490] <6>[fglrx] ioport: bar 4, base 0xc000, size: 0x100
[    5.618194] <6>[fglrx] Kernel PAT support is enabled
[    5.618209] <6>[fglrx] module loaded - fglrx 15.30.3 [Dec 17 2015] with 2 
minors
[    5.655729] ppdev: user-space parallel port driver
[    5.657603] intel_rapl: no valid rapl domains found in package 0
[    5.768491] intel_rapl: no valid rapl domains found in package 0
[    5.852839] init: failsafe main process (576) killed by TERM signal
[    5.864381] intel_rapl: no valid rapl domains found in package 0
[    5.883191] audit: type=1400 audit(1451601077.330:8): apparmor="STATUS" 
operation="profile_load" profile="unconfined" name="/usr/sbin/tcpdump" 
pid=766 comm="apparmor_parser"
[    5.883388] audit: type=1400 audit(1451601077.330:9): apparmor="STATUS" 
operation="profile_replace" profile="unconfined" name="/sbin/dhclient" 
pid=764 comm="apparmor_parser"
[    5.883392] audit: type=1400 audit(1451601077.330:10): apparmor="STATUS" 
operation="profile_replace" profile="unconfined" 
name="/usr/lib/NetworkManager/nm-dhcp-client.action" pid=764 
comm="apparmor_parser"
[    5.883394] audit: type=1400 audit(1451601077.330:11): apparmor="STATUS" 
operation="profile_replace" profile="unconfined" 
name="/usr/lib/connman/scripts/dhclient-script" pid=764 
comm="apparmor_parser"
[    5.883595] audit: type=1400 audit(1451601077.330:12): apparmor="STATUS" 
operation="profile_replace" profile="unconfined" 
name="/usr/lib/NetworkManager/nm-dhcp-client.action" pid=764 
comm="apparmor_parser"
[    5.883596] audit: type=1400 audit(1451601077.330:13): apparmor="STATUS" 
operation="profile_replace" profile="unconfined" 
name="/usr/lib/connman/scripts/dhclient-script" pid=764 
comm="apparmor_parser"
[    5.883704] audit: type=1400 audit(1451601077.330:14): apparmor="STATUS" 
operation="profile_replace" profile="unconfined" 
name="/usr/lib/connman/scripts/dhclient-script" pid=764 
comm="apparmor_parser"
[    5.956595] intel_rapl: no valid rapl domains found in package 0
[    6.008319] ip_tables: (C) 2000-2006 Netfilter Core Team
[    6.028699] nf_conntrack version 0.5.0 (16384 buckets, 65536 max)
[    7.270251] <6>[fglrx] Firegl kernel thread PID: 1054
[    7.270389] <6>[fglrx] Firegl kernel thread PID: 1055
[    7.270489] <6>[fglrx] IRQ 34 Enabled
[    7.289302] <6>[fglrx] Reserved FB block: Shared offset:0, size:1000000
[    7.289304] <6>[fglrx] Reserved FB block: Unshared offset:f6b4000, 
size:4000
[    7.289304] <6>[fglrx] Reserved FB block: Unshared offset:f6b8000, 
size:548000
[    7.289305] <6>[fglrx] Reserved FB block: Unshared offset:fc00000, 
size:100000
[    7.289306] <6>[fglrx] Reserved FB block: Unshared offset:fff8000, 
size:8000
[    7.289306] <6>[fglrx] Reserved FB block: Unshared offset:ffff3000, 
size:d000
[    7.599687] <3>[fglrx:firegl_cail_init] *ERROR* CAIL: CAILInitialize 
failed, error 1
[    7.599690] <3>[fglrx:hal_init_gpu] *ERROR* Failed to initialize cail.
[    7.599691] <6>[fglrx] device open failed with code -1
[    7.602613] vgaarb: this pci device is not a vga device
[    7.602618] vgaarb: this pci device is not a vga device
[    7.602622] vgaarb: this pci device is not a vga device
[    7.602625] vgaarb: this pci device is not a vga device
[    7.602628] vgaarb: this pci device is not a vga device
[    7.602632] vgaarb: this pci device is not a vga device
[    7.602636] vgaarb: this pci device is not a vga device
[    7.602640] vgaarb: this pci device is not a vga device
[    7.602644] vgaarb: this pci device is not a vga device
[    7.602648] vgaarb: this pci device is not a vga device
[    7.602652] vgaarb: this pci device is not a vga device
[    7.602656] vgaarb: this pci device is not a vga device
[    7.602660] vgaarb: this pci device is not a vga device
[    7.602669] vgaarb: this pci device is not a vga device
[    7.602679] vgaarb: device changed decodes: 
PCI:0000:04:00.0,olddecodes=io+mem,decodes=none:owns=none
[    7.602688] vgaarb: this pci device is not a vga device
[    7.670389] <3>[fglrx:firegl_cail_query_parameter] *ERROR* 
CAIL_QueryParameter failed
[   85.620552] random: nonblocking pool is initialized

------------------------------------------------------------------------------

dmesg output on the VM with three 6950s:

[    0.000000] Initializing cgroup subsys cpuset
[    0.000000] Initializing cgroup subsys cpu
[    0.000000] Initializing cgroup subsys cpuacct
[    0.000000] Linux version 3.19.0-42-generic (buildd at lgw01-24) (gcc version 
4.8.2 (Ubuntu 4.8.2-19ubuntu1) ) #48~14.04.1-Ubuntu SMP Fri Dec 18 10:24:49 
UTC 2015 (Ubuntu 3.19.0-42.48~14.04.1-generic 3.19.8-ckt10)
[    0.000000] Command line: BOOT_IMAGE=/boot/vmlinuz-3.19.0-42-generic 
root=UUID=1e153495-22c3-41e8-99be-734777b0f4bc ro
[    0.000000] KERNEL supported cpus:
[    0.000000]   Intel GenuineIntel
[    0.000000]   AMD AuthenticAMD
[    0.000000]   Centaur CentaurHauls
[    0.000000] e820: BIOS-provided physical RAM map:
[    0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable
[    0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] 
reserved
[    0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] 
reserved
[    0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000007fffafff] usable
[    0.000000] BIOS-e820: [mem 0x000000007fffb000-0x000000007fffffff] 
reserved
[    0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] 
reserved
[    0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] 
reserved
[    0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] 
reserved
[    0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000027fffffff] usable
[    0.000000] NX (Execute Disable) protection: active
[    0.000000] SMBIOS 2.4 present.
[    0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS Bochs 
01/01/2011
[    0.000000] Hypervisor detected: KVM
[    0.000000] e820: update [mem 0x00000000-0x00000fff] usable ==> reserved
[    0.000000] e820: remove [mem 0x000a0000-0x000fffff] usable
[    0.000000] AGP: No AGP bridge found
[    0.000000] e820: last_pfn = 0x280000 max_arch_pfn = 0x400000000
[    0.000000] MTRR default type: write-back
[    0.000000] MTRR fixed ranges enabled:
[    0.000000]   00000-9FFFF write-back
[    0.000000]   A0000-BFFFF uncachable
[    0.000000]   C0000-FFFFF write-protect
[    0.000000] MTRR variable ranges enabled:
[    0.000000]   0 base 00C0000000 mask FFC0000000 uncachable
[    0.000000]   1 disabled
[    0.000000]   2 disabled
[    0.000000]   3 disabled
[    0.000000]   4 disabled
[    0.000000]   5 disabled
[    0.000000]   6 disabled
[    0.000000]   7 disabled
[    0.000000] PAT configuration [0-7]: WB  WC  UC- UC  WB  WC  UC- UC 
[    0.000000] e820: last_pfn = 0x7fffb max_arch_pfn = 0x400000000
[    0.000000] found SMP MP-table at [mem 0x000f0ae0-0x000f0aef] mapped at 
[ffff8800000f0ae0]
[    0.000000] Scanning 1 areas for low memory corruption
[    0.000000] Base memory trampoline at [ffff880000099000] 99000 size 24576
[    0.000000] Using GB pages for direct mapping
[    0.000000] init_memory_mapping: [mem 0x00000000-0x000fffff]
[    0.000000]  [mem 0x00000000-0x000fffff] page 4k
[    0.000000] BRK [0x01fd4000, 0x01fd4fff] PGTABLE
[    0.000000] BRK [0x01fd5000, 0x01fd5fff] PGTABLE
[    0.000000] BRK [0x01fd6000, 0x01fd6fff] PGTABLE
[    0.000000] init_memory_mapping: [mem 0x27fe00000-0x27fffffff]
[    0.000000]  [mem 0x27fe00000-0x27fffffff] page 1G
[    0.000000] init_memory_mapping: [mem 0x260000000-0x27fdfffff]
[    0.000000]  [mem 0x260000000-0x27fdfffff] page 1G
[    0.000000] init_memory_mapping: [mem 0x00100000-0x7fffafff]
[    0.000000]  [mem 0x00100000-0x001fffff] page 4k
[    0.000000]  [mem 0x00200000-0x7fdfffff] page 2M
[    0.000000]  [mem 0x7fe00000-0x7fffafff] page 4k
[    0.000000] init_memory_mapping: [mem 0x100000000-0x25fffffff]
[    0.000000]  [mem 0x100000000-0x25fffffff] page 1G
[    0.000000] RAMDISK: [mem 0x359ea000-0x36cecfff]
[    0.000000] ACPI: Early table checksum verification disabled
[    0.000000] ACPI: RSDP 0x00000000000F08B0 000014 (v00 BOCHS )
[    0.000000] ACPI: RSDT 0x000000007FFFF1A6 000038 (v01 BOCHS  BXPCRSDT 
00000001 BXPC 00000001)
[    0.000000] ACPI: FACP 0x000000007FFFED12 000074 (v01 BOCHS  BXPCFACP 
00000001 BXPC 00000001)
[    0.000000] ACPI: DSDT 0x000000007FFFD040 001CD2 (v01 BOCHS  BXPCDSDT 
00000001 BXPC 00000001)
[    0.000000] ACPI: FACS 0x000000007FFFD000 000040
[    0.000000] ACPI: SSDT 0x000000007FFFED86 00031C (v01 BOCHS  BXPCSSDT 
00000001 BXPC 00000001)
[    0.000000] ACPI: APIC 0x000000007FFFF0A2 000090 (v01 BOCHS  BXPCAPIC 
00000001 BXPC 00000001)
[    0.000000] ACPI: HPET 0x000000007FFFF132 000038 (v01 BOCHS  BXPCHPET 
00000001 BXPC 00000001)
[    0.000000] ACPI: MCFG 0x000000007FFFF16A 00003C (v01 BOCHS  BXPCMCFG 
00000001 BXPC 00000001)
[    0.000000] ACPI: Local APIC address 0xfee00000
[    0.000000] No NUMA configuration found
[    0.000000] Faking a node at [mem 0x0000000000000000-0x000000027fffffff]
[    0.000000] NODE_DATA(0) allocated [mem 0x27fff9000-0x27fffdfff]
[    0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00
[    0.000000] kvm-clock: cpu 0, msr 2:7fff5001, primary cpu clock
[    0.000000]  [ffffea0000000000-ffffea0009ffffff] PMD -> 
[ffff880277600000-ffff88027f5fffff] on node 0
[    0.000000] Zone ranges:
[    0.000000]   DMA      [mem 0x00001000-0x00ffffff]
[    0.000000]   DMA32    [mem 0x01000000-0xffffffff]
[    0.000000]   Normal   [mem 0x100000000-0x27fffffff]
[    0.000000] Movable zone start for each node
[    0.000000] Early memory node ranges
[    0.000000]   node   0: [mem 0x00001000-0x0009efff]
[    0.000000]   node   0: [mem 0x00100000-0x7fffafff]
[    0.000000]   node   0: [mem 0x100000000-0x27fffffff]
[    0.000000] Initmem setup node 0 [mem 0x00001000-0x27fffffff]
[    0.000000] On node 0 totalpages: 2097049
[    0.000000]   DMA zone: 64 pages used for memmap
[    0.000000]   DMA zone: 21 pages reserved
[    0.000000]   DMA zone: 3998 pages, LIFO batch:0
[    0.000000]   DMA32 zone: 8128 pages used for memmap
[    0.000000]   DMA32 zone: 520187 pages, LIFO batch:31
[    0.000000]   Normal zone: 24576 pages used for memmap
[    0.000000]   Normal zone: 1572864 pages, LIFO batch:31
[    0.000000] ACPI: PM-Timer IO Port: 0xb008
[    0.000000] ACPI: Local APIC address 0xfee00000
[    0.000000] ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x01] lapic_id[0x01] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x02] lapic_id[0x02] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x03] lapic_id[0x03] enabled)
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])
[    0.000000] ACPI: IOAPIC (id[0x00] address[0xfec00000] gsi_base[0])
[    0.000000] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)
[    0.000000] ACPI: IRQ0 used by override.
[    0.000000] ACPI: IRQ5 used by override.
[    0.000000] ACPI: IRQ9 used by override.
[    0.000000] ACPI: IRQ10 used by override.
[    0.000000] ACPI: IRQ11 used by override.
[    0.000000] Using ACPI (MADT) for SMP configuration information
[    0.000000] ACPI: HPET id: 0x8086a201 base: 0xfed00000
[    0.000000] smpboot: Allowing 4 CPUs, 0 hotplug CPUs
[    0.000000] PM: Registered nosave memory: [mem 0x00000000-0x00000fff]
[    0.000000] PM: Registered nosave memory: [mem 0x0009f000-0x0009ffff]
[    0.000000] PM: Registered nosave memory: [mem 0x000a0000-0x000effff]
[    0.000000] PM: Registered nosave memory: [mem 0x000f0000-0x000fffff]
[    0.000000] PM: Registered nosave memory: [mem 0x7fffb000-0x7fffffff]
[    0.000000] PM: Registered nosave memory: [mem 0x80000000-0xafffffff]
[    0.000000] PM: Registered nosave memory: [mem 0xb0000000-0xbfffffff]
[    0.000000] PM: Registered nosave memory: [mem 0xc0000000-0xfeffbfff]
[    0.000000] PM: Registered nosave memory: [mem 0xfeffc000-0xfeffffff]
[    0.000000] PM: Registered nosave memory: [mem 0xff000000-0xfffbffff]
[    0.000000] PM: Registered nosave memory: [mem 0xfffc0000-0xffffffff]
[    0.000000] e820: [mem 0xc0000000-0xfeffbfff] available for PCI devices
[    0.000000] Booting paravirtualized kernel on KVM
[    0.000000] setup_percpu: NR_CPUS:256 nr_cpumask_bits:256 nr_cpu_ids:4 
nr_node_ids:1
[    0.000000] PERCPU: Embedded 31 pages/cpu @ffff88027fc00000 s86144 r8192 
d32640 u524288
[    0.000000] pcpu-alloc: s86144 r8192 d32640 u524288 alloc=1*2097152
[    0.000000] pcpu-alloc: [0] 0 1 2 3
[    0.000000] KVM setup async PF for cpu 0
[    0.000000] kvm-stealtime: cpu 0, msr 27fc0e100
[    0.000000] Built 1 zonelists in Node order, mobility grouping on.  Total 
pages: 2064260
[    0.000000] Policy zone: Normal
[    0.000000] Kernel command line: 
BOOT_IMAGE=/boot/vmlinuz-3.19.0-42-generic 
root=UUID=1e153495-22c3-41e8-99be-734777b0f4bc ro
[    0.000000] PID hash table entries: 4096 (order: 3, 32768 bytes)
[    0.000000] xsave: enabled xstate_bv 0x7, cntxt size 0x340 using standard 
form
[    0.000000] AGP: Checking aperture...
[    0.000000] AGP: No AGP bridge found
[    0.000000] Calgary: detecting Calgary via BIOS EBDA area
[    0.000000] Calgary: Unable to locate Rio Grande table in EBDA - bailing!
[    0.000000] Memory: 8154496K/8388196K available (7922K kernel code, 1174K 
rwdata, 3756K rodata, 1408K init, 1292K bss, 233700K reserved, 0K 
cma-reserved)
[    0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1
[    0.000000] Hierarchical RCU implementation.
[    0.000000]     RCU dyntick-idle grace-period acceleration is enabled.
[    0.000000]     RCU restricting CPUs from NR_CPUS=256 to nr_cpu_ids=4.
[    0.000000] RCU: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4
[    0.000000] NR_IRQS:16640 nr_irqs:456 16
[    0.000000]     Offload RCU callbacks from all CPUs
[    0.000000]     Offload RCU callbacks from CPUs: 0-3.
[    0.000000] Console: colour dummy device 80x25
[    0.000000] console [tty0] enabled
[    0.000000] hpet clockevent registered
[    0.000000] tsc: Detected 3499.996 MHz processor
[    0.008000] Calibrating delay loop (skipped) preset value.. 6999.99 
BogoMIPS (lpj=13999984)
[    0.008000] pid_max: default: 32768 minimum: 301
[    0.008000] ACPI: Core revision 20141107
[    0.008000] ACPI: All ACPI Tables successfully acquired
[    0.008000] Security Framework initialized
[    0.008000] AppArmor: AppArmor initialized
[    0.008000] Yama: becoming mindful.
[    0.008000] Dentry cache hash table entries: 1048576 (order: 11, 8388608 
bytes)
[    0.008000] Inode-cache hash table entries: 524288 (order: 10, 4194304 
bytes)
[    0.008000] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes)
[    0.008000] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 
bytes)
[    0.008000] Initializing cgroup subsys memory
[    0.008000] Initializing cgroup subsys devices
[    0.008000] Initializing cgroup subsys freezer
[    0.008000] Initializing cgroup subsys net_cls
[    0.008000] Initializing cgroup subsys blkio
[    0.008000] Initializing cgroup subsys perf_event
[    0.008000] Initializing cgroup subsys net_prio
[    0.008000] Initializing cgroup subsys hugetlb
[    0.008000] mce: CPU supports 10 MCE banks
[    0.008000] Last level iTLB entries: 4KB 0, 2MB 0, 4MB 0
[    0.008000] Last level dTLB entries: 4KB 0, 2MB 0, 4MB 0, 1GB 0
[    0.008000] Freeing SMP alternatives memory: 32K (ffffffff81e87000 - 
ffffffff81e8f000)
[    0.010905] ftrace: allocating 30027 entries in 118 pages
[    0.020169] Enabling x2apic
[    0.020179] Enabled x2apic
[    0.020314] Switched APIC routing to physical x2apic.
[    0.024158] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1
[    0.024159] smpboot: CPU0: Intel Core Processor (Haswell) (fam: 06, model: 
3c, stepping: 01)
[    0.024177] TSC deadline timer enabled
[    0.024199] Performance Events: unsupported p6 CPU model 60 no PMU driver, 
software events only.
[    0.024717] NMI watchdog: disabled (cpu0): hardware events not enabled
[    0.024773] x86: Booting SMP configuration:
[    0.024774] .... node  #0, CPUs:      #1
[    0.008000] kvm-clock: cpu 1, msr 2:7fff5041, secondary cpu clock
[    0.040017] KVM setup async PF for cpu 1
[    0.040024] kvm-stealtime: cpu 1, msr 27fc8e100
[    0.040095]  #2
[    0.008000] kvm-clock: cpu 2, msr 2:7fff5081, secondary cpu clock
[    0.056003] KVM setup async PF for cpu 2
[    0.056003] kvm-stealtime: cpu 2, msr 27fd0e100
[    0.056090]  #3
[    0.008000] kvm-clock: cpu 3, msr 2:7fff50c1, secondary cpu clock
[    0.072034] x86: Booted up 1 node, 4 CPUs
[    0.072024] KVM setup async PF for cpu 3
[    0.072024] kvm-stealtime: cpu 3, msr 27fd8e100
[    0.072045] smpboot: Total of 4 processors activated (27999.96 BogoMIPS)
[    0.073074] devtmpfs: initialized
[    0.074661] evm: security.selinux
[    0.074664] evm: security.SMACK64
[    0.074665] evm: security.SMACK64EXEC
[    0.074667] evm: security.SMACK64TRANSMUTE
[    0.074668] evm: security.SMACK64MMAP
[    0.074670] evm: security.ima
[    0.074671] evm: security.capability
[    0.076070] pinctrl core: initialized pinctrl subsystem
[    0.076173] RTC time: 14:18:35, date: 12/29/15
[    0.077099] NET: Registered protocol family 16
[    0.080021] cpuidle: using governor ladder
[    0.084007] cpuidle: using governor menu
[    0.084102] ACPI: bus type PCI registered
[    0.084104] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5
[    0.084203] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 
0xb0000000-0xbfffffff] (base 0xb0000000)
[    0.084206] PCI: MMCONFIG at [mem 0xb0000000-0xbfffffff] reserved in E820
[    0.084408] PCI: Using configuration type 1 for base access
[    0.088079] ACPI: Added _OSI(Module Device)
[    0.088081] ACPI: Added _OSI(Processor Device)
[    0.088082] ACPI: Added _OSI(3.0 _SCP Extensions)
[    0.088083] ACPI: Added _OSI(Processor Aggregator Device)
[    0.089569] ACPI: Interpreter enabled
[    0.089578] ACPI Exception: AE_NOT_FOUND, While evaluating Sleep State 
[\_S1_] (20141107/hwxface-580)
[    0.089581] ACPI Exception: AE_NOT_FOUND, While evaluating Sleep State 
[\_S2_] (20141107/hwxface-580)
[    0.089589] ACPI: (supports S0 S3 S4 S5)
[    0.089591] ACPI: Using IOAPIC for interrupt routing
[    0.089610] PCI: Using host bridge windows from ACPI; if necessary, use 
"pci=nocrs" and report a bug
[    0.090621] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])
[    0.090625] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM 
ClockPM Segments MSI]
[    0.090681] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME AER 
PCIeCapability]
[    0.090751] PCI host bridge to bus 0000:00
[    0.090753] pci_bus 0000:00: root bus resource [bus 00-ff]
[    0.090754] pci_bus 0000:00: root bus resource [io  0x0000-0x0cd7]
[    0.090756] pci_bus 0000:00: root bus resource [io  0x0d00-0xffff]
[    0.090757] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff]
[    0.090759] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff]
[    0.090775] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000
[    0.090944] pci 0000:00:02.0: [8086:244e] type 01 class 0x060401
[    0.093800] pci 0000:00:1a.0: [8086:3420] type 01 class 0x060400
[    0.116293] pci 0000:00:1b.0: [8086:3420] type 01 class 0x060400
[    0.140304] pci 0000:00:1c.0: [8086:3420] type 01 class 0x060400
[    0.164286] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100
[    0.164454] pci 0000:00:1f.0: quirk: [io  0xb000-0xb07f] claimed by ICH6 
ACPI/GPIO/TCO
[    0.164546] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601
[    0.172009] pci 0000:00:1f.2: reg 0x20: [io  0x10040-0x1005f]
[    0.173893] pci 0000:00:1f.2: reg 0x24: [mem 0xfea00000-0xfea00fff]
[    0.175708] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500
[    0.179839] pci 0000:00:1f.3: reg 0x20: [io  0xb100-0xb13f]
[    0.181964] pci 0000:01:01.0: [1b36:0001] type 01 class 0x060400
[    0.183765] pci 0000:01:01.0: reg 0x10: [mem 0xfe200000-0xfe2000ff 64bit]
[    0.185128] pci 0000:00:02.0: PCI bridge to [bus 01-02] (subtractive 
decode)
[    0.185139] pci 0000:00:02.0:   bridge window [io  0xf000-0xffff]
[    0.185147] pci 0000:00:02.0:   bridge window [mem 0xfe000000-0xfe3fffff]
[    0.185160] pci 0000:00:02.0:   bridge window [io  0x0000-0x0cd7] 
(subtractive decode)
[    0.185161] pci 0000:00:02.0:   bridge window [io  0x0d00-0xffff] 
(subtractive decode)
[    0.185162] pci 0000:00:02.0:   bridge window [mem 0x000a0000-0x000bffff] 
(subtractive decode)
[    0.185163] pci 0000:00:02.0:   bridge window [mem 0xc0000000-0xfebfffff] 
(subtractive decode)
[    0.185723] pci 0000:02:01.0: [8086:2934] type 00 class 0x0c0300
[    0.189692] pci 0000:02:01.0: reg 0x20: [io  0xf040-0xf05f]
[    0.191420] pci 0000:02:01.1: [8086:293a] type 00 class 0x0c0320
[    0.192003] pci 0000:02:01.1: reg 0x10: [mem 0xfe040000-0xfe040fff]
[    0.196897] pci 0000:02:02.0: [1af4:1001] type 00 class 0x010000
[    0.198559] pci 0000:02:02.0: reg 0x10: [io  0xf000-0xf03f]
[    0.200003] pci 0000:02:02.0: reg 0x14: [mem 0xfe041000-0xfe041fff]
[    0.209521] pci 0000:02:03.0: [1af4:1000] type 00 class 0x020000
[    0.212012] pci 0000:02:03.0: reg 0x10: [io  0xf060-0xf07f]
[    0.214579] pci 0000:02:03.0: reg 0x14: [mem 0xfe042000-0xfe042fff]
[    0.223282] pci 0000:02:03.0: reg 0x30: [mem 0xfe000000-0xfe03ffff pref]
[    0.223431] pci 0000:02:04.0: [1af4:1002] type 00 class 0x00ff00
[    0.224003] pci 0000:02:04.0: reg 0x10: [io  0xf080-0xf09f]
[    0.228976] pci 0000:01:01.0: PCI bridge to [bus 02]
[    0.228987] pci 0000:01:01.0:   bridge window [io  0xf000-0xffff]
[    0.228994] pci 0000:01:01.0:   bridge window [mem 0xfe000000-0xfe1fffff]
[    0.231252] pci 0000:03:00.0: [1002:6719] type 00 class 0x030000
[    0.236011] pci 0000:03:00.0: reg 0x10: [mem 0xe0000000-0xefffffff 64bit 
pref]
[    0.244018] pci 0000:03:00.0: reg 0x18: [mem 0xfe800000-0xfe81ffff 64bit]
[    0.252012] pci 0000:03:00.0: reg 0x20: [io  0xe000-0xe0ff]
[    0.268013] pci 0000:03:00.0: reg 0x30: [mem 0xfe820000-0xfe83ffff pref]
[    0.268180] pci 0000:03:00.0: supports D1 D2
[    0.268284] pci 0000:03:00.1: [1002:aa80] type 00 class 0x040300
[    0.269230] pci 0000:03:00.1: reg 0x10: [mem 0xfe840000-0xfe843fff 64bit]
[    0.273946] pci 0000:03:00.1: supports D1 D2
[    0.274089] pci 0000:00:1a.0: PCI bridge to [bus 03]
[    0.274098] pci 0000:00:1a.0:   bridge window [io  0xe000-0xefff]
[    0.274105] pci 0000:00:1a.0:   bridge window [mem 0xfe800000-0xfe9fffff]
[    0.274117] pci 0000:00:1a.0:   bridge window [mem 0xe0000000-0xefffffff 
64bit pref]
[    0.275148] pci 0000:04:00.0: [1002:6719] type 00 class 0x030000
[    0.280017] pci 0000:04:00.0: reg 0x10: [mem 0xd0000000-0xdfffffff 64bit 
pref]
[    0.288016] pci 0000:04:00.0: reg 0x18: [mem 0xfe600000-0xfe61ffff 64bit]
[    0.296014] pci 0000:04:00.0: reg 0x20: [io  0xd000-0xd0ff]
[    0.312015] pci 0000:04:00.0: reg 0x30: [mem 0xfe620000-0xfe63ffff pref]
[    0.312211] pci 0000:04:00.0: supports D1 D2
[    0.312324] pci 0000:04:00.1: [1002:aa80] type 00 class 0x040300
[    0.313282] pci 0000:04:00.1: reg 0x10: [mem 0xfe640000-0xfe643fff 64bit]
[    0.317539] pci 0000:04:00.1: supports D1 D2
[    0.317697] pci 0000:00:1b.0: PCI bridge to [bus 04]
[    0.317708] pci 0000:00:1b.0:   bridge window [io  0xd000-0xdfff]
[    0.317715] pci 0000:00:1b.0:   bridge window [mem 0xfe600000-0xfe7fffff]
[    0.317728] pci 0000:00:1b.0:   bridge window [mem 0xd0000000-0xdfffffff 
64bit pref]
[    0.318721] pci 0000:05:00.0: [1002:671d] type 00 class 0x030000
[    0.324013] pci 0000:05:00.0: reg 0x10: [mem 0xc0000000-0xcfffffff 64bit 
pref]
[    0.332013] pci 0000:05:00.0: reg 0x18: [mem 0xfe400000-0xfe41ffff 64bit]
[    0.340012] pci 0000:05:00.0: reg 0x20: [io  0xc000-0xc0ff]
[    0.356211] pci 0000:05:00.0: supports D1 D2
[    0.356329] pci 0000:05:00.1: [1002:aa80] type 00 class 0x040300
[    0.357304] pci 0000:05:00.1: reg 0x10: [mem 0xfe420000-0xfe423fff 64bit]
[    0.362123] pci 0000:05:00.1: supports D1 D2
[    0.362293] pci 0000:00:1c.0: PCI bridge to [bus 05]
[    0.362304] pci 0000:00:1c.0:   bridge window [io  0xc000-0xcfff]
[    0.362312] pci 0000:00:1c.0:   bridge window [mem 0xfe400000-0xfe5fffff]
[    0.362325] pci 0000:00:1c.0:   bridge window [mem 0xc0000000-0xcfffffff 
64bit pref]
[    0.366374] ACPI: PCI Interrupt Link [LNKA] (IRQs 5 *10 11)
[    0.366530] ACPI: PCI Interrupt Link [LNKB] (IRQs 5 *10 11)
[    0.366646] ACPI: PCI Interrupt Link [LNKC] (IRQs 5 10 *11)
[    0.366685] ACPI: PCI Interrupt Link [LNKD] (IRQs 5 10 *11)
[    0.366721] ACPI: PCI Interrupt Link [LNKE] (IRQs 5 *10 11)
[    0.366758] ACPI: PCI Interrupt Link [LNKF] (IRQs 5 *10 11)
[    0.366794] ACPI: PCI Interrupt Link [LNKG] (IRQs 5 10 *11)
[    0.366831] ACPI: PCI Interrupt Link [LNKH] (IRQs 5 10 *11)
[    0.366847] ACPI: PCI Interrupt Link [GSIA] (IRQs *16)
[    0.366852] ACPI: PCI Interrupt Link [GSIB] (IRQs *17)
[    0.366857] ACPI: PCI Interrupt Link [GSIC] (IRQs *18)
[    0.366862] ACPI: PCI Interrupt Link [GSID] (IRQs *19)
[    0.366866] ACPI: PCI Interrupt Link [GSIE] (IRQs *20)
[    0.366870] ACPI: PCI Interrupt Link [GSIF] (IRQs *21)
[    0.366874] ACPI: PCI Interrupt Link [GSIG] (IRQs *22)
[    0.366878] ACPI: PCI Interrupt Link [GSIH] (IRQs *23)
[    0.367104] ACPI: Enabled 16 GPEs in block 00 to 3F
[    0.367171] vgaarb: setting as boot device: PCI:0000:03:00.0
[    0.367171] vgaarb: device added: 
PCI:0000:03:00.0,decodes=io+mem,owns=io+mem,locks=none
[    0.367171] vgaarb: device added: 
PCI:0000:04:00.0,decodes=io+mem,owns=none,locks=none
[    0.367171] vgaarb: device added: 
PCI:0000:05:00.0,decodes=io+mem,owns=none,locks=none
[    0.367171] vgaarb: loaded
[    0.367171] vgaarb: bridge control possible 0000:05:00.0
[    0.367171] vgaarb: bridge control possible 0000:04:00.0
[    0.367171] vgaarb: bridge control possible 0000:03:00.0
[    0.367171] SCSI subsystem initialized
[    0.367181] libata version 3.00 loaded.
[    0.367181] ACPI: bus type USB registered
[    0.367181] usbcore: registered new interface driver usbfs
[    0.367181] usbcore: registered new interface driver hub
[    0.367181] usbcore: registered new device driver usb
[    0.367181] PCI: Using ACPI for IRQ routing
[    0.397802] PCI: pci_cache_line_size set to 64 bytes
[    0.397891] pci 0000:00:1f.2: can't claim BAR 4 [io  0x10040-0x1005f]: no 
compatible bridge window
[    0.397969] e820: reserve RAM buffer [mem 0x0009fc00-0x0009ffff]
[    0.397971] e820: reserve RAM buffer [mem 0x7fffb000-0x7fffffff]
[    0.398057] NetLabel: Initializing
[    0.398058] NetLabel:  domain hash size = 128
[    0.398059] NetLabel:  protocols = UNLABELED CIPSOv4
[    0.398067] NetLabel:  unlabeled traffic allowed by default
[    0.398125] HPET: 3 timers in total, 0 timers will be used for per-cpu 
timer
[    0.398135] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0
[    0.398138] hpet0: 3 comparators, 64-bit 100.000000 MHz counter
[    0.401910] Switched to clocksource kvm-clock
[    0.406613] AppArmor: AppArmor Filesystem Enabled
[    0.406683] pnp: PnP ACPI init
[    0.406762] pnp 00:00: Plug and Play ACPI device, IDs PNP0b00 (active)
[    0.406808] pnp 00:01: Plug and Play ACPI device, IDs PNP0303 (active)
[    0.406843] pnp 00:02: Plug and Play ACPI device, IDs PNP0f13 (active)
[    0.407101] pnp: PnP ACPI: found 3 devices
[    0.662950] pci 0000:00:1f.2: BAR 4: assigned [io  0x1000-0x101f]
[    0.663805] pci 0000:01:01.0: PCI bridge to [bus 02]
[    0.663813] pci 0000:01:01.0:   bridge window [io  0xf000-0xffff]
[    0.665100] pci 0000:01:01.0:   bridge window [mem 0xfe000000-0xfe1fffff]
[    0.667796] pci 0000:00:02.0: PCI bridge to [bus 01-02]
[    0.667803] pci 0000:00:02.0:   bridge window [io  0xf000-0xffff]
[    0.669067] pci 0000:00:02.0:   bridge window [mem 0xfe000000-0xfe3fffff]
[    0.671712] pci 0000:00:1a.0: PCI bridge to [bus 03]
[    0.671726] pci 0000:00:1a.0:   bridge window [io  0xe000-0xefff]
[    0.672982] pci 0000:00:1a.0:   bridge window [mem 0xfe800000-0xfe9fffff]
[    0.673807] pci 0000:00:1a.0:   bridge window [mem 0xe0000000-0xefffffff 
64bit pref]
[    0.675444] pci 0000:00:1b.0: PCI bridge to [bus 04]
[    0.675451] pci 0000:00:1b.0:   bridge window [io  0xd000-0xdfff]
[    0.676683] pci 0000:00:1b.0:   bridge window [mem 0xfe600000-0xfe7fffff]
[    0.677500] pci 0000:00:1b.0:   bridge window [mem 0xd0000000-0xdfffffff 
64bit pref]
[    0.679172] pci 0000:00:1c.0: PCI bridge to [bus 05]
[    0.679181] pci 0000:00:1c.0:   bridge window [io  0xc000-0xcfff]
[    0.680501] pci 0000:00:1c.0:   bridge window [mem 0xfe400000-0xfe5fffff]
[    0.681341] pci 0000:00:1c.0:   bridge window [mem 0xc0000000-0xcfffffff 
64bit pref]
[    0.683018] pci_bus 0000:00: resource 4 [io  0x0000-0x0cd7]
[    0.683019] pci_bus 0000:00: resource 5 [io  0x0d00-0xffff]
[    0.683020] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff]
[    0.683021] pci_bus 0000:00: resource 7 [mem 0xc0000000-0xfebfffff]
[    0.683022] pci_bus 0000:01: resource 0 [io  0xf000-0xffff]
[    0.683023] pci_bus 0000:01: resource 1 [mem 0xfe000000-0xfe3fffff]
[    0.683024] pci_bus 0000:01: resource 4 [io  0x0000-0x0cd7]
[    0.683025] pci_bus 0000:01: resource 5 [io  0x0d00-0xffff]
[    0.683026] pci_bus 0000:01: resource 6 [mem 0x000a0000-0x000bffff]
[    0.683027] pci_bus 0000:01: resource 7 [mem 0xc0000000-0xfebfffff]
[    0.683028] pci_bus 0000:02: resource 0 [io  0xf000-0xffff]
[    0.683029] pci_bus 0000:02: resource 1 [mem 0xfe000000-0xfe1fffff]
[    0.683031] pci_bus 0000:03: resource 0 [io  0xe000-0xefff]
[    0.683032] pci_bus 0000:03: resource 1 [mem 0xfe800000-0xfe9fffff]
[    0.683033] pci_bus 0000:03: resource 2 [mem 0xe0000000-0xefffffff 64bit 
pref]
[    0.683034] pci_bus 0000:04: resource 0 [io  0xd000-0xdfff]
[    0.683035] pci_bus 0000:04: resource 1 [mem 0xfe600000-0xfe7fffff]
[    0.683036] pci_bus 0000:04: resource 2 [mem 0xd0000000-0xdfffffff 64bit 
pref]
[    0.683037] pci_bus 0000:05: resource 0 [io  0xc000-0xcfff]
[    0.683038] pci_bus 0000:05: resource 1 [mem 0xfe400000-0xfe5fffff]
[    0.683039] pci_bus 0000:05: resource 2 [mem 0xc0000000-0xcfffffff 64bit 
pref]
[    0.683072] NET: Registered protocol family 2
[    0.683199] TCP established hash table entries: 65536 (order: 7, 524288 
bytes)
[    0.683292] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes)
[    0.683366] TCP: Hash tables configured (established 65536 bind 65536)
[    0.683381] TCP: reno registered
[    0.683389] UDP hash table entries: 4096 (order: 5, 131072 bytes)
[    0.683405] UDP-Lite hash table entries: 4096 (order: 5, 131072 bytes)
[    0.683439] NET: Registered protocol family 1
[    0.684776] ACPI: PCI Interrupt Link [GSIH] enabled at IRQ 23
[    0.686298] ACPI: PCI Interrupt Link [GSIE] enabled at IRQ 20
[    0.687349] pci 0000:03:00.0: Video device with shadowed ROM
[    0.687390] PCI: CLS 64 bytes, default 64
[    0.687433] Trying to unpack rootfs image as initramfs...
[    0.882459] Freeing initrd memory: 19468K (ffff8800359ea000 - 
ffff880036ced000)
[    0.882477] PCI-DMA: Using software bounce buffering for IO (SWIOTLB)
[    0.882481] software IO TLB [mem 0x7bffb000-0x7fffb000] (64MB) mapped at 
[ffff88007bffb000-ffff88007fffafff]
[    0.882788] microcode: CPU0 sig=0x306c1, pf=0x1, revision=0x1
[    0.882803] microcode: CPU1 sig=0x306c1, pf=0x1, revision=0x1
[    0.882816] microcode: CPU2 sig=0x306c1, pf=0x1, revision=0x1
[    0.882829] microcode: CPU3 sig=0x306c1, pf=0x1, revision=0x1
[    0.882892] microcode: Microcode Update Driver: v2.00 
<tigran at aivazian.fsnet.co.uk>, Peter Oruba
[    0.882923] Scanning for low memory corruption every 60 seconds
[    0.883232] futex hash table entries: 1024 (order: 4, 65536 bytes)
[    0.883247] Initialise system trusted keyring
[    0.883270] audit: initializing netlink subsys (disabled)
[    0.883283] audit: type=2000 audit(1451398716.186:1): initialized
[    0.883507] HugeTLB registered 2 MB page size, pre-allocated 0 pages
[    0.884976] zpool: loaded
[    0.884981] zbud: loaded
[    0.885205] VFS: Disk quotas dquot_6.5.2
[    0.885242] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
[    0.885676] fuse init (API version 7.23)
[    0.885796] Key type big_key registered
[    0.886152] Key type asymmetric registered
[    0.886155] Asymmetric key parser 'x509' registered
[    0.886180] Block layer SCSI generic (bsg) driver version 0.4 loaded 
(major 252)
[    0.886216] io scheduler noop registered
[    0.886219] io scheduler deadline registered (default)
[    0.886237] io scheduler cfq registered
[    0.894085] aer 0000:00:1a.0:pcie02: service driver aer loaded
[    0.894145] aer 0000:00:1b.0:pcie02: service driver aer loaded
[    0.894206] aer 0000:00:1c.0:pcie02: service driver aer loaded
[    0.894229] pcieport 0000:00:1a.0: Signaling PME through PCIe PME 
interrupt
[    0.894232] pci 0000:03:00.0: Signaling PME through PCIe PME interrupt
[    0.894233] pci 0000:03:00.1: Signaling PME through PCIe PME interrupt
[    0.894241] pcie_pme 0000:00:1a.0:pcie01: service driver pcie_pme loaded
[    0.894256] pcieport 0000:00:1b.0: Signaling PME through PCIe PME 
interrupt
[    0.894257] pci 0000:04:00.0: Signaling PME through PCIe PME interrupt
[    0.894258] pci 0000:04:00.1: Signaling PME through PCIe PME interrupt
[    0.894266] pcie_pme 0000:00:1b.0:pcie01: service driver pcie_pme loaded
[    0.894280] pcieport 0000:00:1c.0: Signaling PME through PCIe PME 
interrupt
[    0.894282] pci 0000:05:00.0: Signaling PME through PCIe PME interrupt
[    0.894283] pci 0000:05:00.1: Signaling PME through PCIe PME interrupt
[    0.894290] pcie_pme 0000:00:1c.0:pcie01: service driver pcie_pme loaded
[    0.894294] pci_hotplug: PCI Hot Plug PCI Core version: 0.5
[    0.894331] pciehp 0000:00:1a.0:pcie04: Slot #0 AttnBtn+ AttnInd+ PwrInd+ 
PwrCtrl- MRL- Interlock+ NoCompl- LLActRep-
[    0.894391] pciehp 0000:00:1a.0:pcie04: service driver pciehp loaded
[    0.894431] pciehp 0000:00:1b.0:pcie04: Slot #0 AttnBtn+ AttnInd+ PwrInd+ 
PwrCtrl- MRL- Interlock+ NoCompl- LLActRep-
[    0.894499] pciehp 0000:00:1b.0:pcie04: service driver pciehp loaded
[    0.894529] pciehp 0000:00:1c.0:pcie04: Slot #0 AttnBtn+ AttnInd+ PwrInd+ 
PwrCtrl- MRL- Interlock+ NoCompl- LLActRep-
[    0.894597] pciehp 0000:00:1c.0:pcie04: service driver pciehp loaded
[    0.894602] pciehp: PCI Express Hot Plug Controller Driver version: 0.4
[    0.894631] vesafb: mode is 640x480x32, linelength=2560, pages=0
[    0.894632] vesafb: scrolling: redraw
[    0.894633] vesafb: Truecolor: size=0:8:8:8, shift=0:16:8:0
[    0.896859] vesafb: framebuffer at 0xe0000000, mapped to 
0xffffc90010e80000, using 1216k, total 1216k
[    0.897840] Console: switching to colour frame buffer device 80x30
[    0.898679] fb0: VESA VGA frame buffer device
[    0.898714] intel_idle: does not run on family 6 model 60
[    0.898751] input: Power Button as 
/devices/LNXSYSTM:00/LNXPWRBN:00/input/input0
[    0.898783] ACPI: Power Button [PWRF]
[    0.898971] GHES: HEST is not enabled!
[    0.899751] ACPI: PCI Interrupt Link [GSIF] enabled at IRQ 21
[    0.903531] ACPI: PCI Interrupt Link [GSIG] enabled at IRQ 22
[    0.908051] Serial: 8250/16550 driver, 32 ports, IRQ sharing enabled
[    0.909766] Linux agpgart interface v0.103
[    0.910998] brd: module loaded
[    0.911863] loop: module loaded
[    0.914210]  vda: vda1
[    0.914940] libphy: Fixed MDIO Bus: probed
[    0.915494] tun: Universal TUN/TAP device driver, 1.6
[    0.916054] tun: (C) 1999-2004 Max Krasnyansky <maxk at qualcomm.com>
[    0.919473] PPP generic driver version 2.4.2
[    0.920089] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
[    0.920674] ehci-pci: EHCI PCI platform driver
[    0.922779] ehci-pci 0000:02:01.1: EHCI Host Controller
[    0.923334] ehci-pci 0000:02:01.1: new USB bus registered, assigned bus 
number 1
[    0.924475] ehci-pci 0000:02:01.1: irq 23, io mem 0xfe040000
[    0.936053] ehci-pci 0000:02:01.1: USB 2.0 started, EHCI 1.00
[    0.936698] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002
[    0.937272] usb usb1: New USB device strings: Mfr=3, Product=2, 
SerialNumber=1
[    0.938419] usb usb1: Product: EHCI Host Controller
[    0.938994] usb usb1: Manufacturer: Linux 3.19.0-42-generic ehci_hcd
[    0.939562] usb usb1: SerialNumber: 0000:02:01.1
[    0.940284] hub 1-0:1.0: USB hub found
[    0.940841] hub 1-0:1.0: 6 ports detected
[    0.941555] ehci-platform: EHCI generic platform driver
[    0.942094] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver
[    0.942634] ohci-pci: OHCI PCI platform driver
[    0.943184] ohci-platform: OHCI generic platform driver
[    0.943729] uhci_hcd: USB Universal Host Controller Interface driver
[    0.946734] uhci_hcd 0000:02:01.0: UHCI Host Controller
[    0.947254] uhci_hcd 0000:02:01.0: new USB bus registered, assigned bus 
number 2
[    0.948287] uhci_hcd 0000:02:01.0: detected 2 ports
[    0.948888] uhci_hcd 0000:02:01.0: irq 20, io base 0x0000f040
[    0.949488] usb usb2: New USB device found, idVendor=1d6b, idProduct=0001
[    0.950040] usb usb2: New USB device strings: Mfr=3, Product=2, 
SerialNumber=1
[    0.951117] usb usb2: Product: UHCI Host Controller
[    0.951665] usb usb2: Manufacturer: Linux 3.19.0-42-generic uhci_hcd
[    0.952225] usb usb2: SerialNumber: 0000:02:01.0
[    0.952889] hub 2-0:1.0: USB hub found
[    0.953427] hub 2-0:1.0: 2 ports detected
[    0.954135] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 
0x60,0x64 irq 1,12
[    0.955732] serio: i8042 KBD port at 0x60,0x64 irq 1
[    0.956291] serio: i8042 AUX port at 0x60,0x64 irq 12
[    0.957016] mousedev: PS/2 mouse device common for all mice
[    0.957927] input: AT Translated Set 2 keyboard as 
/devices/platform/i8042/serio0/input/input1
[    0.959333] rtc_cmos 00:00: RTC can wake from S4
[    0.960154] rtc_cmos 00:00: rtc core: registered rtc_cmos as rtc0
[    0.960864] rtc_cmos 00:00: alarms up to one day, 114 bytes nvram, hpet 
irqs
[    0.961459] i2c /dev entries driver
[    0.962095] device-mapper: uevent: version 1.0.3
[    0.962756] device-mapper: ioctl: 4.29.0-ioctl (2014-10-28) initialised: 
dm-devel at redhat.com
[    0.963834] ledtrig-cpu: registered to indicate activity on CPUs
[    0.964594] PCCT header not found.
[    0.965133] ACPI PCC probe failed.
[    0.965723] TCP: cubic registered
[    0.966309] NET: Registered protocol family 10
[    0.967025] NET: Registered protocol family 17
[    0.967536] Key type dns_resolver registered
[    0.968351] Loading compiled-in X.509 certificates
[    0.969351] Loaded X.509 cert 'Magrathea: Glacier signing key: 
759bcd6455a9dfaba6111485d04eded53ab83150'
[    0.970380] registered taskstats version 1
[    0.971992] Key type trusted registered
[    0.974597] Key type encrypted registered
[    0.975098] AppArmor: AppArmor sha1 policy hashing enabled
[    0.975599] ima: No TPM chip found, activating TPM-bypass!
[    0.976152] evm: HMAC attrs: 0x1
[    0.977274]   Magic number: 11:971:334
[    0.977774] tty tty55: hash matches
[    0.978315] rtc_cmos 00:00: setting system clock to 2015-12-29 14:18:38 
UTC (1451398718)
[    0.979361] BIOS EDD facility v0.16 2004-Jun-25, 0 devices found
[    0.979866] EDD information not available.
[    0.980409] PM: Hibernation image not present or could not be loaded.
[    0.980628] Freeing unused kernel memory: 1408K (ffffffff81d27000 - 
ffffffff81e87000)
[    0.981629] Write protecting the kernel read-only data: 12288k
[    0.982317] Freeing unused kernel memory: 256K (ffff8800017c0000 - 
ffff880001800000)
[    0.983430] Freeing unused kernel memory: 340K (ffff880001bab000 - 
ffff880001c00000)
[    0.991950] systemd-udevd[119]: starting version 204
[    0.998975] ahci 0000:00:1f.2: version 3.0
[    0.999168] ACPI: PCI Interrupt Link [GSIA] enabled at IRQ 16
[    0.999951] ahci 0000:00:1f.2: AHCI 0001.0000 32 slots 6 ports 1.5 Gbps 
0x3f impl SATA mode
[    1.001061] ahci 0000:00:1f.2: flags: ncq only
[    1.004041] scsi host0: ahci
[    1.004708] scsi host1: ahci
[    1.005339] scsi host2: ahci
[    1.008163] scsi host3: ahci
[    1.008765] scsi host4: ahci
[    1.009348] scsi host5: ahci
[    1.009897] ata1: SATA max UDMA/133 abar m4096 at 0xfea00000 port 0xfea00100 
irq 32
[    1.010974] ata2: SATA max UDMA/133 abar m4096 at 0xfea00000 port 0xfea00180 
irq 32
[    1.012100] ata3: SATA max UDMA/133 abar m4096 at 0xfea00000 port 0xfea00200 
irq 32
[    1.012104] ata4: SATA max UDMA/133 abar m4096 at 0xfea00000 port 0xfea00280 
irq 32
[    1.012106] ata5: SATA max UDMA/133 abar m4096 at 0xfea00000 port 0xfea00300 
irq 32
[    1.012109] ata6: SATA max UDMA/133 abar m4096 at 0xfea00000 port 0xfea00380 
irq 32
[    1.020398] FDC 0 is a S82078B
[    1.039681] EXT4-fs (vda1): INFO: recovery required on readonly filesystem
[    1.040287] EXT4-fs (vda1): write access will be enabled during recovery
[    1.091581] EXT4-fs (vda1): recovery complete
[    1.093156] EXT4-fs (vda1): mounted filesystem with ordered data mode. 
Opts: (null)
[    1.332073] ata1: SATA link up 1.5 Gbps (SStatus 113 SControl 300)
[    1.333325] ata1.00: ATAPI: QEMU DVD-ROM, 2.0.0, max UDMA/100
[    1.333944] ata1.00: applying bridge limits
[    1.334596] ata1.00: configured for UDMA/100
[    1.335422] scsi 0:0:0:0: CD-ROM            QEMU     QEMU DVD-ROM     2.0. 
PQ: 0 ANSI: 5
[    1.336070] ata5: SATA link down (SStatus 0 SControl 300)
[    1.336129] ata3: SATA link down (SStatus 0 SControl 300)
[    1.337059] ata4: SATA link down (SStatus 0 SControl 300)
[    1.342839] ata6: SATA link down (SStatus 0 SControl 300)
[    1.343482] ata2: SATA link down (SStatus 0 SControl 300)
[    1.348245] sr 0:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray
[    1.348799] cdrom: Uniform CD-ROM driver Revision: 3.20
[    1.349434] sr 0:0:0:0: Attached scsi CD-ROM sr0
[    1.349534] sr 0:0:0:0: Attached scsi generic sg0 type 5
[    1.376989] random: init urandom read with 14 bits of entropy available
[    1.386559] init: plymouth-upstart-bridge main process (192) terminated 
with status 1
[    1.387644] init: plymouth-upstart-bridge main process ended, respawning
[    1.393186] init: plymouth-upstart-bridge main process (202) terminated 
with status 1
[    1.394338] init: plymouth-upstart-bridge main process ended, respawning
[    1.438051] EXT4-fs (vda1): re-mounted. Opts: errors=remount-ro
[    1.503855] systemd-udevd[341]: starting version 204
[    1.547219] lp: driver loaded but no devices found
[    1.569731] acpi PNP0A08:00: _OSC: platform does not support [SHPCHotplug]
[    1.569816] acpi PNP0A08:00: _OSC: not requesting control; platform does 
not support [SHPCHotplug]
[    1.570123] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4
[    1.638089] AMD IOMMUv2 driver by Joerg Roedel <joerg.roedel at amd.com>
[    1.638091] AMD IOMMUv2 functionality not available on this system
[    1.653428] lpc_ich 0000:00:1f.0: RCBA is disabled by hardware/BIOS, 
device disabled
[    1.653444] lpc_ich 0000:00:1f.0: I/O space for GPIO uninitialized
[    1.653445] lpc_ich 0000:00:1f.0: No MFD cells added
[    1.654504] fglrx: module license 'Proprietary. (C) 2002 - ATI 
Technologies, Starnberg, GERMANY' taints kernel.
[    1.654507] Disabling lock debugging due to kernel taint
[    1.656763] ACPI: PCI Interrupt Link [GSIB] enabled at IRQ 17
[    1.656824] snd_hda_intel 0000:03:00.1: Handle VGA-switcheroo audio client
[    1.658319] fglrx: module verification failed: signature and/or  required 
key missing - tainting kernel
[    1.659439] snd_hda_intel 0000:04:00.1: Handle VGA-switcheroo audio client
[    1.659624] snd_hda_intel 0000:05:00.1: Handle VGA-switcheroo audio client
[    1.671394] input: HDA ATI HDMI HDMI/DP,pcm=3 as 
/devices/pci0000:00/0000:00:1a.0/0000:03:00.1/sound/card0/input4
[    1.677191] input: HDA ATI HDMI HDMI/DP,pcm=3 as 
/devices/pci0000:00/0000:00:1b.0/0000:04:00.1/sound/card1/input5
[    1.679729] input: HDA ATI HDMI HDMI/DP,pcm=3 as 
/devices/pci0000:00/0000:00:1c.0/0000:05:00.1/sound/card2/input6
[    1.682910] audit: type=1400 audit(1451398719.197:2): apparmor="STATUS" 
operation="profile_load" profile="unconfined" name="/sbin/dhclient" pid=454 
comm="apparmor_parser"
[    1.682917] audit: type=1400 audit(1451398719.197:3): apparmor="STATUS" 
operation="profile_load" profile="unconfined" 
name="/usr/lib/NetworkManager/nm-dhcp-client.action" pid=454 
comm="apparmor_parser"
[    1.682921] audit: type=1400 audit(1451398719.197:4): apparmor="STATUS" 
operation="profile_load" profile="unconfined" 
name="/usr/lib/connman/scripts/dhclient-script" pid=454 
comm="apparmor_parser"
[    1.683254] audit: type=1400 audit(1451398719.197:5): apparmor="STATUS" 
operation="profile_replace" profile="unconfined" 
name="/usr/lib/NetworkManager/nm-dhcp-client.action" pid=454 
comm="apparmor_parser"
[    1.683258] audit: type=1400 audit(1451398719.197:6): apparmor="STATUS" 
operation="profile_replace" profile="unconfined" 
name="/usr/lib/connman/scripts/dhclient-script" pid=454 
comm="apparmor_parser"
[    1.683437] audit: type=1400 audit(1451398719.197:7): apparmor="STATUS" 
operation="profile_replace" profile="unconfined" 
name="/usr/lib/connman/scripts/dhclient-script" pid=454 
comm="apparmor_parser"
[    1.692326] <6>[fglrx] Maximum main memory to use for locked dma buffers: 
7751 MBytes.
[    1.692433] <6>[fglrx]   vendor: 1002 device: 6719 revision: 0 count: 1
[    1.692436] <6>[fglrx]   vendor: 1002 device: 6719 revision: 0 count: 2
[    1.692438] <6>[fglrx]   vendor: 1002 device: 671d revision: 0 count: 3
[    1.692680] <6>[fglrx] ioport: bar 4, base 0xe000, size: 0x100
[    1.696676] <6>[fglrx] ioport: bar 4, base 0xd000, size: 0x100
[    1.700106] <6>[fglrx] ioport: bar 4, base 0xc000, size: 0x100
[    1.708631] <6>[fglrx] Kernel PAT support is enabled
[    1.710157] <6>[fglrx] module loaded - fglrx 15.20.3 [Sep  8 2015] with 3 
minors
[    1.711934] AVX2 version of gcm_enc/dec engaged.
[    1.711935] AES CTR mode by8 optimization enabled
[    1.751973] ppdev: user-space parallel port driver
[    1.815585] intel_rapl: no valid rapl domains found in package 0
[    1.864289] intel_rapl: no valid rapl domains found in package 0
[    1.880039] tsc: Refined TSC clocksource calibration: 3499.994 MHz
[    1.906089] init: failsafe main process (535) killed by TERM signal
[    2.003472] audit: type=1400 audit(1451398719.517:8): apparmor="STATUS" 
operation="profile_load" profile="unconfined" name="/usr/sbin/tcpdump" 
pid=837 comm="apparmor_parser"
[    2.003873] audit: type=1400 audit(1451398719.517:9): apparmor="STATUS" 
operation="profile_replace" profile="unconfined" name="/sbin/dhclient" 
pid=835 comm="apparmor_parser"
[    2.003880] audit: type=1400 audit(1451398719.517:10): apparmor="STATUS" 
operation="profile_replace" profile="unconfined" 
name="/usr/lib/NetworkManager/nm-dhcp-client.action" pid=835 
comm="apparmor_parser"
[    2.040787] input: ImExPS/2 Generic Explorer Mouse as 
/devices/platform/i8042/serio1/input/input3
[    2.119676] ip_tables: (C) 2000-2006 Netfilter Core Team
[    2.124628] nf_conntrack version 0.5.0 (16384 buckets, 65536 max)
[    2.571706] <6>[fglrx] Firegl kernel thread PID: 1056
[    2.571751] <6>[fglrx] Firegl kernel thread PID: 1057
[    2.571791] <6>[fglrx] Firegl kernel thread PID: 1058
[    2.571883] <6>[fglrx] IRQ 36 Enabled
[    2.656091] <6>[fglrx] Reserved FB block: Shared offset:0, size:1000000
[    2.656094] <6>[fglrx] Reserved FB block: Unshared offset:f7b4000, 
size:4000
[    2.656095] <6>[fglrx] Reserved FB block: Unshared offset:f7b8000, 
size:548000
[    2.656096] <6>[fglrx] Reserved FB block: Unshared offset:7fff3000, 
size:d000
[    2.673072] vgaarb: this pci device is not a vga device
[    2.673078] vgaarb: this pci device is not a vga device
[    2.673081] vgaarb: this pci device is not a vga device
[    2.673085] vgaarb: this pci device is not a vga device
[    2.673089] vgaarb: this pci device is not a vga device
[    2.673092] vgaarb: this pci device is not a vga device
[    2.673096] vgaarb: this pci device is not a vga device
[    2.673100] vgaarb: this pci device is not a vga device
[    2.673104] vgaarb: this pci device is not a vga device
[    2.673108] vgaarb: this pci device is not a vga device
[    2.673112] vgaarb: this pci device is not a vga device
[    2.673116] vgaarb: this pci device is not a vga device
[    2.673121] vgaarb: this pci device is not a vga device
[    2.673125] vgaarb: this pci device is not a vga device
[    2.673135] vgaarb: this pci device is not a vga device
[    2.673145] vgaarb: device changed decodes: 
PCI:0000:04:00.0,olddecodes=io+mem,decodes=none:owns=none
[    2.673154] vgaarb: this pci device is not a vga device
[    2.673163] vgaarb: device changed decodes: 
PCI:0000:05:00.0,olddecodes=io+mem,decodes=none:owns=none
[    2.673171] vgaarb: this pci device is not a vga device
[    3.178822] <6>[fglrx] Firegl kernel thread PID: 1061
[    3.178903] <6>[fglrx] Firegl kernel thread PID: 1062
[    3.178981] <6>[fglrx] Firegl kernel thread PID: 1063
[    3.179083] <6>[fglrx] IRQ 37 Enabled
[    3.264086] <6>[fglrx] Reserved FB block: Shared offset:0, size:1000000
[    3.264089] <6>[fglrx] Reserved FB block: Unshared offset:f7b4000, 
size:4000
[    3.264090] <6>[fglrx] Reserved FB block: Unshared offset:f7b8000, 
size:548000
[    3.264091] <6>[fglrx] Reserved FB block: Unshared offset:7fff3000, 
size:d000
[    3.768910] <6>[fglrx] Firegl kernel thread PID: 1064
[    3.768969] <6>[fglrx] Firegl kernel thread PID: 1065
[    3.769021] <6>[fglrx] Firegl kernel thread PID: 1066
[    3.769128] <6>[fglrx] IRQ 38 Enabled
[    3.852096] <6>[fglrx] Reserved FB block: Shared offset:0, size:1000000
[    3.852098] <6>[fglrx] Reserved FB block: Unshared offset:f7b4000, 
size:4000
[    3.852099] <6>[fglrx] Reserved FB block: Unshared offset:f7b8000, 
size:548000
[    3.852100] <6>[fglrx] Reserved FB block: Unshared offset:7fff3000, 
size:d000
[   60.957865] random: nonblocking pool is initialized

------------------------------------------------------------------------------

X crashes on start on the VM with two R9s and of course not with three 6950s. 
I have tried different flgrx version, no change.

I've noticed a few differences in the "dmesg | grep vfio" "dmesg | grep 
vgaarb" outputs between the hosts:

The host with two R9s:
[  236.196729] vfio_ecap_init: 0000:01:00.0 hiding ecap 0x19 at 0x270
[  236.196735] vfio_ecap_init: 0000:01:00.0 hiding ecap 0x1b at 0x2d0

These do not show up on the host with 6950s...

The host with two R9s:
[    0.232243] vgaarb: device added: 
PCI:0000:00:02.0,decodes=io+mem,owns=io+mem,locks=none
[    0.232246] vgaarb: device added: 
PCI:0000:01:00.0,decodes=io+mem,owns=io+mem,locks=none
[    0.232249] vgaarb: device added: 
PCI:0000:02:00.0,decodes=io+mem,owns=none,locks=none

The host with three 6950s:
[    0.240385] vgaarb: device added: 
PCI:0000:00:02.0,decodes=io+mem,owns=io+mem,locks=none
[    0.240388] vgaarb: device added: 
PCI:0000:01:00.0,decodes=io+mem,owns=none,locks=none
[    0.240391] vgaarb: device added: 
PCI:0000:02:00.0,decodes=io+mem,owns=none,locks=none
[    0.240395] vgaarb: device added: 
PCI:0000:06:00.0,decodes=io+mem,owns=none,locks=none

For some reason one R9 has "owns=io+mem", whereas all three 6950 has 
"owns=none". I'll leave the question of relevance to you :)
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://listman.redhat.com/archives/vfio-users/attachments/20160101/7a2d3dc3/attachment.htm>


More information about the vfio-users mailing list