[libvirt] sr-iov ethernet VF is not assigned correctly to guest

[Daniel P. Berrange]

On Mon, Mar 26, 2012 at 11:12:56AM -0400, Scott wrote:
> Hi,  I'm hoping someone could possibly show me what I may be doing wrong here, and why I'm not seeing the expected results
> 
> Thanks in advance!
> 
> Server Information:HP Product Name: ProLiant DL165 G7
> Ethernet Card Information: Intel 82599EB 10-Gigabit SFI/SFP+
> uname: Linux 3.0.0-16-server x86_64 GNU/Linux
> OS Release: Ubuntu 11.10
> qemu-kvm version 0.14.1+noroms-0ubuntu6.2
> 
> First, here's a list of my VFs:
> # ip link show:
> 2: eth0: <BROADCAST,MULTICAST,SLAVE,UP,LOWER_UP> mtu 1500 qdisc mq master bond0 state UP qlen 1000
>    link/ether 00:1b:21:7d:70:16 brd ff:ff:ff:ff:ff:ff
>    vf 0 MAC 02:22:25:00:00:00
>    vf 1 MAC 02:22:25:00:00:01
>    vf 2 MAC 02:22:25:00:00:02
>    vf 3 MAC 02:22:25:00:00:03
>    vf 4 MAC 02:22:25:00:00:04
>    vf 5 MAC 02:22:25:00:00:05
>    vf 6 MAC 02:22:25:00:00:06
> 3: eth1: <NO-CARRIER,BROADCAST,MULTICAST,SLAVE,UP> mtu 1500 qdisc mq master bond0 state DOWN qlen 1000
>    link/ether 00:1b:21:7d:70:16 brd ff:ff:ff:ff:ff:ff
>    vf 0 MAC 02:22:25:01:00:00
>    vf 1 MAC 02:22:25:01:00:01
>    vf 2 MAC 02:22:25:01:00:02
>    vf 3 MAC 02:22:25:01:00:03
>    vf 4 MAC 02:22:25:01:00:04
>    vf 5 MAC 02:22:25:01:00:05
>    vf 6 MAC 02:22:25:01:00:06
> 
> # lspci |grep 05
> 05:00.0 Ethernet controller: Intel Corporation 82576 Gigabit Network Connection (rev 01)
> 05:00.1 Ethernet controller: Intel Corporation 82576 Gigabit Network Connection (rev 01)
> 05:10.0 Ethernet controller: Intel Corporation 82576 Virtual Function (rev 01)
> 05:10.1 Ethernet controller: Intel Corporation 82576 Virtual Function (rev 01)
> 05:10.2 Ethernet controller: Intel Corporation 82576 Virtual Function (rev 01)
> 05:10.3 Ethernet controller: Intel Corporation 82576 Virtual Function (rev 01)
> 05:10.4 Ethernet controller: Intel Corporation 82576 Virtual Function (rev 01)
> 05:10.5 Ethernet controller: Intel Corporation 82576 Virtual Function (rev 01)
> 05:10.6 Ethernet controller: Intel Corporation 82576 Virtual Function (rev 01)
> 05:10.7 Ethernet controller: Intel Corporation 82576 Virtual Function (rev 01)
> 05:11.0 Ethernet controller: Intel Corporation 82576 Virtual Function (rev 01)
> 05:11.1 Ethernet controller: Intel Corporation 82576 Virtual Function (rev 01)
> 05:11.2 Ethernet controller: Intel Corporation 82576 Virtual Function (rev 01)
> 05:11.3 Ethernet controller: Intel Corporation 82576 Virtual Function (rev 01)
> 05:11.4 Ethernet controller: Intel Corporation 82576 Virtual Function (rev 01)
> 05:11.5 Ethernet controller: Intel Corporation 82576 Virtual Function (rev 01)
> 
> # virsh nodedev-list |grep 05
> pci_0000_05_00_0
> pci_0000_05_00_1

> pci_0000_05_10_0
> pci_0000_05_10_1
> pci_0000_05_10_2
> pci_0000_05_10_3
> pci_0000_05_10_4
> pci_0000_05_10_5
> pci_0000_05_10_6
> pci_0000_05_10_7

> pci_0000_05_11_0
> pci_0000_05_11_1
> pci_0000_05_11_2
> pci_0000_05_11_3
> pci_0000_05_11_4
> pci_0000_05_11_5
> 
> 
> 4 Now detach 05.10.0 and 05.11.0 from the host:
> # virsh nodedev-dettach pci_0000_05_10_0
> Device pci_0000_05_10_0 dettached
> 
> # virsh nodedev-dettach pci_0000_05_11_0
> Device pci_0000_05_11_0 dettached

I don't see where you check that  pci_0000_05_10_0 and pci_0000_05_11_0
really do correspond to the virtual functions you want. ie where are
you checking that they actually have the expected MAC addrs, before
assigning them to the guest


> ip link:
> 2: eth0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast state UP qlen 1000
>    link/ether 02:22:25:00:00:00 brd ff:ff:ff:ff:ff:ff
> 3: eth1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast state UP qlen 1000
>    link/ether 02:22:25:00:00:04 brd ff:ff:ff:ff:ff:ff
> 
> 
> Expected Results:
> GUEST-A should have the following assignment:
> eth0 should = eth0-vf0 (bus:5, slot:10, fun:0), mac: 02:22:25:00:00:00
> eth1 should = eth1-vf0 (bus:5, slot:11, fun:0), mac: 02:22:25:01:00:00


Daniel
-- 
|: http://berrange.com      -o-    http://www.flickr.com/photos/dberrange/ :|
|: http://libvirt.org              -o-             http://virt-manager.org :|
|: http://autobuild.org       -o-         http://search.cpan.org/~danberr/ :|
|: http://entangle-photo.org       -o-       http://live.gnome.org/gtk-vnc :|