<div dir="ltr"><div><div><span style="color:rgb(0,0,0);font-family:Helvetica;font-size:medium">Hi Folks,</span></div><div><span style="color:rgb(0,0,0);font-family:Helvetica;font-size:medium"><br></span></div><div><span style="color:rgb(0,0,0);font-family:Helvetica;font-size:medium">I' m in the process of setting up a openvswitch deployment and following this guide (<a href="https://access.redhat.com/site/documentation/en-US/Red_Hat_OpenStack_Preview/2/pdf/Release_Notes/Red_Hat_OpenStack_Preview-2-Release_Notes-en-US.pdf">https://access.redhat.com/site/documentation/en-US/Red_Hat_OpenStack_Preview/2/pdf/Release_Notes/Red_Hat_OpenStack_Preview-2-Release_Notes-en-US.pdf</a>)</span></div>
<div style="color:rgb(0,0,0);font-family:Helvetica;font-size:medium"><br></div><div style="color:rgb(0,0,0);font-family:Helvetica;font-size:medium">My plan was to create network segmented by different vlan'ids using OVS.</div>
<div style="color:rgb(0,0,0);font-family:Helvetica;font-size:medium"><br></div><div style="color:rgb(0,0,0);font-family:Helvetica;font-size:medium">This is my configuration :</div><div style="color:rgb(0,0,0);font-family:Helvetica;font-size:medium">
<br></div><div style="color:rgb(0,0,0);font-family:Helvetica;font-size:medium">----------------------------------------------------------------------------------------------</div><div style="color:rgb(0,0,0);font-family:Helvetica;font-size:medium">
[compute node]                        [nova-compute and other nova utilities]</div><div style="color:rgb(0,0,0);font-family:Helvetica;font-size:medium">                                                    [quantum-server]</div>
<div style="color:rgb(0,0,0);font-family:Helvetica;font-size:medium">                                                    [quantum-dhcp-agent]</div><div style="color:rgb(0,0,0);font-family:Helvetica;font-size:medium">----------------------------------------------------------------------------------------------</div>
<div style="color:rgb(0,0,0);font-family:Helvetica;font-size:medium">10.9.10.43                                eth5</div><div style="color:rgb(0,0,0);font-family:Helvetica;font-size:medium">         |                                            |</div>
<div style="color:rgb(0,0,0);font-family:Helvetica;font-size:medium">    [mgmt]                                  [data]</div><div style="color:rgb(0,0,0);font-family:Helvetica;font-size:medium">         |                                            |</div>
<div style="color:rgb(0,0,0);font-family:Helvetica;font-size:medium">10.9.10.129                              eth1</div><div style="color:rgb(0,0,0);font-family:Helvetica;font-size:medium">----------------------------------------------------------------------------------------------</div>
<div style="color:rgb(0,0,0);font-family:Helvetica;font-size:medium">[network node]                         [quantum-l3-agent] </div><div style="color:rgb(0,0,0);font-family:Helvetica;font-size:medium">----------------------------------------------------------------------------------------------</div>
<div style="color:rgb(0,0,0);font-family:Helvetica;font-size:medium"><br></div><div style="color:rgb(0,0,0);font-family:Helvetica;font-size:medium">I've the configuration files pasted at the end of this email for more clarity, but here's what I was expecting to accomplish.</div>
<div style="color:rgb(0,0,0);font-family:Helvetica;font-size:medium"><br></div><div style="color:rgb(0,0,0);font-family:Helvetica;font-size:medium">Step 1 : Create a network</div><div style="color:rgb(0,0,0);font-family:Helvetica;font-size:medium">
<div><b>quantum net-create opn1 --provider:network-type vlan --provider:physical-network physnet5 --provider:segmentation-id 500</b></div><div>Created a new network:</div><div>+---------------------------+--------------------------------------+</div>
<div>| Field                     | Value                                |</div><div>+---------------------------+--------------------------------------+</div><div>| admin_state_up            | True                                 |</div>
<div>| id                        | 5d47f63f-c804-4d23-8aaa-86373bc96b3b |</div><div>| name                      | opn1                                 |</div><div>| provider:network_type     | vlan                                 |</div>
<div>| provider:physical_network | physnet5                             |</div><div>| provider:segmentation_id  | 500                                  |</div><div>| router:external           | False                                |</div>
<div>| shared                    | False                                |</div><div>| status                    | ACTIVE                               |</div><div>| subnets                   |                                      |</div>
<div>| tenant_id                 | b26737806380406dbed3d273308a6a2f     |</div><div>+---------------------------+--------------------------------------+</div></div><div style="color:rgb(0,0,0);font-family:Helvetica;font-size:medium">
<br></div><div style="color:rgb(0,0,0);font-family:Helvetica;font-size:medium">Step 2 :</div><div style="color:rgb(0,0,0);font-family:Helvetica;font-size:medium">Create a subnet</div><div style="color:rgb(0,0,0);font-family:Helvetica;font-size:medium">
<div><b>quantum subnet-create opn1 <a href="http://65.1.1.0/24">65.1.1.0/24</a></b></div><div>Created a new subnet:</div><div>+------------------+--------------------------------------------+</div><div>| Field            | Value                                      |</div>
<div>+------------------+--------------------------------------------+</div><div>| allocation_pools | {"start": "65.1.1.2", "end": "65.1.1.254"} |</div><div>| cidr             | <a href="http://65.1.1.0/24">65.1.1.0/24</a>                                |</div>
<div>| dns_nameservers  |                                            |</div><div>| enable_dhcp      | True                                       |</div><div>| gateway_ip       | 65.1.1.1                                   |</div>
<div>| host_routes      |                                            |</div><div>| id               | 5df16c75-31eb-4332-b76c-c0986525e2de       |</div><div>| ip_version       | 4                                          |</div>
<div>| name             |                                            |</div><div>| network_id       | 5d47f63f-c804-4d23-8aaa-86373bc96b3b       |                                                                  C</div><div>
| tenant_id        | b26737806380406dbed3d273308a6a2f           |                                                               </div></div><div style="color:rgb(0,0,0);font-family:Helvetica;font-size:medium"><br></div><div style="color:rgb(0,0,0);font-family:Helvetica;font-size:medium">
Step 3: boot an image and attach it to this network</div><div style="color:rgb(0,0,0);font-family:Helvetica;font-size:medium"><b>nova boot --image cirros --flavor m1.tiny --nic net-id=5d47f63f-c804-4d23-8aaa-86373bc96b3b --key-name test my_1_server</b></div>
<div style="color:rgb(0,0,0);font-family:Helvetica;font-size:medium"><br></div><div style="color:rgb(0,0,0);font-family:Helvetica;font-size:medium">At this point, the vm comes up with an address on the subnet and is accessible locally from within the compute node :</div>
<div style="color:rgb(0,0,0);font-family:Helvetica;font-size:medium"><br></div><div style="color:rgb(0,0,0);font-family:Helvetica;font-size:medium"><div>+--------------------------------------+-------------+--------+---------------+</div>
<div>| ID                                   | Name        | Status | Networks      |</div><div>+--------------------------------------+-------------+--------+---------------+</div><div>| 72224a7c-273e-4dea-922b-09c38bd77538 | my_1_server | ACTIVE | opn1=65.1.1.3 |</div>
<div>+--------------------------------------+-------------+--------+---------------+</div></div><div style="color:rgb(0,0,0);font-family:Helvetica;font-size:medium"><br></div><div style="color:rgb(0,0,0);font-family:Helvetica;font-size:medium">
But, I was expecting to see a vnic on eth5 for the vlan 500 which we created in Step1 - that didn't seem to have happened from the ovs-vsctl show output.</div><div style="color:rgb(0,0,0);font-family:Helvetica;font-size:medium">
<br></div><div style="color:rgb(0,0,0);font-family:Helvetica;font-size:medium"><div>f83d2ba4-ff86-4e2c-8f00-0c572e30533f</div><div>    Bridge "br-eth5"</div><div>        Port "br-eth5"</div><div>            Interface "br-eth5"</div>
<div>                type: internal</div><div>    Bridge br-ex</div><div>        Port br-ex</div><div>            Interface br-ex</div><div>                type: internal</div><div>    Bridge br-int</div><div>        Port "tapa12a740a-c2"</div>
<div>            tag: 5</div><div>            Interface "tapa12a740a-c2"</div><div>                type: internal</div><div>        Port "qvoccf5b741-60"</div><div>            tag: 4095</div><div>            Interface "qvoccf5b741-60"</div>
<div>        Port "qvodc963159-16"</div><div>            tag: 4095</div><div>            Interface "qvodc963159-16"</div><div>        Port "qvod7544ba5-c1"</div><div>            tag: 5</div><div>
            Interface "qvod7544ba5-c1"</div><div>        Port "qvo4894fa5d-40"</div><div>            tag: 4095</div><div>            Interface "qvo4894fa5d-40"</div><div>        Port br-int</div>
<div>            Interface br-int</div><div>                type: internal</div><div>    ovs_version: "1.9.0"</div></div><div style="color:rgb(0,0,0);font-family:Helvetica;font-size:medium"><br></div><div style="color:rgb(0,0,0);font-family:Helvetica;font-size:medium">
<br></div><div style="color:rgb(0,0,0);font-family:Helvetica;font-size:medium"> My question is how do we expect the VMs on this compute node to talk with other VMs on a different compute node if the physical interface is not plugged into the br-int. Am I missing something here ?</div>
<div style="color:rgb(0,0,0);font-family:Helvetica;font-size:medium"><br></div><div style="color:rgb(0,0,0);font-family:Helvetica;font-size:medium">Regards,</div><div style="color:rgb(0,0,0);font-family:Helvetica;font-size:medium">
Prashanth</div><div style="color:rgb(0,0,0);font-family:Helvetica;font-size:medium"><br></div><div style="color:rgb(0,0,0);font-family:Helvetica;font-size:medium"><br></div><div style="color:rgb(0,0,0);font-family:Helvetica;font-size:medium">
Below is a snapshot of the different configuration files :</div><div style="color:rgb(0,0,0);font-family:Helvetica;font-size:medium"><b><br></b></div><div style="color:rgb(0,0,0);font-family:Helvetica;font-size:medium"><b>[Compute Node]</b></div>
<div style="color:rgb(0,0,0);font-family:Helvetica;font-size:medium"><b>quantum.conf</b></div><div style="color:rgb(0,0,0);font-family:Helvetica;font-size:medium"><div><br></div><div>[DEFAULT]</div><div>rpc_backend = quantum.openstack.common.rpc.impl_qpid</div>
<div>qpid_hostname = 10.9.10.43</div><div>core_plugin = quantum.plugins.openvswitch.ovs_quantum_plugin.OVSQuantumPluginV2</div><div>auth_strategy = keystone</div><div>verbose = True</div><div>debug = True</div><div>bind_port = 9696</div>
<div>[keystone_authtoken]</div><div>admin_tenant_name = openstack_network</div><div>admin_user = openstack_network</div><div>admin_password = test123</div></div><div style="color:rgb(0,0,0);font-family:Helvetica;font-size:medium">
<br></div><div style="color:rgb(0,0,0);font-family:Helvetica;font-size:medium"><b>dhcp_agent.ini</b></div><div style="color:rgb(0,0,0);font-family:Helvetica;font-size:medium"><div>[DEFAULT]</div><div>auth_url = <a href="http://localhost:35357/v2.0/">http://localhost:35357/v2.0/</a></div>
<div>admin_tenant_name = openstack_network</div><div>admin_user = openstack_network</div><div>admin_password = test123</div><div>interface_driver = quantum.agent.linux.interface.OVSInterfaceDriver</div><div>use_namespaces = False</div>
<div>dhcp_driver = quantum.agent.linux.dhcp.Dnsmasq</div><div>admin_username = quantum</div></div><div style="color:rgb(0,0,0);font-family:Helvetica;font-size:medium"><br></div><div style="color:rgb(0,0,0);font-family:Helvetica;font-size:medium">
<div><b>/etc/quantum/plugins/openvswitch/ovs_quantum_plugin.ini</b></div><div>[DATABASE]</div><div>sql_connection = <a href="mysql://quantum:quantum@r5-20/ovs_quantum">mysql://quantum:quantum@r5-20/ovs_quantum</a></div><div>
[OVS]</div><div>tenant_network_type = vlan</div><div>network_vlan_ranges = physnet5:100:1000</div><div>bridge_mapping = physnet5:br-eth5</div></div><div style="color:rgb(0,0,0);font-family:Helvetica;font-size:medium"><br>
</div><div style="color:rgb(0,0,0);font-family:Helvetica;font-size:medium"><b>nova.conf</b></div><div style="color:rgb(0,0,0);font-family:Helvetica;font-size:medium"><div>[DEFAULT]</div><div><….></div><div>network_api_class = nova.network.quantumv2.api.API</div>
<div>quantum_admin_username = openstack_network</div><div>quantum_admin_password = test123</div><div>quantum_admin_auth_url = <a href="http://127.0.0.1:35357/v2.0/">http://127.0.0.1:35357/v2.0/</a></div><div>quantum_auth_strategy = keystone</div>
<div>quantum_admin_tenant_name = openstack_network</div><div>quantum_url = <a href="http://10.9.10.43:9696/">http://10.9.10.43:9696/</a></div></div><div style="color:rgb(0,0,0);font-family:Helvetica;font-size:medium"><div>
libvirt_vif_driver = nova.virt.libvirt.vif.LibvirtHybridOVSBridgeDriver</div><div>libvirt_use_virtio_for_bridges=true</div></div><div style="color:rgb(0,0,0);font-family:Helvetica;font-size:medium"><br></div><div style="color:rgb(0,0,0);font-family:Helvetica;font-size:medium">
<br></div><div style="color:rgb(0,0,0);font-family:Helvetica;font-size:medium">On the network node, this is the l3 configuration :</div><div style="color:rgb(0,0,0);font-family:Helvetica;font-size:medium"><b>l3_agent.ini</b></div>
<div style="color:rgb(0,0,0);font-family:Helvetica;font-size:medium"><div>[DEFAULT]</div><div>auth_url = <a href="http://10.9.10.43:35357/v2.0/">http://10.9.10.43:35357/v2.0/</a></div><div>admin_user = openstack_network</div>
<div>admin_password = test123</div><div>admin_tenant_name = openstack_network</div><div>auth_strategy = keystone</div><div>interface_driver = quantum.agent.linux.interface.OVSInterfaceDriver</div><div>use_namespaces = False</div>
<div>verbose = True</div><div>debug = False</div><div>interface_driver = quantum.agent.linux.interface.OVSInterfaceDriver</div><div>auth_region = regionOne</div><div>router_id = 0496b7f6-1b27-487f-8a95-d7430302b080</div><div>
external_network_bridge = br-ex</div><div><br></div></div></div></div>