<div dir="ltr"><div><div><div><div><div><div><div><div><div>Hello all,<br><br></div>I tried to deploy RDO Pike without container on our internal plateform. <br></div><div><br></div><div>The setup is pretty simple :<br></div> - 3 Controller in HA<br></div> - 5 Ceph<br></div> - 4 Compute</div><div> - 3 Object-Store</div><div><br></div>I didn't used any exotic parameter.<br></div>This is my deployment command :<br><br>openstack overcloud deploy --templates <br> -e environement.yaml <br> --ntp-server <a href="http://0.pool.ntp.org" target="_blank">0.pool.ntp.org</a> <br> -e storage-env.yaml <br> -e network-env.yaml <br> -e /usr/share/openstack-tripleo-h<wbr>eat-templates/environments/pup<wbr>pet-ceph.yaml <br> --control-scale 3 --control-flavor control <br> --compute-scale 4 --compute-flavor compute <br> --ceph-storage-scale 5 --ceph-storage-flavor ceph-storage <br> --swift-storage-flavor swift-storage --swift-storage-scale 3 <br> -e scheduler_hints_env.yaml <br> -e /usr/share/openstack-tripleo-h<wbr>eat-templates/environments/net<wbr>work-isolation.yaml <br> -e /usr/share/openstack-tripleo-h<wbr>eat-templates/environments/pup<wbr>pet-pacemaker.yaml<br><br></div><b>environnement.yaml :</b><br> parameter_defaults:<br> ControllerCount: 3<br> ComputeCount: 4<br> CephStorageCount: 5<br> OvercloudCephStorageFlavor: ceph-storage<br> CephDefaultPoolSize: 3<br> ObjectStorageCount: 3<br><br></div><b>network-env.yaml :</b><br> resource_registry:<br> OS::TripleO::Compute::Net::Sof<wbr>twareConfig: /home/stack/templates/nic-conf<wbr>igs/compute.yaml<br> OS::TripleO::Controller::Net::<wbr>SoftwareConfig: /home/stack/templates/nic-conf<wbr>igs/controller.yaml<br> OS::TripleO::CephStorage::Net:<wbr>:SoftwareConfig: /home/stack/templates/nic-conf<wbr>igs/ceph-storage.yaml<br> OS::TripleO::ObjectStorage::Ne<wbr>t::SoftwareConfig: /home/stack/templates/nic-conf<wbr>igs/swift-storage.yaml<br><br>parameter_defaults:<br> InternalApiNetCidr: <a href="http://172.16.0.0/24" target="_blank">172.16.0.0/24</a><br> TenantNetCidr: <a href="http://172.17.0.0/24" target="_blank">172.17.0.0/24</a><br> StorageNetCidr: <a href="http://172.18.0.0/24" target="_blank">172.18.0.0/24</a><br> StorageMgmtNetCidr: <a href="http://172.19.0.0/24" target="_blank">172.19.0.0/24</a><br> ManagementNetCidr: <a href="http://172.20.0.0/24" target="_blank">172.20.0.0/24</a><br> ExternalNetCidr: <a href="http://10.41.11.0/24" target="_blank">10.41.11.0/24</a><br> InternalApiAllocationPools: [{'start': '172.16.0.10', 'end': '172.16.0.200'}]<br> TenantAllocationPools: [{'start': '172.17.0.10', 'end': '172.17.0.200'}]<br> StorageAllocationPools: [{'start': '172.18.0.10', 'end': '172.18.0.200'}]<br> StorageMgmtAllocationPools: [{'start': '172.19.0.10', 'end': '172.19.0.200'}]<br> ManagementAllocationPools: [{'start': '172.20.0.10', 'end': '172.20.0.200'}]<br> # Leave room for floating IPs in the External allocation pool<br> ExternalAllocationPools: [{'start': '10.41.11.10', 'end': '10.41.11.30'}]<br> # Set to the router gateway on the external network<br> ExternalInterfaceDefaultRoute: 10.41.11.254<br> # Gateway router for the provisioning network (or Undercloud IP)<br> ControlPlaneDefaultRoute: 192.168.131.253<br> # The IP address of the EC2 metadata server. Generally the IP of the Undercloud<br> EC2MetadataIp: 192.0.2.1<br> # Define the DNS servers (maximum 2) for the overcloud nodes<br> DnsServers: ["10.38.5.26"]<br> InternalApiNetworkVlanID: 202<br> StorageNetworkVlanID: 203<br> StorageMgmtNetworkVlanID: 204<br> TenantNetworkVlanID: 205<br> ManagementNetworkVlanID: 206<br> ExternalNetworkVlanID: 198<br> NeutronExternalNetworkBridge: "''"<br> ControlPlaneSubnetCidr: '24'<br> BondInterfaceOvsOptions:<br> "mode=balance-xor"<br><b><br></b></div><b>storage-env.yaml :</b><br>parameter_defaults:<br> ExtraConfig:<br> ceph::profile::params::osds:<br> '/dev/sdb': {}<br> '/dev/sdc': {}<br> '/dev/sdd': {}<br> '/dev/sde': {}<br> '/dev/sdf': {}<br> '/dev/sdg': {}<br> SwiftRingBuild: false<br> RingBuild: false<br clear="all"><div><br></div><div><br></div><div><b>scheduler_hints_env.yaml</b><br></div><div>parameter_defaults:<br> ControllerSchedulerHints:<br> 'capabilities:node': 'control-%index%'<br> NovaComputeSchedulerHints:<br> 'capabilities:node': 'compute-%index%'<br> CephStorageSchedulerHints:<br> 'capabilities:node': 'ceph-storage-%index%'<br> ObjectStorageSchedulerHints:<br> 'capabilities:node': 'swift-storage-%index%'</div><div><br></div><div>After a little use, I found that I found that one controller is unable to get active ha-router and I got this output :</div><div><br></div><div>neutron l3-agent-list-hosting-router XXX<br></div><div>+-----------------------------<wbr>---------+--------------------<wbr>----------------+-------------<wbr>---+-------+----------+<br>| id <wbr> | host <wbr> | admin_state_up | alive | ha_state |<br>+-----------------------------<wbr>---------+--------------------<wbr>----------------+-------------<wbr>---+-------+----------+<br>| 420a7e31-bae1-4f8c-9438-<wbr>97839cf190c4 | overcloud-controller-0.<wbr>localdomain | True | :-) | standby |<br>| 6a943aa5-6fd1-4b44-8557-<wbr>f0043b266a2f | overcloud-controller-1.<wbr>localdomain | True | :-) | standby |<br>| dd66ef16-7533-434f-bf5b-<wbr>25e38c51375f | overcloud-controller-2.<wbr>localdomain | True | :-) | standby |<br>+-----------------------------<wbr>---------+--------------------<wbr>----------------+-------------<wbr>---+-------+----------+</div><div><br></div><div>So
each time a router is schedule on this controller I can't get an active
router. I tried to compare the configuration but everything seems to be
good. I redeployed to see if it help, and the only thing that change is
the controller where the ha-router are stuck.</div><div><br></div><div>The only message that I got is fron OVS :</div><div><br></div><div>2017-10-20 08:38:44.930 136145 WARNING neutron.agent.rpc [req-0ad9aec4-f718-498f-9ca7-<wbr>15b265340174 - - - - -] Device Port(admin_state_up=True,<wbr>allowed_address_pairs=[],<wbr>binding=PortBinding,binding_<wbr>levels=[],created_at=2017-10-<wbr>20T08:38:38Z,data_plane_<wbr>status=<?>,description='',<wbr>device_id='a7e23552-9329-4572-<wbr>a69d-d7f316fcc5c9',device_<wbr>owner='network:router_ha_<wbr>interface',dhcp_options=[],<wbr>distributed_binding=None,dns=<wbr>None,fixed_ips=[IPAllocation],<wbr>id=7b6d81ef-0451-4216-9fe5-<wbr>52d921052cb7,mac_address=fa:<wbr>16:3e:13:e9:3c,name='HA port tenant 0ee0af8e94044a42923873939978ed<wbr>42',network_id=ffe5ffa5-2693-<wbr>4d35-988e-7290899601e0,<wbr>project_id='',qos_policy_id=<wbr>None,revision_number=5,<wbr>security=PortSecurity(<wbr>7b6d81ef-0451-4216-9fe5-<wbr>52d921052cb7),security_group_<wbr>ids=set([]),status='DOWN',<wbr>updated_at=2017-10-20T08:38:<wbr>44Z) is not bound.<br>2017-10-20 08:38:44.944 136145 WARNING neutron.plugins.ml2.drivers.<wbr>openvswitch.agent.ovs_neutron_<wbr>agent [req-0ad9aec4-f718-498f-9ca7-<wbr>15b265340174 - - - - -] Device 7b6d81ef-0451-4216-9fe5-<wbr>52d921052cb7 not defined on plugin or binding failed<br></div><div><br></div>Any Idea ?<br clear="all"><br>-- <br><div class="gmail_signature"><div dir="ltr"><div>
<p style="font-weight:bold;margin:0px;padding:0px;font-size:14px;text-transform:uppercase"><span>LECOMTE</span> <span>Cedric</span></p><span></span><span></span><p style="font-weight:normal;font-size:10px;margin:0px 0px 4px;text-transform:uppercase"><span>Senior software ENgineer<br></span></p>
<p style="font-weight:normal;margin:0px;font-size:10px;color:rgb(153,153,153)"><a style="color:rgb(0,136,206);font-size:10px;margin:0px;text-decoration:none;font-family:"overpass",sans-serif" href="https://www.redhat.com" target="_blank">Red Hat <span><br><br></span></a></p>
<p style="font-weight:normal;margin:0px 0px 6px;font-size:10px;color:rgb(153,153,153)"><span style="margin:0px;padding:0px">
<a style="color:rgb(0,136,206);font-size:10px;margin:0px;text-decoration:none;font-family:"overpass",sans-serif" href="mailto:clecomte@redhat.com" target="_blank">clecomte@redhat.com</a> </span>
</p>
<table border="0"><tbody><tr><td width="100px"><a href="https://red.ht/sig" target="_blank"> <img src="https://www.redhat.com/files/brand/email/sig-redhat.png" width="90" height="auto"></a> </td>
<td style="font-weight:normal;font-size:10px">
<div><a href="https://redhat.com/trusted" style="text-decoration:none;color:rgb(204,0,0);font-weight:bold" target="_blank">TRIED. TESTED. TRUSTED.</a></div>
</td></tr></tbody></table>
</div></div></div>
</div>