<div dir="ltr"><p class="MsoNormal"><span class="gmail-apple-converted-space"><span style="font-size:12pt;line-height:115%;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial">Hi, </span></span><span style="font-size:12pt;line-height:115%"><span></span></span></p>
<p class="MsoNormal"><span style="font-size:12pt;line-height:115%"><br></span></p><p class="MsoNormal"><span style="font-size:12pt;line-height:115%">Upon trying
to create VM instance (Say A) with one QAT VF, it fails with the following
error i.e., “Requested operation is not valid: PCI device 0000:88:04.7 is in
use by driver QEMU, domain instance-00000081”. Please note that, PCI device
0000:88:04.7 is already being assigned to another VM (Say B) . </span><span class="gmail-apple-converted-space"><span style="font-size:12pt;line-height:115%;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"> </span></span><span style="font-size:12pt;line-height:115%;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial">We have installed openstack-</span><span class="gmail-il">mitaka</span><span class="gmail-apple-converted-space"> release on CentO7 system. It has two
Intel<span class="gmail-apple-converted-space"> </span></span><span class="gmail-il">QAT</span><span class="gmail-apple-converted-space"> devices. There are 32 VF devices
available per<span class="gmail-apple-converted-space"> </span></span><span class="gmail-il">QAT</span><span class="gmail-apple-converted-space"> Device/DH895xCC device</span> Out of 64 VFs, only
8 VFs are allocated (to VM instances) and rest should be available. <span style="font-size:12pt;line-height:115%"><span></span></span></p>
<p class="MsoNormal"><span style="font-size:12pt;line-height:115%">But the nova
scheduler tries to assign an already-in-use SRIOV VF to a new instance and
instance fails. It appears that the nova database is not tracking which VF's
have already been taken. But if I shut down VM B instance, then other instance VM
A boots up and vice-versa. Note that, both the VM instances cannot run
simultaneously because of the aforesaid issue. <span></span></span></p>
<p class="MsoNormal"><span style="font-size:12pt;line-height:115%"><br></span></p><p class="MsoNormal"><span style="font-size:12pt;line-height:115%">We should
always be able to create as many instances with the requested PCI devices as
there are available VFs. <span></span></span></p>
<p class="MsoNormal"><span style="font-size:12pt;line-height:115%"><br></span></p><p class="MsoNormal"><span style="font-size:12pt;line-height:115%">Please feel
free to let me know if additional information is needed. </span><span style="font-size:12pt;line-height:115%;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial">Can anyone please suggest why it tries to assign same PCI
device which has been assigned already? Is there any way to resolve this issue?</span>
Thank you in advance for your support and help.<span></span></p><p class="MsoNormal"><br></p>
<p class="MsoNormal" style="margin-bottom:0.0001pt;line-height:normal;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><span style="font-size:12pt">[root@localhost
~(keystone_admin)]# lspci -d:435<span></span></span></p>
<p class="MsoNormal" style="margin-bottom:0.0001pt;line-height:normal;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><span style="font-size:12pt">83:00.0
Co-processor: Intel Corporation </span><span style="font-size:12pt;color:red">DH895XCC Series QAT</span><span style="font-size:12pt"><span></span></span></p>
<p class="MsoNormal" style="margin-bottom:0.0001pt;line-height:normal;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><span style="font-size:12pt">88:00.0
Co-processor: Intel Corporation </span><span style="font-size:12pt;color:red">DH895XCC Series QAT</span><span style="font-size:12pt"><span></span></span></p>
<p class="MsoNormal" style="margin-bottom:0.0001pt;line-height:normal;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><span style="font-size:12pt">[root@localhost
~(keystone_admin)]#<span></span></span></p>
<p class="MsoNormal" style="margin-bottom:0.0001pt;line-height:normal;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><span style="font-size:12pt"><br>
<br>
<span></span></span></p>
<p class="MsoNormal" style="margin-bottom:0.0001pt;line-height:normal;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><span style="font-size:12pt">[root@localhost
~(keystone_admin)]# lspci -d:443 | grep "QAT Virtual Function" |
wc -l<span></span></span></p>
<p class="MsoNormal" style="margin-bottom:0.0001pt;line-height:normal;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><span style="font-size:12pt">64<span></span></span></p>
<p class="MsoNormal" style="margin-bottom:0.0001pt;line-height:normal;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><span style="font-size:12pt">[root@localhost
~(keystone_admin)]#<span></span></span></p>
<p class="MsoNormal"><span style="font-size:12pt;line-height:115%"><span> </span></span></p>
<p class="MsoNormal"><span style="font-size:12pt;line-height:115%"><span> </span></span></p>
<p class="MsoNormal" style="background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><span style="font-size:12pt;line-height:115%">[root@localhost
~(keystone_admin)]# mysql -u root nova -e "SELECT hypervisor_hostname,
address, instance_uuid, status FROM pci_devices JOIN compute_nodes on<a href="http://compute_nodes.id/" target="_blank">compute_nodes.id</a>=compute_node_<wbr>id" |
grep 0000:88:04.7<span></span></span></p>
<p class="MsoNormal" style="background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><span style="background-image:initial;background-position:initial;background-repeat:initial"><span style="font-size:12pt;line-height:115%">localhost
0000:88:04.7 e10a76f3-e58e-4071-a4dd-<wbr>7a545e8000de
allocated<span></span></span></span></p>
<p class="MsoNormal" style="background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><span style="background-image:initial;background-position:initial;background-repeat:initial"><span style="font-size:12pt;line-height:115%">localhost
0000:88:04.7 c3dbac90-198d-4150-ba0f-<wbr>a80b912d8021
allocated<span></span></span></span></p>
<p class="MsoNormal" style="background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><span style="background-image:initial;background-position:initial;background-repeat:initial"><span style="font-size:12pt;line-height:115%">localhost
0000:88:04.7 c7f6adad-83f0-4881-b68f-<wbr>6d154d565ce3
allocated<span></span></span></span></p>
<p class="MsoNormal" style="background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><span style="background-image:initial;background-position:initial;background-repeat:initial"><span style="font-size:12pt;line-height:115%"><a href="http://stag48.nfv.benunets.com/" target="_blank">localhost.nfv.benunets.com</a><span class="gmail-apple-converted-space"> </span>0000:88:04.7
0c3c11a5-f9a4-4f0d-b120-<wbr>40e4dde843d4 allocated<span></span></span></span></p>
<p class="MsoNormal" style="background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><span style="background-image:initial;background-position:initial;background-repeat:initial"><span style="font-size:12pt;line-height:115%">[root@localhost
~(keystone_admin)]#<span></span></span></span></p>
<p class="MsoNormal" style="background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><span style="background-image:initial;background-position:initial;background-repeat:initial"><span style="font-size:12pt;line-height:115%"> </span><span></span></span></p>
<p class="MsoNormal" style="background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><span style="background-image:initial;background-position:initial;background-repeat:initial"><span style="font-size:12pt;line-height:115%">[root@localhost
~(keystone_admin)]# grep -r e10a76f3-e58e-4071-a4dd-<wbr>7a545e8000de
/etc/libvirt/qemu<span></span></span></span></p>
<p class="MsoNormal" style="background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><span style="background-image:initial;background-position:initial;background-repeat:initial"><span style="font-size:12pt;line-height:115%">/etc/libvirt/qemu/instance-<wbr>00000081.xml:
<uuid>e10a76f3-e58e-4071-a4dd-<wbr>7a545e8000de</uuid><span></span></span></span></p>
<p class="MsoNormal" style="background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><span style="background-image:initial;background-position:initial;background-repeat:initial"><span style="font-size:12pt;line-height:115%">/etc/libvirt/qemu/instance-<wbr>00000081.xml:
<entry name='uuid'>e10a76f3-e58e-<wbr>4071-a4dd-7a545e8000de</entry><span></span></span></span></p>
<p class="MsoNormal" style="background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><span style="background-image:initial;background-position:initial;background-repeat:initial"><span style="font-size:12pt;line-height:115%">/etc/libvirt/qemu/instance-<wbr>00000081.xml:
<source file='/var/lib/nova/instances/<wbr>e10a76f3-e58e-4071-a4dd-<wbr>7a545e8000de/disk'/><span></span></span></span></p>
<p class="MsoNormal" style="background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><span style="background-image:initial;background-position:initial;background-repeat:initial"><span style="font-size:12pt;line-height:115%">/etc/libvirt/qemu/instance-<wbr>00000081.xml:
<source path='/var/lib/nova/instances/<wbr>e10a76f3-e58e-4071-a4dd-<wbr>7a545e8000de/console.log'/><span></span></span></span></p>
<p class="MsoNormal" style="background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><span style="background-image:initial;background-position:initial;background-repeat:initial"><span style="font-size:12pt;line-height:115%">/etc/libvirt/qemu/instance-<wbr>00000081.xml:
<source path='/var/lib/nova/instances/<wbr>e10a76f3-e58e-4071-a4dd-<wbr>7a545e8000de/console.log'/><span></span></span></span></p>
<p class="MsoNormal" style="background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><span style="background-image:initial;background-position:initial;background-repeat:initial"><span style="font-size:12pt;line-height:115%">[root@localhost
~(keystone_admin)]#<span></span></span></span></p>
<p class="MsoNormal" style="background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><span style="background-image:initial;background-position:initial;background-repeat:initial"><span style="font-size:12pt;line-height:115%">[root@localhost
~(keystone_admin)]# grep -r 0c3c11a5-f9a4-4f0d-b120-<wbr>40e4dde843d4
/etc/libvirt/qemu<span></span></span></span></p>
<p class="MsoNormal" style="background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><span style="background-image:initial;background-position:initial;background-repeat:initial"><span style="font-size:12pt;line-height:115%">/etc/libvirt/qemu/instance-<wbr>000000ab.xml:
<uuid>0c3c11a5-f9a4-4f0d-b120-<wbr>40e4dde843d4</uuid><span></span></span></span></p>
<p class="MsoNormal" style="background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><span style="background-image:initial;background-position:initial;background-repeat:initial"><span style="font-size:12pt;line-height:115%">/etc/libvirt/qemu/instance-<wbr>000000ab.xml:
<entry name='uuid'>0c3c11a5-f9a4-<wbr>4f0d-b120-40e4dde843d4</entry><span></span></span></span></p>
<p class="MsoNormal" style="background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><span style="background-image:initial;background-position:initial;background-repeat:initial"><span style="font-size:12pt;line-height:115%">/etc/libvirt/qemu/instance-<wbr>000000ab.xml:
<source file='/var/lib/nova/instances/<wbr>0c3c11a5-f9a4-4f0d-b120-<wbr>40e4dde843d4/disk'/><span></span></span></span></p>
<p class="MsoNormal" style="background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><span style="background-image:initial;background-position:initial;background-repeat:initial"><span style="font-size:12pt;line-height:115%">/etc/libvirt/qemu/instance-<wbr>000000ab.xml:
<source path='/var/lib/nova/instances/<wbr>0c3c11a5-f9a4-4f0d-b120-<wbr>40e4dde843d4/console.log'/><span></span></span></span></p>
<p class="MsoNormal" style="background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><span style="background-image:initial;background-position:initial;background-repeat:initial"><span style="font-size:12pt;line-height:115%">/etc/libvirt/qemu/instance-<wbr>000000ab.xml:
<source path='/var/lib/nova/instances/<wbr>0c3c11a5-f9a4-4f0d-b120-<wbr>40e4dde843d4/console.log'/><span></span></span></span></p>
<p class="MsoNormal" style="background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><span style="background-image:initial;background-position:initial;background-repeat:initial"><span style="font-size:12pt;line-height:115%">[root@localhost
~(keystone_admin)]#<span></span></span></span></p>
<p class="MsoNormal" style="background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><span style="font-size:12pt;line-height:115%"><span> </span></span></p>
<p class="MsoNormal" style="background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><span style="font-size:12pt;line-height:115%;color:black">On the controller, , it appears there are duplicate PCI
device entries in the Database:</span><span style="font-size:12pt;line-height:115%"><span></span></span></p>
<p class="MsoNormal" style="background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><span style="font-size:12pt;line-height:115%"><span> </span></span></p>
<p class="MsoNormal" style="background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><span style="font-size:12pt;line-height:115%;color:black">MariaDB [nova]> select hypervisor_hostname,address,<wbr>count(*)
from pci_devices JOIN compute_nodes on<span class="gmail-apple-converted-space"> </span><a href="http://compute_nodes.id/" target="_blank">compute_nodes.id</a>=compute_node_<wbr>id group by
hypervisor_hostname,address having count(*) > 1;</span><span style="font-size:12pt;line-height:115%"><span></span></span></p>
<p class="MsoNormal" style="background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><span style="font-size:12pt;line-height:115%;color:black">+---------------------+-------<wbr>-------+----------+</span><span style="font-size:12pt;line-height:115%"><span></span></span></p>
<p class="MsoNormal" style="background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><span style="font-size:12pt;line-height:115%;color:black">| hypervisor_hostname |
address | count(*) |</span><span style="font-size:12pt;line-height:115%"><span></span></span></p>
<p class="MsoNormal" style="background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><span style="font-size:12pt;line-height:115%;color:black">+---------------------+-------<wbr>-------+----------+</span><span style="font-size:12pt;line-height:115%"><span></span></span></p>
<p class="MsoNormal" style="background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><span style="font-size:12pt;line-height:115%;color:black">| localhost
| 0000:05:00.0 | 3 |</span><span style="font-size:12pt;line-height:115%"><span></span></span></p>
<p class="MsoNormal" style="background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><span style="font-size:12pt;line-height:115%;color:black">| localhost
| 0000:05:00.1 | 3 |</span><span style="font-size:12pt;line-height:115%"><span></span></span></p>
<p class="MsoNormal" style="background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><span style="font-size:12pt;line-height:115%;color:black">| localhost
| 0000:83:01.0 | 3 |</span><span style="font-size:12pt;line-height:115%"><span></span></span></p>
<p class="MsoNormal" style="background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><span style="font-size:12pt;line-height:115%;color:black">| localhost
| 0000:83:01.1 | 3 |</span><span style="font-size:12pt;line-height:115%"><span></span></span></p>
<p class="MsoNormal" style="background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><span style="font-size:12pt;line-height:115%;color:black">| localhost
| 0000:83:01.2 | 3 |</span><span style="font-size:12pt;line-height:115%"><span></span></span></p>
<p class="MsoNormal" style="background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><span style="font-size:12pt;line-height:115%;color:black">| localhost
| 0000:83:01.3 | 3 |</span><span style="font-size:12pt;line-height:115%"><span></span></span></p>
<p class="MsoNormal" style="background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><span style="font-size:12pt;line-height:115%;color:black">| localhost
| 0000:83:01.4 | 3 |</span><span style="font-size:12pt;line-height:115%"><span></span></span></p>
<p class="MsoNormal" style="background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><span style="font-size:12pt;line-height:115%;color:black">| localhost
| 0000:83:01.5 | 3 |</span><span style="font-size:12pt;line-height:115%"><span></span></span></p>
<p class="MsoNormal" style="background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><span style="font-size:12pt;line-height:115%;color:black">| localhost
| 0000:83:01.6 | 3 |</span><span style="font-size:12pt;line-height:115%"><span></span></span></p>
<p class="MsoNormal" style="background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><span style="font-size:12pt;line-height:115%;color:black">| localhost
| 0000:83:01.7 | 3 |</span><span style="font-size:12pt;line-height:115%"><span></span></span></p>
<p class="MsoNormal" style="background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><span style="font-size:12pt;line-height:115%;color:black">| localhost
| 0000:83:02.0 | 3 |</span><span style="font-size:12pt;line-height:115%"><span></span></span></p>
<p class="MsoNormal" style="background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><span style="font-size:12pt;line-height:115%;color:black">| localhost
| 0000:83:02.1 | 3 |</span><span style="font-size:12pt;line-height:115%"><span></span></span></p>
<p class="MsoNormal" style="background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><span style="font-size:12pt;line-height:115%;color:black">| localhost
| 0000:83:02.2 | 3 |</span><span style="font-size:12pt;line-height:115%"><span></span></span></p>
<p class="MsoNormal" style="background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><span style="font-size:12pt;line-height:115%;color:black">| localhost
| 0000:83:02.3 | 3 |</span><span style="font-size:12pt;line-height:115%"><span></span></span></p>
<p class="MsoNormal" style="background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><span style="font-size:12pt;line-height:115%;color:black">| localhost
| 0000:83:02.4 | 3 |</span><span style="font-size:12pt;line-height:115%"><span></span></span></p>
<p class="MsoNormal" style="background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><span style="font-size:12pt;line-height:115%;color:black">| localhost
| 0000:83:02.5 | 3 |</span><span style="font-size:12pt;line-height:115%"><span></span></span></p>
<p class="MsoNormal" style="background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><span style="font-size:12pt;line-height:115%;color:black">| localhost
| 0000:83:02.6 | 3 |</span><span style="font-size:12pt;line-height:115%"><span></span></span></p>
<p class="MsoNormal" style="background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><span style="font-size:12pt;line-height:115%;color:black">| localhost
| 0000:83:02.7 | 3 |</span><span style="font-size:12pt;line-height:115%"><span></span></span></p>
<p class="MsoNormal" style="background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><span style="font-size:12pt;line-height:115%;color:black">| localhost
| 0000:83:03.0
| 3 |</span><span style="font-size:12pt;line-height:115%"><span></span></span></p>
<p class="MsoNormal" style="background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><span style="font-size:12pt;line-height:115%;color:black">| localhost
| 0000:83:03.1 | 3 |</span><span style="font-size:12pt;line-height:115%"><span></span></span></p>
<p class="MsoNormal" style="background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><span style="font-size:12pt;line-height:115%;color:black">| localhost
| 0000:83:03.2 | 3 |</span><span style="font-size:12pt;line-height:115%"><span></span></span></p>
<p class="MsoNormal" style="background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><span style="font-size:12pt;line-height:115%;color:black">| localhost
| 0000:83:03.3 | 3 |</span><span style="font-size:12pt;line-height:115%"><span></span></span></p>
<p class="MsoNormal" style="background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><span style="font-size:12pt;line-height:115%;color:black">| localhost
| 0000:83:03.4 | 3 |</span><span style="font-size:12pt;line-height:115%"><span></span></span></p>
<p class="MsoNormal" style="background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><span style="font-size:12pt;line-height:115%;color:black">| localhost
| 0000:83:03.5
| 3 |</span><span style="font-size:12pt;line-height:115%"><span></span></span></p>
<p class="MsoNormal" style="background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><span style="font-size:12pt;line-height:115%;color:black">| localhost
| 0000:83:03.6 | 3 |</span><span style="font-size:12pt;line-height:115%"><span></span></span></p>
<p class="MsoNormal" style="background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><span style="font-size:12pt;line-height:115%;color:black">| localhost
| 0000:83:03.7 | 3 |</span><span style="font-size:12pt;line-height:115%"><span></span></span></p>
<p class="MsoNormal" style="background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><span style="font-size:12pt;line-height:115%;color:black">| localhost
| 0000:83:04.0 | 3 |</span><span style="font-size:12pt;line-height:115%"><span></span></span></p>
<p class="MsoNormal" style="background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><span style="font-size:12pt;line-height:115%;color:black">| localhost
| 0000:83:04.1 | 3 |</span><span style="font-size:12pt;line-height:115%"><span></span></span></p>
<p class="MsoNormal" style="background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><span style="font-size:12pt;line-height:115%;color:black">| localhost
| 0000:83:04.2 | 3 |</span><span style="font-size:12pt;line-height:115%"><span></span></span></p>
<p class="MsoNormal" style="background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><span style="font-size:12pt;line-height:115%;color:black">| localhost
| 0000:83:04.3 | 3 |</span><span style="font-size:12pt;line-height:115%"><span></span></span></p>
<p class="MsoNormal" style="background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><span style="font-size:12pt;line-height:115%;color:black">| localhost
| 0000:83:04.4 | 3 |</span><span style="font-size:12pt;line-height:115%"><span></span></span></p>
<p class="MsoNormal" style="background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><span style="font-size:12pt;line-height:115%;color:black">| localhost
| 0000:83:04.5 | 3 |</span><span style="font-size:12pt;line-height:115%"><span></span></span></p>
<p class="MsoNormal" style="background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><span style="font-size:12pt;line-height:115%;color:black">| localhost
| 0000:83:04.6 | 3 |</span><span style="font-size:12pt;line-height:115%"><span></span></span></p>
<p class="MsoNormal" style="background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><span style="font-size:12pt;line-height:115%;color:black">| localhost
| 0000:83:04.7 | 3 |</span><span style="font-size:12pt;line-height:115%"><span></span></span></p>
<p class="MsoNormal" style="background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><span style="font-size:12pt;line-height:115%;color:black">| localhost
| 0000:88:01.0 | 3 |</span><span style="font-size:12pt;line-height:115%"><span></span></span></p>
<p class="MsoNormal" style="background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><span style="font-size:12pt;line-height:115%;color:black">| localhost
| 0000:88:01.1 | 3 |</span><span style="font-size:12pt;line-height:115%"><span></span></span></p>
<p class="MsoNormal" style="background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><span style="font-size:12pt;line-height:115%;color:black">| localhost
| 0000:88:01.2 | 3 |</span><span style="font-size:12pt;line-height:115%"><span></span></span></p>
<p class="MsoNormal" style="background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><span style="font-size:12pt;line-height:115%;color:black">| localhost
| 0000:88:01.3 | 3 |</span><span style="font-size:12pt;line-height:115%"><span></span></span></p>
<p class="MsoNormal" style="background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><span style="font-size:12pt;line-height:115%;color:black">| localhost
| 0000:88:01.4 | 3 |</span><span style="font-size:12pt;line-height:115%"><span></span></span></p>
<p class="MsoNormal" style="background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><span style="font-size:12pt;line-height:115%;color:black">| localhost
| 0000:88:01.5 | 3 |</span><span style="font-size:12pt;line-height:115%"><span></span></span></p>
<p class="MsoNormal" style="background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><span style="font-size:12pt;line-height:115%;color:black">| localhost
| 0000:88:01.6 | 3 |</span><span style="font-size:12pt;line-height:115%"><span></span></span></p>
<p class="MsoNormal" style="background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><span style="font-size:12pt;line-height:115%;color:black">| localhost
| 0000:88:01.7 | 3 |</span><span style="font-size:12pt;line-height:115%"><span></span></span></p>
<p class="MsoNormal" style="background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><span style="font-size:12pt;line-height:115%;color:black">| localhost
| 0000:88:02.0 | 3 |</span><span style="font-size:12pt;line-height:115%"><span></span></span></p>
<p class="MsoNormal" style="background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><span style="font-size:12pt;line-height:115%;color:black">| localhost
| 0000:88:02.1 | 3 |</span><span style="font-size:12pt;line-height:115%"><span></span></span></p>
<p class="MsoNormal" style="background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><span style="font-size:12pt;line-height:115%;color:black">| localhost
| 0000:88:02.2 | 3 |</span><span style="font-size:12pt;line-height:115%"><span></span></span></p>
<p class="MsoNormal" style="background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><span style="font-size:12pt;line-height:115%;color:black">| localhost
| 0000:88:02.3 | 3 |</span><span style="font-size:12pt;line-height:115%"><span></span></span></p>
<p class="MsoNormal" style="background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><span style="font-size:12pt;line-height:115%;color:black">| localhost
| 0000:88:02.4 | 3 |</span><span style="font-size:12pt;line-height:115%"><span></span></span></p>
<p class="MsoNormal" style="background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><span style="font-size:12pt;line-height:115%;color:black">| localhost
| 0000:88:02.5 | 3 |</span><span style="font-size:12pt;line-height:115%"><span></span></span></p>
<p class="MsoNormal" style="background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><span style="font-size:12pt;line-height:115%;color:black">| localhost
| 0000:88:02.6
| 3 |</span><span style="font-size:12pt;line-height:115%"><span></span></span></p>
<p class="MsoNormal" style="background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><span style="font-size:12pt;line-height:115%;color:black">| localhost
| 0000:88:02.7 | 3 |</span><span style="font-size:12pt;line-height:115%"><span></span></span></p>
<p class="MsoNormal" style="background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><span style="font-size:12pt;line-height:115%;color:black">| localhost
| 0000:88:03.0 | 3 |</span><span style="font-size:12pt;line-height:115%"><span></span></span></p>
<p class="MsoNormal" style="background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><span style="font-size:12pt;line-height:115%;color:black">| localhost
| 0000:88:03.1 | 3 |</span><span style="font-size:12pt;line-height:115%"><span></span></span></p>
<p class="MsoNormal" style="background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><span style="font-size:12pt;line-height:115%;color:black">| localhost
| 0000:88:03.2 | 3 |</span><span style="font-size:12pt;line-height:115%"><span></span></span></p>
<p class="MsoNormal" style="background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><span style="font-size:12pt;line-height:115%;color:black">| localhost
| 0000:88:03.3
| 3 |</span><span style="font-size:12pt;line-height:115%"><span></span></span></p>
<p class="MsoNormal" style="background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><span style="font-size:12pt;line-height:115%;color:black">| localhost
| 0000:88:03.4 | 3 |</span><span style="font-size:12pt;line-height:115%"><span></span></span></p>
<p class="MsoNormal" style="background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><span style="font-size:12pt;line-height:115%;color:black">| localhost
| 0000:88:03.5 | 3 |</span><span style="font-size:12pt;line-height:115%"><span></span></span></p>
<p class="MsoNormal" style="background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><span style="font-size:12pt;line-height:115%;color:black">| localhost
| 0000:88:03.6 | 3 |</span><span style="font-size:12pt;line-height:115%"><span></span></span></p>
<p class="MsoNormal" style="background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><span style="font-size:12pt;line-height:115%;color:black">| localhost
| 0000:88:03.7 | 3 |</span><span style="font-size:12pt;line-height:115%"><span></span></span></p>
<p class="MsoNormal" style="background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><span style="font-size:12pt;line-height:115%;color:black">| localhost
| 0000:88:04.0 | 3 |</span><span style="font-size:12pt;line-height:115%"><span></span></span></p>
<p class="MsoNormal" style="background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><span style="font-size:12pt;line-height:115%;color:black">| localhost
| 0000:88:04.1 | 3 |</span><span style="font-size:12pt;line-height:115%"><span></span></span></p>
<p class="MsoNormal" style="background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><span style="font-size:12pt;line-height:115%;color:black">| localhost
| 0000:88:04.2 | 3 |</span><span style="font-size:12pt;line-height:115%"><span></span></span></p>
<p class="MsoNormal" style="background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><span style="font-size:12pt;line-height:115%;color:black">| localhost
| 0000:88:04.3 | 3 |</span><span style="font-size:12pt;line-height:115%"><span></span></span></p>
<p class="MsoNormal" style="background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><span style="font-size:12pt;line-height:115%;color:black">| localhost
| 0000:88:04.4 | 3 |</span><span style="font-size:12pt;line-height:115%"><span></span></span></p>
<p class="MsoNormal" style="background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><span style="font-size:12pt;line-height:115%;color:black">| localhost
| 0000:88:04.5 | 3 |</span><span style="font-size:12pt;line-height:115%"><span></span></span></p>
<p class="MsoNormal" style="background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><span style="font-size:12pt;line-height:115%;color:black">| localhost
| 0000:88:04.6 | 3 |</span><span style="font-size:12pt;line-height:115%"><span></span></span></p>
<p class="MsoNormal" style="background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><span style="font-size:12pt;line-height:115%;color:black">| localhost
| 0000:88:04.7 | 3 |</span><span style="font-size:12pt;line-height:115%"><span></span></span></p>
<p class="MsoNormal" style="background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><span style="font-size:12pt;line-height:115%;color:black">+---------------------+-------<wbr>-------+----------+</span><span style="font-size:12pt;line-height:115%"><span></span></span></p>
<p class="MsoNormal" style="background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><span style="font-size:12pt;line-height:115%;color:black">66 rows in set (0.00 sec)</span><span style="font-size:12pt;line-height:115%"><span></span></span></p>
<p class="MsoNormal" style="background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><span style="font-size:12pt;line-height:115%;color:black"> </span><span style="font-size:12pt;line-height:115%"><span></span></span></p>
<p class="MsoNormal" style="background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><span style="font-size:12pt;line-height:115%;color:black">MariaDB [nova]><span></span></span></p>
<p class="MsoNormal" style="background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><span style="font-size:12pt;line-height:115%;color:black"><span> </span></span></p>
<p class="MsoNormal" style="background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><span style="font-size:12pt;line-height:115%;color:black">Regards,<span></span></span></p>
<p class="MsoNormal" style="background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><span style="font-size:12pt;line-height:115%;color:black">Chinmaya</span><span style="font-size:12pt;line-height:115%"><span></span></span></p></div>