<div dir="ltr">Hello community,<div><br></div><div> Sorry to bring this up again. I have found qemu monitor command qom-list returned and compare it with live configuration under /var/run (attached at the end).</div><div>qom-list returns only one disk while current xml got two. I tried to restart libvirt container because I hope reconnect which calls qemuProcessUpdateDevices</div><div>could fix current xml. But it does not.</div><div><br></div><div> So my question is 1) should qemuProcessUpdateDevices remove gone devices from current configuration? 2) what could I do without reboot virtual machine?</div><div><br></div><div>Thank you,</div><div><br></div><div>Best,</div><div>Jiatong Shen</div><div><br></div><div><div>virsh # qemu-monitor-command instance-00000138 '{"execute": "qom-list", "arguments": {"path": "/machine/peripheral"}}' --pretty</div><div>{</div><div> "return": [</div><div> {</div><div> "name": "virtio-serial0",</div><div> "type": "child<virtio-serial-pci>"</div><div> },</div><div> {</div><div> "name": "type",</div><div> "type": "string"</div><div> },</div><div> {</div><div> "name": "input0",</div><div> "type": "child<usb-tablet>"</div><div> },</div><div> {</div><div> <span style="background-color:rgb(255,250,165)">"name": "virtio-disk0"</span>,</div><div> "type": "child<virtio-blk-pci>"</div><div> },</div><div> {</div><div> "name": "balloon0",</div><div> "type": "child<virtio-balloon-pci>"</div><div> },</div><div> {</div><div> "name": "net1",</div><div> "type": "child<virtio-net-pci>"</div><div> },</div><div> {</div><div> "name": "net0",</div><div> "type": "child<virtio-net-pci>"</div><div> },</div><div> {</div><div> "name": "usb",</div><div> "type": "child<piix3-usb-uhci>"</div><div> },</div><div> {</div><div> "name": "serial0",</div><div> "type": "child<isa-serial>"</div><div> },</div><div> {</div><div> "name": "channel0",</div><div> "type": "child<virtserialport>"</div><div> },</div><div> {</div><div> "name": "video0",</div><div> "type": "child<cirrus-vga>"</div><div> }</div><div> ],</div><div> "id": "libvirt-255"</div><div>}</div></div><div><br></div><div><br></div><div><br></div><div><domstatus state='running' reason='booted' pid='2613967'><br> <taint flag='custom-monitor'/><br> <taint flag='custom-ga-command'/><br> <monitor path='/var/lib/libvirt/qemu/domain-111-instance-00000138/monitor.sock' type='unix'/><br> <vcpus><br> <vcpu id='0' pid='2614006'/><br> <vcpu id='1' pid='2614008'/><br> <vcpu id='2' pid='2614009'/><br> <vcpu id='3' pid='2614010'/><br> <vcpu id='4' pid='2614011'/><br> <vcpu id='5' pid='2614012'/><br> <vcpu id='6' pid='2614013'/><br> <vcpu id='7' pid='2614014'/><br> <vcpu id='8' pid='2614015'/><br> <vcpu id='9' pid='2614016'/><br> <vcpu id='10' pid='2614017'/><br> <vcpu id='11' pid='2614018'/><br> </vcpus><br> <qemuCaps><br> <flag name='kvm'/><br> <flag name='mem-path'/><br> <flag name='drive-serial'/><br> <flag name='monitor-json'/><br> <flag name='sdl'/><br> <flag name='netdev'/><br> <flag name='rtc'/><br> <flag name='vhost-net'/><br> <flag name='no-hpet'/><br> <flag name='no-kvm-pit'/><br> <flag name='nodefconfig'/><br> <flag name='boot-menu'/><br> <flag name='fsdev'/><br> <flag name='name-process'/><br> <flag name='smbios-type'/><br> <flag name='spice'/><br> <flag name='vga-none'/><br> <flag name='boot-index'/><br> <flag name='hda-duplex'/><br> <flag name='drive-aio'/><br> <flag name='ccid-emulated'/><br> <flag name='ccid-passthru'/><br> <flag name='chardev-spicevmc'/><br> <flag name='virtio-tx-alg'/><br> <flag name='pci-multifunction'/><br> <flag name='virtio-blk-pci.ioeventfd'/><br> <flag name='sga'/><br> <flag name='virtio-blk-pci.event_idx'/><br> <flag name='virtio-net-pci.event_idx'/><br> <flag name='cache-directsync'/><br> <flag name='piix3-usb-uhci'/><br> <flag name='piix4-usb-uhci'/><br> <flag name='usb-ehci'/><br> <flag name='ich9-usb-ehci1'/><br> <flag name='vt82c686b-usb-uhci'/><br> <flag name='pci-ohci'/><br> <flag name='usb-redir'/><br> <flag name='usb-hub'/><br> <flag name='no-shutdown'/><br> <flag name='cache-unsafe'/><br> <flag name='ich9-ahci'/><br> <flag name='no-acpi'/><br> <flag name='fsdev-readonly'/><br> <flag name='virtio-blk-pci.scsi'/><br> <flag name='drive-copy-on-read'/><br> <flag name='fsdev-writeout'/><br> <flag name='drive-iotune'/><br> <flag name='system_wakeup'/><br> <flag name='scsi-disk.channel'/><br> <flag name='scsi-block'/><br> <flag name='transaction'/><br> <flag name='block-job-async'/><br> <flag name='scsi-cd'/><br> <flag name='ide-cd'/><br> <flag name='no-user-config'/><br> <flag name='hda-micro'/><br> <flag name='dump-guest-memory'/><br> <flag name='nec-usb-xhci'/><br> <flag name='balloon-event'/><br> <flag name='bridge'/><br> <flag name='lsi'/><br> <flag name='virtio-scsi-pci'/><br> <flag name='blockio'/><br> <flag name='disable-s3'/><br> <flag name='disable-s4'/><br> <flag name='usb-redir.filter'/><br> <flag name='ide-drive.wwn'/><br> <flag name='scsi-disk.wwn'/><br> <flag name='seccomp-sandbox'/><br> <flag name='reboot-timeout'/><br> <flag name='dump-guest-core'/><br> <flag name='seamless-migration'/><br> <flag name='block-commit'/><br> <flag name='vnc'/><br> <flag name='drive-mirror'/><br> <flag name='usb-redir.bootindex'/><br> <flag name='usb-host.bootindex'/><br> <flag name='blockdev-snapshot-sync'/><br> <flag name='qxl'/><br> <flag name='VGA'/><br> <flag name='cirrus-vga'/><br> <flag name='vmware-svga'/><br> <flag name='device-video-primary'/><br> <flag name='usb-serial'/><br> <flag name='usb-net'/><br> <flag name='add-fd'/><br> <flag name='nbd-server'/><br> <flag name='virtio-rng'/><br> <flag name='rng-random'/><br> <flag name='rng-egd'/><br> <flag name='dtb'/><br> <flag name='megasas'/><br> <flag name='ipv6-migration'/><br> <flag name='machine-opt'/><br> <flag name='machine-usb-opt'/><br> <flag name='tpm-passthrough'/><br> <flag name='tpm-tis'/><br> <flag name='pci-bridge'/><br> <flag name='vfio-pci'/><br> <flag name='vfio-pci.bootindex'/><br> <flag name='scsi-generic'/><br> <flag name='scsi-generic.bootindex'/><br> <flag name='mem-merge'/><br> <flag name='vnc-websocket'/><br> <flag name='drive-discard'/><br> <flag name='mlock'/><br> <flag name='vnc-share-policy'/><br> <flag name='device-del-event'/><br> <flag name='dmi-to-pci-bridge'/><br> <flag name='i440fx-pci-hole64-size'/><br> <flag name='q35-pci-hole64-size'/><br> <flag name='usb-storage'/><br> <flag name='usb-storage.removable'/><br> <flag name='virtio-mmio'/><br> <flag name='ich9-intel-hda'/><br> <flag name='kvm-pit-lost-tick-policy'/><br> <flag name='boot-strict'/><br> <flag name='pvpanic'/><br> <flag name='spice-file-xfer-disable'/><br> <flag name='spiceport'/><br> <flag name='usb-kbd'/><br> <flag name='host-pci-multidomain'/><br> <flag name='msg-timestamp'/><br> <flag name='active-commit'/><br> <flag name='change-backing-file'/><br> <flag name='memory-backend-ram'/><br> <flag name='numa'/><br> <flag name='memory-backend-file'/><br> <flag name='usb-audio'/><br> <flag name='rtc-reset-reinjection'/><br> <flag name='splash-timeout'/><br> <flag name='iothread'/><br> <flag name='migrate-rdma'/><br> <flag name='ivshmem'/><br> <flag name='drive-iotune-max'/><br> <flag name='VGA.vgamem_mb'/><br> <flag name='vmware-svga.vgamem_mb'/><br> <flag name='qxl.vgamem_mb'/><br> <flag name='pc-dimm'/><br> <flag name='machine-vmport-opt'/><br> <flag name='aes-key-wrap'/><br> <flag name='dea-key-wrap'/><br> <flag name='pci-serial'/><br> <flag name='vhost-user-multiqueue'/><br> <flag name='migration-event'/><br> <flag name='ioh3420'/><br> <flag name='x3130-upstream'/><br> <flag name='xio3130-downstream'/><br> <flag name='rtl8139'/><br> <flag name='e1000'/><br> <flag name='virtio-net'/><br> <flag name='gic-version'/><br> <flag name='incoming-defer'/><br> <flag name='virtio-gpu'/><br> <flag name='virtio-keyboard'/><br> <flag name='virtio-mouse'/><br> <flag name='virtio-tablet'/><br> <flag name='virtio-input-host'/><br> <flag name='chardev-file-append'/><br> <flag name='ich9-disable-s3'/><br> <flag name='ich9-disable-s4'/><br> <flag name='vserport-change-event'/><br> <flag name='virtio-balloon-pci.deflate-on-oom'/><br> <flag name='mptsas1068'/><br> <flag name='qxl.vram64_size_mb'/><br> <flag name='chardev-logfile'/><br> <flag name='debug-threads'/><br> <flag name='secret'/><br> <flag name='pxb'/><br> <flag name='pxb-pcie'/><br> <flag name='device-tray-moved-event'/><br> <flag name='nec-usb-xhci-ports'/><br> <flag name='virtio-scsi-pci.iothread'/><br> <flag name='name-guest'/><br> <flag name='qxl.max_outputs'/><br> <flag name='spice-unix'/><br> <flag name='drive-detect-zeroes'/><br> <flag name='tls-creds-x509'/><br> <flag name='display'/><br> <flag name='intel-iommu'/><br> <flag name='smm'/><br> <flag name='virtio-pci-disable-legacy'/><br> <flag name='query-hotpluggable-cpus'/><br> <flag name='virtio-net.rx_queue_size'/><br> <flag name='virtio-vga'/><br> <flag name='drive-iotune-max-length'/><br> <flag name='ivshmem-plain'/><br> <flag name='ivshmem-doorbell'/><br> <flag name='query-qmp-schema'/><br> <flag name='gluster.debug_level'/><br> <flag name='vhost-scsi'/><br> <flag name='drive-iotune-group'/><br> <flag name='query-cpu-model-expansion'/><br> <flag name='virtio-net.host_mtu'/><br> <flag name='nvdimm'/><br> <flag name='pcie-root-port'/><br> <flag name='query-cpu-definitions'/><br> <flag name='block-write-threshold'/><br> <flag name='query-named-block-nodes'/><br> <flag name='cpu-cache'/><br> <flag name='qemu-xhci'/><br> <flag name='kernel-irqchip'/><br> <flag name='kernel-irqchip.split'/><br> <flag name='intel-iommu.intremap'/><br> <flag name='intel-iommu.caching-mode'/><br> <flag name='intel-iommu.eim'/><br> <flag name='intel-iommu.device-iotlb'/><br> <flag name='virtio.iommu_platform'/><br> <flag name='virtio.ats'/><br> <flag name='loadparm'/><br> <flag name='vnc-multi-servers'/><br> <flag name='virtio-net.tx_queue_size'/><br> <flag name='chardev-reconnect'/><br> <flag name='virtio-gpu.max_outputs'/><br> <flag name='vxhs'/><br> <flag name='virtio-blk.num-queues'/><br> <flag name='vmcoreinfo'/><br> <flag name='numa.dist'/><br> <flag name='disk-share-rw'/><br> <flag name='iscsi.password-secret'/><br> <flag name='isa-serial'/><br> </qemuCaps><br> <devices><br> <device alias='virtio-serial0'/><br> <device alias='input0'/><br> <device alias='virtio-disk0'/><br> <device alias='balloon0'/><br> <device alias='net1'/><br> <device alias='net0'/><br> <device alias='usb'/><br> <device alias='serial0'/><br> <device alias='channel0'/><br> <device alias='video0'/><br> </devices><br> <libDir path='/var/lib/libvirt/qemu/domain-111-instance-00000138'/><br> <channelTargetDir path='/var/lib/libvirt/qemu/channel/target/domain-111-instance-00000138'/><br> <allowReboot value='yes'/><br> <blockjobs active='no'/><br> <agentTimeout>-2</agentTimeout><br> <domain type='kvm' id='111'><br> <name>instance-00000138</name><br> <uuid>0b985bed-ebdd-4334-9477-19a5dab70eb1</uuid><br> <metadata><br> <nova:instance xmlns:nova="<a href="http://openstack.org/xmlns/libvirt/nova/1.0">http://openstack.org/xmlns/libvirt/nova/1.0</a>"><br> <nova:package version="18.2.3"/><br> <nova:name>VSA</nova:name><br> <nova:creationTime>2020-09-08 01:12:58</nova:creationTime><br> <nova:flavor name="ecs_12C64G200G"><br> <nova:memory>65536</nova:memory><br> <nova:disk>200</nova:disk><br> <nova:swap>0</nova:swap><br> <nova:ephemeral>0</nova:ephemeral><br> <nova:vcpus>12</nova:vcpus><br> </nova:flavor><br> <nova:owner><br> <nova:user uuid="9ec899ea3a4144dcbc6dccacc1e36645">admin</nova:user><br> <nova:project uuid="f689fa41de3641cb8e4a98046268aa48">HBS</nova:project><br> </nova:owner><br> </nova:instance><br> </metadata><br> <memory unit='KiB'>67108864</memory><br> <currentMemory unit='KiB'>67108864</currentMemory><br> <vcpu placement='static'>12</vcpu><br> <cputune><br> <shares>12288</shares><br> </cputune><br> <resource><br> <partition>/machine</partition><br> </resource><br> <sysinfo type='smbios'><br> <system><br> <entry name='manufacturer'>OpenStack Foundation</entry><br> <entry name='product'>OpenStack Nova</entry><br> <entry name='version'>18.2.3</entry><br> <entry name='uuid'>0b985bed-ebdd-4334-9477-19a5dab70eb1</entry><br> <entry name='family'>Virtual Machine</entry><br> </system><br> </sysinfo><br> <os><br> <type arch='x86_64' machine='pc-i440fx-bionic'>hvm</type><br> <boot dev='hd'/><br> <smbios mode='sysinfo'/><br> </os><br> <features><br> <acpi/><br> <apic/><br> <hyperv><br> <relaxed state='on'/><br> <vapic state='on'/><br> <spinlocks state='on' retries='8191'/><br> </hyperv><br> </features><br> <cpu mode='custom' match='exact' check='full'><br> <model fallback='forbid'>Skylake-Client-IBRS</model><br> <vendor>Intel</vendor><br> <topology sockets='12' cores='1' threads='1'/><br> <feature policy='require' name='ss'/><br> <feature policy='require' name='hypervisor'/><br> <feature policy='require' name='tsc_adjust'/><br> <feature policy='require' name='md-clear'/><br> <feature policy='require' name='ssbd'/><br> <feature policy='require' name='pdpe1gb'/><br> <feature policy='disable' name='mpx'/><br> <feature policy='disable' name='xsavec'/><br> <feature policy='disable' name='xgetbv1'/><br> </cpu><br> <clock offset='localtime'><br> <timer name='pit' tickpolicy='delay'/><br> <timer name='rtc' tickpolicy='catchup'/><br> <timer name='hpet' present='no'/><br> <timer name='hypervclock' present='yes'/><br> </clock><br> <on_poweroff>destroy</on_poweroff><br> <on_reboot>restart</on_reboot><br> <on_crash>destroy</on_crash><br> <devices><br> <emulator>/usr/bin/qemu-system-x86_64</emulator><br> <disk type='network' device='disk'><br> <driver name='qemu' type='raw' cache='writeback' discard='unmap'/><br> <auth username='cinder_eafdd9d8-8fe3-40d1-8fbe-fc81f96f1fd6'><br> <secret type='ceph' uuid='eafdd9d8-8fe3-40d1-8fbe-fc81f96f1fd6'/><br> </auth><br> <source protocol='rbd' name='' tlsFromConfig='0'><br> <privateData><br> <nodenames><br> <nodename type='storage' name='#block034'/><br> <nodename type='format' name='#block104'/><br> </nodenames><br> <objects><br> <secret type='auth' alias='virtio-disk0-secret0'/><br> </objects><br> </privateData><br> </source><br> <target dev='vda' bus='virtio'/><br> <alias name='virtio-disk0'/><br> <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/><br> </disk><br> <disk type='network' device='disk'><br> <driver name='qemu' type='raw' cache='writeback' discard='unmap'/><br> <auth username='cinder_eafdd9d8-8fe3-40d1-8fbe-fc81f96f1fd6'><br> <secret type='ceph' uuid='eafdd9d8-8fe3-40d1-8fbe-fc81f96f1fd6'/><br> </auth><br> <source protocol='rbd' name='cinder.volumes' tlsFromConfig='0'><br> <privateData><br> <objects><br> <secret type='auth' alias='virtio-disk7-secret0'/><br> </objects><br> </privateData><br> </source><br> <target dev='vdh' bus='virtio'/><br> <alias name='virtio-disk7'/><br> <address type='pci' domain='0x0000' bus='0x00' slot='0x0e' function='0x0'/><br> </disk><br> <controller type='usb' index='0' model='piix3-uhci'><br> <alias name='usb'/><br> <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x2'/><br> </controller><br> <controller type='pci' index='0' model='pci-root'><br> <alias name='pci.0'/><br> </controller><br> <controller type='virtio-serial' index='0'><br> <alias name='virtio-serial0'/><br> <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/><br> </controller><br> <interface type='bridge'><br> <mac address='fa:16:3e:40:1a:19'/><br> <source bridge='qbrfbca49dd-ad'/><br> <target dev='tapfbca49dd-ad'/><br> <model type='virtio'/><br> <mtu size='1550'/><br> <alias name='net0'/><br> <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/><br> </interface><br> <interface type='bridge'><br> <mac address='fa:16:3e:11:ee:66'/><br> <source bridge='qbrdb246b9f-79'/><br> <target dev='tapdb246b9f-79'/><br> <model type='virtio'/><br> <mtu size='1500'/><br> <alias name='net1'/><br> <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/><br> </interface><br> <serial type='pty'><br> <source path='/dev/pts/11'/><br> <log file='/var/lib/nova/instances/0b985bed-ebdd-4334-9477-19a5dab70eb1/console.log' append='off'/><br> <target type='isa-serial' port='0'><br> <model name='isa-serial'/><br> </target><br> <alias name='serial0'/><br> </serial><br> <console type='pty' tty='/dev/pts/11'><br> <source path='/dev/pts/11'/><br> <log file='/var/lib/nova/instances/0b985bed-ebdd-4334-9477-19a5dab70eb1/console.log' append='off'/><br> <target type='serial' port='0'/><br> <alias name='serial0'/><br> </console><br> <channel type='unix'><br> <source mode='bind' path='/var/lib/libvirt/qemu/org.qemu.guest_agent.0.instance-00000138.sock'/><br> <target type='virtio' name='org.qemu.guest_agent.0' state='disconnected'/><br> <alias name='channel0'/><br> <address type='virtio-serial' controller='0' bus='0' port='1'/><br> </channel><br> <input type='tablet' bus='usb'><br> <alias name='input0'/><br> <address type='usb' bus='0' port='1'/><br> </input><br> <input type='mouse' bus='ps2'><br> <alias name='input1'/><br> </input><br> <input type='keyboard' bus='ps2'><br> <alias name='input2'/><br> </input><br> <graphics type='vnc' port='5911' autoport='yes' websocketGenerated='no' listen='0.0.0.0'><br> <listen type='address' address='0.0.0.0' fromConfig='0' autoGenerated='no'/><br> </graphics><br> <video><br> <model type='cirrus' vram='16384' heads='1' primary='yes'/><br> <alias name='video0'/><br> <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/><br> </video><br> <memballoon model='virtio'><br> <stats period='10'/><br> <alias name='balloon0'/><br> <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/><br> </memballoon><br> </devices><br> <seclabel type='dynamic' model='dac' relabel='yes'><br> <label>+42424:+104</label><br> <imagelabel>+42424:+104</imagelabel><br> </seclabel><br> </domain><br></domstatus><br></div><div><br></div><div><br></div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Mon, Nov 28, 2022 at 4:43 PM Jiatong Shen <<a href="mailto:yshxxsjt715@gmail.com">yshxxsjt715@gmail.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr">Thank you very much for the reply. But the interesting thing is that qemu monitoring<br><div>command info blocks returns the specified device has been detached while virsh domblklist</div><div>still displays the device. So does this imply qemu does not reply to libvirt when the device is</div><div>detached?</div><div><br></div><div>Best,</div><div>Jiatong Shen</div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Thu, Nov 24, 2022 at 10:58 PM Peter Krempa <<a href="mailto:pkrempa@redhat.com" target="_blank">pkrempa@redhat.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">On Thu, Nov 24, 2022 at 16:47:48 +0800, Jiatong Shen wrote:<br> > Hello Commnunity,<br> > <br> > I saw an weird situation on a phytium machine (arm64 v8), after the<br> > following commands, I can still see the interface which should be<br> > successfully detached.<br> > <br> > virsh # detach-interface 4a365b06-2597-4c17-8b44-dbb6953f9ced bridge --mac<br> > fa:16:3e:c5:62:40<br> > Interface detached successfully<br> > <br> > Future qmp commands shows, that a device hostnet23 exists but seems no<br> > front end device exists.<br> > <br> > So what could be the problem? Thank you very much.<br> <br> The man page for virsh states for the 'detach-interface' command:<br> <br> "Please see documentation for detach-device for known quirks."<br> <br> And the 'quirks' part of 'detach-device':<br> <br> Quirk: Device unplug is asynchronous in most cases and requires guest<br> cooperation. This means that it's up to the discretion of the guest to<br> disallow or delay the unplug arbitrarily. As the libvirt API used in<br> this command was designed as synchronous it returns success after some<br> timeout even if the device was not unplugged yet to allow further in‐<br> teractions with the domain e.g. if the guest is unresponsive. Callers<br> which need to make sure that the device was unplugged can use libvirt<br> events (see virsh event) to be notified when the device is removed.<br> Note that the event may arrive before the command returns.<br> <br> </blockquote></div><br clear="all"><div><br></div>-- <br><div dir="ltr"><div dir="ltr"><br><div>Best Regards,</div><div><br></div><div>Jiatong Shen</div></div></div> </blockquote></div><br clear="all"><div><br></div>-- <br><div dir="ltr" class="gmail_signature"><div dir="ltr"><br><div>Best Regards,</div><div><br></div><div>Jiatong Shen</div></div></div>