[libvirt] libvirtd segfault
Scott Sullivan
ssullivan at liquidweb.com
Fri Dec 28 19:23:31 UTC 2012
On 12/28/2012 01:31 PM, Scott Sullivan wrote:
> On 12/28/2012 10:50 AM, Michal Privoznik wrote:
>> On 28.12.2012 14:24, Scott Sullivan wrote:
>>> In case its useful, here's the 'bt' output from this session as well:
>>>
>>> (gdb) bt
>>> #0 qemuDomainObjBeginJobInternal (driver=0x7fffe401d740,
>>> driver_locked=true, obj=0x7fff80001b00, job=QEMU_JOB_DESTROY,
>>> asyncJob=QEMU_ASYNC_JOB_NONE) at qemu/qemu_domain.c:768
>>> #1 0x00007fffeac2b223 in qemuDomainDestroyFlags (dom=<value
>>> optimized out>, flags=<value optimized out>) at qemu/qemu_driver.c:2052
>>> #2 0x00000039f10f97df in virDomainDestroy (domain=0x7fff741b8540)
>>> at libvirt.c:2201
>>> #3 0x0000000000428e22 in remoteDispatchDomainDestroy (server=<value
>>> optimized out>, client=<value optimized out>, msg=<value optimized
>>> out>, rerr=0x7fff8e1fbbe0, args=<value optimized out>, ret=<value
>>> optimized> out>) at remote_dispatch.h:1277
>>> #4 remoteDispatchDomainDestroyHelper (server=<value optimized out>,
>>> client=<value optimized out>, msg=<value optimized out>,
>>> rerr=0x7fff8e1fbbe0, args=<value optimized out>, ret=<value
>>> optimized out>) at remote_dispatch.h:1255
>>> #5 0x00000039f1146152 in virNetServerProgramDispatchCall
>>> (prog=0x6884a0, server=0x67fe60, client=0x68eb50, msg=0x6930b0) at
>>> rpc/virnetserverprogram.c:431
>>> #6 virNetServerProgramDispatch (prog=0x6884a0, server=0x67fe60,
>>> client=0x68eb50, msg=0x6930b0) at rpc/virnetserverprogram.c:304
>>> #7 0x00000039f1143fee in virNetServerProcessMsg (srv=<value
>>> optimized out>, client=0x68eb50, prog=<value optimized out>,
>>> msg=0x6930b0) at rpc/virnetserver.c:171
>>> #8 0x00000039f1144a8b in virNetServerHandleJob (jobOpaque=<value
>>> optimized out>, opaque=<value optimized out>) at rpc/virnetserver.c:192
>>> #9 0x00000039f10643ec in virThreadPoolWorker (opaque=<value
>>> optimized out>) at util/threadpool.c:144
>>> #10 0x00000039f1063cd9 in virThreadHelper (data=<value optimized
>>> out>) at util/threads-pthread.c:161
>>> #11 0x000000300a2077f1 in start_thread () from /lib64/libpthread.so.0
>>> #12 0x0000003009ae570d in clone () from /lib64/libc.so.6
>>> (gdb)
>> I think this patch should fix your problem:
>>
>> https://www.redhat.com/archives/libvir-list/2012-December/msg00935.html
>>
>> If so, can you please test and confirm that since you already have
>> everything set up.
>>
>> Michal
>
> I have applied this patch, on top of stable v1.0.1. I am going have my
> test running over the weekend, and will report back if I get another
> SIGSEGV as I saw before.
>
> However so far, I have ran the same test as I noted in my previous
> posting, and after maybe 20 minutes this time I got another halt in my
> GDB session, though this time it is a SIGPIPE. Here is the output:
>
> Program received signal SIGPIPE, Broken pipe.
> 0x000000300a20e48d in write () from /lib64/libpthread.so.0
> Missing separate debuginfos, use: debuginfo-install
> audit-libs-2.1.3-3.el6.x86_64 augeas-libs-0.9.0-1.el6.x86_64
> avahi-libs-0.6.25-11.el6.x86_64 cyrus-sasl-gssapi-2.1.23-13.el6.x86_64
> cyrus-sasl-lib-2.1.23-13.el6.x86_64
> cyrus-sasl-md5-2.1.23-13.el6.x86_64
> cyrus-sasl-plain-2.1.23-13.el6.x86_64 db4-4.7.25-16.el6.x86_64
> dbus-libs-1.2.24-5.el6_1.x86_64
> device-mapper-libs-1.02.66-7storm.x86_64 glibc-2.12-1.47.el6.x86_64
> gnutls-2.8.5-4.el6.x86_64 keyutils-libs-1.4-3.el6.x86_64
> krb5-libs-1.9-22.el6_2.1.x86_64 libblkid-2.17.2-12.4.el6.x86_64
> libcap-ng-0.6.4-3.el6_0.1.x86_64 libcom_err-1.41.12-11.el6.x86_64
> libcurl-7.19.7-26.el6_1.2.x86_64 libgcrypt-1.4.5-9.el6.x86_64
> libgpg-error-1.7-4.el6.x86_64 libidn-1.18-2.el6.x86_64
> libnl-1.1-14.el6.x86_64 libpcap-1.0.0-6.20091201git117cb5.el6.x86_64
> libpciaccess-0.12.1-1.el6.x86_64 libselinux-2.0.94-5.2.el6.x86_64
> libsepol-2.0.41-4.el6.x86_64 libtasn1-2.3-3.el6.x86_64
> libudev-147-2.40.el6.x86_64 libuuid-2.17.2-12.4.el6.x86_64
> libxml2-2.7.6-4.el6.x86_64 libxslt-1.1.26-2.el6.x86_64
> netcf-libs-0.1.9-2.el6.x86_64 nspr-4.8.8-3.el6.x86_64
> nss-3.12.10-17.el6_2.x86_64 nss-softokn-freebl-3.12.9-11.el6.x86_64
> nss-util-3.12.10-2.el6.x86_64 numactl-2.0.3-9.el6.x86_64
> openldap-2.4.23-20.el6.x86_64 openssl-1.0.0-20.el6.x86_64
> yajl-1.0.7-3.el6.x86_64 zlib-1.2.3-27.el6.x86_64
> (gdb) bt
> #0 0x000000300a20e48d in write () from /lib64/libpthread.so.0
> #1 0x00007ffff7adb47e in virNetSocketWriteWire (sock=0x685af0,
> buf=0x1e90690 "", len=36) at rpc/virnetsocket.c:1344
> #2 0x00007ffff7adb67e in virNetSocketWrite (sock=0x685af0,
> buf=0x1e90690 "", len=36) at rpc/virnetsocket.c:1490
> #3 0x00007ffff7acb3d6 in virNetServerClientWrite (sock=<value
> optimized out>, events=11, opaque=0x68a7e0) at
> rpc/virnetserverclient.c:1095
> #4 virNetServerClientDispatchWrite (sock=<value optimized out>,
> events=11, opaque=0x68a7e0) at rpc/virnetserverclient.c:1116
> #5 virNetServerClientDispatchEvent (sock=<value optimized out>,
> events=11, opaque=0x68a7e0) at rpc/virnetserverclient.c:1227
> #6 0x00007ffff79d6305 in virEventPollDispatchHandles () at
> util/event_poll.c:500
> #7 virEventPollRunOnce () at util/event_poll.c:647
> #8 0x00007ffff79d4ecd in virEventRunDefaultImpl () at util/event.c:247
> #9 0x00007ffff7ace275 in virNetServerRun (srv=0x678df0) at
> rpc/virnetserver.c:1121
> #10 0x000000000040c76a in main (argc=<value optimized out>,
> argv=<value optimized out>) at libvirtd.c:1449
> (gdb) thread apply all bt
> Thread 28 (Thread 0x7fff86bfd700 (LWP 2038)):
> #0 0x000000300a20b3dc in pthread_cond_wait@@GLIBC_2.3.2 () from
> /lib64/libpthread.so.0
> #1 0x00007ffff79e8aa6 in virCondWait (c=<value optimized out>,
> m=<value optimized out>) at util/threads-pthread.c:117
> #2 0x00007ffff79e9073 in virThreadPoolWorker (opaque=<value optimized
> out>) at util/threadpool.c:103
> #3 0x00007ffff79e88c9 in virThreadHelper (data=<value optimized out>)
> at util/threads-pthread.c:161
> #4 0x000000300a2077f1 in start_thread () from /lib64/libpthread.so.0
> #5 0x0000003009ae570d in clone () from /lib64/libc.so.6
>
> Thread 27 (Thread 0x7fff875fe700 (LWP 32222)):
> #0 0x000000300a20b3dc in pthread_cond_wait@@GLIBC_2.3.2 () from
> /lib64/libpthread.so.0
> #1 0x00007ffff79e8aa6 in virCondWait (c=<value optimized out>,
> m=<value optimized out>) at util/threads-pthread.c:117
> #2 0x00007ffff79e9073 in virThreadPoolWorker (opaque=<value optimized
> out>) at util/threadpool.c:103
> #3 0x00007ffff79e88c9 in virThreadHelper (data=<value optimized out>)
> at util/threads-pthread.c:161
> #4 0x000000300a2077f1 in start_thread () from /lib64/libpthread.so.0
> #5 0x0000003009ae570d in clone () from /lib64/libc.so.6
>
> Thread 26 (Thread 0x7fff87fff700 (LWP 31895)):
> #0 0x000000300a20b3dc in pthread_cond_wait@@GLIBC_2.3.2 () from
> /lib64/libpthread.so.0
> #1 0x00007ffff79e8aa6 in virCondWait (c=<value optimized out>,
> m=<value optimized out>) at util/threads-pthread.c:117
> #2 0x00007ffff79e9073 in virThreadPoolWorker (opaque=<value optimized
> out>) at util/threadpool.c:103
> #3 0x00007ffff79e88c9 in virThreadHelper (data=<value optimized out>)
> at util/threads-pthread.c:161
> #4 0x000000300a2077f1 in start_thread () from /lib64/libpthread.so.0
> #5 0x0000003009ae570d in clone () from /lib64/libc.so.6
>
> Thread 25 (Thread 0x7fffb8dfa700 (LWP 31894)):
> #0 0x000000300a20b3dc in pthread_cond_wait@@GLIBC_2.3.2 () from
> /lib64/libpthread.so.0
> #1 0x00007ffff79e8aa6 in virCondWait (c=<value optimized out>,
> m=<value optimized out>) at util/threads-pthread.c:117
> #2 0x00007ffff79e9073 in virThreadPoolWorker (opaque=<value optimized
> out>) at util/threadpool.c:103
> #3 0x00007ffff79e88c9 in virThreadHelper (data=<value optimized out>)
> at util/threads-pthread.c:161
> #4 0x000000300a2077f1 in start_thread () from /lib64/libpthread.so.0
> #5 0x0000003009ae570d in clone () from /lib64/libc.so.6
>
> Thread 24 (Thread 0x7fffb97fb700 (LWP 31893)):
> #0 0x000000300a20b3dc in pthread_cond_wait@@GLIBC_2.3.2 () from
> /lib64/libpthread.so.0
> #1 0x00007ffff79e8aa6 in virCondWait (c=<value optimized out>,
> m=<value optimized out>) at util/threads-pthread.c:117
> #2 0x00007ffff79e9073 in virThreadPoolWorker (opaque=<value optimized
> out>) at util/threadpool.c:103
> #3 0x00007ffff79e88c9 in virThreadHelper (data=<value optimized out>)
> at util/threads-pthread.c:161
> #4 0x000000300a2077f1 in start_thread () from /lib64/libpthread.so.0
> #5 0x0000003009ae570d in clone () from /lib64/libc.so.6
>
> Thread 23 (Thread 0x7fffba1fc700 (LWP 31659)):
> #0 0x000000300a20b3dc in pthread_cond_wait@@GLIBC_2.3.2 () from
> /lib64/libpthread.so.0
> #1 0x00007ffff79e8aa6 in virCondWait (c=<value optimized out>,
> m=<value optimized out>) at util/threads-pthread.c:117
> #2 0x00007ffff79e9073 in virThreadPoolWorker (opaque=<value optimized
> out>) at util/threadpool.c:103
> #3 0x00007ffff79e88c9 in virThreadHelper (data=<value optimized out>)
> at util/threads-pthread.c:161
> #4 0x000000300a2077f1 in start_thread () from /lib64/libpthread.so.0
> #5 0x0000003009ae570d in clone () from /lib64/libc.so.6
>
> Thread 22 (Thread 0x7fffbabfd700 (LWP 31562)):
> #0 0x000000300a20b3dc in pthread_cond_wait@@GLIBC_2.3.2 () from
> /lib64/libpthread.so.0
> #1 0x00007ffff79e8aa6 in virCondWait (c=<value optimized out>,
> m=<value optimized out>) at util/threads-pthread.c:117
> #2 0x00007ffff79e9073 in virThreadPoolWorker (opaque=<value optimized
> out>) at util/threadpool.c:103
> #3 0x00007ffff79e88c9 in virThreadHelper (data=<value optimized out>)
> at util/threads-pthread.c:161
> #4 0x000000300a2077f1 in start_thread () from /lib64/libpthread.so.0
> #5 0x0000003009ae570d in clone () from /lib64/libc.so.6
>
> Thread 21 (Thread 0x7fffbb5fe700 (LWP 31555)):
> #0 0x000000300a20b3dc in pthread_cond_wait@@GLIBC_2.3.2 () from
> /lib64/libpthread.so.0
> #1 0x00007ffff79e8aa6 in virCondWait (c=<value optimized out>,
> m=<value optimized out>) at util/threads-pthread.c:117
> #2 0x00007ffff79e9073 in virThreadPoolWorker (opaque=<value optimized
> out>) at util/threadpool.c:103
> #3 0x00007ffff79e88c9 in virThreadHelper (data=<value optimized out>)
> at util/threads-pthread.c:161
> #4 0x000000300a2077f1 in start_thread () from /lib64/libpthread.so.0
> #5 0x0000003009ae570d in clone () from /lib64/libc.so.6
>
> Thread 20 (Thread 0x7fffe0dfa700 (LWP 31452)):
> #0 0x000000300a20b3dc in pthread_cond_wait@@GLIBC_2.3.2 () from
> /lib64/libpthread.so.0
> #1 0x00007ffff79e8aa6 in virCondWait (c=<value optimized out>,
> m=<value optimized out>) at util/threads-pthread.c:117
> #2 0x00007ffff79e9073 in virThreadPoolWorker (opaque=<value optimized
> out>) at util/threadpool.c:103
> #3 0x00007ffff79e88c9 in virThreadHelper (data=<value optimized out>)
> at util/threads-pthread.c:161
> #4 0x000000300a2077f1 in start_thread () from /lib64/libpthread.so.0
> #5 0x0000003009ae570d in clone () from /lib64/libc.so.6
>
> Thread 19 (Thread 0x7fffe17fb700 (LWP 31315)):
> #0 0x000000300a20b3dc in pthread_cond_wait@@GLIBC_2.3.2 () from
> /lib64/libpthread.so.0
> #1 0x00007ffff79e8aa6 in virCondWait (c=<value optimized out>,
> m=<value optimized out>) at util/threads-pthread.c:117
> #2 0x00007ffff79e9073 in virThreadPoolWorker (opaque=<value optimized
> out>) at util/threadpool.c:103
> #3 0x00007ffff79e88c9 in virThreadHelper (data=<value optimized out>)
> at util/threads-pthread.c:161
> #4 0x000000300a2077f1 in start_thread () from /lib64/libpthread.so.0
> #5 0x0000003009ae570d in clone () from /lib64/libc.so.6
>
> Thread 18 (Thread 0x7fffe21fc700 (LWP 31128)):
> #0 0x000000300a20b3dc in pthread_cond_wait@@GLIBC_2.3.2 () from
> /lib64/libpthread.so.0
> #1 0x00007ffff79e8aa6 in virCondWait (c=<value optimized out>,
> m=<value optimized out>) at util/threads-pthread.c:117
> #2 0x00007ffff79e9073 in virThreadPoolWorker (opaque=<value optimized
> out>) at util/threadpool.c:103
> #3 0x00007ffff79e88c9 in virThreadHelper (data=<value optimized out>)
> at util/threads-pthread.c:161
> #4 0x000000300a2077f1 in start_thread () from /lib64/libpthread.so.0
> #5 0x0000003009ae570d in clone () from /lib64/libc.so.6
>
> Thread 17 (Thread 0x7fffe2bfd700 (LWP 30991)):
> #0 0x000000300a20b3dc in pthread_cond_wait@@GLIBC_2.3.2 () from
> /lib64/libpthread.so.0
> #1 0x00007ffff79e8aa6 in virCondWait (c=<value optimized out>,
> m=<value optimized out>) at util/threads-pthread.c:117
> #2 0x00007ffff79e9073 in virThreadPoolWorker (opaque=<value optimized
> out>) at util/threadpool.c:103
> #3 0x00007ffff79e88c9 in virThreadHelper (data=<value optimized out>)
> at util/threads-pthread.c:161
> #4 0x000000300a2077f1 in start_thread () from /lib64/libpthread.so.0
> #5 0x0000003009ae570d in clone () from /lib64/libc.so.6
>
> Thread 16 (Thread 0x7fffe35fe700 (LWP 30801)):
> #0 0x000000300a20b3dc in pthread_cond_wait@@GLIBC_2.3.2 () from
> /lib64/libpthread.so.0
> #1 0x00007ffff79e8aa6 in virCondWait (c=<value optimized out>,
> m=<value optimized out>) at util/threads-pthread.c:117
> #2 0x00007ffff79e9073 in virThreadPoolWorker (opaque=<value optimized
> out>) at util/threadpool.c:103
> #3 0x00007ffff79e88c9 in virThreadHelper (data=<value optimized out>)
> at util/threads-pthread.c:161
> #4 0x000000300a2077f1 in start_thread () from /lib64/libpthread.so.0
> #5 0x0000003009ae570d in clone () from /lib64/libc.so.6
>
> Thread 15 (Thread 0x7fffbbfff700 (LWP 30790)):
> #0 0x000000300a20b3dc in pthread_cond_wait@@GLIBC_2.3.2 () from
> /lib64/libpthread.so.0
> #1 0x00007ffff79e8aa6 in virCondWait (c=<value optimized out>,
> m=<value optimized out>) at util/threads-pthread.c:117
> #2 0x00007fffea56a97c in qemuMonitorSend (mon=0x7fffb00052d0,
> msg=<value optimized out>) at qemu/qemu_monitor.c:907
> #3 0x00007fffea576045 in qemuMonitorJSONCommandWithFd
> (mon=0x7fffb00052d0, cmd=0x7fffb0005c70, scm_fd=-1,
> reply=0x7fffbbffde48) at qemu/qemu_monitor_json.c:263
> #4 0x00007fffea577af1 in qemuMonitorJSONGetCommands
> (mon=0x7fffb00052d0, commands=0x7fffbbffdea8) at
> qemu/qemu_monitor_json.c:3889
> #5 0x00007fffea527ccf in qemuCapsProbeQMPCommands
> (caps=0x7fffb00050c0, mon=<value optimized out>) at
> qemu/qemu_capabilities.c:1927
> #6 0x00007fffea528093 in qemuCapsProbeQMP (caps=0x7fffb00050c0,
> mon=0x7fffb00052d0) at qemu/qemu_capabilities.c:2128
> #7 0x00007fffea553040 in qemuConnectMonitor (driver=0x7fffe4013520,
> vm=0x7fffb0001870) at qemu/qemu_process.c:1322
> #8 0x00007fffea558f94 in qemuProcessWaitForMonitor (driver=<value
> optimized out>, vm=0x7fffb0001870, caps=0x7fffb00050c0, pos=<value
> optimized out>) at qemu/qemu_process.c:1670
> #9 0x00007fffea55aa9a in qemuProcessStart (conn=0x7fffd4007120,
> driver=0x7fffe4013520, vm=0x7fffb0001870, migrateFrom=0x0,
> stdin_fd=-1, stdin_path=0x0, snapshot=0x0,
> vmop=VIR_NETDEV_VPORT_PROFILE_OP_CREATE, flags=1) at
> qemu/qemu_process.c:3824
> #10 0x00007fffea59329c in qemuDomainCreate (conn=0x7fffd4007120,
> xml=<value optimized out>, flags=<value optimized out>) at
> qemu/qemu_driver.c:1701
> #11 0x00007ffff7a76d87 in virDomainCreateXML (conn=0x7fffd4007120,
> xmlDesc=0x7fffb0000ae0 "<domain type=\"kvm\">\n
> <name>cmgmceul</name>\n
> <uuid>6c9d8e5d-9c2b-774c-306c-5f515b25e54b</uuid>\n
> <memory>450560</memory>\n <currentMemory>450560</currentMemory>\n
> <vcpu>2</vcpu>\n <cpu>\n <topology"..., flags=0)
> at libvirt.c:1979
> #12 0x00000000004298a7 in remoteDispatchDomainCreateXML (server=<value
> optimized out>, client=0x686a00, msg=<value optimized out>,
> rerr=0x7fffbbffebc0, args=0x7fffb00f55c0, ret=0x7fffb00f57c0) at
> remote_dispatch.h:1172
> #13 remoteDispatchDomainCreateXMLHelper (server=<value optimized out>,
> client=0x686a00, msg=<value optimized out>, rerr=0x7fffbbffebc0,
> args=0x7fffb00f55c0, ret=0x7fffb00f57c0) at remote_dispatch.h:1152
> #14 0x00007ffff7ad0d02 in virNetServerProgramDispatchCall
> (prog=0x6814d0, server=0x678df0, client=0x686a00, msg=0x690130) at
> rpc/virnetserverprogram.c:431
> #15 virNetServerProgramDispatch (prog=0x6814d0, server=0x678df0,
> client=0x686a00, msg=0x690130) at rpc/virnetserverprogram.c:304
> #16 0x00007ffff7aceaa6 in virNetServerProcessMsg (srv=<value optimized
> out>, client=0x686a00, prog=<value optimized out>, msg=0x690130) at
> rpc/virnetserver.c:173
> #17 0x00007ffff7acf5e3 in virNetServerHandleJob (jobOpaque=<value
> optimized out>, opaque=0x678df0) at rpc/virnetserver.c:194
> #18 0x00007ffff79e8fdc in virThreadPoolWorker (opaque=<value optimized
> out>) at util/threadpool.c:144
> #19 0x00007ffff79e88c9 in virThreadHelper (data=<value optimized out>)
> at util/threads-pthread.c:161
> #20 0x000000300a2077f1 in start_thread () from /lib64/libpthread.so.0
> #21 0x0000003009ae570d in clone () from /lib64/libc.so.6
>
> Thread 14 (Thread 0x7fffe912c700 (LWP 30786)):
> #0 0x000000300a20b3dc in pthread_cond_wait@@GLIBC_2.3.2 () from
> /lib64/libpthread.so.0
> #1 0x00007ffff79e8aa6 in virCondWait (c=<value optimized out>,
> m=<value optimized out>) at util/threads-pthread.c:117
> #2 0x00007ffff79e9073 in virThreadPoolWorker (opaque=<value optimized
> out>) at util/threadpool.c:103
> #3 0x00007ffff79e88c9 in virThreadHelper (data=<value optimized out>)
> at util/threads-pthread.c:161
> #4 0x000000300a2077f1 in start_thread () from /lib64/libpthread.so.0
> #5 0x0000003009ae570d in clone () from /lib64/libc.so.6
>
> Thread 11 (Thread 0x7fffec0cd700 (LWP 29955)):
> #0 0x000000300a20b3dc in pthread_cond_wait@@GLIBC_2.3.2 () from
> /lib64/libpthread.so.0
> #1 0x00007ffff79e8aa6 in virCondWait (c=<value optimized out>,
> m=<value optimized out>) at util/threads-pthread.c:117
> #2 0x00007ffff79e9073 in virThreadPoolWorker (opaque=<value optimized
> out>) at util/threadpool.c:103
> #3 0x00007ffff79e88c9 in virThreadHelper (data=<value optimized out>)
> at util/threads-pthread.c:161
> #4 0x000000300a2077f1 in start_thread () from /lib64/libpthread.so.0
> #5 0x0000003009ae570d in clone () from /lib64/libc.so.6
>
> Thread 10 (Thread 0x7fffecace700 (LWP 29954)):
> #0 0x000000300a20b3dc in pthread_cond_wait@@GLIBC_2.3.2 () from
> /lib64/libpthread.so.0
> #1 0x00007ffff79e8aa6 in virCondWait (c=<value optimized out>,
> m=<value optimized out>) at util/threads-pthread.c:117
> #2 0x00007ffff79e9073 in virThreadPoolWorker (opaque=<value optimized
> out>) at util/threadpool.c:103
> #3 0x00007ffff79e88c9 in virThreadHelper (data=<value optimized out>)
> at util/threads-pthread.c:161
> #4 0x000000300a2077f1 in start_thread () from /lib64/libpthread.so.0
> #5 0x0000003009ae570d in clone () from /lib64/libc.so.6
>
> Thread 9 (Thread 0x7fffed4cf700 (LWP 29953)):
> #0 0x000000300a20b3dc in pthread_cond_wait@@GLIBC_2.3.2 () from
> /lib64/libpthread.so.0
> #1 0x00007ffff79e8aa6 in virCondWait (c=<value optimized out>,
> m=<value optimized out>) at util/threads-pthread.c:117
> #2 0x00007ffff79e9073 in virThreadPoolWorker (opaque=<value optimized
> out>) at util/threadpool.c:103
> #3 0x00007ffff79e88c9 in virThreadHelper (data=<value optimized out>)
> at util/threads-pthread.c:161
> #4 0x000000300a2077f1 in start_thread () from /lib64/libpthread.so.0
> #5 0x0000003009ae570d in clone () from /lib64/libc.so.6
>
> Thread 8 (Thread 0x7fffeded0700 (LWP 29952)):
> #0 0x000000300a20b3dc in pthread_cond_wait@@GLIBC_2.3.2 () from
> /lib64/libpthread.so.0
> #1 0x00007ffff79e8aa6 in virCondWait (c=<value optimized out>,
> m=<value optimized out>) at util/threads-pthread.c:117
> #2 0x00007ffff79e9073 in virThreadPoolWorker (opaque=<value optimized
> out>) at util/threadpool.c:103
> #3 0x00007ffff79e88c9 in virThreadHelper (data=<value optimized out>)
> at util/threads-pthread.c:161
> #4 0x000000300a2077f1 in start_thread () from /lib64/libpthread.so.0
> #5 0x0000003009ae570d in clone () from /lib64/libc.so.6
>
> Thread 7 (Thread 0x7fffee8d1700 (LWP 29951)):
> #0 0x000000300a20b3dc in pthread_cond_wait@@GLIBC_2.3.2 () from
> /lib64/libpthread.so.0
> #1 0x00007ffff79e8aa6 in virCondWait (c=<value optimized out>,
> m=<value optimized out>) at util/threads-pthread.c:117
> #2 0x00007ffff79e9073 in virThreadPoolWorker (opaque=<value optimized
> out>) at util/threadpool.c:103
> #3 0x00007ffff79e88c9 in virThreadHelper (data=<value optimized out>)
> at util/threads-pthread.c:161
> #4 0x000000300a2077f1 in start_thread () from /lib64/libpthread.so.0
> #5 0x0000003009ae570d in clone () from /lib64/libc.so.6
>
> Thread 6 (Thread 0x7fffef2d2700 (LWP 29950)):
> #0 0x0000003009a794a1 in malloc () from /lib64/libc.so.6
> #1 0x0000003009afede8 in __vasprintf_chk () from /lib64/libc.so.6
> #2 0x00007ffff79eb2f4 in vasprintf (strp=<value optimized out>,
> fmt=<value optimized out>, list=<value optimized out>) at
> /usr/include/bits/stdio2.h:199
> #3 virVasprintf (strp=<value optimized out>, fmt=<value optimized
> out>, list=<value optimized out>) at util/util.c:1990
> #4 0x00007ffff79dc97b in virLogVMessage (source=VIR_LOG_FROM_TRACE,
> priority=<value optimized out>, filename=0x7fffea5be5f7
> "qemu/qemu_monitor.c", linenr=904, funcname=0x7fffea5c0d70
> "qemuMonitorSend", metadata=0x0, fmt=0x7fffea5bf300
> "QEMU_MONITOR_SEND_MSG: mon=%p msg=%s fd=%d", vargs=0x7fffef2d1240)
> at util/logging.c:814
> #5 0x00007ffff79dcda9 in virLogMessage (source=<value optimized out>,
> priority=<value optimized out>, filename=<value optimized out>,
> linenr=<value optimized out>, funcname=<value optimized out>,
> metadata=<value optimized out>, fmt=0x7fffea5bf300
> "QEMU_MONITOR_SEND_MSG: mon=%p msg=%s fd=%d") at util/logging.c:751
> #6 0x00007fffea56a935 in qemuMonitorSend (mon=0x7fffc40022d0,
> msg=<value optimized out>) at qemu/qemu_monitor.c:902
> #7 0x00007fffea576045 in qemuMonitorJSONCommandWithFd
> (mon=0x7fffc40022d0, cmd=0x7fffc4032eb0, scm_fd=-1,
> reply=0x7fffef2d1428) at qemu/qemu_monitor_json.c:263
> #8 0x00007fffea57899e in qemuMonitorJSONSetBalloon
> (mon=0x7fffc40022d0, newmem=<value optimized out>) at
> qemu/qemu_monitor_json.c:2067
> #9 0x00007fffea55b540 in qemuProcessStart (conn=0x7fff94003920,
> driver=0x7fffe4013520, vm=<value optimized out>, migrateFrom=0x0,
> stdin_fd=-282258048, stdin_path=0x7fffc4032340 "", snapshot=0x0,
> vmop=VIR_NETDEV_VPORT_PROFILE_OP_CREATE, flags=1) at
> qemu/qemu_process.c:3892
> #10 0x00007fffea59329c in qemuDomainCreate (conn=0x7fff94003920,
> xml=<value optimized out>, flags=<value optimized out>) at
> qemu/qemu_driver.c:1701
> #11 0x00007ffff7a76d87 in virDomainCreateXML (conn=0x7fff94003920,
> xmlDesc=0x7fffc4000f00 "<domain type=\"kvm\">\n
> <name>ezkzoelz</name>\n
> <uuid>f9d6d86b-b75a-91df-6cc8-05236d2b4750</uuid>\n
> <memory>450560</memory>\n <currentMemory>450560</currentMemory>\n
> <vcpu>2</vcpu>\n <cpu>\n <topology"..., flags=0)
> at libvirt.c:1979
> #12 0x00000000004298a7 in remoteDispatchDomainCreateXML (server=<value
> optimized out>, client=0x68c7d0, msg=<value optimized out>,
> rerr=0x7fffef2d1bc0, args=0x7fffc4000e70, ret=0x7fffc4000ed0) at
> remote_dispatch.h:1172
> #13 remoteDispatchDomainCreateXMLHelper (server=<value optimized out>,
> client=0x68c7d0, msg=<value optimized out>, rerr=0x7fffef2d1bc0,
> args=0x7fffc4000e70, ret=0x7fffc4000ed0) at remote_dispatch.h:1152
> #14 0x00007ffff7ad0d02 in virNetServerProgramDispatchCall
> (prog=0x6814d0, server=0x678df0, client=0x68c7d0, msg=0x687b00) at
> rpc/virnetserverprogram.c:431
> #15 virNetServerProgramDispatch (prog=0x6814d0, server=0x678df0,
> client=0x68c7d0, msg=0x687b00) at rpc/virnetserverprogram.c:304
> #16 0x00007ffff7aceaa6 in virNetServerProcessMsg (srv=<value optimized
> out>, client=0x68c7d0, prog=<value optimized out>, msg=0x687b00) at
> rpc/virnetserver.c:173
> #17 0x00007ffff7acf5e3 in virNetServerHandleJob (jobOpaque=<value
> optimized out>, opaque=0x678df0) at rpc/virnetserver.c:194
> #18 0x00007ffff79e8fdc in virThreadPoolWorker (opaque=<value optimized
> out>) at util/threadpool.c:144
> #19 0x00007ffff79e88c9 in virThreadHelper (data=<value optimized out>)
> at util/threads-pthread.c:161
> #20 0x000000300a2077f1 in start_thread () from /lib64/libpthread.so.0
> #21 0x0000003009ae570d in clone () from /lib64/libc.so.6
>
> Thread 5 (Thread 0x7fffefcd3700 (LWP 29949)):
> #0 0x000000300a20b3dc in pthread_cond_wait@@GLIBC_2.3.2 () from
> /lib64/libpthread.so.0
> #1 0x00007ffff79e8aa6 in virCondWait (c=<value optimized out>,
> m=<value optimized out>) at util/threads-pthread.c:117
> #2 0x00007ffff79e9073 in virThreadPoolWorker (opaque=<value optimized
> out>) at util/threadpool.c:103
> #3 0x00007ffff79e88c9 in virThreadHelper (data=<value optimized out>)
> at util/threads-pthread.c:161
> #4 0x000000300a2077f1 in start_thread () from /lib64/libpthread.so.0
> #5 0x0000003009ae570d in clone () from /lib64/libc.so.6
>
> Thread 4 (Thread 0x7ffff06d4700 (LWP 29948)):
> #0 0x000000300a20b3dc in pthread_cond_wait@@GLIBC_2.3.2 () from
> /lib64/libpthread.so.0
> #1 0x00007ffff79e8aa6 in virCondWait (c=<value optimized out>,
> m=<value optimized out>) at util/threads-pthread.c:117
> #2 0x00007ffff79e9073 in virThreadPoolWorker (opaque=<value optimized
> out>) at util/threadpool.c:103
> #3 0x00007ffff79e88c9 in virThreadHelper (data=<value optimized out>)
> at util/threads-pthread.c:161
> #4 0x000000300a2077f1 in start_thread () from /lib64/libpthread.so.0
> #5 0x0000003009ae570d in clone () from /lib64/libc.so.6
>
> Thread 3 (Thread 0x7ffff10d5700 (LWP 29947)):
> #0 0x000000300a20b3dc in pthread_cond_wait@@GLIBC_2.3.2 () from
> /lib64/libpthread.so.0
> #1 0x00007ffff79e8aa6 in virCondWait (c=<value optimized out>,
> m=<value optimized out>) at util/threads-pthread.c:117
> #2 0x00007ffff79e9073 in virThreadPoolWorker (opaque=<value optimized
> out>) at util/threadpool.c:103
> #3 0x00007ffff79e88c9 in virThreadHelper (data=<value optimized out>)
> at util/threads-pthread.c:161
> #4 0x000000300a2077f1 in start_thread () from /lib64/libpthread.so.0
> #5 0x0000003009ae570d in clone () from /lib64/libc.so.6
>
> Thread 2 (Thread 0x7ffff1ad6700 (LWP 29946)):
> #0 0x000000300a20b3dc in pthread_cond_wait@@GLIBC_2.3.2 () from
> /lib64/libpthread.so.0
> #1 0x00007ffff79e8aa6 in virCondWait (c=<value optimized out>,
> m=<value optimized out>) at util/threads-pthread.c:117
> #2 0x00007fffea56a97c in qemuMonitorSend (mon=0x7fffcc005480,
> msg=<value optimized out>) at qemu/qemu_monitor.c:907
> #3 0x00007fffea576045 in qemuMonitorJSONCommandWithFd
> (mon=0x7fffcc005480, cmd=0x7fffcc003900, scm_fd=-1,
> reply=0x7ffff1ad53b0) at qemu/qemu_monitor_json.c:263
> #4 0x00007fffea57ca92 in qemuMonitorJSONGetCPUInfo
> (mon=0x7fffcc005480, pids=0x7ffff1ad5418) at
> qemu/qemu_monitor_json.c:1261
> #5 0x00007fffea55551a in qemuProcessDetectVcpuPIDs
> (driver=0x7fffe4013520, vm=0x7fffcc000d20) at qemu/qemu_process.c:1728
> #6 0x00007fffea55aaef in qemuProcessStart (conn=0x7fffc80824b0,
> driver=0x7fffe4013520, vm=0x7fffcc000d20, migrateFrom=0x0,
> stdin_fd=-1, stdin_path=0x0, snapshot=0x0,
> vmop=VIR_NETDEV_VPORT_PROFILE_OP_CREATE, flags=1) at
> qemu/qemu_process.c:3836
> #7 0x00007fffea59329c in qemuDomainCreate (conn=0x7fffc80824b0,
> xml=<value optimized out>, flags=<value optimized out>) at
> qemu/qemu_driver.c:1701
> #8 0x00007ffff7a76d87 in virDomainCreateXML (conn=0x7fffc80824b0,
> xmlDesc=0x7fffcc001820 "<domain type=\"kvm\">\n
> <name>vfkgfkgc</name>\n
> <uuid>d926a1a9-6a42-312b-ded8-4512c9328e8c</uuid>\n
> <memory>450560</memory>\n <currentMemory>450560</currentMemory>\n
> <vcpu>2</vcpu>\n <cpu>\n <topology"..., flags=0)
> at libvirt.c:1979
> #9 0x00000000004298a7 in remoteDispatchDomainCreateXML (server=<value
> optimized out>, client=0x687b70, msg=<value optimized out>,
> rerr=0x7ffff1ad5bc0, args=0x7fffcc001fc0, ret=0x7fffcc002020) at
> remote_dispatch.h:1172
> #10 remoteDispatchDomainCreateXMLHelper (server=<value optimized out>,
> client=0x687b70, msg=<value optimized out>, rerr=0x7ffff1ad5bc0,
> args=0x7fffcc001fc0, ret=0x7fffcc002020) at remote_dispatch.h:1152
> #11 0x00007ffff7ad0d02 in virNetServerProgramDispatchCall
> (prog=0x6814d0, server=0x678df0, client=0x687b70, msg=0x686c60) at
> rpc/virnetserverprogram.c:431
> #12 virNetServerProgramDispatch (prog=0x6814d0, server=0x678df0,
> client=0x687b70, msg=0x686c60) at rpc/virnetserverprogram.c:304
> #13 0x00007ffff7aceaa6 in virNetServerProcessMsg (srv=<value optimized
> out>, client=0x687b70, prog=<value optimized out>, msg=0x686c60) at
> rpc/virnetserver.c:173
> #14 0x00007ffff7acf5e3 in virNetServerHandleJob (jobOpaque=<value
> optimized out>, opaque=0x678df0) at rpc/virnetserver.c:194
> #15 0x00007ffff79e8fdc in virThreadPoolWorker (opaque=<value optimized
> out>) at util/threadpool.c:144
> #16 0x00007ffff79e88c9 in virThreadHelper (data=<value optimized out>)
> at util/threads-pthread.c:161
> #17 0x000000300a2077f1 in start_thread () from /lib64/libpthread.so.0
> #18 0x0000003009ae570d in clone () from /lib64/libc.so.6
>
> Thread 1 (Thread 0x7ffff7968800 (LWP 29943)):
> #0 0x000000300a20e48d in write () from /lib64/libpthread.so.0
> #1 0x00007ffff7adb47e in virNetSocketWriteWire (sock=0x685af0,
> buf=0x1e90690 "", len=36) at rpc/virnetsocket.c:1344
> #2 0x00007ffff7adb67e in virNetSocketWrite (sock=0x685af0,
> buf=0x1e90690 "", len=36) at rpc/virnetsocket.c:1490
> #3 0x00007ffff7acb3d6 in virNetServerClientWrite (sock=<value
> optimized out>, events=11, opaque=0x68a7e0) at
> rpc/virnetserverclient.c:1095
> #4 virNetServerClientDispatchWrite (sock=<value optimized out>,
> events=11, opaque=0x68a7e0) at rpc/virnetserverclient.c:1116
> #5 virNetServerClientDispatchEvent (sock=<value optimized out>,
> events=11, opaque=0x68a7e0) at rpc/virnetserverclient.c:1227
> #6 0x00007ffff79d6305 in virEventPollDispatchHandles () at
> util/event_poll.c:500
> #7 virEventPollRunOnce () at util/event_poll.c:647
> #8 0x00007ffff79d4ecd in virEventRunDefaultImpl () at util/event.c:247
> #9 0x00007ffff7ace275 in virNetServerRun (srv=0x678df0) at
> rpc/virnetserver.c:1121
> #10 0x000000000040c76a in main (argc=<value optimized out>,
> argv=<value optimized out>) at libvirtd.c:1449
> (gdb)
>
> This appears to maybe be a different issue? I am going to start
> another test run now.
I have just now received another SIGSEGV, with your patch applied.
Here's the info from the GDB session:
Detaching after fork from child process 11266.
2012-12-28 18:56:53.261+0000: 29943: error : qemuMonitorIO:614 :
internal error End of file from monitor
Program received signal SIGSEGV, Segmentation fault.
[Switching to Thread 0x7fffec0cd700 (LWP 29955)]
qemuDomainObjBeginJobInternal (driver=0x7fffe4013520,
driver_locked=true, obj=0x7fff7801fc80, job=QEMU_JOB_DESTROY,
asyncJob=QEMU_ASYNC_JOB_NONE) at qemu/qemu_domain.c:780
780 priv->jobs_queued++;
(gdb) bt
#0 qemuDomainObjBeginJobInternal (driver=0x7fffe4013520,
driver_locked=true, obj=0x7fff7801fc80, job=QEMU_JOB_DESTROY,
asyncJob=QEMU_ASYNC_JOB_NONE) at qemu/qemu_domain.c:780
#1 0x00007fffea599f46 in qemuDomainDestroyFlags (dom=<value optimized
out>, flags=<value optimized out>) at qemu/qemu_driver.c:2189
#2 0x00007ffff7a83587 in virDomainDestroy (domain=0x7fffe414a510) at
libvirt.c:2215
#3 0x00000000004296e2 in remoteDispatchDomainDestroy (server=<value
optimized out>, client=<value optimized out>, msg=<value optimized out>,
rerr=0x7fffec0ccbc0, args=<value optimized out>, ret=<value optimized
out>) at remote_dispatch.h:1277
#4 remoteDispatchDomainDestroyHelper (server=<value optimized out>,
client=<value optimized out>, msg=<value optimized out>,
rerr=0x7fffec0ccbc0, args=<value optimized out>, ret=<value optimized
out>) at remote_dispatch.h:1255
#5 0x00007ffff7ad0d02 in virNetServerProgramDispatchCall
(prog=0x6814d0, server=0x678df0, client=0x693a80, msg=0x6986d0) at
rpc/virnetserverprogram.c:431
#6 virNetServerProgramDispatch (prog=0x6814d0, server=0x678df0,
client=0x693a80, msg=0x6986d0) at rpc/virnetserverprogram.c:304
#7 0x00007ffff7aceaa6 in virNetServerProcessMsg (srv=<value optimized
out>, client=0x693a80, prog=<value optimized out>, msg=0x6986d0) at
rpc/virnetserver.c:173
#8 0x00007ffff7acf5e3 in virNetServerHandleJob (jobOpaque=<value
optimized out>, opaque=0x678df0) at rpc/virnetserver.c:194
#9 0x00007ffff79e8fdc in virThreadPoolWorker (opaque=<value optimized
out>) at util/threadpool.c:144
#10 0x00007ffff79e88c9 in virThreadHelper (data=<value optimized out>)
at util/threads-pthread.c:161
#11 0x000000300a2077f1 in start_thread () from /lib64/libpthread.so.0
#12 0x0000003009ae570d in clone () from /lib64/libc.so.6
(gdb)
(gdb) thread apply all bt
Thread 28 (Thread 0x7fff86bfd700 (LWP 2038)):
#0 0x000000300a20b3dc in pthread_cond_wait@@GLIBC_2.3.2 () from
/lib64/libpthread.so.0
#1 0x00007ffff79e8aa6 in virCondWait (c=<value optimized out>, m=<value
optimized out>) at util/threads-pthread.c:117
#2 0x00007ffff79e9073 in virThreadPoolWorker (opaque=<value optimized
out>) at util/threadpool.c:103
#3 0x00007ffff79e88c9 in virThreadHelper (data=<value optimized out>)
at util/threads-pthread.c:161
#4 0x000000300a2077f1 in start_thread () from /lib64/libpthread.so.0
#5 0x0000003009ae570d in clone () from /lib64/libc.so.6
Thread 27 (Thread 0x7fff875fe700 (LWP 32222)):
#0 0x000000300a20b3dc in pthread_cond_wait@@GLIBC_2.3.2 () from
/lib64/libpthread.so.0
#1 0x00007ffff79e8aa6 in virCondWait (c=<value optimized out>, m=<value
optimized out>) at util/threads-pthread.c:117
#2 0x00007ffff79e9073 in virThreadPoolWorker (opaque=<value optimized
out>) at util/threadpool.c:103
#3 0x00007ffff79e88c9 in virThreadHelper (data=<value optimized out>)
at util/threads-pthread.c:161
#4 0x000000300a2077f1 in start_thread () from /lib64/libpthread.so.0
#5 0x0000003009ae570d in clone () from /lib64/libc.so.6
Thread 26 (Thread 0x7fff87fff700 (LWP 31895)):
#0 0x000000300a20b3dc in pthread_cond_wait@@GLIBC_2.3.2 () from
/lib64/libpthread.so.0
#1 0x00007ffff79e8aa6 in virCondWait (c=<value optimized out>, m=<value
optimized out>) at util/threads-pthread.c:117
#2 0x00007ffff79e9073 in virThreadPoolWorker (opaque=<value optimized
out>) at util/threadpool.c:103
#3 0x00007ffff79e88c9 in virThreadHelper (data=<value optimized out>)
at util/threads-pthread.c:161
#4 0x000000300a2077f1 in start_thread () from /lib64/libpthread.so.0
#5 0x0000003009ae570d in clone () from /lib64/libc.so.6
Thread 25 (Thread 0x7fffb8dfa700 (LWP 31894)):
#0 0x000000300a20b3dc in pthread_cond_wait@@GLIBC_2.3.2 () from
/lib64/libpthread.so.0
#1 0x00007ffff79e8aa6 in virCondWait (c=<value optimized out>, m=<value
optimized out>) at util/threads-pthread.c:117
#2 0x00007ffff79e9073 in virThreadPoolWorker (opaque=<value optimized
out>) at util/threadpool.c:103
#3 0x00007ffff79e88c9 in virThreadHelper (data=<value optimized out>)
at util/threads-pthread.c:161
#4 0x000000300a2077f1 in start_thread () from /lib64/libpthread.so.0
#5 0x0000003009ae570d in clone () from /lib64/libc.so.6
Thread 24 (Thread 0x7fffb97fb700 (LWP 31893)):
#0 0x000000300a20b3dc in pthread_cond_wait@@GLIBC_2.3.2 () from
/lib64/libpthread.so.0
#1 0x00007ffff79e8aa6 in virCondWait (c=<value optimized out>, m=<value
optimized out>) at util/threads-pthread.c:117
#2 0x00007ffff79e9073 in virThreadPoolWorker (opaque=<value optimized
out>) at util/threadpool.c:103
#3 0x00007ffff79e88c9 in virThreadHelper (data=<value optimized out>)
at util/threads-pthread.c:161
#4 0x000000300a2077f1 in start_thread () from /lib64/libpthread.so.0
#5 0x0000003009ae570d in clone () from /lib64/libc.so.6
Thread 23 (Thread 0x7fffba1fc700 (LWP 31659)):
#0 0x000000300a20b3dc in pthread_cond_wait@@GLIBC_2.3.2 () from
/lib64/libpthread.so.0
#1 0x00007ffff79e8aa6 in virCondWait (c=<value optimized out>, m=<value
optimized out>) at util/threads-pthread.c:117
#2 0x00007ffff79e9073 in virThreadPoolWorker (opaque=<value optimized
out>) at util/threadpool.c:103
#3 0x00007ffff79e88c9 in virThreadHelper (data=<value optimized out>)
at util/threads-pthread.c:161
#4 0x000000300a2077f1 in start_thread () from /lib64/libpthread.so.0
#5 0x0000003009ae570d in clone () from /lib64/libc.so.6
Thread 22 (Thread 0x7fffbabfd700 (LWP 31562)):
#0 0x000000300a20b3dc in pthread_cond_wait@@GLIBC_2.3.2 () from
/lib64/libpthread.so.0
#1 0x00007ffff79e8aa6 in virCondWait (c=<value optimized out>, m=<value
optimized out>) at util/threads-pthread.c:117
#2 0x00007ffff79e9073 in virThreadPoolWorker (opaque=<value optimized
out>) at util/threadpool.c:103
#3 0x00007ffff79e88c9 in virThreadHelper (data=<value optimized out>)
at util/threads-pthread.c:161
#4 0x000000300a2077f1 in start_thread () from /lib64/libpthread.so.0
#5 0x0000003009ae570d in clone () from /lib64/libc.so.6
Thread 21 (Thread 0x7fffbb5fe700 (LWP 31555)):
#0 0x000000300a20b3dc in pthread_cond_wait@@GLIBC_2.3.2 () from
/lib64/libpthread.so.0
#1 0x00007ffff79e8aa6 in virCondWait (c=<value optimized out>, m=<value
optimized out>) at util/threads-pthread.c:117
#2 0x00007ffff79e9073 in virThreadPoolWorker (opaque=<value optimized
out>) at util/threadpool.c:103
#3 0x00007ffff79e88c9 in virThreadHelper (data=<value optimized out>)
at util/threads-pthread.c:161
#4 0x000000300a2077f1 in start_thread () from /lib64/libpthread.so.0
#5 0x0000003009ae570d in clone () from /lib64/libc.so.6
Thread 20 (Thread 0x7fffe0dfa700 (LWP 31452)):
#0 0x000000300a20b3dc in pthread_cond_wait@@GLIBC_2.3.2 () from
/lib64/libpthread.so.0
#1 0x00007ffff79e8aa6 in virCondWait (c=<value optimized out>, m=<value
optimized out>) at util/threads-pthread.c:117
#2 0x00007ffff79e9073 in virThreadPoolWorker (opaque=<value optimized
out>) at util/threadpool.c:103
#3 0x00007ffff79e88c9 in virThreadHelper (data=<value optimized out>)
at util/threads-pthread.c:161
#4 0x000000300a2077f1 in start_thread () from /lib64/libpthread.so.0
#5 0x0000003009ae570d in clone () from /lib64/libc.so.6
Thread 19 (Thread 0x7fffe17fb700 (LWP 31315)):
#0 0x000000300a20b3dc in pthread_cond_wait@@GLIBC_2.3.2 () from
/lib64/libpthread.so.0
#1 0x00007ffff79e8aa6 in virCondWait (c=<value optimized out>, m=<value
optimized out>) at util/threads-pthread.c:117
#2 0x00007ffff79e9073 in virThreadPoolWorker (opaque=<value optimized
out>) at util/threadpool.c:103
#3 0x00007ffff79e88c9 in virThreadHelper (data=<value optimized out>)
at util/threads-pthread.c:161
#4 0x000000300a2077f1 in start_thread () from /lib64/libpthread.so.0
#5 0x0000003009ae570d in clone () from /lib64/libc.so.6
Thread 18 (Thread 0x7fffe21fc700 (LWP 31128)):
#0 0x000000300a20b3dc in pthread_cond_wait@@GLIBC_2.3.2 () from
/lib64/libpthread.so.0
#1 0x00007ffff79e8aa6 in virCondWait (c=<value optimized out>, m=<value
optimized out>) at util/threads-pthread.c:117
#2 0x00007ffff79e9073 in virThreadPoolWorker (opaque=<value optimized
out>) at util/threadpool.c:103
#3 0x00007ffff79e88c9 in virThreadHelper (data=<value optimized out>)
at util/threads-pthread.c:161
#4 0x000000300a2077f1 in start_thread () from /lib64/libpthread.so.0
#5 0x0000003009ae570d in clone () from /lib64/libc.so.6
Thread 17 (Thread 0x7fffe2bfd700 (LWP 30991)):
#0 0x000000300a20b3dc in pthread_cond_wait@@GLIBC_2.3.2 () from
/lib64/libpthread.so.0
#1 0x00007ffff79e8aa6 in virCondWait (c=<value optimized out>, m=<value
optimized out>) at util/threads-pthread.c:117
#2 0x00007ffff79e9073 in virThreadPoolWorker (opaque=<value optimized
out>) at util/threadpool.c:103
#3 0x00007ffff79e88c9 in virThreadHelper (data=<value optimized out>)
at util/threads-pthread.c:161
#4 0x000000300a2077f1 in start_thread () from /lib64/libpthread.so.0
#5 0x0000003009ae570d in clone () from /lib64/libc.so.6
Thread 16 (Thread 0x7fffe35fe700 (LWP 30801)):
#0 0x000000300a20b3dc in pthread_cond_wait@@GLIBC_2.3.2 () from
/lib64/libpthread.so.0
#1 0x00007ffff79e8aa6 in virCondWait (c=<value optimized out>, m=<value
optimized out>) at util/threads-pthread.c:117
#2 0x00007ffff79e9073 in virThreadPoolWorker (opaque=<value optimized
out>) at util/threadpool.c:103
#3 0x00007ffff79e88c9 in virThreadHelper (data=<value optimized out>)
at util/threads-pthread.c:161
#4 0x000000300a2077f1 in start_thread () from /lib64/libpthread.so.0
#5 0x0000003009ae570d in clone () from /lib64/libc.so.6
Thread 15 (Thread 0x7fffbbfff700 (LWP 30790)):
#0 0x000000300a20b3dc in pthread_cond_wait@@GLIBC_2.3.2 () from
/lib64/libpthread.so.0
#1 0x00007ffff79e8aa6 in virCondWait (c=<value optimized out>, m=<value
optimized out>) at util/threads-pthread.c:117
#2 0x00007ffff79e9073 in virThreadPoolWorker (opaque=<value optimized
out>) at util/threadpool.c:103
#3 0x00007ffff79e88c9 in virThreadHelper (data=<value optimized out>)
at util/threads-pthread.c:161
#4 0x000000300a2077f1 in start_thread () from /lib64/libpthread.so.0
#5 0x0000003009ae570d in clone () from /lib64/libc.so.6
Thread 14 (Thread 0x7fffe912c700 (LWP 30786)):
#0 0x000000300a20b3dc in pthread_cond_wait@@GLIBC_2.3.2 () from
/lib64/libpthread.so.0
#1 0x00007ffff79e8aa6 in virCondWait (c=<value optimized out>, m=<value
optimized out>) at util/threads-pthread.c:117
#2 0x00007ffff79e9073 in virThreadPoolWorker (opaque=<value optimized
out>) at util/threadpool.c:103
#3 0x00007ffff79e88c9 in virThreadHelper (data=<value optimized out>)
at util/threads-pthread.c:161
#4 0x000000300a2077f1 in start_thread () from /lib64/libpthread.so.0
#5 0x0000003009ae570d in clone () from /lib64/libc.so.6
Thread 11 (Thread 0x7fffec0cd700 (LWP 29955)):
#0 qemuDomainObjBeginJobInternal (driver=0x7fffe4013520,
driver_locked=true, obj=0x7fff7801fc80, job=QEMU_JOB_DESTROY,
asyncJob=QEMU_ASYNC_JOB_NONE) at qemu/qemu_domain.c:780
#1 0x00007fffea599f46 in qemuDomainDestroyFlags (dom=<value optimized
out>, flags=<value optimized out>) at qemu/qemu_driver.c:2189
#2 0x00007ffff7a83587 in virDomainDestroy (domain=0x7fffe414a510) at
libvirt.c:2215
#3 0x00000000004296e2 in remoteDispatchDomainDestroy (server=<value
optimized out>, client=<value optimized out>, msg=<value optimized out>,
rerr=0x7fffec0ccbc0, args=<value optimized out>, ret=<value optimized
out>) at remote_dispatch.h:1277
#4 remoteDispatchDomainDestroyHelper (server=<value optimized out>,
client=<value optimized out>, msg=<value optimized out>,
rerr=0x7fffec0ccbc0, args=<value optimized out>, ret=<value optimized
out>) at remote_dispatch.h:1255
#5 0x00007ffff7ad0d02 in virNetServerProgramDispatchCall
(prog=0x6814d0, server=0x678df0, client=0x693a80, msg=0x6986d0) at
rpc/virnetserverprogram.c:431
#6 virNetServerProgramDispatch (prog=0x6814d0, server=0x678df0,
client=0x693a80, msg=0x6986d0) at rpc/virnetserverprogram.c:304
#7 0x00007ffff7aceaa6 in virNetServerProcessMsg (srv=<value optimized
out>, client=0x693a80, prog=<value optimized out>, msg=0x6986d0) at
rpc/virnetserver.c:173
#8 0x00007ffff7acf5e3 in virNetServerHandleJob (jobOpaque=<value
optimized out>, opaque=0x678df0) at rpc/virnetserver.c:194
#9 0x00007ffff79e8fdc in virThreadPoolWorker (opaque=<value optimized
out>) at util/threadpool.c:144
#10 0x00007ffff79e88c9 in virThreadHelper (data=<value optimized out>)
at util/threads-pthread.c:161
#11 0x000000300a2077f1 in start_thread () from /lib64/libpthread.so.0
#12 0x0000003009ae570d in clone () from /lib64/libc.so.6
Thread 10 (Thread 0x7fffecace700 (LWP 29954)):
#0 0x000000300a20b3dc in pthread_cond_wait@@GLIBC_2.3.2 () from
/lib64/libpthread.so.0
#1 0x00007ffff79e8aa6 in virCondWait (c=<value optimized out>, m=<value
optimized out>) at util/threads-pthread.c:117
#2 0x00007ffff79e9073 in virThreadPoolWorker (opaque=<value optimized
out>) at util/threadpool.c:103
#3 0x00007ffff79e88c9 in virThreadHelper (data=<value optimized out>)
at util/threads-pthread.c:161
#4 0x000000300a2077f1 in start_thread () from /lib64/libpthread.so.0
#5 0x0000003009ae570d in clone () from /lib64/libc.so.6
Thread 9 (Thread 0x7fffed4cf700 (LWP 29953)):
#0 0x000000300a20b3dc in pthread_cond_wait@@GLIBC_2.3.2 () from
/lib64/libpthread.so.0
#1 0x00007ffff79e8aa6 in virCondWait (c=<value optimized out>, m=<value
optimized out>) at util/threads-pthread.c:117
#2 0x00007ffff79e9073 in virThreadPoolWorker (opaque=<value optimized
out>) at util/threadpool.c:103
#3 0x00007ffff79e88c9 in virThreadHelper (data=<value optimized out>)
at util/threads-pthread.c:161
#4 0x000000300a2077f1 in start_thread () from /lib64/libpthread.so.0
#5 0x0000003009ae570d in clone () from /lib64/libc.so.6
Thread 8 (Thread 0x7fffeded0700 (LWP 29952)):
#0 0x000000300a20b3dc in pthread_cond_wait@@GLIBC_2.3.2 () from
/lib64/libpthread.so.0
#1 0x00007ffff79e8aa6 in virCondWait (c=<value optimized out>, m=<value
optimized out>) at util/threads-pthread.c:117
#2 0x00007ffff79e9073 in virThreadPoolWorker (opaque=<value optimized
out>) at util/threadpool.c:103
#3 0x00007ffff79e88c9 in virThreadHelper (data=<value optimized out>)
at util/threads-pthread.c:161
#4 0x000000300a2077f1 in start_thread () from /lib64/libpthread.so.0
#5 0x0000003009ae570d in clone () from /lib64/libc.so.6
Thread 7 (Thread 0x7fffee8d1700 (LWP 29951)):
#0 0x000000300a20b3dc in pthread_cond_wait@@GLIBC_2.3.2 () from
/lib64/libpthread.so.0
#1 0x00007ffff79e8aa6 in virCondWait (c=<value optimized out>, m=<value
optimized out>) at util/threads-pthread.c:117
#2 0x00007ffff79e9073 in virThreadPoolWorker (opaque=<value optimized
out>) at util/threadpool.c:103
#3 0x00007ffff79e88c9 in virThreadHelper (data=<value optimized out>)
at util/threads-pthread.c:161
#4 0x000000300a2077f1 in start_thread () from /lib64/libpthread.so.0
#5 0x0000003009ae570d in clone () from /lib64/libc.so.6
Thread 6 (Thread 0x7fffef2d2700 (LWP 29950)):
#0 0x000000300a20b3dc in pthread_cond_wait@@GLIBC_2.3.2 () from
/lib64/libpthread.so.0
#1 0x00007ffff79e8aa6 in virCondWait (c=<value optimized out>, m=<value
optimized out>) at util/threads-pthread.c:117
#2 0x00007ffff79e9073 in virThreadPoolWorker (opaque=<value optimized
out>) at util/threadpool.c:103
#1 0x00007ffff79e8aa6 in virCondWait (c=<value optimized out>, m=<value
optimized out>) at util/threads-pthread.c:117
#2 0x00007ffff79e9073 in virThreadPoolWorker (opaque=<value optimized
out>) at util/threadpool.c:103
#3 0x00007ffff79e88c9 in virThreadHelper (data=<value optimized out>)
at util/threads-pthread.c:161
#4 0x000000300a2077f1 in start_thread () from /lib64/libpthread.so.0
#5 0x0000003009ae570d in clone () from /lib64/libc.so.6
Thread 9 (Thread 0x7fffed4cf700 (LWP 29953)):
#0 0x000000300a20b3dc in pthread_cond_wait@@GLIBC_2.3.2 () from
/lib64/libpthread.so.0
#1 0x00007ffff79e8aa6 in virCondWait (c=<value optimized out>, m=<value
optimized out>) at util/threads-pthread.c:117
#2 0x00007ffff79e9073 in virThreadPoolWorker (opaque=<value optimized
out>) at util/threadpool.c:103
#3 0x00007ffff79e88c9 in virThreadHelper (data=<value optimized out>)
at util/threads-pthread.c:161
#4 0x000000300a2077f1 in start_thread () from /lib64/libpthread.so.0
#5 0x0000003009ae570d in clone () from /lib64/libc.so.6
Thread 8 (Thread 0x7fffeded0700 (LWP 29952)):
#0 0x000000300a20b3dc in pthread_cond_wait@@GLIBC_2.3.2 () from
/lib64/libpthread.so.0
#1 0x00007ffff79e8aa6 in virCondWait (c=<value optimized out>, m=<value
optimized out>) at util/threads-pthread.c:117
#2 0x00007ffff79e9073 in virThreadPoolWorker (opaque=<value optimized
out>) at util/threadpool.c:103
#3 0x00007ffff79e88c9 in virThreadHelper (data=<value optimized out>)
at util/threads-pthread.c:161
#4 0x000000300a2077f1 in start_thread () from /lib64/libpthread.so.0
#5 0x0000003009ae570d in clone () from /lib64/libc.so.6
Thread 7 (Thread 0x7fffee8d1700 (LWP 29951)):
#0 0x000000300a20b3dc in pthread_cond_wait@@GLIBC_2.3.2 () from
/lib64/libpthread.so.0
#1 0x00007ffff79e8aa6 in virCondWait (c=<value optimized out>, m=<value
optimized out>) at util/threads-pthread.c:117
#2 0x00007ffff79e9073 in virThreadPoolWorker (opaque=<value optimized
out>) at util/threadpool.c:103
#3 0x00007ffff79e88c9 in virThreadHelper (data=<value optimized out>)
at util/threads-pthread.c:161
#4 0x000000300a2077f1 in start_thread () from /lib64/libpthread.so.0
#5 0x0000003009ae570d in clone () from /lib64/libc.so.6
Thread 6 (Thread 0x7fffef2d2700 (LWP 29950)):
#0 0x000000300a20b3dc in pthread_cond_wait@@GLIBC_2.3.2 () from
/lib64/libpthread.so.0
#1 0x00007ffff79e8aa6 in virCondWait (c=<value optimized out>, m=<value
optimized out>) at util/threads-pthread.c:117
#2 0x00007ffff79e9073 in virThreadPoolWorker (opaque=<value optimized
out>) at util/threadpool.c:103
---Type <return> to continue, or q <return> to quit---
#3 0x00007ffff79e88c9 in virThreadHelper (data=<value optimized out>)
at util/threads-pthread.c:161
#4 0x000000300a2077f1 in start_thread () from /lib64/libpthread.so.0
#5 0x0000003009ae570d in clone () from /lib64/libc.so.6
Thread 5 (Thread 0x7fffefcd3700 (LWP 29949)):
#0 0x000000300a20b3dc in pthread_cond_wait@@GLIBC_2.3.2 () from
/lib64/libpthread.so.0
#1 0x00007ffff79e8aa6 in virCondWait (c=<value optimized out>, m=<value
optimized out>) at util/threads-pthread.c:117
#2 0x00007ffff79e9073 in virThreadPoolWorker (opaque=<value optimized
out>) at util/threadpool.c:103
#3 0x00007ffff79e88c9 in virThreadHelper (data=<value optimized out>)
at util/threads-pthread.c:161
#4 0x000000300a2077f1 in start_thread () from /lib64/libpthread.so.0
#5 0x0000003009ae570d in clone () from /lib64/libc.so.6
Thread 4 (Thread 0x7ffff06d4700 (LWP 29948)):
#0 0x000000300a20b3dc in pthread_cond_wait@@GLIBC_2.3.2 () from
/lib64/libpthread.so.0
#1 0x00007ffff79e8aa6 in virCondWait (c=<value optimized out>, m=<value
optimized out>) at util/threads-pthread.c:117
#2 0x00007ffff79e9073 in virThreadPoolWorker (opaque=<value optimized
out>) at util/threadpool.c:103
#3 0x00007ffff79e88c9 in virThreadHelper (data=<value optimized out>)
at util/threads-pthread.c:161
#4 0x000000300a2077f1 in start_thread () from /lib64/libpthread.so.0
#5 0x0000003009ae570d in clone () from /lib64/libc.so.6
Thread 3 (Thread 0x7ffff10d5700 (LWP 29947)):
#0 0x000000300a20b3dc in pthread_cond_wait@@GLIBC_2.3.2 () from
/lib64/libpthread.so.0
#1 0x00007ffff79e8aa6 in virCondWait (c=<value optimized out>, m=<value
optimized out>) at util/threads-pthread.c:117
#2 0x00007ffff79e9073 in virThreadPoolWorker (opaque=<value optimized
out>) at util/threadpool.c:103
#3 0x00007ffff79e88c9 in virThreadHelper (data=<value optimized out>)
at util/threads-pthread.c:161
#4 0x000000300a2077f1 in start_thread () from /lib64/libpthread.so.0
#5 0x0000003009ae570d in clone () from /lib64/libc.so.6
Thread 2 (Thread 0x7ffff1ad6700 (LWP 29946)):
#0 0x000000300a20b3dc in pthread_cond_wait@@GLIBC_2.3.2 () from
/lib64/libpthread.so.0
#1 0x00007ffff79e8aa6 in virCondWait (c=<value optimized out>, m=<value
optimized out>) at util/threads-pthread.c:117
#2 0x00007ffff79e9073 in virThreadPoolWorker (opaque=<value optimized
out>) at util/threadpool.c:103
#3 0x00007ffff79e88c9 in virThreadHelper (data=<value optimized out>)
at util/threads-pthread.c:161
#4 0x000000300a2077f1 in start_thread () from /lib64/libpthread.so.0
#5 0x0000003009ae570d in clone () from /lib64/libc.so.6
Thread 1 (Thread 0x7ffff7968800 (LWP 29943)):
#0 0x0000003009a4691a in vfprintf () from /lib64/libc.so.6
#1 0x0000003009afc970 in __vsnprintf_chk () from /lib64/libc.so.6
#2 0x0000003009afc8aa in __snprintf_chk () from /lib64/libc.so.6
#3 0x00007ffff7a0788a in snprintf (when=<value optimized out>,
buf=0x7fffffffd450 "2012-12-28 18:56:53.264+0000") at
/usr/include/bits/stdio2.h:65
#4 virTimeStringThenRaw (when=<value optimized out>, buf=0x7fffffffd450
"2012-12-28 18:56:53.264+0000") at util/virtime.c:219
#5 0x00007ffff7a07aba in virTimeStringNowRaw (buf=0x7fffffffd450
"2012-12-28 18:56:53.264+0000") at util/virtime.c:195
#6 0x00007ffff79dc9b4 in virLogVMessage (source=VIR_LOG_FROM_FILE,
priority=<value optimized out>, filename=0x7ffff7b4e705
"util/event_poll.c", linenr=393, funcname=0x7ffff7b4ed70
"virEventPollMakePollFDs", metadata=0x0, fmt=0x7ffff7b4eaa0 "Prepare
n=%d w=%d, f=%d e=%d d=%d", vargs=0x7fffffffd4d0)
at util/logging.c:822
#7 0x00007ffff79dcda9 in virLogMessage (source=<value optimized out>,
priority=<value optimized out>, filename=<value optimized out>,
linenr=<value optimized out>, funcname=<value optimized out>,
metadata=<value optimized out>, fmt=0x7ffff7b4eaa0 "Prepare n=%d w=%d,
f=%d e=%d d=%d") at util/logging.c:751
#8 0x00007ffff79d5bf9 in virEventPollMakePollFDs () at
util/event_poll.c:389
#9 virEventPollRunOnce () at util/event_poll.c:620
#10 0x00007ffff79d4ecd in virEventRunDefaultImpl () at util/event.c:247
#11 0x00007ffff7ace275 in virNetServerRun (srv=0x678df0) at
rpc/virnetserver.c:1121
#12 0x000000000040c76a in main (argc=<value optimized out>, argv=<value
optimized out>) at libvirtd.c:1449
(gdb)
More information about the libvir-list
mailing list