[Freeipa-users] Freeipa 4.2.0 hangs intermittently
Rakesh Rajasekharan
rakesh.rajasekharan at gmail.com
Thu Sep 15 19:14:49 UTC 2016
Hi Thierry,
I had been doing pretty much the same to reproduce the hang..
After changing the checkpoint interval.. the hangs had become manageable..
However, this time when the hang occurred.. I did not add any clients and
also the behavior was bit different. This time my ns-slapd did not hang..
ldapsearch was working fine.. but, the ipa commands were taking a long
time to respond and most users were not able to login to any of the
clients..
restarting ipa did not help either.
I was seeing around 14-15 connections in SYN_RECV state continously and
/var.log/messages has entries like "TCP: request_sock_TCP: Possible SYN
flooding on port 88. Sending cookies. Check SNMP counter"
I also see in the /var/log/krb5kdc.log this error
ipa-master-xyz.com krb5kdc[15308](info): TGS_REQ (4 etypes {18 17 16 23})
10.1.12.155: PROCESS_TGS: authtime 0, host/10.1.12.155 at XYZ.COM for ldap/
ipa-master-xyz.com at XYZ.COM, Clock skew too great
there are arounf 7.5k messages like that.. which I guess is too high
grep "krbtgt/XYZ.COM at XYZ.COM, Clock skew too great" /var/log/krb5kdc.log |
wc -l
7570
Would this give rise to a hang or make IPA nonresponsive..
The kinit admin command itself was taking an unusually long time to
respond..
KRB5_TRACE=/dev/stderr kinit admin
[11298] 1473702491.60880: Getting initial credentials for admin at XYZ.COM
[11298] 1473702491.62981: Sending request (167 bytes) to XYZ.COM
[11298] 1473702491.63119: Initiating TCP connection to stream 10.1.3.35:88
[11298] 1473702491.63359: Sending TCP request to stream 10.1.3.35:88
[11298] 1473702493.797835: Received answer (341 bytes) from stream
10.1.3.35:88
[11298] 1473702493.797848: Terminating TCP connection to stream 10.1.3.35:88
[11298] 1473702493.797911: Response was from master KDC
[11298] 1473702493.797956: Received error from KDC: -1765328359/Additional
pre-authentication required
[11298] 1473702493.797993: Processing preauth types: 136, 19, 2, 133
[11298] 1473702493.798005: Selected etype info: etype aes256-cts, salt
"V at Cbu147E#1;R0WD", params ""
[11298] 1473702493.798009: Received cookie: MIT
Password for admin at XYZ.COM:
[11298] 1473702498.190064: AS key obtained for encrypted timestamp:
aes256-cts/2C9D
[11298] 1473702498.190109: Encrypted timestamp (for 1473702498.184527):
plain 301AA011180F32303136303931323137343831385AA105020302D0CF, encrypted
25FC8D37EFB6B7837C8D5C6649DFB9972010D40EE29D1222FBA45CAA98428E42C7FCC9B7FE881A04BD3390A6A9EDE9D2D93729FDF3E47B6D
[11298] 1473702498.190129: Preauth module encrypted_timestamp (2) (real)
returned: 0/Success
[11298] 1473702498.190133: Produced preauth for next request: 133, 2
[11298] 1473702498.190148: Sending request (261 bytes) to XYZ.COM
[11298] 1473702498.190246: Initiating TCP connection to stream 10.1.3.35:88
[11298] 1473702499.191933: Sending initial UDP request to dgram 10.1.3.35:88
[11298] 1473702502.195157: Sending retry UDP request to dgram 10.1.3.35:88
[11298] 1473702507.200405: Sending retry UDP request to dgram 10.1.3.35:88
[11298] 1473702513.226371: Sending TCP request to stream 10.1.3.35:88
[11298] 1473702515.797243: Received answer (730 bytes) from stream
10.1.3.35:88
[11298] 1473702515.797271: Terminating TCP connection to stream 10.1.3.35:88
[11298] 1473702515.797326: Response was from master KDC
[11298] 1473702515.797353: Processing preauth types: 19
[11298] 1473702515.797360: Selected etype info: etype aes256-cts, salt
"V at Cbu147E#1;R0WD", params ""
[11298] 1473702515.797394: Produced preauth for next request: (empty)
[11298] 1473702515.797401: AS key determined by preauth: aes256-cts/2C9D
[11298] 1473702515.797445: Decrypted AS reply; session key is:
aes256-cts/702E
[11298] 1473702515.797460: FAST negotiation: available
[11298] 1473702515.797478: Initializing KEYRING:persistent:0:0 with default
princ admin at XYZ.COM
[11298] 1473702515.797534: Storing admin at XYZ.COM -> krbtgt/XYZ.COM at XYZ.COM
in KEYRING:persistent:0:0
[11298] 1473702515.797572: Storing config in KEYRING:persistent:0:0 for
krbtgt/XYZ.COM at XYZ.COM: fast_avail: yes
[11298] 1473702515.797585: Storing admin at XYZ.COM ->
krb5_ccache_conf_data/fast_avail/krbtgt\/XYZ.COM\@XYZ.COM at X-CACHECONF: in
KEYRING:persistent:0:0
[11298] 1473702515.797631: Storing config in KEYRING:persistent:0:0 for
krbtgt/XYZ.COM at XYZ.COM: pa_type: 2
[11298] 1473702515.797647: Storing admin at XYZ.COM ->
krb5_ccache_conf_data/pa_type/krbtgt\/XYZ.COM\@XYZ.COM at X-CACHECONF: in
KEYRING:persistent:0:0
Could it be an version specific issue..as I am running 4.2.0 verison.. and
yours is 4.3.2
If so, I will try to upgrade my IPA version
Thanks
Rakesh
On Thu, Sep 15, 2016 at 10:08 PM, thierry bordaz <tbordaz at redhat.com> wrote:
> Hello Rakesh,
>
> Sorry to be back so late. I finally manage to try to reproduce locally the
> hang of DS... and I fail ;-)
>
> I am running 4 VM, with freeipa 4.3.2.
> One is running a server (where I provisioned some users), with 200Mb
> cache. The server receives no direct load (SRCH or update).
> The tree others are running in a loop ipa-client-install and uninstall. So
> far it has run for several hours without hang.
>
> Going through the mail thread I have not found others details.
> Am I missing something to reproduce ?
>
> thanks in advance for your help
> thierry
>
> On 09/07/2016 01:46 PM, Rakesh Rajasekharan wrote:
>
> I changed the nsslapd-db-checkpoint interval first to 80 and increased
> till 160.. however the hang has not gone away yet
>
>
> I migrated my data from a openldap, can that cause issues like this.. If
> so, i could try creating users from scratch directly on IPA rather than
> migrating and test it
>
> But before that , have taken a fresh pstack just incase if it helps to
> nail down the issue
>
> Thread 44 (Thread 0x7f53ed52f700 (LWP 128165)):
> #0 0x00007f54047649b3 in select () from /lib64/libc.so.6
> #1 0x00007f5406eef0e9 in DS_Sleep () from /usr/lib64/dirsrv/libslapd.so.0
> #2 0x00007f53fa53d907 in deadlock_threadmain () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #3 0x00007f540509e7bb in _pt_root () from /lib64/libnspr4.so
> #4 0x00007f5404a3fdc5 in start_thread () from /lib64/libpthread.so.0
> #5 0x00007f540476d28d in clone () from /lib64/libc.so.6
> Thread 43 (Thread 0x7f53ecd2e700 (LWP 128166)):
> #0 0x00007f54047649b3 in select () from /lib64/libc.so.6
> #1 0x00007f53ff0cbbad in __os_yield () from /lib64/libdb-5.3.so
> #2 0x00007f53ff0c72b3 in __memp_sync_int () from /lib64/libdb-5.3.so
> #3 0x00007f53ff0d7752 in __txn_checkpoint () from /lib64/libdb-5.3.so
> #4 0x00007f53ff0d7b74 in __txn_checkpoint_pp () from /lib64/libdb-5.3.so
> #5 0x00007f53fa541a87 in checkpoint_threadmain () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #6 0x00007f540509e7bb in _pt_root () from /lib64/libnspr4.so
> #7 0x00007f5404a3fdc5 in start_thread () from /lib64/libpthread.so.0
> #8 0x00007f540476d28d in clone () from /lib64/libc.so.6
> Thread 42 (Thread 0x7f53ec52d700 (LWP 128167)):
> #0 0x00007f54047649b3 in select () from /lib64/libc.so.6
> #1 0x00007f5406eef0e9 in DS_Sleep () from /usr/lib64/dirsrv/libslapd.so.0
> #2 0x00007f53fa53db7f in trickle_threadmain () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #3 0x00007f540509e7bb in _pt_root () from /lib64/libnspr4.so
> #4 0x00007f5404a3fdc5 in start_thread () from /lib64/libpthread.so.0
> #5 0x00007f540476d28d in clone () from /lib64/libc.so.6
> Thread 41 (Thread 0x7f53ebd2c700 (LWP 128168)):
> #0 0x00007f54047649b3 in select () from /lib64/libc.so.6
> #1 0x00007f5406eef0e9 in DS_Sleep () from /usr/lib64/dirsrv/libslapd.so.0
> #2 0x00007f53fa538707 in perf_threadmain () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #3 0x00007f540509e7bb in _pt_root () from /lib64/libnspr4.so
> #4 0x00007f5404a3fdc5 in start_thread () from /lib64/libpthread.so.0
> #5 0x00007f540476d28d in clone () from /lib64/libc.so.6
> Thread 40 (Thread 0x7f53eb322700 (LWP 128204)):
> #0 0x00007f5404a436d5 in pthread_cond_wait@@GLIBC_2.3.2 () from
> /lib64/libpthread.so.0
> #1 0x00007f5405099050 in PR_WaitCondVar () from /lib64/libnspr4.so
> #2 0x00007f5406ede198 in slapi_wait_condvar () from
> /usr/lib64/dirsrv/libslapd.so.0
> #3 0x00007f53fd27062e in cos_cache_wait_on_change () from
> /usr/lib64/dirsrv/plugins/libcos-plugin.so
> #4 0x00007f540509e7bb in _pt_root () from /lib64/libnspr4.so
> #5 0x00007f5404a3fdc5 in start_thread () from /lib64/libpthread.so.0
> #6 0x00007f540476d28d in clone () from /lib64/libc.so.6
> Thread 39 (Thread 0x7f53eab21700 (LWP 128206)):
> #0 0x00007f5404a436d5 in pthread_cond_wait@@GLIBC_2.3.2 () from
> /lib64/libpthread.so.0
> #1 0x00007f5405099050 in PR_WaitCondVar () from /lib64/libnspr4.so
> #2 0x00007f5406ede198 in slapi_wait_condvar () from
> /usr/lib64/dirsrv/libslapd.so.0
> #3 0x00007f53f8bdbeed in roles_cache_wait_on_change () from
> /usr/lib64/dirsrv/plugins/libroles-plugin.so
> #4 0x00007f540509e7bb in _pt_root () from /lib64/libnspr4.so
> #5 0x00007f5404a3fdc5 in start_thread () from /lib64/libpthread.so.0
> #6 0x00007f540476d28d in clone () from /lib64/libc.so.6
> Thread 38 (Thread 0x7f53ea320700 (LWP 128207)):
> #0 0x00007f5404a436d5 in pthread_cond_wait@@GLIBC_2.3.2 () from
> /lib64/libpthread.so.0
> #1 0x00007f5405099050 in PR_WaitCondVar () from /lib64/libnspr4.so
> #2 0x00007f5406ede198 in slapi_wait_condvar () from
> /usr/lib64/dirsrv/libslapd.so.0
> #3 0x00007f53f8bdbeed in roles_cache_wait_on_change () from
> /usr/lib64/dirsrv/plugins/libroles-plugin.so
> #4 0x00007f540509e7bb in _pt_root () from /lib64/libnspr4.so
> #5 0x00007f5404a3fdc5 in start_thread () from /lib64/libpthread.so.0
> #6 0x00007f540476d28d in clone () from /lib64/libc.so.6
> Thread 37 (Thread 0x7f53e9b1f700 (LWP 128208)):
> #0 0x00007f5404a436d5 in pthread_cond_wait@@GLIBC_2.3.2 () from
> /lib64/libpthread.so.0
> #1 0x00007f5405099050 in PR_WaitCondVar () from /lib64/libnspr4.so
> #2 0x00007f5406ede198 in slapi_wait_condvar () from
> /usr/lib64/dirsrv/libslapd.so.0
> #3 0x00007f53f8bdbeed in roles_cache_wait_on_change () from
> /usr/lib64/dirsrv/plugins/libroles-plugin.so
> #4 0x00007f540509e7bb in _pt_root () from /lib64/libnspr4.so
> #5 0x00007f5404a3fdc5 in start_thread () from /lib64/libpthread.so.0
> #6 0x00007f540476d28d in clone () from /lib64/libc.so.6
> Thread 36 (Thread 0x7f53e931e700 (LWP 128209)):
> #0 0x00007f5404a43a82 in pthread_cond_timedwait@@GLIBC_2.3.2 () from
> /lib64/libpthread.so.0
> #1 0x00007f5405098b07 in pt_TimedWait () from /lib64/libnspr4.so
> #2 0x00007f5405098fce in PR_WaitCondVar () from /lib64/libnspr4.so
> #3 0x00007f5407397d03 in housecleaning ()
> #4 0x00007f540509e7bb in _pt_root () from /lib64/libnspr4.so
> #5 0x00007f5404a3fdc5 in start_thread () from /lib64/libpthread.so.0
> #6 0x00007f540476d28d in clone () from /lib64/libc.so.6
> Thread 35 (Thread 0x7f53e8b1d700 (LWP 128210)):
> #0 0x00007f5404a43a82 in pthread_cond_timedwait@@GLIBC_2.3.2 () from
> /lib64/libpthread.so.0
> #1 0x00007f5405098b07 in pt_TimedWait () from /lib64/libnspr4.so
> #2 0x00007f5405098fce in PR_WaitCondVar () from /lib64/libnspr4.so
> #3 0x00007f5406e841e8 in eq_loop () from /usr/lib64/dirsrv/libslapd.so.0
> #4 0x00007f540509e7bb in _pt_root () from /lib64/libnspr4.so
> #5 0x00007f5404a3fdc5 in start_thread () from /lib64/libpthread.so.0
> #6 0x00007f540476d28d in clone () from /lib64/libc.so.6
> Thread 34 (Thread 0x7f53db7fe700 (LWP 128212)):
> #0 0x00007f5404a436d5 in pthread_cond_wait@@GLIBC_2.3.2 () from
> /lib64/libpthread.so.0
> #1 0x00007f53fef9f2f3 in __db_hybrid_mutex_suspend () from /lib64/
> libdb-5.3.so
> #2 0x00007f53fef9e640 in __db_tas_mutex_lock () from /lib64/libdb-5.3.so
> #3 0x00007f53ff048d3a in __lock_get_internal () from /lib64/libdb-5.3.so
> #4 0x00007f53ff049820 in __lock_get () from /lib64/libdb-5.3.so
> #5 0x00007f53ff075142 in __db_lget () from /lib64/libdb-5.3.so
> #6 0x00007f53fefbc605 in __bam_search () from /lib64/libdb-5.3.so
> #7 0x00007f53fefa7256 in __bamc_search () from /lib64/libdb-5.3.so
> #8 0x00007f53fefa8d0f in __bamc_get () from /lib64/libdb-5.3.so
> #9 0x00007f53ff061ca6 in __dbc_iget () from /lib64/libdb-5.3.so
> #10 0x00007f53ff070b02 in __dbc_get_pp () from /lib64/libdb-5.3.so
> #11 0x00007f53fa54c680 in idl_new_fetch () from /usr/lib64/dirsrv/plugins/
> libback-ldbm.so
> #12 0x00007f53fa55ab26 in index_read_ext_allids () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #13 0x00007f53fa545284 in keys2idl () from /usr/lib64/dirsrv/plugins/
> libback-ldbm.so
> #14 0x00007f53fa5459e3 in ava_candidates.isra.0 () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #15 0x00007f53fa545fd2 in filter_candidates_ext () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #16 0x00007f53fa547096 in list_candidates () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #17 0x00007f53fa545f40 in filter_candidates_ext () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #18 0x00007f53fa58180c in subtree_candidates () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #19 0x00007f53fa582e7f in ldbm_back_search () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #20 0x00007f5406eb01d6 in op_shared_search () from
> /usr/lib64/dirsrv/libslapd.so.0
> #21 0x00007f54073a133e in do_search ()
> #22 0x00007f540738f567 in connection_threadmain ()
> #23 0x00007f540509e7bb in _pt_root () from /lib64/libnspr4.so
> #24 0x00007f5404a3fdc5 in start_thread () from /lib64/libpthread.so.0
> #25 0x00007f540476d28d in clone () from /lib64/libc.so.6
> Thread 33 (Thread 0x7f53daffd700 (LWP 128213)):
> #0 0x00007f5404a436d5 in pthread_cond_wait@@GLIBC_2.3.2 () from
> /lib64/libpthread.so.0
> #1 0x00007f53fef9f2f3 in __db_hybrid_mutex_suspend () from /lib64/
> libdb-5.3.so
> #2 0x00007f53fef9e640 in __db_tas_mutex_lock () from /lib64/libdb-5.3.so
> #3 0x00007f53ff048d3a in __lock_get_internal () from /lib64/libdb-5.3.so
> #4 0x00007f53ff049820 in __lock_get () from /lib64/libdb-5.3.so
> #5 0x00007f53ff075142 in __db_lget () from /lib64/libdb-5.3.so
> #6 0x00007f53fefbc605 in __bam_search () from /lib64/libdb-5.3.so
> #7 0x00007f53fefa7256 in __bamc_search () from /lib64/libdb-5.3.so
> #8 0x00007f53fefa8d0f in __bamc_get () from /lib64/libdb-5.3.so
> #9 0x00007f53ff061ca6 in __dbc_iget () from /lib64/libdb-5.3.so
> #10 0x00007f53ff070b02 in __dbc_get_pp () from /lib64/libdb-5.3.so
> #11 0x00007f53fa54c680 in idl_new_fetch () from /usr/lib64/dirsrv/plugins/
> libback-ldbm.so
> #12 0x00007f53fa55ab26 in index_read_ext_allids () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #13 0x00007f53fa545284 in keys2idl () from /usr/lib64/dirsrv/plugins/
> libback-ldbm.so
> #14 0x00007f53fa5459e3 in ava_candidates.isra.0 () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #15 0x00007f53fa545fd2 in filter_candidates_ext () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #16 0x00007f53fa547096 in list_candidates () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #17 0x00007f53fa545f40 in filter_candidates_ext () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #18 0x00007f53fa58180c in subtree_candidates () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #19 0x00007f53fa582e7f in ldbm_back_search () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #20 0x00007f5406eb01d6 in op_shared_search () from
> /usr/lib64/dirsrv/libslapd.so.0
> #21 0x00007f54073a133e in do_search ()
> #22 0x00007f540738f567 in connection_threadmain ()
> #23 0x00007f540509e7bb in _pt_root () from /lib64/libnspr4.so
> #24 0x00007f5404a3fdc5 in start_thread () from /lib64/libpthread.so.0
> #25 0x00007f540476d28d in clone () from /lib64/libc.so.6
> Thread 32 (Thread 0x7f53da7fc700 (LWP 128214)):
> #0 0x00007f5404a436d5 in pthread_cond_wait@@GLIBC_2.3.2 () from
> /lib64/libpthread.so.0
> #1 0x00007f53fef9f2f3 in __db_hybrid_mutex_suspend () from /lib64/
> libdb-5.3.so
> #2 0x00007f53fef9e640 in __db_tas_mutex_lock () from /lib64/libdb-5.3.so
> #3 0x00007f53ff048d3a in __lock_get_internal () from /lib64/libdb-5.3.so
> #4 0x00007f53ff049820 in __lock_get () from /lib64/libdb-5.3.so
> #5 0x00007f53ff075142 in __db_lget () from /lib64/libdb-5.3.so
> #6 0x00007f53fefbc605 in __bam_search () from /lib64/libdb-5.3.so
> #7 0x00007f53fefa7256 in __bamc_search () from /lib64/libdb-5.3.so
> #8 0x00007f53fefa8d0f in __bamc_get () from /lib64/libdb-5.3.so
> #9 0x00007f53ff061ca6 in __dbc_iget () from /lib64/libdb-5.3.so
> #10 0x00007f53ff070b02 in __dbc_get_pp () from /lib64/libdb-5.3.so
> #11 0x00007f53fa54c680 in idl_new_fetch () from /usr/lib64/dirsrv/plugins/
> libback-ldbm.so
> #12 0x00007f53fa55ab26 in index_read_ext_allids () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #13 0x00007f53fa545284 in keys2idl () from /usr/lib64/dirsrv/plugins/
> libback-ldbm.so
> #14 0x00007f53fa5459e3 in ava_candidates.isra.0 () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #15 0x00007f53fa545fd2 in filter_candidates_ext () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #16 0x00007f53fa547096 in list_candidates () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #17 0x00007f53fa545f40 in filter_candidates_ext () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #18 0x00007f53fa547096 in list_candidates () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #19 0x00007f53fa545f40 in filter_candidates_ext () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #20 0x00007f53fa547096 in list_candidates () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #21 0x00007f53fa545f40 in filter_candidates_ext () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #22 0x00007f53fa58180c in subtree_candidates () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #23 0x00007f53fa582e7f in ldbm_back_search () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #24 0x00007f5406eb01d6 in op_shared_search () from
> /usr/lib64/dirsrv/libslapd.so.0
> #25 0x00007f54073a133e in do_search ()
> #26 0x00007f540738f3c3 in connection_threadmain ()
> #27 0x00007f540509e7bb in _pt_root () from /lib64/libnspr4.so
> #28 0x00007f5404a3fdc5 in start_thread () from /lib64/libpthread.so.0
> #29 0x00007f540476d28d in clone () from /lib64/libc.so.6
> Thread 31 (Thread 0x7f53d9ffb700 (LWP 128215)):
> #0 0x00007f5404a436d5 in pthread_cond_wait@@GLIBC_2.3.2 () from
> /lib64/libpthread.so.0
> #1 0x00007f53fef9f2f3 in __db_hybrid_mutex_suspend () from /lib64/
> libdb-5.3.so
> #2 0x00007f53fef9e640 in __db_tas_mutex_lock () from /lib64/libdb-5.3.so
> #3 0x00007f53ff048d3a in __lock_get_internal () from /lib64/libdb-5.3.so
> #4 0x00007f53ff049820 in __lock_get () from /lib64/libdb-5.3.so
> #5 0x00007f53ff075142 in __db_lget () from /lib64/libdb-5.3.so
> #6 0x00007f53fefbc605 in __bam_search () from /lib64/libdb-5.3.so
> #7 0x00007f53fefa7256 in __bamc_search () from /lib64/libdb-5.3.so
> #8 0x00007f53fefa8d0f in __bamc_get () from /lib64/libdb-5.3.so
> #9 0x00007f53ff061ca6 in __dbc_iget () from /lib64/libdb-5.3.so
> #10 0x00007f53ff070b02 in __dbc_get_pp () from /lib64/libdb-5.3.so
> #11 0x00007f53fa54c680 in idl_new_fetch () from /usr/lib64/dirsrv/plugins/
> libback-ldbm.so
> #12 0x00007f53fa55ab26 in index_read_ext_allids () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #13 0x00007f53fa545284 in keys2idl () from /usr/lib64/dirsrv/plugins/
> libback-ldbm.so
> #14 0x00007f53fa5459e3 in ava_candidates.isra.0 () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #15 0x00007f53fa545fd2 in filter_candidates_ext () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #16 0x00007f53fa547096 in list_candidates () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #17 0x00007f53fa545f40 in filter_candidates_ext () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #18 0x00007f53fa58180c in subtree_candidates () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #19 0x00007f53fa582e7f in ldbm_back_search () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #20 0x00007f5406eb01d6 in op_shared_search () from
> /usr/lib64/dirsrv/libslapd.so.0
> #21 0x00007f54073a133e in do_search ()
> #22 0x00007f540738f567 in connection_threadmain ()
> #23 0x00007f540509e7bb in _pt_root () from /lib64/libnspr4.so
> #24 0x00007f5404a3fdc5 in start_thread () from /lib64/libpthread.so.0
> #25 0x00007f540476d28d in clone () from /lib64/libc.so.6
> Thread 30 (Thread 0x7f53d97fa700 (LWP 128216)):
> #0 0x00007f5404a436d5 in pthread_cond_wait@@GLIBC_2.3.2 () from
> /lib64/libpthread.so.0
> #1 0x00007f53fef9f2f3 in __db_hybrid_mutex_suspend () from /lib64/
> libdb-5.3.so
> #2 0x00007f53fef9e640 in __db_tas_mutex_lock () from /lib64/libdb-5.3.so
> #3 0x00007f53ff048d3a in __lock_get_internal () from /lib64/libdb-5.3.so
> #4 0x00007f53ff049820 in __lock_get () from /lib64/libdb-5.3.so
> #5 0x00007f53ff075142 in __db_lget () from /lib64/libdb-5.3.so
> #6 0x00007f53fefbc605 in __bam_search () from /lib64/libdb-5.3.so
> #7 0x00007f53fefa7256 in __bamc_search () from /lib64/libdb-5.3.so
> #8 0x00007f53fefa8d0f in __bamc_get () from /lib64/libdb-5.3.so
> #9 0x00007f53ff061ca6 in __dbc_iget () from /lib64/libdb-5.3.so
> #10 0x00007f53ff070b02 in __dbc_get_pp () from /lib64/libdb-5.3.so
> #11 0x00007f53fa54c680 in idl_new_fetch () from /usr/lib64/dirsrv/plugins/
> libback-ldbm.so
> #12 0x00007f53fa55ab26 in index_read_ext_allids () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #13 0x00007f53fa545284 in keys2idl () from /usr/lib64/dirsrv/plugins/
> libback-ldbm.so
> #14 0x00007f53fa5459e3 in ava_candidates.isra.0 () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #15 0x00007f53fa545fd2 in filter_candidates_ext () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #16 0x00007f53fa547096 in list_candidates () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #17 0x00007f53fa545f40 in filter_candidates_ext () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #18 0x00007f53fa58180c in subtree_candidates () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #19 0x00007f53fa582e7f in ldbm_back_search () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #20 0x00007f5406eb01d6 in op_shared_search () from
> /usr/lib64/dirsrv/libslapd.so.0
> #21 0x00007f54073a133e in do_search ()
> #22 0x00007f540738f567 in connection_threadmain ()
> #23 0x00007f540509e7bb in _pt_root () from /lib64/libnspr4.so
> #24 0x00007f5404a3fdc5 in start_thread () from /lib64/libpthread.so.0
> #25 0x00007f540476d28d in clone () from /lib64/libc.so.6
> Thread 29 (Thread 0x7f53d8ff9700 (LWP 128217)):
> #0 0x00007f5404a436d5 in pthread_cond_wait@@GLIBC_2.3.2 () from
> /lib64/libpthread.so.0
> #1 0x00007f53fef9f2f3 in __db_hybrid_mutex_suspend () from /lib64/
> libdb-5.3.so
> #2 0x00007f53fef9e640 in __db_tas_mutex_lock () from /lib64/libdb-5.3.so
> #3 0x00007f53ff048d3a in __lock_get_internal () from /lib64/libdb-5.3.so
> #4 0x00007f53ff049820 in __lock_get () from /lib64/libdb-5.3.so
> #5 0x00007f53ff075142 in __db_lget () from /lib64/libdb-5.3.so
> #6 0x00007f53fefbc605 in __bam_search () from /lib64/libdb-5.3.so
> #7 0x00007f53fefa7256 in __bamc_search () from /lib64/libdb-5.3.so
> #8 0x00007f53fefa8d0f in __bamc_get () from /lib64/libdb-5.3.so
> #9 0x00007f53ff061ca6 in __dbc_iget () from /lib64/libdb-5.3.so
> #10 0x00007f53ff070b02 in __dbc_get_pp () from /lib64/libdb-5.3.so
> #11 0x00007f53fa54c680 in idl_new_fetch () from /usr/lib64/dirsrv/plugins/
> libback-ldbm.so
> #12 0x00007f53fa55ab26 in index_read_ext_allids () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #13 0x00007f53fa545284 in keys2idl () from /usr/lib64/dirsrv/plugins/
> libback-ldbm.so
> #14 0x00007f53fa5459e3 in ava_candidates.isra.0 () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #15 0x00007f53fa545fd2 in filter_candidates_ext () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #16 0x00007f53fa547096 in list_candidates () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #17 0x00007f53fa545f40 in filter_candidates_ext () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #18 0x00007f53fa58180c in subtree_candidates () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #19 0x00007f53fa582e7f in ldbm_back_search () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #20 0x00007f5406eb01d6 in op_shared_search () from
> /usr/lib64/dirsrv/libslapd.so.0
> #21 0x00007f54073a133e in do_search ()
> #22 0x00007f540738f567 in connection_threadmain ()
> #23 0x00007f540509e7bb in _pt_root () from /lib64/libnspr4.so
> #24 0x00007f5404a3fdc5 in start_thread () from /lib64/libpthread.so.0
> #25 0x00007f540476d28d in clone () from /lib64/libc.so.6
> Thread 28 (Thread 0x7f53d87f8700 (LWP 128218)):
> #0 0x00007f5404a436d5 in pthread_cond_wait@@GLIBC_2.3.2 () from
> /lib64/libpthread.so.0
> #1 0x00007f53fef9f2f3 in __db_hybrid_mutex_suspend () from /lib64/
> libdb-5.3.so
> #2 0x00007f53fef9e640 in __db_tas_mutex_lock () from /lib64/libdb-5.3.so
> #3 0x00007f53ff048d3a in __lock_get_internal () from /lib64/libdb-5.3.so
> #4 0x00007f53ff049820 in __lock_get () from /lib64/libdb-5.3.so
> #5 0x00007f53ff075142 in __db_lget () from /lib64/libdb-5.3.so
> #6 0x00007f53fefbc605 in __bam_search () from /lib64/libdb-5.3.so
> #7 0x00007f53fefa7256 in __bamc_search () from /lib64/libdb-5.3.so
> #8 0x00007f53fefa8d0f in __bamc_get () from /lib64/libdb-5.3.so
> #9 0x00007f53ff061ca6 in __dbc_iget () from /lib64/libdb-5.3.so
> #10 0x00007f53ff070b02 in __dbc_get_pp () from /lib64/libdb-5.3.so
> #11 0x00007f53fa54c680 in idl_new_fetch () from /usr/lib64/dirsrv/plugins/
> libback-ldbm.so
> #12 0x00007f53fa55ab26 in index_read_ext_allids () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #13 0x00007f53fa545284 in keys2idl () from /usr/lib64/dirsrv/plugins/
> libback-ldbm.so
> #14 0x00007f53fa5459e3 in ava_candidates.isra.0 () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #15 0x00007f53fa545fd2 in filter_candidates_ext () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #16 0x00007f53fa547096 in list_candidates () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #17 0x00007f53fa545f40 in filter_candidates_ext () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #18 0x00007f53fa58180c in subtree_candidates () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #19 0x00007f53fa582e7f in ldbm_back_search () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #20 0x00007f5406eb01d6 in op_shared_search () from
> /usr/lib64/dirsrv/libslapd.so.0
> #21 0x00007f54073a133e in do_search ()
> #22 0x00007f540738f567 in connection_threadmain ()
> #23 0x00007f540509e7bb in _pt_root () from /lib64/libnspr4.so
> #24 0x00007f5404a3fdc5 in start_thread () from /lib64/libpthread.so.0
> #25 0x00007f540476d28d in clone () from /lib64/libc.so.6
> Thread 27 (Thread 0x7f53d7ff7700 (LWP 128219)):
> #0 0x00007f5404a436d5 in pthread_cond_wait@@GLIBC_2.3.2 () from
> /lib64/libpthread.so.0
> #1 0x00007f53fef9f2f3 in __db_hybrid_mutex_suspend () from /lib64/
> libdb-5.3.so
> #2 0x00007f53fef9e640 in __db_tas_mutex_lock () from /lib64/libdb-5.3.so
> #3 0x00007f53ff048d3a in __lock_get_internal () from /lib64/libdb-5.3.so
> #4 0x00007f53ff049820 in __lock_get () from /lib64/libdb-5.3.so
> #5 0x00007f53ff075142 in __db_lget () from /lib64/libdb-5.3.so
> #6 0x00007f53fefbc605 in __bam_search () from /lib64/libdb-5.3.so
> #7 0x00007f53fefa7256 in __bamc_search () from /lib64/libdb-5.3.so
> #8 0x00007f53fefa8d0f in __bamc_get () from /lib64/libdb-5.3.so
> #9 0x00007f53ff061ca6 in __dbc_iget () from /lib64/libdb-5.3.so
> #10 0x00007f53ff070b02 in __dbc_get_pp () from /lib64/libdb-5.3.so
> #11 0x00007f53fa54c680 in idl_new_fetch () from /usr/lib64/dirsrv/plugins/
> libback-ldbm.so
> #12 0x00007f53fa55ab26 in index_read_ext_allids () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #13 0x00007f53fa545284 in keys2idl () from /usr/lib64/dirsrv/plugins/
> libback-ldbm.so
> #14 0x00007f53fa5459e3 in ava_candidates.isra.0 () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #15 0x00007f53fa545fd2 in filter_candidates_ext () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #16 0x00007f53fa547096 in list_candidates () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #17 0x00007f53fa545f40 in filter_candidates_ext () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #18 0x00007f53fa58180c in subtree_candidates () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #19 0x00007f53fa582e7f in ldbm_back_search () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #20 0x00007f5406eb01d6 in op_shared_search () from
> /usr/lib64/dirsrv/libslapd.so.0
> #21 0x00007f54073a133e in do_search ()
> #22 0x00007f540738f567 in connection_threadmain ()
> #23 0x00007f540509e7bb in _pt_root () from /lib64/libnspr4.so
> #24 0x00007f5404a3fdc5 in start_thread () from /lib64/libpthread.so.0
> #25 0x00007f540476d28d in clone () from /lib64/libc.so.6
> Thread 26 (Thread 0x7f53d77f6700 (LWP 128220)):
> #0 0x00007f5404a436d5 in pthread_cond_wait@@GLIBC_2.3.2 () from
> /lib64/libpthread.so.0
> #1 0x00007f53fef9f2f3 in __db_hybrid_mutex_suspend () from /lib64/
> libdb-5.3.so
> #2 0x00007f53fef9e640 in __db_tas_mutex_lock () from /lib64/libdb-5.3.so
> #3 0x00007f53ff048d3a in __lock_get_internal () from /lib64/libdb-5.3.so
> #4 0x00007f53ff049820 in __lock_get () from /lib64/libdb-5.3.so
> #5 0x00007f53ff075142 in __db_lget () from /lib64/libdb-5.3.so
> #6 0x00007f53fefbc605 in __bam_search () from /lib64/libdb-5.3.so
> #7 0x00007f53fefa7256 in __bamc_search () from /lib64/libdb-5.3.so
> #8 0x00007f53fefa8d0f in __bamc_get () from /lib64/libdb-5.3.so
> #9 0x00007f53ff061ca6 in __dbc_iget () from /lib64/libdb-5.3.so
> #10 0x00007f53ff070b02 in __dbc_get_pp () from /lib64/libdb-5.3.so
> #11 0x00007f53fa54c680 in idl_new_fetch () from /usr/lib64/dirsrv/plugins/
> libback-ldbm.so
> #12 0x00007f53fa55ab26 in index_read_ext_allids () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #13 0x00007f53fa545284 in keys2idl () from /usr/lib64/dirsrv/plugins/
> libback-ldbm.so
> #14 0x00007f53fa5459e3 in ava_candidates.isra.0 () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #15 0x00007f53fa545fd2 in filter_candidates_ext () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #16 0x00007f53fa547096 in list_candidates () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #17 0x00007f53fa545f40 in filter_candidates_ext () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #18 0x00007f53fa58180c in subtree_candidates () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #19 0x00007f53fa582e7f in ldbm_back_search () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #20 0x00007f5406eb01d6 in op_shared_search () from
> /usr/lib64/dirsrv/libslapd.so.0
> #21 0x00007f54073a133e in do_search ()
> #22 0x00007f540738f567 in connection_threadmain ()
> #23 0x00007f540509e7bb in _pt_root () from /lib64/libnspr4.so
> #24 0x00007f5404a3fdc5 in start_thread () from /lib64/libpthread.so.0
> #25 0x00007f540476d28d in clone () from /lib64/libc.so.6
> Thread 25 (Thread 0x7f53d6ff5700 (LWP 128221)):
> #0 0x00007f5404a436d5 in pthread_cond_wait@@GLIBC_2.3.2 () from
> /lib64/libpthread.so.0
> #1 0x00007f53fef9f2f3 in __db_hybrid_mutex_suspend () from /lib64/
> libdb-5.3.so
> #2 0x00007f53fef9e640 in __db_tas_mutex_lock () from /lib64/libdb-5.3.so
> #3 0x00007f53ff048d3a in __lock_get_internal () from /lib64/libdb-5.3.so
> #4 0x00007f53ff049820 in __lock_get () from /lib64/libdb-5.3.so
> #5 0x00007f53ff075142 in __db_lget () from /lib64/libdb-5.3.so
> #6 0x00007f53fefbc605 in __bam_search () from /lib64/libdb-5.3.so
> #7 0x00007f53fefa7256 in __bamc_search () from /lib64/libdb-5.3.so
> #8 0x00007f53fefa8d0f in __bamc_get () from /lib64/libdb-5.3.so
> #9 0x00007f53ff061ca6 in __dbc_iget () from /lib64/libdb-5.3.so
> #10 0x00007f53ff070b02 in __dbc_get_pp () from /lib64/libdb-5.3.so
> #11 0x00007f53fa54c680 in idl_new_fetch () from /usr/lib64/dirsrv/plugins/
> libback-ldbm.so
> #12 0x00007f53fa55ab26 in index_read_ext_allids () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #13 0x00007f53fa545284 in keys2idl () from /usr/lib64/dirsrv/plugins/
> libback-ldbm.so
> #14 0x00007f53fa5459e3 in ava_candidates.isra.0 () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #15 0x00007f53fa545fd2 in filter_candidates_ext () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #16 0x00007f53fa547096 in list_candidates () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #17 0x00007f53fa545f40 in filter_candidates_ext () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #18 0x00007f53fa58180c in subtree_candidates () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #19 0x00007f53fa582e7f in ldbm_back_search () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #20 0x00007f5406eb01d6 in op_shared_search () from
> /usr/lib64/dirsrv/libslapd.so.0
> #21 0x00007f54073a133e in do_search ()
> #22 0x00007f540738f567 in connection_threadmain ()
> #23 0x00007f540509e7bb in _pt_root () from /lib64/libnspr4.so
> #24 0x00007f5404a3fdc5 in start_thread () from /lib64/libpthread.so.0
> #25 0x00007f540476d28d in clone () from /lib64/libc.so.6
> Thread 24 (Thread 0x7f53d67f4700 (LWP 128222)):
> #0 0x00007f5404a436d5 in pthread_cond_wait@@GLIBC_2.3.2 () from
> /lib64/libpthread.so.0
> #1 0x00007f53fef9f2f3 in __db_hybrid_mutex_suspend () from /lib64/
> libdb-5.3.so
> #2 0x00007f53fef9e640 in __db_tas_mutex_lock () from /lib64/libdb-5.3.so
> #3 0x00007f53ff048d3a in __lock_get_internal () from /lib64/libdb-5.3.so
> #4 0x00007f53ff049820 in __lock_get () from /lib64/libdb-5.3.so
> #5 0x00007f53ff075142 in __db_lget () from /lib64/libdb-5.3.so
> #6 0x00007f53fefbc605 in __bam_search () from /lib64/libdb-5.3.so
> #7 0x00007f53fefa7256 in __bamc_search () from /lib64/libdb-5.3.so
> #8 0x00007f53fefa8d0f in __bamc_get () from /lib64/libdb-5.3.so
> #9 0x00007f53ff061ca6 in __dbc_iget () from /lib64/libdb-5.3.so
> #10 0x00007f53ff070b02 in __dbc_get_pp () from /lib64/libdb-5.3.so
> #11 0x00007f53fa54c680 in idl_new_fetch () from /usr/lib64/dirsrv/plugins/
> libback-ldbm.so
> #12 0x00007f53fa55ab26 in index_read_ext_allids () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #13 0x00007f53fa545284 in keys2idl () from /usr/lib64/dirsrv/plugins/
> libback-ldbm.so
> #14 0x00007f53fa5459e3 in ava_candidates.isra.0 () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #15 0x00007f53fa545fd2 in filter_candidates_ext () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #16 0x00007f53fa547096 in list_candidates () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #17 0x00007f53fa545f40 in filter_candidates_ext () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #18 0x00007f53fa58180c in subtree_candidates () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #19 0x00007f53fa582e7f in ldbm_back_search () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #20 0x00007f5406eb01d6 in op_shared_search () from
> /usr/lib64/dirsrv/libslapd.so.0
> #21 0x00007f54073a133e in do_search ()
> #22 0x00007f540738f567 in connection_threadmain ()
> #23 0x00007f540509e7bb in _pt_root () from /lib64/libnspr4.so
> #24 0x00007f5404a3fdc5 in start_thread () from /lib64/libpthread.so.0
> #25 0x00007f540476d28d in clone () from /lib64/libc.so.6
> Thread 23 (Thread 0x7f53d5ff3700 (LWP 128223)):
> #0 0x00007f5404a436d5 in pthread_cond_wait@@GLIBC_2.3.2 () from
> /lib64/libpthread.so.0
> #1 0x00007f53fef9f2f3 in __db_hybrid_mutex_suspend () from /lib64/
> libdb-5.3.so
> #2 0x00007f53fef9e640 in __db_tas_mutex_lock () from /lib64/libdb-5.3.so
> #3 0x00007f53ff0b8e1b in __memp_fget () from /lib64/libdb-5.3.so
> #4 0x00007f53fefbc211 in __bam_search () from /lib64/libdb-5.3.so
> #5 0x00007f53fefa7256 in __bamc_search () from /lib64/libdb-5.3.so
> #6 0x00007f53fefab6c4 in __bamc_put () from /lib64/libdb-5.3.so
> #7 0x00007f53ff0626d5 in __dbc_iput () from /lib64/libdb-5.3.so
> #8 0x00007f53ff05da0e in __db_put () from /lib64/libdb-5.3.so
> #9 0x00007f53ff072fa4 in __db_put_pp () from /lib64/libdb-5.3.so
> #10 0x00007f53fa54d4cf in idl_new_insert_key () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #11 0x00007f53fa55c5b5 in addordel_values_sv.isra.3 () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #12 0x00007f53fa55d25a in index_addordel_values_ext_sv () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #13 0x00007f53fa55d694 in index_addordel_values_sv () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #14 0x00007f53fa55d75a in index_addordel_entry () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #15 0x00007f53fa5605fa in ldbm_back_add () from /usr/lib64/dirsrv/plugins/
> libback-ldbm.so
> #16 0x00007f5406e62cca in op_shared_add () from
> /usr/lib64/dirsrv/libslapd.so.0
> #17 0x00007f5406e64020 in do_add () from /usr/lib64/dirsrv/libslapd.so.0
> #18 0x00007f540738f303 in connection_threadmain ()
> #19 0x00007f540509e7bb in _pt_root () from /lib64/libnspr4.so
> #20 0x00007f5404a3fdc5 in start_thread () from /lib64/libpthread.so.0
> #21 0x00007f540476d28d in clone () from /lib64/libc.so.6
> Thread 22 (Thread 0x7f53d57f2700 (LWP 128224)):
> #0 0x00007f5404a436d5 in pthread_cond_wait@@GLIBC_2.3.2 () from
> /lib64/libpthread.so.0
> #1 0x00007f53fef9f2f3 in __db_hybrid_mutex_suspend () from /lib64/
> libdb-5.3.so
> #2 0x00007f53fef9e640 in __db_tas_mutex_lock () from /lib64/libdb-5.3.so
> #3 0x00007f53ff048d3a in __lock_get_internal () from /lib64/libdb-5.3.so
> #4 0x00007f53ff049820 in __lock_get () from /lib64/libdb-5.3.so
> #5 0x00007f53ff075142 in __db_lget () from /lib64/libdb-5.3.so
> #6 0x00007f53fefbc605 in __bam_search () from /lib64/libdb-5.3.so
> #7 0x00007f53fefa7256 in __bamc_search () from /lib64/libdb-5.3.so
> #8 0x00007f53fefa8d0f in __bamc_get () from /lib64/libdb-5.3.so
> #9 0x00007f53ff061ca6 in __dbc_iget () from /lib64/libdb-5.3.so
> #10 0x00007f53ff070b02 in __dbc_get_pp () from /lib64/libdb-5.3.so
> #11 0x00007f53fa54c680 in idl_new_fetch () from /usr/lib64/dirsrv/plugins/
> libback-ldbm.so
> #12 0x00007f53fa55ab26 in index_read_ext_allids () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #13 0x00007f53fa545284 in keys2idl () from /usr/lib64/dirsrv/plugins/
> libback-ldbm.so
> #14 0x00007f53fa5459e3 in ava_candidates.isra.0 () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #15 0x00007f53fa545fd2 in filter_candidates_ext () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #16 0x00007f53fa547096 in list_candidates () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #17 0x00007f53fa545f40 in filter_candidates_ext () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #18 0x00007f53fa58180c in subtree_candidates () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #19 0x00007f53fa582e7f in ldbm_back_search () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #20 0x00007f5406eb01d6 in op_shared_search () from
> /usr/lib64/dirsrv/libslapd.so.0
> #21 0x00007f54073a133e in do_search ()
> #22 0x00007f540738f567 in connection_threadmain ()
> #23 0x00007f540509e7bb in _pt_root () from /lib64/libnspr4.so
> #24 0x00007f5404a3fdc5 in start_thread () from /lib64/libpthread.so.0
> #25 0x00007f540476d28d in clone () from /lib64/libc.so.6
> Thread 21 (Thread 0x7f53d4ff1700 (LWP 128225)):
> #0 0x00007f5404a436d5 in pthread_cond_wait@@GLIBC_2.3.2 () from
> /lib64/libpthread.so.0
> #1 0x00007f53fef9f2f3 in __db_hybrid_mutex_suspend () from /lib64/
> libdb-5.3.so
> #2 0x00007f53fef9e640 in __db_tas_mutex_lock () from /lib64/libdb-5.3.so
> #3 0x00007f53ff048d3a in __lock_get_internal () from /lib64/libdb-5.3.so
> #4 0x00007f53ff049820 in __lock_get () from /lib64/libdb-5.3.so
> #5 0x00007f53ff075142 in __db_lget () from /lib64/libdb-5.3.so
> #6 0x00007f53fefbc605 in __bam_search () from /lib64/libdb-5.3.so
> #7 0x00007f53fefa7256 in __bamc_search () from /lib64/libdb-5.3.so
> #8 0x00007f53fefa8d0f in __bamc_get () from /lib64/libdb-5.3.so
> #9 0x00007f53ff061ca6 in __dbc_iget () from /lib64/libdb-5.3.so
> #10 0x00007f53ff070b02 in __dbc_get_pp () from /lib64/libdb-5.3.so
> #11 0x00007f53fa54c680 in idl_new_fetch () from /usr/lib64/dirsrv/plugins/
> libback-ldbm.so
> #12 0x00007f53fa55ab26 in index_read_ext_allids () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #13 0x00007f53fa545284 in keys2idl () from /usr/lib64/dirsrv/plugins/
> libback-ldbm.so
> #14 0x00007f53fa5459e3 in ava_candidates.isra.0 () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #15 0x00007f53fa545fd2 in filter_candidates_ext () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #16 0x00007f53fa547096 in list_candidates () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #17 0x00007f53fa545f40 in filter_candidates_ext () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #18 0x00007f53fa58180c in subtree_candidates () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #19 0x00007f53fa582e7f in ldbm_back_search () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #20 0x00007f5406eb01d6 in op_shared_search () from
> /usr/lib64/dirsrv/libslapd.so.0
> #21 0x00007f54073a133e in do_search ()
> #22 0x00007f540738f567 in connection_threadmain ()
> #23 0x00007f540509e7bb in _pt_root () from /lib64/libnspr4.so
> #24 0x00007f5404a3fdc5 in start_thread () from /lib64/libpthread.so.0
> #25 0x00007f540476d28d in clone () from /lib64/libc.so.6
> Thread 20 (Thread 0x7f53d47f0700 (LWP 128226)):
> #0 0x00007f5404a436d5 in pthread_cond_wait@@GLIBC_2.3.2 () from
> /lib64/libpthread.so.0
> #1 0x00007f53fef9f2f3 in __db_hybrid_mutex_suspend () from /lib64/
> libdb-5.3.so
> #2 0x00007f53fef9e640 in __db_tas_mutex_lock () from /lib64/libdb-5.3.so
> #3 0x00007f53ff048d3a in __lock_get_internal () from /lib64/libdb-5.3.so
> #4 0x00007f53ff049820 in __lock_get () from /lib64/libdb-5.3.so
> #5 0x00007f53ff075142 in __db_lget () from /lib64/libdb-5.3.so
> #6 0x00007f53fefbc605 in __bam_search () from /lib64/libdb-5.3.so
> #7 0x00007f53fefa7256 in __bamc_search () from /lib64/libdb-5.3.so
> #8 0x00007f53fefa8d0f in __bamc_get () from /lib64/libdb-5.3.so
> #9 0x00007f53ff061ca6 in __dbc_iget () from /lib64/libdb-5.3.so
> #10 0x00007f53ff070b02 in __dbc_get_pp () from /lib64/libdb-5.3.so
> #11 0x00007f53fa54c680 in idl_new_fetch () from /usr/lib64/dirsrv/plugins/
> libback-ldbm.so
> #12 0x00007f53fa55ab26 in index_read_ext_allids () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #13 0x00007f53fa545284 in keys2idl () from /usr/lib64/dirsrv/plugins/
> libback-ldbm.so
> #14 0x00007f53fa5459e3 in ava_candidates.isra.0 () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #15 0x00007f53fa545fd2 in filter_candidates_ext () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #16 0x00007f53fa547096 in list_candidates () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #17 0x00007f53fa545f40 in filter_candidates_ext () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #18 0x00007f53fa58180c in subtree_candidates () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #19 0x00007f53fa582e7f in ldbm_back_search () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #20 0x00007f5406eb01d6 in op_shared_search () from
> /usr/lib64/dirsrv/libslapd.so.0
> #21 0x00007f5406ec094e in search_internal_callback_pb () from
> /usr/lib64/dirsrv/libslapd.so.0
> #22 0x00007f5406ec0be8 in search_internal_pb () from
> /usr/lib64/dirsrv/libslapd.so.0
> #23 0x00007f53fe118e90 in search_one_berval () from
> /usr/lib64/dirsrv/plugins/libattr-unique-plugin.so
> #24 0x00007f53fe119242 in search () from /usr/lib64/dirsrv/plugins/
> libattr-unique-plugin.so
> #25 0x00007f53fe11954c in searchAllSubtrees () from
> /usr/lib64/dirsrv/plugins/libattr-unique-plugin.so
> #26 0x00007f53fe11a015 in preop_add () from /usr/lib64/dirsrv/plugins/
> libattr-unique-plugin.so
> #27 0x00007f5406ebb848 in plugin_call_func () from
> /usr/lib64/dirsrv/libslapd.so.0
> #28 0x00007f5406ebbb13 in plugin_call_plugins () from
> /usr/lib64/dirsrv/libslapd.so.0
> #29 0x00007f5406e62c2b in op_shared_add () from
> /usr/lib64/dirsrv/libslapd.so.0
> #30 0x00007f5406e64020 in do_add () from /usr/lib64/dirsrv/libslapd.so.0
> #31 0x00007f540738f303 in connection_threadmain ()
> #32 0x00007f540509e7bb in _pt_root () from /lib64/libnspr4.so
> #33 0x00007f5404a3fdc5 in start_thread () from /lib64/libpthread.so.0
> #34 0x00007f540476d28d in clone () from /lib64/libc.so.6
> Thread 19 (Thread 0x7f53d3fef700 (LWP 128227)):
> #0 0x00007f5404a436d5 in pthread_cond_wait@@GLIBC_2.3.2 () from
> /lib64/libpthread.so.0
> #1 0x00007f53fef9f2f3 in __db_hybrid_mutex_suspend () from /lib64/
> libdb-5.3.so
> #2 0x00007f53fef9e640 in __db_tas_mutex_lock () from /lib64/libdb-5.3.so
> #3 0x00007f53ff048d3a in __lock_get_internal () from /lib64/libdb-5.3.so
> #4 0x00007f53ff049820 in __lock_get () from /lib64/libdb-5.3.so
> #5 0x00007f53ff075142 in __db_lget () from /lib64/libdb-5.3.so
> #6 0x00007f53fefbc605 in __bam_search () from /lib64/libdb-5.3.so
> #7 0x00007f53fefa7256 in __bamc_search () from /lib64/libdb-5.3.so
> #8 0x00007f53fefa8d0f in __bamc_get () from /lib64/libdb-5.3.so
> #9 0x00007f53ff061ca6 in __dbc_iget () from /lib64/libdb-5.3.so
> #10 0x00007f53ff070b02 in __dbc_get_pp () from /lib64/libdb-5.3.so
> #11 0x00007f53fa54c680 in idl_new_fetch () from /usr/lib64/dirsrv/plugins/
> libback-ldbm.so
> #12 0x00007f53fa55ab26 in index_read_ext_allids () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #13 0x00007f53fa545284 in keys2idl () from /usr/lib64/dirsrv/plugins/
> libback-ldbm.so
> #14 0x00007f53fa5459e3 in ava_candidates.isra.0 () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #15 0x00007f53fa545fd2 in filter_candidates_ext () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #16 0x00007f53fa547096 in list_candidates () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #17 0x00007f53fa545f40 in filter_candidates_ext () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #18 0x00007f53fa58180c in subtree_candidates () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #19 0x00007f53fa582e7f in ldbm_back_search () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #20 0x00007f5406eb01d6 in op_shared_search () from
> /usr/lib64/dirsrv/libslapd.so.0
> #21 0x00007f54073a133e in do_search ()
> #22 0x00007f540738f567 in connection_threadmain ()
> #23 0x00007f540509e7bb in _pt_root () from /lib64/libnspr4.so
> #24 0x00007f5404a3fdc5 in start_thread () from /lib64/libpthread.so.0
> #25 0x00007f540476d28d in clone () from /lib64/libc.so.6
> Thread 18 (Thread 0x7f53d37ee700 (LWP 128228)):
> #0 0x00007f5404a436d5 in pthread_cond_wait@@GLIBC_2.3.2 () from
> /lib64/libpthread.so.0
> #1 0x00007f53fef9f2f3 in __db_hybrid_mutex_suspend () from /lib64/
> libdb-5.3.so
> #2 0x00007f53fef9e640 in __db_tas_mutex_lock () from /lib64/libdb-5.3.so
> #3 0x00007f53ff048d3a in __lock_get_internal () from /lib64/libdb-5.3.so
> #4 0x00007f53ff049820 in __lock_get () from /lib64/libdb-5.3.so
> #5 0x00007f53ff075142 in __db_lget () from /lib64/libdb-5.3.so
> #6 0x00007f53fefbc605 in __bam_search () from /lib64/libdb-5.3.so
> #7 0x00007f53fefa7256 in __bamc_search () from /lib64/libdb-5.3.so
> #8 0x00007f53fefa8d0f in __bamc_get () from /lib64/libdb-5.3.so
> #9 0x00007f53ff061ca6 in __dbc_iget () from /lib64/libdb-5.3.so
> #10 0x00007f53ff070b02 in __dbc_get_pp () from /lib64/libdb-5.3.so
> #11 0x00007f53fa54c680 in idl_new_fetch () from /usr/lib64/dirsrv/plugins/
> libback-ldbm.so
> #12 0x00007f53fa55ab26 in index_read_ext_allids () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #13 0x00007f53fa545284 in keys2idl () from /usr/lib64/dirsrv/plugins/
> libback-ldbm.so
> #14 0x00007f53fa5459e3 in ava_candidates.isra.0 () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #15 0x00007f53fa545fd2 in filter_candidates_ext () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #16 0x00007f53fa547096 in list_candidates () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #17 0x00007f53fa545f40 in filter_candidates_ext () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #18 0x00007f53fa58180c in subtree_candidates () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #19 0x00007f53fa582e7f in ldbm_back_search () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #20 0x00007f5406eb01d6 in op_shared_search () from
> /usr/lib64/dirsrv/libslapd.so.0
> #21 0x00007f54073a133e in do_search ()
> #22 0x00007f540738f567 in connection_threadmain ()
> #23 0x00007f540509e7bb in _pt_root () from /lib64/libnspr4.so
> #24 0x00007f5404a3fdc5 in start_thread () from /lib64/libpthread.so.0
> #25 0x00007f540476d28d in clone () from /lib64/libc.so.6
> Thread 17 (Thread 0x7f53d2fed700 (LWP 128229)):
> #0 0x00007f5404a436d5 in pthread_cond_wait@@GLIBC_2.3.2 () from
> /lib64/libpthread.so.0
> #1 0x00007f53fef9f2f3 in __db_hybrid_mutex_suspend () from /lib64/
> libdb-5.3.so
> #2 0x00007f53fef9e640 in __db_tas_mutex_lock () from /lib64/libdb-5.3.so
> #3 0x00007f53ff048d3a in __lock_get_internal () from /lib64/libdb-5.3.so
> #4 0x00007f53ff049820 in __lock_get () from /lib64/libdb-5.3.so
> #5 0x00007f53ff075142 in __db_lget () from /lib64/libdb-5.3.so
> #6 0x00007f53fefbc605 in __bam_search () from /lib64/libdb-5.3.so
> #7 0x00007f53fefa7256 in __bamc_search () from /lib64/libdb-5.3.so
> #8 0x00007f53fefa8d0f in __bamc_get () from /lib64/libdb-5.3.so
> #9 0x00007f53ff061ca6 in __dbc_iget () from /lib64/libdb-5.3.so
> #10 0x00007f53ff070b02 in __dbc_get_pp () from /lib64/libdb-5.3.so
> #11 0x00007f53fa54c680 in idl_new_fetch () from /usr/lib64/dirsrv/plugins/
> libback-ldbm.so
> #12 0x00007f53fa55ab26 in index_read_ext_allids () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #13 0x00007f53fa545284 in keys2idl () from /usr/lib64/dirsrv/plugins/
> libback-ldbm.so
> #14 0x00007f53fa5459e3 in ava_candidates.isra.0 () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #15 0x00007f53fa545fd2 in filter_candidates_ext () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #16 0x00007f53fa547096 in list_candidates () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #17 0x00007f53fa545f40 in filter_candidates_ext () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #18 0x00007f53fa58180c in subtree_candidates () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #19 0x00007f53fa582e7f in ldbm_back_search () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #20 0x00007f5406eb01d6 in op_shared_search () from
> /usr/lib64/dirsrv/libslapd.so.0
> #21 0x00007f54073a133e in do_search ()
> #22 0x00007f540738f567 in connection_threadmain ()
> #23 0x00007f540509e7bb in _pt_root () from /lib64/libnspr4.so
> #24 0x00007f5404a3fdc5 in start_thread () from /lib64/libpthread.so.0
> #25 0x00007f540476d28d in clone () from /lib64/libc.so.6
> Thread 16 (Thread 0x7f53d27ec700 (LWP 128230)):
> #0 0x00007f5404a436d5 in pthread_cond_wait@@GLIBC_2.3.2 () from
> /lib64/libpthread.so.0
> #1 0x00007f53fef9f2f3 in __db_hybrid_mutex_suspend () from /lib64/
> libdb-5.3.so
> #2 0x00007f53fef9e640 in __db_tas_mutex_lock () from /lib64/libdb-5.3.so
> #3 0x00007f53ff048d3a in __lock_get_internal () from /lib64/libdb-5.3.so
> #4 0x00007f53ff049820 in __lock_get () from /lib64/libdb-5.3.so
> #5 0x00007f53ff075142 in __db_lget () from /lib64/libdb-5.3.so
> #6 0x00007f53fefbc605 in __bam_search () from /lib64/libdb-5.3.so
> #7 0x00007f53fefa7256 in __bamc_search () from /lib64/libdb-5.3.so
> #8 0x00007f53fefa8d0f in __bamc_get () from /lib64/libdb-5.3.so
> #9 0x00007f53ff061ca6 in __dbc_iget () from /lib64/libdb-5.3.so
> #10 0x00007f53ff070b02 in __dbc_get_pp () from /lib64/libdb-5.3.so
> #11 0x00007f53fa54c680 in idl_new_fetch () from /usr/lib64/dirsrv/plugins/
> libback-ldbm.so
> #12 0x00007f53fa55ab26 in index_read_ext_allids () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #13 0x00007f53fa545284 in keys2idl () from /usr/lib64/dirsrv/plugins/
> libback-ldbm.so
> #14 0x00007f53fa5459e3 in ava_candidates.isra.0 () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #15 0x00007f53fa545fd2 in filter_candidates_ext () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #16 0x00007f53fa547096 in list_candidates () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #17 0x00007f53fa545f40 in filter_candidates_ext () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #18 0x00007f53fa58180c in subtree_candidates () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #19 0x00007f53fa582e7f in ldbm_back_search () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #20 0x00007f5406eb01d6 in op_shared_search () from
> /usr/lib64/dirsrv/libslapd.so.0
> #21 0x00007f54073a133e in do_search ()
> #22 0x00007f540738f567 in connection_threadmain ()
> #23 0x00007f540509e7bb in _pt_root () from /lib64/libnspr4.so
> #24 0x00007f5404a3fdc5 in start_thread () from /lib64/libpthread.so.0
> #25 0x00007f540476d28d in clone () from /lib64/libc.so.6
> Thread 15 (Thread 0x7f53d1feb700 (LWP 128231)):
> #0 0x00007f5404a436d5 in pthread_cond_wait@@GLIBC_2.3.2 () from
> /lib64/libpthread.so.0
> #1 0x00007f53fef9f2f3 in __db_hybrid_mutex_suspend () from /lib64/
> libdb-5.3.so
> #2 0x00007f53fef9e640 in __db_tas_mutex_lock () from /lib64/libdb-5.3.so
> #3 0x00007f53ff048d3a in __lock_get_internal () from /lib64/libdb-5.3.so
> #4 0x00007f53ff049820 in __lock_get () from /lib64/libdb-5.3.so
> #5 0x00007f53ff075142 in __db_lget () from /lib64/libdb-5.3.so
> #6 0x00007f53fefbc605 in __bam_search () from /lib64/libdb-5.3.so
> #7 0x00007f53fefa7256 in __bamc_search () from /lib64/libdb-5.3.so
> #8 0x00007f53fefa8d0f in __bamc_get () from /lib64/libdb-5.3.so
> #9 0x00007f53ff061ca6 in __dbc_iget () from /lib64/libdb-5.3.so
> #10 0x00007f53ff070b02 in __dbc_get_pp () from /lib64/libdb-5.3.so
> #11 0x00007f53fa54c680 in idl_new_fetch () from /usr/lib64/dirsrv/plugins/
> libback-ldbm.so
> #12 0x00007f53fa55ab26 in index_read_ext_allids () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #13 0x00007f53fa545284 in keys2idl () from /usr/lib64/dirsrv/plugins/
> libback-ldbm.so
> #14 0x00007f53fa5459e3 in ava_candidates.isra.0 () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #15 0x00007f53fa545fd2 in filter_candidates_ext () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #16 0x00007f53fa547096 in list_candidates () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #17 0x00007f53fa545f40 in filter_candidates_ext () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #18 0x00007f53fa58180c in subtree_candidates () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #19 0x00007f53fa582e7f in ldbm_back_search () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #20 0x00007f5406eb01d6 in op_shared_search () from
> /usr/lib64/dirsrv/libslapd.so.0
> #21 0x00007f54073a133e in do_search ()
> #22 0x00007f540738f567 in connection_threadmain ()
> #23 0x00007f540509e7bb in _pt_root () from /lib64/libnspr4.so
> #24 0x00007f5404a3fdc5 in start_thread () from /lib64/libpthread.so.0
> #25 0x00007f540476d28d in clone () from /lib64/libc.so.6
> Thread 14 (Thread 0x7f53d17ea700 (LWP 128232)):
> #0 0x00007f5404a436d5 in pthread_cond_wait@@GLIBC_2.3.2 () from
> /lib64/libpthread.so.0
> #1 0x00007f53fef9f2f3 in __db_hybrid_mutex_suspend () from /lib64/
> libdb-5.3.so
> #2 0x00007f53fef9e640 in __db_tas_mutex_lock () from /lib64/libdb-5.3.so
> #3 0x00007f53ff048d3a in __lock_get_internal () from /lib64/libdb-5.3.so
> #4 0x00007f53ff049820 in __lock_get () from /lib64/libdb-5.3.so
> #5 0x00007f53ff075142 in __db_lget () from /lib64/libdb-5.3.so
> #6 0x00007f53fefbc605 in __bam_search () from /lib64/libdb-5.3.so
> #7 0x00007f53fefa7256 in __bamc_search () from /lib64/libdb-5.3.so
> #8 0x00007f53fefa8d0f in __bamc_get () from /lib64/libdb-5.3.so
> #9 0x00007f53ff061ca6 in __dbc_iget () from /lib64/libdb-5.3.so
> #10 0x00007f53ff070b02 in __dbc_get_pp () from /lib64/libdb-5.3.so
> #11 0x00007f53fa54c680 in idl_new_fetch () from /usr/lib64/dirsrv/plugins/
> libback-ldbm.so
> #12 0x00007f53fa55ab26 in index_read_ext_allids () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #13 0x00007f53fa545284 in keys2idl () from /usr/lib64/dirsrv/plugins/
> libback-ldbm.so
> #14 0x00007f53fa5459e3 in ava_candidates.isra.0 () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #15 0x00007f53fa545fd2 in filter_candidates_ext () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #16 0x00007f53fa547096 in list_candidates () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #17 0x00007f53fa545f40 in filter_candidates_ext () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #18 0x00007f53fa547096 in list_candidates () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #19 0x00007f53fa545f40 in filter_candidates_ext () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #20 0x00007f53fa547096 in list_candidates () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #21 0x00007f53fa545f40 in filter_candidates_ext () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #22 0x00007f53fa58180c in subtree_candidates () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #23 0x00007f53fa582e7f in ldbm_back_search () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #24 0x00007f5406eb01d6 in op_shared_search () from
> /usr/lib64/dirsrv/libslapd.so.0
> #25 0x00007f54073a133e in do_search ()
> #26 0x00007f540738f3c3 in connection_threadmain ()
> #27 0x00007f540509e7bb in _pt_root () from /lib64/libnspr4.so
> #28 0x00007f5404a3fdc5 in start_thread () from /lib64/libpthread.so.0
> #29 0x00007f540476d28d in clone () from /lib64/libc.so.6
> Thread 13 (Thread 0x7f53d0fe9700 (LWP 128233)):
> #0 0x00007f5404a436d5 in pthread_cond_wait@@GLIBC_2.3.2 () from
> /lib64/libpthread.so.0
> #1 0x00007f53fef9f2f3 in __db_hybrid_mutex_suspend () from /lib64/
> libdb-5.3.so
> #2 0x00007f53fef9e640 in __db_tas_mutex_lock () from /lib64/libdb-5.3.so
> #3 0x00007f53ff048d3a in __lock_get_internal () from /lib64/libdb-5.3.so
> #4 0x00007f53ff049820 in __lock_get () from /lib64/libdb-5.3.so
> #5 0x00007f53ff075142 in __db_lget () from /lib64/libdb-5.3.so
> #6 0x00007f53fefbc605 in __bam_search () from /lib64/libdb-5.3.so
> #7 0x00007f53fefa7256 in __bamc_search () from /lib64/libdb-5.3.so
> #8 0x00007f53fefa8d0f in __bamc_get () from /lib64/libdb-5.3.so
> #9 0x00007f53ff061ca6 in __dbc_iget () from /lib64/libdb-5.3.so
> #10 0x00007f53ff070b02 in __dbc_get_pp () from /lib64/libdb-5.3.so
> #11 0x00007f53fa54c680 in idl_new_fetch () from /usr/lib64/dirsrv/plugins/
> libback-ldbm.so
> #12 0x00007f53fa55ab26 in index_read_ext_allids () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #13 0x00007f53fa545284 in keys2idl () from /usr/lib64/dirsrv/plugins/
> libback-ldbm.so
> #14 0x00007f53fa5459e3 in ava_candidates.isra.0 () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #15 0x00007f53fa545fd2 in filter_candidates_ext () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #16 0x00007f53fa547096 in list_candidates () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #17 0x00007f53fa545f40 in filter_candidates_ext () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #18 0x00007f53fa58180c in subtree_candidates () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #19 0x00007f53fa582e7f in ldbm_back_search () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #20 0x00007f5406eb01d6 in op_shared_search () from
> /usr/lib64/dirsrv/libslapd.so.0
> #21 0x00007f54073a133e in do_search ()
> #22 0x00007f540738f567 in connection_threadmain ()
> #23 0x00007f540509e7bb in _pt_root () from /lib64/libnspr4.so
> #24 0x00007f5404a3fdc5 in start_thread () from /lib64/libpthread.so.0
> #25 0x00007f540476d28d in clone () from /lib64/libc.so.6
> Thread 12 (Thread 0x7f53d07e8700 (LWP 128234)):
> #0 0x00007f5404a436d5 in pthread_cond_wait@@GLIBC_2.3.2 () from
> /lib64/libpthread.so.0
> #1 0x00007f53fef9f2f3 in __db_hybrid_mutex_suspend () from /lib64/
> libdb-5.3.so
> #2 0x00007f53fef9e640 in __db_tas_mutex_lock () from /lib64/libdb-5.3.so
> #3 0x00007f53ff048d3a in __lock_get_internal () from /lib64/libdb-5.3.so
> #4 0x00007f53ff049820 in __lock_get () from /lib64/libdb-5.3.so
> #5 0x00007f53ff075142 in __db_lget () from /lib64/libdb-5.3.so
> #6 0x00007f53fefbc605 in __bam_search () from /lib64/libdb-5.3.so
> #7 0x00007f53fefa7256 in __bamc_search () from /lib64/libdb-5.3.so
> #8 0x00007f53fefa8d0f in __bamc_get () from /lib64/libdb-5.3.so
> #9 0x00007f53ff061ca6 in __dbc_iget () from /lib64/libdb-5.3.so
> #10 0x00007f53ff070b02 in __dbc_get_pp () from /lib64/libdb-5.3.so
> #11 0x00007f53fa54c680 in idl_new_fetch () from /usr/lib64/dirsrv/plugins/
> libback-ldbm.so
> #12 0x00007f53fa55ab26 in index_read_ext_allids () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #13 0x00007f53fa545284 in keys2idl () from /usr/lib64/dirsrv/plugins/
> libback-ldbm.so
> #14 0x00007f53fa5459e3 in ava_candidates.isra.0 () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #15 0x00007f53fa545fd2 in filter_candidates_ext () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #16 0x00007f53fa547096 in list_candidates () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #17 0x00007f53fa545f40 in filter_candidates_ext () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #18 0x00007f53fa58180c in subtree_candidates () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #19 0x00007f53fa582e7f in ldbm_back_search () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #20 0x00007f5406eb01d6 in op_shared_search () from
> /usr/lib64/dirsrv/libslapd.so.0
> #21 0x00007f54073a133e in do_search ()
> #22 0x00007f540738f567 in connection_threadmain ()
> #23 0x00007f540509e7bb in _pt_root () from /lib64/libnspr4.so
> #24 0x00007f5404a3fdc5 in start_thread () from /lib64/libpthread.so.0
> #25 0x00007f540476d28d in clone () from /lib64/libc.so.6
> Thread 11 (Thread 0x7f53cffe7700 (LWP 128235)):
> #0 0x00007f5404a436d5 in pthread_cond_wait@@GLIBC_2.3.2 () from
> /lib64/libpthread.so.0
> #1 0x00007f53fef9f2f3 in __db_hybrid_mutex_suspend () from /lib64/
> libdb-5.3.so
> #2 0x00007f53fef9e640 in __db_tas_mutex_lock () from /lib64/libdb-5.3.so
> #3 0x00007f53ff048d3a in __lock_get_internal () from /lib64/libdb-5.3.so
> #4 0x00007f53ff049820 in __lock_get () from /lib64/libdb-5.3.so
> #5 0x00007f53ff075142 in __db_lget () from /lib64/libdb-5.3.so
> #6 0x00007f53fefbc605 in __bam_search () from /lib64/libdb-5.3.so
> #7 0x00007f53fefa7256 in __bamc_search () from /lib64/libdb-5.3.so
> #8 0x00007f53fefa8d0f in __bamc_get () from /lib64/libdb-5.3.so
> #9 0x00007f53ff061ca6 in __dbc_iget () from /lib64/libdb-5.3.so
> #10 0x00007f53ff070b02 in __dbc_get_pp () from /lib64/libdb-5.3.so
> #11 0x00007f53fa54c680 in idl_new_fetch () from /usr/lib64/dirsrv/plugins/
> libback-ldbm.so
> #12 0x00007f53fa55ab26 in index_read_ext_allids () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #13 0x00007f53fa545284 in keys2idl () from /usr/lib64/dirsrv/plugins/
> libback-ldbm.so
> #14 0x00007f53fa5459e3 in ava_candidates.isra.0 () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #15 0x00007f53fa545fd2 in filter_candidates_ext () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #16 0x00007f53fa547096 in list_candidates () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #17 0x00007f53fa545f40 in filter_candidates_ext () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #18 0x00007f53fa58180c in subtree_candidates () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #19 0x00007f53fa582e7f in ldbm_back_search () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #20 0x00007f5406eb01d6 in op_shared_search () from
> /usr/lib64/dirsrv/libslapd.so.0
> #21 0x00007f54073a133e in do_search ()
> #22 0x00007f540738f567 in connection_threadmain ()
> #23 0x00007f540509e7bb in _pt_root () from /lib64/libnspr4.so
> #24 0x00007f5404a3fdc5 in start_thread () from /lib64/libpthread.so.0
> #25 0x00007f540476d28d in clone () from /lib64/libc.so.6
> Thread 10 (Thread 0x7f53cf7e6700 (LWP 128236)):
> #0 0x00007f5404a436d5 in pthread_cond_wait@@GLIBC_2.3.2 () from
> /lib64/libpthread.so.0
> #1 0x00007f53fef9f2f3 in __db_hybrid_mutex_suspend () from /lib64/
> libdb-5.3.so
> #2 0x00007f53fef9e640 in __db_tas_mutex_lock () from /lib64/libdb-5.3.so
> #3 0x00007f53ff048d3a in __lock_get_internal () from /lib64/libdb-5.3.so
> #4 0x00007f53ff049820 in __lock_get () from /lib64/libdb-5.3.so
> #5 0x00007f53ff075142 in __db_lget () from /lib64/libdb-5.3.so
> #6 0x00007f53fefbc605 in __bam_search () from /lib64/libdb-5.3.so
> #7 0x00007f53fefa7256 in __bamc_search () from /lib64/libdb-5.3.so
> #8 0x00007f53fefa8d0f in __bamc_get () from /lib64/libdb-5.3.so
> #9 0x00007f53ff061ca6 in __dbc_iget () from /lib64/libdb-5.3.so
> #10 0x00007f53ff070b02 in __dbc_get_pp () from /lib64/libdb-5.3.so
> #11 0x00007f53fa54c680 in idl_new_fetch () from /usr/lib64/dirsrv/plugins/
> libback-ldbm.so
> #12 0x00007f53fa55ab26 in index_read_ext_allids () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #13 0x00007f53fa545284 in keys2idl () from /usr/lib64/dirsrv/plugins/
> libback-ldbm.so
> #14 0x00007f53fa5459e3 in ava_candidates.isra.0 () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #15 0x00007f53fa545fd2 in filter_candidates_ext () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #16 0x00007f53fa547096 in list_candidates () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #17 0x00007f53fa545f40 in filter_candidates_ext () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #18 0x00007f53fa58180c in subtree_candidates () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #19 0x00007f53fa582e7f in ldbm_back_search () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #20 0x00007f5406eb01d6 in op_shared_search () from
> /usr/lib64/dirsrv/libslapd.so.0
> #21 0x00007f54073a133e in do_search ()
> #22 0x00007f540738f567 in connection_threadmain ()
> #23 0x00007f540509e7bb in _pt_root () from /lib64/libnspr4.so
> #24 0x00007f5404a3fdc5 in start_thread () from /lib64/libpthread.so.0
> #25 0x00007f540476d28d in clone () from /lib64/libc.so.6
> Thread 9 (Thread 0x7f53cefe5700 (LWP 128237)):
> #0 0x00007f5404a436d5 in pthread_cond_wait@@GLIBC_2.3.2 () from
> /lib64/libpthread.so.0
> #1 0x00007f53fef9f2f3 in __db_hybrid_mutex_suspend () from /lib64/
> libdb-5.3.so
> #2 0x00007f53fef9e640 in __db_tas_mutex_lock () from /lib64/libdb-5.3.so
> #3 0x00007f53ff048d3a in __lock_get_internal () from /lib64/libdb-5.3.so
> #4 0x00007f53ff049820 in __lock_get () from /lib64/libdb-5.3.so
> #5 0x00007f53ff075142 in __db_lget () from /lib64/libdb-5.3.so
> #6 0x00007f53fefbc605 in __bam_search () from /lib64/libdb-5.3.so
> #7 0x00007f53fefa7256 in __bamc_search () from /lib64/libdb-5.3.so
> #8 0x00007f53fefa8d0f in __bamc_get () from /lib64/libdb-5.3.so
> #9 0x00007f53ff061ca6 in __dbc_iget () from /lib64/libdb-5.3.so
> #10 0x00007f53ff070b02 in __dbc_get_pp () from /lib64/libdb-5.3.so
> #11 0x00007f53fa54c680 in idl_new_fetch () from /usr/lib64/dirsrv/plugins/
> libback-ldbm.so
> #12 0x00007f53fa55ab26 in index_read_ext_allids () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #13 0x00007f53fa545284 in keys2idl () from /usr/lib64/dirsrv/plugins/
> libback-ldbm.so
> #14 0x00007f53fa5459e3 in ava_candidates.isra.0 () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #15 0x00007f53fa545fd2 in filter_candidates_ext () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #16 0x00007f53fa547096 in list_candidates () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #17 0x00007f53fa545f40 in filter_candidates_ext () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #18 0x00007f53fa58180c in subtree_candidates () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #19 0x00007f53fa582e7f in ldbm_back_search () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #20 0x00007f5406eb01d6 in op_shared_search () from
> /usr/lib64/dirsrv/libslapd.so.0
> #21 0x00007f54073a133e in do_search ()
> #22 0x00007f540738f567 in connection_threadmain ()
> #23 0x00007f540509e7bb in _pt_root () from /lib64/libnspr4.so
> #24 0x00007f5404a3fdc5 in start_thread () from /lib64/libpthread.so.0
> #25 0x00007f540476d28d in clone () from /lib64/libc.so.6
> Thread 8 (Thread 0x7f53ce7e4700 (LWP 128238)):
> #0 0x00007f5404a436d5 in pthread_cond_wait@@GLIBC_2.3.2 () from
> /lib64/libpthread.so.0
> #1 0x00007f53fef9f2f3 in __db_hybrid_mutex_suspend () from /lib64/
> libdb-5.3.so
> #2 0x00007f53fef9e640 in __db_tas_mutex_lock () from /lib64/libdb-5.3.so
> #3 0x00007f53ff048d3a in __lock_get_internal () from /lib64/libdb-5.3.so
> #4 0x00007f53ff049820 in __lock_get () from /lib64/libdb-5.3.so
> #5 0x00007f53ff075142 in __db_lget () from /lib64/libdb-5.3.so
> #6 0x00007f53fefbc605 in __bam_search () from /lib64/libdb-5.3.so
> #7 0x00007f53fefa7256 in __bamc_search () from /lib64/libdb-5.3.so
> #8 0x00007f53fefa8d0f in __bamc_get () from /lib64/libdb-5.3.so
> #9 0x00007f53ff061ca6 in __dbc_iget () from /lib64/libdb-5.3.so
> #10 0x00007f53ff070b02 in __dbc_get_pp () from /lib64/libdb-5.3.so
> #11 0x00007f53fa54c680 in idl_new_fetch () from /usr/lib64/dirsrv/plugins/
> libback-ldbm.so
> #12 0x00007f53fa55ab26 in index_read_ext_allids () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #13 0x00007f53fa545284 in keys2idl () from /usr/lib64/dirsrv/plugins/
> libback-ldbm.so
> #14 0x00007f53fa5459e3 in ava_candidates.isra.0 () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #15 0x00007f53fa545fd2 in filter_candidates_ext () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #16 0x00007f53fa547096 in list_candidates () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #17 0x00007f53fa545f40 in filter_candidates_ext () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #18 0x00007f53fa58180c in subtree_candidates () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #19 0x00007f53fa582e7f in ldbm_back_search () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #20 0x00007f5406eb01d6 in op_shared_search () from
> /usr/lib64/dirsrv/libslapd.so.0
> #21 0x00007f54073a133e in do_search ()
> #22 0x00007f540738f567 in connection_threadmain ()
> #23 0x00007f540509e7bb in _pt_root () from /lib64/libnspr4.so
> #24 0x00007f5404a3fdc5 in start_thread () from /lib64/libpthread.so.0
> #25 0x00007f540476d28d in clone () from /lib64/libc.so.6
> Thread 7 (Thread 0x7f53cdfe3700 (LWP 128239)):
> #0 0x00007f5404a436d5 in pthread_cond_wait@@GLIBC_2.3.2 () from
> /lib64/libpthread.so.0
> #1 0x00007f53fef9f2f3 in __db_hybrid_mutex_suspend () from /lib64/
> libdb-5.3.so
> #2 0x00007f53fef9e640 in __db_tas_mutex_lock () from /lib64/libdb-5.3.so
> #3 0x00007f53ff048d3a in __lock_get_internal () from /lib64/libdb-5.3.so
> #4 0x00007f53ff049820 in __lock_get () from /lib64/libdb-5.3.so
> #5 0x00007f53ff075142 in __db_lget () from /lib64/libdb-5.3.so
> #6 0x00007f53fefbc605 in __bam_search () from /lib64/libdb-5.3.so
> #7 0x00007f53fefa7256 in __bamc_search () from /lib64/libdb-5.3.so
> #8 0x00007f53fefa8d0f in __bamc_get () from /lib64/libdb-5.3.so
> #9 0x00007f53ff061ca6 in __dbc_iget () from /lib64/libdb-5.3.so
> #10 0x00007f53ff070b02 in __dbc_get_pp () from /lib64/libdb-5.3.so
> #11 0x00007f53fa54c680 in idl_new_fetch () from /usr/lib64/dirsrv/plugins/
> libback-ldbm.so
> #12 0x00007f53fa55ab26 in index_read_ext_allids () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #13 0x00007f53fa545284 in keys2idl () from /usr/lib64/dirsrv/plugins/
> libback-ldbm.so
> #14 0x00007f53fa5459e3 in ava_candidates.isra.0 () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #15 0x00007f53fa545fd2 in filter_candidates_ext () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #16 0x00007f53fa547096 in list_candidates () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #17 0x00007f53fa545f40 in filter_candidates_ext () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #18 0x00007f53fa58180c in subtree_candidates () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #19 0x00007f53fa582e7f in ldbm_back_search () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #20 0x00007f5406eb01d6 in op_shared_search () from
> /usr/lib64/dirsrv/libslapd.so.0
> #21 0x00007f54073a133e in do_search ()
> #22 0x00007f540738f567 in connection_threadmain ()
> #23 0x00007f540509e7bb in _pt_root () from /lib64/libnspr4.so
> #24 0x00007f5404a3fdc5 in start_thread () from /lib64/libpthread.so.0
> #25 0x00007f540476d28d in clone () from /lib64/libc.so.6
> Thread 6 (Thread 0x7f53cd7e2700 (LWP 128240)):
> #0 0x00007f5404a436d5 in pthread_cond_wait@@GLIBC_2.3.2 () from
> /lib64/libpthread.so.0
> #1 0x00007f53fef9f2f3 in __db_hybrid_mutex_suspend () from /lib64/
> libdb-5.3.so
> #2 0x00007f53fef9eb37 in __db_tas_mutex_readlock () from /lib64/
> libdb-5.3.so
> #3 0x00007f53ff0b8d35 in __memp_fget () from /lib64/libdb-5.3.so
> #4 0x00007f53ff062333 in __dbc_iget () from /lib64/libdb-5.3.so
> #5 0x00007f53ff070b02 in __dbc_get_pp () from /lib64/libdb-5.3.so
> #6 0x00007f53fa54c822 in idl_new_fetch () from /usr/lib64/dirsrv/plugins/
> libback-ldbm.so
> #7 0x00007f53fa55ab26 in index_read_ext_allids () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #8 0x00007f53fa545284 in keys2idl () from /usr/lib64/dirsrv/plugins/
> libback-ldbm.so
> #9 0x00007f53fa5459e3 in ava_candidates.isra.0 () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #10 0x00007f53fa545fd2 in filter_candidates_ext () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #11 0x00007f53fa547096 in list_candidates () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #12 0x00007f53fa545f40 in filter_candidates_ext () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #13 0x00007f53fa547096 in list_candidates () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #14 0x00007f53fa545f40 in filter_candidates_ext () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #15 0x00007f53fa547096 in list_candidates () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #16 0x00007f53fa545f40 in filter_candidates_ext () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #17 0x00007f53fa58180c in subtree_candidates () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #18 0x00007f53fa582e7f in ldbm_back_search () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #19 0x00007f5406eb01d6 in op_shared_search () from
> /usr/lib64/dirsrv/libslapd.so.0
> #20 0x00007f54073a133e in do_search ()
> #21 0x00007f540738f3c3 in connection_threadmain ()
> #22 0x00007f540509e7bb in _pt_root () from /lib64/libnspr4.so
> #23 0x00007f5404a3fdc5 in start_thread () from /lib64/libpthread.so.0
> #24 0x00007f540476d28d in clone () from /lib64/libc.so.6
> Thread 5 (Thread 0x7f53ccfe1700 (LWP 128241)):
> #0 0x00007f5404a436d5 in pthread_cond_wait@@GLIBC_2.3.2 () from
> /lib64/libpthread.so.0
> #1 0x00007f53fef9f2f3 in __db_hybrid_mutex_suspend () from /lib64/
> libdb-5.3.so
> #2 0x00007f53fef9e640 in __db_tas_mutex_lock () from /lib64/libdb-5.3.so
> #3 0x00007f53ff048d3a in __lock_get_internal () from /lib64/libdb-5.3.so
> #4 0x00007f53ff049820 in __lock_get () from /lib64/libdb-5.3.so
> #5 0x00007f53ff075142 in __db_lget () from /lib64/libdb-5.3.so
> #6 0x00007f53fefbc605 in __bam_search () from /lib64/libdb-5.3.so
> #7 0x00007f53fefa7256 in __bamc_search () from /lib64/libdb-5.3.so
> #8 0x00007f53fefa8d0f in __bamc_get () from /lib64/libdb-5.3.so
> #9 0x00007f53ff061ca6 in __dbc_iget () from /lib64/libdb-5.3.so
> #10 0x00007f53ff070b02 in __dbc_get_pp () from /lib64/libdb-5.3.so
> #11 0x00007f53fa54c680 in idl_new_fetch () from /usr/lib64/dirsrv/plugins/
> libback-ldbm.so
> #12 0x00007f53fa55ab26 in index_read_ext_allids () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #13 0x00007f53fa545284 in keys2idl () from /usr/lib64/dirsrv/plugins/
> libback-ldbm.so
> #14 0x00007f53fa5459e3 in ava_candidates.isra.0 () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #15 0x00007f53fa545fd2 in filter_candidates_ext () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #16 0x00007f53fa547096 in list_candidates () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #17 0x00007f53fa545f40 in filter_candidates_ext () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #18 0x00007f53fa547096 in list_candidates () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #19 0x00007f53fa545f40 in filter_candidates_ext () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #20 0x00007f53fa547096 in list_candidates () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #21 0x00007f53fa545f40 in filter_candidates_ext () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #22 0x00007f53fa58180c in subtree_candidates () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #23 0x00007f53fa582e7f in ldbm_back_search () from
> /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #24 0x00007f5406eb01d6 in op_shared_search () from
> /usr/lib64/dirsrv/libslapd.so.0
> #25 0x00007f54073a133e in do_search ()
> #26 0x00007f540738f3c3 in connection_threadmain ()
> #27 0x00007f540509e7bb in _pt_root () from /lib64/libnspr4.so
> #28 0x00007f5404a3fdc5 in start_thread () from /lib64/libpthread.so.0
> #29 0x00007f540476d28d in clone () from /lib64/libc.so.6
> Thread 4 (Thread 0x7f53cc7e0700 (LWP 128242)):
> #0 0x00007f54047649b3 in select () from /lib64/libc.so.6
> #1 0x00007f5406eef0e9 in DS_Sleep () from /usr/lib64/dirsrv/libslapd.so.0
> #2 0x00007f5407390325 in time_thread ()
> #3 0x00007f540509e7bb in _pt_root () from /lib64/libnspr4.so
> #4 0x00007f5404a3fdc5 in start_thread () from /lib64/libpthread.so.0
> #5 0x00007f540476d28d in clone () from /lib64/libc.so.6
> Thread 3 (Thread 0x7f53cb7a0700 (LWP 128259)):
> #0 0x00007f5404a436d5 in pthread_cond_wait@@GLIBC_2.3.2 () from
> /lib64/libpthread.so.0
> #1 0x00007f5405099050 in PR_WaitCondVar () from /lib64/libnspr4.so
> #2 0x00007f540739bf25 in ps_send_results ()
> #3 0x00007f540509e7bb in _pt_root () from /lib64/libnspr4.so
> #4 0x00007f5404a3fdc5 in start_thread () from /lib64/libpthread.so.0
> #5 0x00007f540476d28d in clone () from /lib64/libc.so.6
> Thread 2 (Thread 0x7f53cab9d700 (LWP 9020)):
> #0 0x00007f5404a436d5 in pthread_cond_wait@@GLIBC_2.3.2 () from
> /lib64/libpthread.so.0
> #1 0x00007f5405099050 in PR_WaitCondVar () from /lib64/libnspr4.so
> #2 0x00007f540739bf25 in ps_send_results ()
> #3 0x00007f540509e7bb in _pt_root () from /lib64/libnspr4.so
> #4 0x00007f5404a3fdc5 in start_thread () from /lib64/libpthread.so.0
> #5 0x00007f540476d28d in clone () from /lib64/libc.so.6
> Thread 1 (Thread 0x7f5407357840 (LWP 128124)):
> #0 0x00007f5404762c3d in poll () from /lib64/libc.so.6
> #1 0x00007f540509a967 in _pr_poll_with_poll () from /lib64/libnspr4.so
> #2 0x00007f5407393ff1 in slapd_daemon ()
> #3 0x00007f5407385c6c in main ()
>
>
> Thanks
>
> On Tue, Sep 6, 2016 at 5:51 PM, Rakesh Rajasekharan <
> rakesh.rajasekharan at gmail.com> wrote:
>
>> Hi,
>>
>> With script provided by Rich, I looked at my db cache usage and it does
>> not look to be high enough
>>
>> # under each db are the list of selected indexes specified with INDEXLIST
>> dbname count free free% size
>> changelog:ent 5 2076333 99.0 4163.8
>> changelog:dn 15976 9303557 88.7 74.0
>> userroot:ent 4763 175321074 83.6 7221.1
>> userroot:dn 4763 9995056 95.3 103.0
>> ipaca:ent 425 6337866 60.4 9759.8
>> ipaca:dn 425 10451081 99.7 81.6
>>
>> Right now I set it to 200MB. So, I am planning to bring it down to 100MB
>>
>> Also, *nsslapd-db-checkpoint-interval *will change it to 80 or 90 from
>> default of 60
>>
>> I will check this out and the impact it has on the hang issues and get
>> back
>>
>> Thanks
>> Rakesh
>>
>> On Tue, Sep 6, 2016 at 4:13 PM, Ludwig Krispenz < <lkrispen at redhat.com>
>> lkrispen at redhat.com> wrote:
>>
>>> Hi,
>>>
>>> I think you are running into this bug:
>>> <https://bugzilla.redhat.com/show_bug.cgi?id=1349779>
>>> https://bugzilla.redhat.com/show_bug.cgi?id=1349779
>>> it was the outcome of an analysis started in this one:
>>> https://bugzilla.redhat.com/show_bug.cgi?id=1347800
>>>
>>> the problem is that it looks like the checkpoint thread is holding a
>>> mutex and otehr threads are blocked on it. It looks like an issue in
>>> BerkeleyDB although there is no explanation from the BDB code why this
>>> could happen, we also had a support case with Oracle to investigate this,
>>> with no solution. Oracle at the end was providing a diagnostic patch, which
>>> we did not test since the customer with the original problem had worked
>>> around this by changing their configuration.
>>> I don't know the status of this patch and if we can make it available,
>>> probably depends on your support status, you need to contact support for
>>> this.
>>>
>>> About the workarounds:
>>> you can try to change timing for the database update and checkpointing
>>> eg by reducing the dbcache size, changing the checkpoint interval. In the
>>> customer case they identified one substring index, which was frequently
>>> updated but not really required - and removing this index helped.
>>>
>>> Regards,
>>> Ludwig
>>>
>>> On 09/06/2016 11:31 AM, thierry bordaz wrote:
>>>
>>> Hi,
>>>
>>> The following thread is hanging most of the others threads
>>>
>>> Thread 20 (Thread 0x7f68007f8700 (LWP 4873)):
>>>
>>> #0 0x00007f683d0506d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>> #1 0x00007f68375ac2f3 in __db_hybrid_mutex_suspend () from /lib64/
>>> libdb-5.3.so
>>> #2 0x00007f68375ab640 in __db_tas_mutex_lock () from /lib64/
>>> libdb-5.3.so
>>> #3 0x00007f68376c5e1b in __memp_fget () from /lib64/libdb-5.3.so
>>> #4 0x00007f68375c9211 in __bam_search () from /lib64/libdb-5.3.so
>>> #5 0x00007f68375b4256 in __bamc_search () from /lib64/libdb-5.3.so
>>> #6 0x00007f68375b86c4 in __bamc_put () from /lib64/libdb-5.3.so
>>> #7 0x00007f683766f6d5 in __dbc_iput () from /lib64/libdb-5.3.so
>>> #8 0x00007f683766aa0e in __db_put () from /lib64/libdb-5.3.so
>>> #9 0x00007f683767ffa4 in __db_put_pp () from /lib64/libdb-5.3.so
>>> #10 0x00007f6832b5a4cf in idl_new_insert_key () from
>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>> #11 0x00007f6832b695b5 in addordel_values_sv.isra.3 () from
>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>> #12 0x00007f6832b6a25a in index_addordel_values_ext_sv () from
>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>> #13 0x00007f6832b6a694 in index_addordel_values_sv () from
>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>> #14 0x00007f6832b6a75a in index_addordel_entry () from
>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>> #15 0x00007f6832b6d5fa in ldbm_back_add () from
>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>> #16 0x00007f683f46fcca in op_shared_add () from
>>> /usr/lib64/dirsrv/libslapd.so.0
>>> #17 0x00007f683f471020 in do_add () from /usr/lib64/dirsrv/libslapd.so.0
>>> #18 0x00007f683f99c303 in connection_threadmain ()
>>> #19 0x00007f683d6ab7bb in _pt_root () from /lib64/libnspr4.so
>>> #20 0x00007f683d04cdc5 in start_thread () from /lib64/libpthread.so.0
>>> #21 0x00007f683cd7a28d in clone () from /lib64/libc.so.6
>>>
>>> This thread is likely not hang on 'db_tas_mutex_lock' as the db_lock
>>> does not show it waiting for something.
>>> Unfortunately it is not shown in the output of top -H, did you get the
>>> complete output ?
>>> Ludwig mentioned a known issue that DS is not scaling well on NUMA arch,
>>> do you know if the machine is NUMA ?
>>> A possibility is that this thread get severely slowed down by a NUMA
>>> remote lock and showing DS has hung.
>>> This is why it would be interesting to know if it consums CPU.
>>>
>>> thanks
>>> theirry
>>>
>>> On 09/06/2016 10:59 AM, Rakesh Rajasekharan wrote:
>>>
>>> Hi Thierry/Ludwig,
>>>
>>> I again hit the hang issue. This is the pstack of the ns-slapd
>>>
>>> So was able to this time get the pstack and db locks
>>>
>>> db locks details
>>> Default locking region information:
>>> 451 Last allocated locker ID
>>> 0x7fffffff Current maximum unused locker ID
>>> 9 Number of lock modes
>>> 800 Initial number of locks allocated
>>> 0 Initial number of lockers allocated
>>> 800 Initial number of lock objects allocated
>>> 10000 Maximum number of locks possible
>>> 10000 Maximum number of lockers possible
>>> 10000 Maximum number of lock objects possible
>>> 800 Current number of locks allocated
>>> 366 Current number of lockers allocated
>>> 800 Current number of lock objects allocated
>>> 160 Number of lock object partitions
>>> 8191 Size of object hash table
>>> 126 Number of current locks
>>> 1005 Maximum number of locks at any one time
>>> 33 Maximum number of locks in any one bucket
>>> 3987 Maximum number of locks stolen by for an empty partition
>>> 75 Maximum number of locks stolen for any one partition
>>> 309 Number of current lockers
>>> 313 Maximum number of lockers at any one time
>>> 121 Number of current lock objects
>>> 676 Maximum number of lock objects at any one time
>>> 3 Maximum number of lock objects in any one bucket
>>> 69 Maximum number of objects stolen by for an empty partition
>>> 5 Maximum number of objects stolen for any one partition
>>> 22M Total number of locks requested (22009642)
>>> 21M Total number of locks released (21992878)
>>> 0 Total number of locks upgraded
>>> 95 Total number of locks downgraded
>>> 3348 Lock requests not available due to conflicts, for which we
>>> waited
>>> 12646 Lock requests not available due to conflicts, for which we
>>> did not wait
>>> 0 Number of deadlocks
>>> 0 Lock timeout value
>>> 0 Number of locks that have timed out
>>> 0 Transaction timeout value
>>> 0 Number of transactions that have timed out
>>> 2MB 560KB Region size
>>> 71719 The number of partition locks that required waiting (0%)
>>> 23105 The maximum number of times any partition lock was waited for
>>> (0%)
>>> 0 The number of object queue operations that required waiting
>>> (0%)
>>> 163 The number of locker allocations that required waiting (0%)
>>> 3172 The number of region locks that required waiting (0%)
>>> 5 Maximum hash bucket length
>>> =-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=
>>> Lock REGINFO information:
>>> Environment Region type
>>> 1 Region ID
>>> /var/lib/dirsrv/slapd-SPRINKLR-COM/db/__db.001 Region name
>>> 0x7f67ef869000 Region address
>>> 0x7f67ef8690a0 Region allocation head
>>> 0x7f67ef8712b0 Region primary address
>>> 0 Region maximum allocation
>>> 0 Region allocated
>>> Region allocations: 1581345 allocations, 0 failures, 1580794 frees, 6
>>> longest
>>> Allocations by power-of-two sizes:
>>> 1KB 1581329
>>> 2KB 3
>>> 4KB 4
>>> 8KB 3
>>> 16KB 3
>>> 32KB 1
>>> 64KB 0
>>> 128KB 0
>>> 256KB 2
>>> 512KB 0
>>> 1024KB 1
>>> REGION_SHARED Region flags
>>> =-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=
>>> Lock region parameters:
>>> 2 Lock region region mutex [3172/14M 0% !Own] <wakeups 0/1143>
>>> 16381 locker table size
>>> 8191 object table size
>>> 34128 obj_off
>>> 900216 locker_off
>>> 0 need_dd
>>> =-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=
>>> Lock conflict matrix:
>>> =-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=
>>> Locks grouped by lockers:
>>> Locker Mode Count Status ----------------- Object ---------------
>>> 2 dd=308 locks held 1 write locks 0 pid/thread
>>> 4845/140085720139840 flags 10 priority 100
>>> 2 READ 1 HELD userRoot/id2entry.db handle
>>> 0
>>> 3 dd=307 locks held 0 write locks 0 pid/thread
>>> 4845/140084829472512 flags 0 priority 100
>>> 4 dd=306 locks held 1 write locks 0 pid/thread
>>> 4845/140085720139840 flags 10 priority 100
>>> 4 READ 1 HELD ipaca/id2entry.db handle
>>> 0
>>> 5 dd=305 locks held 0 write locks 0 pid/thread
>>> 4845/140084837865216 flags 0 priority 100
>>> 6 dd=304 locks held 1 write locks 0 pid/thread
>>> 4845/140085720139840 flags 10 priority 100
>>> 6 READ 1 HELD ipaca/entryrdn.db handle
>>> 0
>>> 7 dd=303 locks held 0 write locks 0 pid/thread
>>> 4845/140084804294400 flags 0 priority 100
>>> 8 dd=302 locks held 0 write locks 0 pid/thread
>>> 4845/140084720432896 flags 0 priority 100
>>> 9 dd=301 locks held 0 write locks 0 pid/thread
>>> 4845/140084837865216 flags 0 priority 100
>>> a dd=300 locks held 1 write locks 0 pid/thread
>>> 4845/140085720139840 flags 10 priority 100
>>> a READ 1 HELD ipaca/vlv#allcertspkitomcatindex.db
>>> handle 0
>>> e dd=299 locks held 1 write locks 0 pid/thread
>>> 4845/140085720139840 flags 10 priority 100
>>> e READ 1 HELD ipaca/vlv#allnonrevokedcertspkitomcatindex.db
>>> handle 0
>>> 10 dd=298 locks held 1 write locks 0 pid/thread
>>> 4845/140085720139840 flags 10 priority 100
>>> 10 READ 1 HELD ipaca/vlv#allrevokedcertspkitomcatindex.db
>>> handle 0
>>> 11 dd=297 locks held 1 write locks 0 pid/thread
>>> 4845/140085720139840 flags 10 priority 100
>>> 11 READ 1 HELD ipaca/vlv#allrevokedcertsnotafterpkitomcatindex.db
>>> handle 0
>>> 14 dd=296 locks held 1 write locks 0 pid/thread
>>> 4845/140085720139840 flags 10 priority 100
>>> 14 READ 1 HELD ipaca/vlv#allrevokedorrevokedexpiredcertspkitomcatindex.db
>>> handle 0
>>> 15 dd=295 locks held 1 write locks 0 pid/thread
>>> 4845/140085720139840 flags 10 priority 100
>>> 15 READ 1 HELD ipaca/vlv#allvalidcertspkitomcatindex.db
>>> handle 0
>>> 16 dd=294 locks held 1 write locks 0 pid/thread
>>> 4845/140085720139840 flags 10 priority 100
>>> 16 READ 1 HELD ipaca/vlv#allvalidcertsnotafterpkitomcatindex.db
>>> handle 0
>>> 17 dd=293 locks held 1 write locks 0 pid/thread
>>> 4845/140085720139840 flags 10 priority 100
>>> 17 READ 1 HELD ipaca/vlv#allvalidorrevokedcertspkitomcatindex.db
>>> handle 0
>>> 18 dd=292 locks held 1 write locks 0 pid/thread
>>> 4845/140085720139840 flags 10 priority 100
>>> 18 READ 1 HELD ipaca/vlv#caallpkitomcatindex.db
>>> handle 0
>>> 1d dd=291 locks held 1 write locks 0 pid/thread
>>> 4845/140085720139840 flags 10 priority 100
>>> 1d READ 1 HELD ipaca/vlv#cacompletepkitomcatindex.db
>>> handle 0
>>> 1e dd=290 locks held 1 write locks 0 pid/thread
>>> 4845/140085720139840 flags 10 priority 100
>>> 1e READ 1 HELD ipaca/vlv#cacompleteenrollmentpkitomcatindex.db
>>> handle 0
>>> 20 dd=289 locks held 1 write locks 0 pid/thread
>>> 4845/140085720139840 flags 10 priority 100
>>> 20 READ 1 HELD ipaca/vlv#cacompleterevocationpkitomcatindex.db
>>> handle 0
>>> 21 dd=288 locks held 1 write locks 0 pid/thread
>>> 4845/140085720139840 flags 10 priority 100
>>> 21 READ 1 HELD ipaca/vlv#caenrollmentpkitomcatindex.db
>>> handle 0
>>> 2b dd=287 locks held 1 write locks 0 pid/thread
>>> 4845/140085720139840 flags 10 priority 100
>>> 2b READ 1 HELD ipaca/vlv#carevocationpkitomcatindex.db
>>> handle 0
>>> 2c dd=286 locks held 1 write locks 0 pid/thread
>>> 4845/140085720139840 flags 10 priority 100
>>> 2c READ 1 HELD changelog/id2entry.db handle
>>> 0
>>> 2d dd=285 locks held 0 write locks 0 pid/thread
>>> 4845/140085719607040 flags 0 priority 100
>>> 2e dd=284 locks held 1 write locks 0 pid/thread
>>> 4845/140085720139840 flags 10 priority 100
>>> 2e READ 1 HELD changelog/entryusn.db handle
>>> 0
>>> 2f dd=283 locks held 0 write locks 0 pid/thread
>>> 4845/140085720139840 flags 0 priority 100
>>> 30 dd=282 locks held 1 write locks 0 pid/thread
>>> 4845/140085720139840 flags 10 priority 100
>>> 30 READ 1 HELD userRoot/entryusn.db handle
>>> 0
>>> 31 dd=281 locks held 0 write locks 0 pid/thread
>>> 4845/140085720139840 flags 0 priority 100
>>> 32 dd=280 locks held 1 write locks 0 pid/thread
>>> 4845/140085720139840 flags 10 priority 100
>>> 32 READ 1 HELD ipaca/entryusn.db handle
>>> 0
>>> 33 dd=279 locks held 0 write locks 0 pid/thread
>>> 4845/140085720139840 flags 0 priority 100
>>> 34 dd=278 locks held 1 write locks 0 pid/thread
>>> 4845/140085720139840 flags 10 priority 100
>>> 34 READ 1 HELD userRoot/entryrdn.db handle
>>> 0
>>> 35 dd=277 locks held 0 write locks 0 pid/thread
>>> 4845/140084544186112 flags 0 priority 100
>>> 36 dd=276 locks held 0 write locks 0 pid/thread
>>> 4845/140084636505856 flags 0 priority 100
>>> 37 dd=275 locks held 0 write locks 0 pid/thread
>>> 4845/140084854650624 flags 0 priority 100
>>> 38 dd=274 locks held 1 write locks 0 pid/thread
>>> 4845/140085720139840 flags 10 priority 100
>>> 38 READ 1 HELD userRoot/objectclass.db handle
>>> 0
>>> 39 dd=273 locks held 0 write locks 0 pid/thread
>>> 4845/140084569364224 flags 0 priority 100
>>> 3a dd=272 locks held 1 write locks 0 pid/thread
>>> 4845/140085720139840 flags 10 priority 100
>>> 3a READ 1 HELD userRoot/ancestorid.db handle
>>> 0
>>> 3b dd=271 locks held 0 write locks 0 pid/thread
>>> 4845/140084854650624 flags 0 priority 100
>>> 3c dd=270 locks held 1 write locks 0 pid/thread
>>> 4845/140085720139840 flags 10 priority 100
>>> 3c READ 1 HELD changelog/entryrdn.db handle
>>> 0
>>> 3d dd=269 locks held 0 write locks 0 pid/thread
>>> 4845/140085719607040 flags 0 priority 100
>>> 3e dd=268 locks held 0 write locks 0 pid/thread
>>> 4845/140084602935040 flags 0 priority 100
>>> 3f dd=267 locks held 0 write locks 0 pid/thread
>>> 4845/140085719607040 flags 0 priority 100
>>> 40 dd=266 locks held 1 write locks 0 pid/thread
>>> 4845/140085720139840 flags 10 priority 100
>>> 40 READ 1 HELD changelog/objectclass.db handle
>>> 0
>>> 41 dd=265 locks held 0 write locks 0 pid/thread
>>> 4845/140085719607040 flags 0 priority 100
>>> 42 dd=264 locks held 0 write locks 0 pid/thread
>>> 4845/140085719607040 flags 0 priority 100
>>> 43 dd=263 locks held 0 write locks 0 pid/thread
>>> 4845/140084653291264 flags 0 priority 100
>>> 44 dd=262 locks held 1 write locks 0 pid/thread
>>> 4845/140085720139840 flags 10 priority 100
>>> 44 READ 1 HELD ipaca/objectclass.db handle
>>> 0
>>> 45 dd=261 locks held 0 write locks 0 pid/thread
>>> 4845/140084577756928 flags 0 priority 100
>>> 46 dd=260 locks held 0 write locks 0 pid/thread
>>> 4845/140084720432896 flags 0 priority 100
>>> 47 dd=259 locks held 1 write locks 0 pid/thread
>>> 4845/140085720139840 flags 10 priority 100
>>> 47 READ 1 HELD changelog/aci.db handle
>>> 0
>>> 48 dd=258 locks held 0 write locks 0 pid/thread
>>> 4845/140085720139840 flags 0 priority 100
>>> 49 dd=257 locks held 1 write locks 0 pid/thread
>>> 4845/140085720139840 flags 10 priority 100
>>> 49 READ 1 HELD userRoot/aci.db handle
>>> 0
>>> 4a dd=256 locks held 0 write locks 0 pid/thread
>>> 4845/140085720139840 flags 0 priority 100
>>> 4b dd=255 locks held 0 write locks 0 pid/thread
>>> 4845/140084535793408 flags 0 priority 100
>>> 4c dd=254 locks held 1 write locks 0 pid/thread
>>> 4845/140085720139840 flags 10 priority 100
>>> 4c READ 1 HELD ipaca/aci.db handle
>>> 0
>>> 4d dd=253 locks held 0 write locks 0 pid/thread
>>> 4845/140085720139840 flags 0 priority 100
>>> 4e dd=252 locks held 1 write locks 0 pid/thread
>>> 4845/140085720139840 flags 10 priority 100
>>> 4e READ 1 HELD userRoot/parentid.db handle
>>> 0
>>> 4f dd=251 locks held 0 write locks 0 pid/thread
>>> 4845/140085720139840 flags 0 priority 100
>>> 50 dd=250 locks held 0 write locks 0 pid/thread
>>> 4845/140085719607040 flags 0 priority 100
>>> 51 dd=249 locks held 1 write locks 0 pid/thread
>>> 4845/140085720139840 flags 10 priority 100
>>> 51 READ 1 HELD changelog/nsuniqueid.db handle
>>> 0
>>> 52 dd=248 locks held 1 write locks 0 pid/thread
>>> 4845/140085720139840 flags 10 priority 100
>>> 52 READ 1 HELD changelog/changenumber.db handle
>>> 0
>>> 53 dd=247 locks held 0 write locks 0 pid/thread
>>> 4845/140084602935040 flags 0 priority 100
>>> 54 dd=246 locks held 0 write locks 0 pid/thread
>>> 4845/140085719607040 flags 0 priority 100
>>> 55 dd=245 locks held 1 write locks 0 pid/thread
>>> 4845/140085719607040 flags 10 priority 100
>>> 55 READ 1 HELD changelog/targetuniqueid.db
>>> handle 0
>>> 56 dd=244 locks held 1 write locks 0 pid/thread
>>> 4845/140085719607040 flags 10 priority 100
>>> 56 READ 1 HELD changelog/parentid.db handle
>>> 0
>>> 57 dd=243 locks held 1 write locks 0 pid/thread
>>> 4845/140085719607040 flags 10 priority 100
>>> 57 READ 1 HELD changelog/ancestorid.db handle
>>> 0
>>> 58 dd=242 locks held 1 write locks 0 pid/thread
>>> 4845/140085719607040 flags 10 priority 100
>>> 58 READ 1 HELD changelog/numsubordinates.db
>>> handle 0
>>> 59 dd=241 locks held 0 write locks 0 pid/thread
>>> 4845/140085719607040 flags 0 priority 100
>>> 5a dd=240 locks held 0 write locks 0 pid/thread
>>> 4845/140084544186112 flags 0 priority 100
>>> 5b dd=239 locks held 1 write locks 0 pid/thread
>>> 4845/140084577756928 flags 10 priority 100
>>> 5b READ 1 HELD userRoot/krbPrincipalName.db
>>> handle 0
>>> 5c dd=238 locks held 0 write locks 0 pid/thread
>>> 4845/140084636505856 flags 0 priority 100
>>> 5d dd=237 locks held 0 write locks 0 pid/thread
>>> 4845/140084695254784 flags 0 priority 100
>>> 5e dd=236 locks held 1 write locks 0 pid/thread
>>> 4845/140084560971520 flags 10 priority 100
>>> 5e READ 1 HELD userRoot/ipakrbprincipalalias.db
>>> handle 0
>>> 5f dd=235 locks held 0 write locks 0 pid/thread
>>> 4845/140084703647488 flags 0 priority 100
>>> 60 dd=234 locks held 0 write locks 0 pid/thread
>>> 4845/140084653291264 flags 0 priority 100
>>> 61 dd=233 locks held 0 write locks 0 pid/thread
>>> 4845/140084577756928 flags 0 priority 100
>>> 62 dd=232 locks held 0 write locks 0 pid/thread
>>> 4845/140084686862080 flags 0 priority 100
>>> 63 dd=231 locks held 1 write locks 0 pid/thread
>>> 4845/140084611327744 flags 10 priority 100
>>> 63 READ 1 HELD changelog/seeAlso.db handle
>>> 0
>>> 64 dd=230 locks held 0 write locks 0 pid/thread
>>> 4845/140084686862080 flags 0 priority 100
>>> 65 dd=229 locks held 1 write locks 0 pid/thread
>>> 4845/140084611327744 flags 10 priority 100
>>> 65 READ 1 HELD userRoot/seeAlso.db handle
>>> 0
>>> 66 dd=228 locks held 0 write locks 0 pid/thread
>>> 4845/140084636505856 flags 0 priority 100
>>> 67 dd=227 locks held 1 write locks 0 pid/thread
>>> 4845/140084611327744 flags 10 priority 100
>>> 67 READ 1 HELD ipaca/seeAlso.db handle
>>> 0
>>> 68 dd=226 locks held 0 write locks 0 pid/thread
>>> 4845/140084686862080 flags 0 priority 100
>>> 69 dd=225 locks held 1 write locks 0 pid/thread
>>> 4845/140084678469376 flags 10 priority 100
>>> 69 READ 1 HELD ipaca/parentid.db handle
>>> 0
>>> 6a dd=224 locks held 0 write locks 0 pid/thread
>>> 4845/140084678469376 flags 0 priority 100
>>> 6b dd=223 locks held 0 write locks 0 pid/thread
>>> 4845/140084829472512 flags 0 priority 100
>>> 6c dd=222 locks held 0 write locks 0 pid/thread
>>> 4845/140084653291264 flags 0 priority 100
>>> 6d dd=221 locks held 0 write locks 0 pid/thread
>>> 4845/140084569364224 flags 0 priority 100
>>> 6e dd=220 locks held 0 write locks 0 pid/thread
>>> 4845/140084636505856 flags 0 priority 100
>>> 6e READ 1 WAIT userRoot/objectclass.db page
>>> 18
>>> 6f dd=219 locks held 0 write locks 0 pid/thread
>>> 4845/140084544186112 flags 0 priority 100
>>> 70 dd=218 locks held 0 write locks 0 pid/thread
>>> 4845/140084569364224 flags 0 priority 100
>>> 71 dd=217 locks held 0 write locks 0 pid/thread
>>> 4845/140084619720448 flags 0 priority 100
>>> 72 dd=216 locks held 0 write locks 0 pid/thread
>>> 4845/140084552578816 flags 0 priority 100
>>> 73 dd=215 locks held 0 write locks 0 pid/thread
>>> 4845/140084829472512 flags 0 priority 100
>>> 74 dd=214 locks held 0 write locks 0 pid/thread
>>> 4845/140084628113152 flags 0 priority 100
>>> 75 dd=213 locks held 0 write locks 0 pid/thread
>>> 4845/140084686862080 flags 0 priority 100
>>> 76 dd=212 locks held 1 write locks 0 pid/thread
>>> 4845/140084560971520 flags 10 priority 100
>>> 76 READ 1 HELD userRoot/ipauniqueid.db handle
>>> 0
>>> 77 dd=211 locks held 0 write locks 0 pid/thread
>>> 4845/140084661683968 flags 0 priority 100
>>> 78 dd=210 locks held 0 write locks 0 pid/thread
>>> 4845/140084846257920 flags 0 priority 100
>>> 79 dd=209 locks held 0 write locks 0 pid/thread
>>> 4845/140084628113152 flags 0 priority 100
>>> 7a dd=208 locks held 1 write locks 0 pid/thread
>>> 4845/140084560971520 flags 10 priority 100
>>> 7a READ 1 HELD userRoot/nsuniqueid.db handle
>>> 0
>>> 7b dd=207 locks held 1 write locks 0 pid/thread
>>> 4845/140084560971520 flags 10 priority 100
>>> 7b READ 1 HELD userRoot/cn.db handle
>>> 0
>>> 7c dd=206 locks held 1 write locks 0 pid/thread
>>> 4845/140084560971520 flags 10 priority 100
>>> 7c READ 1 HELD userRoot/fqdn.db handle
>>> 0
>>> 7d dd=205 locks held 1 write locks 0 pid/thread
>>> 4845/140084560971520 flags 10 priority 100
>>> 7d READ 1 HELD userRoot/managedby.db handle
>>> 0
>>> 7e dd=204 locks held 1 write locks 0 pid/thread
>>> 4845/140084560971520 flags 10 priority 100
>>> 7e READ 1 HELD userRoot/numsubordinates.db
>>> handle 0
>>> 7f dd=203 locks held 1 write locks 0 pid/thread
>>> 4845/140084678469376 flags 10 priority 100
>>> 7f READ 1 HELD userRoot/member.db handle
>>> 0
>>> 80 dd=202 locks held 0 write locks 0 pid/thread
>>> 4845/140084712040192 flags 0 priority 100
>>> 81 dd=201 locks held 1 write locks 0 pid/thread
>>> 4845/140084678469376 flags 10 priority 100
>>> 81 READ 1 HELD userRoot/memberUser.db handle
>>> 0
>>> 82 dd=200 locks held 0 write locks 0 pid/thread
>>> 4845/140084577756928 flags 0 priority 100
>>> 83 dd=199 locks held 1 write locks 0 pid/thread
>>> 4845/140084678469376 flags 10 priority 100
>>> 83 READ 1 HELD userRoot/memberHost.db handle
>>> 0
>>> 84 dd=198 locks held 0 write locks 0 pid/thread
>>> 4845/140084712040192 flags 0 priority 100
>>> 85 dd=197 locks held 0 write locks 0 pid/thread
>>> 4845/140084577756928 flags 0 priority 100
>>> 86 dd=196 locks held 0 write locks 0 pid/thread
>>> 4845/140084670076672 flags 0 priority 100
>>> 87 dd=195 locks held 0 write locks 0 pid/thread
>>> 4845/140084577756928 flags 0 priority 100
>>> 88 dd=194 locks held 0 write locks 0 pid/thread
>>> 4845/140084846257920 flags 0 priority 100
>>> 89 dd=193 locks held 0 write locks 0 pid/thread
>>> 4845/140084552578816 flags 0 priority 100
>>> 8a dd=192 locks held 0 write locks 0 pid/thread
>>> 4845/140084703647488 flags 0 priority 100
>>> 8b dd=191 locks held 0 write locks 0 pid/thread
>>> 4845/140084544186112 flags 0 priority 100
>>> 8c dd=190 locks held 0 write locks 0 pid/thread
>>> 4845/140084846257920 flags 0 priority 100
>>> 8d dd=189 locks held 0 write locks 0 pid/thread
>>> 4845/140084661683968 flags 0 priority 100
>>> 8e dd=188 locks held 1 write locks 0 pid/thread
>>> 4845/140085067675392 flags 10 priority 100
>>> 8e READ 1 HELD userRoot/macAddress.db handle
>>> 0
>>> 8f dd=187 locks held 0 write locks 0 pid/thread
>>> 4845/140085067675392 flags 0 priority 100
>>> 90 dd=186 locks held 0 write locks 0 pid/thread
>>> 4845/140084703647488 flags 0 priority 100
>>> 91 dd=185 locks held 0 write locks 0 pid/thread
>>> 4845/140084552578816 flags 0 priority 100
>>> 92 dd=184 locks held 0 write locks 0 pid/thread
>>> 4845/140084560971520 flags 0 priority 100
>>> 92 READ 1 WAIT userRoot/objectclass.db page
>>> 9
>>> 93 dd=183 locks held 0 write locks 0 pid/thread
>>> 4845/140084577756928 flags 0 priority 100
>>> 94 dd=182 locks held 0 write locks 0 pid/thread
>>> 4845/140084821079808 flags 0 priority 100
>>> 94 READ 1 WAIT userRoot/objectclass.db page
>>> 18
>>> 95 dd=181 locks held 0 write locks 0 pid/thread
>>> 4845/140084544186112 flags 0 priority 100
>>> 96 dd=180 locks held 0 write locks 0 pid/thread
>>> 4845/140084804294400 flags 0 priority 100
>>> 97 dd=179 locks held 1 write locks 0 pid/thread
>>> 4845/140084712040192 flags 10 priority 100
>>> 97 READ 1 HELD userRoot/uid.db handle
>>> 0
>>> 98 dd=178 locks held 0 write locks 0 pid/thread
>>> 4845/140084552578816 flags 0 priority 100
>>> 99 dd=177 locks held 0 write locks 0 pid/thread
>>> 4845/140084577756928 flags 0 priority 100
>>> 9a dd=176 locks held 0 write locks 0 pid/thread
>>> 4845/140084602935040 flags 0 priority 100
>>> 9b dd=175 locks held 1 write locks 0 pid/thread
>>> 4845/140085076068096 flags 10 priority 100
>>> 9b READ 1 HELD userRoot/uniquemember.db handle
>>> 0
>>> 9c dd=174 locks held 1 write locks 0 pid/thread
>>> 4845/140085076068096 flags 10 priority 100
>>> 9c READ 1 HELD userRoot/owner.db handle
>>> 0
>>> 9d dd=173 locks held 1 write locks 0 pid/thread
>>> 4845/140085076068096 flags 10 priority 100
>>> 9d READ 1 HELD userRoot/ipaallowedtarget.db
>>> handle 0
>>> 9e dd=172 locks held 1 write locks 0 pid/thread
>>> 4845/140085076068096 flags 10 priority 100
>>> 9e READ 1 HELD userRoot/ipaMemberCertProfile.db
>>> handle 0
>>> 9f dd=171 locks held 1 write locks 0 pid/thread
>>> 4845/140085076068096 flags 10 priority 100
>>> 9f READ 1 HELD userRoot/ipaassignedidview.db
>>> handle 0
>>> a0 dd=170 locks held 1 write locks 0 pid/thread
>>> 4845/140085076068096 flags 10 priority 100
>>> a0 READ 1 HELD userRoot/secretary.db handle
>>> 0
>>> a1 dd=169 locks held 1 write locks 0 pid/thread
>>> 4845/140085076068096 flags 10 priority 100
>>> a1 READ 1 HELD userRoot/memberdenycmd.db handle
>>> 0
>>> a2 dd=168 locks held 1 write locks 0 pid/thread
>>> 4845/140085076068096 flags 10 priority 100
>>> a2 READ 1 HELD userRoot/memberallowcmd.db
>>> handle 0
>>> a3 dd=167 locks held 1 write locks 0 pid/thread
>>> 4845/140085076068096 flags 10 priority 100
>>> a3 READ 1 HELD userRoot/manager.db handle
>>> 0
>>> a4 dd=166 locks held 1 write locks 0 pid/thread
>>> 4845/140085076068096 flags 10 priority 100
>>> a4 READ 1 HELD userRoot/ipasudorunas.db handle
>>> 0
>>> a5 dd=165 locks held 1 write locks 0 pid/thread
>>> 4845/140085076068096 flags 10 priority 100
>>> a5 READ 1 HELD userRoot/ipaMemberCa.db handle
>>> 0
>>> a6 dd=164 locks held 1 write locks 0 pid/thread
>>> 4845/140085076068096 flags 10 priority 100
>>> a6 READ 1 HELD userRoot/ipasudorunasgroup.db
>>> handle 0
>>> a7 dd=163 locks held 1 write locks 0 pid/thread
>>> 4845/140085076068096 flags 10 priority 100
>>> a7 READ 1 HELD userRoot/sourcehost.db handle
>>> 0
>>> a8 dd=162 locks held 1 write locks 0 pid/thread
>>> 4845/140085076068096 flags 10 priority 100
>>> a8 READ 1 HELD userRoot/memberservice.db handle
>>> 0
>>> a9 dd=161 locks held 1 write locks 0 pid/thread
>>> 4845/140085076068096 flags 10 priority 100
>>> a9 READ 1 HELD userRoot/ipatokenradiusconfiglink.db
>>> handle 0
>>> aa dd=160 locks held 0 write locks 0 pid/thread
>>> 4845/140084703647488 flags 0 priority 100
>>> ab dd=159 locks held 0 write locks 0 pid/thread
>>> 4845/140084821079808 flags 0 priority 100
>>> ac dd=158 locks held 0 write locks 0 pid/thread
>>> 4845/140084628113152 flags 0 priority 100
>>> ad dd=157 locks held 0 write locks 0 pid/thread
>>> 4845/140084829472512 flags 0 priority 100
>>> ae dd=156 locks held 0 write locks 0 pid/thread
>>> 4845/140084829472512 flags 0 priority 100
>>> af dd=155 locks held 0 write locks 0 pid/thread
>>> 4845/140084854650624 flags 0 priority 100
>>> b0 dd=154 locks held 0 write locks 0 pid/thread
>>> 4845/140084854650624 flags 0 priority 100
>>> b1 dd=153 locks held 0 write locks 0 pid/thread
>>> 4845/140084837865216 flags 0 priority 100
>>> b2 dd=152 locks held 0 write locks 0 pid/thread
>>> 4845/140084804294400 flags 0 priority 100
>>> b3 dd=151 locks held 0 write locks 0 pid/thread
>>> 4845/140084812687104 flags 0 priority 100
>>> b4 dd=150 locks held 0 write locks 0 pid/thread
>>> 4845/140084804294400 flags 0 priority 100
>>> b5 dd=149 locks held 0 write locks 0 pid/thread
>>> 4845/140084837865216 flags 0 priority 100
>>> b6 dd=148 locks held 0 write locks 0 pid/thread
>>> 4845/140084569364224 flags 0 priority 100
>>> b7 dd=147 locks held 0 write locks 0 pid/thread
>>> 4845/140084829472512 flags 0 priority 100
>>> b8 dd=146 locks held 0 write locks 0 pid/thread
>>> 4845/140084586149632 flags 0 priority 100
>>> b9 dd=145 locks held 0 write locks 0 pid/thread
>>> 4845/140084653291264 flags 0 priority 100
>>> ba dd=144 locks held 0 write locks 0 pid/thread
>>> 4845/140084636505856 flags 0 priority 100
>>> bb dd=143 locks held 0 write locks 0 pid/thread
>>> 4845/140084804294400 flags 0 priority 100
>>> bc dd=142 locks held 0 write locks 0 pid/thread
>>> 4845/140084804294400 flags 0 priority 100
>>> bd dd=141 locks held 0 write locks 0 pid/thread
>>> 4845/140084695254784 flags 0 priority 100
>>> be dd=140 locks held 0 write locks 0 pid/thread
>>> 4845/140084670076672 flags 0 priority 100
>>> bf dd=139 locks held 0 write locks 0 pid/thread
>>> 4845/140084628113152 flags 0 priority 100
>>> c0 dd=138 locks held 0 write locks 0 pid/thread
>>> 4845/140084661683968 flags 0 priority 100
>>> c1 dd=137 locks held 0 write locks 0 pid/thread
>>> 4845/140084712040192 flags 0 priority 100
>>> c2 dd=136 locks held 0 write locks 0 pid/thread
>>> 4845/140084661683968 flags 0 priority 100
>>> c3 dd=135 locks held 0 write locks 0 pid/thread
>>> 4845/140084577756928 flags 0 priority 100
>>> c4 dd=134 locks held 0 write locks 0 pid/thread
>>> 4845/140084854650624 flags 0 priority 100
>>> c5 dd=133 locks held 1 write locks 0 pid/thread
>>> 4845/140084644898560 flags 10 priority 100
>>> c5 READ 1 HELD userRoot/uidnumber.db handle
>>> 0
>>> c6 dd=132 locks held 0 write locks 0 pid/thread
>>> 4845/140084594542336 flags 0 priority 100
>>> c8 dd=131 locks held 1 write locks 0 pid/thread
>>> 4845/140084678469376 flags 10 priority 100
>>> c8 READ 1 HELD ipaca/certstatus.db handle
>>> 0
>>> c9 dd=130 locks held 0 write locks 0 pid/thread
>>> 4845/140084720432896 flags 0 priority 100
>>> ca dd=129 locks held 0 write locks 0 pid/thread
>>> 4845/140084619720448 flags 0 priority 100
>>> cb dd=128 locks held 0 write locks 0 pid/thread
>>> 4845/140084821079808 flags 0 priority 100
>>> cc dd=127 locks held 0 write locks 0 pid/thread
>>> 4845/140084594542336 flags 0 priority 100
>>> cd dd=126 locks held 0 write locks 0 pid/thread
>>> 4845/140084560971520 flags 0 priority 100
>>> ce dd=125 locks held 1 write locks 0 pid/thread
>>> 4845/140084837865216 flags 10 priority 100
>>> ce READ 1 HELD userRoot/gidnumber.db handle
>>> 0
>>> cf dd=124 locks held 0 write locks 0 pid/thread
>>> 4845/140084720432896 flags 0 priority 100
>>> d0 dd=123 locks held 0 write locks 0 pid/thread
>>> 4845/140084569364224 flags 0 priority 100
>>> d1 dd=122 locks held 1 write locks 0 pid/thread
>>> 4845/140084678469376 flags 10 priority 100
>>> d1 READ 1 HELD userRoot/nscpEntryDN.db handle
>>> 0
>>> d2 dd=121 locks held 0 write locks 0 pid/thread
>>> 4845/140084695254784 flags 0 priority 100
>>> d3 dd=120 locks held 0 write locks 0 pid/thread
>>> 4845/140084569364224 flags 0 priority 100
>>> d4 dd=119 locks held 0 write locks 0 pid/thread
>>> 4845/140084653291264 flags 0 priority 100
>>> d5 dd=118 locks held 0 write locks 0 pid/thread
>>> 4845/140084829472512 flags 0 priority 100
>>> d6 dd=117 locks held 0 write locks 0 pid/thread
>>> 4845/140084661683968 flags 0 priority 100
>>> d7 dd=116 locks held 0 write locks 0 pid/thread
>>> 4845/140084804294400 flags 0 priority 100
>>> d8 dd=115 locks held 1 write locks 0 pid/thread
>>> 4845/140084821079808 flags 10 priority 100
>>> d8 READ 1 HELD ipaca/description.db handle
>>> 0
>>> d9 dd=114 locks held 0 write locks 0 pid/thread
>>> 4845/140084661683968 flags 0 priority 100
>>> da dd=113 locks held 0 write locks 0 pid/thread
>>> 4845/140084837865216 flags 0 priority 100
>>> db dd=112 locks held 1 write locks 0 pid/thread
>>> 4845/140084678469376 flags 10 priority 100
>>> db READ 1 HELD ipaca/cn.db handle
>>> 0
>>> dc dd=111 locks held 0 write locks 0 pid/thread
>>> 4845/140084577756928 flags 0 priority 100
>>> dd dd=110 locks held 1 write locks 0 pid/thread
>>> 4845/140084678469376 flags 10 priority 100
>>> dd READ 1 HELD ipaca/ancestorid.db handle
>>> 0
>>> de dd=109 locks held 0 write locks 0 pid/thread
>>> 4845/140084577756928 flags 0 priority 100
>>> df dd=108 locks held 0 write locks 0 pid/thread
>>> 4845/140084703647488 flags 0 priority 100
>>> e0 dd=107 locks held 0 write locks 0 pid/thread
>>> 4845/140084569364224 flags 0 priority 100
>>> e1 dd=106 locks held 0 write locks 0 pid/thread
>>> 4845/140084569364224 flags 0 priority 100
>>> e2 dd=105 locks held 0 write locks 0 pid/thread
>>> 4845/140084821079808 flags 0 priority 100
>>> e3 dd=104 locks held 1 write locks 0 pid/thread
>>> 4845/140084686862080 flags 10 priority 100
>>> e3 READ 1 HELD ipaca/serialno.db handle
>>> 0
>>> e4 dd=103 locks held 0 write locks 0 pid/thread
>>> 4845/140084837865216 flags 0 priority 100
>>> e5 dd=102 locks held 1 write locks 0 pid/thread
>>> 4845/140084695254784 flags 10 priority 100
>>> e5 READ 1 HELD ipaca/revInfo.db handle
>>> 0
>>> e6 dd=101 locks held 1 write locks 0 pid/thread
>>> 4845/140084695254784 flags 10 priority 100
>>> e6 READ 1 HELD ipaca/revokedby.db handle
>>> 0
>>> e7 dd=100 locks held 1 write locks 0 pid/thread
>>> 4845/140084695254784 flags 10 priority 100
>>> e7 READ 1 HELD ipaca/revokedOn.db handle
>>> 0
>>> e8 dd=99 locks held 0 write locks 0 pid/thread
>>> 4845/140084829472512 flags 0 priority 100
>>> e9 dd=98 locks held 0 write locks 0 pid/thread
>>> 4845/140084846257920 flags 0 priority 100
>>> ea dd=97 locks held 1 write locks 0 pid/thread
>>> 4845/140084703647488 flags 10 priority 100
>>> ea READ 1 HELD ipaca/nsuniqueid.db handle
>>> 0
>>> eb dd=96 locks held 1 write locks 0 pid/thread
>>> 4845/140084703647488 flags 10 priority 100
>>> eb READ 1 HELD ipaca/requestid.db handle
>>> 0
>>> ec dd=95 locks held 1 write locks 0 pid/thread
>>> 4845/140084703647488 flags 10 priority 100
>>> ec READ 1 HELD ipaca/requeststate.db handle
>>> 0
>>> ed dd=94 locks held 1 write locks 0 pid/thread
>>> 4845/140084703647488 flags 10 priority 100
>>> ed READ 1 HELD ipaca/dateOfCreate.db handle
>>> 0
>>> ee dd=93 locks held 1 write locks 0 pid/thread
>>> 4845/140084703647488 flags 10 priority 100
>>> ee READ 1 HELD ipaca/requesttype.db handle
>>> 0
>>> ef dd=92 locks held 1 write locks 0 pid/thread
>>> 4845/140084703647488 flags 10 priority 100
>>> ef READ 1 HELD ipaca/numsubordinates.db handle
>>> 0
>>> f0 dd=91 locks held 1 write locks 0 pid/thread
>>> 4845/140084611327744 flags 10 priority 100
>>> f0 READ 1 HELD userRoot/userCertificate.db
>>> handle 0
>>> f1 dd=90 locks held 0 write locks 0 pid/thread
>>> 4845/140084821079808 flags 0 priority 100
>>> f2 dd=89 locks held 0 write locks 0 pid/thread
>>> 4845/140084569364224 flags 0 priority 100
>>> f3 dd=88 locks held 0 write locks 0 pid/thread
>>> 4845/140084602935040 flags 0 priority 100
>>> f4 dd=87 locks held 0 write locks 0 pid/thread
>>> 4845/140084720432896 flags 0 priority 100
>>> f5 dd=86 locks held 0 write locks 0 pid/thread
>>> 4845/140084628113152 flags 0 priority 100
>>> f6 dd=85 locks held 0 write locks 0 pid/thread
>>> 4845/140084703647488 flags 0 priority 100
>>> f7 dd=84 locks held 0 write locks 0 pid/thread
>>> 4845/140084611327744 flags 0 priority 100
>>> f8 dd=83 locks held 0 write locks 0 pid/thread
>>> 4845/140084661683968 flags 0 priority 100
>>> f9 dd=82 locks held 0 write locks 0 pid/thread
>>> 4845/140084837865216 flags 0 priority 100
>>> fa dd=81 locks held 0 write locks 0 pid/thread
>>> 4845/140084544186112 flags 0 priority 100
>>> fb dd=80 locks held 0 write locks 0 pid/thread
>>> 4845/140084703647488 flags 0 priority 100
>>> fc dd=79 locks held 0 write locks 0 pid/thread
>>> 4845/140084544186112 flags 0 priority 100
>>> fd dd=78 locks held 0 write locks 0 pid/thread
>>> 4845/140084535793408 flags 0 priority 100
>>> fe dd=77 locks held 0 write locks 0 pid/thread
>>> 4845/140084586149632 flags 0 priority 100
>>> ff dd=76 locks held 0 write locks 0 pid/thread
>>> 4845/140084569364224 flags 0 priority 100
>>> 100 dd=75 locks held 0 write locks 0 pid/thread
>>> 4845/140084804294400 flags 0 priority 100
>>> 101 dd=74 locks held 0 write locks 0 pid/thread
>>> 4845/140084703647488 flags 0 priority 100
>>> 102 dd=73 locks held 0 write locks 0 pid/thread
>>> 4845/140084703647488 flags 0 priority 100
>>> 103 dd=72 locks held 0 write locks 0 pid/thread
>>> 4845/140084821079808 flags 0 priority 100
>>> 104 dd=71 locks held 0 write locks 0 pid/thread
>>> 4845/140084695254784 flags 0 priority 100
>>> 105 dd=70 locks held 0 write locks 0 pid/thread
>>> 4845/140084544186112 flags 0 priority 100
>>> 106 dd=69 locks held 0 write locks 0 pid/thread
>>> 4845/140084854650624 flags 0 priority 100
>>> 107 dd=68 locks held 0 write locks 0 pid/thread
>>> 4845/140084628113152 flags 0 priority 100
>>> 108 dd=67 locks held 0 write locks 0 pid/thread
>>> 4845/140084569364224 flags 0 priority 100
>>> 109 dd=66 locks held 0 write locks 0 pid/thread
>>> 4845/140084594542336 flags 0 priority 100
>>> 10a dd=65 locks held 0 write locks 0 pid/thread
>>> 4845/140084661683968 flags 0 priority 100
>>> 10b dd=64 locks held 0 write locks 0 pid/thread
>>> 4845/140084653291264 flags 0 priority 100
>>> 10c dd=63 locks held 0 write locks 0 pid/thread
>>> 4845/140084695254784 flags 0 priority 100
>>> 10d dd=62 locks held 0 write locks 0 pid/thread
>>> 4845/140084720432896 flags 0 priority 100
>>> 10e dd=61 locks held 0 write locks 0 pid/thread
>>> 4845/140084619720448 flags 0 priority 100
>>> 10f dd=60 locks held 0 write locks 0 pid/thread
>>> 4845/140084720432896 flags 0 priority 100
>>> 110 dd=59 locks held 0 write locks 0 pid/thread
>>> 4845/140084569364224 flags 0 priority 100
>>> 111 dd=58 locks held 0 write locks 0 pid/thread
>>> 4845/140084695254784 flags 0 priority 100
>>> 112 dd=57 locks held 0 write locks 0 pid/thread
>>> 4845/140084653291264 flags 0 priority 100
>>> 113 dd=56 locks held 0 write locks 0 pid/thread
>>> 4845/140084712040192 flags 0 priority 100
>>> 114 dd=55 locks held 0 write locks 0 pid/thread
>>> 4845/140084686862080 flags 0 priority 100
>>> 115 dd=54 locks held 0 write locks 0 pid/thread
>>> 4845/140084577756928 flags 0 priority 100
>>> 115 READ 1 WAIT userRoot/objectclass.db page
>>> 9
>>> 116 dd=53 locks held 0 write locks 0 pid/thread
>>> 4845/140084837865216 flags 0 priority 100
>>> 116 READ 1 WAIT userRoot/objectclass.db page
>>> 9
>>> 117 dd=52 locks held 0 write locks 0 pid/thread
>>> 4845/140084577756928 flags 0 priority 100
>>> 118 dd=51 locks held 0 write locks 0 pid/thread
>>> 4845/140084569364224 flags 0 priority 100
>>> 119 dd=50 locks held 0 write locks 0 pid/thread
>>> 4845/140084560971520 flags 0 priority 100
>>> 11a dd=49 locks held 1 write locks 0 pid/thread
>>> 4845/140084695254784 flags 10 priority 100
>>> 11a READ 1 HELD ipaca/metaInfo.db handle
>>> 0
>>> 11b dd=48 locks held 1 write locks 0 pid/thread
>>> 4845/140084695254784 flags 10 priority 100
>>> 11b READ 1 HELD ipaca/notbefore.db handle
>>> 0
>>> 11c dd=47 locks held 1 write locks 0 pid/thread
>>> 4845/140084695254784 flags 10 priority 100
>>> 11c READ 1 HELD ipaca/notafter.db handle
>>> 0
>>> 11d dd=46 locks held 1 write locks 0 pid/thread
>>> 4845/140084695254784 flags 10 priority 100
>>> 11d READ 1 HELD ipaca/duration.db handle
>>> 0
>>> 11e dd=45 locks held 1 write locks 0 pid/thread
>>> 4845/140084695254784 flags 10 priority 100
>>> 11e READ 1 HELD ipaca/subjectname.db handle
>>> 0
>>> 11f dd=44 locks held 1 write locks 0 pid/thread
>>> 4845/140084695254784 flags 10 priority 100
>>> 11f READ 1 HELD ipaca/publicKeyData.db handle
>>> 0
>>> 120 dd=43 locks held 1 write locks 0 pid/thread
>>> 4845/140084695254784 flags 10 priority 100
>>> 120 READ 1 HELD ipaca/extension.db handle
>>> 0
>>> 121 dd=42 locks held 1 write locks 0 pid/thread
>>> 4845/140084695254784 flags 10 priority 100
>>> 121 READ 1 HELD ipaca/issuedby.db handle
>>> 0
>>> 122 dd=41 locks held 0 write locks 0 pid/thread
>>> 4845/140084712040192 flags 0 priority 100
>>> 123 dd=40 locks held 0 write locks 0 pid/thread
>>> 4845/140084812687104 flags 0 priority 100
>>> 124 dd=39 locks held 0 write locks 0 pid/thread
>>> 4845/140084544186112 flags 0 priority 100
>>> 125 dd=38 locks held 0 write locks 0 pid/thread
>>> 4845/140084686862080 flags 0 priority 100
>>> 126 dd=37 locks held 0 write locks 0 pid/thread
>>> 4845/140084552578816 flags 0 priority 100
>>> 128 dd=36 locks held 0 write locks 0 pid/thread
>>> 4845/140084686862080 flags 0 priority 100
>>> 12a dd=35 locks held 0 write locks 0 pid/thread
>>> 4845/140084720432896 flags 0 priority 100
>>> 12b dd=34 locks held 0 write locks 0 pid/thread
>>> 4845/140084552578816 flags 0 priority 100
>>> 12c dd=33 locks held 0 write locks 0 pid/thread
>>> 4845/140084670076672 flags 0 priority 100
>>> 12d dd=32 locks held 0 write locks 0 pid/thread
>>> 4845/140084577756928 flags 0 priority 100
>>> 12e dd=31 locks held 0 write locks 0 pid/thread
>>> 4845/140084712040192 flags 0 priority 100
>>> 12f dd=30 locks held 0 write locks 0 pid/thread
>>> 4845/140084670076672 flags 0 priority 100
>>> 130 dd=29 locks held 0 write locks 0 pid/thread
>>> 4845/140084577756928 flags 0 priority 100
>>> 131 dd=28 locks held 0 write locks 0 pid/thread
>>> 4845/140084560971520 flags 0 priority 100
>>> 132 dd=27 locks held 0 write locks 0 pid/thread
>>> 4845/140084670076672 flags 0 priority 100
>>> 133 dd=26 locks held 0 write locks 0 pid/thread
>>> 4845/140084602935040 flags 0 priority 100
>>> 134 dd=25 locks held 0 write locks 0 pid/thread
>>> 4845/140084552578816 flags 0 priority 100
>>> 135 dd=24 locks held 0 write locks 0 pid/thread
>>> 4845/140084678469376 flags 0 priority 100
>>> 136 dd=23 locks held 0 write locks 0 pid/thread
>>> 4845/140084544186112 flags 0 priority 100
>>> 137 dd=22 locks held 0 write locks 0 pid/thread
>>> 4845/140084577756928 flags 0 priority 100
>>> 138 dd=21 locks held 0 write locks 0 pid/thread
>>> 4845/140084703647488 flags 0 priority 100
>>> 139 dd=20 locks held 0 write locks 0 pid/thread
>>> 4845/140084678469376 flags 0 priority 100
>>> 13b dd=19 locks held 0 write locks 0 pid/thread
>>> 4845/140084812687104 flags 0 priority 100
>>> 144 dd=18 locks held 0 write locks 0 pid/thread
>>> 4845/140084670076672 flags 0 priority 100
>>> 156 dd=17 locks held 0 write locks 0 pid/thread
>>> 4845/140084594542336 flags 0 priority 100
>>> 15a dd=16 locks held 0 write locks 0 pid/thread
>>> 4845/140084577756928 flags 0 priority 100
>>> 168 dd=15 locks held 0 write locks 0 pid/thread
>>> 4845/140084653291264 flags 0 priority 100
>>> 16a dd=14 locks held 0 write locks 0 pid/thread
>>> 4845/140084829472512 flags 0 priority 100
>>> 17d dd=13 locks held 0 write locks 0 pid/thread
>>> 4845/140084829472512 flags 0 priority 100
>>> 17e dd=12 locks held 0 write locks 0 pid/thread
>>> 4845/140084829472512 flags 0 priority 100
>>> 17f dd=11 locks held 0 write locks 0 pid/thread
>>> 4845/140084586149632 flags 0 priority 100
>>> 180 dd=10 locks held 0 write locks 0 pid/thread
>>> 4845/140084594542336 flags 0 priority 100
>>> 181 dd= 9 locks held 0 write locks 0 pid/thread
>>> 4845/140084577756928 flags 0 priority 100
>>> 193 dd= 8 locks held 0 write locks 0 pid/thread
>>> 4845/140084812687104 flags 0 priority 100
>>> 196 dd= 7 locks held 0 write locks 0 pid/thread
>>> 4845/140084695254784 flags 0 priority 100
>>> 1a1 dd= 6 locks held 0 write locks 0 pid/thread
>>> 4845/140084720432896 flags 0 priority 100
>>> 1a2 dd= 5 locks held 0 write locks 0 pid/thread
>>> 4845/140084577756928 flags 0 priority 100
>>> 1a3 dd= 4 locks held 0 write locks 0 pid/thread
>>> 4845/140084812687104 flags 0 priority 100
>>> 1a4 dd= 3 locks held 0 write locks 0 pid/thread
>>> 4845/140084812687104 flags 0 priority 100
>>> 1a5 dd= 2 locks held 0 write locks 0 pid/thread
>>> 4845/140084577756928 flags 0 priority 100
>>> 1a6 dd= 1 locks held 0 write locks 0 pid/thread
>>> 4845/140084594542336 flags 0 priority 100
>>> 800b3a33 dd= 0 locks held 26 write locks 22 pid/thread
>>> 4845/140084661683968 flags 0 priority 100
>>> 800b3a33 WRITE 1 HELD userRoot/objectclass.db page
>>> 9
>>> 800b3a33 WRITE 1 HELD userRoot/objectclass.db page
>>> 8
>>> 800b3a33 WRITE 1 HELD userRoot/objectclass.db page
>>> 18
>>> 800b3a33 WRITE 1 HELD userRoot/objectclass.db page
>>> 7
>>> 800b3a33 WRITE 1 HELD userRoot/objectclass.db page
>>> 14
>>> 800b3a33 WRITE 1 HELD userRoot/objectclass.db page
>>> 11
>>> 800b3a33 WRITE 2 HELD userRoot/objectclass.db page
>>> 3
>>> 800b3a33 WRITE 1 HELD userRoot/cn.db page
>>> 150
>>> 800b3a33 WRITE 1 HELD userRoot/cn.db page
>>> 89
>>> 800b3a33 WRITE 1 HELD userRoot/cn.db page
>>> 53
>>> 800b3a33 WRITE 1 HELD userRoot/cn.db page
>>> 131
>>> 800b3a33 WRITE 1 HELD userRoot/cn.db page
>>> 117
>>> 800b3a33 WRITE 1 HELD userRoot/cn.db page
>>> 11
>>> 800b3a33 WRITE 2 HELD userRoot/cn.db page
>>> 141
>>> 800b3a33 WRITE 1 HELD userRoot/cn.db page
>>> 41
>>> 800b3a33 WRITE 1 HELD userRoot/cn.db page
>>> 40
>>> 800b3a33 WRITE 1 HELD userRoot/cn.db page
>>> 143
>>> 800b3a33 WRITE 1 HELD userRoot/cn.db page
>>> 30
>>> 800b3a33 WRITE 2 HELD userRoot/id2entry.db page
>>> 8184
>>> 800b3a33 WRITE 1 HELD userRoot/id2entry.db page
>>> 8183
>>> 800b3a33 WRITE 1 HELD userRoot/id2entry.db page
>>> 7779
>>> 800b3a33 WRITE 1 HELD userRoot/id2entry.db page
>>> 0
>>> 800b3a33 READ 3 HELD userRoot/entryrdn.db page
>>> 3
>>> 800b3a33 READ 1 HELD userRoot/entryrdn.db page
>>> 36
>>> 800b3a33 READ 1 HELD userRoot/entryrdn.db page
>>> 4
>>> 800b3a33 READ 1 HELD userRoot/nsuniqueid.db page
>>> 86
>>> =-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=
>>> Locks grouped by object:
>>> Locker Mode Count Status ----------------- Object ---------------
>>> a4 READ 1 HELD userRoot/ipasudorunas.db handle
>>> 0
>>>
>>> 9e READ 1 HELD userRoot/ipaMemberCertProfile.db
>>> handle 0
>>>
>>> 10 READ 1 HELD ipaca/vlv#allrevokedcertspkitomcatindex.db
>>> handle 0
>>>
>>> 800b3a33 WRITE 2 HELD userRoot/id2entry.db page
>>> 8184
>>>
>>> 800b3a33 WRITE 1 HELD userRoot/id2entry.db page
>>> 8183
>>>
>>> 800b3a33 WRITE 1 HELD userRoot/id2entry.db page
>>> 7779
>>>
>>> a1 READ 1 HELD userRoot/memberdenycmd.db handle
>>> 0
>>>
>>> a READ 1 HELD ipaca/vlv#allcertspkitomcatindex.db
>>> handle 0
>>>
>>> a7 READ 1 HELD userRoot/sourcehost.db handle
>>> 0
>>>
>>> 57 READ 1 HELD changelog/ancestorid.db handle
>>> 0
>>>
>>> e5 READ 1 HELD ipaca/revInfo.db handle
>>> 0
>>>
>>> e6 READ 1 HELD ipaca/revokedby.db handle
>>> 0
>>>
>>> 11 READ 1 HELD ipaca/vlv#allrevokedcertsnotafterpkitomcatindex.db
>>> handle 0
>>>
>>> 4e READ 1 HELD userRoot/parentid.db handle
>>> 0
>>>
>>> 4 READ 1 HELD ipaca/id2entry.db handle
>>> 0
>>>
>>> 58 READ 1 HELD changelog/numsubordinates.db
>>> handle 0
>>>
>>> 67 READ 1 HELD ipaca/seeAlso.db handle
>>> 0
>>>
>>> 2b READ 1 HELD ipaca/vlv#carevocationpkitomcatindex.db
>>> handle 0
>>>
>>> ec READ 1 HELD ipaca/requeststate.db handle
>>> 0
>>>
>>> 11b READ 1 HELD ipaca/notbefore.db handle
>>> 0
>>>
>>> 7e READ 1 HELD userRoot/numsubordinates.db
>>> handle 0
>>>
>>> a2 READ 1 HELD userRoot/memberallowcmd.db
>>> handle 0
>>>
>>> 9c READ 1 HELD userRoot/owner.db handle
>>> 0
>>>
>>> 1e READ 1 HELD ipaca/vlv#cacompleteenrollmentpkitomcatindex.db
>>> handle 0
>>>
>>> 11c READ 1 HELD ipaca/notafter.db handle
>>> 0
>>>
>>> 40 READ 1 HELD changelog/objectclass.db handle
>>> 0
>>>
>>> 2e READ 1 HELD changelog/entryusn.db handle
>>> 0
>>>
>>> 16 READ 1 HELD ipaca/vlv#allvalidcertsnotafterpkitomcatindex.db
>>> handle 0
>>>
>>> 15 READ 1 HELD ipaca/vlv#allvalidcertspkitomcatindex.db
>>> handle 0
>>>
>>> a5 READ 1 HELD userRoot/ipaMemberCa.db handle
>>> 0
>>>
>>> 18 READ 1 HELD ipaca/vlv#caallpkitomcatindex.db
>>> handle 0
>>>
>>> a0 READ 1 HELD userRoot/secretary.db handle
>>> 0
>>>
>>> 81 READ 1 HELD userRoot/memberUser.db handle
>>> 0
>>>
>>> 9f READ 1 HELD userRoot/ipaassignedidview.db
>>> handle 0
>>>
>>> a3 READ 1 HELD userRoot/manager.db handle
>>> 0
>>>
>>> d8 READ 1 HELD ipaca/description.db handle
>>> 0
>>>
>>> a8 READ 1 HELD userRoot/memberservice.db handle
>>> 0
>>>
>>> 44 READ 1 HELD ipaca/objectclass.db handle
>>> 0
>>>
>>> ed READ 1 HELD ipaca/dateOfCreate.db handle
>>> 0
>>>
>>> 800b3a33 WRITE 1 HELD userRoot/id2entry.db page
>>> 0
>>>
>>> 2 READ 1 HELD userRoot/id2entry.db handle
>>> 0
>>>
>>> 5b READ 1 HELD userRoot/krbPrincipalName.db
>>> handle 0
>>>
>>> ee READ 1 HELD ipaca/requesttype.db handle
>>> 0
>>>
>>> c8 READ 1 HELD ipaca/certstatus.db handle
>>> 0
>>>
>>> 56 READ 1 HELD changelog/parentid.db handle
>>> 0
>>>
>>> 83 READ 1 HELD userRoot/memberHost.db handle
>>> 0
>>>
>>> 5e READ 1 HELD userRoot/ipakrbprincipalalias.db
>>> handle 0
>>>
>>> 121 READ 1 HELD ipaca/issuedby.db handle
>>> 0
>>>
>>> 6 READ 1 HELD ipaca/entryrdn.db handle
>>> 0
>>>
>>> e7 READ 1 HELD ipaca/revokedOn.db handle
>>> 0
>>>
>>> 4c READ 1 HELD ipaca/aci.db handle
>>> 0
>>>
>>> 11d READ 1 HELD ipaca/duration.db handle
>>> 0
>>>
>>> 14 READ 1 HELD ipaca/vlv#allrevokedorrevokedexpiredcertspkitomcatindex.db
>>> handle 0
>>>
>>> 21 READ 1 HELD ipaca/vlv#caenrollmentpkitomcatindex.db
>>> handle 0
>>>
>>> 55 READ 1 HELD changelog/targetuniqueid.db
>>> handle 0
>>>
>>> 800b3a33 READ 1 HELD userRoot/entryrdn.db page
>>> 36
>>>
>>> 2c READ 1 HELD changelog/id2entry.db handle
>>> 0
>>>
>>> 800b3a33 READ 1 HELD userRoot/entryrdn.db page
>>> 4
>>>
>>> 34 READ 1 HELD userRoot/entryrdn.db handle
>>> 0
>>>
>>> 800b3a33 READ 3 HELD userRoot/entryrdn.db page
>>> 3
>>>
>>> eb READ 1 HELD ipaca/requestid.db handle
>>> 0
>>>
>>> 49 READ 1 HELD userRoot/aci.db handle
>>> 0
>>>
>>> 76 READ 1 HELD userRoot/ipauniqueid.db handle
>>> 0
>>>
>>> 63 READ 1 HELD changelog/seeAlso.db handle
>>> 0
>>>
>>> 7c READ 1 HELD userRoot/fqdn.db handle
>>> 0
>>>
>>> db READ 1 HELD ipaca/cn.db handle
>>> 0
>>>
>>> ef READ 1 HELD ipaca/numsubordinates.db handle
>>> 0
>>>
>>> 32 READ 1 HELD ipaca/entryusn.db handle
>>> 0
>>>
>>> 1d READ 1 HELD ipaca/vlv#cacompletepkitomcatindex.db
>>> handle 0
>>>
>>> dd READ 1 HELD ipaca/ancestorid.db handle
>>> 0
>>>
>>> a9 READ 1 HELD userRoot/ipatokenradiusconfiglink.db
>>> handle 0
>>>
>>> f0 READ 1 HELD userRoot/userCertificate.db
>>> handle 0
>>>
>>> 11a READ 1 HELD ipaca/metaInfo.db handle
>>> 0
>>>
>>> 7d READ 1 HELD userRoot/managedby.db handle
>>> 0
>>>
>>> ea READ 1 HELD ipaca/nsuniqueid.db handle
>>> 0
>>>
>>> c5 READ 1 HELD userRoot/uidnumber.db handle
>>> 0
>>>
>>> d1 READ 1 HELD userRoot/nscpEntryDN.db handle
>>> 0
>>>
>>> 120 READ 1 HELD ipaca/extension.db handle
>>> 0
>>>
>>> 800b3a33 WRITE 1 HELD userRoot/cn.db page
>>> 150
>>>
>>> 69 READ 1 HELD ipaca/parentid.db handle
>>> 0
>>>
>>> 800b3a33 WRITE 1 HELD userRoot/cn.db page
>>> 131
>>>
>>> 800b3a33 WRITE 1 HELD userRoot/cn.db page
>>> 143
>>>
>>> 800b3a33 WRITE 2 HELD userRoot/cn.db page
>>> 141
>>>
>>> 20 READ 1 HELD ipaca/vlv#cacompleterevocationpkitomcatindex.db
>>> handle 0
>>>
>>> 8e READ 1 HELD userRoot/macAddress.db handle
>>> 0
>>>
>>> e READ 1 HELD ipaca/vlv#allnonrevokedcertspkitomcatindex.db
>>> handle 0
>>>
>>> 17 READ 1 HELD ipaca/vlv#allvalidorrevokedcertspkitomcatindex.db
>>> handle 0
>>>
>>> 800b3a33 WRITE 1 HELD userRoot/cn.db page
>>> 30
>>>
>>> 800b3a33 WRITE 1 HELD userRoot/objectclass.db page
>>> 14
>>>
>>> 800b3a33 WRITE 1 HELD userRoot/objectclass.db page
>>> 9
>>> 116 READ 1 WAIT userRoot/objectclass.db page
>>> 9
>>> 115 READ 1 WAIT userRoot/objectclass.db page
>>> 9
>>> 92 READ 1 WAIT userRoot/objectclass.db page
>>> 9
>>>
>>> 800b3a33 WRITE 1 HELD userRoot/objectclass.db page
>>> 8
>>>
>>> 7b READ 1 HELD userRoot/cn.db handle
>>> 0
>>>
>>> 800b3a33 WRITE 1 HELD userRoot/objectclass.db page
>>> 11
>>>
>>> 800b3a33 WRITE 1 HELD userRoot/objectclass.db page
>>> 7
>>>
>>> 800b3a33 WRITE 1 HELD userRoot/cn.db page
>>> 11
>>>
>>> 38 READ 1 HELD userRoot/objectclass.db handle
>>> 0
>>>
>>> 800b3a33 WRITE 2 HELD userRoot/objectclass.db page
>>> 3
>>>
>>> 800b3a33 WRITE 1 HELD userRoot/cn.db page
>>> 53
>>>
>>> 800b3a33 WRITE 1 HELD userRoot/objectclass.db page
>>> 18
>>> 6e READ 1 WAIT userRoot/objectclass.db page
>>> 18
>>> 94 READ 1 WAIT userRoot/objectclass.db page
>>> 18
>>>
>>> 800b3a33 WRITE 1 HELD userRoot/cn.db page
>>> 41
>>>
>>> 800b3a33 WRITE 1 HELD userRoot/cn.db page
>>> 40
>>>
>>> 800b3a33 WRITE 1 HELD userRoot/cn.db page
>>> 89
>>>
>>> 800b3a33 WRITE 1 HELD userRoot/cn.db page
>>> 117
>>>
>>> 30 READ 1 HELD userRoot/entryusn.db handle
>>> 0
>>>
>>> 3c READ 1 HELD changelog/entryrdn.db handle
>>> 0
>>>
>>> 97 READ 1 HELD userRoot/uid.db handle
>>> 0
>>>
>>> 47 READ 1 HELD changelog/aci.db handle
>>> 0
>>>
>>> e3 READ 1 HELD ipaca/serialno.db handle
>>> 0
>>>
>>> 7a READ 1 HELD userRoot/nsuniqueid.db handle
>>> 0
>>>
>>> 800b3a33 READ 1 HELD userRoot/nsuniqueid.db page
>>> 86
>>>
>>> 51 READ 1 HELD changelog/nsuniqueid.db handle
>>> 0
>>>
>>> 11e READ 1 HELD ipaca/subjectname.db handle
>>> 0
>>>
>>> 7f READ 1 HELD userRoot/member.db handle
>>> 0
>>>
>>> 11f READ 1 HELD ipaca/publicKeyData.db handle
>>> 0
>>>
>>> 9b READ 1 HELD userRoot/uniquemember.db handle
>>> 0
>>>
>>> 52 READ 1 HELD changelog/changenumber.db handle
>>> 0
>>>
>>> ce READ 1 HELD userRoot/gidnumber.db handle
>>> 0
>>>
>>> 65 READ 1 HELD userRoot/seeAlso.db handle
>>> 0
>>>
>>> 9d READ 1 HELD userRoot/ipaallowedtarget.db
>>> handle 0
>>>
>>> a6 READ 1 HELD userRoot/ipasudorunasgroup.db
>>> handle 0
>>>
>>> 3a READ 1 HELD userRoot/ancestorid.db handle
>>> 0
>>>
>>>
>>>
>>>
>>> pstack output
>>>
>>> root at ipa-master ]# pstack 4845
>>> Thread 44 (Thread 0x7f681dd3a700 (LWP 4847)):
>>> #0 0x00007f683cd719b3 in select () from /lib64/libc.so.6
>>> #1 0x00007f683f4fc0e9 in DS_Sleep () from /usr/lib64/dirsrv/libslapd.so.
>>> 0
>>> #2 0x00007f6832b4a907 in deadlock_threadmain () from
>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>> #3 0x00007f683d6ab7bb in _pt_root () from /lib64/libnspr4.so
>>> #4 0x00007f683d04cdc5 in start_thread () from /lib64/libpthread.so.0
>>> #5 0x00007f683cd7a28d in clone () from /lib64/libc.so.6
>>> Thread 43 (Thread 0x7f681d539700 (LWP 4848)):
>>> #0 0x00007f683cd719b3 in select () from /lib64/libc.so.6
>>> #1 0x00007f68376d8bad in __os_yield () from /lib64/libdb-5.3.so
>>> #2 0x00007f68376d42b3 in __memp_sync_int () from /lib64/libdb-5.3.so
>>> #3 0x00007f68376e4752 in __txn_checkpoint () from /lib64/libdb-5.3.so
>>> #4 0x00007f68376e4b74 in __txn_checkpoint_pp () from /lib64/
>>> libdb-5.3.so
>>> #5 0x00007f6832b4ea87 in checkpoint_threadmain () from
>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>> #6 0x00007f683d6ab7bb in _pt_root () from /lib64/libnspr4.so
>>> #7 0x00007f683d04cdc5 in start_thread () from /lib64/libpthread.so.0
>>> #8 0x00007f683cd7a28d in clone () from /lib64/libc.so.6
>>> Thread 42 (Thread 0x7f681cd38700 (LWP 4849)):
>>> #0 0x00007f683cd719b3 in select () from /lib64/libc.so.6
>>> #1 0x00007f683f4fc0e9 in DS_Sleep () from /usr/lib64/dirsrv/libslapd.so.
>>> 0
>>> #2 0x00007f6832b4ab7f in trickle_threadmain () from
>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>> #3 0x00007f683d6ab7bb in _pt_root () from /lib64/libnspr4.so
>>> #4 0x00007f683d04cdc5 in start_thread () from /lib64/libpthread.so.0
>>> #5 0x00007f683cd7a28d in clone () from /lib64/libc.so.6
>>> Thread 41 (Thread 0x7f681c537700 (LWP 4850)):
>>> #0 0x00007f683cd719b3 in select () from /lib64/libc.so.6
>>> #1 0x00007f683f4fc0e9 in DS_Sleep () from /usr/lib64/dirsrv/libslapd.so.
>>> 0
>>> #2 0x00007f6832b45707 in perf_threadmain () from
>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>> #3 0x00007f683d6ab7bb in _pt_root () from /lib64/libnspr4.so
>>> #4 0x00007f683d04cdc5 in start_thread () from /lib64/libpthread.so.0
>>> #5 0x00007f683cd7a28d in clone () from /lib64/libc.so.6
>>> Thread 40 (Thread 0x7f681bb2d700 (LWP 4851)):
>>> #0 0x00007f683d0506d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>> #1 0x00007f683d6a6050 in PR_WaitCondVar () from /lib64/libnspr4.so
>>> #2 0x00007f683f4eb198 in slapi_wait_condvar () from
>>> /usr/lib64/dirsrv/libslapd.so.0
>>> #3 0x00007f683587d62e in cos_cache_wait_on_change () from
>>> /usr/lib64/dirsrv/plugins/libcos-plugin.so
>>> #4 0x00007f683d6ab7bb in _pt_root () from /lib64/libnspr4.so
>>> #5 0x00007f683d04cdc5 in start_thread () from /lib64/libpthread.so.0
>>> #6 0x00007f683cd7a28d in clone () from /lib64/libc.so.6
>>> Thread 39 (Thread 0x7f681b32c700 (LWP 4852)):
>>> #0 0x00007f683d0506d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>> #1 0x00007f683d6a6050 in PR_WaitCondVar () from /lib64/libnspr4.so
>>> #2 0x00007f683f4eb198 in slapi_wait_condvar () from
>>> /usr/lib64/dirsrv/libslapd.so.0
>>> #3 0x00007f68311e8eed in roles_cache_wait_on_change () from
>>> /usr/lib64/dirsrv/plugins/libroles-plugin.so
>>> #4 0x00007f683d6ab7bb in _pt_root () from /lib64/libnspr4.so
>>> #5 0x00007f683d04cdc5 in start_thread () from /lib64/libpthread.so.0
>>> #6 0x00007f683cd7a28d in clone () from /lib64/libc.so.6
>>> Thread 38 (Thread 0x7f681ab2b700 (LWP 4853)):
>>> #0 0x00007f683d0506d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>> #1 0x00007f683d6a6050 in PR_WaitCondVar () from /lib64/libnspr4.so
>>> #2 0x00007f683f4eb198 in slapi_wait_condvar () from
>>> /usr/lib64/dirsrv/libslapd.so.0
>>> #3 0x00007f68311e8eed in roles_cache_wait_on_change () from
>>> /usr/lib64/dirsrv/plugins/libroles-plugin.so
>>> #4 0x00007f683d6ab7bb in _pt_root () from /lib64/libnspr4.so
>>> #5 0x00007f683d04cdc5 in start_thread () from /lib64/libpthread.so.0
>>> #6 0x00007f683cd7a28d in clone () from /lib64/libc.so.6
>>> Thread 37 (Thread 0x7f681a32a700 (LWP 4854)):
>>> #0 0x00007f683d0506d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>> #1 0x00007f683d6a6050 in PR_WaitCondVar () from /lib64/libnspr4.so
>>> #2 0x00007f683f4eb198 in slapi_wait_condvar () from
>>> /usr/lib64/dirsrv/libslapd.so.0
>>> #3 0x00007f68311e8eed in roles_cache_wait_on_change () from
>>> /usr/lib64/dirsrv/plugins/libroles-plugin.so
>>> #4 0x00007f683d6ab7bb in _pt_root () from /lib64/libnspr4.so
>>> #5 0x00007f683d04cdc5 in start_thread () from /lib64/libpthread.so.0
>>> #6 0x00007f683cd7a28d in clone () from /lib64/libc.so.6
>>> Thread 36 (Thread 0x7f6819b29700 (LWP 4855)):
>>> #0 0x00007f683d050a82 in pthread_cond_timedwait@@GLIBC_2.3.2 () from
>>> /lib64/libpthread.so.0
>>> #1 0x00007f683d6a5b07 in pt_TimedWait () from /lib64/libnspr4.so
>>> #2 0x00007f683d6a5fce in PR_WaitCondVar () from /lib64/libnspr4.so
>>> #3 0x00007f683f9a4d03 in housecleaning ()
>>> #4 0x00007f683d6ab7bb in _pt_root () from /lib64/libnspr4.so
>>> #5 0x00007f683d04cdc5 in start_thread () from /lib64/libpthread.so.0
>>> #6 0x00007f683cd7a28d in clone () from /lib64/libc.so.6
>>> Thread 35 (Thread 0x7f6819328700 (LWP 4856)):
>>> #0 0x00007f683d050a82 in pthread_cond_timedwait@@GLIBC_2.3.2 () from
>>> /lib64/libpthread.so.0
>>> #1 0x00007f683d6a5b07 in pt_TimedWait () from /lib64/libnspr4.so
>>> #2 0x00007f683d6a5fce in PR_WaitCondVar () from /lib64/libnspr4.so
>>> #3 0x00007f683f4911e8 in eq_loop () from /usr/lib64/dirsrv/libslapd.so.
>>> 0
>>> #4 0x00007f683d6ab7bb in _pt_root () from /lib64/libnspr4.so
>>> #5 0x00007f683d04cdc5 in start_thread () from /lib64/libpthread.so.0
>>> #6 0x00007f683cd7a28d in clone () from /lib64/libc.so.6
>>> Thread 34 (Thread 0x7f680bfff700 (LWP 4859)):
>>> #0 0x00007f683d0506d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>> #1 0x00007f683d6a6050 in PR_WaitCondVar () from /lib64/libnspr4.so
>>> #2 0x00007f683f999fee in connection_wait_for_new_work ()
>>> #3 0x00007f683f99b719 in connection_threadmain ()
>>> #4 0x00007f683d6ab7bb in _pt_root () from /lib64/libnspr4.so
>>> #5 0x00007f683d04cdc5 in start_thread () from /lib64/libpthread.so.0
>>> #6 0x00007f683cd7a28d in clone () from /lib64/libc.so.6
>>> Thread 33 (Thread 0x7f680b7fe700 (LWP 4860)):
>>> #0 0x00007f683d0506d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>> #1 0x00007f683d6a6050 in PR_WaitCondVar () from /lib64/libnspr4.so
>>> #2 0x00007f683f999fee in connection_wait_for_new_work ()
>>> #3 0x00007f683f99b719 in connection_threadmain ()
>>> #4 0x00007f683d6ab7bb in _pt_root () from /lib64/libnspr4.so
>>> #5 0x00007f683d04cdc5 in start_thread () from /lib64/libpthread.so.0
>>> #6 0x00007f683cd7a28d in clone () from /lib64/libc.so.6
>>> Thread 32 (Thread 0x7f680affd700 (LWP 4861)):
>>> #0 0x00007f683d0506d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>> #1 0x00007f68375ac2f3 in __db_hybrid_mutex_suspend () from /lib64/
>>> libdb-5.3.so
>>> #2 0x00007f68375ab640 in __db_tas_mutex_lock () from /lib64/
>>> libdb-5.3.so
>>> #3 0x00007f6837655d3a in __lock_get_internal () from /lib64/
>>> libdb-5.3.so
>>> #4 0x00007f6837656820 in __lock_get () from /lib64/libdb-5.3.so
>>> #5 0x00007f6837682142 in __db_lget () from /lib64/libdb-5.3.so
>>> #6 0x00007f68375c9605 in __bam_search () from /lib64/libdb-5.3.so
>>> #7 0x00007f68375b4256 in __bamc_search () from /lib64/libdb-5.3.so
>>> #8 0x00007f68375b5d0f in __bamc_get () from /lib64/libdb-5.3.so
>>> #9 0x00007f683766eca6 in __dbc_iget () from /lib64/libdb-5.3.so
>>> #10 0x00007f683767db02 in __dbc_get_pp () from /lib64/libdb-5.3.so
>>> #11 0x00007f6832b59680 in idl_new_fetch () from
>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>> #12 0x00007f6832b67b26 in index_read_ext_allids () from
>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>> #13 0x00007f6832b52284 in keys2idl () from /usr/lib64/dirsrv/plugins/libb
>>> ack-ldbm.so
>>> #14 0x00007f6832b529e3 in ava_candidates.isra.0 () from
>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>> #15 0x00007f6832b52fd2 in filter_candidates_ext () from
>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>> #16 0x00007f6832b54096 in list_candidates () from
>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>> #17 0x00007f6832b52f40 in filter_candidates_ext () from
>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>> #18 0x00007f6832b54096 in list_candidates () from
>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>> #19 0x00007f6832b52f40 in filter_candidates_ext () from
>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>> #20 0x00007f6832b54096 in list_candidates () from
>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>> #21 0x00007f6832b52f40 in filter_candidates_ext () from
>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>> #22 0x00007f6832b8e80c in subtree_candidates () from
>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>> #23 0x00007f6832b8fe7f in ldbm_back_search () from
>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>> #24 0x00007f683f4bd1d6 in op_shared_search () from
>>> /usr/lib64/dirsrv/libslapd.so.0
>>> #25 0x00007f683f9ae33e in do_search ()
>>> #26 0x00007f683f99c3c3 in connection_threadmain ()
>>> #27 0x00007f683d6ab7bb in _pt_root () from /lib64/libnspr4.so
>>> #28 0x00007f683d04cdc5 in start_thread () from /lib64/libpthread.so.0
>>> #29 0x00007f683cd7a28d in clone () from /lib64/libc.so.6
>>> Thread 31 (Thread 0x7f680a7fc700 (LWP 4862)):
>>> #0 0x00007f683d0506d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>> #1 0x00007f683d6a62c3 in PR_EnterMonitor () from /lib64/libnspr4.so
>>> #2 0x00007f6832b4d3e6 in dblayer_txn_begin () from
>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>> #3 0x00007f6832b89007 in ldbm_back_modify () from
>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>> #4 0x00007f683f4b6541 in op_shared_modify () from
>>> /usr/lib64/dirsrv/libslapd.so.0
>>> #5 0x00007f683f4b7004 in modify_internal_pb () from
>>> /usr/lib64/dirsrv/libslapd.so.0
>>> #6 0x00007f683483bbbb in ipalockout_postop () from
>>> /usr/lib64/dirsrv/plugins/libipa_lockout.so
>>> #7 0x00007f683f4c8848 in plugin_call_func () from
>>> /usr/lib64/dirsrv/libslapd.so.0
>>> #8 0x00007f683f4c8b13 in plugin_call_plugins () from
>>> /usr/lib64/dirsrv/libslapd.so.0
>>> #9 0x00007f683f9954d8 in do_bind ()
>>> #10 0x00007f683f99c3fd in connection_threadmain ()
>>> #11 0x00007f683d6ab7bb in _pt_root () from /lib64/libnspr4.so
>>> #12 0x00007f683d04cdc5 in start_thread () from /lib64/libpthread.so.0
>>> #13 0x00007f683cd7a28d in clone () from /lib64/libc.so.6
>>> Thread 30 (Thread 0x7f6809ffb700 (LWP 4863)):
>>> #0 0x00007f683d0506d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>> #1 0x00007f68375ac2f3 in __db_hybrid_mutex_suspend () from /lib64/
>>> libdb-5.3.so
>>> #2 0x00007f68375ab640 in __db_tas_mutex_lock () from /lib64/
>>> libdb-5.3.so
>>> #3 0x00007f6837655d3a in __lock_get_internal () from /lib64/
>>> libdb-5.3.so
>>> #4 0x00007f6837656820 in __lock_get () from /lib64/libdb-5.3.so
>>> #5 0x00007f6837682142 in __db_lget () from /lib64/libdb-5.3.so
>>> #6 0x00007f68375c9605 in __bam_search () from /lib64/libdb-5.3.so
>>> #7 0x00007f68375b4256 in __bamc_search () from /lib64/libdb-5.3.so
>>> #8 0x00007f68375b5d0f in __bamc_get () from /lib64/libdb-5.3.so
>>> #9 0x00007f683766eca6 in __dbc_iget () from /lib64/libdb-5.3.so
>>> #10 0x00007f683767db02 in __dbc_get_pp () from /lib64/libdb-5.3.so
>>> #11 0x00007f6832b59680 in idl_new_fetch () from
>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>> #12 0x00007f6832b67b26 in index_read_ext_allids () from
>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>> #13 0x00007f6832b52284 in keys2idl () from /usr/lib64/dirsrv/plugins/libb
>>> ack-ldbm.so
>>> #14 0x00007f6832b529e3 in ava_candidates.isra.0 () from
>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>> #15 0x00007f6832b52fd2 in filter_candidates_ext () from
>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>> #16 0x00007f6832b54096 in list_candidates () from
>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>> #17 0x00007f6832b52f40 in filter_candidates_ext () from
>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>> #18 0x00007f6832b8e80c in subtree_candidates () from
>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>> #19 0x00007f6832b8fe7f in ldbm_back_search () from
>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>> #20 0x00007f683f4bd1d6 in op_shared_search () from
>>> /usr/lib64/dirsrv/libslapd.so.0
>>> #21 0x00007f683f4cd94e in search_internal_callback_pb () from
>>> /usr/lib64/dirsrv/libslapd.so.0
>>> #22 0x00007f683f4cdbe8 in search_internal_pb () from
>>> /usr/lib64/dirsrv/libslapd.so.0
>>> #23 0x00007f683f9ac49b in ids_sasl_canon_user ()
>>> #24 0x00007f683d46c93b in _sasl_canon_user () from /lib64/libsasl2.so.3
>>> #25 0x00007f683d46cc4c in _sasl_canon_user_lookup () from
>>> /lib64/libsasl2.so.3
>>> #26 0x00007f6837374fb9 in gssapi_server_mech_step () from
>>> /usr/lib64/sasl2/libgssapiv2.so
>>> #27 0x00007f683d478b9b in sasl_server_step () from /lib64/libsasl2.so.3
>>> #28 0x00007f683f9ad83b in ids_sasl_check_bind ()
>>> #29 0x00007f683f99561a in do_bind ()
>>> #30 0x00007f683f99c3fd in connection_threadmain ()
>>> #31 0x00007f683d6ab7bb in _pt_root () from /lib64/libnspr4.so
>>> #32 0x00007f683d04cdc5 in start_thread () from /lib64/libpthread.so.0
>>> #33 0x00007f683cd7a28d in clone () from /lib64/libc.so.6
>>> Thread 29 (Thread 0x7f68097fa700 (LWP 4864)):
>>> #0 0x00007f683d0506d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>> #1 0x00007f683d6a6050 in PR_WaitCondVar () from /lib64/libnspr4.so
>>> #2 0x00007f683f999fee in connection_wait_for_new_work ()
>>> #3 0x00007f683f99b719 in connection_threadmain ()
>>> #4 0x00007f683d6ab7bb in _pt_root () from /lib64/libnspr4.so
>>> #5 0x00007f683d04cdc5 in start_thread () from /lib64/libpthread.so.0
>>> #6 0x00007f683cd7a28d in clone () from /lib64/libc.so.6
>>> Thread 28 (Thread 0x7f6808ff9700 (LWP 4865)):
>>> #0 0x00007f683d0506d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>> #1 0x00007f683d6a6050 in PR_WaitCondVar () from /lib64/libnspr4.so
>>> #2 0x00007f683f999fee in connection_wait_for_new_work ()
>>> #3 0x00007f683f99b719 in connection_threadmain ()
>>> #4 0x00007f683d6ab7bb in _pt_root () from /lib64/libnspr4.so
>>> #5 0x00007f683d04cdc5 in start_thread () from /lib64/libpthread.so.0
>>> #6 0x00007f683cd7a28d in clone () from /lib64/libc.so.6
>>> Thread 27 (Thread 0x7f6803fff700 (LWP 4866)):
>>> #0 0x00007f683d0506d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>> #1 0x00007f683d6a6050 in PR_WaitCondVar () from /lib64/libnspr4.so
>>> #2 0x00007f683f999fee in connection_wait_for_new_work ()
>>> #3 0x00007f683f99b719 in connection_threadmain ()
>>> #4 0x00007f683d6ab7bb in _pt_root () from /lib64/libnspr4.so
>>> #5 0x00007f683d04cdc5 in start_thread () from /lib64/libpthread.so.0
>>> #6 0x00007f683cd7a28d in clone () from /lib64/libc.so.6
>>> Thread 26 (Thread 0x7f68037fe700 (LWP 4867)):
>>> #0 0x00007f683d0506d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>> #1 0x00007f683d6a6050 in PR_WaitCondVar () from /lib64/libnspr4.so
>>> #2 0x00007f683f999fee in connection_wait_for_new_work ()
>>> #3 0x00007f683f99b719 in connection_threadmain ()
>>> #4 0x00007f683d6ab7bb in _pt_root () from /lib64/libnspr4.so
>>> #5 0x00007f683d04cdc5 in start_thread () from /lib64/libpthread.so.0
>>> #6 0x00007f683cd7a28d in clone () from /lib64/libc.so.6
>>> Thread 25 (Thread 0x7f6802ffd700 (LWP 4868)):
>>> #0 0x00007f683d0506d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>> #1 0x00007f683d6a6050 in PR_WaitCondVar () from /lib64/libnspr4.so
>>> #2 0x00007f683f999fee in connection_wait_for_new_work ()
>>> #3 0x00007f683f99b719 in connection_threadmain ()
>>> #4 0x00007f683d6ab7bb in _pt_root () from /lib64/libnspr4.so
>>> #5 0x00007f683d04cdc5 in start_thread () from /lib64/libpthread.so.0
>>> #6 0x00007f683cd7a28d in clone () from /lib64/libc.so.6
>>> Thread 24 (Thread 0x7f68027fc700 (LWP 4869)):
>>> #0 0x00007f683d0506d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>> #1 0x00007f68375ac2f3 in __db_hybrid_mutex_suspend () from /lib64/
>>> libdb-5.3.so
>>> #2 0x00007f68375abb37 in __db_tas_mutex_readlock () from /lib64/
>>> libdb-5.3.so
>>> #3 0x00007f68376c5d35 in __memp_fget () from /lib64/libdb-5.3.so
>>> #4 0x00007f683766f333 in __dbc_iget () from /lib64/libdb-5.3.so
>>> #5 0x00007f683767db02 in __dbc_get_pp () from /lib64/libdb-5.3.so
>>> #6 0x00007f6832b59822 in idl_new_fetch () from
>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>> #7 0x00007f6832b67b26 in index_read_ext_allids () from
>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>> #8 0x00007f6832b52284 in keys2idl () from /usr/lib64/dirsrv/plugins/libb
>>> ack-ldbm.so
>>> #9 0x00007f6832b529e3 in ava_candidates.isra.0 () from
>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>> #10 0x00007f6832b52fd2 in filter_candidates_ext () from
>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>> #11 0x00007f6832b54096 in list_candidates () from
>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>> #12 0x00007f6832b52f40 in filter_candidates_ext () from
>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>> #13 0x00007f6832b54096 in list_candidates () from
>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>> #14 0x00007f6832b52f40 in filter_candidates_ext () from
>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>> #15 0x00007f6832b54096 in list_candidates () from
>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>> #16 0x00007f6832b52f40 in filter_candidates_ext () from
>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>> #17 0x00007f6832b8e80c in subtree_candidates () from
>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>> #18 0x00007f6832b8fe7f in ldbm_back_search () from
>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>> #19 0x00007f683f4bd1d6 in op_shared_search () from
>>> /usr/lib64/dirsrv/libslapd.so.0
>>> #20 0x00007f683f9ae33e in do_search ()
>>> #21 0x00007f683f99c3c3 in connection_threadmain ()
>>> #22 0x00007f683d6ab7bb in _pt_root () from /lib64/libnspr4.so
>>> #23 0x00007f683d04cdc5 in start_thread () from /lib64/libpthread.so.0
>>> #24 0x00007f683cd7a28d in clone () from /lib64/libc.so.6
>>> Thread 23 (Thread 0x7f6801ffb700 (LWP 4870)):
>>> #0 0x00007f683d0506d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>> #1 0x00007f683d6a6050 in PR_WaitCondVar () from /lib64/libnspr4.so
>>> #2 0x00007f683f999fee in connection_wait_for_new_work ()
>>> #3 0x00007f683f99b719 in connection_threadmain ()
>>> #4 0x00007f683d6ab7bb in _pt_root () from /lib64/libnspr4.so
>>> #5 0x00007f683d04cdc5 in start_thread () from /lib64/libpthread.so.0
>>> #6 0x00007f683cd7a28d in clone () from /lib64/libc.so.6
>>> Thread 22 (Thread 0x7f68017fa700 (LWP 4871)):
>>> #0 0x00007f683d0506d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>> #1 0x00007f683d6a6050 in PR_WaitCondVar () from /lib64/libnspr4.so
>>> #2 0x00007f683f999fee in connection_wait_for_new_work ()
>>> #3 0x00007f683f99b719 in connection_threadmain ()
>>> #4 0x00007f683d6ab7bb in _pt_root () from /lib64/libnspr4.so
>>> #5 0x00007f683d04cdc5 in start_thread () from /lib64/libpthread.so.0
>>> #6 0x00007f683cd7a28d in clone () from /lib64/libc.so.6
>>> Thread 21 (Thread 0x7f6800ff9700 (LWP 4872)):
>>> #0 0x00007f683d0506d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>> #1 0x00007f683d6a6050 in PR_WaitCondVar () from /lib64/libnspr4.so
>>> #2 0x00007f683f999fee in connection_wait_for_new_work ()
>>> #3 0x00007f683f99b719 in connection_threadmain ()
>>> #4 0x00007f683d6ab7bb in _pt_root () from /lib64/libnspr4.so
>>> #5 0x00007f683d04cdc5 in start_thread () from /lib64/libpthread.so.0
>>> #6 0x00007f683cd7a28d in clone () from /lib64/libc.so.6
>>> Thread 20 (Thread 0x7f68007f8700 (LWP 4873)):
>>> #0 0x00007f683d0506d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>> #1 0x00007f68375ac2f3 in __db_hybrid_mutex_suspend () from /lib64/
>>> libdb-5.3.so
>>> #2 0x00007f68375ab640 in __db_tas_mutex_lock () from /lib64/
>>> libdb-5.3.so
>>> #3 0x00007f68376c5e1b in __memp_fget () from /lib64/libdb-5.3.so
>>> #4 0x00007f68375c9211 in __bam_search () from /lib64/libdb-5.3.so
>>> #5 0x00007f68375b4256 in __bamc_search () from /lib64/libdb-5.3.so
>>> #6 0x00007f68375b86c4 in __bamc_put () from /lib64/libdb-5.3.so
>>> #7 0x00007f683766f6d5 in __dbc_iput () from /lib64/libdb-5.3.so
>>> #8 0x00007f683766aa0e in __db_put () from /lib64/libdb-5.3.so
>>> #9 0x00007f683767ffa4 in __db_put_pp () from /lib64/libdb-5.3.so
>>> #10 0x00007f6832b5a4cf in idl_new_insert_key () from
>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>> #11 0x00007f6832b695b5 in addordel_values_sv.isra.3 () from
>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>> #12 0x00007f6832b6a25a in index_addordel_values_ext_sv () from
>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>> #13 0x00007f6832b6a694 in index_addordel_values_sv () from
>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>> #14 0x00007f6832b6a75a in index_addordel_entry () from
>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>> #15 0x00007f6832b6d5fa in ldbm_back_add () from
>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>> #16 0x00007f683f46fcca in op_shared_add () from
>>> /usr/lib64/dirsrv/libslapd.so.0
>>> #17 0x00007f683f471020 in do_add () from /usr/lib64/dirsrv/libslapd.so.0
>>> #18 0x00007f683f99c303 in connection_threadmain ()
>>> #19 0x00007f683d6ab7bb in _pt_root () from /lib64/libnspr4.so
>>> #20 0x00007f683d04cdc5 in start_thread () from /lib64/libpthread.so.0
>>> #21 0x00007f683cd7a28d in clone () from /lib64/libc.so.6
>>> Thread 19 (Thread 0x7f67ffff7700 (LWP 4874)):
>>> #0 0x00007f683d0506d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>> #1 0x00007f683d6a62c3 in PR_EnterMonitor () from /lib64/libnspr4.so
>>> #2 0x00007f6832b4d3e6 in dblayer_txn_begin () from
>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>> #3 0x00007f6832b89007 in ldbm_back_modify () from
>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>> #4 0x00007f683f4b6541 in op_shared_modify () from
>>> /usr/lib64/dirsrv/libslapd.so.0
>>> #5 0x00007f683f4b7004 in modify_internal_pb () from
>>> /usr/lib64/dirsrv/libslapd.so.0
>>> #6 0x00007f6832dd3b60 in ipapwd_apply_mods () from
>>> /usr/lib64/dirsrv/plugins/libipa_pwd_extop.so
>>> #7 0x00007f6832dd78e0 in store_new_keys () from
>>> /usr/lib64/dirsrv/plugins/libipa_pwd_extop.so
>>> #8 0x00007f6832dd9ad0 in ipapwd_extop () from
>>> /usr/lib64/dirsrv/plugins/libipa_pwd_extop.so
>>> #9 0x00007f683f4c6ba2 in plugin_call_exop_plugins () from
>>> /usr/lib64/dirsrv/libslapd.so.0
>>> #10 0x00007f683f9a2efe in do_extended ()
>>> #11 0x00007f683f99c41a in connection_threadmain ()
>>> #12 0x00007f683d6ab7bb in _pt_root () from /lib64/libnspr4.so
>>> #13 0x00007f683d04cdc5 in start_thread () from /lib64/libpthread.so.0
>>> #14 0x00007f683cd7a28d in clone () from /lib64/libc.so.6
>>> Thread 18 (Thread 0x7f67ff7f6700 (LWP 4875)):
>>> #0 0x00007f683d0506d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>> #1 0x00007f683d6a6050 in PR_WaitCondVar () from /lib64/libnspr4.so
>>> #2 0x00007f683f999fee in connection_wait_for_new_work ()
>>> #3 0x00007f683f99b719 in connection_threadmain ()
>>> #4 0x00007f683d6ab7bb in _pt_root () from /lib64/libnspr4.so
>>> #5 0x00007f683d04cdc5 in start_thread () from /lib64/libpthread.so.0
>>> #6 0x00007f683cd7a28d in clone () from /lib64/libc.so.6
>>> Thread 17 (Thread 0x7f67feff5700 (LWP 4876)):
>>> #0 0x00007f683d0506d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>> #1 0x00007f68375ac2f3 in __db_hybrid_mutex_suspend () from /lib64/
>>> libdb-5.3.so
>>> #2 0x00007f68375ab640 in __db_tas_mutex_lock () from /lib64/
>>> libdb-5.3.so
>>> #3 0x00007f6837655d3a in __lock_get_internal () from /lib64/
>>> libdb-5.3.so
>>> #4 0x00007f6837656820 in __lock_get () from /lib64/libdb-5.3.so
>>> #5 0x00007f6837682142 in __db_lget () from /lib64/libdb-5.3.so
>>> #6 0x00007f68375c9605 in __bam_search () from /lib64/libdb-5.3.so
>>> #7 0x00007f68375b4256 in __bamc_search () from /lib64/libdb-5.3.so
>>> #8 0x00007f68375b5d0f in __bamc_get () from /lib64/libdb-5.3.so
>>> #9 0x00007f683766eca6 in __dbc_iget () from /lib64/libdb-5.3.so
>>> #10 0x00007f683767db02 in __dbc_get_pp () from /lib64/libdb-5.3.so
>>> #11 0x00007f6832b59680 in idl_new_fetch () from
>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>> #12 0x00007f6832b67b26 in index_read_ext_allids () from
>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>> #13 0x00007f6832b52284 in keys2idl () from /usr/lib64/dirsrv/plugins/libb
>>> ack-ldbm.so
>>> #14 0x00007f6832b529e3 in ava_candidates.isra.0 () from
>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>> #15 0x00007f6832b52fd2 in filter_candidates_ext () from
>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>> #16 0x00007f6832b54096 in list_candidates () from
>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>> #17 0x00007f6832b52f40 in filter_candidates_ext () from
>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>> #18 0x00007f6832b8e80c in subtree_candidates () from
>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>> #19 0x00007f6832b8fe7f in ldbm_back_search () from
>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>> #20 0x00007f683f4bd1d6 in op_shared_search () from
>>> /usr/lib64/dirsrv/libslapd.so.0
>>> #21 0x00007f683f4cd94e in search_internal_callback_pb () from
>>> /usr/lib64/dirsrv/libslapd.so.0
>>> #22 0x00007f683f4cdbe8 in search_internal_pb () from
>>> /usr/lib64/dirsrv/libslapd.so.0
>>> #23 0x00007f6832dd75dc in get_entry_by_principal () from
>>> /usr/lib64/dirsrv/plugins/libipa_pwd_extop.so
>>> #24 0x00007f6832dd8eb1 in ipapwd_extop () from
>>> /usr/lib64/dirsrv/plugins/libipa_pwd_extop.so
>>> #25 0x00007f683f4c6ba2 in plugin_call_exop_plugins () from
>>> /usr/lib64/dirsrv/libslapd.so.0
>>> #26 0x00007f683f9a2efe in do_extended ()
>>> #27 0x00007f683f99c41a in connection_threadmain ()
>>> #28 0x00007f683d6ab7bb in _pt_root () from /lib64/libnspr4.so
>>> #29 0x00007f683d04cdc5 in start_thread () from /lib64/libpthread.so.0
>>> #30 0x00007f683cd7a28d in clone () from /lib64/libc.so.6
>>> Thread 16 (Thread 0x7f67fe7f4700 (LWP 4877)):
>>> #0 0x00007f683d0506d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>> #1 0x00007f683d6a6050 in PR_WaitCondVar () from /lib64/libnspr4.so
>>> #2 0x00007f683f999fee in connection_wait_for_new_work ()
>>> #3 0x00007f683f99b719 in connection_threadmain ()
>>> #4 0x00007f683d6ab7bb in _pt_root () from /lib64/libnspr4.so
>>> #5 0x00007f683d04cdc5 in start_thread () from /lib64/libpthread.so.0
>>> #6 0x00007f683cd7a28d in clone () from /lib64/libc.so.6
>>> Thread 15 (Thread 0x7f67fdff3700 (LWP 4878)):
>>> #0 0x00007f683d0506d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>> #1 0x00007f683d6a6050 in PR_WaitCondVar () from /lib64/libnspr4.so
>>> #2 0x00007f683f999fee in connection_wait_for_new_work ()
>>> #3 0x00007f683f99b719 in connection_threadmain ()
>>> #4 0x00007f683d6ab7bb in _pt_root () from /lib64/libnspr4.so
>>> #5 0x00007f683d04cdc5 in start_thread () from /lib64/libpthread.so.0
>>> #6 0x00007f683cd7a28d in clone () from /lib64/libc.so.6
>>> Thread 14 (Thread 0x7f67fd7f2700 (LWP 4879)):
>>> #0 0x00007f683d0506d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>> #1 0x00007f683d6a6050 in PR_WaitCondVar () from /lib64/libnspr4.so
>>> #2 0x00007f683f999fee in connection_wait_for_new_work ()
>>> #3 0x00007f683f99b719 in connection_threadmain ()
>>> #4 0x00007f683d6ab7bb in _pt_root () from /lib64/libnspr4.so
>>> #5 0x00007f683d04cdc5 in start_thread () from /lib64/libpthread.so.0
>>> #6 0x00007f683cd7a28d in clone () from /lib64/libc.so.6
>>> Thread 13 (Thread 0x7f67fcff1700 (LWP 4880)):
>>> #0 0x00007f683d0506d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>> #1 0x00007f683d6a6050 in PR_WaitCondVar () from /lib64/libnspr4.so
>>> #2 0x00007f683f999fee in connection_wait_for_new_work ()
>>> #3 0x00007f683f99b719 in connection_threadmain ()
>>> #4 0x00007f683d6ab7bb in _pt_root () from /lib64/libnspr4.so
>>> #5 0x00007f683d04cdc5 in start_thread () from /lib64/libpthread.so.0
>>> #6 0x00007f683cd7a28d in clone () from /lib64/libc.so.6
>>> Thread 12 (Thread 0x7f67fc7f0700 (LWP 4881)):
>>> #0 0x00007f683d0506d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>> #1 0x00007f683d6a6050 in PR_WaitCondVar () from /lib64/libnspr4.so
>>> #2 0x00007f683f999fee in connection_wait_for_new_work ()
>>> #3 0x00007f683f99b719 in connection_threadmain ()
>>> #4 0x00007f683d6ab7bb in _pt_root () from /lib64/libnspr4.so
>>> #5 0x00007f683d04cdc5 in start_thread () from /lib64/libpthread.so.0
>>> #6 0x00007f683cd7a28d in clone () from /lib64/libc.so.6
>>> Thread 11 (Thread 0x7f67fbfef700 (LWP 4882)):
>>> #0 0x00007f683d0506d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>> #1 0x00007f683d6a6050 in PR_WaitCondVar () from /lib64/libnspr4.so
>>> #2 0x00007f683f999fee in connection_wait_for_new_work ()
>>> #3 0x00007f683f99b719 in connection_threadmain ()
>>> #4 0x00007f683d6ab7bb in _pt_root () from /lib64/libnspr4.so
>>> #5 0x00007f683d04cdc5 in start_thread () from /lib64/libpthread.so.0
>>> #6 0x00007f683cd7a28d in clone () from /lib64/libc.so.6
>>> Thread 10 (Thread 0x7f67fb7ee700 (LWP 4883)):
>>> #0 0x00007f683d0506d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>> #1 0x00007f68375ac2f3 in __db_hybrid_mutex_suspend () from /lib64/
>>> libdb-5.3.so
>>> #2 0x00007f68375ab640 in __db_tas_mutex_lock () from /lib64/
>>> libdb-5.3.so
>>> #3 0x00007f6837655d3a in __lock_get_internal () from /lib64/
>>> libdb-5.3.so
>>> #4 0x00007f6837656820 in __lock_get () from /lib64/libdb-5.3.so
>>> #5 0x00007f6837682142 in __db_lget () from /lib64/libdb-5.3.so
>>> #6 0x00007f68375c9605 in __bam_search () from /lib64/libdb-5.3.so
>>> #7 0x00007f68375b4256 in __bamc_search () from /lib64/libdb-5.3.so
>>> #8 0x00007f68375b5d0f in __bamc_get () from /lib64/libdb-5.3.so
>>> #9 0x00007f683766eca6 in __dbc_iget () from /lib64/libdb-5.3.so
>>> #10 0x00007f683767db02 in __dbc_get_pp () from /lib64/libdb-5.3.so
>>> #11 0x00007f6832b59680 in idl_new_fetch () from
>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>> #12 0x00007f6832b67b26 in index_read_ext_allids () from
>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>> #13 0x00007f6832b52284 in keys2idl () from /usr/lib64/dirsrv/plugins/libb
>>> ack-ldbm.so
>>> #14 0x00007f6832b529e3 in ava_candidates.isra.0 () from
>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>> #15 0x00007f6832b52fd2 in filter_candidates_ext () from
>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>> #16 0x00007f6832b54096 in list_candidates () from
>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>> #17 0x00007f6832b52f40 in filter_candidates_ext () from
>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>> #18 0x00007f6832b54096 in list_candidates () from
>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>> #19 0x00007f6832b52f40 in filter_candidates_ext () from
>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>> #20 0x00007f6832b54096 in list_candidates () from
>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>> #21 0x00007f6832b52f40 in filter_candidates_ext () from
>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>> #22 0x00007f6832b8e80c in subtree_candidates () from
>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>> #23 0x00007f6832b8fe7f in ldbm_back_search () from
>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>> #24 0x00007f683f4bd1d6 in op_shared_search () from
>>> /usr/lib64/dirsrv/libslapd.so.0
>>> #25 0x00007f683f9ae33e in do_search ()
>>> #26 0x00007f683f99c3c3 in connection_threadmain ()
>>> #27 0x00007f683d6ab7bb in _pt_root () from /lib64/libnspr4.so
>>> #28 0x00007f683d04cdc5 in start_thread () from /lib64/libpthread.so.0
>>> #29 0x00007f683cd7a28d in clone () from /lib64/libc.so.6
>>> Thread 9 (Thread 0x7f67fafed700 (LWP 4884)):
>>> #0 0x00007f683d0506d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>> #1 0x00007f683d6a6050 in PR_WaitCondVar () from /lib64/libnspr4.so
>>> #2 0x00007f683f999fee in connection_wait_for_new_work ()
>>> #3 0x00007f683f99b719 in connection_threadmain ()
>>> #4 0x00007f683d6ab7bb in _pt_root () from /lib64/libnspr4.so
>>> #5 0x00007f683d04cdc5 in start_thread () from /lib64/libpthread.so.0
>>> #6 0x00007f683cd7a28d in clone () from /lib64/libc.so.6
>>> Thread 8 (Thread 0x7f67fa7ec700 (LWP 4885)):
>>> #0 0x00007f683d0506d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>> #1 0x00007f68375ac2f3 in __db_hybrid_mutex_suspend () from /lib64/
>>> libdb-5.3.so
>>> #2 0x00007f68375ab640 in __db_tas_mutex_lock () from /lib64/
>>> libdb-5.3.so
>>> #3 0x00007f6837655d3a in __lock_get_internal () from /lib64/
>>> libdb-5.3.so
>>> #4 0x00007f6837656820 in __lock_get () from /lib64/libdb-5.3.so
>>> #5 0x00007f6837682142 in __db_lget () from /lib64/libdb-5.3.so
>>> #6 0x00007f68375c9605 in __bam_search () from /lib64/libdb-5.3.so
>>> #7 0x00007f68375b4256 in __bamc_search () from /lib64/libdb-5.3.so
>>> #8 0x00007f68375b5d0f in __bamc_get () from /lib64/libdb-5.3.so
>>> #9 0x00007f683766eca6 in __dbc_iget () from /lib64/libdb-5.3.so
>>> #10 0x00007f683767db02 in __dbc_get_pp () from /lib64/libdb-5.3.so
>>> #11 0x00007f6832b59680 in idl_new_fetch () from
>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>> #12 0x00007f6832b67b26 in index_read_ext_allids () from
>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>> #13 0x00007f6832b52284 in keys2idl () from /usr/lib64/dirsrv/plugins/libb
>>> ack-ldbm.so
>>> #14 0x00007f6832b529e3 in ava_candidates.isra.0 () from
>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>> #15 0x00007f6832b52fd2 in filter_candidates_ext () from
>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>> #16 0x00007f6832b54096 in list_candidates () from
>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>> #17 0x00007f6832b52f40 in filter_candidates_ext () from
>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>> #18 0x00007f6832b54096 in list_candidates () from
>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>> #19 0x00007f6832b52f40 in filter_candidates_ext () from
>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>> #20 0x00007f6832b54096 in list_candidates () from
>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>> #21 0x00007f6832b52f40 in filter_candidates_ext () from
>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>> #22 0x00007f6832b8e80c in subtree_candidates () from
>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>> #23 0x00007f6832b8fe7f in ldbm_back_search () from
>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>> #24 0x00007f683f4bd1d6 in op_shared_search () from
>>> /usr/lib64/dirsrv/libslapd.so.0
>>> #25 0x00007f683f9ae33e in do_search ()
>>> #26 0x00007f683f99c3c3 in connection_threadmain ()
>>> #27 0x00007f683d6ab7bb in _pt_root () from /lib64/libnspr4.so
>>> #28 0x00007f683d04cdc5 in start_thread () from /lib64/libpthread.so.0
>>> #29 0x00007f683cd7a28d in clone () from /lib64/libc.so.6
>>> Thread 7 (Thread 0x7f67f9feb700 (LWP 4886)):
>>> #0 0x00007f683d0506d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>> #1 0x00007f683d6a6050 in PR_WaitCondVar () from /lib64/libnspr4.so
>>> #2 0x00007f683f999fee in connection_wait_for_new_work ()
>>> #3 0x00007f683f99b719 in connection_threadmain ()
>>> #4 0x00007f683d6ab7bb in _pt_root () from /lib64/libnspr4.so
>>> #5 0x00007f683d04cdc5 in start_thread () from /lib64/libpthread.so.0
>>> #6 0x00007f683cd7a28d in clone () from /lib64/libc.so.6
>>> Thread 6 (Thread 0x7f67f97ea700 (LWP 4887)):
>>> #0 0x00007f683d0506d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>> #1 0x00007f683d6a6050 in PR_WaitCondVar () from /lib64/libnspr4.so
>>> #2 0x00007f683f999fee in connection_wait_for_new_work ()
>>> #3 0x00007f683f99b719 in connection_threadmain ()
>>> #4 0x00007f683d6ab7bb in _pt_root () from /lib64/libnspr4.so
>>> #5 0x00007f683d04cdc5 in start_thread () from /lib64/libpthread.so.0
>>> #6 0x00007f683cd7a28d in clone () from /lib64/libc.so.6
>>> Thread 5 (Thread 0x7f67f8fe9700 (LWP 4888)):
>>> #0 0x00007f683d0506d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>> #1 0x00007f683d6a6050 in PR_WaitCondVar () from /lib64/libnspr4.so
>>> #2 0x00007f683f999fee in connection_wait_for_new_work ()
>>> #3 0x00007f683f99b719 in connection_threadmain ()
>>> #4 0x00007f683d6ab7bb in _pt_root () from /lib64/libnspr4.so
>>> #5 0x00007f683d04cdc5 in start_thread () from /lib64/libpthread.so.0
>>> #6 0x00007f683cd7a28d in clone () from /lib64/libc.so.6
>>> Thread 4 (Thread 0x7f67f87e8700 (LWP 4889)):
>>> #0 0x00007f683cd719b3 in select () from /lib64/libc.so.6
>>> #1 0x00007f683f4fc0e9 in DS_Sleep () from /usr/lib64/dirsrv/libslapd.so.
>>> 0
>>> #2 0x00007f683f99d325 in time_thread ()
>>> #3 0x00007f683d6ab7bb in _pt_root () from /lib64/libnspr4.so
>>> #4 0x00007f683d04cdc5 in start_thread () from /lib64/libpthread.so.0
>>> #5 0x00007f683cd7a28d in clone () from /lib64/libc.so.6
>>> Thread 3 (Thread 0x7f67f7de6700 (LWP 4892)):
>>> #0 0x00007f683d0506d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>> #1 0x00007f683d6a6050 in PR_WaitCondVar () from /lib64/libnspr4.so
>>> #2 0x00007f683f9a8f25 in ps_send_results ()
>>> #3 0x00007f683d6ab7bb in _pt_root () from /lib64/libnspr4.so
>>> #4 0x00007f683d04cdc5 in start_thread () from /lib64/libpthread.so.0
>>> #5 0x00007f683cd7a28d in clone () from /lib64/libc.so.6
>>> Thread 2 (Thread 0x7f67f75e5700 (LWP 5084)):
>>> #0 0x00007f683d0506d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>> #1 0x00007f683d6a6050 in PR_WaitCondVar () from /lib64/libnspr4.so
>>> #2 0x00007f683f9a8f25 in ps_send_results ()
>>> #3 0x00007f683d6ab7bb in _pt_root () from /lib64/libnspr4.so
>>> #4 0x00007f683d04cdc5 in start_thread () from /lib64/libpthread.so.0
>>> #5 0x00007f683cd7a28d in clone () from /lib64/libc.so.6
>>> Thread 1 (Thread 0x7f683f964840 (LWP 4845)):
>>> #0 0x00007f683d0506d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>> #1 0x00007f683d6a62c3 in PR_EnterMonitor () from /lib64/libnspr4.so
>>> #2 0x00007f683f99d5ed in setup_pr_read_pds ()
>>> #3 0x00007f683f9a0fd9 in slapd_daemon ()
>>> #4 0x00007f683f992c6c in main ()
>>>
>>>
>>>
>>> the top output seems ok, there was just a sudden spike to around 340%
>>> cpu then it comes down
>>>
>>> top - 08:53:12 up 6 days, 23:20, 1 user, load average: 0.00, 0.01, 0.12
>>> Threads: 44 total, 0 running, 44 sleeping, 0 stopped, 0 zombie
>>> %Cpu(s): 0.0 us, 0.0 sy, 0.0 ni,100.0 id, 0.0 wa, 0.0 hi, 0.0 si,
>>> 0.0 st
>>> KiB Mem : 65533176 total, 52165676 free, 6135088 used, 7232412
>>> buff/cache
>>> KiB Swap: 3999996 total, 3999996 free, 0 used. 58452040 avail
>>> Mem
>>>
>>> PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+
>>> COMMAND
>>> 4845 dirsrv 20 0 5133196 3.150g 281272 S 0.0 5.0 31:34.51
>>> ns-slapd
>>> 4847 dirsrv 20 0 5133196 3.150g 281272 S 0.0 5.0 0:13.53
>>> ns-slapd
>>> 4848 dirsrv 20 0 5133196 3.150g 281272 S 0.0 5.0 0:13.16
>>> ns-slapd
>>> 4849 dirsrv 20 0 5133196 3.150g 281272 S 0.0 5.0 0:45.27
>>> ns-slapd
>>> 4850 dirsrv 20 0 5133196 3.150g 281272 S 0.0 5.0 0:01.60
>>> ns-slapd
>>> 4851 dirsrv 20 0 5133196 3.150g 281272 S 0.0 5.0 0:00.00
>>> ns-slapd
>>> 4852 dirsrv 20 0 5133196 3.150g 281272 S 0.0 5.0 0:00.00
>>> ns-slapd
>>> 4853 dirsrv 20 0 5133196 3.150g 281272 S 0.0 5.0 0:00.00
>>> ns-slapd
>>> 4854 dirsrv 20 0 5133196 3.150g 281272 S 0.0 5.0 0:00.00
>>> ns-slapd
>>> 4855 dirsrv 20 0 5133196 3.150g 281272 S 0.0 5.0 0:03.02
>>> ns-slapd
>>> 4856 dirsrv 20 0 5133196 3.150g 281272 S 0.0 5.0 0:00.26
>>> ns-slapd
>>> 4859 dirsrv 20 0 5133196 3.150g 281272 S 0.0 5.0 3:18.67
>>> ns-slapd
>>> 4860 dirsrv 20 0 5133196 3.150g 281272 S 0.0 5.0 3:19.82
>>> ns-slapd
>>> 4861 dirsrv 20 0 5133196 3.150g 281272 S 0.0 5.0 3:20.23
>>> ns-slapd
>>> 4862 dirsrv 20 0 5133196 3.150g 281272 S 0.0 5.0 3:22.65
>>> ns-slapd
>>> 4863 dirsrv 20 0 5133196 3.150g 281272 S 0.0 5.0 3:16.64
>>> ns-slapd
>>> 4864 dirsrv 20 0 5133196 3.150g 281272 S 0.0 5.0 3:17.39
>>> ns-slapd
>>> 4865 dirsrv 20 0 5133196 3.150g 281272 S 0.0 5.0 3:17.80
>>> ns-slapd
>>>
>>>
>>> Thanks
>>> Rakesh
>>>
>>> On Tue, Sep 6, 2016 at 12:09 AM, Rakesh Rajasekharan <
>>> rakesh.rajasekharan at gmail.com> wrote:
>>>
>>>> Hi Thierry/Ludwig,
>>>>
>>>> Unfortunately I had by then restarted the service and since then have
>>>> been trying to hit the hang issue again but no luck this time
>>>>
>>>> It has been running fine for the last few hours now in-spite of trying
>>>> all that I believe could cause the hang like making simultaneous client
>>>> addition requests.
>>>>
>>>> I will continue testing this and next time I get it I will make sure I
>>>> get the pstack and also get the dump of db lock info.
>>>>
>>>> Thanks,
>>>> Rakesh
>>>>
>>>>
>>>>
>>>> On Mon, Sep 5, 2016 at 6:14 PM, Ludwig Krispenz < <lkrispen at redhat.com>
>>>> lkrispen at redhat.com> wrote:
>>>>
>>>>>
>>>>> On 09/05/2016 02:31 PM, thierry bordaz wrote:
>>>>>
>>>>> Hi Rakesh,
>>>>>
>>>>> Thanks you soooo much for you continuous help on this !!
>>>>>
>>>>> If the hang is still going on, would you dump the DB lock information
>>>>> with:
>>>>>
>>>>> db_stat -CA -N -h /var/lib/dirsrv/slapd-<instance>/db
>>>>> >/tmp/db_lock_info
>>>>>
>>>>> It is looking like several threads are waiting for one/several db
>>>>> locks. With the lock info we will know which thread acquired it/them.
>>>>> A guess is that it could be the checkpointing thread but this one is
>>>>> also waiting (on a memory pool).
>>>>>
>>>>> I am copying Ludwig on this thread in case this pstack rings any bell.
>>>>>
>>>>> the frequent presence of __db_tas_mutex_lock() looks like the NUMA
>>>>> problem of libdb, although the threads already have stopped spinning (maybe
>>>>> this was an effect of gcore).
>>>>> If the hang aoccurs again, could you check cpu consumption
>>>>> top -H -p <slapd-pid>
>>>>> and get a pstack
>>>>> pstack <slapd-pid>
>>>>>
>>>>>
>>>>> best regards
>>>>> thierry
>>>>>
>>>>> On 09/05/2016 02:05 PM, Rakesh Rajasekharan wrote:
>>>>>
>>>>> Hi Thierry,
>>>>>
>>>>> I was able to now reporduce the issue..
>>>>>
>>>>> the ns-slapd process just got hung,.. however, no core file was
>>>>> generate..
>>>>>
>>>>> I manually created a coredump using gcore and then took a strace of it
>>>>> this is strace from the coredump generated
>>>>>
>>>>> GNU gdb (GDB) Red Hat Enterprise Linux 7.6.1-80.el7
>>>>> Copyright (C) 2013 Free Software Foundation, Inc.
>>>>> License GPLv3+: GNU GPL version 3 or later <
>>>>> <http://gnu.org/licenses/gpl.h>http://gnu.org/licenses/gpl.html>
>>>>> This is free software: you are free to change and redistribute it.
>>>>> There is NO WARRANTY, to the extent permitted by law. Type "show
>>>>> copying"
>>>>> and "show warranty" for details.
>>>>> This GDB was configured as "x86_64-redhat-linux-gnu".
>>>>> For bug reporting instructions, please see:
>>>>> < <http://www.gnu.org/software/gdb/bugs/>http://www.gnu.org/software/g
>>>>> db/bugs/>...
>>>>> Reading symbols from /usr/sbin/ns-slapd...Reading symbols from
>>>>> /usr/sbin/ns-slapd...(no debugging symbols found)...done.
>>>>> (no debugging symbols found)...done.
>>>>> [New LWP 105159]
>>>>> [New LWP 105160]
>>>>> [New LWP 105161]
>>>>> [New LWP 105162]
>>>>> [New LWP 105163]
>>>>> [New LWP 105164]
>>>>> [New LWP 105165]
>>>>> [New LWP 105166]
>>>>> [New LWP 105167]
>>>>> [New LWP 105168]
>>>>> [New LWP 105171]
>>>>> [New LWP 105172]
>>>>> [New LWP 105173]
>>>>> [New LWP 105174]
>>>>> [New LWP 105175]
>>>>> [New LWP 105176]
>>>>> [New LWP 105177]
>>>>> [New LWP 105178]
>>>>> [New LWP 105179]
>>>>> [New LWP 105180]
>>>>> [New LWP 105181]
>>>>> [New LWP 105182]
>>>>> [New LWP 105183]
>>>>> [New LWP 105184]
>>>>> [New LWP 105185]
>>>>> [New LWP 105186]
>>>>> [New LWP 105187]
>>>>> [New LWP 105188]
>>>>> [New LWP 105189]
>>>>> [New LWP 105190]
>>>>> [New LWP 105191]
>>>>> [New LWP 105192]
>>>>> [New LWP 105193]
>>>>> [New LWP 105194]
>>>>> [New LWP 105195]
>>>>> [New LWP 105196]
>>>>> [New LWP 105197]
>>>>> [New LWP 105198]
>>>>> [New LWP 105199]
>>>>> [New LWP 105200]
>>>>> [New LWP 105201]
>>>>> [New LWP 105203]
>>>>> [New LWP 105215]
>>>>> [New LWP 105158]
>>>>> [Thread debugging using libthread_db enabled]
>>>>> Using host libthread_db library "/lib64/libthread_db.so.1".
>>>>> Core was generated by `/usr/sbin/ns-slapd'.
>>>>> #0 0x00007f1b48ae69b3 in select () from /lib64/libc.so.6
>>>>>
>>>>> Thread 44 (Thread 0x7f1b4b6d9840 (LWP 105158)):
>>>>> #0 0x00007f1b48dc56d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>>>> No symbol table info available.
>>>>> #1 0x00007f1b4941b2c3 in PR_EnterMonitor () from /lib64/libnspr4.so
>>>>> No symbol table info available.
>>>>> #2 0x00007f1b4b7125ed in setup_pr_read_pds ()
>>>>> No symbol table info available.
>>>>> #3 0x00007f1b4b715fd9 in slapd_daemon ()
>>>>> No symbol table info available.
>>>>> #4 0x00007f1b4b707c6c in main ()
>>>>> No symbol table info available.
>>>>>
>>>>> Thread 43 (Thread 0x7f1a5df0f700 (LWP 105215)):
>>>>> #0 0x00007f1b48dc56d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>>>> No symbol table info available.
>>>>> #1 0x00007f1b4941b050 in PR_WaitCondVar () from /lib64/libnspr4.so
>>>>> No symbol table info available.
>>>>> #2 0x00007f1b4b71df25 in ps_send_results ()
>>>>> No symbol table info available.
>>>>> #3 0x00007f1b494207bb in _pt_root () from /lib64/libnspr4.so
>>>>> No symbol table info available.
>>>>> #4 0x00007f1b48dc1dc5 in start_thread () from /lib64/libpthread.so.0
>>>>> No symbol table info available.
>>>>> #5 0x00007f1b48aef28d in clone () from /lib64/libc.so.6
>>>>> No symbol table info available.
>>>>>
>>>>> Thread 42 (Thread 0x7f1b03fe7700 (LWP 105203)):
>>>>> #0 0x00007f1b48dc56d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>>>> No symbol table info available.
>>>>> #1 0x00007f1b4941b050 in PR_WaitCondVar () from /lib64/libnspr4.so
>>>>> No symbol table info available.
>>>>> #2 0x00007f1b4b71df25 in ps_send_results ()
>>>>> No symbol table info available.
>>>>> #3 0x00007f1b494207bb in _pt_root () from /lib64/libnspr4.so
>>>>> No symbol table info available.
>>>>> #4 0x00007f1b48dc1dc5 in start_thread () from /lib64/libpthread.so.0
>>>>> No symbol table info available.
>>>>> #5 0x00007f1b48aef28d in clone () from /lib64/libc.so.6
>>>>> No symbol table info available.
>>>>>
>>>>> Thread 41 (Thread 0x7f1b047e8700 (LWP 105201)):
>>>>> #0 0x00007f1b48ae69b3 in select () from /lib64/libc.so.6
>>>>> No symbol table info available.
>>>>> #1 0x00007f1b4b2710e9 in DS_Sleep () from
>>>>> /usr/lib64/dirsrv/libslapd.so.0
>>>>> No symbol table info available.
>>>>> #2 0x00007f1b4b712325 in time_thread ()
>>>>> No symbol table info available.
>>>>> #3 0x00007f1b494207bb in _pt_root () from /lib64/libnspr4.so
>>>>> No symbol table info available.
>>>>> #4 0x00007f1b48dc1dc5 in start_thread () from /lib64/libpthread.so.0
>>>>> No symbol table info available.
>>>>> #5 0x00007f1b48aef28d in clone () from /lib64/libc.so.6
>>>>> No symbol table info available.
>>>>>
>>>>> Thread 40 (Thread 0x7f1b04fe9700 (LWP 105200)):
>>>>> #0 0x00007f1b48dc56d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>>>> No symbol table info available.
>>>>> #1 0x00007f1b433212f3 in __db_hybrid_mutex_suspend () from /lib64/
>>>>> libdb-5.3.so
>>>>> No symbol table info available.
>>>>> #2 0x00007f1b43320640 in __db_tas_mutex_lock () from /lib64/
>>>>> libdb-5.3.so
>>>>> No symbol table info available.
>>>>> #3 0x00007f1b4343ae1b in __memp_fget () from /lib64/libdb-5.3.so
>>>>> No symbol table info available.
>>>>> #4 0x00007f1b4333e211 in __bam_search () from /lib64/libdb-5.3.so
>>>>> No symbol table info available.
>>>>> #5 0x00007f1b43329256 in __bamc_search () from /lib64/libdb-5.3.so
>>>>> No symbol table info available.
>>>>> #6 0x00007f1b4332d6c4 in __bamc_put () from /lib64/libdb-5.3.so
>>>>> No symbol table info available.
>>>>> #7 0x00007f1b433e46d5 in __dbc_iput () from /lib64/libdb-5.3.so
>>>>> No symbol table info available.
>>>>> #8 0x00007f1b433dfa0e in __db_put () from /lib64/libdb-5.3.so
>>>>> No symbol table info available.
>>>>> #9 0x00007f1b433f4fa4 in __db_put_pp () from /lib64/libdb-5.3.so
>>>>> No symbol table info available.
>>>>> #10 0x00007f1b3e8cf4cf in idl_new_insert_key () from
>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>> No symbol table info available.
>>>>> #11 0x00007f1b3e8de5b5 in addordel_values_sv.isra.3 () from
>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>> No symbol table info available.
>>>>> #12 0x00007f1b3e8df25a in index_addordel_values_ext_sv () from
>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>> No symbol table info available.
>>>>> #13 0x00007f1b3e8df694 in index_addordel_values_sv () from
>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>> No symbol table info available.
>>>>> #14 0x00007f1b3e8df75a in index_addordel_entry () from
>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>> No symbol table info available.
>>>>> #15 0x00007f1b3e8e25fa in ldbm_back_add () from
>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>> No symbol table info available.
>>>>> #16 0x00007f1b4b1e4cca in op_shared_add () from
>>>>> /usr/lib64/dirsrv/libslapd.so.0
>>>>> No symbol table info available.
>>>>> #17 0x00007f1b4b1e6020 in do_add () from /usr/lib64/dirsrv/libslapd.so.
>>>>> 0
>>>>> No symbol table info available.
>>>>> #18 0x00007f1b4b711303 in connection_threadmain ()
>>>>> No symbol table info available.
>>>>> #19 0x00007f1b494207bb in _pt_root () from /lib64/libnspr4.so
>>>>> No symbol table info available.
>>>>> #20 0x00007f1b48dc1dc5 in start_thread () from /lib64/libpthread.so.0
>>>>> No symbol table info available.
>>>>> #21 0x00007f1b48aef28d in clone () from /lib64/libc.so.6
>>>>> No symbol table info available.
>>>>>
>>>>> Thread 39 (Thread 0x7f1b057ea700 (LWP 105199)):
>>>>> #0 0x00007f1b48dc56d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>>>> No symbol table info available.
>>>>> #1 0x00007f1b4941b050 in PR_WaitCondVar () from /lib64/libnspr4.so
>>>>> No symbol table info available.
>>>>> #2 0x00007f1b4b70efee in connection_wait_for_new_work ()
>>>>> No symbol table info available.
>>>>> #3 0x00007f1b4b710719 in connection_threadmain ()
>>>>> No symbol table info available.
>>>>> #4 0x00007f1b494207bb in _pt_root () from /lib64/libnspr4.so
>>>>> No symbol table info available.
>>>>> #5 0x00007f1b48dc1dc5 in start_thread () from /lib64/libpthread.so.0
>>>>> No symbol table info available.
>>>>> #6 0x00007f1b48aef28d in clone () from /lib64/libc.so.6
>>>>> No symbol table info available.
>>>>>
>>>>> Thread 38 (Thread 0x7f1b05feb700 (LWP 105198)):
>>>>> #0 0x00007f1b48dc56d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>>>> No symbol table info available.
>>>>> #1 0x00007f1b4941b050 in PR_WaitCondVar () from /lib64/libnspr4.so
>>>>> No symbol table info available.
>>>>> #2 0x00007f1b4b70efee in connection_wait_for_new_work ()
>>>>> No symbol table info available.
>>>>> #3 0x00007f1b4b710719 in connection_threadmain ()
>>>>> No symbol table info available.
>>>>> #4 0x00007f1b494207bb in _pt_root () from /lib64/libnspr4.so
>>>>> No symbol table info available.
>>>>> #5 0x00007f1b48dc1dc5 in start_thread () from /lib64/libpthread.so.0
>>>>> No symbol table info available.
>>>>> #6 0x00007f1b48aef28d in clone () from /lib64/libc.so.6
>>>>> No symbol table info available.
>>>>>
>>>>> Thread 37 (Thread 0x7f1b067ec700 (LWP 105197)):
>>>>> #0 0x00007f1b48dc56d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>>>> No symbol table info available.
>>>>> #1 0x00007f1b4941b050 in PR_WaitCondVar () from /lib64/libnspr4.so
>>>>> No symbol table info available.
>>>>> #2 0x00007f1b4b70efee in connection_wait_for_new_work ()
>>>>> No symbol table info available.
>>>>> #3 0x00007f1b4b710719 in connection_threadmain ()
>>>>> No symbol table info available.
>>>>> #4 0x00007f1b494207bb in _pt_root () from /lib64/libnspr4.so
>>>>> No symbol table info available.
>>>>> #5 0x00007f1b48dc1dc5 in start_thread () from /lib64/libpthread.so.0
>>>>> No symbol table info available.
>>>>> #6 0x00007f1b48aef28d in clone () from /lib64/libc.so.6
>>>>> No symbol table info available.
>>>>>
>>>>> Thread 36 (Thread 0x7f1b06fed700 (LWP 105196)):
>>>>> #0 0x00007f1b48dc56d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>>>> No symbol table info available.
>>>>> #1 0x00007f1b4941b050 in PR_WaitCondVar () from /lib64/libnspr4.so
>>>>> No symbol table info available.
>>>>> #2 0x00007f1b4b70efee in connection_wait_for_new_work ()
>>>>> No symbol table info available.
>>>>> #3 0x00007f1b4b710719 in connection_threadmain ()
>>>>> No symbol table info available.
>>>>> #4 0x00007f1b494207bb in _pt_root () from /lib64/libnspr4.so
>>>>> No symbol table info available.
>>>>> #5 0x00007f1b48dc1dc5 in start_thread () from /lib64/libpthread.so.0
>>>>> No symbol table info available.
>>>>> #6 0x00007f1b48aef28d in clone () from /lib64/libc.so.6
>>>>> No symbol table info available.
>>>>>
>>>>> Thread 35 (Thread 0x7f1b077ee700 (LWP 105195)):
>>>>> #0 0x00007f1b48dc56d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>>>> No symbol table info available.
>>>>> #1 0x00007f1b4941b2c3 in PR_EnterMonitor () from /lib64/libnspr4.so
>>>>> No symbol table info available.
>>>>> #2 0x00007f1b3e8c23e6 in dblayer_txn_begin () from
>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>> No symbol table info available.
>>>>> #3 0x00007f1b3e8fe007 in ldbm_back_modify () from
>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>> No symbol table info available.
>>>>> #4 0x00007f1b4b22b541 in op_shared_modify () from
>>>>> /usr/lib64/dirsrv/libslapd.so.0
>>>>> No symbol table info available.
>>>>> #5 0x00007f1b4b22c004 in modify_internal_pb () from
>>>>> /usr/lib64/dirsrv/libslapd.so.0
>>>>> No symbol table info available.
>>>>> #6 0x00007f1b3eb48b60 in ipapwd_apply_mods () from
>>>>> /usr/lib64/dirsrv/plugins/libipa_pwd_extop.so
>>>>> No symbol table info available.
>>>>> #7 0x00007f1b3eb4c8e0 in store_new_keys () from
>>>>> /usr/lib64/dirsrv/plugins/libipa_pwd_extop.so
>>>>> No symbol table info available.
>>>>> #8 0x00007f1b3eb4ead0 in ipapwd_extop () from
>>>>> /usr/lib64/dirsrv/plugins/libipa_pwd_extop.so
>>>>> No symbol table info available.
>>>>> #9 0x00007f1b4b23bba2 in plugin_call_exop_plugins () from
>>>>> /usr/lib64/dirsrv/libslapd.so.0
>>>>> No symbol table info available.
>>>>> #10 0x00007f1b4b717efe in do_extended ()
>>>>> No symbol table info available.
>>>>> #11 0x00007f1b4b71141a in connection_threadmain ()
>>>>> No symbol table info available.
>>>>> #12 0x00007f1b494207bb in _pt_root () from /lib64/libnspr4.so
>>>>> No symbol table info available.
>>>>> #13 0x00007f1b48dc1dc5 in start_thread () from /lib64/libpthread.so.0
>>>>> No symbol table info available.
>>>>> #14 0x00007f1b48aef28d in clone () from /lib64/libc.so.6
>>>>> No symbol table info available.
>>>>>
>>>>> Thread 34 (Thread 0x7f1b07fef700 (LWP 105194)):
>>>>> #0 0x00007f1b48dc56d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>>>> No symbol table info available.
>>>>> #1 0x00007f1b4941b050 in PR_WaitCondVar () from /lib64/libnspr4.so
>>>>> No symbol table info available.
>>>>> #2 0x00007f1b4b70efee in connection_wait_for_new_work ()
>>>>> No symbol table info available.
>>>>> #3 0x00007f1b4b710719 in connection_threadmain ()
>>>>> No symbol table info available.
>>>>> #4 0x00007f1b494207bb in _pt_root () from /lib64/libnspr4.so
>>>>> No symbol table info available.
>>>>> #5 0x00007f1b48dc1dc5 in start_thread () from /lib64/libpthread.so.0
>>>>> No symbol table info available.
>>>>> #6 0x00007f1b48aef28d in clone () from /lib64/libc.so.6
>>>>> No symbol table info available.
>>>>>
>>>>> Thread 33 (Thread 0x7f1b087f0700 (LWP 105193)):
>>>>> #0 0x00007f1b48dc56d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>>>> No symbol table info available.
>>>>> #1 0x00007f1b4941b050 in PR_WaitCondVar () from /lib64/libnspr4.so
>>>>> No symbol table info available.
>>>>> #2 0x00007f1b4b70efee in connection_wait_for_new_work ()
>>>>> No symbol table info available.
>>>>> #3 0x00007f1b4b710719 in connection_threadmain ()
>>>>> No symbol table info available.
>>>>> #4 0x00007f1b494207bb in _pt_root () from /lib64/libnspr4.so
>>>>> No symbol table info available.
>>>>> #5 0x00007f1b48dc1dc5 in start_thread () from /lib64/libpthread.so.0
>>>>> No symbol table info available.
>>>>> #6 0x00007f1b48aef28d in clone () from /lib64/libc.so.6
>>>>> No symbol table info available.
>>>>>
>>>>> Thread 32 (Thread 0x7f1b08ff1700 (LWP 105192)):
>>>>> #0 0x00007f1b48dc56d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>>>> No symbol table info available.
>>>>> #1 0x00007f1b4941b050 in PR_WaitCondVar () from /lib64/libnspr4.so
>>>>> No symbol table info available.
>>>>> #2 0x00007f1b4b70efee in connection_wait_for_new_work ()
>>>>> No symbol table info available.
>>>>> #3 0x00007f1b4b710719 in connection_threadmain ()
>>>>> No symbol table info available.
>>>>> #4 0x00007f1b494207bb in _pt_root () from /lib64/libnspr4.so
>>>>> No symbol table info available.
>>>>> #5 0x00007f1b48dc1dc5 in start_thread () from /lib64/libpthread.so.0
>>>>> No symbol table info available.
>>>>> #6 0x00007f1b48aef28d in clone () from /lib64/libc.so.6
>>>>> No symbol table info available.
>>>>>
>>>>> Thread 31 (Thread 0x7f1b097f2700 (LWP 105191)):
>>>>> #0 0x00007f1b48dc56d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>>>> No symbol table info available.
>>>>> #1 0x00007f1b4941b050 in PR_WaitCondVar () from /lib64/libnspr4.so
>>>>> No symbol table info available.
>>>>> #2 0x00007f1b4b70efee in connection_wait_for_new_work ()
>>>>> No symbol table info available.
>>>>> #3 0x00007f1b4b710719 in connection_threadmain ()
>>>>> No symbol table info available.
>>>>> #4 0x00007f1b494207bb in _pt_root () from /lib64/libnspr4.so
>>>>> No symbol table info available.
>>>>> #5 0x00007f1b48dc1dc5 in start_thread () from /lib64/libpthread.so.0
>>>>> No symbol table info available.
>>>>> #6 0x00007f1b48aef28d in clone () from /lib64/libc.so.6
>>>>> No symbol table info available.
>>>>>
>>>>> Thread 30 (Thread 0x7f1b09ff3700 (LWP 105190)):
>>>>> #0 0x00007f1b48dc56d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>>>> No symbol table info available.
>>>>> #1 0x00007f1b433212f3 in __db_hybrid_mutex_suspend () from /lib64/
>>>>> libdb-5.3.so
>>>>> No symbol table info available.
>>>>> #2 0x00007f1b43320640 in __db_tas_mutex_lock () from /lib64/
>>>>> libdb-5.3.so
>>>>> No symbol table info available.
>>>>> #3 0x00007f1b433cad3a in __lock_get_internal () from /lib64/
>>>>> libdb-5.3.so
>>>>> No symbol table info available.
>>>>> #4 0x00007f1b433cb820 in __lock_get () from /lib64/libdb-5.3.so
>>>>> No symbol table info available.
>>>>> #5 0x00007f1b433f7142 in __db_lget () from /lib64/libdb-5.3.so
>>>>> No symbol table info available.
>>>>> #6 0x00007f1b4333e605 in __bam_search () from /lib64/libdb-5.3.so
>>>>> No symbol table info available.
>>>>> #7 0x00007f1b43329256 in __bamc_search () from /lib64/libdb-5.3.so
>>>>> No symbol table info available.
>>>>> #8 0x00007f1b4332ad0f in __bamc_get () from /lib64/libdb-5.3.so
>>>>> No symbol table info available.
>>>>> #9 0x00007f1b433e3ca6 in __dbc_iget () from /lib64/libdb-5.3.so
>>>>> No symbol table info available.
>>>>> #10 0x00007f1b433f2b02 in __dbc_get_pp () from /lib64/libdb-5.3.so
>>>>> No symbol table info available.
>>>>> #11 0x00007f1b3e8ce680 in idl_new_fetch () from
>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>> No symbol table info available.
>>>>> #12 0x00007f1b3e8dcb26 in index_read_ext_allids () from
>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>> No symbol table info available.
>>>>> #13 0x00007f1b3e8c7284 in keys2idl () from
>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>> No symbol table info available.
>>>>> #14 0x00007f1b3e8c79e3 in ava_candidates.isra.0 () from
>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>> No symbol table info available.
>>>>> #15 0x00007f1b3e8c7fd2 in filter_candidates_ext () from
>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>> No symbol table info available.
>>>>> #16 0x00007f1b3e8c9096 in list_candidates () from
>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>> No symbol table info available.
>>>>> #17 0x00007f1b3e8c7f40 in filter_candidates_ext () from
>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>> No symbol table info available.
>>>>> #18 0x00007f1b3e8c9096 in list_candidates () from
>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>> No symbol table info available.
>>>>> #19 0x00007f1b3e8c7f40 in filter_candidates_ext () from
>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>> No symbol table info available.
>>>>> #20 0x00007f1b3e8c9096 in list_candidates () from
>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>> No symbol table info available.
>>>>> #21 0x00007f1b3e8c7f40 in filter_candidates_ext () from
>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>> No symbol table info available.
>>>>> #22 0x00007f1b3e90380c in subtree_candidates () from
>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>> No symbol table info available.
>>>>> #23 0x00007f1b3e904e7f in ldbm_back_search () from
>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>> No symbol table info available.
>>>>> #24 0x00007f1b4b2321d6 in op_shared_search () from
>>>>> /usr/lib64/dirsrv/libslapd.so.0
>>>>> No symbol table info available.
>>>>> #25 0x00007f1b4b72333e in do_search ()
>>>>> No symbol table info available.
>>>>> #26 0x00007f1b4b7113c3 in connection_threadmain ()
>>>>> No symbol table info available.
>>>>> #27 0x00007f1b494207bb in _pt_root () from /lib64/libnspr4.so
>>>>> No symbol table info available.
>>>>> #28 0x00007f1b48dc1dc5 in start_thread () from /lib64/libpthread.so.0
>>>>> No symbol table info available.
>>>>> #29 0x00007f1b48aef28d in clone () from /lib64/libc.so.6
>>>>> No symbol table info available.
>>>>>
>>>>> Thread 29 (Thread 0x7f1b0a7f4700 (LWP 105189)):
>>>>> #0 0x00007f1b48dc56d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>>>> No symbol table info available.
>>>>> #1 0x00007f1b4941b050 in PR_WaitCondVar () from /lib64/libnspr4.so
>>>>> No symbol table info available.
>>>>> #2 0x00007f1b4b70efee in connection_wait_for_new_work ()
>>>>> No symbol table info available.
>>>>> #3 0x00007f1b4b710719 in connection_threadmain ()
>>>>> No symbol table info available.
>>>>> #4 0x00007f1b494207bb in _pt_root () from /lib64/libnspr4.so
>>>>> No symbol table info available.
>>>>> #5 0x00007f1b48dc1dc5 in start_thread () from /lib64/libpthread.so.0
>>>>> No symbol table info available.
>>>>> #6 0x00007f1b48aef28d in clone () from /lib64/libc.so.6
>>>>> No symbol table info available.
>>>>>
>>>>> Thread 28 (Thread 0x7f1b0aff5700 (LWP 105188)):
>>>>> #0 0x00007f1b48dc56d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>>>> No symbol table info available.
>>>>> #1 0x00007f1b4941b050 in PR_WaitCondVar () from /lib64/libnspr4.so
>>>>> No symbol table info available.
>>>>> #2 0x00007f1b4b70efee in connection_wait_for_new_work ()
>>>>> No symbol table info available.
>>>>> #3 0x00007f1b4b710719 in connection_threadmain ()
>>>>> No symbol table info available.
>>>>> #4 0x00007f1b494207bb in _pt_root () from /lib64/libnspr4.so
>>>>> No symbol table info available.
>>>>> #5 0x00007f1b48dc1dc5 in start_thread () from /lib64/libpthread.so.0
>>>>> No symbol table info available.
>>>>> #6 0x00007f1b48aef28d in clone () from /lib64/libc.so.6
>>>>> No symbol table info available.
>>>>>
>>>>> Thread 27 (Thread 0x7f1b0b7f6700 (LWP 105187)):
>>>>> #0 0x00007f1b48dc56d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>>>> No symbol table info available.
>>>>> #1 0x00007f1b4941b050 in PR_WaitCondVar () from /lib64/libnspr4.so
>>>>> No symbol table info available.
>>>>> #2 0x00007f1b4b70efee in connection_wait_for_new_work ()
>>>>> No symbol table info available.
>>>>> #3 0x00007f1b4b710719 in connection_threadmain ()
>>>>> No symbol table info available.
>>>>> #4 0x00007f1b494207bb in _pt_root () from /lib64/libnspr4.so
>>>>> No symbol table info available.
>>>>> #5 0x00007f1b48dc1dc5 in start_thread () from /lib64/libpthread.so.0
>>>>> No symbol table info available.
>>>>> #6 0x00007f1b48aef28d in clone () from /lib64/libc.so.6
>>>>> No symbol table info available.
>>>>>
>>>>> Thread 26 (Thread 0x7f1b0bff7700 (LWP 105186)):
>>>>> #0 0x00007f1b48dc56d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>>>> No symbol table info available.
>>>>> #1 0x00007f1b433212f3 in __db_hybrid_mutex_suspend () from /lib64/
>>>>> libdb-5.3.so
>>>>> No symbol table info available.
>>>>> #2 0x00007f1b43320640 in __db_tas_mutex_lock () from /lib64/
>>>>> libdb-5.3.so
>>>>> No symbol table info available.
>>>>> #3 0x00007f1b433cad3a in __lock_get_internal () from /lib64/
>>>>> libdb-5.3.so
>>>>> No symbol table info available.
>>>>> #4 0x00007f1b433cb820 in __lock_get () from /lib64/libdb-5.3.so
>>>>> No symbol table info available.
>>>>> #5 0x00007f1b433f7142 in __db_lget () from /lib64/libdb-5.3.so
>>>>> No symbol table info available.
>>>>> #6 0x00007f1b4333e605 in __bam_search () from /lib64/libdb-5.3.so
>>>>> No symbol table info available.
>>>>> #7 0x00007f1b43329256 in __bamc_search () from /lib64/libdb-5.3.so
>>>>> No symbol table info available.
>>>>> #8 0x00007f1b4332ad0f in __bamc_get () from /lib64/libdb-5.3.so
>>>>> No symbol table info available.
>>>>> #9 0x00007f1b433e3ca6 in __dbc_iget () from /lib64/libdb-5.3.so
>>>>> No symbol table info available.
>>>>> #10 0x00007f1b433f2b02 in __dbc_get_pp () from /lib64/libdb-5.3.so
>>>>> No symbol table info available.
>>>>> #11 0x00007f1b3e8ce680 in idl_new_fetch () from
>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>> No symbol table info available.
>>>>> #12 0x00007f1b3e8dcb26 in index_read_ext_allids () from
>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>> No symbol table info available.
>>>>> #13 0x00007f1b3e8c7284 in keys2idl () from
>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>> No symbol table info available.
>>>>> #14 0x00007f1b3e8c79e3 in ava_candidates.isra.0 () from
>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>> No symbol table info available.
>>>>> #15 0x00007f1b3e8c7fd2 in filter_candidates_ext () from
>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>> No symbol table info available.
>>>>> #16 0x00007f1b3e8c9096 in list_candidates () from
>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>> No symbol table info available.
>>>>> #17 0x00007f1b3e8c7f40 in filter_candidates_ext () from
>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>> No symbol table info available.
>>>>> #18 0x00007f1b3e90380c in subtree_candidates () from
>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>> No symbol table info available.
>>>>> #19 0x00007f1b3e904e7f in ldbm_back_search () from
>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>> No symbol table info available.
>>>>> #20 0x00007f1b4b2321d6 in op_shared_search () from
>>>>> /usr/lib64/dirsrv/libslapd.so.0
>>>>> No symbol table info available.
>>>>> #21 0x00007f1b4b24294e in search_internal_callback_pb () from
>>>>> /usr/lib64/dirsrv/libslapd.so.0
>>>>> No symbol table info available.
>>>>> #22 0x00007f1b4b242be8 in search_internal_pb () from
>>>>> /usr/lib64/dirsrv/libslapd.so.0
>>>>> No symbol table info available.
>>>>> #23 0x00007f1b4b72149b in ids_sasl_canon_user ()
>>>>> No symbol table info available.
>>>>> #24 0x00007f1b491e193b in _sasl_canon_user () from /lib64/libsasl2.so.3
>>>>> No symbol table info available.
>>>>> #25 0x00007f1b491e1c4c in _sasl_canon_user_lookup () from
>>>>> /lib64/libsasl2.so.3
>>>>> No symbol table info available.
>>>>> #26 0x00007f1b430e9fb9 in gssapi_server_mech_step () from
>>>>> /usr/lib64/sasl2/libgssapiv2.so
>>>>> No symbol table info available.
>>>>> #27 0x00007f1b491edb9b in sasl_server_step () from /lib64/libsasl2.so.3
>>>>> No symbol table info available.
>>>>> #28 0x00007f1b4b72283b in ids_sasl_check_bind ()
>>>>> No symbol table info available.
>>>>> #29 0x00007f1b4b70a61a in do_bind ()
>>>>> No symbol table info available.
>>>>> #30 0x00007f1b4b7113fd in connection_threadmain ()
>>>>> No symbol table info available.
>>>>> #31 0x00007f1b494207bb in _pt_root () from /lib64/libnspr4.so
>>>>> No symbol table info available.
>>>>> #32 0x00007f1b48dc1dc5 in start_thread () from /lib64/libpthread.so.0
>>>>> No symbol table info available.
>>>>> #33 0x00007f1b48aef28d in clone () from /lib64/libc.so.6
>>>>> No symbol table info available.
>>>>>
>>>>> Thread 25 (Thread 0x7f1b0c7f8700 (LWP 105185)):
>>>>> #0 0x00007f1b48dc56d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>>>> No symbol table info available.
>>>>> #1 0x00007f1b4941b050 in PR_WaitCondVar () from /lib64/libnspr4.so
>>>>> No symbol table info available.
>>>>> #2 0x00007f1b4b70efee in connection_wait_for_new_work ()
>>>>> No symbol table info available.
>>>>> #3 0x00007f1b4b710719 in connection_threadmain ()
>>>>> No symbol table info available.
>>>>> #4 0x00007f1b494207bb in _pt_root () from /lib64/libnspr4.so
>>>>> No symbol table info available.
>>>>> #5 0x00007f1b48dc1dc5 in start_thread () from /lib64/libpthread.so.0
>>>>> No symbol table info available.
>>>>> #6 0x00007f1b48aef28d in clone () from /lib64/libc.so.6
>>>>> No symbol table info available.
>>>>>
>>>>> Thread 24 (Thread 0x7f1b0cff9700 (LWP 105184)):
>>>>> #0 0x00007f1b48dc56d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>>>> No symbol table info available.
>>>>> #1 0x00007f1b4941b050 in PR_WaitCondVar () from /lib64/libnspr4.so
>>>>> No symbol table info available.
>>>>> #2 0x00007f1b4b70efee in connection_wait_for_new_work ()
>>>>> No symbol table info available.
>>>>> #3 0x00007f1b4b710719 in connection_threadmain ()
>>>>> No symbol table info available.
>>>>> #4 0x00007f1b494207bb in _pt_root () from /lib64/libnspr4.so
>>>>> No symbol table info available.
>>>>> #5 0x00007f1b48dc1dc5 in start_thread () from /lib64/libpthread.so.0
>>>>> No symbol table info available.
>>>>> #6 0x00007f1b48aef28d in clone () from /lib64/libc.so.6
>>>>> No symbol table info available.
>>>>>
>>>>> Thread 23 (Thread 0x7f1b0d7fa700 (LWP 105183)):
>>>>> #0 0x00007f1b48dc56d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>>>> No symbol table info available.
>>>>> #1 0x00007f1b4941b050 in PR_WaitCondVar () from /lib64/libnspr4.so
>>>>> No symbol table info available.
>>>>> #2 0x00007f1b4b70efee in connection_wait_for_new_work ()
>>>>> No symbol table info available.
>>>>> #3 0x00007f1b4b710719 in connection_threadmain ()
>>>>> No symbol table info available.
>>>>> #4 0x00007f1b494207bb in _pt_root () from /lib64/libnspr4.so
>>>>> No symbol table info available.
>>>>> #5 0x00007f1b48dc1dc5 in start_thread () from /lib64/libpthread.so.0
>>>>> No symbol table info available.
>>>>> #6 0x00007f1b48aef28d in clone () from /lib64/libc.so.6
>>>>> No symbol table info available.
>>>>>
>>>>> Thread 22 (Thread 0x7f1b0dffb700 (LWP 105182)):
>>>>> #0 0x00007f1b48dc56d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>>>> No symbol table info available.
>>>>> #1 0x00007f1b4941b050 in PR_WaitCondVar () from /lib64/libnspr4.so
>>>>> No symbol table info available.
>>>>> #2 0x00007f1b4b70efee in connection_wait_for_new_work ()
>>>>> No symbol table info available.
>>>>> #3 0x00007f1b4b710719 in connection_threadmain ()
>>>>> No symbol table info available.
>>>>> #4 0x00007f1b494207bb in _pt_root () from /lib64/libnspr4.so
>>>>> No symbol table info available.
>>>>> #5 0x00007f1b48dc1dc5 in start_thread () from /lib64/libpthread.so.0
>>>>> No symbol table info available.
>>>>> #6 0x00007f1b48aef28d in clone () from /lib64/libc.so.6
>>>>> No symbol table info available.
>>>>>
>>>>> Thread 21 (Thread 0x7f1b0e7fc700 (LWP 105181)):
>>>>> #0 0x00007f1b48dc56d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>>>> No symbol table info available.
>>>>> #1 0x00007f1b4941b050 in PR_WaitCondVar () from /lib64/libnspr4.so
>>>>> No symbol table info available.
>>>>> #2 0x00007f1b4b70efee in connection_wait_for_new_work ()
>>>>> No symbol table info available.
>>>>> #3 0x00007f1b4b710719 in connection_threadmain ()
>>>>> No symbol table info available.
>>>>> #4 0x00007f1b494207bb in _pt_root () from /lib64/libnspr4.so
>>>>> No symbol table info available.
>>>>> #5 0x00007f1b48dc1dc5 in start_thread () from /lib64/libpthread.so.0
>>>>> No symbol table info available.
>>>>> #6 0x00007f1b48aef28d in clone () from /lib64/libc.so.6
>>>>> No symbol table info available.
>>>>>
>>>>> Thread 20 (Thread 0x7f1b0effd700 (LWP 105180)):
>>>>> #0 0x00007f1b48dc56d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>>>> No symbol table info available.
>>>>> #1 0x00007f1b433212f3 in __db_hybrid_mutex_suspend () from /lib64/
>>>>> libdb-5.3.so
>>>>> No symbol table info available.
>>>>> #2 0x00007f1b43320b37 in __db_tas_mutex_readlock () from /lib64/
>>>>> libdb-5.3.so
>>>>> No symbol table info available.
>>>>> #3 0x00007f1b4343ad35 in __memp_fget () from /lib64/libdb-5.3.so
>>>>> No symbol table info available.
>>>>> #4 0x00007f1b433e4333 in __dbc_iget () from /lib64/libdb-5.3.so
>>>>> No symbol table info available.
>>>>> #5 0x00007f1b433f2b02 in __dbc_get_pp () from /lib64/libdb-5.3.so
>>>>> No symbol table info available.
>>>>> #6 0x00007f1b3e8ce822 in idl_new_fetch () from
>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>> No symbol table info available.
>>>>> #7 0x00007f1b3e8dcb26 in index_read_ext_allids () from
>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>> No symbol table info available.
>>>>> #8 0x00007f1b3e8c7284 in keys2idl () from
>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>> No symbol table info available.
>>>>> #9 0x00007f1b3e8c79e3 in ava_candidates.isra.0 () from
>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>> No symbol table info available.
>>>>> #10 0x00007f1b3e8c7fd2 in filter_candidates_ext () from
>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>> No symbol table info available.
>>>>> #11 0x00007f1b3e8c9096 in list_candidates () from
>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>> No symbol table info available.
>>>>> #12 0x00007f1b3e8c7f40 in filter_candidates_ext () from
>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>> No symbol table info available.
>>>>> #13 0x00007f1b3e8c9096 in list_candidates () from
>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>> No symbol table info available.
>>>>> #14 0x00007f1b3e8c7f40 in filter_candidates_ext () from
>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>> No symbol table info available.
>>>>> #15 0x00007f1b3e8c9096 in list_candidates () from
>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>> No symbol table info available.
>>>>> #16 0x00007f1b3e8c7f40 in filter_candidates_ext () from
>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>> No symbol table info available.
>>>>> #17 0x00007f1b3e90380c in subtree_candidates () from
>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>> No symbol table info available.
>>>>> #18 0x00007f1b3e904e7f in ldbm_back_search () from
>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>> No symbol table info available.
>>>>> #19 0x00007f1b4b2321d6 in op_shared_search () from
>>>>> /usr/lib64/dirsrv/libslapd.so.0
>>>>> No symbol table info available.
>>>>> #20 0x00007f1b4b72333e in do_search ()
>>>>> No symbol table info available.
>>>>> #21 0x00007f1b4b7113c3 in connection_threadmain ()
>>>>> No symbol table info available.
>>>>> #22 0x00007f1b494207bb in _pt_root () from /lib64/libnspr4.so
>>>>> No symbol table info available.
>>>>> #23 0x00007f1b48dc1dc5 in start_thread () from /lib64/libpthread.so.0
>>>>> No symbol table info available.
>>>>> #24 0x00007f1b48aef28d in clone () from /lib64/libc.so.6
>>>>> No symbol table info available.
>>>>>
>>>>> Thread 19 (Thread 0x7f1b0f7fe700 (LWP 105179)):
>>>>> #0 0x00007f1b48dc56d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>>>> No symbol table info available.
>>>>> #1 0x00007f1b433212f3 in __db_hybrid_mutex_suspend () from /lib64/
>>>>> libdb-5.3.so
>>>>> No symbol table info available.
>>>>> #2 0x00007f1b43320640 in __db_tas_mutex_lock () from /lib64/
>>>>> libdb-5.3.so
>>>>> No symbol table info available.
>>>>> #3 0x00007f1b433cad3a in __lock_get_internal () from /lib64/
>>>>> libdb-5.3.so
>>>>> No symbol table info available.
>>>>> #4 0x00007f1b433cb820 in __lock_get () from /lib64/libdb-5.3.so
>>>>> No symbol table info available.
>>>>> #5 0x00007f1b433f7142 in __db_lget () from /lib64/libdb-5.3.so
>>>>> No symbol table info available.
>>>>> #6 0x00007f1b4333e605 in __bam_search () from /lib64/libdb-5.3.so
>>>>> No symbol table info available.
>>>>> #7 0x00007f1b43329256 in __bamc_search () from /lib64/libdb-5.3.so
>>>>> No symbol table info available.
>>>>> #8 0x00007f1b4332ad0f in __bamc_get () from /lib64/libdb-5.3.so
>>>>> No symbol table info available.
>>>>> #9 0x00007f1b433e3ca6 in __dbc_iget () from /lib64/libdb-5.3.so
>>>>> No symbol table info available.
>>>>> #10 0x00007f1b433f2b02 in __dbc_get_pp () from /lib64/libdb-5.3.so
>>>>> No symbol table info available.
>>>>> #11 0x00007f1b3e8ce680 in idl_new_fetch () from
>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>> No symbol table info available.
>>>>> #12 0x00007f1b3e8dcb26 in index_read_ext_allids () from
>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>> No symbol table info available.
>>>>> #13 0x00007f1b3e8c7284 in keys2idl () from
>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>> No symbol table info available.
>>>>> #14 0x00007f1b3e8c79e3 in ava_candidates.isra.0 () from
>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>> No symbol table info available.
>>>>> #15 0x00007f1b3e8c7fd2 in filter_candidates_ext () from
>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>> No symbol table info available.
>>>>> #16 0x00007f1b3e8c9096 in list_candidates () from
>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>> No symbol table info available.
>>>>> #17 0x00007f1b3e8c7f40 in filter_candidates_ext () from
>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>> No symbol table info available.
>>>>> #18 0x00007f1b3e8c9096 in list_candidates () from
>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>> No symbol table info available.
>>>>> #19 0x00007f1b3e8c7f40 in filter_candidates_ext () from
>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>> No symbol table info available.
>>>>> #20 0x00007f1b3e8c9096 in list_candidates () from
>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>> No symbol table info available.
>>>>> #21 0x00007f1b3e8c7f40 in filter_candidates_ext () from
>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>> No symbol table info available.
>>>>> #22 0x00007f1b3e90380c in subtree_candidates () from
>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>> No symbol table info available.
>>>>> #23 0x00007f1b3e904e7f in ldbm_back_search () from
>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>> No symbol table info available.
>>>>> #24 0x00007f1b4b2321d6 in op_shared_search () from
>>>>> /usr/lib64/dirsrv/libslapd.so.0
>>>>> No symbol table info available.
>>>>> #25 0x00007f1b4b72333e in do_search ()
>>>>> No symbol table info available.
>>>>> #26 0x00007f1b4b7113c3 in connection_threadmain ()
>>>>> No symbol table info available.
>>>>> #27 0x00007f1b494207bb in _pt_root () from /lib64/libnspr4.so
>>>>> No symbol table info available.
>>>>> #28 0x00007f1b48dc1dc5 in start_thread () from /lib64/libpthread.so.0
>>>>> No symbol table info available.
>>>>> #29 0x00007f1b48aef28d in clone () from /lib64/libc.so.6
>>>>> No symbol table info available.
>>>>>
>>>>> Thread 18 (Thread 0x7f1b0ffff700 (LWP 105178)):
>>>>> #0 0x00007f1b48dc56d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>>>> No symbol table info available.
>>>>> #1 0x00007f1b4941b050 in PR_WaitCondVar () from /lib64/libnspr4.so
>>>>> No symbol table info available.
>>>>> #2 0x00007f1b4b70efee in connection_wait_for_new_work ()
>>>>> No symbol table info available.
>>>>> #3 0x00007f1b4b710719 in connection_threadmain ()
>>>>> No symbol table info available.
>>>>> #4 0x00007f1b494207bb in _pt_root () from /lib64/libnspr4.so
>>>>> No symbol table info available.
>>>>> #5 0x00007f1b48dc1dc5 in start_thread () from /lib64/libpthread.so.0
>>>>> No symbol table info available.
>>>>> #6 0x00007f1b48aef28d in clone () from /lib64/libc.so.6
>>>>> No symbol table info available.
>>>>>
>>>>> Thread 17 (Thread 0x7f1b14d28700 (LWP 105177)):
>>>>> #0 0x00007f1b48dc56d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>>>> No symbol table info available.
>>>>> #1 0x00007f1b4941b050 in PR_WaitCondVar () from /lib64/libnspr4.so
>>>>> No symbol table info available.
>>>>> #2 0x00007f1b4b70efee in connection_wait_for_new_work ()
>>>>> No symbol table info available.
>>>>> #3 0x00007f1b4b710719 in connection_threadmain ()
>>>>> No symbol table info available.
>>>>> #4 0x00007f1b494207bb in _pt_root () from /lib64/libnspr4.so
>>>>> No symbol table info available.
>>>>> #5 0x00007f1b48dc1dc5 in start_thread () from /lib64/libpthread.so.0
>>>>> No symbol table info available.
>>>>> #6 0x00007f1b48aef28d in clone () from /lib64/libc.so.6
>>>>> No symbol table info available.
>>>>>
>>>>> Thread 16 (Thread 0x7f1b15529700 (LWP 105176)):
>>>>> #0 0x00007f1b48dc56d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>>>> No symbol table info available.
>>>>> #1 0x00007f1b4941b050 in PR_WaitCondVar () from /lib64/libnspr4.so
>>>>> No symbol table info available.
>>>>> #2 0x00007f1b4b70efee in connection_wait_for_new_work ()
>>>>> No symbol table info available.
>>>>> #3 0x00007f1b4b710719 in connection_threadmain ()
>>>>> No symbol table info available.
>>>>> #4 0x00007f1b494207bb in _pt_root () from /lib64/libnspr4.so
>>>>> No symbol table info available.
>>>>> #5 0x00007f1b48dc1dc5 in start_thread () from /lib64/libpthread.so.0
>>>>> No symbol table info available.
>>>>> #6 0x00007f1b48aef28d in clone () from /lib64/libc.so.6
>>>>> No symbol table info available.
>>>>>
>>>>> Thread 15 (Thread 0x7f1b15d2a700 (LWP 105175)):
>>>>> #0 0x00007f1b48dc56d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>>>> No symbol table info available.
>>>>> #1 0x00007f1b4941b050 in PR_WaitCondVar () from /lib64/libnspr4.so
>>>>> No symbol table info available.
>>>>> #2 0x00007f1b4b70efee in connection_wait_for_new_work ()
>>>>> No symbol table info available.
>>>>> #3 0x00007f1b4b710719 in connection_threadmain ()
>>>>> No symbol table info available.
>>>>> #4 0x00007f1b494207bb in _pt_root () from /lib64/libnspr4.so
>>>>> No symbol table info available.
>>>>> #5 0x00007f1b48dc1dc5 in start_thread () from /lib64/libpthread.so.0
>>>>> No symbol table info available.
>>>>> #6 0x00007f1b48aef28d in clone () from /lib64/libc.so.6
>>>>> No symbol table info available.
>>>>>
>>>>> Thread 14 (Thread 0x7f1b1652b700 (LWP 105174)):
>>>>> #0 0x00007f1b48dc56d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>>>> No symbol table info available.
>>>>> #1 0x00007f1b4941b050 in PR_WaitCondVar () from /lib64/libnspr4.so
>>>>> No symbol table info available.
>>>>> #2 0x00007f1b4b70efee in connection_wait_for_new_work ()
>>>>> No symbol table info available.
>>>>> #3 0x00007f1b4b710719 in connection_threadmain ()
>>>>> No symbol table info available.
>>>>> #4 0x00007f1b494207bb in _pt_root () from /lib64/libnspr4.so
>>>>> No symbol table info available.
>>>>> #5 0x00007f1b48dc1dc5 in start_thread () from /lib64/libpthread.so.0
>>>>> No symbol table info available.
>>>>> #6 0x00007f1b48aef28d in clone () from /lib64/libc.so.6
>>>>> No symbol table info available.
>>>>>
>>>>> Thread 13 (Thread 0x7f1b16d2c700 (LWP 105173)):
>>>>> #0 0x00007f1b48dc56d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>>>> No symbol table info available.
>>>>> #1 0x00007f1b433212f3 in __db_hybrid_mutex_suspend () from /lib64/
>>>>> libdb-5.3.so
>>>>> No symbol table info available.
>>>>> #2 0x00007f1b43320640 in __db_tas_mutex_lock () from /lib64/
>>>>> libdb-5.3.so
>>>>> No symbol table info available.
>>>>> #3 0x00007f1b433cad3a in __lock_get_internal () from /lib64/
>>>>> libdb-5.3.so
>>>>> No symbol table info available.
>>>>> #4 0x00007f1b433cb820 in __lock_get () from /lib64/libdb-5.3.so
>>>>> No symbol table info available.
>>>>> #5 0x00007f1b433f7142 in __db_lget () from /lib64/libdb-5.3.so
>>>>> No symbol table info available.
>>>>> #6 0x00007f1b4333e605 in __bam_search () from /lib64/libdb-5.3.so
>>>>> No symbol table info available.
>>>>> #7 0x00007f1b43329256 in __bamc_search () from /lib64/libdb-5.3.so
>>>>> No symbol table info available.
>>>>> #8 0x00007f1b4332ad0f in __bamc_get () from /lib64/libdb-5.3.so
>>>>> No symbol table info available.
>>>>> #9 0x00007f1b433e3ca6 in __dbc_iget () from /lib64/libdb-5.3.so
>>>>> No symbol table info available.
>>>>> #10 0x00007f1b433f2b02 in __dbc_get_pp () from /lib64/libdb-5.3.so
>>>>> No symbol table info available.
>>>>> #11 0x00007f1b3e8ce680 in idl_new_fetch () from
>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>> No symbol table info available.
>>>>> #12 0x00007f1b3e8dcb26 in index_read_ext_allids () from
>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>> No symbol table info available.
>>>>> #13 0x00007f1b3e8c7284 in keys2idl () from
>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>> No symbol table info available.
>>>>> #14 0x00007f1b3e8c79e3 in ava_candidates.isra.0 () from
>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>> No symbol table info available.
>>>>> #15 0x00007f1b3e8c7fd2 in filter_candidates_ext () from
>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>> No symbol table info available.
>>>>> #16 0x00007f1b3e8c9096 in list_candidates () from
>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>> No symbol table info available.
>>>>> #17 0x00007f1b3e8c7f40 in filter_candidates_ext () from
>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>> No symbol table info available.
>>>>> #18 0x00007f1b3e8c9096 in list_candidates () from
>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>> No symbol table info available.
>>>>> #19 0x00007f1b3e8c7f40 in filter_candidates_ext () from
>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>> No symbol table info available.
>>>>> #20 0x00007f1b3e8c9096 in list_candidates () from
>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>> No symbol table info available.
>>>>> #21 0x00007f1b3e8c7f40 in filter_candidates_ext () from
>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>> No symbol table info available.
>>>>> #22 0x00007f1b3e90380c in subtree_candidates () from
>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>> No symbol table info available.
>>>>> #23 0x00007f1b3e904e7f in ldbm_back_search () from
>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>> No symbol table info available.
>>>>> #24 0x00007f1b4b2321d6 in op_shared_search () from
>>>>> /usr/lib64/dirsrv/libslapd.so.0
>>>>> No symbol table info available.
>>>>> #25 0x00007f1b4b72333e in do_search ()
>>>>> No symbol table info available.
>>>>> #26 0x00007f1b4b7113c3 in connection_threadmain ()
>>>>> No symbol table info available.
>>>>> #27 0x00007f1b494207bb in _pt_root () from /lib64/libnspr4.so
>>>>> No symbol table info available.
>>>>> #28 0x00007f1b48dc1dc5 in start_thread () from /lib64/libpthread.so.0
>>>>> No symbol table info available.
>>>>> #29 0x00007f1b48aef28d in clone () from /lib64/libc.so.6
>>>>> No symbol table info available.
>>>>>
>>>>> Thread 12 (Thread 0x7f1b1752d700 (LWP 105172)):
>>>>> #0 0x00007f1b48dc56d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>>>> No symbol table info available.
>>>>> #1 0x00007f1b4941b050 in PR_WaitCondVar () from /lib64/libnspr4.so
>>>>> No symbol table info available.
>>>>> #2 0x00007f1b4b70efee in connection_wait_for_new_work ()
>>>>> No symbol table info available.
>>>>> #3 0x00007f1b4b710719 in connection_threadmain ()
>>>>> No symbol table info available.
>>>>> #4 0x00007f1b494207bb in _pt_root () from /lib64/libnspr4.so
>>>>> No symbol table info available.
>>>>> #5 0x00007f1b48dc1dc5 in start_thread () from /lib64/libpthread.so.0
>>>>> No symbol table info available.
>>>>> #6 0x00007f1b48aef28d in clone () from /lib64/libc.so.6
>>>>> No symbol table info available.
>>>>>
>>>>> Thread 11 (Thread 0x7f1b17d2e700 (LWP 105171)):
>>>>> #0 0x00007f1b48dc56d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>>>> No symbol table info available.
>>>>> #1 0x00007f1b4941b050 in PR_WaitCondVar () from /lib64/libnspr4.so
>>>>> No symbol table info available.
>>>>> #2 0x00007f1b4b70efee in connection_wait_for_new_work ()
>>>>> No symbol table info available.
>>>>> #3 0x00007f1b4b710719 in connection_threadmain ()
>>>>> No symbol table info available.
>>>>> #4 0x00007f1b494207bb in _pt_root () from /lib64/libnspr4.so
>>>>> No symbol table info available.
>>>>> #5 0x00007f1b48dc1dc5 in start_thread () from /lib64/libpthread.so.0
>>>>> No symbol table info available.
>>>>> #6 0x00007f1b48aef28d in clone () from /lib64/libc.so.6
>>>>> No symbol table info available.
>>>>>
>>>>> Thread 10 (Thread 0x7f1b2509d700 (LWP 105168)):
>>>>> #0 0x00007f1b48dc5a82 in pthread_cond_timedwait@@GLIBC_2.3.2 () from
>>>>> /lib64/libpthread.so.0
>>>>> No symbol table info available.
>>>>> #1 0x00007f1b4941ab07 in pt_TimedWait () from /lib64/libnspr4.so
>>>>> No symbol table info available.
>>>>> #2 0x00007f1b4941afce in PR_WaitCondVar () from /lib64/libnspr4.so
>>>>> No symbol table info available.
>>>>> #3 0x00007f1b4b2061e8 in eq_loop () from
>>>>> /usr/lib64/dirsrv/libslapd.so.0
>>>>> No symbol table info available.
>>>>> #4 0x00007f1b494207bb in _pt_root () from /lib64/libnspr4.so
>>>>> No symbol table info available.
>>>>> #5 0x00007f1b48dc1dc5 in start_thread () from /lib64/libpthread.so.0
>>>>> No symbol table info available.
>>>>> #6 0x00007f1b48aef28d in clone () from /lib64/libc.so.6
>>>>> No symbol table info available.
>>>>>
>>>>> Thread 9 (Thread 0x7f1b2589e700 (LWP 105167)):
>>>>> #0 0x00007f1b48dc5a82 in pthread_cond_timedwait@@GLIBC_2.3.2 () from
>>>>> /lib64/libpthread.so.0
>>>>> No symbol table info available.
>>>>> #1 0x00007f1b4941ab07 in pt_TimedWait () from /lib64/libnspr4.so
>>>>> No symbol table info available.
>>>>> #2 0x00007f1b4941afce in PR_WaitCondVar () from /lib64/libnspr4.so
>>>>> No symbol table info available.
>>>>> #3 0x00007f1b4b719d03 in housecleaning ()
>>>>> No symbol table info available.
>>>>> #4 0x00007f1b494207bb in _pt_root () from /lib64/libnspr4.so
>>>>> No symbol table info available.
>>>>> #5 0x00007f1b48dc1dc5 in start_thread () from /lib64/libpthread.so.0
>>>>> No symbol table info available.
>>>>> #6 0x00007f1b48aef28d in clone () from /lib64/libc.so.6
>>>>> No symbol table info available.
>>>>>
>>>>> Thread 8 (Thread 0x7f1b2609f700 (LWP 105166)):
>>>>> #0 0x00007f1b48dc56d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>>>> No symbol table info available.
>>>>> #1 0x00007f1b4941b050 in PR_WaitCondVar () from /lib64/libnspr4.so
>>>>> No symbol table info available.
>>>>> #2 0x00007f1b4b260198 in slapi_wait_condvar () from
>>>>> /usr/lib64/dirsrv/libslapd.so.0
>>>>> No symbol table info available.
>>>>> #3 0x00007f1b3cf5deed in roles_cache_wait_on_change () from
>>>>> /usr/lib64/dirsrv/plugins/libroles-plugin.so
>>>>> No symbol table info available.
>>>>> #4 0x00007f1b494207bb in _pt_root () from /lib64/libnspr4.so
>>>>> No symbol table info available.
>>>>> #5 0x00007f1b48dc1dc5 in start_thread () from /lib64/libpthread.so.0
>>>>> No symbol table info available.
>>>>> #6 0x00007f1b48aef28d in clone () from /lib64/libc.so.6
>>>>> No symbol table info available.
>>>>>
>>>>> Thread 7 (Thread 0x7f1b268a0700 (LWP 105165)):
>>>>> #0 0x00007f1b48dc56d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>>>> No symbol table info available.
>>>>> #1 0x00007f1b4941b050 in PR_WaitCondVar () from /lib64/libnspr4.so
>>>>> No symbol table info available.
>>>>> #2 0x00007f1b4b260198 in slapi_wait_condvar () from
>>>>> /usr/lib64/dirsrv/libslapd.so.0
>>>>> No symbol table info available.
>>>>> #3 0x00007f1b3cf5deed in roles_cache_wait_on_change () from
>>>>> /usr/lib64/dirsrv/plugins/libroles-plugin.so
>>>>> No symbol table info available.
>>>>> #4 0x00007f1b494207bb in _pt_root () from /lib64/libnspr4.so
>>>>> No symbol table info available.
>>>>> #5 0x00007f1b48dc1dc5 in start_thread () from /lib64/libpthread.so.0
>>>>> No symbol table info available.
>>>>> #6 0x00007f1b48aef28d in clone () from /lib64/libc.so.6
>>>>> No symbol table info available.
>>>>>
>>>>> Thread 6 (Thread 0x7f1b270a1700 (LWP 105164)):
>>>>> #0 0x00007f1b48dc56d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>>>> No symbol table info available.
>>>>> #1 0x00007f1b4941b050 in PR_WaitCondVar () from /lib64/libnspr4.so
>>>>> No symbol table info available.
>>>>> #2 0x00007f1b4b260198 in slapi_wait_condvar () from
>>>>> /usr/lib64/dirsrv/libslapd.so.0
>>>>> No symbol table info available.
>>>>> #3 0x00007f1b3cf5deed in roles_cache_wait_on_change () from
>>>>> /usr/lib64/dirsrv/plugins/libroles-plugin.so
>>>>> No symbol table info available.
>>>>> #4 0x00007f1b494207bb in _pt_root () from /lib64/libnspr4.so
>>>>> No symbol table info available.
>>>>> #5 0x00007f1b48dc1dc5 in start_thread () from /lib64/libpthread.so.0
>>>>> No symbol table info available.
>>>>> #6 0x00007f1b48aef28d in clone () from /lib64/libc.so.6
>>>>> No symbol table info available.
>>>>>
>>>>> Thread 5 (Thread 0x7f1b278a2700 (LWP 105163)):
>>>>> #0 0x00007f1b48dc56d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>>>> No symbol table info available.
>>>>> #1 0x00007f1b4941b050 in PR_WaitCondVar () from /lib64/libnspr4.so
>>>>> No symbol table info available.
>>>>> #2 0x00007f1b4b260198 in slapi_wait_condvar () from
>>>>> /usr/lib64/dirsrv/libslapd.so.0
>>>>> No symbol table info available.
>>>>> #3 0x00007f1b415f262e in cos_cache_wait_on_change () from
>>>>> /usr/lib64/dirsrv/plugins/libcos-plugin.so
>>>>> No symbol table info available.
>>>>> #4 0x00007f1b494207bb in _pt_root () from /lib64/libnspr4.so
>>>>> No symbol table info available.
>>>>> #5 0x00007f1b48dc1dc5 in start_thread () from /lib64/libpthread.so.0
>>>>> No symbol table info available.
>>>>> #6 0x00007f1b48aef28d in clone () from /lib64/libc.so.6
>>>>> No symbol table info available.
>>>>>
>>>>> Thread 4 (Thread 0x7f1b282ac700 (LWP 105162)):
>>>>> #0 0x00007f1b48ae69b3 in select () from /lib64/libc.so.6
>>>>> No symbol table info available.
>>>>> #1 0x00007f1b4b2710e9 in DS_Sleep () from
>>>>> /usr/lib64/dirsrv/libslapd.so.0
>>>>> No symbol table info available.
>>>>> #2 0x00007f1b3e8ba707 in perf_threadmain () from
>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>> No symbol table info available.
>>>>> #3 0x00007f1b494207bb in _pt_root () from /lib64/libnspr4.so
>>>>> No symbol table info available.
>>>>> #4 0x00007f1b48dc1dc5 in start_thread () from /lib64/libpthread.so.0
>>>>> No symbol table info available.
>>>>> #5 0x00007f1b48aef28d in clone () from /lib64/libc.so.6
>>>>> No symbol table info available.
>>>>>
>>>>> Thread 3 (Thread 0x7f1b28aad700 (LWP 105161)):
>>>>> #0 0x00007f1b48ae69b3 in select () from /lib64/libc.so.6
>>>>> No symbol table info available.
>>>>> #1 0x00007f1b4b2710e9 in DS_Sleep () from
>>>>> /usr/lib64/dirsrv/libslapd.so.0
>>>>> No symbol table info available.
>>>>> #2 0x00007f1b3e8bfb7f in trickle_threadmain () from
>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>> No symbol table info available.
>>>>> #3 0x00007f1b494207bb in _pt_root () from /lib64/libnspr4.so
>>>>> No symbol table info available.
>>>>> #4 0x00007f1b48dc1dc5 in start_thread () from /lib64/libpthread.so.0
>>>>> No symbol table info available.
>>>>> #5 0x00007f1b48aef28d in clone () from /lib64/libc.so.6
>>>>> No symbol table info available.
>>>>>
>>>>> Thread 2 (Thread 0x7f1b292ae700 (LWP 105160)):
>>>>> #0 0x00007f1b48ae69b3 in select () from /lib64/libc.so.6
>>>>> No symbol table info available.
>>>>> #1 0x00007f1b4344dbad in __os_yield () from /lib64/libdb-5.3.so
>>>>> No symbol table info available.
>>>>> #2 0x00007f1b434492b3 in __memp_sync_int () from /lib64/libdb-5.3.so
>>>>> No symbol table info available.
>>>>> #3 0x00007f1b43459752 in __txn_checkpoint () from /lib64/libdb-5.3.so
>>>>> No symbol table info available.
>>>>> #4 0x00007f1b43459b74 in __txn_checkpoint_pp () from /lib64/
>>>>> libdb-5.3.so
>>>>> No symbol table info available.
>>>>> #5 0x00007f1b3e8c3a87 in checkpoint_threadmain () from
>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>> No symbol table info available.
>>>>> #6 0x00007f1b494207bb in _pt_root () from /lib64/libnspr4.so
>>>>> No symbol table info available.
>>>>> #7 0x00007f1b48dc1dc5 in start_thread () from /lib64/libpthread.so.0
>>>>> No symbol table info available.
>>>>> #8 0x00007f1b48aef28d in clone () from /lib64/libc.so.6
>>>>> No symbol table info available.
>>>>>
>>>>> Thread 1 (Thread 0x7f1b29aaf700 (LWP 105159)):
>>>>> #0 0x00007f1b48ae69b3 in select () from /lib64/libc.so.6
>>>>> No symbol table info available.
>>>>> #1 0x00007f1b4b2710e9 in DS_Sleep () from
>>>>> /usr/lib64/dirsrv/libslapd.so.0
>>>>> No symbol table info available.
>>>>> #2 0x00007f1b3e8bf907 in deadlock_threadmain () from
>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>> No symbol table info available.
>>>>> #3 0x00007f1b494207bb in _pt_root () from /lib64/libnspr4.so
>>>>> No symbol table info available.
>>>>> #4 0x00007f1b48dc1dc5 in start_thread () from /lib64/libpthread.so.0
>>>>> No symbol table info available.
>>>>> #5 0x00007f1b48aef28d in clone () from /lib64/libc.so.6
>>>>> No symbol table info available.
>>>>>
>>>>>
>>>>>
>>>>> Thanks,
>>>>>
>>>>> Rakesh
>>>>>
>>>>>
>>>>> On Mon, Sep 5, 2016 at 4:48 PM, thierry bordaz < <tbordaz at redhat.com>
>>>>> tbordaz at redhat.com> wrote:
>>>>>
>>>>>>
>>>>>>
>>>>>> On 09/05/2016 12:05 PM, Rakesh Rajasekharan wrote:
>>>>>>
>>>>>> Hi Thierry,
>>>>>>
>>>>>>
>>>>>> I was getting the hang issue while running ipa-client-install
>>>>>> simultaneously on few clients..
>>>>>> However, today, I am not able to replicate that.
>>>>>>
>>>>>> I could not get a gdb . But i will try getting that the next time I
>>>>>> face this issue.
>>>>>>
>>>>>> The CPU does not stay high.. it just momentarily touches a high value
>>>>>> and then drops down to around 2-7%
>>>>>>
>>>>>> One question I have is , is it ok to set it nsslapd-threadnumber to a
>>>>>> very high value .
>>>>>> I have around 4000 clients and with nsslapd-maxthreadsperconn set to
>>>>>> 5..So, can I set nsslapd-threadnumber to around 25000.
>>>>>>
>>>>>>
>>>>>> Hello,
>>>>>>
>>>>>> I know some users running in production with several hunderds of
>>>>>> threads (>600) and this without problem.
>>>>>>
>>>>>> I do not recall having suggested to increase that number and for what
>>>>>> reason.
>>>>>> Usually 30 workers is a good enough value. It can create bootleneck
>>>>>> if for some reason each operation is very long to satisfy and exhaust the
>>>>>> number of workers. You can monitor the work queue:
>>>>>>
>>>>>> ldapsearch -D "cn=directory manager" -w xxx -LLL -b "cn=monitor" -s
>>>>>> base opsinitiated opscompleted
>>>>>>
>>>>>>
>>>>>> If opscompleted-opsinitiated remains close to threadnumber, then yes
>>>>>> it would be valuable to increase it.
>>>>>>
>>>>>> The computation #client * #async_op_per_client sound an overkill.
>>>>>> Even if all clients send at the exact same time all their requests, it is
>>>>>> very likely that some common resource (db page, log, allocator...) will
>>>>>> serialize them. If you monitor a need to increase the work, you would for
>>>>>> example set it to 50, then monitor, then set it to 100, then monitor...
>>>>>> until you find a good enough value.
>>>>>> Note the increasing the #thread, increases the memory footprint that
>>>>>> will reduce the efficiency of file system cache and can increase the
>>>>>> response time.
>>>>>>
>>>>>>
>>>>>> best regards
>>>>>> thierry
>>>>>>
>>>>>>
>>>>>> Thanks
>>>>>>
>>>>>> On Mon, Sep 5, 2016 at 1:03 PM, thierry bordaz < <tbordaz at redhat.com>
>>>>>> tbordaz at redhat.com> wrote:
>>>>>>
>>>>>>>
>>>>>>> Hi Rakesh,
>>>>>>>
>>>>>>> Were you able to get a pstack or full stack with gdb (
>>>>>>> <http://www.port389.org/docs/>http://www.port389.org/docs/3
>>>>>>> 89ds/FAQ/faq.html#debugging-crashes) when the server hangs ?
>>>>>>>
>>>>>>> If it happens with 500 threads as well as with 30, using 30 threads
>>>>>>> is a better choice to debug this issue.
>>>>>>> I will try to reproduce using 150 parallel 'ipa user-find p-testipa'
>>>>>>> commands
>>>>>>>
>>>>>>> Something I am unsure is if the CPU consumption stays high (you
>>>>>>> mentioned 340% CPU usage) as long as the hang happens or if after a suddent
>>>>>>> shot up to 340% (that marks the beginning of the hang) it drops and stay
>>>>>>> hanging ?
>>>>>>>
>>>>>>> thanks
>>>>>>> thierry
>>>>>>>
>>>>>>> On 09/04/2016 08:40 PM, Rakesh Rajasekharan wrote:
>>>>>>>
>>>>>>> starce on the slapd process actually had this in the output..
>>>>>>> FUTEX_WAIT_PRIVATE
>>>>>>>
>>>>>>> and checking for the number of threads slapd had.. there were 5015
>>>>>>> threads
>>>>>>>
>>>>>>> ps -efL|grep slapd|wc -l
>>>>>>> 5015
>>>>>>>
>>>>>>> strace on most of the threads gave this output
>>>>>>>
>>>>>>> strace -p 67411
>>>>>>> Process 67411 attached
>>>>>>> futex(0x7f3f0226b41c, FUTEX_WAIT_PRIVATE, 1, NULL) = -1 EAGAIN
>>>>>>> (Resource temporarily unavailable)
>>>>>>> futex(0x7f3f0226b41c, FUTEX_WAIT_PRIVATE, 2, NULL^CProcess 67411
>>>>>>> detached
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> On Sun, Sep 4, 2016 at 5:34 PM, Rakesh Rajasekharan <
>>>>>>> <rakesh.rajasekharan at gmail.com>rakesh.rajasekharan at gmail.com> wrote:
>>>>>>>
>>>>>>>> I have again got the issue of IPA hanging.. The issue came up when
>>>>>>>> i tried to run ipa-client-isntall on 142 clients simultaneously
>>>>>>>>
>>>>>>>>
>>>>>>>> None of the IPA commands are responding, and I see this error
>>>>>>>>
>>>>>>>> ipa user-find p-testipa
>>>>>>>> ipa: ERROR: Insufficient access: SASL(-1): generic failure: GSSAPI
>>>>>>>> Error: Unspecified GSS failure. Minor code may provide more information
>>>>>>>> (KDC returned error string: PROCESS_TGS)
>>>>>>>>
>>>>>>>> KRB5_TRACE=/dev/stdout kinit admin
>>>>>>>> [41178] 1472984115.233214: Getting initial credentials for
>>>>>>>> <admin at XYZ.COM>admin at XYZ.COM
>>>>>>>> [41178] 1472984115.235257: Sending request (167 bytes) to XYZ.COM
>>>>>>>> [41178] 1472984115.235419: Initiating TCP connection to stream
>>>>>>>> 10.1.3.36:88
>>>>>>>> [41178] 1472984115.235685: Sending TCP request to stream
>>>>>>>> 10.1.3.36:88
>>>>>>>> [41178] 1472984120.238914: Received answer (174 bytes) from stream
>>>>>>>> 10.1.3.36:88
>>>>>>>> [41178] 1472984120.238925: Terminating TCP connection to stream
>>>>>>>> 10.1.3.36:88
>>>>>>>> [41178] 1472984120.238993: Response was from master KDC
>>>>>>>> [41
>>>>>>>>
>>>>>>>>
>>>>>>>> Running an ldapsearch to see the db.. does not give any results and
>>>>>>>> just hangs there
>>>>>>>>
>>>>>>>> ldapsearch -x -D 'cn=Directory Manager' -W -s one -b
>>>>>>>> 'cn=kerberos,dc=xyz,dc=com'
>>>>>>>> Enter LDAP Password:
>>>>>>>>
>>>>>>>> even an ldapsearch -x does not respond
>>>>>>>> At this point, am sure that slapd is the one causing issues
>>>>>>>>
>>>>>>>> Running an strace against the hung slapd itself seems to get stuck
>>>>>>>> does not proceed after saying "attaching to process"
>>>>>>>>
>>>>>>>> From some others posts I read Thierry suggesting to increase the
>>>>>>>> nsslapd-threadnumber value
>>>>>>>>
>>>>>>>> It was set to 30, I think that might be too low.
>>>>>>>>
>>>>>>> ...
>>>>>
>>>>> [Message clipped]
>>>>
>>>>
>>>>
>>>
>>>
>>> --
>>> Red Hat GmbH, http://www.de.redhat.com/, Registered seat: Grasbrunn,
>>> Commercial register: Amtsgericht Muenchen, HRB 153243,
>>> Managing Directors: Charles Cachera, Michael Cunningham, Michael O'Neill, Eric Shander
>>>
>>>
>>
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://listman.redhat.com/archives/freeipa-users/attachments/20160916/61101fe9/attachment.htm>
More information about the Freeipa-users
mailing list