[Freeipa-users] Freeipa 4.2.0 hangs intermittently

Rob Crittenden rcritten at redhat.com
Wed Sep 7 20:16:14 UTC 2016


Rakesh Rajasekharan wrote:
> I feel since I migrated from my earlier openldap.. There might be some
> issues with the indexes.. So may be creating fresh users might help..
> Is there a way to  read clear text user password..  That way I could
> have just recreated the users and set them the older password...

Migrated users are added one-by-one in pretty much the same way that ipa 
user-add works so there shouldn't be any issues with the indexes, at 
least not due to the migration.

There is no way to retrieve the cleartext password.

rob

>
> Just trying what ever I could think of to fix this :)
>
>
> On Sep 7, 2016 5:16 PM, "Rakesh Rajasekharan"
> <rakesh.rajasekharan at gmail.com <mailto:rakesh.rajasekharan at gmail.com>>
> wrote:
>
>     I changed the nsslapd-db-checkpoint interval first to 80 and
>     increased till 160.. however the hang has not gone away yet
>
>
>     I migrated my data from a openldap, can that cause issues like
>     this.. If so, i could try creating users from scratch directly on
>     IPA rather than migrating and test it
>
>     But before that , have taken a fresh pstack just incase if it helps
>     to nail down the issue
>
>     Thread 44 (Thread 0x7f53ed52f700 (LWP 128165)):
>     #0  0x00007f54047649b3 in select () from /lib64/libc.so.6
>     #1  0x00007f5406eef0e9 in DS_Sleep () from
>     /usr/lib64/dirsrv/libslapd.so.0
>     #2  0x00007f53fa53d907 in deadlock_threadmain () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #3  0x00007f540509e7bb in _pt_root () from /lib64/libnspr4.so
>     #4  0x00007f5404a3fdc5 in start_thread () from /lib64/libpthread.so.0
>     #5  0x00007f540476d28d in clone () from /lib64/libc.so.6
>     Thread 43 (Thread 0x7f53ecd2e700 (LWP 128166)):
>     #0  0x00007f54047649b3 in select () from /lib64/libc.so.6
>     #1  0x00007f53ff0cbbad in __os_yield () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #2  0x00007f53ff0c72b3 in __memp_sync_int () from
>     /lib64/libdb-5.3.so <http://libdb-5.3.so>
>     #3  0x00007f53ff0d7752 in __txn_checkpoint () from
>     /lib64/libdb-5.3.so <http://libdb-5.3.so>
>     #4  0x00007f53ff0d7b74 in __txn_checkpoint_pp () from
>     /lib64/libdb-5.3.so <http://libdb-5.3.so>
>     #5  0x00007f53fa541a87 in checkpoint_threadmain () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #6  0x00007f540509e7bb in _pt_root () from /lib64/libnspr4.so
>     #7  0x00007f5404a3fdc5 in start_thread () from /lib64/libpthread.so.0
>     #8  0x00007f540476d28d in clone () from /lib64/libc.so.6
>     Thread 42 (Thread 0x7f53ec52d700 (LWP 128167)):
>     #0  0x00007f54047649b3 in select () from /lib64/libc.so.6
>     #1  0x00007f5406eef0e9 in DS_Sleep () from
>     /usr/lib64/dirsrv/libslapd.so.0
>     #2  0x00007f53fa53db7f in trickle_threadmain () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #3  0x00007f540509e7bb in _pt_root () from /lib64/libnspr4.so
>     #4  0x00007f5404a3fdc5 in start_thread () from /lib64/libpthread.so.0
>     #5  0x00007f540476d28d in clone () from /lib64/libc.so.6
>     Thread 41 (Thread 0x7f53ebd2c700 (LWP 128168)):
>     #0  0x00007f54047649b3 in select () from /lib64/libc.so.6
>     #1  0x00007f5406eef0e9 in DS_Sleep () from
>     /usr/lib64/dirsrv/libslapd.so.0
>     #2  0x00007f53fa538707 in perf_threadmain () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #3  0x00007f540509e7bb in _pt_root () from /lib64/libnspr4.so
>     #4  0x00007f5404a3fdc5 in start_thread () from /lib64/libpthread.so.0
>     #5  0x00007f540476d28d in clone () from /lib64/libc.so.6
>     Thread 40 (Thread 0x7f53eb322700 (LWP 128204)):
>     #0  0x00007f5404a436d5 in pthread_cond_wait@@GLIBC_2.3.2 () from
>     /lib64/libpthread.so.0
>     #1  0x00007f5405099050 in PR_WaitCondVar () from /lib64/libnspr4.so
>     #2  0x00007f5406ede198 in slapi_wait_condvar () from
>     /usr/lib64/dirsrv/libslapd.so.0
>     #3  0x00007f53fd27062e in cos_cache_wait_on_change () from
>     /usr/lib64/dirsrv/plugins/libcos-plugin.so
>     #4  0x00007f540509e7bb in _pt_root () from /lib64/libnspr4.so
>     #5  0x00007f5404a3fdc5 in start_thread () from /lib64/libpthread.so.0
>     #6  0x00007f540476d28d in clone () from /lib64/libc.so.6
>     Thread 39 (Thread 0x7f53eab21700 (LWP 128206)):
>     #0  0x00007f5404a436d5 in pthread_cond_wait@@GLIBC_2.3.2 () from
>     /lib64/libpthread.so.0
>     #1  0x00007f5405099050 in PR_WaitCondVar () from /lib64/libnspr4.so
>     #2  0x00007f5406ede198 in slapi_wait_condvar () from
>     /usr/lib64/dirsrv/libslapd.so.0
>     #3  0x00007f53f8bdbeed in roles_cache_wait_on_change () from
>     /usr/lib64/dirsrv/plugins/libroles-plugin.so
>     #4  0x00007f540509e7bb in _pt_root () from /lib64/libnspr4.so
>     #5  0x00007f5404a3fdc5 in start_thread () from /lib64/libpthread.so.0
>     #6  0x00007f540476d28d in clone () from /lib64/libc.so.6
>     Thread 38 (Thread 0x7f53ea320700 (LWP 128207)):
>     #0  0x00007f5404a436d5 in pthread_cond_wait@@GLIBC_2.3.2 () from
>     /lib64/libpthread.so.0
>     #1  0x00007f5405099050 in PR_WaitCondVar () from /lib64/libnspr4.so
>     #2  0x00007f5406ede198 in slapi_wait_condvar () from
>     /usr/lib64/dirsrv/libslapd.so.0
>     #3  0x00007f53f8bdbeed in roles_cache_wait_on_change () from
>     /usr/lib64/dirsrv/plugins/libroles-plugin.so
>     #4  0x00007f540509e7bb in _pt_root () from /lib64/libnspr4.so
>     #5  0x00007f5404a3fdc5 in start_thread () from /lib64/libpthread.so.0
>     #6  0x00007f540476d28d in clone () from /lib64/libc.so.6
>     Thread 37 (Thread 0x7f53e9b1f700 (LWP 128208)):
>     #0  0x00007f5404a436d5 in pthread_cond_wait@@GLIBC_2.3.2 () from
>     /lib64/libpthread.so.0
>     #1  0x00007f5405099050 in PR_WaitCondVar () from /lib64/libnspr4.so
>     #2  0x00007f5406ede198 in slapi_wait_condvar () from
>     /usr/lib64/dirsrv/libslapd.so.0
>     #3  0x00007f53f8bdbeed in roles_cache_wait_on_change () from
>     /usr/lib64/dirsrv/plugins/libroles-plugin.so
>     #4  0x00007f540509e7bb in _pt_root () from /lib64/libnspr4.so
>     #5  0x00007f5404a3fdc5 in start_thread () from /lib64/libpthread.so.0
>     #6  0x00007f540476d28d in clone () from /lib64/libc.so.6
>     Thread 36 (Thread 0x7f53e931e700 (LWP 128209)):
>     #0  0x00007f5404a43a82 in pthread_cond_timedwait@@GLIBC_2.3.2 ()
>     from /lib64/libpthread.so.0
>     #1  0x00007f5405098b07 in pt_TimedWait () from /lib64/libnspr4.so
>     #2  0x00007f5405098fce in PR_WaitCondVar () from /lib64/libnspr4.so
>     #3  0x00007f5407397d03 in housecleaning ()
>     #4  0x00007f540509e7bb in _pt_root () from /lib64/libnspr4.so
>     #5  0x00007f5404a3fdc5 in start_thread () from /lib64/libpthread.so.0
>     #6  0x00007f540476d28d in clone () from /lib64/libc.so.6
>     Thread 35 (Thread 0x7f53e8b1d700 (LWP 128210)):
>     #0  0x00007f5404a43a82 in pthread_cond_timedwait@@GLIBC_2.3.2 ()
>     from /lib64/libpthread.so.0
>     #1  0x00007f5405098b07 in pt_TimedWait () from /lib64/libnspr4.so
>     #2  0x00007f5405098fce in PR_WaitCondVar () from /lib64/libnspr4.so
>     #3  0x00007f5406e841e8 in eq_loop () from
>     /usr/lib64/dirsrv/libslapd.so.0
>     #4  0x00007f540509e7bb in _pt_root () from /lib64/libnspr4.so
>     #5  0x00007f5404a3fdc5 in start_thread () from /lib64/libpthread.so.0
>     #6  0x00007f540476d28d in clone () from /lib64/libc.so.6
>     Thread 34 (Thread 0x7f53db7fe700 (LWP 128212)):
>     #0  0x00007f5404a436d5 in pthread_cond_wait@@GLIBC_2.3.2 () from
>     /lib64/libpthread.so.0
>     #1  0x00007f53fef9f2f3 in __db_hybrid_mutex_suspend () from
>     /lib64/libdb-5.3.so <http://libdb-5.3.so>
>     #2  0x00007f53fef9e640 in __db_tas_mutex_lock () from
>     /lib64/libdb-5.3.so <http://libdb-5.3.so>
>     #3  0x00007f53ff048d3a in __lock_get_internal () from
>     /lib64/libdb-5.3.so <http://libdb-5.3.so>
>     #4  0x00007f53ff049820 in __lock_get () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #5  0x00007f53ff075142 in __db_lget () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #6  0x00007f53fefbc605 in __bam_search () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #7  0x00007f53fefa7256 in __bamc_search () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #8  0x00007f53fefa8d0f in __bamc_get () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #9  0x00007f53ff061ca6 in __dbc_iget () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #10 0x00007f53ff070b02 in __dbc_get_pp () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #11 0x00007f53fa54c680 in idl_new_fetch () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #12 0x00007f53fa55ab26 in index_read_ext_allids () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #13 0x00007f53fa545284 in keys2idl () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #14 0x00007f53fa5459e3 in ava_candidates.isra.0 () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #15 0x00007f53fa545fd2 in filter_candidates_ext () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #16 0x00007f53fa547096 in list_candidates () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #17 0x00007f53fa545f40 in filter_candidates_ext () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #18 0x00007f53fa58180c in subtree_candidates () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #19 0x00007f53fa582e7f in ldbm_back_search () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #20 0x00007f5406eb01d6 in op_shared_search () from
>     /usr/lib64/dirsrv/libslapd.so.0
>     #21 0x00007f54073a133e in do_search ()
>     #22 0x00007f540738f567 in connection_threadmain ()
>     #23 0x00007f540509e7bb in _pt_root () from /lib64/libnspr4.so
>     #24 0x00007f5404a3fdc5 in start_thread () from /lib64/libpthread.so.0
>     #25 0x00007f540476d28d in clone () from /lib64/libc.so.6
>     Thread 33 (Thread 0x7f53daffd700 (LWP 128213)):
>     #0  0x00007f5404a436d5 in pthread_cond_wait@@GLIBC_2.3.2 () from
>     /lib64/libpthread.so.0
>     #1  0x00007f53fef9f2f3 in __db_hybrid_mutex_suspend () from
>     /lib64/libdb-5.3.so <http://libdb-5.3.so>
>     #2  0x00007f53fef9e640 in __db_tas_mutex_lock () from
>     /lib64/libdb-5.3.so <http://libdb-5.3.so>
>     #3  0x00007f53ff048d3a in __lock_get_internal () from
>     /lib64/libdb-5.3.so <http://libdb-5.3.so>
>     #4  0x00007f53ff049820 in __lock_get () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #5  0x00007f53ff075142 in __db_lget () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #6  0x00007f53fefbc605 in __bam_search () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #7  0x00007f53fefa7256 in __bamc_search () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #8  0x00007f53fefa8d0f in __bamc_get () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #9  0x00007f53ff061ca6 in __dbc_iget () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #10 0x00007f53ff070b02 in __dbc_get_pp () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #11 0x00007f53fa54c680 in idl_new_fetch () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #12 0x00007f53fa55ab26 in index_read_ext_allids () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #13 0x00007f53fa545284 in keys2idl () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #14 0x00007f53fa5459e3 in ava_candidates.isra.0 () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #15 0x00007f53fa545fd2 in filter_candidates_ext () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #16 0x00007f53fa547096 in list_candidates () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #17 0x00007f53fa545f40 in filter_candidates_ext () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #18 0x00007f53fa58180c in subtree_candidates () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #19 0x00007f53fa582e7f in ldbm_back_search () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #20 0x00007f5406eb01d6 in op_shared_search () from
>     /usr/lib64/dirsrv/libslapd.so.0
>     #21 0x00007f54073a133e in do_search ()
>     #22 0x00007f540738f567 in connection_threadmain ()
>     #23 0x00007f540509e7bb in _pt_root () from /lib64/libnspr4.so
>     #24 0x00007f5404a3fdc5 in start_thread () from /lib64/libpthread.so.0
>     #25 0x00007f540476d28d in clone () from /lib64/libc.so.6
>     Thread 32 (Thread 0x7f53da7fc700 (LWP 128214)):
>     #0  0x00007f5404a436d5 in pthread_cond_wait@@GLIBC_2.3.2 () from
>     /lib64/libpthread.so.0
>     #1  0x00007f53fef9f2f3 in __db_hybrid_mutex_suspend () from
>     /lib64/libdb-5.3.so <http://libdb-5.3.so>
>     #2  0x00007f53fef9e640 in __db_tas_mutex_lock () from
>     /lib64/libdb-5.3.so <http://libdb-5.3.so>
>     #3  0x00007f53ff048d3a in __lock_get_internal () from
>     /lib64/libdb-5.3.so <http://libdb-5.3.so>
>     #4  0x00007f53ff049820 in __lock_get () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #5  0x00007f53ff075142 in __db_lget () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #6  0x00007f53fefbc605 in __bam_search () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #7  0x00007f53fefa7256 in __bamc_search () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #8  0x00007f53fefa8d0f in __bamc_get () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #9  0x00007f53ff061ca6 in __dbc_iget () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #10 0x00007f53ff070b02 in __dbc_get_pp () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #11 0x00007f53fa54c680 in idl_new_fetch () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #12 0x00007f53fa55ab26 in index_read_ext_allids () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #13 0x00007f53fa545284 in keys2idl () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #14 0x00007f53fa5459e3 in ava_candidates.isra.0 () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #15 0x00007f53fa545fd2 in filter_candidates_ext () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #16 0x00007f53fa547096 in list_candidates () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #17 0x00007f53fa545f40 in filter_candidates_ext () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #18 0x00007f53fa547096 in list_candidates () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #19 0x00007f53fa545f40 in filter_candidates_ext () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #20 0x00007f53fa547096 in list_candidates () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #21 0x00007f53fa545f40 in filter_candidates_ext () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #22 0x00007f53fa58180c in subtree_candidates () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #23 0x00007f53fa582e7f in ldbm_back_search () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #24 0x00007f5406eb01d6 in op_shared_search () from
>     /usr/lib64/dirsrv/libslapd.so.0
>     #25 0x00007f54073a133e in do_search ()
>     #26 0x00007f540738f3c3 in connection_threadmain ()
>     #27 0x00007f540509e7bb in _pt_root () from /lib64/libnspr4.so
>     #28 0x00007f5404a3fdc5 in start_thread () from /lib64/libpthread.so.0
>     #29 0x00007f540476d28d in clone () from /lib64/libc.so.6
>     Thread 31 (Thread 0x7f53d9ffb700 (LWP 128215)):
>     #0  0x00007f5404a436d5 in pthread_cond_wait@@GLIBC_2.3.2 () from
>     /lib64/libpthread.so.0
>     #1  0x00007f53fef9f2f3 in __db_hybrid_mutex_suspend () from
>     /lib64/libdb-5.3.so <http://libdb-5.3.so>
>     #2  0x00007f53fef9e640 in __db_tas_mutex_lock () from
>     /lib64/libdb-5.3.so <http://libdb-5.3.so>
>     #3  0x00007f53ff048d3a in __lock_get_internal () from
>     /lib64/libdb-5.3.so <http://libdb-5.3.so>
>     #4  0x00007f53ff049820 in __lock_get () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #5  0x00007f53ff075142 in __db_lget () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #6  0x00007f53fefbc605 in __bam_search () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #7  0x00007f53fefa7256 in __bamc_search () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #8  0x00007f53fefa8d0f in __bamc_get () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #9  0x00007f53ff061ca6 in __dbc_iget () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #10 0x00007f53ff070b02 in __dbc_get_pp () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #11 0x00007f53fa54c680 in idl_new_fetch () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #12 0x00007f53fa55ab26 in index_read_ext_allids () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #13 0x00007f53fa545284 in keys2idl () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #14 0x00007f53fa5459e3 in ava_candidates.isra.0 () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #15 0x00007f53fa545fd2 in filter_candidates_ext () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #16 0x00007f53fa547096 in list_candidates () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #17 0x00007f53fa545f40 in filter_candidates_ext () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #18 0x00007f53fa58180c in subtree_candidates () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #19 0x00007f53fa582e7f in ldbm_back_search () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #20 0x00007f5406eb01d6 in op_shared_search () from
>     /usr/lib64/dirsrv/libslapd.so.0
>     #21 0x00007f54073a133e in do_search ()
>     #22 0x00007f540738f567 in connection_threadmain ()
>     #23 0x00007f540509e7bb in _pt_root () from /lib64/libnspr4.so
>     #24 0x00007f5404a3fdc5 in start_thread () from /lib64/libpthread.so.0
>     #25 0x00007f540476d28d in clone () from /lib64/libc.so.6
>     Thread 30 (Thread 0x7f53d97fa700 (LWP 128216)):
>     #0  0x00007f5404a436d5 in pthread_cond_wait@@GLIBC_2.3.2 () from
>     /lib64/libpthread.so.0
>     #1  0x00007f53fef9f2f3 in __db_hybrid_mutex_suspend () from
>     /lib64/libdb-5.3.so <http://libdb-5.3.so>
>     #2  0x00007f53fef9e640 in __db_tas_mutex_lock () from
>     /lib64/libdb-5.3.so <http://libdb-5.3.so>
>     #3  0x00007f53ff048d3a in __lock_get_internal () from
>     /lib64/libdb-5.3.so <http://libdb-5.3.so>
>     #4  0x00007f53ff049820 in __lock_get () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #5  0x00007f53ff075142 in __db_lget () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #6  0x00007f53fefbc605 in __bam_search () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #7  0x00007f53fefa7256 in __bamc_search () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #8  0x00007f53fefa8d0f in __bamc_get () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #9  0x00007f53ff061ca6 in __dbc_iget () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #10 0x00007f53ff070b02 in __dbc_get_pp () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #11 0x00007f53fa54c680 in idl_new_fetch () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #12 0x00007f53fa55ab26 in index_read_ext_allids () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #13 0x00007f53fa545284 in keys2idl () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #14 0x00007f53fa5459e3 in ava_candidates.isra.0 () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #15 0x00007f53fa545fd2 in filter_candidates_ext () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #16 0x00007f53fa547096 in list_candidates () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #17 0x00007f53fa545f40 in filter_candidates_ext () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #18 0x00007f53fa58180c in subtree_candidates () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #19 0x00007f53fa582e7f in ldbm_back_search () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #20 0x00007f5406eb01d6 in op_shared_search () from
>     /usr/lib64/dirsrv/libslapd.so.0
>     #21 0x00007f54073a133e in do_search ()
>     #22 0x00007f540738f567 in connection_threadmain ()
>     #23 0x00007f540509e7bb in _pt_root () from /lib64/libnspr4.so
>     #24 0x00007f5404a3fdc5 in start_thread () from /lib64/libpthread.so.0
>     #25 0x00007f540476d28d in clone () from /lib64/libc.so.6
>     Thread 29 (Thread 0x7f53d8ff9700 (LWP 128217)):
>     #0  0x00007f5404a436d5 in pthread_cond_wait@@GLIBC_2.3.2 () from
>     /lib64/libpthread.so.0
>     #1  0x00007f53fef9f2f3 in __db_hybrid_mutex_suspend () from
>     /lib64/libdb-5.3.so <http://libdb-5.3.so>
>     #2  0x00007f53fef9e640 in __db_tas_mutex_lock () from
>     /lib64/libdb-5.3.so <http://libdb-5.3.so>
>     #3  0x00007f53ff048d3a in __lock_get_internal () from
>     /lib64/libdb-5.3.so <http://libdb-5.3.so>
>     #4  0x00007f53ff049820 in __lock_get () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #5  0x00007f53ff075142 in __db_lget () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #6  0x00007f53fefbc605 in __bam_search () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #7  0x00007f53fefa7256 in __bamc_search () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #8  0x00007f53fefa8d0f in __bamc_get () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #9  0x00007f53ff061ca6 in __dbc_iget () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #10 0x00007f53ff070b02 in __dbc_get_pp () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #11 0x00007f53fa54c680 in idl_new_fetch () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #12 0x00007f53fa55ab26 in index_read_ext_allids () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #13 0x00007f53fa545284 in keys2idl () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #14 0x00007f53fa5459e3 in ava_candidates.isra.0 () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #15 0x00007f53fa545fd2 in filter_candidates_ext () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #16 0x00007f53fa547096 in list_candidates () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #17 0x00007f53fa545f40 in filter_candidates_ext () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #18 0x00007f53fa58180c in subtree_candidates () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #19 0x00007f53fa582e7f in ldbm_back_search () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #20 0x00007f5406eb01d6 in op_shared_search () from
>     /usr/lib64/dirsrv/libslapd.so.0
>     #21 0x00007f54073a133e in do_search ()
>     #22 0x00007f540738f567 in connection_threadmain ()
>     #23 0x00007f540509e7bb in _pt_root () from /lib64/libnspr4.so
>     #24 0x00007f5404a3fdc5 in start_thread () from /lib64/libpthread.so.0
>     #25 0x00007f540476d28d in clone () from /lib64/libc.so.6
>     Thread 28 (Thread 0x7f53d87f8700 (LWP 128218)):
>     #0  0x00007f5404a436d5 in pthread_cond_wait@@GLIBC_2.3.2 () from
>     /lib64/libpthread.so.0
>     #1  0x00007f53fef9f2f3 in __db_hybrid_mutex_suspend () from
>     /lib64/libdb-5.3.so <http://libdb-5.3.so>
>     #2  0x00007f53fef9e640 in __db_tas_mutex_lock () from
>     /lib64/libdb-5.3.so <http://libdb-5.3.so>
>     #3  0x00007f53ff048d3a in __lock_get_internal () from
>     /lib64/libdb-5.3.so <http://libdb-5.3.so>
>     #4  0x00007f53ff049820 in __lock_get () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #5  0x00007f53ff075142 in __db_lget () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #6  0x00007f53fefbc605 in __bam_search () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #7  0x00007f53fefa7256 in __bamc_search () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #8  0x00007f53fefa8d0f in __bamc_get () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #9  0x00007f53ff061ca6 in __dbc_iget () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #10 0x00007f53ff070b02 in __dbc_get_pp () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #11 0x00007f53fa54c680 in idl_new_fetch () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #12 0x00007f53fa55ab26 in index_read_ext_allids () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #13 0x00007f53fa545284 in keys2idl () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #14 0x00007f53fa5459e3 in ava_candidates.isra.0 () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #15 0x00007f53fa545fd2 in filter_candidates_ext () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #16 0x00007f53fa547096 in list_candidates () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #17 0x00007f53fa545f40 in filter_candidates_ext () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #18 0x00007f53fa58180c in subtree_candidates () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #19 0x00007f53fa582e7f in ldbm_back_search () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #20 0x00007f5406eb01d6 in op_shared_search () from
>     /usr/lib64/dirsrv/libslapd.so.0
>     #21 0x00007f54073a133e in do_search ()
>     #22 0x00007f540738f567 in connection_threadmain ()
>     #23 0x00007f540509e7bb in _pt_root () from /lib64/libnspr4.so
>     #24 0x00007f5404a3fdc5 in start_thread () from /lib64/libpthread.so.0
>     #25 0x00007f540476d28d in clone () from /lib64/libc.so.6
>     Thread 27 (Thread 0x7f53d7ff7700 (LWP 128219)):
>     #0  0x00007f5404a436d5 in pthread_cond_wait@@GLIBC_2.3.2 () from
>     /lib64/libpthread.so.0
>     #1  0x00007f53fef9f2f3 in __db_hybrid_mutex_suspend () from
>     /lib64/libdb-5.3.so <http://libdb-5.3.so>
>     #2  0x00007f53fef9e640 in __db_tas_mutex_lock () from
>     /lib64/libdb-5.3.so <http://libdb-5.3.so>
>     #3  0x00007f53ff048d3a in __lock_get_internal () from
>     /lib64/libdb-5.3.so <http://libdb-5.3.so>
>     #4  0x00007f53ff049820 in __lock_get () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #5  0x00007f53ff075142 in __db_lget () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #6  0x00007f53fefbc605 in __bam_search () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #7  0x00007f53fefa7256 in __bamc_search () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #8  0x00007f53fefa8d0f in __bamc_get () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #9  0x00007f53ff061ca6 in __dbc_iget () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #10 0x00007f53ff070b02 in __dbc_get_pp () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #11 0x00007f53fa54c680 in idl_new_fetch () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #12 0x00007f53fa55ab26 in index_read_ext_allids () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #13 0x00007f53fa545284 in keys2idl () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #14 0x00007f53fa5459e3 in ava_candidates.isra.0 () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #15 0x00007f53fa545fd2 in filter_candidates_ext () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #16 0x00007f53fa547096 in list_candidates () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #17 0x00007f53fa545f40 in filter_candidates_ext () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #18 0x00007f53fa58180c in subtree_candidates () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #19 0x00007f53fa582e7f in ldbm_back_search () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #20 0x00007f5406eb01d6 in op_shared_search () from
>     /usr/lib64/dirsrv/libslapd.so.0
>     #21 0x00007f54073a133e in do_search ()
>     #22 0x00007f540738f567 in connection_threadmain ()
>     #23 0x00007f540509e7bb in _pt_root () from /lib64/libnspr4.so
>     #24 0x00007f5404a3fdc5 in start_thread () from /lib64/libpthread.so.0
>     #25 0x00007f540476d28d in clone () from /lib64/libc.so.6
>     Thread 26 (Thread 0x7f53d77f6700 (LWP 128220)):
>     #0  0x00007f5404a436d5 in pthread_cond_wait@@GLIBC_2.3.2 () from
>     /lib64/libpthread.so.0
>     #1  0x00007f53fef9f2f3 in __db_hybrid_mutex_suspend () from
>     /lib64/libdb-5.3.so <http://libdb-5.3.so>
>     #2  0x00007f53fef9e640 in __db_tas_mutex_lock () from
>     /lib64/libdb-5.3.so <http://libdb-5.3.so>
>     #3  0x00007f53ff048d3a in __lock_get_internal () from
>     /lib64/libdb-5.3.so <http://libdb-5.3.so>
>     #4  0x00007f53ff049820 in __lock_get () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #5  0x00007f53ff075142 in __db_lget () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #6  0x00007f53fefbc605 in __bam_search () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #7  0x00007f53fefa7256 in __bamc_search () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #8  0x00007f53fefa8d0f in __bamc_get () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #9  0x00007f53ff061ca6 in __dbc_iget () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #10 0x00007f53ff070b02 in __dbc_get_pp () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #11 0x00007f53fa54c680 in idl_new_fetch () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #12 0x00007f53fa55ab26 in index_read_ext_allids () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #13 0x00007f53fa545284 in keys2idl () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #14 0x00007f53fa5459e3 in ava_candidates.isra.0 () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #15 0x00007f53fa545fd2 in filter_candidates_ext () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #16 0x00007f53fa547096 in list_candidates () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #17 0x00007f53fa545f40 in filter_candidates_ext () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #18 0x00007f53fa58180c in subtree_candidates () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #19 0x00007f53fa582e7f in ldbm_back_search () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #20 0x00007f5406eb01d6 in op_shared_search () from
>     /usr/lib64/dirsrv/libslapd.so.0
>     #21 0x00007f54073a133e in do_search ()
>     #22 0x00007f540738f567 in connection_threadmain ()
>     #23 0x00007f540509e7bb in _pt_root () from /lib64/libnspr4.so
>     #24 0x00007f5404a3fdc5 in start_thread () from /lib64/libpthread.so.0
>     #25 0x00007f540476d28d in clone () from /lib64/libc.so.6
>     Thread 25 (Thread 0x7f53d6ff5700 (LWP 128221)):
>     #0  0x00007f5404a436d5 in pthread_cond_wait@@GLIBC_2.3.2 () from
>     /lib64/libpthread.so.0
>     #1  0x00007f53fef9f2f3 in __db_hybrid_mutex_suspend () from
>     /lib64/libdb-5.3.so <http://libdb-5.3.so>
>     #2  0x00007f53fef9e640 in __db_tas_mutex_lock () from
>     /lib64/libdb-5.3.so <http://libdb-5.3.so>
>     #3  0x00007f53ff048d3a in __lock_get_internal () from
>     /lib64/libdb-5.3.so <http://libdb-5.3.so>
>     #4  0x00007f53ff049820 in __lock_get () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #5  0x00007f53ff075142 in __db_lget () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #6  0x00007f53fefbc605 in __bam_search () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #7  0x00007f53fefa7256 in __bamc_search () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #8  0x00007f53fefa8d0f in __bamc_get () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #9  0x00007f53ff061ca6 in __dbc_iget () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #10 0x00007f53ff070b02 in __dbc_get_pp () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #11 0x00007f53fa54c680 in idl_new_fetch () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #12 0x00007f53fa55ab26 in index_read_ext_allids () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #13 0x00007f53fa545284 in keys2idl () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #14 0x00007f53fa5459e3 in ava_candidates.isra.0 () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #15 0x00007f53fa545fd2 in filter_candidates_ext () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #16 0x00007f53fa547096 in list_candidates () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #17 0x00007f53fa545f40 in filter_candidates_ext () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #18 0x00007f53fa58180c in subtree_candidates () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #19 0x00007f53fa582e7f in ldbm_back_search () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #20 0x00007f5406eb01d6 in op_shared_search () from
>     /usr/lib64/dirsrv/libslapd.so.0
>     #21 0x00007f54073a133e in do_search ()
>     #22 0x00007f540738f567 in connection_threadmain ()
>     #23 0x00007f540509e7bb in _pt_root () from /lib64/libnspr4.so
>     #24 0x00007f5404a3fdc5 in start_thread () from /lib64/libpthread.so.0
>     #25 0x00007f540476d28d in clone () from /lib64/libc.so.6
>     Thread 24 (Thread 0x7f53d67f4700 (LWP 128222)):
>     #0  0x00007f5404a436d5 in pthread_cond_wait@@GLIBC_2.3.2 () from
>     /lib64/libpthread.so.0
>     #1  0x00007f53fef9f2f3 in __db_hybrid_mutex_suspend () from
>     /lib64/libdb-5.3.so <http://libdb-5.3.so>
>     #2  0x00007f53fef9e640 in __db_tas_mutex_lock () from
>     /lib64/libdb-5.3.so <http://libdb-5.3.so>
>     #3  0x00007f53ff048d3a in __lock_get_internal () from
>     /lib64/libdb-5.3.so <http://libdb-5.3.so>
>     #4  0x00007f53ff049820 in __lock_get () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #5  0x00007f53ff075142 in __db_lget () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #6  0x00007f53fefbc605 in __bam_search () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #7  0x00007f53fefa7256 in __bamc_search () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #8  0x00007f53fefa8d0f in __bamc_get () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #9  0x00007f53ff061ca6 in __dbc_iget () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #10 0x00007f53ff070b02 in __dbc_get_pp () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #11 0x00007f53fa54c680 in idl_new_fetch () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #12 0x00007f53fa55ab26 in index_read_ext_allids () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #13 0x00007f53fa545284 in keys2idl () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #14 0x00007f53fa5459e3 in ava_candidates.isra.0 () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #15 0x00007f53fa545fd2 in filter_candidates_ext () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #16 0x00007f53fa547096 in list_candidates () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #17 0x00007f53fa545f40 in filter_candidates_ext () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #18 0x00007f53fa58180c in subtree_candidates () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #19 0x00007f53fa582e7f in ldbm_back_search () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #20 0x00007f5406eb01d6 in op_shared_search () from
>     /usr/lib64/dirsrv/libslapd.so.0
>     #21 0x00007f54073a133e in do_search ()
>     #22 0x00007f540738f567 in connection_threadmain ()
>     #23 0x00007f540509e7bb in _pt_root () from /lib64/libnspr4.so
>     #24 0x00007f5404a3fdc5 in start_thread () from /lib64/libpthread.so.0
>     #25 0x00007f540476d28d in clone () from /lib64/libc.so.6
>     Thread 23 (Thread 0x7f53d5ff3700 (LWP 128223)):
>     #0  0x00007f5404a436d5 in pthread_cond_wait@@GLIBC_2.3.2 () from
>     /lib64/libpthread.so.0
>     #1  0x00007f53fef9f2f3 in __db_hybrid_mutex_suspend () from
>     /lib64/libdb-5.3.so <http://libdb-5.3.so>
>     #2  0x00007f53fef9e640 in __db_tas_mutex_lock () from
>     /lib64/libdb-5.3.so <http://libdb-5.3.so>
>     #3  0x00007f53ff0b8e1b in __memp_fget () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #4  0x00007f53fefbc211 in __bam_search () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #5  0x00007f53fefa7256 in __bamc_search () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #6  0x00007f53fefab6c4 in __bamc_put () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #7  0x00007f53ff0626d5 in __dbc_iput () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #8  0x00007f53ff05da0e in __db_put () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #9  0x00007f53ff072fa4 in __db_put_pp () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #10 0x00007f53fa54d4cf in idl_new_insert_key () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #11 0x00007f53fa55c5b5 in addordel_values_sv.isra.3 () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #12 0x00007f53fa55d25a in index_addordel_values_ext_sv () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #13 0x00007f53fa55d694 in index_addordel_values_sv () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #14 0x00007f53fa55d75a in index_addordel_entry () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #15 0x00007f53fa5605fa in ldbm_back_add () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #16 0x00007f5406e62cca in op_shared_add () from
>     /usr/lib64/dirsrv/libslapd.so.0
>     #17 0x00007f5406e64020 in do_add () from /usr/lib64/dirsrv/libslapd.so.0
>     #18 0x00007f540738f303 in connection_threadmain ()
>     #19 0x00007f540509e7bb in _pt_root () from /lib64/libnspr4.so
>     #20 0x00007f5404a3fdc5 in start_thread () from /lib64/libpthread.so.0
>     #21 0x00007f540476d28d in clone () from /lib64/libc.so.6
>     Thread 22 (Thread 0x7f53d57f2700 (LWP 128224)):
>     #0  0x00007f5404a436d5 in pthread_cond_wait@@GLIBC_2.3.2 () from
>     /lib64/libpthread.so.0
>     #1  0x00007f53fef9f2f3 in __db_hybrid_mutex_suspend () from
>     /lib64/libdb-5.3.so <http://libdb-5.3.so>
>     #2  0x00007f53fef9e640 in __db_tas_mutex_lock () from
>     /lib64/libdb-5.3.so <http://libdb-5.3.so>
>     #3  0x00007f53ff048d3a in __lock_get_internal () from
>     /lib64/libdb-5.3.so <http://libdb-5.3.so>
>     #4  0x00007f53ff049820 in __lock_get () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #5  0x00007f53ff075142 in __db_lget () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #6  0x00007f53fefbc605 in __bam_search () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #7  0x00007f53fefa7256 in __bamc_search () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #8  0x00007f53fefa8d0f in __bamc_get () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #9  0x00007f53ff061ca6 in __dbc_iget () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #10 0x00007f53ff070b02 in __dbc_get_pp () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #11 0x00007f53fa54c680 in idl_new_fetch () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #12 0x00007f53fa55ab26 in index_read_ext_allids () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #13 0x00007f53fa545284 in keys2idl () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #14 0x00007f53fa5459e3 in ava_candidates.isra.0 () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #15 0x00007f53fa545fd2 in filter_candidates_ext () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #16 0x00007f53fa547096 in list_candidates () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #17 0x00007f53fa545f40 in filter_candidates_ext () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #18 0x00007f53fa58180c in subtree_candidates () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #19 0x00007f53fa582e7f in ldbm_back_search () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #20 0x00007f5406eb01d6 in op_shared_search () from
>     /usr/lib64/dirsrv/libslapd.so.0
>     #21 0x00007f54073a133e in do_search ()
>     #22 0x00007f540738f567 in connection_threadmain ()
>     #23 0x00007f540509e7bb in _pt_root () from /lib64/libnspr4.so
>     #24 0x00007f5404a3fdc5 in start_thread () from /lib64/libpthread.so.0
>     #25 0x00007f540476d28d in clone () from /lib64/libc.so.6
>     Thread 21 (Thread 0x7f53d4ff1700 (LWP 128225)):
>     #0  0x00007f5404a436d5 in pthread_cond_wait@@GLIBC_2.3.2 () from
>     /lib64/libpthread.so.0
>     #1  0x00007f53fef9f2f3 in __db_hybrid_mutex_suspend () from
>     /lib64/libdb-5.3.so <http://libdb-5.3.so>
>     #2  0x00007f53fef9e640 in __db_tas_mutex_lock () from
>     /lib64/libdb-5.3.so <http://libdb-5.3.so>
>     #3  0x00007f53ff048d3a in __lock_get_internal () from
>     /lib64/libdb-5.3.so <http://libdb-5.3.so>
>     #4  0x00007f53ff049820 in __lock_get () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #5  0x00007f53ff075142 in __db_lget () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #6  0x00007f53fefbc605 in __bam_search () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #7  0x00007f53fefa7256 in __bamc_search () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #8  0x00007f53fefa8d0f in __bamc_get () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #9  0x00007f53ff061ca6 in __dbc_iget () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #10 0x00007f53ff070b02 in __dbc_get_pp () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #11 0x00007f53fa54c680 in idl_new_fetch () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #12 0x00007f53fa55ab26 in index_read_ext_allids () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #13 0x00007f53fa545284 in keys2idl () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #14 0x00007f53fa5459e3 in ava_candidates.isra.0 () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #15 0x00007f53fa545fd2 in filter_candidates_ext () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #16 0x00007f53fa547096 in list_candidates () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #17 0x00007f53fa545f40 in filter_candidates_ext () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #18 0x00007f53fa58180c in subtree_candidates () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #19 0x00007f53fa582e7f in ldbm_back_search () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #20 0x00007f5406eb01d6 in op_shared_search () from
>     /usr/lib64/dirsrv/libslapd.so.0
>     #21 0x00007f54073a133e in do_search ()
>     #22 0x00007f540738f567 in connection_threadmain ()
>     #23 0x00007f540509e7bb in _pt_root () from /lib64/libnspr4.so
>     #24 0x00007f5404a3fdc5 in start_thread () from /lib64/libpthread.so.0
>     #25 0x00007f540476d28d in clone () from /lib64/libc.so.6
>     Thread 20 (Thread 0x7f53d47f0700 (LWP 128226)):
>     #0  0x00007f5404a436d5 in pthread_cond_wait@@GLIBC_2.3.2 () from
>     /lib64/libpthread.so.0
>     #1  0x00007f53fef9f2f3 in __db_hybrid_mutex_suspend () from
>     /lib64/libdb-5.3.so <http://libdb-5.3.so>
>     #2  0x00007f53fef9e640 in __db_tas_mutex_lock () from
>     /lib64/libdb-5.3.so <http://libdb-5.3.so>
>     #3  0x00007f53ff048d3a in __lock_get_internal () from
>     /lib64/libdb-5.3.so <http://libdb-5.3.so>
>     #4  0x00007f53ff049820 in __lock_get () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #5  0x00007f53ff075142 in __db_lget () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #6  0x00007f53fefbc605 in __bam_search () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #7  0x00007f53fefa7256 in __bamc_search () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #8  0x00007f53fefa8d0f in __bamc_get () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #9  0x00007f53ff061ca6 in __dbc_iget () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #10 0x00007f53ff070b02 in __dbc_get_pp () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #11 0x00007f53fa54c680 in idl_new_fetch () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #12 0x00007f53fa55ab26 in index_read_ext_allids () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #13 0x00007f53fa545284 in keys2idl () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #14 0x00007f53fa5459e3 in ava_candidates.isra.0 () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #15 0x00007f53fa545fd2 in filter_candidates_ext () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #16 0x00007f53fa547096 in list_candidates () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #17 0x00007f53fa545f40 in filter_candidates_ext () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #18 0x00007f53fa58180c in subtree_candidates () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #19 0x00007f53fa582e7f in ldbm_back_search () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #20 0x00007f5406eb01d6 in op_shared_search () from
>     /usr/lib64/dirsrv/libslapd.so.0
>     #21 0x00007f5406ec094e in search_internal_callback_pb () from
>     /usr/lib64/dirsrv/libslapd.so.0
>     #22 0x00007f5406ec0be8 in search_internal_pb () from
>     /usr/lib64/dirsrv/libslapd.so.0
>     #23 0x00007f53fe118e90 in search_one_berval () from
>     /usr/lib64/dirsrv/plugins/libattr-unique-plugin.so
>     #24 0x00007f53fe119242 in search () from
>     /usr/lib64/dirsrv/plugins/libattr-unique-plugin.so
>     #25 0x00007f53fe11954c in searchAllSubtrees () from
>     /usr/lib64/dirsrv/plugins/libattr-unique-plugin.so
>     #26 0x00007f53fe11a015 in preop_add () from
>     /usr/lib64/dirsrv/plugins/libattr-unique-plugin.so
>     #27 0x00007f5406ebb848 in plugin_call_func () from
>     /usr/lib64/dirsrv/libslapd.so.0
>     #28 0x00007f5406ebbb13 in plugin_call_plugins () from
>     /usr/lib64/dirsrv/libslapd.so.0
>     #29 0x00007f5406e62c2b in op_shared_add () from
>     /usr/lib64/dirsrv/libslapd.so.0
>     #30 0x00007f5406e64020 in do_add () from /usr/lib64/dirsrv/libslapd.so.0
>     #31 0x00007f540738f303 in connection_threadmain ()
>     #32 0x00007f540509e7bb in _pt_root () from /lib64/libnspr4.so
>     #33 0x00007f5404a3fdc5 in start_thread () from /lib64/libpthread.so.0
>     #34 0x00007f540476d28d in clone () from /lib64/libc.so.6
>     Thread 19 (Thread 0x7f53d3fef700 (LWP 128227)):
>     #0  0x00007f5404a436d5 in pthread_cond_wait@@GLIBC_2.3.2 () from
>     /lib64/libpthread.so.0
>     #1  0x00007f53fef9f2f3 in __db_hybrid_mutex_suspend () from
>     /lib64/libdb-5.3.so <http://libdb-5.3.so>
>     #2  0x00007f53fef9e640 in __db_tas_mutex_lock () from
>     /lib64/libdb-5.3.so <http://libdb-5.3.so>
>     #3  0x00007f53ff048d3a in __lock_get_internal () from
>     /lib64/libdb-5.3.so <http://libdb-5.3.so>
>     #4  0x00007f53ff049820 in __lock_get () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #5  0x00007f53ff075142 in __db_lget () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #6  0x00007f53fefbc605 in __bam_search () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #7  0x00007f53fefa7256 in __bamc_search () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #8  0x00007f53fefa8d0f in __bamc_get () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #9  0x00007f53ff061ca6 in __dbc_iget () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #10 0x00007f53ff070b02 in __dbc_get_pp () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #11 0x00007f53fa54c680 in idl_new_fetch () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #12 0x00007f53fa55ab26 in index_read_ext_allids () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #13 0x00007f53fa545284 in keys2idl () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #14 0x00007f53fa5459e3 in ava_candidates.isra.0 () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #15 0x00007f53fa545fd2 in filter_candidates_ext () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #16 0x00007f53fa547096 in list_candidates () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #17 0x00007f53fa545f40 in filter_candidates_ext () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #18 0x00007f53fa58180c in subtree_candidates () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #19 0x00007f53fa582e7f in ldbm_back_search () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #20 0x00007f5406eb01d6 in op_shared_search () from
>     /usr/lib64/dirsrv/libslapd.so.0
>     #21 0x00007f54073a133e in do_search ()
>     #22 0x00007f540738f567 in connection_threadmain ()
>     #23 0x00007f540509e7bb in _pt_root () from /lib64/libnspr4.so
>     #24 0x00007f5404a3fdc5 in start_thread () from /lib64/libpthread.so.0
>     #25 0x00007f540476d28d in clone () from /lib64/libc.so.6
>     Thread 18 (Thread 0x7f53d37ee700 (LWP 128228)):
>     #0  0x00007f5404a436d5 in pthread_cond_wait@@GLIBC_2.3.2 () from
>     /lib64/libpthread.so.0
>     #1  0x00007f53fef9f2f3 in __db_hybrid_mutex_suspend () from
>     /lib64/libdb-5.3.so <http://libdb-5.3.so>
>     #2  0x00007f53fef9e640 in __db_tas_mutex_lock () from
>     /lib64/libdb-5.3.so <http://libdb-5.3.so>
>     #3  0x00007f53ff048d3a in __lock_get_internal () from
>     /lib64/libdb-5.3.so <http://libdb-5.3.so>
>     #4  0x00007f53ff049820 in __lock_get () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #5  0x00007f53ff075142 in __db_lget () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #6  0x00007f53fefbc605 in __bam_search () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #7  0x00007f53fefa7256 in __bamc_search () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #8  0x00007f53fefa8d0f in __bamc_get () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #9  0x00007f53ff061ca6 in __dbc_iget () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #10 0x00007f53ff070b02 in __dbc_get_pp () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #11 0x00007f53fa54c680 in idl_new_fetch () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #12 0x00007f53fa55ab26 in index_read_ext_allids () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #13 0x00007f53fa545284 in keys2idl () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #14 0x00007f53fa5459e3 in ava_candidates.isra.0 () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #15 0x00007f53fa545fd2 in filter_candidates_ext () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #16 0x00007f53fa547096 in list_candidates () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #17 0x00007f53fa545f40 in filter_candidates_ext () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #18 0x00007f53fa58180c in subtree_candidates () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #19 0x00007f53fa582e7f in ldbm_back_search () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #20 0x00007f5406eb01d6 in op_shared_search () from
>     /usr/lib64/dirsrv/libslapd.so.0
>     #21 0x00007f54073a133e in do_search ()
>     #22 0x00007f540738f567 in connection_threadmain ()
>     #23 0x00007f540509e7bb in _pt_root () from /lib64/libnspr4.so
>     #24 0x00007f5404a3fdc5 in start_thread () from /lib64/libpthread.so.0
>     #25 0x00007f540476d28d in clone () from /lib64/libc.so.6
>     Thread 17 (Thread 0x7f53d2fed700 (LWP 128229)):
>     #0  0x00007f5404a436d5 in pthread_cond_wait@@GLIBC_2.3.2 () from
>     /lib64/libpthread.so.0
>     #1  0x00007f53fef9f2f3 in __db_hybrid_mutex_suspend () from
>     /lib64/libdb-5.3.so <http://libdb-5.3.so>
>     #2  0x00007f53fef9e640 in __db_tas_mutex_lock () from
>     /lib64/libdb-5.3.so <http://libdb-5.3.so>
>     #3  0x00007f53ff048d3a in __lock_get_internal () from
>     /lib64/libdb-5.3.so <http://libdb-5.3.so>
>     #4  0x00007f53ff049820 in __lock_get () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #5  0x00007f53ff075142 in __db_lget () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #6  0x00007f53fefbc605 in __bam_search () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #7  0x00007f53fefa7256 in __bamc_search () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #8  0x00007f53fefa8d0f in __bamc_get () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #9  0x00007f53ff061ca6 in __dbc_iget () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #10 0x00007f53ff070b02 in __dbc_get_pp () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #11 0x00007f53fa54c680 in idl_new_fetch () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #12 0x00007f53fa55ab26 in index_read_ext_allids () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #13 0x00007f53fa545284 in keys2idl () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #14 0x00007f53fa5459e3 in ava_candidates.isra.0 () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #15 0x00007f53fa545fd2 in filter_candidates_ext () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #16 0x00007f53fa547096 in list_candidates () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #17 0x00007f53fa545f40 in filter_candidates_ext () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #18 0x00007f53fa58180c in subtree_candidates () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #19 0x00007f53fa582e7f in ldbm_back_search () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #20 0x00007f5406eb01d6 in op_shared_search () from
>     /usr/lib64/dirsrv/libslapd.so.0
>     #21 0x00007f54073a133e in do_search ()
>     #22 0x00007f540738f567 in connection_threadmain ()
>     #23 0x00007f540509e7bb in _pt_root () from /lib64/libnspr4.so
>     #24 0x00007f5404a3fdc5 in start_thread () from /lib64/libpthread.so.0
>     #25 0x00007f540476d28d in clone () from /lib64/libc.so.6
>     Thread 16 (Thread 0x7f53d27ec700 (LWP 128230)):
>     #0  0x00007f5404a436d5 in pthread_cond_wait@@GLIBC_2.3.2 () from
>     /lib64/libpthread.so.0
>     #1  0x00007f53fef9f2f3 in __db_hybrid_mutex_suspend () from
>     /lib64/libdb-5.3.so <http://libdb-5.3.so>
>     #2  0x00007f53fef9e640 in __db_tas_mutex_lock () from
>     /lib64/libdb-5.3.so <http://libdb-5.3.so>
>     #3  0x00007f53ff048d3a in __lock_get_internal () from
>     /lib64/libdb-5.3.so <http://libdb-5.3.so>
>     #4  0x00007f53ff049820 in __lock_get () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #5  0x00007f53ff075142 in __db_lget () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #6  0x00007f53fefbc605 in __bam_search () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #7  0x00007f53fefa7256 in __bamc_search () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #8  0x00007f53fefa8d0f in __bamc_get () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #9  0x00007f53ff061ca6 in __dbc_iget () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #10 0x00007f53ff070b02 in __dbc_get_pp () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #11 0x00007f53fa54c680 in idl_new_fetch () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #12 0x00007f53fa55ab26 in index_read_ext_allids () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #13 0x00007f53fa545284 in keys2idl () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #14 0x00007f53fa5459e3 in ava_candidates.isra.0 () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #15 0x00007f53fa545fd2 in filter_candidates_ext () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #16 0x00007f53fa547096 in list_candidates () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #17 0x00007f53fa545f40 in filter_candidates_ext () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #18 0x00007f53fa58180c in subtree_candidates () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #19 0x00007f53fa582e7f in ldbm_back_search () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #20 0x00007f5406eb01d6 in op_shared_search () from
>     /usr/lib64/dirsrv/libslapd.so.0
>     #21 0x00007f54073a133e in do_search ()
>     #22 0x00007f540738f567 in connection_threadmain ()
>     #23 0x00007f540509e7bb in _pt_root () from /lib64/libnspr4.so
>     #24 0x00007f5404a3fdc5 in start_thread () from /lib64/libpthread.so.0
>     #25 0x00007f540476d28d in clone () from /lib64/libc.so.6
>     Thread 15 (Thread 0x7f53d1feb700 (LWP 128231)):
>     #0  0x00007f5404a436d5 in pthread_cond_wait@@GLIBC_2.3.2 () from
>     /lib64/libpthread.so.0
>     #1  0x00007f53fef9f2f3 in __db_hybrid_mutex_suspend () from
>     /lib64/libdb-5.3.so <http://libdb-5.3.so>
>     #2  0x00007f53fef9e640 in __db_tas_mutex_lock () from
>     /lib64/libdb-5.3.so <http://libdb-5.3.so>
>     #3  0x00007f53ff048d3a in __lock_get_internal () from
>     /lib64/libdb-5.3.so <http://libdb-5.3.so>
>     #4  0x00007f53ff049820 in __lock_get () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #5  0x00007f53ff075142 in __db_lget () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #6  0x00007f53fefbc605 in __bam_search () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #7  0x00007f53fefa7256 in __bamc_search () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #8  0x00007f53fefa8d0f in __bamc_get () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #9  0x00007f53ff061ca6 in __dbc_iget () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #10 0x00007f53ff070b02 in __dbc_get_pp () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #11 0x00007f53fa54c680 in idl_new_fetch () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #12 0x00007f53fa55ab26 in index_read_ext_allids () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #13 0x00007f53fa545284 in keys2idl () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #14 0x00007f53fa5459e3 in ava_candidates.isra.0 () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #15 0x00007f53fa545fd2 in filter_candidates_ext () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #16 0x00007f53fa547096 in list_candidates () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #17 0x00007f53fa545f40 in filter_candidates_ext () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #18 0x00007f53fa58180c in subtree_candidates () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #19 0x00007f53fa582e7f in ldbm_back_search () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #20 0x00007f5406eb01d6 in op_shared_search () from
>     /usr/lib64/dirsrv/libslapd.so.0
>     #21 0x00007f54073a133e in do_search ()
>     #22 0x00007f540738f567 in connection_threadmain ()
>     #23 0x00007f540509e7bb in _pt_root () from /lib64/libnspr4.so
>     #24 0x00007f5404a3fdc5 in start_thread () from /lib64/libpthread.so.0
>     #25 0x00007f540476d28d in clone () from /lib64/libc.so.6
>     Thread 14 (Thread 0x7f53d17ea700 (LWP 128232)):
>     #0  0x00007f5404a436d5 in pthread_cond_wait@@GLIBC_2.3.2 () from
>     /lib64/libpthread.so.0
>     #1  0x00007f53fef9f2f3 in __db_hybrid_mutex_suspend () from
>     /lib64/libdb-5.3.so <http://libdb-5.3.so>
>     #2  0x00007f53fef9e640 in __db_tas_mutex_lock () from
>     /lib64/libdb-5.3.so <http://libdb-5.3.so>
>     #3  0x00007f53ff048d3a in __lock_get_internal () from
>     /lib64/libdb-5.3.so <http://libdb-5.3.so>
>     #4  0x00007f53ff049820 in __lock_get () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #5  0x00007f53ff075142 in __db_lget () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #6  0x00007f53fefbc605 in __bam_search () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #7  0x00007f53fefa7256 in __bamc_search () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #8  0x00007f53fefa8d0f in __bamc_get () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #9  0x00007f53ff061ca6 in __dbc_iget () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #10 0x00007f53ff070b02 in __dbc_get_pp () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #11 0x00007f53fa54c680 in idl_new_fetch () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #12 0x00007f53fa55ab26 in index_read_ext_allids () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #13 0x00007f53fa545284 in keys2idl () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #14 0x00007f53fa5459e3 in ava_candidates.isra.0 () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #15 0x00007f53fa545fd2 in filter_candidates_ext () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #16 0x00007f53fa547096 in list_candidates () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #17 0x00007f53fa545f40 in filter_candidates_ext () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #18 0x00007f53fa547096 in list_candidates () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #19 0x00007f53fa545f40 in filter_candidates_ext () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #20 0x00007f53fa547096 in list_candidates () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #21 0x00007f53fa545f40 in filter_candidates_ext () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #22 0x00007f53fa58180c in subtree_candidates () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #23 0x00007f53fa582e7f in ldbm_back_search () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #24 0x00007f5406eb01d6 in op_shared_search () from
>     /usr/lib64/dirsrv/libslapd.so.0
>     #25 0x00007f54073a133e in do_search ()
>     #26 0x00007f540738f3c3 in connection_threadmain ()
>     #27 0x00007f540509e7bb in _pt_root () from /lib64/libnspr4.so
>     #28 0x00007f5404a3fdc5 in start_thread () from /lib64/libpthread.so.0
>     #29 0x00007f540476d28d in clone () from /lib64/libc.so.6
>     Thread 13 (Thread 0x7f53d0fe9700 (LWP 128233)):
>     #0  0x00007f5404a436d5 in pthread_cond_wait@@GLIBC_2.3.2 () from
>     /lib64/libpthread.so.0
>     #1  0x00007f53fef9f2f3 in __db_hybrid_mutex_suspend () from
>     /lib64/libdb-5.3.so <http://libdb-5.3.so>
>     #2  0x00007f53fef9e640 in __db_tas_mutex_lock () from
>     /lib64/libdb-5.3.so <http://libdb-5.3.so>
>     #3  0x00007f53ff048d3a in __lock_get_internal () from
>     /lib64/libdb-5.3.so <http://libdb-5.3.so>
>     #4  0x00007f53ff049820 in __lock_get () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #5  0x00007f53ff075142 in __db_lget () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #6  0x00007f53fefbc605 in __bam_search () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #7  0x00007f53fefa7256 in __bamc_search () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #8  0x00007f53fefa8d0f in __bamc_get () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #9  0x00007f53ff061ca6 in __dbc_iget () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #10 0x00007f53ff070b02 in __dbc_get_pp () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #11 0x00007f53fa54c680 in idl_new_fetch () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #12 0x00007f53fa55ab26 in index_read_ext_allids () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #13 0x00007f53fa545284 in keys2idl () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #14 0x00007f53fa5459e3 in ava_candidates.isra.0 () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #15 0x00007f53fa545fd2 in filter_candidates_ext () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #16 0x00007f53fa547096 in list_candidates () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #17 0x00007f53fa545f40 in filter_candidates_ext () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #18 0x00007f53fa58180c in subtree_candidates () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #19 0x00007f53fa582e7f in ldbm_back_search () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #20 0x00007f5406eb01d6 in op_shared_search () from
>     /usr/lib64/dirsrv/libslapd.so.0
>     #21 0x00007f54073a133e in do_search ()
>     #22 0x00007f540738f567 in connection_threadmain ()
>     #23 0x00007f540509e7bb in _pt_root () from /lib64/libnspr4.so
>     #24 0x00007f5404a3fdc5 in start_thread () from /lib64/libpthread.so.0
>     #25 0x00007f540476d28d in clone () from /lib64/libc.so.6
>     Thread 12 (Thread 0x7f53d07e8700 (LWP 128234)):
>     #0  0x00007f5404a436d5 in pthread_cond_wait@@GLIBC_2.3.2 () from
>     /lib64/libpthread.so.0
>     #1  0x00007f53fef9f2f3 in __db_hybrid_mutex_suspend () from
>     /lib64/libdb-5.3.so <http://libdb-5.3.so>
>     #2  0x00007f53fef9e640 in __db_tas_mutex_lock () from
>     /lib64/libdb-5.3.so <http://libdb-5.3.so>
>     #3  0x00007f53ff048d3a in __lock_get_internal () from
>     /lib64/libdb-5.3.so <http://libdb-5.3.so>
>     #4  0x00007f53ff049820 in __lock_get () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #5  0x00007f53ff075142 in __db_lget () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #6  0x00007f53fefbc605 in __bam_search () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #7  0x00007f53fefa7256 in __bamc_search () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #8  0x00007f53fefa8d0f in __bamc_get () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #9  0x00007f53ff061ca6 in __dbc_iget () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #10 0x00007f53ff070b02 in __dbc_get_pp () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #11 0x00007f53fa54c680 in idl_new_fetch () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #12 0x00007f53fa55ab26 in index_read_ext_allids () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #13 0x00007f53fa545284 in keys2idl () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #14 0x00007f53fa5459e3 in ava_candidates.isra.0 () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #15 0x00007f53fa545fd2 in filter_candidates_ext () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #16 0x00007f53fa547096 in list_candidates () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #17 0x00007f53fa545f40 in filter_candidates_ext () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #18 0x00007f53fa58180c in subtree_candidates () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #19 0x00007f53fa582e7f in ldbm_back_search () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #20 0x00007f5406eb01d6 in op_shared_search () from
>     /usr/lib64/dirsrv/libslapd.so.0
>     #21 0x00007f54073a133e in do_search ()
>     #22 0x00007f540738f567 in connection_threadmain ()
>     #23 0x00007f540509e7bb in _pt_root () from /lib64/libnspr4.so
>     #24 0x00007f5404a3fdc5 in start_thread () from /lib64/libpthread.so.0
>     #25 0x00007f540476d28d in clone () from /lib64/libc.so.6
>     Thread 11 (Thread 0x7f53cffe7700 (LWP 128235)):
>     #0  0x00007f5404a436d5 in pthread_cond_wait@@GLIBC_2.3.2 () from
>     /lib64/libpthread.so.0
>     #1  0x00007f53fef9f2f3 in __db_hybrid_mutex_suspend () from
>     /lib64/libdb-5.3.so <http://libdb-5.3.so>
>     #2  0x00007f53fef9e640 in __db_tas_mutex_lock () from
>     /lib64/libdb-5.3.so <http://libdb-5.3.so>
>     #3  0x00007f53ff048d3a in __lock_get_internal () from
>     /lib64/libdb-5.3.so <http://libdb-5.3.so>
>     #4  0x00007f53ff049820 in __lock_get () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #5  0x00007f53ff075142 in __db_lget () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #6  0x00007f53fefbc605 in __bam_search () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #7  0x00007f53fefa7256 in __bamc_search () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #8  0x00007f53fefa8d0f in __bamc_get () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #9  0x00007f53ff061ca6 in __dbc_iget () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #10 0x00007f53ff070b02 in __dbc_get_pp () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #11 0x00007f53fa54c680 in idl_new_fetch () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #12 0x00007f53fa55ab26 in index_read_ext_allids () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #13 0x00007f53fa545284 in keys2idl () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #14 0x00007f53fa5459e3 in ava_candidates.isra.0 () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #15 0x00007f53fa545fd2 in filter_candidates_ext () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #16 0x00007f53fa547096 in list_candidates () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #17 0x00007f53fa545f40 in filter_candidates_ext () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #18 0x00007f53fa58180c in subtree_candidates () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #19 0x00007f53fa582e7f in ldbm_back_search () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #20 0x00007f5406eb01d6 in op_shared_search () from
>     /usr/lib64/dirsrv/libslapd.so.0
>     #21 0x00007f54073a133e in do_search ()
>     #22 0x00007f540738f567 in connection_threadmain ()
>     #23 0x00007f540509e7bb in _pt_root () from /lib64/libnspr4.so
>     #24 0x00007f5404a3fdc5 in start_thread () from /lib64/libpthread.so.0
>     #25 0x00007f540476d28d in clone () from /lib64/libc.so.6
>     Thread 10 (Thread 0x7f53cf7e6700 (LWP 128236)):
>     #0  0x00007f5404a436d5 in pthread_cond_wait@@GLIBC_2.3.2 () from
>     /lib64/libpthread.so.0
>     #1  0x00007f53fef9f2f3 in __db_hybrid_mutex_suspend () from
>     /lib64/libdb-5.3.so <http://libdb-5.3.so>
>     #2  0x00007f53fef9e640 in __db_tas_mutex_lock () from
>     /lib64/libdb-5.3.so <http://libdb-5.3.so>
>     #3  0x00007f53ff048d3a in __lock_get_internal () from
>     /lib64/libdb-5.3.so <http://libdb-5.3.so>
>     #4  0x00007f53ff049820 in __lock_get () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #5  0x00007f53ff075142 in __db_lget () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #6  0x00007f53fefbc605 in __bam_search () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #7  0x00007f53fefa7256 in __bamc_search () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #8  0x00007f53fefa8d0f in __bamc_get () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #9  0x00007f53ff061ca6 in __dbc_iget () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #10 0x00007f53ff070b02 in __dbc_get_pp () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #11 0x00007f53fa54c680 in idl_new_fetch () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #12 0x00007f53fa55ab26 in index_read_ext_allids () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #13 0x00007f53fa545284 in keys2idl () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #14 0x00007f53fa5459e3 in ava_candidates.isra.0 () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #15 0x00007f53fa545fd2 in filter_candidates_ext () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #16 0x00007f53fa547096 in list_candidates () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #17 0x00007f53fa545f40 in filter_candidates_ext () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #18 0x00007f53fa58180c in subtree_candidates () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #19 0x00007f53fa582e7f in ldbm_back_search () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #20 0x00007f5406eb01d6 in op_shared_search () from
>     /usr/lib64/dirsrv/libslapd.so.0
>     #21 0x00007f54073a133e in do_search ()
>     #22 0x00007f540738f567 in connection_threadmain ()
>     #23 0x00007f540509e7bb in _pt_root () from /lib64/libnspr4.so
>     #24 0x00007f5404a3fdc5 in start_thread () from /lib64/libpthread.so.0
>     #25 0x00007f540476d28d in clone () from /lib64/libc.so.6
>     Thread 9 (Thread 0x7f53cefe5700 (LWP 128237)):
>     #0  0x00007f5404a436d5 in pthread_cond_wait@@GLIBC_2.3.2 () from
>     /lib64/libpthread.so.0
>     #1  0x00007f53fef9f2f3 in __db_hybrid_mutex_suspend () from
>     /lib64/libdb-5.3.so <http://libdb-5.3.so>
>     #2  0x00007f53fef9e640 in __db_tas_mutex_lock () from
>     /lib64/libdb-5.3.so <http://libdb-5.3.so>
>     #3  0x00007f53ff048d3a in __lock_get_internal () from
>     /lib64/libdb-5.3.so <http://libdb-5.3.so>
>     #4  0x00007f53ff049820 in __lock_get () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #5  0x00007f53ff075142 in __db_lget () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #6  0x00007f53fefbc605 in __bam_search () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #7  0x00007f53fefa7256 in __bamc_search () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #8  0x00007f53fefa8d0f in __bamc_get () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #9  0x00007f53ff061ca6 in __dbc_iget () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #10 0x00007f53ff070b02 in __dbc_get_pp () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #11 0x00007f53fa54c680 in idl_new_fetch () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #12 0x00007f53fa55ab26 in index_read_ext_allids () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #13 0x00007f53fa545284 in keys2idl () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #14 0x00007f53fa5459e3 in ava_candidates.isra.0 () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #15 0x00007f53fa545fd2 in filter_candidates_ext () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #16 0x00007f53fa547096 in list_candidates () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #17 0x00007f53fa545f40 in filter_candidates_ext () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #18 0x00007f53fa58180c in subtree_candidates () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #19 0x00007f53fa582e7f in ldbm_back_search () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #20 0x00007f5406eb01d6 in op_shared_search () from
>     /usr/lib64/dirsrv/libslapd.so.0
>     #21 0x00007f54073a133e in do_search ()
>     #22 0x00007f540738f567 in connection_threadmain ()
>     #23 0x00007f540509e7bb in _pt_root () from /lib64/libnspr4.so
>     #24 0x00007f5404a3fdc5 in start_thread () from /lib64/libpthread.so.0
>     #25 0x00007f540476d28d in clone () from /lib64/libc.so.6
>     Thread 8 (Thread 0x7f53ce7e4700 (LWP 128238)):
>     #0  0x00007f5404a436d5 in pthread_cond_wait@@GLIBC_2.3.2 () from
>     /lib64/libpthread.so.0
>     #1  0x00007f53fef9f2f3 in __db_hybrid_mutex_suspend () from
>     /lib64/libdb-5.3.so <http://libdb-5.3.so>
>     #2  0x00007f53fef9e640 in __db_tas_mutex_lock () from
>     /lib64/libdb-5.3.so <http://libdb-5.3.so>
>     #3  0x00007f53ff048d3a in __lock_get_internal () from
>     /lib64/libdb-5.3.so <http://libdb-5.3.so>
>     #4  0x00007f53ff049820 in __lock_get () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #5  0x00007f53ff075142 in __db_lget () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #6  0x00007f53fefbc605 in __bam_search () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #7  0x00007f53fefa7256 in __bamc_search () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #8  0x00007f53fefa8d0f in __bamc_get () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #9  0x00007f53ff061ca6 in __dbc_iget () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #10 0x00007f53ff070b02 in __dbc_get_pp () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #11 0x00007f53fa54c680 in idl_new_fetch () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #12 0x00007f53fa55ab26 in index_read_ext_allids () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #13 0x00007f53fa545284 in keys2idl () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #14 0x00007f53fa5459e3 in ava_candidates.isra.0 () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #15 0x00007f53fa545fd2 in filter_candidates_ext () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #16 0x00007f53fa547096 in list_candidates () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #17 0x00007f53fa545f40 in filter_candidates_ext () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #18 0x00007f53fa58180c in subtree_candidates () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #19 0x00007f53fa582e7f in ldbm_back_search () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #20 0x00007f5406eb01d6 in op_shared_search () from
>     /usr/lib64/dirsrv/libslapd.so.0
>     #21 0x00007f54073a133e in do_search ()
>     #22 0x00007f540738f567 in connection_threadmain ()
>     #23 0x00007f540509e7bb in _pt_root () from /lib64/libnspr4.so
>     #24 0x00007f5404a3fdc5 in start_thread () from /lib64/libpthread.so.0
>     #25 0x00007f540476d28d in clone () from /lib64/libc.so.6
>     Thread 7 (Thread 0x7f53cdfe3700 (LWP 128239)):
>     #0  0x00007f5404a436d5 in pthread_cond_wait@@GLIBC_2.3.2 () from
>     /lib64/libpthread.so.0
>     #1  0x00007f53fef9f2f3 in __db_hybrid_mutex_suspend () from
>     /lib64/libdb-5.3.so <http://libdb-5.3.so>
>     #2  0x00007f53fef9e640 in __db_tas_mutex_lock () from
>     /lib64/libdb-5.3.so <http://libdb-5.3.so>
>     #3  0x00007f53ff048d3a in __lock_get_internal () from
>     /lib64/libdb-5.3.so <http://libdb-5.3.so>
>     #4  0x00007f53ff049820 in __lock_get () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #5  0x00007f53ff075142 in __db_lget () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #6  0x00007f53fefbc605 in __bam_search () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #7  0x00007f53fefa7256 in __bamc_search () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #8  0x00007f53fefa8d0f in __bamc_get () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #9  0x00007f53ff061ca6 in __dbc_iget () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #10 0x00007f53ff070b02 in __dbc_get_pp () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #11 0x00007f53fa54c680 in idl_new_fetch () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #12 0x00007f53fa55ab26 in index_read_ext_allids () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #13 0x00007f53fa545284 in keys2idl () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #14 0x00007f53fa5459e3 in ava_candidates.isra.0 () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #15 0x00007f53fa545fd2 in filter_candidates_ext () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #16 0x00007f53fa547096 in list_candidates () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #17 0x00007f53fa545f40 in filter_candidates_ext () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #18 0x00007f53fa58180c in subtree_candidates () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #19 0x00007f53fa582e7f in ldbm_back_search () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #20 0x00007f5406eb01d6 in op_shared_search () from
>     /usr/lib64/dirsrv/libslapd.so.0
>     #21 0x00007f54073a133e in do_search ()
>     #22 0x00007f540738f567 in connection_threadmain ()
>     #23 0x00007f540509e7bb in _pt_root () from /lib64/libnspr4.so
>     #24 0x00007f5404a3fdc5 in start_thread () from /lib64/libpthread.so.0
>     #25 0x00007f540476d28d in clone () from /lib64/libc.so.6
>     Thread 6 (Thread 0x7f53cd7e2700 (LWP 128240)):
>     #0  0x00007f5404a436d5 in pthread_cond_wait@@GLIBC_2.3.2 () from
>     /lib64/libpthread.so.0
>     #1  0x00007f53fef9f2f3 in __db_hybrid_mutex_suspend () from
>     /lib64/libdb-5.3.so <http://libdb-5.3.so>
>     #2  0x00007f53fef9eb37 in __db_tas_mutex_readlock () from
>     /lib64/libdb-5.3.so <http://libdb-5.3.so>
>     #3  0x00007f53ff0b8d35 in __memp_fget () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #4  0x00007f53ff062333 in __dbc_iget () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #5  0x00007f53ff070b02 in __dbc_get_pp () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #6  0x00007f53fa54c822 in idl_new_fetch () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #7  0x00007f53fa55ab26 in index_read_ext_allids () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #8  0x00007f53fa545284 in keys2idl () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #9  0x00007f53fa5459e3 in ava_candidates.isra.0 () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #10 0x00007f53fa545fd2 in filter_candidates_ext () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #11 0x00007f53fa547096 in list_candidates () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #12 0x00007f53fa545f40 in filter_candidates_ext () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #13 0x00007f53fa547096 in list_candidates () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #14 0x00007f53fa545f40 in filter_candidates_ext () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #15 0x00007f53fa547096 in list_candidates () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #16 0x00007f53fa545f40 in filter_candidates_ext () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #17 0x00007f53fa58180c in subtree_candidates () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #18 0x00007f53fa582e7f in ldbm_back_search () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #19 0x00007f5406eb01d6 in op_shared_search () from
>     /usr/lib64/dirsrv/libslapd.so.0
>     #20 0x00007f54073a133e in do_search ()
>     #21 0x00007f540738f3c3 in connection_threadmain ()
>     #22 0x00007f540509e7bb in _pt_root () from /lib64/libnspr4.so
>     #23 0x00007f5404a3fdc5 in start_thread () from /lib64/libpthread.so.0
>     #24 0x00007f540476d28d in clone () from /lib64/libc.so.6
>     Thread 5 (Thread 0x7f53ccfe1700 (LWP 128241)):
>     #0  0x00007f5404a436d5 in pthread_cond_wait@@GLIBC_2.3.2 () from
>     /lib64/libpthread.so.0
>     #1  0x00007f53fef9f2f3 in __db_hybrid_mutex_suspend () from
>     /lib64/libdb-5.3.so <http://libdb-5.3.so>
>     #2  0x00007f53fef9e640 in __db_tas_mutex_lock () from
>     /lib64/libdb-5.3.so <http://libdb-5.3.so>
>     #3  0x00007f53ff048d3a in __lock_get_internal () from
>     /lib64/libdb-5.3.so <http://libdb-5.3.so>
>     #4  0x00007f53ff049820 in __lock_get () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #5  0x00007f53ff075142 in __db_lget () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #6  0x00007f53fefbc605 in __bam_search () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #7  0x00007f53fefa7256 in __bamc_search () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #8  0x00007f53fefa8d0f in __bamc_get () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #9  0x00007f53ff061ca6 in __dbc_iget () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #10 0x00007f53ff070b02 in __dbc_get_pp () from /lib64/libdb-5.3.so
>     <http://libdb-5.3.so>
>     #11 0x00007f53fa54c680 in idl_new_fetch () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #12 0x00007f53fa55ab26 in index_read_ext_allids () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #13 0x00007f53fa545284 in keys2idl () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #14 0x00007f53fa5459e3 in ava_candidates.isra.0 () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #15 0x00007f53fa545fd2 in filter_candidates_ext () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #16 0x00007f53fa547096 in list_candidates () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #17 0x00007f53fa545f40 in filter_candidates_ext () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #18 0x00007f53fa547096 in list_candidates () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #19 0x00007f53fa545f40 in filter_candidates_ext () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #20 0x00007f53fa547096 in list_candidates () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #21 0x00007f53fa545f40 in filter_candidates_ext () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #22 0x00007f53fa58180c in subtree_candidates () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #23 0x00007f53fa582e7f in ldbm_back_search () from
>     /usr/lib64/dirsrv/plugins/libback-ldbm.so
>     #24 0x00007f5406eb01d6 in op_shared_search () from
>     /usr/lib64/dirsrv/libslapd.so.0
>     #25 0x00007f54073a133e in do_search ()
>     #26 0x00007f540738f3c3 in connection_threadmain ()
>     #27 0x00007f540509e7bb in _pt_root () from /lib64/libnspr4.so
>     #28 0x00007f5404a3fdc5 in start_thread () from /lib64/libpthread.so.0
>     #29 0x00007f540476d28d in clone () from /lib64/libc.so.6
>     Thread 4 (Thread 0x7f53cc7e0700 (LWP 128242)):
>     #0  0x00007f54047649b3 in select () from /lib64/libc.so.6
>     #1  0x00007f5406eef0e9 in DS_Sleep () from
>     /usr/lib64/dirsrv/libslapd.so.0
>     #2  0x00007f5407390325 in time_thread ()
>     #3  0x00007f540509e7bb in _pt_root () from /lib64/libnspr4.so
>     #4  0x00007f5404a3fdc5 in start_thread () from /lib64/libpthread.so.0
>     #5  0x00007f540476d28d in clone () from /lib64/libc.so.6
>     Thread 3 (Thread 0x7f53cb7a0700 (LWP 128259)):
>     #0  0x00007f5404a436d5 in pthread_cond_wait@@GLIBC_2.3.2 () from
>     /lib64/libpthread.so.0
>     #1  0x00007f5405099050 in PR_WaitCondVar () from /lib64/libnspr4.so
>     #2  0x00007f540739bf25 in ps_send_results ()
>     #3  0x00007f540509e7bb in _pt_root () from /lib64/libnspr4.so
>     #4  0x00007f5404a3fdc5 in start_thread () from /lib64/libpthread.so.0
>     #5  0x00007f540476d28d in clone () from /lib64/libc.so.6
>     Thread 2 (Thread 0x7f53cab9d700 (LWP 9020)):
>     #0  0x00007f5404a436d5 in pthread_cond_wait@@GLIBC_2.3.2 () from
>     /lib64/libpthread.so.0
>     #1  0x00007f5405099050 in PR_WaitCondVar () from /lib64/libnspr4.so
>     #2  0x00007f540739bf25 in ps_send_results ()
>     #3  0x00007f540509e7bb in _pt_root () from /lib64/libnspr4.so
>     #4  0x00007f5404a3fdc5 in start_thread () from /lib64/libpthread.so.0
>     #5  0x00007f540476d28d in clone () from /lib64/libc.so.6
>     Thread 1 (Thread 0x7f5407357840 (LWP 128124)):
>     #0  0x00007f5404762c3d in poll () from /lib64/libc.so.6
>     #1  0x00007f540509a967 in _pr_poll_with_poll () from /lib64/libnspr4.so
>     #2  0x00007f5407393ff1 in slapd_daemon ()
>     #3  0x00007f5407385c6c in main ()
>
>
>     Thanks
>
>     On Tue, Sep 6, 2016 at 5:51 PM, Rakesh Rajasekharan
>     <rakesh.rajasekharan at gmail.com
>     <mailto:rakesh.rajasekharan at gmail.com>> wrote:
>
>         Hi,
>
>         With script provided by Rich, I looked at my db cache usage and
>         it does not look to be high enough
>
>         # under each db are the list of selected indexes specified with
>         INDEXLIST
>                 dbname      count          free  free%    size
>         changelog:ent          5       2076333   99.0  4163.8
>         changelog:dn       15976       9303557   88.7    74.0
>           userroot:ent       4763     175321074   83.6  7221.1
>           userroot:dn        4763       9995056   95.3   103.0
>              ipaca:ent        425       6337866   60.4  9759.8
>              ipaca:dn         425      10451081   99.7    81.6
>
>         Right now I set it to 200MB. So, I am planning to bring it down
>         to 100MB
>
>         Also, /|nsslapd-db-checkpoint-interval |/will change it to 80 or
>         90 from default of 60
>
>         I will check this out and the impact it has on the hang issues
>         and get back
>
>         Thanks
>         Rakesh
>
>         On Tue, Sep 6, 2016 at 4:13 PM, Ludwig Krispenz
>         <lkrispen at redhat.com <mailto:lkrispen at redhat.com>> wrote:
>
>             Hi,
>
>             I think you are running into this bug:
>             https://bugzilla.redhat.com/show_bug.cgi?id=1349779
>             <https://bugzilla.redhat.com/show_bug.cgi?id=1349779>
>             it was the outcome of an analysis started in this one:
>             https://bugzilla.redhat.com/show_bug.cgi?id=1347800
>             <https://bugzilla.redhat.com/show_bug.cgi?id=1347800>
>
>             the problem is that it looks like the checkpoint thread is
>             holding a mutex and otehr threads are blocked on it. It
>             looks like an issue in BerkeleyDB although there is no
>             explanation from the BDB code why this could happen, we also
>             had a support case with Oracle to investigate this, with no
>             solution. Oracle at the end was providing a diagnostic
>             patch, which we did not test since the customer with the
>             original problem had worked around this by changing their
>             configuration.
>             I don't know the status of this patch and if we can make it
>             available, probably depends on your support status, you need
>             to contact support for this.
>
>             About the workarounds:
>             you can try to change timing for the database update and
>             checkpointing eg by reducing the dbcache size, changing the
>             checkpoint interval. In the customer case they identified
>             one substring index, which was frequently updated but not
>             really required - and removing this index helped.
>
>             Regards,
>             Ludwig
>
>             On 09/06/2016 11:31 AM, thierry bordaz wrote:
>>             Hi,
>>
>>             The following thread is hanging most of the others threads
>>
>>                 Thread 20 (Thread 0x7f68007f8700 (LWP 4873)):
>>                 #0  0x00007f683d0506d5 in
>>                 pthread_cond_wait@@GLIBC_2.3.2
>>                 <mailto:pthread_cond_wait@@GLIBC_2.3.2> () from
>>                 /lib64/libpthread.so.0
>>                 #1  0x00007f68375ac2f3 in __db_hybrid_mutex_suspend ()
>>                 from /lib64/libdb-5.3.so <http://libdb-5.3.so>
>>                 #2  0x00007f68375ab640 in __db_tas_mutex_lock () from
>>                 /lib64/libdb-5.3.so <http://libdb-5.3.so>
>>                 #3  0x00007f68376c5e1b in __memp_fget () from
>>                 /lib64/libdb-5.3.so <http://libdb-5.3.so>
>>                 #4  0x00007f68375c9211 in __bam_search () from
>>                 /lib64/libdb-5.3.so <http://libdb-5.3.so>
>>                 #5  0x00007f68375b4256 in __bamc_search () from
>>                 /lib64/libdb-5.3.so <http://libdb-5.3.so>
>>                 #6  0x00007f68375b86c4 in __bamc_put () from
>>                 /lib64/libdb-5.3.so <http://libdb-5.3.so>
>>                 #7  0x00007f683766f6d5 in __dbc_iput () from
>>                 /lib64/libdb-5.3.so <http://libdb-5.3.so>
>>                 #8  0x00007f683766aa0e in __db_put () from
>>                 /lib64/libdb-5.3.so <http://libdb-5.3.so>
>>                 #9  0x00007f683767ffa4 in __db_put_pp () from
>>                 /lib64/libdb-5.3.so <http://libdb-5.3.so>
>>                 #10 0x00007f6832b5a4cf in idl_new_insert_key () from
>>                 /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>                 #11 0x00007f6832b695b5 in addordel_values_sv.isra.3 ()
>>                 from /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>                 #12 0x00007f6832b6a25a in index_addordel_values_ext_sv
>>                 () from /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>                 #13 0x00007f6832b6a694 in index_addordel_values_sv ()
>>                 from /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>                 #14 0x00007f6832b6a75a in index_addordel_entry () from
>>                 /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>                 #15 0x00007f6832b6d5fa in ldbm_back_add () from
>>                 /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>                 #16 0x00007f683f46fcca in op_shared_add () from
>>                 /usr/lib64/dirsrv/libslapd.so.0
>>                 #17 0x00007f683f471020 in do_add () from
>>                 /usr/lib64/dirsrv/libslapd.so.0
>>                 #18 0x00007f683f99c303 in connection_threadmain ()
>>                 #19 0x00007f683d6ab7bb in _pt_root () from
>>                 /lib64/libnspr4.so
>>                 #20 0x00007f683d04cdc5 in start_thread () from
>>                 /lib64/libpthread.so.0
>>                 #21 0x00007f683cd7a28d in clone () from /lib64/libc.so.6
>>
>>             This thread is likely not hang on 'db_tas_mutex_lock' as
>>             the db_lock does not show it waiting for something.
>>             Unfortunately it is not shown in the output of top -H, did
>>             you get the complete output ?
>>             Ludwig mentioned a known issue that DS is not scaling well
>>             on NUMA arch, do you know if the machine is NUMA ?
>>             A possibility is that this thread get severely slowed down
>>             by a NUMA remote lock and showing DS has hung.
>>             This is why it would be interesting to know if it consums CPU.
>>
>>             thanks
>>             theirry
>>
>>             On 09/06/2016 10:59 AM, Rakesh Rajasekharan wrote:
>>>             Hi Thierry/Ludwig,
>>>
>>>             I again hit the hang issue. This is the pstack of the
>>>             ns-slapd
>>>
>>>             So was able to this time get the pstack and db locks
>>>
>>>             db locks details
>>>             Default locking region information:
>>>             451        Last allocated locker ID
>>>             0x7fffffff         Current maximum unused locker ID
>>>             9          Number of lock modes
>>>             800        Initial number of locks allocated
>>>             0          Initial number of lockers allocated
>>>             800        Initial number of lock objects allocated
>>>             10000      Maximum number of locks possible
>>>             10000      Maximum number of lockers possible
>>>             10000      Maximum number of lock objects possible
>>>             800        Current number of locks allocated
>>>             366        Current number of lockers allocated
>>>             800        Current number of lock objects allocated
>>>             160        Number of lock object partitions
>>>             8191       Size of object hash table
>>>             126        Number of current locks
>>>             1005       Maximum number of locks at any one time
>>>             33         Maximum number of locks in any one bucket
>>>             3987       Maximum number of locks stolen by for an empty
>>>             partition
>>>             75         Maximum number of locks stolen for any one
>>>             partition
>>>             309        Number of current lockers
>>>             313        Maximum number of lockers at any one time
>>>             121        Number of current lock objects
>>>             676        Maximum number of lock objects at any one time
>>>             3          Maximum number of lock objects in any one bucket
>>>             69         Maximum number of objects stolen by for an
>>>             empty partition
>>>             5          Maximum number of objects stolen for any one
>>>             partition
>>>             22M        Total number of locks requested (22009642)
>>>             21M        Total number of locks released (21992878)
>>>             0          Total number of locks upgraded
>>>             95         Total number of locks downgraded
>>>             3348       Lock requests not available due to conflicts,
>>>             for which we waited
>>>             12646      Lock requests not available due to conflicts,
>>>             for which we did not wait
>>>             0          Number of deadlocks
>>>             0          Lock timeout value
>>>             0          Number of locks that have timed out
>>>             0          Transaction timeout value
>>>             0          Number of transactions that have timed out
>>>             2MB 560KB          Region size
>>>             71719      The number of partition locks that required
>>>             waiting (0%)
>>>             23105      The maximum number of times any partition lock
>>>             was waited for (0%)
>>>             0          The number of object queue operations that
>>>             required waiting (0%)
>>>             163        The number of locker allocations that required
>>>             waiting (0%)
>>>             3172       The number of region locks that required
>>>             waiting (0%)
>>>             5          Maximum hash bucket length
>>>             =-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=
>>>             Lock REGINFO information:
>>>             Environment        Region type
>>>             1          Region ID
>>>             /var/lib/dirsrv/slapd-SPRINKLR-COM/db/__db.001 Region name
>>>             0x7f67ef869000     Region address
>>>             0x7f67ef8690a0     Region allocation head
>>>             0x7f67ef8712b0     Region primary address
>>>             0          Region maximum allocation
>>>             0          Region allocated
>>>             Region allocations: 1581345 allocations, 0 failures,
>>>             1580794 frees, 6 longest
>>>             Allocations by power-of-two sizes:
>>>               1KB      1581329
>>>               2KB      3
>>>               4KB      4
>>>               8KB      3
>>>              16KB      3
>>>              32KB      1
>>>              64KB      0
>>>             128KB      0
>>>             256KB      2
>>>             512KB      0
>>>             1024KB     1
>>>             REGION_SHARED      Region flags
>>>             =-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=
>>>             Lock region parameters:
>>>             2          Lock region region mutex [3172/14M 0% !Own]
>>>             <wakeups 0/1143>
>>>             16381      locker table size
>>>             8191       object table size
>>>             34128      obj_off
>>>             900216     locker_off
>>>             0          need_dd
>>>             =-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=
>>>             Lock conflict matrix:
>>>             =-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=
>>>             Locks grouped by lockers:
>>>             Locker   Mode      Count Status  ----------------- Object
>>>             ---------------
>>>                    2 dd=308 locks held 1    write locks 0 pid/thread
>>>             4845/140085720139840 flags 10   priority 100
>>>                    2 READ          1 HELD userRoot/id2entry.db
>>>             handle        0
>>>                    3 dd=307 locks held 0    write locks 0 pid/thread
>>>             4845/140084829472512 flags 0    priority 100
>>>                    4 dd=306 locks held 1    write locks 0 pid/thread
>>>             4845/140085720139840 flags 10   priority 100
>>>                    4 READ          1 HELD ipaca/id2entry.db
>>>             handle        0
>>>                    5 dd=305 locks held 0    write locks 0 pid/thread
>>>             4845/140084837865216 flags 0    priority 100
>>>                    6 dd=304 locks held 1    write locks 0 pid/thread
>>>             4845/140085720139840 flags 10   priority 100
>>>                    6 READ          1 HELD ipaca/entryrdn.db
>>>             handle        0
>>>                    7 dd=303 locks held 0    write locks 0 pid/thread
>>>             4845/140084804294400 flags 0    priority 100
>>>                    8 dd=302 locks held 0    write locks 0 pid/thread
>>>             4845/140084720432896 flags 0    priority 100
>>>                    9 dd=301 locks held 0    write locks 0 pid/thread
>>>             4845/140084837865216 flags 0    priority 100
>>>                    a dd=300 locks held 1    write locks 0 pid/thread
>>>             4845/140085720139840 flags 10   priority 100
>>>                    a READ          1 HELD
>>>             ipaca/vlv#allcertspkitomcatindex.db handle        0
>>>                    e dd=299 locks held 1    write locks 0 pid/thread
>>>             4845/140085720139840 flags 10   priority 100
>>>                    e READ          1 HELD
>>>             ipaca/vlv#allnonrevokedcertspkitomcatindex.db handle        0
>>>                   10 dd=298 locks held 1    write locks 0 pid/thread
>>>             4845/140085720139840 flags 10   priority 100
>>>                   10 READ          1 HELD
>>>             ipaca/vlv#allrevokedcertspkitomcatindex.db handle        0
>>>                   11 dd=297 locks held 1    write locks 0 pid/thread
>>>             4845/140085720139840 flags 10   priority 100
>>>                   11 READ          1 HELD
>>>             ipaca/vlv#allrevokedcertsnotafterpkitomcatindex.db
>>>             handle        0
>>>                   14 dd=296 locks held 1    write locks 0 pid/thread
>>>             4845/140085720139840 flags 10   priority 100
>>>                   14 READ          1 HELD
>>>             ipaca/vlv#allrevokedorrevokedexpiredcertspkitomcatindex.db handle
>>>             0
>>>                   15 dd=295 locks held 1    write locks 0 pid/thread
>>>             4845/140085720139840 flags 10   priority 100
>>>                   15 READ          1 HELD
>>>             ipaca/vlv#allvalidcertspkitomcatindex.db handle 0
>>>                   16 dd=294 locks held 1    write locks 0 pid/thread
>>>             4845/140085720139840 flags 10   priority 100
>>>                   16 READ          1 HELD
>>>             ipaca/vlv#allvalidcertsnotafterpkitomcatindex.db
>>>             handle        0
>>>                   17 dd=293 locks held 1    write locks 0 pid/thread
>>>             4845/140085720139840 flags 10   priority 100
>>>                   17 READ          1 HELD
>>>             ipaca/vlv#allvalidorrevokedcertspkitomcatindex.db
>>>             handle        0
>>>                   18 dd=292 locks held 1    write locks 0 pid/thread
>>>             4845/140085720139840 flags 10   priority 100
>>>                   18 READ          1 HELD
>>>             ipaca/vlv#caallpkitomcatindex.db handle        0
>>>                   1d dd=291 locks held 1    write locks 0 pid/thread
>>>             4845/140085720139840 flags 10   priority 100
>>>                   1d READ          1 HELD
>>>             ipaca/vlv#cacompletepkitomcatindex.db handle        0
>>>                   1e dd=290 locks held 1    write locks 0
>
>     ...
>
>
>
>




More information about the Freeipa-users mailing list